[bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

A regression to v2.6.26:

I started getting this skb-head corruption message today, on a T60 
laptop with e1000:

PM: Removing info for No Bus:vcs11
device: 'vcs11': device_create_release
=============================================================================
BUG skbuff_head_cache: Poison overwritten
-----------------------------------------------------------------------------

INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b
INFO: Allocated in __alloc_skb+0x2c/0x110 age=0 cpu=0 pid=5098
INFO: Freed in __kfree_skb+0x31/0x80 age=0 cpu=1 pid=4440
INFO: Slab 0xc16cc140 objects=16 used=1 fp=0xf658ae00 flags=0x400000c3
INFO: Object 0xf658ae00 @offset=3584 fp=0xf658af00

Bytes b4 0xf658adf0:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
  Object 0xf658ae00:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf658ae10:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf658ae20:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf658ae30:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf658ae40:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf658ae50:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf658ae60:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf658ae70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
 Redzone 0xf658aea0:  bb bb bb bb                                     ����            
 Padding 0xf658aec8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
 Padding 0xf658aed8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
 Padding 0xf658aee8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
 Padding 0xf658aef8:  5a 5a 5a 5a 5a 5a 5a 5a                         ZZZZZZZZ        
Pid: 5098, comm: gdm-binary Not tainted 2.6.26-tip #3094
 [<c0186f99>] print_trailer+0xa9/0xf0
 [<c018707b>] check_bytes_and_report+0x9b/0xc0
 [<c01874ae>] check_object+0x19e/0x1e0
 [<c0187ef1>] __slab_alloc+0x371/0x4e0
 [<c0188552>] kmem_cache_alloc+0xb2/0xc0
 [<c06732dc>] ? __alloc_skb+0x2c/0x110
 [<c06732dc>] ? __alloc_skb+0x2c/0x110
 [<c06732dc>] __alloc_skb+0x2c/0x110
 [<c0685b6c>] find_skb+0x3c/0x80
 [<c068624b>] netpoll_send_udp+0x2b/0x1f0
 [<c0322e62>] ? notify_update+0x22/0x30
 [<c046d405>] write_msg+0x95/0xe0
 [<c046d370>] ? write_msg+0x0/0xe0
 [<c012df70>] __call_console_drivers+0x60/0x70
 [<c012dff9>] _call_console_drivers+0x79/0x90
 [<c012e3f4>] release_console_sem+0xc4/0x1f0
 [<c012e89e>] vprintk+0x15e/0x3b0
 [<c01ce683>] ? release_sysfs_dirent+0x43/0xa0
 [<c01ce683>] ? release_sysfs_dirent+0x43/0xa0
 [<c01ce683>] ? release_sysfs_dirent+0x43/0xa0
 [<c012eb0b>] printk+0x1b/0x20
 [<c0367597>] device_create_release+0x27/0x40
 [<c0367955>] device_release+0x15/0x70
 [<c02b1d29>] kobject_release+0x39/0x80
 [<c02b1cf0>] ? kobject_release+0x0/0x80
 [<c02b2a0d>] kref_put+0x2d/0x70
 [<c02b1c30>] kobject_put+0x20/0x50
 [<c02b1ce2>] ? kobject_del+0x22/0x30
 [<c03680f3>] ? device_del+0x123/0x140
 [<c0367b7f>] put_device+0xf/0x20
 [<c0368145>] device_unregister+0x35/0x40
 [<c0368179>] device_destroy+0x29/0x30
 [<c031e66c>] vcs_remove_sysfs+0x1c/0x40
 [<c032480e>] con_close+0x5e/0x70
 [<c0317289>] release_dev+0x139/0x600
 [<c0188222>] ? __slab_free+0x1c2/0x240
 [<c019fd59>] ? destroy_inode+0x39/0x40
 [<c019d4d3>] ? __d_free+0x23/0x30
 [<c019d4d3>] ? __d_free+0x23/0x30
 [<c019d4d3>] ? __d_free+0x23/0x30
 [<c0317762>] tty_release+0x12/0x20
 [<c018dba2>] __fput+0xb2/0x1d0
 [<c018dfe9>] fput+0x19/0x20
 [<c018ad59>] filp_close+0x49/0x70
 [<c018c3a6>] sys_close+0x66/0xb0
 [<c0103d01>] sysenter_past_esp+0x6a/0x99
 =======================
FIX skbuff_head_cache: Restoring 0xf658ae9c-0xf658ae9c=0x6b

FIX skbuff_head_cache: Marking all objects used
device: 'vcsa11': device_unregister
PM: Removing info for No Bus:vcsa11
device: 'vcsa11': device_create_release

With this config:

   http://redhat.com/~mingo/misc/config-Thu_Jul_17_20_24_45_CEST_2008.bad
	
The box uses netconsole.

Suspected range of breakage is v2.6.26..a3cf859, or around 3000 commits. 
But a fair portion of those commit were tested on this box before.

Perhaps SLUB debugging got smarter?

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[David Miller]

From: Ingo Molnar <mingo@elte.hu>
Date: Thu, 17 Jul 2008 23:42:22 +0200

> 
> A regression to v2.6.26:
> 
> I started getting this skb-head corruption message today, on a T60 
> laptop with e1000:

This is very unlikely to be added by us networking folks, no
networking merges have happened for the 2.6.27 merge window yet :-)

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* David Miller <davem@davemloft.net> wrote:

> From: Ingo Molnar <mingo@elte.hu>
> Date: Thu, 17 Jul 2008 23:42:22 +0200
> 
> > 
> > A regression to v2.6.26:
> > 
> > I started getting this skb-head corruption message today, on a T60 
> > laptop with e1000:
> 
> This is very unlikely to be added by us networking folks, no 
> networking merges have happened for the 2.6.27 merge window yet :-)

yeah. That's why i observed:

> > Perhaps SLUB debugging got smarter?

and Cc:-ed SLUB folks. Could be a sleeper cell of bugs gone active ;-) 

Or could be SLUB (-debugging) breakage. Netconsole is pretty reliable on 
this box. (and the bootup continued just fine after this report)

Just re-tried it, the bug is reliably repeatable. Will try a bisection 
run.

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[David Miller]

From: Ingo Molnar <mingo@elte.hu>
Date: Fri, 18 Jul 2008 00:06:00 +0200

> > > Perhaps SLUB debugging got smarter?
> 
> and Cc:-ed SLUB folks. Could be a sleeper cell of bugs gone active ;-) 

This bug would be a quite positive result then :)

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Ingo Molnar <mingo@elte.hu> wrote:

> Just re-tried it, the bug is reliably repeatable. Will try a bisection 
> run.

hm, but it was not reproducible on the third and fourth attempt :-( I 
tried hard to provoke it by generating artificial parallel network and 
netconsole output - but it didnt want to trigger. Heisenbug ...

Maybe the debug output gives someone an idea about the nature of the 
bug?

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Thu, Jul 17, 2008 at 11:42 PM, Ingo Molnar <mingo@elte.hu> wrote:
>
> A regression to v2.6.26:
>
> I started getting this skb-head corruption message today, on a T60
> laptop with e1000:
>
> PM: Removing info for No Bus:vcs11
> device: 'vcs11': device_create_release
> =============================================================================
> BUG skbuff_head_cache: Poison overwritten
> -----------------------------------------------------------------------------
>
> INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b

1. Notice the range. It's just a single byte.
2. Notice the value. It's just a ++.

Probably a stray increment of a uint8_t somewhere on a freed object?

The offset from the beginning of the object is 0xf658ae9c - 0xf658ae00 = 0x9c.

How big is a struct sk_buff? Hm.. it is in fact quite big. Now what
member has offset 0x9c? Seems to depend on your config. Is there any
way you can figure it out, Ingo? I'll try it with your config too.


Vegard

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Thu, Jul 17, 2008 at 11:42 PM, Ingo Molnar <mingo@elte.hu> wrote:
> With this config:
>
>   http://redhat.com/~mingo/misc/config-Thu_Jul_17_20_24_45_CEST_2008.bad
>

It doesn't actually work. The config says

    # head: 088fcf34

and I checked out this from the tip tree. But kernel-config still
complains about unknown config options... What went wrong?


Vegard

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Fri, Jul 18, 2008 at 1:15 AM, Vegard Nossum <vegard.nossum@gmail.com> wrote:
> On Thu, Jul 17, 2008 at 11:42 PM, Ingo Molnar <mingo@elte.hu> wrote:
>>
>> A regression to v2.6.26:
>>
>> I started getting this skb-head corruption message today, on a T60
>> laptop with e1000:
>>
>> PM: Removing info for No Bus:vcs11
>> device: 'vcs11': device_create_release
>> =============================================================================
>> BUG skbuff_head_cache: Poison overwritten
>> -----------------------------------------------------------------------------
>>
>> INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b
>
> 1. Notice the range. It's just a single byte.
> 2. Notice the value. It's just a ++.
>
> Probably a stray increment of a uint8_t somewhere on a freed object?
>
> The offset from the beginning of the object is 0xf658ae9c - 0xf658ae00 = 0x9c.
>
> How big is a struct sk_buff? Hm.. it is in fact quite big. Now what
> member has offset 0x9c? Seems to depend on your config. Is there any
> way you can figure it out, Ingo? I'll try it with your config too.

With your config:

(gdb) p ((struct sk_buff *) 0)->truesize
Cannot access memory at address 0x9c

Now just audit users of ->truesize... There are quite a few.

Which one would only += 1?


Vegard

PS: I might be on the completely wrong track. So far I only have bad
experiences with this sk_buff...

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Vegard Nossum <vegard.nossum@gmail.com> wrote:

> On Thu, Jul 17, 2008 at 11:42 PM, Ingo Molnar <mingo@elte.hu> wrote:
> >
> > A regression to v2.6.26:
> >
> > I started getting this skb-head corruption message today, on a T60
> > laptop with e1000:
> >
> > PM: Removing info for No Bus:vcs11
> > device: 'vcs11': device_create_release
> > =============================================================================
> > BUG skbuff_head_cache: Poison overwritten
> > -----------------------------------------------------------------------------
> >
> > INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b
> 
> 1. Notice the range. It's just a single byte.
> 2. Notice the value. It's just a ++.
> 
> Probably a stray increment of a uint8_t somewhere on a freed object?
> 
> The offset from the beginning of the object is 0xf658ae9c - 0xf658ae00 
> = 0x9c.
> 
> How big is a struct sk_buff? Hm.. it is in fact quite big. Now what 
> member has offset 0x9c? Seems to depend on your config. Is there any 
> way you can figure it out, Ingo? I'll try it with your config too.

hmm ... your analysis gave me a wonderful albeit admittedly remote idea:

 If only we had some kernel technology that could track and validate 
 memory accesses, and point out the cases where we access uninitialized 
 memory, just like Valgrind?

... something like kmemcheck? ;-)

So i booted that box with tip/master and kmemcheck enabled. (plus a few 
fixlets to make networking allocations be properly tracked by 
kmemcheck.)

It was a slow bootup and long wait, but it gave a few hits here:

kmemcheck: Caught 8-bit read from uninitialized memory (f653ad24)
iiiiiiiiiiiiiiiiuuuuuuuuuuuuuuuuuuuuuiuuuuuuuuuuuuuuuuuuuuuuuuuu
                                    ^

Pid: 2484, comm: arping Not tainted (2.6.26-tip #20187)
EIP: 0060:[<c05e973c>] EFLAGS: 00010282 CPU: 0
EIP is at __copy_skb_header+0x7c/0x100
EAX: 00000000 EBX: f653acc0 ECX: f653ac00 EDX: f653ac00
ESI: f653ac50 EDI: f653ad10 EBP: c09b9e84 ESP: c09ddaa8
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
CR0: 8005003b CR2: f71c2700 CR3: 36513000 CR4: 000006d0
DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
DR6: ffff4ff0 DR7: 00000400
 [<c05e97e7>] __skb_clone+0x27/0xe0
 [<c05eb101>] skb_clone+0x41/0x60
 [<c065cbf1>] packet_rcv+0xc1/0x290
 [<c05f07ad>] netif_receive_skb+0x20d/0x400
 [<c03b2aa7>] e1000_receive_skb+0x47/0x180
 [<c03b3983>] e1000_clean_rx_irq+0x223/0x2e0
 [<c03b225b>] e1000_clean+0x5b/0x200
 [<c05f29db>] net_rx_action+0xfb/0x160
 [<c0129092>] __do_softirq+0x82/0xf0
 [<c0105b8a>] call_on_stack+0x1a/0x30

false positive? Find below the quick hacks i did to pre-initialize skb 
allocations that have RX DMA into them.

another one is:

kmemcheck: Caught 8-bit read from uninitialized memory (f653a902)
iiuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu
  ^

Pid: 2575, comm: hcid Not tainted (2.6.26-tip #20187)
EIP: 0060:[<c02b9926>] EFLAGS: 00010293 CPU: 0
EIP is at __copy_to_user_ll+0x46/0x70
EAX: 00000004 EBX: b7f3c478 ECX: 00000002 EDX: f653a900
ESI: f653a902 EDI: b7f3c47a EBP: f668ceec ESP: c09ddbc8
 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
CR0: 8005003b CR2: f71c2700 CR3: 3668d000 CR4: 000006d0
DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
DR6: ffff4ff0 DR7: 00000400
 [<c02b9e4a>] copy_to_user+0x3a/0x50
 [<c068b1b0>] hci_get_dev_list+0x100/0x120
 [<c068fe53>] hci_sock_ioctl+0x143/0x2c0
 [<c05e6a41>] sock_ioctl+0xc1/0x1d0
 [<c0187aad>] vfs_ioctl+0x2d/0x90
 [<c0187d7b>] do_vfs_ioctl+0x26b/0x2d0
 [<c0187e37>] sys_ioctl+0x57/0x70
 [<c0103c01>] sysenter_past_esp+0x6a/0x91
 [<ffffffff>] 0xffffffff

this might actually be genuine use of uninitialized memory, hm? Or 
perhaps gcc optimizing out bitmasks and kmemcheck not coping with it?

a third type was this:

kmemcheck: Caught 8-bit read from uninitialized memory (f653a2a4)
iiiiiiiiiiiiiiiiuuuuuuuuuuuuuuuuuuuuuiuuuuuuuuuuuuuuuuuuuuuuuuuu
                                    ^

Pid: 2771, comm: ssh Not tainted (2.6.26-tip #20187)
EIP: 0060:[<c05e973c>] EFLAGS: 00010282 CPU: 0
EIP is at __copy_skb_header+0x7c/0x100
EAX: 00000000 EBX: f653a240 ECX: f6762000 EDX: f6762000
ESI: f6762050 EDI: f653a290 EBP: f675cd28 ESP: c09ddce8
 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
CR0: 8005003b CR2: f71c2700 CR3: 367e3000 CR4: 000006d0
DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
DR6: ffff4ff0 DR7: 00000400
 [<c05e97e7>] __skb_clone+0x27/0xe0
 [<c05eb101>] skb_clone+0x41/0x60
 [<c062fbd1>] tcp_transmit_skb+0x41/0x800
 [<c06328c3>] tcp_connect+0x293/0x330
 [<c0636676>] tcp_v4_connect+0x3d6/0x550
 [<c0642359>] inet_stream_connect+0x1b9/0x240
 [<c05e4e66>] sys_connect+0x86/0xa0
 [<c05e66d0>] sys_socketcall+0x220/0x260
 [<c0103c01>] sysenter_past_esp+0x6a/0x91
 [<ffffffff>] 0xffffffff

this too is likely a false positive related to RX packets?

none of this looks netconsole related.

I'll keep the box running under kmemcheck - maybe something pops up.

	Ingo

------------------->
Subject: kmemcheck/net hacks
From: Ingo Molnar <mingo@elte.hu>

---
 include/asm-generic/siginfo.h |    8 ++++++++
 include/linux/fs.h            |    4 ++--
 include/linux/netdevice.h     |    4 ++--
 include/linux/skbuff.h        |    6 +++++-
 include/net/inet_sock.h       |    3 ++-
 include/net/tcp.h             |   11 +++++++++++
 kernel/signal.c               |   12 ++++++++++++
 net/core/skbuff.c             |    6 ++++++
 net/ipv4/tcp_output.c         |    4 ++++
 9 files changed, 52 insertions(+), 6 deletions(-)

Index: linux/include/asm-generic/siginfo.h
===================================================================
--- linux.orig/include/asm-generic/siginfo.h
+++ linux/include/asm-generic/siginfo.h
@@ -278,11 +278,19 @@ void do_schedule_next_timer(struct sigin
 
 static inline void copy_siginfo(struct siginfo *to, struct siginfo *from)
 {
+#ifdef CONFIG_KMEMCHECK
+	memcpy(to, from, sizeof(*to));
+#else
+	/*
+	 * Optimization, only copy up to the size of the largest known
+	 * union member:
+	 */
 	if (from->si_code < 0)
 		memcpy(to, from, sizeof(*to));
 	else
 		/* _sigchld is currently the largest know union member */
 		memcpy(to, from, __ARCH_SI_PREAMBLE_SIZE + sizeof(from->_sifields._sigchld));
+#endif
 }
 
 #endif
Index: linux/include/linux/fs.h
===================================================================
--- linux.orig/include/linux/fs.h
+++ linux/include/linux/fs.h
@@ -922,8 +922,8 @@ struct file_lock {
 	struct pid *fl_nspid;
 	wait_queue_head_t fl_wait;
 	struct file *fl_file;
-	unsigned char fl_flags;
-	unsigned char fl_type;
+	unsigned int fl_flags;
+	unsigned int fl_type;
 	loff_t fl_start;
 	loff_t fl_end;
 
Index: linux/include/linux/netdevice.h
===================================================================
--- linux.orig/include/linux/netdevice.h
+++ linux/include/linux/netdevice.h
@@ -199,8 +199,8 @@ struct dev_addr_list
 {
 	struct dev_addr_list	*next;
 	u8			da_addr[MAX_ADDR_LEN];
-	u8			da_addrlen;
-	u8			da_synced;
+	unsigned int		da_addrlen;
+	unsigned int		da_synced;
 	int			da_users;
 	int			da_gusers;
 };
Index: linux/include/linux/skbuff.h
===================================================================
--- linux.orig/include/linux/skbuff.h
+++ linux/include/linux/skbuff.h
@@ -1208,7 +1208,11 @@ static inline void __skb_queue_purge(str
 static inline struct sk_buff *__dev_alloc_skb(unsigned int length,
 					      gfp_t gfp_mask)
 {
-	struct sk_buff *skb = alloc_skb(length + NET_SKB_PAD, gfp_mask);
+	struct sk_buff *skb;
+#ifdef CONFIG_KMEMCHECK
+	gfp_mask |= __GFP_ZERO;
+#endif
+	skb = alloc_skb(length + NET_SKB_PAD, gfp_mask);
 	if (likely(skb))
 		skb_reserve(skb, NET_SKB_PAD);
 	return skb;
Index: linux/include/net/inet_sock.h
===================================================================
--- linux.orig/include/net/inet_sock.h
+++ linux/include/net/inet_sock.h
@@ -72,7 +72,8 @@ struct inet_request_sock {
 				sack_ok	   : 1,
 				wscale_ok  : 1,
 				ecn_ok	   : 1,
-				acked	   : 1;
+				acked	   : 1,
+				__filler   : 3;
 	struct ip_options	*opt;
 };
 
Index: linux/include/net/tcp.h
===================================================================
--- linux.orig/include/net/tcp.h
+++ linux/include/net/tcp.h
@@ -966,6 +966,17 @@ static inline void tcp_openreq_init(stru
 	tcp_rsk(req)->rcv_isn = TCP_SKB_CB(skb)->seq;
 	req->mss = rx_opt->mss_clamp;
 	req->ts_recent = rx_opt->saw_tstamp ? rx_opt->rcv_tsval : 0;
+#ifdef CONFIG_KMEMCHECK
+	/* bitfield init */
+	ireq->snd_wscale =
+	ireq->rcv_wscale =
+	ireq->tstamp_ok =
+	ireq->sack_ok =
+	ireq->wscale_ok =
+	ireq->ecn_ok =
+	ireq->acked =
+	ireq->__filler = 0;
+#endif
 	ireq->tstamp_ok = rx_opt->tstamp_ok;
 	ireq->sack_ok = rx_opt->sack_ok;
 	ireq->snd_wscale = rx_opt->snd_wscale;
Index: linux/kernel/signal.c
===================================================================
--- linux.orig/kernel/signal.c
+++ linux/kernel/signal.c
@@ -841,6 +841,12 @@ static int send_signal(int sig, struct s
 		list_add_tail(&q->list, &pending->list);
 		switch ((unsigned long) info) {
 		case (unsigned long) SEND_SIG_NOINFO:
+			/*
+			 * Make sure we always have a fully initialized
+			 * siginfo struct:
+			 */
+			memset(&q->info, 0, sizeof(q->info));
+
 			q->info.si_signo = sig;
 			q->info.si_errno = 0;
 			q->info.si_code = SI_USER;
@@ -848,6 +854,12 @@ static int send_signal(int sig, struct s
 			q->info.si_uid = current->uid;
 			break;
 		case (unsigned long) SEND_SIG_PRIV:
+			/*
+			 * Make sure we always have a fully initialized
+			 * siginfo struct:
+			 */
+			memset(&q->info, 0, sizeof(q->info));
+
 			q->info.si_signo = sig;
 			q->info.si_errno = 0;
 			q->info.si_code = SI_KERNEL;
Index: linux/net/core/skbuff.c
===================================================================
--- linux.orig/net/core/skbuff.c
+++ linux/net/core/skbuff.c
@@ -225,6 +225,9 @@ struct sk_buff *__alloc_skb(unsigned int
 		struct sk_buff *child = skb + 1;
 		atomic_t *fclone_ref = (atomic_t *) (child + 1);
 
+#ifdef CONFIG_KMEMCHECK
+		memset(child, 0, offsetof(struct sk_buff, tail));
+#endif
 		skb->fclone = SKB_FCLONE_ORIG;
 		atomic_set(fclone_ref, 1);
 
@@ -257,6 +260,9 @@ struct sk_buff *__netdev_alloc_skb(struc
 	int node = dev_to_node(&dev->dev);
 	struct sk_buff *skb;
 
+#ifdef CONFIG_KMEMCHECK
+	gfp_mask |= __GFP_ZERO;
+#endif
 	skb = __alloc_skb(length + NET_SKB_PAD, gfp_mask, 0, node);
 	if (likely(skb)) {
 		skb_reserve(skb, NET_SKB_PAD);
Index: linux/net/ipv4/tcp_output.c
===================================================================
--- linux.orig/net/ipv4/tcp_output.c
+++ linux/net/ipv4/tcp_output.c
@@ -333,6 +333,10 @@ static inline void TCP_ECN_send(struct s
 static void tcp_init_nondata_skb(struct sk_buff *skb, u32 seq, u8 flags)
 {
 	skb->csum = 0;
+	skb->local_df = skb->cloned = skb->ip_summed = skb->nohdr =
+		skb->nfctinfo = 0;
+	skb->pkt_type = skb->fclone = skb->ipvs_property = skb->peeked =
+		skb->nf_trace = 0;
 
 	TCP_SKB_CB(skb)->flags = flags;
 	TCP_SKB_CB(skb)->sacked = 0;

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Vegard Nossum <vegard.nossum@gmail.com> wrote:

> On Thu, Jul 17, 2008 at 11:42 PM, Ingo Molnar <mingo@elte.hu> wrote:
> > With this config:
> >
> >   http://redhat.com/~mingo/misc/config-Thu_Jul_17_20_24_45_CEST_2008.bad
> >
> 
> It doesn't actually work. The config says
> 
>     # head: 088fcf34
> 
> and I checked out this from the tip tree. But kernel-config still
> complains about unknown config options... What went wrong?

that's ok - i've got some local qa helpers that have config options. 

Things like making SMP bootups more likely in randconfig, adding various 
boot parameters to the bootup via .config methods (so that boot 
parameters can be randomized via make randconfig), etc.

these:

  CONFIG_BOOTPARAM_SUPPORT=y
  CONFIG_BOOTPARAM_NO_HZ_OFF=y
  CONFIG_BOOTPARAM_NMI_WATCHDOG_BIT_0=y
  CONFIG_BOOTPARAM_LAPIC=y
  CONFIG_BOOTPARAM_IDLE_MWAIT=y
  CONFIG_BOOTPARAM_NOPAT=y
  CONFIG_BOOTPARAM_NOTSC=y

are equivalent to adding this to the boot line:

   nohz=off nmi_watchdog=1 lapic idle=mwait nopat notsc

although i dont think they are normally material to netconsole workings.

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

two other ones:

kmemcheck: Caught 32-bit read from uninitialized memory (f459ac00)
uuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu
^

Pid: 1614, comm: kjournald Not tainted (2.6.26-tip #20187)
EIP: 0060:[<c05ea904>] EFLAGS: 00010216 CPU: 0
EIP is at skb_copy_bits+0x54/0x220
EAX: 00000110 EBX: 00000110 ECX: 00000044 EDX: f6c256c0
ESI: f459ac00 EDI: f459a000 EBP: c09b9f60 ESP: c09de048
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
CR0: 8005003b CR2: f71c2700 CR3: 2e849000 CR4: 000006d0
DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
DR6: ffff4ff0 DR7: 00000400
 [<c05ebe28>] skb_copy+0x78/0x90
 [<c05f9426>] neigh_timer_handler+0x156/0x2c0
 [<c012ba62>] run_timer_softirq+0x142/0x180
 [<c0129092>] __do_softirq+0x82/0xf0
 [<c0105b8a>] call_on_stack+0x1a/0x30
 [<ffffffff>] 0xffffffff


plus:

kmemcheck: Caught 32-bit read from uninitialized memory (f654b590)
iiiiiiiiiiiiiiiiuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu
                ^

Pid: 3130, comm: git-read-tree Not tainted (2.6.26-tip #20187)
EIP: 0060:[<c05eb396>] EFLAGS: 00010286 CPU: 0
EIP is at pskb_expand_head+0x86/0x150
EAX: 00000140 EBX: f6763124 ECX: 00000027 EDX: f6549400
ESI: f654b590 EDI: f6549650 EBP: c09b9a80 ESP: c09dfa28
 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
CR0: 8005003b CR2: f71c2700 CR3: 2e849000 CR4: 000006d0
DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
DR6: ffff4ff0 DR7: 00000400
 [<c05eb67d>] __pskb_pull_tail+0x21d/0x300
 [<c03b45dd>] e1000_xmit_frame+0x1fd/0xa60
 [<c05f0fd4>] dev_hard_start_xmit+0x254/0x2e0
 [<c0609721>] __qdisc_run+0x61/0x1b0
 [<c05f383e>] dev_queue_xmit+0x25e/0x340
 [<c061f315>] ip_finish_output+0x105/0x260
 [<c061f739>] ip_output+0x49/0x50
 [<c061debd>] ip_local_out+0x1d/0x30
 [<c061fa85>] ip_queue_xmit+0x1a5/0x340
 [<c062ffd3>] tcp_transmit_skb+0x443/0x800
 [<c06316aa>] __tcp_push_pending_frames+0xfa/0x730
 [<c062ee58>] tcp_rcv_established+0x3b8/0x6f0
 [<c0634f50>] tcp_v4_do_rcv+0x2d0/0x510
 [<c063720e>] tcp_v4_rcv+0x58e/0x660
 [<c061b5ac>] ip_local_deliver+0x4c/0x180
 [<c061b99e>] ip_rcv+0x2be/0x570
 [<c05f08d3>] netif_receive_skb+0x333/0x400
 [<c03b2aa7>] e1000_receive_skb+0x47/0x180
 [<c03b3983>] e1000_clean_rx_irq+0x223/0x2e0
 [<c03b225b>] e1000_clean+0x5b/0x200
 [<c05f29db>] net_rx_action+0xfb/0x160
 [<c0129092>] __do_softirq+0x82/0xf0
 [<c0105b8a>] call_on_stack+0x1a/0x30
 [<ffffffff>] 0xffffffff

again, from the RX path, likely false positives. We've got to fix these 
false positives to make automated debugging easier.

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Fri, Jul 18, 2008 at 1:52 AM, Ingo Molnar <mingo@elte.hu> wrote:
>  If only we had some kernel technology that could track and validate
>  memory accesses, and point out the cases where we access uninitialized
>  memory, just like Valgrind?
>
> ... something like kmemcheck? ;-)

Cool :)

> So i booted that box with tip/master and kmemcheck enabled. (plus a few
> fixlets to make networking allocations be properly tracked by
> kmemcheck.)
>
> It was a slow bootup and long wait, but it gave a few hits here:

Hm, if you think it was that slow, I am suspecting you were also using
SLUB debugging.

This can actually be negative, since now SLUB will access the objects
(+redzone +padding) and possibly trick kmemcheck into thinking they
were initialized in the first place.

But what we are really looking for is "read from freed memory"
messages. So I would actually recommend this: Disable kmemcheck's
reporting of uninitialized memory, simply to make it easier to spot
the "freed" messages more easily.

Maybe something like this (warning: whitespace-munged):

diff --git a/arch/x86/mm/kmemcheck/error.c b/arch/x86/mm/kmemcheck/error.c
index 56410c6..6944cb7 100644
--- a/arch/x86/mm/kmemcheck/error.c
+++ b/arch/x86/mm/kmemcheck/error.c
@@ -98,6 +98,9 @@ void kmemcheck_error_save(enum kmemcheck_shadow state,
                return;
        prev_ip = regs->ip;

+       if (state == KMEMCHECK_SHADOW_UNINITIALIZED)
+               return;
+
        e = error_next_wr();
        if (!e)
                return;


If this only happens during boot, it would also be a good idea to
simply reboot the machine a lot...


Vegard

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Vegard Nossum <vegard.nossum@gmail.com> wrote:

> On Fri, Jul 18, 2008 at 1:52 AM, Ingo Molnar <mingo@elte.hu> wrote:
> >  If only we had some kernel technology that could track and validate
> >  memory accesses, and point out the cases where we access uninitialized
> >  memory, just like Valgrind?
> >
> > ... something like kmemcheck? ;-)
> 
> Cool :)
> 
> > So i booted that box with tip/master and kmemcheck enabled. (plus a few
> > fixlets to make networking allocations be properly tracked by
> > kmemcheck.)
> >
> > It was a slow bootup and long wait, but it gave a few hits here:
> 
> Hm, if you think it was that slow, I am suspecting you were also using 
> SLUB debugging.

nope:

 # CONFIG_SLUB_DEBUG is not set
 CONFIG_SLUB=y

> This can actually be negative, since now SLUB will access the objects 
> (+redzone +padding) and possibly trick kmemcheck into thinking they 
> were initialized in the first place.
> 
> But what we are really looking for is "read from freed memory" 
> messages. So I would actually recommend this: Disable kmemcheck's 
> reporting of uninitialized memory, simply to make it easier to spot 
> the "freed" messages more easily.
> 
> Maybe something like this (warning: whitespace-munged):

ok, applied this too.

> If this only happens during boot, it would also be a good idea to 
> simply reboot the machine a lot...

yeah, i've got a script for that. Will try it overnight.

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[David Miller]

From: "Vegard Nossum" <vegard.nossum@gmail.com>
Date: Fri, 18 Jul 2008 01:15:47 +0200

> On Thu, Jul 17, 2008 at 11:42 PM, Ingo Molnar <mingo@elte.hu> wrote:
> >
> > A regression to v2.6.26:
> >
> > I started getting this skb-head corruption message today, on a T60
> > laptop with e1000:
> >
> > PM: Removing info for No Bus:vcs11
> > device: 'vcs11': device_create_release
> > =============================================================================
> > BUG skbuff_head_cache: Poison overwritten
> > -----------------------------------------------------------------------------
> >
> > INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b
> 
> 1. Notice the range. It's just a single byte.
> 2. Notice the value. It's just a ++.

It's supposed to be 0x6b, this would be a "--"

Also it (more likely IMHO) could be clearing a flag with the value 0x01.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[David Miller]

From: Ingo Molnar <mingo@elte.hu>
Date: Fri, 18 Jul 2008 01:52:54 +0200

> kmemcheck: Caught 8-bit read from uninitialized memory (f653ad24)
> iiiiiiiiiiiiiiiiuuuuuuuuuuuuuuuuuuuuuiuuuuuuuuuuuuuuuuuuuuuuuuuu
>                                     ^
> 
> Pid: 2484, comm: arping Not tainted (2.6.26-tip #20187)
> EIP: 0060:[<c05e973c>] EFLAGS: 00010282 CPU: 0
> EIP is at __copy_skb_header+0x7c/0x100
> EAX: 00000000 EBX: f653acc0 ECX: f653ac00 EDX: f653ac00
> ESI: f653ac50 EDI: f653ad10 EBP: c09b9e84 ESP: c09ddaa8
>  DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
> CR0: 8005003b CR2: f71c2700 CR3: 36513000 CR4: 000006d0
> DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
> DR6: ffff4ff0 DR7: 00000400
>  [<c05e97e7>] __skb_clone+0x27/0xe0
>  [<c05eb101>] skb_clone+0x41/0x60
>  [<c065cbf1>] packet_rcv+0xc1/0x290
>  [<c05f07ad>] netif_receive_skb+0x20d/0x400
>  [<c03b2aa7>] e1000_receive_skb+0x47/0x180
>  [<c03b3983>] e1000_clean_rx_irq+0x223/0x2e0
>  [<c03b225b>] e1000_clean+0x5b/0x200
>  [<c05f29db>] net_rx_action+0xfb/0x160
>  [<c0129092>] __do_softirq+0x82/0xf0
>  [<c0105b8a>] call_on_stack+0x1a/0x30
> 
> false positive? Find below the quick hacks i did to pre-initialize skb 
> allocations that have RX DMA into them.

Maybe.  Every SKB object allocated is fully initialized
in __alloc_skb():

	/*
	 * Only clear those fields we need to clear, not those that we will
	 * actually initialise below. Hence, don't put any more fields after
	 * the tail pointer in struct sk_buff!
	 */
	memset(skb, 0, offsetof(struct sk_buff, tail));

That leaves the following trailing members of struct sk_buff:

	/* These elements must be at the end, see alloc_skb() for details.  */
	sk_buff_data_t		tail;
	sk_buff_data_t		end;
	unsigned char		*head,
				*data;
	unsigned int		truesize;
	atomic_t		users;

which are the explicitly initialized right after the quotes memset().

	skb->truesize = size + sizeof(struct sk_buff);
	atomic_set(&skb->users, 1);
	skb->head = data;
	skb->data = data;
	skb_reset_tail_pointer(skb);
	skb->end = skb->tail + size;

When we clone, there are probably some fields we don't copy over
explicitly.  And we usually do that because they don't matter or
if they do the caller will take care of it.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Evgeniy Polyakov]

Hi Ingo.

On Thu, Jul 17, 2008 at 11:42:22PM +0200, Ingo Molnar (mingo@elte.hu) wrote:
> Pid: 5098, comm: gdm-binary Not tainted 2.6.26-tip #3094
>  [<c0186f99>] print_trailer+0xa9/0xf0
>  [<c018707b>] check_bytes_and_report+0x9b/0xc0
>  [<c01874ae>] check_object+0x19e/0x1e0
>  [<c0187ef1>] __slab_alloc+0x371/0x4e0
>  [<c0188552>] kmem_cache_alloc+0xb2/0xc0
>  [<c06732dc>] ? __alloc_skb+0x2c/0x110

Out of curiosity, why does it scream at allocation time?
Does SLUB have a debug check at freeing time? If so, how does it work
and why didn't it caught use after free there?

-- 
	Evgeniy Polyakov

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Fri, Jul 18, 2008 at 4:03 AM, David Miller <davem@davemloft.net> wrote:
>> On Thu, Jul 17, 2008 at 11:42 PM, Ingo Molnar <mingo@elte.hu> wrote:
>> >
>> > A regression to v2.6.26:
>> >
>> > I started getting this skb-head corruption message today, on a T60
>> > laptop with e1000:
>> >
>> > PM: Removing info for No Bus:vcs11
>> > device: 'vcs11': device_create_release
>> > =============================================================================
>> > BUG skbuff_head_cache: Poison overwritten
>> > -----------------------------------------------------------------------------
>> >
>> > INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b
>>
>> 1. Notice the range. It's just a single byte.
>> 2. Notice the value. It's just a ++.
>
> It's supposed to be 0x6b, this would be a "--"

You're right! Oops. In my defence, I wrote that at 2 AM last night ;-)

> Also it (more likely IMHO) could be clearing a flag with the value 0x01.

It could be. But like I said in a later e-mail, the thing is likely
sk_buff->truesize. Which is not a flags variable. It _is_ however, a
counter, which is frequently -= and atomic_sub()ed.

That field is also an int, not a byte like I suggested above. This is
fine, though. "--" on an int can of course legitimately update/change
just the lower byte of an int.

But.. it could also be some random corruption coming from elsewhere.
Maybe even bad RAM (it's just a single bit anyway). But that's less
likely.


Vegard

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[David Miller]

From: "Vegard Nossum" <vegard.nossum@gmail.com>
Date: Fri, 18 Jul 2008 09:03:50 +0200

> > It's supposed to be 0x6b, this would be a "--"
> 
> You're right! Oops. In my defence, I wrote that at 2 AM last night ;-)
> 
> > Also it (more likely IMHO) could be clearing a flag with the value 0x01.
> 
> It could be. But like I said in a later e-mail, the thing is likely
> sk_buff->truesize. Which is not a flags variable. It _is_ however, a
> counter, which is frequently -= and atomic_sub()ed.

skb->truesize is ever incremented or decremented by only one.

Usually it is changed by the entire packet size, or at least one MSS's
worth.

On packet free, it will be decremented by at least sizeof(struct sk_buff)

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Pekka J Enberg]

Hi Ingo,

On Thu, 17 Jul 2008, Ingo Molnar wrote:
> A regression to v2.6.26:
> 
> I started getting this skb-head corruption message today, on a T60 
> laptop with e1000:

[snip]
 
On Thu, 17 Jul 2008, Ingo Molnar wrote:
> Perhaps SLUB debugging got smarter?

Nope.

On Thu, 17 Jul 2008, Ingo Molnar wrote:
> PM: Removing info for No Bus:vcs11
> device: 'vcs11': device_create_release
> =============================================================================
> BUG skbuff_head_cache: Poison overwritten
> -----------------------------------------------------------------------------
> 
> INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b

0x6b is POISON_FREE so 0x6a is one bit corruption.

> INFO: Allocated in __alloc_skb+0x2c/0x110 age=0 cpu=0 pid=5098
> INFO: Freed in __kfree_skb+0x31/0x80 age=0 cpu=1 pid=4440
> INFO: Slab 0xc16cc140 objects=16 used=1 fp=0xf658ae00 flags=0x400000c3
> INFO: Object 0xf658ae00 @offset=3584 fp=0xf658af00
> 
> Bytes b4 0xf658adf0:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
>   Object 0xf658ae00:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>   Object 0xf658ae10:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>   Object 0xf658ae20:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>   Object 0xf658ae30:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>   Object 0xf658ae40:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>   Object 0xf658ae50:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>   Object 0xf658ae60:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>   Object 0xf658ae70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk

It's bit unfortunate that we don't see full dump of the corruption here 
because SLUB limits the output to 128 bytes. Ingo, you might want to try 
this patch so that we can see all of it:

diff --git a/mm/slub.c b/mm/slub.c
index 5f6e2c4..f69d181 100644
--- a/mm/slub.c
+++ b/mm/slub.c
@@ -492,7 +492,7 @@ static void print_trailer(struct kmem_cache *s, struct page *page, u8 *p)
 	if (p > addr + 16)
 		print_section("Bytes b4", p - 16, 16);
 
-	print_section("Object", p, min(s->objsize, 128));
+	print_section("Object", p, s->objsize);
 
 	if (s->flags & SLAB_RED_ZONE)
 		print_section("Redzone", p + s->objsize,

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Pekka Enberg]

Hi Evgeniy,

On Fri, Jul 18, 2008 at 8:46 AM, Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:
> Hi Ingo.
>
> On Thu, Jul 17, 2008 at 11:42:22PM +0200, Ingo Molnar (mingo@elte.hu) wrote:
>> Pid: 5098, comm: gdm-binary Not tainted 2.6.26-tip #3094
>>  [<c0186f99>] print_trailer+0xa9/0xf0
>>  [<c018707b>] check_bytes_and_report+0x9b/0xc0
>>  [<c01874ae>] check_object+0x19e/0x1e0
>>  [<c0187ef1>] __slab_alloc+0x371/0x4e0
>>  [<c0188552>] kmem_cache_alloc+0xb2/0xc0
>>  [<c06732dc>] ? __alloc_skb+0x2c/0x110
>
> Out of curiosity, why does it scream at allocation time?

Because it's checking for use-after-free errors. The object is
poisoned with POISON_FREE when it's free'd and we verify the poison
values at allocation time.

On Fri, Jul 18, 2008 at 8:46 AM, Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:
> Does SLUB have a debug check at freeing time? If so, how does it work
> and why didn't it caught use after free there?

You can't detect use after free before the object is actually free'd ;-)

                                      Pekka

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Vegard Nossum <vegard.nossum@gmail.com> wrote:

> But.. it could also be some random corruption coming from elsewhere. 
> Maybe even bad RAM (it's just a single bit anyway). But that's less 
> likely.

ok, i looked at the logs once more and while i thought that it occured 
twice it only occured once:

  Jul 17 20:22:14 europe kernel: BUG skbuff_head_cache: Poison overwritten

... this would explain why my attempts to bisect and reproduce it 
failed. I got too excited about it being seemingly reproducible and 
possibly bisectable (memory corruption bugs rarely are). My overnight 
reboot-the-same-kernel tests didnt show anything either.

It's a known-reliable system with thousands of bootups:

 Jul 17 20:20:54 europe kernel: Linux version 2.6.26-tip (mingo@europe) 
 (gcc version 4.2.2) #3094 SMP Thu Jul 17 20:19:27 CEST 2008

... but a hw fluke is never out of question. (It wasnt a particularly 
hot day but the evening was unusually humid, maybe that made the 
difference.)

So lets close this for now, it's not a reproducible regression that we 
can act upon. I'll update this thread if anything new happens. 
Netconsole is reliable on this system in any case.

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Pekka Enberg <penberg@cs.helsinki.fi> wrote:

> On Fri, Jul 18, 2008 at 8:46 AM, Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:
> > Does SLUB have a debug check at freeing time? If so, how does it work
> > and why didn't it caught use after free there?
> 
> You can't detect use after free before the object is actually free'd 
> ;-)

yeah, we want to check use-after free at the next allocation point - 
i.e. as late as possible to gather all corruptions that happened 
meanwhile.

We could in theory have a SLUB debug mode where a SCHED_IDLE kernel 
thread would periodically check all free objects (of that CPU) in the 
background to ensure their integrity. That would catch corruptions 
sooner, with a possibly still meaningful context to print out. [right 
after the IRQ or process that corrupts them finishes running]

It could also be hooked into ftrace to print out the last few hundred 
kernel function calls executed prior any corruption. ftrace/slub-debug 
plugin perhaps?

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Pekka J Enberg <penberg@cs.helsinki.fi> wrote:

> >   Object 0xf658ae70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
> 
> It's bit unfortunate that we don't see full dump of the corruption 
> here because SLUB limits the output to 128 bytes. Ingo, you might want 
> to try this patch so that we can see all of it:

ok, applied this as a debug special to tip/out-of-tree - future 
incidents should have the full object dump.

would makes sense for upstream too i think, or increase the limit to 4K 
or so. (which is still fair to be dumped into a syslog)

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Pekka Enberg]

Hi Ingo,

On Fri, Jul 18, 2008 at 12:09 PM, Ingo Molnar <mingo@elte.hu> wrote:
> yeah, we want to check use-after free at the next allocation point -
> i.e. as late as possible to gather all corruptions that happened
> meanwhile.
>
> We could in theory have a SLUB debug mode where a SCHED_IDLE kernel
> thread would periodically check all free objects (of that CPU) in the
> background to ensure their integrity. That would catch corruptions
> sooner, with a possibly still meaningful context to print out. [right
> after the IRQ or process that corrupts them finishes running]
>
> It could also be hooked into ftrace to print out the last few hundred
> kernel function calls executed prior any corruption. ftrace/slub-debug
> plugin perhaps?

Well, there's this Norwegian guy, Vegard, who has written a small
piece of code that can detect use-after-free _as it happens_. I think
he calls the thing kmemcheck :-).

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Pekka Enberg]

On Fri, Jul 18, 2008 at 12:11 PM, Ingo Molnar <mingo@elte.hu> wrote:
>
> * Pekka J Enberg <penberg@cs.helsinki.fi> wrote:
>
>> >   Object 0xf658ae70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>>
>> It's bit unfortunate that we don't see full dump of the corruption
>> here because SLUB limits the output to 128 bytes. Ingo, you might want
>> to try this patch so that we can see all of it:
>
> ok, applied this as a debug special to tip/out-of-tree - future
> incidents should have the full object dump.
>
> would makes sense for upstream too i think, or increase the limit to 4K
> or so. (which is still fair to be dumped into a syslog)

SLUB already limits object sizes to less than PAGE_SIZE so the patch
should be fine. Christoph, are you okay with this going upstream?

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Evgeniy Polyakov]

Hi Pekka.

On Fri, Jul 18, 2008 at 12:02:26PM +0300, Pekka Enberg (penberg@cs.helsinki.fi) wrote:
> > Out of curiosity, why does it scream at allocation time?
> 
> Because it's checking for use-after-free errors. The object is
> poisoned with POISON_FREE when it's free'd and we verify the poison
> values at allocation time.

Does it also scream on double free event? Just to closer guilty
circles... 0x9c offset is somewhere at the very end of the skbuff
structure, likely skb->users.

Can you also check in some kind of this patch to catch freed skb freeing
for testing?

diff --git a/net/core/skbuff.c b/net/core/skbuff.c
index 3666216..dda96bf 100644
--- a/net/core/skbuff.c
+++ b/net/core/skbuff.c
@@ -419,6 +419,14 @@ void kfree_skb(struct sk_buff *skb)
 {
 	if (unlikely(!skb))
 		return;
+
+	{
+		u8 *ptr = (u8 *)(&skb->users);
+
+		if (*ptr == POISON_FREE || *ptr == POISON_INUSE || *ptr == POISON_END)
+			BUG();
+	}
+
 	if (likely(atomic_read(&skb->users) == 1))
 		smp_rmb();
 	else if (likely(!atomic_dec_and_test(&skb->users)))

-- 
	Evgeniy Polyakov

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Christoph Lameter]

Pekka Enberg wrote:
> On Fri, Jul 18, 2008 at 12:11 PM, Ingo Molnar <mingo@elte.hu> wrote:
>> * Pekka J Enberg <penberg@cs.helsinki.fi> wrote:
>>
>>>>   Object 0xf658ae70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
>>> It's bit unfortunate that we don't see full dump of the corruption
>>> here because SLUB limits the output to 128 bytes. Ingo, you might want
>>> to try this patch so that we can see all of it:
>> ok, applied this as a debug special to tip/out-of-tree - future
>> incidents should have the full object dump.
>>
>> would makes sense for upstream too i think, or increase the limit to 4K
>> or so. (which is still fair to be dumped into a syslog)
> 
> SLUB already limits object sizes to less than PAGE_SIZE so the patch
> should be fine. Christoph, are you okay with this going upstream?

I am fine with the patch. Just be aware that we are going to be shoveling a lot of stuff into the log. The object size can be greater than 4k for non kmalloc slab caches. True in general object sizes are <4k.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Christoph Lameter]

>> INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b
> 
> 0x6b is POISON_FREE so 0x6a is one bit corruption.

Typically this means that a refcount at the head of the object was decremented. But the object was already freed.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Pekka Enberg]

Hi Evgeniy,

On Fri, Jul 18, 2008 at 12:02:26PM +0300, Pekka Enberg
(penberg@cs.helsinki.fi) wrote:
>> > Out of curiosity, why does it scream at allocation time?
>>
>> Because it's checking for use-after-free errors. The object is
>> poisoned with POISON_FREE when it's free'd and we verify the poison
>> values at allocation time.

On Fri, Jul 18, 2008 at 1:16 PM, Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:
> Does it also scream on double free event? Just to closer guilty
> circles... 0x9c offset is somewhere at the very end of the skbuff
> structure, likely skb->users.

Yeah. See the free_debug_processing() function in mm/slub.c for
details (the on_freelist() part). However, if you look at slab_free()
you can see that in the SLUB fast-path we don't do any of these
debugging checks. So you can end up with slab corruption without a
nice error message.

                                  Pekka

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Christoph Lameter]

Pekka Enberg wrote:

> Yeah. See the free_debug_processing() function in mm/slub.c for
> details (the on_freelist() part). However, if you look at slab_free()
> you can see that in the SLUB fast-path we don't do any of these
> debugging checks. So you can end up with slab corruption without a
> nice error message.

The slub fastpath is not used when debugging is enabled.

Without debugging on double frees will typically corrupt the freepointer. So you get an invalid pointer reference in __slab_free.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Evgeniy Polyakov]

Hi Pekka.

On Fri, Jul 18, 2008 at 05:44:44PM +0300, Pekka Enberg (penberg@cs.helsinki.fi) wrote:
> Yeah. See the free_debug_processing() function in mm/slub.c for
> details (the on_freelist() part). However, if you look at slab_free()
> you can see that in the SLUB fast-path we don't do any of these
> debugging checks. So you can end up with slab corruption without a
> nice error message.

Yup, I see.

Actually with the network there will be no duuble free as long as uses
use kfree_skb(), since first freeing (with skb->users being equal to 1,
so user owns this skb) will fill skb with 0x6b, so any subsequent
kfree_skb() will try to decrement particulary huge reference counter
(0x6b6b6b6b) and actually will never reach 1 again, so things will look
quite clear, but if the same slub area will be reused for the next skb
before it is freed second time, very hard-to-debug data corruption will
happen, so I belive this kind of checks should be done into kfree_skb()
(of course under special debug compile option). I posted that patch just
for the reference and that Ingo would be able to detect where skb is
used after already being freed.

-- 
	Evgeniy Polyakov

Re: [bug] Attempt to release alive inet socket f6fac040

[Ingo Molnar]

Hm, just got another skb related weirdness and crash on that testbox:

[   13.495000] usb 1-0:1.0: uevent
[   19.392000] Attempt to release alive inet socket f6fac040
[   20.387000] EXT3 FS on sda1, internal journal
[   20.762500] eth0: no IPv6 routers present
[   22.431000] warning: process `kudzu' used the deprecated sysctl system call with 1.23.
[   22.906000] ------------[ cut here ]------------
[   22.906000] kernel BUG at mm/slab.c:2927!
[   22.906000] invalid opcode: 0000 [#1] PREEMPT SMP 
[   22.906000] Modules linked in:
[   22.906000] 
[   22.906000] Pid: 1831, comm: ip6tables-resto Tainted: G        W (2.6.26-tip-03923-g2c96bcb-dirty #3134)
[   22.906000] EIP: 0060:[<b01878d2>] EFLAGS: 00010046 CPU: 0
[   22.906000] EIP is at cache_alloc_refill+0xfa/0x431
[   22.906000] EAX: 00000004 EBX: f6ec1a00 ECX: f67826c0 EDX: f6fa3c40
[   22.906000] ESI: f6fac000 EDI: 0000000b EBP: f5c01ec4 ESP: f5c01e70
[   22.906000]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
[   22.906000] Process ip6tables-resto (pid: 1831, ti=f5c01000 task=f5d2f060 task.ti=f5c01000)
[   22.906000] Stack: 00000004 00000004 000000d0 000000d0 f67826c8 f67826d0 f6fac01c 000080d0 
[   22.906000]        f6fa3c40 f6fa9800 f67826c0 00000000 7f431025 b014a3e9 b2bd6ab8 00000000 
[   22.906000]        00000000 00000000 00000246 f6fa3c40 f6fa3c40 f5c01ee4 b0187793 b07c11d6 
[   22.906000] Call Trace:
[   22.906000]  [<b014a3e9>] ? __wake_up_bit+0xc/0x37
[   22.906000]  [<b0187793>] ? kmem_cache_alloc+0x53/0x98
[   22.906000]  [<b05589b5>] ? sk_prot_alloc+0x1e/0xa7
[   22.906000]  [<b026cb86>] ? cap_capable+0xa/0x2b
[   22.906000]  [<b0559fa4>] ? sk_alloc+0x20/0xa3
[   22.906000]  [<b05c4364>] ? inet6_create+0x187/0x316
[   22.906000]  [<b0556e87>] ? __sock_create+0x15b/0x229
[   22.906000]  [<b0556f9c>] ? sock_create+0x29/0x2e
[   22.906000]  [<b0557112>] ? sys_socket+0x1e/0x42
[   22.906000]  [<b05577b6>] ? sys_socketcall+0x56/0x163
[   22.906000]  [<b011a418>] ? resume_userspace+0x8/0x30
[   22.906000]  [<b011a4ff>] ? sysenter_past_esp+0x78/0xb9
[   22.906000]  =======================
[   22.906000] Code: bb 00 00 00 8b 45 d4 8b 30 39 c6 75 13 c7 40 50 01 00 00 00 8b 70 10 3b 75 c0 0f 84 94 00 00 00 8b 55 cc 8b 42 38 39 46 10 72 37 <0f> 0b eb fe 8b 0b 89 4d ac 8b 56 14 8b 45 cc 0f af 50 2c 03 56 
[   22.906000] EIP: [<b01878d2>] cache_alloc_refill+0xfa/0x431 SS:ESP 0068:f5c01e70
[   22.906000] Kernel panic - not syncing: Fatal exception
[   22.906000] Pid: 1831, comm: ip6tables-resto Tainted: G      D W 2.6.26-tip-03923-g2c96bcb-dirty #3134

Config and full crashlog at:

 http://redhat.com/~mingo/misc/config-Fri_Jul_18_19_59_56_CEST_2008.bad
 http://redhat.com/~mingo/misc/crash-2.6.26-tip-03923-g2c96bcb.log

Note, the first warning the bootlog is here:

[   10.039500] initcall ip6_queue_init+0x0/0x111 returned 0 after 0 msecs
[   10.039500] calling  ip6_tunnel_init+0x0/0x91
[   10.039500] ------------[ cut here ]------------
[   10.039500] WARNING: at net/core/dst.c:265 dst_release+0x24/0x2b()
[   10.039500] Modules linked in:
[   10.039500] Pid: 7, comm: ksoftirqd/1 Not tainted 2.6.26-tip-03923-g2c96bcb-dirty #3134
[   10.040500]  [<b0139b2d>] warn_on_slowpath+0x46/0x6a
[   10.040500]  [<b0152c9a>] ? put_lock_stats+0xd/0x21
[   10.040500]  [<b015397b>] ? __lock_acquire+0x5ba/0x618
[   10.040500]  [<b0152c9a>] ? put_lock_stats+0xd/0x21
[   10.040500]  [<b05642f6>] dst_release+0x24/0x2b
[   10.040500]  [<b055bfa3>] skb_release_all+0x13/0x83
[   10.041500]  [<b055b910>] __kfree_skb+0x10/0x6b
[   10.041500]  [<b0561e16>] net_tx_action+0x6e/0xee
[   10.041500]  [<b013e38d>] __do_softirq+0x7a/0xe8
[   10.041500]  [<b013e313>] ? __do_softirq+0x0/0xe8
[   10.041500]  [<b011ccc6>] do_softirq+0x79/0xba
[   10.041500]  [<b013e647>] ksoftirqd+0x88/0x13b
[   10.042500]  [<b013e5bf>] ? ksoftirqd+0x0/0x13b
[   10.042500]  [<b014a365>] kthread+0x40/0x67
[   10.042500]  [<b014a325>] ? kthread+0x0/0x67
[   10.042500]  [<b011b7c7>] kernel_thread_helper+0x7/0x10
[   10.042500]  =======================
[   10.042500] ---[ end trace 5c376f440d7caa15 ]---
[   10.042500] Attempt to release alive inet socket f6fac040
[   10.043500] initcall ip6_tunnel_init+0x0/0x91 returned 0 after 3 msecs
[   10.043500] calling  packet_init+0x0/0x3e

That does seem to be quite specific.

Note, this box never had skb problems and was running hundreds of 
similar boot tests every day - these appeared in this merge window.

The upstream base of 2.6.26-tip-03923-g2c96bcb is v2.6.26-3465-g5b664cb.

I'll now check how reproducible this crash is.

	Ingo

Re: [bug] Attempt to release alive inet socket f6fac040

[Ingo Molnar]

* Ingo Molnar <mingo@elte.hu> wrote:

> Hm, just got another skb related weirdness and crash on that testbox:

Totally weird bug. Using the same bzImage i was able to crash the box 2 
times in a row. Then i tried another (but similarly configured) kernel 
and it wouldnt crash.

Then i tried the original bzImage again (bit for bit equivalent) and it 
wouldnt crash 5 times in a row.

I've attached the second crashlog below - in case it's interesting to 
anyone.

This cannot be random corruption or hw flakiness as the two crashes in a 
row are so similar. One (remote) possibility would be for some hw 
component to be in a weird state that doesnt get proper re-initialized 
after reboot. As long as that condition lingered, it would crash. Once 
that condition was gone, it wouldnt crash.

For now i've given up on this variant of the bug. I'll continue with 
randconfig searching - maybe another config gives us something more 
debuggable ...

And note that this time it was SLAB not SLUB - so any SLUB impact is 
highly unlikely. (i strongly suspect some hw initialization issue.)

	Ingo

-------------------->
[    0.000000] Linux version 2.6.26-tip-03923-g2c96bcb-dirty (mingo@europe) (gcc version 4.2.2) #3134 SMP PREEMPT Fri Jul 18 20:06:13 CEST 2008
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009f000 (usable)
[    0.000000]  BIOS-e820: 000000000009f000 - 00000000000a0000 (reserved)
[    0.000000]  BIOS-e820: 00000000000d2000 - 00000000000d4000 (reserved)
[    0.000000]  BIOS-e820: 00000000000dc000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 000000007f6e0000 (usable)
[    0.000000]  BIOS-e820: 000000007f6e0000 - 000000007f6f3000 (ACPI data)
[    0.000000]  BIOS-e820: 000000007f6f3000 - 000000007f700000 (ACPI NVS)
[    0.000000]  BIOS-e820: 000000007f700000 - 0000000080000000 (reserved)
[    0.000000]  BIOS-e820: 00000000f0000000 - 00000000f4000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
[    0.000000]  BIOS-e820: 00000000fed00000 - 00000000fed00400 (reserved)
[    0.000000]  BIOS-e820: 00000000fed14000 - 00000000fed1a000 (reserved)
[    0.000000]  BIOS-e820: 00000000fed1c000 - 00000000fed90000 (reserved)
[    0.000000]  BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
[    0.000000]  BIOS-e820: 00000000ff800000 - 0000000100000000 (reserved)
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] using polling idle threads.
[    0.000000] last_pfn = 0x7f6e0 max_arch_pfn = 0x100000
[    0.000000] kernel direct mapping tables up to 48000000 @ 7000-c000
[    0.000000] ACPI: RSDP 000F68A0, 0024 (r2 LENOVO)
[    0.000000] ACPI: XSDT 7F6E631F, 0074 (r1 LENOVO TP-79        1020  LTP        0)
[    0.000000] ACPI: FACP 7F6E6400, 00F4 (r3 LENOVO TP-79        1020 LNVO        1)
[    0.000000] ACPI Warning (tbfadt-0447): Optional field "Gpe1Block" has zero address or length: 000000000000102C/0 [20080609]
[    0.000000] ACPI: DSDT 7F6E65E7, C765 (r1 LENOVO TP-79        1020 MSFT  100000E)
[    0.000000] ACPI: FACS 7F6F4000, 0040
[    0.000000] ACPI: SSDT 7F6E65B4, 0033 (r1 LENOVO TP-79        1020 MSFT  100000E)
[    0.000000] ACPI: ECDT 7F6F2D4C, 0052 (r1 LENOVO TP-79        1020 LNVO        1)
[    0.000000] ACPI: TCPA 7F6F2D9E, 0032 (r2 LENOVO TP-79        1020 LNVO        1)
[    0.000000] ACPI: APIC 7F6F2DD0, 0068 (r1 LENOVO TP-79        1020 LNVO        1)
[    0.000000] ACPI: MCFG 7F6F2E38, 003E (r1 LENOVO TP-79        1020 LNVO        1)
[    0.000000] ACPI: HPET 7F6F2E76, 0038 (r1 LENOVO TP-79        1020 LNVO        1)
[    0.000000] ACPI: BOOT 7F6F2FD8, 0028 (r1 LENOVO TP-79        1020  LTP        1)
[    0.000000] ACPI: SSDT 7F6E58DA, 0507 (r1 LENOVO TP-79        1020 INTL 20050513)
[    0.000000] ACPI: SSDT 7F6E5702, 01D8 (r1 LENOVO TP-79        1020 INTL 20050513)
[    0.000000] Entering add_active_range(0, 0x0, 0x9f) 0 entries of 256 used
[    0.000000] Entering add_active_range(0, 0x100, 0x7f6e0) 1 entries of 256 used
[    0.000000] 886MB HIGHMEM available.
[    0.000000] 1152MB LOWMEM available.
[    0.000000]   mapped low ram: 0 - 48000000
[    0.000000]   low ram: 00000000 - 48000000
[    0.000000]   bootmap 00008000 - 00011000
[    0.000000] (8 early reservations) ==> bootmem
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [0000001000 - 0000002000]    EX TRAMPOLINE ==> [0000001000 - 0000002000]
[    0.000000]   #2 [0000006000 - 0000007000]       TRAMPOLINE ==> [0000006000 - 0000007000]
[    0.000000]   #3 [0000100000 - 0000cec520]    TEXT DATA BSS ==> [0000100000 - 0000cec520]
[    0.000000]   #4 [0000ced000 - 0000cf2000]    INIT_PG_TABLE ==> [0000ced000 - 0000cf2000]
[    0.000000]   #5 [000009f000 - 0000100000]    BIOS reserved ==> [000009f000 - 0000100000]
[    0.000000]   #6 [0000007000 - 0000008000]          PGTABLE ==> [0000007000 - 0000008000]
[    0.000000]   #7 [0000008000 - 0000011000]          BOOTMAP ==> [0000008000 - 0000011000]
[    0.000000] Scan SMP from b0000000 for 1024 bytes.
[    0.000000] Scan SMP from b009fc00 for 1024 bytes.
[    0.000000] Scan SMP from b00f0000 for 65536 bytes.
[    0.000000] found SMP MP-table at [b00f68e0] 000f68e0
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   Normal   0x00001000 -> 0x00048000
[    0.000000]   HighMem  0x00048000 -> 0x0007f6e0
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     0: 0x00000000 -> 0x0000009f
[    0.000000]     0: 0x00000100 -> 0x0007f6e0
[    0.000000] On node 0 totalpages: 521855
[    0.000000] free_area_init_node: node 0, pgdat b088e820, node_mem_map b1000000
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 3943 pages, LIFO batch:0
[    0.000000]   Normal zone: 3976 pages used for memmap
[    0.000000]   Normal zone: 286840 pages, LIFO batch:31
[    0.000000]   HighMem zone: 3105 pages used for memmap
[    0.000000]   HighMem zone: 223935 pages, LIFO batch:31
[    0.000000]   Movable zone: 0 pages used for memmap
[    0.000000] ACPI: PM-Timer IO Port: 0x1008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Bus #0 is ISA
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Enabling APIC mode:  Flat.  Using 1 I/O APICs
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] SMP: Allowing 2 CPUs, 0 hotplug CPUs
[    0.000000] mapped APIC to ffffb000 (fee00000)
[    0.000000] mapped IOAPIC to ffffa000 (fec00000)
[    0.000000] Allocating PCI resources starting at 88000000 (gap: 80000000:70000000)
[    0.000000] PERCPU: Allocating 323600 bytes of per cpu data
[    0.000000] NR_CPUS: 8, nr_cpu_ids: 2, nr_node_ids 1
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 514718
[    0.000000] Kernel command line: root=/dev/sda1 console=tty profile=0 debug initcall_debug enforcing=0 apic=verbose sysrq_always_enabled ignore_loglevel selinux=1 relaxed_check=1 netconsole=4444@10.0.1.15/eth0,4444@10.0.1.16/00:19:d1:01:f5:55 no_hz=off nolapic_timer hpet=disable idle=poll notsc
[    0.000000] kernel profiling enabled (shift: 0)
[    0.000000] debug: sysrq always enabled.
[    0.000000] notsc: Kernel compiled with CONFIG_X86_TSC, cannot disable TSC completely.
[    0.000000] Enabling fast FPU save and restore... done.
[    0.000000] Enabling unmasked SIMD FPU exception support... done.
[    0.000000] Initializing CPU#0
[    0.000000] CPU 0 irqstacks, hard=b09c3000 soft=b09bb000
[    0.000000] PID hash table entries: 4096 (order: 12, 16384 bytes)
[    0.000000] Extended CMOS year: 2000
[    0.000000] TSC calibrated against PM_TIMER
[    0.000000] Detected 1828.742 MHz processor.
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
[    0.000000] ... MAX_LOCKDEP_SUBCLASSES:    8
[    0.000000] ... MAX_LOCK_DEPTH:          48
[    0.000000] ... MAX_LOCKDEP_KEYS:        2048
[    0.000000] ... CLASSHASH_SIZE:           1024
[    0.000000] ... MAX_LOCKDEP_ENTRIES:     8192
[    0.000000] ... MAX_LOCKDEP_CHAINS:      16384
[    0.000000] ... CHAINHASH_SIZE:          8192
[    0.000000]  memory used by lock dependency info: 1088 kB
[    0.000000]  per task-struct memory footprint: 2688 bytes
[    0.000000] ------------------------
[    0.000000] | Locking API testsuite:
[    0.000000] ----------------------------------------------------------------------------
[    0.000000]                                  | spin |wlock |rlock |mutex | wsem | rsem |
[    0.000000]   --------------------------------------------------------------------------
[    0.000000]                      A-A deadlock:failed|failed|  ok  |failed|failed|failed|
[    0.000000]                  A-B-B-A deadlock:failed|failed|  ok  |failed|failed|failed|
[    0.000000]              A-B-B-C-C-A deadlock:failed|failed|  ok  |failed|failed|failed|
[    0.000000]              A-B-C-A-B-C deadlock:failed|failed|  ok  |failed|failed|failed|
[    0.000000]          A-B-B-C-C-D-D-A deadlock:failed|failed|  ok  |failed|failed|failed|
[    0.000000]          A-B-C-D-B-D-D-A deadlock:failed|failed|  ok  |failed|failed|failed|
[    0.000000]          A-B-C-D-B-C-D-A deadlock:failed|failed|  ok  |failed|failed|failed|
[    0.000000]                     double unlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
[    0.000000]                   initialize held:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
[    0.000000]                  bad unlock order:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
[    0.000000]   --------------------------------------------------------------------------
[    0.000000]               recursive read-lock:             |  ok  |             |failed|
[    0.000000]            recursive read-lock #2:             |  ok  |             |failed|
[    0.000000]             mixed read-write-lock:             |failed|             |failed|
[    0.000000]             mixed write-read-lock:             |failed|             |failed|
[    0.000000]   --------------------------------------------------------------------------
[    0.000000]      hard-irqs-on + irq-safe-A/12:failed|failed|  ok  |
[    0.000000]      soft-irqs-on + irq-safe-A/12:failed|failed|  ok  |
[    0.000000]      hard-irqs-on + irq-safe-A/21:failed|failed|  ok  |
[    0.000000]      soft-irqs-on + irq-safe-A/21:failed|failed|  ok  |
[    0.000000]        sirq-safe-A => hirqs-on/12:failed|failed|  ok  |
[    0.000000]        sirq-safe-A => hirqs-on/21:failed|failed|  ok  |
[    0.000000]          hard-safe-A + irqs-on/12:failed|failed|  ok  |
[    0.000000]          soft-safe-A + irqs-on/12:failed|failed|  ok  |
[    0.000000]          hard-safe-A + irqs-on/21:failed|failed|  ok  |
[    0.000000]          soft-safe-A + irqs-on/21:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #1/123:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #1/123:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #1/132:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #1/132:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #1/213:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #1/213:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #1/231:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #1/231:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #1/312:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #1/312:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #1/321:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #1/321:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #2/123:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #2/123:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #2/132:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #2/132:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #2/213:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #2/213:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #2/231:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #2/231:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #2/312:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #2/312:failed|failed|  ok  |
[    0.000000]     hard-safe-A + unsafe-B #2/321:failed|failed|  ok  |
[    0.000000]     soft-safe-A + unsafe-B #2/321:failed|failed|  ok  |
[    0.000000]       hard-irq lock-inversion/123:failed|failed|  ok  |
[    0.000000]       soft-irq lock-inversion/123:failed|failed|  ok  |
[    0.000000]       hard-irq lock-inversion/132:failed|failed|  ok  |
[    0.000000]       soft-irq lock-inversion/132:failed|failed|  ok  |
[    0.000000]       hard-irq lock-inversion/213:failed|failed|  ok  |
[    0.000000]       soft-irq lock-inversion/213:failed|failed|  ok  |
[    0.000000]       hard-irq lock-inversion/231:failed|failed|  ok  |
[    0.000000]       soft-irq lock-inversion/231:failed|failed|  ok  |
[    0.000000]       hard-irq lock-inversion/312:failed|failed|  ok  |
[    0.000000]       soft-irq lock-inversion/312:failed|failed|  ok  |
[    0.000000]       hard-irq lock-inversion/321:failed|failed|  ok  |
[    0.000000]       soft-irq lock-inversion/321:failed|failed|  ok  |
[    0.000000]       hard-irq read-recursion/123:  ok  |
[    0.000000]       soft-irq read-recursion/123:  ok  |
[    0.000000]       hard-irq read-recursion/132:  ok  |
[    0.000000]       soft-irq read-recursion/132:  ok  |
[    0.000000]       hard-irq read-recursion/213:  ok  |
[    0.000000]       soft-irq read-recursion/213:  ok  |
[    0.000000]       hard-irq read-recursion/231:  ok  |
[    0.000000]       soft-irq read-recursion/231:  ok  |
[    0.000000]       hard-irq read-recursion/312:  ok  |
[    0.000000]       soft-irq read-recursion/312:  ok  |
[    0.000000]       hard-irq read-recursion/321:  ok  |
[    0.000000]       soft-irq read-recursion/321:  ok  |
[    0.000000] --------------------------------------------------------
[    0.000000] 133 out of 218 testcases failed, as expected. |
[    0.000000] ----------------------------------------------------
[    0.000000] Dentry cache hash table entries: 262144 (order: 8, 1048576 bytes)
[    0.000000] Inode-cache hash table entries: 131072 (order: 7, 524288 bytes)
[    0.000000] Memory: 2021684k/2087808k available (5436k kernel code, 64940k reserved, 2813k data, 652k init, 908160k highmem)
[    0.000000] virtual kernel memory layout:
[    0.000000]     fixmap  : 0xffee1000 - 0xfffff000   (1144 kB)
[    0.000000]     pkmap   : 0xff800000 - 0xffc00000   (4096 kB)
[    0.000000]     vmalloc : 0xf8800000 - 0xff7fe000   ( 111 MB)
[    0.000000]     lowmem  : 0xb0000000 - 0xf8000000   (1152 MB)
[    0.000000]       .init : 0xb0915000 - 0xb09b8000   ( 652 kB)
[    0.000000]       .data : 0xb064f021 - 0xb090e534   (2813 kB)
[    0.000000]       .text : 0xb0100000 - 0xb064f021   (5436 kB)
[    0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok.
[    0.000000] CPA: page pool initialized 1 of 1 pages preallocated
[    0.001000] Calibrating delay loop (skipped), value calculated using timer frequency.. <6>3657.48 BogoMIPS (lpj=1828742)
[    0.001000] Security Framework initialized
[    0.001000] Mount-cache hash table entries: 512
[    0.002000] Initializing cgroup subsys debug
[    0.002000] Initializing cgroup subsys ns
[    0.002000] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.002000] CPU: L2 cache: 2048K
[    0.002000] CPU: Physical Processor ID: 0
[    0.002000] CPU: Processor Core ID: 0
[    0.002000] Intel machine check architecture supported.
[    0.002000] Intel machine check reporting enabled on CPU#0.
[    0.002000] Checking 'hlt' instruction... OK.
[    0.009000] ACPI: Core revision 20080609
[    0.034000] Parsing all Control Methods:
[    0.036000] Table [DSDT](id 0001) - 1587 Objects with 76 Devices 433 Methods 26 Regions
[    0.037000] Parsing all Control Methods:
[    0.039000] Table [SSDT](id 0002) - 1 Objects with 0 Devices 1 Methods 0 Regions
[    0.039000] Parsing all Control Methods:
[    0.041000] Table [SSDT](id 0003) - 14 Objects with 0 Devices 5 Methods 0 Regions
[    0.042000] Parsing all Control Methods:
[    0.044000] Table [SSDT](id 0004) - 14 Objects with 1 Devices 2 Methods 0 Regions
[    0.044000]  tbxface-0596 [00] tb_load_namespace     : ACPI Tables successfully acquired
[    0.045000] evxfevnt-0091 [00] enable                : Transition to ACPI mode successful
[    0.046000] enabled ExtINT on CPU#0
[    0.046000] ESR value before enabling vector: 0x00000040  after: 0x00000000
[    0.046000] ENABLING IO-APIC IRQs
[    0.046000] init IO_APIC IRQs
[    0.046000]  IO-APIC (apicid-pin) 1-0 not connected.
[    0.047000]  IO-APIC (apicid-pin) 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22, 1-23 not connected.
[    0.047000] ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.059000] CPU0: Intel Genuine Intel(R) CPU           T2400  @ 1.83GHz stepping 08
[    0.060000] ++++++++++++++++++++=_---CPU UP  1
[    0.060000] lockdep: fixing up alternatives.
[    0.060000] CPU 1 irqstacks, hard=b09c4000 soft=b09bc000
[    0.060000] Booting processor 1/1 ip 6000
[    0.060000] Setting warm reset code and vector.
[    0.060000] 1.
[    0.061000] 2.
[    0.061000] 3.
[    0.061000] Asserting INIT.
[    0.061000] Waiting for send to finish...
[    0.072000] Deasserting INIT.
[    0.073000] Waiting for send to finish...
[    0.073000] #startup loops: 2.
[    0.073000] Sending STARTUP #1.
[    0.073000] After apic_write.
[    0.073000] Startup point 1.
[    0.073000] Waiting for send to finish...
[    0.073000] Initializing CPU#1
[    0.073000] CPU#1 (phys ID: 1) waiting for CALLOUT
[    0.074000] Sending STARTUP #2.
[    0.074000] After apic_write.
[    0.074000] Startup point 1.
[    0.074000] Waiting for send to finish...
[    0.075000] After Startup.
[    0.075000] Before Callout 1.
[    0.075000] After Callout 1.
[    0.075000] CALLIN, before setup_local_APIC().
[    0.075000] masked ExtINT on CPU#1
[    0.075000] Calibrating delay loop... <6>3186.68 BogoMIPS (lpj=1593344)
[    0.099000] Stack at about f7c7afac
[    0.099000] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.099000] CPU: L2 cache: 2048K
[    0.099000] CPU: Physical Processor ID: 0
[    0.099000] CPU: Processor Core ID: 1
[    0.099000] Intel machine check architecture supported.
[    0.099000] Intel machine check reporting enabled on CPU#1.
[    0.099000] OK.
[    0.100000] CPU1: Intel Genuine Intel(R) CPU           T2400  @ 1.83GHz stepping 08
[    0.100000] CPU has booted.
[    0.100000] checking TSC synchronization [CPU#0 -> CPU#1]:
[    0.100000] Measured 580415 cycles TSC warp between CPUs, turning off TSC clock.
[    0.100000] Marking TSC unstable due to check_tsc_sync_source failed
[    0.101000] Brought up 2 CPUs
[    0.101000] Boot done.
[    0.101000] Before bogomips.
[    0.101000] Total of 2 processors activated (6844.17 BogoMIPS).
[    0.101000] Before bogocount - setting activated=1.
[    0.102000] calling  net_ns_init+0x0/0x10a
[    0.102000] net_namespace: 728 bytes
[    0.102000] initcall net_ns_init+0x0/0x10a returned 0 after 0 msecs
[    0.102000] calling  reboot_init+0x0/0xc
[    0.102000] initcall reboot_init+0x0/0xc returned 0 after 0 msecs
[    0.102000] calling  print_banner+0x0/0xd
[    0.103000] Booting paravirtualized kernel on bare hardware
[    0.103000] initcall print_banner+0x0/0xd returned 0 after 0 msecs
[    0.103000] calling  sysctl_init+0x0/0x18
[    0.103000] initcall sysctl_init+0x0/0x18 returned 0 after 0 msecs
[    0.103000] calling  ksysfs_init+0x0/0x9b
[    0.103000] initcall ksysfs_init+0x0/0x9b returned 0 after 0 msecs
[    0.103000] calling  init_jiffies_clocksource+0x0/0x14
[    0.103000] initcall init_jiffies_clocksource+0x0/0x14 returned 0 after 0 msecs
[    0.104000] calling  pm_init+0x0/0x32
[    0.105000] initcall pm_init+0x0/0x32 returned 0 after 0 msecs
[    0.105000] calling  filelock_init+0x0/0x2c
[    0.105000] initcall filelock_init+0x0/0x2c returned 0 after 0 msecs
[    0.105000] calling  init_aout_binfmt+0x0/0x14
[    0.105000] initcall init_aout_binfmt+0x0/0x14 returned 0 after 0 msecs
[    0.105000] calling  init_script_binfmt+0x0/0x14
[    0.105000] initcall init_script_binfmt+0x0/0x14 returned 0 after 0 msecs
[    0.105000] calling  init_elf_binfmt+0x0/0x14
[    0.105000] initcall init_elf_binfmt+0x0/0x14 returned 0 after 0 msecs
[    0.106000] calling  debugfs_init+0x0/0x46
[    0.106000] initcall debugfs_init+0x0/0x46 returned 0 after 0 msecs
[    0.106000] calling  securityfs_init+0x0/0x46
[    0.106000] initcall securityfs_init+0x0/0x46 returned 0 after 0 msecs
[    0.106000] calling  random32_init+0x0/0x3f
[    0.106000] initcall random32_init+0x0/0x3f returned 0 after 0 msecs
[    0.106000] calling  sock_init+0x0/0x56
[    0.106000] initcall sock_init+0x0/0x56 returned 0 after 0 msecs
[    0.107000] calling  netpoll_init+0x0/0x3e
[    0.107000] initcall netpoll_init+0x0/0x3e returned 0 after 0 msecs
[    0.107000] calling  netlink_proto_init+0x0/0x10c
[    0.107000] NET: Registered protocol family 16
[    0.107000] initcall netlink_proto_init+0x0/0x10c returned 0 after 0 msecs
[    0.107000] calling  bdi_class_init+0x0/0x38
[    0.107000] initcall bdi_class_init+0x0/0x38 returned 0 after 0 msecs
[    0.108000] calling  kobject_uevent_init+0x0/0x3f
[    0.108000] initcall kobject_uevent_init+0x0/0x3f returned 0 after 0 msecs
[    0.108000] calling  pcibus_class_init+0x0/0x14
[    0.108000] initcall pcibus_class_init+0x0/0x14 returned 0 after 0 msecs
[    0.108000] calling  pci_driver_init+0x0/0x14
[    0.108000] initcall pci_driver_init+0x0/0x14 returned 0 after 0 msecs
[    0.108000] calling  backlight_class_init+0x0/0x42
[    0.109000] initcall backlight_class_init+0x0/0x42 returned 0 after 0 msecs
[    0.109000] calling  video_output_class_init+0x0/0x14
[    0.109000] initcall video_output_class_init+0x0/0x14 returned 0 after 0 msecs
[    0.109000] calling  dock_init+0x0/0x58
[    0.110000] ACPI: ACPI Dock Station Driver
[    0.110000] initcall dock_init+0x0/0x58 returned 0 after 0 msecs
[    0.111000] calling  tty_class_init+0x0/0x2c
[    0.111000] initcall tty_class_init+0x0/0x2c returned 0 after 0 msecs
[    0.111000] calling  vtconsole_class_init+0x0/0x9f
[    0.111000] initcall vtconsole_class_init+0x0/0x9f returned 0 after 0 msecs
[    0.111000] calling  enable_pci_io_ecs+0x0/0x30
[    0.111000] initcall enable_pci_io_ecs+0x0/0x30 returned 0 after 0 msecs
[    0.112000] calling  rdc_board_setup+0x0/0x1e
[    0.112000] initcall rdc_board_setup+0x0/0x1e returned 0 after 0 msecs
[    0.112000] calling  arch_kdebugfs_init+0x0/0x277
[    0.112000] initcall arch_kdebugfs_init+0x0/0x277 returned 0 after 0 msecs
[    0.112000] calling  init_pit_clocksource+0x0/0x8b
[    0.112000] initcall init_pit_clocksource+0x0/0x8b returned 0 after 0 msecs
[    0.112000] calling  mtrr_if_init+0x0/0x5b
[    0.113000] initcall mtrr_if_init+0x0/0x5b returned 0 after 0 msecs
[    0.113000] calling  acpi_pci_init+0x0/0x3d
[    0.113000] ACPI: bus type pci registered
[    0.113000] initcall acpi_pci_init+0x0/0x3d returned 0 after 0 msecs
[    0.113000] calling  init_acpi_device_notify+0x0/0x48
[    0.113000] initcall init_acpi_device_notify+0x0/0x48 returned 0 after 0 msecs
[    0.113000] calling  pci_arch_init+0x0/0x38
[    0.114000] PCI: PCI BIOS revision 2.10 entry at 0xfd84b, last bus=24
[    0.114000] initcall pci_arch_init+0x0/0x38 returned 0 after 0 msecs
[    0.114000] calling  topology_init+0x0/0x2d
[    0.114000] initcall topology_init+0x0/0x2d returned 0 after 0 msecs
[    0.114000] calling  mtrr_init_finialize+0x0/0x3a
[    0.114000] initcall mtrr_init_finialize+0x0/0x3a returned 0 after 0 msecs
[    0.114000] calling  param_sysfs_init+0x0/0x159
[    0.126000] initcall param_sysfs_init+0x0/0x159 returned 0 after 10 msecs
[    0.126000] calling  pm_sysrq_init+0x0/0x1b
[    0.126000] initcall pm_sysrq_init+0x0/0x1b returned 0 after 0 msecs
[    0.126000] calling  readahead_init+0x0/0x34
[    0.127000] initcall readahead_init+0x0/0x34 returned 0 after 0 msecs
[    0.127000] calling  init_bio+0x0/0xb0
[    0.127000] initcall init_bio+0x0/0xb0 returned 0 after 0 msecs
[    0.127000] calling  integrity_init+0x0/0x39
[    0.127000] initcall integrity_init+0x0/0x39 returned 0 after 0 msecs
[    0.127000] calling  blk_settings_init+0x0/0x22
[    0.127000] initcall blk_settings_init+0x0/0x22 returned 0 after 0 msecs
[    0.128000] calling  blk_ioc_init+0x0/0x29
[    0.128000] initcall blk_ioc_init+0x0/0x29 returned 0 after 0 msecs
[    0.128000] calling  genhd_device_init+0x0/0x37
[    0.128000] initcall genhd_device_init+0x0/0x37 returned 0 after 0 msecs
[    0.128000] calling  blk_dev_integrity_init+0x0/0x29
[    0.128000] initcall blk_dev_integrity_init+0x0/0x29 returned 0 after 0 msecs
[    0.128000] calling  pci_slot_init+0x0/0x40
[    0.129000] initcall pci_slot_init+0x0/0x40 returned 0 after 0 msecs
[    0.129000] calling  fbmem_init+0x0/0x78
[    0.129000] initcall fbmem_init+0x0/0x78 returned 0 after 0 msecs
[    0.129000] calling  acpi_init+0x0/0x21b
[    0.138000] evgpeblk-0957 [00] ev_create_gpe_block   : GPE 00 to 1F [_GPE] 4 regs on int 0x9
[    0.138000] ACPI: EC: EC description table is found, configuring boot EC
[    0.148000] Completing Region/Field/Buffer/Package initialization:.........................................................................................................................................................................................................................................................................................
[    0.168000] Initialized 26/26 Regions 142/142 Fields 64/64 Buffers 49/49 Packages (1625 nodes)
[    0.168000] Initializing Device/Processor/Thermal objects by executing _INI methods:...<6>ACPI: EC: non-query interrupt received, switching to interrupt mode
[    0.179000] ....
[    0.182000] Executed 7 _INI methods requiring 2 _STA executions (examined 83 objects)
[    0.183000] evgpeblk-1054 [00] ev_initialize_gpe_bloc: Found 8 Wake, Enabled 2 Runtime GPEs in this block
[    0.183000] ACPI: Interpreter enabled
[    0.183000] ACPI: (supports S0 S3 S5)
[    0.183000] ACPI: Using IOAPIC for interrupt routing
[    0.184000] initcall acpi_init+0x0/0x21b returned 0 after 52 msecs
[    0.184000] calling  acpi_scan_init+0x0/0xf2
[    0.214000] initcall acpi_scan_init+0x0/0xf2 returned 0 after 28 msecs
[    0.214000] calling  acpi_ec_init+0x0/0x5a
[    0.214000] ACPI: EC: GPE = 0x1c, I/O: command/status = 0x66, data = 0x62
[    0.214000] ACPI: EC: driver started in interrupt mode
[    0.215000] initcall acpi_ec_init+0x0/0x5a returned 0 after 0 msecs
[    0.215000] calling  acpi_pci_root_init+0x0/0x2a
[    0.215000] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    0.215000] PCI: 0000:00:02.0 reg 10 32bit mmio: [ee100000, ee17ffff]
[    0.216000] PCI: 0000:00:02.0 reg 14 io port: [1800, 1807]
[    0.216000] PCI: 0000:00:02.0 reg 18 32bit mmio: [d0000000, dfffffff]
[    0.216000] PCI: 0000:00:02.0 reg 1c 32bit mmio: [ee200000, ee23ffff]
[    0.216000] PCI: 0000:00:02.1 reg 10 32bit mmio: [ee180000, ee1fffff]
[    0.216000] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    0.216000] pci 0000:00:1b.0: PME# disabled
[    0.217000] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.217000] pci 0000:00:1c.0: PME# disabled
[    0.217000] pci 0000:00:1c.1: PME# supported from D0 D3hot D3cold
[    0.217000] pci 0000:00:1c.1: PME# disabled
[    0.217000] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold
[    0.217000] pci 0000:00:1c.2: PME# disabled
[    0.218000] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[    0.218000] pci 0000:00:1c.3: PME# disabled
[    0.218000] PCI: 0000:00:1d.0 reg 20 io port: [1820, 183f]
[    0.218000] PCI: 0000:00:1d.1 reg 20 io port: [1840, 185f]
[    0.218000] PCI: 0000:00:1d.2 reg 20 io port: [1860, 187f]
[    0.219000] PCI: 0000:00:1d.3 reg 20 io port: [1880, 189f]
[    0.219000] PCI: 0000:00:1d.7 reg 10 32bit mmio: [ee444000, ee4443ff]
[    0.219000] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    0.219000] pci 0000:00:1d.7: PME# disabled
[    0.219000] pci 0000:00:1f.0: quirk: region 1000-107f claimed by ICH6 ACPI/GPIO/TCO
[    0.220000] pci 0000:00:1f.0: quirk: region 1180-11bf claimed by ICH6 GPIO
[    0.220000] PCI: 0000:00:1f.1 reg 10 io port: [0, 7]
[    0.220000] PCI: 0000:00:1f.1 reg 14 io port: [0, 3]
[    0.220000] PCI: 0000:00:1f.1 reg 18 io port: [0, 7]
[    0.220000] PCI: 0000:00:1f.1 reg 1c io port: [0, 3]
[    0.220000] PCI: 0000:00:1f.1 reg 20 io port: [1810, 181f]
[    0.220000] PCI: 0000:00:1f.2 reg 10 io port: [18d0, 18d7]
[    0.220000] PCI: 0000:00:1f.2 reg 14 io port: [18c4, 18c7]
[    0.221000] PCI: 0000:00:1f.2 reg 18 io port: [18c8, 18cf]
[    0.221000] PCI: 0000:00:1f.2 reg 1c io port: [18c0, 18c3]
[    0.221000] PCI: 0000:00:1f.2 reg 20 io port: [18b0, 18bf]
[    0.221000] PCI: 0000:00:1f.2 reg 24 32bit mmio: [ee444400, ee4447ff]
[    0.221000] pci 0000:00:1f.2: PME# supported from D3hot
[    0.221000] pci 0000:00:1f.2: PME# disabled
[    0.221000] PCI: 0000:00:1f.3 reg 20 io port: [18e0, 18ff]
[    0.222000] PCI: 0000:02:00.0 reg 10 32bit mmio: [ee000000, ee01ffff]
[    0.222000] PCI: 0000:02:00.0 reg 18 io port: [2000, 201f]
[    0.222000] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    0.222000] pci 0000:02:00.0: PME# disabled
[    0.222000] PCI: bridge 0000:00:1c.0 io port: [2000, 2fff]
[    0.223000] PCI: bridge 0000:00:1c.0 32bit mmio: [ee000000, ee0fffff]
[    0.223000] PCI: 0000:03:00.0 reg 10 32bit mmio: [edf00000, edf00fff]
[    0.223000] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[    0.224000] pci 0000:03:00.0: PME# disabled
[    0.224000] PCI: bridge 0000:00:1c.1 io port: [3000, 4fff]
[    0.224000] PCI: bridge 0000:00:1c.1 32bit mmio: [ec000000, edffffff]
[    0.224000] PCI: bridge 0000:00:1c.1 64bit mmio pref: [e4000000, e40fffff]
[    0.224000] PCI: bridge 0000:00:1c.2 io port: [5000, 6fff]
[    0.224000] PCI: bridge 0000:00:1c.2 32bit mmio: [e8000000, e9ffffff]
[    0.224000] PCI: bridge 0000:00:1c.2 64bit mmio pref: [e4100000, e41fffff]
[    0.224000] PCI: bridge 0000:00:1c.3 io port: [7000, 8fff]
[    0.225000] PCI: bridge 0000:00:1c.3 32bit mmio: [ea000000, ebffffff]
[    0.225000] PCI: bridge 0000:00:1c.3 64bit mmio pref: [e4200000, e42fffff]
[    0.225000] PCI: 0000:15:00.0 reg 10 32bit mmio: [e4300000, e4300fff]
[    0.225000] pci 0000:15:00.0: supports D1
[    0.225000] pci 0000:15:00.0: supports D2
[    0.225000] pci 0000:15:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.226000] pci 0000:15:00.0: PME# disabled
[    0.226000] pci 0000:00:1e.0: transparent bridge
[    0.226000] PCI: bridge 0000:00:1e.0 io port: [9000, cfff]
[    0.227000] PCI: bridge 0000:00:1e.0 32bit mmio: [e4300000, e7ffffff]
[    0.227000] PCI: bridge 0000:00:1e.0 64bit mmio pref: [e0000000, e3ffffff]
[    0.227000] bus 00 -> node 0
[    0.227000] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    0.227000] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP0._PRT]
[    0.228000] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP1._PRT]
[    0.228000] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP2._PRT]
[    0.229000] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP3._PRT]
[    0.229000] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI1._PRT]
[    0.241000] initcall acpi_pci_root_init+0x0/0x2a returned 0 after 24 msecs
[    0.242000] calling  acpi_pci_link_init+0x0/0x48
[    0.242000] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11)
[    0.243000] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 *11)
[    0.244000] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 *11)
[    0.245000] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11)
[    0.246000] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11)
[    0.246000] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 *11)
[    0.247000] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 *11)
[    0.248000] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 *11)
[    0.249000] initcall acpi_pci_link_init+0x0/0x48 returned 0 after 6 msecs
[    0.249000] calling  acpi_power_init+0x0/0x6e
[    0.250000] ACPI: Power Resource [PUBS] (on)
[    0.250000] initcall acpi_power_init+0x0/0x6e returned 0 after 0 msecs
[    0.250000] calling  acpi_system_init+0x0/0x209
[    0.251000] initcall acpi_system_init+0x0/0x209 returned 0 after 0 msecs
[    0.251000] calling  acpi_debug_init+0x0/0x9e
[    0.251000] initcall acpi_debug_init+0x0/0x9e returned 0 after 0 msecs
[    0.251000] calling  acpi_cm_sbs_init+0x0/0xc
[    0.251000] initcall acpi_cm_sbs_init+0x0/0xc returned 0 after 0 msecs
[    0.251000] calling  pnp_init+0x0/0x1e
[    0.251000] Linux Plug and Play Support v0.97 (c) Adam Belay
[    0.252000] initcall pnp_init+0x0/0x1e returned 0 after 0 msecs
[    0.252000] calling  pnpacpi_init+0x0/0x80
[    0.252000] pnp: PnP ACPI init
[    0.252000] ACPI: bus type pnp registered
[    0.262000] pnp: PnP ACPI: found 11 devices
[    0.262000] ACPI: ACPI bus type pnp unregistered
[    0.262000] initcall pnpacpi_init+0x0/0x80 returned 0 after 9 msecs
[    0.262000] calling  pnpbios_init+0x0/0x313
[    0.262000] PnPBIOS: Disabled by ACPI PNP
[    0.262000] initcall pnpbios_init+0x0/0x313 returned -19 after 0 msecs
[    0.262000] calling  misc_init+0x0/0x84
[    0.262000] initcall misc_init+0x0/0x84 returned 0 after 0 msecs
[    0.263000] calling  tifm_init+0x0/0x72
[    0.263000] initcall tifm_init+0x0/0x72 returned 0 after 0 msecs
[    0.263000] calling  phy_init+0x0/0x2e
[    0.263000] initcall phy_init+0x0/0x2e returned 0 after 0 msecs
[    0.263000] calling  init_scsi+0x0/0x7e
[    0.264000] SCSI subsystem initialized
[    0.264000] initcall init_scsi+0x0/0x7e returned 0 after 0 msecs
[    0.264000] calling  ata_init+0x0/0x2a9
[    0.264000] libata version 3.00 loaded.
[    0.265000] initcall ata_init+0x0/0x2a9 returned 0 after 0 msecs
[    0.265000] calling  usb_init+0x0/0x112
[    0.265000] usbcore: registered new interface driver usbfs
[    0.265000] usbcore: registered new interface driver hub
[    0.265000] usbcore: registered new device driver usb
[    0.266000] initcall usb_init+0x0/0x112 returned 0 after 0 msecs
[    0.266000] calling  serio_init+0x0/0x87
[    0.266000] initcall serio_init+0x0/0x87 returned 0 after 0 msecs
[    0.266000] calling  gameport_init+0x0/0x87
[    0.266000] initcall gameport_init+0x0/0x87 returned 0 after 0 msecs
[    0.266000] calling  input_init+0x0/0xe2
[    0.267000] initcall input_init+0x0/0xe2 returned 0 after 0 msecs
[    0.267000] calling  i2c_init+0x0/0x54
[    0.267000] initcall i2c_init+0x0/0x54 returned 0 after 0 msecs
[    0.267000] calling  power_supply_class_init+0x0/0x2e
[    0.267000] initcall power_supply_class_init+0x0/0x2e returned 0 after 0 msecs
[    0.268000] calling  mmc_init+0x0/0x70
[    0.268000] initcall mmc_init+0x0/0x70 returned 0 after 0 msecs
[    0.268000] calling  leds_init+0x0/0x2c
[    0.268000] initcall leds_init+0x0/0x2c returned 0 after 0 msecs
[    0.268000] calling  pci_subsys_init+0x0/0xeb
[    0.268000] PCI: Using ACPI for IRQ routing
[    0.269000] number of MP IRQ sources: 15.
[    0.269000] number of IO-APIC #1 registers: 24.
[    0.269000] testing the IO APIC.......................
[    0.269000] IO APIC #1......
[    0.269000] .... register #00: 02000000
[    0.269000] .......    : physical APIC id: 02
[    0.269000] .......    : Delivery Type: 0
[    0.269000] .......    : LTS          : 0
[    0.269000] .... register #01: 00170020
[    0.269000] .......     : max redirection entries: 0017
[    0.269000] .......     : PRQ implemented: 0
[    0.270000] .......     : IO APIC version: 0020
[    0.270000] .... IRQ redirection table:
[    0.270000]  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
[    0.270000]  00 000 00  1    0    0   0   0    0    0    00
[    0.270000]  01 003 03  1    0    0   0   0    1    1    39
[    0.270000]  02 003 03  0    0    0   0   0    1    1    31
[    0.270000]  03 003 03  1    0    0   0   0    1    1    41
[    0.270000]  04 003 03  0    0    0   0   0    1    1    49
[    0.271000]  05 003 03  0    0    0   0   0    1    1    51
[    0.271000]  06 003 03  0    0    0   0   0    1    1    59
[    0.271000]  07 003 03  0    0    0   0   0    1    1    61
[    0.271000]  08 003 03  1    0    0   0   0    1    1    69
[    0.271000]  09 003 03  0    1    0   0   0    1    1    71
[    0.271000]  0a 003 03  0    0    0   0   0    1    1    79
[    0.271000]  0b 003 03  0    0    0   0   0    1    1    81
[    0.271000]  0c 003 03  1    0    0   0   0    1    1    89
[    0.272000]  0d 003 03  1    0    0   0   0    1    1    91
[    0.272000]  0e 003 03  0    0    0   0   0    1    1    99
[    0.272000]  0f 003 03  0    0    0   0   0    1    1    A1
[    0.272000]  10 000 00  1    0    0   0   0    0    0    00
[    0.272000]  11 000 00  1    0    0   0   0    0    0    00
[    0.272000]  12 000 00  1    0    0   0   0    0    0    00
[    0.272000]  13 000 00  1    0    0   0   0    0    0    00
[    0.273000]  14 000 00  1    0    0   0   0    0    0    00
[    0.273000]  15 000 00  1    0    0   0   0    0    0    00
[    0.273000]  16 000 00  1    0    0   0   0    0    0    00
[    0.273000]  17 000 00  1    0    0   0   0    0    0    00
[    0.273000] IRQ to pin mappings:
[    0.273000] IRQ0 -> 0:2
[    0.273000] IRQ1 -> 0:1
[    0.274000] IRQ3 -> 0:3
[    0.274000] IRQ4 -> 0:4
[    0.274000] IRQ5 -> 0:5
[    0.274000] IRQ6 -> 0:6
[    0.274000] IRQ7 -> 0:7
[    0.274000] IRQ8 -> 0:8
[    0.275000] IRQ9 -> 0:9
[    0.275000] IRQ10 -> 0:10
[    0.275000] IRQ11 -> 0:11
[    0.275000] IRQ12 -> 0:12
[    0.275000] IRQ13 -> 0:13
[    0.275000] IRQ14 -> 0:14
[    0.276000] IRQ15 -> 0:15
[    0.276000] .................................... done.
[    0.276000] initcall pci_subsys_init+0x0/0xeb returned 0 after 7 msecs
[    0.276000] calling  proto_init+0x0/0x2c
[    0.277000] initcall proto_init+0x0/0x2c returned 0 after 0 msecs
[    0.277000] calling  net_dev_init+0x0/0x134
[    0.277000] initcall net_dev_init+0x0/0x134 returned 0 after 0 msecs
[    0.277000] calling  neigh_init+0x0/0x6b
[    0.277000] initcall neigh_init+0x0/0x6b returned 0 after 0 msecs
[    0.277000] calling  fib_rules_init+0x0/0x9e
[    0.277000] initcall fib_rules_init+0x0/0x9e returned 0 after 0 msecs
[    0.277000] calling  genl_init+0x0/0xb5
[    0.278000] initcall genl_init+0x0/0xb5 returned 0 after 0 msecs
[    0.278000] calling  cipso_v4_init+0x0/0x72
[    0.278000] initcall cipso_v4_init+0x0/0x72 returned 0 after 0 msecs
[    0.278000] calling  wanrouter_init+0x0/0x47
[    0.278000] Sangoma WANPIPE Router v1.1 (c) 1995-2000 Sangoma Technologies Inc.
[    0.278000] initcall wanrouter_init+0x0/0x47 returned 0 after 0 msecs
[    0.278000] calling  irda_init+0x0/0x8d
[    0.278000] NET: Registered protocol family 23
[    0.279000] initcall irda_init+0x0/0x8d returned 0 after 0 msecs
[    0.279000] calling  atm_init+0x0/0xa1
[    0.279000] NET: Registered protocol family 8
[    0.279000] NET: Registered protocol family 20
[    0.279000] initcall atm_init+0x0/0xa1 returned 0 after 0 msecs
[    0.279000] calling  wireless_nlevent_init+0x0/0x3e
[    0.279000] initcall wireless_nlevent_init+0x0/0x3e returned 0 after 0 msecs
[    0.279000] calling  netlbl_init+0x0/0x72
[    0.280000] NetLabel: Initializing
[    0.280000] NetLabel:  domain hash size = 128
[    0.280000] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.280000] NetLabel:  unlabeled traffic allowed by default
[    0.280000] initcall netlbl_init+0x0/0x72 returned 0 after 0 msecs
[    0.280000] calling  sysctl_init+0x0/0x28
[    0.280000] initcall sysctl_init+0x0/0x28 returned 0 after 0 msecs
[    0.280000] calling  pci_iommu_init+0x0/0x11
[    0.280000] initcall pci_iommu_init+0x0/0x11 returned 0 after 0 msecs
[    0.281000] calling  init_kmmio+0x0/0x28
[    0.281000] initcall init_kmmio+0x0/0x28 returned 0 after 0 msecs
[    0.281000] calling  clocksource_done_booting+0x0/0x16
[    0.281000] initcall clocksource_done_booting+0x0/0x16 returned 0 after 0 msecs
[    0.281000] calling  tracer_alloc_buffers+0x0/0x47b
[    0.283000] tracer: 772 pages allocated for 65536 entries of 48 bytes
[    0.283000]    actual entries 65620
[    0.283000] initcall tracer_alloc_buffers+0x0/0x47b returned 0 after 1 msecs
[    0.283000] calling  init_pipe_fs+0x0/0x46
[    0.283000] initcall init_pipe_fs+0x0/0x46 returned 0 after 0 msecs
[    0.284000] calling  init_mnt_writers+0x0/0x66
[    0.284000] initcall init_mnt_writers+0x0/0x66 returned 0 after 0 msecs
[    0.285000] calling  eventpoll_init+0x0/0x82
[    0.285000] initcall eventpoll_init+0x0/0x82 returned 0 after 0 msecs
[    0.285000] calling  anon_inode_init+0x0/0xe4
[    0.285000] initcall anon_inode_init+0x0/0xe4 returned 0 after 0 msecs
[    0.285000] calling  acpi_event_init+0x0/0x74
[    0.285000] initcall acpi_event_init+0x0/0x74 returned 0 after 0 msecs
[    0.285000] calling  pnp_system_init+0x0/0x14
[    0.286000] system 00:00: iomem range 0x0-0x9ffff could not be reserved
[    0.286000] system 00:00: iomem range 0xc0000-0xc3fff could not be reserved
[    0.286000] system 00:00: iomem range 0xc4000-0xc7fff could not be reserved
[    0.286000] system 00:00: iomem range 0xc8000-0xcbfff has been reserved
[    0.286000] system 00:00: iomem range 0xcc000-0xcffff could not be reserved
[    0.286000] system 00:00: iomem range 0xd0000-0xd3fff could not be reserved
[    0.286000] system 00:00: iomem range 0xdc000-0xdffff could not be reserved
[    0.286000] system 00:00: iomem range 0xe0000-0xe3fff could not be reserved
[    0.286000] system 00:00: iomem range 0xe4000-0xe7fff could not be reserved
[    0.286000] system 00:00: iomem range 0xe8000-0xebfff could not be reserved
[    0.286000] system 00:00: iomem range 0xec000-0xeffff could not be reserved
[    0.287000] system 00:00: iomem range 0xf0000-0xfffff could not be reserved
[    0.287000] system 00:00: iomem range 0x100000-0x7fffffff could not be reserved
[    0.287000] system 00:00: iomem range 0xfec00000-0xffffffff could not be reserved
[    0.287000] system 00:02: ioport range 0x164e-0x164f has been reserved
[    0.287000] system 00:02: ioport range 0x1000-0x107f has been reserved
[    0.287000] system 00:02: ioport range 0x1180-0x11bf has been reserved
[    0.287000] system 00:02: ioport range 0x800-0x80f has been reserved
[    0.287000] system 00:02: ioport range 0x15e0-0x15ef has been reserved
[    0.287000] system 00:02: ioport range 0x1600-0x165f could not be reserved
[    0.288000] system 00:02: iomem range 0xf0000000-0xf3ffffff could not be reserved
[    0.288000] system 00:02: iomem range 0xfed1c000-0xfed1ffff could not be reserved
[    0.288000] system 00:02: iomem range 0xfed14000-0xfed17fff could not be reserved
[    0.288000] system 00:02: iomem range 0xfed18000-0xfed18fff could not be reserved
[    0.288000] system 00:02: iomem range 0xfed19000-0xfed19fff could not be reserved
[    0.288000] initcall pnp_system_init+0x0/0x14 returned 0 after 2 msecs
[    0.289000] calling  chr_dev_init+0x0/0x8b
[    0.289000] initcall chr_dev_init+0x0/0x8b returned 0 after 0 msecs
[    0.290000] calling  firmware_class_init+0x0/0x61
[    0.290000] initcall firmware_class_init+0x0/0x61 returned 0 after 0 msecs
[    0.290000] calling  loopback_init+0x0/0x14
[    0.290000] initcall loopback_init+0x0/0x14 returned 0 after 0 msecs
[    0.290000] calling  init_acpi_pm_clocksource+0x0/0x150
[    0.321000] PM-Timer running at invalid rate: 87% of normal - aborting.
[    0.321000] initcall init_acpi_pm_clocksource+0x0/0x150 returned -19 after 28 msecs
[    0.321000] calling  pcibios_assign_resources+0x0/0x96
[    0.321000] pci 0000:00:1c.0: PCI bridge, secondary bus 0000:02
[    0.321000] pci 0000:00:1c.0:   IO window: 0x2000-0x2fff
[    0.321000] pci 0000:00:1c.0:   MEM window: 0xee000000-0xee0fffff
[    0.321000] pci 0000:00:1c.0:   PREFETCH window: disabled
[    0.321000] pci 0000:00:1c.1: PCI bridge, secondary bus 0000:03
[    0.321000] pci 0000:00:1c.1:   IO window: 0x3000-0x4fff
[    0.322000] pci 0000:00:1c.1:   MEM window: 0xec000000-0xedffffff
[    0.322000] pci 0000:00:1c.1:   PREFETCH window: 0x000000e4000000-0x000000e40fffff
[    0.322000] pci 0000:00:1c.2: PCI bridge, secondary bus 0000:04
[    0.322000] pci 0000:00:1c.2:   IO window: 0x5000-0x6fff
[    0.322000] pci 0000:00:1c.2:   MEM window: 0xe8000000-0xe9ffffff
[    0.322000] pci 0000:00:1c.2:   PREFETCH window: 0x000000e4100000-0x000000e41fffff
[    0.322000] pci 0000:00:1c.3: PCI bridge, secondary bus 0000:0c
[    0.322000] pci 0000:00:1c.3:   IO window: 0x7000-0x8fff
[    0.322000] pci 0000:00:1c.3:   MEM window: 0xea000000-0xebffffff
[    0.323000] pci 0000:00:1c.3:   PREFETCH window: 0x000000e4200000-0x000000e42fffff
[    0.323000] pci 0000:15:00.0: CardBus bridge, secondary bus 0000:16
[    0.323000] pci 0000:15:00.0:   IO window: 0x009000-0x0090ff
[    0.323000] pci 0000:15:00.0:   IO window: 0x009400-0x0094ff
[    0.323000] pci 0000:15:00.0:   PREFETCH window: 0xe0000000-0xe3ffffff
[    0.323000] pci 0000:15:00.0:   MEM window: 0x88000000-0x8bffffff
[    0.323000] pci 0000:00:1e.0: PCI bridge, secondary bus 0000:15
[    0.323000] pci 0000:00:1e.0:   IO window: 0x9000-0xcfff
[    0.323000] pci 0000:00:1e.0:   MEM window: 0xe4300000-0xe7ffffff
[    0.324000] pci 0000:00:1e.0:   PREFETCH window: 0x000000e0000000-0x000000e3ffffff
[    0.324000] pci 0000:00:1c.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
[    0.324000] PCI: Setting latency timer of device 0000:00:1c.0 to 64
[    0.324000] pci 0000:00:1c.1: PCI INT B -> GSI 21 (level, low) -> IRQ 21
[    0.324000] PCI: Setting latency timer of device 0000:00:1c.1 to 64
[    0.324000] pci 0000:00:1c.2: PCI INT C -> GSI 22 (level, low) -> IRQ 22
[    0.324000] PCI: Setting latency timer of device 0000:00:1c.2 to 64
[    0.324000] pci 0000:00:1c.3: PCI INT D -> GSI 23 (level, low) -> IRQ 23
[    0.324000] PCI: Setting latency timer of device 0000:00:1c.3 to 64
[    0.325000] pci 0000:00:1e.0: enabling device (0005 -> 0007)
[    0.325000] PCI: Setting latency timer of device 0000:00:1e.0 to 64
[    0.325000] vendor=8086 device=2448
[    0.325000] pci 0000:15:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    0.325000] bus: 00 index 0 io port: [0, ffff]
[    0.325000] bus: 00 index 1 mmio: [0, ffffffffffffffff]
[    0.325000] bus: 02 index 0 io port: [2000, 2fff]
[    0.325000] bus: 02 index 1 mmio: [ee000000, ee0fffff]
[    0.325000] bus: 02 index 2 mmio: [0, 0]
[    0.325000] bus: 02 index 3 mmio: [0, 0]
[    0.326000] bus: 03 index 0 io port: [3000, 4fff]
[    0.326000] bus: 03 index 1 mmio: [ec000000, edffffff]
[    0.326000] bus: 03 index 2 mmio: [e4000000, e40fffff]
[    0.326000] bus: 03 index 3 mmio: [0, 0]
[    0.326000] bus: 04 index 0 io port: [5000, 6fff]
[    0.326000] bus: 04 index 1 mmio: [e8000000, e9ffffff]
[    0.326000] bus: 04 index 2 mmio: [e4100000, e41fffff]
[    0.326000] bus: 04 index 3 mmio: [0, 0]
[    0.326000] bus: 0c index 0 io port: [7000, 8fff]
[    0.326000] bus: 0c index 1 mmio: [ea000000, ebffffff]
[    0.326000] bus: 0c index 2 mmio: [e4200000, e42fffff]
[    0.327000] bus: 0c index 3 mmio: [0, 0]
[    0.327000] bus: 15 index 0 io port: [9000, cfff]
[    0.327000] bus: 15 index 1 mmio: [e4300000, e7ffffff]
[    0.327000] bus: 15 index 2 mmio: [e0000000, e3ffffff]
[    0.327000] bus: 15 index 3 io port: [0, ffff]
[    0.327000] bus: 15 index 4 mmio: [0, ffffffffffffffff]
[    0.327000] bus: 16 index 0 io port: [9000, 90ff]
[    0.327000] bus: 16 index 1 io port: [9400, 94ff]
[    0.327000] bus: 16 index 2 mmio: [e0000000, e3ffffff]
[    0.327000] bus: 16 index 3 mmio: [88000000, 8bffffff]
[    0.327000] initcall pcibios_assign_resources+0x0/0x96 returned 0 after 5 msecs
[    0.328000] calling  inet_init+0x0/0x376
[    0.328000] NET: Registered protocol family 2
[    0.328000] IP route cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.329000] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    0.331000] TCP bind hash table entries: 65536 (order: 9, 2359296 bytes)
[    0.335000] TCP: Hash tables configured (established 262144 bind 65536)
[    0.336000] TCP reno registered
[    0.336000] initcall inet_init+0x0/0x376 returned 0 after 7 msecs
[    0.336000] calling  af_unix_init+0x0/0x4c
[    0.336000] NET: Registered protocol family 1
[    0.336000] initcall af_unix_init+0x0/0x4c returned 0 after 0 msecs
[    0.336000] calling  default_rootfs+0x0/0x68
[    0.336000] initcall default_rootfs+0x0/0x68 returned 0 after 0 msecs
[    0.337000] calling  vmx_init+0x0/0x1d7
[    0.337000] initcall vmx_init+0x0/0x1d7 returned 0 after 0 msecs
[    0.338000] calling  svm_init+0x0/0x1b
[    0.338000] kvm: already loaded the other module
[    0.338000] initcall svm_init+0x0/0x1b returned -17 after 0 msecs
[    0.338000] initcall svm_init+0x0/0x1b returned with error code -17 
[    0.338000] calling  i8259A_init_sysfs+0x0/0x22
[    0.338000] initcall i8259A_init_sysfs+0x0/0x22 returned 0 after 0 msecs
[    0.339000] calling  sbf_init+0x0/0xc2
[    0.339000] Simple Boot Flag at 0x35 set to 0x1
[    0.339000] initcall sbf_init+0x0/0xc2 returned 0 after 0 msecs
[    0.339000] calling  i8237A_init_sysfs+0x0/0x22
[    0.339000] initcall i8237A_init_sysfs+0x0/0x22 returned 0 after 0 msecs
[    0.339000] calling  add_rtc_cmos+0x0/0x1a
[    0.339000] initcall add_rtc_cmos+0x0/0x1a returned 0 after 0 msecs
[    0.340000] calling  cache_sysfs_init+0x0/0x4c
[    0.340000] initcall cache_sysfs_init+0x0/0x4c returned 0 after 0 msecs
[    0.341000] calling  thermal_throttle_init_device+0x0/0x6e
[    0.341000] initcall thermal_throttle_init_device+0x0/0x6e returned 0 after 0 msecs
[    0.341000] calling  msr_init+0x0/0xcb
[    0.341000] initcall msr_init+0x0/0xcb returned 0 after 0 msecs
[    0.341000] calling  microcode_init+0x0/0xa7
[    0.341000] IA-32 Microcode Update Driver: v1.14a <tigran@aivazian.fsnet.co.uk>
[    0.342000] initcall microcode_init+0x0/0xa7 returned 0 after 0 msecs
[    0.342000] calling  init_lapic_sysfs+0x0/0x2d
[    0.342000] initcall init_lapic_sysfs+0x0/0x2d returned 0 after 0 msecs
[    0.342000] calling  ioapic_init_sysfs+0x0/0x89
[    0.343000] initcall ioapic_init_sysfs+0x0/0x89 returned 0 after 0 msecs
[    0.343000] calling  add_pcspkr+0x0/0x3a
[    0.343000] initcall add_pcspkr+0x0/0x3a returned 0 after 0 msecs
[    0.343000] calling  init+0x0/0x14
[    0.343000] initcall init+0x0/0x14 returned 0 after 0 msecs
[    0.343000] calling  init+0x0/0x14
[    0.343000] initcall init+0x0/0x14 returned 0 after 0 msecs
[    0.344000] calling  create_proc_profile+0x0/0x170
[    0.344000] initcall create_proc_profile+0x0/0x170 returned 0 after 0 msecs
[    0.344000] calling  ioresources_init+0x0/0x36
[    0.344000] initcall ioresources_init+0x0/0x36 returned 0 after 0 msecs
[    0.344000] calling  uid_cache_init+0x0/0x63
[    0.344000] initcall uid_cache_init+0x0/0x63 returned 0 after 0 msecs
[    0.344000] calling  init_posix_timers+0x0/0x81
[    0.345000] initcall init_posix_timers+0x0/0x81 returned 0 after 0 msecs
[    0.345000] calling  init_posix_cpu_timers+0x0/0x95
[    0.346000] initcall init_posix_cpu_timers+0x0/0x95 returned 0 after 0 msecs
[    0.346000] calling  nsproxy_cache_init+0x0/0x2c
[    0.346000] initcall nsproxy_cache_init+0x0/0x2c returned 0 after 0 msecs
[    0.346000] calling  timekeeping_init_device+0x0/0x22
[    0.346000] initcall timekeeping_init_device+0x0/0x22 returned 0 after 0 msecs
[    0.346000] calling  init_clocksource_sysfs+0x0/0x48
[    0.347000] initcall init_clocksource_sysfs+0x0/0x48 returned 0 after 0 msecs
[    0.347000] calling  init_timer_list_procfs+0x0/0x2c
[    0.347000] initcall init_timer_list_procfs+0x0/0x2c returned 0 after 0 msecs
[    0.347000] calling  lockdep_proc_init+0x0/0x4f
[    0.347000] initcall lockdep_proc_init+0x0/0x4f returned 0 after 0 msecs
[    0.347000] calling  futex_init+0x0/0x74
[    0.347000] initcall futex_init+0x0/0x74 returned 0 after 0 msecs
[    0.347000] calling  proc_dma_init+0x0/0x21
[    0.348000] initcall proc_dma_init+0x0/0x21 returned 0 after 0 msecs
[    0.348000] calling  percpu_modinit+0x0/0x69
[    0.348000] initcall percpu_modinit+0x0/0x69 returned 0 after 0 msecs
[    0.348000] calling  kallsyms_init+0x0/0x24
[    0.348000] initcall kallsyms_init+0x0/0x24 returned 0 after 0 msecs
[    0.348000] calling  init_kprobes+0x0/0x101
[    0.353000] Kprobe smoke test started
[    0.356000] Kprobe smoke test passed successfully
[    0.356000] initcall init_kprobes+0x0/0x101 returned 0 after 7 msecs
[    0.356000] calling  rcu_torture_init+0x0/0x562
[    0.356000] rcu-torture:--- Start of test: nreaders=4 nfakewriters=4 stat_interval=0 verbose=0 test_no_idle_hz=0 shuffle_interval=3 stutter=5 irqreader=1
[    0.357000] initcall rcu_torture_init+0x0/0x562 returned 0 after 0 msecs
[    0.357000] calling  relay_init+0x0/0x16
[    0.357000] initcall relay_init+0x0/0x16 returned 0 after 0 msecs
[    0.357000] calling  utsname_sysctl_init+0x0/0x16
[    0.357000] initcall utsname_sysctl_init+0x0/0x16 returned 0 after 0 msecs
[    0.357000] calling  init_sched_switch_trace+0x0/0x38
[    0.357000] Testing tracer sched_switch: PASSED
[    0.459000] initcall init_sched_switch_trace+0x0/0x38 returned 0 after 97 msecs
[    0.459000] calling  init_function_trace+0x0/0xf
[    0.459000] Testing tracer ftrace: PASSED
[    0.565500] initcall init_function_trace+0x0/0xf returned 0 after 101 msecs
[    0.565500] calling  init_irqsoff_tracer+0x0/0x11
[    0.565500] Testing tracer preemptoff: .. no entries found ..FAILED!
[    0.566500] initcall init_irqsoff_tracer+0x0/0x11 returned 0 after 0 msecs
[    0.567500] calling  init_wakeup_tracer+0x0/0xf
[    0.567500] Testing tracer wakeup: .. no entries found ..FAILED!
[    0.769500] initcall init_wakeup_tracer+0x0/0xf returned -1 after 192 msecs
[    0.769500] initcall init_wakeup_tracer+0x0/0xf returned with error code -1 
[    0.769500] calling  init_mmio_trace+0x0/0xf
[    0.769500] initcall init_mmio_trace+0x0/0xf returned 0 after 0 msecs
[    0.769500] calling  init_per_zone_pages_min+0x0/0x4d
[    0.769500] initcall init_per_zone_pages_min+0x0/0x4d returned 0 after 0 msecs
[    0.770500] calling  pdflush_init+0x0/0x1b
[    0.770500] initcall pdflush_init+0x0/0x1b returned 0 after 0 msecs
[    0.770500] calling  kswapd_init+0x0/0x22
[    0.770500] initcall kswapd_init+0x0/0x22 returned 0 after 0 msecs
[    0.770500] calling  setup_vmstat+0x0/0x3c
[    0.770500] initcall setup_vmstat+0x0/0x3c returned 0 after 0 msecs
[    0.770500] calling  init_emergency_pool+0x0/0x5d
[    0.770500] highmem bounce pool size: 64 pages
[    0.771500] initcall init_emergency_pool+0x0/0x5d returned 0 after 0 msecs
[    0.771500] calling  init_tmpfs+0x0/0xbe
[    0.771500] initcall init_tmpfs+0x0/0xbe returned 0 after 0 msecs
[    0.771500] calling  cpucache_init+0x0/0x2d
[    0.771500] initcall cpucache_init+0x0/0x2d returned 0 after 0 msecs
[    0.771500] calling  fasync_init+0x0/0x29
[    0.771500] initcall fasync_init+0x0/0x29 returned 0 after 0 msecs
[    0.771500] calling  aio_setup+0x0/0x69
[    0.772500] initcall aio_setup+0x0/0x69 returned 0 after 0 msecs
[    0.772500] calling  init_mbcache+0x0/0x16
[    0.772500] initcall init_mbcache+0x0/0x16 returned 0 after 0 msecs
[    0.772500] calling  dquot_init+0x0/0xc6
[    0.772500] VFS: Disk quotas dquot_6.5.1
[    0.772500] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.772500] initcall dquot_init+0x0/0xc6 returned 0 after 0 msecs
[    0.772500] calling  init_devpts_fs+0x0/0x38
[    0.773500] initcall init_devpts_fs+0x0/0x38 returned 0 after 0 msecs
[    0.773500] calling  init_ext3_fs+0x0/0x64
[    0.773500] initcall init_ext3_fs+0x0/0x64 returned 0 after 0 msecs
[    0.773500] calling  journal_init+0x0/0x8a
[    0.773500] initcall journal_init+0x0/0x8a returned 0 after 0 msecs
[    0.773500] calling  init_ramfs_fs+0x0/0x14
[    0.773500] initcall init_ramfs_fs+0x0/0x14 returned 0 after 0 msecs
[    0.774500] calling  vxfs_init+0x0/0x52
[    0.774500] initcall vxfs_init+0x0/0x52 returned 0 after 0 msecs
[    0.774500] calling  init_nls_cp855+0x0/0x14
[    0.774500] initcall init_nls_cp855+0x0/0x14 returned 0 after 0 msecs
[    0.774500] calling  init_nls_cp860+0x0/0x14
[    0.774500] initcall init_nls_cp860+0x0/0x14 returned 0 after 0 msecs
[    0.774500] calling  init_nls_cp864+0x0/0x14
[    0.774500] initcall init_nls_cp864+0x0/0x14 returned 0 after 0 msecs
[    0.774500] calling  init_nls_cp869+0x0/0x14
[    0.775500] initcall init_nls_cp869+0x0/0x14 returned 0 after 0 msecs
[    0.775500] calling  init_nls_cp949+0x0/0x14
[    0.775500] initcall init_nls_cp949+0x0/0x14 returned 0 after 0 msecs
[    0.775500] calling  init_nls_cp1251+0x0/0x14
[    0.775500] initcall init_nls_cp1251+0x0/0x14 returned 0 after 0 msecs
[    0.775500] calling  init_nls_iso8859_5+0x0/0x14
[    0.775500] initcall init_nls_iso8859_5+0x0/0x14 returned 0 after 0 msecs
[    0.775500] calling  init_nls_iso8859_7+0x0/0x14
[    0.775500] initcall init_nls_iso8859_7+0x0/0x14 returned 0 after 0 msecs
[    0.776500] calling  init_nls_cp1255+0x0/0x14
[    0.776500] initcall init_nls_cp1255+0x0/0x14 returned 0 after 0 msecs
[    0.776500] calling  init_nls_iso8859_9+0x0/0x14
[    0.776500] initcall init_nls_iso8859_9+0x0/0x14 returned 0 after 0 msecs
[    0.776500] calling  init_nls_utf8+0x0/0x24
[    0.776500] initcall init_nls_utf8+0x0/0x24 returned 0 after 0 msecs
[    0.776500] calling  init_sysv_fs+0x0/0x48
[    0.776500] initcall init_sysv_fs+0x0/0x48 returned 0 after 0 msecs
[    0.777500] calling  init_ufs_fs+0x0/0x54
[    0.777500] initcall init_ufs_fs+0x0/0x54 returned 0 after 0 msecs
[    0.777500] calling  init_jfs_fs+0x0/0x188
[    0.777500] JFS: nTxBlock = 8192, nTxLock = 65536
[    0.782500] initcall init_jfs_fs+0x0/0x188 returned 0 after 4 msecs
[    0.782500] calling  init_xfs_fs+0x0/0x5f
[    0.782500] SGI XFS with ACLs, security attributes, no debug enabled
[    0.783500] SGI XFS Quota Management subsystem
[    0.783500] initcall init_xfs_fs+0x0/0x5f returned 0 after 0 msecs
[    0.783500] calling  ipc_init+0x0/0x25
[    0.783500] msgmni has been set to 2176
[    0.784500] initcall ipc_init+0x0/0x25 returned 0 after 0 msecs
[    0.784500] calling  ipc_sysctl_init+0x0/0x16
[    0.784500] initcall ipc_sysctl_init+0x0/0x16 returned 0 after 0 msecs
[    0.784500] calling  init_mqueue_fs+0x0/0xbb
[    0.784500] initcall init_mqueue_fs+0x0/0xbb returned 0 after 0 msecs
[    0.784500] calling  key_proc_init+0x0/0x53
[    0.784500] initcall key_proc_init+0x0/0x53 returned 0 after 0 msecs
[    0.785500] calling  crypto_algapi_init+0x0/0x11
[    0.785500] initcall crypto_algapi_init+0x0/0x11 returned 0 after 0 msecs
[    0.785500] calling  blkcipher_module_init+0x0/0x29
[    0.785500] initcall blkcipher_module_init+0x0/0x29 returned 0 after 0 msecs
[    0.785500] calling  seqiv_module_init+0x0/0x14
[    0.785500] initcall seqiv_module_init+0x0/0x14 returned 0 after 0 msecs
[    0.785500] calling  cryptomgr_init+0x0/0x14
[    0.785500] initcall cryptomgr_init+0x0/0x14 returned 0 after 0 msecs
[    0.785500] calling  hmac_module_init+0x0/0x14
[    0.786500] initcall hmac_module_init+0x0/0x14 returned 0 after 0 msecs
[    0.786500] calling  crypto_xcbc_module_init+0x0/0x14
[    0.786500] initcall crypto_xcbc_module_init+0x0/0x14 returned 0 after 0 msecs
[    0.786500] calling  crypto_null_mod_init+0x0/0x6c
[    0.786500] initcall crypto_null_mod_init+0x0/0x6c returned 0 after 0 msecs
[    0.786500] calling  md5_mod_init+0x0/0x14
[    0.786500] initcall md5_mod_init+0x0/0x14 returned 0 after 0 msecs
[    0.786500] calling  sha1_generic_mod_init+0x0/0x14
[    0.786500] initcall sha1_generic_mod_init+0x0/0x14 returned 0 after 0 msecs
[    0.787500] calling  sha512_generic_mod_init+0x0/0x38
[    0.787500] initcall sha512_generic_mod_init+0x0/0x38 returned 0 after 0 msecs
[    0.787500] calling  crypto_ecb_module_init+0x0/0x14
[    0.787500] initcall crypto_ecb_module_init+0x0/0x14 returned 0 after 0 msecs
[    0.787500] calling  crypto_cbc_module_init+0x0/0x14
[    0.787500] initcall crypto_cbc_module_init+0x0/0x14 returned 0 after 0 msecs
[    0.787500] calling  crypto_pcbc_module_init+0x0/0x14
[    0.787500] initcall crypto_pcbc_module_init+0x0/0x14 returned 0 after 0 msecs
[    0.788500] calling  crypto_module_init+0x0/0x14
[    0.788500] initcall crypto_module_init+0x0/0x14 returned 0 after 0 msecs
[    0.788500] calling  crypto_ctr_module_init+0x0/0x38
[    0.788500] initcall crypto_ctr_module_init+0x0/0x38 returned 0 after 0 msecs
[    0.788500] calling  crypto_gcm_module_init+0x0/0x52
[    0.788500] initcall crypto_gcm_module_init+0x0/0x52 returned 0 after 0 msecs
[    0.788500] calling  crypto_ccm_module_init+0x0/0x52
[    0.788500] initcall crypto_ccm_module_init+0x0/0x52 returned 0 after 0 msecs
[    0.789500] calling  des_generic_mod_init+0x0/0x38
[    0.789500] initcall des_generic_mod_init+0x0/0x38 returned 0 after 0 msecs
[    0.789500] calling  fcrypt_mod_init+0x0/0x14
[    0.789500] initcall fcrypt_mod_init+0x0/0x14 returned 0 after 0 msecs
[    0.789500] calling  twofish_mod_init+0x0/0x14
[    0.789500] initcall twofish_mod_init+0x0/0x14 returned 0 after 0 msecs
[    0.789500] calling  cast5_mod_init+0x0/0x14
[    0.789500] initcall cast5_mod_init+0x0/0x14 returned 0 after 0 msecs
[    0.789500] calling  deflate_mod_init+0x0/0x14
[    0.790500] initcall deflate_mod_init+0x0/0x14 returned 0 after 0 msecs
[    0.790500] calling  michael_mic_init+0x0/0x14
[    0.790500] initcall michael_mic_init+0x0/0x14 returned 0 after 0 msecs
[    0.790500] calling  crc32c_mod_init+0x0/0x38
[    0.790500] initcall crc32c_mod_init+0x0/0x38 returned 0 after 0 msecs
[    0.790500] calling  crypto_authenc_module_init+0x0/0x14
[    0.791500] initcall crypto_authenc_module_init+0x0/0x14 returned 0 after 0 msecs
[    0.791500] calling  bsg_init+0x0/0x106
[    0.792500] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254)
[    0.792500] initcall bsg_init+0x0/0x106 returned 0 after 0 msecs
[    0.792500] calling  noop_init+0x0/0x16
[    0.792500] io scheduler noop registered (default)
[    0.792500] initcall noop_init+0x0/0x16 returned 0 after 0 msecs
[    0.792500] calling  percpu_counter_startup+0x0/0x11
[    0.792500] initcall percpu_counter_startup+0x0/0x11 returned 0 after 0 msecs
[    0.792500] calling  pci_init+0x0/0x31
[    0.792500] pci 0000:00:02.0: Boot video device
[    0.793500] pci 0000:00:1d.0: uhci_check_and_reset_hc: legsup = 0x2000
[    0.793500] pci 0000:00:1d.0: Performing full reset
[    0.793500] pci 0000:00:1d.1: uhci_check_and_reset_hc: legsup = 0x2000
[    0.793500] pci 0000:00:1d.1: Performing full reset
[    0.793500] pci 0000:00:1d.2: uhci_check_and_reset_hc: legsup = 0x2000
[    0.793500] pci 0000:00:1d.2: Performing full reset
[    0.793500] pci 0000:00:1d.3: uhci_check_and_reset_hc: legsup = 0x2000
[    0.793500] pci 0000:00:1d.3: Performing full reset
[    0.793500] initcall pci_init+0x0/0x31 returned 0 after 0 msecs
[    0.794500] calling  pci_proc_init+0x0/0x60
[    0.794500] initcall pci_proc_init+0x0/0x60 returned 0 after 0 msecs
[    0.794500] calling  arcfb_init+0x0/0x65
[    0.794500] initcall arcfb_init+0x0/0x65 returned -6 after 0 msecs
[    0.794500] initcall arcfb_init+0x0/0x65 returned with error code -6 
[    0.794500] calling  rivafb_init+0x0/0x1ab
[    0.794500] rivafb_setup START
[    0.795500] initcall rivafb_init+0x0/0x1ab returned 0 after 0 msecs
[    0.795500] calling  kyrofb_init+0x0/0xd0
[    0.795500] initcall kyrofb_init+0x0/0xd0 returned 0 after 0 msecs
[    0.795500] calling  gxfb_init+0x0/0x73
[    0.796500] initcall gxfb_init+0x0/0x73 returned 0 after 0 msecs
[    0.796500] calling  tridentfb_init+0x0/0x1f8
[    0.796500] tridentfb: Trident framebuffer 0.7.8-NEWAPI initializing
[    0.796500] initcall tridentfb_init+0x0/0x1f8 returned 0 after 0 msecs
[    0.796500] calling  hgafb_init+0x0/0x4d
[    0.797500] hgafb: HGA card not detected.
[    0.797500] hgafb: probe of hgafb.0 failed with error -22
[    0.797500] initcall hgafb_init+0x0/0x4d returned 0 after 0 msecs
[    0.797500] calling  sstfb_init+0x0/0x193
[    0.797500] initcall sstfb_init+0x0/0x193 returned 0 after 0 msecs
[    0.797500] calling  s1d13xxxfb_init+0x0/0x2d
[    0.797500] initcall s1d13xxxfb_init+0x0/0x2d returned 0 after 0 msecs
[    0.798500] calling  efifb_init+0x0/0x46
[    0.798500] initcall efifb_init+0x0/0x46 returned -19 after 0 msecs
[    0.798500] calling  acpi_reserve_resources+0x0/0xcd
[    0.798500] initcall acpi_reserve_resources+0x0/0xcd returned 0 after 0 msecs
[    0.798500] calling  acpi_battery_init+0x0/0x42
[    0.842000] ACPI: Battery Slot [BAT0] (battery present)
[    0.842000] initcall acpi_battery_init+0x0/0x42 returned 0 after 41 msecs
[    0.842000] calling  acpi_button_init+0x0/0x56
[    0.843000] input: Power Button (FF) as /class/input/input0
[    0.843000] ACPI: Power Button (FF) [PWRF]
[    0.843000] input: Lid Switch as /class/input/input1
[    0.844000] ACPI: Lid Switch [LID]
[    0.844000] input: Sleep Button (CM) as /class/input/input2
[    0.844000] ACPI: Sleep Button (CM) [SLPB]
[    0.845000] initcall acpi_button_init+0x0/0x56 returned 0 after 2 msecs
[    0.845000] calling  irqrouter_init_sysfs+0x0/0x38
[    0.845000] initcall irqrouter_init_sysfs+0x0/0x38 returned 0 after 0 msecs
[    0.845000] calling  acpi_pci_slot_init+0x0/0x16
[    0.846000] initcall acpi_pci_slot_init+0x0/0x16 returned 0 after 0 msecs
[    0.846000] calling  pnpbios_thread_init+0x0/0x53
[    0.846000] initcall pnpbios_thread_init+0x0/0x53 returned 0 after 0 msecs
[    0.846000] calling  rand_initialize+0x0/0x2a
[    0.846000] initcall rand_initialize+0x0/0x2a returned 0 after 0 msecs
[    0.846000] calling  tty_init+0x0/0x194
[    0.853000] initcall tty_init+0x0/0x194 returned 0 after 6 msecs
[    0.853000] calling  pty_init+0x0/0x1f5
[    0.853000] initcall pty_init+0x0/0x1f5 returned 0 after 0 msecs
[    0.853000] calling  lp_init_module+0x0/0x209
[    0.854000] lp: driver loaded but no devices found
[    0.854000] initcall lp_init_module+0x0/0x209 returned 0 after 0 msecs
[    0.854000] calling  r3964_init+0x0/0x3d
[    0.854000] r3964: Philips r3964 Driver $Revision: 1.10 $
[    0.854000] initcall r3964_init+0x0/0x3d returned 0 after 0 msecs
[    0.854000] calling  sonypi_init+0x0/0x1e
[    0.854000] sonypi: Sony Programmable I/O Controller Driver v1.26.
[    0.854000] initcall sonypi_init+0x0/0x1e returned -19 after 0 msecs
[    0.854000] calling  i8k_init+0x0/0x13c
[    0.855000] initcall i8k_init+0x0/0x13c returned -19 after 0 msecs
[    0.855000] calling  ppdev_init+0x0/0x9a
[    0.855000] ppdev: user-space parallel port driver
[    0.855000] initcall ppdev_init+0x0/0x9a returned 0 after 0 msecs
[    0.855000] calling  nsc_gpio_init+0x0/0x16
[    0.855000] nsc_gpio initializing
[    0.855000] initcall nsc_gpio_init+0x0/0x16 returned 0 after 0 msecs
[    0.855000] calling  cs5535_gpio_init+0x0/0x16c
[    0.855000] cs5535_gpio: DIVIL not found
[    0.856000] initcall cs5535_gpio_init+0x0/0x16c returned -19 after 0 msecs
[    0.856000] calling  agp_init+0x0/0x26
[    0.856000] Linux agpgart interface v0.103
[    0.856000] initcall agp_init+0x0/0x26 returned 0 after 0 msecs
[    0.856000] calling  agp_ali_init+0x0/0x29
[    0.856000] initcall agp_ali_init+0x0/0x29 returned 0 after 0 msecs
[    0.856000] calling  agp_ati_init+0x0/0x29
[    0.857000] initcall agp_ati_init+0x0/0x29 returned 0 after 0 msecs
[    0.857000] calling  agp_amdk7_init+0x0/0x29
[    0.857000] initcall agp_amdk7_init+0x0/0x29 returned 0 after 0 msecs
[    0.857000] calling  agp_efficeon_init+0x0/0x3e
[    0.857000] initcall agp_efficeon_init+0x0/0x3e returned 0 after 0 msecs
[    0.858000] calling  agp_intel_init+0x0/0x29
[    0.858000] agpgart: Detected an Intel 945GM Chipset.
[    0.859000] agpgart: Detected 7932K stolen memory.
[    0.876000] agpgart: AGP aperture is 256M @ 0xd0000000
[    0.876000] initcall agp_intel_init+0x0/0x29 returned 0 after 17 msecs
[    0.876000] calling  agp_serverworks_init+0x0/0x29
[    0.877000] initcall agp_serverworks_init+0x0/0x29 returned 0 after 0 msecs
[    0.877000] calling  ipmi_init_msghandler_mod+0x0/0x11
[    0.877000] ipmi message handler version 39.2
[    0.877000] initcall ipmi_init_msghandler_mod+0x0/0x11 returned 0 after 0 msecs
[    0.877000] calling  init_ipmi_si+0x0/0x53b
[    0.878000] IPMI System Interface driver.
[    0.878000] ipmi_si: Unable to find any System Interface(s)
[    0.878000] initcall init_ipmi_si+0x0/0x53b returned -19 after 0 msecs
[    0.878000] calling  ipmi_wdog_init+0x0/0x103
[    0.878000] IPMI Watchdog: driver initialized
[    0.879000] initcall ipmi_wdog_init+0x0/0x103 returned 0 after 0 msecs
[    0.879000] calling  ipmi_poweroff_init+0x0/0x7b
[    0.879000] Copyright (C) 2004 MontaVista Software - IPMI Powerdown via sys_reboot.
[    0.879000] initcall ipmi_poweroff_init+0x0/0x7b returned 0 after 0 msecs
[    0.879000] calling  intelfb_init+0x0/0x4e6
[    0.879000] intelfb: Framebuffer driver for Intel(R) 830M/845G/852GM/855GM/865G/915G/915GM/945G/945GM/965G/965GM chipsets
[    0.879000] intelfb: Version 0.9.5
[    0.880000] intelfb 0000:00:02.0: power state changed by ACPI to D0
[    0.880000] Pin 1-16 already programmed
[    0.880000] intelfb 0000:00:02.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    0.880000] intelfb: 00:02.0: Intel(R) 945GM, aperture size 256MB, stolen memory 7932kB
[    0.884000] intelfb: Non-CRT device is enabled ( LVDS port ).  Disabling mode switching.
[    0.884000] intelfb: Video mode must be programmed at boot time.
[    0.886000] initcall intelfb_init+0x0/0x4e6 returned 0 after 6 msecs
[    0.886000] calling  serial8250_init+0x0/0x111
[    0.886000] Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing disabled
[    0.887000] serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a NS16550A
[    0.887000] initcall serial8250_init+0x0/0x111 returned 0 after 0 msecs
[    0.887000] calling  parport_default_proc_register+0x0/0x1b
[    0.887000] initcall parport_default_proc_register+0x0/0x1b returned 0 after 0 msecs
[    0.888000] calling  isa_bus_init+0x0/0x38
[    0.888000] initcall isa_bus_init+0x0/0x38 returned 0 after 0 msecs
[    0.888000] calling  topology_sysfs_init+0x0/0x3b
[    0.888000] initcall topology_sysfs_init+0x0/0x3b returned 0 after 0 msecs
[    0.888000] calling  floppy_init+0x0/0xdb1
[    3.899000] floppy0: no floppy controllers found
[    3.899000] initcall floppy_init+0x0/0xdb1 returned -19 after 2871 msecs
[    3.899000] calling  brd_init+0x0/0x136
[    3.903000] brd: module loaded
[    3.903000] initcall brd_init+0x0/0x136 returned 0 after 3 msecs
[    3.903000] calling  cpqarray_init+0x0/0x230
[    3.903000] Compaq SMART2 Driver (v 2.6.0)
[    3.904000] initcall cpqarray_init+0x0/0x230 returned 0 after 0 msecs
[    3.904000] calling  cciss_init+0x0/0x25
[    3.904000] HP CISS Driver (v 3.6.20)
[    3.904000] initcall cciss_init+0x0/0x25 returned 0 after 0 msecs
[    3.904000] calling  DAC960_init_module+0x0/0x46
[    3.905000] initcall DAC960_init_module+0x0/0x46 returned 0 after 0 msecs
[    3.905000] calling  mm_init+0x0/0x14b
[    3.905000] MM: desc_per_page = 128
[    3.905000] initcall mm_init+0x0/0x14b returned 0 after 0 msecs
[    3.905000] calling  nbd_init+0x0/0x28f
[    3.906000] nbd: registered device at major 43
[    3.910000] initcall nbd_init+0x0/0x28f returned 0 after 4 msecs
[    3.910000] calling  carm_init+0x0/0x1b
[    3.910000] initcall carm_init+0x0/0x1b returned 0 after 0 msecs
[    3.910000] calling  lkdtm_module_init+0x0/0x1c4
[    3.910000] lkdtm : Invalid command
[    3.911000] initcall lkdtm_module_init+0x0/0x1c4 returned -22 after 0 msecs
[    3.911000] initcall lkdtm_module_init+0x0/0x1c4 returned with error code -22 
[    3.911000] calling  init_kgdbts+0x0/0x1a
[    3.911000] initcall init_kgdbts+0x0/0x1a returned 0 after 0 msecs
[    3.911000] calling  e1000_init_module+0x0/0x58
[    3.912000] e1000e: Intel(R) PRO/1000 Network Driver - 0.3.3.3-k2
[    3.912000] e1000e: Copyright (c) 1999-2008 Intel Corporation.
[    3.912000] e1000e 0000:02:00.0: Disabling L1 ASPM
[    3.913000] vendor=8086 device=27d0
[    3.913000] Pin 1-16 already programmed
[    3.913000] e1000e 0000:02:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    3.913000] PCI: Setting latency timer of device 0000:02:00.0 to 64
[    3.996000] eth0: (PCI Express:2.5GB/s:Width x1) 00:16:41:17:49:d2
[    3.997000] eth0: Intel(R) PRO/1000 Network Connection
[    3.997000] eth0: MAC: 2, PHY: 2, PBA No: 005301-003
[    3.997000] initcall e1000_init_module+0x0/0x58 returned 0 after 81 msecs
[    3.997000] calling  ixgbe_init_module+0x0/0x48
[    3.997000] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 1.3.18-k2
[    3.997000] ixgbe: Copyright (c) 1999-2007 Intel Corporation.
[    3.998000] initcall ixgbe_init_module+0x0/0x48 returned 0 after 0 msecs
[    3.998000] calling  ixgb_init_module+0x0/0x3e
[    3.998000] Intel(R) PRO/10GbE Network Driver - version 1.0.126-k4
[    3.998000] Copyright (c) 1999-2006 Intel Corporation.
[    3.998000] initcall ixgb_init_module+0x0/0x3e returned 0 after 0 msecs
[    3.998000] calling  atl1_init_module+0x0/0x1b
[    3.999000] initcall atl1_init_module+0x0/0x1b returned 0 after 0 msecs
[    3.999000] calling  plip_init+0x0/0x57
[    3.999000] initcall plip_init+0x0/0x57 returned 0 after 0 msecs
[    3.999000] calling  happy_meal_probe+0x0/0x1b
[    3.999000] initcall happy_meal_probe+0x0/0x1b returned 0 after 0 msecs
[    3.999000] calling  vortex_init+0x0/0xa1
[    4.000000] initcall vortex_init+0x0/0xa1 returned 0 after 0 msecs
[    4.000000] calling  ne2k_pci_init+0x0/0x1b
[    4.000000] initcall ne2k_pci_init+0x0/0x1b returned 0 after 0 msecs
[    4.000000] calling  e100_init_module+0x0/0x52
[    4.000000] e100: Intel(R) PRO/100 Network Driver, 3.5.23-k4-NAPI
[    4.000000] e100: Copyright(c) 1999-2006 Intel Corporation
[    4.001000] initcall e100_init_module+0x0/0x52 returned 0 after 0 msecs
[    4.001000] calling  epic_init+0x0/0x1b
[    4.001000] initcall epic_init+0x0/0x1b returned 0 after 0 msecs
[    4.001000] calling  acenic_init+0x0/0x1b
[    4.001000] initcall acenic_init+0x0/0x1b returned 0 after 0 msecs
[    4.002000] calling  ns83820_init+0x0/0x25
[    4.002000] ns83820.c: National Semiconductor DP83820 10/100/1000 driver.
[    4.002000] initcall ns83820_init+0x0/0x25 returned 0 after 0 msecs
[    4.002000] calling  tg3_init+0x0/0x1b
[    4.002000] initcall tg3_init+0x0/0x1b returned 0 after 0 msecs
[    4.002000] calling  bnx2x_init+0x0/0x1b
[    4.003000] initcall bnx2x_init+0x0/0x1b returned 0 after 0 msecs
[    4.003000] calling  skfd_init+0x0/0x1b
[    4.003000] initcall skfd_init+0x0/0x1b returned 0 after 0 msecs
[    4.003000] calling  velocity_init_module+0x0/0x34
[    4.003000] initcall velocity_init_module+0x0/0x34 returned 0 after 0 msecs
[    4.004000] calling  cicada_init+0x0/0x38
[    4.004000] initcall cicada_init+0x0/0x38 returned 0 after 0 msecs
[    4.004000] calling  hamachi_init+0x0/0x1b
[    4.004000] initcall hamachi_init+0x0/0x1b returned 0 after 0 msecs
[    4.004000] calling  net_olddevs_init+0x0/0x86
[    4.005000] initcall net_olddevs_init+0x0/0x86 returned 0 after 0 msecs
[    4.005000] calling  sb1000_init+0x0/0x14
[    4.005000] initcall sb1000_init+0x0/0x14 returned 0 after 0 msecs
[    4.005000] calling  hp100_module_init+0x0/0x1b
[    4.005000] initcall hp100_module_init+0x0/0x1b returned 0 after 0 msecs
[    4.005000] calling  init_nic+0x0/0x1b
[    4.006000] initcall init_nic+0x0/0x1b returned 0 after 0 msecs
[    4.006000] calling  dummy_init_module+0x0/0x9a
[    4.006000] initcall dummy_init_module+0x0/0x9a returned 0 after 0 msecs
[    4.006000] calling  macvlan_init_module+0x0/0x4a
[    4.006000] initcall macvlan_init_module+0x0/0x4a returned 0 after 0 msecs
[    4.007000] calling  dfx_init+0x0/0x1b
[    4.007000] initcall dfx_init+0x0/0x1b returned 0 after 0 msecs
[    4.007000] calling  el3_init_module+0x0/0x109
[    4.050000] initcall el3_init_module+0x0/0x109 returned 0 after 41 msecs
[    4.050000] calling  rtl8139_init_module+0x0/0x1b
[    4.050000] initcall rtl8139_init_module+0x0/0x1b returned 0 after 0 msecs
[    4.050000] calling  myri10ge_init_module+0x0/0x30
[    4.050000] myri10ge: Version 1.3.99-1.347
[    4.051000] initcall myri10ge_init_module+0x0/0x30 returned 0 after 0 msecs
[    4.051000] calling  arcnet_init+0x0/0x55
[    4.051000] arcnet loaded.
[    4.051000] initcall arcnet_init+0x0/0x55 returned 0 after 0 msecs
[    4.051000] calling  arcnet_rfc1051_init+0x0/0x42
[    4.051000] arcnet: RFC1051 "simple standard" (`s') encapsulation support loaded.
[    4.051000] initcall arcnet_rfc1051_init+0x0/0x42 returned 0 after 0 msecs
[    4.051000] calling  arcnet_raw_init+0x0/0x57
[    4.051000] arcnet: raw mode (`r') encapsulation support loaded.
[    4.052000] initcall arcnet_raw_init+0x0/0x57 returned 0 after 0 msecs
[    4.052000] calling  kaweth_init+0x0/0x2a
[    4.052000] drivers/net/usb/kaweth.c: Driver loading
[    4.052000] usbcore: registered new interface driver kaweth
[    4.052000] initcall kaweth_init+0x0/0x2a returned 0 after 0 msecs
[    4.052000] calling  cdc_init+0x0/0x1b
[    4.052000] usbcore: registered new interface driver cdc_ether
[    4.052000] initcall cdc_init+0x0/0x1b returned 0 after 0 msecs
[    4.053000] calling  net1080_init+0x0/0x1b
[    4.053000] usbcore: registered new interface driver net1080
[    4.053000] initcall net1080_init+0x0/0x1b returned 0 after 0 msecs
[    4.053000] calling  plusb_init+0x0/0x1b
[    4.053000] usbcore: registered new interface driver plusb
[    4.053000] initcall plusb_init+0x0/0x1b returned 0 after 0 msecs
[    4.053000] calling  rndis_init+0x0/0x1b
[    4.054000] usbcore: registered new interface driver rndis_host
[    4.054000] initcall rndis_init+0x0/0x1b returned 0 after 0 msecs
[    4.054000] calling  mcs7830_init+0x0/0x1b
[    4.054000] usbcore: registered new interface driver MOSCHIP usb-ethernet driver
[    4.054000] initcall mcs7830_init+0x0/0x1b returned 0 after 0 msecs
[    4.054000] calling  usbnet_init+0x0/0x2b
[    4.054000] initcall usbnet_init+0x0/0x2b returned 0 after 0 msecs
[    4.054000] calling  ipw2100_init+0x0/0x5f
[    4.055000] ipw2100: Intel(R) PRO/Wireless 2100 Network Driver, git-1.2.2
[    4.055000] ipw2100: Copyright(c) 2003-2006 Intel Corporation
[    4.055000] initcall ipw2100_init+0x0/0x5f returned 0 after 0 msecs
[    4.055000] calling  ipw_init+0x0/0x73
[    4.055000] ipw2200: Intel(R) PRO/Wireless 2200/2915 Network Driver, 1.2.2kdmprq
[    4.055000] ipw2200: Copyright(c) 2003-2006 Intel Corporation
[    4.056000] initcall ipw_init+0x0/0x73 returned 0 after 0 msecs
[    4.056000] calling  strip_init_driver+0x0/0x5c
[    4.056000] STRIP: Version 1.3A-STUART.CHESHIRE (unlimited channels)
[    4.056000] initcall strip_init_driver+0x0/0x5c returned 0 after 0 msecs
[    4.056000] calling  rndis_wlan_init+0x0/0x1b
[    4.056000] usbcore: registered new interface driver rndis_wlan
[    4.056000] initcall rndis_wlan_init+0x0/0x1b returned 0 after 0 msecs
[    4.056000] calling  zd1201_init+0x0/0x1b
[    4.057000] usbcore: registered new interface driver zd1201
[    4.057000] initcall zd1201_init+0x0/0x1b returned 0 after 0 msecs
[    4.057000] calling  w840_init+0x0/0x25
[    4.057000] winbond-840.c:v1.01-e (2.4 port) Sep-11-2006  Donald Becker <becker@scyld.com>
[    4.057000]   http://www.scyld.com/network/drivers.html
[    4.057000] initcall w840_init+0x0/0x25 returned 0 after 0 msecs
[    4.057000] calling  uli526x_init_module+0x0/0x92
[    4.058000] uli526x: ULi M5261/M5263 net driver, version 0.9.3 (2005-7-29)
[    4.058000] initcall uli526x_init_module+0x0/0x92 returned 0 after 0 msecs
[    4.058000] calling  stir_init+0x0/0x1b
[    4.058000] usbcore: registered new interface driver stir4200
[    4.058000] initcall stir_init+0x0/0x1b returned 0 after 0 msecs
[    4.058000] calling  nsc_ircc_init+0x0/0x1d9
[    4.059000] nsc-ircc, chip->init
[    4.059000] nsc-ircc, Found chip at base=0x164e
[    4.059000] nsc-ircc, driver loaded (Dag Brattli)
[    4.059000] nsc_ircc_open(), can't get iobase of 0x2f8
[    4.059000] nsc-ircc, Found chip at base=0x164e
[    4.059000] nsc-ircc, driver loaded (Dag Brattli)
[    4.059000] nsc_ircc_open(), can't get iobase of 0x2f8
[    4.060000] nsc-ircc 00:0a: disabled
[    4.060000] initcall nsc_ircc_init+0x0/0x1d9 returned -19 after 0 msecs
[    4.060000] calling  w83977af_init+0x0/0x43a
[    4.060000] initcall w83977af_init+0x0/0x43a returned -19 after 0 msecs
[    4.061000] calling  donauboe_init+0x0/0x1b
[    4.061000] initcall donauboe_init+0x0/0x1b returned 0 after 0 msecs
[    4.061000] calling  irtty_sir_init+0x0/0x3b
[    4.061000] initcall irtty_sir_init+0x0/0x3b returned 0 after 0 msecs
[    4.061000] calling  sir_wq_init+0x0/0x34
[    4.061000] initcall sir_wq_init+0x0/0x34 returned 0 after 0 msecs
[    4.061000] calling  ksdazzle_init+0x0/0x1b
[    4.062000] usbcore: registered new interface driver ksdazzle-sir
[    4.062000] initcall ksdazzle_init+0x0/0x1b returned 0 after 0 msecs
[    4.062000] calling  ks959_init+0x0/0x1b
[    4.062000] usbcore: registered new interface driver ks959-sir
[    4.062000] initcall ks959_init+0x0/0x1b returned 0 after 0 msecs
[    4.062000] calling  init_netconsole+0x0/0x16c
[    4.062000] netconsole: local port 4444
[    4.062000] netconsole: local IP 10.0.1.15
[    4.063000] netconsole: interface eth0
[    4.063000] netconsole: remote port 4444
[    4.063000] netconsole: remote IP 10.0.1.16
[    4.063000] netconsole: remote ethernet address 00:19:d1:01:f5:55
[    4.063000] netconsole: device eth0 not up yet, forcing it
[    8.080000] netconsole: timeout waiting for carrier
[    8.081000] eth0: Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[    8.082000] console [netcon0] enabled
[    8.083000] netconsole: network logging started
[    8.083000] initcall init_netconsole+0x0/0x16c returned 0 after 3834 msecs
[    8.084000] calling  niu_init+0x0/0x3b
[    8.084000] initcall niu_init+0x0/0x3b returned 0 after 0 msecs
[    8.084000] calling  videodev_init+0x0/0x73
[    8.084000] Linux video capture interface: v2.00
[    8.084000] initcall videodev_init+0x0/0x73 returned 0 after 0 msecs
[    8.085000] calling  amb_module_init+0x0/0x106
[    8.086000] Madge ATM Ambassador driver version 1.2.4
[    8.086000] initcall amb_module_init+0x0/0x106 returned 0 after 0 msecs
[    8.086000] calling  hrz_module_init+0x0/0xbf
[    8.086000] Madge ATM Horizon [Ultra] driver version 1.2.1
[    8.086000] hrz: debug bitmap is 0
[    8.086000] initcall hrz_module_init+0x0/0xbf returned 0 after 0 msecs
[    8.087000] calling  fore200e_module_init+0x0/0xbc
[    8.087000] fore200e: FORE Systems 200E-series ATM driver - version 0.3e
[    8.087000] initcall fore200e_module_init+0x0/0xbc returned 0 after 0 msecs
[    8.087000] calling  lanai_module_init+0x0/0x32
[    8.087000] initcall lanai_module_init+0x0/0x32 returned 0 after 0 msecs
[    8.088000] calling  scsi_tgt_init+0x0/0x7a
[    8.088000] initcall scsi_tgt_init+0x0/0x7a returned 0 after 0 msecs
[    8.088000] calling  raid_init+0x0/0x14
[    8.088000] initcall raid_init+0x0/0x14 returned 0 after 0 msecs
[    8.089000] calling  spi_transport_init+0x0/0x2c
[    8.089000] initcall spi_transport_init+0x0/0x2c returned 0 after 0 msecs
[    8.089000] calling  fc_transport_init+0x0/0x48
[    8.089000] initcall fc_transport_init+0x0/0x48 returned 0 after 0 msecs
[    8.090000] calling  iscsi_transport_init+0x0/0x11d
[    8.090000] Loading iSCSI transport class v2.0-870.
[    8.090000] initcall iscsi_transport_init+0x0/0x11d returned 0 after 0 msecs
[    8.090000] calling  iscsi_tcp_init+0x0/0x3f
[    8.091000] iscsi: registered transport (tcp)
[    8.091000] initcall iscsi_tcp_init+0x0/0x3f returned 0 after 0 msecs
[    8.091000] calling  aha152x_init+0x0/0x42a
[    8.091000] initcall aha152x_init+0x0/0x42a returned -19 after 0 msecs
[    8.091000] calling  ahc_linux_init+0x0/0x61
[    8.092000] initcall ahc_linux_init+0x0/0x61 returned 0 after 0 msecs
[    8.092000] calling  aac_init+0x0/0x63
[    8.092000] Adaptec aacraid driver 1.1-5[2456]-ms
[    8.092000] initcall aac_init+0x0/0x63 returned 0 after 0 msecs
[    8.092000] calling  init_this_scsi_driver+0x0/0xd0
[    8.093000] initcall init_this_scsi_driver+0x0/0xd0 returned -19 after 0 msecs
[    8.093000] calling  init_this_scsi_driver+0x0/0xd0
[    8.094000] initcall init_this_scsi_driver+0x0/0xd0 returned -19 after 0 msecs
[    8.094000] calling  init_this_scsi_driver+0x0/0xd0
[    8.094000] initcall init_this_scsi_driver+0x0/0xd0 returned -19 after 0 msecs
[    8.094000] calling  init_this_scsi_driver+0x0/0xd0
[    8.094000] sym53c416.c: Version 1.0.0-ac
[    8.094000] initcall init_this_scsi_driver+0x0/0xd0 returned -19 after 0 msecs
[    8.095000] calling  qla1280_init+0x0/0x1b
[    8.095000] initcall qla1280_init+0x0/0x1b returned 0 after 0 msecs
[    8.095000] calling  qla2x00_module_init+0x0/0x102
[    8.095000] QLogic Fibre Channel HBA Driver: 8.02.01-k4
[    8.095000] initcall qla2x00_module_init+0x0/0x102 returned 0 after 0 msecs
[    8.096000] calling  lpfc_init+0x0/0xa9
[    8.096000] Emulex LightPulse Fibre Channel SCSI driver 8.2.7
[    8.096000] Copyright(c) 2004-2008 Emulex.  All rights reserved.
[    8.096000] initcall lpfc_init+0x0/0xa9 returned 0 after 0 msecs
[    8.096000] calling  init_this_scsi_driver+0x0/0xd0
[    8.096000] initcall init_this_scsi_driver+0x0/0xd0 returned -19 after 0 msecs
[    8.097000] calling  init_this_scsi_driver+0x0/0xd0
[    8.097000] initcall init_this_scsi_driver+0x0/0xd0 returned -19 after 0 msecs
[    8.097000] calling  sym2_init+0x0/0xe4
[    8.097000] initcall sym2_init+0x0/0xe4 returned 0 after 0 msecs
[    8.097000] calling  megaraid_init+0x0/0xa2
[    8.098000] initcall megaraid_init+0x0/0xa2 returned 0 after 0 msecs
[    8.098000] calling  mraid_mm_init+0x0/0x76
[    8.098000] megaraid cmm: 2.20.2.7 (Release Date: Sun Jul 16 00:01:03 EST 2006)
[    8.098000] initcall mraid_mm_init+0x0/0x76 returned 0 after 0 msecs
[    8.098000] calling  megaraid_init+0x0/0x8b
[    8.098000] megaraid: 2.20.5.1 (Release Date: Thu Nov 16 15:32:35 EST 2006)
[    8.099000] initcall megaraid_init+0x0/0x8b returned 0 after 0 msecs
[    8.099000] calling  tw_init+0x0/0x2a
[    8.099000] 3ware Storage Controller device driver for Linux v1.26.02.002.
[    8.099000] initcall tw_init+0x0/0x2a returned 0 after 0 msecs
[    8.099000] calling  init_nsp32+0x0/0x31
[    8.099000] nsp32: loading...
[    8.100000] initcall init_nsp32+0x0/0x31 returned 0 after 0 msecs
[    8.100000] calling  hptiop_module_init+0x0/0x2f
[    8.100000] RocketRAID 3xxx/4xxx Controller driver v1.3 (071203)
[    8.100000] initcall hptiop_module_init+0x0/0x2f returned 0 after 0 msecs
[    8.100000] calling  init_sd+0x0/0xb6
[    8.101000] Driver 'sd' needs updating - please use bus_type methods
[    8.101000] initcall init_sd+0x0/0xb6 returned 0 after 0 msecs
[    8.101000] calling  init_sr+0x0/0x42
[    8.101000] Driver 'sr' needs updating - please use bus_type methods
[    8.101000] initcall init_sr+0x0/0x42 returned 0 after 0 msecs
[    8.101000] calling  init_sg+0x0/0xaf
[    8.102000] initcall init_sg+0x0/0xaf returned 0 after 0 msecs
[    8.102000] calling  init_ch_module+0x0/0x8c
[    8.102000] SCSI Media Changer driver v0.25 
[    8.102000] Driver 'ch' needs updating - please use bus_type methods
[    8.102000] initcall init_ch_module+0x0/0x8c returned 0 after 0 msecs
[    8.102000] calling  ahci_init+0x0/0x1b
[    8.103000] ahci 0000:00:1f.2: version 3.0
[    8.103000] Pin 1-16 already programmed
[    8.103000] ahci 0000:00:1f.2: PCI INT B -> GSI 16 (level, low) -> IRQ 16
[    8.103000] ahci 0000:00:1f.2: AHCI 0001.0100 32 slots 4 ports 1.5 Gbps 0x1 impl SATA mode
[    8.103000] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part 
[    8.103000] PCI: Setting latency timer of device 0000:00:1f.2 to 64
[    8.104000] scsi0 : ahci
[    8.104000] scsi1 : ahci
[    8.104000] scsi2 : ahci
[    8.105000] scsi3 : ahci
[    8.105000] ata1: SATA max UDMA/133 abar m1024@0xee444400 port 0xee444500 irq 222
[    8.105000] ata2: DUMMY
[    8.105000] ata3: DUMMY
[    8.105000] ata4: DUMMY
[    8.411500] ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    8.412000] ata1.00: ACPI cmd ef/02:00:00:00:00:a0 succeeded
[    8.413000] ata1.00: ACPI cmd f5/00:00:00:00:00:a0 filtered out
[    8.413000] ata1.00: ACPI cmd ef/10:03:00:00:00:a0 filtered out
[    8.414000] ata1.00: ATA-7: HTS541080G9SA00, MB4IC60H, max UDMA/100
[    8.414000] ata1.00: 156301488 sectors, multi 16: LBA48 
[    8.416000] ata1.00: ACPI cmd ef/02:00:00:00:00:a0 succeeded
[    8.416000] ata1.00: ACPI cmd f5/00:00:00:00:00:a0 filtered out
[    8.417000] ata1.00: ACPI cmd ef/10:03:00:00:00:a0 filtered out
[    8.418000] ata1.00: configured for UDMA/100
[    8.421000] ata1.00: configured for UDMA/100
[    8.421000] ata1: EH complete
[    8.422000] scsi 0:0:0:0: Direct-Access     ATA      HTS541080G9SA00  MB4I PQ: 0 ANSI: 5
[    8.422000] sd 0:0:0:0: [sda] 156301488 512-byte hardware sectors (80026 MB)
[    8.422000] sd 0:0:0:0: [sda] Write Protect is off
[    8.422000] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    8.423000] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.423000] sd 0:0:0:0: [sda] 156301488 512-byte hardware sectors (80026 MB)
[    8.423000] sd 0:0:0:0: [sda] Write Protect is off
[    8.423000] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    8.423000] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.424000]  sda: sda1 sda2
[    8.843000] sd 0:0:0:0: [sda] Attached SCSI disk
[    8.843000] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    8.844000] initcall ahci_init+0x0/0x1b returned 0 after 707 msecs
[    8.844000] calling  piix_init+0x0/0x29
[    8.844000] ata_piix 0000:00:1f.1: version 2.12
[    8.844000] Pin 1-16 already programmed
[    8.844000] ata_piix 0000:00:1f.1: PCI INT C -> GSI 16 (level, low) -> IRQ 16
[    8.845000] PCI: Setting latency timer of device 0000:00:1f.1 to 64
[    8.845000] scsi4 : ata_piix
[    8.845000] scsi5 : ata_piix
[    8.847000] ata5: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0x1810 irq 14
[    8.847000] ata6: PATA max UDMA/100 cmd 0x170 ctl 0x376 bmdma 0x1818 irq 15
[    9.001000] ata5.00: ATAPI: HL-DT-STCD-RW/DVD DRIVE GCC-4246N, 0X05, max UDMA/33
[    9.007000] ata5.00: configured for UDMA/33
[    9.007000] ata6: port disabled. ignoring.
[    9.022000] scsi 4:0:0:0: CD-ROM            HL-DT-ST RW/DVD GCC-4246N 0X05 PQ: 0 ANSI: 5
[    9.036000] sr0: scsi3-mmc drive: 24x/24x writer cd/rw xa/form2 cdda tray
[    9.036000] Uniform CD-ROM driver Revision: 3.20
[    9.036000] sr 4:0:0:0: Attached scsi CD-ROM sr0
[    9.037000] sr 4:0:0:0: Attached scsi generic sg1 type 5
[    9.037000] initcall piix_init+0x0/0x29 returned 0 after 184 msecs
[    9.037000] calling  pdc_ata_init+0x0/0x1b
[    9.037000] initcall pdc_ata_init+0x0/0x1b returned 0 after 0 msecs
[    9.037000] calling  sil24_init+0x0/0x1b
[    9.038000] initcall sil24_init+0x0/0x1b returned 0 after 0 msecs
[    9.038000] calling  pdc_sata_init+0x0/0x1b
[    9.038000] initcall pdc_sata_init+0x0/0x1b returned 0 after 0 msecs
[    9.038000] calling  nv_init+0x0/0x1b
[    9.039000] initcall nv_init+0x0/0x1b returned 0 after 0 msecs
[    9.039000] calling  mv_init+0x0/0x3f
[    9.039000] initcall mv_init+0x0/0x3f returned 0 after 0 msecs
[    9.039000] calling  inic_init+0x0/0x1b
[    9.040000] initcall inic_init+0x0/0x1b returned 0 after 0 msecs
[    9.040000] calling  amd_init+0x0/0x1b
[    9.040000] initcall amd_init+0x0/0x1b returned 0 after 0 msecs
[    9.040000] calling  artop_init+0x0/0x1b
[    9.041000] initcall artop_init+0x0/0x1b returned 0 after 0 msecs
[    9.041000] calling  cs5520_init+0x0/0x1b
[    9.041000] initcall cs5520_init+0x0/0x1b returned 0 after 0 msecs
[    9.041000] calling  cs5535_init+0x0/0x1b
[    9.041000] initcall cs5535_init+0x0/0x1b returned 0 after 0 msecs
[    9.042000] calling  efar_init+0x0/0x1b
[    9.042000] initcall efar_init+0x0/0x1b returned 0 after 0 msecs
[    9.042000] calling  hpt37x_init+0x0/0x1b
[    9.043000] initcall hpt37x_init+0x0/0x1b returned 0 after 0 msecs
[    9.043000] calling  hpt3x2n_init+0x0/0x1b
[    9.044000] initcall hpt3x2n_init+0x0/0x1b returned 0 after 0 msecs
[    9.044000] calling  netcell_init+0x0/0x1b
[    9.044000] initcall netcell_init+0x0/0x1b returned 0 after 0 msecs
[    9.044000] calling  ninja32_init+0x0/0x1b
[    9.044000] initcall ninja32_init+0x0/0x1b returned 0 after 0 msecs
[    9.045000] calling  ns87415_init+0x0/0x1b
[    9.045000] initcall ns87415_init+0x0/0x1b returned 0 after 0 msecs
[    9.045000] calling  optidma_init+0x0/0x1b
[    9.045000] initcall optidma_init+0x0/0x1b returned 0 after 0 msecs
[    9.045000] calling  mpiix_init+0x0/0x1b
[    9.046000] initcall mpiix_init+0x0/0x1b returned 0 after 0 msecs
[    9.046000] calling  oldpiix_init+0x0/0x1b
[    9.046000] initcall oldpiix_init+0x0/0x1b returned 0 after 0 msecs
[    9.046000] calling  sc1200_init+0x0/0x1b
[    9.047000] initcall sc1200_init+0x0/0x1b returned 0 after 0 msecs
[    9.047000] calling  serverworks_init+0x0/0x1b
[    9.047000] initcall serverworks_init+0x0/0x1b returned 0 after 0 msecs
[    9.047000] calling  sil680_init+0x0/0x1b
[    9.047000] initcall sil680_init+0x0/0x1b returned 0 after 0 msecs
[    9.048000] calling  via_init+0x0/0x1b
[    9.048000] initcall via_init+0x0/0x1b returned 0 after 0 msecs
[    9.048000] calling  pata_platform_init+0x0/0x14
[    9.048000] initcall pata_platform_init+0x0/0x14 returned 0 after 0 msecs
[    9.048000] calling  cdrom_init+0x0/0x11
[    9.049000] initcall cdrom_init+0x0/0x11 returned 0 after 0 msecs
[    9.049000] calling  mon_init+0x0/0xf3
[    9.049000] initcall mon_init+0x0/0xf3 returned 0 after 0 msecs
[    9.049000] calling  ehci_hcd_init+0x0/0x75
[    9.049000] ehci_hcd: block sizes: qh 128 qtd 96 itd 160 sitd 96
[    9.050000] ehci_hcd 0000:00:1d.7: power state changed by ACPI to D0
[    9.050000] ehci_hcd 0000:00:1d.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
[    9.050000] PCI: Setting latency timer of device 0000:00:1d.7 to 64
[    9.050000] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    9.051000] drivers/usb/core/inode.c: creating file 'devices'
[    9.051000] drivers/usb/core/inode.c: creating file '001'
[    9.051000] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
[    9.051000] ehci_hcd 0000:00:1d.7: reset hcs_params 0x104208 dbg=1 cc=4 pcc=2 ordered !ppc ports=8
[    9.051000] ehci_hcd 0000:00:1d.7: reset hcc_params 6871 thresh 7 uframes 1024 64 bit addr
[    9.052000] ehci_hcd 0000:00:1d.7: reset command 080022 (park)=0 ithresh=8 Async period=1024 Reset HALT
[    9.056000] ehci_hcd 0000:00:1d.7: debug port 1
[    9.056000] ehci_hcd 0000:00:1d.7: cache line size of 32 is not supported
[    9.057000] ehci_hcd 0000:00:1d.7: supports USB remote wakeup
[    9.057000] ehci_hcd 0000:00:1d.7: irq 19, io mem 0xee444000
[    9.057000] ehci_hcd 0000:00:1d.7: reset command 080002 (park)=0 ithresh=8 period=1024 Reset HALT
[    9.061000] ehci_hcd 0000:00:1d.7: init command 010001 (park)=0 ithresh=1 period=1024 RUN
[    9.068000] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
[    9.068000] usb usb1: default language 0x0409
[    9.068000] usb usb1: uevent
[    9.068000] usb usb1: usb_probe_device
[    9.068000] usb usb1: configuration #1 chosen from 1 choice
[    9.068000] usb usb1: adding 1-0:1.0 (config #1, interface 0)
[    9.069000] usb 1-0:1.0: uevent
[    9.069000] hub 1-0:1.0: usb_probe_interface
[    9.069000] hub 1-0:1.0: usb_probe_interface - got id
[    9.069000] hub 1-0:1.0: USB hub found
[    9.069000] hub 1-0:1.0: 8 ports detected
[    9.069000] hub 1-0:1.0: standalone hub
[    9.069000] hub 1-0:1.0: no power switching (usb 1.0)
[    9.069000] hub 1-0:1.0: individual port over-current protection
[    9.070000] hub 1-0:1.0: power on to power good time: 20ms
[    9.070000] hub 1-0:1.0: local power source is good
[    9.070000] hub 1-0:1.0: trying to enable port power on non-switchable hub
[    9.171500] hub 1-0:1.0: state 7 ports 8 chg 0000 evt 0000
[    9.171000] drivers/usb/core/inode.c: creating file '001'
[    9.171500] ehci_hcd 0000:00:1d.7: GetStatus port 8 status 001803 POWER sig=j CSC CONNECT
[    9.171000] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    9.171000] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.171000] usb usb1: Product: EHCI Host Controller
[    9.171000] usb usb1: Manufacturer: Linux 2.6.26-tip-03923-g2c96bcb-dirty ehci_hcd
[    9.171000] usb usb1: SerialNumber: 0000:00:1d.7
[    9.171000] initcall ehci_hcd_init+0x0/0x75 returned 0 after 116 msecs
[    9.171000] calling  ohci_hcd_mod_init+0x0/0x85
[    9.171000] ohci_hcd: 2006 August 04 USB 1.1 'Open' Host Controller (OHCI) Driver
[    9.171000] ohci_hcd: block sizes: ed 64 td 64
[    9.171000] initcall ohci_hcd_mod_init+0x0/0x85 returned 0 after 0 msecs
[    9.171000] calling  uhci_hcd_init+0x0/0xc6
[    9.171000] USB Universal Host Controller Interface driver v3.0
[    9.172500] hub 1-0:1.0: port 8, status 0501, change 0001, 480 Mb/s
[    9.173000] uhci_hcd 0000:00:1d.0: power state changed by ACPI to D0
[    9.173000] Pin 1-16 already programmed
[    9.173000] uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    9.173000] PCI: Setting latency timer of device 0000:00:1d.0 to 64
[    9.174000] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    9.174000] drivers/usb/core/inode.c: creating file '002'
[    9.174000] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    9.174000] uhci_hcd 0000:00:1d.0: detected 2 ports
[    9.174000] uhci_hcd 0000:00:1d.0: uhci_check_and_reset_hc: cmd = 0x0000
[    9.174000] uhci_hcd 0000:00:1d.0: Performing full reset
[    9.174000] uhci_hcd 0000:00:1d.0: supports USB remote wakeup
[    9.175000] uhci_hcd 0000:00:1d.0: irq 16, io base 0x00001820
[    9.175000] usb usb2: default language 0x0409
[    9.175000] usb usb2: uevent
[    9.175000] usb usb2: usb_probe_device
[    9.175000] usb usb2: configuration #1 chosen from 1 choice
[    9.175000] usb usb2: adding 2-0:1.0 (config #1, interface 0)
[    9.176000] usb 2-0:1.0: uevent
[    9.176000] hub 2-0:1.0: usb_probe_interface
[    9.176000] hub 2-0:1.0: usb_probe_interface - got id
[    9.176000] hub 2-0:1.0: USB hub found
[    9.176000] hub 2-0:1.0: 2 ports detected
[    9.176000] hub 2-0:1.0: standalone hub
[    9.176000] hub 2-0:1.0: no power switching (usb 1.0)
[    9.176000] hub 2-0:1.0: individual port over-current protection
[    9.177000] hub 2-0:1.0: power on to power good time: 2ms
[    9.177000] hub 2-0:1.0: local power source is good
[    9.177000] hub 2-0:1.0: trying to enable port power on non-switchable hub
[    9.277500] hub 1-0:1.0: debounce: port 8: total 100ms stable 100ms status 0x501
[    9.278000] drivers/usb/core/inode.c: creating file '001'
[    9.278000] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
[    9.278000] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.278000] usb usb2: Product: UHCI Host Controller
[    9.278000] usb usb2: Manufacturer: Linux 2.6.26-tip-03923-g2c96bcb-dirty uhci_hcd
[    9.278000] usb usb2: SerialNumber: 0000:00:1d.0
[    9.279000] uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[    9.279000] PCI: Setting latency timer of device 0000:00:1d.1 to 64
[    9.279000] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    9.279000] drivers/usb/core/inode.c: creating file '003'
[    9.279000] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
[    9.279000] uhci_hcd 0000:00:1d.1: detected 2 ports
[    9.280000] uhci_hcd 0000:00:1d.1: uhci_check_and_reset_hc: cmd = 0x0000
[    9.280000] uhci_hcd 0000:00:1d.1: Performing full reset
[    9.280000] uhci_hcd 0000:00:1d.1: supports USB remote wakeup
[    9.280000] uhci_hcd 0000:00:1d.1: irq 17, io base 0x00001840
[    9.280000] usb usb3: default language 0x0409
[    9.280000] usb usb3: uevent
[    9.281000] usb usb3: usb_probe_device
[    9.281000] usb usb3: configuration #1 chosen from 1 choice
[    9.281000] usb usb3: adding 3-0:1.0 (config #1, interface 0)
[    9.281000] usb 3-0:1.0: uevent
[    9.281000] hub 3-0:1.0: usb_probe_interface
[    9.281000] hub 3-0:1.0: usb_probe_interface - got id
[    9.281000] hub 3-0:1.0: USB hub found
[    9.281000] hub 3-0:1.0: 2 ports detected
[    9.282000] hub 3-0:1.0: standalone hub
[    9.282000] hub 3-0:1.0: no power switching (usb 1.0)
[    9.282000] hub 3-0:1.0: individual port over-current protection
[    9.282000] hub 3-0:1.0: power on to power good time: 2ms
[    9.282000] hub 3-0:1.0: local power source is good
[    9.282000] hub 3-0:1.0: trying to enable port power on non-switchable hub
[    9.328500] ehci_hcd 0000:00:1d.7: port 8 full speed --> companion
[    9.328500] ehci_hcd 0000:00:1d.7: GetStatus port 8 status 003801 POWER OWNER sig=j CONNECT
[    9.328500] hub 1-0:1.0: port 8 not reset yet, waiting 50ms
[    9.379500] ehci_hcd 0000:00:1d.7: GetStatus port 8 status 003002 POWER OWNER sig=se0 CSC
[    9.379500] hub 2-0:1.0: state 7 ports 2 chg 0000 evt 0000
[    9.379500] hub 1-0:1.0: state 7 ports 8 chg 0000 evt 0100
[    9.383500] hub 3-0:1.0: state 7 ports 2 chg 0000 evt 0000
[    9.383000] drivers/usb/core/inode.c: creating file '001'
[    9.383000] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
[    9.383000] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.383000] usb usb3: Product: UHCI Host Controller
[    9.383000] usb usb3: Manufacturer: Linux 2.6.26-tip-03923-g2c96bcb-dirty uhci_hcd
[    9.383000] usb usb3: SerialNumber: 0000:00:1d.1
[    9.384000] uhci_hcd 0000:00:1d.2: power state changed by ACPI to D0
[    9.384000] uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
[    9.384000] PCI: Setting latency timer of device 0000:00:1d.2 to 64
[    9.385000] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    9.385000] drivers/usb/core/inode.c: creating file '004'
[    9.385000] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
[    9.386000] uhci_hcd 0000:00:1d.2: detected 2 ports
[    9.386000] uhci_hcd 0000:00:1d.2: uhci_check_and_reset_hc: cmd = 0x0000
[    9.386000] uhci_hcd 0000:00:1d.2: Performing full reset
[    9.387000] uhci_hcd 0000:00:1d.2: supports USB remote wakeup
[    9.387000] uhci_hcd 0000:00:1d.2: irq 18, io base 0x00001860
[    9.387000] usb usb4: default language 0x0409
[    9.387000] usb usb4: uevent
[    9.387000] usb usb4: usb_probe_device
[    9.387000] usb usb4: configuration #1 chosen from 1 choice
[    9.387000] usb usb4: adding 4-0:1.0 (config #1, interface 0)
[    9.388000] usb 4-0:1.0: uevent
[    9.388000] hub 4-0:1.0: usb_probe_interface
[    9.388000] hub 4-0:1.0: usb_probe_interface - got id
[    9.388000] hub 4-0:1.0: USB hub found
[    9.388000] hub 4-0:1.0: 2 ports detected
[    9.388000] hub 4-0:1.0: standalone hub
[    9.388000] hub 4-0:1.0: no power switching (usb 1.0)
[    9.388000] hub 4-0:1.0: individual port over-current protection
[    9.389000] hub 4-0:1.0: power on to power good time: 2ms
[    9.389000] hub 4-0:1.0: local power source is good
[    9.389000] hub 4-0:1.0: trying to enable port power on non-switchable hub
[    9.490500] hub 4-0:1.0: state 7 ports 2 chg 0000 evt 0000
[    9.490000] drivers/usb/core/inode.c: creating file '001'
[    9.490000] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
[    9.490000] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.490000] usb usb4: Product: UHCI Host Controller
[    9.490000] usb usb4: Manufacturer: Linux 2.6.26-tip-03923-g2c96bcb-dirty uhci_hcd
[    9.490000] usb usb4: SerialNumber: 0000:00:1d.2
[    9.491000] Pin 1-19 already programmed
[    9.491000] uhci_hcd 0000:00:1d.3: PCI INT D -> GSI 19 (level, low) -> IRQ 19
[    9.491000] PCI: Setting latency timer of device 0000:00:1d.3 to 64
[    9.491000] uhci_hcd 0000:00:1d.3: UHCI Host Controller
[    9.491000] drivers/usb/core/inode.c: creating file '005'
[    9.491000] uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
[    9.492000] uhci_hcd 0000:00:1d.3: detected 2 ports
[    9.492000] uhci_hcd 0000:00:1d.3: uhci_check_and_reset_hc: cmd = 0x0000
[    9.492000] uhci_hcd 0000:00:1d.3: Performing full reset
[    9.492000] uhci_hcd 0000:00:1d.3: irq 19, io base 0x00001880
[    9.492000] usb usb5: default language 0x0409
[    9.492000] usb usb5: uevent
[    9.493000] usb usb5: usb_probe_device
[    9.493000] usb usb5: configuration #1 chosen from 1 choice
[    9.493000] usb usb5: adding 5-0:1.0 (config #1, interface 0)
[    9.493000] usb 5-0:1.0: uevent
[    9.493000] hub 5-0:1.0: usb_probe_interface
[    9.493000] hub 5-0:1.0: usb_probe_interface - got id
[    9.493000] hub 5-0:1.0: USB hub found
[    9.493000] hub 5-0:1.0: 2 ports detected
[    9.494000] hub 5-0:1.0: standalone hub
[    9.494000] hub 5-0:1.0: no power switching (usb 1.0)
[    9.494000] hub 5-0:1.0: individual port over-current protection
[    9.494000] hub 5-0:1.0: power on to power good time: 2ms
[    9.494000] hub 5-0:1.0: local power source is good
[    9.494000] hub 5-0:1.0: trying to enable port power on non-switchable hub
[    9.595500] hub 5-0:1.0: state 7 ports 2 chg 0000 evt 0000
[    9.595000] drivers/usb/core/inode.c: creating file '001'
[    9.595500] uhci_hcd 0000:00:1d.3: port 2 portsc 009b,00
[    9.595500] hub 5-0:1.0: port 2, status 0101, change 0003, 12 Mb/s
[    9.595000] usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
[    9.595000] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.595000] usb usb5: Product: UHCI Host Controller
[    9.596000] usb usb5: Manufacturer: Linux 2.6.26-tip-03923-g2c96bcb-dirty uhci_hcd
[    9.596000] usb usb5: SerialNumber: 0000:00:1d.3
[    9.596000] initcall uhci_hcd_init+0x0/0xc6 returned 0 after 405 msecs
[    9.596000] calling  sl811h_init+0x0/0x3d
[    9.596000] sl811: driver sl811-hcd, 19 May 2005
[    9.596000] initcall sl811h_init+0x0/0x3d returned 0 after 0 msecs
[    9.597000] calling  acm_init+0x0/0xd7
[    9.699500] hub 5-0:1.0: debounce: port 2: total 100ms stable 100ms status 0x101
[    9.801500] usb 5-2: new full speed USB device using uhci_hcd and address 2
[    9.922000] usb 5-2: ep0 maxpacket = 8
[    9.949000] usb 5-2: default language 0x0409
[    9.971000] usb 5-2: uevent
[    9.971000] usb 5-2: usb_probe_device
[    9.971000] usb 5-2: configuration #1 chosen from 1 choice
[    9.974000] usb 5-2: adding 5-2:1.0 (config #1, interface 0)
[    9.974000] usb 5-2:1.0: uevent
[    9.975000] drivers/usb/core/inode.c: creating file '002'
[    9.975000] usb 5-2: New USB device found, idVendor=0483, idProduct=2016
[    9.975000] usb 5-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    9.975000] usb 5-2: Product: Biometric Coprocessor
[    9.976000] usb 5-2: Manufacturer: STMicroelectronics
[    9.976000] usbcore: registered new interface driver cdc_acm
[    9.976000] cdc_acm: v0.26:USB Abstract Control Model driver for USB modems and ISDN adapters
[    9.976000] initcall acm_init+0x0/0xd7 returned 0 after 361 msecs
[    9.976000] calling  usblp_init+0x0/0x1b
[    9.976000] usbcore: registered new interface driver usblp
[    9.977000] initcall usblp_init+0x0/0x1b returned 0 after 0 msecs
[    9.977000] calling  adu_init+0x0/0x80
[    9.977000] drivers/usb/misc/adutux.c :  adu_init : enter 
[    9.977000] usbcore: registered new interface driver adutux
[    9.977000] adutux: adutux adutux (see www.ontrak.net) v0.0.13
[    9.977000] adutux: adutux is an experimental driver. Use at your own risk
[    9.977000] drivers/usb/misc/adutux.c :  adu_init : leave, return value 0 
[    9.978000] initcall adu_init+0x0/0x80 returned 0 after 0 msecs
[    9.978000] calling  appledisplay_init+0x0/0x53
[    9.978000] usbcore: registered new interface driver appledisplay
[    9.978000] initcall appledisplay_init+0x0/0x53 returned 0 after 0 msecs
[    9.978000] calling  berry_init+0x0/0x1b
[    9.978000] usbcore: registered new interface driver berry_charge
[    9.979000] initcall berry_init+0x0/0x1b returned 0 after 0 msecs
[    9.979000] calling  usb_cytherm_init+0x0/0x41
[    9.979000] usbcore: registered new interface driver cytherm
[    9.979000] cytherm: v1.0:Cypress USB Thermometer driver
[    9.979000] initcall usb_cytherm_init+0x0/0x41 returned 0 after 0 msecs
[    9.979000] calling  emi62_init+0x0/0x32
[    9.980000] usbcore: registered new interface driver emi62 - firmware loader
[    9.980000] initcall emi62_init+0x0/0x32 returned 0 after 0 msecs
[    9.980000] calling  usb_idmouse_init+0x0/0x3f
[    9.980000] idmouse: Siemens ID Mouse FingerTIP Sensor Driver 0.6
[    9.980000] usbcore: registered new interface driver idmouse
[    9.980000] initcall usb_idmouse_init+0x0/0x3f returned 0 after 0 msecs
[    9.980000] calling  usb_lcd_init+0x0/0x34
[    9.981000] usbcore: registered new interface driver usblcd
[    9.981000] initcall usb_lcd_init+0x0/0x34 returned 0 after 0 msecs
[    9.981000] calling  usb_led_init+0x0/0x34
[    9.981000] usbcore: registered new interface driver usbled
[    9.981000] initcall usb_led_init+0x0/0x34 returned 0 after 0 msecs
[    9.982000] calling  lego_usb_tower_init+0x0/0x7a
[    9.982000] drivers/usb/misc/legousbtower.c: lego_usb_tower_init: enter
[    9.982000] usbcore: registered new interface driver legousbtower
[    9.982000] legousbtower: LEGO USB Tower Driver v0.96
[    9.982000] drivers/usb/misc/legousbtower.c: lego_usb_tower_init: leave, return value 0
[    9.982000] initcall lego_usb_tower_init+0x0/0x7a returned 0 after 0 msecs
[    9.982000] calling  usb_rio_init+0x0/0x32
[    9.983000] usbcore: registered new interface driver rio500
[    9.983000] rio500: v1.1:USB Rio 500 driver
[    9.983000] initcall usb_rio_init+0x0/0x32 returned 0 after 0 msecs
[    9.983000] calling  usbtest_init+0x0/0x40
[    9.983000] usbtest 5-2:1.0: usb_probe_interface
[    9.983000] usbtest 5-2:1.0: usb_probe_interface - got id
[    9.983000] usbcore: registered new interface driver usbtest
[    9.984000] initcall usbtest_init+0x0/0x40 returned 0 after 0 msecs
[    9.984000] calling  cxacru_init+0x0/0x1b
[    9.984000] usbcore: registered new interface driver cxacru
[    9.984000] initcall cxacru_init+0x0/0x1b returned 0 after 0 msecs
[    9.984000] calling  usbatm_usb_init+0x0/0x61
[    9.984000] drivers/usb/atm/usbatm.c: usbatm_usb_init: driver version 1.10
[    9.984000] initcall usbatm_usb_init+0x0/0x61 returned 0 after 0 msecs
[    9.985000] calling  init+0x0/0x1b
[    9.985000] initcall init+0x0/0x1b returned 0 after 0 msecs
[    9.985000] calling  gs_module_init+0x0/0x11c
[    9.985000] gs_module_init: cannot register gadget driver, ret=-19
[    9.985000] initcall gs_module_init+0x0/0x11c returned -19 after 0 msecs
[    9.985000] calling  i8042_init+0x0/0x2db
[    9.986000] PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    9.994000] serio: i8042 KBD port at 0x60,0x64 irq 1
[    9.994000] serio: i8042 AUX port at 0x60,0x64 irq 12
[    9.995000] initcall i8042_init+0x0/0x2db returned 0 after 8 msecs
[    9.995000] calling  ct82c710_init+0x0/0x172
[    9.995000] initcall ct82c710_init+0x0/0x172 returned -19 after 0 msecs
[    9.995000] calling  pcips2_init+0x0/0x1b
[    9.995000] initcall pcips2_init+0x0/0x1b returned 0 after 0 msecs
[    9.996000] calling  mousedev_init+0x0/0x7d
[    9.996500] mice: PS/2 mouse device common for all mice
[    9.996500] initcall mousedev_init+0x0/0x7d returned 0 after 0 msecs
[    9.996500] calling  atkbd_init+0x0/0x1b
[    9.996500] initcall atkbd_init+0x0/0x1b returned 0 after 0 msecs
[    9.997500] calling  lkkbd_init+0x0/0x1b
[   10.002000] input: AT Translated Set 2 keyboard as /class/input/input3
[   10.008500] initcall lkkbd_init+0x0/0x1b returned 0 after 10 msecs
[   10.008500] calling  nkbd_init+0x0/0x1b
[   10.008500] initcall nkbd_init+0x0/0x1b returned 0 after 0 msecs
[   10.008500] calling  gpio_keys_init+0x0/0x14
[   10.008500] initcall gpio_keys_init+0x0/0x14 returned 0 after 0 msecs
[   10.008500] calling  joydump_init+0x0/0x18
[   10.009500] initcall joydump_init+0x0/0x18 returned 0 after 0 msecs
[   10.009500] calling  magellan_init+0x0/0x1b
[   10.009500] initcall magellan_init+0x0/0x1b returned 0 after 0 msecs
[   10.009500] calling  stinger_init+0x0/0x1b
[   10.010500] initcall stinger_init+0x0/0x1b returned 0 after 0 msecs
[   10.010500] calling  tgfx_init+0x0/0x38d
[   10.010500] initcall tgfx_init+0x0/0x38d returned -19 after 0 msecs
[   10.011500] calling  usb_xpad_init+0x0/0x32
[   10.011500] usbcore: registered new interface driver xpad
[   10.011500] xpad: X-Box pad driver
[   10.011500] initcall usb_xpad_init+0x0/0x32 returned 0 after 0 msecs
[   10.011500] calling  usb_acecad_init+0x0/0x32
[   10.011500] usbcore: registered new interface driver usb_acecad
[   10.011500] acecad: v3.2:USB Acecad Flair tablet driver
[   10.012500] initcall usb_acecad_init+0x0/0x32 returned 0 after 0 msecs
[   10.012500] calling  aiptek_init+0x0/0x3d
[   10.012500] usbcore: registered new interface driver aiptek
[   10.012500] aiptek: v2.3 (May 2, 2007): Bryan W. Headley/Chris Atenasio/Cedric Brun/Rene van Paassen
[   10.012500] aiptek: Aiptek HyperPen USB Tablet Driver (Linux 2.6.x)
[   10.012500] initcall aiptek_init+0x0/0x3d returned 0 after 0 msecs
[   10.012500] calling  gtco_init+0x0/0x40
[   10.013500] usbcore: registered new interface driver gtco
[   10.013500] GTCO usb driver version: 2.00.0006initcall gtco_init+0x0/0x40 returned 0 after 0 msecs
[   10.013500] calling  kbtab_init+0x0/0x32
[   10.013500] usbcore: registered new interface driver kbtab
[   10.013500] kbtab: v0.0.2:USB KB Gear JamStudio Tablet driver
[   10.013500] initcall kbtab_init+0x0/0x32 returned 0 after 0 msecs
[   10.014500] calling  pcwd_init_module+0x0/0x19
[   10.015500] initcall pcwd_init_module+0x0/0x19 returned -19 after 0 msecs
[   10.015500] calling  acq_init+0x0/0x5b
[   10.015500] WDT driver for Acquire single board computer initialising.
[   10.015500] acquirewdt: I/O address 0x0043 already in use
[   10.015500] acquirewdt: probe of acquirewdt failed with error -5
[   10.015500] initcall acq_init+0x0/0x5b returned 0 after 0 msecs
[   10.015500] calling  sc520_wdt_init+0x0/0xd5
[   10.016500] sc520_wdt: WDT driver for SC520 initialised. timeout=30 sec (nowayout=1)
[   10.016500] initcall sc520_wdt_init+0x0/0xd5 returned 0 after 0 msecs
[   10.016500] calling  ibwdt_init+0x0/0x5b
[   10.016500] ib700wdt: WDT driver for IB700 single board computer initialising.
[   10.016500] ib700wdt: failed to register misc device
[   10.017500] ib700wdt: probe of ib700wdt failed with error -16
[   10.017500] initcall ibwdt_init+0x0/0x5b returned 0 after 0 msecs
[   10.017500] calling  sbc7240_wdt_init+0x0/0xfa
[   10.017500] sbc7240_wdt: timeout set to 30 seconds
[   10.017500] sbc7240_wdt: cannot register miscdev on minor=130 (err=-16)
[   10.017500] initcall sbc7240_wdt_init+0x0/0xfa returned -16 after 0 msecs
[   10.017500] initcall sbc7240_wdt_init+0x0/0xfa returned with error code -16 
[   10.017500] calling  w83877f_wdt_init+0x0/0x13c
[   10.018500] w83877f_wdt: cannot register miscdev on minor=130 (err=-16)
[   10.018500] initcall w83877f_wdt_init+0x0/0x13c returned -16 after 0 msecs
[   10.018500] initcall w83877f_wdt_init+0x0/0x13c returned with error code -16 
[   10.018500] calling  telephony_init+0x0/0x44
[   10.018500] Linux telephony interface: v1.00
[   10.018500] initcall telephony_init+0x0/0x44 returned 0 after 0 msecs
[   10.018500] calling  isdn_init+0x0/0x267
[   10.019500] ISDN subsystem Rev: 1.1.2.3/1.1.2.3/1.1.2.2/none/none/1.1.2.2
[   10.019500] initcall isdn_init+0x0/0x267 returned 0 after 0 msecs
[   10.019500] calling  divert_init+0x0/0x5e
[   10.019500] dss1_divert module successfully installed
[   10.019500] initcall divert_init+0x0/0x5e returned 0 after 0 msecs
[   10.020500] calling  HiSax_init+0x0/0x303
[   10.020500] HiSax: Linux Driver for passive ISDN cards
[   10.020500] HiSax: Version 3.5 (kernel)
[   10.020500] HiSax: Layer1 Revision 2.46.2.5
[   10.020500] HiSax: Layer2 Revision 2.30.2.4
[   10.020500] HiSax: TeiMgr Revision 2.20.2.3
[   10.020500] HiSax: Layer3 Revision 2.22.2.3
[   10.020500] HiSax: LinkLayer Revision 2.59.2.4
[   10.020500] HiSax: Total 1 card defined
[   10.020500] HiSax: Card 1 Protocol EDSS1 Id=HiSax (0)
[   10.021500] HiSax: Niccy driver Rev. 1.21.2.4
[   10.021500] Niccy: io0 0 and NO_PCI_BIOS
[   10.021500] Niccy: unable to config NICCY PCI
[   10.021500] HiSax: Card NICCY not installed !
[   10.021500] initcall HiSax_init+0x0/0x303 returned -19 after 0 msecs
[   10.021500] calling  act2000_init+0x0/0x57
[   10.021500] IBM Active 2000 ISDN driver
[   10.021500] act2000: No cards defined yet
[   10.021500] initcall act2000_init+0x0/0x57 returned 0 after 0 msecs
[   10.022500] calling  init+0x0/0x1e8
[   10.022500] lguest: mapped switcher at ffc00000
[   10.022500] initcall init+0x0/0x1e8 returned 0 after 0 msecs
[   10.022500] calling  mmc_blk_init+0x0/0x27
[   10.022500] initcall mmc_blk_init+0x0/0x27 returned 0 after 0 msecs
[   10.023500] calling  mmc_test_init+0x0/0x14
[   10.023500] initcall mmc_test_init+0x0/0x14 returned 0 after 0 msecs
[   10.023500] calling  sdio_uart_init+0x0/0xcb
[   10.023500] initcall sdio_uart_init+0x0/0xcb returned 0 after 0 msecs
[   10.023500] calling  tifm_sd_init+0x0/0x14
[   10.023500] initcall tifm_sd_init+0x0/0x14 returned 0 after 0 msecs
[   10.024500] calling  memstick_init+0x0/0x72
[   10.024500] initcall memstick_init+0x0/0x72 returned 0 after 0 msecs
[   10.024500] calling  mspro_block_init+0x0/0x68
[   10.024500] initcall mspro_block_init+0x0/0x68 returned 0 after 0 msecs
[   10.024500] calling  tifm_ms_init+0x0/0x14
[   10.025500] initcall tifm_ms_init+0x0/0x14 returned 0 after 0 msecs
[   10.025500] calling  gpio_led_init+0x0/0x14
[   10.025500] Registered led device: rdc:dmz
[   10.025500] initcall gpio_led_init+0x0/0x14 returned 0 after 0 msecs
[   10.025500] calling  dcdbas_init+0x0/0x58
[   10.026500] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[   10.026500] initcall dcdbas_init+0x0/0x58 returned 0 after 0 msecs
[   10.026500] calling  sysctl_core_init+0x0/0x14
[   10.026500] initcall sysctl_core_init+0x0/0x14 returned 0 after 0 msecs
[   10.026500] calling  flow_cache_init+0x0/0x14d
[   10.026500] initcall flow_cache_init+0x0/0x14d returned 0 after 0 msecs
[   10.027500] calling  pg_init+0x0/0x254
[   10.027500] pktgen v2.69: Packet Generator for packet performance testing.
[   10.027500] initcall pg_init+0x0/0x254 returned 0 after 0 msecs
[   10.027500] calling  llc_init+0x0/0x20
[   10.027500] initcall llc_init+0x0/0x20 returned 0 after 0 msecs
[   10.027500] calling  snap_init+0x0/0x2f
[   10.027500] initcall snap_init+0x0/0x2f returned 0 after 0 msecs
[   10.028500] calling  nfnetlink_init+0x0/0x54
[   10.028500] Netfilter messages via NETLINK v0.30.
[   10.028500] initcall nfnetlink_init+0x0/0x54 returned 0 after 0 msecs
[   10.028500] calling  nfnetlink_queue_init+0x0/0x8c
[   10.028500] initcall nfnetlink_queue_init+0x0/0x8c returned 0 after 0 msecs
[   10.028500] calling  nf_conntrack_standalone_init+0x0/0xa0
[   10.028500] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[   10.028500] initcall nf_conntrack_standalone_init+0x0/0xa0 returned 0 after 0 msecs
[   10.029500] calling  nf_conntrack_tftp_init+0x0/0x154
[   10.029500] initcall nf_conntrack_tftp_init+0x0/0x154 returned 0 after 0 msecs
[   10.029500] calling  xt_init+0x0/0x83
[   10.029500] initcall xt_init+0x0/0x83 returned 0 after 0 msecs
[   10.029500] calling  tcpudp_mt_init+0x0/0x19
[   10.029500] initcall tcpudp_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.030500] calling  xt_rateest_tg_init+0x0/0x3b
[   10.030500] initcall xt_rateest_tg_init+0x0/0x3b returned 0 after 0 msecs
[   10.030500] calling  tcpmss_tg_init+0x0/0x19
[   10.030500] initcall tcpmss_tg_init+0x0/0x19 returned 0 after 0 msecs
[   10.030500] calling  comment_mt_init+0x0/0x19
[   10.030500] initcall comment_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.030500] calling  connmark_mt_init+0x0/0x19
[   10.030500] initcall connmark_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.031500] calling  dscp_mt_init+0x0/0x19
[   10.031500] initcall dscp_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.031500] calling  iprange_mt_init+0x0/0x19
[   10.031500] initcall iprange_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.031500] calling  xt_rateest_mt_init+0x0/0x19
[   10.031500] initcall xt_rateest_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.031500] calling  sctp_mt_init+0x0/0x19
[   10.031500] initcall sctp_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.032500] calling  state_mt_init+0x0/0x19
[   10.032500] initcall state_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.032500] calling  u32_mt_init+0x0/0x19
[   10.032500] initcall u32_mt_init+0x0/0x19 returned 0 after 0 msecs
[   10.032500] calling  sysctl_ipv4_init+0x0/0x44
[   10.032500] initcall sysctl_ipv4_init+0x0/0x44 returned 0 after 0 msecs
[   10.032500] calling  ah4_init+0x0/0x5f
[   10.032500] initcall ah4_init+0x0/0x5f returned 0 after 0 msecs
[   10.033500] calling  esp4_init+0x0/0x5f
[   10.033500] initcall esp4_init+0x0/0x5f returned 0 after 0 msecs
[   10.033500] calling  ipcomp4_init+0x0/0x5f
[   10.033500] initcall ipcomp4_init+0x0/0x5f returned 0 after 0 msecs
[   10.033500] calling  ipip_init+0x0/0x8d
[   10.033500] initcall ipip_init+0x0/0x8d returned 0 after 0 msecs
[   10.033500] calling  tunnel4_init+0x0/0x5f
[   10.033500] initcall tunnel4_init+0x0/0x5f returned 0 after 0 msecs
[   10.034500] calling  xfrm4_mode_tunnel_init+0x0/0x19
[   10.034500] initcall xfrm4_mode_tunnel_init+0x0/0x19 returned 0 after 0 msecs
[   10.034500] calling  ipv4_netfilter_init+0x0/0x14
[   10.034500] initcall ipv4_netfilter_init+0x0/0x14 returned 0 after 0 msecs
[   10.034500] calling  arp_tables_init+0x0/0x7d
[   10.034500] arp_tables: (C) 2002 David S. Miller
[   10.034500] initcall arp_tables_init+0x0/0x7d returned 0 after 0 msecs
[   10.035500] calling  arpt_mangle_init+0x0/0x14
[   10.035500] initcall arpt_mangle_init+0x0/0x14 returned 0 after 0 msecs
[   10.035500] calling  arptable_filter_init+0x0/0x3d
[   10.035500] initcall arptable_filter_init+0x0/0x3d returned 0 after 0 msecs
[   10.035500] calling  ip_queue_init+0x0/0x111
[   10.035500] initcall ip_queue_init+0x0/0x111 returned 0 after 0 msecs
[   10.035500] calling  cubictcp_register+0x0/0x98
[   10.035500] TCP cubic registered
[   10.036500] initcall cubictcp_register+0x0/0x98 returned 0 after 0 msecs
[   10.036500] calling  xfrm_user_init+0x0/0x56
[   10.036500] Initializing XFRM netlink socket
[   10.037500] initcall xfrm_user_init+0x0/0x56 returned 0 after 0 msecs
[   10.037500] calling  inet6_init+0x0/0x2ee
[   10.037500] NET: Registered protocol family 10
[   10.039500] initcall inet6_init+0x0/0x2ee returned 0 after 1 msecs
[   10.039500] calling  esp6_init+0x0/0x5f
[   10.039500] initcall esp6_init+0x0/0x5f returned 0 after 0 msecs
[   10.039500] calling  ipcomp6_init+0x0/0x5f
[   10.040500] initcall ipcomp6_init+0x0/0x5f returned 0 after 0 msecs
[   10.040500] calling  xfrm6_tunnel_init+0x0/0xe0
[   10.040500] initcall xfrm6_tunnel_init+0x0/0xe0 returned 0 after 0 msecs
[   10.040500] calling  tunnel6_init+0x0/0x5f
[   10.040500] initcall tunnel6_init+0x0/0x5f returned 0 after 0 msecs
[   10.040500] calling  xfrm6_transport_init+0x0/0x19
[   10.040500] initcall xfrm6_transport_init+0x0/0x19 returned 0 after 0 msecs
[   10.040500] calling  ip6_queue_init+0x0/0x111
[   10.041500] initcall ip6_queue_init+0x0/0x111 returned 0 after 0 msecs
[   10.041500] calling  ip6_tunnel_init+0x0/0x91
[   10.041500] ------------[ cut here ]------------
[   10.041500] WARNING: at net/core/dst.c:265 dst_release+0x24/0x2b()
[   10.041500] Modules linked in:
[   10.042500] Pid: 7, comm: ksoftirqd/1 Not tainted 2.6.26-tip-03923-g2c96bcb-dirty #3134
[   10.042500]  [<b0139b2d>] warn_on_slowpath+0x46/0x6a
[   10.042500]  [<b0152c9a>] ? put_lock_stats+0xd/0x21
[   10.042500]  [<b015397b>] ? __lock_acquire+0x5ba/0x618
[   10.042500]  [<b0152c9a>] ? put_lock_stats+0xd/0x21
[   10.042500]  [<b05642f6>] dst_release+0x24/0x2b
[   10.043500]  [<b055bfa3>] skb_release_all+0x13/0x83
[   10.043500]  [<b055b910>] __kfree_skb+0x10/0x6b
[   10.043500]  [<b0561e16>] net_tx_action+0x6e/0xee
[   10.043500]  [<b013e38d>] __do_softirq+0x7a/0xe8
[   10.043500]  [<b013e313>] ? __do_softirq+0x0/0xe8
[   10.043500]  [<b011ccc6>] do_softirq+0x79/0xba
[   10.043500]  [<b013e647>] ksoftirqd+0x88/0x13b
[   10.044500]  [<b013e5bf>] ? ksoftirqd+0x0/0x13b
[   10.044500]  [<b014a365>] kthread+0x40/0x67
[   10.044500]  [<b014a325>] ? kthread+0x0/0x67
[   10.044500]  [<b011b7c7>] kernel_thread_helper+0x7/0x10
[   10.044500]  =======================
[   10.044500] ---[ end trace 96563eea573244e7 ]---
[   10.044500] Attempt to release alive inet socket f6fac040
[   10.045500] initcall ip6_tunnel_init+0x0/0x91 returned 0 after 3 msecs
[   10.045500] calling  packet_init+0x0/0x3e
[   10.045500] NET: Registered protocol family 17
[   10.045500] initcall packet_init+0x0/0x3e returned 0 after 0 msecs
[   10.045500] calling  br_init+0x0/0xb1
[   10.045500] initcall br_init+0x0/0xb1 returned 0 after 0 msecs
[   10.045500] calling  ipx_init+0x0/0xd7
[   10.046500] NET: Registered protocol family 4
[   10.046500] initcall ipx_init+0x0/0xd7 returned 0 after 0 msecs
[   10.046500] calling  atm_clip_init+0x0/0x95
[   10.046500] initcall atm_clip_init+0x0/0x95 returned 0 after 0 msecs
[   10.046500] calling  econet_proto_init+0x0/0x190
[   10.046500] NET: Registered protocol family 19
[   10.046500] initcall econet_proto_init+0x0/0x190 returned 0 after 0 msecs
[   10.046500] calling  ieee80211_init+0x0/0x20
[   10.047500] ieee80211: 802.11 data/management/control stack, git-1.1.13
[   10.047500] ieee80211: Copyright (C) 2004-2005 Intel Corporation <jketreno@linux.intel.com>
[   10.047500] initcall ieee80211_init+0x0/0x20 returned 0 after 0 msecs
[   10.047500] calling  ieee80211_crypto_init+0x0/0x14
[   10.047500] ieee80211_crypt: registered algorithm 'NULL'
[   10.047500] initcall ieee80211_crypto_init+0x0/0x14 returned 0 after 0 msecs
[   10.047500] calling  update_mp_table+0x0/0x400
[   10.047500] initcall update_mp_table+0x0/0x400 returned 0 after 0 msecs
[   10.048500] calling  lapic_insert_resource+0x0/0x49
[   10.048500] initcall lapic_insert_resource+0x0/0x49 returned 0 after 0 msecs
[   10.048500] calling  init_lapic_nmi_sysfs+0x0/0x38
[   10.048500] initcall init_lapic_nmi_sysfs+0x0/0x38 returned 0 after 0 msecs
[   10.048500] calling  io_apic_bug_finalize+0x0/0x1f
[   10.048500] initcall io_apic_bug_finalize+0x0/0x1f returned 0 after 0 msecs
[   10.048500] calling  balanced_irq_init+0x0/0x147
[   10.048500] Starting balanced_irq
[   10.049500] initcall balanced_irq_init+0x0/0x147 returned 0 after 0 msecs
[   10.049500] calling  check_early_ioremap_leak+0x0/0x3d
[   10.049500] initcall check_early_ioremap_leak+0x0/0x3d returned 0 after 0 msecs
[   10.049500] calling  print_ipi_mode+0x0/0x2a
[   10.049500] Using IPI No-Shortcut mode
[   10.049500] initcall print_ipi_mode+0x0/0x2a returned 0 after 0 msecs
[   10.049500] calling  init_oops_id+0x0/0x28
[   10.049500] initcall init_oops_id+0x0/0x28 returned 0 after 0 msecs
[   10.050500] calling  disable_boot_consoles+0x0/0x3b
[   10.050500] initcall disable_boot_consoles+0x0/0x3b returned 0 after 0 msecs
[   10.050500] calling  pm_qos_power_init+0x0/0x59
[   10.050500] initcall pm_qos_power_init+0x0/0x59 returned 0 after 0 msecs
[   10.050500] calling  debugfs_kprobe_init+0x0/0x7d
[   10.050500] initcall debugfs_kprobe_init+0x0/0x7d returned 0 after 0 msecs
[   10.051500] calling  taskstats_init+0x0/0x82
[   10.051500] registered taskstats version 1
[   10.051500] initcall taskstats_init+0x0/0x82 returned 0 after 0 msecs
[   10.051500] calling  fail_page_alloc_debugfs+0x0/0xc6
[   10.051500] initcall fail_page_alloc_debugfs+0x0/0xc6 returned 0 after 0 msecs
[   10.051500] calling  fail_make_request_debugfs+0x0/0x19
[   10.052500] initcall fail_make_request_debugfs+0x0/0x19 returned 0 after 0 msecs
[   10.052500] calling  random32_reseed+0x0/0x4e
[   10.052500] initcall random32_reseed+0x0/0x4e returned 0 after 0 msecs
[   10.052500] calling  pci_sysfs_init+0x0/0x49
[   10.052500] initcall pci_sysfs_init+0x0/0x49 returned 0 after 0 msecs
[   10.052500] calling  acpi_wakeup_device_init+0x0/0x9f
[   10.053500] initcall acpi_wakeup_device_init+0x0/0x9f returned 0 after 0 msecs
[   10.053500] calling  acpi_sleep_proc_init+0x0/0x93
[   10.053500] initcall acpi_sleep_proc_init+0x0/0x93 returned 0 after 0 msecs
[   10.053500] calling  seqgen_init+0x0/0x13
[   10.053500] initcall seqgen_init+0x0/0x13 returned 0 after 0 msecs
[   10.053500] calling  hd_init+0x0/0x2a0
[   10.053500] hd: no drives specified - use hd=cyl,head,sectors on kernel command line
[   10.054500] initcall hd_init+0x0/0x2a0 returned -1 after 0 msecs
[   10.054500] initcall hd_init+0x0/0x2a0 returned with error code -1 
[   10.054500] calling  scsi_complete_async_scans+0x0/0xd2
[   10.054500] initcall scsi_complete_async_scans+0x0/0xd2 returned 0 after 0 msecs
[   10.054500] calling  tcp_congestion_default+0x0/0x14
[   10.054500] initcall tcp_congestion_default+0x0/0x14 returned 0 after 0 msecs
[   10.054500] calling  ip_auto_config+0x0/0xc8b
[   10.054500] initcall ip_auto_config+0x0/0xc8b returned 0 after 0 msecs
[   10.085500] kjournald starting.  Commit interval 5 seconds
[   10.085000] EXT3-fs: mounted filesystem with ordered data mode.
[   10.085000] VFS: Mounted root (ext3 filesystem) readonly.
[   10.086000] Freeing unused kernel memory: 652k freed
[   10.454000] usb usb2: suspend_rh (auto-stop)
[   10.454000] usb usb3: suspend_rh (auto-stop)
[   10.704000] usb usb4: suspend_rh (auto-stop)
[   13.522500] usb usb2: uevent
[   13.522500] usb 2-0:1.0: uevent
[   13.522500] usb usb3: uevent
[   13.522500] usb 3-0:1.0: uevent
[   13.523500] usb usb4: uevent
[   13.523500] usb 4-0:1.0: uevent
[   13.523500] usb usb5: uevent
[   13.523500] usb 5-0:1.0: uevent
[   13.523500] usb 5-2: uevent
[   13.523500] usb 5-2:1.0: uevent
[   13.523500] usb usb1: uevent
[   13.524500] usb 1-0:1.0: uevent
[   19.394000] Attempt to release alive inet socket f6fac040
[   20.389000] EXT3 FS on sda1, internal journal
[   20.764500] eth0: no IPv6 routers present
[   22.460000] warning: process `kudzu' used the deprecated sysctl system call with 1.23.
[   22.933000] ------------[ cut here ]------------
[   22.933000] kernel BUG at mm/slab.c:2927!
[   22.933000] invalid opcode: 0000 [#1] PREEMPT SMP 
[   22.933000] Modules linked in:
[   22.933000] 
[   22.933000] Pid: 1796, comm: ip6tables-resto Tainted: G        W (2.6.26-tip-03923-g2c96bcb-dirty #3134)
[   22.933000] EIP: 0060:[<b01878d2>] EFLAGS: 00010046 CPU: 0
[   22.933000] EIP is at cache_alloc_refill+0xfa/0x431
[   22.933000] EAX: 00000004 EBX: f6684800 ECX: f6f806c0 EDX: f6fa3c40
[   22.933000] ESI: f6fac000 EDI: 0000000b EBP: f6badec4 ESP: f6bade70
[   22.933000]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
[   22.933000] Process ip6tables-resto (pid: 1796, ti=f6bad000 task=f67ac060 task.ti=f6bad000)
[   22.933000] Stack: 00000004 00000004 000000d0 000000d0 f6f806c8 f6f806d0 f6fac01c 000080d0 
[   22.933000]        f6fa3c40 f6fa9800 f6f806c0 00000000 7f430025 b014a3e9 b2bd6a80 00000000 
[   22.933000]        00000000 00000000 00000246 f6fa3c40 f6fa3c40 f6badee4 b0187793 b07c11d6 
[   22.933000] Call Trace:
[   22.933000]  [<b014a3e9>] ? __wake_up_bit+0xc/0x37
[   22.933000]  [<b0187793>] ? kmem_cache_alloc+0x53/0x98
[   22.933000]  [<b05589b5>] ? sk_prot_alloc+0x1e/0xa7
[   22.933000]  [<b026cb86>] ? cap_capable+0xa/0x2b
[   22.933000]  [<b0559fa4>] ? sk_alloc+0x20/0xa3
[   22.933000]  [<b05c4364>] ? inet6_create+0x187/0x316
[   22.933000]  [<b0556e87>] ? __sock_create+0x15b/0x229
[   22.933000]  [<b0556f9c>] ? sock_create+0x29/0x2e
[   22.933000]  [<b0557112>] ? sys_socket+0x1e/0x42
[   22.933000]  [<b05577b6>] ? sys_socketcall+0x56/0x163
[   22.933000]  [<b011a418>] ? resume_userspace+0x8/0x30
[   22.933000]  [<b011a4ff>] ? sysenter_past_esp+0x78/0xb9
[   22.933000]  =======================
[   22.933000] Code: bb 00 00 00 8b 45 d4 8b 30 39 c6 75 13 c7 40 50 01 00 00 00 8b 70 10 3b 75 c0 0f 84 94 00 00 00 8b 55 cc 8b 42 38 39 46 10 72 37 <0f> 0b eb fe 8b 0b 89 4d ac 8b 56 14 8b 45 cc 0f af 50 2c 03 56 
[   22.933000] EIP: [<b01878d2>] cache_alloc_refill+0xfa/0x431 SS:ESP 0068:f6bade70
[   22.933000] Kernel panic - not syncing: Fatal exception
[   22.933000] Pid: 1796, comm: ip6tables-resto Tainted: G      D W 2.6.26-tip-03923-g2c96bcb-dirty #3134
[   22.933000]  [<b0139a3e>] panic+0x4e/0xf7
[   22.933000]  [<b064b7ca>] oops_end+0x70/0x94
[   22.933000]  [<b011bef6>] die+0x5c/0x64
[   22.933000]  [<b064b9cf>] do_trap+0x83/0x8b
[   22.933000]  [<b011bf7a>] ? do_invalid_op+0x0/0x7b
[   22.933000]  [<b011bfeb>] do_invalid_op+0x71/0x7b
[   22.933000]  [<b01878d2>] ? cache_alloc_refill+0xfa/0x431
[   22.933000]  [<b012e2cb>] ? kmap_atomic_prot+0x1f/0x1de
[   22.933000]  [<b019bed2>] ? touch_atime+0xa7/0xc1
[   22.933000]  [<b064b5a2>] error_code+0x72/0x80
[   22.933000]  [<b01878d2>] ? cache_alloc_refill+0xfa/0x431
[   22.933000]  [<b014a3e9>] ? __wake_up_bit+0xc/0x37
[   22.933000]  [<b0187793>] kmem_cache_alloc+0x53/0x98
[   22.933000]  [<b05589b5>] sk_prot_alloc+0x1e/0xa7
[   22.933000]  [<b026cb86>] ? cap_capable+0xa/0x2b
[   22.933000]  [<b0559fa4>] sk_alloc+0x20/0xa3
[   22.933000]  [<b05c4364>] inet6_create+0x187/0x316
[   22.933000]  [<b0556e87>] __sock_create+0x15b/0x229
[   22.933000]  [<b0556f9c>] sock_create+0x29/0x2e
[   22.933000]  [<b0557112>] sys_socket+0x1e/0x42
[   22.933000]  [<b05577b6>] sys_socketcall+0x56/0x163
[   22.933000]  [<b011a418>] ? resume_userspace+0x8/0x30
[   22.933000]  [<b011a4ff>] sysenter_past_esp+0x78/0xb9
[   22.933000]  =======================
[   22.933000] ------------[ cut here ]------------
[   22.933000] WARNING: at kernel/smp.c:288 smp_call_function_mask+0x38/0x131()
[   22.933000] Modules linked in:
[   22.933000] Pid: 1796, comm: ip6tables-resto Tainted: G      D W 2.6.26-tip-03923-g2c96bcb-dirty #3134
[   22.933000]  [<b0139b2d>] warn_on_slowpath+0x46/0x6a
[   22.933000]  [<b0139f0f>] ? wake_up_klogd+0x8/0x36
[   22.933000]  [<b013a0d6>] ? release_console_sem+0x199/0x1a1
[   22.933000]  [<b013a61b>] ? vprintk+0x384/0x3a4
[   22.933000]  [<b064b2a1>] ? _spin_unlock_irqrestore+0x3b/0x51
[   22.933000]  [<b0130020>] ? twofish_dec_blk+0xd9/0x729
[   22.933000]  [<b011a4ff>] ? sysenter_past_esp+0x78/0xb9
[   22.933000]  [<b013a655>] ? printk+0x1a/0x1c
[   22.933000]  [<b0162cc2>] ? touch_softlockup_watchdog+0x8/0x1d
[   22.933000]  [<b015806e>] smp_call_function_mask+0x38/0x131
[   22.933000]  [<b0127d94>] ? stop_this_cpu+0x0/0x48
[   22.933000]  [<b013a655>] ? printk+0x1a/0x1c
[   22.933000]  [<b011bc3e>] ? show_trace_log_lvl+0x25/0x2d
[   22.933000]  [<b011c0e2>] ? show_trace+0x15/0x19
[   22.933000]  [<b0127d94>] ? stop_this_cpu+0x0/0x48
[   22.933000]  [<b0158191>] smp_call_function+0x2a/0x53
[   22.933000]  [<b0127e32>] native_smp_send_stop+0x20/0x4a
[   22.933000]  [<b0139a4b>] panic+0x5b/0xf7
[   22.933000]  [<b064b7ca>] oops_end+0x70/0x94
[   22.933000]  [<b011bef6>] die+0x5c/0x64
[   22.933000]  [<b064b9cf>] do_trap+0x83/0x8b
[   22.933000]  [<b011bf7a>] ? do_invalid_op+0x0/0x7b
[   22.933000]  [<b011bfeb>] do_invalid_op+0x71/0x7b
[   22.933000]  [<b01878d2>] ? cache_alloc_refill+0xfa/0x431
[   22.933000]  [<b012e2cb>] ? kmap_atomic_prot+0x1f/0x1de
[   22.933000]  [<b019bed2>] ? touch_atime+0xa7/0xc1
[   22.933000]  [<b064b5a2>] error_code+0x72/0x80
[   22.933000]  [<b01878d2>] ? cache_alloc_refill+0xfa/0x431
[   22.933000]  [<b014a3e9>] ? __wake_up_bit+0xc/0x37
[   22.933000]  [<b0187793>] kmem_cache_alloc+0x53/0x98
[   22.933000]  [<b05589b5>] sk_prot_alloc+0x1e/0xa7
[   22.933000]  [<b026cb86>] ? cap_capable+0xa/0x2b
[   22.933000]  [<b0559fa4>] sk_alloc+0x20/0xa3
[   22.933000]  [<b05c4364>] inet6_create+0x187/0x316
[   22.933000]  [<b0556e87>] __sock_create+0x15b/0x229
[   22.933000]  [<b0556f9c>] sock_create+0x29/0x2e
[   22.933000]  [<b0557112>] sys_socket+0x1e/0x42
[   22.933000]  [<b05577b6>] sys_socketcall+0x56/0x163
[   22.933000]  [<b011a418>] ? resume_userspace+0x8/0x30
[   22.933000]  [<b011a4ff>] sysenter_past_esp+0x78/0xb9
[   22.933000]  =======================
[   22.933000] ---[ end trace 96563eea573244e7 ]---
[   22.933000] ------------[ cut here ]------------
[   22.933000] WARNING: at kernel/smp.c:214 smp_call_function_single+0x44/0xd5()
[   22.933000] Modules linked in:
[   22.933000] Pid: 1796, comm: ip6tables-resto Tainted: G      D W 2.6.26-tip-03923-g2c96bcb-dirty #3134
[   22.933000]  [<b0139b2d>] warn_on_slowpath+0x46/0x6a
[   22.933000]  [<b0139f0f>] ? wake_up_klogd+0x8/0x36
[   22.933000]  [<b013a0d6>] ? release_console_sem+0x199/0x1a1
[   22.933000]  [<b013a61b>] ? vprintk+0x384/0x3a4
[   22.933000]  [<b064b2a1>] ? _spin_unlock_irqrestore+0x3b/0x51
[   22.933000]  [<b0130020>] ? twofish_dec_blk+0xd9/0x729
[   22.933000]  [<b0157fa5>] smp_call_function_single+0x44/0xd5
[   22.933000]  [<b0127d94>] ? stop_this_cpu+0x0/0x48
[   22.933000]  [<b013a655>] ? printk+0x1a/0x1c
[   22.933000]  [<b0162cc2>] ? touch_softlockup_watchdog+0x8/0x1d
[   22.933000]  [<b01580b8>] smp_call_function_mask+0x82/0x131
[   22.933000]  [<b0127d94>] ? stop_this_cpu+0x0/0x48
[   22.933000]  [<b013a655>] ? printk+0x1a/0x1c
[   22.933000]  [<b011bc3e>] ? show_trace_log_lvl+0x25/0x2d
[   22.933000]  [<b011c0e2>] ? show_trace+0x15/0x19
[   22.933000]  [<b0127d94>] ? stop_this_cpu+0x0/0x48
[   22.933000]  [<b0158191>] smp_call_function+0x2a/0x53
[   22.933000]  [<b0127e32>] native_smp_send_stop+0x20/0x4a
[   22.933000]  [<b0139a4b>] panic+0x5b/0xf7
[   22.933000]  [<b064b7ca>] oops_end+0x70/0x94
[   22.933000]  [<b011bef6>] die+0x5c/0x64
[   22.933000]  [<b064b9cf>] do_trap+0x83/0x8b
[   22.933000]  [<b011bf7a>] ? do_invalid_op+0x0/0x7b
[   22.933000]  [<b011bfeb>] do_invalid_op+0x71/0x7b
[   22.933000]  [<b01878d2>] ? cache_alloc_refill+0xfa/0x431
[   22.933000]  [<b012e2cb>] ? kmap_atomic_prot+0x1f/0x1de
[   22.933000]  [<b019bed2>] ? touch_atime+0xa7/0xc1
[   22.933000]  [<b064b5a2>] error_code+0x72/0x80
[   22.933000]  [<b01878d2>] ? cache_alloc_refill+0xfa/0x431
[   22.933000]  [<b014a3e9>] ? __wake_up_bit+0xc/0x37
[   22.933000]  [<b0187793>] kmem_cache_alloc+0x53/0x98
[   22.933000]  [<b05589b5>] sk_prot_alloc+0x1e/0xa7
[   22.933000]  [<b026cb86>] ? cap_capable+0xa/0x2b
[   22.933000]  [<b0559fa4>] sk_alloc+0x20/0xa3
[   22.933000]  [<b05c4364>] inet6_create+0x187/0x316
[   22.933000]  [<b0556e87>] __sock_create+0x15b/0x229
[   22.933000]  [<b0556f9c>] sock_create+0x29/0x2e
[   22.933000]  [<b0557112>] sys_socket+0x1e/0x42
[   22.933000]  [<b05577b6>] sys_socketcall+0x56/0x163
[   22.933000]  [<b011a418>] ? resume_userspace+0x8/0x30
[   22.933000]  [<b011a4ff>] sysenter_past_esp+0x78/0xb9
[   22.933000]  =======================
[   22.933000] ---[ end trace 96563eea573244e7 ]---
[   22.933000] Rebooting in 1 seconds..[    0.000000] Initializing cgroup subsys cpuset

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

update about this problem: just triggered another colorful crash, see 
below. This was with the 4K object dump patch already, maybe the dump 
gives a clue?

The upstream base of this test kernel was v2.6.26-5253-g14b395e - i.e. 
post the big networking pull, but this problem predates it. (It first 
triggered after v2.6.26)

All the crashes trigger in or close to networking code - not a single 
block IO DMA or other DMA crash happened so far, and no filesystem 
corruptions or anything like that which would signal hw trouble.

	Ingo

------------------>
initcall sctp_init+0x0/0x697 returned 0 after 9 msecs
calling  powernowk8_init+0x0/0x6e
initcall powernowk8_init+0x0/0x6e returned -19 after 0 msecs
calling  hpet_insert_resource+0x0/0x1e
initcall hpet_insert_resource+0x0/0x1e returned 0 after 0 msecs
calling  lapic_insert_resource+0x0/0x44
initcall lapic_insert_resource+0x0/0x44 returned 0 after 0 msecs
calling  init_lapic_nmi_sysfs+0x0/0x33
initcall init_lapic_nmi_sysfs+0x0/0x33 returned 0 after 0 msecs
=============================================================================
BUG skbuff_head_cache: Poison overwritten
-----------------------------------------------------------------------------

INFO: 0xf7ccc100-0xf7ccc103. First byte 0x0 instead of 0x6b
INFO: Allocated in __alloc_skb+0x30/0x10e age=1 cpu=1 pid=1
INFO: Freed in __kfree_skb+0x63/0x66 age=1 cpu=0 pid=0
INFO: Slab 0xc1c34ca0 objects=16 used=1 fp=0xf7ccc100 flags=0x400000c3
INFO: Object 0xf7ccc100 @offset=256 fp=0xf7ccc200

Bytes b4 0xf7ccc0f0:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
  Object 0xf7ccc100:  00 00 00 00 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b ....kkkkkkkkkkkk
  Object 0xf7ccc110:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc120:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc130:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc140:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc150:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc160:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc170:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc180:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc190:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc1a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b a5 kkkkkkkkkkkkkkk�
 Redzone 0xf7ccc1b0:  bb bb bb bb                                     ����            
 Padding 0xf7ccc1d8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
 Padding 0xf7ccc1e8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
 Padding 0xf7ccc1f8:  5a 5a 5a 5a 5a 5a 5a 5a                         ZZZZZZZZ        
Pid: 1, comm: swapper Not tainted 2.6.26-tip #3261
 [<c01673ad>] print_trailer+0xd1/0xd9
 [<c0167428>] check_bytes_and_report+0x73/0x8f
 [<c0167664>] check_object+0xa5/0x15a
 [<c016824c>] __slab_alloc+0x2fb/0x3c8
 [<c0168364>] kmem_cache_alloc+0x4b/0xa8
 [<c0497376>] ? __alloc_skb+0x30/0x10e
 [<c0497376>] ? __alloc_skb+0x30/0x10e
 [<c0497376>] __alloc_skb+0x30/0x10e
 [<c04a6678>] alloc_skb+0xc/0xe
 [<c04a6ce5>] find_skb+0x28/0x66
 [<c04a6f5f>] netpoll_send_udp+0x2b/0x1cf
 [<c058800f>] ? _spin_lock_irqsave+0x4b/0x55
 [<c03db399>] write_msg+0x79/0xac
 [<c03db320>] ? write_msg+0x0/0xac
 [<c0122f96>] __call_console_drivers+0x56/0x63
 [<c0122ffa>] _call_console_drivers+0x57/0x5b
 [<c0123386>] release_console_sem+0x112/0x1a5
 [<c01238f3>] vprintk+0x344/0x35e

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Pekka Enberg]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset=UTF-8, Size: 3434 bytes --]

Hi Ingo,
On Mon, Jul 21, 2008 at 12:41 PM, Ingo Molnar <mingo@elte.hu> wrote:> update about this problem: just triggered another colorful crash, see> below. This was with the 4K object dump patch already, maybe the dump> gives a clue?
...to point out the obvious:
> =============================================================================> BUG skbuff_head_cache: Poison overwritten> ----------------------------------------------------------------------------->> INFO: 0xf7ccc100-0xf7ccc103. First byte 0x0 instead of 0x6b> INFO: Allocated in __alloc_skb+0x30/0x10e age=1 cpu=1 pid=1> INFO: Freed in __kfree_skb+0x63/0x66 age=1 cpu=0 pid=0> INFO: Slab 0xc1c34ca0 objects=16 used=1 fp=0xf7ccc100 flags=0x400000c3> INFO: Object 0xf7ccc100 @offset=256 fp=0xf7ccc200>> Bytes b4 0xf7ccc0f0:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ>  Object 0xf7ccc100:  00 00 00 00 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b ....kkkkkkkkkkkk
Use after free where first four bytes are zeroed.
>  Object 0xf7ccc110:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc120:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc130:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc140:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc150:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc160:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc170:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc180:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc190:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk>  Object 0xf7ccc1a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b a5 kkkkkkkkkkkkkkk�
Rest of the object looks correct.
>  Redzone 0xf7ccc1b0:  bb bb bb bb                                     ����>  Padding 0xf7ccc1d8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ>  Padding 0xf7ccc1e8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ>  Padding 0xf7ccc1f8:  5a 5a 5a 5a 5a 5a 5a 5a                         ZZZZZZZZ> Pid: 1, comm: swapper Not tainted 2.6.26-tip #3261>  [<c01673ad>] print_trailer+0xd1/0xd9>  [<c0167428>] check_bytes_and_report+0x73/0x8f>  [<c0167664>] check_object+0xa5/0x15a>  [<c016824c>] __slab_alloc+0x2fb/0x3c8>  [<c0168364>] kmem_cache_alloc+0x4b/0xa8>  [<c0497376>] ? __alloc_skb+0x30/0x10e>  [<c0497376>] ? __alloc_skb+0x30/0x10e>  [<c0497376>] __alloc_skb+0x30/0x10e>  [<c04a6678>] alloc_skb+0xc/0xe>  [<c04a6ce5>] find_skb+0x28/0x66>  [<c04a6f5f>] netpoll_send_udp+0x2b/0x1cf>  [<c058800f>] ? _spin_lock_irqsave+0x4b/0x55>  [<c03db399>] write_msg+0x79/0xac>  [<c03db320>] ? write_msg+0x0/0xac>  [<c0122f96>] __call_console_drivers+0x56/0x63>  [<c0122ffa>] _call_console_drivers+0x57/0x5b>  [<c0123386>] release_console_sem+0x112/0x1a5>  [<c01238f3>] vprintk+0x344/0x35e> --> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in> the body of a message to majordomo@vger.kernel.org> More majordomo info at  http://vger.kernel.org/majordomo-info.html> Please read the FAQ at  http://www.tux.org/lkml/>ÿôèº{.nÇ+‰·Ÿ®‰­†+%ŠËÿ±éݶ\x17¥Šwÿº{.nÇ+‰·¥Š{±þG«éÿŠ{ayº\x1dʇڙë,j\a­¢f£¢·hšïêÿ‘êçz_è®\x03(­éšŽŠÝ¢j"ú\x1a¶^[m§ÿÿ¾\a«þG«éÿ¢¸?™¨è­Ú&£ø§~á¶iO•æ¬z·švØ^\x14\x04\x1a¶^[m§ÿÿÃ\fÿ¶ìÿ¢¸?–I¥

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Evgeniy Polyakov]

Hi.

On Mon, Jul 21, 2008 at 12:52:45PM +0300, Pekka Enberg (penberg@cs.helsinki.fi) wrote:
> On Mon, Jul 21, 2008 at 12:41 PM, Ingo Molnar <mingo@elte.hu> wrote:
> > update about this problem: just triggered another colorful crash, see
> > below. This was with the 4K object dump patch already, maybe the dump
> > gives a clue?
> 
> ...to point out the obvious:
> 
> > =============================================================================
> > BUG skbuff_head_cache: Poison overwritten
> > -----------------------------------------------------------------------------
> >
> > INFO: 0xf7ccc100-0xf7ccc103. First byte 0x0 instead of 0x6b
> > INFO: Allocated in __alloc_skb+0x30/0x10e age=1 cpu=1 pid=1
> > INFO: Freed in __kfree_skb+0x63/0x66 age=1 cpu=0 pid=0
> > INFO: Slab 0xc1c34ca0 objects=16 used=1 fp=0xf7ccc100 flags=0x400000c3
> > INFO: Object 0xf7ccc100 @offset=256 fp=0xf7ccc200
> >
> > Bytes b4 0xf7ccc0f0:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> >  Object 0xf7ccc100:  00 00 00 00 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b ....kkkkkkkkkkkk
> 
> Use after free where first four bytes are zeroed.

Not that obvious...
skb->next is cleared in lots of places, in xmit network helper
for example, but since rest of the packet was not modified, it
means given skb was not freed, so it will not help.

Ingo do you see other similar dumps with last byte modified?
That's the one which can help to determine the reason.

-- 
	Evgeniy Polyakov

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:

> Hi.
> 
> On Mon, Jul 21, 2008 at 12:52:45PM +0300, Pekka Enberg (penberg@cs.helsinki.fi) wrote:
> > On Mon, Jul 21, 2008 at 12:41 PM, Ingo Molnar <mingo@elte.hu> wrote:
> > > update about this problem: just triggered another colorful crash, see
> > > below. This was with the 4K object dump patch already, maybe the dump
> > > gives a clue?
> > 
> > ...to point out the obvious:
> > 
> > > =============================================================================
> > > BUG skbuff_head_cache: Poison overwritten
> > > -----------------------------------------------------------------------------
> > >
> > > INFO: 0xf7ccc100-0xf7ccc103. First byte 0x0 instead of 0x6b
> > > INFO: Allocated in __alloc_skb+0x30/0x10e age=1 cpu=1 pid=1
> > > INFO: Freed in __kfree_skb+0x63/0x66 age=1 cpu=0 pid=0
> > > INFO: Slab 0xc1c34ca0 objects=16 used=1 fp=0xf7ccc100 flags=0x400000c3
> > > INFO: Object 0xf7ccc100 @offset=256 fp=0xf7ccc200
> > >
> > > Bytes b4 0xf7ccc0f0:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
> > >  Object 0xf7ccc100:  00 00 00 00 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b ....kkkkkkkkkkkk
> > 
> > Use after free where first four bytes are zeroed.
> 
> Not that obvious...
> skb->next is cleared in lots of places, in xmit network helper
> for example, but since rest of the packet was not modified, it
> means given skb was not freed, so it will not help.
> 
> Ingo do you see other similar dumps with last byte modified? That's 
> the one which can help to determine the reason.

the problem is, most of the crashes dont come with any usable dump. This 
is a laptop so netconsole is the only reliable route out - and if 
something in networking crashes chances are that it hoses netconsole 
before it can get anything out.

Another thing is that i'm activating netconsole on this box via a kernel 
boot line and from within a bzImage (to get it activated as early as 
possible) - maybe that's a tad too early for certain initialization 
sequences?

I could try run tests with netconsole deactivated, if you think that's a 
worthwile line of probing this problem. (although that would make me do 
blind tests in essence - having kernel log output is really essential.)

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Mon, Jul 21, 2008 at 12:50 PM, Ingo Molnar <mingo@elte.hu> wrote:
> the problem is, most of the crashes dont come with any usable dump. This
> is a laptop so netconsole is the only reliable route out - and if
> something in networking crashes chances are that it hoses netconsole
> before it can get anything out.
>
> Another thing is that i'm activating netconsole on this box via a kernel
> boot line and from within a bzImage (to get it activated as early as
> possible) - maybe that's a tad too early for certain initialization
> sequences?
>
> I could try run tests with netconsole deactivated, if you think that's a
> worthwile line of probing this problem. (although that would make me do
> blind tests in essence - having kernel log output is really essential.)

How about posting your custom patches for public review? :-D

(There was recently an odd case of kzalloc() succeeding even though it
was called before the slab caches were initialized -- and it only
generated a warning about irqs-on happening too early. I just mean to
say that it _can_ happen. On another machine, it crashed
spectacularly. I guess you're not enabling the netconsole before slab
allocator is up?)


Vegard

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Vegard Nossum <vegard.nossum@gmail.com> wrote:

> On Mon, Jul 21, 2008 at 12:50 PM, Ingo Molnar <mingo@elte.hu> wrote:
> > the problem is, most of the crashes dont come with any usable dump. This
> > is a laptop so netconsole is the only reliable route out - and if
> > something in networking crashes chances are that it hoses netconsole
> > before it can get anything out.
> >
> > Another thing is that i'm activating netconsole on this box via a kernel
> > boot line and from within a bzImage (to get it activated as early as
> > possible) - maybe that's a tad too early for certain initialization
> > sequences?
> >
> > I could try run tests with netconsole deactivated, if you think 
> > that's a worthwile line of probing this problem. (although that 
> > would make me do blind tests in essence - having kernel log output 
> > is really essential.)
> 
> How about posting your custom patches for public review? :-D

I changed nothing in that area - being able to enable the netconsole 
like that has been a years-old feature. Otherwise it's just tip/master, 
but the weirdnesses were reproducible under plain linus/master as well.

> (There was recently an odd case of kzalloc() succeeding even though it 
> was called before the slab caches were initialized -- and it only 
> generated a warning about irqs-on happening too early. I just mean to 
> say that it _can_ happen. On another machine, it crashed 
> spectacularly. I guess you're not enabling the netconsole before slab 
> allocator is up?)

if i had any changes in that area i'd have declared them. Find below the 
full bootlog of the last crash - can you see any init order weirdness in 
it?

Btw., i disabled netconsole now and got 3 successful bootups in a row. 
(which is still not significant statistically - i had a series of 40 
bootups in a row before. Then again i had like 5 failures in a row 
earlier this morning, before disabling netconsole.)

Btw. #2, in the log below you can see this partial line:

 initcall pm_qos_power_init+0x0/0x54Linux version 2.6.26-tip (mingo@europe) (gcc version 4.2.2) #3261 SMP Mon Jul 21 11:17:45 CEST 2008

That was a previous bootup with another failure but which came without 
any log output.

Hey, if you find this report frustrating, dont worry, i almost never 
report easy bugs - i can fix them just fine ;-)

	Ingo

--------------->
initcall pm_qos_power_init+0x0/0x54Linux version 2.6.26-tip (mingo@europe) (gcc version 4.2.2) #3261 SMP Mon Jul 21 11:17:45 CEST 2008
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000009f000 (usable)
 BIOS-e820: 000000000009f000 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000d2000 - 00000000000d4000 (reserved)
 BIOS-e820: 00000000000dc000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 000000007f6e0000 (usable)
 BIOS-e820: 000000007f6e0000 - 000000007f6f3000 (ACPI data)
 BIOS-e820: 000000007f6f3000 - 000000007f700000 (ACPI NVS)
 BIOS-e820: 000000007f700000 - 0000000080000000 (reserved)
 BIOS-e820: 00000000f0000000 - 00000000f4000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
 BIOS-e820: 00000000fed00000 - 00000000fed00400 (reserved)
 BIOS-e820: 00000000fed14000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed90000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ff800000 - 0000000100000000 (reserved)
debug: ignoring loglevel setting.
using polling idle threads.
using polling idle threads.
last_pfn = 0x7f6e0 max_arch_pfn = 0x1000000
Warning only 896MB will be used.
Use a HIGHMEM enabled kernel.
kernel direct mapping tables up to 38000000 @ 7000-c000
NX (Execute Disable) protection: active
DMI present.
ACPI: RSDP 000F68A0, 0024 (r2 LENOVO)
ACPI: XSDT 7F6E631F, 0074 (r1 LENOVO TP-79        1020  LTP        0)
ACPI: FACP 7F6E6400, 00F4 (r3 LENOVO TP-79        1020 LNVO        1)
ACPI Warning (tbfadt-0447): Optional field "Gpe1Block" has zero address or length: 000000000000102C/0 [20080609]
ACPI: DSDT 7F6E65E7, C765 (r1 LENOVO TP-79        1020 MSFT  100000E)
ACPI: FACS 7F6F4000, 0040
ACPI: SSDT 7F6E65B4, 0033 (r1 LENOVO TP-79        1020 MSFT  100000E)
ACPI: ECDT 7F6F2D4C, 0052 (r1 LENOVO TP-79        1020 LNVO        1)
ACPI: TCPA 7F6F2D9E, 0032 (r2 LENOVO TP-79        1020 LNVO        1)
ACPI: APIC 7F6F2DD0, 0068 (r1 LENOVO TP-79        1020 LNVO        1)
ACPI: MCFG 7F6F2E38, 003E (r1 LENOVO TP-79        1020 LNVO        1)
ACPI: HPET 7F6F2E76, 0038 (r1 LENOVO TP-79        1020 LNVO        1)
ACPI: BOOT 7F6F2FD8, 0028 (r1 LENOVO TP-79        1020  LTP        1)
ACPI: SSDT 7F6E58DA, 0507 (r1 LENOVO TP-79        1020 INTL 20050513)
ACPI: SSDT 7F6E5702, 01D8 (r1 LENOVO TP-79        1020 INTL 20050513)
Entering add_active_range(0, 0x0, 0x9f) 0 entries of 256 used
Entering add_active_range(0, 0x100, 0x38000) 1 entries of 256 used
896MB LOWMEM available.
  mapped low ram: 0 - 38000000
  low ram: 00000000 - 38000000
  bootmap 00009000 - 00010000
(8 early reservations) ==> bootmem [0000000000 - 0038000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000001000 - 0000002000]    EX TRAMPOLINE ==> [0000001000 - 0000002000]
  #2 [0000006000 - 0000007000]       TRAMPOLINE ==> [0000006000 - 0000007000]
  #3 [0000100000 - 0000ccbc50]    TEXT DATA BSS ==> [0000100000 - 0000ccbc50]
  #4 [0000ccc000 - 0000d18000]    INIT_PG_TABLE ==> [0000ccc000 - 0000d18000]
  #5 [000009f000 - 0000100000]    BIOS reserved ==> [000009f000 - 0000100000]
  #6 [0000007000 - 0000009000]          PGTABLE ==> [0000007000 - 0000009000]
  #7 [0000009000 - 0000010000]          BOOTMAP ==> [0000009000 - 0000010000]
Zone PFN ranges:
  DMA      0x00000000 -> 0x00001000
  Normal   0x00001000 -> 0x00038000
Movable zone start PFN for each node
early_node_map[2] active PFN ranges
    0: 0x00000000 -> 0x0000009f
    0: 0x00000100 -> 0x00038000
On node 0 totalpages: 229279
free_area_init_node: node 0, pgdat c081bf80, node_mem_map c1000000
  DMA zone: 56 pages used for memmap
  DMA zone: 0 pages reserved
  DMA zone: 3943 pages, LIFO batch:0
  Normal zone: 3080 pages used for memmap
  Normal zone: 222200 pages, LIFO batch:31
  Movable zone: 0 pages used for memmap
ACPI: PM-Timer IO Port: 0x1008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Bus #0 is ISA
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ9 used by override.
Enabling APIC mode:  Flat.  Using 1 I/O APICs
ACPI: HPET id: 0x8086a201 base: 0xfed00000
SMP: Allowing 2 CPUs, 0 hotplug CPUs
mapped APIC to ffffb000 (fee00000)
mapped IOAPIC to ffffa000 (fec00000)
Allocating PCI resources starting at 88000000 (gap: 80000000:70000000)
PERCPU: Allocating 332592 bytes of per cpu data
NR_CPUS: 8, nr_cpu_ids: 2, nr_node_ids 1
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 226143
Kernel command line: root=/dev/sda1 console=tty profile=0 debug initcall_debug enforcing=0 apic=verbose sysrq_always_enabled ignore_loglevel selinux=1 relaxed_check=1 netconsole=4444@10.0.1.15/eth0,4444@10.0.1.16/00:19:d1:01:f5:55 nmi_watchdog=2 idle=poll no_hz=off nmi_watchdog=0 nolapic_timer hpet=disable idle=mwait idle=poll nopat
kernel profiling enabled (shift: 0)
debug: sysrq always enabled.
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c0941000 soft=c0939000
PID hash table entries: 4096 (order: 12, 16384 bytes)
Extended CMOS year: 2000
TSC calibrated against PM_TIMER
Detected 1828.742 MHz processor.
Console: colour VGA+ 80x25
console [tty0] enabled
Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
... MAX_LOCKDEP_SUBCLASSES:    8
... MAX_LOCK_DEPTH:          48
... MAX_LOCKDEP_KEYS:        2048
... CLASSHASH_SIZE:           1024
... MAX_LOCKDEP_ENTRIES:     8192
... MAX_LOCKDEP_CHAINS:      16384
... CHAINHASH_SIZE:          8192
 memory used by lock dependency info: 1088 kB
 per task-struct memory footprint: 2688 bytes
------------------------
| Locking API testsuite:
----------------------------------------------------------------------------
                                 | spin |wlock |rlock |mutex | wsem | rsem |
  --------------------------------------------------------------------------
                     A-A deadlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
                 A-B-B-A deadlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
             A-B-B-C-C-A deadlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
             A-B-C-A-B-C deadlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
         A-B-B-C-C-D-D-A deadlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
         A-B-C-D-B-D-D-A deadlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
         A-B-C-D-B-C-D-A deadlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
                    double unlock:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
                  initialize held:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
                 bad unlock order:  ok  |  ok  |  ok  |  ok  |  ok  |  ok  |
  --------------------------------------------------------------------------
              recursive read-lock:             |  ok  |             |  ok  |
           recursive read-lock #2:             |  ok  |             |  ok  |
            mixed read-write-lock:             |  ok  |             |  ok  |
            mixed write-read-lock:             |  ok  |             |  ok  |
  --------------------------------------------------------------------------
     hard-irqs-on + irq-safe-A/12:  ok  |  ok  |  ok  |
     soft-irqs-on + irq-safe-A/12:  ok  |  ok  |  ok  |
     hard-irqs-on + irq-safe-A/21:  ok  |  ok  |  ok  |
     soft-irqs-on + irq-safe-A/21:  ok  |  ok  |  ok  |
       sirq-safe-A => hirqs-on/12:  ok  |  ok  |  ok  |
       sirq-safe-A => hirqs-on/21:  ok  |  ok  |  ok  |
         hard-safe-A + irqs-on/12:  ok  |  ok  |  ok  |
         soft-safe-A + irqs-on/12:  ok  |  ok  |  ok  |
         hard-safe-A + irqs-on/21:  ok  |  ok  |  ok  |
         soft-safe-A + irqs-on/21:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #1/123:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #1/123:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #1/132:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #1/132:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #1/213:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #1/213:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #1/231:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #1/231:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #1/312:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #1/312:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #1/321:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #1/321:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #2/123:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #2/123:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #2/132:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #2/132:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #2/213:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #2/213:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #2/231:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #2/231:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #2/312:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #2/312:  ok  |  ok  |  ok  |
    hard-safe-A + unsafe-B #2/321:  ok  |  ok  |  ok  |
    soft-safe-A + unsafe-B #2/321:  ok  |  ok  |  ok  |
      hard-irq lock-inversion/123:  ok  |  ok  |  ok  |
      soft-irq lock-inversion/123:  ok  |  ok  |  ok  |
      hard-irq lock-inversion/132:  ok  |  ok  |  ok  |
      soft-irq lock-inversion/132:  ok  |  ok  |  ok  |
      hard-irq lock-inversion/213:  ok  |  ok  |  ok  |
      soft-irq lock-inversion/213:  ok  |  ok  |  ok  |
      hard-irq lock-inversion/231:  ok  |  ok  |  ok  |
      soft-irq lock-inversion/231:  ok  |  ok  |  ok  |
      hard-irq lock-inversion/312:  ok  |  ok  |  ok  |
      soft-irq lock-inversion/312:  ok  |  ok  |  ok  |
      hard-irq lock-inversion/321:  ok  |  ok  |  ok  |
      soft-irq lock-inversion/321:  ok  |  ok  |  ok  |
      hard-irq read-recursion/123:  ok  |
      soft-irq read-recursion/123:  ok  |
      hard-irq read-recursion/132:  ok  |
      soft-irq read-recursion/132:  ok  |
      hard-irq read-recursion/213:  ok  |
      soft-irq read-recursion/213:  ok  |
      hard-irq read-recursion/231:  ok  |
      soft-irq read-recursion/231:  ok  |
      hard-irq read-recursion/312:  ok  |
      soft-irq read-recursion/312:  ok  |
      hard-irq read-recursion/321:  ok  |
      soft-irq read-recursion/321:  ok  |
-------------------------------------------------------
Good, all 218 testcases passed! |
---------------------------------
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 872052k/917504k available (4655k kernel code, 45060k reserved, 3079k data, 656k init, 0k highmem)
virtual kernel memory layout:
    fixmap  : 0xfffb8000 - 0xfffff000   ( 284 kB)
    vmalloc : 0xf8800000 - 0xfffb6000   ( 119 MB)
    lowmem  : 0xc0000000 - 0xf8000000   ( 896 MB)
      .init : 0xc0892000 - 0xc0936000   ( 656 kB)
      .data : 0xc058bc52 - 0xc088dacc   (3079 kB)
      .text : 0xc0100000 - 0xc058bc52   (4655 kB)
Checking if this processor honours the WP bit even in supervisor mode...Ok.
CPA: page pool initialized 16 of 16 pages preallocated
SLUB: Genslabs=12, HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
Calibrating delay loop (skipped), value calculated using timer frequency.. <6>3657.48 BogoMIPS (lpj=1828742)
Security Framework initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
Mount-cache hash table entries: 512
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 2048K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
Checking 'hlt' instruction... OK.
ACPI: Core revision 20080609
enabled ExtINT on CPU#0
ESR value before enabling vector: 0x00000040  after: 0x00000000
ENABLING IO-APIC IRQs
init IO_APIC IRQs
 IO-APIC (apicid-pin) 1-0 not connected.
 IO-APIC (apicid-pin) 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22, 1-23 not connected.
..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel Genuine Intel(R) CPU           T2400  @ 1.83GHz stepping 08
++++++++++++++++++++=_---CPU UP  1
lockdep: fixing up alternatives.
CPU 1 irqstacks, hard=c0942000 soft=c093a000
Booting processor 1/1 ip 6000
Setting warm reset code and vector.
1.
2.
3.
Asserting INIT.
Waiting for send to finish...
Deasserting INIT.
Waiting for send to finish...
#startup loops: 2.
Sending STARTUP #1.
After apic_write.
Initializing CPU#1
Startup point 1.
CPU#1 (phys ID: 1) waiting for CALLOUT
Waiting for send to finish...
Sending STARTUP #2.
After apic_write.
Startup point 1.
Waiting for send to finish...
After Startup.
Before Callout 1.
After Callout 1.
CALLIN, before setup_local_APIC().
masked ExtINT on CPU#1
Calibrating delay using timer specific routine.. <6>3194.05 BogoMIPS (lpj=1597026)
Stack at about f7c7efb0
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 2048K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 1
OK.
CPU1: Intel Genuine Intel(R) CPU           T2400  @ 1.83GHz stepping 08
CPU has booted.
checking TSC synchronization [CPU#0 -> CPU#1]:
Measured 580129 cycles TSC warp between CPUs, turning off TSC clock.
Marking TSC unstable due to check_tsc_sync_source failed
Brought up 2 CPUs
Boot done.
Before bogomips.
Total of 2 processors activated (6851.53 BogoMIPS).
Before bogocount - setting activated=1.
khelper used greatest stack depth: 3052 bytes left
khelper used greatest stack depth: 2684 bytes left
calling  init_cpufreq_transition_notifier_list+0x0/0x18
initcall init_cpufreq_transition_notifier_list+0x0/0x18 returned 0 after 0 msecs
calling  net_ns_init+0x0/0x10f
net_namespace: 800 bytes
initcall net_ns_init+0x0/0x10f returned 0 after 0 msecs
calling  cpufreq_tsc+0x0/0x13
initcall cpufreq_tsc+0x0/0x13 returned 0 after 0 msecs
calling  reboot_init+0x0/0x11
initcall reboot_init+0x0/0x11 returned 0 after 0 msecs
calling  sysctl_init+0x0/0x29
initcall sysctl_init+0x0/0x29 returned 0 after 0 msecs
calling  ksysfs_init+0x0/0x96
initcall ksysfs_init+0x0/0x96 returned 0 after 0 msecs
calling  init_jiffies_clocksource+0x0/0xf
initcall init_jiffies_clocksource+0x0/0xf returned 0 after 0 msecs
calling  pm_init+0x0/0x2d
initcall pm_init+0x0/0x2d returned 0 after 0 msecs
calling  filelock_init+0x0/0x27
initcall filelock_init+0x0/0x27 returned 0 after 0 msecs
calling  init_aout_binfmt+0x0/0xf
initcall init_aout_binfmt+0x0/0xf returned 0 after 0 msecs
calling  init_misc_binfmt+0x0/0x33
initcall init_misc_binfmt+0x0/0x33 returned 0 after 0 msecs
calling  init_script_binfmt+0x0/0xf
initcall init_script_binfmt+0x0/0xf returned 0 after 0 msecs
calling  init_elf_binfmt+0x0/0xf
initcall init_elf_binfmt+0x0/0xf returned 0 after 0 msecs
calling  debugfs_init+0x0/0x41
initcall debugfs_init+0x0/0x41 returned 0 after 0 msecs
calling  securityfs_init+0x0/0x41
initcall securityfs_init+0x0/0x41 returned 0 after 0 msecs
calling  random32_init+0x0/0x3f
initcall random32_init+0x0/0x3f returned 0 after 0 msecs
calling  cpufreq_core_init+0x0/0x51
initcall cpufreq_core_init+0x0/0x51 returned 0 after 0 msecs
calling  virtio_init+0x0/0x1f
initcall virtio_init+0x0/0x1f returned 0 after 0 msecs
calling  sock_init+0x0/0x51
initcall sock_init+0x0/0x51 returned 0 after 0 msecs
calling  netpoll_init+0x0/0x11
initcall netpoll_init+0x0/0x11 returned 0 after 0 msecs
calling  netlink_proto_init+0x0/0x107
NET: Registered protocol family 16
initcall netlink_proto_init+0x0/0x107 returned 0 after 0 msecs
calling  bdi_class_init+0x0/0x33
initcall bdi_class_init+0x0/0x33 returned 0 after 0 msecs
calling  kobject_uevent_init+0x0/0x3f
initcall kobject_uevent_init+0x0/0x3f returned 0 after 0 msecs
calling  pcibus_class_init+0x0/0xf
initcall pcibus_class_init+0x0/0xf returned 0 after 0 msecs
calling  pci_driver_init+0x0/0xf
initcall pci_driver_init+0x0/0xf returned 0 after 0 msecs
calling  lcd_class_init+0x0/0x3d
initcall lcd_class_init+0x0/0x3d returned 0 after 0 msecs
calling  backlight_class_init+0x0/0x3d
initcall backlight_class_init+0x0/0x3d returned 0 after 0 msecs
calling  tty_class_init+0x0/0x27
initcall tty_class_init+0x0/0x27 returned 0 after 0 msecs
calling  vtconsole_class_init+0x0/0x9a
initcall vtconsole_class_init+0x0/0x9a returned 0 after 0 msecs
calling  eisa_init+0x0/0x26
EISA bus registered
initcall eisa_init+0x0/0x26 returned 0 after 0 msecs
calling  enable_pci_io_ecs+0x0/0x2b
initcall enable_pci_io_ecs+0x0/0x2b returned 0 after 0 msecs
calling  rdc_board_setup+0x0/0x19
initcall rdc_board_setup+0x0/0x19 returned 0 after 0 msecs
calling  arch_kdebugfs_init+0x0/0x1de
initcall arch_kdebugfs_init+0x0/0x1de returned 0 after 0 msecs
calling  init_pit_clocksource+0x0/0x8f
initcall init_pit_clocksource+0x0/0x8f returned 0 after 0 msecs
calling  ffh_cstate_init+0x0/0x2c
initcall ffh_cstate_init+0x0/0x2c returned 0 after 0 msecs
calling  acpi_pci_init+0x0/0x38
ACPI: bus type pci registered
initcall acpi_pci_init+0x0/0x38 returned 0 after 0 msecs
calling  init_acpi_device_notify+0x0/0x43
initcall init_acpi_device_notify+0x0/0x43 returned 0 after 0 msecs
calling  pci_arch_init+0x0/0x4a
PCI: MCFG configuration 0: base f0000000 segment 0 buses 0 - 63
PCI: MCFG area at f0000000 reserved in E820
PCI: Using MMCONFIG for extended config space
PCI: Using configuration type 1 for base access
initcall pci_arch_init+0x0/0x4a returned 0 after 0 msecs
calling  topology_init+0x0/0x28
initcall topology_init+0x0/0x28 returned 0 after 0 msecs
calling  param_sysfs_init+0x0/0x154
initcall param_sysfs_init+0x0/0x154 returned 0 after 21 msecs
calling  pm_sysrq_init+0x0/0x16
initcall pm_sysrq_init+0x0/0x16 returned 0 after 0 msecs
calling  readahead_init+0x0/0x2f
initcall readahead_init+0x0/0x2f returned 0 after 0 msecs
calling  init_bio+0x0/0xa6
initcall init_bio+0x0/0xa6 returned 0 after 0 msecs
calling  blk_settings_init+0x0/0x1d
initcall blk_settings_init+0x0/0x1d returned 0 after 0 msecs
calling  blk_ioc_init+0x0/0x24
initcall blk_ioc_init+0x0/0x24 returned 0 after 0 msecs
calling  genhd_device_init+0x0/0x32
initcall genhd_device_init+0x0/0x32 returned 0 after 0 msecs
calling  pci_slot_init+0x0/0x3b
initcall pci_slot_init+0x0/0x3b returned 0 after 0 msecs
calling  fbmem_init+0x0/0x73
initcall fbmem_init+0x0/0x73 returned 0 after 0 msecs
calling  acpi_init+0x0/0x21b
ACPI: EC: EC description table is found, configuring boot EC
ACPI: EC: non-query interrupt received, switching to interrupt mode
ACPI: Interpreter enabled
ACPI: (supports S0 S3 S5)
ACPI: Using IOAPIC for interrupt routing
initcall acpi_init+0x0/0x21b returned 0 after 67 msecs
calling  acpi_scan_init+0x0/0xed
initcall acpi_scan_init+0x0/0xed returned 0 after 49 msecs
calling  acpi_ec_init+0x0/0x55
ACPI: EC: GPE = 0x1c, I/O: command/status = 0x66, data = 0x62
ACPI: EC: driver started in interrupt mode
initcall acpi_ec_init+0x0/0x55 returned 0 after 0 msecs
calling  acpi_pci_root_init+0x0/0x25
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: 0000:00:02.0 reg 10 32bit mmio: [ee100000, ee17ffff]
PCI: 0000:00:02.0 reg 14 io port: [1800, 1807]
PCI: 0000:00:02.0 reg 18 32bit mmio: [d0000000, dfffffff]
PCI: 0000:00:02.0 reg 1c 32bit mmio: [ee200000, ee23ffff]
PCI: 0000:00:02.1 reg 10 32bit mmio: [ee180000, ee1fffff]
pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1b.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.1: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.1: PME# disabled
pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.2: PME# disabled
pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.3: PME# disabled
PCI: 0000:00:1d.0 reg 20 io port: [1820, 183f]
PCI: 0000:00:1d.1 reg 20 io port: [1840, 185f]
PCI: 0000:00:1d.2 reg 20 io port: [1860, 187f]
PCI: 0000:00:1d.3 reg 20 io port: [1880, 189f]
PCI: 0000:00:1d.7 reg 10 32bit mmio: [ee444000, ee4443ff]
pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.7: PME# disabled
pci 0000:00:1f.0: quirk: region 1000-107f claimed by ICH6 ACPI/GPIO/TCO
pci 0000:00:1f.0: quirk: region 1180-11bf claimed by ICH6 GPIO
PCI: 0000:00:1f.1 reg 10 io port: [0, 7]
PCI: 0000:00:1f.1 reg 14 io port: [0, 3]
PCI: 0000:00:1f.1 reg 18 io port: [0, 7]
PCI: 0000:00:1f.1 reg 1c io port: [0, 3]
PCI: 0000:00:1f.1 reg 20 io port: [1810, 181f]
PCI: 0000:00:1f.2 reg 10 io port: [18d0, 18d7]
PCI: 0000:00:1f.2 reg 14 io port: [18c4, 18c7]
PCI: 0000:00:1f.2 reg 18 io port: [18c8, 18cf]
PCI: 0000:00:1f.2 reg 1c io port: [18c0, 18c3]
PCI: 0000:00:1f.2 reg 20 io port: [18b0, 18bf]
PCI: 0000:00:1f.2 reg 24 32bit mmio: [ee444400, ee4447ff]
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
PCI: 0000:00:1f.3 reg 20 io port: [18e0, 18ff]
PCI: 0000:02:00.0 reg 10 32bit mmio: [ee000000, ee01ffff]
PCI: 0000:02:00.0 reg 18 io port: [2000, 201f]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
PCI: bridge 0000:00:1c.0 io port: [2000, 2fff]
PCI: bridge 0000:00:1c.0 32bit mmio: [ee000000, ee0fffff]
PCI: 0000:03:00.0 reg 10 32bit mmio: [edf00000, edf00fff]
pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
pci 0000:03:00.0: PME# disabled
PCI: bridge 0000:00:1c.1 io port: [3000, 4fff]
PCI: bridge 0000:00:1c.1 32bit mmio: [ec000000, edffffff]
PCI: bridge 0000:00:1c.1 64bit mmio pref: [e4000000, e40fffff]
PCI: bridge 0000:00:1c.2 io port: [5000, 6fff]
PCI: bridge 0000:00:1c.2 32bit mmio: [e8000000, e9ffffff]
PCI: bridge 0000:00:1c.2 64bit mmio pref: [e4100000, e41fffff]
PCI: bridge 0000:00:1c.3 io port: [7000, 8fff]
PCI: bridge 0000:00:1c.3 32bit mmio: [ea000000, ebffffff]
PCI: bridge 0000:00:1c.3 64bit mmio pref: [e4200000, e42fffff]
PCI: 0000:15:00.0 reg 10 32bit mmio: [e4300000, e4300fff]
pci 0000:15:00.0: supports D1
pci 0000:15:00.0: supports D2
pci 0000:15:00.0: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:15:00.0: PME# disabled
pci 0000:00:1e.0: transparent bridge
PCI: bridge 0000:00:1e.0 io port: [9000, cfff]
PCI: bridge 0000:00:1e.0 32bit mmio: [e4300000, e7ffffff]
PCI: bridge 0000:00:1e.0 64bit mmio pref: [e0000000, e3ffffff]
bus 00 -> node 0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP1._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP2._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP3._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI1._PRT]
initcall acpi_pci_root_init+0x0/0x25 returned 0 after 43 msecs
calling  acpi_pci_link_init+0x0/0x43
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 *11)
initcall acpi_pci_link_init+0x0/0x43 returned 0 after 10 msecs
calling  acpi_power_init+0x0/0x69
ACPI: Power Resource [PUBS] (on)
initcall acpi_power_init+0x0/0x69 returned 0 after 1 msecs
calling  acpi_system_init+0x0/0x167
initcall acpi_system_init+0x0/0x167 returned 0 after 0 msecs
calling  acpi_cm_sbs_init+0x0/0x7
initcall acpi_cm_sbs_init+0x0/0x7 returned 0 after 0 msecs
calling  pnp_init+0x0/0x19
Linux Plug and Play Support v0.97 (c) Adam Belay
initcall pnp_init+0x0/0x19 returned 0 after 0 msecs
calling  pnpacpi_init+0x0/0x7b
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp 00:00: parse allocated resources
pnp 00:00:   add mem 0x0-0x9ffff flags 0x1
pnp 00:00:   add mem 0xc0000-0xc3fff flags 0x0
pnp 00:00:   add mem 0xc4000-0xc7fff flags 0x0
pnp 00:00:   add mem 0xc8000-0xcbfff flags 0x0
pnp 00:00:   add mem 0xcc000-0xcffff flags 0x0
pnp 00:00:   add mem 0xd0000-0xd3fff flags 0x0
pnp 00:00:   add mem 0xd4000-0xd3fff flags 0x10000000
pnp 00:00:   add mem 0xd8000-0xd7fff flags 0x10000000
pnp 00:00:   add mem 0xdc000-0xdffff flags 0x1
pnp 00:00:   add mem 0xe0000-0xe3fff flags 0x0
pnp 00:00:   add mem 0xe4000-0xe7fff flags 0x0
pnp 00:00:   add mem 0xe8000-0xebfff flags 0x0
pnp 00:00:   add mem 0xec000-0xeffff flags 0x0
pnp 00:00:   add mem 0xf0000-0xfffff flags 0x0
pnp 00:00:   add mem 0x100000-0x7fffffff flags 0x1
pnp 00:00:   add mem 0xfec00000-0xffffffff flags 0x0
pnp 00:00:   add mem 0xfed41000-0xfed40fff flags 0x10000000
pnp 00:00: PNP0c01: calling quirk_system_pci_resources+0x0/0x188
pnp 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
pnp 00:01: parse allocated resources
pnp 00:01:   add io  0xcf8-0xcff flags 0x1
pnp 00:01: Plug and Play ACPI device, IDs PNP0a08 PNP0a03 (active)
pnp 00:02: parse allocated resources
pnp 00:02:   add io  0x10-0x1f flags 0x1
pnp 00:02:   add io  0x90-0x9f flags 0x1
pnp 00:02:   add io  0x24-0x25 flags 0x1
pnp 00:02:   add io  0x28-0x29 flags 0x1
pnp 00:02:   add io  0x2c-0x2d flags 0x1
pnp 00:02:   add io  0x30-0x31 flags 0x1
pnp 00:02:   add io  0x34-0x35 flags 0x1
pnp 00:02:   add io  0x38-0x39 flags 0x1
pnp 00:02:   add io  0x3c-0x3d flags 0x1
pnp 00:02:   add io  0xa4-0xa5 flags 0x1
pnp 00:02:   add io  0xa8-0xa9 flags 0x1
pnp 00:02:   add io  0xac-0xad flags 0x1
pnp 00:02:   add io  0xb0-0xb5 flags 0x1
pnp 00:02:   add io  0xb8-0xb9 flags 0x1
pnp 00:02:   add io  0xbc-0xbd flags 0x1
pnp 00:02:   add io  0x50-0x53 flags 0x1
pnp 00:02:   add io  0x72-0x77 flags 0x1
pnp 00:02:   add io  0x164e-0x164f flags 0x1
pnp 00:02:   add io  0x2e-0x2f flags 0x1
pnp 00:02:   add io  0x1000-0x107f flags 0x1
pnp 00:02:   add io  0x1180-0x11bf flags 0x1
pnp 00:02:   add io  0x800-0x80f flags 0x1
pnp 00:02:   add io  0x15e0-0x15ef flags 0x1
pnp 00:02:   add io  0x1600-0x165f flags 0x1
pnp 00:02:   add mem 0xf0000000-0xf3ffffff flags 0x1
pnp 00:02:   add mem 0xfed1c000-0xfed1ffff flags 0x1
pnp 00:02:   add mem 0xfed14000-0xfed17fff flags 0x1
pnp 00:02:   add mem 0xfed18000-0xfed18fff flags 0x1
pnp 00:02:   add mem 0xfed19000-0xfed19fff flags 0x1
pnp 00:02: PNP0c02: calling quirk_system_pci_resources+0x0/0x188
pnp 00:02: Plug and Play ACPI device, IDs PNP0c02 (active)
pnp 00:03: parse allocated resources
pnp 00:03:   add mem 0xfed00000-0xfed003ff flags 0x0
pnp 00:03: Plug and Play ACPI device, IDs PNP0103 (active)
pnp 00:04: parse allocated resources
pnp 00:04:   add io  0x0-0xf flags 0x1
pnp 00:04:   add io  0x80-0x8f flags 0x1
pnp 00:04:   add io  0xc0-0xdf flags 0x1
pnp 00:04:   add dma 4 flags 0x5
pnp 00:04: Plug and Play ACPI device, IDs PNP0200 (active)
pnp 00:05: parse allocated resources
pnp 00:05:   add io  0x61-0x61 flags 0x1
pnp 00:05: Plug and Play ACPI device, IDs PNP0800 (active)
pnp 00:06: parse allocated resources
pnp 00:06:   add io  0xf0-0xf0 flags 0x1
pnp 00:06:   add irq 13 flags 0x1
pnp 00:06: Plug and Play ACPI device, IDs PNP0c04 (active)
pnp 00:07: parse allocated resources
pnp 00:07:   add io  0x70-0x71 flags 0x1
pnp 00:07:   add irq 8 flags 0x1
pnp 00:07: Plug and Play ACPI device, IDs PNP0b00 (active)
pnp 00:08: parse allocated resources
pnp 00:08:   add io  0x60-0x60 flags 0x1
pnp 00:08:   add io  0x64-0x64 flags 0x1
pnp 00:08:   add irq 1 flags 0x1
pnp 00:08: Plug and Play ACPI device, IDs PNP0303 (active)
pnp 00:09: parse allocated resources
pnp 00:09:   add irq 12 flags 0x1
pnp 00:09: Plug and Play ACPI device, IDs IBM0057 PNP0f13 (active)
pnp 00:0a: parse allocated resources
pnp 00:0a:   add io  0x2f8-0x2ff flags 0x1
pnp 00:0a:   add irq 3 flags 0x1
pnp 00:0a:   add dma 3 flags 0x0
pnp 00:0a: parse resource options
pnp 00:0a:   dependent set 0 (preferred) io  min 0x2f8 max 0x2f8 align 1 size 8 flags 0x1
pnp 00:0a:   dependent set 0 (preferred) irq 3 flags 0x1
pnp 00:0a:   dependent set 0 (preferred) dma 0 1 3 (bitmask 0xb) flags 0x0
pnp 00:0a:   dependent set 1 (acceptable) io  min 0x3f8 max 0x3f8 align 1 size 8 flags 0x1
pnp 00:0a:   dependent set 1 (acceptable) irq 4 flags 0x1
pnp 00:0a:   dependent set 1 (acceptable) dma 0 1 3 (bitmask 0xb) flags 0x0
pnp 00:0a:   dependent set 2 (acceptable) io  min 0x2e8 max 0x2e8 align 1 size 8 flags 0x1
pnp 00:0a:   dependent set 2 (acceptable) irq 3 flags 0x1
pnp 00:0a:   dependent set 2 (acceptable) dma 0 1 3 (bitmask 0xb) flags 0x0
pnp 00:0a:   dependent set 3 (acceptable) io  min 0x3e8 max 0x3e8 align 1 size 8 flags 0x1
pnp 00:0a:   dependent set 3 (acceptable) irq 4 flags 0x1
pnp 00:0a:   dependent set 3 (acceptable) dma 0 1 3 (bitmask 0xb) flags 0x0
pnp 00:0a:   dependent set 4 (functional) io  min 0x2f8 max 0x2f8 align 1 size 8 flags 0x1
pnp 00:0a:   dependent set 4 (functional) irq 4 5 7 flags 0x1
pnp 00:0a:   dependent set 4 (functional) dma 0 1 3 (bitmask 0xb) flags 0x0
pnp 00:0a:   dependent set 5 (functional) io  min 0x3f8 max 0x3f8 align 1 size 8 flags 0x1
pnp 00:0a:   dependent set 5 (functional) irq 3 5 7 flags 0x1
pnp 00:0a:   dependent set 5 (functional) dma 0 1 3 (bitmask 0xb) flags 0x0
pnp 00:0a:   dependent set 6 (functional) io  min 0x2e8 max 0x2e8 align 1 size 8 flags 0x1
pnp 00:0a:   dependent set 6 (functional) irq 4 5 7 flags 0x1
pnp 00:0a:   dependent set 6 (functional) dma 0 1 3 (bitmask 0xb) flags 0x0
pnp 00:0a:   dependent set 7 (functional) io  min 0x3e8 max 0x3e8 align 1 size 8 flags 0x1
pnp 00:0a:   dependent set 7 (functional) irq 3 5 7 flags 0x1
pnp 00:0a:   dependent set 7 (functional) dma 0 1 3 (bitmask 0xb) flags 0x0
pnp 00:0a: Plug and Play ACPI device, IDs IBM0071 PNP0511 (active)
pnp: PnP ACPI: found 11 devices
ACPI: ACPI bus type pnp unregistered
initcall pnpacpi_init+0x0/0x7b returned 0 after 26 msecs
calling  misc_init+0x0/0x7f
initcall misc_init+0x0/0x7f returned 0 after 0 msecs
calling  cn_init+0x0/0xcb
initcall cn_init+0x0/0xcb returned 0 after 0 msecs
calling  tifm_init+0x0/0x6d
initcall tifm_init+0x0/0x6d returned 0 after 0 msecs
calling  phy_init+0x0/0x29
initcall phy_init+0x0/0x29 returned 0 after 0 msecs
calling  init_scsi+0x0/0x79
SCSI subsystem initialized
initcall init_scsi+0x0/0x79 returned 0 after 0 msecs
calling  ata_init+0x0/0x2a4
libata version 3.00 loaded.
initcall ata_init+0x0/0x2a4 returned 0 after 0 msecs
calling  spi_init+0x0/0x68
initcall spi_init+0x0/0x68 returned 0 after 0 msecs
calling  usb_init+0x0/0xfd
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
initcall usb_init+0x0/0xfd returned 0 after 1 msecs
calling  serio_init+0x0/0x82
initcall serio_init+0x0/0x82 returned 0 after 0 msecs
calling  gameport_init+0x0/0x82
initcall gameport_init+0x0/0x82 returned 0 after 0 msecs
calling  input_init+0x0/0xd7
initcall input_init+0x0/0xd7 returned 0 after 0 msecs
calling  i2c_init+0x0/0x4f
i2c-core: driver [dummy] registered
initcall i2c_init+0x0/0x4f returned 0 after 0 msecs
calling  power_supply_class_init+0x0/0x29
initcall power_supply_class_init+0x0/0x29 returned 0 after 0 msecs
calling  thermal_init+0x0/0x41
initcall thermal_init+0x0/0x41 returned 0 after 0 msecs
calling  mmc_init+0x0/0x6b
initcall mmc_init+0x0/0x6b returned 0 after 0 msecs
calling  leds_init+0x0/0x27
initcall leds_init+0x0/0x27 returned 0 after 0 msecs
calling  dma_bus_init+0x0/0x23
initcall dma_bus_init+0x0/0x23 returned 0 after 0 msecs
calling  pci_subsys_init+0x0/0xe6
PCI: Using ACPI for IRQ routing
number of MP IRQ sources: 15.
number of IO-APIC #1 registers: 24.
testing the IO APIC.......................
IO APIC #1......
.... register #00: 02000000
.......    : physical APIC id: 02
.......    : Delivery Type: 0
.......    : LTS          : 0
.... register #01: 00170020
.......     : max redirection entries: 0017
.......     : PRQ implemented: 0
.......     : IO APIC version: 0020
.... IRQ redirection table:
 NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
 00 000 00  1    0    0   0   0    0    0    00
 01 003 03  1    0    0   0   0    1    1    39
 02 003 03  0    0    0   0   0    1    1    31
 03 003 03  1    0    0   0   0    1    1    41
 04 003 03  0    0    0   0   0    1    1    49
 05 003 03  0    0    0   0   0    1    1    51
 06 003 03  0    0    0   0   0    1    1    59
 07 003 03  0    0    0   0   0    1    1    61
 08 003 03  1    0    0   0   0    1    1    69
 09 003 03  0    1    0   0   0    1    1    71
 0a 003 03  0    0    0   0   0    1    1    79
 0b 003 03  0    0    0   0   0    1    1    81
 0c 003 03  1    0    0   0   0    1    1    89
 0d 003 03  1    0    0   0   0    1    1    91
 0e 003 03  0    0    0   0   0    1    1    99
 0f 003 03  0    0    0   0   0    1    1    A1
 10 000 00  1    0    0   0   0    0    0    00
 11 000 00  1    0    0   0   0    0    0    00
 12 000 00  1    0    0   0   0    0    0    00
 13 000 00  1    0    0   0   0    0    0    00
 14 000 00  1    0    0   0   0    0    0    00
 15 000 00  1    0    0   0   0    0    0    00
 16 000 00  1    0    0   0   0    0    0    00
 17 000 00  1    0    0   0   0    0    0    00
IRQ to pin mappings:
IRQ0 -> 0:2
IRQ1 -> 0:1
IRQ3 -> 0:3
IRQ4 -> 0:4
IRQ5 -> 0:5
IRQ6 -> 0:6
IRQ7 -> 0:7
IRQ8 -> 0:8
IRQ9 -> 0:9
IRQ10 -> 0:10
IRQ11 -> 0:11
IRQ12 -> 0:12
IRQ13 -> 0:13
IRQ14 -> 0:14
IRQ15 -> 0:15
.................................... done.
initcall pci_subsys_init+0x0/0xe6 returned 0 after 6 msecs
calling  proto_init+0x0/0x27
initcall proto_init+0x0/0x27 returned 0 after 0 msecs
calling  net_dev_init+0x0/0x12f
initcall net_dev_init+0x0/0x12f returned 0 after 0 msecs
calling  neigh_init+0x0/0x66
initcall neigh_init+0x0/0x66 returned 0 after 0 msecs
calling  fib_rules_init+0x0/0x99
initcall fib_rules_init+0x0/0x99 returned 0 after 0 msecs
calling  genl_init+0x0/0xb0
initcall genl_init+0x0/0xb0 returned 0 after 0 msecs
calling  cipso_v4_init+0x0/0x6d
initcall cipso_v4_init+0x0/0x6d returned 0 after 0 msecs
calling  bt_init+0x0/0x50
Bluetooth: Core ver 2.12
NET: Registered protocol family 31
Bluetooth: HCI device and connection manager initialized
Bluetooth: HCI socket layer initialized
initcall bt_init+0x0/0x50 returned 0 after 0 msecs
calling  atm_init+0x0/0x9c
NET: Registered protocol family 8
NET: Registered protocol family 20
initcall atm_init+0x0/0x9c returned 0 after 0 msecs
calling  wireless_nlevent_init+0x0/0x39
initcall wireless_nlevent_init+0x0/0x39 returned 0 after 0 msecs
calling  netlbl_init+0x0/0x6d
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
initcall netlbl_init+0x0/0x6d returned 0 after 0 msecs
calling  rfkill_init+0x0/0x5a
initcall rfkill_init+0x0/0x5a returned 0 after 0 msecs
calling  sysctl_init+0x0/0x2d
initcall sysctl_init+0x0/0x2d returned 0 after 0 msecs
calling  pci_iommu_init+0x0/0xc
initcall pci_iommu_init+0x0/0xc returned 0 after 0 msecs
calling  hpet_late_init+0x0/0xfb
initcall hpet_late_init+0x0/0xfb returned -19 after 0 msecs
calling  clocksource_done_booting+0x0/0x11
initcall clocksource_done_booting+0x0/0x11 returned 0 after 0 msecs
calling  init_pipe_fs+0x0/0x41
initcall init_pipe_fs+0x0/0x41 returned 0 after 0 msecs
calling  init_mnt_writers+0x0/0x61
initcall init_mnt_writers+0x0/0x61 returned 0 after 0 msecs
calling  eventpoll_init+0x0/0x7d
initcall eventpoll_init+0x0/0x7d returned 0 after 0 msecs
calling  anon_inode_init+0x0/0xdf
initcall anon_inode_init+0x0/0xdf returned 0 after 0 msecs
calling  acpi_rtc_init+0x0/0xd4
ACPI: RTC can wake from S4
initcall acpi_rtc_init+0x0/0xd4 returned 0 after 0 msecs
calling  acpi_event_init+0x0/0x46
initcall acpi_event_init+0x0/0x46 returned 0 after 0 msecs
calling  pnp_system_init+0x0/0xf
pnp: the driver 'system' has been registered
system 00:00: iomem range 0x0-0x9ffff could not be reserved
system 00:00: iomem range 0xc0000-0xc3fff could not be reserved
system 00:00: iomem range 0xc4000-0xc7fff could not be reserved
system 00:00: iomem range 0xc8000-0xcbfff has been reserved
system 00:00: iomem range 0xcc000-0xcffff could not be reserved
system 00:00: iomem range 0xd0000-0xd3fff could not be reserved
system 00:00: iomem range 0xdc000-0xdffff could not be reserved
system 00:00: iomem range 0xe0000-0xe3fff could not be reserved
system 00:00: iomem range 0xe4000-0xe7fff could not be reserved
system 00:00: iomem range 0xe8000-0xebfff could not be reserved
system 00:00: iomem range 0xec000-0xeffff could not be reserved
system 00:00: iomem range 0xf0000-0xfffff could not be reserved
system 00:00: iomem range 0x100000-0x7fffffff could not be reserved
system 00:00: iomem range 0xfec00000-0xffffffff could not be reserved
system 00:00: driver attached
system 00:02: ioport range 0x164e-0x164f has been reserved
system 00:02: ioport range 0x1000-0x107f has been reserved
system 00:02: ioport range 0x1180-0x11bf has been reserved
system 00:02: ioport range 0x800-0x80f has been reserved
system 00:02: ioport range 0x15e0-0x15ef has been reserved
system 00:02: ioport range 0x1600-0x165f could not be reserved
system 00:02: iomem range 0xf0000000-0xf3ffffff could not be reserved
system 00:02: iomem range 0xfed1c000-0xfed1ffff could not be reserved
system 00:02: iomem range 0xfed14000-0xfed17fff could not be reserved
system 00:02: iomem range 0xfed18000-0xfed18fff could not be reserved
system 00:02: iomem range 0xfed19000-0xfed19fff could not be reserved
system 00:02: driver attached
initcall pnp_system_init+0x0/0xf returned 0 after 1 msecs
calling  chr_dev_init+0x0/0x86
initcall chr_dev_init+0x0/0x86 returned 0 after 1 msecs
calling  firmware_class_init+0x0/0x5c
initcall firmware_class_init+0x0/0x5c returned 0 after 0 msecs
calling  loopback_init+0x0/0xf
initcall loopback_init+0x0/0xf returned 0 after 0 msecs
calling  cpufreq_gov_performance_init+0x0/0xf
initcall cpufreq_gov_performance_init+0x0/0xf returned 0 after 0 msecs
calling  cpufreq_gov_dbs_init+0x0/0xf
initcall cpufreq_gov_dbs_init+0x0/0xf returned 0 after 0 msecs
calling  init_acpi_pm_clocksource+0x0/0x152
PM-Timer running at invalid rate: 87% of normal - aborting.
initcall init_acpi_pm_clocksource+0x0/0x152 returned -19 after 28 msecs
calling  ssb_modinit+0x0/0x41
initcall ssb_modinit+0x0/0x41 returned 0 after 0 msecs
calling  pcibios_assign_resources+0x0/0x91
pci 0000:00:1c.0: PCI bridge, secondary bus 0000:02
pci 0000:00:1c.0:   IO window: 0x2000-0x2fff
pci 0000:00:1c.0:   MEM window: 0xee000000-0xee0fffff
pci 0000:00:1c.0:   PREFETCH window: disabled
pci 0000:00:1c.1: PCI bridge, secondary bus 0000:03
pci 0000:00:1c.1:   IO window: 0x3000-0x4fff
pci 0000:00:1c.1:   MEM window: 0xec000000-0xedffffff
pci 0000:00:1c.1:   PREFETCH window: 0x000000e4000000-0x000000e40fffff
pci 0000:00:1c.2: PCI bridge, secondary bus 0000:04
pci 0000:00:1c.2:   IO window: 0x5000-0x6fff
pci 0000:00:1c.2:   MEM window: 0xe8000000-0xe9ffffff
pci 0000:00:1c.2:   PREFETCH window: 0x000000e4100000-0x000000e41fffff
pci 0000:00:1c.3: PCI bridge, secondary bus 0000:0c
pci 0000:00:1c.3:   IO window: 0x7000-0x8fff
pci 0000:00:1c.3:   MEM window: 0xea000000-0xebffffff
pci 0000:00:1c.3:   PREFETCH window: 0x000000e4200000-0x000000e42fffff
pci 0000:15:00.0: CardBus bridge, secondary bus 0000:16
pci 0000:15:00.0:   IO window: 0x009000-0x0090ff
pci 0000:15:00.0:   IO window: 0x009400-0x0094ff
pci 0000:15:00.0:   PREFETCH window: 0xe0000000-0xe3ffffff
pci 0000:15:00.0:   MEM window: 0x88000000-0x8bffffff
pci 0000:00:1e.0: PCI bridge, secondary bus 0000:15
pci 0000:00:1e.0:   IO window: 0x9000-0xcfff
pci 0000:00:1e.0:   MEM window: 0xe4300000-0xe7ffffff
pci 0000:00:1e.0:   PREFETCH window: 0x000000e0000000-0x000000e3ffffff
pci 0000:00:1c.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
PCI: Setting latency timer of device 0000:00:1c.0 to 64
pci 0000:00:1c.1: PCI INT B -> GSI 21 (level, low) -> IRQ 21
PCI: Setting latency timer of device 0000:00:1c.1 to 64
pci 0000:00:1c.2: PCI INT C -> GSI 22 (level, low) -> IRQ 22
PCI: Setting latency timer of device 0000:00:1c.2 to 64
pci 0000:00:1c.3: PCI INT D -> GSI 23 (level, low) -> IRQ 23
PCI: Setting latency timer of device 0000:00:1c.3 to 64
pci 0000:00:1e.0: enabling device (0005 -> 0007)
PCI: Setting latency timer of device 0000:00:1e.0 to 64
vendor=8086 device=2448
pci 0000:15:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
bus: 00 index 0 io port: [0, ffff]
bus: 00 index 1 mmio: [0, ffffffffffffffff]
bus: 02 index 0 io port: [2000, 2fff]
bus: 02 index 1 mmio: [ee000000, ee0fffff]
bus: 02 index 2 mmio: [0, 0]
bus: 02 index 3 mmio: [0, 0]
bus: 03 index 0 io port: [3000, 4fff]
bus: 03 index 1 mmio: [ec000000, edffffff]
bus: 03 index 2 mmio: [e4000000, e40fffff]
bus: 03 index 3 mmio: [0, 0]
bus: 04 index 0 io port: [5000, 6fff]
bus: 04 index 1 mmio: [e8000000, e9ffffff]
bus: 04 index 2 mmio: [e4100000, e41fffff]
bus: 04 index 3 mmio: [0, 0]
bus: 0c index 0 io port: [7000, 8fff]
bus: 0c index 1 mmio: [ea000000, ebffffff]
bus: 0c index 2 mmio: [e4200000, e42fffff]
bus: 0c index 3 mmio: [0, 0]
bus: 15 index 0 io port: [9000, cfff]
bus: 15 index 1 mmio: [e4300000, e7ffffff]
bus: 15 index 2 mmio: [e0000000, e3ffffff]
bus: 15 index 3 io port: [0, ffff]
bus: 15 index 4 mmio: [0, ffffffffffffffff]
bus: 16 index 0 io port: [9000, 90ff]
bus: 16 index 1 io port: [9400, 94ff]
bus: 16 index 2 mmio: [e0000000, e3ffffff]
bus: 16 index 3 mmio: [88000000, 8bffffff]
initcall pcibios_assign_resources+0x0/0x91 returned 0 after 4 msecs
calling  inet_init+0x0/0x1be
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 9, 2359296 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
initcall inet_init+0x0/0x1be returned 0 after 11 msecs
calling  af_unix_init+0x0/0x47
NET: Registered protocol family 1
initcall af_unix_init+0x0/0x47 returned 0 after 0 msecs
calling  populate_rootfs+0x0/0x102
initcall populate_rootfs+0x0/0x102 returned 0 after 1 msecs
calling  pci_init+0x0/0x2c
pci 0000:00:02.0: Boot video device
pci 0000:00:1d.0: uhci_check_and_reset_hc: legsup = 0x2000
pci 0000:00:1d.0: Performing full reset
pci 0000:00:1d.1: uhci_check_and_reset_hc: legsup = 0x2000
pci 0000:00:1d.1: Performing full reset
pci 0000:00:1d.2: uhci_check_and_reset_hc: legsup = 0x2000
pci 0000:00:1d.2: Performing full reset
pci 0000:00:1d.3: uhci_check_and_reset_hc: legsup = 0x2000
pci 0000:00:1d.3: Performing full reset
initcall pci_init+0x0/0x2c returned 0 after 0 msecs
calling  ehci_hcd_init+0x0/0x70
ehci_hcd: block sizes: qh 128 qtd 96 itd 160 sitd 96
ehci_hcd 0000:00:1d.7: power state changed by ACPI to D0
ehci_hcd 0000:00:1d.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
PCI: Setting latency timer of device 0000:00:1d.7 to 64
ehci_hcd 0000:00:1d.7: EHCI Host Controller
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1d.7: reset hcs_params 0x104208 dbg=1 cc=4 pcc=2 ordered !ppc ports=8
ehci_hcd 0000:00:1d.7: reset hcc_params 6871 thresh 7 uframes 1024 64 bit addr
ehci_hcd 0000:00:1d.7: reset command 080022 (park)=0 ithresh=8 Async period=1024 Reset HALT
ehci_hcd 0000:00:1d.7: debug port 1
ehci_hcd 0000:00:1d.7: cache line size of 32 is not supported
ehci_hcd 0000:00:1d.7: supports USB remote wakeup
ehci_hcd 0000:00:1d.7: irq 19, io mem 0xee444000
ehci_hcd 0000:00:1d.7: reset command 080002 (park)=0 ithresh=8 period=1024 Reset HALT
ehci_hcd 0000:00:1d.7: init command 010001 (park)=0 ithresh=1 period=1024 RUN
ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
usb usb1: default language 0x0409
usb usb1: uevent
usb usb1: usb_probe_device
usb usb1: configuration #1 chosen from 1 choice
usb usb1: adding 1-0:1.0 (config #1, interface 0)
usb 1-0:1.0: uevent
hub 1-0:1.0: usb_probe_interface
hub 1-0:1.0: usb_probe_interface - got id
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 8 ports detected
hub 1-0:1.0: standalone hub
hub 1-0:1.0: no power switching (usb 1.0)
hub 1-0:1.0: individual port over-current protection
hub 1-0:1.0: power on to power good time: 20ms
hub 1-0:1.0: local power source is good
hub 1-0:1.0: trying to enable port power on non-switchable hub
hub 1-0:1.0: state 7 ports 8 chg 0000 evt 0000
ehci_hcd 0000:00:1d.7: GetStatus port 8 status 001803 POWER sig=j CSC CONNECT
hub 1-0:1.0: port 8, status 0501, change 0001, 480 Mb/s
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.26-tip ehci_hcd
usb usb1: SerialNumber: 0000:00:1d.7
initcall ehci_hcd_init+0x0/0x70 returned 0 after 116 msecs
calling  ohci_hcd_mod_init+0x0/0xb0
ohci_hcd: 2006 August 04 USB 1.1 'Open' Host Controller (OHCI) Driver
ohci_hcd: block sizes: ed 64 td 64
initcall ohci_hcd_mod_init+0x0/0xb0 returned 0 after 0 msecs
calling  uhci_hcd_init+0x0/0xc7
USB Universal Host Controller Interface driver v3.0
uhci_hcd 0000:00:1d.0: power state changed by ACPI to D0
Pin 1-16 already programmed
uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
PCI: Setting latency timer of device 0000:00:1d.0 to 64
uhci_hcd 0000:00:1d.0: UHCI Host Controller
uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
uhci_hcd 0000:00:1d.0: detected 2 ports
uhci_hcd 0000:00:1d.0: uhci_check_and_reset_hc: cmd = 0x0000
uhci_hcd 0000:00:1d.0: Performing full reset
uhci_hcd 0000:00:1d.0: supports USB remote wakeup
uhci_hcd 0000:00:1d.0: irq 16, io base 0x00001820
usb usb2: default language 0x0409
usb usb2: uevent
usb usb2: usb_probe_device
usb usb2: configuration #1 chosen from 1 choice
usb usb2: adding 2-0:1.0 (config #1, interface 0)
usb 2-0:1.0: uevent
hub 2-0:1.0: usb_probe_interface
hub 2-0:1.0: usb_probe_interface - got id
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
hub 2-0:1.0: standalone hub
hub 2-0:1.0: no power switching (usb 1.0)
hub 2-0:1.0: individual port over-current protection
hub 2-0:1.0: power on to power good time: 2ms
hub 2-0:1.0: local power source is good
hub 2-0:1.0: trying to enable port power on non-switchable hub
hub 1-0:1.0: debounce: port 8: total 100ms stable 100ms status 0x501
usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: UHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.26-tip uhci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
PCI: Setting latency timer of device 0000:00:1d.1 to 64
uhci_hcd 0000:00:1d.1: UHCI Host Controller
uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
uhci_hcd 0000:00:1d.1: detected 2 ports
uhci_hcd 0000:00:1d.1: uhci_check_and_reset_hc: cmd = 0x0000
uhci_hcd 0000:00:1d.1: Performing full reset
uhci_hcd 0000:00:1d.1: supports USB remote wakeup
uhci_hcd 0000:00:1d.1: irq 17, io base 0x00001840
usb usb3: default language 0x0409
usb usb3: uevent
usb usb3: usb_probe_device
usb usb3: configuration #1 chosen from 1 choice
usb usb3: adding 3-0:1.0 (config #1, interface 0)
usb 3-0:1.0: uevent
hub 3-0:1.0: usb_probe_interface
hub 3-0:1.0: usb_probe_interface - got id
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
hub 3-0:1.0: standalone hub
hub 3-0:1.0: no power switching (usb 1.0)
hub 3-0:1.0: individual port over-current protection
hub 3-0:1.0: power on to power good time: 2ms
hub 3-0:1.0: local power source is good
hub 3-0:1.0: trying to enable port power on non-switchable hub
ehci_hcd 0000:00:1d.7: port 8 full speed --> companion
ehci_hcd 0000:00:1d.7: GetStatus port 8 status 003801 POWER OWNER sig=j CONNECT
hub 1-0:1.0: port 8 not reset yet, waiting 50ms
ehci_hcd 0000:00:1d.7: GetStatus port 8 status 003002 POWER OWNER sig=se0 CSC
hub 2-0:1.0: state 7 ports 2 chg 0000 evt 0000
hub 1-0:1.0: state 7 ports 8 chg 0000 evt 0100
hub 3-0:1.0: state 7 ports 2 chg 0000 evt 0000
usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb3: Product: UHCI Host Controller
usb usb3: Manufacturer: Linux 2.6.26-tip uhci_hcd
usb usb3: SerialNumber: 0000:00:1d.1
uhci_hcd 0000:00:1d.2: power state changed by ACPI to D0
uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
PCI: Setting latency timer of device 0000:00:1d.2 to 64
uhci_hcd 0000:00:1d.2: UHCI Host Controller
uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
uhci_hcd 0000:00:1d.2: detected 2 ports
uhci_hcd 0000:00:1d.2: uhci_check_and_reset_hc: cmd = 0x0000
uhci_hcd 0000:00:1d.2: Performing full reset
uhci_hcd 0000:00:1d.2: supports USB remote wakeup
uhci_hcd 0000:00:1d.2: irq 18, io base 0x00001860
usb usb4: default language 0x0409
usb usb4: uevent
usb usb4: usb_probe_device
usb usb4: configuration #1 chosen from 1 choice
usb usb4: adding 4-0:1.0 (config #1, interface 0)
usb 4-0:1.0: uevent
hub 4-0:1.0: usb_probe_interface
hub 4-0:1.0: usb_probe_interface - got id
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 2 ports detected
hub 4-0:1.0: standalone hub
hub 4-0:1.0: no power switching (usb 1.0)
hub 4-0:1.0: individual port over-current protection
hub 4-0:1.0: power on to power good time: 2ms
hub 4-0:1.0: local power source is good
hub 4-0:1.0: trying to enable port power on non-switchable hub
hub 4-0:1.0: state 7 ports 2 chg 0000 evt 0000
usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb4: Product: UHCI Host Controller
usb usb4: Manufacturer: Linux 2.6.26-tip uhci_hcd
usb usb4: SerialNumber: 0000:00:1d.2
Pin 1-19 already programmed
uhci_hcd 0000:00:1d.3: PCI INT D -> GSI 19 (level, low) -> IRQ 19
PCI: Setting latency timer of device 0000:00:1d.3 to 64
uhci_hcd 0000:00:1d.3: UHCI Host Controller
uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
uhci_hcd 0000:00:1d.3: detected 2 ports
uhci_hcd 0000:00:1d.3: uhci_check_and_reset_hc: cmd = 0x0000
uhci_hcd 0000:00:1d.3: Performing full reset
uhci_hcd 0000:00:1d.3: irq 19, io base 0x00001880
usb usb5: default language 0x0409
usb usb5: uevent
usb usb5: usb_probe_device
usb usb5: configuration #1 chosen from 1 choice
usb usb5: adding 5-0:1.0 (config #1, interface 0)
usb 5-0:1.0: uevent
hub 5-0:1.0: usb_probe_interface
hub 5-0:1.0: usb_probe_interface - got id
hub 5-0:1.0: USB hub found
hub 5-0:1.0: 2 ports detected
hub 5-0:1.0: standalone hub
hub 5-0:1.0: no power switching (usb 1.0)
hub 5-0:1.0: individual port over-current protection
hub 5-0:1.0: power on to power good time: 2ms
hub 5-0:1.0: local power source is good
hub 5-0:1.0: trying to enable port power on non-switchable hub
hub 5-0:1.0: state 7 ports 2 chg 0000 evt 0000
uhci_hcd 0000:00:1d.3: port 2 portsc 009b,00
hub 5-0:1.0: port 2, status 0101, change 0003, 12 Mb/s
usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb5: Product: UHCI Host Controller
usb usb5: Manufacturer: Linux 2.6.26-tip uhci_hcd
usb usb5: SerialNumber: 0000:00:1d.3
initcall uhci_hcd_init+0x0/0xc7 returned 0 after 402 msecs
calling  i8259A_init_sysfs+0x0/0x1d
initcall i8259A_init_sysfs+0x0/0x1d returned 0 after 0 msecs
calling  sbf_init+0x0/0xbd
Simple Boot Flag at 0x35 set to 0x1
initcall sbf_init+0x0/0xbd returned 0 after 0 msecs
calling  i8237A_init_sysfs+0x0/0x1d
initcall i8237A_init_sysfs+0x0/0x1d returned 0 after 0 msecs
calling  add_rtc_cmos+0x0/0x1a
initcall add_rtc_cmos+0x0/0x1a returned 0 after 0 msecs
calling  cache_sysfs_init+0x0/0x47
initcall cache_sysfs_init+0x0/0x47 returned 0 after 0 msecs
calling  eps_init+0x0/0x3e
initcall eps_init+0x0/0x3e returned -19 after 0 msecs
calling  nforce2_init+0x0/0x5e
cpufreq: No nForce2 chipset.
initcall nforce2_init+0x0/0x5e returned -19 after 0 msecs
calling  microcode_init+0x0/0xa2
IA-32 Microcode Update Driver: v1.14a <tigran@aivazian.fsnet.co.uk>
initcall microcode_init+0x0/0xa2 returned 0 after 0 msecs
calling  init_lapic_sysfs+0x0/0x38
initcall init_lapic_sysfs+0x0/0x38 returned 0 after 0 msecs
calling  ioapic_init_sysfs+0x0/0x84
initcall ioapic_init_sysfs+0x0/0x84 returned 0 after 0 msecs
calling  add_pcspkr+0x0/0x35
initcall add_pcspkr+0x0/0x35 returned 0 after 0 msecs
calling  start_pageattr_test+0x0/0x38
initcall start_pageattr_test+0x0/0x38 returned 0 after 0 msecs
calling  debug_pagealloc_proc_init+0x0/0x27
initcall debug_pagealloc_proc_init+0x0/0x27 returned 0 after 0 msecs
calling  aes_init+0x0/0xf
initcall aes_init+0x0/0xf returned 0 after 0 msecs
calling  init+0x0/0xf
initcall init+0x0/0xf returned 0 after 0 msecs
calling  init+0x0/0xf
initcall init+0x0/0xf returned 0 after 0 msecs
calling  create_proc_profile+0x0/0x19f
initcall create_proc_profile+0x0/0x19f returned 0 after 0 msecs
calling  ioresources_init+0x0/0x2d
initcall ioresources_init+0x0/0x2d returned 0 after 0 msecs
calling  uid_cache_init+0x0/0x5e
initcall uid_cache_init+0x0/0x5e returned 0 after 0 msecs
calling  init_posix_timers+0x0/0x7c
initcall init_posix_timers+0x0/0x7c returned 0 after 0 msecs
calling  init_posix_cpu_timers+0x0/0x90
initcall init_posix_cpu_timers+0x0/0x90 returned 0 after 0 msecs
calling  nsproxy_cache_init+0x0/0x27
initcall nsproxy_cache_init+0x0/0x27 returned 0 after 0 msecs
calling  timekeeping_init_device+0x0/0x1d
initcall timekeeping_init_device+0x0/0x1d returned 0 after 0 msecs
calling  init_clocksource_sysfs+0x0/0x43
initcall init_clocksource_sysfs+0x0/0x43 returned 0 after 0 msecs
calling  init_timer_list_procfs+0x0/0x27
initcall init_timer_list_procfs+0x0/0x27 returned 0 after 0 msecs
calling  lockdep_proc_init+0x0/0x5f
initcall lockdep_proc_init+0x0/0x5f returned 0 after 0 msecs
calling  futex_init+0x0/0x6f
initcall futex_init+0x0/0x6f returned 0 after 0 msecs
calling  init_rttest+0x0/0x102
Initializing RT-Tester: OK
initcall init_rttest+0x0/0x102 returned 0 after 1 msecs
calling  proc_dma_init+0x0/0x1c
initcall proc_dma_init+0x0/0x1c returned 0 after 0 msecs
calling  percpu_modinit+0x0/0x64
initcall percpu_modinit+0x0/0x64 returned 0 after 0 msecs
calling  kallsyms_init+0x0/0x1f
initcall kallsyms_init+0x0/0x1f returned 0 after 0 msecs
calling  crash_save_vmcoreinfo_init+0x0/0x316
initcall crash_save_vmcoreinfo_init+0x0/0x316 returned 0 after 0 msecs
calling  crash_notes_memory_init+0x0/0x36
initcall crash_notes_memory_init+0x0/0x36 returned 0 after 0 msecs
calling  pid_namespaces_init+0x0/0x27
initcall pid_namespaces_init+0x0/0x27 returned 0 after 0 msecs
calling  audit_init+0x0/0xc4
audit: initializing netlink socket (disabled)
type=2000 audit(1216632057.064:1): initialized
initcall audit_init+0x0/0xc4 returned 0 after 0 msecs
calling  init_kprobes+0x0/0xfc
Kprobe smoke test started
Kprobe smoke test passed successfully
initcall init_kprobes+0x0/0xfc returned 0 after 14 msecs
calling  relay_init+0x0/0x11
initcall relay_init+0x0/0x11 returned 0 after 0 msecs
calling  utsname_sysctl_init+0x0/0x11
initcall utsname_sysctl_init+0x0/0x11 returned 0 after 0 msecs
calling  init_per_zone_pages_min+0x0/0x48
initcall init_per_zone_pages_min+0x0/0x48 returned 0 after 0 msecs
calling  pdflush_init+0x0/0x16
initcall pdflush_init+0x0/0x16 returned 0 after 0 msecs
calling  kswapd_init+0x0/0x1d
initcall kswapd_init+0x0/0x1d returned 0 after 0 msecs
calling  setup_vmstat+0x0/0x37
initcall setup_vmstat+0x0/0x37 returned 0 after 0 msecs
calling  init_tmpfs+0x0/0xb9
initcall init_tmpfs+0x0/0xb9 returned 0 after 0 msecs
calling  slab_sysfs_init+0x0/0xb7
initcall slab_sysfs_init+0x0/0xb7 returned 0 after 30 msecs
calling  fasync_init+0x0/0x24
initcall fasync_init+0x0/0x24 returned 0 after 0 msecs
calling  aio_setup+0x0/0x64
initcall aio_setup+0x0/0x64 returned 0 after 0 msecs
calling  init_mbcache+0x0/0x11
initcall init_mbcache+0x0/0x11 returned 0 after 0 msecs
calling  dquot_init+0x0/0xdd
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
initcall dquot_init+0x0/0xdd returned 0 after 0 msecs
calling  init_v1_quota_format+0x0/0xf
initcall init_v1_quota_format+0x0/0xf returned 0 after 0 msecs
calling  dnotify_init+0x0/0x24
initcall dnotify_init+0x0/0x24 returned 0 after 0 msecs
calling  configfs_init+0x0/0xbb
initcall configfs_init+0x0/0xbb returned 0 after 0 msecs
calling  init_devpts_fs+0x0/0x33
initcall init_devpts_fs+0x0/0x33 returned 0 after 0 msecs
calling  init_reiserfs_fs+0x0/0x72
initcall init_reiserfs_fs+0x0/0x72 returned 0 after 0 msecs
calling  init_ext3_fs+0x0/0x5f
initcall init_ext3_fs+0x0/0x5f returned 0 after 0 msecs
calling  init_ext4_fs+0x0/0x5f
initcall init_ext4_fs+0x0/0x5f returned 0 after 0 msecs
calling  journal_init+0x0/0xb6
initcall journal_init+0x0/0xb6 returned 0 after 1 msecs
calling  journal_init+0x0/0xd3
initcall journal_init+0x0/0xd3 returned 0 after 1 msecs
calling  init_ramfs_fs+0x0/0xf
initcall init_ramfs_fs+0x0/0xf returned 0 after 0 msecs
calling  init_fat_fs+0x0/0x46
initcall init_fat_fs+0x0/0x46 returned 0 after 0 msecs
calling  init_msdos_fs+0x0/0xf
initcall init_msdos_fs+0x0/0xf returned 0 after 0 msecs
calling  init_bfs_fs+0x0/0x4f
initcall init_bfs_fs+0x0/0x4f returned 0 after 0 msecs
calling  init_hfsplus_fs+0x0/0x50
initcall init_hfsplus_fs+0x0/0x50 returned 0 after 0 msecs
calling  vxfs_init+0x0/0x4d
initcall vxfs_init+0x0/0x4d returned 0 after 0 msecs
calling  init_nfs_fs+0x0/0xfc
initcall init_nfs_fs+0x0/0xfc returned 0 after 1 msecs
calling  init_nlm+0x0/0x1c
initcall init_nlm+0x0/0x1c returned 0 after 0 msecs
calling  init_nls_cp437+0x0/0xf
initcall init_nls_cp437+0x0/0xf returned 0 after 0 msecs
calling  init_nls_cp865+0x0/0xf
initcall init_nls_cp865+0x0/0xf returned 0 after 0 msecs
calling  init_nls_cp932+0x0/0xf
initcall init_nls_cp932+0x0/0xf returned 0 after 0 msecs
calling  init_nls_euc_jp+0x0/0x39
initcall init_nls_euc_jp+0x0/0x39 returned 0 after 0 msecs
calling  init_nls_cp936+0x0/0xf
initcall init_nls_cp936+0x0/0xf returned 0 after 0 msecs
calling  init_nls_cp949+0x0/0xf
initcall init_nls_cp949+0x0/0xf returned 0 after 0 msecs
calling  init_nls_cp1251+0x0/0xf
initcall init_nls_cp1251+0x0/0xf returned 0 after 0 msecs
calling  init_nls_ascii+0x0/0xf
initcall init_nls_ascii+0x0/0xf returned 0 after 0 msecs
calling  init_nls_iso8859_1+0x0/0xf
initcall init_nls_iso8859_1+0x0/0xf returned 0 after 0 msecs
calling  init_nls_iso8859_13+0x0/0xf
initcall init_nls_iso8859_13+0x0/0xf returned 0 after 0 msecs
calling  init_nls_iso8859_14+0x0/0xf
initcall init_nls_iso8859_14+0x0/0xf returned 0 after 0 msecs
calling  init_nls_koi8_u+0x0/0xf
initcall init_nls_koi8_u+0x0/0xf returned 0 after 0 msecs
calling  init_nls_koi8_ru+0x0/0x39
initcall init_nls_koi8_ru+0x0/0x39 returned 0 after 0 msecs
calling  init_nls_utf8+0x0/0x1f
initcall init_nls_utf8+0x0/0x1f returned 0 after 0 msecs
calling  init_sysv_fs+0x0/0x43
initcall init_sysv_fs+0x0/0x43 returned 0 after 0 msecs
calling  init_ncp_fs+0x0/0x4f
initcall init_ncp_fs+0x0/0x4f returned 0 after 0 msecs
calling  init_ntfs_fs+0x0/0x199
NTFS driver 2.1.29 [Flags: R/O].
initcall init_ntfs_fs+0x0/0x199 returned 0 after 0 msecs
calling  init_autofs4_fs+0x0/0xf
initcall init_autofs4_fs+0x0/0xf returned 0 after 0 msecs
calling  fuse_init+0x0/0xf8
fuse init (API version 7.9)
initcall fuse_init+0x0/0xf8 returned 0 after 0 msecs
calling  ipc_init+0x0/0x20
msgmni has been set to 1703
initcall ipc_init+0x0/0x20 returned 0 after 0 msecs
calling  ipc_sysctl_init+0x0/0x11
initcall ipc_sysctl_init+0x0/0x11 returned 0 after 0 msecs
calling  key_proc_init+0x0/0x2c
initcall key_proc_init+0x0/0x2c returned 0 after 0 msecs
calling  selinux_nf_ip_init+0x0/0x68
SELinux:  Registering netfilter hooks
initcall selinux_nf_ip_init+0x0/0x68 returned 0 after 0 msecs
calling  init_sel_fs+0x0/0x5a
initcall init_sel_fs+0x0/0x5a returned 0 after 0 msecs
calling  selnl_init+0x0/0x46
initcall selnl_init+0x0/0x46 returned 0 after 0 msecs
calling  sel_netif_init+0x0/0x57
initcall sel_netif_init+0x0/0x57 returned 0 after 0 msecs
calling  sel_netnode_init+0x0/0x68
initcall sel_netnode_init+0x0/0x68 returned 0 after 0 msecs
calling  sel_netport_init+0x0/0x68
initcall sel_netport_init+0x0/0x68 returned 0 after 0 msecs
calling  aurule_init+0x0/0x30
initcall aurule_init+0x0/0x30 returned 0 after 0 msecs
calling  crypto_algapi_init+0x0/0xc
initcall crypto_algapi_init+0x0/0xc returned 0 after 0 msecs
calling  blkcipher_module_init+0x0/0x24
initcall blkcipher_module_init+0x0/0x24 returned 0 after 0 msecs
calling  seqiv_module_init+0x0/0xf
initcall seqiv_module_init+0x0/0xf returned 0 after 0 msecs
calling  cryptomgr_init+0x0/0xf
initcall cryptomgr_init+0x0/0xf returned 0 after 0 msecs
calling  hmac_module_init+0x0/0xf
initcall hmac_module_init+0x0/0xf returned 0 after 0 msecs
calling  crypto_xcbc_module_init+0x0/0xf
initcall crypto_xcbc_module_init+0x0/0xf returned 0 after 0 msecs
calling  crypto_null_mod_init+0x0/0x67
initcall crypto_null_mod_init+0x0/0x67 returned 0 after 0 msecs
calling  md5_mod_init+0x0/0xf
initcall md5_mod_init+0x0/0xf returned 0 after 0 msecs
calling  rmd128_mod_init+0x0/0xf
initcall rmd128_mod_init+0x0/0xf returned 0 after 0 msecs
calling  sha1_generic_mod_init+0x0/0xf
initcall sha1_generic_mod_init+0x0/0xf returned 0 after 0 msecs
calling  tgr192_mod_init+0x0/0x52
initcall tgr192_mod_init+0x0/0x52 returned 0 after 0 msecs
calling  crypto_cbc_module_init+0x0/0xf
initcall crypto_cbc_module_init+0x0/0xf returned 0 after 0 msecs
calling  crypto_pcbc_module_init+0x0/0xf
initcall crypto_pcbc_module_init+0x0/0xf returned 0 after 0 msecs
calling  crypto_module_init+0x0/0xf
initcall crypto_module_init+0x0/0xf returned 0 after 0 msecs
calling  crypto_ctr_module_init+0x0/0x33
initcall crypto_ctr_module_init+0x0/0x33 returned 0 after 0 msecs
calling  des_generic_mod_init+0x0/0x33
initcall des_generic_mod_init+0x0/0x33 returned 0 after 0 msecs
calling  fcrypt_mod_init+0x0/0xf
initcall fcrypt_mod_init+0x0/0xf returned 0 after 0 msecs
calling  twofish_mod_init+0x0/0xf
initcall twofish_mod_init+0x0/0xf returned 0 after 0 msecs
calling  aes_init+0x0/0x2ac
initcall aes_init+0x0/0x2ac returned 0 after 0 msecs
calling  cast5_mod_init+0x0/0xf
initcall cast5_mod_init+0x0/0xf returned 0 after 0 msecs
calling  anubis_mod_init+0x0/0xf
initcall anubis_mod_init+0x0/0xf returned 0 after 0 msecs
calling  deflate_mod_init+0x0/0xf
initcall deflate_mod_init+0x0/0xf returned 0 after 0 msecs
calling  crypto_authenc_module_init+0x0/0xf
initcall crypto_authenc_module_init+0x0/0xf returned 0 after 0 msecs
calling  noop_init+0x0/0x11
io scheduler noop registered (default)
initcall noop_init+0x0/0x11 returned 0 after 0 msecs
calling  init_kmp+0x0/0xf
initcall init_kmp+0x0/0xf returned 0 after 0 msecs
calling  init_bm+0x0/0xf
initcall init_bm+0x0/0xf returned 0 after 0 msecs
calling  init_fsm+0x0/0xf
initcall init_fsm+0x0/0xf returned 0 after 0 msecs
calling  percpu_counter_startup+0x0/0x11
initcall percpu_counter_startup+0x0/0x11 returned 0 after 0 msecs
calling  audit_classes_init+0x0/0x4f
initcall audit_classes_init+0x0/0x4f returned 0 after 0 msecs
calling  pci_proc_init+0x0/0x5b
initcall pci_proc_init+0x0/0x5b returned 0 after 0 msecs
calling  progearbl_init+0x0/0x53
ALI M7101 PMU not found.
initcall progearbl_init+0x0/0x53 returned 0 after 0 msecs
calling  cr_backlight_init+0x0/0x60
INTEL CARILLO RANCH LPC not found.
Carillo Ranch Backlight Driver Initialized.
initcall cr_backlight_init+0x0/0x60 returned 0 after 0 msecs
calling  tdfxfb_init+0x0/0xe3
initcall tdfxfb_init+0x0/0xe3 returned 0 after 0 msecs
calling  vmlfb_init+0x0/0x81
vmlfb: initializing
initcall vmlfb_init+0x0/0x81 returned 0 after 0 msecs
calling  arkfb_init+0x0/0x4b
initcall arkfb_init+0x0/0x4b returned 0 after 0 msecs
calling  sstfb_init+0x0/0x18e
initcall sstfb_init+0x0/0x18e returned 0 after 0 msecs
calling  uvesafb_init+0x0/0x360
hub 5-0:1.0: debounce: port 2: total 100ms stable 100ms status 0x101
uvesafb: failed to execute /sbin/v86d
uvesafb: make sure that the v86d helper is installed and executable
uvesafb: Getting VBE info block failed (eax=0x4f00, err=-2)
uvesafb: vbe_init() failed with -22
uvesafb: probe of uvesafb.0 failed with error -22
initcall uvesafb_init+0x0/0x360 returned 0 after 0 msecs
calling  efifb_init+0x0/0x41
initcall efifb_init+0x0/0x41 returned -19 after 0 msecs
calling  acpi_reserve_resources+0x0/0xc8
initcall acpi_reserve_resources+0x0/0xc8 returned 0 after 0 msecs
calling  acpi_fan_init+0x0/0x2c
initcall acpi_fan_init+0x0/0x2c returned 0 after 0 msecs
calling  irqrouter_init_sysfs+0x0/0x33
initcall irqrouter_init_sysfs+0x0/0x33 returned 0 after 0 msecs
calling  acpi_pci_slot_init+0x0/0x1b
initcall acpi_pci_slot_init+0x0/0x1b returned 0 after 0 msecs
calling  acpi_container_init+0x0/0x3d
Clocksource tsc unstable (delta = -63036542 ns)
initcall acpi_container_init+0x0/0x3d returned 0 after 14 msecs
calling  asus_acpi_init+0x0/0xe2
initcall asus_acpi_init+0x0/0xe2 returned -19 after 0 msecs
calling  toshiba_acpi_init+0x0/0x159
initcall toshiba_acpi_init+0x0/0x159 returned -19 after 0 msecs
calling  rand_initialize+0x0/0x25
initcall rand_initialize+0x0/0x25 returned 0 after 0 msecs
calling  tty_init+0x0/0x18f
initcall tty_init+0x0/0x18f returned 0 after 15 msecs
calling  pty_init+0x0/0x37d
usb 5-2: new full speed USB device using uhci_hcd and address 2
initcall pty_init+0x0/0x37d returned 0 after 113 msecs
calling  moxa_init+0x0/0xf3
MOXA Intellio family driver version 6.0k
initcall moxa_init+0x0/0xf3 returned 0 after 30 msecs
calling  mxser_module_init+0x0/0x5f8
MOXA Smartio/Industio family driver version 2.0.3
initcall mxser_module_init+0x0/0x5f8 returned 0 after 0 msecs
calling  ip2_init+0x0/0x45
Computone IntelliPort Plus multiport driver version 1.2.14
initcall ip2_init+0x0/0x45 returned 0 after 0 msecs
calling  riscom8_init_module+0x0/0x3bd
rc: SDL RISCom/8 card driver v1.1, (c) D.Gorodchanin 1994-1996.
rc0: RISCom/8 Board at 0x220 not found.
rc1: RISCom/8 Board at 0x240 not found.
rc2: RISCom/8 Board at 0x250 not found.
rc3: RISCom/8 Board at 0x260 not found.
rc: No RISCom/8 boards detected.
initcall riscom8_init_module+0x0/0x3bd returned -5 after 19 msecs
initcall riscom8_init_module+0x0/0x3bd returned with error code -5 
calling  applicom_init+0x0/0x42c
Applicom driver: $Id: ac.c,v 1.30 2000/03/22 16:03:57 dwmw2 Exp $
ac.o: No PCI boards found.
ac.o: For an ISA board you must supply memory and irq parameters.
initcall applicom_init+0x0/0x42c returned -6 after 0 msecs
initcall applicom_init+0x0/0x42c returned with error code -6 
calling  hpet_init+0x0/0x57
hpet_acpi_add: no address or irqs in _CRS
initcall hpet_init+0x0/0x57 returned 0 after 0 msecs
calling  nvram_init+0x0/0x75
Non-volatile memory driver v1.2
initcall nvram_init+0x0/0x75 returned 0 after 0 msecs
calling  toshiba_init+0x0/0x31a
toshiba: not a supported Toshiba laptop
initcall toshiba_init+0x0/0x31a returned -19 after 0 msecs
calling  i8k_init+0x0/0x174
initcall i8k_init+0x0/0x174 returned -19 after 0 msecs
calling  cs5535_gpio_init+0x0/0x147
cs5535_gpio: DIVIL not found
initcall cs5535_gpio_init+0x0/0x147 returned -19 after 0 msecs
calling  agp_init+0x0/0x21
Linux agpgart interface v0.103
initcall agp_init+0x0/0x21 returned 0 after 0 msecs
calling  agp_ati_init+0x0/0x24
initcall agp_ati_init+0x0/0x24 returned 0 after 0 msecs
calling  agp_intel_init+0x0/0x24
agpgart: Detected an Intel 945GM Chipset.
agpgart: Detected 7932K stolen memory.
usb 5-2: ep0 maxpacket = 8
agpgart: AGP aperture is 256M @ 0xd0000000
initcall agp_intel_init+0x0/0x24 returned 0 after 18 msecs
calling  agp_sis_init+0x0/0x24
initcall agp_sis_init+0x0/0x24 returned 0 after 0 msecs
calling  agp_via_init+0x0/0x24
initcall agp_via_init+0x0/0x24 returned 0 after 0 msecs
calling  ipmi_init_msghandler_mod+0x0/0xc
ipmi message handler version 39.2
initcall ipmi_init_msghandler_mod+0x0/0xc returned 0 after 0 msecs
calling  init_ipmi_si+0x0/0x6ee
IPMI System Interface driver.
ipmi_si: Unable to find any System Interface(s)
initcall init_ipmi_si+0x0/0x6ee returned -19 after 1 msecs
calling  ipmi_wdog_init+0x0/0xfe
IPMI Watchdog: driver initialized
initcall ipmi_wdog_init+0x0/0xfe returned 0 after 0 msecs
calling  init_atmel+0x0/0x167
initcall init_atmel+0x0/0x167 returned -19 after 0 msecs
calling  drm_core_init+0x0/0xcc
[drm] Initialized drm 1.1.0 20060810
initcall drm_core_init+0x0/0xcc returned 0 after 0 msecs
calling  i810_init+0x0/0x19
initcall i810_init+0x0/0x19 returned 0 after 0 msecs
calling  i915_init+0x0/0x19
pci 0000:00:02.0: power state changed by ACPI to D0
Pin 1-16 already programmed
pci 0000:00:02.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
PCI: Setting latency timer of device 0000:00:02.0 to 64
[drm] Initialized i915 1.6.0 20060119 on minor 0
initcall i915_init+0x0/0x19 returned 0 after 0 msecs
calling  cn_proc_init+0x0/0x30
initcall cn_proc_init+0x0/0x30 returned 0 after 0 msecs
calling  i810fb_init+0x0/0x35a
initcall i810fb_init+0x0/0x35a returned 0 after 0 msecs
calling  serial8250_init+0x0/0x10c
Serial: 8250/16550 driver4 ports, IRQ sharing disabled
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a NS16550A
initcall serial8250_init+0x0/0x10c returned 0 after 2 msecs
calling  serial8250_pnp_init+0x0/0xf
pnp: the driver 'serial' has been registered
initcall serial8250_pnp_init+0x0/0xf returned 0 after 0 msecs
calling  serial8250_pci_init+0x0/0x16
initcall serial8250_pci_init+0x0/0x16 returned 0 after 0 msecs
calling  fourport_init+0x0/0xf
initcall fourport_init+0x0/0xf returned 0 after 6 msecs
calling  accent_init+0x0/0xf
initcall accent_init+0x0/0xf returned 0 after 0 msecs
calling  exar_init+0x0/0xf
initcall exar_init+0x0/0xf returned 0 after 2 msecs
calling  hub6_init+0x0/0xf
usb 5-2: default language 0x0409
initcall hub6_init+0x0/0xf returned 0 after 8 msecs
calling  jsm_init_module+0x0/0x3a
initcall jsm_init_module+0x0/0x3a returned 0 after 0 msecs
calling  isa_bus_init+0x0/0x33
initcall isa_bus_init+0x0/0x33 returned 0 after 0 msecs
calling  topology_sysfs_init+0x0/0x36
initcall topology_sysfs_init+0x0/0x36 returned 0 after 0 msecs
calling  xd_init+0x0/0x47a
xd: Out of memory.
initcall xd_init+0x0/0x47a returned -12 after 0 msecs
initcall xd_init+0x0/0x47a returned with error code -12 
calling  cpqarray_init+0x0/0x22b
Compaq SMART2 Driver (v 2.6.0)
initcall cpqarray_init+0x0/0x22b returned 0 after 0 msecs
calling  mm_init+0x0/0x146
MM: desc_per_page = 128
initcall mm_init+0x0/0x146 returned 0 after 0 msecs
calling  nbd_init+0x0/0x28a
nbd: registered device at major 43
initcall nbd_init+0x0/0x28a returned 0 after 10 msecs
calling  carm_init+0x0/0x16
initcall carm_init+0x0/0x16 returned 0 after 0 msecs
calling  compal_init+0x0/0xed
initcall compal_init+0x0/0xed returned -19 after 0 msecs
calling  lkdtm_module_init+0x0/0x1bf
lkdtm : Invalid command
initcall lkdtm_module_init+0x0/0x1bf returned -22 after 0 msecs
initcall lkdtm_module_init+0x0/0x1bf returned with error code -22 
calling  ioc4_init+0x0/0x16
initcall ioc4_init+0x0/0x16 returned 0 after 0 msecs
calling  sm501_base_init+0x0/0x20
usb 5-2: uevent
usb 5-2: usb_probe_device
usb 5-2: configuration #1 chosen from 1 choice
initcall sm501_base_init+0x0/0x20 returned 0 after 0 msecs
calling  pasic3_base_init+0x0/0x14
initcall pasic3_base_init+0x0/0x14 returned -19 after 0 msecs
calling  e1000_init_module+0x0/0x53
e1000e: Intel(R) PRO/1000 Network Driver - 0.3.3.3-k2
e1000e: Copyright (c) 1999-2008 Intel Corporation.
e1000e 0000:02:00.0: Disabling L1 ASPM
vendor=8086 device=27d0
Pin 1-16 already programmed
e1000e 0000:02:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
PCI: Setting latency timer of device 0000:02:00.0 to 64
usb 5-2: adding 5-2:1.0 (config #1, interface 0)
usb 5-2:1.0: uevent
usb 5-2: New USB device found, idVendor=0483, idProduct=2016
usb 5-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
usb 5-2: Product: Biometric Coprocessor
usb 5-2: Manufacturer: STMicroelectronics
eth0: (PCI Express:2.5GB/s:Width x1) 00:16:41:17:49:d2
eth0: Intel(R) PRO/1000 Network Connection
eth0: MAC: 2, PHY: 2, PBA No: 005301-003
initcall e1000_init_module+0x0/0x53 returned 0 after 82 msecs
calling  ixgb_init_module+0x0/0x39
Intel(R) PRO/10GbE Network Driver - version 1.0.135-k2-NAPI
Copyright (c) 1999-2008 Intel Corporation.
initcall ixgb_init_module+0x0/0x39 returned 0 after 0 msecs
calling  t1_init_module+0x0/0x16
initcall t1_init_module+0x0/0x16 returned 0 after 0 msecs
calling  cxgb3_init_module+0x0/0x1b
initcall cxgb3_init_module+0x0/0x1b returned 0 after 0 msecs
calling  vcan_init_module+0x0/0x2e
vcan: Virtual CAN interface driver
initcall vcan_init_module+0x0/0x2e returned 0 after 0 msecs
calling  happy_meal_probe+0x0/0x16
initcall happy_meal_probe+0x0/0x16 returned 0 after 0 msecs
calling  vortex_init+0x0/0xbf
initcall vortex_init+0x0/0xbf returned 0 after 0 msecs
calling  pcnet32_init_module+0x0/0x118
pcnet32.c:v1.35 21.Apr.2008 tsbogend@alpha.franken.de
initcall pcnet32_init_module+0x0/0x118 returned 0 after 0 msecs
calling  eepro100_init_module+0x0/0x16
initcall eepro100_init_module+0x0/0x16 returned 0 after 0 msecs
calling  e100_init_module+0x0/0x4d
e100: Intel(R) PRO/100 Network Driver, 3.5.23-k4-NAPI
e100: Copyright(c) 1999-2006 Intel Corporation
initcall e100_init_module+0x0/0x4d returned 0 after 0 msecs
calling  epic_init+0x0/0x16
initcall epic_init+0x0/0x16 returned 0 after 0 msecs
calling  r6040_init+0x0/0x16
initcall r6040_init+0x0/0x16 returned 0 after 0 msecs
calling  yellowfin_init+0x0/0x16
initcall yellowfin_init+0x0/0x16 returned 0 after 0 msecs
calling  ns83820_init+0x0/0x20
ns83820.c: National Semiconductor DP83820 10/100/1000 driver.
initcall ns83820_init+0x0/0x20 returned 0 after 0 msecs
calling  tg3_init+0x0/0x16
initcall tg3_init+0x0/0x16 returned 0 after 0 msecs
calling  bnx2_init+0x0/0x16
initcall bnx2_init+0x0/0x16 returned 0 after 0 msecs
calling  bnx2x_init+0x0/0x16
initcall bnx2x_init+0x0/0x16 returned 0 after 0 msecs
calling  skfd_init+0x0/0x16
initcall skfd_init+0x0/0x16 returned 0 after 0 msecs
calling  net_olddevs_init+0x0/0x81
initcall net_olddevs_init+0x0/0x81 returned 0 after 8 msecs
calling  init_nic+0x0/0x16
initcall init_nic+0x0/0x16 returned 0 after 0 msecs
calling  ppp_init+0x0/0x83
PPP generic driver version 2.4.2
initcall ppp_init+0x0/0x83 returned 0 after 0 msecs
calling  deflate_init+0x0/0x30
PPP Deflate Compression module registered
initcall deflate_init+0x0/0x30 returned 0 after 0 msecs
calling  pppox_init+0x0/0xf
NET: Registered protocol family 24
initcall pppox_init+0x0/0xf returned 0 after 0 msecs
calling  pppoe_init+0x0/0x81
initcall pppoe_init+0x0/0x81 returned 0 after 0 msecs
calling  slip_init+0x0/0x98
SLIP: version 0.8.4-NET3.019-NEWTTY (dynamic channels, max=256) (6 bit encapsulation enabled).
CSLIP: code copyright 1989 Regents of the University of California.
initcall slip_init+0x0/0x98 returned 0 after 0 msecs
calling  dummy_init_module+0x0/0x95
initcall dummy_init_module+0x0/0x95 returned 0 after 0 msecs
calling  macvlan_init_module+0x0/0x45
initcall macvlan_init_module+0x0/0x45 returned 0 after 0 msecs
calling  rtl8139_init_module+0x0/0x16
initcall rtl8139_init_module+0x0/0x16 returned 0 after 0 msecs
calling  znet_probe+0x0/0x2bd
initcall znet_probe+0x0/0x2bd returned -19 after 0 msecs
calling  depca_module_init+0x0/0xd4
initcall depca_module_init+0x0/0xd4 returned 0 after 0 msecs
calling  lp486e_init_module+0x0/0x240
eth%d: i82596 initialization timed out
initcall lp486e_init_module+0x0/0x240 returned -19 after 0 msecs
calling  s2io_starter+0x0/0x16
initcall s2io_starter+0x0/0x16 returned 0 after 0 msecs
calling  enc28j60_init+0x0/0x1e
initcall enc28j60_init+0x0/0x1e returned 0 after 0 msecs
calling  arcnet_init+0x0/0x50
arcnet loaded.
initcall arcnet_init+0x0/0x50 returned 0 after 0 msecs
calling  arcnet_rfc1201_init+0x0/0x65
arcnet: RFC1201 "standard" (`a') encapsulation support loaded.
initcall arcnet_rfc1201_init+0x0/0x65 returned 0 after 0 msecs
calling  kaweth_init+0x0/0x25
drivers/net/usb/kaweth.c: Driver loading
usbcore: registered new interface driver kaweth
initcall kaweth_init+0x0/0x25 returned 0 after 0 msecs
calling  pegasus_init+0x0/0x150
pegasus: v0.6.14 (2006/09/27), Pegasus/Pegasus II USB Ethernet driver
usbcore: registered new interface driver pegasus
initcall pegasus_init+0x0/0x150 returned 0 after 0 msecs
calling  tulip_init+0x0/0x2a
initcall tulip_init+0x0/0x2a returned 0 after 0 msecs
calling  uli526x_init_module+0x0/0x8d
uli526x: ULi M5261/M5263 net driver, version 0.9.3 (2005-7-29)
initcall uli526x_init_module+0x0/0x8d returned 0 after 0 msecs
calling  init_netconsole+0x0/0x1bb
netconsole: local port 4444
netconsole: local IP 10.0.1.15
netconsole: interface eth0
netconsole: remote port 4444
netconsole: remote IP 10.0.1.16
netconsole: remote ethernet address 00:19:d1:01:f5:55
netconsole: device eth0 not up yet, forcing it
usb usb2: suspend_rh (auto-stop)
usb usb3: suspend_rh (auto-stop)
usb usb4: suspend_rh (auto-stop)
hub 2-0:1.0: hub_suspend
usb usb2: bus auto-suspend
usb usb2: suspend_rh
hub 1-0:1.0: hub_suspend
usb usb1: bus auto-suspend
ehci_hcd 0000:00:1d.7: suspend root hub
hub 3-0:1.0: hub_suspend
usb usb3: bus auto-suspend
usb usb3: suspend_rh
hub 4-0:1.0: hub_suspend
usb usb4: bus auto-suspend
usb usb4: suspend_rh
netconsole: timeout waiting for carrier
eth0: Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
console [netcon0] enabled
netconsole: network logging started
initcall init_netconsole+0x0/0x1bb returned 0 after 3837 msecs
calling  scsi_tgt_init+0x0/0x75
initcall scsi_tgt_init+0x0/0x75 returned 0 after 0 msecs
calling  spi_transport_init+0x0/0x27
initcall spi_transport_init+0x0/0x27 returned 0 after 0 msecs
calling  hp_sw_init+0x0/0xf
initcall hp_sw_init+0x0/0xf returned 0 after 0 msecs
calling  clariion_init+0x0/0x26
initcall clariion_init+0x0/0x26 returned 0 after 0 msecs
calling  ahc_linux_init+0x0/0x61
initcall ahc_linux_init+0x0/0x61 returned 0 after 0 msecs
calling  init_st+0x0/0x146
st: Version 20080224, fixed bufsize 32768, s/g segs 256
Driver 'st' needs updating - please use bus_type methods
initcall init_st+0x0/0x146 returned 0 after 0 msecs
calling  init_sd+0x0/0xb1
Driver 'sd' needs updating - please use bus_type methods
initcall init_sd+0x0/0xb1 returned 0 after 0 msecs
calling  init_ch_module+0x0/0x87
SCSI Media Changer driver v0.25 
Driver 'ch' needs updating - please use bus_type methods
initcall init_ch_module+0x0/0x87 returned 0 after 0 msecs
calling  ahci_init+0x0/0x16
ahci 0000:00:1f.2: version 3.0
Pin 1-16 already programmed
ahci 0000:00:1f.2: PCI INT B -> GSI 16 (level, low) -> IRQ 16
ahci 0000:00:1f.2: AHCI 0001.0100 32 slots 4 ports 1.5 Gbps 0x1 impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part 
PCI: Setting latency timer of device 0000:00:1f.2 to 64
scsi0 : ahci
scsi1 : ahci
scsi2 : ahci
scsi3 : ahci
ata1: SATA max UDMA/133 abar m1024@0xee444400 port 0xee444500 irq 222
ata2: DUMMY
ata3: DUMMY
ata4: DUMMY
ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
ata1.00: ATA-7: HTS541080G9SA00, MB4IC60H, max UDMA/100
ata1.00: 156301488 sectors, multi 16: LBA48 
ata1.00: configured for UDMA/100
scsi 0:0:0:0: Direct-Access     ATA      HTS541080G9SA00  MB4I PQ: 0 ANSI: 5
sd 0:0:0:0: [sda] 156301488 512-byte hardware sectors (80026 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:0:0: [sda] 156301488 512-byte hardware sectors (80026 MB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sda: sda1 sda2
sd 0:0:0:0: [sda] Attached SCSI disk
initcall ahci_init+0x0/0x16 returned 0 after 1021 msecs
calling  piix_init+0x0/0x24
ata_piix 0000:00:1f.1: version 2.12
Pin 1-16 already programmed
ata_piix 0000:00:1f.1: PCI INT C -> GSI 16 (level, low) -> IRQ 16
PCI: Setting latency timer of device 0000:00:1f.1 to 64
scsi4 : ata_piix
scsi5 : ata_piix
ata5: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0x1810 irq 14
ata6: PATA max UDMA/100 cmd 0x170 ctl 0x376 bmdma 0x1818 irq 15
ata5.00: ATAPI: HL-DT-STCD-RW/DVD DRIVE GCC-4246N, 0X05, max UDMA/33
ata5.00: configured for UDMA/33
ata6: port disabled. ignoring.
scsi 4:0:0:0: CD-ROM            HL-DT-ST RW/DVD GCC-4246N 0X05 PQ: 0 ANSI: 5
initcall piix_init+0x0/0x24 returned 0 after 161 msecs
calling  qs_ata_init+0x0/0x16
initcall qs_ata_init+0x0/0x16 returned 0 after 0 msecs
calling  svia_init+0x0/0x16
initcall svia_init+0x0/0x16 returned 0 after 0 msecs
calling  vsc_sata_init+0x0/0x16
initcall vsc_sata_init+0x0/0x16 returned 0 after 0 msecs
calling  pdc_sata_init+0x0/0x16
initcall pdc_sata_init+0x0/0x16 returned 0 after 0 msecs
calling  nv_init+0x0/0x16
initcall nv_init+0x0/0x16 returned 0 after 0 msecs
calling  amd_init+0x0/0x16
initcall amd_init+0x0/0x16 returned 0 after 0 msecs
calling  artop_init+0x0/0x16
initcall artop_init+0x0/0x16 returned 0 after 0 msecs
calling  atiixp_init+0x0/0x16
initcall atiixp_init+0x0/0x16 returned 0 after 0 msecs
calling  cmd64x_init+0x0/0x16
initcall cmd64x_init+0x0/0x16 returned 0 after 0 msecs
calling  efar_init+0x0/0x16
initcall efar_init+0x0/0x16 returned 0 after 0 msecs
calling  hpt3x2n_init+0x0/0x16
initcall hpt3x2n_init+0x0/0x16 returned 0 after 0 msecs
calling  it8213_init+0x0/0x16
initcall it8213_init+0x0/0x16 returned 0 after 0 msecs
calling  ninja32_init+0x0/0x16
initcall ninja32_init+0x0/0x16 returned 0 after 0 msecs
calling  mpiix_init+0x0/0x16
initcall mpiix_init+0x0/0x16 returned 0 after 0 msecs
calling  oldpiix_init+0x0/0x16
initcall oldpiix_init+0x0/0x16 returned 0 after 0 msecs
calling  via_init+0x0/0x16
initcall via_init+0x0/0x16 returned 0 after 0 msecs
calling  sl82c105_init+0x0/0x16
initcall sl82c105_init+0x0/0x16 returned 0 after 0 msecs
calling  sis_init+0x0/0x16
initcall sis_init+0x0/0x16 returned 0 after 0 msecs
calling  triflex_init+0x0/0x16
initcall triflex_init+0x0/0x16 returned 0 after 0 msecs
calling  ata_generic_init+0x0/0x16
initcall ata_generic_init+0x0/0x16 returned 0 after 0 msecs
calling  legacy_init+0x0/0x865
initcall legacy_init+0x0/0x865 returned -19 after 0 msecs
calling  i2o_iop_init+0x0/0x41
I2O subsystem v1.325
i2o: max drivers = 8
initcall i2o_iop_init+0x0/0x41 returned 0 after 0 msecs
calling  i2o_block_init+0x0/0xf7
I2O Block Device OSM v1.325
initcall i2o_block_init+0x0/0xf7 returned 0 after 0 msecs
calling  i2o_proc_init+0x0/0x14e
I2O ProcFS OSM v1.316
initcall i2o_proc_init+0x0/0x14e returned 0 after 0 msecs
calling  uio_init+0x0/0x7
initcall uio_init+0x0/0x7 returned 0 after 0 msecs
calling  smx_ce_init_module+0x0/0xf
initcall smx_ce_init_module+0x0/0xf returned 0 after 0 msecs
calling  mon_init+0x0/0xee
initcall mon_init+0x0/0xee returned 0 after 1 msecs
calling  isp116x_init+0x0/0x38
116x: driver isp116x-hcd, 03 Nov 2005
initcall isp116x_init+0x0/0x38 returned 0 after 0 msecs
calling  r8a66597_init+0x0/0x38
r8a66597_hcd: driver r8a66597_hcd, 10 Apr 2008
initcall r8a66597_init+0x0/0x38 returned 0 after 0 msecs
calling  c67x00_init+0x0/0xf
initcall c67x00_init+0x0/0xf returned 0 after 0 msecs
calling  usb_stor_init+0x0/0x42
Initializing USB Mass Storage driver...
usbcore: registered new interface driver usb-storage
USB Mass Storage support registered.
initcall usb_stor_init+0x0/0x42 returned 0 after 0 msecs
calling  usb_usual_init+0x0/0x32
usbcore: registered new interface driver libusual
initcall usb_usual_init+0x0/0x32 returned 0 after 0 msecs
calling  appledisplay_init+0x0/0x4e
usbcore: registered new interface driver appledisplay
initcall appledisplay_init+0x0/0x4e returned 0 after 0 msecs
calling  cypress_init+0x0/0x2f
usbcore: registered new interface driver cypress_cy7c63
initcall cypress_init+0x0/0x2f returned 0 after 0 msecs
calling  usb_cytherm_init+0x0/0x3c
usbcore: registered new interface driver cytherm
cytherm: v1.0:Cypress USB Thermometer driver
initcall usb_cytherm_init+0x0/0x3c returned 0 after 0 msecs
calling  isight_firmware_init+0x0/0x16
usbcore: registered new interface driver isight_firmware
initcall isight_firmware_init+0x0/0x16 returned 0 after 0 msecs
calling  usb_lcd_init+0x0/0x2f
usbcore: registered new interface driver usblcd
initcall usb_lcd_init+0x0/0x2f returned 0 after 0 msecs
calling  usb_sisusb_init+0x0/0x1b
usbcore: registered new interface driver sisusb
initcall usb_sisusb_init+0x0/0x1b returned 0 after 0 msecs
calling  usbatm_usb_init+0x0/0x5c
drivers/usb/atm/usbatm.c: usbatm_usb_init: driver version 1.10
initcall usbatm_usb_init+0x0/0x5c returned 0 after 0 msecs
calling  init+0x0/0x16
initcall init+0x0/0x16 returned 0 after 0 msecs
calling  init+0x0/0xa7
Printer Gadget: usb_gadget_register_driver ffffffed
initcall init+0x0/0xa7 returned -19 after 0 msecs
calling  i8042_init+0x0/0x31e
pnp: the driver 'i8042 kbd' has been registered
i8042 kbd 00:08: driver attached
pnp: the driver 'i8042 aux' has been registered
i8042 aux 00:09: driver attached
PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
initcall i8042_init+0x0/0x31e returned 0 after 9 msecs
calling  mousedev_init+0x0/0x51
mice: PS/2 mouse device common for all mice
initcall mousedev_init+0x0/0x51 returned 0 after 0 msecs
calling  joydev_init+0x0/0xf
initcall joydev_init+0x0/0xf returned 0 after 0 msecs
calling  evdev_init+0x0/0xf
initcall evdev_init+0x0/0xf returned 0 after 0 msecs
calling  atkbd_init+0x0/0x20
initcall atkbd_init+0x0/0x20 returned 0 after 0 msecs
calling  lkkbd_init+0x0/0x16
input: AT Translated Set 2 keyboard as /class/input/input0
initcall lkkbd_init+0x0/0x16 returned 0 after 11 msecs
calling  skbd_init+0x0/0x16
initcall skbd_init+0x0/0x16 returned 0 after 0 msecs
calling  inport_init+0x0/0x122
inport.c: Didn't find InPort mouse at 0x23c
initcall inport_init+0x0/0x122 returned -19 after 0 msecs
calling  gpio_mouse_init+0x0/0x14
initcall gpio_mouse_init+0x0/0x14 returned -19 after 0 msecs
calling  cobra_init+0x0/0x13
initcall cobra_init+0x0/0x13 returned 0 after 0 msecs
calling  gf2k_init+0x0/0x13
initcall gf2k_init+0x0/0x13 returned 0 after 0 msecs
calling  grip_init+0x0/0x13
initcall grip_init+0x0/0x13 returned 0 after 0 msecs
calling  iforce_init+0x0/0x7
initcall iforce_init+0x0/0x7 returned 0 after 0 msecs
calling  stinger_init+0x0/0x16
initcall stinger_init+0x0/0x16 returned 0 after 0 msecs
calling  warrior_init+0x0/0x16
initcall warrior_init+0x0/0x16 returned 0 after 0 msecs
calling  zhenhua_init+0x0/0x16
initcall zhenhua_init+0x0/0x16 returned 0 after 0 msecs
calling  aiptek_init+0x0/0x38
usbcore: registered new interface driver aiptek
aiptek: v2.3 (May 2, 2007): Bryan W. Headley/Chris Atenasio/Cedric Brun/Rene van Paassen
aiptek: Aiptek HyperPen USB Tablet Driver (Linux 2.6.x)
initcall aiptek_init+0x0/0x38 returned 0 after 0 msecs
calling  kbtab_init+0x0/0x2d
usbcore: registered new interface driver kbtab
kbtab: v0.0.2:USB KB Gear JamStudio Tablet driver
initcall kbtab_init+0x0/0x2d returned 0 after 0 msecs
calling  wacom_init+0x0/0x37
usbcore: registered new interface driver wacom
wacom: v1.48:USB Wacom Graphire and Wacom Intuos tablet driver
initcall wacom_init+0x0/0x37 returned 0 after 0 msecs
calling  ati_remote_init+0x0/0x3c
usbcore: registered new interface driver ati_remote
ati_remote: Registered USB driver ATI/X10 RF USB Remote Control v. 2.2.1
initcall ati_remote_init+0x0/0x3c returned 0 after 0 msecs
calling  ati_remote2_init+0x0/0x3c
usbcore: registered new interface driver ati_remote2
ati_remote2: ATI/Philips USB RF remote driver 0.2
initcall ati_remote2_init+0x0/0x3c returned 0 after 0 msecs
calling  powermate_init+0x0/0x16
usbcore: registered new interface driver powermate
initcall powermate_init+0x0/0x16 returned 0 after 0 msecs
calling  uinput_init+0x0/0xf
initcall uinput_init+0x0/0xf returned 0 after 0 msecs
calling  i2c_amd8111_init+0x0/0x16
initcall i2c_amd8111_init+0x0/0x16 returned 0 after 0 msecs
calling  i2c_sis96x_init+0x0/0x16
initcall i2c_sis96x_init+0x0/0x16 returned 0 after 0 msecs
calling  i2c_vt586b_init+0x0/0x16
initcall i2c_vt586b_init+0x0/0x16 returned 0 after 0 msecs
calling  i2c_vt596_init+0x0/0x16
initcall i2c_vt596_init+0x0/0x16 returned 0 after 0 msecs
calling  i2c_gpio_init+0x0/0x2d
i2c-gpio: probe failed: -19
initcall i2c_gpio_init+0x0/0x2d returned -19 after 0 msecs
calling  i2c_parport_init+0x0/0x144
i2c-parport-light: adapter type unspecified
initcall i2c_parport_init+0x0/0x144 returned -19 after 0 msecs
calling  i2c_voodoo3_init+0x0/0x16
initcall i2c_voodoo3_init+0x0/0x16 returned 0 after 0 msecs
calling  scx200_acb_init+0x0/0x204
scx200_acb: NatSemi SCx200 ACCESS.bus Driver
initcall scx200_acb_init+0x0/0x204 returned -19 after 0 msecs
calling  ds1682_init+0x0/0x11
i2c-core: driver [ds1682] registered
initcall ds1682_init+0x0/0x11 returned 0 after 0 msecs
calling  eeprom_init+0x0/0x11
i2c-core: driver [eeprom] registered
initcall eeprom_init+0x0/0x11 returned 0 after 0 msecs
calling  max6875_init+0x0/0x11
i2c-core: driver [max6875] registered
initcall max6875_init+0x0/0x11 returned 0 after 0 msecs
calling  pcf8591_init+0x0/0x32
i2c-core: driver [pcf8591] registered
initcall pcf8591_init+0x0/0x32 returned 0 after 0 msecs
calling  w1_init+0x0/0xe4
Driver for 1-wire Dallas network protocol.
initcall w1_init+0x0/0xe4 returned 0 after 0 msecs
calling  w1_gpio_init+0x0/0x14
initcall w1_gpio_init+0x0/0x14 returned -19 after 0 msecs
calling  w1_smem_init+0x0/0x33
initcall w1_smem_init+0x0/0x33 returned 0 after 0 msecs
calling  w1_ds2760_init+0x0/0x23
1-Wire driver for the DS2760 battery monitor  chip  - (c) 2004-2005, Szabolcs Gyurko
initcall w1_ds2760_init+0x0/0x23 returned 0 after 0 msecs
calling  ds2760_battery_init+0x0/0xf
initcall ds2760_battery_init+0x0/0xf returned 0 after 0 msecs
calling  bpa10x_init+0x0/0x25
Bluetooth: Digianswer Bluetooth USB driver ver 0.9
usbcore: registered new interface driver bpa10x
initcall bpa10x_init+0x0/0x25 returned 0 after 0 msecs
calling  btsdio_init+0x0/0x1e
Bluetooth: Generic Bluetooth SDIO driver ver 0.1
initcall btsdio_init+0x0/0x1e returned 0 after 0 msecs
calling  pci_eisa_init_module+0x0/0x16
initcall pci_eisa_init_module+0x0/0x16 returned 0 after 0 msecs
calling  cpufreq_stats_init+0x0/0x80
initcall cpufreq_stats_init+0x0/0x80 returned 0 after 0 msecs
calling  mmc_test_init+0x0/0xf
initcall mmc_test_init+0x0/0xf returned 0 after 0 msecs
calling  tifm_sd_init+0x0/0xf
initcall tifm_sd_init+0x0/0xf returned 0 after 0 msecs
calling  gpio_led_init+0x0/0xf
Registered led device: rdc:dmz
initcall gpio_led_init+0x0/0xf returned 0 after 0 msecs
calling  ioat_init_module+0x0/0x16
initcall ioat_init_module+0x0/0x16 returned 0 after 0 msecs
calling  dca_init+0x0/0xa
initcall dca_init+0x0/0xa returned 0 after 0 msecs
calling  virtio_pci_init+0x0/0x3a
initcall virtio_pci_init+0x0/0x3a returned 0 after 0 msecs
calling  oprofile_init+0x0/0x47
oprofile: using NMI interrupt.
initcall oprofile_init+0x0/0x47 returned 0 after 0 msecs
calling  sysctl_core_init+0x0/0x1e
initcall sysctl_core_init+0x0/0x1e returned 0 after 0 msecs
calling  flow_cache_init+0x0/0x139
initcall flow_cache_init+0x0/0x139 returned 0 after 0 msecs
calling  llc_init+0x0/0x1b
initcall llc_init+0x0/0x1b returned 0 after 0 msecs
calling  snap_init+0x0/0x2a
initcall snap_init+0x0/0x2a returned 0 after 0 msecs
calling  xt_init+0x0/0x7e
initcall xt_init+0x0/0x7e returned 0 after 0 msecs
calling  tcpudp_mt_init+0x0/0x14
initcall tcpudp_mt_init+0x0/0x14 returned 0 after 0 msecs
calling  classify_tg_init+0x0/0x14
initcall classify_tg_init+0x0/0x14 returned 0 after 0 msecs
calling  dccp_mt_init+0x0/0x45
initcall dccp_mt_init+0x0/0x45 returned 0 after 0 msecs
calling  dscp_mt_init+0x0/0x14
initcall dscp_mt_init+0x0/0x14 returned 0 after 0 msecs
calling  iprange_mt_init+0x0/0x14
initcall iprange_mt_init+0x0/0x14 returned 0 after 0 msecs
calling  pkttype_mt_init+0x0/0x14
initcall pkttype_mt_init+0x0/0x14 returned 0 after 0 msecs
calling  sctp_mt_init+0x0/0x14
initcall sctp_mt_init+0x0/0x14 returned 0 after 0 msecs
calling  string_mt_init+0x0/0x14
initcall string_mt_init+0x0/0x14 returned 0 after 0 msecs
calling  tcpmss_mt_init+0x0/0x14
initcall tcpmss_mt_init+0x0/0x14 returned 0 after 0 msecs
calling  sysctl_ipv4_init+0x0/0x3f
initcall sysctl_ipv4_init+0x0/0x3f returned 0 after 1 msecs
calling  xfrm4_mode_tunnel_init+0x0/0x14
initcall xfrm4_mode_tunnel_init+0x0/0x14 returned 0 after 0 msecs
calling  ipv4_netfilter_init+0x0/0xf
initcall ipv4_netfilter_init+0x0/0xf returned 0 after 0 msecs
calling  arp_tables_init+0x0/0x78
arp_tables: (C) 2002 David S. Miller
initcall arp_tables_init+0x0/0x78 returned 0 after 0 msecs
calling  arpt_mangle_init+0x0/0xf
initcall arpt_mangle_init+0x0/0xf returned 0 after 0 msecs
calling  cubictcp_register+0x0/0x93
TCP cubic registered
initcall cubictcp_register+0x0/0x93 returned 0 after 0 msecs
calling  inet6_init+0x0/0x2e4
NET: Registered protocol family 10
initcall inet6_init+0x0/0x2e4 returned 0 after 11 msecs
calling  ah6_init+0x0/0x5a
initcall ah6_init+0x0/0x5a returned 0 after 0 msecs
calling  esp6_init+0x0/0x5a
initcall esp6_init+0x0/0x5a returned 0 after 0 msecs
calling  ipcomp6_init+0x0/0x5a
initcall ipcomp6_init+0x0/0x5a returned 0 after 0 msecs
calling  xfrm6_tunnel_init+0x0/0xdb
initcall xfrm6_tunnel_init+0x0/0xdb returned 0 after 0 msecs
calling  tunnel6_init+0x0/0x5a
initcall tunnel6_init+0x0/0x5a returned 0 after 0 msecs
calling  xfrm6_mode_tunnel_init+0x0/0x14
initcall xfrm6_mode_tunnel_init+0x0/0x14 returned 0 after 0 msecs
calling  mip6_init+0x0/0xa7
Mobile IPv6
initcall mip6_init+0x0/0xa7 returned 0 after 0 msecs
calling  packet_init+0x0/0x39
NET: Registered protocol family 17
initcall packet_init+0x0/0x39 returned 0 after 0 msecs
calling  ipsec_pfkey_init+0x0/0x7a
NET: Registered protocol family 15
initcall ipsec_pfkey_init+0x0/0x7a returned 0 after 0 msecs
calling  br_init+0x0/0xa1
Bridge firewalling registered
initcall br_init+0x0/0xa1 returned 0 after 0 msecs
calling  lapb_init+0x0/0x7
initcall lapb_init+0x0/0x7 returned 0 after 0 msecs
calling  can_init+0x0/0xd1
can: controller area network core (rev 20071116 abi 8)
NET: Registered protocol family 29
initcall can_init+0x0/0xd1 returned 0 after 0 msecs
calling  sco_init+0x0/0xc2
Bluetooth: SCO (Voice Link) ver 0.6
Bluetooth: SCO socket layer initialized
initcall sco_init+0x0/0xc2 returned 0 after 0 msecs
calling  init_sunrpc+0x0/0x53
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
initcall init_sunrpc+0x0/0x53 returned 0 after 1 msecs
calling  init_rpcsec_gss+0x0/0x2e
initcall init_rpcsec_gss+0x0/0x2e returned 0 after 0 msecs
calling  init_kerberos_module+0x0/0x26
initcall init_kerberos_module+0x0/0x26 returned 0 after 0 msecs
calling  lane_module_init+0x0/0x4f
lec.c: Jul 21 2008 11:15:34 initialized
initcall lane_module_init+0x0/0x4f returned 0 after 0 msecs
calling  econet_proto_init+0x0/0x186
NET: Registered protocol family 19
initcall econet_proto_init+0x0/0x186 returned 0 after 0 msecs
calling  sctp_init+0x0/0x697
SCTP: Hash tables configured (established 26214 bind 29127)
sctp_init_sock(sk: f720c000)
initcall sctp_init+0x0/0x697 returned 0 after 9 msecs
calling  powernowk8_init+0x0/0x6e
initcall powernowk8_init+0x0/0x6e returned -19 after 0 msecs
calling  hpet_insert_resource+0x0/0x1e
initcall hpet_insert_resource+0x0/0x1e returned 0 after 0 msecs
calling  lapic_insert_resource+0x0/0x44
initcall lapic_insert_resource+0x0/0x44 returned 0 after 0 msecs
calling  init_lapic_nmi_sysfs+0x0/0x33
initcall init_lapic_nmi_sysfs+0x0/0x33 returned 0 after 0 msecs
=============================================================================
BUG skbuff_head_cache: Poison overwritten
-----------------------------------------------------------------------------

INFO: 0xf7ccc100-0xf7ccc103. First byte 0x0 instead of 0x6b
INFO: Allocated in __alloc_skb+0x30/0x10e age=1 cpu=1 pid=1
INFO: Freed in __kfree_skb+0x63/0x66 age=1 cpu=0 pid=0
INFO: Slab 0xc1c34ca0 objects=16 used=1 fp=0xf7ccc100 flags=0x400000c3
INFO: Object 0xf7ccc100 @offset=256 fp=0xf7ccc200

Bytes b4 0xf7ccc0f0:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
  Object 0xf7ccc100:  00 00 00 00 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b ....kkkkkkkkkkkk
  Object 0xf7ccc110:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc120:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc130:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc140:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc150:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc160:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc170:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc180:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc190:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xf7ccc1a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b a5 kkkkkkkkkkkkkkk�
 Redzone 0xf7ccc1b0:  bb bb bb bb                                     ����            
 Padding 0xf7ccc1d8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
 Padding 0xf7ccc1e8:  5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a ZZZZZZZZZZZZZZZZ
 Padding 0xf7ccc1f8:  5a 5a 5a 5a 5a 5a 5a 5a                         ZZZZZZZZ        
Pid: 1, comm: swapper Not tainted 2.6.26-tip #3261
 [<c01673ad>] print_trailer+0xd1/0xd9
 [<c0167428>] check_bytes_and_report+0x73/0x8f
 [<c0167664>] check_object+0xa5/0x15a
 [<c016824c>] __slab_alloc+0x2fb/0x3c8
 [<c0168364>] kmem_cache_alloc+0x4b/0xa8
 [<c0497376>] ? __alloc_skb+0x30/0x10e
 [<c0497376>] ? __alloc_skb+0x30/0x10e
 [<c0497376>] __alloc_skb+0x30/0x10e
 [<c04a6678>] alloc_skb+0xc/0xe
 [<c04a6ce5>] find_skb+0x28/0x66
 [<c04a6f5f>] netpoll_send_udp+0x2b/0x1cf
 [<c058800f>] ? _spin_lock_irqsave+0x4b/0x55
 [<c03db399>] write_msg+0x79/0xac
 [<c03db320>] ? write_msg+0x0/0xac
 [<c0122f96>] __call_console_drivers+0x56/0x63
 [<c0122ffa>] _call_console_drivers+0x57/0x5b
 [<c0123386>] release_console_sem+0x112/0x1a5
 [<c01238f3>] vprintk+0x344/0x35e

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Evgeniy Polyakov]

On Mon, Jul 21, 2008 at 12:50:51PM +0200, Ingo Molnar (mingo@elte.hu) wrote:
> > Ingo do you see other similar dumps with last byte modified? That's 
> > the one which can help to determine the reason.
> 
> the problem is, most of the crashes dont come with any usable dump. This 
> is a laptop so netconsole is the only reliable route out - and if 
> something in networking crashes chances are that it hoses netconsole 
> before it can get anything out.
> 
> Another thing is that i'm activating netconsole on this box via a kernel 
> boot line and from within a bzImage (to get it activated as early as 
> possible) - maybe that's a tad too early for certain initialization 
> sequences?
> 
> I could try run tests with netconsole deactivated, if you think that's a 
> worthwile line of probing this problem. (although that would make me do 
> blind tests in essence - having kernel log output is really essential.)

Let's try this way first. If system will continue to crash, we will add
some debug options in various pathes. Existing reports do not contain
enough information unfortunately, so we will not lose too much.

-- 
	Evgeniy Polyakov

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Fri, Jul 18, 2008 at 1:56 AM, Ingo Molnar <mingo@elte.hu> wrote:
>
> * Vegard Nossum <vegard.nossum@gmail.com> wrote:
>
>> On Thu, Jul 17, 2008 at 11:42 PM, Ingo Molnar <mingo@elte.hu> wrote:
>> > With this config:
>> >
>> >   http://redhat.com/~mingo/misc/config-Thu_Jul_17_20_24_45_CEST_2008.bad
>> >
>>
>> It doesn't actually work. The config says
>>
>>     # head: 088fcf34
>>
>> and I checked out this from the tip tree. But kernel-config still
>> complains about unknown config options... What went wrong?
>
> that's ok - i've got some local qa helpers that have config options.
>
> Things like making SMP bootups more likely in randconfig, adding various
> boot parameters to the bootup via .config methods (so that boot
> parameters can be randomized via make randconfig), etc.

Hm, your config doesn't contain SLUB_DEBUG either. Isn't that a
requirement for seeing the BUG you're getting?

$ grep SLUB config-Thu_Jul_17_20_24_45_CEST_2008.bad
# CONFIG_SLUB_DEBUG is not set
CONFIG_SLUB=y

Did you post the wrong config?


Vegard

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:

> > I could try run tests with netconsole deactivated, if you think 
> > that's a worthwile line of probing this problem. (although that 
> > would make me do blind tests in essence - having kernel log output 
> > is really essential.)
> 
> Let's try this way first. If system will continue to crash, we will 
> add some debug options in various pathes. Existing reports do not 
> contain enough information unfortunately, so we will not lose too 
> much.

ok. I've turned off netconsole - 8 successful bootups in a row so far. 
The box is a slow booter/builder with an 8 kernels/hour test throughput, 
so if everything goes fine we should have meaningful results in about 10 
hours.

( there are other, faster testboxes in -tip testing with 33 kernels/hour 
  build+boot throughput where we'd have to wait only 2 hours - but as 
  per Murphy's law they dont trigger this bug ;-)

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Evgeniy Polyakov]

On Mon, Jul 21, 2008 at 01:55:55PM +0200, Ingo Molnar (mingo@elte.hu) wrote:
> > > I could try run tests with netconsole deactivated, if you think 
> > > that's a worthwile line of probing this problem. (although that 
> > > would make me do blind tests in essence - having kernel log output 
> > > is really essential.)
> > 
> > Let's try this way first. If system will continue to crash, we will 
> > add some debug options in various pathes. Existing reports do not 
> > contain enough information unfortunately, so we will not lose too 
> > much.
> 
> ok. I've turned off netconsole - 8 successful bootups in a row so far. 
> The box is a slow booter/builder with an 8 kernels/hour test throughput, 
> so if everything goes fine we should have meaningful results in about 10 
> hours.
> 
> ( there are other, faster testboxes in -tip testing with 33 kernels/hour 
>   build+boot throughput where we'd have to wait only 2 hours - but as 
>   per Murphy's law they dont trigger this bug ;-)

Since 2.6.25 there was only single change in netpoll.c:
f5184d267c1aedb9b7a8cc44e08ff6b8d382c3b5
Which looks innocent.

Is your driver e1000 or e1000e? Can you check different one?

-- 
	Evgeniy Polyakov

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:

> On Mon, Jul 21, 2008 at 01:55:55PM +0200, Ingo Molnar (mingo@elte.hu) wrote:
> > > > I could try run tests with netconsole deactivated, if you think 
> > > > that's a worthwile line of probing this problem. (although that 
> > > > would make me do blind tests in essence - having kernel log output 
> > > > is really essential.)
> > > 
> > > Let's try this way first. If system will continue to crash, we will 
> > > add some debug options in various pathes. Existing reports do not 
> > > contain enough information unfortunately, so we will not lose too 
> > > much.
> > 
> > ok. I've turned off netconsole - 8 successful bootups in a row so far. 
> > The box is a slow booter/builder with an 8 kernels/hour test throughput, 
> > so if everything goes fine we should have meaningful results in about 10 
> > hours.
> > 
> > ( there are other, faster testboxes in -tip testing with 33 kernels/hour 
> >   build+boot throughput where we'd have to wait only 2 hours - but as 
> >   per Murphy's law they dont trigger this bug ;-)
> 
> Since 2.6.25 there was only single change in netpoll.c:
> f5184d267c1aedb9b7a8cc44e08ff6b8d382c3b5
> Which looks innocent.
> 
> Is your driver e1000 or e1000e? Can you check different one?

i cannot check e1000 anymore due to this upstream commit:

| d03157babed7424f5391af43200593768ce69c9a is first bad commit
| commit d03157babed7424f5391af43200593768ce69c9a
| Author: Auke Kok <auke-jan.h.kok@intel.com>
| Date:   Sun Jun 22 15:21:29 2008 -0700
|
|    e1000: remove PCI Express device IDs
|
|    We do not want to prolong the situation much longer that e1000
|    and e1000e support these devices at the same time. As a result,
|    take out the bandage that was added for the interim period
|    and remove all the PCI Express device IDs from e1000.

but yes, this box was using e1000 for a long time, and recently migrated 
to e1000e. I'm not sure there's any connection, do you think there is?

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Christoph Lameter]

Vegard Nossum wrote:
> On Mon, Jul 21, 2008 at 12:50 PM, Ingo Molnar <mingo@elte.hu> wrote:
>   
>> the problem is, most of the crashes dont come with any usable dump. This
>> is a laptop so netconsole is the only reliable route out - and if
>> something in networking crashes chances are that it hoses netconsole
>> before it can get anything out.
>>
>> Another thing is that i'm activating netconsole on this box via a kernel
>> boot line and from within a bzImage (to get it activated as early as
>> possible) - maybe that's a tad too early for certain initialization
>> sequences?
>>
>> I could try run tests with netconsole deactivated, if you think that's a
>> worthwile line of probing this problem. (although that would make me do
>> blind tests in essence - having kernel log output is really essential.)
>>     
>
> How about posting your custom patches for public review? :-D
>
> (There was recently an odd case of kzalloc() succeeding even though it
> was called before the slab caches were initialized -- and it only
> generated a warning about irqs-on happening too early. I just mean to
> say that it _can_ happen. On another machine, it crashed
> spectacularly. I guess you're not enabling the netconsole before slab
> allocator is up?)
>
>
> Vegard
>
>   
Kzalloc for objects > 4k will succeed even during early boot since we 
will directly call into the page allocator.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Christoph Lameter]

Evgeniy Polyakov wrote:
> Not that obvious...
> skb->next is cleared in lots of places, in xmit network helper
> for example, but since rest of the packet was not modified, it
> means given skb was not freed, so it will not help.
>
>   

The skb was definitely freed. 6b is written over an object when it is 
freed. Something else retained a pointer to the skb and was confident 
that the skb still exists.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Ingo Molnar <mingo@elte.hu> wrote:

> * Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:
> 
> > > I could try run tests with netconsole deactivated, if you think 
> > > that's a worthwile line of probing this problem. (although that 
> > > would make me do blind tests in essence - having kernel log output 
> > > is really essential.)
> > 
> > Let's try this way first. If system will continue to crash, we will 
> > add some debug options in various pathes. Existing reports do not 
> > contain enough information unfortunately, so we will not lose too 
> > much.
> 
> ok. I've turned off netconsole - 8 successful bootups in a row so far. 
> The box is a slow booter/builder with an 8 kernels/hour test 
> throughput, so if everything goes fine we should have meaningful 
> results in about 10 hours.
> 
> ( there are other, faster testboxes in -tip testing with 33 kernels/hour 
>   build+boot throughput where we'd have to wait only 2 hours - but as 
>   per Murphy's law they dont trigger this bug ;-)

70 bootups with netconsole turned off, and not a single crash so far.

So it's now a strong likelyhood that this crash is a combination of 
e1000e+netconsole.

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Evgeniy Polyakov]

Hi Christoph.

On Mon, Jul 21, 2008 at 11:22:27AM -0500, Christoph Lameter (cl@linux-foundation.org) wrote:
> >Not that obvious...
> >skb->next is cleared in lots of places, in xmit network helper
> >for example, but since rest of the packet was not modified, it
> >means given skb was not freed, so it will not help.
> 
> The skb was definitely freed. 6b is written over an object when it is 
> freed. Something else retained a pointer to the skb and was confident 
> that the skb still exists.

I meant it was not tried to be freed second time, since skb->users area
(the very end of the skb) was not changed from 6b to 6a, but its
skb->next pointer (first field in the skb) was set to NULL, so after
that skb was not used at all.

It could be an interesting kmemcheck extension to catch not only
non-initialized memory, but also writes into just freed one, but not yet
returned by allocator to the next user.

-- 
	Evgeniy Polyakov

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:

> It could be an interesting kmemcheck extension to catch not only 
> non-initialized memory, but also writes into just freed one, but not 
> yet returned by allocator to the next user.

hm, i think kmemcheck does that mostly already. If not then I think 
kmemcheck should just turn off all buffering that might happen on the 
SLUB level (if it doesnt do it already). I.e. a kfree()d buffer should 
be marked as uninitialized immediately.

	Ingo

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Mon, Jul 21, 2008 at 10:05 PM, Ingo Molnar <mingo@elte.hu> wrote:
>
> * Evgeniy Polyakov <johnpol@2ka.mipt.ru> wrote:
>
>> It could be an interesting kmemcheck extension to catch not only
>> non-initialized memory, but also writes into just freed one, but not
>> yet returned by allocator to the next user.
>
> hm, i think kmemcheck does that mostly already. If not then I think
> kmemcheck should just turn off all buffering that might happen on the
> SLUB level (if it doesnt do it already). I.e. a kfree()d buffer should
> be marked as uninitialized immediately.

We don't catch writes (yet, because kmemcheck gets confused by SLUB's
own writes so far), but yes, we mark objects "freed" when they are
freed (until the slab page is returned to the page allocator) and we
may detect reads from this area before the object is reallocated. In
that case, a "read from freed memory" message will appear.

Unfortunately, it doesn't work quite as well as I'd like it to yet. We
did catch one real bug in ACPI in this way (read-after-free). But as I
have discovered, not all machines support single-stepping over REP
STOS instructions properly. Which means that kmemcheck breaks silently
on some machines. There's also the recent DMA patch, which might
improve things. Linus is right, it's really fragile. But we are
working on it. It is going in the right direction anyway.

(Pekka and I were also working on an extension to SLUB which delays
the freeing of objects, i.e. so that objects will remain in the
"freed" state for a certain amount of time before it can be allocated
again. But we don't really have a _good_ patch for this yet, it was
more like an ugly hack at the time.)


Vegard

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Vegard Nossum]

On Mon, Jul 21, 2008 at 6:19 PM, Christoph Lameter
<cl@linux-foundation.org> wrote:
>> (There was recently an odd case of kzalloc() succeeding even though it
>> was called before the slab caches were initialized -- and it only
>> generated a warning about irqs-on happening too early. I just mean to
>> say that it _can_ happen. On another machine, it crashed
>> spectacularly. I guess you're not enabling the netconsole before slab
>> allocator is up?)
>
> Kzalloc for objects > 4k will succeed even during early boot since we will
> directly call into the page allocator.

It wasn't just that; it got into __slab_alloc() and out again. See the
backtrace at http://lkml.org/lkml/2008/7/19/23

It's scary, I know. It's a good thing we have irqtrace :-)


Vegard

-- 
"The animistic metaphor of the bug that maliciously sneaked in while
the programmer was not looking is intellectually dishonest as it
disguises that the error is the programmer's own creation."
	-- E. W. Dijkstra, EWD1036

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Evgeniy Polyakov]

On Mon, Jul 21, 2008 at 09:21:38PM +0200, Ingo Molnar (mingo@elte.hu) wrote:
> So it's now a strong likelyhood that this crash is a combination of 
> e1000e+netconsole.

e1000_clean_tx_irq() call looks particulary suspicious: it is called
without adapter->tx_queue_lock in poll controller (netconsole callback)
and with that lock in NAPI handler.

Can you check kind of this patch:

diff --git a/drivers/net/e1000e/netdev.c b/drivers/net/e1000e/netdev.c
index 869544b..5f180d8 100644
--- a/drivers/net/e1000e/netdev.c
+++ b/drivers/net/e1000e/netdev.c
@@ -4067,7 +4067,9 @@ static void e1000_netpoll(struct net_device *netdev)
 	disable_irq(adapter->pdev->irq);
 	e1000_intr(adapter->pdev->irq, netdev);
 
+	spin_lock(&adapter->tx_queue_lock);
 	e1000_clean_tx_irq(adapter);
+	spin_unlock(&adapter->tx_queue_lock);
 
 	enable_irq(adapter->pdev->irq);
 }


-- 
	Evgeniy Polyakov

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[David Miller]

From: Evgeniy Polyakov <johnpol@2ka.mipt.ru>
Date: Tue, 22 Jul 2008 01:24:48 +0400

> On Mon, Jul 21, 2008 at 09:21:38PM +0200, Ingo Molnar (mingo@elte.hu) wrote:
> > So it's now a strong likelyhood that this crash is a combination of 
> > e1000e+netconsole.
> 
> e1000_clean_tx_irq() call looks particulary suspicious: it is called
> without adapter->tx_queue_lock in poll controller (netconsole callback)
> and with that lock in NAPI handler.
> 
> Can you check kind of this patch:

The call even seems pointless, since the caller will call
->poll() (which is e1000_clean) as the very next action,
and that will invoke e1000_clean_tx_irq() properly.

I would just delete this call from e1000_netpoll() entirely.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* David Miller <davem@davemloft.net> wrote:

> From: Evgeniy Polyakov <johnpol@2ka.mipt.ru>
> Date: Tue, 22 Jul 2008 01:24:48 +0400
> 
> > On Mon, Jul 21, 2008 at 09:21:38PM +0200, Ingo Molnar (mingo@elte.hu) wrote:
> > > So it's now a strong likelyhood that this crash is a combination of 
> > > e1000e+netconsole.
> > 
> > e1000_clean_tx_irq() call looks particulary suspicious: it is called
> > without adapter->tx_queue_lock in poll controller (netconsole callback)
> > and with that lock in NAPI handler.
> > 
> > Can you check kind of this patch:
> 
> The call even seems pointless, since the caller will call ->poll() 
> (which is e1000_clean) as the very next action, and that will invoke 
> e1000_clean_tx_irq() properly.
> 
> I would just delete this call from e1000_netpoll() entirely.

ok, i've added the patch below to tip/out-of-tree.

Overnight test had about 100 successful bootups on this testbox. (until 
it stopped on a drivers/net/hp.c build error - which is unrelated to 
this problem)

So testing with netconsole disabled is conclusive enough to implicate 
netconsole strongly. I've now re-enabled netconsole on the testbox and 
will continue the test with the fix below. Previously it would crash 
within 10-40 iterations.

	Ingo

----------------->
commit bf89280dea6d97671aa5f75f2591ae7e8e3e6699
Author: Ingo Molnar <mingo@elte.hu>
Date:   Tue Jul 22 09:44:32 2008 +0200

    e1000e: fix e1000_netpoll(), remove extraneous e1000_clean_tx_irq() call
    
    Evgeniy Polyakov noticed that drivers/net/e1000e/netdev.c:e1000_netpoll()
    was calling e1000_clean_tx_irq() without taking the TX lock.
    
    David Miller suggested to remove the call altogether: since in this
    callpah there's periodic calls to ->poll() anyway which will do
    e1000_clean_tx_irq() and will garbage-collect any finished TX ring
    descriptors.
    
    This might solve the e1000e+netconsole crashes i've been seeing:
    
    =============================================================================
    BUG skbuff_head_cache: Poison overwritten
    -----------------------------------------------------------------------------
    
    INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b
    INFO: Allocated in __alloc_skb+0x2c/0x110 age=0 cpu=0 pid=5098
    INFO: Freed in __kfree_skb+0x31/0x80 age=0 cpu=1 pid=4440
    INFO: Slab 0xc16cc140 objects=16 used=1 fp=0xf658ae00 flags=0x400000c3
    INFO: Object 0xf658ae00 @offset=3584 fp=0xf658af00
    
    Signed-off-by: Ingo Molnar <mingo@elte.hu>
---
 drivers/net/e1000e/netdev.c |    2 --
 1 files changed, 0 insertions(+), 2 deletions(-)

diff --git a/drivers/net/e1000e/netdev.c b/drivers/net/e1000e/netdev.c
index 869544b..9c0f56b 100644
--- a/drivers/net/e1000e/netdev.c
+++ b/drivers/net/e1000e/netdev.c
@@ -4067,8 +4067,6 @@ static void e1000_netpoll(struct net_device *netdev)
 	disable_irq(adapter->pdev->irq);
 	e1000_intr(adapter->pdev->irq, netdev);
 
-	e1000_clean_tx_irq(adapter);
-
 	enable_irq(adapter->pdev->irq);
 }
 #endif

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Ingo Molnar]

* Ingo Molnar <mingo@elte.hu> wrote:

> > > Can you check kind of this patch:
> > 
> > The call even seems pointless, since the caller will call ->poll() 
> > (which is e1000_clean) as the very next action, and that will invoke 
> > e1000_clean_tx_irq() properly.
> > 
> > I would just delete this call from e1000_netpoll() entirely.
> 
> ok, i've added the patch below to tip/out-of-tree.
> 
> Overnight test had about 100 successful bootups on this testbox. 
> (until it stopped on a drivers/net/hp.c build error - which is 
> unrelated to this problem)
> 
> So testing with netconsole disabled is conclusive enough to implicate 
> netconsole strongly. I've now re-enabled netconsole on the testbox and 
> will continue the test with the fix below. Previously it would crash 
> within 10-40 iterations.

it's now past 50 successful iterations with e1000e+netconsole enabled 
again with the fix applied, and not a single crash, hang, memory 
corruption or other weirdness happened. Jeff, please apply the fix 
below.

Thanks,

	Ingo

---------------->
commit 1fd48807674d4f6defe82258c46619ce2c116943
Author: Ingo Molnar <mingo@elte.hu>
Date:   Tue Jul 22 09:44:32 2008 +0200

    e1000e: fix e1000_netpoll(), remove extraneous e1000_clean_tx_irq() call
    
    Evgeniy Polyakov noticed that drivers/net/e1000e/netdev.c:e1000_netpoll()
    was calling e1000_clean_tx_irq() without taking the TX lock.
    
    David Miller suggested to remove the call altogether: since in this
    callpah there's periodic calls to ->poll() anyway which will do
    e1000_clean_tx_irq() and will garbage-collect any finished TX ring
    descriptors.
    
    This fix solved the e1000e+netconsole crashes i've been seeing:
    
    =============================================================================
    BUG skbuff_head_cache: Poison overwritten
    -----------------------------------------------------------------------------
    
    INFO: 0xf658ae9c-0xf658ae9c. First byte 0x6a instead of 0x6b
    INFO: Allocated in __alloc_skb+0x2c/0x110 age=0 cpu=0 pid=5098
    INFO: Freed in __kfree_skb+0x31/0x80 age=0 cpu=1 pid=4440
    INFO: Slab 0xc16cc140 objects=16 used=1 fp=0xf658ae00 flags=0x400000c3
    INFO: Object 0xf658ae00 @offset=3584 fp=0xf658af00
    
    Signed-off-by: Ingo Molnar <mingo@elte.hu>
---
 drivers/net/e1000e/netdev.c |    2 --
 1 files changed, 0 insertions(+), 2 deletions(-)

diff --git a/drivers/net/e1000e/netdev.c b/drivers/net/e1000e/netdev.c
index 869544b..9c0f56b 100644
--- a/drivers/net/e1000e/netdev.c
+++ b/drivers/net/e1000e/netdev.c
@@ -4067,8 +4067,6 @@ static void e1000_netpoll(struct net_device *netdev)
 	disable_irq(adapter->pdev->irq);
 	e1000_intr(adapter->pdev->irq, netdev);
 
-	e1000_clean_tx_irq(adapter);
-
 	enable_irq(adapter->pdev->irq);
 }
 #endif

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[David Miller]

From: Ingo Molnar <mingo@elte.hu>
Date: Tue, 22 Jul 2008 15:34:15 +0200

> it's now past 50 successful iterations with e1000e+netconsole enabled 
> again with the fix applied, and not a single crash, hang, memory 
> corruption or other weirdness happened. Jeff, please apply the fix 
> below.

I'll take care of integrating this, thanks Ingo.

Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten

[Jeff Kirsher]

On Wed, 2008-07-23 at 15:31 -0700, David Miller wrote:
> From: Ingo Molnar <mingo@elte.hu>
> Date: Tue, 22 Jul 2008 15:34:15 +0200
> 
> > it's now past 50 successful iterations with e1000e+netconsole enabled 
> > again with the fix applied, and not a single crash, hang, memory 
> > corruption or other weirdness happened. Jeff, please apply the fix 
> > below.
> 
> I'll take care of integrating this, thanks Ingo.
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/

Thanks Dave.  I have the patch in my queue of patches to push, just had
not pushed it to you and Jeff yet.

-- 
Cheers,
Jeff