linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* [Problem] kernel hangs at boot (bisected 892d208bcf)
@ 2012-01-18 19:32 Dirk Gouders
  2012-01-19 11:01 ` Catalin Marinas
  0 siblings, 1 reply; 15+ messages in thread
From: Dirk Gouders @ 2012-01-18 19:32 UTC (permalink / raw)
  To: catalin.marinas; +Cc: linux-kernel

Hi Catalin,

I am not sure if you are the correct person to contact, but
I noticed a regression in Linus' master branch and bisected this to
commit 892d208bcf
"Merge tag 'kmemleak' of git://git.kernel.org/pub/scm/linux/kernel/git/cmarinas/linux".

I have to note that while bisecting, there was a situation where the
machine also did not boot but with a different output, so I considered
it "good" until I found the commit the gave the output I still get.

I noticed that regression on a real machine but just tested it with a
virtual one and it has the same problem.

I attach the output of the vm and my .config.

Best regards,

Dirk

------------------------------------------------------------------------
Freeing unused kernel memory: 608k freed
kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
BUG: unable to handle kernel paging request at ffffffff818b232b
IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
PGD 17ed067 PUD 17f1063 PMD 3c6a9063 PTE 80000000018b2163
Oops: 0011 [#1] SMP 
CPU 1 
Modules linked in:

Pid: 1, comm: swapper/0 Not tainted 3.2.0-09104-gccb19d2 #4 Bochs Bochs
RIP: 0010:[<ffffffff818b232b>]  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
RSP: 0018:ffff88003fd03e58  EFLAGS: 00010282
RAX: 0000000000000001 RBX: ffff88003dbd2600 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff88003dbd2600 RDI: 0000000000000002
RBP: ffff88003e015488 R08: ffff88003fd0d5c0 R09: ffff88003fd122e0
R10: 0000000000000400 R11: ffffffff81572da5 R12: ffffea0000f6f480
R13: ffffffff810aa687 R14: 0000000000000000 R15: ffff88003e31dbc8
FS:  0000000000000000(0000) GS:ffff88003fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff818b232b CR3: 00000000017eb000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper/0 (pid: 1, threadinfo ffff88003e272000, task ffff88003e278000)
Stack:
 ffffffff810fed11 ffff88003dbd2680 ffff88003fd0d830 ffffffff81805980
 ffff88003d48dd00 ffff88003fd0d860 ffffffff810aa687 ffff88003e2ad420
 0000000a3e2ad820 ffff88003e272000 ffff88003e278000 ffff88003fd03eb0
Call Trace:
 <IRQ> 
 [<ffffffff810fed11>] ? kmem_cache_free+0x4f/0xd9
 [<ffffffff810aa687>] ? __rcu_process_callbacks+0x1bf/0x2e2
 [<ffffffff810aa7f4>] ? rcu_process_callbacks+0x4a/0x95
[<ffffffff8105cc1a>] ? __do_softirq+0xb6/0x171
 [<ffffffff8155a58c>] ? call_softirq+0x1c/0x30
 [<ffffffff81032d85>] ? do_softirq+0x31/0x68
 [<ffffffff8105ce7f>] ? irq_exit+0x44/0x9e
 [<ffffffff81047fd9>] ? smp_apic_timer_interrupt+0x85/0x95
 [<ffffffff818d1000>] ? free_area_init_node+0x21f/0x2fb
 [<ffffffff81559c4b>] ? apic_timer_interrupt+0x6b/0x70
 <EOI> 
 [<ffffffff818d1000>] ? free_area_init_node+0x21f/0x2fb
 [<ffffffff818d14b0>] ? __next_free_mem_range_rev+0x57/0x11e
 [<ffffffff8104d31b>] ? free_init_pages+0xea/0x110
 [<ffffffff810001c0>] ? init_post+0xe/0xbb
 [<ffffffff81895b93>] ? kernel_init+0x10f/0x113
 [<ffffffff8155a494>] ? kernel_thread_helper+0x4/0x10
 [<ffffffff81895a84>] ? start_kernel+0x319/0x319
 [<ffffffff8155a490>] ? gs_change+0xb/0xb
Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 
RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
 RSP <ffff88003fd03e58>
CR2: ffffffff818b232b
---[ end trace 74bcd7e97bebc5e8 ]---
Kernel panic - not syncing: Fatal exception in interrupt
kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
BUG: unable to handle kernel paging request at ffffffff818b232b
IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
PGD 17ed067 PUD 17f1063 PMD 3c6a9063 PTE 80000000018b2163
Oops: 0011 [#2] SMP 
CPU 1 
Modules linked in:

Pid: 1, comm: swapper/0 Tainted: G      D      3.2.0-09104-gccb19d2 #4 Bochs Bochs
RIP: 0010:[<ffffffff818b232b>]  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
RSP: 0018:ffff88003fd03b10  EFLAGS: 00010046
RAX: 0000000000000001 RBX: 0000000000000000 RCX: 0000000000000001
RDX: 0000000000000040 RSI: ffff88003cceaab8 RDI: 0000000000000000
RBP: ffff88003e005680 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000007 R12: ffff88003cceaab8
R13: 00000000000080d0 R14: ffffffff81034013 R15: 0000000000000028
FS:  0000000000000000(0000) GS:ffff88003fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff818b232b CR3: 00000000017eb000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper/0 (pid: 1, threadinfo ffff88003e272000, task ffff88003e278000)
Stack:
 ffffffff810ffe4b 0000000000000046 0000000000000000 ffffffff81047433
 0000000000000001 0000000000000010 00000000ffffffea ffffffff81718181
 ffffffff81034013 0000000000000092 ffffffff81877898 0000000000000000
Call Trace:
 <IRQ> 
 [<ffffffff810ffe4b>] ? kmem_cache_alloc_trace+0xb6/0x108
 [<ffffffff81047433>] ? native_nmi_stop_other_cpus+0xab/0xab
 [<ffffffff81034013>] ? register_nmi_handler+0x49/0x148
 [<ffffffff810473df>] ? native_nmi_stop_other_cpus+0x57/0xab
 [<ffffffff815509c5>] ? panic+0xc2/0x1b1
 [<ffffffff81553d91>] ? oops_end+0x7f/0x8e
 [<ffffffff818b232b>] ? kmemleak_late_init+0x8a/0x8a
 [<ffffffff8104dec5>] ? no_context+0x251/0x260
 [<ffffffff818b232b>] ? kmemleak_late_init+0x8a/0x8a
 [<ffffffff810aa687>] ? __rcu_process_callbacks+0x1bf/0x2e2
 [<ffffffff81555c63>] ? do_page_fault+0x1bd/0x3ac
 [<ffffffff81032ff9>] ? dump_trace+0x23d/0x24c
 [<ffffffff810fe50c>] ? set_track+0x5e/0xd9
 [<ffffffff813671a9>] ? blk_done+0xc3/0x101
 [<ffffffff813671a9>] ? blk_done+0xc3/0x101
 [<ffffffff8103bbf9>] ? save_stack_trace+0x22/0x3d
 [<ffffffff810fe50c>] ? set_track+0x5e/0xd9
 [<ffffffff810aa687>] ? __rcu_process_callbacks+0x1bf/0x2e2
 [<ffffffff8155342f>] ? page_fault+0x1f/0x30
 [<ffffffff810aa687>] ? __rcu_process_callbacks+0x1bf/0x2e2
 [<ffffffff818b232b>] ? kmemleak_late_init+0x8a/0x8a
 [<ffffffff810fed11>] ? kmem_cache_free+0x4f/0xd9
 [<ffffffff810aa687>] ? __rcu_process_callbacks+0x1bf/0x2e2
 [<ffffffff810aa7f4>] ? rcu_process_callbacks+0x4a/0x95
 [<ffffffff8105cc1a>] ? __do_softirq+0xb6/0x171
 [<ffffffff8155a58c>] ? call_softirq+0x1c/0x30
 [<ffffffff81032d85>] ? do_softirq+0x31/0x68
 [<ffffffff8105ce7f>] ? irq_exit+0x44/0x9e
 [<ffffffff81047fd9>] ? smp_apic_timer_interrupt+0x85/0x95
 [<ffffffff818d1000>] ? free_area_init_node+0x21f/0x2fb
 [<ffffffff81559c4b>] ? apic_timer_interrupt+0x6b/0x70
 <EOI> 
 [<ffffffff818d1000>] ? free_area_init_node+0x21f/0x2fb
 [<ffffffff818d14b0>] ? __next_free_mem_range_rev+0x57/0x11e
 [<ffffffff8104d31b>] ? free_init_pages+0xea/0x110
 [<ffffffff810001c0>] ? init_post+0xe/0xbb
 [<ffffffff81895b93>] ? kernel_init+0x10f/0x113
 [<ffffffff8155a494>] ? kernel_thread_helper+0x4/0x10
 [<ffffffff81895a84>] ? start_kernel+0x319/0x319
 [<ffffffff8155a490>] ? gs_change+0xb/0xb
Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 
RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
 RSP <ffff88003fd03b10>
CR2: ffffffff818b232b
---[ end trace 74bcd7e97bebc5e9 ]---
INFO: rcu_sched detected stalls on CPUs/tasks: { 1} (detected by 0, t=15864 jiffies)
Pid: 0, comm: swapper/0 Tainted: G      D      3.2.0-09104-gccb19d2 #4
Call Trace:
 <IRQ>  [<ffffffff810aa0ce>] ? __rcu_pending+0x21a/0x336
 [<ffffffff8108fa3a>] ? tick_nohz_handler+0xcb/0xcb
 [<ffffffff810aade1>] ? rcu_check_callbacks+0x89/0xe8
 [<ffffffff81063aa0>] ? update_process_times+0x31/0x63
 [<ffffffff8108fa9f>] ? tick_sched_timer+0x65/0x8b
 [<ffffffff81073ae9>] ? __run_hrtimer+0xce/0x159
 [<ffffffff810aa810>] ? rcu_process_callbacks+0x66/0x95
 [<ffffffff81074384>] ? hrtimer_interrupt+0xd6/0x19a
 [<ffffffff8108f94b>] ? tick_do_update_jiffies64+0x7c/0xa0
 [<ffffffff81047fd4>] ? smp_apic_timer_interrupt+0x80/0x95
 [<ffffffff81559c4b>] ? apic_timer_interrupt+0x6b/0x70
 <EOI>  [<ffffffff81037c29>] ? default_idle+0x95/0x112
 [<ffffffff8103053f>] ? cpu_idle+0x61/0x7f
 [<ffffffff81895a79>] ? start_kernel+0x30e/0x319
INFO: rcu_sched detected stalls on CPUs/tasks: { 1} (detected by 0, t=62355 jiffies)
Pid: 0, comm: swapper/0 Tainted: G      D      3.2.0-09104-gccb19d2 #4
Call Trace:
 <IRQ>  [<ffffffff810aa0ce>] ? __rcu_pending+0x21a/0x336
 [<ffffffff8108fa3a>] ? tick_nohz_handler+0xcb/0xcb
 [<ffffffff810aade1>] ? rcu_check_callbacks+0x89/0xe8
 [<ffffffff81063aa0>] ? update_process_times+0x31/0x63
 [<ffffffff8108fa9f>] ? tick_sched_timer+0x65/0x8b
 [<ffffffff81073ae9>] ? __run_hrtimer+0xce/0x159
 [<ffffffff81074384>] ? hrtimer_interrupt+0xd6/0x19a
 [<ffffffff8108f94b>] ? tick_do_update_jiffies64+0x7c/0xa0
 [<ffffffff81047fd4>] ? smp_apic_timer_interrupt+0x80/0x95
 [<ffffffff81559c4b>] ? apic_timer_interrupt+0x6b/0x70
 <EOI>  [<ffffffff81037c29>] ? default_idle+0x95/0x112
 [<ffffffff8103053f>] ? cpu_idle+0x61/0x7f
 [<ffffffff81895a79>] ? start_kernel+0x30e/0x319
kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
BUG: unable to handle kernel paging request at ffffffff818b232b
IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
PGD 17ed067 PUD 17f1063 PMD 3c6a9063 PTE 80000000018b2163
Oops: 0011 [#3] SMP 
CPU 0 
Modules linked in:

Pid: 656, comm: kworker/u:2 Tainted: G      D      3.2.0-09104-gccb19d2 #4 Bochs Bochs
RIP: 0010:[<ffffffff818b232b>]  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
RSP: 0018:ffff88003ccb3e08  EFLAGS: 00010082
RAX: 0000000000000001 RBX: ffff88003cf8df00 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff88003cf8df00 RDI: 0000000000000002
RBP: ffff88003e014db0 R08: dead000000200200 R09: ffff88003e3c4158
R10: 0000000000000000 R11: 00000000000122c0 R12: ffffea0000f3e200
R13: ffffffff81059549 R14: 0000000000000000 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff88003fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff818b232b CR3: 00000000017eb000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/u:2 (pid: 656, threadinfo ffff88003ccb2000, task ffff88003e31dd70)
Stack:
 ffffffff810fed11 0000000000000082 ffff88003e31dd70 ffff88003e3c4000
 ffff88003cf8df00 0000000000000001 ffffffff81059549 0000000000000086
 ffff88003e31dd70 ffff88003e31dd70 0000000000000001 ffff88003ccb3e90
Call Trace:
 [<ffffffff810fed11>] ? kmem_cache_free+0x4f/0xd9
 [<ffffffff81059549>] ? release_task+0x25a/0x2fd
 [<ffffffff8105a9b8>] ? do_exit+0x688/0x72e
 [<ffffffff8106d808>] ? manage_workers.clone.17+0x158/0x158
 [<ffffffff8106d808>] ? manage_workers.clone.17+0x158/0x158
 [<ffffffff81070c00>] ? kthread+0x89/0x89
 [<ffffffff8155a494>] ? kernel_thread_helper+0x4/0x10
 [<ffffffff81070b77>] ? kthread_freezable_should_stop+0x52/0x52
 [<ffffffff8155a490>] ? gs_change+0xb/0xb
Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 
RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
 RSP <ffff88003ccb3e08>
CR2: ffffffff818b232b
---[ end trace 74bcd7e97bebc5ea ]---
Fixing recursive fault but reboot is needed!
kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
BUG: unable to handle kernel paging request at ffffffff818b232b
IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
PGD 17ed067 PUD 17f1063 PMD 3c6a9063 PTE 80000000018b2163
Oops: 0011 [#4] SMP 
CPU 0 
Modules linked in:

Pid: 12, comm: kworker/u:1 Tainted: G      D      3.2.0-09104-gccb19d2 #4 Bochs Bochs
RIP: 0010:[<ffffffff818b232b>]  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
RSP: 0018:ffff88003e2d7e08  EFLAGS: 00010282
RAX: 0000000000000001 RBX: ffff88003cf9a1c8 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff88003cf9a1c8 RDI: 0000000000000002
RBP: ffffea0000f3e680 R08: dead000000100100 R09: 00000000000000fa
R10: 0000000000000000 R11: 0000000000000007 R12: ffff88003e004900
R13: ffffffff8106b7f2 R14: ffff88003e27ab20 R15: ffff88003e27ab20
FS:  0000000000000000(0000) GS:ffff88003fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff818b232b CR3: 00000000017eb000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/u:1 (pid: 12, threadinfo ffff88003e2d6000, task ffff88003e27ab20)
Stack:
 ffffffff810feedc ffff88003e27ab20 ffff88003cf9a1c8 ffffffff819957c0
 0000000000000002 ffff88003e2a23b0 ffffffff8106b7f2 0000000000000001
 ffffffff819957c0 ffff88003e27ab20 ffffffff8106d703 ffff88003e2a2390
Call Trace:
 [<ffffffff810feedc>] ? kfree+0xbc/0x11e
 [<ffffffff8106b7f2>] ? destroy_worker+0x65/0x80
 [<ffffffff8106d703>] ? manage_workers.clone.17+0x53/0x158
 [<ffffffff8106da11>] ? worker_thread+0x209/0x234
 [<ffffffff8106d808>] ? manage_workers.clone.17+0x158/0x158
 [<ffffffff8106d808>] ? manage_workers.clone.17+0x158/0x158
 [<ffffffff81070bf8>] ? kthread+0x81/0x89
 [<ffffffff8155a494>] ? kernel_thread_helper+0x4/0x10
 [<ffffffff81070b77>] ? kthread_freezable_should_stop+0x52/0x52
 [<ffffffff8155a490>] ? gs_change+0xb/0xb
Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 
RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
 RSP <ffff88003e2d7e08>
CR2: ffffffff818b232b
---[ end trace 74bcd7e97bebc5eb ]---

------------------------------------------------------------------------
#
# Automatically generated file; DO NOT EDIT.
# Linux/x86_64 3.2.0 Kernel Configuration
#
CONFIG_64BIT=y
# CONFIG_X86_32 is not set
CONFIG_X86_64=y
CONFIG_X86=y
CONFIG_INSTRUCTION_DECODER=y
CONFIG_OUTPUT_FORMAT="elf64-x86-64"
CONFIG_ARCH_DEFCONFIG="arch/x86/configs/x86_64_defconfig"
CONFIG_GENERIC_CMOS_UPDATE=y
CONFIG_CLOCKSOURCE_WATCHDOG=y
CONFIG_GENERIC_CLOCKEVENTS=y
CONFIG_ARCH_CLOCKSOURCE_DATA=y
CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_HAVE_LATENCYTOP_SUPPORT=y
CONFIG_MMU=y
CONFIG_ZONE_DMA=y
CONFIG_NEED_DMA_MAP_STATE=y
CONFIG_NEED_SG_DMA_LENGTH=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
# CONFIG_RWSEM_GENERIC_SPINLOCK is not set
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_ARCH_HAS_CPU_IDLE_WAIT=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_GENERIC_TIME_VSYSCALL=y
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_ARCH_HAS_DEFAULT_IDLE=y
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_ARCH_SUSPEND_POSSIBLE=y
CONFIG_ZONE_DMA32=y
CONFIG_AUDIT_ARCH=y
CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_X86_64_SMP=y
CONFIG_X86_HT=y
CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-rdi -fcall-saved-rsi -fcall-saved-rdx -fcall-saved-rcx -fcall-saved-r8 -fcall-saved-r9 -fcall-saved-r10 -fcall-saved-r11"
# CONFIG_KTIME_SCALAR is not set
CONFIG_ARCH_CPU_PROBE_RELEASE=y
CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
CONFIG_HAVE_IRQ_WORK=y
CONFIG_IRQ_WORK=y

#
# General setup
#
CONFIG_EXPERIMENTAL=y
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_CROSS_COMPILE=""
CONFIG_LOCALVERSION=""
CONFIG_LOCALVERSION_AUTO=y
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_HAVE_KERNEL_LZO=y
CONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_LZO is not set
CONFIG_DEFAULT_HOSTNAME="(none)"
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_SYSVIPC_SYSCTL=y
CONFIG_POSIX_MQUEUE=y
CONFIG_POSIX_MQUEUE_SYSCTL=y
# CONFIG_BSD_PROCESS_ACCT is not set
# CONFIG_FHANDLE is not set
CONFIG_TASKSTATS=y
CONFIG_TASK_DELAY_ACCT=y
# CONFIG_TASK_XACCT is not set
CONFIG_AUDIT=y
CONFIG_AUDITSYSCALL=y
CONFIG_AUDIT_WATCH=y
CONFIG_AUDIT_TREE=y
# CONFIG_AUDIT_LOGINUID_IMMUTABLE is not set
CONFIG_HAVE_GENERIC_HARDIRQS=y

#
# IRQ subsystem
#
CONFIG_GENERIC_HARDIRQS=y
CONFIG_HAVE_SPARSE_IRQ=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_GENERIC_IRQ_SHOW=y
CONFIG_GENERIC_PENDING_IRQ=y
CONFIG_IRQ_FORCED_THREADING=y
CONFIG_SPARSE_IRQ=y

#
# RCU Subsystem
#
CONFIG_TREE_RCU=y
# CONFIG_PREEMPT_RCU is not set
# CONFIG_RCU_TRACE is not set
CONFIG_RCU_FANOUT=64
# CONFIG_RCU_FANOUT_EXACT is not set
# CONFIG_RCU_FAST_NO_HZ is not set
# CONFIG_TREE_RCU_TRACE is not set
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_LOG_BUF_SHIFT=18
CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
# CONFIG_CGROUPS is not set
# CONFIG_CHECKPOINT_RESTORE is not set
CONFIG_NAMESPACES=y
# CONFIG_UTS_NS is not set
# CONFIG_IPC_NS is not set
# CONFIG_USER_NS is not set
# CONFIG_PID_NS is not set
# CONFIG_NET_NS is not set
# CONFIG_SCHED_AUTOGROUP is not set
# CONFIG_SYSFS_DEPRECATED is not set
CONFIG_RELAY=y
CONFIG_BLK_DEV_INITRD=y
CONFIG_INITRAMFS_SOURCE=""
CONFIG_RD_GZIP=y
CONFIG_RD_BZIP2=y
CONFIG_RD_LZMA=y
CONFIG_RD_XZ=y
CONFIG_RD_LZO=y
CONFIG_CC_OPTIMIZE_FOR_SIZE=y
CONFIG_SYSCTL=y
CONFIG_ANON_INODES=y
# CONFIG_EXPERT is not set
CONFIG_UID16=y
# CONFIG_SYSCTL_SYSCALL is not set
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
CONFIG_HOTPLUG=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_PCSPKR_PLATFORM=y
CONFIG_HAVE_PCSPKR_PLATFORM=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SIGNALFD=y
CONFIG_TIMERFD=y
CONFIG_EVENTFD=y
CONFIG_SHMEM=y
CONFIG_AIO=y
# CONFIG_EMBEDDED is not set
CONFIG_HAVE_PERF_EVENTS=y

#
# Kernel Performance Events And Counters
#
CONFIG_PERF_EVENTS=y
CONFIG_PERF_COUNTERS=y
# CONFIG_DEBUG_PERF_USE_VMALLOC is not set
CONFIG_VM_EVENT_COUNTERS=y
CONFIG_PCI_QUIRKS=y
CONFIG_SLUB_DEBUG=y
CONFIG_COMPAT_BRK=y
# CONFIG_SLAB is not set
CONFIG_SLUB=y
CONFIG_PROFILING=y
CONFIG_TRACEPOINTS=y
CONFIG_OPROFILE=y
# CONFIG_OPROFILE_EVENT_MULTIPLEX is not set
CONFIG_HAVE_OPROFILE=y
CONFIG_OPROFILE_NMI_TIMER=y
CONFIG_KPROBES=y
# CONFIG_JUMP_LABEL is not set
CONFIG_OPTPROBES=y
CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_KRETPROBES=y
CONFIG_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_HAVE_KPROBES=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_DMA_ATTRS=y
CONFIG_USE_GENERIC_SMP_HELPERS=y
CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
CONFIG_HAVE_DMA_API_DEBUG=y
CONFIG_HAVE_HW_BREAKPOINT=y
CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
CONFIG_HAVE_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_PERF_EVENTS_NMI=y
CONFIG_HAVE_ARCH_JUMP_LABEL=y
CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
CONFIG_HAVE_CMPXCHG_LOCAL=y
CONFIG_HAVE_CMPXCHG_DOUBLE=y

#
# GCOV-based kernel profiling
#
# CONFIG_GCOV_KERNEL is not set
# CONFIG_HAVE_GENERIC_DMA_COHERENT is not set
CONFIG_SLABINFO=y
CONFIG_RT_MUTEXES=y
CONFIG_BASE_SMALL=0
CONFIG_MODULES=y
# CONFIG_MODULE_FORCE_LOAD is not set
CONFIG_MODULE_UNLOAD=y
CONFIG_MODULE_FORCE_UNLOAD=y
# CONFIG_MODVERSIONS is not set
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_STOP_MACHINE=y
CONFIG_BLOCK=y
# CONFIG_BLK_DEV_BSG is not set
# CONFIG_BLK_DEV_BSGLIB is not set
# CONFIG_BLK_DEV_INTEGRITY is not set

#
# Partition Types
#
# CONFIG_PARTITION_ADVANCED is not set
CONFIG_MSDOS_PARTITION=y
CONFIG_BLOCK_COMPAT=y

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_DEFAULT_DEADLINE is not set
CONFIG_DEFAULT_CFQ=y
# CONFIG_DEFAULT_NOOP is not set
CONFIG_DEFAULT_IOSCHED="cfq"
CONFIG_PREEMPT_NOTIFIERS=y
# CONFIG_INLINE_SPIN_TRYLOCK is not set
# CONFIG_INLINE_SPIN_TRYLOCK_BH is not set
# CONFIG_INLINE_SPIN_LOCK is not set
# CONFIG_INLINE_SPIN_LOCK_BH is not set
# CONFIG_INLINE_SPIN_LOCK_IRQ is not set
# CONFIG_INLINE_SPIN_LOCK_IRQSAVE is not set
CONFIG_INLINE_SPIN_UNLOCK=y
# CONFIG_INLINE_SPIN_UNLOCK_BH is not set
CONFIG_INLINE_SPIN_UNLOCK_IRQ=y
# CONFIG_INLINE_SPIN_UNLOCK_IRQRESTORE is not set
# CONFIG_INLINE_READ_TRYLOCK is not set
# CONFIG_INLINE_READ_LOCK is not set
# CONFIG_INLINE_READ_LOCK_BH is not set
# CONFIG_INLINE_READ_LOCK_IRQ is not set
# CONFIG_INLINE_READ_LOCK_IRQSAVE is not set
CONFIG_INLINE_READ_UNLOCK=y
# CONFIG_INLINE_READ_UNLOCK_BH is not set
CONFIG_INLINE_READ_UNLOCK_IRQ=y
# CONFIG_INLINE_READ_UNLOCK_IRQRESTORE is not set
# CONFIG_INLINE_WRITE_TRYLOCK is not set
# CONFIG_INLINE_WRITE_LOCK is not set
# CONFIG_INLINE_WRITE_LOCK_BH is not set
# CONFIG_INLINE_WRITE_LOCK_IRQ is not set
# CONFIG_INLINE_WRITE_LOCK_IRQSAVE is not set
CONFIG_INLINE_WRITE_UNLOCK=y
# CONFIG_INLINE_WRITE_UNLOCK_BH is not set
CONFIG_INLINE_WRITE_UNLOCK_IRQ=y
# CONFIG_INLINE_WRITE_UNLOCK_IRQRESTORE is not set
CONFIG_MUTEX_SPIN_ON_OWNER=y
CONFIG_FREEZER=y

#
# Processor type and features
#
CONFIG_TICK_ONESHOT=y
CONFIG_NO_HZ=y
CONFIG_HIGH_RES_TIMERS=y
CONFIG_GENERIC_CLOCKEVENTS_BUILD=y
CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
CONFIG_SMP=y
CONFIG_X86_MPPARSE=y
CONFIG_X86_EXTENDED_PLATFORM=y
# CONFIG_X86_VSMP is not set
CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y
CONFIG_SCHED_OMIT_FRAME_POINTER=y
# CONFIG_PARAVIRT_GUEST is not set
CONFIG_NO_BOOTMEM=y
# CONFIG_MEMTEST is not set
CONFIG_MK8=y
# CONFIG_MPSC is not set
# CONFIG_MCORE2 is not set
# CONFIG_MATOM is not set
# CONFIG_GENERIC_CPU is not set
CONFIG_X86_INTERNODE_CACHE_SHIFT=7
CONFIG_X86_CMPXCHG=y
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_X86_XADD=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_X86_TSC=y
CONFIG_X86_CMPXCHG64=y
CONFIG_X86_CMOV=y
CONFIG_X86_MINIMUM_CPU_FAMILY=64
CONFIG_X86_DEBUGCTLMSR=y
CONFIG_CPU_SUP_INTEL=y
CONFIG_CPU_SUP_AMD=y
CONFIG_CPU_SUP_CENTAUR=y
CONFIG_HPET_TIMER=y
CONFIG_HPET_EMULATE_RTC=y
CONFIG_DMI=y
CONFIG_GART_IOMMU=y
# CONFIG_CALGARY_IOMMU is not set
CONFIG_SWIOTLB=y
CONFIG_IOMMU_HELPER=y
# CONFIG_MAXSMP is not set
CONFIG_NR_CPUS=32
CONFIG_SCHED_SMT=y
CONFIG_SCHED_MC=y
# CONFIG_IRQ_TIME_ACCOUNTING is not set
# CONFIG_PREEMPT_NONE is not set
CONFIG_PREEMPT_VOLUNTARY=y
# CONFIG_PREEMPT is not set
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
# CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS is not set
CONFIG_X86_MCE=y
CONFIG_X86_MCE_INTEL=y
CONFIG_X86_MCE_AMD=y
CONFIG_X86_MCE_THRESHOLD=y
# CONFIG_X86_MCE_INJECT is not set
CONFIG_X86_THERMAL_VECTOR=y
# CONFIG_I8K is not set
# CONFIG_MICROCODE is not set
CONFIG_X86_MSR=y
CONFIG_X86_CPUID=y
CONFIG_ARCH_PHYS_ADDR_T_64BIT=y
CONFIG_ARCH_DMA_ADDR_T_64BIT=y
CONFIG_DIRECT_GBPAGES=y
CONFIG_NUMA=y
CONFIG_AMD_NUMA=y
CONFIG_X86_64_ACPI_NUMA=y
CONFIG_NODES_SPAN_OTHER_NODES=y
CONFIG_NUMA_EMU=y
CONFIG_NODES_SHIFT=6
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SPARSEMEM_DEFAULT=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_ARCH_PROC_KCORE_TEXT=y
CONFIG_ILLEGAL_POINTER_VALUE=0xdead000000000000
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_SPARSEMEM_MANUAL=y
CONFIG_SPARSEMEM=y
CONFIG_NEED_MULTIPLE_NODES=y
CONFIG_HAVE_MEMORY_PRESENT=y
CONFIG_SPARSEMEM_EXTREME=y
CONFIG_SPARSEMEM_VMEMMAP_ENABLE=y
CONFIG_SPARSEMEM_ALLOC_MEM_MAP_TOGETHER=y
CONFIG_SPARSEMEM_VMEMMAP=y
CONFIG_HAVE_MEMBLOCK=y
CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
CONFIG_ARCH_DISCARD_MEMBLOCK=y
# CONFIG_MEMORY_HOTPLUG is not set
CONFIG_PAGEFLAGS_EXTENDED=y
CONFIG_SPLIT_PTLOCK_CPUS=4
# CONFIG_COMPACTION is not set
CONFIG_MIGRATION=y
CONFIG_PHYS_ADDR_T_64BIT=y
CONFIG_ZONE_DMA_FLAG=1
CONFIG_BOUNCE=y
CONFIG_VIRT_TO_BUS=y
CONFIG_MMU_NOTIFIER=y
# CONFIG_KSM is not set
CONFIG_DEFAULT_MMAP_MIN_ADDR=4096
CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=y
# CONFIG_MEMORY_FAILURE is not set
# CONFIG_TRANSPARENT_HUGEPAGE is not set
# CONFIG_CLEANCACHE is not set
# CONFIG_X86_CHECK_BIOS_CORRUPTION is not set
CONFIG_X86_RESERVE_LOW=64
CONFIG_MTRR=y
CONFIG_MTRR_SANITIZER=y
CONFIG_MTRR_SANITIZER_ENABLE_DEFAULT=0
CONFIG_MTRR_SANITIZER_SPARE_REG_NR_DEFAULT=1
CONFIG_X86_PAT=y
CONFIG_ARCH_USES_PG_UNCACHED=y
CONFIG_ARCH_RANDOM=y
# CONFIG_EFI is not set
CONFIG_SECCOMP=y
# CONFIG_CC_STACKPROTECTOR is not set
# CONFIG_HZ_100 is not set
CONFIG_HZ_250=y
# CONFIG_HZ_300 is not set
# CONFIG_HZ_1000 is not set
CONFIG_HZ=250
CONFIG_SCHED_HRTICK=y
# CONFIG_KEXEC is not set
# CONFIG_CRASH_DUMP is not set
CONFIG_PHYSICAL_START=0x1000000
# CONFIG_RELOCATABLE is not set
CONFIG_PHYSICAL_ALIGN=0x1000000
CONFIG_HOTPLUG_CPU=y
CONFIG_COMPAT_VDSO=y
# CONFIG_CMDLINE_BOOL is not set
CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
CONFIG_USE_PERCPU_NUMA_NODE_ID=y

#
# Power management and ACPI options
#
CONFIG_ARCH_HIBERNATION_HEADER=y
CONFIG_SUSPEND=y
CONFIG_SUSPEND_FREEZER=y
CONFIG_HIBERNATE_CALLBACKS=y
CONFIG_HIBERNATION=y
CONFIG_PM_STD_PARTITION=""
CONFIG_PM_SLEEP=y
CONFIG_PM_SLEEP_SMP=y
CONFIG_PM_RUNTIME=y
CONFIG_PM=y
CONFIG_PM_DEBUG=y
# CONFIG_PM_ADVANCED_DEBUG is not set
CONFIG_CAN_PM_TRACE=y
CONFIG_PM_TRACE=y
CONFIG_PM_TRACE_RTC=y
CONFIG_ACPI=y
CONFIG_ACPI_SLEEP=y
CONFIG_ACPI_PROCFS=y
CONFIG_ACPI_PROCFS_POWER=y
# CONFIG_ACPI_EC_DEBUGFS is not set
CONFIG_ACPI_PROC_EVENT=y
CONFIG_ACPI_AC=y
CONFIG_ACPI_BATTERY=y
CONFIG_ACPI_BUTTON=y
CONFIG_ACPI_FAN=y
CONFIG_ACPI_DOCK=y
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_HOTPLUG_CPU=y
# CONFIG_ACPI_PROCESSOR_AGGREGATOR is not set
CONFIG_ACPI_THERMAL=y
CONFIG_ACPI_NUMA=y
# CONFIG_ACPI_CUSTOM_DSDT is not set
CONFIG_ACPI_BLACKLIST_YEAR=0
# CONFIG_ACPI_DEBUG is not set
# CONFIG_ACPI_PCI_SLOT is not set
CONFIG_X86_PM_TIMER=y
CONFIG_ACPI_CONTAINER=y
# CONFIG_ACPI_SBS is not set
# CONFIG_ACPI_HED is not set
# CONFIG_ACPI_CUSTOM_METHOD is not set
# CONFIG_ACPI_APEI is not set
# CONFIG_SFI is not set

#
# CPU Frequency scaling
#
CONFIG_CPU_FREQ=y
CONFIG_CPU_FREQ_TABLE=y
CONFIG_CPU_FREQ_STAT=y
# CONFIG_CPU_FREQ_STAT_DETAILS is not set
CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_ONDEMAND is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_CONSERVATIVE is not set
CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
# CONFIG_CPU_FREQ_GOV_POWERSAVE is not set
CONFIG_CPU_FREQ_GOV_USERSPACE=y
CONFIG_CPU_FREQ_GOV_ONDEMAND=y
CONFIG_CPU_FREQ_GOV_CONSERVATIVE=y

#
# x86 CPU frequency scaling drivers
#
# CONFIG_X86_PCC_CPUFREQ is not set
CONFIG_X86_ACPI_CPUFREQ=y
CONFIG_X86_POWERNOW_K8=y
# CONFIG_X86_SPEEDSTEP_CENTRINO is not set
# CONFIG_X86_P4_CLOCKMOD is not set

#
# shared options
#
# CONFIG_X86_SPEEDSTEP_LIB is not set
CONFIG_CPU_IDLE=y
CONFIG_CPU_IDLE_GOV_LADDER=y
CONFIG_CPU_IDLE_GOV_MENU=y
# CONFIG_INTEL_IDLE is not set

#
# Memory power savings
#
# CONFIG_I7300_IDLE is not set

#
# Bus options (PCI etc.)
#
CONFIG_PCI=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_PCI_DOMAINS=y
# CONFIG_PCI_CNB20LE_QUIRK is not set
CONFIG_PCIEPORTBUS=y
CONFIG_PCIEAER=y
# CONFIG_PCIE_ECRC is not set
# CONFIG_PCIEAER_INJECT is not set
CONFIG_PCIEASPM=y
# CONFIG_PCIEASPM_DEBUG is not set
CONFIG_PCIE_PME=y
CONFIG_ARCH_SUPPORTS_MSI=y
CONFIG_PCI_MSI=y
# CONFIG_PCI_DEBUG is not set
# CONFIG_PCI_STUB is not set
# CONFIG_HT_IRQ is not set
# CONFIG_PCI_IOV is not set
# CONFIG_PCI_PRI is not set
# CONFIG_PCI_PASID is not set
CONFIG_PCI_IOAPIC=y
CONFIG_PCI_LABEL=y
CONFIG_ISA_DMA_API=y
CONFIG_AMD_NB=y
# CONFIG_PCCARD is not set
# CONFIG_HOTPLUG_PCI is not set
# CONFIG_RAPIDIO is not set

#
# Executable file formats / Emulations
#
CONFIG_BINFMT_ELF=y
CONFIG_COMPAT_BINFMT_ELF=y
CONFIG_ARCH_BINFMT_ELF_RANDOMIZE_PIE=y
# CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS is not set
# CONFIG_HAVE_AOUT is not set
# CONFIG_BINFMT_MISC is not set
CONFIG_IA32_EMULATION=y
CONFIG_IA32_AOUT=y
CONFIG_COMPAT=y
CONFIG_COMPAT_FOR_U64_ALIGNMENT=y
CONFIG_SYSVIPC_COMPAT=y
CONFIG_KEYS_COMPAT=y
CONFIG_HAVE_TEXT_POKE_SMP=y
CONFIG_NET=y

#
# Networking options
#
CONFIG_PACKET=y
CONFIG_UNIX=y
# CONFIG_UNIX_DIAG is not set
CONFIG_XFRM=y
# CONFIG_XFRM_USER is not set
# CONFIG_XFRM_SUB_POLICY is not set
# CONFIG_XFRM_MIGRATE is not set
# CONFIG_XFRM_STATISTICS is not set
CONFIG_XFRM_IPCOMP=y
# CONFIG_NET_KEY is not set
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
# CONFIG_IP_ADVANCED_ROUTER is not set
CONFIG_IP_ROUTE_CLASSID=y
CONFIG_IP_PNP=y
CONFIG_IP_PNP_DHCP=y
# CONFIG_IP_PNP_BOOTP is not set
# CONFIG_IP_PNP_RARP is not set
# CONFIG_NET_IPIP is not set
# CONFIG_NET_IPGRE_DEMUX is not set
# CONFIG_IP_MROUTE is not set
# CONFIG_ARPD is not set
# CONFIG_SYN_COOKIES is not set
# CONFIG_INET_AH is not set
# CONFIG_INET_ESP is not set
# CONFIG_INET_IPCOMP is not set
# CONFIG_INET_XFRM_TUNNEL is not set
CONFIG_INET_TUNNEL=y
# CONFIG_INET_XFRM_MODE_TRANSPORT is not set
# CONFIG_INET_XFRM_MODE_TUNNEL is not set
# CONFIG_INET_XFRM_MODE_BEET is not set
# CONFIG_INET_LRO is not set
CONFIG_INET_DIAG=y
CONFIG_INET_TCP_DIAG=y
# CONFIG_INET_UDP_DIAG is not set
# CONFIG_TCP_CONG_ADVANCED is not set
CONFIG_TCP_CONG_CUBIC=y
CONFIG_DEFAULT_TCP_CONG="cubic"
# CONFIG_TCP_MD5SIG is not set
CONFIG_IPV6=y
CONFIG_IPV6_PRIVACY=y
CONFIG_IPV6_ROUTER_PREF=y
# CONFIG_IPV6_ROUTE_INFO is not set
# CONFIG_IPV6_OPTIMISTIC_DAD is not set
CONFIG_INET6_AH=y
CONFIG_INET6_ESP=y
CONFIG_INET6_IPCOMP=y
CONFIG_IPV6_MIP6=y
CONFIG_INET6_XFRM_TUNNEL=y
CONFIG_INET6_TUNNEL=y
CONFIG_INET6_XFRM_MODE_TRANSPORT=y
CONFIG_INET6_XFRM_MODE_TUNNEL=y
CONFIG_INET6_XFRM_MODE_BEET=y
CONFIG_INET6_XFRM_MODE_ROUTEOPTIMIZATION=y
CONFIG_IPV6_SIT=y
# CONFIG_IPV6_SIT_6RD is not set
CONFIG_IPV6_NDISC_NODETYPE=y
# CONFIG_IPV6_TUNNEL is not set
CONFIG_IPV6_MULTIPLE_TABLES=y
CONFIG_IPV6_SUBTREES=y
# CONFIG_IPV6_MROUTE is not set
# CONFIG_NETWORK_SECMARK is not set
# CONFIG_NETWORK_PHY_TIMESTAMPING is not set
CONFIG_NETFILTER=y
# CONFIG_NETFILTER_DEBUG is not set
CONFIG_NETFILTER_ADVANCED=y
CONFIG_BRIDGE_NETFILTER=y

#
# Core Netfilter Configuration
#
CONFIG_NETFILTER_NETLINK=m
# CONFIG_NETFILTER_NETLINK_ACCT is not set
CONFIG_NETFILTER_NETLINK_QUEUE=m
CONFIG_NETFILTER_NETLINK_LOG=m
CONFIG_NF_CONNTRACK=y
CONFIG_NF_CONNTRACK_MARK=y
# CONFIG_NF_CONNTRACK_ZONES is not set
CONFIG_NF_CONNTRACK_PROCFS=y
# CONFIG_NF_CONNTRACK_EVENTS is not set
# CONFIG_NF_CONNTRACK_TIMESTAMP is not set
# CONFIG_NF_CT_PROTO_DCCP is not set
# CONFIG_NF_CT_PROTO_SCTP is not set
# CONFIG_NF_CT_PROTO_UDPLITE is not set
# CONFIG_NF_CONNTRACK_AMANDA is not set
CONFIG_NF_CONNTRACK_FTP=y
CONFIG_NF_CONNTRACK_H323=y
# CONFIG_NF_CONNTRACK_IRC is not set
# CONFIG_NF_CONNTRACK_NETBIOS_NS is not set
# CONFIG_NF_CONNTRACK_SNMP is not set
# CONFIG_NF_CONNTRACK_PPTP is not set
# CONFIG_NF_CONNTRACK_SANE is not set
CONFIG_NF_CONNTRACK_SIP=y
# CONFIG_NF_CONNTRACK_TFTP is not set
# CONFIG_NF_CT_NETLINK is not set
# CONFIG_NETFILTER_TPROXY is not set
CONFIG_NETFILTER_XTABLES=y

#
# Xtables combined modules
#
CONFIG_NETFILTER_XT_MARK=m
CONFIG_NETFILTER_XT_CONNMARK=m

#
# Xtables targets
#
# CONFIG_NETFILTER_XT_TARGET_AUDIT is not set
CONFIG_NETFILTER_XT_TARGET_CHECKSUM=m
CONFIG_NETFILTER_XT_TARGET_CLASSIFY=m
CONFIG_NETFILTER_XT_TARGET_CONNMARK=m
CONFIG_NETFILTER_XT_TARGET_CT=m
CONFIG_NETFILTER_XT_TARGET_DSCP=m
CONFIG_NETFILTER_XT_TARGET_HL=m
CONFIG_NETFILTER_XT_TARGET_IDLETIMER=m
CONFIG_NETFILTER_XT_TARGET_MARK=m
CONFIG_NETFILTER_XT_TARGET_NFLOG=m
CONFIG_NETFILTER_XT_TARGET_NFQUEUE=m
CONFIG_NETFILTER_XT_TARGET_NOTRACK=m
CONFIG_NETFILTER_XT_TARGET_RATEEST=m
CONFIG_NETFILTER_XT_TARGET_TEE=m
CONFIG_NETFILTER_XT_TARGET_TRACE=m
CONFIG_NETFILTER_XT_TARGET_TCPMSS=m
CONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP=m

#
# Xtables matches
#
# CONFIG_NETFILTER_XT_MATCH_ADDRTYPE is not set
CONFIG_NETFILTER_XT_MATCH_CLUSTER=m
CONFIG_NETFILTER_XT_MATCH_COMMENT=m
CONFIG_NETFILTER_XT_MATCH_CONNBYTES=m
CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=m
CONFIG_NETFILTER_XT_MATCH_CONNMARK=m
CONFIG_NETFILTER_XT_MATCH_CONNTRACK=m
CONFIG_NETFILTER_XT_MATCH_CPU=m
CONFIG_NETFILTER_XT_MATCH_DCCP=m
# CONFIG_NETFILTER_XT_MATCH_DEVGROUP is not set
CONFIG_NETFILTER_XT_MATCH_DSCP=m
# CONFIG_NETFILTER_XT_MATCH_ECN is not set
CONFIG_NETFILTER_XT_MATCH_ESP=m
CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=m
CONFIG_NETFILTER_XT_MATCH_HELPER=m
CONFIG_NETFILTER_XT_MATCH_HL=y
CONFIG_NETFILTER_XT_MATCH_IPRANGE=m
CONFIG_NETFILTER_XT_MATCH_LENGTH=m
CONFIG_NETFILTER_XT_MATCH_LIMIT=m
CONFIG_NETFILTER_XT_MATCH_MAC=m
CONFIG_NETFILTER_XT_MATCH_MARK=m
CONFIG_NETFILTER_XT_MATCH_MULTIPORT=m
# CONFIG_NETFILTER_XT_MATCH_NFACCT is not set
CONFIG_NETFILTER_XT_MATCH_OSF=m
CONFIG_NETFILTER_XT_MATCH_OWNER=m
CONFIG_NETFILTER_XT_MATCH_POLICY=m
CONFIG_NETFILTER_XT_MATCH_PHYSDEV=m
CONFIG_NETFILTER_XT_MATCH_PKTTYPE=m
CONFIG_NETFILTER_XT_MATCH_QUOTA=m
CONFIG_NETFILTER_XT_MATCH_RATEEST=m
CONFIG_NETFILTER_XT_MATCH_REALM=m
CONFIG_NETFILTER_XT_MATCH_RECENT=m
CONFIG_NETFILTER_XT_MATCH_SCTP=m
CONFIG_NETFILTER_XT_MATCH_STATE=m
CONFIG_NETFILTER_XT_MATCH_STATISTIC=m
CONFIG_NETFILTER_XT_MATCH_STRING=m
CONFIG_NETFILTER_XT_MATCH_TCPMSS=m
CONFIG_NETFILTER_XT_MATCH_TIME=m
CONFIG_NETFILTER_XT_MATCH_U32=m
# CONFIG_IP_SET is not set
# CONFIG_IP_VS is not set

#
# IP: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV4=y
CONFIG_NF_CONNTRACK_IPV4=y
CONFIG_NF_CONNTRACK_PROC_COMPAT=y
# CONFIG_IP_NF_QUEUE is not set
CONFIG_IP_NF_IPTABLES=y
# CONFIG_IP_NF_MATCH_AH is not set
# CONFIG_IP_NF_MATCH_ECN is not set
# CONFIG_IP_NF_MATCH_RPFILTER is not set
# CONFIG_IP_NF_MATCH_TTL is not set
CONFIG_IP_NF_FILTER=y
CONFIG_IP_NF_TARGET_REJECT=y
CONFIG_IP_NF_TARGET_LOG=y
# CONFIG_IP_NF_TARGET_ULOG is not set
CONFIG_NF_NAT=y
CONFIG_NF_NAT_NEEDED=y
CONFIG_IP_NF_TARGET_MASQUERADE=y
# CONFIG_IP_NF_TARGET_NETMAP is not set
# CONFIG_IP_NF_TARGET_REDIRECT is not set
CONFIG_NF_NAT_FTP=y
# CONFIG_NF_NAT_IRC is not set
# CONFIG_NF_NAT_TFTP is not set
# CONFIG_NF_NAT_AMANDA is not set
# CONFIG_NF_NAT_PPTP is not set
CONFIG_NF_NAT_H323=y
CONFIG_NF_NAT_SIP=y
CONFIG_IP_NF_MANGLE=y
# CONFIG_IP_NF_TARGET_CLUSTERIP is not set
# CONFIG_IP_NF_TARGET_ECN is not set
# CONFIG_IP_NF_TARGET_TTL is not set
# CONFIG_IP_NF_RAW is not set
# CONFIG_IP_NF_ARPTABLES is not set

#
# IPv6: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV6=y
CONFIG_NF_CONNTRACK_IPV6=y
CONFIG_IP6_NF_QUEUE=y
CONFIG_IP6_NF_IPTABLES=y
CONFIG_IP6_NF_MATCH_AH=y
CONFIG_IP6_NF_MATCH_EUI64=y
CONFIG_IP6_NF_MATCH_FRAG=y
CONFIG_IP6_NF_MATCH_OPTS=y
CONFIG_IP6_NF_MATCH_HL=y
CONFIG_IP6_NF_MATCH_IPV6HEADER=y
CONFIG_IP6_NF_MATCH_MH=y
# CONFIG_IP6_NF_MATCH_RPFILTER is not set
CONFIG_IP6_NF_MATCH_RT=y
# CONFIG_IP6_NF_TARGET_HL is not set
CONFIG_IP6_NF_TARGET_LOG=y
CONFIG_IP6_NF_FILTER=y
CONFIG_IP6_NF_TARGET_REJECT=y
CONFIG_IP6_NF_MANGLE=y
CONFIG_IP6_NF_RAW=y
# CONFIG_BRIDGE_NF_EBTABLES is not set
# CONFIG_IP_DCCP is not set
# CONFIG_IP_SCTP is not set
# CONFIG_RDS is not set
# CONFIG_TIPC is not set
# CONFIG_ATM is not set
# CONFIG_L2TP is not set
CONFIG_STP=m
CONFIG_BRIDGE=m
CONFIG_BRIDGE_IGMP_SNOOPING=y
# CONFIG_NET_DSA is not set
# CONFIG_VLAN_8021Q is not set
# CONFIG_DECNET is not set
CONFIG_LLC=m
# CONFIG_LLC2 is not set
# CONFIG_IPX is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_ECONET is not set
# CONFIG_WAN_ROUTER is not set
# CONFIG_PHONET is not set
# CONFIG_IEEE802154 is not set
# CONFIG_NET_SCHED is not set
# CONFIG_DCB is not set
CONFIG_DNS_RESOLVER=y
# CONFIG_BATMAN_ADV is not set
# CONFIG_OPENVSWITCH is not set
CONFIG_RPS=y
CONFIG_RFS_ACCEL=y
CONFIG_XPS=y
CONFIG_BQL=y
CONFIG_HAVE_BPF_JIT=y
# CONFIG_BPF_JIT is not set

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
# CONFIG_NET_TCPPROBE is not set
# CONFIG_NET_DROP_MONITOR is not set
# CONFIG_HAMRADIO is not set
# CONFIG_CAN is not set
# CONFIG_IRDA is not set
CONFIG_BT=y
# CONFIG_BT_RFCOMM is not set
# CONFIG_BT_BNEP is not set
# CONFIG_BT_CMTP is not set

#
# Bluetooth device drivers
#
CONFIG_BT_HCIBTUSB=m
CONFIG_BT_HCIUART=m
# CONFIG_BT_HCIUART_H4 is not set
# CONFIG_BT_HCIUART_BCSP is not set
# CONFIG_BT_HCIUART_ATH3K is not set
# CONFIG_BT_HCIUART_LL is not set
CONFIG_BT_HCIBCM203X=m
CONFIG_BT_HCIBPA10X=m
CONFIG_BT_HCIBFUSB=m
CONFIG_BT_HCIVHCI=m
CONFIG_BT_MRVL=m
CONFIG_BT_ATH3K=m
# CONFIG_AF_RXRPC is not set
CONFIG_FIB_RULES=y
CONFIG_WIRELESS=y
# CONFIG_CFG80211 is not set
# CONFIG_LIB80211 is not set

#
# CFG80211 needs to be enabled for MAC80211
#
# CONFIG_WIMAX is not set
# CONFIG_RFKILL is not set
# CONFIG_NET_9P is not set
# CONFIG_CAIF is not set
# CONFIG_CEPH_LIB is not set
# CONFIG_NFC is not set

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug"
# CONFIG_DEVTMPFS is not set
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=y
CONFIG_FIRMWARE_IN_KERNEL=y
CONFIG_EXTRA_FIRMWARE=""
# CONFIG_DEBUG_DRIVER is not set
# CONFIG_DEBUG_DEVRES is not set
# CONFIG_SYS_HYPERVISOR is not set
# CONFIG_GENERIC_CPU_DEVICES is not set
# CONFIG_DMA_SHARED_BUFFER is not set
CONFIG_CONNECTOR=y
CONFIG_PROC_EVENTS=y
# CONFIG_MTD is not set
# CONFIG_PARPORT is not set
CONFIG_PNP=y
CONFIG_PNP_DEBUG_MESSAGES=y

#
# Protocols
#
CONFIG_PNPACPI=y
CONFIG_BLK_DEV=y
CONFIG_BLK_DEV_FD=y
# CONFIG_BLK_CPQ_DA is not set
# CONFIG_BLK_CPQ_CISS_DA is not set
# CONFIG_BLK_DEV_DAC960 is not set
# CONFIG_BLK_DEV_UMEM is not set
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=y
CONFIG_BLK_DEV_LOOP_MIN_COUNT=8
# CONFIG_BLK_DEV_CRYPTOLOOP is not set
# CONFIG_BLK_DEV_DRBD is not set
# CONFIG_BLK_DEV_NBD is not set
# CONFIG_BLK_DEV_SX8 is not set
# CONFIG_BLK_DEV_UB is not set
CONFIG_BLK_DEV_RAM=y
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=4096
# CONFIG_BLK_DEV_XIP is not set
# CONFIG_CDROM_PKTCDVD is not set
# CONFIG_ATA_OVER_ETH is not set
CONFIG_VIRTIO_BLK=y
# CONFIG_BLK_DEV_HD is not set
# CONFIG_BLK_DEV_RBD is not set
# CONFIG_SENSORS_LIS3LV02D is not set
CONFIG_MISC_DEVICES=y
# CONFIG_AD525X_DPOT is not set
# CONFIG_IBM_ASM is not set
# CONFIG_PHANTOM is not set
# CONFIG_INTEL_MID_PTI is not set
# CONFIG_SGI_IOC4 is not set
# CONFIG_TIFM_CORE is not set
# CONFIG_ICS932S401 is not set
# CONFIG_ENCLOSURE_SERVICES is not set
# CONFIG_HP_ILO is not set
# CONFIG_APDS9802ALS is not set
# CONFIG_ISL29003 is not set
# CONFIG_ISL29020 is not set
# CONFIG_SENSORS_TSL2550 is not set
# CONFIG_SENSORS_BH1780 is not set
# CONFIG_SENSORS_BH1770 is not set
# CONFIG_SENSORS_APDS990X is not set
# CONFIG_HMC6352 is not set
# CONFIG_DS1682 is not set
# CONFIG_VMWARE_BALLOON is not set
# CONFIG_BMP085 is not set
# CONFIG_PCH_PHUB is not set
# CONFIG_USB_SWITCH_FSA9480 is not set
# CONFIG_C2PORT is not set

#
# EEPROM support
#
# CONFIG_EEPROM_AT24 is not set
# CONFIG_EEPROM_LEGACY is not set
# CONFIG_EEPROM_MAX6875 is not set
# CONFIG_EEPROM_93CX6 is not set
# CONFIG_CB710_CORE is not set

#
# Texas Instruments shared transport line discipline
#
# CONFIG_SENSORS_LIS3_I2C is not set

#
# Altera FPGA firmware download module
#
# CONFIG_ALTERA_STAPL is not set
CONFIG_HAVE_IDE=y
CONFIG_IDE=y

#
# Please see Documentation/ide/ide.txt for help/info on IDE drives
#
CONFIG_IDE_XFER_MODE=y
CONFIG_IDE_TIMINGS=y
CONFIG_IDE_ATAPI=y
# CONFIG_BLK_DEV_IDE_SATA is not set
CONFIG_IDE_GD=y
# CONFIG_IDE_GD_ATA is not set
# CONFIG_IDE_GD_ATAPI is not set
CONFIG_BLK_DEV_IDECD=y
CONFIG_BLK_DEV_IDECD_VERBOSE_ERRORS=y
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDEACPI is not set
# CONFIG_IDE_TASK_IOCTL is not set
CONFIG_IDE_PROC_FS=y

#
# IDE chipset support/bugfixes
#
# CONFIG_IDE_GENERIC is not set
# CONFIG_BLK_DEV_PLATFORM is not set
# CONFIG_BLK_DEV_CMD640 is not set
# CONFIG_BLK_DEV_IDEPNP is not set
CONFIG_BLK_DEV_IDEDMA_SFF=y

#
# PCI IDE chipsets support
#
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_PCIBUS_ORDER=y
# CONFIG_BLK_DEV_GENERIC is not set
# CONFIG_BLK_DEV_OPTI621 is not set
# CONFIG_BLK_DEV_RZ1000 is not set
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_AEC62XX is not set
# CONFIG_BLK_DEV_ALI15X3 is not set
# CONFIG_BLK_DEV_AMD74XX is not set
# CONFIG_BLK_DEV_ATIIXP is not set
# CONFIG_BLK_DEV_CMD64X is not set
# CONFIG_BLK_DEV_TRIFLEX is not set
# CONFIG_BLK_DEV_CS5520 is not set
# CONFIG_BLK_DEV_CS5530 is not set
# CONFIG_BLK_DEV_HPT366 is not set
# CONFIG_BLK_DEV_JMICRON is not set
# CONFIG_BLK_DEV_SC1200 is not set
# CONFIG_BLK_DEV_PIIX is not set
# CONFIG_BLK_DEV_IT8172 is not set
# CONFIG_BLK_DEV_IT8213 is not set
# CONFIG_BLK_DEV_IT821X is not set
# CONFIG_BLK_DEV_NS87415 is not set
# CONFIG_BLK_DEV_PDC202XX_OLD is not set
# CONFIG_BLK_DEV_PDC202XX_NEW is not set
# CONFIG_BLK_DEV_SVWKS is not set
# CONFIG_BLK_DEV_SIIMAGE is not set
# CONFIG_BLK_DEV_SIS5513 is not set
# CONFIG_BLK_DEV_SLC90E66 is not set
# CONFIG_BLK_DEV_TRM290 is not set
CONFIG_BLK_DEV_VIA82CXXX=y
# CONFIG_BLK_DEV_TC86C001 is not set
CONFIG_BLK_DEV_IDEDMA=y

#
# SCSI device support
#
CONFIG_SCSI_MOD=y
# CONFIG_RAID_ATTRS is not set
CONFIG_SCSI=y
CONFIG_SCSI_DMA=y
CONFIG_SCSI_TGT=y
CONFIG_SCSI_NETLINK=y
# CONFIG_SCSI_PROC_FS is not set

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=y
# CONFIG_CHR_DEV_ST is not set
# CONFIG_CHR_DEV_OSST is not set
CONFIG_BLK_DEV_SR=y
CONFIG_BLK_DEV_SR_VENDOR=y
CONFIG_CHR_DEV_SG=y
# CONFIG_CHR_DEV_SCH is not set
# CONFIG_SCSI_MULTI_LUN is not set
CONFIG_SCSI_CONSTANTS=y
# CONFIG_SCSI_LOGGING is not set
# CONFIG_SCSI_SCAN_ASYNC is not set
CONFIG_SCSI_WAIT_SCAN=m

#
# SCSI Transports
#
CONFIG_SCSI_SPI_ATTRS=y
CONFIG_SCSI_FC_ATTRS=y
# CONFIG_SCSI_FC_TGT_ATTRS is not set
# CONFIG_SCSI_ISCSI_ATTRS is not set
# CONFIG_SCSI_SAS_ATTRS is not set
# CONFIG_SCSI_SAS_LIBSAS is not set
# CONFIG_SCSI_SRP_ATTRS is not set
CONFIG_SCSI_LOWLEVEL=y
# CONFIG_ISCSI_TCP is not set
# CONFIG_ISCSI_BOOT_SYSFS is not set
# CONFIG_SCSI_CXGB3_ISCSI is not set
# CONFIG_SCSI_CXGB4_ISCSI is not set
# CONFIG_SCSI_BNX2_ISCSI is not set
# CONFIG_SCSI_BNX2X_FCOE is not set
# CONFIG_BE2ISCSI is not set
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
# CONFIG_SCSI_HPSA is not set
# CONFIG_SCSI_3W_9XXX is not set
# CONFIG_SCSI_3W_SAS is not set
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC7XXX_OLD is not set
CONFIG_SCSI_AIC79XX=y
CONFIG_AIC79XX_CMDS_PER_DEVICE=32
CONFIG_AIC79XX_RESET_DELAY_MS=4000
# CONFIG_AIC79XX_DEBUG_ENABLE is not set
CONFIG_AIC79XX_DEBUG_MASK=0
# CONFIG_AIC79XX_REG_PRETTY_PRINT is not set
# CONFIG_SCSI_AIC94XX is not set
# CONFIG_SCSI_MVSAS is not set
# CONFIG_SCSI_MVUMI is not set
# CONFIG_SCSI_DPT_I2O is not set
# CONFIG_SCSI_ADVANSYS is not set
# CONFIG_SCSI_ARCMSR is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_MEGARAID_SAS is not set
# CONFIG_SCSI_MPT2SAS is not set
# CONFIG_SCSI_HPTIOP is not set
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_VMWARE_PVSCSI is not set
# CONFIG_LIBFC is not set
# CONFIG_LIBFCOE is not set
# CONFIG_FCOE is not set
# CONFIG_FCOE_FNIC is not set
# CONFIG_SCSI_DMX3191D is not set
# CONFIG_SCSI_EATA is not set
# CONFIG_SCSI_FUTURE_DOMAIN is not set
# CONFIG_SCSI_GDTH is not set
# CONFIG_SCSI_ISCI is not set
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INITIO is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_STEX is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_IPR is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
# CONFIG_SCSI_QLA_FC is not set
# CONFIG_SCSI_QLA_ISCSI is not set
# CONFIG_SCSI_LPFC is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_DC390T is not set
# CONFIG_SCSI_DEBUG is not set
# CONFIG_SCSI_PMCRAID is not set
# CONFIG_SCSI_PM8001 is not set
# CONFIG_SCSI_SRP is not set
# CONFIG_SCSI_BFA_FC is not set
# CONFIG_SCSI_DH is not set
# CONFIG_SCSI_OSD_INITIATOR is not set
CONFIG_ATA=y
# CONFIG_ATA_NONSTANDARD is not set
CONFIG_ATA_VERBOSE_ERROR=y
CONFIG_ATA_ACPI=y
CONFIG_SATA_PMP=y

#
# Controllers with non-SFF native interface
#
CONFIG_SATA_AHCI=y
# CONFIG_SATA_AHCI_PLATFORM is not set
# CONFIG_SATA_INIC162X is not set
# CONFIG_SATA_ACARD_AHCI is not set
# CONFIG_SATA_SIL24 is not set
CONFIG_ATA_SFF=y

#
# SFF controllers with custom DMA interface
#
# CONFIG_PDC_ADMA is not set
# CONFIG_SATA_QSTOR is not set
# CONFIG_SATA_SX4 is not set
CONFIG_ATA_BMDMA=y

#
# SATA SFF controllers with BMDMA
#
# CONFIG_ATA_PIIX is not set
# CONFIG_SATA_MV is not set
# CONFIG_SATA_NV is not set
# CONFIG_SATA_PROMISE is not set
# CONFIG_SATA_SIL is not set
# CONFIG_SATA_SIS is not set
# CONFIG_SATA_SVW is not set
# CONFIG_SATA_ULI is not set
CONFIG_SATA_VIA=y
# CONFIG_SATA_VITESSE is not set

#
# PATA SFF controllers with BMDMA
#
# CONFIG_PATA_ALI is not set
# CONFIG_PATA_AMD is not set
# CONFIG_PATA_ARTOP is not set
# CONFIG_PATA_ATIIXP is not set
# CONFIG_PATA_ATP867X is not set
# CONFIG_PATA_CMD64X is not set
# CONFIG_PATA_CS5520 is not set
# CONFIG_PATA_CS5530 is not set
# CONFIG_PATA_CS5536 is not set
# CONFIG_PATA_CYPRESS is not set
# CONFIG_PATA_EFAR is not set
# CONFIG_PATA_HPT366 is not set
# CONFIG_PATA_HPT37X is not set
# CONFIG_PATA_HPT3X2N is not set
# CONFIG_PATA_HPT3X3 is not set
# CONFIG_PATA_IT8213 is not set
# CONFIG_PATA_IT821X is not set
# CONFIG_PATA_JMICRON is not set
# CONFIG_PATA_MARVELL is not set
# CONFIG_PATA_NETCELL is not set
# CONFIG_PATA_NINJA32 is not set
# CONFIG_PATA_NS87415 is not set
# CONFIG_PATA_OLDPIIX is not set
# CONFIG_PATA_OPTIDMA is not set
# CONFIG_PATA_PDC2027X is not set
# CONFIG_PATA_PDC_OLD is not set
# CONFIG_PATA_RADISYS is not set
# CONFIG_PATA_RDC is not set
# CONFIG_PATA_SC1200 is not set
# CONFIG_PATA_SCH is not set
# CONFIG_PATA_SERVERWORKS is not set
# CONFIG_PATA_SIL680 is not set
# CONFIG_PATA_SIS is not set
# CONFIG_PATA_TOSHIBA is not set
# CONFIG_PATA_TRIFLEX is not set
CONFIG_PATA_VIA=y
# CONFIG_PATA_WINBOND is not set

#
# PIO-only SFF controllers
#
# CONFIG_PATA_CMD640_PCI is not set
# CONFIG_PATA_MPIIX is not set
# CONFIG_PATA_NS87410 is not set
# CONFIG_PATA_OPTI is not set
# CONFIG_PATA_RZ1000 is not set

#
# Generic fallback / legacy drivers
#
# CONFIG_PATA_ACPI is not set
CONFIG_ATA_GENERIC=y
CONFIG_PATA_LEGACY=y
CONFIG_MD=y
CONFIG_BLK_DEV_MD=y
CONFIG_MD_AUTODETECT=y
# CONFIG_MD_LINEAR is not set
# CONFIG_MD_RAID0 is not set
CONFIG_MD_RAID1=y
# CONFIG_MD_RAID10 is not set
# CONFIG_MD_RAID456 is not set
# CONFIG_MD_MULTIPATH is not set
# CONFIG_MD_FAULTY is not set
CONFIG_BLK_DEV_DM=y
# CONFIG_DM_DEBUG is not set
CONFIG_DM_CRYPT=y
CONFIG_DM_SNAPSHOT=y
# CONFIG_DM_THIN_PROVISIONING is not set
CONFIG_DM_MIRROR=y
# CONFIG_DM_RAID is not set
CONFIG_DM_LOG_USERSPACE=y
CONFIG_DM_ZERO=y
CONFIG_DM_MULTIPATH=y
CONFIG_DM_MULTIPATH_QL=y
CONFIG_DM_MULTIPATH_ST=y
CONFIG_DM_DELAY=y
CONFIG_DM_UEVENT=y
# CONFIG_DM_FLAKEY is not set
# CONFIG_TARGET_CORE is not set
# CONFIG_FUSION is not set

#
# IEEE 1394 (FireWire) support
#
# CONFIG_FIREWIRE is not set
# CONFIG_FIREWIRE_NOSY is not set
# CONFIG_I2O is not set
# CONFIG_MACINTOSH_DRIVERS is not set
CONFIG_NETDEVICES=y
CONFIG_NET_CORE=y
# CONFIG_BONDING is not set
# CONFIG_DUMMY is not set
# CONFIG_EQUALIZER is not set
# CONFIG_NET_FC is not set
CONFIG_MII=m
# CONFIG_NET_TEAM is not set
# CONFIG_MACVLAN is not set
# CONFIG_NETCONSOLE is not set
# CONFIG_NETPOLL is not set
# CONFIG_NET_POLL_CONTROLLER is not set
CONFIG_TUN=y
# CONFIG_VETH is not set
# CONFIG_VIRTIO_NET is not set
# CONFIG_ARCNET is not set

#
# CAIF transport drivers
#
CONFIG_ETHERNET=y
CONFIG_NET_VENDOR_3COM=y
# CONFIG_VORTEX is not set
# CONFIG_TYPHOON is not set
CONFIG_NET_VENDOR_ADAPTEC=y
# CONFIG_ADAPTEC_STARFIRE is not set
CONFIG_NET_VENDOR_ALTEON=y
# CONFIG_ACENIC is not set
CONFIG_NET_VENDOR_AMD=y
# CONFIG_AMD8111_ETH is not set
# CONFIG_PCNET32 is not set
CONFIG_NET_VENDOR_ATHEROS=y
# CONFIG_ATL2 is not set
CONFIG_ATL1=m
# CONFIG_ATL1E is not set
# CONFIG_ATL1C is not set
CONFIG_NET_VENDOR_BROADCOM=y
# CONFIG_B44 is not set
# CONFIG_BNX2 is not set
# CONFIG_CNIC is not set
# CONFIG_TIGON3 is not set
# CONFIG_BNX2X is not set
CONFIG_NET_VENDOR_BROCADE=y
# CONFIG_BNA is not set
# CONFIG_NET_CALXEDA_XGMAC is not set
CONFIG_NET_VENDOR_CHELSIO=y
# CONFIG_CHELSIO_T1 is not set
# CONFIG_CHELSIO_T3 is not set
# CONFIG_CHELSIO_T4 is not set
# CONFIG_CHELSIO_T4VF is not set
CONFIG_NET_VENDOR_CISCO=y
# CONFIG_ENIC is not set
# CONFIG_DNET is not set
CONFIG_NET_VENDOR_DEC=y
# CONFIG_NET_TULIP is not set
CONFIG_NET_VENDOR_DLINK=y
# CONFIG_DL2K is not set
# CONFIG_SUNDANCE is not set
CONFIG_NET_VENDOR_EMULEX=y
# CONFIG_BE2NET is not set
CONFIG_NET_VENDOR_EXAR=y
# CONFIG_S2IO is not set
# CONFIG_VXGE is not set
CONFIG_NET_VENDOR_HP=y
# CONFIG_HP100 is not set
CONFIG_NET_VENDOR_INTEL=y
# CONFIG_E100 is not set
# CONFIG_E1000 is not set
# CONFIG_E1000E is not set
# CONFIG_IGB is not set
# CONFIG_IGBVF is not set
# CONFIG_IXGB is not set
# CONFIG_IXGBE is not set
# CONFIG_IXGBEVF is not set
CONFIG_NET_VENDOR_I825XX=y
# CONFIG_ZNET is not set
# CONFIG_IP1000 is not set
# CONFIG_JME is not set
CONFIG_NET_VENDOR_MARVELL=y
# CONFIG_SKGE is not set
# CONFIG_SKY2 is not set
CONFIG_NET_VENDOR_MELLANOX=y
# CONFIG_MLX4_EN is not set
# CONFIG_MLX4_CORE is not set
CONFIG_NET_VENDOR_MICREL=y
# CONFIG_KS8851_MLL is not set
# CONFIG_KSZ884X_PCI is not set
CONFIG_NET_VENDOR_MYRI=y
# CONFIG_MYRI10GE is not set
# CONFIG_FEALNX is not set
CONFIG_NET_VENDOR_NATSEMI=y
# CONFIG_NATSEMI is not set
# CONFIG_NS83820 is not set
CONFIG_NET_VENDOR_8390=y
# CONFIG_NE2K_PCI is not set
CONFIG_NET_VENDOR_NVIDIA=y
# CONFIG_FORCEDETH is not set
CONFIG_NET_VENDOR_OKI=y
# CONFIG_PCH_GBE is not set
# CONFIG_ETHOC is not set
# CONFIG_NET_PACKET_ENGINE is not set
CONFIG_NET_VENDOR_QLOGIC=y
# CONFIG_QLA3XXX is not set
# CONFIG_QLCNIC is not set
# CONFIG_QLGE is not set
# CONFIG_NETXEN_NIC is not set
CONFIG_NET_VENDOR_REALTEK=y
# CONFIG_8139CP is not set
# CONFIG_8139TOO is not set
# CONFIG_R8169 is not set
CONFIG_NET_VENDOR_RDC=y
# CONFIG_R6040 is not set
CONFIG_NET_VENDOR_SEEQ=y
# CONFIG_SEEQ8005 is not set
CONFIG_NET_VENDOR_SILAN=y
# CONFIG_SC92031 is not set
CONFIG_NET_VENDOR_SIS=y
# CONFIG_SIS900 is not set
# CONFIG_SIS190 is not set
# CONFIG_SFC is not set
CONFIG_NET_VENDOR_SMSC=y
# CONFIG_EPIC100 is not set
# CONFIG_SMSC9420 is not set
CONFIG_NET_VENDOR_STMICRO=y
# CONFIG_STMMAC_ETH is not set
CONFIG_NET_VENDOR_SUN=y
# CONFIG_HAPPYMEAL is not set
# CONFIG_SUNGEM is not set
# CONFIG_CASSINI is not set
# CONFIG_NIU is not set
CONFIG_NET_VENDOR_TEHUTI=y
# CONFIG_TEHUTI is not set
CONFIG_NET_VENDOR_TI=y
# CONFIG_TLAN is not set
CONFIG_NET_VENDOR_VIA=y
# CONFIG_VIA_RHINE is not set
# CONFIG_VIA_VELOCITY is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_NET_SB1000 is not set
# CONFIG_PHYLIB is not set
# CONFIG_PPP is not set
# CONFIG_SLIP is not set
# CONFIG_TR is not set

#
# USB Network Adapters
#
CONFIG_USB_CATC=m
CONFIG_USB_KAWETH=m
CONFIG_USB_PEGASUS=m
CONFIG_USB_RTL8150=m
CONFIG_USB_USBNET=m
CONFIG_USB_NET_AX8817X=m
CONFIG_USB_NET_CDCETHER=m
# CONFIG_USB_NET_CDC_EEM is not set
CONFIG_USB_NET_CDC_NCM=m
CONFIG_USB_NET_DM9601=m
# CONFIG_USB_NET_SMSC75XX is not set
# CONFIG_USB_NET_SMSC95XX is not set
CONFIG_USB_NET_GL620A=m
CONFIG_USB_NET_NET1080=m
CONFIG_USB_NET_PLUSB=m
CONFIG_USB_NET_MCS7830=m
CONFIG_USB_NET_RNDIS_HOST=m
CONFIG_USB_NET_CDC_SUBSET=m
# CONFIG_USB_ALI_M5632 is not set
# CONFIG_USB_AN2720 is not set
CONFIG_USB_BELKIN=y
CONFIG_USB_ARMLINUX=y
# CONFIG_USB_EPSON2888 is not set
# CONFIG_USB_KC2190 is not set
CONFIG_USB_NET_ZAURUS=m
# CONFIG_USB_NET_CX82310_ETH is not set
# CONFIG_USB_NET_KALMIA is not set
# CONFIG_USB_NET_INT51X1 is not set
# CONFIG_USB_IPHETH is not set
# CONFIG_USB_SIERRA_NET is not set
# CONFIG_USB_VL600 is not set
CONFIG_WLAN=y
# CONFIG_AIRO is not set
# CONFIG_ATMEL is not set
# CONFIG_PRISM54 is not set
# CONFIG_USB_ZD1201 is not set
# CONFIG_HOSTAP is not set

#
# Enable WiMAX (Networking options) to see the WiMAX drivers
#
# CONFIG_WAN is not set
# CONFIG_VMXNET3 is not set
CONFIG_ISDN=y
# CONFIG_ISDN_I4L is not set
CONFIG_ISDN_CAPI=y
CONFIG_ISDN_DRV_AVMB1_VERBOSE_REASON=y
CONFIG_CAPI_TRACE=y
# CONFIG_ISDN_CAPI_MIDDLEWARE is not set
# CONFIG_ISDN_CAPI_CAPI20 is not set

#
# CAPI hardware drivers
#
# CONFIG_CAPI_AVM is not set
# CONFIG_CAPI_EICON is not set
# CONFIG_ISDN_DRV_GIGASET is not set
# CONFIG_HYSDN is not set
CONFIG_MISDN=y
# CONFIG_MISDN_DSP is not set
# CONFIG_MISDN_L1OIP is not set

#
# mISDN hardware drivers
#
# CONFIG_MISDN_HFCPCI is not set
# CONFIG_MISDN_HFCMULTI is not set
CONFIG_MISDN_HFCUSB=m
# CONFIG_MISDN_AVMFRITZ is not set
# CONFIG_MISDN_SPEEDFAX is not set
# CONFIG_MISDN_INFINEON is not set
# CONFIG_MISDN_W6692 is not set
# CONFIG_MISDN_NETJET is not set
# CONFIG_PHONE is not set

#
# Input device support
#
CONFIG_INPUT=y
# CONFIG_INPUT_FF_MEMLESS is not set
CONFIG_INPUT_POLLDEV=m
# CONFIG_INPUT_SPARSEKMAP is not set

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
# CONFIG_INPUT_JOYDEV is not set
CONFIG_INPUT_EVDEV=y
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
# CONFIG_KEYBOARD_ADP5588 is not set
# CONFIG_KEYBOARD_ADP5589 is not set
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_QT1070 is not set
# CONFIG_KEYBOARD_QT2160 is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_TCA6416 is not set
# CONFIG_KEYBOARD_TCA8418 is not set
# CONFIG_KEYBOARD_LM8323 is not set
# CONFIG_KEYBOARD_MAX7359 is not set
# CONFIG_KEYBOARD_MCS is not set
# CONFIG_KEYBOARD_MPR121 is not set
# CONFIG_KEYBOARD_NEWTON is not set
# CONFIG_KEYBOARD_OPENCORES is not set
# CONFIG_KEYBOARD_STOWAWAY is not set
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_XTKBD is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
CONFIG_MOUSE_PS2_ALPS=y
CONFIG_MOUSE_PS2_LOGIPS2PP=y
CONFIG_MOUSE_PS2_SYNAPTICS=y
CONFIG_MOUSE_PS2_LIFEBOOK=y
CONFIG_MOUSE_PS2_TRACKPOINT=y
# CONFIG_MOUSE_PS2_ELANTECH is not set
# CONFIG_MOUSE_PS2_SENTELIC is not set
# CONFIG_MOUSE_PS2_TOUCHKIT is not set
# CONFIG_MOUSE_SERIAL is not set
# CONFIG_MOUSE_APPLETOUCH is not set
# CONFIG_MOUSE_BCM5974 is not set
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_MOUSE_SYNAPTICS_I2C is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TABLET is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
# CONFIG_INPUT_MISC is not set

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
# CONFIG_SERIO_SERPORT is not set
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PCIPS2 is not set
CONFIG_SERIO_LIBPS2=y
# CONFIG_SERIO_RAW is not set
# CONFIG_SERIO_ALTERA_PS2 is not set
# CONFIG_SERIO_PS2MULT is not set
# CONFIG_GAMEPORT is not set

#
# Character devices
#
CONFIG_VT=y
CONFIG_CONSOLE_TRANSLATIONS=y
CONFIG_VT_CONSOLE=y
CONFIG_VT_CONSOLE_SLEEP=y
CONFIG_HW_CONSOLE=y
# CONFIG_VT_HW_CONSOLE_BINDING is not set
CONFIG_UNIX98_PTYS=y
# CONFIG_DEVPTS_MULTIPLE_INSTANCES is not set
CONFIG_LEGACY_PTYS=y
CONFIG_LEGACY_PTY_COUNT=256
# CONFIG_SERIAL_NONSTANDARD is not set
# CONFIG_NOZOMI is not set
# CONFIG_N_GSM is not set
# CONFIG_TRACE_SINK is not set
CONFIG_DEVKMEM=y

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_SERIAL_8250_PCI=y
CONFIG_SERIAL_8250_PNP=y
CONFIG_SERIAL_8250_NR_UARTS=4
CONFIG_SERIAL_8250_RUNTIME_UARTS=4
# CONFIG_SERIAL_8250_EXTENDED is not set

#
# Non-8250 serial port support
#
# CONFIG_SERIAL_MFD_HSU is not set
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
# CONFIG_SERIAL_JSM is not set
# CONFIG_SERIAL_TIMBERDALE is not set
# CONFIG_SERIAL_ALTERA_JTAGUART is not set
# CONFIG_SERIAL_ALTERA_UART is not set
# CONFIG_SERIAL_PCH_UART is not set
# CONFIG_SERIAL_XILINX_PS_UART is not set
# CONFIG_VIRTIO_CONSOLE is not set
# CONFIG_IPMI_HANDLER is not set
CONFIG_HW_RANDOM=y
# CONFIG_HW_RANDOM_TIMERIOMEM is not set
CONFIG_HW_RANDOM_INTEL=y
CONFIG_HW_RANDOM_AMD=y
CONFIG_HW_RANDOM_VIA=y
# CONFIG_HW_RANDOM_VIRTIO is not set
# CONFIG_NVRAM is not set
CONFIG_RTC=y
# CONFIG_R3964 is not set
# CONFIG_APPLICOM is not set
# CONFIG_MWAVE is not set
CONFIG_RAW_DRIVER=y
CONFIG_MAX_RAW_DEVS=256
CONFIG_HPET=y
CONFIG_HPET_MMAP=y
# CONFIG_HANGCHECK_TIMER is not set
# CONFIG_TCG_TPM is not set
# CONFIG_TELCLOCK is not set
CONFIG_DEVPORT=y
# CONFIG_RAMOOPS is not set
CONFIG_I2C=y
CONFIG_I2C_BOARDINFO=y
CONFIG_I2C_COMPAT=y
CONFIG_I2C_CHARDEV=y
# CONFIG_I2C_MUX is not set
CONFIG_I2C_HELPER_AUTO=y

#
# I2C Hardware Bus support
#

#
# PC SMBus host controller drivers
#
# CONFIG_I2C_ALI1535 is not set
# CONFIG_I2C_ALI1563 is not set
# CONFIG_I2C_ALI15X3 is not set
CONFIG_I2C_AMD756=y
CONFIG_I2C_AMD756_S4882=y
# CONFIG_I2C_AMD8111 is not set
# CONFIG_I2C_I801 is not set
# CONFIG_I2C_ISCH is not set
# CONFIG_I2C_PIIX4 is not set
CONFIG_I2C_NFORCE2=y
CONFIG_I2C_NFORCE2_S4985=y
# CONFIG_I2C_SIS5595 is not set
# CONFIG_I2C_SIS630 is not set
# CONFIG_I2C_SIS96X is not set
# CONFIG_I2C_VIA is not set
CONFIG_I2C_VIAPRO=m

#
# ACPI drivers
#
# CONFIG_I2C_SCMI is not set

#
# I2C system bus drivers (mostly embedded / system-on-chip)
#
# CONFIG_I2C_DESIGNWARE_PCI is not set
# CONFIG_I2C_INTEL_MID is not set
# CONFIG_I2C_OCORES is not set
# CONFIG_I2C_PCA_PLATFORM is not set
# CONFIG_I2C_PXA_PCI is not set
# CONFIG_I2C_SIMTEC is not set
# CONFIG_I2C_XILINX is not set
# CONFIG_I2C_EG20T is not set

#
# External I2C/SMBus adapter drivers
#
# CONFIG_I2C_DIOLAN_U2C is not set
# CONFIG_I2C_PARPORT_LIGHT is not set
# CONFIG_I2C_TAOS_EVM is not set
# CONFIG_I2C_TINY_USB is not set

#
# Other I2C/SMBus bus drivers
#
# CONFIG_I2C_STUB is not set
# CONFIG_I2C_DEBUG_CORE is not set
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
# CONFIG_SPI is not set

#
# PPS support
#
# CONFIG_PPS is not set

#
# PPS generators support
#

#
# PTP clock support
#

#
# Enable Device Drivers -> PPS to see the PTP clock options.
#
CONFIG_ARCH_WANT_OPTIONAL_GPIOLIB=y
# CONFIG_GPIOLIB is not set
CONFIG_W1=m
CONFIG_W1_CON=y

#
# 1-wire Bus Masters
#
# CONFIG_W1_MASTER_MATROX is not set
CONFIG_W1_MASTER_DS2490=m
# CONFIG_W1_MASTER_DS2482 is not set
# CONFIG_W1_MASTER_DS1WM is not set

#
# 1-wire Slaves
#
CONFIG_W1_SLAVE_THERM=m
# CONFIG_W1_SLAVE_SMEM is not set
# CONFIG_W1_SLAVE_DS2408 is not set
# CONFIG_W1_SLAVE_DS2423 is not set
# CONFIG_W1_SLAVE_DS2431 is not set
# CONFIG_W1_SLAVE_DS2433 is not set
# CONFIG_W1_SLAVE_DS2760 is not set
# CONFIG_W1_SLAVE_DS2780 is not set
# CONFIG_W1_SLAVE_BQ27000 is not set
CONFIG_POWER_SUPPLY=y
# CONFIG_POWER_SUPPLY_DEBUG is not set
# CONFIG_PDA_POWER is not set
# CONFIG_TEST_POWER is not set
# CONFIG_BATTERY_DS2780 is not set
# CONFIG_BATTERY_DS2782 is not set
# CONFIG_BATTERY_SBS is not set
# CONFIG_BATTERY_BQ27x00 is not set
# CONFIG_BATTERY_MAX17040 is not set
# CONFIG_BATTERY_MAX17042 is not set
# CONFIG_CHARGER_MAX8903 is not set
# CONFIG_CHARGER_LP8727 is not set
CONFIG_HWMON=y
CONFIG_HWMON_VID=m
# CONFIG_HWMON_DEBUG_CHIP is not set

#
# Native drivers
#
CONFIG_SENSORS_ABITUGURU=m
CONFIG_SENSORS_ABITUGURU3=m
# CONFIG_SENSORS_AD7414 is not set
# CONFIG_SENSORS_AD7418 is not set
# CONFIG_SENSORS_ADM1021 is not set
# CONFIG_SENSORS_ADM1025 is not set
# CONFIG_SENSORS_ADM1026 is not set
# CONFIG_SENSORS_ADM1029 is not set
# CONFIG_SENSORS_ADM1031 is not set
# CONFIG_SENSORS_ADM9240 is not set
# CONFIG_SENSORS_ADT7411 is not set
# CONFIG_SENSORS_ADT7462 is not set
# CONFIG_SENSORS_ADT7470 is not set
# CONFIG_SENSORS_ADT7475 is not set
# CONFIG_SENSORS_ASC7621 is not set
CONFIG_SENSORS_K8TEMP=m
# CONFIG_SENSORS_K10TEMP is not set
# CONFIG_SENSORS_FAM15H_POWER is not set
# CONFIG_SENSORS_ASB100 is not set
# CONFIG_SENSORS_ATXP1 is not set
# CONFIG_SENSORS_DS620 is not set
# CONFIG_SENSORS_DS1621 is not set
CONFIG_SENSORS_I5K_AMB=m
CONFIG_SENSORS_F71805F=m
CONFIG_SENSORS_F71882FG=m
# CONFIG_SENSORS_F75375S is not set
# CONFIG_SENSORS_FSCHMD is not set
# CONFIG_SENSORS_G760A is not set
# CONFIG_SENSORS_GL518SM is not set
# CONFIG_SENSORS_GL520SM is not set
CONFIG_SENSORS_CORETEMP=m
CONFIG_SENSORS_IT87=m
# CONFIG_SENSORS_JC42 is not set
# CONFIG_SENSORS_LINEAGE is not set
# CONFIG_SENSORS_LM63 is not set
# CONFIG_SENSORS_LM73 is not set
# CONFIG_SENSORS_LM75 is not set
# CONFIG_SENSORS_LM77 is not set
# CONFIG_SENSORS_LM78 is not set
# CONFIG_SENSORS_LM80 is not set
# CONFIG_SENSORS_LM83 is not set
# CONFIG_SENSORS_LM85 is not set
# CONFIG_SENSORS_LM87 is not set
# CONFIG_SENSORS_LM90 is not set
# CONFIG_SENSORS_LM92 is not set
# CONFIG_SENSORS_LM93 is not set
# CONFIG_SENSORS_LTC4151 is not set
# CONFIG_SENSORS_LTC4215 is not set
# CONFIG_SENSORS_LTC4245 is not set
# CONFIG_SENSORS_LTC4261 is not set
# CONFIG_SENSORS_LM95241 is not set
# CONFIG_SENSORS_LM95245 is not set
# CONFIG_SENSORS_MAX16065 is not set
# CONFIG_SENSORS_MAX1619 is not set
# CONFIG_SENSORS_MAX1668 is not set
# CONFIG_SENSORS_MAX6639 is not set
# CONFIG_SENSORS_MAX6642 is not set
# CONFIG_SENSORS_MAX6650 is not set
# CONFIG_SENSORS_NTC_THERMISTOR is not set
CONFIG_SENSORS_PC87360=m
CONFIG_SENSORS_PC87427=m
# CONFIG_SENSORS_PCF8591 is not set
# CONFIG_PMBUS is not set
# CONFIG_SENSORS_SHT21 is not set
CONFIG_SENSORS_SIS5595=m
# CONFIG_SENSORS_SMM665 is not set
# CONFIG_SENSORS_DME1737 is not set
# CONFIG_SENSORS_EMC1403 is not set
# CONFIG_SENSORS_EMC2103 is not set
# CONFIG_SENSORS_EMC6W201 is not set
CONFIG_SENSORS_SMSC47M1=m
# CONFIG_SENSORS_SMSC47M192 is not set
CONFIG_SENSORS_SMSC47B397=m
# CONFIG_SENSORS_SCH56XX_COMMON is not set
# CONFIG_SENSORS_SCH5627 is not set
# CONFIG_SENSORS_SCH5636 is not set
# CONFIG_SENSORS_ADS1015 is not set
# CONFIG_SENSORS_ADS7828 is not set
# CONFIG_SENSORS_AMC6821 is not set
# CONFIG_SENSORS_THMC50 is not set
# CONFIG_SENSORS_TMP102 is not set
# CONFIG_SENSORS_TMP401 is not set
# CONFIG_SENSORS_TMP421 is not set
# CONFIG_SENSORS_VIA_CPUTEMP is not set
CONFIG_SENSORS_VIA686A=m
CONFIG_SENSORS_VT1211=m
CONFIG_SENSORS_VT8231=m
# CONFIG_SENSORS_W83781D is not set
# CONFIG_SENSORS_W83791D is not set
# CONFIG_SENSORS_W83792D is not set
# CONFIG_SENSORS_W83793 is not set
# CONFIG_SENSORS_W83795 is not set
# CONFIG_SENSORS_W83L785TS is not set
# CONFIG_SENSORS_W83L786NG is not set
CONFIG_SENSORS_W83627HF=m
CONFIG_SENSORS_W83627EHF=m
CONFIG_SENSORS_APPLESMC=m

#
# ACPI drivers
#
# CONFIG_SENSORS_ACPI_POWER is not set
CONFIG_SENSORS_ATK0110=m
CONFIG_THERMAL=y
CONFIG_THERMAL_HWMON=y
# CONFIG_WATCHDOG is not set
CONFIG_SSB_POSSIBLE=y

#
# Sonics Silicon Backplane
#
# CONFIG_SSB is not set
CONFIG_BCMA_POSSIBLE=y

#
# Broadcom specific AMBA
#
# CONFIG_BCMA is not set

#
# Multifunction device drivers
#
# CONFIG_MFD_CORE is not set
# CONFIG_MFD_88PM860X is not set
# CONFIG_MFD_SM501 is not set
# CONFIG_HTC_PASIC3 is not set
# CONFIG_TPS6105X is not set
# CONFIG_TPS6507X is not set
# CONFIG_MFD_STMPE is not set
# CONFIG_MFD_TC3589X is not set
# CONFIG_MFD_TMIO is not set
# CONFIG_PMIC_DA903X is not set
# CONFIG_MFD_DA9052_I2C is not set
# CONFIG_PMIC_ADP5520 is not set
# CONFIG_MFD_MAX8925 is not set
# CONFIG_MFD_MAX8997 is not set
# CONFIG_MFD_MAX8998 is not set
# CONFIG_MFD_S5M_CORE is not set
# CONFIG_MFD_WM8400 is not set
# CONFIG_MFD_WM831X_I2C is not set
# CONFIG_MFD_WM8350_I2C is not set
# CONFIG_MFD_WM8994 is not set
# CONFIG_MFD_PCF50633 is not set
# CONFIG_ABX500_CORE is not set
# CONFIG_MFD_CS5535 is not set
# CONFIG_LPC_SCH is not set
# CONFIG_MFD_RDC321X is not set
# CONFIG_MFD_JANZ_CMODIO is not set
# CONFIG_MFD_VX855 is not set
# CONFIG_MFD_WL1273_CORE is not set
# CONFIG_REGULATOR is not set
# CONFIG_MEDIA_SUPPORT is not set

#
# Graphics support
#
CONFIG_AGP=y
CONFIG_AGP_AMD64=y
CONFIG_AGP_INTEL=y
# CONFIG_AGP_SIS is not set
# CONFIG_AGP_VIA is not set
CONFIG_VGA_ARB=y
CONFIG_VGA_ARB_MAX_GPUS=16
# CONFIG_VGA_SWITCHEROO is not set
# CONFIG_DRM is not set
# CONFIG_STUB_POULSBO is not set
# CONFIG_VGASTATE is not set
# CONFIG_VIDEO_OUTPUT_CONTROL is not set
# CONFIG_FB is not set
# CONFIG_BACKLIGHT_LCD_SUPPORT is not set

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
CONFIG_VGACON_SOFT_SCROLLBACK=y
CONFIG_VGACON_SOFT_SCROLLBACK_SIZE=256
CONFIG_DUMMY_CONSOLE=y
CONFIG_SOUND=y
CONFIG_SOUND_OSS_CORE=y
CONFIG_SOUND_OSS_CORE_PRECLAIM=y
CONFIG_SND=m
CONFIG_SND_TIMER=m
CONFIG_SND_PCM=m
# CONFIG_SND_SEQUENCER is not set
CONFIG_SND_OSSEMUL=y
CONFIG_SND_MIXER_OSS=m
CONFIG_SND_PCM_OSS=m
CONFIG_SND_PCM_OSS_PLUGINS=y
# CONFIG_SND_HRTIMER is not set
CONFIG_SND_RTCTIMER=m
CONFIG_SND_DYNAMIC_MINORS=y
CONFIG_SND_SUPPORT_OLD_API=y
CONFIG_SND_VERBOSE_PROCFS=y
# CONFIG_SND_VERBOSE_PRINTK is not set
# CONFIG_SND_DEBUG is not set
CONFIG_SND_VMASTER=y
CONFIG_SND_KCTL_JACK=y
CONFIG_SND_DMA_SGBUF=y
# CONFIG_SND_RAWMIDI_SEQ is not set
# CONFIG_SND_OPL3_LIB_SEQ is not set
# CONFIG_SND_OPL4_LIB_SEQ is not set
# CONFIG_SND_SBAWE_SEQ is not set
# CONFIG_SND_EMU10K1_SEQ is not set
CONFIG_SND_DRIVERS=y
# CONFIG_SND_PCSP is not set
# CONFIG_SND_DUMMY is not set
# CONFIG_SND_ALOOP is not set
# CONFIG_SND_MTPAV is not set
# CONFIG_SND_SERIAL_U16550 is not set
# CONFIG_SND_MPU401 is not set
CONFIG_SND_PCI=y
# CONFIG_SND_AD1889 is not set
# CONFIG_SND_ALS300 is not set
# CONFIG_SND_ALS4000 is not set
# CONFIG_SND_ALI5451 is not set
# CONFIG_SND_ASIHPI is not set
# CONFIG_SND_ATIIXP is not set
# CONFIG_SND_ATIIXP_MODEM is not set
# CONFIG_SND_AU8810 is not set
# CONFIG_SND_AU8820 is not set
# CONFIG_SND_AU8830 is not set
# CONFIG_SND_AW2 is not set
# CONFIG_SND_AZT3328 is not set
# CONFIG_SND_BT87X is not set
# CONFIG_SND_CA0106 is not set
# CONFIG_SND_CMIPCI is not set
# CONFIG_SND_OXYGEN is not set
# CONFIG_SND_CS4281 is not set
# CONFIG_SND_CS46XX is not set
# CONFIG_SND_CS5530 is not set
# CONFIG_SND_CS5535AUDIO is not set
# CONFIG_SND_CTXFI is not set
# CONFIG_SND_DARLA20 is not set
# CONFIG_SND_GINA20 is not set
# CONFIG_SND_LAYLA20 is not set
# CONFIG_SND_DARLA24 is not set
# CONFIG_SND_GINA24 is not set
# CONFIG_SND_LAYLA24 is not set
# CONFIG_SND_MONA is not set
# CONFIG_SND_MIA is not set
# CONFIG_SND_ECHO3G is not set
# CONFIG_SND_INDIGO is not set
# CONFIG_SND_INDIGOIO is not set
# CONFIG_SND_INDIGODJ is not set
# CONFIG_SND_INDIGOIOX is not set
# CONFIG_SND_INDIGODJX is not set
# CONFIG_SND_EMU10K1 is not set
# CONFIG_SND_EMU10K1X is not set
# CONFIG_SND_ENS1370 is not set
# CONFIG_SND_ENS1371 is not set
# CONFIG_SND_ES1938 is not set
# CONFIG_SND_ES1968 is not set
# CONFIG_SND_FM801 is not set
CONFIG_SND_HDA_INTEL=m
CONFIG_SND_HDA_PREALLOC_SIZE=64
# CONFIG_SND_HDA_HWDEP is not set
# CONFIG_SND_HDA_INPUT_BEEP is not set
# CONFIG_SND_HDA_INPUT_JACK is not set
# CONFIG_SND_HDA_PATCH_LOADER is not set
CONFIG_SND_HDA_CODEC_REALTEK=y
CONFIG_SND_HDA_ENABLE_REALTEK_QUIRKS=y
CONFIG_SND_HDA_CODEC_ANALOG=y
CONFIG_SND_HDA_CODEC_SIGMATEL=y
CONFIG_SND_HDA_CODEC_VIA=y
CONFIG_SND_HDA_CODEC_HDMI=y
CONFIG_SND_HDA_CODEC_CIRRUS=y
CONFIG_SND_HDA_CODEC_CONEXANT=y
CONFIG_SND_HDA_CODEC_CA0110=y
CONFIG_SND_HDA_CODEC_CA0132=y
CONFIG_SND_HDA_CODEC_CMEDIA=y
CONFIG_SND_HDA_CODEC_SI3054=y
CONFIG_SND_HDA_GENERIC=y
# CONFIG_SND_HDA_POWER_SAVE is not set
# CONFIG_SND_HDSP is not set
# CONFIG_SND_HDSPM is not set
# CONFIG_SND_ICE1712 is not set
# CONFIG_SND_ICE1724 is not set
# CONFIG_SND_INTEL8X0 is not set
# CONFIG_SND_INTEL8X0M is not set
# CONFIG_SND_KORG1212 is not set
# CONFIG_SND_LOLA is not set
# CONFIG_SND_LX6464ES is not set
# CONFIG_SND_MAESTRO3 is not set
# CONFIG_SND_MIXART is not set
# CONFIG_SND_NM256 is not set
# CONFIG_SND_PCXHR is not set
# CONFIG_SND_RIPTIDE is not set
# CONFIG_SND_RME32 is not set
# CONFIG_SND_RME96 is not set
# CONFIG_SND_RME9652 is not set
# CONFIG_SND_SONICVIBES is not set
# CONFIG_SND_TRIDENT is not set
# CONFIG_SND_VIA82XX is not set
# CONFIG_SND_VIA82XX_MODEM is not set
# CONFIG_SND_VIRTUOSO is not set
# CONFIG_SND_VX222 is not set
# CONFIG_SND_YMFPCI is not set
CONFIG_SND_USB=y
# CONFIG_SND_USB_AUDIO is not set
# CONFIG_SND_USB_UA101 is not set
# CONFIG_SND_USB_USX2Y is not set
# CONFIG_SND_USB_CAIAQ is not set
# CONFIG_SND_USB_US122L is not set
# CONFIG_SND_USB_6FIRE is not set
# CONFIG_SND_SOC is not set
CONFIG_SOUND_PRIME=y
# CONFIG_SOUND_OSS is not set
# CONFIG_HID_SUPPORT is not set
CONFIG_USB_SUPPORT=y
CONFIG_USB_COMMON=y
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB_ARCH_HAS_EHCI=y
CONFIG_USB_ARCH_HAS_XHCI=y
CONFIG_USB=y
# CONFIG_USB_DEBUG is not set
# CONFIG_USB_ANNOUNCE_NEW_DEVICES is not set

#
# Miscellaneous USB options
#
CONFIG_USB_DEVICEFS=y
# CONFIG_USB_DEVICE_CLASS is not set
# CONFIG_USB_DYNAMIC_MINORS is not set
CONFIG_USB_SUSPEND=y
# CONFIG_USB_OTG is not set
CONFIG_USB_MON=y
# CONFIG_USB_WUSB is not set
# CONFIG_USB_WUSB_CBAF is not set

#
# USB Host Controller Drivers
#
# CONFIG_USB_C67X00_HCD is not set
# CONFIG_USB_XHCI_HCD is not set
CONFIG_USB_EHCI_HCD=y
# CONFIG_USB_EHCI_ROOT_HUB_TT is not set
# CONFIG_USB_EHCI_TT_NEWSCHED is not set
# CONFIG_USB_EHCI_MV is not set
# CONFIG_USB_OXU210HP_HCD is not set
# CONFIG_USB_ISP116X_HCD is not set
# CONFIG_USB_ISP1760_HCD is not set
# CONFIG_USB_ISP1362_HCD is not set
CONFIG_USB_OHCI_HCD=y
# CONFIG_USB_OHCI_BIG_ENDIAN_DESC is not set
# CONFIG_USB_OHCI_BIG_ENDIAN_MMIO is not set
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
CONFIG_USB_UHCI_HCD=y
# CONFIG_USB_SL811_HCD is not set
# CONFIG_USB_R8A66597_HCD is not set
# CONFIG_USB_WHCI_HCD is not set
# CONFIG_USB_HWA_HCD is not set

#
# USB Device Class drivers
#
# CONFIG_USB_ACM is not set
# CONFIG_USB_PRINTER is not set
# CONFIG_USB_WDM is not set
# CONFIG_USB_TMC is not set

#
# NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may
#

#
# also be needed; see USB_STORAGE Help for more info
#
CONFIG_USB_STORAGE=y
# CONFIG_USB_STORAGE_DEBUG is not set
CONFIG_USB_STORAGE_REALTEK=m
CONFIG_REALTEK_AUTOPM=y
CONFIG_USB_STORAGE_DATAFAB=m
CONFIG_USB_STORAGE_FREECOM=m
CONFIG_USB_STORAGE_ISD200=m
CONFIG_USB_STORAGE_USBAT=m
CONFIG_USB_STORAGE_SDDR09=m
CONFIG_USB_STORAGE_SDDR55=m
CONFIG_USB_STORAGE_JUMPSHOT=m
CONFIG_USB_STORAGE_ALAUDA=m
CONFIG_USB_STORAGE_ONETOUCH=m
CONFIG_USB_STORAGE_KARMA=m
CONFIG_USB_STORAGE_CYPRESS_ATACB=m
CONFIG_USB_STORAGE_ENE_UB6250=m
# CONFIG_USB_UAS is not set
# CONFIG_USB_LIBUSUAL is not set

#
# USB Imaging devices
#
# CONFIG_USB_MDC800 is not set
# CONFIG_USB_MICROTEK is not set

#
# USB port drivers
#
CONFIG_USB_SERIAL=y
# CONFIG_USB_SERIAL_CONSOLE is not set
CONFIG_USB_EZUSB=y
CONFIG_USB_SERIAL_GENERIC=y
CONFIG_USB_SERIAL_AIRCABLE=m
CONFIG_USB_SERIAL_ARK3116=m
CONFIG_USB_SERIAL_BELKIN=m
CONFIG_USB_SERIAL_CH341=m
CONFIG_USB_SERIAL_WHITEHEAT=m
CONFIG_USB_SERIAL_DIGI_ACCELEPORT=m
CONFIG_USB_SERIAL_CP210X=m
CONFIG_USB_SERIAL_CYPRESS_M8=m
CONFIG_USB_SERIAL_EMPEG=m
CONFIG_USB_SERIAL_FTDI_SIO=m
CONFIG_USB_SERIAL_FUNSOFT=m
CONFIG_USB_SERIAL_VISOR=m
CONFIG_USB_SERIAL_IPAQ=m
CONFIG_USB_SERIAL_IR=m
CONFIG_USB_SERIAL_EDGEPORT=m
CONFIG_USB_SERIAL_EDGEPORT_TI=m
CONFIG_USB_SERIAL_GARMIN=m
CONFIG_USB_SERIAL_IPW=m
CONFIG_USB_SERIAL_IUU=m
CONFIG_USB_SERIAL_KEYSPAN_PDA=m
CONFIG_USB_SERIAL_KEYSPAN=m
# CONFIG_USB_SERIAL_KEYSPAN_MPR is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28 is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28X is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28XA is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28XB is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA19 is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA18X is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA19W is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA19QW is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA19QI is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA49W is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA49WLC is not set
CONFIG_USB_SERIAL_KLSI=m
CONFIG_USB_SERIAL_KOBIL_SCT=m
CONFIG_USB_SERIAL_MCT_U232=m
CONFIG_USB_SERIAL_MOS7720=m
CONFIG_USB_SERIAL_MOS7840=m
CONFIG_USB_SERIAL_MOTOROLA=m
CONFIG_USB_SERIAL_NAVMAN=m
CONFIG_USB_SERIAL_PL2303=m
CONFIG_USB_SERIAL_OTI6858=m
CONFIG_USB_SERIAL_QCAUX=m
CONFIG_USB_SERIAL_QUALCOMM=m
CONFIG_USB_SERIAL_SPCP8X5=m
CONFIG_USB_SERIAL_HP4X=m
CONFIG_USB_SERIAL_SAFE=m
# CONFIG_USB_SERIAL_SAFE_PADDED is not set
CONFIG_USB_SERIAL_SIEMENS_MPI=m
CONFIG_USB_SERIAL_SIERRAWIRELESS=m
CONFIG_USB_SERIAL_SYMBOL=m
CONFIG_USB_SERIAL_TI=m
CONFIG_USB_SERIAL_CYBERJACK=m
CONFIG_USB_SERIAL_XIRCOM=m
CONFIG_USB_SERIAL_WWAN=m
CONFIG_USB_SERIAL_OPTION=m
CONFIG_USB_SERIAL_OMNINET=m
CONFIG_USB_SERIAL_OPTICON=m
CONFIG_USB_SERIAL_VIVOPAY_SERIAL=m
# CONFIG_USB_SERIAL_ZIO is not set
# CONFIG_USB_SERIAL_SSU100 is not set
CONFIG_USB_SERIAL_DEBUG=m

#
# USB Miscellaneous drivers
#
# CONFIG_USB_EMI62 is not set
# CONFIG_USB_EMI26 is not set
# CONFIG_USB_ADUTUX is not set
# CONFIG_USB_SEVSEG is not set
# CONFIG_USB_RIO500 is not set
# CONFIG_USB_LEGOTOWER is not set
# CONFIG_USB_LCD is not set
# CONFIG_USB_LED is not set
# CONFIG_USB_CYPRESS_CY7C63 is not set
# CONFIG_USB_CYTHERM is not set
# CONFIG_USB_IDMOUSE is not set
# CONFIG_USB_FTDI_ELAN is not set
# CONFIG_USB_APPLEDISPLAY is not set
# CONFIG_USB_SISUSBVGA is not set
# CONFIG_USB_LD is not set
# CONFIG_USB_TRANCEVIBRATOR is not set
# CONFIG_USB_IOWARRIOR is not set
# CONFIG_USB_TEST is not set
# CONFIG_USB_ISIGHTFW is not set
# CONFIG_USB_YUREX is not set
# CONFIG_USB_GADGET is not set

#
# OTG and related infrastructure
#
# CONFIG_NOP_USB_XCEIV is not set
# CONFIG_UWB is not set
# CONFIG_MMC is not set
# CONFIG_MEMSTICK is not set
CONFIG_NEW_LEDS=y
CONFIG_LEDS_CLASS=y

#
# LED drivers
#
# CONFIG_LEDS_LM3530 is not set
# CONFIG_LEDS_PCA9532 is not set
# CONFIG_LEDS_LP3944 is not set
# CONFIG_LEDS_LP5521 is not set
# CONFIG_LEDS_LP5523 is not set
# CONFIG_LEDS_CLEVO_MAIL is not set
# CONFIG_LEDS_PCA955X is not set
# CONFIG_LEDS_BD2802 is not set
# CONFIG_LEDS_INTEL_SS4200 is not set
# CONFIG_LEDS_TCA6507 is not set
# CONFIG_LEDS_TRIGGERS is not set

#
# LED Triggers
#
# CONFIG_ACCESSIBILITY is not set
# CONFIG_INFINIBAND is not set
# CONFIG_EDAC is not set
# CONFIG_RTC_CLASS is not set
# CONFIG_DMADEVICES is not set
# CONFIG_AUXDISPLAY is not set
# CONFIG_UIO is not set
CONFIG_VIRTIO=y
CONFIG_VIRTIO_RING=y

#
# Virtio drivers
#
CONFIG_VIRTIO_PCI=y
CONFIG_VIRTIO_BALLOON=y
# CONFIG_VIRTIO_MMIO is not set

#
# Microsoft Hyper-V guest support
#
# CONFIG_HYPERV is not set
# CONFIG_STAGING is not set
# CONFIG_X86_PLATFORM_DEVICES is not set

#
# Hardware Spinlock drivers
#
CONFIG_CLKEVT_I8253=y
CONFIG_I8253_LOCK=y
CONFIG_CLKBLD_I8253=y
CONFIG_IOMMU_SUPPORT=y
# CONFIG_AMD_IOMMU is not set
# CONFIG_INTEL_IOMMU is not set
# CONFIG_IRQ_REMAP is not set
# CONFIG_VIRT_DRIVERS is not set
# CONFIG_PM_DEVFREQ is not set

#
# Firmware Drivers
#
# CONFIG_EDD is not set
CONFIG_FIRMWARE_MEMMAP=y
# CONFIG_DELL_RBU is not set
# CONFIG_DCDBAS is not set
CONFIG_DMIID=y
# CONFIG_DMI_SYSFS is not set
# CONFIG_ISCSI_IBFT_FIND is not set
# CONFIG_GOOGLE_FIRMWARE is not set

#
# File systems
#
CONFIG_EXT2_FS=y
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
# CONFIG_EXT2_FS_SECURITY is not set
# CONFIG_EXT2_FS_XIP is not set
CONFIG_EXT3_FS=y
# CONFIG_EXT3_DEFAULTS_TO_ORDERED is not set
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
# CONFIG_EXT3_FS_SECURITY is not set
CONFIG_EXT4_FS=y
CONFIG_EXT4_FS_XATTR=y
# CONFIG_EXT4_FS_POSIX_ACL is not set
# CONFIG_EXT4_FS_SECURITY is not set
# CONFIG_EXT4_DEBUG is not set
CONFIG_JBD=y
# CONFIG_JBD_DEBUG is not set
CONFIG_JBD2=y
# CONFIG_JBD2_DEBUG is not set
CONFIG_FS_MBCACHE=y
# CONFIG_REISERFS_FS is not set
# CONFIG_JFS_FS is not set
CONFIG_XFS_FS=y
CONFIG_XFS_QUOTA=y
CONFIG_XFS_POSIX_ACL=y
CONFIG_XFS_RT=y
CONFIG_XFS_DEBUG=y
# CONFIG_GFS2_FS is not set
CONFIG_BTRFS_FS=m
CONFIG_BTRFS_FS_POSIX_ACL=y
# CONFIG_BTRFS_FS_CHECK_INTEGRITY is not set
# CONFIG_NILFS2_FS is not set
CONFIG_FS_POSIX_ACL=y
CONFIG_EXPORTFS=y
CONFIG_FILE_LOCKING=y
CONFIG_FSNOTIFY=y
CONFIG_DNOTIFY=y
CONFIG_INOTIFY_USER=y
# CONFIG_FANOTIFY is not set
# CONFIG_QUOTA is not set
# CONFIG_QUOTA_NETLINK_INTERFACE is not set
CONFIG_QUOTACTL=y
CONFIG_QUOTACTL_COMPAT=y
CONFIG_AUTOFS4_FS=y
CONFIG_FUSE_FS=m
# CONFIG_CUSE is not set
CONFIG_GENERIC_ACL=y

#
# Caches
#
CONFIG_FSCACHE=y
# CONFIG_FSCACHE_STATS is not set
# CONFIG_FSCACHE_HISTOGRAM is not set
# CONFIG_FSCACHE_DEBUG is not set
# CONFIG_FSCACHE_OBJECT_LIST is not set
CONFIG_CACHEFILES=y
# CONFIG_CACHEFILES_DEBUG is not set
# CONFIG_CACHEFILES_HISTOGRAM is not set

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
# CONFIG_ZISOFS is not set
CONFIG_UDF_FS=m
CONFIG_UDF_NLS=y

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=y
CONFIG_MSDOS_FS=y
CONFIG_VFAT_FS=y
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
CONFIG_NTFS_FS=m
# CONFIG_NTFS_DEBUG is not set
CONFIG_NTFS_RW=y

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_PROC_SYSCTL=y
CONFIG_PROC_PAGE_MONITOR=y
CONFIG_SYSFS=y
CONFIG_TMPFS=y
CONFIG_TMPFS_POSIX_ACL=y
CONFIG_TMPFS_XATTR=y
CONFIG_HUGETLBFS=y
CONFIG_HUGETLB_PAGE=y
# CONFIG_CONFIGFS_FS is not set
CONFIG_MISC_FILESYSTEMS=y
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_ECRYPT_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
# CONFIG_LOGFS is not set
# CONFIG_CRAMFS is not set
# CONFIG_SQUASHFS is not set
# CONFIG_VXFS_FS is not set
# CONFIG_MINIX_FS is not set
# CONFIG_OMFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
# CONFIG_ROMFS_FS is not set
# CONFIG_PSTORE is not set
# CONFIG_SYSV_FS is not set
# CONFIG_UFS_FS is not set
CONFIG_NETWORK_FILESYSTEMS=y
CONFIG_NFS_FS=y
CONFIG_NFS_V3=y
# CONFIG_NFS_V3_ACL is not set
CONFIG_NFS_V4=y
CONFIG_NFS_V4_1=y
CONFIG_PNFS_FILE_LAYOUT=y
CONFIG_PNFS_BLOCK=m
CONFIG_ROOT_NFS=y
CONFIG_NFS_FSCACHE=y
# CONFIG_NFS_USE_LEGACY_DNS is not set
CONFIG_NFS_USE_KERNEL_DNS=y
# CONFIG_NFS_USE_NEW_IDMAPPER is not set
CONFIG_NFSD=y
CONFIG_NFSD_V3=y
# CONFIG_NFSD_V3_ACL is not set
# CONFIG_NFSD_V4 is not set
CONFIG_LOCKD=y
CONFIG_LOCKD_V4=y
CONFIG_NFS_COMMON=y
CONFIG_SUNRPC=y
CONFIG_SUNRPC_GSS=y
CONFIG_SUNRPC_BACKCHANNEL=y
# CONFIG_CEPH_FS is not set
CONFIG_CIFS=m
# CONFIG_CIFS_STATS is not set
# CONFIG_CIFS_WEAK_PW_HASH is not set
# CONFIG_CIFS_UPCALL is not set
# CONFIG_CIFS_XATTR is not set
# CONFIG_CIFS_DEBUG2 is not set
# CONFIG_CIFS_DFS_UPCALL is not set
# CONFIG_CIFS_FSCACHE is not set
# CONFIG_NCP_FS is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not set
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-1"
CONFIG_NLS_CODEPAGE_437=y
# CONFIG_NLS_CODEPAGE_737 is not set
# CONFIG_NLS_CODEPAGE_775 is not set
# CONFIG_NLS_CODEPAGE_850 is not set
# CONFIG_NLS_CODEPAGE_852 is not set
# CONFIG_NLS_CODEPAGE_855 is not set
# CONFIG_NLS_CODEPAGE_857 is not set
# CONFIG_NLS_CODEPAGE_860 is not set
# CONFIG_NLS_CODEPAGE_861 is not set
# CONFIG_NLS_CODEPAGE_862 is not set
# CONFIG_NLS_CODEPAGE_863 is not set
# CONFIG_NLS_CODEPAGE_864 is not set
# CONFIG_NLS_CODEPAGE_865 is not set
# CONFIG_NLS_CODEPAGE_866 is not set
# CONFIG_NLS_CODEPAGE_869 is not set
# CONFIG_NLS_CODEPAGE_936 is not set
# CONFIG_NLS_CODEPAGE_950 is not set
# CONFIG_NLS_CODEPAGE_932 is not set
# CONFIG_NLS_CODEPAGE_949 is not set
# CONFIG_NLS_CODEPAGE_874 is not set
# CONFIG_NLS_ISO8859_8 is not set
# CONFIG_NLS_CODEPAGE_1250 is not set
# CONFIG_NLS_CODEPAGE_1251 is not set
CONFIG_NLS_ASCII=y
CONFIG_NLS_ISO8859_1=y
# CONFIG_NLS_ISO8859_2 is not set
# CONFIG_NLS_ISO8859_3 is not set
# CONFIG_NLS_ISO8859_4 is not set
# CONFIG_NLS_ISO8859_5 is not set
# CONFIG_NLS_ISO8859_6 is not set
# CONFIG_NLS_ISO8859_7 is not set
# CONFIG_NLS_ISO8859_9 is not set
# CONFIG_NLS_ISO8859_13 is not set
# CONFIG_NLS_ISO8859_14 is not set
CONFIG_NLS_ISO8859_15=y
# CONFIG_NLS_KOI8_R is not set
# CONFIG_NLS_KOI8_U is not set
CONFIG_NLS_UTF8=y

#
# Kernel hacking
#
CONFIG_TRACE_IRQFLAGS_SUPPORT=y
# CONFIG_PRINTK_TIME is not set
CONFIG_DEFAULT_MESSAGE_LOGLEVEL=4
CONFIG_ENABLE_WARN_DEPRECATED=y
# CONFIG_ENABLE_MUST_CHECK is not set
CONFIG_FRAME_WARN=2048
CONFIG_MAGIC_SYSRQ=y
# CONFIG_STRIP_ASM_SYMS is not set
CONFIG_UNUSED_SYMBOLS=y
CONFIG_DEBUG_FS=y
# CONFIG_HEADERS_CHECK is not set
# CONFIG_DEBUG_SECTION_MISMATCH is not set
CONFIG_DEBUG_KERNEL=y
# CONFIG_DEBUG_SHIRQ is not set
# CONFIG_LOCKUP_DETECTOR is not set
# CONFIG_HARDLOCKUP_DETECTOR is not set
CONFIG_DETECT_HUNG_TASK=y
CONFIG_DEFAULT_HUNG_TASK_TIMEOUT=120
# CONFIG_BOOTPARAM_HUNG_TASK_PANIC is not set
CONFIG_BOOTPARAM_HUNG_TASK_PANIC_VALUE=0
# CONFIG_SCHED_DEBUG is not set
# CONFIG_SCHEDSTATS is not set
CONFIG_TIMER_STATS=y
# CONFIG_DEBUG_OBJECTS is not set
CONFIG_SLUB_DEBUG_ON=y
# CONFIG_SLUB_STATS is not set
CONFIG_DEBUG_KMEMLEAK=y
CONFIG_DEBUG_KMEMLEAK_EARLY_LOG_SIZE=400
# CONFIG_DEBUG_KMEMLEAK_TEST is not set
CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF=y
# CONFIG_DEBUG_RT_MUTEXES is not set
# CONFIG_RT_MUTEX_TESTER is not set
# CONFIG_DEBUG_SPINLOCK is not set
# CONFIG_DEBUG_MUTEXES is not set
# CONFIG_DEBUG_LOCK_ALLOC is not set
# CONFIG_PROVE_LOCKING is not set
# CONFIG_SPARSE_RCU_POINTER is not set
# CONFIG_LOCK_STAT is not set
# CONFIG_DEBUG_ATOMIC_SLEEP is not set
# CONFIG_DEBUG_LOCKING_API_SELFTESTS is not set
CONFIG_STACKTRACE=y
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_DEBUG_KOBJECT is not set
CONFIG_DEBUG_BUGVERBOSE=y
# CONFIG_DEBUG_INFO is not set
# CONFIG_DEBUG_VM is not set
# CONFIG_DEBUG_VIRTUAL is not set
# CONFIG_DEBUG_WRITECOUNT is not set
CONFIG_DEBUG_MEMORY_INIT=y
# CONFIG_DEBUG_LIST is not set
# CONFIG_TEST_LIST_SORT is not set
# CONFIG_DEBUG_SG is not set
# CONFIG_DEBUG_NOTIFIERS is not set
# CONFIG_DEBUG_CREDENTIALS is not set
CONFIG_ARCH_WANT_FRAME_POINTERS=y
# CONFIG_FRAME_POINTER is not set
# CONFIG_BOOT_PRINTK_DELAY is not set
# CONFIG_RCU_TORTURE_TEST is not set
CONFIG_RCU_CPU_STALL_TIMEOUT=60
# CONFIG_KPROBES_SANITY_TEST is not set
# CONFIG_BACKTRACE_SELF_TEST is not set
# CONFIG_DEBUG_BLOCK_EXT_DEVT is not set
# CONFIG_DEBUG_FORCE_WEAK_PER_CPU is not set
# CONFIG_DEBUG_PER_CPU_MAPS is not set
# CONFIG_LKDTM is not set
# CONFIG_CPU_NOTIFIER_ERROR_INJECT is not set
# CONFIG_FAULT_INJECTION is not set
# CONFIG_LATENCYTOP is not set
CONFIG_SYSCTL_SYSCALL_CHECK=y
# CONFIG_DEBUG_PAGEALLOC is not set
CONFIG_USER_STACKTRACE_SUPPORT=y
CONFIG_NOP_TRACER=y
CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_FP_TEST=y
CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
CONFIG_HAVE_C_RECORDMCOUNT=y
CONFIG_RING_BUFFER=y
CONFIG_EVENT_TRACING=y
CONFIG_EVENT_POWER_TRACING_DEPRECATED=y
CONFIG_CONTEXT_SWITCH_TRACER=y
CONFIG_RING_BUFFER_ALLOW_SWAP=y
CONFIG_TRACING=y
CONFIG_TRACING_SUPPORT=y
CONFIG_FTRACE=y
# CONFIG_FUNCTION_TRACER is not set
# CONFIG_IRQSOFF_TRACER is not set
# CONFIG_SCHED_TRACER is not set
# CONFIG_ENABLE_DEFAULT_TRACERS is not set
# CONFIG_FTRACE_SYSCALLS is not set
CONFIG_BRANCH_PROFILE_NONE=y
# CONFIG_PROFILE_ANNOTATED_BRANCHES is not set
# CONFIG_PROFILE_ALL_BRANCHES is not set
# CONFIG_STACK_TRACER is not set
# CONFIG_BLK_DEV_IO_TRACE is not set
CONFIG_KPROBE_EVENT=y
# CONFIG_MMIOTRACE is not set
# CONFIG_RING_BUFFER_BENCHMARK is not set
# CONFIG_PROVIDE_OHCI1394_DMA_INIT is not set
# CONFIG_DYNAMIC_DEBUG is not set
# CONFIG_DMA_API_DEBUG is not set
# CONFIG_ATOMIC64_SELFTEST is not set
# CONFIG_SAMPLES is not set
CONFIG_HAVE_ARCH_KGDB=y
# CONFIG_KGDB is not set
CONFIG_HAVE_ARCH_KMEMCHECK=y
# CONFIG_TEST_KSTRTOX is not set
# CONFIG_STRICT_DEVMEM is not set
CONFIG_X86_VERBOSE_BOOTUP=y
CONFIG_EARLY_PRINTK=y
# CONFIG_EARLY_PRINTK_DBGP is not set
CONFIG_DEBUG_STACKOVERFLOW=y
# CONFIG_X86_PTDUMP is not set
# CONFIG_DEBUG_RODATA is not set
# CONFIG_DEBUG_SET_MODULE_RONX is not set
# CONFIG_DEBUG_NX_TEST is not set
# CONFIG_IOMMU_DEBUG is not set
# CONFIG_IOMMU_STRESS is not set
CONFIG_HAVE_MMIOTRACE_SUPPORT=y
# CONFIG_X86_DECODER_SELFTEST is not set
CONFIG_IO_DELAY_TYPE_0X80=0
CONFIG_IO_DELAY_TYPE_0XED=1
CONFIG_IO_DELAY_TYPE_UDELAY=2
CONFIG_IO_DELAY_TYPE_NONE=3
CONFIG_IO_DELAY_0X80=y
# CONFIG_IO_DELAY_0XED is not set
# CONFIG_IO_DELAY_UDELAY is not set
# CONFIG_IO_DELAY_NONE is not set
CONFIG_DEFAULT_IO_DELAY_TYPE=0
# CONFIG_DEBUG_BOOT_PARAMS is not set
# CONFIG_CPA_DEBUG is not set
# CONFIG_OPTIMIZE_INLINING is not set
# CONFIG_DEBUG_STRICT_USER_COPY_CHECKS is not set
# CONFIG_DEBUG_NMI_SELFTEST is not set

#
# Security options
#
CONFIG_KEYS=y
# CONFIG_ENCRYPTED_KEYS is not set
# CONFIG_KEYS_DEBUG_PROC_KEYS is not set
# CONFIG_SECURITY_DMESG_RESTRICT is not set
# CONFIG_SECURITY is not set
# CONFIG_SECURITYFS is not set
CONFIG_DEFAULT_SECURITY_DAC=y
CONFIG_DEFAULT_SECURITY=""
CONFIG_CRYPTO=y

#
# Crypto core or helper
#
CONFIG_CRYPTO_ALGAPI=y
CONFIG_CRYPTO_ALGAPI2=y
CONFIG_CRYPTO_AEAD=y
CONFIG_CRYPTO_AEAD2=y
CONFIG_CRYPTO_BLKCIPHER=y
CONFIG_CRYPTO_BLKCIPHER2=y
CONFIG_CRYPTO_HASH=y
CONFIG_CRYPTO_HASH2=y
CONFIG_CRYPTO_RNG2=y
CONFIG_CRYPTO_PCOMP=y
CONFIG_CRYPTO_PCOMP2=y
CONFIG_CRYPTO_MANAGER=y
CONFIG_CRYPTO_MANAGER2=y
# CONFIG_CRYPTO_USER is not set
CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y
CONFIG_CRYPTO_GF128MUL=m
# CONFIG_CRYPTO_NULL is not set
# CONFIG_CRYPTO_PCRYPT is not set
CONFIG_CRYPTO_WORKQUEUE=y
# CONFIG_CRYPTO_CRYPTD is not set
CONFIG_CRYPTO_AUTHENC=y
# CONFIG_CRYPTO_TEST is not set

#
# Authenticated Encryption with Associated Data
#
# CONFIG_CRYPTO_CCM is not set
# CONFIG_CRYPTO_GCM is not set
# CONFIG_CRYPTO_SEQIV is not set

#
# Block modes
#
CONFIG_CRYPTO_CBC=y
# CONFIG_CRYPTO_CTR is not set
# CONFIG_CRYPTO_CTS is not set
CONFIG_CRYPTO_ECB=y
CONFIG_CRYPTO_LRW=m
CONFIG_CRYPTO_PCBC=m
CONFIG_CRYPTO_XTS=m

#
# Hash modes
#
CONFIG_CRYPTO_HMAC=y
CONFIG_CRYPTO_XCBC=m
# CONFIG_CRYPTO_VMAC is not set

#
# Digest
#
CONFIG_CRYPTO_CRC32C=y
# CONFIG_CRYPTO_CRC32C_INTEL is not set
# CONFIG_CRYPTO_GHASH is not set
CONFIG_CRYPTO_MD4=m
CONFIG_CRYPTO_MD5=y
# CONFIG_CRYPTO_MICHAEL_MIC is not set
# CONFIG_CRYPTO_RMD128 is not set
# CONFIG_CRYPTO_RMD160 is not set
# CONFIG_CRYPTO_RMD256 is not set
# CONFIG_CRYPTO_RMD320 is not set
CONFIG_CRYPTO_SHA1=y
# CONFIG_CRYPTO_SHA1_SSSE3 is not set
# CONFIG_CRYPTO_SHA256 is not set
# CONFIG_CRYPTO_SHA512 is not set
# CONFIG_CRYPTO_TGR192 is not set
# CONFIG_CRYPTO_WP512 is not set
# CONFIG_CRYPTO_GHASH_CLMUL_NI_INTEL is not set

#
# Ciphers
#
CONFIG_CRYPTO_AES=y
CONFIG_CRYPTO_AES_X86_64=m
# CONFIG_CRYPTO_AES_NI_INTEL is not set
# CONFIG_CRYPTO_ANUBIS is not set
CONFIG_CRYPTO_ARC4=m
# CONFIG_CRYPTO_BLOWFISH is not set
# CONFIG_CRYPTO_BLOWFISH_X86_64 is not set
# CONFIG_CRYPTO_CAMELLIA is not set
# CONFIG_CRYPTO_CAST5 is not set
# CONFIG_CRYPTO_CAST6 is not set
CONFIG_CRYPTO_DES=y
# CONFIG_CRYPTO_FCRYPT is not set
# CONFIG_CRYPTO_KHAZAD is not set
# CONFIG_CRYPTO_SALSA20 is not set
# CONFIG_CRYPTO_SALSA20_X86_64 is not set
# CONFIG_CRYPTO_SEED is not set
# CONFIG_CRYPTO_SERPENT is not set
# CONFIG_CRYPTO_SERPENT_SSE2_X86_64 is not set
# CONFIG_CRYPTO_TEA is not set
# CONFIG_CRYPTO_TWOFISH is not set
# CONFIG_CRYPTO_TWOFISH_X86_64 is not set
# CONFIG_CRYPTO_TWOFISH_X86_64_3WAY is not set

#
# Compression
#
CONFIG_CRYPTO_DEFLATE=y
CONFIG_CRYPTO_ZLIB=y
# CONFIG_CRYPTO_LZO is not set

#
# Random Number Generation
#
# CONFIG_CRYPTO_ANSI_CPRNG is not set
# CONFIG_CRYPTO_USER_API_HASH is not set
# CONFIG_CRYPTO_USER_API_SKCIPHER is not set
CONFIG_CRYPTO_HW=y
# CONFIG_CRYPTO_DEV_PADLOCK is not set
CONFIG_HAVE_KVM=y
CONFIG_HAVE_KVM_IRQCHIP=y
CONFIG_HAVE_KVM_EVENTFD=y
CONFIG_KVM_APIC_ARCHITECTURE=y
CONFIG_KVM_MMIO=y
CONFIG_KVM_ASYNC_PF=y
CONFIG_VIRTUALIZATION=y
CONFIG_KVM=y
# CONFIG_KVM_INTEL is not set
CONFIG_KVM_AMD=y
# CONFIG_KVM_MMU_AUDIT is not set
# CONFIG_VHOST_NET is not set
CONFIG_BINARY_PRINTF=y

#
# Library routines
#
CONFIG_BITREVERSE=y
CONFIG_GENERIC_FIND_FIRST_BIT=y
CONFIG_GENERIC_PCI_IOMAP=y
CONFIG_GENERIC_IOMAP=y
CONFIG_CRC_CCITT=y
CONFIG_CRC16=y
# CONFIG_CRC_T10DIF is not set
CONFIG_CRC_ITU_T=m
CONFIG_CRC32=y
# CONFIG_CRC7 is not set
CONFIG_LIBCRC32C=m
# CONFIG_CRC8 is not set
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=y
CONFIG_LZO_COMPRESS=y
CONFIG_LZO_DECOMPRESS=y
CONFIG_XZ_DEC=y
CONFIG_XZ_DEC_X86=y
CONFIG_XZ_DEC_POWERPC=y
CONFIG_XZ_DEC_IA64=y
CONFIG_XZ_DEC_ARM=y
CONFIG_XZ_DEC_ARMTHUMB=y
CONFIG_XZ_DEC_SPARC=y
CONFIG_XZ_DEC_BCJ=y
# CONFIG_XZ_DEC_TEST is not set
CONFIG_DECOMPRESS_GZIP=y
CONFIG_DECOMPRESS_BZIP2=y
CONFIG_DECOMPRESS_LZMA=y
CONFIG_DECOMPRESS_XZ=y
CONFIG_DECOMPRESS_LZO=y
CONFIG_TEXTSEARCH=y
CONFIG_TEXTSEARCH_KMP=m
CONFIG_TEXTSEARCH_BM=m
CONFIG_TEXTSEARCH_FSM=m
CONFIG_HAS_IOMEM=y
CONFIG_HAS_IOPORT=y
CONFIG_HAS_DMA=y
CONFIG_CPU_RMAP=y
CONFIG_DQL=y
CONFIG_NLATTR=y
# CONFIG_AVERAGE is not set
# CONFIG_CORDIC is not set

------------------------------------------------------------------------

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-18 19:32 [Problem] kernel hangs at boot (bisected 892d208bcf) Dirk Gouders
@ 2012-01-19 11:01 ` Catalin Marinas
  2012-01-19 12:16   ` Dirk Gouders
  0 siblings, 1 reply; 15+ messages in thread
From: Catalin Marinas @ 2012-01-19 11:01 UTC (permalink / raw)
  To: Dirk Gouders; +Cc: linux-kernel

Hi Dirk,

On Wed, Jan 18, 2012 at 07:32:59PM +0000, Dirk Gouders wrote:
> I am not sure if you are the correct person to contact,

I am for kmemleak :) but I'm not sure it's kmemleak's fault here.

> but
> I noticed a regression in Linus' master branch and bisected this to
> commit 892d208bcf
> "Merge tag 'kmemleak' of git://git.kernel.org/pub/scm/linux/kernel/git/cmarinas/linux".
...
> Freeing unused kernel memory: 608k freed
> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
> BUG: unable to handle kernel paging request at ffffffff818b232b
> IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
> PGD 17ed067 PUD 17f1063 PMD 3c6a9063 PTE 80000000018b2163
> Oops: 0011 [#1] SMP
> CPU 1
> Modules linked in:
> 
> Pid: 1, comm: swapper/0 Not tainted 3.2.0-09104-gccb19d2 #4 Bochs Bochs
> RIP: 0010:[<ffffffff818b232b>]  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
> RSP: 0018:ffff88003fd03e58  EFLAGS: 00010282
> RAX: 0000000000000001 RBX: ffff88003dbd2600 RCX: 0000000000000000
> RDX: 0000000000000000 RSI: ffff88003dbd2600 RDI: 0000000000000002
> RBP: ffff88003e015488 R08: ffff88003fd0d5c0 R09: ffff88003fd122e0
> R10: 0000000000000400 R11: ffffffff81572da5 R12: ffffea0000f6f480
> R13: ffffffff810aa687 R14: 0000000000000000 R15: ffff88003e31dbc8
> FS:  0000000000000000(0000) GS:ffff88003fd00000(0000) knlGS:0000000000000000
> CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> CR2: ffffffff818b232b CR3: 00000000017eb000 CR4: 00000000000006e0
> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> Process swapper/0 (pid: 1, threadinfo ffff88003e272000, task ffff88003e278000)
> Stack:
>  ffffffff810fed11 ffff88003dbd2680 ffff88003fd0d830 ffffffff81805980
>  ffff88003d48dd00 ffff88003fd0d860 ffffffff810aa687 ffff88003e2ad420
>  0000000a3e2ad820 ffff88003e272000 ffff88003e278000 ffff88003fd03eb0
> Call Trace:
>  <IRQ>
>  [<ffffffff810fed11>] ? kmem_cache_free+0x4f/0xd9
>  [<ffffffff810aa687>] ? __rcu_process_callbacks+0x1bf/0x2e2
>  [<ffffffff810aa7f4>] ? rcu_process_callbacks+0x4a/0x95
> [<ffffffff8105cc1a>] ? __do_softirq+0xb6/0x171
>  [<ffffffff8155a58c>] ? call_softirq+0x1c/0x30
>  [<ffffffff81032d85>] ? do_softirq+0x31/0x68
>  [<ffffffff8105ce7f>] ? irq_exit+0x44/0x9e
>  [<ffffffff81047fd9>] ? smp_apic_timer_interrupt+0x85/0x95
>  [<ffffffff818d1000>] ? free_area_init_node+0x21f/0x2fb
>  [<ffffffff81559c4b>] ? apic_timer_interrupt+0x6b/0x70
>  <EOI>
>  [<ffffffff818d1000>] ? free_area_init_node+0x21f/0x2fb
>  [<ffffffff818d14b0>] ? __next_free_mem_range_rev+0x57/0x11e
>  [<ffffffff8104d31b>] ? free_init_pages+0xea/0x110
>  [<ffffffff810001c0>] ? init_post+0xe/0xbb
>  [<ffffffff81895b93>] ? kernel_init+0x10f/0x113
>  [<ffffffff8155a494>] ? kernel_thread_helper+0x4/0x10
>  [<ffffffff81895a84>] ? start_kernel+0x319/0x319
>  [<ffffffff8155a490>] ? gs_change+0xb/0xb
> Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
> RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>  RSP <ffff88003fd03e58>
> CR2: ffffffff818b232b

I don't really see how kmemleak could cause such error (or any of the
recent changes I have made). It looks like some of the code in the
.init.text section is not executable.

If you still have the vmlinux around, could you please run:

addr2line -i -f -e vmlinux ffffffff818b232b

The code shown shown in the oops message is also a bit weird (all 0xcc).
Maybe you could do an objdump -d in that area, see if it looks like sane
asm code.

Thanks.

-- 
Catalin

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 11:01 ` Catalin Marinas
@ 2012-01-19 12:16   ` Dirk Gouders
  2012-01-19 14:00     ` Catalin Marinas
  0 siblings, 1 reply; 15+ messages in thread
From: Dirk Gouders @ 2012-01-19 12:16 UTC (permalink / raw)
  To: Catalin Marinas; +Cc: linux-kernel

Hi Catalin,

Catalin Marinas <catalin.marinas@arm.com> writes:

> Hi Dirk,
>
> On Wed, Jan 18, 2012 at 07:32:59PM +0000, Dirk Gouders wrote:
>> I am not sure if you are the correct person to contact,
>
> I am for kmemleak :) but I'm not sure it's kmemleak's fault here.
>
>> but
>> I noticed a regression in Linus' master branch and bisected this to
>> commit 892d208bcf
>> "Merge tag 'kmemleak' of git://git.kernel.org/pub/scm/linux/kernel/git/cmarinas/linux".
> ...
>> Freeing unused kernel memory: 608k freed
>> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
>> BUG: unable to handle kernel paging request at ffffffff818b232b
>> IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>> PGD 17ed067 PUD 17f1063 PMD 3c6a9063 PTE 80000000018b2163
>> Oops: 0011 [#1] SMP
>> CPU 1
>> Modules linked in:
>> 
>> Pid: 1, comm: swapper/0 Not tainted 3.2.0-09104-gccb19d2 #4 Bochs Bochs
>> RIP: 0010:[<ffffffff818b232b>]  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>> RSP: 0018:ffff88003fd03e58  EFLAGS: 00010282
>> RAX: 0000000000000001 RBX: ffff88003dbd2600 RCX: 0000000000000000
>> RDX: 0000000000000000 RSI: ffff88003dbd2600 RDI: 0000000000000002
>> RBP: ffff88003e015488 R08: ffff88003fd0d5c0 R09: ffff88003fd122e0
>> R10: 0000000000000400 R11: ffffffff81572da5 R12: ffffea0000f6f480
>> R13: ffffffff810aa687 R14: 0000000000000000 R15: ffff88003e31dbc8
>> FS:  0000000000000000(0000) GS:ffff88003fd00000(0000) knlGS:0000000000000000
>> CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> CR2: ffffffff818b232b CR3: 00000000017eb000 CR4: 00000000000006e0
>> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>> Process swapper/0 (pid: 1, threadinfo ffff88003e272000, task ffff88003e278000)
>> Stack:
>>  ffffffff810fed11 ffff88003dbd2680 ffff88003fd0d830 ffffffff81805980
>>  ffff88003d48dd00 ffff88003fd0d860 ffffffff810aa687 ffff88003e2ad420
>>  0000000a3e2ad820 ffff88003e272000 ffff88003e278000 ffff88003fd03eb0
>> Call Trace:
>>  <IRQ>
>>  [<ffffffff810fed11>] ? kmem_cache_free+0x4f/0xd9
>>  [<ffffffff810aa687>] ? __rcu_process_callbacks+0x1bf/0x2e2
>>  [<ffffffff810aa7f4>] ? rcu_process_callbacks+0x4a/0x95
>> [<ffffffff8105cc1a>] ? __do_softirq+0xb6/0x171
>>  [<ffffffff8155a58c>] ? call_softirq+0x1c/0x30
>>  [<ffffffff81032d85>] ? do_softirq+0x31/0x68
>>  [<ffffffff8105ce7f>] ? irq_exit+0x44/0x9e
>>  [<ffffffff81047fd9>] ? smp_apic_timer_interrupt+0x85/0x95
>>  [<ffffffff818d1000>] ? free_area_init_node+0x21f/0x2fb
>>  [<ffffffff81559c4b>] ? apic_timer_interrupt+0x6b/0x70
>>  <EOI>
>>  [<ffffffff818d1000>] ? free_area_init_node+0x21f/0x2fb
>>  [<ffffffff818d14b0>] ? __next_free_mem_range_rev+0x57/0x11e
>>  [<ffffffff8104d31b>] ? free_init_pages+0xea/0x110
>>  [<ffffffff810001c0>] ? init_post+0xe/0xbb
>>  [<ffffffff81895b93>] ? kernel_init+0x10f/0x113
>>  [<ffffffff8155a494>] ? kernel_thread_helper+0x4/0x10
>>  [<ffffffff81895a84>] ? start_kernel+0x319/0x319
>>  [<ffffffff8155a490>] ? gs_change+0xb/0xb
>> Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
>> RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>>  RSP <ffff88003fd03e58>
>> CR2: ffffffff818b232b
>
> I don't really see how kmemleak could cause such error (or any of the
> recent changes I have made). It looks like some of the code in the
> .init.text section is not executable.
>
> If you still have the vmlinux around, could you please run:
>
> addr2line -i -f -e vmlinux ffffffff818b232b
>
> The code shown shown in the oops message is also a bit weird (all 0xcc).
> Maybe you could do an objdump -d in that area, see if it looks like sane
> asm code.

I'll attach the information you asked for.
I mentioned that while bisecting there was another commit that gave me
hangs on boot.  This was when about six candidates were left and I will
re-bisect with treating that commit bad and see where I get then.

Best regards,

Dirk

------------------------------------------------------------------------

$ addr2line -i -f -e vmlinux ffffffff818b232b
log_early
kmemleak.c:0

And here the requested part of objdump (maybe obvious: I searched for
the cc pattern as well but did not find any):

ffffffff818b232b <log_early>:
ffffffff818b232b:       55                      push   %rbp
ffffffff818b232c:       53                      push   %rbx
ffffffff818b232d:       48 83 ec 08             sub    $0x8,%rsp
ffffffff818b2331:       8b 05 1d 32 13 00       mov    0x13321d(%rip),%eax        # ffffffff819e5554 <kmemleak_error>
ffffffff818b2337:       85 c0                   test   %eax,%eax
ffffffff818b2339:       74 08                   je     ffffffff818b2343 <log_early+0x18>
ffffffff818b233b:       ff 05 6f 2f 03 00       incl   0x32f6f(%rip)        # ffffffff818e52b0 <crt_early_log>
ffffffff818b2341:       eb 5c                   jmp    ffffffff818b239f <log_early+0x74>
ffffffff818b2343:       81 3d 63 2f 03 00 8f    cmpl   $0x18f,0x32f63(%rip)        # ffffffff818e52b0 <crt_early_log>
ffffffff818b234a:       01 00 00 
ffffffff818b234d:       76 0b                   jbe    ffffffff818b235a <log_early+0x2f>
ffffffff818b234f:       48 83 c4 08             add    $0x8,%rsp
ffffffff818b2353:       5b                      pop    %rbx
ffffffff818b2354:       5d                      pop    %rbp
ffffffff818b2355:       e9 68 0d 85 ff          jmpq   ffffffff811030c2 <kmemleak_disable>
ffffffff818b235a:       9c                      pushfq 
ffffffff818b235b:       5d                      pop    %rbp
ffffffff818b235c:       fa                      cli    
ffffffff818b235d:       48 63 1d 4c 2f 03 00    movslq 0x32f4c(%rip),%rbx        # ffffffff818e52b0 <crt_early_log>

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 12:16   ` Dirk Gouders
@ 2012-01-19 14:00     ` Catalin Marinas
  2012-01-19 14:38       ` Dirk Gouders
  0 siblings, 1 reply; 15+ messages in thread
From: Catalin Marinas @ 2012-01-19 14:00 UTC (permalink / raw)
  To: Dirk Gouders; +Cc: linux-kernel

On Thu, Jan 19, 2012 at 12:16:56PM +0000, Dirk Gouders wrote:
> Catalin Marinas <catalin.marinas@arm.com> writes:
> > On Wed, Jan 18, 2012 at 07:32:59PM +0000, Dirk Gouders wrote:
> >> Freeing unused kernel memory: 608k freed
> >> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
> >> BUG: unable to handle kernel paging request at ffffffff818b232b
> >> IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
...
> >> Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
> >> RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
> >
> > I don't really see how kmemleak could cause such error (or any of the
> > recent changes I have made). It looks like some of the code in the
> > .init.text section is not executable.

Ah, the interesting part - 0xcc is the poison value for freed initmem.
And from the kernel logs you posted Linux frees the initmem and later
calls kmemleak_late_init() which should have been in the .init.text
section.

The kmemleak_late_init() function is defined as:

static int __init kmemleak_late_init(void)
{
...
}
late_initcall(kmemleak_late_init);

and it must *not* be called after the initmem has been freed. Was there
any change in the x86 or generic code with regards to the freeing of the
init memory?

-- 
Catalin

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 14:00     ` Catalin Marinas
@ 2012-01-19 14:38       ` Dirk Gouders
  2012-01-19 15:37         ` Catalin Marinas
  0 siblings, 1 reply; 15+ messages in thread
From: Dirk Gouders @ 2012-01-19 14:38 UTC (permalink / raw)
  To: Catalin Marinas; +Cc: linux-kernel

Catalin Marinas <catalin.marinas@arm.com> writes:

> On Thu, Jan 19, 2012 at 12:16:56PM +0000, Dirk Gouders wrote:
>> Catalin Marinas <catalin.marinas@arm.com> writes:
>> > On Wed, Jan 18, 2012 at 07:32:59PM +0000, Dirk Gouders wrote:
>> >> Freeing unused kernel memory: 608k freed
>> >> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
>> >> BUG: unable to handle kernel paging request at ffffffff818b232b
>> >> IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
> ...
>> >> Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
>> >> RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>> >
>> > I don't really see how kmemleak could cause such error (or any of the
>> > recent changes I have made). It looks like some of the code in the
>> > .init.text section is not executable.
>
> Ah, the interesting part - 0xcc is the poison value for freed initmem.
> And from the kernel logs you posted Linux frees the initmem and later
> calls kmemleak_late_init() which should have been in the .init.text
> section.
>
> The kmemleak_late_init() function is defined as:
>
> static int __init kmemleak_late_init(void)
> {
> ...
> }
> late_initcall(kmemleak_late_init);
>
> and it must *not* be called after the initmem has been freed. Was there
> any change in the x86 or generic code with regards to the freeing of the
> init memory?

I tried to re-bisect this problem by marking commit
029aeff5db879afd7760f11214b6fea45f76b58e
"kmemleak: Add support for memory hotplug" (that I previously considered
good, because it produces a different output) bad.  The attached output
shows that kmemleak_late_init is also involved but bisect did not bring
me a step further:

$ git bisect good f1c84dae0e
Bisecting: a merge base must be tested
[c3b92c8787367a8bb53d57d9789b558f1295cc96] Linux 3.1

Here, I am kind of lost and do not know how to continue.

Dirk

------------------------------------------------------------------------
Freeing unused kernel memory: 676k freed
kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
BUG: unable to handle kernel paging request at ffffffff81892482
IP: [<ffffffff81892482>] kmemleak_late_init+0x8a/0x8a
PGD 17cd067 PUD 17d1063 PMD 3c5c8063 PTE 8000000001892163
Oops: 0011 [#1] SMP 
CPU 0 
Modules linked in:

Pid: 1, comm: swapper Not tainted 3.2.0-rc4-00005-g029aeff #4 Bochs Bochs
RIP: 0010:[<ffffffff81892482>]  [<ffffffff81892482>] kmemleak_late_init+0x8a/0x8a
RSP: 0018:ffff88003fc03e68  EFLAGS: 00010282
RAX: 0000000000000001 RBX: ffff88003c59eab8 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff88003c59eab8 RDI: 0000000000000002
RBP: ffffea0000f16780 R08: ffff88003fc0d480 R09: ffff88003fc120e0
R10: 0000000000000400 R11: ffffffff81559cd5 R12: ffff88003e005680
R13: ffffffff810a77da R14: ffff88003c59fa28 R15: ffff88003e342680
FS:  0000000000000000(0000) GS:ffff88003fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff81892482 CR3: 00000000017cb000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 1, threadinfo ffff88003e272000, task ffff88003e278000)
Stack:
 ffffffff810faf78 ffffffff817e5280 ffff88003fc0d650 ffffffff817e5280
 ffff88003fc0d680 0000000000000000 ffffffff810a77da ffffffff81983a20
 0000000a3e273fd8 ffff88003fc03eb0 ffffffff817ca0c8 ffff88003e273fd8
Call Trace:
 <IRQ> 
 [<ffffffff810faf78>] ? kfree+0xbc/0x11e
 [<ffffffff810a77da>] ? __rcu_process_callbacks+0x19c/0x2a6
 [<ffffffff810a792e>] ? rcu_process_callbacks+0x4a/0x95
 [<ffffffff8106648a>] ? __do_softirq+0xb6/0x171
 [<ffffffff815432ac>] ? call_softirq+0x1c/0x30
 [<ffffffff81032472>] ? do_softirq+0x31/0x67
 [<ffffffff810666ef>] ? irq_exit+0x44/0xa5
 [<ffffffff8104707d>] ? smp_apic_timer_interrupt+0x85/0x95
 [<ffffffff81541dcb>] ? apic_timer_interrupt+0x6b/0x70
 <EOI> 
 [<ffffffff81061aa7>] ? vprintk+0x33b/0x35f
 [<ffffffff8104e39c>] ? change_page_attr_set_clr+0x172/0x329
 [<ffffffff81538d10>] ? printk+0x40/0x45
 [<ffffffff8104c2f3>] ? free_init_pages+0xae/0x110
 [<ffffffff810001c0>] ? init_post+0xe/0xbb
 [<ffffffff81874b8c>] ? kernel_init+0x10f/0x113
 [<ffffffff815431b4>] ? kernel_thread_helper+0x4/0x10
 [<ffffffff81874a7d>] ? start_kernel+0x319/0x319
 [<ffffffff815431b0>] ? gs_change+0xb/0xb
Code: e8 50 81 ca ff e8 fa d9 86 ff 48 c7 c7 70 b0 7e 81 e8 e3 7c ca ff 48 c7 c7 2f ba 70 81 31 c0 e8 55 68 ca ff 31 c0 48 83 c4 08 c3 
 53 48 83 ec 08 8b 05 c6 0f 14 00 85 c0 74 08 ff 05 b8 2d 03 
RIP  [<ffffffff81892482>] kmemleak_late_init+0x8a/0x8a
 RSP <ffff88003fc03e68>
CR2: ffffffff81892482
---[ end trace 25fd5fd8ecba3a5f ]---
Kernel panic - not syncing: Fatal exception in interrupt
Pid: 1, comm: swapper Tainted: G      D      3.2.0-rc4-00005-g029aeff #4
Call Trace:
 <IRQ>  [<ffffffff81538bcf>] ? panic+0x92/0x193
 [<ffffffff8153bef8>] ? oops_end+0x7e/0x8d
 [<ffffffff81892482>] ? kmemleak_late_init+0x8a/0x8a
 [<ffffffff8104ce7c>] ? no_context+0x1f8/0x205
 [<ffffffff81892482>] ? kmemleak_late_init+0x8a/0x8a
 [<ffffffff810a77da>] ? __rcu_process_callbacks+0x19c/0x2a6
 [<ffffffff8153dd77>] ? do_page_fault+0x1bd/0x3ac
 [<ffffffff810326e5>] ? dump_trace+0x23d/0x24c
 [<ffffffff810fa5a8>] ? set_track+0x5e/0xd9
 [<ffffffff8136043e>] ? blk_done+0xc3/0x101
 [<ffffffff8136043e>] ? blk_done+0xc3/0x101
 [<ffffffff8103b0f9>] ? save_stack_trace+0x2

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 14:38       ` Dirk Gouders
@ 2012-01-19 15:37         ` Catalin Marinas
  2012-01-19 17:43           ` Dirk Gouders
  0 siblings, 1 reply; 15+ messages in thread
From: Catalin Marinas @ 2012-01-19 15:37 UTC (permalink / raw)
  To: Dirk Gouders; +Cc: linux-kernel

On Thu, Jan 19, 2012 at 02:38:01PM +0000, Dirk Gouders wrote:
> Catalin Marinas <catalin.marinas@arm.com> writes:
> > On Thu, Jan 19, 2012 at 12:16:56PM +0000, Dirk Gouders wrote:
> >> Catalin Marinas <catalin.marinas@arm.com> writes:
> >> > On Wed, Jan 18, 2012 at 07:32:59PM +0000, Dirk Gouders wrote:
> >> >> Freeing unused kernel memory: 608k freed
> >> >> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
> >> >> BUG: unable to handle kernel paging request at ffffffff818b232b
> >> >> IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
> > ...
> >> >> Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
> >> >> RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
> >> >
> >> > I don't really see how kmemleak could cause such error (or any of the
> >> > recent changes I have made). It looks like some of the code in the
> >> > .init.text section is not executable.
> >
> > Ah, the interesting part - 0xcc is the poison value for freed initmem.
> > And from the kernel logs you posted Linux frees the initmem and later
> > calls kmemleak_late_init() which should have been in the .init.text
> > section.
> >
> > The kmemleak_late_init() function is defined as:
> >
> > static int __init kmemleak_late_init(void)
> > {
> > ...
> > }
> > late_initcall(kmemleak_late_init);
> >
> > and it must *not* be called after the initmem has been freed. Was there
> > any change in the x86 or generic code with regards to the freeing of the
> > init memory?
> 
> I tried to re-bisect this problem by marking commit
> 029aeff5db879afd7760f11214b6fea45f76b58e
> "kmemleak: Add support for memory hotplug" (that I previously considered
> good, because it produces a different output) bad.  The attached output
> shows that kmemleak_late_init is also involved but bisect did not bring
> me a step further:
> 
> $ git bisect good f1c84dae0e
> Bisecting: a merge base must be tested
> [c3b92c8787367a8bb53d57d9789b558f1295cc96] Linux 3.1

If you bisect to one of the kmemleak commits, they are based on 3.2-rc4
so you miss any commits that may have been merged during the merge
window.

> ------------------------------------------------------------------------
> Freeing unused kernel memory: 676k freed
> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
> BUG: unable to handle kernel paging request at ffffffff81892482
> IP: [<ffffffff81892482>] kmemleak_late_init+0x8a/0x8a
> PGD 17cd067 PUD 17d1063 PMD 3c5c8063 PTE 8000000001892163
> Oops: 0011 [#1] SMP 

Similar behaviour, the init memory is freed before the initcalls, so
doesn't look like a kmemleak problem.

Could you pass initcall_debug on the kernel command line and see how may
commits are called before and after the free_initmem() call?

You could also try to revert (git revert) the kmemleak commits from the
latest git tree, without bisecting.

-- 
Catalin

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 15:37         ` Catalin Marinas
@ 2012-01-19 17:43           ` Dirk Gouders
  2012-01-19 19:58             ` Dirk Gouders
  0 siblings, 1 reply; 15+ messages in thread
From: Dirk Gouders @ 2012-01-19 17:43 UTC (permalink / raw)
  To: Catalin Marinas

Catalin Marinas <catalin.marinas@arm.com> writes:

> On Thu, Jan 19, 2012 at 02:38:01PM +0000, Dirk Gouders wrote:
>> Catalin Marinas <catalin.marinas@arm.com> writes:
>> > On Thu, Jan 19, 2012 at 12:16:56PM +0000, Dirk Gouders wrote:
>> >> Catalin Marinas <catalin.marinas@arm.com> writes:
>> >> > On Wed, Jan 18, 2012 at 07:32:59PM +0000, Dirk Gouders wrote:
>> >> >> Freeing unused kernel memory: 608k freed
>> >> >> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
>> >> >> BUG: unable to handle kernel paging request at ffffffff818b232b
>> >> >> IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>> > ...
>> >> >> Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
>> >> >> RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>> >> >
>> >> > I don't really see how kmemleak could cause such error (or any of the
>> >> > recent changes I have made). It looks like some of the code in the
>> >> > .init.text section is not executable.
>> >
>> > Ah, the interesting part - 0xcc is the poison value for freed initmem.
>> > And from the kernel logs you posted Linux frees the initmem and later
>> > calls kmemleak_late_init() which should have been in the .init.text
>> > section.
>> >
>> > The kmemleak_late_init() function is defined as:
>> >
>> > static int __init kmemleak_late_init(void)
>> > {
>> > ...
>> > }
>> > late_initcall(kmemleak_late_init);
>> >
>> > and it must *not* be called after the initmem has been freed. Was there
>> > any change in the x86 or generic code with regards to the freeing of the
>> > init memory?
>> 
>> I tried to re-bisect this problem by marking commit
>> 029aeff5db879afd7760f11214b6fea45f76b58e
>> "kmemleak: Add support for memory hotplug" (that I previously considered
>> good, because it produces a different output) bad.  The attached output
>> shows that kmemleak_late_init is also involved but bisect did not bring
>> me a step further:
>> 
>> $ git bisect good f1c84dae0e
>> Bisecting: a merge base must be tested
>> [c3b92c8787367a8bb53d57d9789b558f1295cc96] Linux 3.1
>
> If you bisect to one of the kmemleak commits, they are based on 3.2-rc4
> so you miss any commits that may have been merged during the merge
> window.

Hmm, I thought that the above was an error message but when I ignored it
and just continued bisecting (whith a huge set of commits), it ended in:

b66930052abf2e41b8a978ae265303917cbe6fa0 is the first bad commit
commit b66930052abf2e41b8a978ae265303917cbe6fa0
Author: Catalin Marinas <catalin.marinas@arm.com>
Date:   Wed Sep 28 17:22:56 2011 +0100

    kmemleak: When the early log buffer is exceeded, report the actual number
    
    Just telling that the early log buffer has been exceeded doesn't mean
    much. This patch moves the error printing to the kmemleak_init()
    function and displays the actual calls to the kmemleak API during early
    logging.
    
    Signed-off-by: Catalin Marinas <catalin.marinas@arm.com>

:040000 040000 6b16996be5be3f428eceb5ca8a153ac72f1848b3 246cccb0645241d4a1e1c392aaea3e2ea3e34da5 M      mm

>> ------------------------------------------------------------------------
>> Freeing unused kernel memory: 676k freed
>> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
>> BUG: unable to handle kernel paging request at ffffffff81892482
>> IP: [<ffffffff81892482>] kmemleak_late_init+0x8a/0x8a
>> PGD 17cd067 PUD 17d1063 PMD 3c5c8063 PTE 8000000001892163
>> Oops: 0011 [#1] SMP 
>
> Similar behaviour, the init memory is freed before the initcalls, so
> doesn't look like a kmemleak problem.
>
> Could you pass initcall_debug on the kernel command line and see how may
> commits are called before and after the free_initmem() call?
>
> You could also try to revert (git revert) the kmemleak commits from the
> latest git tree, without bisecting.

OK, I added initcall_debug to a bad kernel I saved while bisecting and
attach the console output of the serial console - the output on the
graphical console was more complete.

Further, I tested Linus' current master with b66930052abf2 reverted 

------------------------------------------------------------------------
commit 27e8880932050e77d2822a19fb9f39230f6363e9
Author: Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de>
Date:   Thu Jan 19 18:31:40 2012 +0100

    Revert "kmemleak: When the early log buffer is exceeded, report the actual number"
    
    This reverts commit b66930052abf2e41b8a978ae265303917cbe6fa0.

commit ccb19d263fd1c9e34948e2158c53eacbff369344
Merge: 6a48897 c3b5003
Author: Linus Torvalds <torvalds@linux-foundation.org>
Date:   Tue Jan 17 22:26:41 2012 -0800
------------------------------------------------------------------------

and that kernel works here.

Dirk

------------------------------------------------------------------------

Linux version 3.2.0-07907-g892d208 (root@mx10) (gcc version 4.5.3 (Gentoo 4.5.3-r2 p1.0, pie-0.4.7) ) #3 SMP Wed Jan 18 20:01:57 CET 2012
Command line: root=/dev/vda1 console=ttyS0,115200 console=tty0 initcall_debug
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000009bc00 (usable)
 BIOS-e820: 000000000009bc00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 000000003fffd000 (usable)
 BIOS-e820: 000000003fffd000 - 0000000040000000 (reserved)
 BIOS-e820: 00000000feffc000 - 00000000ff000000 (reserved)
 BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
NX (Execute Disable) protection: active
DMI 2.4 present.
No AGP bridge found
last_pfn = 0x3fffd max_arch_pfn = 0x400000000
PAT not supported by CPU.
found SMP MP-table at [ffff8800000fd5f0] fd5f0
init_memory_mapping: 0000000000000000-000000003fffd000
ACPI: RSDP 00000000000fd460 00014 (v00 BOCHS )
ACPI: RSDT 000000003fffd740 00034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
ACPI: FACP 000000003fffff80 00074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)
ACPI: DSDT 000000003fffd9b0 02589 (v01   BXPC   BXDSDT 00000001 INTL 20100528)
ACPI: FACS 000000003fffff40 00040
ACPI: SSDT 000000003fffd8b0 000FF (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)
ACPI: APIC 000000003fffd7c0 0007A (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
ACPI: HPET 000000003fffd780 00038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
No NUMA configuration found
Faking a node at 0000000000000000-000000003fffd000
Initmem setup node 0 0000000000000000-000000003fffd000
  NODE_DATA [000000003fff8000 - 000000003fffcfff]
Zone PFN ranges:
  DMA      0x00000010 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   empty
Movable zone start PFN for each node
Early memory PFN ranges
    0: 0x00000010 -> 0x0000009b
    0: 0x00000100 -> 0x0003fffd
ACPI: PM-Timer IO Port: 0xb008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a201 base: 0xfed00000
SMP: Allowing 2 CPUs, 0 hotplug CPUs
PM: Registered nosave memory: 000000000009b000 - 000000000009c000
PM: Registered nosave memory: 000000000009c000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
Allocating PCI resources starting at 40000000 (gap: 40000000:beffc000)
setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:2 nr_node_ids:1
PERCPU: Embedded 27 pages/cpu @ffff88003fc00000 s78016 r8192 d24384 u1048576
Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257923
Policy zone: DMA32
Kernel command line: root=/dev/vda1 console=ttyS0,115200 console=tty0 initcall_debug
PID hash table entries: 4096 (order: 3, 32768 bytes)
Checking aperture...
No AGP bridge found
Memory: 1021076k/1048564k available (5490k kernel code, 468k absent, 27020k reserved, 3206k data, 612k init)
SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
Hierarchical RCU implementation.
NR_IRQS:4352 nr_irqs:512 16
Console: colour VGA+ 80x25
console [tty0] enabled
console [ttyS0] enabled
kmemleak: Kernel memory leak detector disabled
Fast TSC calibration using PIT
Detected 2666.146 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5332.29 BogoMIPS (lpj=10664584)
pid_max: default: 32768 minimum: 301
Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
Mount-cache hash table entries: 256
mce: CPU supports 10 MCE banks
ACPI: Core revision 20110623
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel QEMU Virtual CPU version 0.15.1 stepping 03
Performance Events: unsupported p6 CPU model 2 no PMU driver, software events only.
Booting Node   0, Processors  #1 Ok.
Brought up 2 CPUs
Total of 2 processors activated (10683.75 BogoMIPS).
RTC time: 16:54:13, date: 01/19/12
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Added _OSI(Module Device)
ACPI: Added _OSI(Processor Device)
ACPI: Added _OSI(3.0 _SCP Extensions)
ACPI: Added _OSI(Processor Aggregator Device)
ACPI: Interpreter enabled
ACPI: (supports S0 S3 S4 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
pci_bus 0000:00: root bus resource [mem 0x00000000-0xffffffffff]
pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
pci 0000:00:01.3: quirk: [io  0xb100-0xb10f] claimed by PIIX4 SMB
 pci0000:00: Unable to request _OSC control (_OSC support mask: 0x1e)
ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
ACPI: PCI Interrupt Link [LNKS] (IRQs 9) *0
vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:00:02.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
Bluetooth: Core ver 2.16
NET: Registered protocol family 31
Bluetooth: HCI device and connection manager initialized
Bluetooth: HCI socket layer initialized
Bluetooth: L2CAP socket layer initialized
Bluetooth: SCO socket layer initialized
HPET: 3 timers in total, 0 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
hpet0: 3 comparators, 64-bit 100.000000 MHz counter
Switching to clocksource hpet
FS-Cache: Loaded
CacheFiles: Loaded
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 7 devices
ACPI: ACPI bus type pnp unregistered
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 6, 262144 bytes)
TCP established hash table entries: 131072 (order: 9, 2097152 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
UDP hash table entries: 512 (order: 2, 16384 bytes)
UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
NET: Registered protocol family 1
RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
pci 0000:00:00.0: Limiting direct PCI/PCI transfers
pci 0000:00:01.0: PIIX3: Enabling Passive Release
pci 0000:00:01.0: Activating ISA DMA hang workarounds
has_svm: not amd
kvm: no hardware support
initcall svm_init+0x0/0x20 returned with error code -95 
audit: initializing netlink socket (disabled)
type=2000 audit(1326992053.972:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
FS-Cache: Netfs 'nfs' registered for caching
nfs4filelayout_init: NFSv4 File Layout Driver Registering...
Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
SGI XFS with ACLs, security attributes, realtime, large block/inode numbers, debug enabled
SGI XFS Quota Management subsystem
msgmni has been set to 1994
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10
Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Real Time Clock Driver v1.12b
Linux agpgart interface v0.103
FDC 0 is a S82078B
brd: module loaded
loop: module loaded
 vda: vda1
 vdb: unknown partition table
Uniform Multi-Platform E-IDE driver
ide-gd driver 1.18
ide-cd driver 5.00
tun: Universal TUN/TAP device driver, 1.6
tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
uhci_hcd 0000:00:01.2: UHCI Host Controller
uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c080
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
Initializing USB Mass Storage driver...
usbcore: registered new interface driver usb-storage
USB Mass Storage support registered.
usbcore: registered new interface driver usbserial
USB Serial support registered for generic
usbcore: registered new interface driver usbserial_generic
usbserial: USB Serial Driver core
i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mousedev: PS/2 mouse device common for all mice
input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
i2c /dev entries driver
md: raid1 personality registered for level 1
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@redhat.com
Refined TSC clocksource calibration: 2665.992 MHz.
Switching to clocksource tsc
device-mapper: multipath: version 1.3.0 loaded
device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: multipath queue-length: version 0.1.0 loaded
device-mapper: multipath service-time: version 0.2.0 loaded
device-mapper: dm-log-userspace: version 1.1.0 loaded
Modular ISDN core version 1.1.21
NET: Registered protocol family 34
cpuidle: using governor ladder
cpuidle: using governor menu
oprofile: using NMI interrupt.
nf_conntrack version 0.5.0 (7977 buckets, 31908 max)
ip_tables: (C) 2000-2006 Netfilter Core Team
TCP cubic registered
NET: Registered protocol family 10
Mobile IPv6
ip6_tables: (C) 2000-2006 Netfilter Core Team
IPv6 over IPv4 tunneling driver
NET: Registered protocol family 17
Registering the dns_resolver key type
initcall software_resume+0x0/0x25c returned with error code -2 
registered taskstats version 1
initcall kmemleak_late_init+0x0/0x8a returned with error code -12 
  Magic number: 12:982:944
tty ptyyf: hash matches
tty tty1: hash matches
initcall pci_mmcfg_late_insert_resources+0x0/0x54 returned with error code 1 
input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2
md: Waiting for all devices to be available before autodetect
md: If you don't use raid, use raid=noautodetect
md: Autodetecting RAID arrays.
md: Scanned 0 and added 0 devices.
md: autorun ...
md: ... autorun DONE.
kjournald starting.  Commit interval 5 seconds
EXT3-fs (vda1): mounted filesystem with writeback data mode
VFS: Mounted root (ext3 filesystem) readonly on device 253:1.
Freeing unused kernel memory: 612k freed
kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
BUG: unable to handle kernel paging request at ffffffff818b1287
IP: [<ffffffff818b1287>] kmemleak_late_init+0x8a/0x8a
PGD 17eb067 PUD 17ef063 PMD 3c602063 PTE 80000000018b1163
Oops: 0011 [#1] SMP 
CPU 0 
Modules linked in:

Pid: 1, comm: swapper/0 Not tainted 3.2.0-07907-g892d208 #3 Bochs Bochs
RIP: 0010:[<ffffffff818b1287>]  [<ffffffff818b1287>] kmemleak_late_init+0x8a/0x8a
RSP: 0018:ffff88003e273eb8  EFLAGS: 00010286
RAX: 0000000000000001 RBX: ffff88003e01de40 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff88003e01de40 RDI: 0000000000000002
RBP: ffff88003e014490 R08: ffff88003fbf6f40 R09: 0000000000000006
R10: 0000000000000000 R11: dead000000200200 R12: ffffea0000f80700
R13: ffffffff810f9bec R14: ffff88003e01de40 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff88003fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff818b1287 CR3: 00000000017e9000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper/0 (pid: 1, threadinfo ffff88003e272000, task ffff88003e278000)
Stack:
 ffffffff810fe9e9 0000000000000000 0000000000000000 ffff88003e278000
 0000000000000000 0000000000000000 ffffffff810f9bec 0000000000000000
 ffffffff8104d28c ffffffff8190fe20 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff810fe9e9>] ? kmem_cache_free+0x4f/0xd9
 [<ffffffff810f9bec>] ? do_set_mempolicy+0x10b/0x11b
 [<ffffffff8104d28c>] ? free_init_pages+0xfb/0x110
 [<ffffffff810001cf>] ? init_post+0x1d/0xbb
 [<ffffffff81894b93>] ? kernel_init+0x10f/0x113
 [<ffffffff81559f54>] ? kernel_thread_helper+0x4/0x10
 [<ffffffff81894a84>] ? start_kernel+0x319/0x319
 [<ffffffff81559f50>] ? gs_change+0xb/0xb
Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 
RIP  [<ffffffff818b1287>] kmemleak_late_init+0x8a/0x8a
 RSP <ffff88003e273eb8>
CR2: ffffffff818b1287
---[ end trace de4fdfae9d24382c ]---
kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
BUG: unable to handle kernel paging request at ffffffff818b1287
IP: [<ffffffff818b1287>] kmemleak_late_init+0x8a/0x8a
PGD 17eb067 PUD 17ef063 PMD 3c602063 PTE 80000000018b1163
Oops: 0011 [#2] SMP 
CPU 0 
Modules linked in:

Pid: 1, comm: swapper/0 Tainted: G      D      3.2.0-07907-g892d208 #3 Bochs Bochs
RIP: 0010:[<ffffffff818b1287>]  [<ffffffff818b1287>] kmemleak_late_init+0x8a/0x8a
RSP: 0018:ffff88003fc03e58  EFLAGS: 00010282
RAX: 0000000000000001 RBX: ffff88003cc94dc8 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff88003cc94dc8 RDI: 0000000000000002
RBP: ffffea0000f32500 R08: ffff88003fc0d840 R09: ffff88003fc125a0
R10: 0000000000000400 R11: ffffffff81571d95 R12: ffff88003e005680
R13: ffffffff810aa32f R14: 0000000000000000 R15: ffff88003d47ccc0
FS:  0000000000000000(0000) GS:ffff88003fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff818b1287 CR3: 00000000017e9000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper/0 (pid: 1, threadinfo ffff88003e272000, task ffff88003e278000)
Stack:
 ffffffff810febb4 0000000000000100 ffff88003fc0dab0 ffffffff81803900
 ffff88003cc95280 ffff88003fc0dae0 ffffffff810aa32f ffffffff819929e0
 0000000a81992de0 ffff88003e272000 ffff88003e278000 ffff88003fc03eb0
Call Trace:
 <IRQ> 
 [<ffffffff810febb4>] ? kfree+0xbc/0x11e
 [<ffffffff810aa32f>] ? __rcu_process_callbacks+0x1bf/0x2e2
 [<ffffffff810aa49c>] ? rcu_process_callbacks+0x4a/0x95
 [<ffffffff8105cb6a>] ? __do_softirq+0xb6/0x171
 [<ffffffff8155a04c>] ? call_softirq+0x1c/0x30
 [<ffffffff81032d85>] ? do_softirq+0x31/0x68
 [<ffffffff8105cdcf>] ? irq_exit+0x44/0x9e
 [<ffffffff81047f39>] ? smp_apic_timer_interrupt+0x85/0x95
 [<ffffffff8155970b>] ? apic_timer_interrupt+0x6b/0x70
 <EOI> 
 [<ffffffff81330f5f>] ? tty_audit_exit+0x4d/0x80
 [<ffffffff81330f34>] ? tty_audit_exit+0x22/0x80
 [<ffffffff8105a9a9>] ? do_exit+0x729/0x72e
 [<ffffffff8105899f>] ? kmsg_dump+0x40/0xcd
 [<ffffffff81553881>] ? oops_end+0x87/0x8e
 [<ffffffff818b1287>] ? kmemleak_late_init+0x8a/0x8a
 [<ffffffff8104de25>] ? 

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 17:43           ` Dirk Gouders
@ 2012-01-19 19:58             ` Dirk Gouders
  2012-01-19 20:52               ` Dirk Gouders
  0 siblings, 1 reply; 15+ messages in thread
From: Dirk Gouders @ 2012-01-19 19:58 UTC (permalink / raw)
  To: Catalin Marinas; +Cc: linux-kernel

Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de> writes:

> Catalin Marinas <catalin.marinas@arm.com> writes:
>
>> On Thu, Jan 19, 2012 at 02:38:01PM +0000, Dirk Gouders wrote:
>>> Catalin Marinas <catalin.marinas@arm.com> writes:
>>> > On Thu, Jan 19, 2012 at 12:16:56PM +0000, Dirk Gouders wrote:
>>> >> Catalin Marinas <catalin.marinas@arm.com> writes:
>>> >> > On Wed, Jan 18, 2012 at 07:32:59PM +0000, Dirk Gouders wrote:
>>> >> >> Freeing unused kernel memory: 608k freed
>>> >> >> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
>>> >> >> BUG: unable to handle kernel paging request at ffffffff818b232b
>>> >> >> IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>>> > ...
>>> >> >> Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
>>> >> >> RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>>> >> >
>>> >> > I don't really see how kmemleak could cause such error (or any of the
>>> >> > recent changes I have made). It looks like some of the code in the
>>> >> > .init.text section is not executable.
>>> >
>>> > Ah, the interesting part - 0xcc is the poison value for freed initmem.
>>> > And from the kernel logs you posted Linux frees the initmem and later
>>> > calls kmemleak_late_init() which should have been in the .init.text
>>> > section.
>>> >
>>> > The kmemleak_late_init() function is defined as:
>>> >
>>> > static int __init kmemleak_late_init(void)
>>> > {
>>> > ...
>>> > }
>>> > late_initcall(kmemleak_late_init);
>>> >
>>> > and it must *not* be called after the initmem has been freed. Was there
>>> > any change in the x86 or generic code with regards to the freeing of the
>>> > init memory?
>>> 
>>> I tried to re-bisect this problem by marking commit
>>> 029aeff5db879afd7760f11214b6fea45f76b58e
>>> "kmemleak: Add support for memory hotplug" (that I previously considered
>>> good, because it produces a different output) bad.  The attached output
>>> shows that kmemleak_late_init is also involved but bisect did not bring
>>> me a step further:
>>> 
>>> $ git bisect good f1c84dae0e
>>> Bisecting: a merge base must be tested
>>> [c3b92c8787367a8bb53d57d9789b558f1295cc96] Linux 3.1
>>
>> If you bisect to one of the kmemleak commits, they are based on 3.2-rc4
>> so you miss any commits that may have been merged during the merge
>> window.
>
> Hmm, I thought that the above was an error message but when I ignored it
> and just continued bisecting (whith a huge set of commits), it ended in:
>
> b66930052abf2e41b8a978ae265303917cbe6fa0 is the first bad commit
> commit b66930052abf2e41b8a978ae265303917cbe6fa0
> Author: Catalin Marinas <catalin.marinas@arm.com>
> Date:   Wed Sep 28 17:22:56 2011 +0100
>
>     kmemleak: When the early log buffer is exceeded, report the actual number
>     
>     Just telling that the early log buffer has been exceeded doesn't mean
>     much. This patch moves the error printing to the kmemleak_init()
>     function and displays the actual calls to the kmemleak API during early
>     logging.
>     
>     Signed-off-by: Catalin Marinas <catalin.marinas@arm.com>
>
> :040000 040000 6b16996be5be3f428eceb5ca8a153ac72f1848b3 246cccb0645241d4a1e1c392aaea3e2ea3e34da5 M      mm
>
>>> ------------------------------------------------------------------------
>>> Freeing unused kernel memory: 676k freed
>>> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
>>> BUG: unable to handle kernel paging request at ffffffff81892482
>>> IP: [<ffffffff81892482>] kmemleak_late_init+0x8a/0x8a
>>> PGD 17cd067 PUD 17d1063 PMD 3c5c8063 PTE 8000000001892163
>>> Oops: 0011 [#1] SMP 
>>
>> Similar behaviour, the init memory is freed before the initcalls, so
>> doesn't look like a kmemleak problem.
>>
>> Could you pass initcall_debug on the kernel command line and see how may
>> commits are called before and after the free_initmem() call?
>>
>> You could also try to revert (git revert) the kmemleak commits from the
>> latest git tree, without bisecting.
>
> OK, I added initcall_debug to a bad kernel I saved while bisecting and
> attach the console output of the serial console - the output on the
> graphical console was more complete.
>
> Further, I tested Linus' current master with b66930052abf2 reverted 
>
> ------------------------------------------------------------------------
> commit 27e8880932050e77d2822a19fb9f39230f6363e9
> Author: Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de>
> Date:   Thu Jan 19 18:31:40 2012 +0100
>
>     Revert "kmemleak: When the early log buffer is exceeded, report the actual number"
>     
>     This reverts commit b66930052abf2e41b8a978ae265303917cbe6fa0.
>
> commit ccb19d263fd1c9e34948e2158c53eacbff369344
> Merge: 6a48897 c3b5003
> Author: Linus Torvalds <torvalds@linux-foundation.org>
> Date:   Tue Jan 17 22:26:41 2012 -0800
> ------------------------------------------------------------------------
>
> and that kernel works here.

Hi Catlin,

I did some more testing and it turns out that I have to revert a single
line of commit b66930052abf2 to make the kernel boot:

diff --git a/mm/kmemleak.c b/mm/kmemleak.c
index c833add..d8bbb68 100644
--- a/mm/kmemleak.c
+++ b/mm/kmemleak.c
@@ -1710,6 +1710,7 @@ static void kmemleak_disable(void)
                return;
 
        /* stop any memory operation tracing */
+       atomic_set(&kmemleak_early_log, 0);
        atomic_set(&kmemleak_enabled, 0);
 
        /* check whether it is too early for a kernel thread */

I started that kernel with initcall_debug and attach the dmesg output.

Dirk

------------------------------------------------------------------------
Linux version 3.2.0-09104-gccb19d2-dirty (root@mx10) (gcc version 4.5.3 (Gentoo 4.5.3-r2 p1.0, pie-0.4.7) ) #22 SMP Thu Jan 19 20:48:50 CET 2012
Command line: root=/dev/vda1 console=ttyS0,115200 console=tty0 initcall_debug
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000009bc00 (usable)
 BIOS-e820: 000000000009bc00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 000000003fffd000 (usable)
 BIOS-e820: 000000003fffd000 - 0000000040000000 (reserved)
 BIOS-e820: 00000000feffc000 - 00000000ff000000 (reserved)
 BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
NX (Execute Disable) protection: active
DMI 2.4 present.
DMI: Bochs Bochs, BIOS Bochs 01/01/2007
e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
e820 remove range: 00000000000a0000 - 0000000000100000 (usable)
No AGP bridge found
last_pfn = 0x3fffd max_arch_pfn = 0x400000000
MTRR default type: write-back
MTRR fixed ranges enabled:
  00000-9FFFF write-back
  A0000-BFFFF uncachable
  C0000-FFFFF write-protect
MTRR variable ranges enabled:
  0 base 00E0000000 mask FFE0000000 uncachable
  1 disabled
  2 disabled
  3 disabled
  4 disabled
  5 disabled
  6 disabled
  7 disabled
PAT not supported by CPU.
found SMP MP-table at [ffff8800000fd5f0] fd5f0
initial memory mapped : 0 - 20000000
Base memory trampoline at [ffff880000096000] 96000 size 20480
init_memory_mapping: 0000000000000000-000000003fffd000
 0000000000 - 003fe00000 page 2M
 003fe00000 - 003fffd000 page 4k
kernel direct mapping tables up to 3fffd000 @ 1fffd000-20000000
ACPI: RSDP 00000000000fd460 00014 (v00 BOCHS )
ACPI: RSDT 000000003fffd740 00034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
ACPI: FACP 000000003fffff80 00074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)
ACPI: DSDT 000000003fffd9b0 02589 (v01   BXPC   BXDSDT 00000001 INTL 20100528)
ACPI: FACS 000000003fffff40 00040
ACPI: SSDT 000000003fffd8b0 000FF (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)
ACPI: APIC 000000003fffd7c0 0007A (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
ACPI: HPET 000000003fffd780 00038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
ACPI: Local APIC address 0xfee00000
No NUMA configuration found
Faking a node at 0000000000000000-000000003fffd000
Initmem setup node 0 0000000000000000-000000003fffd000
  NODE_DATA [000000003fff8000 - 000000003fffcfff]
 [ffffea0000000000-ffffea0000ffffff] PMD -> [ffff88003e600000-ffff88003f5fffff] on node 0
Zone PFN ranges:
  DMA      0x00000010 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   empty
Movable zone start PFN for each node
Early memory PFN ranges
    0: 0x00000010 -> 0x0000009b
    0: 0x00000100 -> 0x0003fffd
On node 0 totalpages: 262024
  DMA zone: 64 pages used for memmap
  DMA zone: 5 pages reserved
  DMA zone: 3910 pages, LIFO batch:0
  DMA32 zone: 4032 pages used for memmap
  DMA32 zone: 254013 pages, LIFO batch:31
ACPI: PM-Timer IO Port: 0xb008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ5 used by override.
ACPI: IRQ9 used by override.
ACPI: IRQ10 used by override.
ACPI: IRQ11 used by override.
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a201 base: 0xfed00000
SMP: Allowing 2 CPUs, 0 hotplug CPUs
nr_irqs_gsi: 40
PM: Registered nosave memory: 000000000009b000 - 000000000009c000
PM: Registered nosave memory: 000000000009c000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
Allocating PCI resources starting at 40000000 (gap: 40000000:beffc000)
setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:2 nr_node_ids:1
PERCPU: Embedded 26 pages/cpu @ffff88003fc00000 s77312 r8192 d20992 u1048576
pcpu-alloc: s77312 r8192 d20992 u1048576 alloc=1*2097152
pcpu-alloc: [0] 0 1 
Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257923
Policy zone: DMA32
Kernel command line: root=/dev/vda1 console=ttyS0,115200 console=tty0 initcall_debug
PID hash table entries: 4096 (order: 3, 32768 bytes)
Checking aperture...
No AGP bridge found
Memory: 1021000k/1048564k available (5533k kernel code, 468k absent, 27096k reserved, 3252k data, 604k init)
SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
Hierarchical RCU implementation.
NR_IRQS:4352 nr_irqs:512 16
Console: colour VGA+ 80x25
console [tty0] enabled
console [ttyS0] enabled
kmemleak: Kernel memory leak detector disabled
hpet clockevent registered
Fast TSC calibration failed
TSC: PIT calibration matches HPET. 2 loops
Detected 2665.818 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5331.63 BogoMIPS (lpj=10663272)
pid_max: default: 32768 minimum: 301
Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
Mount-cache hash table entries: 256
mce: CPU supports 10 MCE banks
ACPI: Core revision 20110623
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel QEMU Virtual CPU version 0.15.1 stepping 03
APIC calibration not consistent with PM-Timer: 103ms instead of 100ms
APIC delta adjusted to PM-Timer: 6250338 (6495757)
calling  trace_init_flags_sys_exit+0x0/0xd @ 1
initcall trace_init_flags_sys_exit+0x0/0xd returned 0 after 0 usecs
calling  trace_init_flags_sys_enter+0x0/0xd @ 1
initcall trace_init_flags_sys_enter+0x0/0xd returned 0 after 0 usecs
calling  init_hw_perf_events+0x0/0x30d @ 1
Performance Events: unsupported p6 CPU model 2 no PMU driver, software events only.
initcall init_hw_perf_events+0x0/0x30d returned 0 after 0 usecs
calling  spawn_ksoftirqd+0x0/0x4a @ 1
initcall spawn_ksoftirqd+0x0/0x4a returned 0 after 0 usecs
calling  init_workqueues+0x0/0x2f8 @ 1
initcall init_workqueues+0x0/0x2f8 returned 0 after 0 usecs
calling  migration_init+0x0/0x65 @ 1
initcall migration_init+0x0/0x65 returned 0 after 0 usecs
calling  cpu_stop_init+0x0/0xa3 @ 1
initcall cpu_stop_init+0x0/0xa3 returned 0 after 0 usecs
calling  rcu_scheduler_really_started+0x0/0xd @ 1
initcall rcu_scheduler_really_started+0x0/0xd returned 0 after 0 usecs
calling  relay_init+0x0/0x17 @ 1
initcall relay_init+0x0/0x17 returned 0 after 0 usecs
calling  tracer_alloc_buffers+0x0/0x16a @ 1
initcall tracer_alloc_buffers+0x0/0x16a returned 0 after 0 usecs
calling  init_trace_printk+0x0/0x14 @ 1
initcall init_trace_printk+0x0/0x14 returned 0 after 0 usecs
Booting Node   0, Processors  #1 Ok.
smpboot cpu 1: start_ip = 96000
Brought up 2 CPUs
Total of 2 processors activated (10663.68 BogoMIPS).
calling  ipc_ns_init+0x0/0x4b @ 1
initcall ipc_ns_init+0x0/0x4b returned 0 after 0 usecs
calling  init_mmap_min_addr+0x0/0x11 @ 1
initcall init_mmap_min_addr+0x0/0x11 returned 0 after 0 usecs
calling  init_cpufreq_transition_notifier_list+0x0/0x1e @ 1
initcall init_cpufreq_transition_notifier_list+0x0/0x1e returned 0 after 0 usecs
calling  net_ns_init+0x0/0x161 @ 1
initcall net_ns_init+0x0/0x161 returned 0 after 0 usecs
calling  e820_mark_nvs_memory+0x0/0x36 @ 1
initcall e820_mark_nvs_memory+0x0/0x36 returned 0 after 0 usecs
calling  cpufreq_tsc+0x0/0x33 @ 1
initcall cpufreq_tsc+0x0/0x33 returned 0 after 0 usecs
calling  pci_reboot_init+0x0/0x17 @ 1
initcall pci_reboot_init+0x0/0x17 returned 0 after 0 usecs
calling  init_lapic_sysfs+0x0/0x23 @ 1
initcall init_lapic_sysfs+0x0/0x23 returned 0 after 0 usecs
calling  init_smp_flush+0x0/0x35 @ 1
initcall init_smp_flush+0x0/0x35 returned 0 after 0 usecs
calling  cpu_hotplug_pm_sync_init+0x0/0x17 @ 1
initcall cpu_hotplug_pm_sync_init+0x0/0x17 returned 0 after 0 usecs
calling  alloc_frozen_cpus+0x0/0x3 @ 1
initcall alloc_frozen_cpus+0x0/0x3 returned 0 after 0 usecs
calling  sysctl_init+0x0/0x35 @ 1
initcall sysctl_init+0x0/0x35 returned 0 after 0 usecs
calling  ksysfs_init+0x0/0x8a @ 1
initcall ksysfs_init+0x0/0x8a returned 0 after 0 usecs
calling  pm_init+0x0/0x6b @ 1
initcall pm_init+0x0/0x6b returned 0 after 0 usecs
calling  pm_disk_init+0x0/0x1b @ 1
initcall pm_disk_init+0x0/0x1b returned 0 after 0 usecs
calling  swsusp_header_init+0x0/0x2f @ 1
initcall swsusp_header_init+0x0/0x2f returned 0 after 0 usecs
calling  init_jiffies_clocksource+0x0/0x14 @ 1
initcall init_jiffies_clocksource+0x0/0x14 returned 0 after 0 usecs
calling  init_zero_pfn+0x0/0x22 @ 1
initcall init_zero_pfn+0x0/0x22 returned 0 after 0 usecs
calling  fsnotify_init+0x0/0x29 @ 1
initcall fsnotify_init+0x0/0x29 returned 0 after 0 usecs
calling  filelock_init+0x0/0x2d @ 1
initcall filelock_init+0x0/0x2d returned 0 after 0 usecs
calling  init_script_binfmt+0x0/0x16 @ 1
initcall init_script_binfmt+0x0/0x16 returned 0 after 0 usecs
calling  init_elf_binfmt+0x0/0x16 @ 1
initcall init_elf_binfmt+0x0/0x16 returned 0 after 0 usecs
calling  init_compat_elf_binfmt+0x0/0x16 @ 1
initcall init_compat_elf_binfmt+0x0/0x16 returned 0 after 0 usecs
calling  debugfs_init+0x0/0x5d @ 1
initcall debugfs_init+0x0/0x5d returned 0 after 0 usecs
calling  random32_init+0x0/0xcb @ 1
initcall random32_init+0x0/0xcb returned 0 after 0 usecs
calling  virtio_init+0x0/0x30 @ 1
initcall virtio_init+0x0/0x30 returned 0 after 0 usecs
calling  early_resume_init+0x0/0x16 @ 1
RTC time: 19:51:00, date: 01/19/12
initcall early_resume_init+0x0/0x16 returned 0 after 0 usecs
calling  cpufreq_core_init+0x0/0xb2 @ 1
initcall cpufreq_core_init+0x0/0xb2 returned 0 after 0 usecs
calling  cpuidle_init+0x0/0x36 @ 1
initcall cpuidle_init+0x0/0x36 returned 0 after 0 usecs
calling  sock_init+0x0/0x79 @ 1
initcall sock_init+0x0/0x79 returned 0 after 0 usecs
calling  netlink_proto_init+0x0/0x1a6 @ 1
NET: Registered protocol family 16
initcall netlink_proto_init+0x0/0x1a6 returned 0 after 0 usecs
calling  bdi_class_init+0x0/0x4c @ 1
initcall bdi_class_init+0x0/0x4c returned 0 after 0 usecs
calling  kobject_uevent_init+0x0/0x23 @ 1
initcall kobject_uevent_init+0x0/0x23 returned 0 after 0 usecs
calling  pcibus_class_init+0x0/0x1b @ 1
initcall pcibus_class_init+0x0/0x1b returned 0 after 3906 usecs
calling  pci_driver_init+0x0/0x1b @ 1
initcall pci_driver_init+0x0/0x1b returned 0 after 0 usecs
calling  tty_class_init+0x0/0x37 @ 1
initcall tty_class_init+0x0/0x37 returned 0 after 0 usecs
calling  vtconsole_class_init+0x0/0xea @ 1
initcall vtconsole_class_init+0x0/0xea returned 0 after 0 usecs
calling  wakeup_sources_debugfs_init+0x0/0x2e @ 1
initcall wakeup_sources_debugfs_init+0x0/0x2e returned 0 after 0 usecs
calling  register_node_type+0x0/0x1b @ 1
initcall register_node_type+0x0/0x1b returned 0 after 0 usecs
calling  i2c_init+0x0/0x79 @ 1
initcall i2c_init+0x0/0x79 returned 0 after 3906 usecs
calling  amd_postcore_init+0x0/0x1e @ 1
initcall amd_postcore_init+0x0/0x1e returned 0 after 0 usecs
calling  arch_kdebugfs_init+0x0/0x27 @ 1
initcall arch_kdebugfs_init+0x0/0x27 returned 0 after 0 usecs
calling  configure_trampolines+0x0/0x2c @ 1
initcall configure_trampolines+0x0/0x2c returned 0 after 0 usecs
calling  mtrr_if_init+0x0/0x67 @ 1
initcall mtrr_if_init+0x0/0x67 returned 0 after 0 usecs
calling  ffh_cstate_init+0x0/0x2d @ 1
initcall ffh_cstate_init+0x0/0x2d returned 0 after 0 usecs
calling  acpi_pci_init+0x0/0x5f @ 1
ACPI: bus type pci registered
initcall acpi_pci_init+0x0/0x5f returned 0 after 0 usecs
calling  dmi_id_init+0x0/0xcd @ 1
initcall dmi_id_init+0x0/0xcd returned 0 after 0 usecs
calling  pci_arch_init+0x0/0x5f @ 1
PCI: Using configuration type 1 for base access
initcall pci_arch_init+0x0/0x5f returned 0 after 0 usecs
calling  topology_init+0x0/0x8d @ 1
initcall topology_init+0x0/0x8d returned 0 after 3906 usecs
calling  mtrr_init_finialize+0x0/0x39 @ 1
initcall mtrr_init_finialize+0x0/0x39 returned 0 after 0 usecs
calling  init_vdso+0x0/0x84 @ 1
initcall init_vdso+0x0/0x84 returned 0 after 0 usecs
calling  sysenter_setup+0x0/0xa4 @ 1
initcall sysenter_setup+0x0/0xa4 returned 0 after 0 usecs
calling  param_sysfs_init+0x0/0x121 @ 1
initcall param_sysfs_init+0x0/0x121 returned 0 after 50784 usecs
calling  pm_sysrq_init+0x0/0x1c @ 1
initcall pm_sysrq_init+0x0/0x1c returned 0 after 0 usecs
calling  default_bdi_init+0x0/0x9d @ 1
initcall default_bdi_init+0x0/0x9d returned 0 after 0 usecs
calling  init_bio+0x0/0xe5 @ 1
bio: create slab <bio-0> at 0
initcall init_bio+0x0/0xe5 returned 0 after 3906 usecs
calling  fsnotify_notification_init+0x0/0x8a @ 1
initcall fsnotify_notification_init+0x0/0x8a returned 0 after 0 usecs
calling  cryptomgr_init+0x0/0x14 @ 1
initcall cryptomgr_init+0x0/0x14 returned 0 after 0 usecs
calling  blk_settings_init+0x0/0x25 @ 1
initcall blk_settings_init+0x0/0x25 returned 0 after 0 usecs
calling  blk_ioc_init+0x0/0x2d @ 1
initcall blk_ioc_init+0x0/0x2d returned 0 after 0 usecs
calling  blk_softirq_init+0x0/0x6f @ 1
initcall blk_softirq_init+0x0/0x6f returned 0 after 0 usecs
calling  blk_iopoll_setup+0x0/0x6f @ 1
initcall blk_iopoll_setup+0x0/0x6f returned 0 after 0 usecs
calling  genhd_device_init+0x0/0x71 @ 1
initcall genhd_device_init+0x0/0x71 returned 0 after 0 usecs
calling  pci_slot_init+0x0/0x49 @ 1
initcall pci_slot_init+0x0/0x49 returned 0 after 0 usecs
calling  acpi_init+0x0/0xb1 @ 1
ACPI: Added _OSI(Module Device)
ACPI: Added _OSI(Processor Device)
ACPI: Added _OSI(3.0 _SCP Extensions)
ACPI: Added _OSI(Processor Aggregator Device)
ACPI: EC: Look up EC in DSDT
ACPI: Interpreter enabled
ACPI: (supports S0 S3 S4 S5)
ACPI: Using IOAPIC for interrupt routing
initcall acpi_init+0x0/0xb1 returned 0 after 156259 usecs
calling  dock_init+0x0/0xa4 @ 1
ACPI: No dock devices found.
initcall dock_init+0x0/0xa4 returned 0 after 7812 usecs
calling  acpi_pci_root_init+0x0/0x2b @ 1
PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
pci_root PNP0A03:00: host bridge window [io  0x0000-0x0cf7] (ignored)
pci_root PNP0A03:00: host bridge window [io  0x0d00-0xffff] (ignored)
pci_root PNP0A03:00: host bridge window [mem 0x000a0000-0x000bffff] (ignored)
pci_root PNP0A03:00: host bridge window [mem 0xe0000000-0xfebfffff] (ignored)
PCI: root bus 00: using default resources
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
pci_bus 0000:00: root bus resource [mem 0x00000000-0xffffffffff]
pci 0000:00:00.0: [8086:1237] type 0 class 0x000600
pci 0000:00:01.0: [8086:7000] type 0 class 0x000601
pci 0000:00:01.1: [8086:7010] type 0 class 0x000101
pci 0000:00:01.1: reg 20: [io  0xc0e0-0xc0ef]
pci 0000:00:01.2: [8086:7020] type 0 class 0x000c03
pci 0000:00:01.2: reg 20: [io  0xc080-0xc09f]
pci 0000:00:01.3: [8086:7113] type 0 class 0x000680
pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
pci 0000:00:01.3: quirk: [io  0xb100-0xb10f] claimed by PIIX4 SMB
pci 0000:00:02.0: [1013:00b8] type 0 class 0x000300
pci 0000:00:02.0: reg 10: [mem 0xfc000000-0xfdffffff pref]
pci 0000:00:02.0: reg 14: [mem 0xfebf4000-0xfebf4fff]
pci 0000:00:02.0: reg 30: [mem 0xfebd0000-0xfebdffff pref]
pci 0000:00:03.0: [1af4:1000] type 0 class 0x000200
pci 0000:00:03.0: reg 10: [io  0xc0a0-0xc0bf]
pci 0000:00:03.0: reg 14: [mem 0xfebf5000-0xfebf5fff]
pci 0000:00:03.0: reg 30: [mem 0xfebe0000-0xfebeffff pref]
pci 0000:00:04.0: [8086:2668] type 0 class 0x000403
pci 0000:00:04.0: reg 10: [mem 0xfebf0000-0xfebf3fff]
pci 0000:00:05.0: [1af4:1002] type 0 class 0x000500
pci 0000:00:05.0: reg 10: [io  0xc0c0-0xc0df]
pci 0000:00:06.0: [1af4:1001] type 0 class 0x000100
pci 0000:00:06.0: reg 10: [io  0xc000-0xc03f]
pci 0000:00:06.0: reg 14: [mem 0xfebf6000-0xfebf6fff]
pci 0000:00:07.0: [1af4:1001] type 0 class 0x000100
pci 0000:00:07.0: reg 10: [io  0xc040-0xc07f]
pci 0000:00:07.0: reg 14: [mem 0xfebf7000-0xfebf7fff]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
 pci0000:00: Unable to request _OSC control (_OSC support mask: 0x1e)
initcall acpi_pci_root_init+0x0/0x2b returned 0 after 312519 usecs
calling  acpi_pci_link_init+0x0/0x41 @ 1
ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
ACPI: PCI Interrupt Link [LNKS] (IRQs 9) *0
initcall acpi_pci_link_init+0x0/0x41 returned 0 after 15625 usecs
calling  pnp_init+0x0/0x1b @ 1
initcall pnp_init+0x0/0x1b returned 0 after 0 usecs
calling  misc_init+0x0/0xad @ 1
initcall misc_init+0x0/0xad returned 0 after 3906 usecs
calling  vga_arb_device_init+0x0/0xd4 @ 1
vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:00:02.0
initcall vga_arb_device_init+0x0/0xd4 returned 0 after 3906 usecs
calling  cn_init+0x0/0xa1 @ 1
initcall cn_init+0x0/0xa1 returned 0 after 0 usecs
calling  init_scsi+0x0/0x77 @ 1
SCSI subsystem initialized
initcall init_scsi+0x0/0x77 returned 0 after 3906 usecs
calling  ata_init+0x0/0x53 @ 1
libata version 3.00 loaded.
initcall ata_init+0x0/0x53 returned 0 after 0 usecs
calling  usb_init+0x0/0x170 @ 1
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
initcall usb_init+0x0/0x170 returned 0 after 3906 usecs
calling  serio_init+0x0/0x2e @ 1
initcall serio_init+0x0/0x2e returned 0 after 0 usecs
calling  input_init+0x0/0x102 @ 1
initcall input_init+0x0/0x102 returned 0 after 0 usecs
calling  power_supply_class_init+0x0/0x43 @ 1
initcall power_supply_class_init+0x0/0x43 returned 0 after 0 usecs
calling  hwmon_init+0x0/0x4a @ 1
initcall hwmon_init+0x0/0x4a returned 0 after 0 usecs
calling  md_init+0x0/0x13d @ 1
initcall md_init+0x0/0x13d returned 0 after 0 usecs
calling  leds_init+0x0/0x47 @ 1
initcall leds_init+0x0/0x47 returned 0 after 0 usecs
calling  init_soundcore+0x0/0x85 @ 1
initcall init_soundcore+0x0/0x85 returned 0 after 0 usecs
calling  pci_subsys_init+0x0/0x43 @ 1
PCI: Using ACPI for IRQ routing
PCI: pci_cache_line_size set to 64 bytes
reserve RAM buffer: 000000000009bc00 - 000000000009ffff 
reserve RAM buffer: 000000003fffd000 - 000000003fffffff 
initcall pci_subsys_init+0x0/0x43 returned 0 after 3906 usecs
calling  proto_init+0x0/0x14 @ 1
initcall proto_init+0x0/0x14 returned 0 after 0 usecs
calling  net_dev_init+0x0/0x1d9 @ 1
initcall net_dev_init+0x0/0x1d9 returned 0 after 0 usecs
calling  neigh_init+0x0/0x83 @ 1
initcall neigh_init+0x0/0x83 returned 0 after 0 usecs
calling  fib_rules_init+0x0/0xa5 @ 1
initcall fib_rules_init+0x0/0xa5 returned 0 after 0 usecs
calling  genl_init+0x0/0x96 @ 1
initcall genl_init+0x0/0x96 returned 0 after 0 usecs
calling  bt_init+0x0/0xa9 @ 1
Bluetooth: Core ver 2.16
NET: Registered protocol family 31
Bluetooth: HCI device and connection manager initialized
Bluetooth: HCI socket layer initialized
Bluetooth: L2CAP socket layer initialized
Bluetooth: SCO socket layer initialized
initcall bt_init+0x0/0xa9 returned 0 after 7812 usecs
calling  sysctl_init+0x0/0x49 @ 1
initcall sysctl_init+0x0/0x49 returned 0 after 0 usecs
calling  hpet_late_init+0x0/0xf5 @ 1
HPET: 3 timers in total, 0 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
hpet0: 3 comparators, 64-bit 100.000000 MHz counter
initcall hpet_late_init+0x0/0xf5 returned 0 after 7812 usecs
calling  init_amd_nbs+0x0/0x35 @ 1
initcall init_amd_nbs+0x0/0x35 returned 0 after 0 usecs
calling  clocksource_done_booting+0x0/0x5d @ 1
Switching to clocksource hpet
initcall clocksource_done_booting+0x0/0x5d returned 0 after 7828 usecs
calling  rb_init_debugfs+0x0/0x32 @ 1
initcall rb_init_debugfs+0x0/0x32 returned 0 after 68 usecs
calling  tracer_init_debugfs+0x0/0x381 @ 1
initcall tracer_init_debugfs+0x0/0x381 returned 0 after 731 usecs
calling  init_trace_printk_function_export+0x0/0x32 @ 1
initcall init_trace_printk_function_export+0x0/0x32 returned 0 after 19 usecs
calling  event_trace_init+0x0/0x1b7 @ 1
initcall event_trace_init+0x0/0x1b7 returned 0 after 52422 usecs
calling  init_kprobe_trace+0x0/0x91 @ 1
initcall init_kprobe_trace+0x0/0x91 returned 0 after 36 usecs
calling  init_pipe_fs+0x0/0x42 @ 1
initcall init_pipe_fs+0x0/0x42 returned 0 after 96 usecs
calling  eventpoll_init+0x0/0xd7 @ 1
initcall eventpoll_init+0x0/0xd7 returned 0 after 48 usecs
calling  anon_inode_init+0x0/0x10b @ 1
initcall anon_inode_init+0x0/0x10b returned 0 after 53 usecs
calling  fscache_init+0x0/0x1e4 @ 1
FS-Cache: Loaded
initcall fscache_init+0x0/0x1e4 returned 0 after 857 usecs
calling  cachefiles_init+0x0/0x83 @ 1
CacheFiles: Loaded
initcall cachefiles_init+0x0/0x83 returned 0 after 1212 usecs
calling  blk_scsi_ioctl_init+0x0/0x8 @ 1
initcall blk_scsi_ioctl_init+0x0/0x8 returned 0 after 6 usecs
calling  acpi_event_init+0x0/0x80 @ 1
initcall acpi_event_init+0x0/0x80 returned 0 after 56 usecs
calling  pnp_system_init+0x0/0x14 @ 1
initcall pnp_system_init+0x0/0x14 returned 0 after 255 usecs
calling  pnpacpi_init+0x0/0x8f @ 1
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp 00:00: [bus 00-ff]
pnp 00:00: [io  0x0cf8-0x0cff]
pnp 00:00: [io  0x0000-0x0cf7 window]
pnp 00:00: [io  0x0d00-0xffff window]
pnp 00:00: [mem 0x000a0000-0x000bffff window]
pnp 00:00: [mem 0xe0000000-0xfebfffff window]
pnp 00:00: Plug and Play ACPI device, IDs PNP0a03 (active)
pnp 00:01: [io  0x0070-0x0071]
pnp 00:01: [irq 8]
pnp 00:01: [io  0x0072-0x0077]
pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
pnp 00:02: [io  0x0060]
pnp 00:02: [io  0x0064]
pnp 00:02: [irq 1]
pnp 00:02: Plug and Play ACPI device, IDs PNP0303 (active)
pnp 00:03: [irq 12]
pnp 00:03: Plug and Play ACPI device, IDs PNP0f13 (active)
pnp 00:04: [io  0x03f2-0x03f5]
pnp 00:04: [io  0x03f7]
pnp 00:04: [irq 6]
pnp 00:04: [dma 2]
pnp 00:04: Plug and Play ACPI device, IDs PNP0700 (active)
pnp 00:05: [io  0x03f8-0x03ff]
pnp 00:05: [irq 4]
pnp 00:05: Plug and Play ACPI device, IDs PNP0501 (active)
pnp 00:06: [mem 0xfed00000-0xfed003ff]
pnp 00:06: Plug and Play ACPI device, IDs PNP0103 (active)
pnp: PnP ACPI: found 7 devices
ACPI: ACPI bus type pnp unregistered
initcall pnpacpi_init+0x0/0x8f returned 0 after 25367 usecs
calling  chr_dev_init+0x0/0xc8 @ 1
initcall chr_dev_init+0x0/0xc8 returned 0 after 48000 usecs
calling  firmware_class_init+0x0/0x1b @ 1
initcall firmware_class_init+0x0/0x1b returned 0 after 284 usecs
calling  thermal_init+0x0/0x6b @ 1
initcall thermal_init+0x0/0x6b returned 0 after 310 usecs
calling  cpufreq_gov_performance_init+0x0/0x14 @ 1
initcall cpufreq_gov_performance_init+0x0/0x14 returned 0 after 16 usecs
calling  init_acpi_pm_clocksource+0x0/0xdb @ 1
initcall init_acpi_pm_clocksource+0x0/0xdb returned 0 after 4589 usecs
calling  pcibios_assign_resources+0x0/0x6a @ 1
PCI: max bus depth: 0 pci_try_num: 1
pci_bus 0000:00: resource 4 [io  0x0000-0xffff]
pci_bus 0000:00: resource 5 [mem 0x00000000-0xffffffffff]
initcall pcibios_assign_resources+0x0/0x6a returned 0 after 123 usecs
calling  sysctl_core_init+0x0/0x3a @ 1
initcall sysctl_core_init+0x0/0x3a returned 0 after 37 usecs
calling  inet_init+0x0/0x27a @ 1
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 6, 262144 bytes)
TCP established hash table entries: 131072 (order: 9, 2097152 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
UDP hash table entries: 512 (order: 2, 16384 bytes)
UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
initcall inet_init+0x0/0x27a returned 0 after 15286 usecs
calling  af_unix_init+0x0/0x4b @ 1
NET: Registered protocol family 1
initcall af_unix_init+0x0/0x4b returned 0 after 994 usecs
calling  init_sunrpc+0x0/0x69 @ 1
RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
initcall init_sunrpc+0x0/0x69 returned 0 after 5065 usecs
calling  pci_apply_final_quirks+0x0/0xfe @ 1
pci 0000:00:00.0: Limiting direct PCI/PCI transfers
pci 0000:00:01.0: PIIX3: Enabling Passive Release
pci 0000:00:01.0: Activating ISA DMA hang workarounds
pci 0000:00:02.0: Boot video device
PCI: CLS 0 bytes, default 64
initcall pci_apply_final_quirks+0x0/0xfe returned 0 after 3649 usecs
calling  populate_rootfs+0x0/0xc8 @ 1
initcall populate_rootfs+0x0/0xc8 returned 0 after 327 usecs
calling  pci_iommu_init+0x0/0x37 @ 1
initcall pci_iommu_init+0x0/0x37 returned 0 after 12 usecs
calling  irqfd_module_init+0x0/0x36 @ 1
initcall irqfd_module_init+0x0/0x36 returned 0 after 137 usecs
calling  svm_init+0x0/0x20 @ 1
has_svm: not amd
kvm: no hardware support
initcall svm_init+0x0/0x20 returned -95 after 1497 usecs
initcall svm_init+0x0/0x20 returned with error code -95 
calling  i8259A_init_ops+0x0/0x24 @ 1
initcall i8259A_init_ops+0x0/0x24 returned 0 after 6 usecs
calling  vsyscall_init+0x0/0x2a @ 1
initcall vsyscall_init+0x0/0x2a returned 0 after 41 usecs
calling  sbf_init+0x0/0xea @ 1
initcall sbf_init+0x0/0xea returned 0 after 5 usecs
calling  init_tsc_clocksource+0x0/0x62 @ 1
initcall init_tsc_clocksource+0x0/0x62 returned 0 after 7 usecs
calling  add_rtc_cmos+0x0/0x98 @ 1
initcall add_rtc_cmos+0x0/0x98 returned 0 after 11 usecs
calling  i8237A_init_ops+0x0/0x17 @ 1
initcall i8237A_init_ops+0x0/0x17 returned 0 after 19 usecs
calling  cache_sysfs_init+0x0/0x62 @ 1
initcall cache_sysfs_init+0x0/0x62 returned 0 after 391 usecs
calling  mcheck_init_device+0x0/0xf0 @ 1
initcall mcheck_init_device+0x0/0xf0 returned 0 after 4270 usecs
calling  threshold_init_device+0x0/0x4d @ 1
initcall threshold_init_device+0x0/0x4d returned 0 after 10 usecs
calling  thermal_throttle_init_device+0x0/0x8c @ 1
initcall thermal_throttle_init_device+0x0/0x8c returned 0 after 5 usecs
calling  amd_ibs_init+0x0/0x1c6 @ 1
initcall amd_ibs_init+0x0/0x1c6 returned -19 after 10 usecs
calling  msr_init+0x0/0x114 @ 1
initcall msr_init+0x0/0x114 returned 0 after 830 usecs
calling  cpuid_init+0x0/0x114 @ 1
initcall cpuid_init+0x0/0x114 returned 0 after 806 usecs
calling  ioapic_init_ops+0x0/0x17 @ 1
initcall ioapic_init_ops+0x0/0x17 returned 0 after 6 usecs
calling  add_pcspkr+0x0/0x65 @ 1
initcall add_pcspkr+0x0/0x65 returned 0 after 278 usecs
calling  audit_classes_init+0x0/0xb2 @ 1
initcall audit_classes_init+0x0/0xb2 returned 0 after 45 usecs
calling  ia32_binfmt_init+0x0/0x17 @ 1
initcall ia32_binfmt_init+0x0/0x17 returned 0 after 18 usecs
calling  init_aout_binfmt+0x0/0x16 @ 1
initcall init_aout_binfmt+0x0/0x16 returned 0 after 6 usecs
calling  proc_execdomains_init+0x0/0x25 @ 1
initcall proc_execdomains_init+0x0/0x25 returned 0 after 35 usecs
calling  ioresources_init+0x0/0x3f @ 1
initcall ioresources_init+0x0/0x3f returned 0 after 25 usecs
calling  uid_cache_init+0x0/0x8b @ 1
initcall uid_cache_init+0x0/0x8b returned 0 after 31 usecs
calling  init_posix_timers+0x0/0x1cd @ 1
initcall init_posix_timers+0x0/0x1cd returned 0 after 26 usecs
calling  init_posix_cpu_timers+0x0/0xc8 @ 1
initcall init_posix_cpu_timers+0x0/0xc8 returned 0 after 5 usecs
calling  snapshot_device_init+0x0/0x14 @ 1
initcall snapshot_device_init+0x0/0x14 returned 0 after 281 usecs
calling  create_proc_profile+0x0/0x61 @ 1
initcall create_proc_profile+0x0/0x61 returned 0 after 5 usecs
calling  timekeeping_init_ops+0x0/0x17 @ 1
initcall timekeeping_init_ops+0x0/0x17 returned 0 after 5 usecs
calling  init_clocksource_sysfs+0x0/0x59 @ 1
initcall init_clocksource_sysfs+0x0/0x59 returned 0 after 810 usecs
calling  init_timer_list_procfs+0x0/0x2f @ 1
initcall init_timer_list_procfs+0x0/0x2f returned 0 after 21 usecs
calling  alarmtimer_init+0x0/0x197 @ 1
initcall alarmtimer_init+0x0/0x197 returned 0 after 1240 usecs
calling  init_tstats_procfs+0x0/0x2f @ 1
initcall init_tstats_procfs+0x0/0x2f returned 0 after 28 usecs
calling  futex_init+0x0/0x5f @ 1
initcall futex_init+0x0/0x5f returned 0 after 46 usecs
calling  proc_dma_init+0x0/0x25 @ 1
initcall proc_dma_init+0x0/0x25 returned 0 after 17 usecs
calling  proc_modules_init+0x0/0x25 @ 1
initcall proc_modules_init+0x0/0x25 returned 0 after 16 usecs
calling  kallsyms_init+0x0/0x28 @ 1
initcall kallsyms_init+0x0/0x28 returned 0 after 16 usecs
calling  ikconfig_init+0x0/0x3d @ 1
initcall ikconfig_init+0x0/0x3d returned 0 after 16 usecs
calling  audit_init+0x0/0x143 @ 1
audit: initializing netlink socket (disabled)
type=2000 audit(1327002660.000:1): initialized
initcall audit_init+0x0/0x143 returned 0 after 2550 usecs
calling  audit_watch_init+0x0/0x3d @ 1
initcall audit_watch_init+0x0/0x3d returned 0 after 16 usecs
calling  audit_tree_init+0x0/0x5b @ 1
initcall audit_tree_init+0x0/0x5b returned 0 after 46 usecs
calling  init_kprobes+0x0/0x170 @ 1
initcall init_kprobes+0x0/0x170 returned 0 after 42385 usecs
calling  hung_task_init+0x0/0x4c @ 1
initcall hung_task_init+0x0/0x4c returned 0 after 229 usecs
calling  irq_pm_init_ops+0x0/0x17 @ 1
initcall irq_pm_init_ops+0x0/0x17 returned 0 after 8 usecs
calling  utsname_sysctl_init+0x0/0x17 @ 1
initcall utsname_sysctl_init+0x0/0x17 returned 0 after 32 usecs
calling  init_tracepoints+0x0/0x14 @ 1
initcall init_tracepoints+0x0/0x14 returned 0 after 7 usecs
calling  init_events+0x0/0x60 @ 1
initcall init_events+0x0/0x60 returned 0 after 11 usecs
calling  perf_event_sysfs_init+0x0/0x99 @ 1
initcall perf_event_sysfs_init+0x0/0x99 returned 0 after 1582 usecs
calling  init_per_zone_wmark_min+0x0/0x7e @ 1
initcall init_per_zone_wmark_min+0x0/0x7e returned 0 after 1643 usecs
calling  kswapd_init+0x0/0x6f @ 1
initcall kswapd_init+0x0/0x6f returned 0 after 223 usecs
calling  setup_vmstat+0x0/0xbe @ 1
initcall setup_vmstat+0x0/0xbe returned 0 after 67 usecs
calling  mm_sysfs_init+0x0/0x2c @ 1
initcall mm_sysfs_init+0x0/0x2c returned 0 after 29 usecs
calling  proc_vmalloc_init+0x0/0x28 @ 1
initcall proc_vmalloc_init+0x0/0x28 returned 0 after 22 usecs
calling  procswaps_init+0x0/0x25 @ 1
initcall procswaps_init+0x0/0x25 returned 0 after 21 usecs
calling  hugetlb_init+0x0/0x25c @ 1
HugeTLB registered 2 MB page size, pre-allocated 0 pages
initcall hugetlb_init+0x0/0x25c returned 0 after 1970 usecs
calling  slab_proc_init+0x0/0x28 @ 1
initcall slab_proc_init+0x0/0x28 returned 0 after 22 usecs
calling  slab_sysfs_init+0x0/0xfa @ 1
initcall slab_sysfs_init+0x0/0xfa returned 0 after 50377 usecs
calling  fcntl_init+0x0/0x2d @ 1
initcall fcntl_init+0x0/0x2d returned 0 after 405 usecs
calling  proc_filesystems_init+0x0/0x25 @ 1
initcall proc_filesystems_init+0x0/0x25 returned 0 after 24 usecs
calling  dio_init+0x0/0x30 @ 1
initcall dio_init+0x0/0x30 returned 0 after 370 usecs
calling  fsnotify_mark_init+0x0/0x43 @ 1
initcall fsnotify_mark_init+0x0/0x43 returned 0 after 138 usecs
calling  dnotify_init+0x0/0x7e @ 1
initcall dnotify_init+0x0/0x7e returned 0 after 727 usecs
calling  inotify_user_setup+0x0/0x73 @ 1
initcall inotify_user_setup+0x0/0x73 returned 0 after 726 usecs
calling  aio_setup+0x0/0x7d @ 1
initcall aio_setup+0x0/0x7d returned 0 after 1533 usecs
calling  proc_locks_init+0x0/0x25 @ 1
initcall proc_locks_init+0x0/0x25 returned 0 after 19 usecs
calling  init_sys32_ioctl+0x0/0x2b @ 1
initcall init_sys32_ioctl+0x0/0x2b returned 0 after 61 usecs
calling  init_mbcache+0x0/0x17 @ 1
initcall init_mbcache+0x0/0x17 returned 0 after 6 usecs
calling  proc_cmdline_init+0x0/0x25 @ 1
initcall proc_cmdline_init+0x0/0x25 returned 0 after 24 usecs
calling  proc_consoles_init+0x0/0x25 @ 1
initcall proc_consoles_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_cpuinfo_init+0x0/0x25 @ 1
initcall proc_cpuinfo_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_devices_init+0x0/0x25 @ 1
initcall proc_devices_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_interrupts_init+0x0/0x25 @ 1
initcall proc_interrupts_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_loadavg_init+0x0/0x25 @ 1
initcall proc_loadavg_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_meminfo_init+0x0/0x25 @ 1
initcall proc_meminfo_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_stat_init+0x0/0x25 @ 1
initcall proc_stat_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_uptime_init+0x0/0x25 @ 1
initcall proc_uptime_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_version_init+0x0/0x25 @ 1
initcall proc_version_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_softirqs_init+0x0/0x25 @ 1
initcall proc_softirqs_init+0x0/0x25 returned 0 after 16 usecs
calling  proc_kcore_init+0x0/0xac @ 1
initcall proc_kcore_init+0x0/0xac returned 0 after 30 usecs
calling  proc_kmsg_init+0x0/0x28 @ 1
initcall proc_kmsg_init+0x0/0x28 returned 0 after 16 usecs
calling  proc_page_init+0x0/0x45 @ 1
initcall proc_page_init+0x0/0x45 returned 0 after 24 usecs
calling  init_devpts_fs+0x0/0x42 @ 1
initcall init_devpts_fs+0x0/0x42 returned 0 after 79 usecs
calling  init_ext3_fs+0x0/0x72 @ 1
initcall init_ext3_fs+0x0/0x72 returned 0 after 708 usecs
calling  init_ext2_fs+0x0/0x72 @ 1
initcall init_ext2_fs+0x0/0x72 returned 0 after 1470 usecs
calling  ext4_init_fs+0x0/0x20d @ 1
initcall ext4_init_fs+0x0/0x20d returned 0 after 3306 usecs
calling  journal_init+0x0/0x8d @ 1
initcall journal_init+0x0/0x8d returned 0 after 1988 usecs
calling  journal_init+0x0/0x2c @ 1
initcall journal_init+0x0/0x2c returned 0 after 2668 usecs
calling  init_ramfs_fs+0x0/0x14 @ 1
initcall init_ramfs_fs+0x0/0x14 returned 0 after 12 usecs
calling  init_hugetlbfs_fs+0x0/0x8e @ 1
initcall init_hugetlbfs_fs+0x0/0x8e returned 0 after 634 usecs
calling  init_fat_fs+0x0/0x45 @ 1
initcall init_fat_fs+0x0/0x45 returned 0 after 1029 usecs
calling  init_vfat_fs+0x0/0x14 @ 1
initcall init_vfat_fs+0x0/0x14 returned 0 after 9 usecs
calling  init_msdos_fs+0x0/0x14 @ 1
initcall init_msdos_fs+0x0/0x14 returned 0 after 8 usecs
calling  init_iso9660_fs+0x0/0x5d @ 1
initcall init_iso9660_fs+0x0/0x5d returned 0 after 505 usecs
calling  init_nfs_fs+0x0/0x11c @ 1
FS-Cache: Netfs 'nfs' registered for caching
initcall init_nfs_fs+0x0/0x11c returned 0 after 5606 usecs
calling  nfs4filelayout_init+0x0/0x29 @ 1
nfs4filelayout_init: NFSv4 File Layout Driver Registering...
initcall nfs4filelayout_init+0x0/0x29 returned 0 after 1741 usecs
calling  init_nfsd+0x0/0xb1 @ 1
Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
initcall init_nfsd+0x0/0xb1 returned 0 after 5328 usecs
calling  init_nlm+0x0/0x25 @ 1
initcall init_nlm+0x0/0x25 returned 0 after 28 usecs
calling  init_nls_cp437+0x0/0x14 @ 1
initcall init_nls_cp437+0x0/0x14 returned 0 after 17 usecs
calling  init_nls_ascii+0x0/0x14 @ 1
initcall init_nls_ascii+0x0/0x14 returned 0 after 7 usecs
calling  init_nls_iso8859_1+0x0/0x14 @ 1
initcall init_nls_iso8859_1+0x0/0x14 returned 0 after 7 usecs
calling  init_nls_iso8859_15+0x0/0x14 @ 1
initcall init_nls_iso8859_15+0x0/0x14 returned 0 after 7 usecs
calling  init_nls_utf8+0x0/0x2b @ 1
initcall init_nls_utf8+0x0/0x2b returned 0 after 14 usecs
calling  init_autofs4_fs+0x0/0x1c @ 1
initcall init_autofs4_fs+0x0/0x1c returned 0 after 510 usecs
calling  init_xfs_fs+0x0/0x9f @ 1
SGI XFS with ACLs, security attributes, realtime, large block/inode numbers, debug enabled
SGI XFS Quota Management subsystem
initcall init_xfs_fs+0x0/0x9f returned 0 after 11831 usecs
calling  ipc_init+0x0/0x26 @ 1
msgmni has been set to 1994
initcall ipc_init+0x0/0x26 returned 0 after 918 usecs
calling  ipc_sysctl_init+0x0/0x17 @ 1
initcall ipc_sysctl_init+0x0/0x17 returned 0 after 24 usecs
calling  init_mqueue_fs+0x0/0x97 @ 1
initcall init_mqueue_fs+0x0/0x97 returned 0 after 473 usecs
calling  key_proc_init+0x0/0x36 @ 1
initcall key_proc_init+0x0/0x36 returned 0 after 17 usecs
calling  crypto_wq_init+0x0/0x36 @ 1
initcall crypto_wq_init+0x0/0x36 returned 0 after 163 usecs
calling  crypto_algapi_init+0x0/0x10 @ 1
initcall crypto_algapi_init+0x0/0x10 returned 0 after 17 usecs
calling  skcipher_module_init+0x0/0x2d @ 1
initcall skcipher_module_init+0x0/0x2d returned 0 after 5 usecs
calling  chainiv_module_init+0x0/0x14 @ 1
initcall chainiv_module_init+0x0/0x14 returned 0 after 14 usecs
calling  eseqiv_module_init+0x0/0x14 @ 1
initcall eseqiv_module_init+0x0/0x14 returned 0 after 5 usecs
calling  hmac_module_init+0x0/0x14 @ 1
initcall hmac_module_init+0x0/0x14 returned 0 after 5 usecs
calling  md5_mod_init+0x0/0x14 @ 1
initcall md5_mod_init+0x0/0x14 returned 0 after 240 usecs
calling  sha1_generic_mod_init+0x0/0x14 @ 1
initcall sha1_generic_mod_init+0x0/0x14 returned 0 after 236 usecs
calling  crypto_ecb_module_init+0x0/0x14 @ 1
initcall crypto_ecb_module_init+0x0/0x14 returned 0 after 5 usecs
calling  crypto_cbc_module_init+0x0/0x14 @ 1
initcall crypto_cbc_module_init+0x0/0x14 returned 0 after 5 usecs
calling  des_generic_mod_init+0x0/0x35 @ 1
initcall des_generic_mod_init+0x0/0x35 returned 0 after 478 usecs
calling  aes_init+0x0/0x14 @ 1
initcall aes_init+0x0/0x14 returned 0 after 238 usecs
calling  deflate_mod_init+0x0/0x14 @ 1
initcall deflate_mod_init+0x0/0x14 returned 0 after 266 usecs
calling  zlib_mod_init+0x0/0x14 @ 1
initcall zlib_mod_init+0x0/0x14 returned 0 after 993 usecs
calling  crc32c_mod_init+0x0/0x14 @ 1
initcall crc32c_mod_init+0x0/0x14 returned 0 after 244 usecs
calling  crypto_authenc_module_init+0x0/0x14 @ 1
initcall crypto_authenc_module_init+0x0/0x14 returned 0 after 6 usecs
calling  crypto_authenc_esn_module_init+0x0/0x14 @ 1
initcall crypto_authenc_esn_module_init+0x0/0x14 returned 0 after 5 usecs
calling  krng_mod_init+0x0/0x14 @ 1
initcall krng_mod_init+0x0/0x14 returned 0 after 240 usecs
calling  proc_genhd_init+0x0/0x3f @ 1
initcall proc_genhd_init+0x0/0x3f returned 0 after 27 usecs
calling  noop_init+0x0/0x14 @ 1
io scheduler noop registered
initcall noop_init+0x0/0x14 returned 0 after 875 usecs
calling  deadline_init+0x0/0x14 @ 1
io scheduler deadline registered
initcall deadline_init+0x0/0x14 returned 0 after 919 usecs
calling  cfq_init+0x0/0x8c @ 1
io scheduler cfq registered (default)
initcall cfq_init+0x0/0x8c returned 0 after 1816 usecs
calling  percpu_counter_startup+0x0/0x1c @ 1
initcall percpu_counter_startup+0x0/0x1c returned 0 after 8 usecs
calling  pci_proc_init+0x0/0x60 @ 1
initcall pci_proc_init+0x0/0x60 returned 0 after 202 usecs
calling  pcie_portdrv_init+0x0/0x6d @ 1
initcall pcie_portdrv_init+0x0/0x6d returned 0 after 582 usecs
calling  aer_service_init+0x0/0x27 @ 1
initcall aer_service_init+0x0/0x27 returned 0 after 256 usecs
calling  pcie_pme_service_init+0x0/0x14 @ 1
initcall pcie_pme_service_init+0x0/0x14 returned 0 after 262 usecs
calling  ioapic_init+0x0/0x1d @ 1
initcall ioapic_init+0x0/0x1d returned 0 after 279 usecs
calling  acpi_reserve_resources+0x0/0xee @ 1
initcall acpi_reserve_resources+0x0/0xee returned 0 after 19 usecs
calling  irqrouter_init_ops+0x0/0x29 @ 1
initcall irqrouter_init_ops+0x0/0x29 returned 0 after 5 usecs
calling  acpi_ac_init+0x0/0x47 @ 1
initcall acpi_ac_init+0x0/0x47 returned 0 after 305 usecs
calling  acpi_button_init+0x0/0x14 @ 1
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
initcall acpi_button_init+0x0/0x14 returned 0 after 3277 usecs
calling  acpi_fan_init+0x0/0x1b @ 1
initcall acpi_fan_init+0x0/0x1b returned 0 after 339 usecs
calling  acpi_processor_init+0x0/0x82 @ 1
initcall acpi_processor_init+0x0/0x82 returned 0 after 7946 usecs
calling  acpi_container_init+0x0/0x4b @ 1
initcall acpi_container_init+0x0/0x4b returned 0 after 26972 usecs
calling  acpi_thermal_init+0x0/0x45 @ 1
initcall acpi_thermal_init+0x0/0x45 returned 0 after 445 usecs
calling  acpi_battery_init+0x0/0x19 @ 1
initcall acpi_battery_init+0x0/0x19 returned 0 after 16 usecs
calling  virtio_pci_init+0x0/0x1d @ 1
calling  1_acpi_battery_init_async+0x0/0x43 @ 5
initcall 1_acpi_battery_init_async+0x0/0x43 returned 0 after 1009 usecs
ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
virtio-pci 0000:00:03.0: setting latency timer to 64
ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
virtio-pci 0000:00:05.0: setting latency timer to 64
ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10
virtio-pci 0000:00:06.0: setting latency timer to 64
virtio-pci 0000:00:07.0: setting latency timer to 64
initcall virtio_pci_init+0x0/0x1d returned 0 after 25131 usecs
calling  init+0x0/0x14 @ 1
initcall init+0x0/0x14 returned 0 after 902 usecs
calling  pty_init+0x0/0x15 @ 1
initcall pty_init+0x0/0x15 returned 0 after 274426 usecs
calling  sysrq_init+0x0/0x6b @ 1
initcall sysrq_init+0x0/0x6b returned 0 after 34 usecs
calling  serial8250_init+0x0/0x18f @ 1
Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
initcall serial8250_init+0x0/0x18f returned 0 after 152634 usecs
calling  serial8250_pnp_init+0x0/0x14 @ 1
00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
initcall serial8250_pnp_init+0x0/0x14 returned 0 after 55644 usecs
calling  serial8250_pci_init+0x0/0x1d @ 1
initcall serial8250_pci_init+0x0/0x1d returned 0 after 543 usecs
calling  rand_initialize+0x0/0x2f @ 1
initcall rand_initialize+0x0/0x2f returned 0 after 41 usecs
calling  raw_init+0x0/0x13a @ 1
initcall raw_init+0x0/0x13a returned 0 after 1101 usecs
calling  rtc_init+0x0/0xa9 @ 1
Real Time Clock Driver v1.12b
initcall rtc_init+0x0/0xa9 returned 0 after 1893 usecs
calling  hpet_init+0x0/0x60 @ 1
initcall hpet_init+0x0/0x60 returned 0 after 1225 usecs
calling  mod_init+0x0/0x1d9 @ 1
initcall mod_init+0x0/0x1d9 returned -19 after 232 usecs
calling  mod_init+0x0/0x128 @ 1
initcall mod_init+0x0/0x128 returned -19 after 87 usecs
calling  mod_init+0x0/0x49 @ 1
initcall mod_init+0x0/0x49 returned -19 after 7 usecs
calling  agp_init+0x0/0x29 @ 1
Linux agpgart interface v0.103
initcall agp_init+0x0/0x29 returned 0 after 1188 usecs
calling  agp_amd64_mod_init+0x0/0x27 @ 1
initcall agp_amd64_mod_init+0x0/0x27 returned -19 after 975 usecs
calling  agp_intel_init+0x0/0x30 @ 1
initcall agp_intel_init+0x0/0x30 returned 0 after 416 usecs
calling  cn_proc_init+0x0/0x33 @ 1
initcall cn_proc_init+0x0/0x33 returned 0 after 14 usecs
calling  topology_sysfs_init+0x0/0x4e @ 1
initcall topology_sysfs_init+0x0/0x4e returned 0 after 180 usecs
calling  floppy_init+0x0/0x5af @ 1
FDC 0 is a S82078B
initcall floppy_init+0x0/0x5af returned 0 after 16967 usecs
calling  brd_init+0x0/0x1b7 @ 1
brd: module loaded
initcall brd_init+0x0/0x1b7 returned 0 after 32096 usecs
calling  loop_init+0x0/0x12d @ 1
loop: module loaded
initcall loop_init+0x0/0x12d returned 0 after 18807 usecs
calling  init+0x0/0x77 @ 1
virtio-pci 0000:00:06.0: irq 40 for MSI/MSI-X
virtio-pci 0000:00:06.0: irq 41 for MSI/MSI-X
 vda: vda1
virtio-pci 0000:00:07.0: irq 42 for MSI/MSI-X
virtio-pci 0000:00:07.0: irq 43 for MSI/MSI-X
Refined TSC clocksource calibration: 2665.986 MHz.
Switching to clocksource tsc
 vdb: unknown partition table
initcall init+0x0/0x77 returned 0 after 240719 usecs
calling  ide_init+0x0/0x79 @ 1
Uniform Multi-Platform E-IDE driver
initcall ide_init+0x0/0x79 returned 0 after 11945 usecs
calling  via_ide_init+0x0/0x1d @ 1
initcall via_ide_init+0x0/0x1d returned 0 after 0 usecs
calling  ide_scan_pcibus+0x0/0xe1 @ 1
initcall ide_scan_pcibus+0x0/0xe1 returned 0 after 401 usecs
calling  ide_gd_init+0x0/0x22 @ 1
ide-gd driver 1.18
initcall ide_gd_init+0x0/0x22 returned 0 after 1279 usecs
calling  ide_cdrom_init+0x0/0x22 @ 1
ide-cd driver 5.00
initcall ide_cdrom_init+0x0/0x22 returned 0 after 1294 usecs
calling  scsi_tgt_init+0x0/0x7a @ 1
initcall scsi_tgt_init+0x0/0x7a returned 0 after 1385 usecs
calling  spi_transport_init+0x0/0x70 @ 1
initcall spi_transport_init+0x0/0x70 returned 0 after 549 usecs
calling  fc_transport_init+0x0/0x8f @ 1
initcall fc_transport_init+0x0/0x8f returned 0 after 2919 usecs
calling  ahd_linux_init+0x0/0x7f @ 1
initcall ahd_linux_init+0x0/0x7f returned 0 after 304 usecs
calling  init_sd+0x0/0x10c @ 1
initcall init_sd+0x0/0x10c returned 0 after 863 usecs
calling  init_sr+0x0/0x47 @ 1
initcall init_sr+0x0/0x47 returned 0 after 250 usecs
calling  init_sg+0x0/0xca @ 1
initcall init_sg+0x0/0xca returned 0 after 225 usecs
calling  ahci_init+0x0/0x1d @ 1
initcall ahci_init+0x0/0x1d returned 0 after 276 usecs
calling  svia_init+0x0/0x1d @ 1
initcall svia_init+0x0/0x1d returned 0 after 273 usecs
calling  via_init+0x0/0x1d @ 1
initcall via_init+0x0/0x1d returned 0 after 348 usecs
calling  ata_generic_init+0x0/0x1d @ 1
initcall ata_generic_init+0x0/0x1d returned 0 after 406 usecs
calling  legacy_init+0x0/0x1f6 @ 1
initcall legacy_init+0x0/0x1f6 returned -19 after 60 usecs
calling  net_olddevs_init+0x0/0x99 @ 1
initcall net_olddevs_init+0x0/0x99 returned 0 after 10 usecs
calling  tun_init+0x0/0x89 @ 1
tun: Universal TUN/TAP device driver, 1.6
tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
initcall tun_init+0x0/0x89 returned 0 after 2480 usecs
calling  cdrom_init+0x0/0x10 @ 1
initcall cdrom_init+0x0/0x10 returned 0 after 30 usecs
calling  mon_init+0x0/0xf8 @ 1
initcall mon_init+0x0/0xf8 returned 0 after 560 usecs
calling  ehci_hcd_init+0x0/0x7b @ 1
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
initcall ehci_hcd_init+0x0/0x7b returned 0 after 1540 usecs
calling  ohci_hcd_mod_init+0x0/0x57 @ 1
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
initcall ohci_hcd_mod_init+0x0/0x57 returned 0 after 1479 usecs
calling  uhci_hcd_init+0x0/0xbc @ 1
uhci_hcd: USB Universal Host Controller Interface driver
ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
uhci_hcd 0000:00:01.2: setting latency timer to 64
uhci_hcd 0000:00:01.2: UHCI Host Controller
uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c080
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
initcall uhci_hcd_init+0x0/0xbc returned 0 after 32463 usecs
calling  usb_stor_init+0x0/0x3c @ 1
Initializing USB Mass Storage driver...
usbcore: registered new interface driver usb-storage
USB Mass Storage support registered.
initcall usb_stor_init+0x0/0x3c returned 0 after 4962 usecs
calling  usb_serial_init+0x0/0x1e2 @ 1
usbcore: registered new interface driver usbserial
USB Serial support registered for generic
usbcore: registered new interface driver usbserial_generic
usbserial: USB Serial Driver core
initcall usb_serial_init+0x0/0x1e2 returned 0 after 11462 usecs
calling  i8042_init+0x0/0x106 @ 1
i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
initcall i8042_init+0x0/0x106 returned 0 after 7776 usecs
calling  mousedev_init+0x0/0x83 @ 1
mousedev: PS/2 mouse device common for all mice
initcall mousedev_init+0x0/0x83 returned 0 after 2323 usecs
calling  evdev_init+0x0/0x14 @ 1
initcall evdev_init+0x0/0x14 returned 0 after 404 usecs
calling  atkbd_init+0x0/0x29 @ 1
initcall atkbd_init+0x0/0x29 returned 0 after 349 usecs
calling  psmouse_init+0x0/0x7c @ 1
input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
initcall psmouse_init+0x0/0x7c returned 0 after 3165 usecs
calling  i2c_dev_init+0x0/0xc0 @ 1
i2c /dev entries driver
initcall i2c_dev_init+0x0/0xc0 returned 0 after 3458 usecs
calling  amd756_init+0x0/0x1d @ 1
initcall amd756_init+0x0/0x1d returned 0 after 321 usecs
calling  amd756_s4882_init+0x0/0x2bb @ 1
initcall amd756_s4882_init+0x0/0x2bb returned -19 after 0 usecs
calling  nforce2_init+0x0/0x1d @ 1
initcall nforce2_init+0x0/0x1d returned 0 after 307 usecs
calling  nforce2_s4985_init+0x0/0x2c4 @ 1
initcall nforce2_s4985_init+0x0/0x2c4 returned -19 after 0 usecs
calling  raid_init+0x0/0x14 @ 1
md: raid1 personality registered for level 1
initcall raid_init+0x0/0x14 returned 0 after 1068 usecs
calling  dm_init+0x0/0x42 @ 1
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@redhat.com
initcall dm_init+0x0/0x42 returned 0 after 8546 usecs
calling  dm_crypt_init+0x0/0x5f @ 1
initcall dm_crypt_init+0x0/0x5f returned 0 after 323 usecs
calling  dm_delay_init+0x0/0xb6 @ 1
initcall dm_delay_init+0x0/0xb6 returned 0 after 395 usecs
calling  dm_multipath_init+0x0/0x121 @ 1
device-mapper: multipath: version 1.3.0 loaded
initcall dm_multipath_init+0x0/0x121 returned 0 after 1553 usecs
calling  dm_rr_init+0x0/0x35 @ 1
device-mapper: multipath round-robin: version 1.0.0 loaded
initcall dm_rr_init+0x0/0x35 returned 0 after 1519 usecs
calling  dm_ql_init+0x0/0x35 @ 1
device-mapper: multipath queue-length: version 0.1.0 loaded
initcall dm_ql_init+0x0/0x35 returned 0 after 1252 usecs
calling  dm_st_init+0x0/0x35 @ 1
device-mapper: multipath service-time: version 0.2.0 loaded
initcall dm_st_init+0x0/0x35 returned 0 after 1243 usecs
calling  dm_snapshot_init+0x0/0x20b @ 1
initcall dm_snapshot_init+0x0/0x20b returned 0 after 1098 usecs
calling  dm_mirror_init+0x0/0x6f @ 1
initcall dm_mirror_init+0x0/0x6f returned 0 after 337 usecs
calling  dm_dirty_log_init+0x0/0x4f @ 1
initcall dm_dirty_log_init+0x0/0x4f returned 0 after 5 usecs
calling  userspace_dirty_log_init+0x0/0x9a @ 1
device-mapper: dm-log-userspace: version 1.1.0 loaded
initcall userspace_dirty_log_init+0x0/0x9a returned 0 after 1537 usecs
calling  dm_zero_init+0x0/0x27 @ 1
initcall dm_zero_init+0x0/0x27 returned 0 after 0 usecs
calling  kcapi_init+0x0/0x63 @ 1
initcall kcapi_init+0x0/0x63 returned 0 after 170 usecs
calling  mISDNInit+0x0/0xd0 @ 1
Modular ISDN core version 1.1.21
NET: Registered protocol family 34
initcall mISDNInit+0x0/0xd0 returned 0 after 2561 usecs
calling  cpufreq_stats_init+0x0/0x90 @ 1
initcall cpufreq_stats_init+0x0/0x90 returned 0 after 5 usecs
calling  cpufreq_gov_userspace_init+0x0/0x14 @ 1
initcall cpufreq_gov_userspace_init+0x0/0x14 returned 0 after 0 usecs
calling  cpufreq_gov_dbs_init+0x0/0x5a @ 1
initcall cpufreq_gov_dbs_init+0x0/0x5a returned 0 after 0 usecs
calling  cpufreq_gov_dbs_init+0x0/0x14 @ 1
initcall cpufreq_gov_dbs_init+0x0/0x14 returned 0 after 0 usecs
calling  init_ladder+0x0/0x14 @ 1
cpuidle: using governor ladder
initcall init_ladder+0x0/0x14 returned 0 after 949 usecs
calling  init_menu+0x0/0x14 @ 1
cpuidle: using governor menu
initcall init_menu+0x0/0x14 returned 0 after 917 usecs
calling  oprofile_init+0x0/0x73 @ 1
oprofile: using NMI interrupt.
initcall oprofile_init+0x0/0x73 returned 0 after 979 usecs
calling  sock_diag_init+0x0/0x39 @ 1
initcall sock_diag_init+0x0/0x39 returned 0 after 17 usecs
calling  flow_cache_init_global+0x0/0x2f @ 1
initcall flow_cache_init_global+0x0/0x2f returned 0 after 400 usecs
calling  nf_conntrack_standalone_init+0x0/0x14 @ 1
nf_conntrack version 0.5.0 (7976 buckets, 31904 max)
initcall nf_conntrack_standalone_init+0x0/0x14 returned 0 after 2115 usecs
calling  nf_conntrack_ftp_init+0x0/0x1a1 @ 1
initcall nf_conntrack_ftp_init+0x0/0x1a1 returned 0 after 1 usecs
calling  nf_conntrack_h323_init+0x0/0xc8 @ 1
initcall nf_conntrack_h323_init+0x0/0xc8 returned 0 after 7 usecs
calling  nf_conntrack_sip_init+0x0/0x1c5 @ 1
initcall nf_conntrack_sip_init+0x0/0x1c5 returned 0 after 0 usecs
calling  xt_init+0x0/0x11d @ 1
initcall xt_init+0x0/0x11d returned 0 after 4 usecs
calling  tcpudp_mt_init+0x0/0x19 @ 1
initcall tcpudp_mt_init+0x0/0x19 returned 0 after 5 usecs
calling  hl_mt_init+0x0/0x19 @ 1
initcall hl_mt_init+0x0/0x19 returned 0 after 0 usecs
calling  sysctl_ipv4_init+0x0/0x7d @ 1
initcall sysctl_ipv4_init+0x0/0x7d returned 0 after 149 usecs
calling  tunnel4_init+0x0/0x69 @ 1
initcall tunnel4_init+0x0/0x69 returned 0 after 0 usecs
calling  ipv4_netfilter_init+0x0/0x14 @ 1
initcall ipv4_netfilter_init+0x0/0x14 returned 0 after 4 usecs
calling  nf_conntrack_l3proto_ipv4_init+0x0/0x141 @ 1
initcall nf_conntrack_l3proto_ipv4_init+0x0/0x141 returned 0 after 190 usecs
calling  nf_nat_init+0x0/0x107 @ 1
initcall nf_nat_init+0x0/0x107 returned 0 after 66 usecs
calling  nf_defrag_init+0x0/0x19 @ 1
initcall nf_defrag_init+0x0/0x19 returned 0 after 0 usecs
calling  nf_nat_ftp_init+0x0/0x1a @ 1
initcall nf_nat_ftp_init+0x0/0x1a returned 0 after 0 usecs
calling  init+0x0/0xd2 @ 1
initcall init+0x0/0xd2 returned 0 after 0 usecs
calling  nf_nat_sip_init+0x0/0xa4 @ 1
initcall nf_nat_sip_init+0x0/0xa4 returned 0 after 0 usecs
calling  ip_tables_init+0x0/0xaf @ 1
ip_tables: (C) 2000-2006 Netfilter Core Team
initcall ip_tables_init+0x0/0xaf returned 0 after 1474 usecs
calling  iptable_filter_init+0x0/0x47 @ 1
initcall iptable_filter_init+0x0/0x47 returned 0 after 55 usecs
calling  iptable_mangle_init+0x0/0x47 @ 1
initcall iptable_mangle_init+0x0/0x47 returned 0 after 36 usecs
calling  nf_nat_standalone_init+0x0/0x76 @ 1
initcall nf_nat_standalone_init+0x0/0x76 returned 0 after 32 usecs
calling  log_tg_init+0x0/0x2c @ 1
initcall log_tg_init+0x0/0x2c returned 0 after 0 usecs
calling  masquerade_tg_init+0x0/0x2f @ 1
initcall masquerade_tg_init+0x0/0x2f returned 0 after 2 usecs
calling  reject_tg_init+0x0/0x14 @ 1
initcall reject_tg_init+0x0/0x14 returned 0 after 0 usecs
calling  inet_diag_init+0x0/0x80 @ 1
initcall inet_diag_init+0x0/0x80 returned 0 after 3 usecs
calling  tcp_diag_init+0x0/0x14 @ 1
initcall tcp_diag_init+0x0/0x14 returned 0 after 0 usecs
calling  cubictcp_register+0x0/0x6e @ 1
TCP cubic registered
initcall cubictcp_register+0x0/0x6e returned 0 after 756 usecs
calling  inet6_init+0x0/0x2a7 @ 1
NET: Registered protocol family 10
initcall inet6_init+0x0/0x2a7 returned 0 after 18661 usecs
calling  ah6_init+0x0/0x69 @ 1
initcall ah6_init+0x0/0x69 returned 0 after 6 usecs
calling  esp6_init+0x0/0x69 @ 1
initcall esp6_init+0x0/0x69 returned 0 after 0 usecs
calling  ipcomp6_init+0x0/0x69 @ 1
initcall ipcomp6_init+0x0/0x69 returned 0 after 0 usecs
calling  xfrm6_tunnel_init+0x0/0xca @ 1
initcall xfrm6_tunnel_init+0x0/0xca returned 0 after 487 usecs
calling  tunnel6_init+0x0/0x69 @ 1
initcall tunnel6_init+0x0/0x69 returned 0 after 0 usecs
calling  xfrm6_transport_init+0x0/0x19 @ 1
initcall xfrm6_transport_init+0x0/0x19 returned 0 after 0 usecs
calling  xfrm6_mode_tunnel_init+0x0/0x19 @ 1
initcall xfrm6_mode_tunnel_init+0x0/0x19 returned 0 after 0 usecs
calling  xfrm6_ro_init+0x0/0x19 @ 1
initcall xfrm6_ro_init+0x0/0x19 returned 0 after 0 usecs
calling  xfrm6_beet_init+0x0/0x19 @ 1
initcall xfrm6_beet_init+0x0/0x19 returned 0 after 0 usecs
calling  mip6_init+0x0/0xbd @ 1
Mobile IPv6
initcall mip6_init+0x0/0xbd returned 0 after 913 usecs
calling  ip6_tables_init+0x0/0xaf @ 1
ip6_tables: (C) 2000-2006 Netfilter Core Team
initcall ip6_tables_init+0x0/0xaf returned 0 after 1606 usecs
calling  ip6table_filter_init+0x0/0x47 @ 1
initcall ip6table_filter_init+0x0/0x47 returned 0 after 68 usecs
calling  ip6table_mangle_init+0x0/0x47 @ 1
initcall ip6table_mangle_init+0x0/0x47 returned 0 after 93 usecs
calling  ip6_queue_init+0x0/0x130 @ 1
initcall ip6_queue_init+0x0/0x130 returned 0 after 86 usecs
calling  ip6table_raw_init+0x0/0x47 @ 1
initcall ip6table_raw_init+0x0/0x47 returned 0 after 53 usecs
calling  nf_conntrack_l3proto_ipv6_init+0x0/0xf2 @ 1
initcall nf_conntrack_l3proto_ipv6_init+0x0/0xf2 returned 0 after 19 usecs
calling  nf_defrag_init+0x0/0x4a @ 1
initcall nf_defrag_init+0x0/0x4a returned 0 after 52 usecs
calling  ah_mt6_init+0x0/0x14 @ 1
initcall ah_mt6_init+0x0/0x14 returned 0 after 0 usecs
calling  eui64_mt6_init+0x0/0x14 @ 1
initcall eui64_mt6_init+0x0/0x14 returned 0 after 0 usecs
calling  frag_mt6_init+0x0/0x14 @ 1
initcall frag_mt6_init+0x0/0x14 returned 0 after 0 usecs
calling  ipv6header_mt6_init+0x0/0x14 @ 1
initcall ipv6header_mt6_init+0x0/0x14 returned 0 after 0 usecs
calling  mh_mt6_init+0x0/0x14 @ 1
initcall mh_mt6_init+0x0/0x14 returned 0 after 0 usecs
calling  hbh_mt6_init+0x0/0x19 @ 1
initcall hbh_mt6_init+0x0/0x19 returned 0 after 0 usecs
calling  rt_mt6_init+0x0/0x14 @ 1
initcall rt_mt6_init+0x0/0x14 returned 0 after 0 usecs
calling  log_tg6_init+0x0/0x2c @ 1
initcall log_tg6_init+0x0/0x2c returned 0 after 0 usecs
calling  reject_tg6_init+0x0/0x14 @ 1
initcall reject_tg6_init+0x0/0x14 returned 0 after 0 usecs
calling  sit_init+0x0/0x56 @ 1
IPv6 over IPv4 tunneling driver
initcall sit_init+0x0/0x56 returned 0 after 11591 usecs
calling  packet_init+0x0/0x3d @ 1
NET: Registered protocol family 17
initcall packet_init+0x0/0x3d returned 0 after 962 usecs
calling  init_rpcsec_gss+0x0/0x43 @ 1
initcall init_rpcsec_gss+0x0/0x43 returned 0 after 75 usecs
calling  init_dns_resolver+0x0/0x103 @ 1
Registering the dns_resolver key type
initcall init_dns_resolver+0x0/0x103 returned 0 after 968 usecs
calling  mcheck_debugfs_init+0x0/0x3e @ 1
initcall mcheck_debugfs_init+0x0/0x3e returned 0 after 25 usecs
calling  severities_debugfs_init+0x0/0x3e @ 1
initcall severities_debugfs_init+0x0/0x3e returned 0 after 7 usecs
calling  hpet_insert_resource+0x0/0x2a @ 1
initcall hpet_insert_resource+0x0/0x2a returned 0 after 2 usecs
calling  update_mp_table+0x0/0x1c0 @ 1
initcall update_mp_table+0x0/0x1c0 returned 0 after 7 usecs
calling  lapic_insert_resource+0x0/0x42 @ 1
initcall lapic_insert_resource+0x0/0x42 returned 0 after 0 usecs
calling  io_apic_bug_finalize+0x0/0x16 @ 1
initcall io_apic_bug_finalize+0x0/0x16 returned 0 after 0 usecs
calling  print_ICs+0x0/0x162 @ 1
initcall print_ICs+0x0/0x162 returned 0 after 0 usecs
calling  check_early_ioremap_leak+0x0/0x53 @ 1
initcall check_early_ioremap_leak+0x0/0x53 returned 0 after 1 usecs
calling  pat_memtype_list_init+0x0/0x35 @ 1
initcall pat_memtype_list_init+0x0/0x35 returned 0 after 0 usecs
calling  init_oops_id+0x0/0x34 @ 1
initcall init_oops_id+0x0/0x34 returned 0 after 1 usecs
calling  printk_late_init+0x0/0x4f @ 1
initcall printk_late_init+0x0/0x4f returned 0 after 3 usecs
calling  pm_debugfs_init+0x0/0x27 @ 1
initcall pm_debugfs_init+0x0/0x27 returned 0 after 8 usecs
calling  pm_qos_power_init+0x0/0xc0 @ 1
initcall pm_qos_power_init+0x0/0xc0 returned 0 after 1441 usecs
calling  software_resume+0x0/0x25c @ 1
PM: Hibernation image not present or could not be loaded.
initcall software_resume+0x0/0x25c returned -2 after 7 usecs
initcall software_resume+0x0/0x25c returned with error code -2 
calling  debugfs_kprobe_init+0x0/0x92 @ 1
initcall debugfs_kprobe_init+0x0/0x92 returned 0 after 35 usecs
calling  taskstats_init+0x0/0x93 @ 1
registered taskstats version 1
initcall taskstats_init+0x0/0x93 returned 0 after 943 usecs
calling  clear_boot_tracer+0x0/0x30 @ 1
initcall clear_boot_tracer+0x0/0x30 returned 0 after 8 usecs
calling  max_swapfiles_check+0x0/0x3 @ 1
initcall max_swapfiles_check+0x0/0x3 returned 0 after 0 usecs
calling  kmemleak_late_init+0x0/0x8a @ 1
initcall kmemleak_late_init+0x0/0x8a returned -12 after 4 usecs
initcall kmemleak_late_init+0x0/0x8a returned with error code -12 
calling  random32_reseed+0x0/0xa6 @ 1
initcall random32_reseed+0x0/0xa6 returned 0 after 6 usecs
calling  pci_resource_alignment_sysfs_init+0x0/0x1b @ 1
initcall pci_resource_alignment_sysfs_init+0x0/0x1b returned 0 after 17 usecs
calling  pci_sysfs_init+0x0/0x4e @ 1
initcall pci_sysfs_init+0x0/0x4e returned 0 after 1122 usecs
calling  random_int_secret_init+0x0/0x1c @ 1
initcall random_int_secret_init+0x0/0x1c returned 0 after 6 usecs
calling  late_resume_init+0x0/0xe3 @ 1
  Magic number: 12:750:900
tty ptyvd: hash matches
acpi PNP0501:00: hash matches
initcall late_resume_init+0x0/0xe3 returned 0 after 3042 usecs
calling  scsi_complete_async_scans+0x0/0x124 @ 1
initcall scsi_complete_async_scans+0x0/0x124 returned 0 after 0 usecs
calling  powernowk8_init+0x0/0x1bc @ 1
initcall powernowk8_init+0x0/0x1bc returned -19 after 38 usecs
calling  acpi_cpufreq_init+0x0/0x9f @ 1
initcall acpi_cpufreq_init+0x0/0x9f returned -19 after 91 usecs
calling  memmap_init+0x0/0x2a @ 1
initcall memmap_init+0x0/0x2a returned 0 after 205 usecs
calling  pci_mmcfg_late_insert_resources+0x0/0x54 @ 1
initcall pci_mmcfg_late_insert_resources+0x0/0x54 returned 1 after 0 usecs
initcall pci_mmcfg_late_insert_resources+0x0/0x54 returned with error code 1 
calling  net_secret_init+0x0/0x1c @ 1
initcall net_secret_init+0x0/0x1c returned 0 after 6 usecs
calling  tcp_congestion_default+0x0/0x14 @ 1
initcall tcp_congestion_default+0x0/0x14 returned 0 after 0 usecs
calling  ip_auto_config+0x0/0x2b2 @ 1
initcall ip_auto_config+0x0/0x2b2 returned 0 after 21 usecs
calling  initialize_hashrnd+0x0/0x1c @ 1
initcall initialize_hashrnd+0x0/0x1c returned 0 after 1 usecs
input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2
async_waiting @ 1
async_continuing @ 1 after 0 usec
md: Waiting for all devices to be available before autodetect
md: If you don't use raid, use raid=noautodetect
async_waiting @ 1
async_continuing @ 1 after 0 usec
md: Autodetecting RAID arrays.
md: Scanned 0 and added 0 devices.
md: autorun ...
md: ... autorun DONE.
kjournald starting.  Commit interval 5 seconds
EXT3-fs (vda1): mounted filesystem with writeback data mode
VFS: Mounted root (ext3 filesystem) readonly on device 253:1.
async_waiting @ 1
async_continuing @ 1 after 0 usec
Freeing unused kernel memory: 604k freed
udevd[1448]: starting version 171
calling  snd_mem_init+0x0/0x2f [snd_page_alloc] @ 1477
initcall snd_mem_init+0x0/0x2f [snd_page_alloc] returned 0 after 19 usecs
calling  alsa_sound_init+0x0/0x8a [snd] @ 1477
initcall alsa_sound_init+0x0/0x8a [snd] returned 0 after 145 usecs
calling  alsa_timer_init+0x0/0xb9 [snd_timer] @ 1477
initcall alsa_timer_init+0x0/0xb9 [snd_timer] returned 0 after 655 usecs
calling  alsa_pcm_init+0x0/0x67 [snd_pcm] @ 1477
initcall alsa_pcm_init+0x0/0x67 [snd_pcm] returned 0 after 22 usecs
calling  alsa_card_azx_init+0x0/0x22 [snd_hda_intel] @ 1477
snd_hda_intel 0000:00:04.0: irq 44 for MSI/MSI-X
snd_hda_intel 0000:00:04.0: setting latency timer to 64
initcall alsa_card_azx_init+0x0/0x22 [snd_hda_intel] returned 0 after 85462 usecs
EXT3-fs (vda1): using internal journal
Adding 2097148k swap on /dev/vdb.  Priority:-1 extents:1 across:2097148k 

^ permalink raw reply related	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 19:58             ` Dirk Gouders
@ 2012-01-19 20:52               ` Dirk Gouders
  2012-01-20  2:20                 ` Josh Boyer
  2012-01-20 11:01                 ` Catalin Marinas
  0 siblings, 2 replies; 15+ messages in thread
From: Dirk Gouders @ 2012-01-19 20:52 UTC (permalink / raw)
  To: Catalin Marinas; +Cc: linux-kernel

Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de> writes:

> Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de> writes:
>
>> Catalin Marinas <catalin.marinas@arm.com> writes:
>>
>>> On Thu, Jan 19, 2012 at 02:38:01PM +0000, Dirk Gouders wrote:
>>>> Catalin Marinas <catalin.marinas@arm.com> writes:
>>>> > On Thu, Jan 19, 2012 at 12:16:56PM +0000, Dirk Gouders wrote:
>>>> >> Catalin Marinas <catalin.marinas@arm.com> writes:
>>>> >> > On Wed, Jan 18, 2012 at 07:32:59PM +0000, Dirk Gouders wrote:
>>>> >> >> Freeing unused kernel memory: 608k freed
>>>> >> >> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
>>>> >> >> BUG: unable to handle kernel paging request at ffffffff818b232b
>>>> >> >> IP: [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>>>> > ...
>>>> >> >> Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <cc> cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
>>>> >> >> RIP  [<ffffffff818b232b>] kmemleak_late_init+0x8a/0x8a
>>>> >> >
>>>> >> > I don't really see how kmemleak could cause such error (or any of the
>>>> >> > recent changes I have made). It looks like some of the code in the
>>>> >> > .init.text section is not executable.
>>>> >
>>>> > Ah, the interesting part - 0xcc is the poison value for freed initmem.
>>>> > And from the kernel logs you posted Linux frees the initmem and later
>>>> > calls kmemleak_late_init() which should have been in the .init.text
>>>> > section.
>>>> >
>>>> > The kmemleak_late_init() function is defined as:
>>>> >
>>>> > static int __init kmemleak_late_init(void)
>>>> > {
>>>> > ...
>>>> > }
>>>> > late_initcall(kmemleak_late_init);
>>>> >
>>>> > and it must *not* be called after the initmem has been freed. Was there
>>>> > any change in the x86 or generic code with regards to the freeing of the
>>>> > init memory?
>>>> 
>>>> I tried to re-bisect this problem by marking commit
>>>> 029aeff5db879afd7760f11214b6fea45f76b58e
>>>> "kmemleak: Add support for memory hotplug" (that I previously considered
>>>> good, because it produces a different output) bad.  The attached output
>>>> shows that kmemleak_late_init is also involved but bisect did not bring
>>>> me a step further:
>>>> 
>>>> $ git bisect good f1c84dae0e
>>>> Bisecting: a merge base must be tested
>>>> [c3b92c8787367a8bb53d57d9789b558f1295cc96] Linux 3.1
>>>
>>> If you bisect to one of the kmemleak commits, they are based on 3.2-rc4
>>> so you miss any commits that may have been merged during the merge
>>> window.
>>
>> Hmm, I thought that the above was an error message but when I ignored it
>> and just continued bisecting (whith a huge set of commits), it ended in:
>>
>> b66930052abf2e41b8a978ae265303917cbe6fa0 is the first bad commit
>> commit b66930052abf2e41b8a978ae265303917cbe6fa0
>> Author: Catalin Marinas <catalin.marinas@arm.com>
>> Date:   Wed Sep 28 17:22:56 2011 +0100
>>
>>     kmemleak: When the early log buffer is exceeded, report the actual number
>>     
>>     Just telling that the early log buffer has been exceeded doesn't mean
>>     much. This patch moves the error printing to the kmemleak_init()
>>     function and displays the actual calls to the kmemleak API during early
>>     logging.
>>     
>>     Signed-off-by: Catalin Marinas <catalin.marinas@arm.com>
>>
>> :040000 040000 6b16996be5be3f428eceb5ca8a153ac72f1848b3 246cccb0645241d4a1e1c392aaea3e2ea3e34da5 M      mm
>>
>>>> ------------------------------------------------------------------------
>>>> Freeing unused kernel memory: 676k freed
>>>> kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
>>>> BUG: unable to handle kernel paging request at ffffffff81892482
>>>> IP: [<ffffffff81892482>] kmemleak_late_init+0x8a/0x8a
>>>> PGD 17cd067 PUD 17d1063 PMD 3c5c8063 PTE 8000000001892163
>>>> Oops: 0011 [#1] SMP 
>>>
>>> Similar behaviour, the init memory is freed before the initcalls, so
>>> doesn't look like a kmemleak problem.
>>>
>>> Could you pass initcall_debug on the kernel command line and see how may
>>> commits are called before and after the free_initmem() call?
>>>
>>> You could also try to revert (git revert) the kmemleak commits from the
>>> latest git tree, without bisecting.
>>
>> OK, I added initcall_debug to a bad kernel I saved while bisecting and
>> attach the console output of the serial console - the output on the
>> graphical console was more complete.
>>
>> Further, I tested Linus' current master with b66930052abf2 reverted 
>>
>> ------------------------------------------------------------------------
>> commit 27e8880932050e77d2822a19fb9f39230f6363e9
>> Author: Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de>
>> Date:   Thu Jan 19 18:31:40 2012 +0100
>>
>>     Revert "kmemleak: When the early log buffer is exceeded, report the actual number"
>>     
>>     This reverts commit b66930052abf2e41b8a978ae265303917cbe6fa0.
>>
>> commit ccb19d263fd1c9e34948e2158c53eacbff369344
>> Merge: 6a48897 c3b5003
>> Author: Linus Torvalds <torvalds@linux-foundation.org>
>> Date:   Tue Jan 17 22:26:41 2012 -0800
>> ------------------------------------------------------------------------
>>
>> and that kernel works here.
>
> Hi Catlin,
>
> I did some more testing and it turns out that I have to revert a single
> line of commit b66930052abf2 to make the kernel boot:
>
> diff --git a/mm/kmemleak.c b/mm/kmemleak.c
> index c833add..d8bbb68 100644
> --- a/mm/kmemleak.c
> +++ b/mm/kmemleak.c
> @@ -1710,6 +1710,7 @@ static void kmemleak_disable(void)
>                 return;
>  
>         /* stop any memory operation tracing */
> +       atomic_set(&kmemleak_early_log, 0);
>         atomic_set(&kmemleak_enabled, 0);
>  
>         /* check whether it is too early for a kernel thread */
>
> I started that kernel with initcall_debug and attach the dmesg output.

Hi Catlin,

I want to note that in my config CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is
set which causes kmemleak_disable() to be called in kmemleak_init().

/*
 * Kmemleak initialization.
 */
void __init kmemleak_init(void)
{
	int i;
	unsigned long flags;

#ifdef CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF
	if (!kmemleak_skip_disable) {
		kmemleak_disable();
		return;
	}
#endif

Perhaps, this in combination with

/* enables or disables early logging of the memory operations */
static atomic_t kmemleak_early_log = ATOMIC_INIT(1);

causes problems?

Dirk

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 20:52               ` Dirk Gouders
@ 2012-01-20  2:20                 ` Josh Boyer
  2012-01-20  9:22                   ` Catalin Marinas
  2012-01-20 11:01                 ` Catalin Marinas
  1 sibling, 1 reply; 15+ messages in thread
From: Josh Boyer @ 2012-01-20  2:20 UTC (permalink / raw)
  To: Dirk Gouders; +Cc: Catalin Marinas, linux-kernel

On Thu, Jan 19, 2012 at 3:52 PM, Dirk Gouders
<gouders@et.bocholt.fh-gelsenkirchen.de> wrote:
>> I did some more testing and it turns out that I have to revert a single
>> line of commit b66930052abf2 to make the kernel boot:
>>
>> diff --git a/mm/kmemleak.c b/mm/kmemleak.c
>> index c833add..d8bbb68 100644
>> --- a/mm/kmemleak.c
>> +++ b/mm/kmemleak.c
>> @@ -1710,6 +1710,7 @@ static void kmemleak_disable(void)
>>                 return;
>>
>>         /* stop any memory operation tracing */
>> +       atomic_set(&kmemleak_early_log, 0);
>>         atomic_set(&kmemleak_enabled, 0);
>>
>>         /* check whether it is too early for a kernel thread */
>>
>> I started that kernel with initcall_debug and attach the dmesg output.
>
> Hi Catlin,
>
> I want to note that in my config CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is
> set which causes kmemleak_disable() to be called in kmemleak_init().

I also had CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF=y in my .config.  Disabling that
option allowed the machine to boot just fine.  Dirk seems to be onto something
here.

josh

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-20  2:20                 ` Josh Boyer
@ 2012-01-20  9:22                   ` Catalin Marinas
  0 siblings, 0 replies; 15+ messages in thread
From: Catalin Marinas @ 2012-01-20  9:22 UTC (permalink / raw)
  To: Josh Boyer; +Cc: Dirk Gouders, linux-kernel

On Fri, Jan 20, 2012 at 02:20:24AM +0000, Josh Boyer wrote:
> On Thu, Jan 19, 2012 at 3:52 PM, Dirk Gouders
> <gouders@et.bocholt.fh-gelsenkirchen.de> wrote:
> >> I did some more testing and it turns out that I have to revert a single
> >> line of commit b66930052abf2 to make the kernel boot:
> >>
> >> diff --git a/mm/kmemleak.c b/mm/kmemleak.c
> >> index c833add..d8bbb68 100644
> >> --- a/mm/kmemleak.c
> >> +++ b/mm/kmemleak.c
> >> @@ -1710,6 +1710,7 @@ static void kmemleak_disable(void)
> >>                 return;
> >>
> >>         /* stop any memory operation tracing */
> >> +       atomic_set(&kmemleak_early_log, 0);
> >>         atomic_set(&kmemleak_enabled, 0);
> >>
> >>         /* check whether it is too early for a kernel thread */
> >>
> >> I started that kernel with initcall_debug and attach the dmesg output.
> >
> > Hi Catlin,
> >
> > I want to note that in my config CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is
> > set which causes kmemleak_disable() to be called in kmemleak_init().
> 
> I also had CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF=y in my .config.  Disabling that
> option allowed the machine to boot just fine.  Dirk seems to be onto something
> here.

It definitely looks like a kmemleak problem with
CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF=y. I managed to reproduce it on ARM as
well.

I'll have a look and get back shortly.

Thanks.

-- 
Catalin

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-19 20:52               ` Dirk Gouders
  2012-01-20  2:20                 ` Josh Boyer
@ 2012-01-20 11:01                 ` Catalin Marinas
  2012-01-20 12:14                   ` Dirk Gouders
  2012-01-20 14:16                   ` Josh Boyer
  1 sibling, 2 replies; 15+ messages in thread
From: Catalin Marinas @ 2012-01-20 11:01 UTC (permalink / raw)
  To: Dirk Gouders; +Cc: linux-kernel

On Thu, Jan 19, 2012 at 08:52:44PM +0000, Dirk Gouders wrote:
> Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de> writes:
> I want to note that in my config CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is
> set which causes kmemleak_disable() to be called in kmemleak_init().

Thanks for the investigation. Could you please try the patch below?
Thanks.


>From 09e7bd41ff3fd07e4c5eea7bbb0a045921eb5944 Mon Sep 17 00:00:00 2001
From: Catalin Marinas <catalin.marinas@arm.com>
Date: Fri, 20 Jan 2012 10:42:40 +0000
Subject: [PATCH] kmemleak: Disable early logging when kmemleak is off by
 default

Commit b6693005 (kmemleak: When the early log buffer is exceeded, report
the actual number) deferred the disabling of the early logging to
kmemleak_init(). However, when CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF=y, the
early logging was no longer disabled causing __init kmemleak functions
to be called even after the kernel freed the init memory. This patch
disables the early logging during kmemleak_init() if kmemleak is left
disabled.

Reported-by: Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de>
Signed-off-by: Catalin Marinas <catalin.marinas@arm.com>
---
 mm/kmemleak.c |    1 +
 1 files changed, 1 insertions(+), 0 deletions(-)

diff --git a/mm/kmemleak.c b/mm/kmemleak.c
index f9f7310..45eb621 100644
--- a/mm/kmemleak.c
+++ b/mm/kmemleak.c
@@ -1757,6 +1757,7 @@ void __init kmemleak_init(void)
 
 #ifdef CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF
 	if (!kmemleak_skip_disable) {
+		atomic_set(&kmemleak_early_log, 0);
 		kmemleak_disable();
 		return;
 	}

-- 
Catalin

^ permalink raw reply related	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-20 11:01                 ` Catalin Marinas
@ 2012-01-20 12:14                   ` Dirk Gouders
  2012-01-20 14:16                   ` Josh Boyer
  1 sibling, 0 replies; 15+ messages in thread
From: Dirk Gouders @ 2012-01-20 12:14 UTC (permalink / raw)
  To: Catalin Marinas; +Cc: linux-kernel

Catalin Marinas <catalin.marinas@arm.com> writes:

> On Thu, Jan 19, 2012 at 08:52:44PM +0000, Dirk Gouders wrote:
>> Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de> writes:
>> I want to note that in my config CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is
>> set which causes kmemleak_disable() to be called in kmemleak_init().
>
> Thanks for the investigation. Could you please try the patch below?
> Thanks.

Hi Catalin,

I tested it and that patch solves the problems here.

Thanks a lot for your help,

Dirk

>
> From 09e7bd41ff3fd07e4c5eea7bbb0a045921eb5944 Mon Sep 17 00:00:00 2001
> From: Catalin Marinas <catalin.marinas@arm.com>
> Date: Fri, 20 Jan 2012 10:42:40 +0000
> Subject: [PATCH] kmemleak: Disable early logging when kmemleak is off by
>  default
>
> Commit b6693005 (kmemleak: When the early log buffer is exceeded, report
> the actual number) deferred the disabling of the early logging to
> kmemleak_init(). However, when CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF=y, the
> early logging was no longer disabled causing __init kmemleak functions
> to be called even after the kernel freed the init memory. This patch
> disables the early logging during kmemleak_init() if kmemleak is left
> disabled.
>
> Reported-by: Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de>
> Signed-off-by: Catalin Marinas <catalin.marinas@arm.com>
> ---
>  mm/kmemleak.c |    1 +
>  1 files changed, 1 insertions(+), 0 deletions(-)
>
> diff --git a/mm/kmemleak.c b/mm/kmemleak.c
> index f9f7310..45eb621 100644
> --- a/mm/kmemleak.c
> +++ b/mm/kmemleak.c
> @@ -1757,6 +1757,7 @@ void __init kmemleak_init(void)
>  
>  #ifdef CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF
>  	if (!kmemleak_skip_disable) {
> +		atomic_set(&kmemleak_early_log, 0);
>  		kmemleak_disable();
>  		return;
>  	}

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-20 11:01                 ` Catalin Marinas
  2012-01-20 12:14                   ` Dirk Gouders
@ 2012-01-20 14:16                   ` Josh Boyer
  2012-01-20 14:21                     ` Catalin Marinas
  1 sibling, 1 reply; 15+ messages in thread
From: Josh Boyer @ 2012-01-20 14:16 UTC (permalink / raw)
  To: Catalin Marinas; +Cc: Dirk Gouders, linux-kernel

On Fri, Jan 20, 2012 at 6:01 AM, Catalin Marinas
<catalin.marinas@arm.com> wrote:
> On Thu, Jan 19, 2012 at 08:52:44PM +0000, Dirk Gouders wrote:
>> Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de> writes:
>> I want to note that in my config CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is
>> set which causes kmemleak_disable() to be called in kmemleak_init().
>
> Thanks for the investigation. Could you please try the patch below?
> Thanks.
>
>
> From 09e7bd41ff3fd07e4c5eea7bbb0a045921eb5944 Mon Sep 17 00:00:00 2001
> From: Catalin Marinas <catalin.marinas@arm.com>
> Date: Fri, 20 Jan 2012 10:42:40 +0000
> Subject: [PATCH] kmemleak: Disable early logging when kmemleak is off by
>  default
>
> Commit b6693005 (kmemleak: When the early log buffer is exceeded, report
> the actual number) deferred the disabling of the early logging to
> kmemleak_init(). However, when CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF=y, the
> early logging was no longer disabled causing __init kmemleak functions
> to be called even after the kernel freed the init memory. This patch
> disables the early logging during kmemleak_init() if kmemleak is left
> disabled.
>
> Reported-by: Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de>
> Signed-off-by: Catalin Marinas <catalin.marinas@arm.com>

I tested this on my machine and it works for me as well.  Thanks for the quick
turn around.  Feel free to add a:

Tested-by: Josh Boyer <jwboyer@gmail.com>

if you'd like.

josh

> ---
>  mm/kmemleak.c |    1 +
>  1 files changed, 1 insertions(+), 0 deletions(-)
>
> diff --git a/mm/kmemleak.c b/mm/kmemleak.c
> index f9f7310..45eb621 100644
> --- a/mm/kmemleak.c
> +++ b/mm/kmemleak.c
> @@ -1757,6 +1757,7 @@ void __init kmemleak_init(void)
>
>  #ifdef CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF
>        if (!kmemleak_skip_disable) {
> +               atomic_set(&kmemleak_early_log, 0);
>                kmemleak_disable();
>                return;
>        }
>
> --
> Catalin
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [Problem] kernel hangs at boot (bisected 892d208bcf)
  2012-01-20 14:16                   ` Josh Boyer
@ 2012-01-20 14:21                     ` Catalin Marinas
  0 siblings, 0 replies; 15+ messages in thread
From: Catalin Marinas @ 2012-01-20 14:21 UTC (permalink / raw)
  To: Josh Boyer; +Cc: Dirk Gouders, linux-kernel

On Fri, Jan 20, 2012 at 02:16:49PM +0000, Josh Boyer wrote:
> On Fri, Jan 20, 2012 at 6:01 AM, Catalin Marinas
> <catalin.marinas@arm.com> wrote:
> > On Thu, Jan 19, 2012 at 08:52:44PM +0000, Dirk Gouders wrote:
> >> Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de> writes:
> >> I want to note that in my config CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is
> >> set which causes kmemleak_disable() to be called in kmemleak_init().
> >
> > Thanks for the investigation. Could you please try the patch below?
> > Thanks.
> >
> >
> > From 09e7bd41ff3fd07e4c5eea7bbb0a045921eb5944 Mon Sep 17 00:00:00 2001
> > From: Catalin Marinas <catalin.marinas@arm.com>
> > Date: Fri, 20 Jan 2012 10:42:40 +0000
> > Subject: [PATCH] kmemleak: Disable early logging when kmemleak is off by
> >  default
> >
> > Commit b6693005 (kmemleak: When the early log buffer is exceeded, report
> > the actual number) deferred the disabling of the early logging to
> > kmemleak_init(). However, when CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF=y, the
> > early logging was no longer disabled causing __init kmemleak functions
> > to be called even after the kernel freed the init memory. This patch
> > disables the early logging during kmemleak_init() if kmemleak is left
> > disabled.
> >
> > Reported-by: Dirk Gouders <gouders@et.bocholt.fh-gelsenkirchen.de>
> > Signed-off-by: Catalin Marinas <catalin.marinas@arm.com>
> 
> I tested this on my machine and it works for me as well.  Thanks for the quick
> turn around.  Feel free to add a:
> 
> Tested-by: Josh Boyer <jwboyer@gmail.com>

Thanks to both of you.

-- 
Catalin

^ permalink raw reply	[flat|nested] 15+ messages in thread

end of thread, other threads:[~2012-01-20 14:22 UTC | newest]

Thread overview: 15+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-01-18 19:32 [Problem] kernel hangs at boot (bisected 892d208bcf) Dirk Gouders
2012-01-19 11:01 ` Catalin Marinas
2012-01-19 12:16   ` Dirk Gouders
2012-01-19 14:00     ` Catalin Marinas
2012-01-19 14:38       ` Dirk Gouders
2012-01-19 15:37         ` Catalin Marinas
2012-01-19 17:43           ` Dirk Gouders
2012-01-19 19:58             ` Dirk Gouders
2012-01-19 20:52               ` Dirk Gouders
2012-01-20  2:20                 ` Josh Boyer
2012-01-20  9:22                   ` Catalin Marinas
2012-01-20 11:01                 ` Catalin Marinas
2012-01-20 12:14                   ` Dirk Gouders
2012-01-20 14:16                   ` Josh Boyer
2012-01-20 14:21                     ` Catalin Marinas

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).