All of lore.kernel.org
 help / color / mirror / Atom feed
* rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
@ 2012-06-29 10:09 Sasha Levin
  2012-06-29 17:23 ` Paul E. McKenney
  0 siblings, 1 reply; 20+ messages in thread
From: Sasha Levin @ 2012-06-29 10:09 UTC (permalink / raw)
  To: paulmck; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

Hi Paul,

I think I've stumbled on another bug that will increase your paranoia levels even further.

I got the following lockup when fuzzing with trinity inside a KVM tools guest, using latest linux-next.

It appears that it was caused by a03d6178 ("rcu: Move RCU grace-period cleanup into kthread"). This issue doesn't reproduce easily though, it took some fuzzing before hitting it.

[   81.457842] irq event stamp: 54856
[   81.457846] BUG: spinlock recursion on CPU#3, trinity-child19/5970
[   81.457852]  lock: 0xffff880035bd6300, .magic: dead4ead, .owner: trinity-child19/5970, .owner_cpu: 3
[   81.457855] Pid: 5970, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479
[   81.457856] Call Trace:
[   81.457865]  [<ffffffff8199b9d8>] spin_dump+0x78/0xc0
[   81.457868]  [<ffffffff8199ba4b>] spin_bug+0x2b/0x40
[   81.457872]  [<ffffffff8199bb8e>] do_raw_spin_lock+0x4e/0x140
[   81.457878]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   81.457883]  [<ffffffff81130603>] ? ttwu_queue+0xd3/0x100
[   81.457886]  [<ffffffff81130603>] ttwu_queue+0xd3/0x100
[   81.457889]  [<ffffffff81132864>] ? try_to_wake_up+0x34/0x290
[   81.457891]  [<ffffffff81132a7c>] try_to_wake_up+0x24c/0x290
[   81.457895]  [<ffffffff8115fcc4>] ? __lock_acquired+0x2a4/0x2e0
[   81.457898]  [<ffffffff81132acd>] default_wake_function+0xd/0x10
[   81.457902]  [<ffffffff8111a6c8>] autoremove_wake_function+0x18/0x40
[   81.457906]  [<ffffffff811253c2>] __wake_up_common+0x52/0x90
[   81.457909]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.457912]  [<ffffffff811283a3>] __wake_up+0x43/0x70
[   81.457917]  [<ffffffff811a4173>] rcu_report_qs_rsp+0x73/0x80
[   81.457921]  [<ffffffff811a81cd>] rcu_report_qs_rnp+0x26d/0x2c0
[   81.457923]  [<ffffffff811a829e>] rcu_report_unblock_qs_rnp+0x7e/0x90
[   81.457926]  [<ffffffff811a8d70>] rcu_read_unlock_special+0x330/0x400
[   81.457928]  [<ffffffff8115d1fa>] ? get_lock_stats+0x2a/0x60
[   81.457931]  [<ffffffff811a906a>] rcu_preempt_note_context_switch+0x22a/0x300
[   81.457934]  [<ffffffff8372789a>] __schedule+0x76a/0x880
[   81.457937]  [<ffffffff81161bc6>] ? mark_held_locks+0xf6/0x120
[   81.457940]  [<ffffffff83727f34>] preempt_schedule_irq+0x94/0xd0
[   81.457943]  [<ffffffff83729da6>] retint_kernel+0x26/0x30
[   81.457946]  [<ffffffff811a8aa2>] ? rcu_read_unlock_special+0x62/0x400
[   81.457949]  [<ffffffff8115d23e>] ? put_lock_stats+0xe/0x40
[   81.457953]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.457956]  [<ffffffff81163c6a>] ? __lock_release+0x1ba/0x1d0
[   81.457958]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.457963]  [<ffffffff81115b5d>] __rcu_read_unlock+0x4d/0xa0
[   81.457965]  [<ffffffff811e0985>] find_get_page+0x235/0x260
[   81.457967]  [<ffffffff811e0750>] ? find_get_pages+0x2e0/0x2e0
[   81.457970]  [<ffffffff811e0eee>] filemap_fault+0x6e/0x4c0
[   81.457973]  [<ffffffff8120e33e>] __do_fault+0xae/0x560
[   81.457976]  [<ffffffff81134cb8>] ? sched_clock_cpu+0x108/0x120
[   81.457979]  [<ffffffff8120ee51>] handle_pte_fault+0x81/0x1f0
[   81.457982]  [<ffffffff8120f2e9>] handle_mm_fault+0x329/0x350
[   81.457985]  [<ffffffff8120b5f0>] ? follow_page+0x550/0x5a0
[   81.457988]  [<ffffffff8120f808>] __get_user_pages+0x438/0x5d0
[   81.457991]  [<ffffffff812108f6>] __mlock_vma_pages_range+0xc6/0xd0
[   81.457993]  [<ffffffff81210a01>] do_mlock_pages+0x101/0x180
[   81.457997]  [<ffffffff81211148>] sys_mlockall+0x128/0x1a0
[   81.457999]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.458678] hardirqs last  enabled at (54855): [<ffffffff8372a565>] sysret_check+0x22/0x5d
[   81.458678] hardirqs last disabled at (54856): [<ffffffff83728ce4>] _raw_spin_lock_irq+0x34/0xa0
[   81.458678] softirqs last  enabled at (54816): [<ffffffff810f5c3b>] __do_softirq+0x3db/0x460
[   81.458678] softirqs last disabled at (54797): [<ffffffff8372baec>] call_softirq+0x1c/0x30
[   81.559841] BUG: spinlock lockup suspected on CPU#1, swapper/1/0
[   81.559841]  lock: rcu_preempt_state, .magic: dead4ead, .owner: trinity-child19/5970, .owner_cpu: 3
[   81.559841] Pid: 0, comm: swapper/1 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479
[   81.559841] Call Trace:
[   81.559841]  [<ffffffff8199b9d8>] spin_dump+0x78/0xc0
[   81.559841]  [<ffffffff8199bc3e>] do_raw_spin_lock+0xfe/0x140
[   81.559841]  [<ffffffff83728c91>] _raw_spin_lock_irqsave+0xa1/0xc0
[   81.559841]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff8112838d>] __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff811a4952>] force_quiescent_state+0x102/0x120
[   81.559841]  [<ffffffff811a95cb>] rcu_prepare_for_idle+0x32b/0x490
[   81.559841]  [<ffffffff811a994c>] rcu_idle_enter_common+0x21c/0x340
[   81.559841]  [<ffffffff81122110>] ? srcu_notifier_call_chain+0x20/0x20
[   81.559841]  [<ffffffff811a9d4b>] rcu_idle_enter+0xdb/0x150
[   81.559841]  [<ffffffff8107243e>] cpu_idle+0x10e/0x180
[   81.559841]  [<ffffffff8371ce3c>] ? setup_APIC_timer+0x88/0x8d
[   81.559841]  [<ffffffff8371c477>] start_secondary+0xd7/0xde
[   81.559841] sending NMI to all CPUs:
[   81.559841] NMI backtrace for cpu 1
[   81.559841] CPU 1 
[   81.559841] Pid: 0, comm: swapper/1 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.559841] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
[   81.559841] RSP: 0018:ffff88000d5d1cb8  EFLAGS: 00000086
[   81.559841] RAX: 0000000000000400 RBX: 0000000000000001 RCX: 0000000000000830
[   81.559841] RDX: 0000000000000001 RSI: 0000000000000400 RDI: 0000000000000830
[   81.559841] RBP: ffff88000d5d1cb8 R08: ffffffff84ee09c0 R09: 0000000000000000
[   81.559841] R10: 0000000000000000 R11: 0000000000000002 R12: 0000000000000001
[   81.559841] R13: ffffffff84ee09c0 R14: 0000000000000001 R15: 000000000000b024
[   81.559841] FS:  0000000000000000(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
[   81.559841] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   81.559841] CR2: 0000000000f73ffc CR3: 000000000bb08000 CR4: 00000000000406e0
[   81.559841] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.559841] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.559841] Process swapper/1 (pid: 0, threadinfo ffff88000d5d0000, task ffff88000d5c8000)
[   81.559841] Stack:
[   81.559841]  ffff88000d5d1d28 ffffffff8109602d 0000000000000000 0000000000000000
[   81.559841]  ffff88000d5d1d38 0000000000000086 0000000000000002 0000000200080000
[   81.559841]  ffff88000d5d1d08 0000000000000000 000000009486a4e0 000000009486a4e0
[   81.559841] Call Trace:
[   81.559841]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
[   81.559841]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
[   81.559841]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
[   81.559841]  [<ffffffff8199bc43>] do_raw_spin_lock+0x103/0x140
[   81.559841]  [<ffffffff83728c91>] _raw_spin_lock_irqsave+0xa1/0xc0
[   81.559841]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff8112838d>] __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff811a4952>] force_quiescent_state+0x102/0x120
[   81.559841]  [<ffffffff811a95cb>] rcu_prepare_for_idle+0x32b/0x490
[   81.559841]  [<ffffffff811a994c>] rcu_idle_enter_common+0x21c/0x340
[   81.559841]  [<ffffffff81122110>] ? srcu_notifier_call_chain+0x20/0x20
[   81.559841]  [<ffffffff811a9d4b>] rcu_idle_enter+0xdb/0x150
[   81.559841]  [<ffffffff8107243e>] cpu_idle+0x10e/0x180
[   81.559841]  [<ffffffff8371ce3c>] ? setup_APIC_timer+0x88/0x8d
[   81.559841]  [<ffffffff8371c477>] start_secondary+0xd7/0xde
[   81.559841] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
[   82.001011] NMI backtrace for cpu 0
[   82.001011] CPU 0 
[   82.001011] Pid: 0, comm: swapper/0 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   82.001011] RIP: 0010:[<ffffffff8109e497>]  [<ffffffff8109e497>] __ticket_spin_trylock+0x27/0x30
[   82.001011] RSP: 0018:ffff88000d803dc0  EFLAGS: 00000097
[   82.001011] RAX: 0000000000000000 RBX: ffff8800299d6300 RCX: 0000000000002277
[   82.001011] RDX: 0000000022772276 RSI: 0000000000010002 RDI: ffff8800299d6300
[   82.001011] RBP: ffff88000d803df8 R08: 0000000000000000 R09: 0000000000000001
[   82.001011] R10: 0000000000000000 R11: 0000000000000001 R12: 000000009205d80a
[   82.001011] R13: 000000009486a4e0 R14: 0000000000000001 R15: 0000000000000001
[   82.001011] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
[   82.001011] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   82.001011] CR2: 0000000000db6594 CR3: 000000000bffa000 CR4: 00000000000406f0
[   82.001011] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   82.001011] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   82.001011] Process swapper/0 (pid: 0, threadinfo ffffffff84800000, task ffffffff8482d400)
[   82.001011] Stack:
[   82.001011]  ffffffff8199bc0a ffff88000d803df8 0000000000000086 ffff8800299d6300
[   82.001011]  ffff8800299d6318 0000000000000001 0000000000000000 ffff88000d803e28
[   82.001011]  ffffffff83728afb ffffffff8113ff5e ffffffff83729500 ffff88000d5a16f8
[   82.001011] Call Trace:
[   82.001011]  <IRQ> 
[   82.001011]  [<ffffffff8199bc0a>] ? do_raw_spin_lock+0xca/0x140
[   82.001011]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   82.001011]  [<ffffffff8113ff5e>] ? do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff83729500>] ? _raw_spin_unlock+0x30/0x60
[   82.001011]  [<ffffffff8113ff5e>] do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff81140245>] sched_rt_period_timer+0x45/0x70
[   82.001011]  [<ffffffff8111f4f6>] __run_hrtimer+0x206/0x330
[   82.001011]  [<ffffffff81140200>] ? do_sched_rt_period_timer+0x320/0x320
[   82.001011]  [<ffffffff8111f8e8>] hrtimer_interrupt+0x118/0x230
[   82.001011]  [<ffffffff81090f55>] smp_apic_timer_interrupt+0x85/0xa0
[   82.001011]  [<ffffffff8372b0ef>] apic_timer_interrupt+0x6f/0x80
[   82.001011]  <EOI> 
[   82.001011]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[   82.001011]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[   82.001011]  [<ffffffff8116211d>] ? trace_hardirqs_on+0xd/0x10
[   82.001011]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[   82.001011]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[   82.001011]  [<ffffffff83636281>] rest_init+0x131/0x140
[   82.001011]  [<ffffffff83636150>] ? csum_partial_copy_generic+0x170/0x170
[   82.001011]  [<ffffffff850d108c>] start_kernel+0x3dc/0x3e9
[   82.001011]  [<ffffffff850d0ade>] ? kernel_init+0x28a/0x28a
[   82.001011]  [<ffffffff850d0324>] x86_64_start_reservations+0xff/0x104
[   82.001011]  [<ffffffff850d047e>] x86_64_start_kernel+0x155/0x164
[   82.001011] Code: 0f 1f 40 00 8b 17 55 89 d1 31 c0 c1 e9 10 48 89 e5 66 39 ca 75 14 8d 8a 00 00 01 00 89 d0 f0 0f b1 0f 39 c2 0f 94 c0 0f b6 c0 c9 <c3> 0f 1f 84 00 00 00 00 00 55 48 89 e5 66 83 07 01 c9 c3 66 0f 
[   81.570014] NMI backtrace for cpu 2
[   81.570014] CPU 2 
[   81.570014] Pid: 5961, comm: trinity-child6 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.570014] RIP: 0010:[<ffffffff81984c6b>]  [<ffffffff81984c6b>] __delay+0xb/0x10
[   81.570014] RSP: 0018:ffff88001a2bb850  EFLAGS: 00000092
[   81.570014] RAX: 0000000000000000 RBX: ffff880035bd6300 RCX: 0000000069fcd06b
[   81.570014] RDX: 0000000000000000 RSI: 0000000000000003 RDI: 0000000000000001
[   81.570014] RBP: ffff88001a2bb888 R08: 0000000000000000 R09: 0000000000000001
[   81.570014] R10: 0000000000000000 R11: 0000000000000001 R12: 00000000933ba7db
[   81.570014] R13: 000000009486a4e0 R14: 0000000000000001 R15: ffff88001a2bb928
[   81.570014] FS:  00007f9767634700(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
[   81.570014] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   81.570014] CR2: 0000000000000ff9 CR3: 000000000b8b0000 CR4: 00000000000406e0
[   81.570014] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.570014] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.570014] Process trinity-child6 (pid: 5961, threadinfo ffff88001a2ba000, task ffff88001a7f3000)
[   81.570014] Stack:
[   81.570014]  ffffffff8199bc1d ffff88001a2bb888 0000000000000086 ffff880035bd6300
[   81.570014]  ffff880035bd6318 0000000000000001 0000000000000000 ffff88001a2bb8c8
[   81.570014]  ffffffff83728a78 ffffffff81139fe2 ffffffff83728b07 ffffffff81139fd5
[   81.570014] Call Trace:
[   81.570014]  [<ffffffff8199bc1d>] ? do_raw_spin_lock+0xdd/0x140
[   81.570014]  [<ffffffff83728a78>] _raw_spin_lock_nested+0x68/0x90
[   81.570014]  [<ffffffff81139fe2>] ? load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff83728b07>] ? _raw_spin_lock+0x67/0x70
[   81.570014]  [<ffffffff81139fd5>] ? load_balance+0x295/0x6e0
[   81.570014]  [<ffffffff81139fe2>] load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff81137dc0>] ? find_busiest_group+0x2a0/0x2a0
[   81.570014]  [<ffffffff8113c6df>] idle_balance+0x15f/0x240
[   81.570014]  [<ffffffff8113c5bf>] ? idle_balance+0x3f/0x240
[   81.570014]  [<ffffffff8372739d>] __schedule+0x26d/0x880
[   81.570014]  [<ffffffff83727b15>] schedule+0x55/0x60
[   81.570014]  [<ffffffff83725568>] schedule_timeout+0x38/0x2c0
[   81.570014]  [<ffffffff8115fa5d>] ? __lock_acquired+0x3d/0x2e0
[   81.570014]  [<ffffffff83726f54>] ? wait_for_common+0x44/0x170
[   81.570014]  [<ffffffff83727007>] ? wait_for_common+0xf7/0x170
[   81.570014]  [<ffffffff8372700f>] wait_for_common+0xff/0x170
[   81.570014]  [<ffffffff81132ac0>] ? try_to_wake_up+0x290/0x290
[   81.570014]  [<ffffffff811efd60>] ? lru_add_drain+0x50/0x50
[   81.570014]  [<ffffffff83727128>] wait_for_completion+0x18/0x20
[   81.570014]  [<ffffffff8110d7c0>] flush_work+0x80/0xc0
[   81.570014]  [<ffffffff8110d740>] ? start_flush_work+0x1a0/0x1a0
[   81.570014]  [<ffffffff8110cab0>] ? do_work_for_cpu+0x30/0x30
[   81.570014]  [<ffffffff8110e33b>] schedule_on_each_cpu+0x13b/0x1c0
[   81.570014]  [<ffffffff811eed90>] lru_add_drain_all+0x10/0x20
[   81.570014]  [<ffffffff812403c9>] do_pages_move+0x49/0x1e0
[   81.570014]  [<ffffffff8199bb30>] ? do_raw_spin_unlock+0xd0/0xe0
[   81.570014]  [<ffffffff812409a7>] sys_move_pages+0x2f7/0x380
[   81.570014]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.570014] Code: 55 48 c7 05 34 8e 25 03 a0 4c 98 81 48 89 e5 c9 c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 ff 15 16 8e 25 03 c9 <c3> 0f 1f 40 00 55 48 8d 04 bd 00 00 00 00 48 89 e5 65 48 8b 14 
[   81.458024] NMI backtrace for cpu 3
[   81.458024] CPU 3 
[   81.458024] Pid: 5970, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.458024] RIP: 0010:[<ffffffff81071646>]  [<ffffffff81071646>] native_read_tsc+0x6/0x20
[   81.458024] RSP: 0000:ffff88000bab15e8  EFLAGS: 00000082
[   81.458024] RAX: 0000000069fce97a RBX: ffff880035bd6300 RCX: 0000000000000000
[   81.458024] RDX: 0000000000000090 RSI: 0000000010000005 RDI: 0000000000000001
[   81.458024] RBP: ffff88000bab15e8 R08: 0000000000000000 R09: 0000000000000000
[   81.458024] R10: 0000000000000000 R11: 00000000000155d4 R12: 00000000941579c2
[   81.458024] R13: 0000000000000001 R14: 0000000000000003 R15: ffff880035a00000
[   81.458024] FS:  00007f9767634700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
[   81.458024] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   81.458024] CR2: 0000000000000008 CR3: 000000000b962000 CR4: 00000000000406e0
[   81.458024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.458024] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.458024] Process trinity-child19 (pid: 5970, threadinfo ffff88000bab0000, task ffff88000b9e8000)
[   81.458024] Stack:
[   81.458024]  ffff88000bab1628 ffffffff81984ce2 ffff88000bab1618 ffff880035bd6300
[   81.458024]  00000000941579c2 000000009486a4e0 0000000000000001 ffff880035a00000
[   81.458024]  ffff88000bab1638 ffffffff81984c6a ffff88000bab1678 ffffffff8199bc1d
[   81.458024] Call Trace:
[   81.458024]  [<ffffffff81984ce2>] delay_tsc+0x42/0x140
[   81.458024]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   81.458024]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   81.458024]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   81.458024]  [<ffffffff81130603>] ? ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81130603>] ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81132864>] ? try_to_wake_up+0x34/0x290
[   81.458024]  [<ffffffff81132a7c>] try_to_wake_up+0x24c/0x290
[   81.458024]  [<ffffffff8115fcc4>] ? __lock_acquired+0x2a4/0x2e0
[   81.458024]  [<ffffffff81132acd>] default_wake_function+0xd/0x10
[   81.458024]  [<ffffffff8111a6c8>] autoremove_wake_function+0x18/0x40
[   81.458024]  [<ffffffff811253c2>] __wake_up_common+0x52/0x90
[   81.458024]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.458024]  [<ffffffff811283a3>] __wake_up+0x43/0x70
[   81.458024]  [<ffffffff811a4173>] rcu_report_qs_rsp+0x73/0x80
[   81.458024]  [<ffffffff811a81cd>] rcu_report_qs_rnp+0x26d/0x2c0
[   81.458024]  [<ffffffff811a829e>] rcu_report_unblock_qs_rnp+0x7e/0x90
[   81.458024]  [<ffffffff811a8d70>] rcu_read_unlock_special+0x330/0x400
[   81.458024]  [<ffffffff8115d1fa>] ? get_lock_stats+0x2a/0x60
[   81.458024]  [<ffffffff811a906a>] rcu_preempt_note_context_switch+0x22a/0x300
[   81.458024]  [<ffffffff8372789a>] __schedule+0x76a/0x880
[   81.458024]  [<ffffffff81161bc6>] ? mark_held_locks+0xf6/0x120
[   81.458024]  [<ffffffff83727f34>] preempt_schedule_irq+0x94/0xd0
[   81.458024]  [<ffffffff83729da6>] retint_kernel+0x26/0x30
[   81.458024]  [<ffffffff811a8aa2>] ? rcu_read_unlock_special+0x62/0x400
[   81.458024]  [<ffffffff8115d23e>] ? put_lock_stats+0xe/0x40
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81163c6a>] ? __lock_release+0x1ba/0x1d0
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81115b5d>] __rcu_read_unlock+0x4d/0xa0
[   81.458024]  [<ffffffff811e0985>] find_get_page+0x235/0x260
[   81.458024]  [<ffffffff811e0750>] ? find_get_pages+0x2e0/0x2e0
[   81.458024]  [<ffffffff811e0eee>] filemap_fault+0x6e/0x4c0
[   81.458024]  [<ffffffff8120e33e>] __do_fault+0xae/0x560
[   81.458024]  [<ffffffff81134cb8>] ? sched_clock_cpu+0x108/0x120
[   81.458024]  [<ffffffff8120ee51>] handle_pte_fault+0x81/0x1f0
[   81.458024]  [<ffffffff8120f2e9>] handle_mm_fault+0x329/0x350
[   81.458024]  [<ffffffff8120b5f0>] ? follow_page+0x550/0x5a0
[   81.458024]  [<ffffffff8120f808>] __get_user_pages+0x438/0x5d0
[   81.458024]  [<ffffffff812108f6>] __mlock_vma_pages_range+0xc6/0xd0
[   81.458024]  [<ffffffff81210a01>] do_mlock_pages+0x101/0x180
[   81.458024]  [<ffffffff81211148>] sys_mlockall+0x128/0x1a0
[   81.458024]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.458024] Code: 08 ff 15 e6 ae 7c 03 48 c7 43 08 00 00 00 00 48 89 03 48 83 c4 08 5b c9 c3 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 0f 31 <89> c1 c9 48 89 d0 89 c9 48 c1 e0 20 48 09 c8 c3 66 2e 0f 1f 84 
[   81.458024] BUG: spinlock lockup suspected on CPU#3, trinity-child19/5970
[   81.458024]  lock: 0xffff880035bd6300, .magic: dead4ead, .owner: trinity-child19/5970, .owner_cpu: 3
[   81.458024] Pid: 5970, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479
[   81.458024] Call Trace:
[   81.458024]  [<ffffffff8199b9d8>] spin_dump+0x78/0xc0
[   81.458024]  [<ffffffff8199bc3e>] do_raw_spin_lock+0xfe/0x140
[   81.458024]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   81.458024]  [<ffffffff81130603>] ? ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81130603>] ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81132864>] ? try_to_wake_up+0x34/0x290
[   81.458024]  [<ffffffff81132a7c>] try_to_wake_up+0x24c/0x290
[   81.458024]  [<ffffffff8115fcc4>] ? __lock_acquired+0x2a4/0x2e0
[   81.458024]  [<ffffffff81132acd>] default_wake_function+0xd/0x10
[   81.458024]  [<ffffffff8111a6c8>] autoremove_wake_function+0x18/0x40
[   81.458024]  [<ffffffff811253c2>] __wake_up_common+0x52/0x90
[   81.458024]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.458024]  [<ffffffff811283a3>] __wake_up+0x43/0x70
[   81.458024]  [<ffffffff811a4173>] rcu_report_qs_rsp+0x73/0x80
[   81.458024]  [<ffffffff811a81cd>] rcu_report_qs_rnp+0x26d/0x2c0
[   81.458024]  [<ffffffff811a829e>] rcu_report_unblock_qs_rnp+0x7e/0x90
[   81.458024]  [<ffffffff811a8d70>] rcu_read_unlock_special+0x330/0x400
[   81.458024]  [<ffffffff8115d1fa>] ? get_lock_stats+0x2a/0x60
[   81.458024]  [<ffffffff811a906a>] rcu_preempt_note_context_switch+0x22a/0x300
[   81.458024]  [<ffffffff8372789a>] __schedule+0x76a/0x880
[   81.458024]  [<ffffffff81161bc6>] ? mark_held_locks+0xf6/0x120
[   81.458024]  [<ffffffff83727f34>] preempt_schedule_irq+0x94/0xd0
[   81.458024]  [<ffffffff83729da6>] retint_kernel+0x26/0x30
[   81.458024]  [<ffffffff811a8aa2>] ? rcu_read_unlock_special+0x62/0x400
[   81.458024]  [<ffffffff8115d23e>] ? put_lock_stats+0xe/0x40
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81163c6a>] ? __lock_release+0x1ba/0x1d0
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81115b5d>] __rcu_read_unlock+0x4d/0xa0
[   81.458024]  [<ffffffff811e0985>] find_get_page+0x235/0x260
[   81.458024]  [<ffffffff811e0750>] ? find_get_pages+0x2e0/0x2e0
[   81.458024]  [<ffffffff811e0eee>] filemap_fault+0x6e/0x4c0
[   81.458024]  [<ffffffff8120e33e>] __do_fault+0xae/0x560
[   81.458024]  [<ffffffff81134cb8>] ? sched_clock_cpu+0x108/0x120
[   81.458024]  [<ffffffff8120ee51>] handle_pte_fault+0x81/0x1f0
[   81.458024]  [<ffffffff8120f2e9>] handle_mm_fault+0x329/0x350
[   81.458024]  [<ffffffff8120b5f0>] ? follow_page+0x550/0x5a0
[   81.458024]  [<ffffffff8120f808>] __get_user_pages+0x438/0x5d0
[   81.458024]  [<ffffffff812108f6>] __mlock_vma_pages_range+0xc6/0xd0
[   81.458024]  [<ffffffff81210a01>] do_mlock_pages+0x101/0x180
[   81.458024]  [<ffffffff81211148>] sys_mlockall+0x128/0x1a0
[   81.458024]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.458024] sending NMI to all CPUs:
[   82.001011] NMI backtrace for cpu 0
[   82.001011] CPU 0 
[   82.001011] Pid: 0, comm: swapper/0 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   82.001011] RIP: 0010:[<ffffffff81071646>]  [<ffffffff81071646>] native_read_tsc+0x6/0x20
[   82.001011] RSP: 0018:ffff88000d803d68  EFLAGS: 00000082
[   82.001011] RAX: 000000000dd5a0d4 RBX: ffff8800299d6300 RCX: 0000000000000000
[   82.001011] RDX: 0000000000000091 RSI: 0000000000010002 RDI: 0000000000000001
[   82.001011] RBP: ffff88000d803d68 R08: 0000000000000000 R09: 0000000000000001
[   82.001011] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000092dffe2d
[   82.001011] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000001
[   82.001011] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
[   82.001011] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   82.001011] CR2: 0000000000db6594 CR3: 000000000bffa000 CR4: 00000000000406f0
[   82.001011] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   82.001011] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   82.001011] Process swapper/0 (pid: 0, threadinfo ffffffff84800000, task ffffffff8482d400)
[   82.001011] Stack:
[   82.001011]  ffff88000d803da8 ffffffff81984ce2 ffff88000d803df8 ffff8800299d6300
[   82.001011]  0000000092dffe2d 000000009486a4e0 0000000000000001 0000000000000001
[   82.001011]  ffff88000d803db8 ffffffff81984c6a ffff88000d803df8 ffffffff8199bc1d
[   82.001011] Call Trace:
[   82.001011]  <IRQ> 
[   82.001011]  [<ffffffff81984ce2>] delay_tsc+0x42/0x140
[   82.001011]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   82.001011]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   82.001011]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   82.001011]  [<ffffffff8113ff5e>] ? do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff83729500>] ? _raw_spin_unlock+0x30/0x60
[   82.001011]  [<ffffffff8113ff5e>] do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff81140245>] sched_rt_period_timer+0x45/0x70
[   82.001011]  [<ffffffff8111f4f6>] __run_hrtimer+0x206/0x330
[   82.001011]  [<ffffffff81140200>] ? do_sched_rt_period_timer+0x320/0x320
[   82.001011]  [<ffffffff8111f8e8>] hrtimer_interrupt+0x118/0x230
[   82.001011]  [<ffffffff81090f55>] smp_apic_timer_interrupt+0x85/0xa0
[   82.001011]  [<ffffffff8372b0ef>] apic_timer_interrupt+0x6f/0x80
[   82.001011]  <EOI> 
[   82.001011]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[   82.001011]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[   82.001011]  [<ffffffff8116211d>] ? trace_hardirqs_on+0xd/0x10
[   82.001011]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[   82.001011]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[   82.001011]  [<ffffffff83636281>] rest_init+0x131/0x140
[   82.001011]  [<ffffffff83636150>] ? csum_partial_copy_generic+0x170/0x170
[   82.001011]  [<ffffffff850d108c>] start_kernel+0x3dc/0x3e9
[   82.001011]  [<ffffffff850d0ade>] ? kernel_init+0x28a/0x28a
[   82.001011]  [<ffffffff850d0324>] x86_64_start_reservations+0xff/0x104
[   82.001011]  [<ffffffff850d047e>] x86_64_start_kernel+0x155/0x164
[   82.001011] Code: 08 ff 15 e6 ae 7c 03 48 c7 43 08 00 00 00 00 48 89 03 48 83 c4 08 5b c9 c3 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 0f 31 <89> c1 c9 48 89 d0 89 c9 48 c1 e0 20 48 09 c8 c3 66 2e 0f 1f 84 
[   81.570014] NMI backtrace for cpu 2
[   81.570014] CPU 2 
[   81.570014] Pid: 5961, comm: trinity-child6 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.570014] RIP: 0010:[<ffffffff81071646>]  [<ffffffff81071646>] native_read_tsc+0x6/0x20
[   81.570014] RSP: 0018:ffff88001a2bb7f8  EFLAGS: 00000082
[   81.570014] RAX: 000000000dd5ced6 RBX: ffff880035bd6300 RCX: 0000000000000000
[   81.570014] RDX: 0000000000000091 RSI: 0000000000000003 RDI: 0000000000000001
[   81.570014] RBP: ffff88001a2bb7f8 R08: 0000000000000000 R09: 0000000000000001
[   81.570014] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000093e2c894
[   81.570014] R13: 0000000000000001 R14: 0000000000000002 R15: ffff88001a2bb928
[   81.570014] FS:  00007f9767634700(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
[   81.570014] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   81.570014] CR2: 0000000000000ff9 CR3: 000000000b8b0000 CR4: 00000000000406e0
[   81.570014] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.570014] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.570014] Process trinity-child6 (pid: 5961, threadinfo ffff88001a2ba000, task ffff88001a7f3000)
[   81.570014] Stack:
[   81.570014]  ffff88001a2bb838 ffffffff81984ce2 ffff88001a2bb888 ffff880035bd6300
[   81.570014]  0000000093e2c894 000000009486a4e0 0000000000000001 ffff88001a2bb928
[   81.570014]  ffff88001a2bb848 ffffffff81984c6a ffff88001a2bb888 ffffffff8199bc1d
[   81.570014] Call Trace:
[   81.570014]  [<ffffffff81984ce2>] delay_tsc+0x42/0x140
[   81.570014]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   81.570014]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   81.570014]  [<ffffffff83728a78>] _raw_spin_lock_nested+0x68/0x90
[   81.570014]  [<ffffffff81139fe2>] ? load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff83728b07>] ? _raw_spin_lock+0x67/0x70
[   81.570014]  [<ffffffff81139fd5>] ? load_balance+0x295/0x6e0
[   81.570014]  [<ffffffff81139fe2>] load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff81137dc0>] ? find_busiest_group+0x2a0/0x2a0
[   81.570014]  [<ffffffff8113c6df>] idle_balance+0x15f/0x240
[   81.570014]  [<ffffffff8113c5bf>] ? idle_balance+0x3f/0x240
[   81.570014]  [<ffffffff8372739d>] __schedule+0x26d/0x880
[   81.570014]  [<ffffffff83727b15>] schedule+0x55/0x60
[   81.570014]  [<ffffffff83725568>] schedule_timeout+0x38/0x2c0
[   81.570014]  [<ffffffff8115fa5d>] ? __lock_acquired+0x3d/0x2e0
[   81.570014]  [<ffffffff83726f54>] ? wait_for_common+0x44/0x170
[   81.570014]  [<ffffffff83727007>] ? wait_for_common+0xf7/0x170
[   81.570014]  [<ffffffff8372700f>] wait_for_common+0xff/0x170
[   81.570014]  [<ffffffff81132ac0>] ? try_to_wake_up+0x290/0x290
[   81.570014]  [<ffffffff811efd60>] ? lru_add_drain+0x50/0x50
[   81.570014]  [<ffffffff83727128>] wait_for_completion+0x18/0x20
[   81.570014]  [<ffffffff8110d7c0>] flush_work+0x80/0xc0
[   81.570014]  [<ffffffff8110d740>] ? start_flush_work+0x1a0/0x1a0
[   81.570014]  [<ffffffff8110cab0>] ? do_work_for_cpu+0x30/0x30
[   81.570014]  [<ffffffff8110e33b>] schedule_on_each_cpu+0x13b/0x1c0
[   81.570014]  [<ffffffff811eed90>] lru_add_drain_all+0x10/0x20
[   81.570014]  [<ffffffff812403c9>] do_pages_move+0x49/0x1e0
[   81.570014]  [<ffffffff8199bb30>] ? do_raw_spin_unlock+0xd0/0xe0
[   81.570014]  [<ffffffff812409a7>] sys_move_pages+0x2f7/0x380
[   81.570014]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.570014] Code: 08 ff 15 e6 ae 7c 03 48 c7 43 08 00 00 00 00 48 89 03 48 83 c4 08 5b c9 c3 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 0f 31 <89> c1 c9 48 89 d0 89 c9 48 c1 e0 20 48 09 c8 c3 66 2e 0f 1f 84 
[   81.458024] NMI backtrace for cpu 3
[   81.458024] CPU 3 
[   81.458024] Pid: 5970, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.458024] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
[   81.458024] RSP: 0000:ffff88000bab1598  EFLAGS: 00000086
[   81.458024] RAX: 0000000000000400 RBX: 0000000000000003 RCX: 0000000000000830
[   81.458024] RDX: 0000000000000003 RSI: 0000000000000400 RDI: 0000000000000830
[   81.458024] RBP: ffff88000bab1598 R08: ffffffff84ee09c0 R09: 0000000000000000
[   81.458024] R10: 0000000000000000 R11: 0000000000000002 R12: 0000000000000003
[   81.458024] R13: ffffffff84ee09c0 R14: 0000000000000003 R15: 000000000000b024
[   81.458024] FS:  00007f9767634700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
[   81.458024] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   81.458024] CR2: 0000000000000008 CR3: 000000000b962000 CR4: 00000000000406e0
[   81.458024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.458024] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.458024] Process trinity-child19 (pid: 5970, threadinfo ffff88000bab0000, task ffff88000b9e8000)
[   81.458024] Stack:
[   81.458024]  ffff88000bab1608 ffffffff8109602d 0000000000000000 ffff880035a00000
[   81.458024]  ffff88000bab1618 0000000000000086 0000000000000002 0000000200080000
[   81.458024]  ffff88000bab15e8 0000000000000000 000000009486a4e0 000000009486a4e0
[   81.458024] Call Trace:
[   81.458024]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
[   81.458024]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
[   81.458024]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
[   81.458024]  [<ffffffff8199bc43>] do_raw_spin_lock+0x103/0x140
[   81.458024]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   81.458024]  [<ffffffff81130603>] ? ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81130603>] ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81132864>] ? try_to_wake_up+0x34/0x290
[   81.458024]  [<ffffffff81132a7c>] try_to_wake_up+0x24c/0x290
[   81.458024]  [<ffffffff8115fcc4>] ? __lock_acquired+0x2a4/0x2e0
[   81.458024]  [<ffffffff81132acd>] default_wake_function+0xd/0x10
[   81.458024]  [<ffffffff8111a6c8>] autoremove_wake_function+0x18/0x40
[   81.458024]  [<ffffffff811253c2>] __wake_up_common+0x52/0x90
[   81.458024]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.458024]  [<ffffffff811283a3>] __wake_up+0x43/0x70
[   81.458024]  [<ffffffff811a4173>] rcu_report_qs_rsp+0x73/0x80
[   81.458024]  [<ffffffff811a81cd>] rcu_report_qs_rnp+0x26d/0x2c0
[   81.458024]  [<ffffffff811a829e>] rcu_report_unblock_qs_rnp+0x7e/0x90
[   81.458024]  [<ffffffff811a8d70>] rcu_read_unlock_special+0x330/0x400
[   81.458024]  [<ffffffff8115d1fa>] ? get_lock_stats+0x2a/0x60
[   81.458024]  [<ffffffff811a906a>] rcu_preempt_note_context_switch+0x22a/0x300
[   81.458024]  [<ffffffff8372789a>] __schedule+0x76a/0x880
[   81.458024]  [<ffffffff81161bc6>] ? mark_held_locks+0xf6/0x120
[   81.458024]  [<ffffffff83727f34>] preempt_schedule_irq+0x94/0xd0
[   81.458024]  [<ffffffff83729da6>] retint_kernel+0x26/0x30
[   81.458024]  [<ffffffff811a8aa2>] ? rcu_read_unlock_special+0x62/0x400
[   81.458024]  [<ffffffff8115d23e>] ? put_lock_stats+0xe/0x40
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81163c6a>] ? __lock_release+0x1ba/0x1d0
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81115b5d>] __rcu_read_unlock+0x4d/0xa0
[   81.458024]  [<ffffffff811e0985>] find_get_page+0x235/0x260
[   81.458024]  [<ffffffff811e0750>] ? find_get_pages+0x2e0/0x2e0
[   81.458024]  [<ffffffff811e0eee>] filemap_fault+0x6e/0x4c0
[   81.458024]  [<ffffffff8120e33e>] __do_fault+0xae/0x560
[   81.458024]  [<ffffffff81134cb8>] ? sched_clock_cpu+0x108/0x120
[   81.458024]  [<ffffffff8120ee51>] handle_pte_fault+0x81/0x1f0
[   81.458024]  [<ffffffff8120f2e9>] handle_mm_fault+0x329/0x350
[   81.458024]  [<ffffffff8120b5f0>] ? follow_page+0x550/0x5a0
[   81.458024]  [<ffffffff8120f808>] __get_user_pages+0x438/0x5d0
[   81.458024]  [<ffffffff812108f6>] __mlock_vma_pages_range+0xc6/0xd0
[   81.458024]  [<ffffffff81210a01>] do_mlock_pages+0x101/0x180
[   81.458024]  [<ffffffff81211148>] sys_mlockall+0x128/0x1a0
[   81.458024]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.458024] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
[   81.559841] NMI backtrace for cpu 1
[   81.559841] CPU 1 
[   81.559841] Pid: 0, comm: swapper/1 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.559841] RIP: 0010:[<ffffffff8199bbf8>]  [<ffffffff8199bbf8>] do_raw_spin_lock+0xb8/0x140
[   81.559841] RSP: 0018:ffff88000d5d1d68  EFLAGS: 00000082
[   81.559841] RAX: 0000000400000000 RBX: ffffffff84b73020 RCX: 000000000db8c30f
[   81.559841] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000000001
[   81.559841] RBP: ffff88000d5d1d98 R08: 0000000000000000 R09: 0000000000000000
[   81.559841] R10: 0000000000000000 R11: 0000000000000002 R12: 000000000078280c
[   81.559841] R13: 000000009486a4e0 R14: 0000000000000000 R15: 0000000000000000
[   81.559841] FS:  0000000000000000(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
[   81.559841] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   81.559841] CR2: 0000000000f73ffc CR3: 000000000bb08000 CR4: 00000000000406e0
[   81.559841] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.559841] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.559841] Process swapper/1 (pid: 0, threadinfo ffff88000d5d0000, task ffff88000d5c8000)
[   81.559841] Stack:
[   81.559841]  ffff88000d5d1d98 0000000000000086 ffffffff84b73020 ffffffff84b73038
[   81.559841]  0000000000000086 0000000000000001 ffff88000d5d1dd8 ffffffff83728c91
[   81.559841]  ffffffff8112838d 0000000000000086 ffff88000d5d1df8 ffffffff84b73020
[   81.559841] Call Trace:
[   81.559841]  [<ffffffff83728c91>] _raw_spin_lock_irqsave+0xa1/0xc0
[   81.559841]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff8112838d>] __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff811a4952>] force_quiescent_state+0x102/0x120
[   81.559841]  [<ffffffff811a95cb>] rcu_prepare_for_idle+0x32b/0x490
[   81.559841]  [<ffffffff811a994c>] rcu_idle_enter_common+0x21c/0x340
[   81.559841]  [<ffffffff81122110>] ? srcu_notifier_call_chain+0x20/0x20
[   81.559841]  [<ffffffff811a9d4b>] rcu_idle_enter+0xdb/0x150
[   81.559841]  [<ffffffff8107243e>] cpu_idle+0x10e/0x180
[   81.559841]  [<ffffffff8371ce3c>] ? setup_APIC_timer+0x88/0x8d
[   81.559841]  [<ffffffff8371c477>] start_secondary+0xd7/0xde
[   81.559841] Code: 28 70 ff 66 90 85 c0 75 72 4c 69 2d 4f 15 e9 02 e8 03 00 00 41 be 01 00 00 00 eb 3e 0f 1f 80 00 00 00 00 48 83 3d 68 a8 ea 02 00 <75> 08 0f 0b 0f 1f 40 00 eb fe 48 89 df e8 66 28 70 ff 66 90 85 
[   81.570014] BUG: spinlock lockup suspected on CPU#2, trinity-child6/5961
[   81.570014]  lock: 0xffff880035bd6300, .magic: dead4ead, .owner: trinity-child19/5970, .owner_cpu: 3
[   81.570014] Pid: 5961, comm: trinity-child6 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479
[   81.570014] Call Trace:
[   81.570014]  [<ffffffff8199b9d8>] spin_dump+0x78/0xc0
[   81.570014]  [<ffffffff8199bc3e>] do_raw_spin_lock+0xfe/0x140
[   81.570014]  [<ffffffff83728a78>] _raw_spin_lock_nested+0x68/0x90
[   81.570014]  [<ffffffff81139fe2>] ? load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff83728b07>] ? _raw_spin_lock+0x67/0x70
[   81.570014]  [<ffffffff81139fd5>] ? load_balance+0x295/0x6e0
[   81.570014]  [<ffffffff81139fe2>] load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff81137dc0>] ? find_busiest_group+0x2a0/0x2a0
[   81.570014]  [<ffffffff8113c6df>] idle_balance+0x15f/0x240
[   81.570014]  [<ffffffff8113c5bf>] ? idle_balance+0x3f/0x240
[   81.570014]  [<ffffffff8372739d>] __schedule+0x26d/0x880
[   81.570014]  [<ffffffff83727b15>] schedule+0x55/0x60
[   81.570014]  [<ffffffff83725568>] schedule_timeout+0x38/0x2c0
[   81.570014]  [<ffffffff8115fa5d>] ? __lock_acquired+0x3d/0x2e0
[   81.570014]  [<ffffffff83726f54>] ? wait_for_common+0x44/0x170
[   81.570014]  [<ffffffff83727007>] ? wait_for_common+0xf7/0x170
[   81.570014]  [<ffffffff8372700f>] wait_for_common+0xff/0x170
[   81.570014]  [<ffffffff81132ac0>] ? try_to_wake_up+0x290/0x290
[   81.570014]  [<ffffffff811efd60>] ? lru_add_drain+0x50/0x50
[   81.570014]  [<ffffffff83727128>] wait_for_completion+0x18/0x20
[   81.570014]  [<ffffffff8110d7c0>] flush_work+0x80/0xc0
[   81.570014]  [<ffffffff8110d740>] ? start_flush_work+0x1a0/0x1a0
[   81.570014]  [<ffffffff8110cab0>] ? do_work_for_cpu+0x30/0x30
[   81.570014]  [<ffffffff8110e33b>] schedule_on_each_cpu+0x13b/0x1c0
[   81.570014]  [<ffffffff811eed90>] lru_add_drain_all+0x10/0x20
[   81.570014]  [<ffffffff812403c9>] do_pages_move+0x49/0x1e0
[   81.570014]  [<ffffffff8199bb30>] ? do_raw_spin_unlock+0xd0/0xe0
[   81.570014]  [<ffffffff812409a7>] sys_move_pages+0x2f7/0x380
[   81.570014]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.570014] sending NMI to all CPUs:
[   82.001011] NMI backtrace for cpu 0
[   82.001011] CPU 0 
[   82.001011] Pid: 0, comm: swapper/0 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   82.001011] RIP: 0010:[<ffffffff8107164c>]  [<ffffffff8107164c>] native_read_tsc+0xc/0x20
[   82.001011] RSP: 0018:ffff88000d803d70  EFLAGS: 00000082
[   82.001011] RAX: 0000000000000091 RBX: 00000000a3e8fee8 RCX: 00000000a3e8ff0f
[   82.001011] RDX: 0000000000000091 RSI: 0000000000010002 RDI: 0000000000000001
[   82.001011] RBP: ffff88000d803da8 R08: 0000000000000000 R09: 0000000000000001
[   82.001011] R10: 0000000000000000 R11: 0000000000000001 R12: ffffffff84800010
[   82.001011] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000001
[   82.001011] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
[   82.001011] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   82.001011] CR2: 0000000000db6594 CR3: 000000000bffa000 CR4: 00000000000406f0
[   82.001011] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   82.001011] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   82.001011] Process swapper/0 (pid: 0, threadinfo ffffffff84800000, task ffffffff8482d400)
[   82.001011] Stack:
[   82.001011]  ffffffff81984d25 ffff88000d803df8 ffff8800299d6300 000000009398743f
[   82.001011]  000000009486a4e0 0000000000000001 0000000000000001 ffff88000d803db8
[   82.001011]  ffffffff81984c6a ffff88000d803df8 ffffffff8199bc1d ffff88000d803df8
[   82.001011] Call Trace:
[   82.001011]  <IRQ> 
[   82.001011]  [<ffffffff81984d25>] ? delay_tsc+0x85/0x140
[   82.001011]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   82.001011]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   82.001011]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   82.001011]  [<ffffffff8113ff5e>] ? do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff83729500>] ? _raw_spin_unlock+0x30/0x60
[   82.001011]  [<ffffffff8113ff5e>] do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff81140245>] sched_rt_period_timer+0x45/0x70
[   82.001011]  [<ffffffff8111f4f6>] __run_hrtimer+0x206/0x330
[   82.001011]  [<ffffffff81140200>] ? do_sched_rt_period_timer+0x320/0x320
[   82.001011]  [<ffffffff8111f8e8>] hrtimer_interrupt+0x118/0x230
[   82.001011]  [<ffffffff81090f55>] smp_apic_timer_interrupt+0x85/0xa0
[   82.001011]  [<ffffffff8372b0ef>] apic_timer_interrupt+0x6f/0x80
[   82.001011]  <EOI> 
[   82.001011]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[   82.001011]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[   82.001011]  [<ffffffff8116211d>] ? trace_hardirqs_on+0xd/0x10
[   82.001011]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[   82.001011]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[   82.001011]  [<ffffffff83636281>] rest_init+0x131/0x140
[   82.001011]  [<ffffffff83636150>] ? csum_partial_copy_generic+0x170/0x170
[   82.001011]  [<ffffffff850d108c>] start_kernel+0x3dc/0x3e9
[   82.001011]  [<ffffffff850d0ade>] ? kernel_init+0x28a/0x28a
[   82.001011]  [<ffffffff850d0324>] x86_64_start_reservations+0xff/0x104
[   82.001011]  [<ffffffff850d047e>] x86_64_start_kernel+0x155/0x164
[   82.001011] Code: 03 48 c7 43 08 00 00 00 00 48 89 03 48 83 c4 08 5b c9 c3 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 0f 31 89 c1 c9 48 89 d0 <89> c9 48 c1 e0 20 48 09 c8 c3 66 2e 0f 1f 84 00 00 00 00 00 55 
[   81.570014] NMI backtrace for cpu 2
[   81.570014] CPU 2 
[   81.570014] Pid: 5961, comm: trinity-child6 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.570014] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
[   81.570014] RSP: 0018:ffff88001a2bb7a8  EFLAGS: 00000086
[   81.570014] RAX: 0000000000000400 RBX: 0000000000000002 RCX: 0000000000000830
[   81.570014] RDX: 0000000000000002 RSI: 0000000000000400 RDI: 0000000000000830
[   81.570014] RBP: ffff88001a2bb7a8 R08: ffffffff84ee09c0 R09: 0000000000000000
[   81.570014] R10: 0000000000000000 R11: 0000000000000002 R12: 0000000000000002
[   81.570014] R13: ffffffff84ee09c0 R14: 0000000000000002 R15: 000000000000b024
[   81.570014] FS:  00007f9767634700(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
[   81.570014] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   81.570014] CR2: 0000000000000ff9 CR3: 000000000b8b0000 CR4: 00000000000406e0
[   81.570014] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.570014] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.570014] Process trinity-child6 (pid: 5961, threadinfo ffff88001a2ba000, task ffff88001a7f3000)
[   81.570014] Stack:
[   81.570014]  ffff88001a2bb818 ffffffff8109602d 0000000000000000 ffff88001a2bb928
[   81.570014]  ffff88001a2bb828 0000000000000086 0000000000000002 0000000200080000
[   81.570014]  ffff88001a2bb7f8 0000000000000000 000000009486a4e0 000000009486a4e0
[   81.570014] Call Trace:
[   81.570014]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
[   81.570014]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
[   81.570014]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
[   81.570014]  [<ffffffff8199bc43>] do_raw_spin_lock+0x103/0x140
[   81.570014]  [<ffffffff83728a78>] _raw_spin_lock_nested+0x68/0x90
[   81.570014]  [<ffffffff81139fe2>] ? load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff83728b07>] ? _raw_spin_lock+0x67/0x70
[   81.570014]  [<ffffffff81139fd5>] ? load_balance+0x295/0x6e0
[   81.570014]  [<ffffffff81139fe2>] load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff81137dc0>] ? find_busiest_group+0x2a0/0x2a0
[   81.570014]  [<ffffffff8113c6df>] idle_balance+0x15f/0x240
[   81.570014]  [<ffffffff8113c5bf>] ? idle_balance+0x3f/0x240
[   81.570014]  [<ffffffff8372739d>] __schedule+0x26d/0x880
[   81.570014]  [<ffffffff83727b15>] schedule+0x55/0x60
[   81.570014]  [<ffffffff83725568>] schedule_timeout+0x38/0x2c0
[   81.570014]  [<ffffffff8115fa5d>] ? __lock_acquired+0x3d/0x2e0
[   81.570014]  [<ffffffff83726f54>] ? wait_for_common+0x44/0x170
[   81.570014]  [<ffffffff83727007>] ? wait_for_common+0xf7/0x170
[   81.570014]  [<ffffffff8372700f>] wait_for_common+0xff/0x170
[   81.570014]  [<ffffffff81132ac0>] ? try_to_wake_up+0x290/0x290
[   81.570014]  [<ffffffff811efd60>] ? lru_add_drain+0x50/0x50
[   81.570014]  [<ffffffff83727128>] wait_for_completion+0x18/0x20
[   81.570014]  [<ffffffff8110d7c0>] flush_work+0x80/0xc0
[   81.570014]  [<ffffffff8110d740>] ? start_flush_work+0x1a0/0x1a0
[   81.570014]  [<ffffffff8110cab0>] ? do_work_for_cpu+0x30/0x30
[   81.570014]  [<ffffffff8110e33b>] schedule_on_each_cpu+0x13b/0x1c0
[   81.570014]  [<ffffffff811eed90>] lru_add_drain_all+0x10/0x20
[   81.570014]  [<ffffffff812403c9>] do_pages_move+0x49/0x1e0
[   81.570014]  [<ffffffff8199bb30>] ? do_raw_spin_unlock+0xd0/0xe0
[   81.570014]  [<ffffffff812409a7>] sys_move_pages+0x2f7/0x380
[   81.570014]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.570014] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
[   81.559841] NMI backtrace for cpu 1
[   81.559841] CPU 1 
[   81.559841] Pid: 0, comm: swapper/1 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.559841] RIP: 0010:[<ffffffff8112956f>]  [<ffffffff8112956f>] add_preempt_count+0x5f/0xa0
[   81.559841] RSP: 0018:ffff88000d5d1d08  EFLAGS: 00000006
[   81.559841] RAX: ffff88000d5d1fd8 RBX: ffffffff84b73020 RCX: 0000000000007159
[   81.559841] RDX: 0000000071597158 RSI: 0000000000000002 RDI: 0000000000000001
[   81.559841] RBP: ffff88000d5d1d08 R08: 0000000000000000 R09: 0000000000000000
[   81.559841] R10: 0000000000000000 R11: 0000000000000002 R12: 0000000000ccecab
[   81.559841] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
[   81.559841] FS:  0000000000000000(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
[   81.559841] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   81.559841] CR2: 0000000000f73ffc CR3: 000000000bb08000 CR4: 00000000000406e0
[   81.559841] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.559841] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.559841] Process swapper/1 (pid: 0, threadinfo ffff88000d5d0000, task ffff88000d5c8000)
[   81.559841] Stack:
[   81.559841]  ffff88000d5d1d48 ffffffff81984cbe 0000000000000000 ffffffff84b73020
[   81.559841]  0000000000ccecab 000000009486a4e0 0000000000000000 0000000000000000
[   81.559841]  ffff88000d5d1d58 ffffffff81984c6a ffff88000d5d1d98 ffffffff8199bc1d
[   81.559841] Call Trace:
[   81.559841]  [<ffffffff81984cbe>] delay_tsc+0x1e/0x140
[   81.559841]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   81.559841]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   81.559841]  [<ffffffff83728c91>] _raw_spin_lock_irqsave+0xa1/0xc0
[   81.559841]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff8112838d>] __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff811a4952>] force_quiescent_state+0x102/0x120
[   81.559841]  [<ffffffff811a95cb>] rcu_prepare_for_idle+0x32b/0x490
[   81.559841]  [<ffffffff811a994c>] rcu_idle_enter_common+0x21c/0x340
[   81.559841]  [<ffffffff81122110>] ? srcu_notifier_call_chain+0x20/0x20
[   81.559841]  [<ffffffff811a9d4b>] rcu_idle_enter+0xdb/0x150
[   81.559841]  [<ffffffff8107243e>] cpu_idle+0x10e/0x180
[   81.559841]  [<ffffffff8371ce3c>] ? setup_APIC_timer+0x88/0x8d
[   81.559841]  [<ffffffff8371c477>] start_secondary+0xd7/0xde
[   81.559841] Code: 63 be 32 0c 00 00 48 c7 c7 25 f1 27 84 e8 3a 1b fc ff eb 50 0f 1f 84 00 00 00 00 00 65 48 8b 04 25 88 d9 00 00 01 b8 44 e0 ff ff <8b> 0d 2f b1 20 04 85 c9 75 2f 80 b8 44 e0 ff ff f4 76 26 e8 49 
[   81.458024] NMI backtrace for cpu 3
[   81.458024] CPU 3 
[   81.458024] Pid: 5970, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.458024] RIP: 0010:[<ffffffff81984cc6>]  [<ffffffff81984cc6>] delay_tsc+0x26/0x140
[   81.458024] RSP: 0000:ffff88000bab15f8  EFLAGS: 00000006
[   81.458024] RAX: 0000000000000003 RBX: ffff880035bd6300 RCX: 0000000000000000
[   81.458024] RDX: 00000000ffe9ffe8 RSI: 0000000010000005 RDI: 0000000000000001
[   81.458024] RBP: ffff88000bab1628 R08: 0000000000000000 R09: 0000000000000000
[   81.458024] R10: 0000000000000000 R11: 0000000000000002 R12: 0000000000899af7
[   81.458024] R13: 0000000000000001 R14: 0000000000000000 R15: ffff880035a00000
[   81.458024] FS:  00007f9767634700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
[   81.458024] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   81.458024] CR2: 0000000000000008 CR3: 000000000b962000 CR4: 00000000000406e0
[   81.458024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.458024] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.458024] Process trinity-child19 (pid: 5970, threadinfo ffff88000bab0000, task ffff88000b9e8000)
[   81.458024] Stack:
[   81.458024]  0000000000000000 ffff880035bd6300 0000000000899af7 000000009486a4e0
[   81.458024]  0000000000000000 ffff880035a00000 ffff88000bab1638 ffffffff81984c6a
[   81.458024]  ffff88000bab1678 ffffffff8199bc1d ffff88000bab1678 0000000000000086
[   81.458024] Call Trace:
[   81.458024]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   81.458024]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   81.458024]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   81.458024]  [<ffffffff81130603>] ? ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81130603>] ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81132864>] ? try_to_wake_up+0x34/0x290
[   81.458024]  [<ffffffff81132a7c>] try_to_wake_up+0x24c/0x290
[   81.458024]  [<ffffffff8115fcc4>] ? __lock_acquired+0x2a4/0x2e0
[   81.458024]  [<ffffffff81132acd>] default_wake_function+0xd/0x10
[   81.458024]  [<ffffffff8111a6c8>] autoremove_wake_function+0x18/0x40
[   81.458024]  [<ffffffff811253c2>] __wake_up_common+0x52/0x90
[   81.458024]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.458024]  [<ffffffff811283a3>] __wake_up+0x43/0x70
[   81.458024]  [<ffffffff811a4173>] rcu_report_qs_rsp+0x73/0x80
[   81.458024]  [<ffffffff811a81cd>] rcu_report_qs_rnp+0x26d/0x2c0
[   81.458024]  [<ffffffff811a829e>] rcu_report_unblock_qs_rnp+0x7e/0x90
[   81.458024]  [<ffffffff811a8d70>] rcu_read_unlock_special+0x330/0x400
[   81.458024]  [<ffffffff8115d1fa>] ? get_lock_stats+0x2a/0x60
[   81.458024]  [<ffffffff811a906a>] rcu_preempt_note_context_switch+0x22a/0x300
[   81.458024]  [<ffffffff8372789a>] __schedule+0x76a/0x880
[   81.458024]  [<ffffffff81161bc6>] ? mark_held_locks+0xf6/0x120
[   81.458024]  [<ffffffff83727f34>] preempt_schedule_irq+0x94/0xd0
[   81.458024]  [<ffffffff83729da6>] retint_kernel+0x26/0x30
[   81.458024]  [<ffffffff811a8aa2>] ? rcu_read_unlock_special+0x62/0x400
[   81.458024]  [<ffffffff8115d23e>] ? put_lock_stats+0xe/0x40
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81163c6a>] ? __lock_release+0x1ba/0x1d0
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81115b5d>] __rcu_read_unlock+0x4d/0xa0
[   81.458024]  [<ffffffff811e0985>] find_get_page+0x235/0x260
[   81.458024]  [<ffffffff811e0750>] ? find_get_pages+0x2e0/0x2e0
[   81.458024]  [<ffffffff811e0eee>] filemap_fault+0x6e/0x4c0
[   81.458024]  [<ffffffff8120e33e>] __do_fault+0xae/0x560
[   81.458024]  [<ffffffff81134cb8>] ? sched_clock_cpu+0x108/0x120
[   81.458024]  [<ffffffff8120ee51>] handle_pte_fault+0x81/0x1f0
[   81.458024]  [<ffffffff8120f2e9>] handle_mm_fault+0x329/0x350
[   81.458024]  [<ffffffff8120b5f0>] ? follow_page+0x550/0x5a0
[   81.458024]  [<ffffffff8120f808>] __get_user_pages+0x438/0x5d0
[   81.458024]  [<ffffffff812108f6>] __mlock_vma_pages_range+0xc6/0xd0
[   81.458024]  [<ffffffff81210a01>] do_mlock_pages+0x101/0x180
[   81.458024]  [<ffffffff81211148>] sys_mlockall+0x128/0x1a0
[   81.458024]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.458024] Code: 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 49 89 fd 41 54 bf 01 00 00 00 53 48 83 ec 08 e8 52 48 7a ff e8 2d 87 01 00 0f 1f 00 <0f> ae e8 48 83 3d 67 15 ec 02 00 75 07 0f 0b 0f 1f 00 eb fe 41 
[   82.001011] BUG: spinlock lockup suspected on CPU#0, swapper/0/0
[   82.001011]  lock: 0xffff8800299d6300, .magic: dead4ead, .owner: trinity-child6/5961, .owner_cpu: 2
[   82.001011] Pid: 0, comm: swapper/0 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479
[   82.001011] Call Trace:
[   82.001011]  <IRQ>  [<ffffffff8199b9d8>] spin_dump+0x78/0xc0
[   82.001011]  [<ffffffff8199bc3e>] do_raw_spin_lock+0xfe/0x140
[   82.001011]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   82.001011]  [<ffffffff8113ff5e>] ? do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff83729500>] ? _raw_spin_unlock+0x30/0x60
[   82.001011]  [<ffffffff8113ff5e>] do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff81140245>] sched_rt_period_timer+0x45/0x70
[   82.001011]  [<ffffffff8111f4f6>] __run_hrtimer+0x206/0x330
[   82.001011]  [<ffffffff81140200>] ? do_sched_rt_period_timer+0x320/0x320
[   82.001011]  [<ffffffff8111f8e8>] hrtimer_interrupt+0x118/0x230
[   82.001011]  [<ffffffff81090f55>] smp_apic_timer_interrupt+0x85/0xa0
[   82.001011]  [<ffffffff8372b0ef>] apic_timer_interrupt+0x6f/0x80
[   82.001011]  <EOI>  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[   82.001011]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[   82.001011]  [<ffffffff8116211d>] ? trace_hardirqs_on+0xd/0x10
[   82.001011]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[   82.001011]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[   82.001011]  [<ffffffff83636281>] rest_init+0x131/0x140
[   82.001011]  [<ffffffff83636150>] ? csum_partial_copy_generic+0x170/0x170
[   82.001011]  [<ffffffff850d108c>] start_kernel+0x3dc/0x3e9
[   82.001011]  [<ffffffff850d0ade>] ? kernel_init+0x28a/0x28a
[   82.001011]  [<ffffffff850d0324>] x86_64_start_reservations+0xff/0x104
[   82.001011]  [<ffffffff850d047e>] x86_64_start_kernel+0x155/0x164
[   82.001011] sending NMI to all CPUs:
[   82.001011] NMI backtrace for cpu 0
[   82.001011] CPU 0 
[   82.001011] Pid: 0, comm: swapper/0 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   82.001011] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
[   82.001011] RSP: 0018:ffff88000d803d18  EFLAGS: 00000086
[   82.001011] RAX: 0000000000000400 RBX: 0000000000000000 RCX: 0000000000000830
[   82.001011] RDX: 0000000000000000 RSI: 0000000000000400 RDI: 0000000000000830
[   82.001011] RBP: ffff88000d803d18 R08: ffffffff84ee09c0 R09: 0000000000000000
[   82.001011] R10: 0000000000000000 R11: 0000000000000002 R12: 0000000000000000
[   82.001011] R13: ffffffff84ee09c0 R14: 0000000000000000 R15: 000000000000b024
[   82.001011] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
[   82.001011] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   82.001011] CR2: 0000000000db6594 CR3: 000000000bffa000 CR4: 00000000000406f0
[   82.001011] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   82.001011] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   82.001011] Process swapper/0 (pid: 0, threadinfo ffffffff84800000, task ffffffff8482d400)
[   82.001011] Stack:
[   82.001011]  ffff88000d803d88 ffffffff8109602d 0000000000000000 0000000000000001
[   82.001011]  ffff88000d803d98 0000000000000086 0000000000000002 0000000200080000
[   82.001011]  ffff88000d803d68 0000000000000000 000000009486a4e0 000000009486a4e0
[   82.001011] Call Trace:
[   82.001011]  <IRQ> 
[   82.001011]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
[   82.001011]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
[   82.001011]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
[   82.001011]  [<ffffffff8199bc43>] do_raw_spin_lock+0x103/0x140
[   82.001011]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   82.001011]  [<ffffffff8113ff5e>] ? do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff83729500>] ? _raw_spin_unlock+0x30/0x60
[   82.001011]  [<ffffffff8113ff5e>] do_sched_rt_period_timer+0x7e/0x320
[   82.001011]  [<ffffffff81140245>] sched_rt_period_timer+0x45/0x70
[   82.001011]  [<ffffffff8111f4f6>] __run_hrtimer+0x206/0x330
[   82.001011]  [<ffffffff81140200>] ? do_sched_rt_period_timer+0x320/0x320
[   82.001011]  [<ffffffff8111f8e8>] hrtimer_interrupt+0x118/0x230
[   82.001011]  [<ffffffff81090f55>] smp_apic_timer_interrupt+0x85/0xa0
[   82.001011]  [<ffffffff8372b0ef>] apic_timer_interrupt+0x6f/0x80
[   82.001011]  <EOI> 
[   82.001011]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[   82.001011]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[   82.001011]  [<ffffffff8116211d>] ? trace_hardirqs_on+0xd/0x10
[   82.001011]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[   82.001011]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[   82.001011]  [<ffffffff83636281>] rest_init+0x131/0x140
[   82.001011]  [<ffffffff83636150>] ? csum_partial_copy_generic+0x170/0x170
[   82.001011]  [<ffffffff850d108c>] start_kernel+0x3dc/0x3e9
[   82.001011]  [<ffffffff850d0ade>] ? kernel_init+0x28a/0x28a
[   82.001011]  [<ffffffff850d0324>] x86_64_start_reservations+0xff/0x104
[   82.001011]  [<ffffffff850d047e>] x86_64_start_kernel+0x155/0x164
[   82.001011] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
[   81.559841] NMI backtrace for cpu 1
[   81.559841] CPU 1 
[   81.559841] Pid: 0, comm: swapper/1 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.559841] RIP: 0010:[<ffffffff81071646>]  [<ffffffff81071646>] native_read_tsc+0x6/0x20
[   81.559841] RSP: 0018:ffff88000d5d1d08  EFLAGS: 00000082
[   81.559841] RAX: 000000007a9c9786 RBX: 000000007a9c9749 RCX: 000000007a9c9749
[   81.559841] RDX: 0000000000000092 RSI: 0000000000000002 RDI: 0000000000000001
[   81.559841] RBP: ffff88000d5d1d08 R08: 0000000000000000 R09: 0000000000000000
[   81.559841] R10: 0000000000000000 R11: 0000000000000002 R12: ffff88000d5d0010
[   81.559841] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000
[   81.559841] FS:  0000000000000000(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
[   81.559841] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   81.559841] CR2: 0000000000f73ffc CR3: 000000000bb08000 CR4: 00000000000406e0
[   81.559841] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.559841] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.559841] Process swapper/1 (pid: 0, threadinfo ffff88000d5d0000, task ffff88000d5c8000)
[   81.559841] Stack:
[   81.559841]  ffff88000d5d1d48 ffffffff81984d25 0000000000000000 ffffffff84b73020
[   81.559841]  000000000192362a 000000009486a4e0 0000000000000000 0000000000000000
[   81.559841]  ffff88000d5d1d58 ffffffff81984c6a ffff88000d5d1d98 ffffffff8199bc1d
[   81.559841] Call Trace:
[   81.559841]  [<ffffffff81984d25>] delay_tsc+0x85/0x140
[   81.559841]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   81.559841]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   81.559841]  [<ffffffff83728c91>] _raw_spin_lock_irqsave+0xa1/0xc0
[   81.559841]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff8112838d>] __wake_up+0x2d/0x70
[   81.559841]  [<ffffffff811a4952>] force_quiescent_state+0x102/0x120
[   81.559841]  [<ffffffff811a95cb>] rcu_prepare_for_idle+0x32b/0x490
[   81.559841]  [<ffffffff811a994c>] rcu_idle_enter_common+0x21c/0x340
[   81.559841]  [<ffffffff81122110>] ? srcu_notifier_call_chain+0x20/0x20
[   81.559841]  [<ffffffff811a9d4b>] rcu_idle_enter+0xdb/0x150
[   81.559841]  [<ffffffff8107243e>] cpu_idle+0x10e/0x180
[   81.559841]  [<ffffffff8371ce3c>] ? setup_APIC_timer+0x88/0x8d
[   81.559841]  [<ffffffff8371c477>] start_secondary+0xd7/0xde
[   81.559841] Code: 08 ff 15 e6 ae 7c 03 48 c7 43 08 00 00 00 00 48 89 03 48 83 c4 08 5b c9 c3 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 0f 31 <89> c1 c9 48 89 d0 89 c9 48 c1 e0 20 48 09 c8 c3 66 2e 0f 1f 84 
[   81.570014] NMI backtrace for cpu 2
[   81.570014] CPU 2 
[   81.570014] Pid: 5961, comm: trinity-child6 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.570014] RIP: 0010:[<ffffffff81071646>]  [<ffffffff81071646>] native_read_tsc+0x6/0x20
[   81.570014] RSP: 0018:ffff88001a2bb7f8  EFLAGS: 00000082
[   81.570014] RAX: 000000007a9cb129 RBX: ffff880035bd6300 RCX: 0000000000000000
[   81.570014] RDX: 0000000000000092 RSI: 0000000000000003 RDI: 0000000000000001
[   81.570014] RBP: ffff88001a2bb7f8 R08: 0000000000000000 R09: 0000000000000000
[   81.570014] R10: 0000000000000000 R11: 0000000000000002 R12: 0000000000988054
[   81.570014] R13: 0000000000000001 R14: 0000000000000002 R15: ffff88001a2bb928
[   81.570014] FS:  00007f9767634700(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
[   81.570014] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   81.570014] CR2: 0000000000000ff9 CR3: 000000000b8b0000 CR4: 00000000000406e0
[   81.570014] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.570014] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.570014] Process trinity-child6 (pid: 5961, threadinfo ffff88001a2ba000, task ffff88001a7f3000)
[   81.570014] Stack:
[   81.570014]  ffff88001a2bb838 ffffffff81984ce2 0000000000000000 ffff880035bd6300
[   81.570014]  0000000000988054 000000009486a4e0 0000000000000000 ffff88001a2bb928
[   81.570014]  ffff88001a2bb848 ffffffff81984c6a ffff88001a2bb888 ffffffff8199bc1d
[   81.570014] Call Trace:
[   81.570014]  [<ffffffff81984ce2>] delay_tsc+0x42/0x140
[   81.570014]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   81.570014]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   81.570014]  [<ffffffff83728a78>] _raw_spin_lock_nested+0x68/0x90
[   81.570014]  [<ffffffff81139fe2>] ? load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff83728b07>] ? _raw_spin_lock+0x67/0x70
[   81.570014]  [<ffffffff81139fd5>] ? load_balance+0x295/0x6e0
[   81.570014]  [<ffffffff81139fe2>] load_balance+0x2a2/0x6e0
[   81.570014]  [<ffffffff81137dc0>] ? find_busiest_group+0x2a0/0x2a0
[   81.570014]  [<ffffffff8113c6df>] idle_balance+0x15f/0x240
[   81.570014]  [<ffffffff8113c5bf>] ? idle_balance+0x3f/0x240
[   81.570014]  [<ffffffff8372739d>] __schedule+0x26d/0x880
[   81.570014]  [<ffffffff83727b15>] schedule+0x55/0x60
[   81.570014]  [<ffffffff83725568>] schedule_timeout+0x38/0x2c0
[   81.570014]  [<ffffffff8115fa5d>] ? __lock_acquired+0x3d/0x2e0
[   81.570014]  [<ffffffff83726f54>] ? wait_for_common+0x44/0x170
[   81.570014]  [<ffffffff83727007>] ? wait_for_common+0xf7/0x170
[   81.570014]  [<ffffffff8372700f>] wait_for_common+0xff/0x170
[   81.570014]  [<ffffffff81132ac0>] ? try_to_wake_up+0x290/0x290
[   81.570014]  [<ffffffff811efd60>] ? lru_add_drain+0x50/0x50
[   81.570014]  [<ffffffff83727128>] wait_for_completion+0x18/0x20
[   81.570014]  [<ffffffff8110d7c0>] flush_work+0x80/0xc0
[   81.570014]  [<ffffffff8110d740>] ? start_flush_work+0x1a0/0x1a0
[   81.570014]  [<ffffffff8110cab0>] ? do_work_for_cpu+0x30/0x30
[   81.570014]  [<ffffffff8110e33b>] schedule_on_each_cpu+0x13b/0x1c0
[   81.570014]  [<ffffffff811eed90>] lru_add_drain_all+0x10/0x20
[   81.570014]  [<ffffffff812403c9>] do_pages_move+0x49/0x1e0
[   81.570014]  [<ffffffff8199bb30>] ? do_raw_spin_unlock+0xd0/0xe0
[   81.570014]  [<ffffffff812409a7>] sys_move_pages+0x2f7/0x380
[   81.570014]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.570014] Code: 08 ff 15 e6 ae 7c 03 48 c7 43 08 00 00 00 00 48 89 03 48 83 c4 08 5b c9 c3 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 0f 31 <89> c1 c9 48 89 d0 89 c9 48 c1 e0 20 48 09 c8 c3 66 2e 0f 1f 84 
[   81.458024] NMI backtrace for cpu 3
[   81.458024] CPU 3 
[   81.458024] Pid: 5970, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120628-sasha-00005-g9f23eb7 #479  
[   81.458024] RIP: 0010:[<ffffffff81984d20>]  [<ffffffff81984d20>] delay_tsc+0x80/0x140
[   81.458024] RSP: 0000:ffff88000bab15f8  EFLAGS: 00000082
[   81.458024] RAX: 000000927a9cc311 RBX: 000000007a9cc311 RCX: 000000007a9cc311
[   81.458024] RDX: 0000000000000092 RSI: 0000000010000005 RDI: 0000000000000001
[   81.458024] RBP: ffff88000bab1628 R08: 0000000000000000 R09: 0000000000000000
[   81.458024] R10: 0000000000000000 R11: 0000000000000002 R12: ffff88000bab0010
[   81.458024] R13: 0000000000000001 R14: 0000000000000003 R15: ffff880035a00000
[   81.458024] FS:  00007f9767634700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
[   81.458024] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[   81.458024] CR2: 0000000000000008 CR3: 000000000b962000 CR4: 00000000000406e0
[   81.458024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   81.458024] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[   81.458024] Process trinity-child19 (pid: 5970, threadinfo ffff88000bab0000, task ffff88000b9e8000)
[   81.458024] Stack:
[   81.458024]  0000000000000000 ffff880035bd6300 00000000011ecec4 000000009486a4e0
[   81.458024]  0000000000000000 ffff880035a00000 ffff88000bab1638 ffffffff81984c6a
[   81.458024]  ffff88000bab1678 ffffffff8199bc1d ffff88000bab1678 0000000000000086
[   81.458024] Call Trace:
[   81.458024]  [<ffffffff81984c6a>] __delay+0xa/0x10
[   81.458024]  [<ffffffff8199bc1d>] do_raw_spin_lock+0xdd/0x140
[   81.458024]  [<ffffffff83728afb>] _raw_spin_lock+0x5b/0x70
[   81.458024]  [<ffffffff81130603>] ? ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81130603>] ttwu_queue+0xd3/0x100
[   81.458024]  [<ffffffff81132864>] ? try_to_wake_up+0x34/0x290
[   81.458024]  [<ffffffff81132a7c>] try_to_wake_up+0x24c/0x290
[   81.458024]  [<ffffffff8115fcc4>] ? __lock_acquired+0x2a4/0x2e0
[   81.458024]  [<ffffffff81132acd>] default_wake_function+0xd/0x10
[   81.458024]  [<ffffffff8111a6c8>] autoremove_wake_function+0x18/0x40
[   81.458024]  [<ffffffff811253c2>] __wake_up_common+0x52/0x90
[   81.458024]  [<ffffffff8112838d>] ? __wake_up+0x2d/0x70
[   81.458024]  [<ffffffff811283a3>] __wake_up+0x43/0x70
[   81.458024]  [<ffffffff811a4173>] rcu_report_qs_rsp+0x73/0x80
[   81.458024]  [<ffffffff811a81cd>] rcu_report_qs_rnp+0x26d/0x2c0
[   81.458024]  [<ffffffff811a829e>] rcu_report_unblock_qs_rnp+0x7e/0x90
[   81.458024]  [<ffffffff811a8d70>] rcu_read_unlock_special+0x330/0x400
[   81.458024]  [<ffffffff8115d1fa>] ? get_lock_stats+0x2a/0x60
[   81.458024]  [<ffffffff811a906a>] rcu_preempt_note_context_switch+0x22a/0x300
[   81.458024]  [<ffffffff8372789a>] __schedule+0x76a/0x880
[   81.458024]  [<ffffffff81161bc6>] ? mark_held_locks+0xf6/0x120
[   81.458024]  [<ffffffff83727f34>] preempt_schedule_irq+0x94/0xd0
[   81.458024]  [<ffffffff83729da6>] retint_kernel+0x26/0x30
[   81.458024]  [<ffffffff811a8aa2>] ? rcu_read_unlock_special+0x62/0x400
[   81.458024]  [<ffffffff8115d23e>] ? put_lock_stats+0xe/0x40
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81163c6a>] ? __lock_release+0x1ba/0x1d0
[   81.458024]  [<ffffffff811e0968>] ? find_get_page+0x218/0x260
[   81.458024]  [<ffffffff81115b5d>] __rcu_read_unlock+0x4d/0xa0
[   81.458024]  [<ffffffff811e0985>] find_get_page+0x235/0x260
[   81.458024]  [<ffffffff811e0750>] ? find_get_pages+0x2e0/0x2e0
[   81.458024]  [<ffffffff811e0eee>] filemap_fault+0x6e/0x4c0
[   81.458024]  [<ffffffff8120e33e>] __do_fault+0xae/0x560
[   81.458024]  [<ffffffff81134cb8>] ? sched_clock_cpu+0x108/0x120
[   81.458024]  [<ffffffff8120ee51>] handle_pte_fault+0x81/0x1f0
[   81.458024]  [<ffffffff8120f2e9>] handle_mm_fault+0x329/0x350
[   81.458024]  [<ffffffff8120b5f0>] ? follow_page+0x550/0x5a0
[   81.458024]  [<ffffffff8120f808>] __get_user_pages+0x438/0x5d0
[   81.458024]  [<ffffffff812108f6>] __mlock_vma_pages_range+0xc6/0xd0
[   81.458024]  [<ffffffff81210a01>] do_mlock_pages+0x101/0x180
[   81.458024]  [<ffffffff81211148>] sys_mlockall+0x128/0x1a0
[   81.458024]  [<ffffffff8372a539>] system_call_fastpath+0x16/0x1b
[   81.458024] Code: 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 0f ae e8 48 83 3d 2a 15 ec 02 00 75 10 0f 0b 66 0f 1f 44 00 00 eb fe 66 0f 1f 44 00 00 <e8> 1b c9 6e ff 66 90 41 89 c7 29 d8 44 39 e8 73 6f bf 01 00 00


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-29 10:09 rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970 Sasha Levin
@ 2012-06-29 17:23 ` Paul E. McKenney
  2012-06-29 21:40   ` Sasha Levin
  2012-06-30 11:36   ` Sasha Levin
  0 siblings, 2 replies; 20+ messages in thread
From: Paul E. McKenney @ 2012-06-29 17:23 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

On Fri, Jun 29, 2012 at 12:09:44PM +0200, Sasha Levin wrote:
> Hi Paul,
> 
> I think I've stumbled on another bug that will increase your paranoia levels even further.
> 
> I got the following lockup when fuzzing with trinity inside a KVM tools guest, using latest linux-next.
> 
> It appears that it was caused by a03d6178 ("rcu: Move RCU grace-period cleanup into kthread"). This issue doesn't reproduce easily though, it took some fuzzing before hitting it.

Hmmm...  If the preemption at that point in __rcu_read_unlock() is
required to make this happen, then it would be pretty hard to hit.
I suspect that you can make it reproduce more quickly by putting
a udelay(10) or similar right after the assignment of INT_MIN to
t->rcu_read_lock_nesting in __rcu_read_unlock() in kernel/rcupdate.c.
Can this be reproduced while running with lockdep enabled?

Please see below for an untested patch that gets RCU out of this loop,
but it is quite possible that something else is involved here, so it would
be very good to get a lockdep run, if possible.  My concern stems from the
fact that interrupts were enabled during the call to __rcu_read_unlock()
-- otherwise it would not have been preempted -- so the runqueue locks
were presumably not held on entry to __rcu_read_unlock().

							Thanx, Paul

------------------------------------------------------------------------

rcu: Avoid grace-period kthread wakeups from unsafe environments

A soft lockup involving the run-queue locks involved the wakeup of
the grace-period kthread.  This commit therefore defers the wakeup
to softirq context.

Reported-by: Sasha Levin <levinsasha928@gmail.com>
Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>

diff --git a/kernel/rcutree.c b/kernel/rcutree.c
index c0e0454..cd0076e 100644
--- a/kernel/rcutree.c
+++ b/kernel/rcutree.c
@@ -1262,6 +1262,15 @@ static int rcu_gp_kthread(void *arg)
 }
 
 /*
+ * Signal the RCU core to wake up the grace-period kthread, as we might
+ * not be in a context where it is safe to do the wakeup directly.
+ */
+static void rcu_wake_gp_kthread(struct rcu_state *rsp)
+{
+	ACCESS_ONCE(rsp->wake_gp_kthread) = 1;
+}
+
+/*
  * Start a new RCU grace period if warranted, re-initializing the hierarchy
  * in preparation for detecting the next grace period.  The caller must hold
  * the root node's ->lock, which is released before return.  Hard irqs must
@@ -1291,7 +1300,7 @@ rcu_start_gp(struct rcu_state *rsp, unsigned long flags)
 
 	rsp->gp_flags = 1;
 	raw_spin_unlock_irqrestore(&rnp->lock, flags);
-	wake_up(&rsp->gp_wq);
+	rcu_wake_gp_kthread(rsp);
 }
 
 /*
@@ -1306,7 +1315,7 @@ static void rcu_report_qs_rsp(struct rcu_state *rsp, unsigned long flags)
 {
 	WARN_ON_ONCE(!rcu_gp_in_progress(rsp));
 	raw_spin_unlock_irqrestore(&rcu_get_root(rsp)->lock, flags);
-	wake_up(&rsp->gp_wq);  /* Memory barrier implied by wake_up() path. */
+	rcu_wake_gp_kthread(rsp); /* smp_mb() implied by wakeup. */
 }
 
 /*
@@ -1889,6 +1898,12 @@ __rcu_process_callbacks(struct rcu_state *rsp)
 
 	WARN_ON_ONCE(rdp->beenonline == 0);
 
+	/* Awaken the grace-period kthread if needed. */
+	if (ACCESS_ONCE(rsp->wake_gp_kthread)) {
+		if (xchg(&rsp->wake_gp_kthread, 0)) /* Prevent wakeup storms. */
+			wake_up(&rsp->gp_wq);
+	}
+
 	/*
 	 * Advance callbacks in response to end of earlier grace
 	 * period that some other CPU ended.
@@ -2304,6 +2319,12 @@ static int __rcu_pending(struct rcu_state *rsp, struct rcu_data *rdp)
 		return 1;
 	}
 
+	/* Does the grace-period kthread need to be awakened? */
+	if (ACCESS_ONCE(rsp->wake_gp_kthread)) {
+		rdp->n_wake_gp_kthread++;
+		return 1;
+	}
+
 	/* nothing to do */
 	rdp->n_rp_need_nothing++;
 	return 0;
diff --git a/kernel/rcutree.h b/kernel/rcutree.h
index 280ad7c..89a190c 100644
--- a/kernel/rcutree.h
+++ b/kernel/rcutree.h
@@ -313,6 +313,7 @@ struct rcu_data {
 	unsigned long n_rp_cpu_needs_gp;
 	unsigned long n_rp_gp_completed;
 	unsigned long n_rp_gp_started;
+	unsigned long n_wake_gp_kthread;
 	unsigned long n_rp_need_nothing;
 
 	/* 6) _rcu_barrier() callback. */
@@ -381,6 +382,7 @@ struct rcu_state {
 	struct task_struct *gp_kthread;		/* Task for grace periods. */
 	wait_queue_head_t gp_wq;		/* Where GP task waits. */
 	int gp_flags;				/* Commands for GP task. */
+	int wake_gp_kthread;			/* Awaken GP task? */
 
 	/* End of fields guarded by root rcu_node's lock. */
 


^ permalink raw reply related	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-29 17:23 ` Paul E. McKenney
@ 2012-06-29 21:40   ` Sasha Levin
  2012-06-29 22:27     ` Paul E. McKenney
  2012-07-02 10:32     ` Peter Zijlstra
  2012-06-30 11:36   ` Sasha Levin
  1 sibling, 2 replies; 20+ messages in thread
From: Sasha Levin @ 2012-06-29 21:40 UTC (permalink / raw)
  To: paulmck; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

On Fri, 2012-06-29 at 10:23 -0700, Paul E. McKenney wrote:
> On Fri, Jun 29, 2012 at 12:09:44PM +0200, Sasha Levin wrote:
> > Hi Paul,
> > 
> > I think I've stumbled on another bug that will increase your paranoia levels even further.
> > 
> > I got the following lockup when fuzzing with trinity inside a KVM tools guest, using latest linux-next.
> > 
> > It appears that it was caused by a03d6178 ("rcu: Move RCU grace-period cleanup into kthread"). This issue doesn't reproduce easily though, it took some fuzzing before hitting it.
> 
> Hmmm...  If the preemption at that point in __rcu_read_unlock() is
> required to make this happen, then it would be pretty hard to hit.
> I suspect that you can make it reproduce more quickly by putting
> a udelay(10) or similar right after the assignment of INT_MIN to
> t->rcu_read_lock_nesting in __rcu_read_unlock() in kernel/rcupdate.c.
> Can this be reproduced while running with lockdep enabled?

The good news are that it is much easier to reproduce it by adding a udelay(10) at the point you've mentioned.

The bad news are that what you saw was a lockdep enabled run (CONFIG_PROVE_RCU is enabled, and lockdep was enabled). There were no lockdep warnings at any point while reproducing it.

> Please see below for an untested patch that gets RCU out of this loop,
> but it is quite possible that something else is involved here, so it would
> be very good to get a lockdep run, if possible.  My concern stems from the
> fact that interrupts were enabled during the call to __rcu_read_unlock()
> -- otherwise it would not have been preempted -- so the runqueue locks
> were presumably not held on entry to __rcu_read_unlock().

I've scheduled to try this patch tomorrow after a sleep, unless you preempt me first :)

> 							Thanx, Paul
> 
> ------------------------------------------------------------------------
> 
> rcu: Avoid grace-period kthread wakeups from unsafe environments
> 
> A soft lockup involving the run-queue locks involved the wakeup of
> the grace-period kthread.  This commit therefore defers the wakeup
> to softirq context.
> 
> Reported-by: Sasha Levin <levinsasha928@gmail.com>
> Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
> 
> diff --git a/kernel/rcutree.c b/kernel/rcutree.c
> index c0e0454..cd0076e 100644
> --- a/kernel/rcutree.c
> +++ b/kernel/rcutree.c
> @@ -1262,6 +1262,15 @@ static int rcu_gp_kthread(void *arg)
>  }
>  
>  /*
> + * Signal the RCU core to wake up the grace-period kthread, as we might
> + * not be in a context where it is safe to do the wakeup directly.
> + */
> +static void rcu_wake_gp_kthread(struct rcu_state *rsp)
> +{
> +	ACCESS_ONCE(rsp->wake_gp_kthread) = 1;
> +}
> +
> +/*
>   * Start a new RCU grace period if warranted, re-initializing the hierarchy
>   * in preparation for detecting the next grace period.  The caller must hold
>   * the root node's ->lock, which is released before return.  Hard irqs must
> @@ -1291,7 +1300,7 @@ rcu_start_gp(struct rcu_state *rsp, unsigned long flags)
>  
>  	rsp->gp_flags = 1;
>  	raw_spin_unlock_irqrestore(&rnp->lock, flags);
> -	wake_up(&rsp->gp_wq);
> +	rcu_wake_gp_kthread(rsp);
>  }
>  
>  /*
> @@ -1306,7 +1315,7 @@ static void rcu_report_qs_rsp(struct rcu_state *rsp, unsigned long flags)
>  {
>  	WARN_ON_ONCE(!rcu_gp_in_progress(rsp));
>  	raw_spin_unlock_irqrestore(&rcu_get_root(rsp)->lock, flags);
> -	wake_up(&rsp->gp_wq);  /* Memory barrier implied by wake_up() path. */
> +	rcu_wake_gp_kthread(rsp); /* smp_mb() implied by wakeup. */
>  }
>  
>  /*
> @@ -1889,6 +1898,12 @@ __rcu_process_callbacks(struct rcu_state *rsp)
>  
>  	WARN_ON_ONCE(rdp->beenonline == 0);
>  
> +	/* Awaken the grace-period kthread if needed. */
> +	if (ACCESS_ONCE(rsp->wake_gp_kthread)) {
> +		if (xchg(&rsp->wake_gp_kthread, 0)) /* Prevent wakeup storms. */
> +			wake_up(&rsp->gp_wq);
> +	}
> +
>  	/*
>  	 * Advance callbacks in response to end of earlier grace
>  	 * period that some other CPU ended.
> @@ -2304,6 +2319,12 @@ static int __rcu_pending(struct rcu_state *rsp, struct rcu_data *rdp)
>  		return 1;
>  	}
>  
> +	/* Does the grace-period kthread need to be awakened? */
> +	if (ACCESS_ONCE(rsp->wake_gp_kthread)) {
> +		rdp->n_wake_gp_kthread++;
> +		return 1;
> +	}
> +
>  	/* nothing to do */
>  	rdp->n_rp_need_nothing++;
>  	return 0;
> diff --git a/kernel/rcutree.h b/kernel/rcutree.h
> index 280ad7c..89a190c 100644
> --- a/kernel/rcutree.h
> +++ b/kernel/rcutree.h
> @@ -313,6 +313,7 @@ struct rcu_data {
>  	unsigned long n_rp_cpu_needs_gp;
>  	unsigned long n_rp_gp_completed;
>  	unsigned long n_rp_gp_started;
> +	unsigned long n_wake_gp_kthread;
>  	unsigned long n_rp_need_nothing;
>  
>  	/* 6) _rcu_barrier() callback. */
> @@ -381,6 +382,7 @@ struct rcu_state {
>  	struct task_struct *gp_kthread;		/* Task for grace periods. */
>  	wait_queue_head_t gp_wq;		/* Where GP task waits. */
>  	int gp_flags;				/* Commands for GP task. */
> +	int wake_gp_kthread;			/* Awaken GP task? */
>  
>  	/* End of fields guarded by root rcu_node's lock. */
>  
> 
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-29 21:40   ` Sasha Levin
@ 2012-06-29 22:27     ` Paul E. McKenney
  2012-06-29 22:40       ` Sasha Levin
  2012-07-02 10:32     ` Peter Zijlstra
  1 sibling, 1 reply; 20+ messages in thread
From: Paul E. McKenney @ 2012-06-29 22:27 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

On Fri, Jun 29, 2012 at 11:40:40PM +0200, Sasha Levin wrote:
> On Fri, 2012-06-29 at 10:23 -0700, Paul E. McKenney wrote:
> > On Fri, Jun 29, 2012 at 12:09:44PM +0200, Sasha Levin wrote:
> > > Hi Paul,
> > > 
> > > I think I've stumbled on another bug that will increase your paranoia levels even further.
> > > 
> > > I got the following lockup when fuzzing with trinity inside a KVM tools guest, using latest linux-next.
> > > 
> > > It appears that it was caused by a03d6178 ("rcu: Move RCU grace-period cleanup into kthread"). This issue doesn't reproduce easily though, it took some fuzzing before hitting it.
> > 
> > Hmmm...  If the preemption at that point in __rcu_read_unlock() is
> > required to make this happen, then it would be pretty hard to hit.
> > I suspect that you can make it reproduce more quickly by putting
> > a udelay(10) or similar right after the assignment of INT_MIN to
> > t->rcu_read_lock_nesting in __rcu_read_unlock() in kernel/rcupdate.c.
> > Can this be reproduced while running with lockdep enabled?
> 
> The good news are that it is much easier to reproduce it by adding a udelay(10) at the point you've mentioned.

How quickly does it reproduce?

> The bad news are that what you saw was a lockdep enabled run (CONFIG_PROVE_RCU is enabled, and lockdep was enabled). There were no lockdep warnings at any point while reproducing it.

Well, at least that means a reasonable way to test fixes.

> > Please see below for an untested patch that gets RCU out of this loop,
> > but it is quite possible that something else is involved here, so it would
> > be very good to get a lockdep run, if possible.  My concern stems from the
> > fact that interrupts were enabled during the call to __rcu_read_unlock()
> > -- otherwise it would not have been preempted -- so the runqueue locks
> > were presumably not held on entry to __rcu_read_unlock().
> 
> I've scheduled to try this patch tomorrow after a sleep, unless you preempt me first :)

Get some sleep!!!

							Thanx, Paul

> > ------------------------------------------------------------------------
> > 
> > rcu: Avoid grace-period kthread wakeups from unsafe environments
> > 
> > A soft lockup involving the run-queue locks involved the wakeup of
> > the grace-period kthread.  This commit therefore defers the wakeup
> > to softirq context.
> > 
> > Reported-by: Sasha Levin <levinsasha928@gmail.com>
> > Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
> > 
> > diff --git a/kernel/rcutree.c b/kernel/rcutree.c
> > index c0e0454..cd0076e 100644
> > --- a/kernel/rcutree.c
> > +++ b/kernel/rcutree.c
> > @@ -1262,6 +1262,15 @@ static int rcu_gp_kthread(void *arg)
> >  }
> >  
> >  /*
> > + * Signal the RCU core to wake up the grace-period kthread, as we might
> > + * not be in a context where it is safe to do the wakeup directly.
> > + */
> > +static void rcu_wake_gp_kthread(struct rcu_state *rsp)
> > +{
> > +	ACCESS_ONCE(rsp->wake_gp_kthread) = 1;
> > +}
> > +
> > +/*
> >   * Start a new RCU grace period if warranted, re-initializing the hierarchy
> >   * in preparation for detecting the next grace period.  The caller must hold
> >   * the root node's ->lock, which is released before return.  Hard irqs must
> > @@ -1291,7 +1300,7 @@ rcu_start_gp(struct rcu_state *rsp, unsigned long flags)
> >  
> >  	rsp->gp_flags = 1;
> >  	raw_spin_unlock_irqrestore(&rnp->lock, flags);
> > -	wake_up(&rsp->gp_wq);
> > +	rcu_wake_gp_kthread(rsp);
> >  }
> >  
> >  /*
> > @@ -1306,7 +1315,7 @@ static void rcu_report_qs_rsp(struct rcu_state *rsp, unsigned long flags)
> >  {
> >  	WARN_ON_ONCE(!rcu_gp_in_progress(rsp));
> >  	raw_spin_unlock_irqrestore(&rcu_get_root(rsp)->lock, flags);
> > -	wake_up(&rsp->gp_wq);  /* Memory barrier implied by wake_up() path. */
> > +	rcu_wake_gp_kthread(rsp); /* smp_mb() implied by wakeup. */
> >  }
> >  
> >  /*
> > @@ -1889,6 +1898,12 @@ __rcu_process_callbacks(struct rcu_state *rsp)
> >  
> >  	WARN_ON_ONCE(rdp->beenonline == 0);
> >  
> > +	/* Awaken the grace-period kthread if needed. */
> > +	if (ACCESS_ONCE(rsp->wake_gp_kthread)) {
> > +		if (xchg(&rsp->wake_gp_kthread, 0)) /* Prevent wakeup storms. */
> > +			wake_up(&rsp->gp_wq);
> > +	}
> > +
> >  	/*
> >  	 * Advance callbacks in response to end of earlier grace
> >  	 * period that some other CPU ended.
> > @@ -2304,6 +2319,12 @@ static int __rcu_pending(struct rcu_state *rsp, struct rcu_data *rdp)
> >  		return 1;
> >  	}
> >  
> > +	/* Does the grace-period kthread need to be awakened? */
> > +	if (ACCESS_ONCE(rsp->wake_gp_kthread)) {
> > +		rdp->n_wake_gp_kthread++;
> > +		return 1;
> > +	}
> > +
> >  	/* nothing to do */
> >  	rdp->n_rp_need_nothing++;
> >  	return 0;
> > diff --git a/kernel/rcutree.h b/kernel/rcutree.h
> > index 280ad7c..89a190c 100644
> > --- a/kernel/rcutree.h
> > +++ b/kernel/rcutree.h
> > @@ -313,6 +313,7 @@ struct rcu_data {
> >  	unsigned long n_rp_cpu_needs_gp;
> >  	unsigned long n_rp_gp_completed;
> >  	unsigned long n_rp_gp_started;
> > +	unsigned long n_wake_gp_kthread;
> >  	unsigned long n_rp_need_nothing;
> >  
> >  	/* 6) _rcu_barrier() callback. */
> > @@ -381,6 +382,7 @@ struct rcu_state {
> >  	struct task_struct *gp_kthread;		/* Task for grace periods. */
> >  	wait_queue_head_t gp_wq;		/* Where GP task waits. */
> >  	int gp_flags;				/* Commands for GP task. */
> > +	int wake_gp_kthread;			/* Awaken GP task? */
> >  
> >  	/* End of fields guarded by root rcu_node's lock. */
> >  
> > 
> > --
> > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> > Please read the FAQ at  http://www.tux.org/lkml/
> 
> 


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-29 22:27     ` Paul E. McKenney
@ 2012-06-29 22:40       ` Sasha Levin
  2012-06-29 23:01         ` Paul E. McKenney
  0 siblings, 1 reply; 20+ messages in thread
From: Sasha Levin @ 2012-06-29 22:40 UTC (permalink / raw)
  To: paulmck; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

On Fri, 2012-06-29 at 15:27 -0700, Paul E. McKenney wrote:
> On Fri, Jun 29, 2012 at 11:40:40PM +0200, Sasha Levin wrote:
> > On Fri, 2012-06-29 at 10:23 -0700, Paul E. McKenney wrote:
> > > On Fri, Jun 29, 2012 at 12:09:44PM +0200, Sasha Levin wrote:
> > > > Hi Paul,
> > > > 
> > > > I think I've stumbled on another bug that will increase your paranoia levels even further.
> > > > 
> > > > I got the following lockup when fuzzing with trinity inside a KVM tools guest, using latest linux-next.
> > > > 
> > > > It appears that it was caused by a03d6178 ("rcu: Move RCU grace-period cleanup into kthread"). This issue doesn't reproduce easily though, it took some fuzzing before hitting it.
> > > 
> > > Hmmm...  If the preemption at that point in __rcu_read_unlock() is
> > > required to make this happen, then it would be pretty hard to hit.
> > > I suspect that you can make it reproduce more quickly by putting
> > > a udelay(10) or similar right after the assignment of INT_MIN to
> > > t->rcu_read_lock_nesting in __rcu_read_unlock() in kernel/rcupdate.c.
> > > Can this be reproduced while running with lockdep enabled?
> > 
> > The good news are that it is much easier to reproduce it by adding a udelay(10) at the point you've mentioned.
> 
> How quickly does it reproduce?

10 seconds more or less.


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-29 22:40       ` Sasha Levin
@ 2012-06-29 23:01         ` Paul E. McKenney
  0 siblings, 0 replies; 20+ messages in thread
From: Paul E. McKenney @ 2012-06-29 23:01 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

On Sat, Jun 30, 2012 at 12:40:07AM +0200, Sasha Levin wrote:
> On Fri, 2012-06-29 at 15:27 -0700, Paul E. McKenney wrote:
> > On Fri, Jun 29, 2012 at 11:40:40PM +0200, Sasha Levin wrote:
> > > On Fri, 2012-06-29 at 10:23 -0700, Paul E. McKenney wrote:
> > > > On Fri, Jun 29, 2012 at 12:09:44PM +0200, Sasha Levin wrote:
> > > > > Hi Paul,
> > > > > 
> > > > > I think I've stumbled on another bug that will increase your paranoia levels even further.
> > > > > 
> > > > > I got the following lockup when fuzzing with trinity inside a KVM tools guest, using latest linux-next.
> > > > > 
> > > > > It appears that it was caused by a03d6178 ("rcu: Move RCU grace-period cleanup into kthread"). This issue doesn't reproduce easily though, it took some fuzzing before hitting it.
> > > > 
> > > > Hmmm...  If the preemption at that point in __rcu_read_unlock() is
> > > > required to make this happen, then it would be pretty hard to hit.
> > > > I suspect that you can make it reproduce more quickly by putting
> > > > a udelay(10) or similar right after the assignment of INT_MIN to
> > > > t->rcu_read_lock_nesting in __rcu_read_unlock() in kernel/rcupdate.c.
> > > > Can this be reproduced while running with lockdep enabled?
> > > 
> > > The good news are that it is much easier to reproduce it by adding a udelay(10) at the point you've mentioned.
> > 
> > How quickly does it reproduce?
> 
> 10 seconds more or less.

Very good -- if an alleged fix survives for 10 minutes, we have excellent
statistical confidence that it is in fact a fix.

							Thanx, Paul


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-29 17:23 ` Paul E. McKenney
  2012-06-29 21:40   ` Sasha Levin
@ 2012-06-30 11:36   ` Sasha Levin
  2012-06-30 13:14     ` Paul E. McKenney
  1 sibling, 1 reply; 20+ messages in thread
From: Sasha Levin @ 2012-06-30 11:36 UTC (permalink / raw)
  To: paulmck; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

Hi Paul,

On Fri, 2012-06-29 at 10:23 -0700, Paul E. McKenney wrote:
> Please see below for an untested patch that gets RCU out of this loop,
> but it is quite possible that something else is involved here, so it would
> be very good to get a lockdep run, if possible.  My concern stems from the
> fact that interrupts were enabled during the call to __rcu_read_unlock()
> -- otherwise it would not have been preempted -- so the runqueue locks
> were presumably not held on entry to __rcu_read_unlock(). 

I'll continue with the good news/bad news theme.

Good news - the original problem I've reported seems to be gone.

Bad news - I'm getting the following instead:

[ 6331.841058] BUG: spinlock recursion on CPU#3, trinity-child45/25254
[ 6331.841066]  lock: 0xffff880035bd6340, .magic: dead4ead, .owner: trinity-child45/25254, .owner_cpu: 3
[ 6331.841066] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488
[ 6331.841066] Call Trace:
[ 6331.841079]  [<ffffffff8199ba38>] spin_dump+0x78/0xc0
[ 6331.841079]  [<ffffffff8199baab>] spin_bug+0x2b/0x40
[ 6331.841079]  [<ffffffff8199bbee>] do_raw_spin_lock+0x4e/0x140
[ 6331.841079]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.841091]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
[ 6331.841096]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
[ 6331.841096]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
[ 6331.841096]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
[ 6331.841096]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
[ 6331.841098]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
[ 6331.841101]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
[ 6331.841104]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.841106]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
[ 6331.841108]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
[ 6331.841111]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
[ 6331.841115]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
[ 6331.841119]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
[ 6331.841121]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
[ 6331.841125]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
[ 6331.841129]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
[ 6331.841131]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
[ 6331.841134]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
[ 6331.841139]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
[ 6331.841141]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
[ 6331.841144]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
[ 6331.841146]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
[ 6331.841150]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
[ 6331.841153]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
[ 6331.841156]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
[ 6331.841158]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.841161]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
[ 6331.841163]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.841166]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
[ 6331.841169]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
[ 6331.841172]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
[ 6331.841174]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
[ 6331.841177]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
[ 6331.906964] hardirqs last  enabled at (1166831): [<ffffffff83728ef5>] __mutex_unlock_slowpath+0x1a5/0x200
[ 6331.906964] hardirqs last disabled at (1166832): [<ffffffff8372bce4>] _raw_spin_lock_irqsave+0x54/0xc0
[ 6331.906964] softirqs last  enabled at (1166798): [<ffffffff8319b5c4>] unlist_netdevice+0xb4/0xe0
[ 6331.906964] softirqs last disabled at (1166796): [<ffffffff8372bf43>] _raw_write_lock_bh+0x13/0x80
[ 6331.954033] BUG: spinlock lockup suspected on CPU#2, swapper/2/0
[ 6331.954033]  lock: 0xffff88000d9d6340, .magic: dead4ead, .owner: rcub/5/12, .owner_cpu: 0
[ 6331.954033] Pid: 0, comm: swapper/2 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488
[ 6331.954033] Call Trace:
[ 6331.954033]  <IRQ>  [<ffffffff8199ba38>] spin_dump+0x78/0xc0
[ 6331.954033]  [<ffffffff8199bc9e>] do_raw_spin_lock+0xfe/0x140
[ 6331.954033]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.954033]  [<ffffffff8113a150>] ? load_balance+0x2b0/0x6e0
[ 6331.954033]  [<ffffffff8113a150>] load_balance+0x2b0/0x6e0
[ 6331.954033]  [<ffffffff8113ab2e>] ? rebalance_domains+0x17e/0x290
[ 6331.954033]  [<ffffffff81137f20>] ? find_busiest_group+0x2a0/0x2a0
[ 6331.954033]  [<ffffffff8113ab6d>] rebalance_domains+0x1bd/0x290
[ 6331.954033]  [<ffffffff8113a9b0>] ? update_shares+0x240/0x240
[ 6331.954033]  [<ffffffff810705bd>] ? sched_clock+0x1d/0x30
[ 6331.954033]  [<ffffffff8113ae53>] run_rebalance_domains+0x43/0x60
[ 6331.954033]  [<ffffffff810f5a81>] __do_softirq+0x221/0x460
[ 6331.954033]  [<ffffffff8109d616>] ? kvm_clock_read+0x46/0x80
[ 6331.954033]  [<ffffffff8372eb6c>] call_softirq+0x1c/0x30
[ 6331.954033]  [<ffffffff8106a215>] do_softirq+0x75/0x120
[ 6331.954033]  [<ffffffff810f4a8b>] irq_exit+0x5b/0xf0
[ 6331.954033]  [<ffffffff81090f5a>] smp_apic_timer_interrupt+0x8a/0xa0
[ 6331.954033]  [<ffffffff8372e16f>] apic_timer_interrupt+0x6f/0x80
[ 6331.954033]  <EOI>  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[ 6331.954033]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[ 6331.954033]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.954033]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[ 6331.954033]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[ 6331.954033]  [<ffffffff8371fed7>] ? setup_APIC_timer+0x88/0x8d
[ 6331.954033]  [<ffffffff8371f512>] start_secondary+0xd7/0xde
[ 6331.954033] sending NMI to all CPUs:
[ 6331.954033] NMI backtrace for cpu 2
[ 6331.954033] CPU 2 
[ 6331.954033] Pid: 0, comm: swapper/2 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.954033] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
[ 6331.954033] RSP: 0018:ffff880029803bf0  EFLAGS: 00000086
[ 6331.954033] RAX: 0000000000000400 RBX: 0000000000000002 RCX: 0000000000000830
[ 6331.954033] RDX: 0000000000000002 RSI: 0000000000000400 RDI: 0000000000000830
[ 6331.954033] RBP: ffff880029803bf0 R08: ffffffff84ee09c0 R09: 0000000000000000
[ 6331.954033] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000002
[ 6331.954033] R13: ffffffff84ee09c0 R14: 0000000000000002 R15: 000000000000b024
[ 6331.954033] FS:  0000000000000000(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
[ 6331.954033] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6331.954033] CR2: 0000000000000004 CR3: 000000001527e000 CR4: 00000000000406e0
[ 6331.954033] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.954033] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.954033] Process swapper/2 (pid: 0, threadinfo ffff88000d5ca000, task ffff88000d5c3000)
[ 6331.954033] Stack:
[ 6331.954033]  ffff880029803c60 ffffffff8109602d 0000000000000000 ffff880029803d60
[ 6331.954033]  ffff880029803c70 0000000000000086 0000000000000002 0000000200080000
[ 6331.954033]  ffff880029803c40 0000000000000000 000000009486a4e0 000000009486a4e0
[ 6331.954033] Call Trace:
[ 6331.954033]  <IRQ> 
[ 6331.954033]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
[ 6331.954033]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
[ 6331.954033]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
[ 6331.954033]  [<ffffffff8199bca3>] do_raw_spin_lock+0x103/0x140
[ 6331.954033]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.954033]  [<ffffffff8113a150>] ? load_balance+0x2b0/0x6e0
[ 6331.954033]  [<ffffffff8113a150>] load_balance+0x2b0/0x6e0
[ 6331.954033]  [<ffffffff8113ab2e>] ? rebalance_domains+0x17e/0x290
[ 6331.954033]  [<ffffffff81137f20>] ? find_busiest_group+0x2a0/0x2a0
[ 6331.954033]  [<ffffffff8113ab6d>] rebalance_domains+0x1bd/0x290
[ 6331.954033]  [<ffffffff8113a9b0>] ? update_shares+0x240/0x240
[ 6331.954033]  [<ffffffff810705bd>] ? sched_clock+0x1d/0x30
[ 6331.954033]  [<ffffffff8113ae53>] run_rebalance_domains+0x43/0x60
[ 6331.954033]  [<ffffffff810f5a81>] __do_softirq+0x221/0x460
[ 6331.954033]  [<ffffffff8109d616>] ? kvm_clock_read+0x46/0x80
[ 6331.954033]  [<ffffffff8372eb6c>] call_softirq+0x1c/0x30
[ 6331.954033]  [<ffffffff8106a215>] do_softirq+0x75/0x120
[ 6331.954033]  [<ffffffff810f4a8b>] irq_exit+0x5b/0xf0
[ 6331.954033]  [<ffffffff81090f5a>] smp_apic_timer_interrupt+0x8a/0xa0
[ 6331.954033]  [<ffffffff8372e16f>] apic_timer_interrupt+0x6f/0x80
[ 6331.954033]  <EOI> 
[ 6331.954033]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[ 6331.954033]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[ 6331.954033]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.954033]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[ 6331.954033]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[ 6331.954033]  [<ffffffff8371fed7>] ? setup_APIC_timer+0x88/0x8d
[ 6331.954033]  [<ffffffff8371f512>] start_secondary+0xd7/0xde
[ 6331.954033] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
[ 6331.906944] NMI backtrace for cpu 0
[ 6331.906944] CPU 0 
[ 6331.906944] Pid: 12, comm: rcub/5 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.906944] RIP: 0010:[<ffffffff8199d552>]  [<ffffffff8199d552>] debug_smp_processor_id+0x102/0x110
[ 6331.906944] RSP: 0018:ffff88000d5799f0  EFLAGS: 00000002
[ 6331.906944] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
[ 6331.906944] RDX: 000000002acf2ace RSI: 0000000000000003 RDI: 0000000000000001
[ 6331.906944] RBP: ffff88000d579a10 R08: 0000000000000000 R09: 0000000000000001
[ 6331.906944] R10: 0000000000000000 R11: 0000000000000001 R12: ffff88000d579fd8
[ 6331.906944] R13: 0000000000000001 R14: 0000000000000001 R15: ffff880035bd6340
[ 6331.906944] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
[ 6331.906944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6331.906944] CR2: 0000000000000800 CR3: 000000001a3ec000 CR4: 00000000000406f0
[ 6331.906944] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.906944] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.906944] Process rcub/5 (pid: 12, threadinfo ffff88000d578000, task ffff88000d573000)
[ 6331.906944] Stack:
[ 6331.906944]  ffff88000d579a70 ffff880035bd6340 000000008b304187 0000000000000001
[ 6331.906944]  ffff88000d579a50 ffffffff81984d23 ffff88000d579aa0 ffff880035bd6340
[ 6331.906944]  000000008b304187 000000009486a4e0 0000000000000001 ffff880035bd6340
[ 6331.906944] Call Trace:
[ 6331.906944]  [<ffffffff81984d23>] delay_tsc+0x23/0x140
[ 6331.906944]  [<ffffffff81984cca>] __delay+0xa/0x10
[ 6331.906944]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
[ 6331.906944]  [<ffffffff8372bb18>] _raw_spin_lock_nested+0x68/0x90
[ 6331.906944]  [<ffffffff8113f7a2>] ? pull_rt_task+0xe2/0x270
[ 6331.906944]  [<ffffffff8372bba7>] ? _raw_spin_lock+0x67/0x70
[ 6331.906944]  [<ffffffff8113f795>] ? pull_rt_task+0xd5/0x270
[ 6331.906944]  [<ffffffff8113f7a2>] pull_rt_task+0xe2/0x270
[ 6331.906944]  [<ffffffff8113f9e4>] pre_schedule_rt+0x14/0x20
[ 6331.906944]  [<ffffffff8372a429>] __schedule+0x259/0x880
[ 6331.906944]  [<ffffffff8372abb5>] schedule+0x55/0x60
[ 6331.906944]  [<ffffffff8372b2bf>] __rt_mutex_slowlock+0xaf/0x110
[ 6331.906944]  [<ffffffff8372b40f>] rt_mutex_slowlock+0xef/0x180
[ 6331.906944]  [<ffffffff8372b520>] rt_mutex_lock+0x30/0x40
[ 6331.906944]  [<ffffffff811a406a>] rcu_boost+0xca/0x110
[ 6331.906944]  [<ffffffff8372b101>] ? rt_mutex_slowunlock+0x31/0x130
[ 6331.906944]  [<ffffffff811ab972>] rcu_boost_kthread+0x222/0x390
[ 6331.906944]  [<ffffffff811ab750>] ? synchronize_rcu_expedited+0x220/0x220
[ 6331.906944]  [<ffffffff81119e92>] kthread+0xb2/0xc0
[ 6331.906944]  [<ffffffff8372ea74>] kernel_thread_helper+0x4/0x10
[ 6331.906944]  [<ffffffff8372ccf4>] ? retint_restore_args+0x13/0x13
[ 6331.906944]  [<ffffffff81119de0>] ? __init_kthread_worker+0x70/0x70
[ 6331.906944]  [<ffffffff8372ea70>] ? gs_change+0x13/0x13
[ 6331.906944] Code: d8 01 48 8b 75 08 48 c7 c7 d6 2b 36 84 e8 27 11 7d ff e8 4e ab d8 01 65 48 8b 04 25 88 d9 00 00 ff 88 44 e0 ff ff 0f 1f 00 89 d8 <4c> 8b 65 f0 48 8b 5d e8 4c 8b 6d f8 c9 c3 55 48 89 e5 48 83 ec 
[ 6331.955620] NMI backtrace for cpu 1
[ 6331.955620] CPU 1 
[ 6331.955620] Pid: 24853, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.955620] RIP: 0010:[<ffffffff81132ac2>]  [<ffffffff81132ac2>] try_to_wake_up+0x132/0x290
[ 6331.955620] RSP: 0018:ffff880012af9af8  EFLAGS: 00000002
[ 6331.955620] RAX: ffff88000d578000 RBX: ffff88000d573000 RCX: 0000000003530352
[ 6331.955620] RDX: 0000000000000002 RSI: 0000000000000001 RDI: 0000000000000086
[ 6331.955620] RBP: ffff880012af9b38 R08: 0000000000000000 R09: 0000000000000000
[ 6331.955620] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d573838
[ 6331.955620] R13: 0000000000000000 R14: 0000000000000286 R15: 0000000000000000
[ 6331.955620] FS:  00007f9e2b631700(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
[ 6331.955620] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 6331.955620] CR2: 0000000000000001 CR3: 0000000022870000 CR4: 00000000000406e0
[ 6331.955620] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.955620] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.955620] Process trinity-child19 (pid: 24853, threadinfo ffff880012af8000, task ffff880012b10000)
[ 6331.955620] Stack:
[ 6331.955620]  ffff880012af9b18 ffff880012b10838 ffff880012b10838 ffff88000d579d50
[ 6331.955620]  ffff880012b10838 ffff880012b10000 ffff88000d579c70 0000000000000286
[ 6331.955620]  ffff880012af9b48 ffffffff81132c50 ffff880012af9b88 ffffffff8372b1b9
[ 6331.955620] Call Trace:
[ 6331.955620]  [<ffffffff81132c50>] wake_up_process+0x10/0x20
[ 6331.955620]  [<ffffffff8372b1b9>] rt_mutex_slowunlock+0xe9/0x130
[ 6331.955620]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
[ 6331.955620]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
[ 6331.955620]  [<ffffffff812c6870>] ? proc_sys_compare+0xe0/0x130
[ 6331.955620]  [<ffffffff81115b67>] __rcu_read_unlock+0x57/0xb0
[ 6331.955620]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
[ 6331.955620]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
[ 6331.955620]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
[ 6331.955620]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
[ 6331.955620]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
[ 6331.955620]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
[ 6331.955620]  [<ffffffff810f342b>] ? do_setitimer+0x23b/0x290
[ 6331.955620]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
[ 6331.955620]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
[ 6331.955620]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
[ 6331.955620]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
[ 6331.955620]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.955620]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
[ 6331.955620]  [<ffffffff8372d5e5>] ? sysret_check+0x22/0x5d
[ 6331.955620]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
[ 6331.955620]  [<ffffffff81273d30>] sys_removexattr+0x30/0x80
[ 6331.955620]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
[ 6331.955620] Code: da ff ff 48 8b 45 c8 48 89 c7 e8 ca 9a 5f 02 e9 31 01 00 00 0f 1f 44 00 00 48 89 c7 e8 b8 9a 5f 02 eb 08 66 0f 1f 44 00 00 f3 90 <8b> 73 28 85 f6 75 f7 31 c0 48 8b 13 83 e2 02 74 0a 0f b7 43 16 
[ 6331.847432] NMI backtrace for cpu 3
[ 6331.847432] CPU 3 
[ 6331.847432] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.847432] RIP: 0010:[<ffffffff81984d29>]  [<ffffffff81984d29>] delay_tsc+0x29/0x140
[ 6331.847432] RSP: 0018:ffff88000bd938a8  EFLAGS: 00000006
[ 6331.847432] RAX: 0000000000000003 RBX: ffff880035bd6340 RCX: 0000000000000000
[ 6331.847432] RDX: 000000002acf2ace RSI: 0000000010000004 RDI: 0000000000000001
[ 6331.847432] RBP: ffff88000bd938d8 R08: 0000000000000000 R09: 0000000000000000
[ 6331.847432] R10: 0000000000000000 R11: 000000000000ab08 R12: 000000008aa97388
[ 6331.847432] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000086
[ 6331.847432] FS:  00007f9e2b631700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
[ 6331.847432] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 6331.847432] CR2: 0000000000000008 CR3: 0000000013c12000 CR4: 00000000000406e0
[ 6331.847432] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.847432] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.847432] Process trinity-child45 (pid: 25254, threadinfo ffff88000bd92000, task ffff88000aea0000)
[ 6331.847432] Stack:
[ 6331.847432]  ffff88000bd938c8 ffff880035bd6340 000000008aa97388 000000009486a4e0
[ 6331.847432]  0000000000000001 0000000000000086 ffff88000bd938e8 ffffffff81984cca
[ 6331.847432]  ffff88000bd93928 ffffffff8199bc7d ffff88000bd93928 0000000000000086
[ 6331.847432] Call Trace:
[ 6331.847432]  [<ffffffff81984cca>] __delay+0xa/0x10
[ 6331.847432]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
[ 6331.847432]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.847432]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
[ 6331.847432]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
[ 6331.847432]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
[ 6331.847432]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
[ 6331.847432]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
[ 6331.847432]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
[ 6331.847432]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
[ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.847432]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
[ 6331.847432]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
[ 6331.847432]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
[ 6331.847432]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
[ 6331.847432]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
[ 6331.847432]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
[ 6331.847432]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
[ 6331.847432]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
[ 6331.847432]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
[ 6331.847432]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
[ 6331.847432]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
[ 6331.847432]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
[ 6331.847432]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
[ 6331.847432]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
[ 6331.847432]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
[ 6331.847432]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
[ 6331.847432]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
[ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.847432]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
[ 6331.847432]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.847432]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
[ 6331.847432]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
[ 6331.847432]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
[ 6331.847432]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
[ 6331.847432]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
[ 6331.847432] Code: 00 00 55 48 89 e5 41 57 41 56 41 55 49 89 fd 41 54 bf 01 00 00 00 53 48 83 ec 08 e8 52 49 7a ff e8 2d 87 01 00 0f 1f 00 0f ae e8 <48> 83 3d 07 15 ec 02 00 75 07 0f 0b 0f 1f 00 eb fe 41 89 c6 e8 
[ 6331.906944] BUG: spinlock lockup suspected on CPU#0, rcub/5/12
[ 6331.906944]  lock: 0xffff880035bd6340, .magic: dead4ead, .owner: trinity-child45/25254, .owner_cpu: 3
[ 6331.906944] Pid: 12, comm: rcub/5 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488
[ 6331.906944] Call Trace:
[ 6331.906944]  [<ffffffff8199ba38>] spin_dump+0x78/0xc0
[ 6331.906944]  [<ffffffff8199bc9e>] do_raw_spin_lock+0xfe/0x140
[ 6331.906944]  [<ffffffff8372bb18>] _raw_spin_lock_nested+0x68/0x90
[ 6331.906944]  [<ffffffff8113f7a2>] ? pull_rt_task+0xe2/0x270
[ 6331.906944]  [<ffffffff8372bba7>] ? _raw_spin_lock+0x67/0x70
[ 6331.906944]  [<ffffffff8113f795>] ? pull_rt_task+0xd5/0x270
[ 6331.906944]  [<ffffffff8113f7a2>] pull_rt_task+0xe2/0x270
[ 6331.906944]  [<ffffffff8113f9e4>] pre_schedule_rt+0x14/0x20
[ 6331.906944]  [<ffffffff8372a429>] __schedule+0x259/0x880
[ 6331.906944]  [<ffffffff8372abb5>] schedule+0x55/0x60
[ 6331.906944]  [<ffffffff8372b2bf>] __rt_mutex_slowlock+0xaf/0x110
[ 6331.906944]  [<ffffffff8372b40f>] rt_mutex_slowlock+0xef/0x180
[ 6331.906944]  [<ffffffff8372b520>] rt_mutex_lock+0x30/0x40
[ 6331.906944]  [<ffffffff811a406a>] rcu_boost+0xca/0x110
[ 6331.906944]  [<ffffffff8372b101>] ? rt_mutex_slowunlock+0x31/0x130
[ 6331.906944]  [<ffffffff811ab972>] rcu_boost_kthread+0x222/0x390
[ 6331.906944]  [<ffffffff811ab750>] ? synchronize_rcu_expedited+0x220/0x220
[ 6331.906944]  [<ffffffff81119e92>] kthread+0xb2/0xc0
[ 6331.906944]  [<ffffffff8372ea74>] kernel_thread_helper+0x4/0x10
[ 6331.906944]  [<ffffffff8372ccf4>] ? retint_restore_args+0x13/0x13
[ 6331.906944]  [<ffffffff81119de0>] ? __init_kthread_worker+0x70/0x70
[ 6331.906944]  [<ffffffff8372ea70>] ? gs_change+0x13/0x13
[ 6331.906944] sending NMI to all CPUs:
[ 6331.906944] NMI backtrace for cpu 0
[ 6331.906944] CPU 0 
[ 6331.906944] Pid: 12, comm: rcub/5 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.906944] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
[ 6331.906944] RSP: 0018:ffff88000d5799c0  EFLAGS: 00000086
[ 6331.906944] RAX: 0000000000000400 RBX: 0000000000000000 RCX: 0000000000000830
[ 6331.906944] RDX: 0000000000000000 RSI: 0000000000000400 RDI: 0000000000000830
[ 6331.906944] RBP: ffff88000d5799c0 R08: ffffffff84ee09c0 R09: 0000000000000000
[ 6331.906944] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[ 6331.906944] R13: ffffffff84ee09c0 R14: 0000000000000000 R15: 000000000000b024
[ 6331.906944] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
[ 6331.906944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6331.906944] CR2: 0000000000000800 CR3: 000000001a3ec000 CR4: 00000000000406f0
[ 6331.906944] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.906944] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.906944] Process rcub/5 (pid: 12, threadinfo ffff88000d578000, task ffff88000d573000)
[ 6331.906944] Stack:
[ 6331.906944]  ffff88000d579a30 ffffffff8109602d 0000000000000000 ffff880035bd6340
[ 6331.906944]  ffff88000d579a40 0000000000000086 0000000000000002 0000000200080000
[ 6331.906944]  ffff88000d579a10 0000000000000000 000000009486a4e0 000000009486a4e0
[ 6331.906944] Call Trace:
[ 6331.906944]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
[ 6331.906944]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
[ 6331.906944]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
[ 6331.906944]  [<ffffffff8199bca3>] do_raw_spin_lock+0x103/0x140
[ 6331.906944]  [<ffffffff8372bb18>] _raw_spin_lock_nested+0x68/0x90
[ 6331.906944]  [<ffffffff8113f7a2>] ? pull_rt_task+0xe2/0x270
[ 6331.906944]  [<ffffffff8372bba7>] ? _raw_spin_lock+0x67/0x70
[ 6331.906944]  [<ffffffff8113f795>] ? pull_rt_task+0xd5/0x270
[ 6331.906944]  [<ffffffff8113f7a2>] pull_rt_task+0xe2/0x270
[ 6331.906944]  [<ffffffff8113f9e4>] pre_schedule_rt+0x14/0x20
[ 6331.906944]  [<ffffffff8372a429>] __schedule+0x259/0x880
[ 6331.906944]  [<ffffffff8372abb5>] schedule+0x55/0x60
[ 6331.906944]  [<ffffffff8372b2bf>] __rt_mutex_slowlock+0xaf/0x110
[ 6331.906944]  [<ffffffff8372b40f>] rt_mutex_slowlock+0xef/0x180
[ 6331.906944]  [<ffffffff8372b520>] rt_mutex_lock+0x30/0x40
[ 6331.906944]  [<ffffffff811a406a>] rcu_boost+0xca/0x110
[ 6331.906944]  [<ffffffff8372b101>] ? rt_mutex_slowunlock+0x31/0x130
[ 6331.906944]  [<ffffffff811ab972>] rcu_boost_kthread+0x222/0x390
[ 6331.906944]  [<ffffffff811ab750>] ? synchronize_rcu_expedited+0x220/0x220
[ 6331.906944]  [<ffffffff81119e92>] kthread+0xb2/0xc0
[ 6331.906944]  [<ffffffff8372ea74>] kernel_thread_helper+0x4/0x10
[ 6331.906944]  [<ffffffff8372ccf4>] ? retint_restore_args+0x13/0x13
[ 6331.906944]  [<ffffffff81119de0>] ? __init_kthread_worker+0x70/0x70
[ 6331.906944]  [<ffffffff8372ea70>] ? gs_change+0x13/0x13
[ 6331.906944] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
[ 6331.955620] NMI backtrace for cpu 1
[ 6331.955620] CPU 1 
[ 6331.955620] Pid: 24853, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.955620] RIP: 0010:[<ffffffff81132ac5>]  [<ffffffff81132ac5>] try_to_wake_up+0x135/0x290
[ 6331.955620] RSP: 0018:ffff880012af9af8  EFLAGS: 00000002
[ 6331.955620] RAX: ffff88000d578000 RBX: ffff88000d573000 RCX: 0000000003530352
[ 6331.955620] RDX: 0000000000000002 RSI: 0000000000000001 RDI: 0000000000000086
[ 6331.955620] RBP: ffff880012af9b38 R08: 0000000000000000 R09: 0000000000000000
[ 6331.955620] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d573838
[ 6331.955620] R13: 0000000000000000 R14: 0000000000000286 R15: 0000000000000000
[ 6331.955620] FS:  00007f9e2b631700(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
[ 6331.955620] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 6331.955620] CR2: 0000000000000001 CR3: 0000000022870000 CR4: 00000000000406e0
[ 6331.955620] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.955620] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.955620] Process trinity-child19 (pid: 24853, threadinfo ffff880012af8000, task ffff880012b10000)
[ 6331.955620] Stack:
[ 6331.955620]  ffff880012af9b18 ffff880012b10838 ffff880012b10838 ffff88000d579d50
[ 6331.955620]  ffff880012b10838 ffff880012b10000 ffff88000d579c70 0000000000000286
[ 6331.955620]  ffff880012af9b48 ffffffff81132c50 ffff880012af9b88 ffffffff8372b1b9
[ 6331.955620] Call Trace:
[ 6331.955620]  [<ffffffff81132c50>] wake_up_process+0x10/0x20
[ 6331.955620]  [<ffffffff8372b1b9>] rt_mutex_slowunlock+0xe9/0x130
[ 6331.955620]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
[ 6331.955620]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
[ 6331.955620]  [<ffffffff812c6870>] ? proc_sys_compare+0xe0/0x130
[ 6331.955620]  [<ffffffff81115b67>] __rcu_read_unlock+0x57/0xb0
[ 6331.955620]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
[ 6331.955620]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
[ 6331.955620]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
[ 6331.955620]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
[ 6331.955620]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
[ 6331.955620]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
[ 6331.955620]  [<ffffffff810f342b>] ? do_setitimer+0x23b/0x290
[ 6331.955620]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
[ 6331.955620]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
[ 6331.955620]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
[ 6331.955620]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
[ 6331.955620]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.955620]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
[ 6331.955620]  [<ffffffff8372d5e5>] ? sysret_check+0x22/0x5d
[ 6331.955620]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
[ 6331.955620]  [<ffffffff81273d30>] sys_removexattr+0x30/0x80
[ 6331.955620]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
[ 6331.955620] Code: 48 8b 45 c8 48 89 c7 e8 ca 9a 5f 02 e9 31 01 00 00 0f 1f 44 00 00 48 89 c7 e8 b8 9a 5f 02 eb 08 66 0f 1f 44 00 00 f3 90 8b 73 28 <85> f6 75 f7 31 c0 48 8b 13 83 e2 02 74 0a 0f b7 43 16 83 f0 01 
[ 6331.954033] NMI backtrace for cpu 2
[ 6331.954033] CPU 2 
[ 6331.954033] Pid: 0, comm: swapper/2 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.954033] RIP: 0010:[<ffffffff81071646>]  [<ffffffff81071646>] native_read_tsc+0x6/0x20
[ 6331.954033] RSP: 0018:ffff880029803c40  EFLAGS: 00000082
[ 6331.954033] RAX: 00000000ad32893d RBX: 00000000ad328911 RCX: 00000000ad328911
[ 6331.954033] RDX: 0000000000000eb4 RSI: 0000000000000104 RDI: 0000000000000001
[ 6331.954033] RBP: ffff880029803c40 R08: 0000000000000000 R09: 0000000000000000
[ 6331.954033] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d5ca010
[ 6331.954033] R13: 0000000000000001 R14: 0000000000000002 R15: ffff880029803d60
[ 6331.954033] FS:  0000000000000000(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
[ 6331.954033] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6331.954033] CR2: 0000000000000004 CR3: 000000001527e000 CR4: 00000000000406e0
[ 6331.954033] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.954033] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.954033] Process swapper/2 (pid: 0, threadinfo ffff88000d5ca000, task ffff88000d5c3000)
[ 6331.954033] Stack:
[ 6331.954033]  ffff880029803c80 ffffffff81984d85 0000000000000000 ffff88000d9d6340
[ 6331.954033]  0000000009a52e9c 000000009486a4e0 0000000000000000 ffff880029803d60
[ 6331.954033]  ffff880029803c90 ffffffff81984cca ffff880029803cd0 ffffffff8199bc7d
[ 6331.954033] Call Trace:
[ 6331.954033]  <IRQ> 
[ 6331.954033]  [<ffffffff81984d85>] delay_tsc+0x85/0x140
[ 6331.954033]  [<ffffffff81984cca>] __delay+0xa/0x10
[ 6331.954033]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
[ 6331.954033]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.954033]  [<ffffffff8113a150>] ? load_balance+0x2b0/0x6e0
[ 6331.954033]  [<ffffffff8113a150>] load_balance+0x2b0/0x6e0
[ 6331.954033]  [<ffffffff8113ab2e>] ? rebalance_domains+0x17e/0x290
[ 6331.954033]  [<ffffffff81137f20>] ? find_busiest_group+0x2a0/0x2a0
[ 6331.954033]  [<ffffffff8113ab6d>] rebalance_domains+0x1bd/0x290
[ 6331.954033]  [<ffffffff8113a9b0>] ? update_shares+0x240/0x240
[ 6331.954033]  [<ffffffff810705bd>] ? sched_clock+0x1d/0x30
[ 6331.954033]  [<ffffffff8113ae53>] run_rebalance_domains+0x43/0x60
[ 6331.954033]  [<ffffffff810f5a81>] __do_softirq+0x221/0x460
[ 6331.954033]  [<ffffffff8109d616>] ? kvm_clock_read+0x46/0x80
[ 6331.954033]  [<ffffffff8372eb6c>] call_softirq+0x1c/0x30
[ 6331.954033]  [<ffffffff8106a215>] do_softirq+0x75/0x120
[ 6331.954033]  [<ffffffff810f4a8b>] irq_exit+0x5b/0xf0
[ 6331.954033]  [<ffffffff81090f5a>] smp_apic_timer_interrupt+0x8a/0xa0
[ 6331.954033]  [<ffffffff8372e16f>] apic_timer_interrupt+0x6f/0x80
[ 6331.954033]  <EOI> 
[ 6331.954033]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[ 6331.954033]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[ 6331.954033]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.954033]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[ 6331.954033]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[ 6331.954033]  [<ffffffff8371fed7>] ? setup_APIC_timer+0x88/0x8d
[ 6331.954033]  [<ffffffff8371f512>] start_secondary+0xd7/0xde
[ 6331.954033] Code: 08 ff 15 e6 ae 7c 03 48 c7 43 08 00 00 00 00 48 89 03 48 83 c4 08 5b c9 c3 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 0f 31 <89> c1 c9 48 89 d0 89 c9 48 c1 e0 20 48 09 c8 c3 66 2e 0f 1f 84 
[ 6331.847432] NMI backtrace for cpu 3
[ 6331.847432] CPU 3 
[ 6331.847432] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.847432] RIP: 0010:[<ffffffff8112960b>]  [<ffffffff8112960b>] sub_preempt_count+0x4b/0xb0
[ 6331.847432] RSP: 0018:ffff88000bd93898  EFLAGS: 00000006
[ 6331.847432] RAX: ffff88000bd93fd8 RBX: 00000000ad329a05 RCX: 00000000ad329a2e
[ 6331.847432] RDX: 0000000000000000 RSI: 0000000010000004 RDI: 0000000000000001
[ 6331.847432] RBP: ffff88000bd93898 R08: 0000000000000000 R09: 0000000000000000
[ 6331.847432] R10: 0000000000000000 R11: 000000000000ab08 R12: ffff88000bd92010
[ 6331.847432] R13: 0000000000000001 R14: 0000000000000003 R15: 00000000ad329a2e
[ 6331.847432] FS:  00007f9e2b631700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
[ 6331.847432] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 6331.847432] CR2: 0000000000000008 CR3: 0000000013c12000 CR4: 00000000000406e0
[ 6331.847432] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.847432] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.847432] Process trinity-child45 (pid: 25254, threadinfo ffff88000bd92000, task ffff88000aea0000)
[ 6331.847432] Stack:
[ 6331.847432]  ffff88000bd938d8 ffffffff81984e0a ffff88000bd938c8 ffff880035bd6340
[ 6331.847432]  0000000093c44cd0 000000009486a4e0 0000000000000001 0000000000000086
[ 6331.847432]  ffff88000bd938e8 ffffffff81984cca ffff88000bd93928 ffffffff8199bc7d
[ 6331.847432] Call Trace:
[ 6331.847432]  [<ffffffff81984e0a>] delay_tsc+0x10a/0x140
[ 6331.847432]  [<ffffffff81984cca>] __delay+0xa/0x10
[ 6331.847432]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
[ 6331.847432]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.847432]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
[ 6331.847432]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
[ 6331.847432]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
[ 6331.847432]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
[ 6331.847432]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
[ 6331.847432]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
[ 6331.847432]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
[ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.847432]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
[ 6331.847432]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
[ 6331.847432]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
[ 6331.847432]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
[ 6331.847432]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
[ 6331.847432]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
[ 6331.847432]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
[ 6331.847432]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
[ 6331.847432]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
[ 6331.847432]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
[ 6331.847432]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
[ 6331.847432]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
[ 6331.847432]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
[ 6331.847432]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
[ 6331.847432]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
[ 6331.847432]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
[ 6331.847432]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
[ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.847432]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
[ 6331.847432]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.847432]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
[ 6331.847432]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
[ 6331.847432]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
[ 6331.847432]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
[ 6331.847432]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
[ 6331.847432] Code: 4c d8 85 00 85 c0 74 78 83 3d 11 85 ce 04 00 75 6f be 48 0c 00 00 48 c7 c7 e1 a2 27 84 e8 8e 1a fc ff eb 5c 80 b8 44 e0 ff ff 00 <75> 2b 0f 1f 00 e8 1b d8 85 00 85 c0 74 47 83 3d e0 84 ce 04 00 
[ 6331.847432] BUG: spinlock lockup suspected on CPU#3, trinity-child45/25254
[ 6331.847432]  lock: 0xffff880035bd6340, .magic: dead4ead, .owner: trinity-child45/25254, .owner_cpu: 3
[ 6331.847432] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488
[ 6331.847432] Call Trace:
[ 6331.847432]  [<ffffffff8199ba38>] spin_dump+0x78/0xc0
[ 6331.847432]  [<ffffffff8199bc9e>] do_raw_spin_lock+0xfe/0x140
[ 6331.847432]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.847432]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
[ 6331.847432]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
[ 6331.847432]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
[ 6331.847432]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
[ 6331.847432]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
[ 6331.847432]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
[ 6331.847432]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
[ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.847432]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
[ 6331.847432]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
[ 6331.847432]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
[ 6331.847432]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
[ 6331.847432]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
[ 6331.847432]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
[ 6331.847432]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
[ 6331.847432]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
[ 6331.847432]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
[ 6331.847432]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
[ 6331.847432]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
[ 6331.847432]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
[ 6331.847432]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
[ 6331.847432]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
[ 6331.847432]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
[ 6331.847432]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
[ 6331.847432]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
[ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.847432]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
[ 6331.847432]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.847432]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
[ 6331.847432]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
[ 6331.847432]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
[ 6331.847432]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
[ 6331.847432]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
[ 6331.847432] sending NMI to all CPUs:
[ 6331.906944] NMI backtrace for cpu 0
[ 6331.906944] CPU 0 
[ 6331.906944] Pid: 12, comm: rcub/5 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.906944] RIP: 0010:[<ffffffff81984d29>]  [<ffffffff81984d29>] delay_tsc+0x29/0x140
[ 6331.906944] RSP: 0018:ffff88000d579a20  EFLAGS: 00000002
[ 6331.906944] RAX: 0000000000000000 RBX: ffff880035bd6340 RCX: 0000000000000000
[ 6331.906944] RDX: 000000002acf2ace RSI: 0000000000000003 RDI: 0000000000000001
[ 6331.906944] RBP: ffff88000d579a50 R08: 0000000000000000 R09: 0000000000000000
[ 6331.906944] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000d775c3
[ 6331.906944] R13: 0000000000000001 R14: 0000000000000000 R15: ffff880035bd6340
[ 6331.906944] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
[ 6331.906944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6331.906944] CR2: 0000000000000800 CR3: 000000001a3ec000 CR4: 00000000000406f0
[ 6331.906944] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.906944] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.906944] Process rcub/5 (pid: 12, threadinfo ffff88000d578000, task ffff88000d573000)
[ 6331.906944] Stack:
[ 6331.906944]  0000000000000000 ffff880035bd6340 0000000000d775c3 000000009486a4e0
[ 6331.906944]  0000000000000000 ffff880035bd6340 ffff88000d579a60 ffffffff81984cca
[ 6331.906944]  ffff88000d579aa0 ffffffff8199bc7d ffff88000d579aa0 0000000000000086
[ 6331.906944] Call Trace:
[ 6331.906944]  [<ffffffff81984cca>] __delay+0xa/0x10
[ 6331.906944]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
[ 6331.906944]  [<ffffffff8372bb18>] _raw_spin_lock_nested+0x68/0x90
[ 6331.906944]  [<ffffffff8113f7a2>] ? pull_rt_task+0xe2/0x270
[ 6331.906944]  [<ffffffff8372bba7>] ? _raw_spin_lock+0x67/0x70
[ 6331.906944]  [<ffffffff8113f795>] ? pull_rt_task+0xd5/0x270
[ 6331.906944]  [<ffffffff8113f7a2>] pull_rt_task+0xe2/0x270
[ 6331.906944]  [<ffffffff8113f9e4>] pre_schedule_rt+0x14/0x20
[ 6331.906944]  [<ffffffff8372a429>] __schedule+0x259/0x880
[ 6331.906944]  [<ffffffff8372abb5>] schedule+0x55/0x60
[ 6331.906944]  [<ffffffff8372b2bf>] __rt_mutex_slowlock+0xaf/0x110
[ 6331.906944]  [<ffffffff8372b40f>] rt_mutex_slowlock+0xef/0x180
[ 6331.906944]  [<ffffffff8372b520>] rt_mutex_lock+0x30/0x40
[ 6331.906944]  [<ffffffff811a406a>] rcu_boost+0xca/0x110
[ 6331.906944]  [<ffffffff8372b101>] ? rt_mutex_slowunlock+0x31/0x130
[ 6331.906944]  [<ffffffff811ab972>] rcu_boost_kthread+0x222/0x390
[ 6331.906944]  [<ffffffff811ab750>] ? synchronize_rcu_expedited+0x220/0x220
[ 6331.906944]  [<ffffffff81119e92>] kthread+0xb2/0xc0
[ 6331.906944]  [<ffffffff8372ea74>] kernel_thread_helper+0x4/0x10
[ 6331.906944]  [<ffffffff8372ccf4>] ? retint_restore_args+0x13/0x13
[ 6331.906944]  [<ffffffff81119de0>] ? __init_kthread_worker+0x70/0x70
[ 6331.906944]  [<ffffffff8372ea70>] ? gs_change+0x13/0x13
[ 6331.906944] Code: 00 00 55 48 89 e5 41 57 41 56 41 55 49 89 fd 41 54 bf 01 00 00 00 53 48 83 ec 08 e8 52 49 7a ff e8 2d 87 01 00 0f 1f 00 0f ae e8 <48> 83 3d 07 15 ec 02 00 75 07 0f 0b 0f 1f 00 eb fe 41 89 c6 e8 
[ 6331.847432] NMI backtrace for cpu 3
[ 6331.847432] CPU 3 
[ 6331.847432] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.847432] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
[ 6331.847432] RSP: 0018:ffff88000bd93848  EFLAGS: 00000086
[ 6331.847432] RAX: 0000000000000400 RBX: 0000000000000003 RCX: 0000000000000830
[ 6331.847432] RDX: 0000000000000003 RSI: 0000000000000400 RDI: 0000000000000830
[ 6331.847432] RBP: ffff88000bd93848 R08: ffffffff84ee09c0 R09: 0000000000000000
[ 6331.847432] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000003
[ 6331.847432] R13: ffffffff84ee09c0 R14: 0000000000000003 R15: 000000000000b024
[ 6331.847432] FS:  00007f9e2b631700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
[ 6331.847432] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 6331.847432] CR2: 0000000000000008 CR3: 0000000013c12000 CR4: 00000000000406e0
[ 6331.847432] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.847432] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.847432] Process trinity-child45 (pid: 25254, threadinfo ffff88000bd92000, task ffff88000aea0000)
[ 6331.847432] Stack:
[ 6331.847432]  ffff88000bd938b8 ffffffff8109602d 0000000000000000 0000000000000086
[ 6331.847432]  ffff88000bd938c8 0000000000000086 0000000000000002 0000000200080000
[ 6331.847432]  ffff88000bd93898 0000000000000000 000000009486a4e0 000000009486a4e0
[ 6331.847432] Call Trace:
[ 6331.847432]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
[ 6331.847432]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
[ 6331.847432]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
[ 6331.847432]  [<ffffffff8199bca3>] do_raw_spin_lock+0x103/0x140
[ 6331.847432]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.847432]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
[ 6331.847432]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
[ 6331.847432]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
[ 6331.847432]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
[ 6331.847432]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
[ 6331.847432]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
[ 6331.847432]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
[ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.847432]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
[ 6331.847432]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
[ 6331.847432]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
[ 6331.847432]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
[ 6331.847432]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
[ 6331.847432]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
[ 6331.847432]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
[ 6331.847432]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
[ 6331.847432]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
[ 6331.847432]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
[ 6331.847432]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
[ 6331.847432]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
[ 6331.847432]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
[ 6331.847432]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
[ 6331.847432]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
[ 6331.847432]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
[ 6331.847432]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
[ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
[ 6331.847432]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
[ 6331.847432]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.847432]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
[ 6331.847432]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
[ 6331.847432]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
[ 6331.847432]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
[ 6331.847432]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
[ 6331.847432] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
[ 6331.954033] NMI backtrace for cpu 2
[ 6331.954033] CPU 2 
[ 6331.954033] Pid: 0, comm: swapper/2 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.954033] RIP: 0010:[<ffffffff81129604>]  [<ffffffff81129604>] sub_preempt_count+0x44/0xb0
[ 6331.954033] RSP: 0018:ffff880029803c40  EFLAGS: 00000097
[ 6331.954033] RAX: ffff88000d5cbfd8 RBX: 000000006ce53fcd RCX: 000000006ce53feb
[ 6331.954033] RDX: 0000000000000000 RSI: 0000000000000104 RDI: 0000000000000001
[ 6331.954033] RBP: ffff880029803c40 R08: 0000000000000000 R09: 0000000000000000
[ 6331.954033] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d5ca010
[ 6331.954033] R13: 0000000000000001 R14: 0000000000000002 R15: 000000006ce53feb
[ 6331.954033] FS:  0000000000000000(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
[ 6331.954033] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 6331.954033] CR2: 0000000000000004 CR3: 000000001527e000 CR4: 00000000000406e0
[ 6331.954033] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.954033] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.954033] Process swapper/2 (pid: 0, threadinfo ffff88000d5ca000, task ffff88000d5c3000)
[ 6331.954033] Stack:
[ 6331.954033]  ffff880029803c80 ffffffff81984e0a 0000000000000000 ffff88000d9d6340
[ 6331.954033]  000000000a9671ab 000000009486a4e0 0000000000000000 ffff880029803d60
[ 6331.954033]  ffff880029803c90 ffffffff81984cca ffff880029803cd0 ffffffff8199bc7d
[ 6331.954033] Call Trace:
[ 6331.954033]  <IRQ> 
[ 6331.954033]  [<ffffffff81984e0a>] delay_tsc+0x10a/0x140
[ 6331.954033]  [<ffffffff81984cca>] __delay+0xa/0x10
[ 6331.954033]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
[ 6331.954033]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
[ 6331.954033]  [<ffffffff8113a150>] ? load_balance+0x2b0/0x6e0
[ 6331.954033]  [<ffffffff8113a150>] load_balance+0x2b0/0x6e0
[ 6331.954033]  [<ffffffff8113ab2e>] ? rebalance_domains+0x17e/0x290
[ 6331.954033]  [<ffffffff81137f20>] ? find_busiest_group+0x2a0/0x2a0
[ 6331.954033]  [<ffffffff8113ab6d>] rebalance_domains+0x1bd/0x290
[ 6331.954033]  [<ffffffff8113a9b0>] ? update_shares+0x240/0x240
[ 6331.954033]  [<ffffffff810705bd>] ? sched_clock+0x1d/0x30
[ 6331.954033]  [<ffffffff8113ae53>] run_rebalance_domains+0x43/0x60
[ 6331.954033]  [<ffffffff810f5a81>] __do_softirq+0x221/0x460
[ 6331.954033]  [<ffffffff8109d616>] ? kvm_clock_read+0x46/0x80
[ 6331.954033]  [<ffffffff8372eb6c>] call_softirq+0x1c/0x30
[ 6331.954033]  [<ffffffff8106a215>] do_softirq+0x75/0x120
[ 6331.954033]  [<ffffffff810f4a8b>] irq_exit+0x5b/0xf0
[ 6331.954033]  [<ffffffff81090f5a>] smp_apic_timer_interrupt+0x8a/0xa0
[ 6331.954033]  [<ffffffff8372e16f>] apic_timer_interrupt+0x6f/0x80
[ 6331.954033]  <EOI> 
[ 6331.954033]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
[ 6331.954033]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
[ 6331.954033]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.954033]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
[ 6331.954033]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
[ 6331.954033]  [<ffffffff8371fed7>] ? setup_APIC_timer+0x88/0x8d
[ 6331.954033]  [<ffffffff8371f512>] start_secondary+0xd7/0xde
[ 6331.954033] Code: 44 e0 ff ff 7d 71 e8 4c d8 85 00 85 c0 74 78 83 3d 11 85 ce 04 00 75 6f be 48 0c 00 00 48 c7 c7 e1 a2 27 84 e8 8e 1a fc ff eb 5c <80> b8 44 e0 ff ff 00 75 2b 0f 1f 00 e8 1b d8 85 00 85 c0 74 47 
[ 6331.955620] NMI backtrace for cpu 1
[ 6331.955620] CPU 1 
[ 6331.955620] Pid: 24853, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
[ 6331.955620] RIP: 0010:[<ffffffff81132ac5>]  [<ffffffff81132ac5>] try_to_wake_up+0x135/0x290
[ 6331.955620] RSP: 0018:ffff880012af9af8  EFLAGS: 00000002
[ 6331.955620] RAX: ffff88000d578000 RBX: ffff88000d573000 RCX: 0000000003530352
[ 6331.955620] RDX: 0000000000000002 RSI: 0000000000000001 RDI: 0000000000000086
[ 6331.955620] RBP: ffff880012af9b38 R08: 0000000000000000 R09: 0000000000000000
[ 6331.955620] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d573838
[ 6331.955620] R13: 0000000000000000 R14: 0000000000000286 R15: 0000000000000000
[ 6331.955620] FS:  00007f9e2b631700(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
[ 6331.955620] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 6331.955620] CR2: 0000000000000001 CR3: 0000000022870000 CR4: 00000000000406e0
[ 6331.955620] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 6331.955620] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 6331.955620] Process trinity-child19 (pid: 24853, threadinfo ffff880012af8000, task ffff880012b10000)
[ 6331.955620] Stack:
[ 6331.955620]  ffff880012af9b18 ffff880012b10838 ffff880012b10838 ffff88000d579d50
[ 6331.955620]  ffff880012b10838 ffff880012b10000 ffff88000d579c70 0000000000000286
[ 6331.955620]  ffff880012af9b48 ffffffff81132c50 ffff880012af9b88 ffffffff8372b1b9
[ 6331.955620] Call Trace:
[ 6331.955620]  [<ffffffff81132c50>] wake_up_process+0x10/0x20
[ 6331.955620]  [<ffffffff8372b1b9>] rt_mutex_slowunlock+0xe9/0x130
[ 6331.955620]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
[ 6331.955620]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
[ 6331.955620]  [<ffffffff812c6870>] ? proc_sys_compare+0xe0/0x130
[ 6331.955620]  [<ffffffff81115b67>] __rcu_read_unlock+0x57/0xb0
[ 6331.955620]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
[ 6331.955620]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
[ 6331.955620]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
[ 6331.955620]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
[ 6331.955620]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
[ 6331.955620]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
[ 6331.955620]  [<ffffffff810f342b>] ? do_setitimer+0x23b/0x290
[ 6331.955620]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
[ 6331.955620]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
[ 6331.955620]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
[ 6331.955620]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
[ 6331.955620]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
[ 6331.955620]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
[ 6331.955620]  [<ffffffff8372d5e5>] ? sysret_check+0x22/0x5d
[ 6331.955620]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
[ 6331.955620]  [<ffffffff81273d30>] sys_removexattr+0x30/0x80
[ 6331.955620]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
[ 6331.955620] Code: 48 8b 45 c8 48 89 c7 e8 ca 9a 5f 02 e9 31 01 00 00 0f 1f 44 00 00 48 89 c7 e8 b8 9a 5f 02 eb 08 66 0f 1f 44 00 00 f3 90 8b 73 28 <85> f6 75 f7 31 c0 48 8b 13 83 e2 02 74 0a 0f b7 43 16 83 f0 01 


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-30 11:36   ` Sasha Levin
@ 2012-06-30 13:14     ` Paul E. McKenney
  2012-06-30 13:28       ` Sasha Levin
  0 siblings, 1 reply; 20+ messages in thread
From: Paul E. McKenney @ 2012-06-30 13:14 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

On Sat, Jun 30, 2012 at 01:36:48PM +0200, Sasha Levin wrote:
> Hi Paul,
> 
> On Fri, 2012-06-29 at 10:23 -0700, Paul E. McKenney wrote:
> > Please see below for an untested patch that gets RCU out of this loop,
> > but it is quite possible that something else is involved here, so it would
> > be very good to get a lockdep run, if possible.  My concern stems from the
> > fact that interrupts were enabled during the call to __rcu_read_unlock()
> > -- otherwise it would not have been preempted -- so the runqueue locks
> > were presumably not held on entry to __rcu_read_unlock(). 
> 
> I'll continue with the good news/bad news theme.
> 
> Good news - the original problem I've reported seems to be gone.
> 
> Bad news - I'm getting the following instead:

Interesting...

You are still running with lockdep?

							Thanx, Paul

> [ 6331.841058] BUG: spinlock recursion on CPU#3, trinity-child45/25254
> [ 6331.841066]  lock: 0xffff880035bd6340, .magic: dead4ead, .owner: trinity-child45/25254, .owner_cpu: 3
> [ 6331.841066] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488
> [ 6331.841066] Call Trace:
> [ 6331.841079]  [<ffffffff8199ba38>] spin_dump+0x78/0xc0
> [ 6331.841079]  [<ffffffff8199baab>] spin_bug+0x2b/0x40
> [ 6331.841079]  [<ffffffff8199bbee>] do_raw_spin_lock+0x4e/0x140
> [ 6331.841079]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.841091]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
> [ 6331.841096]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
> [ 6331.841096]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
> [ 6331.841096]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
> [ 6331.841096]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
> [ 6331.841098]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
> [ 6331.841101]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
> [ 6331.841104]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.841106]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
> [ 6331.841108]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
> [ 6331.841111]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
> [ 6331.841115]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
> [ 6331.841119]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
> [ 6331.841121]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
> [ 6331.841125]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
> [ 6331.841129]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
> [ 6331.841131]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
> [ 6331.841134]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
> [ 6331.841139]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
> [ 6331.841141]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
> [ 6331.841144]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
> [ 6331.841146]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
> [ 6331.841150]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
> [ 6331.841153]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
> [ 6331.841156]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
> [ 6331.841158]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.841161]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
> [ 6331.841163]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.841166]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
> [ 6331.841169]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
> [ 6331.841172]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
> [ 6331.841174]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
> [ 6331.841177]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
> [ 6331.906964] hardirqs last  enabled at (1166831): [<ffffffff83728ef5>] __mutex_unlock_slowpath+0x1a5/0x200
> [ 6331.906964] hardirqs last disabled at (1166832): [<ffffffff8372bce4>] _raw_spin_lock_irqsave+0x54/0xc0
> [ 6331.906964] softirqs last  enabled at (1166798): [<ffffffff8319b5c4>] unlist_netdevice+0xb4/0xe0
> [ 6331.906964] softirqs last disabled at (1166796): [<ffffffff8372bf43>] _raw_write_lock_bh+0x13/0x80
> [ 6331.954033] BUG: spinlock lockup suspected on CPU#2, swapper/2/0
> [ 6331.954033]  lock: 0xffff88000d9d6340, .magic: dead4ead, .owner: rcub/5/12, .owner_cpu: 0
> [ 6331.954033] Pid: 0, comm: swapper/2 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488
> [ 6331.954033] Call Trace:
> [ 6331.954033]  <IRQ>  [<ffffffff8199ba38>] spin_dump+0x78/0xc0
> [ 6331.954033]  [<ffffffff8199bc9e>] do_raw_spin_lock+0xfe/0x140
> [ 6331.954033]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.954033]  [<ffffffff8113a150>] ? load_balance+0x2b0/0x6e0
> [ 6331.954033]  [<ffffffff8113a150>] load_balance+0x2b0/0x6e0
> [ 6331.954033]  [<ffffffff8113ab2e>] ? rebalance_domains+0x17e/0x290
> [ 6331.954033]  [<ffffffff81137f20>] ? find_busiest_group+0x2a0/0x2a0
> [ 6331.954033]  [<ffffffff8113ab6d>] rebalance_domains+0x1bd/0x290
> [ 6331.954033]  [<ffffffff8113a9b0>] ? update_shares+0x240/0x240
> [ 6331.954033]  [<ffffffff810705bd>] ? sched_clock+0x1d/0x30
> [ 6331.954033]  [<ffffffff8113ae53>] run_rebalance_domains+0x43/0x60
> [ 6331.954033]  [<ffffffff810f5a81>] __do_softirq+0x221/0x460
> [ 6331.954033]  [<ffffffff8109d616>] ? kvm_clock_read+0x46/0x80
> [ 6331.954033]  [<ffffffff8372eb6c>] call_softirq+0x1c/0x30
> [ 6331.954033]  [<ffffffff8106a215>] do_softirq+0x75/0x120
> [ 6331.954033]  [<ffffffff810f4a8b>] irq_exit+0x5b/0xf0
> [ 6331.954033]  [<ffffffff81090f5a>] smp_apic_timer_interrupt+0x8a/0xa0
> [ 6331.954033]  [<ffffffff8372e16f>] apic_timer_interrupt+0x6f/0x80
> [ 6331.954033]  <EOI>  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
> [ 6331.954033]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
> [ 6331.954033]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.954033]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
> [ 6331.954033]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
> [ 6331.954033]  [<ffffffff8371fed7>] ? setup_APIC_timer+0x88/0x8d
> [ 6331.954033]  [<ffffffff8371f512>] start_secondary+0xd7/0xde
> [ 6331.954033] sending NMI to all CPUs:
> [ 6331.954033] NMI backtrace for cpu 2
> [ 6331.954033] CPU 2 
> [ 6331.954033] Pid: 0, comm: swapper/2 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.954033] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
> [ 6331.954033] RSP: 0018:ffff880029803bf0  EFLAGS: 00000086
> [ 6331.954033] RAX: 0000000000000400 RBX: 0000000000000002 RCX: 0000000000000830
> [ 6331.954033] RDX: 0000000000000002 RSI: 0000000000000400 RDI: 0000000000000830
> [ 6331.954033] RBP: ffff880029803bf0 R08: ffffffff84ee09c0 R09: 0000000000000000
> [ 6331.954033] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000002
> [ 6331.954033] R13: ffffffff84ee09c0 R14: 0000000000000002 R15: 000000000000b024
> [ 6331.954033] FS:  0000000000000000(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
> [ 6331.954033] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 6331.954033] CR2: 0000000000000004 CR3: 000000001527e000 CR4: 00000000000406e0
> [ 6331.954033] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.954033] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.954033] Process swapper/2 (pid: 0, threadinfo ffff88000d5ca000, task ffff88000d5c3000)
> [ 6331.954033] Stack:
> [ 6331.954033]  ffff880029803c60 ffffffff8109602d 0000000000000000 ffff880029803d60
> [ 6331.954033]  ffff880029803c70 0000000000000086 0000000000000002 0000000200080000
> [ 6331.954033]  ffff880029803c40 0000000000000000 000000009486a4e0 000000009486a4e0
> [ 6331.954033] Call Trace:
> [ 6331.954033]  <IRQ> 
> [ 6331.954033]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
> [ 6331.954033]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
> [ 6331.954033]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
> [ 6331.954033]  [<ffffffff8199bca3>] do_raw_spin_lock+0x103/0x140
> [ 6331.954033]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.954033]  [<ffffffff8113a150>] ? load_balance+0x2b0/0x6e0
> [ 6331.954033]  [<ffffffff8113a150>] load_balance+0x2b0/0x6e0
> [ 6331.954033]  [<ffffffff8113ab2e>] ? rebalance_domains+0x17e/0x290
> [ 6331.954033]  [<ffffffff81137f20>] ? find_busiest_group+0x2a0/0x2a0
> [ 6331.954033]  [<ffffffff8113ab6d>] rebalance_domains+0x1bd/0x290
> [ 6331.954033]  [<ffffffff8113a9b0>] ? update_shares+0x240/0x240
> [ 6331.954033]  [<ffffffff810705bd>] ? sched_clock+0x1d/0x30
> [ 6331.954033]  [<ffffffff8113ae53>] run_rebalance_domains+0x43/0x60
> [ 6331.954033]  [<ffffffff810f5a81>] __do_softirq+0x221/0x460
> [ 6331.954033]  [<ffffffff8109d616>] ? kvm_clock_read+0x46/0x80
> [ 6331.954033]  [<ffffffff8372eb6c>] call_softirq+0x1c/0x30
> [ 6331.954033]  [<ffffffff8106a215>] do_softirq+0x75/0x120
> [ 6331.954033]  [<ffffffff810f4a8b>] irq_exit+0x5b/0xf0
> [ 6331.954033]  [<ffffffff81090f5a>] smp_apic_timer_interrupt+0x8a/0xa0
> [ 6331.954033]  [<ffffffff8372e16f>] apic_timer_interrupt+0x6f/0x80
> [ 6331.954033]  <EOI> 
> [ 6331.954033]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
> [ 6331.954033]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
> [ 6331.954033]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.954033]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
> [ 6331.954033]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
> [ 6331.954033]  [<ffffffff8371fed7>] ? setup_APIC_timer+0x88/0x8d
> [ 6331.954033]  [<ffffffff8371f512>] start_secondary+0xd7/0xde
> [ 6331.954033] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
> [ 6331.906944] NMI backtrace for cpu 0
> [ 6331.906944] CPU 0 
> [ 6331.906944] Pid: 12, comm: rcub/5 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.906944] RIP: 0010:[<ffffffff8199d552>]  [<ffffffff8199d552>] debug_smp_processor_id+0x102/0x110
> [ 6331.906944] RSP: 0018:ffff88000d5799f0  EFLAGS: 00000002
> [ 6331.906944] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
> [ 6331.906944] RDX: 000000002acf2ace RSI: 0000000000000003 RDI: 0000000000000001
> [ 6331.906944] RBP: ffff88000d579a10 R08: 0000000000000000 R09: 0000000000000001
> [ 6331.906944] R10: 0000000000000000 R11: 0000000000000001 R12: ffff88000d579fd8
> [ 6331.906944] R13: 0000000000000001 R14: 0000000000000001 R15: ffff880035bd6340
> [ 6331.906944] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
> [ 6331.906944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 6331.906944] CR2: 0000000000000800 CR3: 000000001a3ec000 CR4: 00000000000406f0
> [ 6331.906944] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.906944] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.906944] Process rcub/5 (pid: 12, threadinfo ffff88000d578000, task ffff88000d573000)
> [ 6331.906944] Stack:
> [ 6331.906944]  ffff88000d579a70 ffff880035bd6340 000000008b304187 0000000000000001
> [ 6331.906944]  ffff88000d579a50 ffffffff81984d23 ffff88000d579aa0 ffff880035bd6340
> [ 6331.906944]  000000008b304187 000000009486a4e0 0000000000000001 ffff880035bd6340
> [ 6331.906944] Call Trace:
> [ 6331.906944]  [<ffffffff81984d23>] delay_tsc+0x23/0x140
> [ 6331.906944]  [<ffffffff81984cca>] __delay+0xa/0x10
> [ 6331.906944]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
> [ 6331.906944]  [<ffffffff8372bb18>] _raw_spin_lock_nested+0x68/0x90
> [ 6331.906944]  [<ffffffff8113f7a2>] ? pull_rt_task+0xe2/0x270
> [ 6331.906944]  [<ffffffff8372bba7>] ? _raw_spin_lock+0x67/0x70
> [ 6331.906944]  [<ffffffff8113f795>] ? pull_rt_task+0xd5/0x270
> [ 6331.906944]  [<ffffffff8113f7a2>] pull_rt_task+0xe2/0x270
> [ 6331.906944]  [<ffffffff8113f9e4>] pre_schedule_rt+0x14/0x20
> [ 6331.906944]  [<ffffffff8372a429>] __schedule+0x259/0x880
> [ 6331.906944]  [<ffffffff8372abb5>] schedule+0x55/0x60
> [ 6331.906944]  [<ffffffff8372b2bf>] __rt_mutex_slowlock+0xaf/0x110
> [ 6331.906944]  [<ffffffff8372b40f>] rt_mutex_slowlock+0xef/0x180
> [ 6331.906944]  [<ffffffff8372b520>] rt_mutex_lock+0x30/0x40
> [ 6331.906944]  [<ffffffff811a406a>] rcu_boost+0xca/0x110
> [ 6331.906944]  [<ffffffff8372b101>] ? rt_mutex_slowunlock+0x31/0x130
> [ 6331.906944]  [<ffffffff811ab972>] rcu_boost_kthread+0x222/0x390
> [ 6331.906944]  [<ffffffff811ab750>] ? synchronize_rcu_expedited+0x220/0x220
> [ 6331.906944]  [<ffffffff81119e92>] kthread+0xb2/0xc0
> [ 6331.906944]  [<ffffffff8372ea74>] kernel_thread_helper+0x4/0x10
> [ 6331.906944]  [<ffffffff8372ccf4>] ? retint_restore_args+0x13/0x13
> [ 6331.906944]  [<ffffffff81119de0>] ? __init_kthread_worker+0x70/0x70
> [ 6331.906944]  [<ffffffff8372ea70>] ? gs_change+0x13/0x13
> [ 6331.906944] Code: d8 01 48 8b 75 08 48 c7 c7 d6 2b 36 84 e8 27 11 7d ff e8 4e ab d8 01 65 48 8b 04 25 88 d9 00 00 ff 88 44 e0 ff ff 0f 1f 00 89 d8 <4c> 8b 65 f0 48 8b 5d e8 4c 8b 6d f8 c9 c3 55 48 89 e5 48 83 ec 
> [ 6331.955620] NMI backtrace for cpu 1
> [ 6331.955620] CPU 1 
> [ 6331.955620] Pid: 24853, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.955620] RIP: 0010:[<ffffffff81132ac2>]  [<ffffffff81132ac2>] try_to_wake_up+0x132/0x290
> [ 6331.955620] RSP: 0018:ffff880012af9af8  EFLAGS: 00000002
> [ 6331.955620] RAX: ffff88000d578000 RBX: ffff88000d573000 RCX: 0000000003530352
> [ 6331.955620] RDX: 0000000000000002 RSI: 0000000000000001 RDI: 0000000000000086
> [ 6331.955620] RBP: ffff880012af9b38 R08: 0000000000000000 R09: 0000000000000000
> [ 6331.955620] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d573838
> [ 6331.955620] R13: 0000000000000000 R14: 0000000000000286 R15: 0000000000000000
> [ 6331.955620] FS:  00007f9e2b631700(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
> [ 6331.955620] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 6331.955620] CR2: 0000000000000001 CR3: 0000000022870000 CR4: 00000000000406e0
> [ 6331.955620] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.955620] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.955620] Process trinity-child19 (pid: 24853, threadinfo ffff880012af8000, task ffff880012b10000)
> [ 6331.955620] Stack:
> [ 6331.955620]  ffff880012af9b18 ffff880012b10838 ffff880012b10838 ffff88000d579d50
> [ 6331.955620]  ffff880012b10838 ffff880012b10000 ffff88000d579c70 0000000000000286
> [ 6331.955620]  ffff880012af9b48 ffffffff81132c50 ffff880012af9b88 ffffffff8372b1b9
> [ 6331.955620] Call Trace:
> [ 6331.955620]  [<ffffffff81132c50>] wake_up_process+0x10/0x20
> [ 6331.955620]  [<ffffffff8372b1b9>] rt_mutex_slowunlock+0xe9/0x130
> [ 6331.955620]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
> [ 6331.955620]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
> [ 6331.955620]  [<ffffffff812c6870>] ? proc_sys_compare+0xe0/0x130
> [ 6331.955620]  [<ffffffff81115b67>] __rcu_read_unlock+0x57/0xb0
> [ 6331.955620]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
> [ 6331.955620]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
> [ 6331.955620]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
> [ 6331.955620]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
> [ 6331.955620]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
> [ 6331.955620]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
> [ 6331.955620]  [<ffffffff810f342b>] ? do_setitimer+0x23b/0x290
> [ 6331.955620]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
> [ 6331.955620]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
> [ 6331.955620]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
> [ 6331.955620]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
> [ 6331.955620]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.955620]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
> [ 6331.955620]  [<ffffffff8372d5e5>] ? sysret_check+0x22/0x5d
> [ 6331.955620]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
> [ 6331.955620]  [<ffffffff81273d30>] sys_removexattr+0x30/0x80
> [ 6331.955620]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
> [ 6331.955620] Code: da ff ff 48 8b 45 c8 48 89 c7 e8 ca 9a 5f 02 e9 31 01 00 00 0f 1f 44 00 00 48 89 c7 e8 b8 9a 5f 02 eb 08 66 0f 1f 44 00 00 f3 90 <8b> 73 28 85 f6 75 f7 31 c0 48 8b 13 83 e2 02 74 0a 0f b7 43 16 
> [ 6331.847432] NMI backtrace for cpu 3
> [ 6331.847432] CPU 3 
> [ 6331.847432] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.847432] RIP: 0010:[<ffffffff81984d29>]  [<ffffffff81984d29>] delay_tsc+0x29/0x140
> [ 6331.847432] RSP: 0018:ffff88000bd938a8  EFLAGS: 00000006
> [ 6331.847432] RAX: 0000000000000003 RBX: ffff880035bd6340 RCX: 0000000000000000
> [ 6331.847432] RDX: 000000002acf2ace RSI: 0000000010000004 RDI: 0000000000000001
> [ 6331.847432] RBP: ffff88000bd938d8 R08: 0000000000000000 R09: 0000000000000000
> [ 6331.847432] R10: 0000000000000000 R11: 000000000000ab08 R12: 000000008aa97388
> [ 6331.847432] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000086
> [ 6331.847432] FS:  00007f9e2b631700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
> [ 6331.847432] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 6331.847432] CR2: 0000000000000008 CR3: 0000000013c12000 CR4: 00000000000406e0
> [ 6331.847432] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.847432] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.847432] Process trinity-child45 (pid: 25254, threadinfo ffff88000bd92000, task ffff88000aea0000)
> [ 6331.847432] Stack:
> [ 6331.847432]  ffff88000bd938c8 ffff880035bd6340 000000008aa97388 000000009486a4e0
> [ 6331.847432]  0000000000000001 0000000000000086 ffff88000bd938e8 ffffffff81984cca
> [ 6331.847432]  ffff88000bd93928 ffffffff8199bc7d ffff88000bd93928 0000000000000086
> [ 6331.847432] Call Trace:
> [ 6331.847432]  [<ffffffff81984cca>] __delay+0xa/0x10
> [ 6331.847432]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
> [ 6331.847432]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.847432]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
> [ 6331.847432]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
> [ 6331.847432]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
> [ 6331.847432]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
> [ 6331.847432]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
> [ 6331.847432]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
> [ 6331.847432]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
> [ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.847432]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
> [ 6331.847432]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
> [ 6331.847432]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
> [ 6331.847432]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
> [ 6331.847432]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
> [ 6331.847432]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
> [ 6331.847432]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
> [ 6331.847432]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
> [ 6331.847432]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
> [ 6331.847432]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
> [ 6331.847432]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
> [ 6331.847432]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
> [ 6331.847432]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
> [ 6331.847432]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
> [ 6331.847432]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
> [ 6331.847432]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
> [ 6331.847432]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
> [ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.847432]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
> [ 6331.847432]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.847432]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
> [ 6331.847432]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
> [ 6331.847432]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
> [ 6331.847432]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
> [ 6331.847432]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
> [ 6331.847432] Code: 00 00 55 48 89 e5 41 57 41 56 41 55 49 89 fd 41 54 bf 01 00 00 00 53 48 83 ec 08 e8 52 49 7a ff e8 2d 87 01 00 0f 1f 00 0f ae e8 <48> 83 3d 07 15 ec 02 00 75 07 0f 0b 0f 1f 00 eb fe 41 89 c6 e8 
> [ 6331.906944] BUG: spinlock lockup suspected on CPU#0, rcub/5/12
> [ 6331.906944]  lock: 0xffff880035bd6340, .magic: dead4ead, .owner: trinity-child45/25254, .owner_cpu: 3
> [ 6331.906944] Pid: 12, comm: rcub/5 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488
> [ 6331.906944] Call Trace:
> [ 6331.906944]  [<ffffffff8199ba38>] spin_dump+0x78/0xc0
> [ 6331.906944]  [<ffffffff8199bc9e>] do_raw_spin_lock+0xfe/0x140
> [ 6331.906944]  [<ffffffff8372bb18>] _raw_spin_lock_nested+0x68/0x90
> [ 6331.906944]  [<ffffffff8113f7a2>] ? pull_rt_task+0xe2/0x270
> [ 6331.906944]  [<ffffffff8372bba7>] ? _raw_spin_lock+0x67/0x70
> [ 6331.906944]  [<ffffffff8113f795>] ? pull_rt_task+0xd5/0x270
> [ 6331.906944]  [<ffffffff8113f7a2>] pull_rt_task+0xe2/0x270
> [ 6331.906944]  [<ffffffff8113f9e4>] pre_schedule_rt+0x14/0x20
> [ 6331.906944]  [<ffffffff8372a429>] __schedule+0x259/0x880
> [ 6331.906944]  [<ffffffff8372abb5>] schedule+0x55/0x60
> [ 6331.906944]  [<ffffffff8372b2bf>] __rt_mutex_slowlock+0xaf/0x110
> [ 6331.906944]  [<ffffffff8372b40f>] rt_mutex_slowlock+0xef/0x180
> [ 6331.906944]  [<ffffffff8372b520>] rt_mutex_lock+0x30/0x40
> [ 6331.906944]  [<ffffffff811a406a>] rcu_boost+0xca/0x110
> [ 6331.906944]  [<ffffffff8372b101>] ? rt_mutex_slowunlock+0x31/0x130
> [ 6331.906944]  [<ffffffff811ab972>] rcu_boost_kthread+0x222/0x390
> [ 6331.906944]  [<ffffffff811ab750>] ? synchronize_rcu_expedited+0x220/0x220
> [ 6331.906944]  [<ffffffff81119e92>] kthread+0xb2/0xc0
> [ 6331.906944]  [<ffffffff8372ea74>] kernel_thread_helper+0x4/0x10
> [ 6331.906944]  [<ffffffff8372ccf4>] ? retint_restore_args+0x13/0x13
> [ 6331.906944]  [<ffffffff81119de0>] ? __init_kthread_worker+0x70/0x70
> [ 6331.906944]  [<ffffffff8372ea70>] ? gs_change+0x13/0x13
> [ 6331.906944] sending NMI to all CPUs:
> [ 6331.906944] NMI backtrace for cpu 0
> [ 6331.906944] CPU 0 
> [ 6331.906944] Pid: 12, comm: rcub/5 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.906944] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
> [ 6331.906944] RSP: 0018:ffff88000d5799c0  EFLAGS: 00000086
> [ 6331.906944] RAX: 0000000000000400 RBX: 0000000000000000 RCX: 0000000000000830
> [ 6331.906944] RDX: 0000000000000000 RSI: 0000000000000400 RDI: 0000000000000830
> [ 6331.906944] RBP: ffff88000d5799c0 R08: ffffffff84ee09c0 R09: 0000000000000000
> [ 6331.906944] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
> [ 6331.906944] R13: ffffffff84ee09c0 R14: 0000000000000000 R15: 000000000000b024
> [ 6331.906944] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
> [ 6331.906944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 6331.906944] CR2: 0000000000000800 CR3: 000000001a3ec000 CR4: 00000000000406f0
> [ 6331.906944] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.906944] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.906944] Process rcub/5 (pid: 12, threadinfo ffff88000d578000, task ffff88000d573000)
> [ 6331.906944] Stack:
> [ 6331.906944]  ffff88000d579a30 ffffffff8109602d 0000000000000000 ffff880035bd6340
> [ 6331.906944]  ffff88000d579a40 0000000000000086 0000000000000002 0000000200080000
> [ 6331.906944]  ffff88000d579a10 0000000000000000 000000009486a4e0 000000009486a4e0
> [ 6331.906944] Call Trace:
> [ 6331.906944]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
> [ 6331.906944]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
> [ 6331.906944]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
> [ 6331.906944]  [<ffffffff8199bca3>] do_raw_spin_lock+0x103/0x140
> [ 6331.906944]  [<ffffffff8372bb18>] _raw_spin_lock_nested+0x68/0x90
> [ 6331.906944]  [<ffffffff8113f7a2>] ? pull_rt_task+0xe2/0x270
> [ 6331.906944]  [<ffffffff8372bba7>] ? _raw_spin_lock+0x67/0x70
> [ 6331.906944]  [<ffffffff8113f795>] ? pull_rt_task+0xd5/0x270
> [ 6331.906944]  [<ffffffff8113f7a2>] pull_rt_task+0xe2/0x270
> [ 6331.906944]  [<ffffffff8113f9e4>] pre_schedule_rt+0x14/0x20
> [ 6331.906944]  [<ffffffff8372a429>] __schedule+0x259/0x880
> [ 6331.906944]  [<ffffffff8372abb5>] schedule+0x55/0x60
> [ 6331.906944]  [<ffffffff8372b2bf>] __rt_mutex_slowlock+0xaf/0x110
> [ 6331.906944]  [<ffffffff8372b40f>] rt_mutex_slowlock+0xef/0x180
> [ 6331.906944]  [<ffffffff8372b520>] rt_mutex_lock+0x30/0x40
> [ 6331.906944]  [<ffffffff811a406a>] rcu_boost+0xca/0x110
> [ 6331.906944]  [<ffffffff8372b101>] ? rt_mutex_slowunlock+0x31/0x130
> [ 6331.906944]  [<ffffffff811ab972>] rcu_boost_kthread+0x222/0x390
> [ 6331.906944]  [<ffffffff811ab750>] ? synchronize_rcu_expedited+0x220/0x220
> [ 6331.906944]  [<ffffffff81119e92>] kthread+0xb2/0xc0
> [ 6331.906944]  [<ffffffff8372ea74>] kernel_thread_helper+0x4/0x10
> [ 6331.906944]  [<ffffffff8372ccf4>] ? retint_restore_args+0x13/0x13
> [ 6331.906944]  [<ffffffff81119de0>] ? __init_kthread_worker+0x70/0x70
> [ 6331.906944]  [<ffffffff8372ea70>] ? gs_change+0x13/0x13
> [ 6331.906944] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
> [ 6331.955620] NMI backtrace for cpu 1
> [ 6331.955620] CPU 1 
> [ 6331.955620] Pid: 24853, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.955620] RIP: 0010:[<ffffffff81132ac5>]  [<ffffffff81132ac5>] try_to_wake_up+0x135/0x290
> [ 6331.955620] RSP: 0018:ffff880012af9af8  EFLAGS: 00000002
> [ 6331.955620] RAX: ffff88000d578000 RBX: ffff88000d573000 RCX: 0000000003530352
> [ 6331.955620] RDX: 0000000000000002 RSI: 0000000000000001 RDI: 0000000000000086
> [ 6331.955620] RBP: ffff880012af9b38 R08: 0000000000000000 R09: 0000000000000000
> [ 6331.955620] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d573838
> [ 6331.955620] R13: 0000000000000000 R14: 0000000000000286 R15: 0000000000000000
> [ 6331.955620] FS:  00007f9e2b631700(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
> [ 6331.955620] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 6331.955620] CR2: 0000000000000001 CR3: 0000000022870000 CR4: 00000000000406e0
> [ 6331.955620] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.955620] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.955620] Process trinity-child19 (pid: 24853, threadinfo ffff880012af8000, task ffff880012b10000)
> [ 6331.955620] Stack:
> [ 6331.955620]  ffff880012af9b18 ffff880012b10838 ffff880012b10838 ffff88000d579d50
> [ 6331.955620]  ffff880012b10838 ffff880012b10000 ffff88000d579c70 0000000000000286
> [ 6331.955620]  ffff880012af9b48 ffffffff81132c50 ffff880012af9b88 ffffffff8372b1b9
> [ 6331.955620] Call Trace:
> [ 6331.955620]  [<ffffffff81132c50>] wake_up_process+0x10/0x20
> [ 6331.955620]  [<ffffffff8372b1b9>] rt_mutex_slowunlock+0xe9/0x130
> [ 6331.955620]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
> [ 6331.955620]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
> [ 6331.955620]  [<ffffffff812c6870>] ? proc_sys_compare+0xe0/0x130
> [ 6331.955620]  [<ffffffff81115b67>] __rcu_read_unlock+0x57/0xb0
> [ 6331.955620]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
> [ 6331.955620]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
> [ 6331.955620]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
> [ 6331.955620]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
> [ 6331.955620]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
> [ 6331.955620]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
> [ 6331.955620]  [<ffffffff810f342b>] ? do_setitimer+0x23b/0x290
> [ 6331.955620]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
> [ 6331.955620]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
> [ 6331.955620]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
> [ 6331.955620]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
> [ 6331.955620]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.955620]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
> [ 6331.955620]  [<ffffffff8372d5e5>] ? sysret_check+0x22/0x5d
> [ 6331.955620]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
> [ 6331.955620]  [<ffffffff81273d30>] sys_removexattr+0x30/0x80
> [ 6331.955620]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
> [ 6331.955620] Code: 48 8b 45 c8 48 89 c7 e8 ca 9a 5f 02 e9 31 01 00 00 0f 1f 44 00 00 48 89 c7 e8 b8 9a 5f 02 eb 08 66 0f 1f 44 00 00 f3 90 8b 73 28 <85> f6 75 f7 31 c0 48 8b 13 83 e2 02 74 0a 0f b7 43 16 83 f0 01 
> [ 6331.954033] NMI backtrace for cpu 2
> [ 6331.954033] CPU 2 
> [ 6331.954033] Pid: 0, comm: swapper/2 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.954033] RIP: 0010:[<ffffffff81071646>]  [<ffffffff81071646>] native_read_tsc+0x6/0x20
> [ 6331.954033] RSP: 0018:ffff880029803c40  EFLAGS: 00000082
> [ 6331.954033] RAX: 00000000ad32893d RBX: 00000000ad328911 RCX: 00000000ad328911
> [ 6331.954033] RDX: 0000000000000eb4 RSI: 0000000000000104 RDI: 0000000000000001
> [ 6331.954033] RBP: ffff880029803c40 R08: 0000000000000000 R09: 0000000000000000
> [ 6331.954033] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d5ca010
> [ 6331.954033] R13: 0000000000000001 R14: 0000000000000002 R15: ffff880029803d60
> [ 6331.954033] FS:  0000000000000000(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
> [ 6331.954033] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 6331.954033] CR2: 0000000000000004 CR3: 000000001527e000 CR4: 00000000000406e0
> [ 6331.954033] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.954033] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.954033] Process swapper/2 (pid: 0, threadinfo ffff88000d5ca000, task ffff88000d5c3000)
> [ 6331.954033] Stack:
> [ 6331.954033]  ffff880029803c80 ffffffff81984d85 0000000000000000 ffff88000d9d6340
> [ 6331.954033]  0000000009a52e9c 000000009486a4e0 0000000000000000 ffff880029803d60
> [ 6331.954033]  ffff880029803c90 ffffffff81984cca ffff880029803cd0 ffffffff8199bc7d
> [ 6331.954033] Call Trace:
> [ 6331.954033]  <IRQ> 
> [ 6331.954033]  [<ffffffff81984d85>] delay_tsc+0x85/0x140
> [ 6331.954033]  [<ffffffff81984cca>] __delay+0xa/0x10
> [ 6331.954033]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
> [ 6331.954033]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.954033]  [<ffffffff8113a150>] ? load_balance+0x2b0/0x6e0
> [ 6331.954033]  [<ffffffff8113a150>] load_balance+0x2b0/0x6e0
> [ 6331.954033]  [<ffffffff8113ab2e>] ? rebalance_domains+0x17e/0x290
> [ 6331.954033]  [<ffffffff81137f20>] ? find_busiest_group+0x2a0/0x2a0
> [ 6331.954033]  [<ffffffff8113ab6d>] rebalance_domains+0x1bd/0x290
> [ 6331.954033]  [<ffffffff8113a9b0>] ? update_shares+0x240/0x240
> [ 6331.954033]  [<ffffffff810705bd>] ? sched_clock+0x1d/0x30
> [ 6331.954033]  [<ffffffff8113ae53>] run_rebalance_domains+0x43/0x60
> [ 6331.954033]  [<ffffffff810f5a81>] __do_softirq+0x221/0x460
> [ 6331.954033]  [<ffffffff8109d616>] ? kvm_clock_read+0x46/0x80
> [ 6331.954033]  [<ffffffff8372eb6c>] call_softirq+0x1c/0x30
> [ 6331.954033]  [<ffffffff8106a215>] do_softirq+0x75/0x120
> [ 6331.954033]  [<ffffffff810f4a8b>] irq_exit+0x5b/0xf0
> [ 6331.954033]  [<ffffffff81090f5a>] smp_apic_timer_interrupt+0x8a/0xa0
> [ 6331.954033]  [<ffffffff8372e16f>] apic_timer_interrupt+0x6f/0x80
> [ 6331.954033]  <EOI> 
> [ 6331.954033]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
> [ 6331.954033]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
> [ 6331.954033]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.954033]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
> [ 6331.954033]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
> [ 6331.954033]  [<ffffffff8371fed7>] ? setup_APIC_timer+0x88/0x8d
> [ 6331.954033]  [<ffffffff8371f512>] start_secondary+0xd7/0xde
> [ 6331.954033] Code: 08 ff 15 e6 ae 7c 03 48 c7 43 08 00 00 00 00 48 89 03 48 83 c4 08 5b c9 c3 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 0f 31 <89> c1 c9 48 89 d0 89 c9 48 c1 e0 20 48 09 c8 c3 66 2e 0f 1f 84 
> [ 6331.847432] NMI backtrace for cpu 3
> [ 6331.847432] CPU 3 
> [ 6331.847432] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.847432] RIP: 0010:[<ffffffff8112960b>]  [<ffffffff8112960b>] sub_preempt_count+0x4b/0xb0
> [ 6331.847432] RSP: 0018:ffff88000bd93898  EFLAGS: 00000006
> [ 6331.847432] RAX: ffff88000bd93fd8 RBX: 00000000ad329a05 RCX: 00000000ad329a2e
> [ 6331.847432] RDX: 0000000000000000 RSI: 0000000010000004 RDI: 0000000000000001
> [ 6331.847432] RBP: ffff88000bd93898 R08: 0000000000000000 R09: 0000000000000000
> [ 6331.847432] R10: 0000000000000000 R11: 000000000000ab08 R12: ffff88000bd92010
> [ 6331.847432] R13: 0000000000000001 R14: 0000000000000003 R15: 00000000ad329a2e
> [ 6331.847432] FS:  00007f9e2b631700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
> [ 6331.847432] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 6331.847432] CR2: 0000000000000008 CR3: 0000000013c12000 CR4: 00000000000406e0
> [ 6331.847432] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.847432] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.847432] Process trinity-child45 (pid: 25254, threadinfo ffff88000bd92000, task ffff88000aea0000)
> [ 6331.847432] Stack:
> [ 6331.847432]  ffff88000bd938d8 ffffffff81984e0a ffff88000bd938c8 ffff880035bd6340
> [ 6331.847432]  0000000093c44cd0 000000009486a4e0 0000000000000001 0000000000000086
> [ 6331.847432]  ffff88000bd938e8 ffffffff81984cca ffff88000bd93928 ffffffff8199bc7d
> [ 6331.847432] Call Trace:
> [ 6331.847432]  [<ffffffff81984e0a>] delay_tsc+0x10a/0x140
> [ 6331.847432]  [<ffffffff81984cca>] __delay+0xa/0x10
> [ 6331.847432]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
> [ 6331.847432]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.847432]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
> [ 6331.847432]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
> [ 6331.847432]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
> [ 6331.847432]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
> [ 6331.847432]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
> [ 6331.847432]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
> [ 6331.847432]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
> [ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.847432]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
> [ 6331.847432]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
> [ 6331.847432]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
> [ 6331.847432]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
> [ 6331.847432]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
> [ 6331.847432]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
> [ 6331.847432]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
> [ 6331.847432]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
> [ 6331.847432]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
> [ 6331.847432]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
> [ 6331.847432]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
> [ 6331.847432]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
> [ 6331.847432]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
> [ 6331.847432]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
> [ 6331.847432]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
> [ 6331.847432]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
> [ 6331.847432]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
> [ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.847432]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
> [ 6331.847432]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.847432]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
> [ 6331.847432]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
> [ 6331.847432]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
> [ 6331.847432]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
> [ 6331.847432]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
> [ 6331.847432] Code: 4c d8 85 00 85 c0 74 78 83 3d 11 85 ce 04 00 75 6f be 48 0c 00 00 48 c7 c7 e1 a2 27 84 e8 8e 1a fc ff eb 5c 80 b8 44 e0 ff ff 00 <75> 2b 0f 1f 00 e8 1b d8 85 00 85 c0 74 47 83 3d e0 84 ce 04 00 
> [ 6331.847432] BUG: spinlock lockup suspected on CPU#3, trinity-child45/25254
> [ 6331.847432]  lock: 0xffff880035bd6340, .magic: dead4ead, .owner: trinity-child45/25254, .owner_cpu: 3
> [ 6331.847432] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488
> [ 6331.847432] Call Trace:
> [ 6331.847432]  [<ffffffff8199ba38>] spin_dump+0x78/0xc0
> [ 6331.847432]  [<ffffffff8199bc9e>] do_raw_spin_lock+0xfe/0x140
> [ 6331.847432]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.847432]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
> [ 6331.847432]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
> [ 6331.847432]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
> [ 6331.847432]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
> [ 6331.847432]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
> [ 6331.847432]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
> [ 6331.847432]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
> [ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.847432]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
> [ 6331.847432]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
> [ 6331.847432]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
> [ 6331.847432]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
> [ 6331.847432]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
> [ 6331.847432]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
> [ 6331.847432]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
> [ 6331.847432]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
> [ 6331.847432]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
> [ 6331.847432]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
> [ 6331.847432]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
> [ 6331.847432]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
> [ 6331.847432]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
> [ 6331.847432]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
> [ 6331.847432]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
> [ 6331.847432]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
> [ 6331.847432]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
> [ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.847432]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
> [ 6331.847432]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.847432]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
> [ 6331.847432]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
> [ 6331.847432]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
> [ 6331.847432]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
> [ 6331.847432]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
> [ 6331.847432] sending NMI to all CPUs:
> [ 6331.906944] NMI backtrace for cpu 0
> [ 6331.906944] CPU 0 
> [ 6331.906944] Pid: 12, comm: rcub/5 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.906944] RIP: 0010:[<ffffffff81984d29>]  [<ffffffff81984d29>] delay_tsc+0x29/0x140
> [ 6331.906944] RSP: 0018:ffff88000d579a20  EFLAGS: 00000002
> [ 6331.906944] RAX: 0000000000000000 RBX: ffff880035bd6340 RCX: 0000000000000000
> [ 6331.906944] RDX: 000000002acf2ace RSI: 0000000000000003 RDI: 0000000000000001
> [ 6331.906944] RBP: ffff88000d579a50 R08: 0000000000000000 R09: 0000000000000000
> [ 6331.906944] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000d775c3
> [ 6331.906944] R13: 0000000000000001 R14: 0000000000000000 R15: ffff880035bd6340
> [ 6331.906944] FS:  0000000000000000(0000) GS:ffff88000d800000(0000) knlGS:0000000000000000
> [ 6331.906944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 6331.906944] CR2: 0000000000000800 CR3: 000000001a3ec000 CR4: 00000000000406f0
> [ 6331.906944] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.906944] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.906944] Process rcub/5 (pid: 12, threadinfo ffff88000d578000, task ffff88000d573000)
> [ 6331.906944] Stack:
> [ 6331.906944]  0000000000000000 ffff880035bd6340 0000000000d775c3 000000009486a4e0
> [ 6331.906944]  0000000000000000 ffff880035bd6340 ffff88000d579a60 ffffffff81984cca
> [ 6331.906944]  ffff88000d579aa0 ffffffff8199bc7d ffff88000d579aa0 0000000000000086
> [ 6331.906944] Call Trace:
> [ 6331.906944]  [<ffffffff81984cca>] __delay+0xa/0x10
> [ 6331.906944]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
> [ 6331.906944]  [<ffffffff8372bb18>] _raw_spin_lock_nested+0x68/0x90
> [ 6331.906944]  [<ffffffff8113f7a2>] ? pull_rt_task+0xe2/0x270
> [ 6331.906944]  [<ffffffff8372bba7>] ? _raw_spin_lock+0x67/0x70
> [ 6331.906944]  [<ffffffff8113f795>] ? pull_rt_task+0xd5/0x270
> [ 6331.906944]  [<ffffffff8113f7a2>] pull_rt_task+0xe2/0x270
> [ 6331.906944]  [<ffffffff8113f9e4>] pre_schedule_rt+0x14/0x20
> [ 6331.906944]  [<ffffffff8372a429>] __schedule+0x259/0x880
> [ 6331.906944]  [<ffffffff8372abb5>] schedule+0x55/0x60
> [ 6331.906944]  [<ffffffff8372b2bf>] __rt_mutex_slowlock+0xaf/0x110
> [ 6331.906944]  [<ffffffff8372b40f>] rt_mutex_slowlock+0xef/0x180
> [ 6331.906944]  [<ffffffff8372b520>] rt_mutex_lock+0x30/0x40
> [ 6331.906944]  [<ffffffff811a406a>] rcu_boost+0xca/0x110
> [ 6331.906944]  [<ffffffff8372b101>] ? rt_mutex_slowunlock+0x31/0x130
> [ 6331.906944]  [<ffffffff811ab972>] rcu_boost_kthread+0x222/0x390
> [ 6331.906944]  [<ffffffff811ab750>] ? synchronize_rcu_expedited+0x220/0x220
> [ 6331.906944]  [<ffffffff81119e92>] kthread+0xb2/0xc0
> [ 6331.906944]  [<ffffffff8372ea74>] kernel_thread_helper+0x4/0x10
> [ 6331.906944]  [<ffffffff8372ccf4>] ? retint_restore_args+0x13/0x13
> [ 6331.906944]  [<ffffffff81119de0>] ? __init_kthread_worker+0x70/0x70
> [ 6331.906944]  [<ffffffff8372ea70>] ? gs_change+0x13/0x13
> [ 6331.906944] Code: 00 00 55 48 89 e5 41 57 41 56 41 55 49 89 fd 41 54 bf 01 00 00 00 53 48 83 ec 08 e8 52 49 7a ff e8 2d 87 01 00 0f 1f 00 0f ae e8 <48> 83 3d 07 15 ec 02 00 75 07 0f 0b 0f 1f 00 eb fe 41 89 c6 e8 
> [ 6331.847432] NMI backtrace for cpu 3
> [ 6331.847432] CPU 3 
> [ 6331.847432] Pid: 25254, comm: trinity-child45 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.847432] RIP: 0010:[<ffffffff8109d6aa>]  [<ffffffff8109d6aa>] native_write_msr_safe+0xa/0x10
> [ 6331.847432] RSP: 0018:ffff88000bd93848  EFLAGS: 00000086
> [ 6331.847432] RAX: 0000000000000400 RBX: 0000000000000003 RCX: 0000000000000830
> [ 6331.847432] RDX: 0000000000000003 RSI: 0000000000000400 RDI: 0000000000000830
> [ 6331.847432] RBP: ffff88000bd93848 R08: ffffffff84ee09c0 R09: 0000000000000000
> [ 6331.847432] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000003
> [ 6331.847432] R13: ffffffff84ee09c0 R14: 0000000000000003 R15: 000000000000b024
> [ 6331.847432] FS:  00007f9e2b631700(0000) GS:ffff880035a00000(0000) knlGS:0000000000000000
> [ 6331.847432] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 6331.847432] CR2: 0000000000000008 CR3: 0000000013c12000 CR4: 00000000000406e0
> [ 6331.847432] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.847432] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.847432] Process trinity-child45 (pid: 25254, threadinfo ffff88000bd92000, task ffff88000aea0000)
> [ 6331.847432] Stack:
> [ 6331.847432]  ffff88000bd938b8 ffffffff8109602d 0000000000000000 0000000000000086
> [ 6331.847432]  ffff88000bd938c8 0000000000000086 0000000000000002 0000000200080000
> [ 6331.847432]  ffff88000bd93898 0000000000000000 000000009486a4e0 000000009486a4e0
> [ 6331.847432] Call Trace:
> [ 6331.847432]  [<ffffffff8109602d>] __x2apic_send_IPI_mask+0xdd/0x1b0
> [ 6331.847432]  [<ffffffff81096117>] x2apic_send_IPI_all+0x17/0x20
> [ 6331.847432]  [<ffffffff810917b4>] arch_trigger_all_cpu_backtrace+0x64/0xb0
> [ 6331.847432]  [<ffffffff8199bca3>] do_raw_spin_lock+0x103/0x140
> [ 6331.847432]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.847432]  [<ffffffff81130291>] ? rt_mutex_setprio+0x81/0x2c0
> [ 6331.847432]  [<ffffffff81130291>] rt_mutex_setprio+0x81/0x2c0
> [ 6331.847432]  [<ffffffff8116a0a0>] __rt_mutex_adjust_prio+0x20/0x30
> [ 6331.847432]  [<ffffffff8372b1d4>] rt_mutex_slowunlock+0x104/0x130
> [ 6331.847432]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
> [ 6331.847432]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
> [ 6331.847432]  [<ffffffff8113fe58>] ? update_curr_rt+0x228/0x270
> [ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.847432]  [<ffffffff811a8fea>] rcu_preempt_note_context_switch+0x22a/0x300
> [ 6331.847432]  [<ffffffff8372a93a>] __schedule+0x76a/0x880
> [ 6331.847432]  [<ffffffff8372ab41>] preempt_schedule+0x51/0x70
> [ 6331.847432]  [<ffffffff81071640>] ? read_persistent_clock+0x30/0x30
> [ 6331.847432]  [<ffffffff81984e23>] delay_tsc+0x123/0x140
> [ 6331.847432]  [<ffffffff81984cf8>] __const_udelay+0x28/0x30
> [ 6331.847432]  [<ffffffff81115b54>] __rcu_read_unlock+0x44/0xb0
> [ 6331.847432]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
> [ 6331.847432]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
> [ 6331.847432]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
> [ 6331.847432]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
> [ 6331.847432]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
> [ 6331.847432]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
> [ 6331.847432]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
> [ 6331.847432]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
> [ 6331.847432]  [<ffffffff8111f168>] ? __hrtimer_start_range_ns+0x448/0x490
> [ 6331.847432]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
> [ 6331.847432]  [<ffffffff8115d35a>] ? get_lock_stats+0x2a/0x60
> [ 6331.847432]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
> [ 6331.847432]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.847432]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
> [ 6331.847432]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
> [ 6331.847432]  [<ffffffff81274d61>] sys_setxattr+0x41/0xb0
> [ 6331.847432]  [<ffffffff81985f3e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
> [ 6331.847432]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
> [ 6331.847432] Code: 00 55 89 f9 48 89 e5 0f 32 45 31 c0 89 c7 44 89 06 48 89 d0 89 f9 48 c1 e0 20 c9 48 09 c8 c3 66 90 55 89 f0 48 89 e5 89 f9 0f 30 <31> c0 c9 c3 66 90 55 89 f9 48 89 e5 0f 33 89 c7 c9 48 89 d0 89 
> [ 6331.954033] NMI backtrace for cpu 2
> [ 6331.954033] CPU 2 
> [ 6331.954033] Pid: 0, comm: swapper/2 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.954033] RIP: 0010:[<ffffffff81129604>]  [<ffffffff81129604>] sub_preempt_count+0x44/0xb0
> [ 6331.954033] RSP: 0018:ffff880029803c40  EFLAGS: 00000097
> [ 6331.954033] RAX: ffff88000d5cbfd8 RBX: 000000006ce53fcd RCX: 000000006ce53feb
> [ 6331.954033] RDX: 0000000000000000 RSI: 0000000000000104 RDI: 0000000000000001
> [ 6331.954033] RBP: ffff880029803c40 R08: 0000000000000000 R09: 0000000000000000
> [ 6331.954033] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d5ca010
> [ 6331.954033] R13: 0000000000000001 R14: 0000000000000002 R15: 000000006ce53feb
> [ 6331.954033] FS:  0000000000000000(0000) GS:ffff880029800000(0000) knlGS:0000000000000000
> [ 6331.954033] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 6331.954033] CR2: 0000000000000004 CR3: 000000001527e000 CR4: 00000000000406e0
> [ 6331.954033] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.954033] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.954033] Process swapper/2 (pid: 0, threadinfo ffff88000d5ca000, task ffff88000d5c3000)
> [ 6331.954033] Stack:
> [ 6331.954033]  ffff880029803c80 ffffffff81984e0a 0000000000000000 ffff88000d9d6340
> [ 6331.954033]  000000000a9671ab 000000009486a4e0 0000000000000000 ffff880029803d60
> [ 6331.954033]  ffff880029803c90 ffffffff81984cca ffff880029803cd0 ffffffff8199bc7d
> [ 6331.954033] Call Trace:
> [ 6331.954033]  <IRQ> 
> [ 6331.954033]  [<ffffffff81984e0a>] delay_tsc+0x10a/0x140
> [ 6331.954033]  [<ffffffff81984cca>] __delay+0xa/0x10
> [ 6331.954033]  [<ffffffff8199bc7d>] do_raw_spin_lock+0xdd/0x140
> [ 6331.954033]  [<ffffffff8372bb9b>] _raw_spin_lock+0x5b/0x70
> [ 6331.954033]  [<ffffffff8113a150>] ? load_balance+0x2b0/0x6e0
> [ 6331.954033]  [<ffffffff8113a150>] load_balance+0x2b0/0x6e0
> [ 6331.954033]  [<ffffffff8113ab2e>] ? rebalance_domains+0x17e/0x290
> [ 6331.954033]  [<ffffffff81137f20>] ? find_busiest_group+0x2a0/0x2a0
> [ 6331.954033]  [<ffffffff8113ab6d>] rebalance_domains+0x1bd/0x290
> [ 6331.954033]  [<ffffffff8113a9b0>] ? update_shares+0x240/0x240
> [ 6331.954033]  [<ffffffff810705bd>] ? sched_clock+0x1d/0x30
> [ 6331.954033]  [<ffffffff8113ae53>] run_rebalance_domains+0x43/0x60
> [ 6331.954033]  [<ffffffff810f5a81>] __do_softirq+0x221/0x460
> [ 6331.954033]  [<ffffffff8109d616>] ? kvm_clock_read+0x46/0x80
> [ 6331.954033]  [<ffffffff8372eb6c>] call_softirq+0x1c/0x30
> [ 6331.954033]  [<ffffffff8106a215>] do_softirq+0x75/0x120
> [ 6331.954033]  [<ffffffff810f4a8b>] irq_exit+0x5b/0xf0
> [ 6331.954033]  [<ffffffff81090f5a>] smp_apic_timer_interrupt+0x8a/0xa0
> [ 6331.954033]  [<ffffffff8372e16f>] apic_timer_interrupt+0x6f/0x80
> [ 6331.954033]  <EOI> 
> [ 6331.954033]  [<ffffffff81072eb8>] ? default_idle+0x1a8/0x390
> [ 6331.954033]  [<ffffffff8109d7e6>] ? native_safe_halt+0x6/0x10
> [ 6331.954033]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.954033]  [<ffffffff81072ed5>] default_idle+0x1c5/0x390
> [ 6331.954033]  [<ffffffff8107244f>] cpu_idle+0x11f/0x180
> [ 6331.954033]  [<ffffffff8371fed7>] ? setup_APIC_timer+0x88/0x8d
> [ 6331.954033]  [<ffffffff8371f512>] start_secondary+0xd7/0xde
> [ 6331.954033] Code: 44 e0 ff ff 7d 71 e8 4c d8 85 00 85 c0 74 78 83 3d 11 85 ce 04 00 75 6f be 48 0c 00 00 48 c7 c7 e1 a2 27 84 e8 8e 1a fc ff eb 5c <80> b8 44 e0 ff ff 00 75 2b 0f 1f 00 e8 1b d8 85 00 85 c0 74 47 
> [ 6331.955620] NMI backtrace for cpu 1
> [ 6331.955620] CPU 1 
> [ 6331.955620] Pid: 24853, comm: trinity-child19 Tainted: G        W    3.5.0-rc4-next-20120629-sasha-00007-g3fd449c #488  
> [ 6331.955620] RIP: 0010:[<ffffffff81132ac5>]  [<ffffffff81132ac5>] try_to_wake_up+0x135/0x290
> [ 6331.955620] RSP: 0018:ffff880012af9af8  EFLAGS: 00000002
> [ 6331.955620] RAX: ffff88000d578000 RBX: ffff88000d573000 RCX: 0000000003530352
> [ 6331.955620] RDX: 0000000000000002 RSI: 0000000000000001 RDI: 0000000000000086
> [ 6331.955620] RBP: ffff880012af9b38 R08: 0000000000000000 R09: 0000000000000000
> [ 6331.955620] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000d573838
> [ 6331.955620] R13: 0000000000000000 R14: 0000000000000286 R15: 0000000000000000
> [ 6331.955620] FS:  00007f9e2b631700(0000) GS:ffff88001b800000(0000) knlGS:0000000000000000
> [ 6331.955620] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 6331.955620] CR2: 0000000000000001 CR3: 0000000022870000 CR4: 00000000000406e0
> [ 6331.955620] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 6331.955620] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 6331.955620] Process trinity-child19 (pid: 24853, threadinfo ffff880012af8000, task ffff880012b10000)
> [ 6331.955620] Stack:
> [ 6331.955620]  ffff880012af9b18 ffff880012b10838 ffff880012b10838 ffff88000d579d50
> [ 6331.955620]  ffff880012b10838 ffff880012b10000 ffff88000d579c70 0000000000000286
> [ 6331.955620]  ffff880012af9b48 ffffffff81132c50 ffff880012af9b88 ffffffff8372b1b9
> [ 6331.955620] Call Trace:
> [ 6331.955620]  [<ffffffff81132c50>] wake_up_process+0x10/0x20
> [ 6331.955620]  [<ffffffff8372b1b9>] rt_mutex_slowunlock+0xe9/0x130
> [ 6331.955620]  [<ffffffff8372b209>] rt_mutex_unlock+0x9/0x10
> [ 6331.955620]  [<ffffffff811a8d10>] rcu_read_unlock_special+0x350/0x400
> [ 6331.955620]  [<ffffffff812c6870>] ? proc_sys_compare+0xe0/0x130
> [ 6331.955620]  [<ffffffff81115b67>] __rcu_read_unlock+0x57/0xb0
> [ 6331.955620]  [<ffffffff8126943d>] __d_lookup+0x2dd/0x2f0
> [ 6331.955620]  [<ffffffff8199bb90>] ? do_raw_spin_unlock+0xd0/0xe0
> [ 6331.955620]  [<ffffffff8125c8ae>] lookup_fast+0x1ae/0x2e0
> [ 6331.955620]  [<ffffffff818c61fd>] ? security_inode_permission+0x1d/0x20
> [ 6331.955620]  [<ffffffff8125d4e4>] link_path_walk+0x204/0x420
> [ 6331.955620]  [<ffffffff8125a0a0>] ? generic_readlink+0xb0/0xb0
> [ 6331.955620]  [<ffffffff810f342b>] ? do_setitimer+0x23b/0x290
> [ 6331.955620]  [<ffffffff8125e024>] path_lookupat+0x54/0x700
> [ 6331.955620]  [<ffffffff8123a134>] ? kmem_cache_alloc+0x154/0x240
> [ 6331.955620]  [<ffffffff8125e6fc>] do_path_lookup+0x2c/0xc0
> [ 6331.955620]  [<ffffffff8125f6bc>] user_path_at_empty+0x6c/0xb0
> [ 6331.955620]  [<ffffffff8116227d>] ? trace_hardirqs_on+0xd/0x10
> [ 6331.955620]  [<ffffffff8372c6e9>] ? _raw_spin_unlock_irq+0x59/0x80
> [ 6331.955620]  [<ffffffff8372d5e5>] ? sysret_check+0x22/0x5d
> [ 6331.955620]  [<ffffffff8125f70c>] user_path_at+0xc/0x10
> [ 6331.955620]  [<ffffffff81273d30>] sys_removexattr+0x30/0x80
> [ 6331.955620]  [<ffffffff8372d5b9>] system_call_fastpath+0x16/0x1b
> [ 6331.955620] Code: 48 8b 45 c8 48 89 c7 e8 ca 9a 5f 02 e9 31 01 00 00 0f 1f 44 00 00 48 89 c7 e8 b8 9a 5f 02 eb 08 66 0f 1f 44 00 00 f3 90 8b 73 28 <85> f6 75 f7 31 c0 48 8b 13 83 e2 02 74 0a 0f b7 43 16 83 f0 01 
> 


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-30 13:14     ` Paul E. McKenney
@ 2012-06-30 13:28       ` Sasha Levin
  2012-06-30 13:58         ` Paul E. McKenney
  0 siblings, 1 reply; 20+ messages in thread
From: Sasha Levin @ 2012-06-30 13:28 UTC (permalink / raw)
  To: paulmck; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

[-- Attachment #1: Type: text/plain, Size: 1126 bytes --]

On Sat, 2012-06-30 at 06:14 -0700, Paul E. McKenney wrote:
> On Sat, Jun 30, 2012 at 01:36:48PM +0200, Sasha Levin wrote:
> > Hi Paul,
> > 
> > On Fri, 2012-06-29 at 10:23 -0700, Paul E. McKenney wrote:
> > > Please see below for an untested patch that gets RCU out of this loop,
> > > but it is quite possible that something else is involved here, so it would
> > > be very good to get a lockdep run, if possible.  My concern stems from the
> > > fact that interrupts were enabled during the call to __rcu_read_unlock()
> > > -- otherwise it would not have been preempted -- so the runqueue locks
> > > were presumably not held on entry to __rcu_read_unlock(). 
> > 
> > I'll continue with the good news/bad news theme.
> > 
> > Good news - the original problem I've reported seems to be gone.
> > 
> > Bad news - I'm getting the following instead:
> 
> Interesting...
> 
> You are still running with lockdep?

It should be on, yes. I don't see anything in dmesg which would suggest
it got disabled before this spew.

I've attached my .config. I'm starting the kernel with "sched_debug
slub_debug=FZPU numa=fake=10" as well.

[-- Attachment #2: config_fuzzkvm --]
[-- Type: text/x-mpsub, Size: 132781 bytes --]

#
# Automatically generated file; DO NOT EDIT.
# Linux/x86_64 3.5.0-rc4 Kernel Configuration
#
CONFIG_64BIT=y
# CONFIG_X86_32 is not set
CONFIG_X86_64=y
CONFIG_X86=y
CONFIG_INSTRUCTION_DECODER=y
CONFIG_OUTPUT_FORMAT="elf64-x86-64"
CONFIG_ARCH_DEFCONFIG="arch/x86/configs/x86_64_defconfig"
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_HAVE_LATENCYTOP_SUPPORT=y
CONFIG_MMU=y
CONFIG_NEED_DMA_MAP_STATE=y
CONFIG_NEED_SG_DMA_LENGTH=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_GENERIC_GPIO=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
# CONFIG_RWSEM_GENERIC_SPINLOCK is not set
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_ARCH_HAS_DEFAULT_IDLE=y
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_ARCH_HAS_CPU_AUTOPROBE=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_ARCH_SUSPEND_POSSIBLE=y
CONFIG_ZONE_DMA32=y
CONFIG_AUDIT_ARCH=y
CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_HAVE_INTEL_TXT=y
CONFIG_X86_64_SMP=y
CONFIG_X86_HT=y
CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-rdi -fcall-saved-rsi -fcall-saved-rdx -fcall-saved-rcx -fcall-saved-r8 -fcall-saved-r9 -fcall-saved-r10 -fcall-saved-r11"
CONFIG_ARCH_CPU_PROBE_RELEASE=y
CONFIG_ARCH_SUPPORTS_UPROBES=y
CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
CONFIG_HAVE_IRQ_WORK=y
CONFIG_IRQ_WORK=y
CONFIG_BUILDTIME_EXTABLE_SORT=y

#
# General setup
#
CONFIG_EXPERIMENTAL=y
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_CROSS_COMPILE=""
CONFIG_LOCALVERSION="-sasha"
CONFIG_LOCALVERSION_AUTO=y
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_HAVE_KERNEL_LZO=y
CONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_LZO is not set
CONFIG_DEFAULT_HOSTNAME="(none)"
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_SYSVIPC_SYSCTL=y
CONFIG_POSIX_MQUEUE=y
CONFIG_POSIX_MQUEUE_SYSCTL=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_BSD_PROCESS_ACCT_V3=y
CONFIG_FHANDLE=y
CONFIG_TASKSTATS=y
CONFIG_TASK_DELAY_ACCT=y
CONFIG_TASK_XACCT=y
CONFIG_TASK_IO_ACCOUNTING=y
CONFIG_AUDIT=y
CONFIG_AUDITSYSCALL=y
CONFIG_AUDIT_WATCH=y
CONFIG_AUDIT_TREE=y
CONFIG_AUDIT_LOGINUID_IMMUTABLE=y
CONFIG_HAVE_GENERIC_HARDIRQS=y

#
# IRQ subsystem
#
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_GENERIC_IRQ_SHOW=y
CONFIG_GENERIC_PENDING_IRQ=y
CONFIG_IRQ_DOMAIN=y
CONFIG_IRQ_DOMAIN_DEBUG=y
CONFIG_IRQ_FORCED_THREADING=y
CONFIG_SPARSE_IRQ=y
CONFIG_CLOCKSOURCE_WATCHDOG=y
CONFIG_ARCH_CLOCKSOURCE_DATA=y
CONFIG_GENERIC_TIME_VSYSCALL=y
CONFIG_GENERIC_CLOCKEVENTS=y
CONFIG_GENERIC_CLOCKEVENTS_BUILD=y
CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
CONFIG_GENERIC_CMOS_UPDATE=y

#
# Timers subsystem
#
CONFIG_TICK_ONESHOT=y
CONFIG_NO_HZ=y
CONFIG_HIGH_RES_TIMERS=y

#
# RCU Subsystem
#
CONFIG_TREE_PREEMPT_RCU=y
CONFIG_PREEMPT_RCU=y
CONFIG_RCU_FANOUT=64
CONFIG_RCU_FANOUT_LEAF=16
# CONFIG_RCU_FANOUT_EXACT is not set
CONFIG_RCU_FAST_NO_HZ=y
CONFIG_TREE_RCU_TRACE=y
CONFIG_RCU_BOOST=y
CONFIG_RCU_BOOST_PRIO=1
CONFIG_RCU_BOOST_DELAY=500
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_LOG_BUF_SHIFT=18
CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
CONFIG_CGROUPS=y
CONFIG_CGROUP_DEBUG=y
CONFIG_CGROUP_FREEZER=y
CONFIG_CGROUP_DEVICE=y
CONFIG_CPUSETS=y
CONFIG_PROC_PID_CPUSET=y
CONFIG_CGROUP_CPUACCT=y
CONFIG_RESOURCE_COUNTERS=y
# CONFIG_CGROUP_MEM_RES_CTLR is not set
CONFIG_CGROUP_HUGETLB_RES_CTLR=y
CONFIG_CGROUP_PERF=y
CONFIG_CGROUP_SCHED=y
CONFIG_FAIR_GROUP_SCHED=y
CONFIG_CFS_BANDWIDTH=y
CONFIG_RT_GROUP_SCHED=y
CONFIG_BLK_CGROUP=y
CONFIG_DEBUG_BLK_CGROUP=y
CONFIG_CHECKPOINT_RESTORE=y
CONFIG_NAMESPACES=y
CONFIG_UTS_NS=y
CONFIG_IPC_NS=y
CONFIG_PID_NS=y
CONFIG_NET_NS=y
CONFIG_SCHED_AUTOGROUP=y
CONFIG_MM_OWNER=y
CONFIG_SYSFS_DEPRECATED=y
CONFIG_SYSFS_DEPRECATED_V2=y
CONFIG_RELAY=y
# CONFIG_BLK_DEV_INITRD is not set
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not set
CONFIG_SYSCTL=y
CONFIG_ANON_INODES=y
CONFIG_EXPERT=y
CONFIG_UID16=y
CONFIG_SYSCTL_SYSCALL=y
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
CONFIG_HOTPLUG=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_PCSPKR_PLATFORM=y
CONFIG_HAVE_PCSPKR_PLATFORM=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SIGNALFD=y
CONFIG_TIMERFD=y
CONFIG_EVENTFD=y
CONFIG_SHMEM=y
CONFIG_AIO=y
CONFIG_EMBEDDED=y
CONFIG_HAVE_PERF_EVENTS=y
CONFIG_PERF_USE_VMALLOC=y

#
# Kernel Performance Events And Counters
#
CONFIG_PERF_EVENTS=y
CONFIG_DEBUG_PERF_USE_VMALLOC=y
CONFIG_VM_EVENT_COUNTERS=y
CONFIG_PCI_QUIRKS=y
CONFIG_SLUB_DEBUG=y
CONFIG_COMPAT_BRK=y
# CONFIG_SLAB is not set
CONFIG_SLUB=y
# CONFIG_SLOB is not set
CONFIG_PROFILING=y
CONFIG_TRACEPOINTS=y
CONFIG_OPROFILE=y
CONFIG_OPROFILE_EVENT_MULTIPLEX=y
CONFIG_HAVE_OPROFILE=y
CONFIG_OPROFILE_NMI_TIMER=y
CONFIG_JUMP_LABEL=y
CONFIG_UPROBES=y
CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_HAVE_KPROBES=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_DMA_ATTRS=y
CONFIG_USE_GENERIC_SMP_HELPERS=y
CONFIG_GENERIC_SMP_IDLE_THREAD=y
CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
CONFIG_HAVE_DMA_API_DEBUG=y
CONFIG_HAVE_HW_BREAKPOINT=y
CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
CONFIG_HAVE_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_PERF_EVENTS_NMI=y
CONFIG_HAVE_ARCH_JUMP_LABEL=y
CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
CONFIG_HAVE_CMPXCHG_LOCAL=y
CONFIG_HAVE_CMPXCHG_DOUBLE=y
CONFIG_ARCH_WANT_OLD_COMPAT_IPC=y
CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
CONFIG_SECCOMP_FILTER=y

#
# GCOV-based kernel profiling
#
# CONFIG_GCOV_KERNEL is not set
# CONFIG_HAVE_GENERIC_DMA_COHERENT is not set
CONFIG_SLABINFO=y
CONFIG_RT_MUTEXES=y
CONFIG_BASE_SMALL=0
# CONFIG_MODULES is not set
CONFIG_STOP_MACHINE=y
CONFIG_BLOCK=y
CONFIG_BLK_DEV_BSG=y
CONFIG_BLK_DEV_BSGLIB=y
CONFIG_BLK_DEV_INTEGRITY=y
CONFIG_BLK_DEV_THROTTLING=y

#
# Partition Types
#
CONFIG_PARTITION_ADVANCED=y
CONFIG_ACORN_PARTITION=y
CONFIG_ACORN_PARTITION_CUMANA=y
CONFIG_ACORN_PARTITION_EESOX=y
CONFIG_ACORN_PARTITION_ICS=y
CONFIG_ACORN_PARTITION_ADFS=y
CONFIG_ACORN_PARTITION_POWERTEC=y
CONFIG_ACORN_PARTITION_RISCIX=y
CONFIG_OSF_PARTITION=y
CONFIG_AMIGA_PARTITION=y
CONFIG_ATARI_PARTITION=y
CONFIG_MAC_PARTITION=y
CONFIG_MSDOS_PARTITION=y
CONFIG_BSD_DISKLABEL=y
CONFIG_MINIX_SUBPARTITION=y
CONFIG_SOLARIS_X86_PARTITION=y
CONFIG_UNIXWARE_DISKLABEL=y
CONFIG_LDM_PARTITION=y
CONFIG_LDM_DEBUG=y
CONFIG_SGI_PARTITION=y
CONFIG_ULTRIX_PARTITION=y
CONFIG_SUN_PARTITION=y
CONFIG_KARMA_PARTITION=y
CONFIG_EFI_PARTITION=y
CONFIG_SYSV68_PARTITION=y
CONFIG_BLOCK_COMPAT=y

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
CONFIG_CFQ_GROUP_IOSCHED=y
# CONFIG_DEFAULT_DEADLINE is not set
CONFIG_DEFAULT_CFQ=y
# CONFIG_DEFAULT_NOOP is not set
CONFIG_DEFAULT_IOSCHED="cfq"
CONFIG_PREEMPT_NOTIFIERS=y
CONFIG_PADATA=y
# CONFIG_INLINE_SPIN_TRYLOCK is not set
# CONFIG_INLINE_SPIN_TRYLOCK_BH is not set
# CONFIG_INLINE_SPIN_LOCK is not set
# CONFIG_INLINE_SPIN_LOCK_BH is not set
# CONFIG_INLINE_SPIN_LOCK_IRQ is not set
# CONFIG_INLINE_SPIN_LOCK_IRQSAVE is not set
CONFIG_UNINLINE_SPIN_UNLOCK=y
# CONFIG_INLINE_SPIN_UNLOCK_BH is not set
# CONFIG_INLINE_SPIN_UNLOCK_IRQ is not set
# CONFIG_INLINE_SPIN_UNLOCK_IRQRESTORE is not set
# CONFIG_INLINE_READ_TRYLOCK is not set
# CONFIG_INLINE_READ_LOCK is not set
# CONFIG_INLINE_READ_LOCK_BH is not set
# CONFIG_INLINE_READ_LOCK_IRQ is not set
# CONFIG_INLINE_READ_LOCK_IRQSAVE is not set
# CONFIG_INLINE_READ_UNLOCK is not set
# CONFIG_INLINE_READ_UNLOCK_BH is not set
# CONFIG_INLINE_READ_UNLOCK_IRQ is not set
# CONFIG_INLINE_READ_UNLOCK_IRQRESTORE is not set
# CONFIG_INLINE_WRITE_TRYLOCK is not set
# CONFIG_INLINE_WRITE_LOCK is not set
# CONFIG_INLINE_WRITE_LOCK_BH is not set
# CONFIG_INLINE_WRITE_LOCK_IRQ is not set
# CONFIG_INLINE_WRITE_LOCK_IRQSAVE is not set
# CONFIG_INLINE_WRITE_UNLOCK is not set
# CONFIG_INLINE_WRITE_UNLOCK_BH is not set
# CONFIG_INLINE_WRITE_UNLOCK_IRQ is not set
# CONFIG_INLINE_WRITE_UNLOCK_IRQRESTORE is not set
# CONFIG_MUTEX_SPIN_ON_OWNER is not set
CONFIG_FREEZER=y

#
# Processor type and features
#
CONFIG_ZONE_DMA=y
CONFIG_SMP=y
CONFIG_X86_X2APIC=y
CONFIG_X86_MPPARSE=y
CONFIG_X86_EXTENDED_PLATFORM=y
CONFIG_X86_NUMACHIP=y
CONFIG_X86_VSMP=y
CONFIG_X86_UV=y
CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y
CONFIG_SCHED_OMIT_FRAME_POINTER=y
CONFIG_KVMTOOL_TEST_ENABLE=y
CONFIG_PARAVIRT_GUEST=y
CONFIG_PARAVIRT_TIME_ACCOUNTING=y
CONFIG_XEN=y
CONFIG_XEN_DOM0=y
CONFIG_XEN_PRIVILEGED_GUEST=y
CONFIG_XEN_PVHVM=y
CONFIG_XEN_MAX_DOMAIN_MEMORY=500
CONFIG_XEN_SAVE_RESTORE=y
CONFIG_XEN_DEBUG_FS=y
CONFIG_KVM_CLOCK=y
CONFIG_KVM_GUEST=y
CONFIG_PARAVIRT=y
CONFIG_PARAVIRT_SPINLOCKS=y
CONFIG_PARAVIRT_CLOCK=y
CONFIG_PARAVIRT_DEBUG=y
CONFIG_NO_BOOTMEM=y
CONFIG_MEMTEST=y
# CONFIG_MK8 is not set
# CONFIG_MPSC is not set
CONFIG_MCORE2=y
# CONFIG_MATOM is not set
# CONFIG_GENERIC_CPU is not set
CONFIG_X86_INTERNODE_CACHE_SHIFT=12
CONFIG_X86_CMPXCHG=y
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_X86_XADD=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_X86_P6_NOP=y
CONFIG_X86_TSC=y
CONFIG_X86_CMPXCHG64=y
CONFIG_X86_CMOV=y
CONFIG_X86_MINIMUM_CPU_FAMILY=64
CONFIG_X86_DEBUGCTLMSR=y
CONFIG_PROCESSOR_SELECT=y
CONFIG_CPU_SUP_INTEL=y
CONFIG_CPU_SUP_AMD=y
CONFIG_CPU_SUP_CENTAUR=y
CONFIG_HPET_TIMER=y
CONFIG_HPET_EMULATE_RTC=y
CONFIG_DMI=y
CONFIG_GART_IOMMU=y
CONFIG_CALGARY_IOMMU=y
CONFIG_CALGARY_IOMMU_ENABLED_BY_DEFAULT=y
CONFIG_SWIOTLB=y
CONFIG_IOMMU_HELPER=y
CONFIG_MAXSMP=y
CONFIG_NR_CPUS=4096
CONFIG_SCHED_SMT=y
CONFIG_SCHED_MC=y
CONFIG_IRQ_TIME_ACCOUNTING=y
# CONFIG_PREEMPT_NONE is not set
# CONFIG_PREEMPT_VOLUNTARY is not set
CONFIG_PREEMPT=y
CONFIG_PREEMPT_COUNT=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS=y
CONFIG_X86_MCE=y
CONFIG_X86_MCE_INTEL=y
CONFIG_X86_MCE_AMD=y
CONFIG_X86_MCE_THRESHOLD=y
CONFIG_X86_MCE_INJECT=y
CONFIG_X86_THERMAL_VECTOR=y
CONFIG_I8K=y
CONFIG_MICROCODE=y
CONFIG_MICROCODE_INTEL=y
CONFIG_MICROCODE_AMD=y
CONFIG_MICROCODE_OLD_INTERFACE=y
CONFIG_X86_MSR=y
CONFIG_X86_CPUID=y
CONFIG_ARCH_PHYS_ADDR_T_64BIT=y
CONFIG_ARCH_DMA_ADDR_T_64BIT=y
CONFIG_DIRECT_GBPAGES=y
CONFIG_NUMA=y
CONFIG_AMD_NUMA=y
CONFIG_X86_64_ACPI_NUMA=y
CONFIG_NODES_SPAN_OTHER_NODES=y
CONFIG_NUMA_EMU=y
CONFIG_NODES_SHIFT=10
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SPARSEMEM_DEFAULT=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_ARCH_MEMORY_PROBE=y
CONFIG_ARCH_PROC_KCORE_TEXT=y
CONFIG_ILLEGAL_POINTER_VALUE=0xdead000000000000
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_SPARSEMEM_MANUAL=y
CONFIG_SPARSEMEM=y
CONFIG_NEED_MULTIPLE_NODES=y
CONFIG_HAVE_MEMORY_PRESENT=y
CONFIG_SPARSEMEM_EXTREME=y
CONFIG_SPARSEMEM_VMEMMAP_ENABLE=y
CONFIG_SPARSEMEM_ALLOC_MEM_MAP_TOGETHER=y
CONFIG_SPARSEMEM_VMEMMAP=y
CONFIG_HAVE_MEMBLOCK=y
CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
CONFIG_ARCH_DISCARD_MEMBLOCK=y
CONFIG_MEMORY_HOTPLUG=y
CONFIG_MEMORY_HOTPLUG_SPARSE=y
CONFIG_MEMORY_HOTREMOVE=y
CONFIG_PAGEFLAGS_EXTENDED=y
CONFIG_SPLIT_PTLOCK_CPUS=999999
CONFIG_COMPACTION=y
CONFIG_MIGRATION=y
CONFIG_PHYS_ADDR_T_64BIT=y
CONFIG_ZONE_DMA_FLAG=1
CONFIG_BOUNCE=y
CONFIG_VIRT_TO_BUS=y
CONFIG_MMU_NOTIFIER=y
CONFIG_KSM=y
CONFIG_DEFAULT_MMAP_MIN_ADDR=4096
CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=y
CONFIG_MEMORY_FAILURE=y
CONFIG_HWPOISON_INJECT=y
CONFIG_TRANSPARENT_HUGEPAGE=y
CONFIG_TRANSPARENT_HUGEPAGE_ALWAYS=y
# CONFIG_TRANSPARENT_HUGEPAGE_MADVISE is not set
CONFIG_CROSS_MEMORY_ATTACH=y
CONFIG_CLEANCACHE=y
CONFIG_FRONTSWAP=y
CONFIG_X86_CHECK_BIOS_CORRUPTION=y
CONFIG_X86_BOOTPARAM_MEMORY_CORRUPTION_CHECK=y
CONFIG_X86_RESERVE_LOW=64
CONFIG_MTRR=y
CONFIG_MTRR_SANITIZER=y
CONFIG_MTRR_SANITIZER_ENABLE_DEFAULT=0
CONFIG_MTRR_SANITIZER_SPARE_REG_NR_DEFAULT=1
CONFIG_X86_PAT=y
CONFIG_ARCH_USES_PG_UNCACHED=y
CONFIG_ARCH_RANDOM=y
CONFIG_EFI=y
CONFIG_EFI_STUB=y
CONFIG_SECCOMP=y
CONFIG_CC_STACKPROTECTOR=y
# CONFIG_HZ_100 is not set
# CONFIG_HZ_250 is not set
# CONFIG_HZ_300 is not set
CONFIG_HZ_1000=y
CONFIG_HZ=1000
CONFIG_SCHED_HRTICK=y
CONFIG_KEXEC=y
CONFIG_CRASH_DUMP=y
CONFIG_KEXEC_JUMP=y
CONFIG_PHYSICAL_START=0x1000000
CONFIG_RELOCATABLE=y
CONFIG_PHYSICAL_ALIGN=0x1000000
CONFIG_HOTPLUG_CPU=y
CONFIG_COMPAT_VDSO=y
CONFIG_CMDLINE_BOOL=y
CONFIG_CMDLINE=""
# CONFIG_CMDLINE_OVERRIDE is not set
CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
CONFIG_ARCH_ENABLE_MEMORY_HOTREMOVE=y
CONFIG_USE_PERCPU_NUMA_NODE_ID=y

#
# Power management and ACPI options
#
CONFIG_ARCH_HIBERNATION_HEADER=y
CONFIG_SUSPEND=y
CONFIG_SUSPEND_FREEZER=y
CONFIG_HIBERNATE_CALLBACKS=y
CONFIG_HIBERNATION=y
CONFIG_PM_STD_PARTITION=""
CONFIG_PM_SLEEP=y
CONFIG_PM_SLEEP_SMP=y
CONFIG_PM_AUTOSLEEP=y
CONFIG_PM_WAKELOCKS=y
CONFIG_PM_WAKELOCKS_LIMIT=0
CONFIG_PM_WAKELOCKS_GC=y
CONFIG_PM_RUNTIME=y
CONFIG_PM=y
CONFIG_PM_DEBUG=y
CONFIG_PM_ADVANCED_DEBUG=y
# CONFIG_PM_TEST_SUSPEND is not set
CONFIG_PM_SLEEP_DEBUG=y
CONFIG_PM_TRACE=y
CONFIG_PM_TRACE_RTC=y
CONFIG_ACPI=y
CONFIG_ACPI_SLEEP=y
CONFIG_ACPI_PROCFS=y
CONFIG_ACPI_PROCFS_POWER=y
CONFIG_ACPI_EC_DEBUGFS=y
CONFIG_ACPI_PROC_EVENT=y
CONFIG_ACPI_AC=y
CONFIG_ACPI_BATTERY=y
CONFIG_ACPI_BUTTON=y
CONFIG_ACPI_VIDEO=y
CONFIG_ACPI_FAN=y
CONFIG_ACPI_DOCK=y
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_HOTPLUG_CPU=y
CONFIG_ACPI_PROCESSOR_AGGREGATOR=y
CONFIG_ACPI_THERMAL=y
CONFIG_ACPI_NUMA=y
# CONFIG_ACPI_CUSTOM_DSDT is not set
CONFIG_ACPI_BLACKLIST_YEAR=0
CONFIG_ACPI_DEBUG=y
CONFIG_ACPI_DEBUG_FUNC_TRACE=y
CONFIG_ACPI_PCI_SLOT=y
CONFIG_X86_PM_TIMER=y
CONFIG_ACPI_CONTAINER=y
CONFIG_ACPI_HOTPLUG_MEMORY=y
CONFIG_ACPI_SBS=y
CONFIG_ACPI_HED=y
CONFIG_ACPI_CUSTOM_METHOD=y
CONFIG_ACPI_BGRT=y
CONFIG_ACPI_APEI=y
CONFIG_ACPI_APEI_GHES=y
CONFIG_ACPI_APEI_PCIEAER=y
CONFIG_ACPI_APEI_MEMORY_FAILURE=y
CONFIG_ACPI_APEI_EINJ=y
CONFIG_ACPI_APEI_ERST_DEBUG=y
CONFIG_SFI=y

#
# CPU Frequency scaling
#
CONFIG_CPU_FREQ=y
CONFIG_CPU_FREQ_TABLE=y
CONFIG_CPU_FREQ_STAT=y
CONFIG_CPU_FREQ_STAT_DETAILS=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_POWERSAVE is not set
CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_ONDEMAND is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_CONSERVATIVE is not set
CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
CONFIG_CPU_FREQ_GOV_POWERSAVE=y
CONFIG_CPU_FREQ_GOV_USERSPACE=y
CONFIG_CPU_FREQ_GOV_ONDEMAND=y
CONFIG_CPU_FREQ_GOV_CONSERVATIVE=y

#
# x86 CPU frequency scaling drivers
#
CONFIG_X86_PCC_CPUFREQ=y
CONFIG_X86_ACPI_CPUFREQ=y
CONFIG_X86_POWERNOW_K8=y
CONFIG_X86_SPEEDSTEP_CENTRINO=y
CONFIG_X86_P4_CLOCKMOD=y

#
# shared options
#
CONFIG_X86_SPEEDSTEP_LIB=y
CONFIG_CPU_IDLE=y
CONFIG_CPU_IDLE_GOV_LADDER=y
CONFIG_CPU_IDLE_GOV_MENU=y
# CONFIG_ARCH_NEEDS_CPU_IDLE_COUPLED is not set
CONFIG_INTEL_IDLE=y

#
# Memory power savings
#
CONFIG_I7300_IDLE_IOAT_CHANNEL=y
CONFIG_I7300_IDLE=y

#
# Bus options (PCI etc.)
#
CONFIG_PCI=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_PCI_XEN=y
CONFIG_PCI_DOMAINS=y
CONFIG_PCI_CNB20LE_QUIRK=y
CONFIG_PCIEPORTBUS=y
CONFIG_HOTPLUG_PCI_PCIE=y
CONFIG_PCIEAER=y
CONFIG_PCIE_ECRC=y
CONFIG_PCIEAER_INJECT=y
CONFIG_PCIEASPM=y
CONFIG_PCIEASPM_DEBUG=y
CONFIG_PCIEASPM_DEFAULT=y
# CONFIG_PCIEASPM_POWERSAVE is not set
# CONFIG_PCIEASPM_PERFORMANCE is not set
CONFIG_PCIE_PME=y
CONFIG_ARCH_SUPPORTS_MSI=y
CONFIG_PCI_MSI=y
CONFIG_PCI_DEBUG=y
CONFIG_PCI_REALLOC_ENABLE_AUTO=y
CONFIG_PCI_STUB=y
CONFIG_XEN_PCIDEV_FRONTEND=y
CONFIG_HT_IRQ=y
CONFIG_PCI_ATS=y
CONFIG_PCI_IOV=y
CONFIG_PCI_PRI=y
CONFIG_PCI_PASID=y
CONFIG_PCI_IOAPIC=y
CONFIG_PCI_LABEL=y
CONFIG_ISA_DMA_API=y
CONFIG_AMD_NB=y
CONFIG_PCCARD=y
CONFIG_PCMCIA=y
CONFIG_PCMCIA_LOAD_CIS=y
CONFIG_CARDBUS=y

#
# PC-card bridges
#
CONFIG_YENTA=y
CONFIG_YENTA_O2=y
CONFIG_YENTA_RICOH=y
CONFIG_YENTA_TI=y
CONFIG_YENTA_ENE_TUNE=y
CONFIG_YENTA_TOSHIBA=y
CONFIG_PD6729=y
CONFIG_I82092=y
CONFIG_PCCARD_NONSTATIC=y
CONFIG_HOTPLUG_PCI=y
CONFIG_HOTPLUG_PCI_FAKE=y
CONFIG_HOTPLUG_PCI_ACPI=y
CONFIG_HOTPLUG_PCI_ACPI_IBM=y
CONFIG_HOTPLUG_PCI_CPCI=y
CONFIG_HOTPLUG_PCI_CPCI_ZT5550=y
CONFIG_HOTPLUG_PCI_CPCI_GENERIC=y
CONFIG_HOTPLUG_PCI_SHPC=y
CONFIG_RAPIDIO=y
CONFIG_RAPIDIO_TSI721=y
CONFIG_RAPIDIO_DISC_TIMEOUT=30
CONFIG_RAPIDIO_ENABLE_RX_TX_PORTS=y
CONFIG_RAPIDIO_DMA_ENGINE=y
CONFIG_RAPIDIO_DEBUG=y
CONFIG_RAPIDIO_TSI57X=y
CONFIG_RAPIDIO_CPS_XX=y
CONFIG_RAPIDIO_TSI568=y
CONFIG_RAPIDIO_CPS_GEN2=y
CONFIG_RAPIDIO_TSI500=y

#
# Executable file formats / Emulations
#
CONFIG_BINFMT_ELF=y
CONFIG_COMPAT_BINFMT_ELF=y
CONFIG_ARCH_BINFMT_ELF_RANDOMIZE_PIE=y
CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=y
# CONFIG_HAVE_AOUT is not set
CONFIG_BINFMT_MISC=y
CONFIG_IA32_EMULATION=y
CONFIG_IA32_AOUT=y
CONFIG_X86_X32=y
CONFIG_COMPAT=y
CONFIG_COMPAT_FOR_U64_ALIGNMENT=y
CONFIG_SYSVIPC_COMPAT=y
CONFIG_KEYS_COMPAT=y
CONFIG_HAVE_TEXT_POKE_SMP=y
CONFIG_X86_DEV_DMA_OPS=y
CONFIG_NET=y
CONFIG_COMPAT_NETLINK_MESSAGES=y

#
# Networking options
#
CONFIG_PACKET=y
CONFIG_UNIX=y
CONFIG_UNIX_DIAG=y
CONFIG_XFRM=y
CONFIG_XFRM_ALGO=y
CONFIG_XFRM_USER=y
CONFIG_XFRM_SUB_POLICY=y
CONFIG_XFRM_MIGRATE=y
CONFIG_XFRM_STATISTICS=y
CONFIG_XFRM_IPCOMP=y
CONFIG_NET_KEY=y
CONFIG_NET_KEY_MIGRATE=y
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_ADVANCED_ROUTER=y
CONFIG_IP_FIB_TRIE_STATS=y
CONFIG_IP_MULTIPLE_TABLES=y
CONFIG_IP_ROUTE_MULTIPATH=y
CONFIG_IP_ROUTE_VERBOSE=y
CONFIG_IP_ROUTE_CLASSID=y
CONFIG_IP_PNP=y
CONFIG_IP_PNP_DHCP=y
CONFIG_IP_PNP_BOOTP=y
CONFIG_IP_PNP_RARP=y
CONFIG_NET_IPIP=y
CONFIG_NET_IPGRE_DEMUX=y
CONFIG_NET_IPGRE=y
CONFIG_NET_IPGRE_BROADCAST=y
CONFIG_IP_MROUTE=y
CONFIG_IP_MROUTE_MULTIPLE_TABLES=y
CONFIG_IP_PIMSM_V1=y
CONFIG_IP_PIMSM_V2=y
CONFIG_ARPD=y
CONFIG_SYN_COOKIES=y
CONFIG_INET_AH=y
CONFIG_INET_ESP=y
CONFIG_INET_IPCOMP=y
CONFIG_INET_XFRM_TUNNEL=y
CONFIG_INET_TUNNEL=y
CONFIG_INET_XFRM_MODE_TRANSPORT=y
CONFIG_INET_XFRM_MODE_TUNNEL=y
CONFIG_INET_XFRM_MODE_BEET=y
CONFIG_INET_LRO=y
CONFIG_INET_DIAG=y
CONFIG_INET_TCP_DIAG=y
CONFIG_INET_UDP_DIAG=y
CONFIG_TCP_CONG_ADVANCED=y
# CONFIG_TCP_CONG_BIC is not set
CONFIG_TCP_CONG_CUBIC=y
# CONFIG_TCP_CONG_WESTWOOD is not set
# CONFIG_TCP_CONG_HTCP is not set
# CONFIG_TCP_CONG_HSTCP is not set
# CONFIG_TCP_CONG_HYBLA is not set
# CONFIG_TCP_CONG_VEGAS is not set
# CONFIG_TCP_CONG_SCALABLE is not set
# CONFIG_TCP_CONG_LP is not set
# CONFIG_TCP_CONG_VENO is not set
# CONFIG_TCP_CONG_YEAH is not set
# CONFIG_TCP_CONG_ILLINOIS is not set
CONFIG_DEFAULT_CUBIC=y
# CONFIG_DEFAULT_RENO is not set
CONFIG_DEFAULT_TCP_CONG="cubic"
CONFIG_TCP_MD5SIG=y
CONFIG_IPV6=y
CONFIG_IPV6_PRIVACY=y
CONFIG_IPV6_ROUTER_PREF=y
CONFIG_IPV6_ROUTE_INFO=y
CONFIG_IPV6_OPTIMISTIC_DAD=y
CONFIG_INET6_AH=y
CONFIG_INET6_ESP=y
CONFIG_INET6_IPCOMP=y
CONFIG_IPV6_MIP6=y
CONFIG_INET6_XFRM_TUNNEL=y
CONFIG_INET6_TUNNEL=y
CONFIG_INET6_XFRM_MODE_TRANSPORT=y
CONFIG_INET6_XFRM_MODE_TUNNEL=y
CONFIG_INET6_XFRM_MODE_BEET=y
CONFIG_INET6_XFRM_MODE_ROUTEOPTIMIZATION=y
CONFIG_IPV6_SIT=y
CONFIG_IPV6_SIT_6RD=y
CONFIG_IPV6_NDISC_NODETYPE=y
CONFIG_IPV6_TUNNEL=y
CONFIG_IPV6_MULTIPLE_TABLES=y
CONFIG_IPV6_SUBTREES=y
CONFIG_IPV6_MROUTE=y
CONFIG_IPV6_MROUTE_MULTIPLE_TABLES=y
CONFIG_IPV6_PIMSM_V2=y
CONFIG_NETLABEL=y
CONFIG_NETWORK_SECMARK=y
CONFIG_NETWORK_PHY_TIMESTAMPING=y
CONFIG_NETFILTER=y
CONFIG_NETFILTER_DEBUG=y
CONFIG_NETFILTER_ADVANCED=y
CONFIG_BRIDGE_NETFILTER=y

#
# Core Netfilter Configuration
#
CONFIG_NETFILTER_NETLINK=y
CONFIG_NETFILTER_NETLINK_ACCT=y
CONFIG_NETFILTER_NETLINK_QUEUE=y
CONFIG_NETFILTER_NETLINK_LOG=y
CONFIG_NF_CONNTRACK=y
CONFIG_NF_CONNTRACK_MARK=y
CONFIG_NF_CONNTRACK_SECMARK=y
CONFIG_NF_CONNTRACK_ZONES=y
CONFIG_NF_CONNTRACK_PROCFS=y
CONFIG_NF_CONNTRACK_EVENTS=y
CONFIG_NF_CONNTRACK_TIMEOUT=y
CONFIG_NF_CONNTRACK_TIMESTAMP=y
CONFIG_NF_CT_PROTO_DCCP=y
CONFIG_NF_CT_PROTO_GRE=y
CONFIG_NF_CT_PROTO_SCTP=y
CONFIG_NF_CT_PROTO_UDPLITE=y
CONFIG_NF_CONNTRACK_AMANDA=y
CONFIG_NF_CONNTRACK_FTP=y
CONFIG_NF_CONNTRACK_H323=y
CONFIG_NF_CONNTRACK_IRC=y
CONFIG_NF_CONNTRACK_BROADCAST=y
CONFIG_NF_CONNTRACK_NETBIOS_NS=y
CONFIG_NF_CONNTRACK_SNMP=y
CONFIG_NF_CONNTRACK_PPTP=y
CONFIG_NF_CONNTRACK_SANE=y
CONFIG_NF_CONNTRACK_SIP=y
CONFIG_NF_CONNTRACK_TFTP=y
CONFIG_NF_CT_NETLINK=y
CONFIG_NF_CT_NETLINK_TIMEOUT=y
CONFIG_NF_CT_NETLINK_HELPER=y
CONFIG_NETFILTER_NETLINK_QUEUE_CT=y
CONFIG_NETFILTER_TPROXY=y
CONFIG_NETFILTER_XTABLES=y

#
# Xtables combined modules
#
CONFIG_NETFILTER_XT_MARK=y
CONFIG_NETFILTER_XT_CONNMARK=y
CONFIG_NETFILTER_XT_SET=y

#
# Xtables targets
#
CONFIG_NETFILTER_XT_TARGET_AUDIT=y
CONFIG_NETFILTER_XT_TARGET_CHECKSUM=y
CONFIG_NETFILTER_XT_TARGET_CLASSIFY=y
CONFIG_NETFILTER_XT_TARGET_CONNMARK=y
CONFIG_NETFILTER_XT_TARGET_CONNSECMARK=y
CONFIG_NETFILTER_XT_TARGET_CT=y
CONFIG_NETFILTER_XT_TARGET_DSCP=y
CONFIG_NETFILTER_XT_TARGET_HL=y
CONFIG_NETFILTER_XT_TARGET_HMARK=y
CONFIG_NETFILTER_XT_TARGET_IDLETIMER=y
CONFIG_NETFILTER_XT_TARGET_LED=y
CONFIG_NETFILTER_XT_TARGET_LOG=y
CONFIG_NETFILTER_XT_TARGET_MARK=y
CONFIG_NETFILTER_XT_TARGET_NFLOG=y
CONFIG_NETFILTER_XT_TARGET_NFQUEUE=y
CONFIG_NETFILTER_XT_TARGET_NOTRACK=y
CONFIG_NETFILTER_XT_TARGET_RATEEST=y
CONFIG_NETFILTER_XT_TARGET_TEE=y
CONFIG_NETFILTER_XT_TARGET_TPROXY=y
CONFIG_NETFILTER_XT_TARGET_TRACE=y
CONFIG_NETFILTER_XT_TARGET_SECMARK=y
CONFIG_NETFILTER_XT_TARGET_TCPMSS=y
CONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP=y

#
# Xtables matches
#
CONFIG_NETFILTER_XT_MATCH_ADDRTYPE=y
CONFIG_NETFILTER_XT_MATCH_CLUSTER=y
CONFIG_NETFILTER_XT_MATCH_COMMENT=y
CONFIG_NETFILTER_XT_MATCH_CONNBYTES=y
CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=y
CONFIG_NETFILTER_XT_MATCH_CONNMARK=y
CONFIG_NETFILTER_XT_MATCH_CONNTRACK=y
CONFIG_NETFILTER_XT_MATCH_CPU=y
CONFIG_NETFILTER_XT_MATCH_DCCP=y
CONFIG_NETFILTER_XT_MATCH_DEVGROUP=y
CONFIG_NETFILTER_XT_MATCH_DSCP=y
CONFIG_NETFILTER_XT_MATCH_ECN=y
CONFIG_NETFILTER_XT_MATCH_ESP=y
CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=y
CONFIG_NETFILTER_XT_MATCH_HELPER=y
CONFIG_NETFILTER_XT_MATCH_HL=y
CONFIG_NETFILTER_XT_MATCH_IPRANGE=y
CONFIG_NETFILTER_XT_MATCH_IPVS=y
CONFIG_NETFILTER_XT_MATCH_LENGTH=y
CONFIG_NETFILTER_XT_MATCH_LIMIT=y
CONFIG_NETFILTER_XT_MATCH_MAC=y
CONFIG_NETFILTER_XT_MATCH_MARK=y
CONFIG_NETFILTER_XT_MATCH_MULTIPORT=y
CONFIG_NETFILTER_XT_MATCH_NFACCT=y
CONFIG_NETFILTER_XT_MATCH_OSF=y
CONFIG_NETFILTER_XT_MATCH_OWNER=y
CONFIG_NETFILTER_XT_MATCH_POLICY=y
CONFIG_NETFILTER_XT_MATCH_PHYSDEV=y
CONFIG_NETFILTER_XT_MATCH_PKTTYPE=y
CONFIG_NETFILTER_XT_MATCH_QUOTA=y
CONFIG_NETFILTER_XT_MATCH_RATEEST=y
CONFIG_NETFILTER_XT_MATCH_REALM=y
CONFIG_NETFILTER_XT_MATCH_RECENT=y
CONFIG_NETFILTER_XT_MATCH_SCTP=y
CONFIG_NETFILTER_XT_MATCH_SOCKET=y
CONFIG_NETFILTER_XT_MATCH_STATE=y
CONFIG_NETFILTER_XT_MATCH_STATISTIC=y
CONFIG_NETFILTER_XT_MATCH_STRING=y
CONFIG_NETFILTER_XT_MATCH_TCPMSS=y
CONFIG_NETFILTER_XT_MATCH_TIME=y
CONFIG_NETFILTER_XT_MATCH_U32=y
CONFIG_IP_SET=y
CONFIG_IP_SET_MAX=256
CONFIG_IP_SET_BITMAP_IP=y
CONFIG_IP_SET_BITMAP_IPMAC=y
CONFIG_IP_SET_BITMAP_PORT=y
CONFIG_IP_SET_HASH_IP=y
CONFIG_IP_SET_HASH_IPPORT=y
CONFIG_IP_SET_HASH_IPPORTIP=y
CONFIG_IP_SET_HASH_IPPORTNET=y
CONFIG_IP_SET_HASH_NET=y
CONFIG_IP_SET_HASH_NETPORT=y
CONFIG_IP_SET_HASH_NETIFACE=y
CONFIG_IP_SET_LIST_SET=y
CONFIG_IP_VS=y
CONFIG_IP_VS_IPV6=y
CONFIG_IP_VS_DEBUG=y
CONFIG_IP_VS_TAB_BITS=12

#
# IPVS transport protocol load balancing support
#
CONFIG_IP_VS_PROTO_TCP=y
CONFIG_IP_VS_PROTO_UDP=y
CONFIG_IP_VS_PROTO_AH_ESP=y
CONFIG_IP_VS_PROTO_ESP=y
CONFIG_IP_VS_PROTO_AH=y
CONFIG_IP_VS_PROTO_SCTP=y

#
# IPVS scheduler
#
CONFIG_IP_VS_RR=y
CONFIG_IP_VS_WRR=y
CONFIG_IP_VS_LC=y
CONFIG_IP_VS_WLC=y
CONFIG_IP_VS_LBLC=y
CONFIG_IP_VS_LBLCR=y
CONFIG_IP_VS_DH=y
CONFIG_IP_VS_SH=y
CONFIG_IP_VS_SED=y
CONFIG_IP_VS_NQ=y

#
# IPVS SH scheduler
#
CONFIG_IP_VS_SH_TAB_BITS=8

#
# IPVS application helper
#
CONFIG_IP_VS_FTP=y
CONFIG_IP_VS_NFCT=y
CONFIG_IP_VS_PE_SIP=y

#
# IP: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV4=y
CONFIG_NF_CONNTRACK_IPV4=y
CONFIG_NF_CONNTRACK_PROC_COMPAT=y
CONFIG_IP_NF_QUEUE=y
CONFIG_IP_NF_IPTABLES=y
CONFIG_IP_NF_MATCH_AH=y
CONFIG_IP_NF_MATCH_ECN=y
CONFIG_IP_NF_MATCH_RPFILTER=y
CONFIG_IP_NF_MATCH_TTL=y
CONFIG_IP_NF_FILTER=y
CONFIG_IP_NF_TARGET_REJECT=y
CONFIG_IP_NF_TARGET_ULOG=y
CONFIG_NF_NAT=y
CONFIG_NF_NAT_NEEDED=y
CONFIG_IP_NF_TARGET_MASQUERADE=y
CONFIG_IP_NF_TARGET_NETMAP=y
CONFIG_IP_NF_TARGET_REDIRECT=y
CONFIG_NF_NAT_SNMP_BASIC=y
CONFIG_NF_NAT_PROTO_DCCP=y
CONFIG_NF_NAT_PROTO_GRE=y
CONFIG_NF_NAT_PROTO_UDPLITE=y
CONFIG_NF_NAT_PROTO_SCTP=y
CONFIG_NF_NAT_FTP=y
CONFIG_NF_NAT_IRC=y
CONFIG_NF_NAT_TFTP=y
CONFIG_NF_NAT_AMANDA=y
CONFIG_NF_NAT_PPTP=y
CONFIG_NF_NAT_H323=y
CONFIG_NF_NAT_SIP=y
CONFIG_IP_NF_MANGLE=y
CONFIG_IP_NF_TARGET_CLUSTERIP=y
CONFIG_IP_NF_TARGET_ECN=y
CONFIG_IP_NF_TARGET_TTL=y
CONFIG_IP_NF_RAW=y
CONFIG_IP_NF_SECURITY=y
CONFIG_IP_NF_ARPTABLES=y
CONFIG_IP_NF_ARPFILTER=y
CONFIG_IP_NF_ARP_MANGLE=y

#
# IPv6: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV6=y
CONFIG_NF_CONNTRACK_IPV6=y
CONFIG_IP6_NF_IPTABLES=y
CONFIG_IP6_NF_MATCH_AH=y
CONFIG_IP6_NF_MATCH_EUI64=y
CONFIG_IP6_NF_MATCH_FRAG=y
CONFIG_IP6_NF_MATCH_OPTS=y
CONFIG_IP6_NF_MATCH_HL=y
CONFIG_IP6_NF_MATCH_IPV6HEADER=y
CONFIG_IP6_NF_MATCH_MH=y
CONFIG_IP6_NF_MATCH_RPFILTER=y
CONFIG_IP6_NF_MATCH_RT=y
CONFIG_IP6_NF_TARGET_HL=y
CONFIG_IP6_NF_FILTER=y
CONFIG_IP6_NF_TARGET_REJECT=y
CONFIG_IP6_NF_MANGLE=y
CONFIG_IP6_NF_RAW=y
CONFIG_IP6_NF_SECURITY=y

#
# DECnet: Netfilter Configuration
#
CONFIG_DECNET_NF_GRABULATOR=y
CONFIG_BRIDGE_NF_EBTABLES=y
CONFIG_BRIDGE_EBT_BROUTE=y
CONFIG_BRIDGE_EBT_T_FILTER=y
CONFIG_BRIDGE_EBT_T_NAT=y
CONFIG_BRIDGE_EBT_802_3=y
CONFIG_BRIDGE_EBT_AMONG=y
CONFIG_BRIDGE_EBT_ARP=y
CONFIG_BRIDGE_EBT_IP=y
CONFIG_BRIDGE_EBT_IP6=y
CONFIG_BRIDGE_EBT_LIMIT=y
CONFIG_BRIDGE_EBT_MARK=y
CONFIG_BRIDGE_EBT_PKTTYPE=y
CONFIG_BRIDGE_EBT_STP=y
CONFIG_BRIDGE_EBT_VLAN=y
CONFIG_BRIDGE_EBT_ARPREPLY=y
CONFIG_BRIDGE_EBT_DNAT=y
CONFIG_BRIDGE_EBT_MARK_T=y
CONFIG_BRIDGE_EBT_REDIRECT=y
CONFIG_BRIDGE_EBT_SNAT=y
CONFIG_BRIDGE_EBT_LOG=y
CONFIG_BRIDGE_EBT_ULOG=y
CONFIG_BRIDGE_EBT_NFLOG=y
CONFIG_IP_DCCP=y
CONFIG_INET_DCCP_DIAG=y

#
# DCCP CCIDs Configuration (EXPERIMENTAL)
#
CONFIG_IP_DCCP_CCID2_DEBUG=y
CONFIG_IP_DCCP_CCID3=y
CONFIG_IP_DCCP_CCID3_DEBUG=y
CONFIG_IP_DCCP_TFRC_LIB=y
CONFIG_IP_DCCP_TFRC_DEBUG=y

#
# DCCP Kernel Hacking
#
CONFIG_IP_DCCP_DEBUG=y
CONFIG_IP_SCTP=y
CONFIG_SCTP_DBG_MSG=y
CONFIG_SCTP_DBG_OBJCNT=y
# CONFIG_SCTP_HMAC_NONE is not set
# CONFIG_SCTP_HMAC_SHA1 is not set
CONFIG_SCTP_HMAC_MD5=y
CONFIG_RDS=y
CONFIG_RDS_RDMA=y
CONFIG_RDS_TCP=y
CONFIG_RDS_DEBUG=y
CONFIG_TIPC=y
CONFIG_TIPC_ADVANCED=y
CONFIG_TIPC_PORTS=8191
CONFIG_TIPC_LOG=0
CONFIG_TIPC_DEBUG=y
CONFIG_ATM=y
CONFIG_ATM_CLIP=y
# CONFIG_ATM_CLIP_NO_ICMP is not set
CONFIG_ATM_LANE=y
CONFIG_ATM_MPOA=y
CONFIG_ATM_BR2684=y
CONFIG_ATM_BR2684_IPFILTER=y
CONFIG_L2TP=y
CONFIG_L2TP_DEBUGFS=y
CONFIG_L2TP_V3=y
CONFIG_L2TP_IP=y
CONFIG_L2TP_ETH=y
CONFIG_STP=y
CONFIG_GARP=y
CONFIG_BRIDGE=y
CONFIG_BRIDGE_IGMP_SNOOPING=y
CONFIG_NET_DSA=y
CONFIG_NET_DSA_TAG_DSA=y
CONFIG_NET_DSA_TAG_EDSA=y
CONFIG_NET_DSA_TAG_TRAILER=y
CONFIG_VLAN_8021Q=y
CONFIG_VLAN_8021Q_GVRP=y
CONFIG_DECNET=y
CONFIG_DECNET_ROUTER=y
CONFIG_LLC=y
# CONFIG_LLC2 is not set
CONFIG_IPX=y
CONFIG_IPX_INTERN=y
CONFIG_ATALK=y
CONFIG_DEV_APPLETALK=y
CONFIG_IPDDP=y
CONFIG_IPDDP_ENCAP=y
CONFIG_IPDDP_DECAP=y
CONFIG_X25=y
CONFIG_LAPB=y
CONFIG_WAN_ROUTER=y
CONFIG_PHONET=y
CONFIG_IEEE802154=y
CONFIG_IEEE802154_6LOWPAN=y
CONFIG_MAC802154=y
CONFIG_NET_SCHED=y

#
# Queueing/Scheduling
#
CONFIG_NET_SCH_CBQ=y
CONFIG_NET_SCH_HTB=y
CONFIG_NET_SCH_HFSC=y
CONFIG_NET_SCH_ATM=y
CONFIG_NET_SCH_PRIO=y
CONFIG_NET_SCH_MULTIQ=y
CONFIG_NET_SCH_RED=y
CONFIG_NET_SCH_SFB=y
CONFIG_NET_SCH_SFQ=y
CONFIG_NET_SCH_TEQL=y
CONFIG_NET_SCH_TBF=y
CONFIG_NET_SCH_GRED=y
CONFIG_NET_SCH_DSMARK=y
CONFIG_NET_SCH_NETEM=y
CONFIG_NET_SCH_DRR=y
CONFIG_NET_SCH_MQPRIO=y
CONFIG_NET_SCH_CHOKE=y
CONFIG_NET_SCH_QFQ=y
CONFIG_NET_SCH_CODEL=y
CONFIG_NET_SCH_FQ_CODEL=y
CONFIG_NET_SCH_INGRESS=y
CONFIG_NET_SCH_PLUG=y

#
# Classification
#
CONFIG_NET_CLS=y
CONFIG_NET_CLS_BASIC=y
CONFIG_NET_CLS_TCINDEX=y
CONFIG_NET_CLS_ROUTE4=y
CONFIG_NET_CLS_FW=y
CONFIG_NET_CLS_U32=y
CONFIG_CLS_U32_PERF=y
CONFIG_CLS_U32_MARK=y
CONFIG_NET_CLS_RSVP=y
CONFIG_NET_CLS_RSVP6=y
CONFIG_NET_CLS_FLOW=y
CONFIG_NET_CLS_CGROUP=y
CONFIG_NET_EMATCH=y
CONFIG_NET_EMATCH_STACK=32
CONFIG_NET_EMATCH_CMP=y
CONFIG_NET_EMATCH_NBYTE=y
CONFIG_NET_EMATCH_U32=y
CONFIG_NET_EMATCH_META=y
CONFIG_NET_EMATCH_TEXT=y
CONFIG_NET_CLS_ACT=y
CONFIG_NET_ACT_POLICE=y
CONFIG_NET_ACT_GACT=y
CONFIG_GACT_PROB=y
CONFIG_NET_ACT_MIRRED=y
CONFIG_NET_ACT_IPT=y
CONFIG_NET_ACT_NAT=y
CONFIG_NET_ACT_PEDIT=y
CONFIG_NET_ACT_SIMP=y
CONFIG_NET_ACT_SKBEDIT=y
CONFIG_NET_ACT_CSUM=y
CONFIG_NET_CLS_IND=y
CONFIG_NET_SCH_FIFO=y
CONFIG_DCB=y
CONFIG_DNS_RESOLVER=y
CONFIG_BATMAN_ADV=y
CONFIG_BATMAN_ADV_BLA=y
CONFIG_BATMAN_ADV_DEBUG=y
CONFIG_OPENVSWITCH=y
CONFIG_RPS=y
CONFIG_RFS_ACCEL=y
CONFIG_XPS=y
CONFIG_NETPRIO_CGROUP=y
CONFIG_BQL=y

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
CONFIG_NET_DROP_MONITOR=y
CONFIG_HAMRADIO=y

#
# Packet Radio protocols
#
CONFIG_AX25=y
CONFIG_AX25_DAMA_SLAVE=y
CONFIG_NETROM=y
CONFIG_ROSE=y

#
# AX.25 network device drivers
#
CONFIG_MKISS=y
CONFIG_6PACK=y
CONFIG_BPQETHER=y
CONFIG_BAYCOM_SER_FDX=y
CONFIG_BAYCOM_SER_HDX=y
CONFIG_BAYCOM_PAR=y
CONFIG_YAM=y
CONFIG_CAN=y
CONFIG_CAN_RAW=y
CONFIG_CAN_BCM=y
CONFIG_CAN_GW=y

#
# CAN Device Drivers
#
CONFIG_CAN_VCAN=y
CONFIG_CAN_SLCAN=y
CONFIG_CAN_DEV=y
CONFIG_CAN_CALC_BITTIMING=y
# CONFIG_CAN_MCP251X is not set
# CONFIG_PCH_CAN is not set
# CONFIG_CAN_SJA1000 is not set
# CONFIG_CAN_C_CAN is not set
# CONFIG_CAN_CC770 is not set

#
# CAN USB interfaces
#
# CONFIG_CAN_EMS_USB is not set
# CONFIG_CAN_ESD_USB2 is not set
CONFIG_CAN_PEAK_USB=y
CONFIG_CAN_SOFTING=y
CONFIG_CAN_SOFTING_CS=y
CONFIG_CAN_DEBUG_DEVICES=y
CONFIG_IRDA=y

#
# IrDA protocols
#
CONFIG_IRLAN=y
CONFIG_IRNET=y
CONFIG_IRCOMM=y
CONFIG_IRDA_ULTRA=y

#
# IrDA options
#
CONFIG_IRDA_CACHE_LAST_LSAP=y
CONFIG_IRDA_FAST_RR=y
CONFIG_IRDA_DEBUG=y

#
# Infrared-port device drivers
#

#
# SIR device drivers
#
CONFIG_IRTTY_SIR=y

#
# Dongle support
#
CONFIG_DONGLE=y
# CONFIG_ESI_DONGLE is not set
# CONFIG_ACTISYS_DONGLE is not set
# CONFIG_TEKRAM_DONGLE is not set
# CONFIG_TOIM3232_DONGLE is not set
# CONFIG_LITELINK_DONGLE is not set
# CONFIG_MA600_DONGLE is not set
# CONFIG_GIRBIL_DONGLE is not set
# CONFIG_MCP2120_DONGLE is not set
# CONFIG_OLD_BELKIN_DONGLE is not set
# CONFIG_ACT200L_DONGLE is not set
# CONFIG_KINGSUN_DONGLE is not set
# CONFIG_KSDAZZLE_DONGLE is not set
# CONFIG_KS959_DONGLE is not set

#
# FIR device drivers
#
# CONFIG_USB_IRDA is not set
# CONFIG_SIGMATEL_FIR is not set
# CONFIG_NSC_FIR is not set
# CONFIG_WINBOND_FIR is not set
# CONFIG_SMC_IRCC_FIR is not set
# CONFIG_ALI_FIR is not set
# CONFIG_VLSI_FIR is not set
# CONFIG_VIA_FIR is not set
# CONFIG_MCS_FIR is not set
CONFIG_BT=y
CONFIG_BT_RFCOMM=y
CONFIG_BT_RFCOMM_TTY=y
CONFIG_BT_BNEP=y
CONFIG_BT_BNEP_MC_FILTER=y
CONFIG_BT_BNEP_PROTO_FILTER=y
CONFIG_BT_CMTP=y
CONFIG_BT_HIDP=y

#
# Bluetooth device drivers
#
CONFIG_BT_HCIBTUSB=y
CONFIG_BT_HCIBTSDIO=y
CONFIG_BT_HCIUART=y
CONFIG_BT_HCIUART_H4=y
CONFIG_BT_HCIUART_BCSP=y
CONFIG_BT_HCIUART_ATH3K=y
CONFIG_BT_HCIUART_LL=y
# CONFIG_BT_HCIBCM203X is not set
# CONFIG_BT_HCIBPA10X is not set
# CONFIG_BT_HCIBFUSB is not set
# CONFIG_BT_HCIDTL1 is not set
# CONFIG_BT_HCIBT3C is not set
# CONFIG_BT_HCIBLUECARD is not set
# CONFIG_BT_HCIBTUART is not set
CONFIG_BT_HCIVHCI=y
# CONFIG_BT_MRVL is not set
CONFIG_BT_ATH3K=y
# CONFIG_BT_WILINK is not set
CONFIG_AF_RXRPC=y
CONFIG_AF_RXRPC_DEBUG=y
CONFIG_RXKAD=y
CONFIG_FIB_RULES=y
CONFIG_WIRELESS=y
CONFIG_WIRELESS_EXT=y
CONFIG_WEXT_CORE=y
CONFIG_WEXT_PROC=y
CONFIG_WEXT_SPY=y
CONFIG_WEXT_PRIV=y
CONFIG_CFG80211=y
CONFIG_NL80211_TESTMODE=y
CONFIG_CFG80211_DEVELOPER_WARNINGS=y
CONFIG_CFG80211_REG_DEBUG=y
CONFIG_CFG80211_DEFAULT_PS=y
CONFIG_CFG80211_DEBUGFS=y
CONFIG_CFG80211_INTERNAL_REGDB=y
CONFIG_CFG80211_WEXT=y
CONFIG_LIB80211=y
CONFIG_LIB80211_CRYPT_WEP=y
CONFIG_LIB80211_CRYPT_CCMP=y
CONFIG_LIB80211_CRYPT_TKIP=y
CONFIG_LIB80211_DEBUG=y
CONFIG_MAC80211=y
CONFIG_MAC80211_HAS_RC=y
CONFIG_MAC80211_RC_PID=y
CONFIG_MAC80211_RC_MINSTREL=y
CONFIG_MAC80211_RC_MINSTREL_HT=y
# CONFIG_MAC80211_RC_DEFAULT_PID is not set
CONFIG_MAC80211_RC_DEFAULT_MINSTREL=y
CONFIG_MAC80211_RC_DEFAULT="minstrel_ht"
CONFIG_MAC80211_MESH=y
CONFIG_MAC80211_LEDS=y
CONFIG_MAC80211_DEBUGFS=y
CONFIG_MAC80211_MESSAGE_TRACING=y
CONFIG_MAC80211_DEBUG_MENU=y
CONFIG_MAC80211_NOINLINE=y
CONFIG_MAC80211_VERBOSE_DEBUG=y
CONFIG_MAC80211_MLME_DEBUG=y
CONFIG_MAC80211_STA_DEBUG=y
CONFIG_MAC80211_HT_DEBUG=y
CONFIG_MAC80211_IBSS_DEBUG=y
CONFIG_MAC80211_PS_DEBUG=y
CONFIG_MAC80211_MPL_DEBUG=y
CONFIG_MAC80211_MPATH_DEBUG=y
CONFIG_MAC80211_MHWMP_DEBUG=y
CONFIG_MAC80211_MESH_SYNC_DEBUG=y
CONFIG_MAC80211_TDLS_DEBUG=y
CONFIG_MAC80211_DEBUG_COUNTERS=y
CONFIG_WIMAX=y
CONFIG_WIMAX_DEBUG_LEVEL=8
CONFIG_RFKILL=y
CONFIG_RFKILL_LEDS=y
CONFIG_RFKILL_INPUT=y
CONFIG_RFKILL_REGULATOR=y
CONFIG_NET_9P=y
CONFIG_NET_9P_VIRTIO=y
CONFIG_NET_9P_RDMA=y
CONFIG_NET_9P_DEBUG=y
CONFIG_CAIF=y
CONFIG_CAIF_DEBUG=y
CONFIG_CAIF_NETDEV=y
CONFIG_CAIF_USB=y
CONFIG_CEPH_LIB=y
CONFIG_CEPH_LIB_PRETTYDEBUG=y
CONFIG_CEPH_LIB_USE_DNS_RESOLVER=y
CONFIG_NFC=y
CONFIG_NFC_NCI=y
CONFIG_NFC_HCI=y
CONFIG_NFC_SHDLC=y
CONFIG_NFC_LLCP=y

#
# Near Field Communication (NFC) devices
#
CONFIG_PN544_NFC=y
CONFIG_PN544_HCI_NFC=y
CONFIG_NFC_PN533=y
# CONFIG_NFC_WILINK is not set
CONFIG_HAVE_BPF_JIT=y

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug"
CONFIG_DEVTMPFS=y
CONFIG_DEVTMPFS_MOUNT=y
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=y
CONFIG_FIRMWARE_IN_KERNEL=y
CONFIG_EXTRA_FIRMWARE=""
CONFIG_DEBUG_DRIVER=y
CONFIG_DEBUG_DEVRES=y
CONFIG_SYS_HYPERVISOR=y
# CONFIG_GENERIC_CPU_DEVICES is not set
CONFIG_REGMAP=y
CONFIG_REGMAP_I2C=y
CONFIG_REGMAP_SPI=y
CONFIG_REGMAP_IRQ=y
CONFIG_DMA_SHARED_BUFFER=y
CONFIG_CONNECTOR=y
CONFIG_PROC_EVENTS=y
CONFIG_MTD=y
CONFIG_MTD_REDBOOT_PARTS=y
CONFIG_MTD_REDBOOT_DIRECTORY_BLOCK=-1
CONFIG_MTD_REDBOOT_PARTS_UNALLOCATED=y
CONFIG_MTD_REDBOOT_PARTS_READONLY=y
CONFIG_MTD_CMDLINE_PARTS=y
CONFIG_MTD_AR7_PARTS=y

#
# User Modules And Translation Layers
#
CONFIG_MTD_CHAR=y
CONFIG_HAVE_MTD_OTP=y
CONFIG_MTD_BLKDEVS=y
CONFIG_MTD_BLOCK=y
CONFIG_FTL=y
CONFIG_NFTL=y
CONFIG_NFTL_RW=y
CONFIG_INFTL=y
CONFIG_RFD_FTL=y
CONFIG_SSFDC=y
CONFIG_SM_FTL=y
CONFIG_MTD_OOPS=y
CONFIG_MTD_SWAP=y

#
# RAM/ROM/Flash chip drivers
#
CONFIG_MTD_CFI=y
CONFIG_MTD_JEDECPROBE=y
CONFIG_MTD_GEN_PROBE=y
CONFIG_MTD_CFI_ADV_OPTIONS=y
CONFIG_MTD_CFI_NOSWAP=y
# CONFIG_MTD_CFI_BE_BYTE_SWAP is not set
# CONFIG_MTD_CFI_LE_BYTE_SWAP is not set
CONFIG_MTD_CFI_GEOMETRY=y
CONFIG_MTD_MAP_BANK_WIDTH_1=y
CONFIG_MTD_MAP_BANK_WIDTH_2=y
CONFIG_MTD_MAP_BANK_WIDTH_4=y
CONFIG_MTD_MAP_BANK_WIDTH_8=y
CONFIG_MTD_MAP_BANK_WIDTH_16=y
CONFIG_MTD_MAP_BANK_WIDTH_32=y
CONFIG_MTD_CFI_I1=y
CONFIG_MTD_CFI_I2=y
CONFIG_MTD_CFI_I4=y
CONFIG_MTD_CFI_I8=y
CONFIG_MTD_OTP=y
CONFIG_MTD_CFI_INTELEXT=y
CONFIG_MTD_CFI_AMDSTD=y
CONFIG_MTD_CFI_STAA=y
CONFIG_MTD_CFI_UTIL=y
CONFIG_MTD_RAM=y
CONFIG_MTD_ROM=y
CONFIG_MTD_ABSENT=y

#
# Mapping drivers for chip access
#
CONFIG_MTD_COMPLEX_MAPPINGS=y
CONFIG_MTD_PHYSMAP=y
CONFIG_MTD_PHYSMAP_COMPAT=y
CONFIG_MTD_PHYSMAP_START=0x8000000
CONFIG_MTD_PHYSMAP_LEN=0
CONFIG_MTD_PHYSMAP_BANKWIDTH=2
CONFIG_MTD_SC520CDP=y
CONFIG_MTD_NETSC520=y
CONFIG_MTD_TS5500=y
CONFIG_MTD_SBC_GXX=y
CONFIG_MTD_AMD76XROM=y
CONFIG_MTD_ICHXROM=y
CONFIG_MTD_ESB2ROM=y
CONFIG_MTD_CK804XROM=y
CONFIG_MTD_SCB2_FLASH=y
CONFIG_MTD_NETtel=y
CONFIG_MTD_L440GX=y
CONFIG_MTD_PCI=y
CONFIG_MTD_PCMCIA=y
CONFIG_MTD_PCMCIA_ANONYMOUS=y
CONFIG_MTD_GPIO_ADDR=y
CONFIG_MTD_INTEL_VR_NOR=y
CONFIG_MTD_PLATRAM=y
CONFIG_MTD_LATCH_ADDR=y

#
# Self-contained MTD device drivers
#
# CONFIG_MTD_PMC551 is not set
CONFIG_MTD_DATAFLASH=y
CONFIG_MTD_DATAFLASH_WRITE_VERIFY=y
CONFIG_MTD_DATAFLASH_OTP=y
CONFIG_MTD_M25P80=y
CONFIG_M25PXX_USE_FAST_READ=y
CONFIG_MTD_SST25L=y
CONFIG_MTD_SLRAM=y
CONFIG_MTD_PHRAM=y
CONFIG_MTD_MTDRAM=y
CONFIG_MTDRAM_TOTAL_SIZE=4096
CONFIG_MTDRAM_ERASE_SIZE=128
CONFIG_MTDRAM_ABS_POS=0
CONFIG_MTD_BLOCK2MTD=y

#
# Disk-On-Chip Device Drivers
#
CONFIG_MTD_DOC2000=y
CONFIG_MTD_DOC2001=y
CONFIG_MTD_DOC2001PLUS=y
CONFIG_MTD_DOCG3=y
CONFIG_BCH_CONST_M=14
CONFIG_BCH_CONST_T=4
CONFIG_MTD_DOCPROBE=y
CONFIG_MTD_DOCECC=y
CONFIG_MTD_DOCPROBE_ADVANCED=y
CONFIG_MTD_DOCPROBE_ADDRESS=0x0
CONFIG_MTD_DOCPROBE_HIGH=y
CONFIG_MTD_DOCPROBE_55AA=y
CONFIG_MTD_NAND_ECC=y
CONFIG_MTD_NAND_ECC_SMC=y
CONFIG_MTD_NAND=y
CONFIG_MTD_NAND_VERIFY_WRITE=y
CONFIG_MTD_NAND_BCH=y
CONFIG_MTD_NAND_ECC_BCH=y
CONFIG_MTD_SM_COMMON=y
CONFIG_MTD_NAND_MUSEUM_IDS=y
CONFIG_MTD_NAND_DENALI=y
CONFIG_MTD_NAND_DENALI_SCRATCH_REG_ADDR=0xFF108018
CONFIG_MTD_NAND_IDS=y
CONFIG_MTD_NAND_RICOH=y
CONFIG_MTD_NAND_DISKONCHIP=y
CONFIG_MTD_NAND_DISKONCHIP_PROBE_ADVANCED=y
CONFIG_MTD_NAND_DISKONCHIP_PROBE_ADDRESS=0
CONFIG_MTD_NAND_DISKONCHIP_PROBE_HIGH=y
CONFIG_MTD_NAND_DISKONCHIP_BBTWRITE=y
CONFIG_MTD_NAND_DOCG4=y
CONFIG_MTD_NAND_CAFE=y
CONFIG_MTD_NAND_NANDSIM=y
CONFIG_MTD_NAND_PLATFORM=y
CONFIG_MTD_ALAUDA=y
CONFIG_MTD_ONENAND=y
CONFIG_MTD_ONENAND_VERIFY_WRITE=y
CONFIG_MTD_ONENAND_GENERIC=y
CONFIG_MTD_ONENAND_OTP=y
CONFIG_MTD_ONENAND_2X_PROGRAM=y
CONFIG_MTD_ONENAND_SIM=y

#
# LPDDR flash memory drivers
#
CONFIG_MTD_LPDDR=y
CONFIG_MTD_QINFO_PROBE=y
CONFIG_MTD_UBI=y
CONFIG_MTD_UBI_WL_THRESHOLD=4096
CONFIG_MTD_UBI_BEB_RESERVE=1
CONFIG_MTD_UBI_GLUEBI=y
CONFIG_PARPORT=y
CONFIG_PARPORT_PC=y
CONFIG_PARPORT_SERIAL=y
CONFIG_PARPORT_PC_FIFO=y
CONFIG_PARPORT_PC_SUPERIO=y
CONFIG_PARPORT_PC_PCMCIA=y
# CONFIG_PARPORT_GSC is not set
CONFIG_PARPORT_AX88796=y
CONFIG_PARPORT_1284=y
CONFIG_PARPORT_NOT_PC=y
CONFIG_PNP=y
CONFIG_PNP_DEBUG_MESSAGES=y

#
# Protocols
#
CONFIG_PNPACPI=y
CONFIG_BLK_DEV=y
CONFIG_BLK_DEV_FD=y
# CONFIG_PARIDE is not set
CONFIG_BLK_DEV_PCIESSD_MTIP32XX=y
CONFIG_BLK_CPQ_DA=y
CONFIG_BLK_CPQ_CISS_DA=y
CONFIG_CISS_SCSI_TAPE=y
CONFIG_BLK_DEV_DAC960=y
CONFIG_BLK_DEV_UMEM=y
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=y
CONFIG_BLK_DEV_LOOP_MIN_COUNT=8
CONFIG_BLK_DEV_CRYPTOLOOP=y
CONFIG_BLK_DEV_DRBD=y
CONFIG_DRBD_FAULT_INJECTION=y
CONFIG_BLK_DEV_NBD=y
CONFIG_BLK_DEV_NVME=y
CONFIG_BLK_DEV_OSD=y
CONFIG_BLK_DEV_SX8=y
CONFIG_BLK_DEV_UB=y
CONFIG_BLK_DEV_RAM=y
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=16384
CONFIG_BLK_DEV_XIP=y
CONFIG_CDROM_PKTCDVD=y
CONFIG_CDROM_PKTCDVD_BUFFERS=8
CONFIG_CDROM_PKTCDVD_WCACHE=y
CONFIG_ATA_OVER_ETH=y
CONFIG_XEN_BLKDEV_FRONTEND=y
CONFIG_XEN_BLKDEV_BACKEND=y
CONFIG_VIRTIO_BLK=y
CONFIG_BLK_DEV_HD=y
CONFIG_BLK_DEV_RBD=y

#
# Misc devices
#
CONFIG_SENSORS_LIS3LV02D=y
CONFIG_AD525X_DPOT=y
CONFIG_AD525X_DPOT_I2C=y
CONFIG_AD525X_DPOT_SPI=y
CONFIG_IBM_ASM=y
CONFIG_PHANTOM=y
CONFIG_INTEL_MID_PTI=y
CONFIG_SGI_IOC4=y
CONFIG_TIFM_CORE=y
CONFIG_TIFM_7XX1=y
CONFIG_ICS932S401=y
CONFIG_ENCLOSURE_SERVICES=y
# CONFIG_SGI_XP is not set
CONFIG_HP_ILO=y
# CONFIG_SGI_GRU is not set
CONFIG_APDS9802ALS=y
CONFIG_ISL29003=y
CONFIG_ISL29020=y
CONFIG_SENSORS_TSL2550=y
CONFIG_SENSORS_BH1780=y
CONFIG_SENSORS_BH1770=y
CONFIG_SENSORS_APDS990X=y
CONFIG_HMC6352=y
CONFIG_DS1682=y
CONFIG_TI_DAC7512=y
CONFIG_VMWARE_BALLOON=y
CONFIG_BMP085=y
CONFIG_BMP085_I2C=y
CONFIG_BMP085_SPI=y
CONFIG_PCH_PHUB=y
CONFIG_USB_SWITCH_FSA9480=y
CONFIG_C2PORT=y
CONFIG_C2PORT_DURAMAR_2150=y

#
# EEPROM support
#
CONFIG_EEPROM_AT24=y
CONFIG_EEPROM_AT25=y
CONFIG_EEPROM_LEGACY=y
CONFIG_EEPROM_MAX6875=y
CONFIG_EEPROM_93CX6=y
CONFIG_EEPROM_93XX46=y
CONFIG_CB710_CORE=y
CONFIG_CB710_DEBUG=y
CONFIG_CB710_DEBUG_ASSUMPTIONS=y
CONFIG_IWMC3200TOP=y
CONFIG_IWMC3200TOP_DEBUG=y
CONFIG_IWMC3200TOP_DEBUGFS=y

#
# Texas Instruments shared transport line discipline
#
CONFIG_TI_ST=y
CONFIG_SENSORS_LIS3_I2C=y

#
# Altera FPGA firmware download module
#
CONFIG_ALTERA_STAPL=y
CONFIG_INTEL_MEI=y
CONFIG_HAVE_IDE=y
# CONFIG_IDE is not set

#
# SCSI device support
#
CONFIG_SCSI_MOD=y
CONFIG_RAID_ATTRS=y
CONFIG_SCSI=y
CONFIG_SCSI_DMA=y
CONFIG_SCSI_TGT=y
CONFIG_SCSI_NETLINK=y
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=y
CONFIG_CHR_DEV_ST=y
CONFIG_CHR_DEV_OSST=y
CONFIG_BLK_DEV_SR=y
CONFIG_BLK_DEV_SR_VENDOR=y
CONFIG_CHR_DEV_SG=y
CONFIG_CHR_DEV_SCH=y
CONFIG_SCSI_ENCLOSURE=y
CONFIG_SCSI_MULTI_LUN=y
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y
CONFIG_SCSI_SCAN_ASYNC=y

#
# SCSI Transports
#
CONFIG_SCSI_SPI_ATTRS=y
CONFIG_SCSI_FC_ATTRS=y
CONFIG_SCSI_FC_TGT_ATTRS=y
CONFIG_SCSI_ISCSI_ATTRS=y
CONFIG_SCSI_SAS_ATTRS=y
CONFIG_SCSI_SAS_LIBSAS=y
CONFIG_SCSI_SAS_ATA=y
CONFIG_SCSI_SAS_HOST_SMP=y
CONFIG_SCSI_SRP_ATTRS=y
CONFIG_SCSI_SRP_TGT_ATTRS=y
CONFIG_SCSI_LOWLEVEL=y
CONFIG_ISCSI_TCP=y
CONFIG_ISCSI_BOOT_SYSFS=y
CONFIG_SCSI_CXGB3_ISCSI=y
CONFIG_SCSI_CXGB4_ISCSI=y
CONFIG_SCSI_BNX2_ISCSI=y
CONFIG_SCSI_BNX2X_FCOE=y
CONFIG_BE2ISCSI=y
CONFIG_BLK_DEV_3W_XXXX_RAID=y
CONFIG_SCSI_HPSA=y
CONFIG_SCSI_3W_9XXX=y
CONFIG_SCSI_3W_SAS=y
CONFIG_SCSI_ACARD=y
CONFIG_SCSI_AACRAID=y
CONFIG_SCSI_AIC7XXX=y
CONFIG_AIC7XXX_CMDS_PER_DEVICE=32
CONFIG_AIC7XXX_RESET_DELAY_MS=5000
CONFIG_AIC7XXX_DEBUG_ENABLE=y
CONFIG_AIC7XXX_DEBUG_MASK=0
CONFIG_AIC7XXX_REG_PRETTY_PRINT=y
CONFIG_SCSI_AIC7XXX_OLD=y
CONFIG_SCSI_AIC79XX=y
CONFIG_AIC79XX_CMDS_PER_DEVICE=32
CONFIG_AIC79XX_RESET_DELAY_MS=5000
CONFIG_AIC79XX_DEBUG_ENABLE=y
CONFIG_AIC79XX_DEBUG_MASK=0
CONFIG_AIC79XX_REG_PRETTY_PRINT=y
CONFIG_SCSI_AIC94XX=y
CONFIG_AIC94XX_DEBUG=y
CONFIG_SCSI_MVSAS=y
CONFIG_SCSI_MVSAS_DEBUG=y
CONFIG_SCSI_MVSAS_TASKLET=y
CONFIG_SCSI_MVUMI=y
CONFIG_SCSI_DPT_I2O=y
CONFIG_SCSI_ADVANSYS=y
CONFIG_SCSI_ARCMSR=y
CONFIG_MEGARAID_NEWGEN=y
CONFIG_MEGARAID_MM=y
CONFIG_MEGARAID_MAILBOX=y
CONFIG_MEGARAID_LEGACY=y
CONFIG_MEGARAID_SAS=y
CONFIG_SCSI_MPT2SAS=y
CONFIG_SCSI_MPT2SAS_MAX_SGE=128
CONFIG_SCSI_MPT2SAS_LOGGING=y
CONFIG_SCSI_UFSHCD=y
CONFIG_SCSI_HPTIOP=y
CONFIG_SCSI_BUSLOGIC=y
CONFIG_VMWARE_PVSCSI=y
CONFIG_HYPERV_STORAGE=y
CONFIG_LIBFC=y
CONFIG_LIBFCOE=y
CONFIG_FCOE=y
CONFIG_FCOE_FNIC=y
CONFIG_SCSI_DMX3191D=y
CONFIG_SCSI_EATA=y
CONFIG_SCSI_EATA_TAGGED_QUEUE=y
CONFIG_SCSI_EATA_LINKED_COMMANDS=y
CONFIG_SCSI_EATA_MAX_TAGS=16
CONFIG_SCSI_FUTURE_DOMAIN=y
CONFIG_SCSI_GDTH=y
CONFIG_SCSI_ISCI=y
CONFIG_SCSI_IPS=y
CONFIG_SCSI_INITIO=y
CONFIG_SCSI_INIA100=y
CONFIG_SCSI_PPA=y
CONFIG_SCSI_IMM=y
CONFIG_SCSI_IZIP_EPP16=y
CONFIG_SCSI_IZIP_SLOW_CTR=y
CONFIG_SCSI_STEX=y
CONFIG_SCSI_SYM53C8XX_2=y
CONFIG_SCSI_SYM53C8XX_DMA_ADDRESSING_MODE=1
CONFIG_SCSI_SYM53C8XX_DEFAULT_TAGS=16
CONFIG_SCSI_SYM53C8XX_MAX_TAGS=64
CONFIG_SCSI_SYM53C8XX_MMIO=y
CONFIG_SCSI_IPR=y
CONFIG_SCSI_IPR_TRACE=y
CONFIG_SCSI_IPR_DUMP=y
CONFIG_SCSI_QLOGIC_1280=y
CONFIG_SCSI_QLA_FC=y
CONFIG_TCM_QLA2XXX=y
CONFIG_SCSI_QLA_ISCSI=y
# CONFIG_SCSI_LPFC is not set
CONFIG_SCSI_DC395x=y
CONFIG_SCSI_DC390T=y
CONFIG_SCSI_DEBUG=y
CONFIG_SCSI_PMCRAID=y
CONFIG_SCSI_PM8001=y
CONFIG_SCSI_SRP=y
CONFIG_SCSI_BFA_FC=y
CONFIG_SCSI_VIRTIO=y
CONFIG_SCSI_LOWLEVEL_PCMCIA=y
CONFIG_SCSI_DH=y
# CONFIG_SCSI_DH_RDAC is not set
# CONFIG_SCSI_DH_HP_SW is not set
# CONFIG_SCSI_DH_EMC is not set
# CONFIG_SCSI_DH_ALUA is not set
CONFIG_SCSI_OSD_INITIATOR=y
CONFIG_SCSI_OSD_ULD=y
CONFIG_SCSI_OSD_DPRINT_SENSE=1
# CONFIG_SCSI_OSD_DEBUG is not set
CONFIG_ATA=y
# CONFIG_ATA_NONSTANDARD is not set
CONFIG_ATA_VERBOSE_ERROR=y
CONFIG_ATA_ACPI=y
CONFIG_SATA_PMP=y

#
# Controllers with non-SFF native interface
#
CONFIG_SATA_AHCI=y
CONFIG_SATA_AHCI_PLATFORM=y
CONFIG_SATA_INIC162X=y
CONFIG_SATA_ACARD_AHCI=y
CONFIG_SATA_SIL24=y
CONFIG_ATA_SFF=y

#
# SFF controllers with custom DMA interface
#
CONFIG_PDC_ADMA=y
CONFIG_SATA_QSTOR=y
CONFIG_SATA_SX4=y
CONFIG_ATA_BMDMA=y

#
# SATA SFF controllers with BMDMA
#
CONFIG_ATA_PIIX=y
CONFIG_SATA_MV=y
CONFIG_SATA_NV=y
CONFIG_SATA_PROMISE=y
CONFIG_SATA_SIL=y
CONFIG_SATA_SIS=y
CONFIG_SATA_SVW=y
CONFIG_SATA_ULI=y
CONFIG_SATA_VIA=y
CONFIG_SATA_VITESSE=y

#
# PATA SFF controllers with BMDMA
#
CONFIG_PATA_ALI=y
CONFIG_PATA_AMD=y
CONFIG_PATA_ARASAN_CF=y
CONFIG_PATA_ARTOP=y
CONFIG_PATA_ATIIXP=y
CONFIG_PATA_ATP867X=y
CONFIG_PATA_CMD64X=y
CONFIG_PATA_CS5520=y
CONFIG_PATA_CS5530=y
CONFIG_PATA_CS5536=y
CONFIG_PATA_CYPRESS=y
CONFIG_PATA_EFAR=y
CONFIG_PATA_HPT366=y
CONFIG_PATA_HPT37X=y
CONFIG_PATA_HPT3X2N=y
CONFIG_PATA_HPT3X3=y
CONFIG_PATA_HPT3X3_DMA=y
CONFIG_PATA_IT8213=y
CONFIG_PATA_IT821X=y
CONFIG_PATA_JMICRON=y
CONFIG_PATA_MARVELL=y
CONFIG_PATA_NETCELL=y
CONFIG_PATA_NINJA32=y
CONFIG_PATA_NS87415=y
CONFIG_PATA_OLDPIIX=y
CONFIG_PATA_OPTIDMA=y
CONFIG_PATA_PDC2027X=y
CONFIG_PATA_PDC_OLD=y
CONFIG_PATA_RADISYS=y
CONFIG_PATA_RDC=y
CONFIG_PATA_SC1200=y
CONFIG_PATA_SCH=y
CONFIG_PATA_SERVERWORKS=y
CONFIG_PATA_SIL680=y
CONFIG_PATA_SIS=y
CONFIG_PATA_TOSHIBA=y
CONFIG_PATA_TRIFLEX=y
CONFIG_PATA_VIA=y
CONFIG_PATA_WINBOND=y

#
# PIO-only SFF controllers
#
CONFIG_PATA_CMD640_PCI=y
CONFIG_PATA_MPIIX=y
CONFIG_PATA_NS87410=y
CONFIG_PATA_OPTI=y
CONFIG_PATA_PCMCIA=y
CONFIG_PATA_PLATFORM=y
CONFIG_PATA_RZ1000=y

#
# Generic fallback / legacy drivers
#
CONFIG_PATA_ACPI=y
CONFIG_ATA_GENERIC=y
CONFIG_PATA_LEGACY=y
CONFIG_MD=y
CONFIG_BLK_DEV_MD=y
CONFIG_MD_AUTODETECT=y
CONFIG_MD_LINEAR=y
CONFIG_MD_RAID0=y
CONFIG_MD_RAID1=y
CONFIG_MD_RAID10=y
CONFIG_MD_RAID456=y
CONFIG_MULTICORE_RAID456=y
CONFIG_MD_MULTIPATH=y
CONFIG_MD_FAULTY=y
CONFIG_BLK_DEV_DM=y
CONFIG_DM_DEBUG=y
CONFIG_DM_BUFIO=y
CONFIG_DM_PERSISTENT_DATA=y
CONFIG_DM_CRYPT=y
CONFIG_DM_SNAPSHOT=y
CONFIG_DM_THIN_PROVISIONING=y
CONFIG_DM_DEBUG_BLOCK_STACK_TRACING=y
CONFIG_DM_DEBUG_SPACE_MAPS=y
CONFIG_DM_MIRROR=y
CONFIG_DM_RAID=y
CONFIG_DM_LOG_USERSPACE=y
CONFIG_DM_ZERO=y
CONFIG_DM_MULTIPATH=y
CONFIG_DM_MULTIPATH_QL=y
CONFIG_DM_MULTIPATH_ST=y
CONFIG_DM_DELAY=y
CONFIG_DM_UEVENT=y
CONFIG_DM_FLAKEY=y
CONFIG_DM_VERITY=y
CONFIG_TARGET_CORE=y
CONFIG_TCM_IBLOCK=y
CONFIG_TCM_FILEIO=y
CONFIG_TCM_PSCSI=y
CONFIG_LOOPBACK_TARGET=y
CONFIG_TCM_FC=y
CONFIG_ISCSI_TARGET=y
CONFIG_SBP_TARGET=y
CONFIG_FUSION=y
CONFIG_FUSION_SPI=y
CONFIG_FUSION_FC=y
CONFIG_FUSION_SAS=y
CONFIG_FUSION_MAX_SGE=128
CONFIG_FUSION_CTL=y
CONFIG_FUSION_LAN=y
CONFIG_FUSION_LOGGING=y

#
# IEEE 1394 (FireWire) support
#
CONFIG_FIREWIRE=y
CONFIG_FIREWIRE_OHCI=y
CONFIG_FIREWIRE_SBP2=y
CONFIG_FIREWIRE_NET=y
CONFIG_FIREWIRE_NOSY=y
CONFIG_I2O=y
CONFIG_I2O_LCT_NOTIFY_ON_CHANGES=y
CONFIG_I2O_EXT_ADAPTEC=y
CONFIG_I2O_EXT_ADAPTEC_DMA64=y
CONFIG_I2O_CONFIG=y
CONFIG_I2O_CONFIG_OLD_IOCTL=y
CONFIG_I2O_BUS=y
CONFIG_I2O_BLOCK=y
CONFIG_I2O_SCSI=y
CONFIG_I2O_PROC=y
CONFIG_MACINTOSH_DRIVERS=y
CONFIG_MAC_EMUMOUSEBTN=y
CONFIG_NETDEVICES=y
CONFIG_NET_CORE=y
CONFIG_BONDING=y
CONFIG_DUMMY=y
CONFIG_EQUALIZER=y
CONFIG_NET_FC=y
CONFIG_MII=y
CONFIG_IEEE802154_DRIVERS=y
CONFIG_IEEE802154_FAKEHARD=y
CONFIG_IEEE802154_FAKELB=y
CONFIG_IEEE802154_AT86RF230=y
CONFIG_IFB=y
CONFIG_NET_TEAM=y
CONFIG_NET_TEAM_MODE_ROUNDROBIN=y
CONFIG_NET_TEAM_MODE_ACTIVEBACKUP=y
CONFIG_NET_TEAM_MODE_LOADBALANCE=y
CONFIG_MACVLAN=y
CONFIG_MACVTAP=y
CONFIG_NETCONSOLE=y
CONFIG_NETCONSOLE_DYNAMIC=y
CONFIG_NETPOLL=y
CONFIG_NETPOLL_TRAP=y
CONFIG_NET_POLL_CONTROLLER=y
CONFIG_RIONET=y
CONFIG_RIONET_TX_SIZE=128
CONFIG_RIONET_RX_SIZE=128
CONFIG_TUN=y
CONFIG_VETH=y
CONFIG_VIRTIO_NET=y
CONFIG_SUNGEM_PHY=y
CONFIG_ARCNET=y
CONFIG_ARCNET_1201=y
CONFIG_ARCNET_1051=y
CONFIG_ARCNET_RAW=y
CONFIG_ARCNET_CAP=y
CONFIG_ARCNET_COM90xx=y
CONFIG_ARCNET_COM90xxIO=y
CONFIG_ARCNET_RIM_I=y
CONFIG_ARCNET_COM20020=y
CONFIG_ARCNET_COM20020_PCI=y
CONFIG_ARCNET_COM20020_CS=y
CONFIG_ATM_DRIVERS=y
CONFIG_ATM_DUMMY=y
CONFIG_ATM_TCP=y
CONFIG_ATM_LANAI=y
CONFIG_ATM_ENI=y
CONFIG_ATM_ENI_DEBUG=y
CONFIG_ATM_ENI_TUNE_BURST=y
CONFIG_ATM_ENI_BURST_TX_16W=y
CONFIG_ATM_ENI_BURST_TX_8W=y
CONFIG_ATM_ENI_BURST_TX_4W=y
CONFIG_ATM_ENI_BURST_TX_2W=y
CONFIG_ATM_ENI_BURST_RX_16W=y
CONFIG_ATM_ENI_BURST_RX_8W=y
CONFIG_ATM_ENI_BURST_RX_4W=y
CONFIG_ATM_ENI_BURST_RX_2W=y
CONFIG_ATM_FIRESTREAM=y
CONFIG_ATM_ZATM=y
CONFIG_ATM_ZATM_DEBUG=y
CONFIG_ATM_NICSTAR=y
CONFIG_ATM_NICSTAR_USE_SUNI=y
CONFIG_ATM_NICSTAR_USE_IDT77105=y
CONFIG_ATM_IDT77252=y
CONFIG_ATM_IDT77252_DEBUG=y
CONFIG_ATM_IDT77252_RCV_ALL=y
CONFIG_ATM_IDT77252_USE_SUNI=y
CONFIG_ATM_AMBASSADOR=y
CONFIG_ATM_AMBASSADOR_DEBUG=y
CONFIG_ATM_HORIZON=y
CONFIG_ATM_HORIZON_DEBUG=y
CONFIG_ATM_IA=y
CONFIG_ATM_IA_DEBUG=y
CONFIG_ATM_FORE200E=y
CONFIG_ATM_FORE200E_USE_TASKLET=y
CONFIG_ATM_FORE200E_TX_RETRY=16
CONFIG_ATM_FORE200E_DEBUG=0
CONFIG_ATM_HE=y
CONFIG_ATM_HE_USE_SUNI=y
CONFIG_ATM_SOLOS=y

#
# CAIF transport drivers
#
CONFIG_CAIF_TTY=y
CONFIG_CAIF_SPI_SLAVE=y
CONFIG_CAIF_SPI_SYNC=y
CONFIG_CAIF_HSI=y

#
# Distributed Switch Architecture drivers
#
CONFIG_NET_DSA_MV88E6XXX=y
CONFIG_NET_DSA_MV88E6060=y
CONFIG_NET_DSA_MV88E6XXX_NEED_PPU=y
CONFIG_NET_DSA_MV88E6131=y
CONFIG_NET_DSA_MV88E6123_61_65=y
CONFIG_ETHERNET=y
CONFIG_MDIO=y
CONFIG_NET_VENDOR_3COM=y
CONFIG_PCMCIA_3C574=y
CONFIG_PCMCIA_3C589=y
CONFIG_VORTEX=y
CONFIG_TYPHOON=y
CONFIG_NET_VENDOR_ADAPTEC=y
CONFIG_ADAPTEC_STARFIRE=y
CONFIG_NET_VENDOR_ALTEON=y
CONFIG_ACENIC=y
CONFIG_ACENIC_OMIT_TIGON_I=y
CONFIG_NET_VENDOR_AMD=y
CONFIG_AMD8111_ETH=y
CONFIG_PCNET32=y
CONFIG_PCMCIA_NMCLAN=y
CONFIG_NET_VENDOR_ATHEROS=y
CONFIG_ATL2=y
CONFIG_ATL1=y
CONFIG_ATL1E=y
CONFIG_ATL1C=y
CONFIG_NET_VENDOR_BROADCOM=y
CONFIG_B44=y
CONFIG_B44_PCI_AUTOSELECT=y
CONFIG_B44_PCICORE_AUTOSELECT=y
CONFIG_B44_PCI=y
CONFIG_BNX2=y
CONFIG_CNIC=y
CONFIG_TIGON3=y
CONFIG_BNX2X=y
CONFIG_NET_VENDOR_BROCADE=y
CONFIG_BNA=y
CONFIG_NET_CALXEDA_XGMAC=y
CONFIG_NET_VENDOR_CHELSIO=y
CONFIG_CHELSIO_T1=y
CONFIG_CHELSIO_T1_1G=y
CONFIG_CHELSIO_T3=y
CONFIG_CHELSIO_T4=y
CONFIG_CHELSIO_T4VF=y
CONFIG_NET_VENDOR_CISCO=y
CONFIG_ENIC=y
CONFIG_DNET=y
CONFIG_NET_VENDOR_DEC=y
CONFIG_NET_TULIP=y
CONFIG_DE2104X=y
CONFIG_DE2104X_DSL=0
CONFIG_TULIP=y
CONFIG_TULIP_MWI=y
CONFIG_TULIP_MMIO=y
CONFIG_TULIP_NAPI=y
CONFIG_TULIP_NAPI_HW_MITIGATION=y
CONFIG_DE4X5=y
CONFIG_WINBOND_840=y
CONFIG_DM9102=y
CONFIG_ULI526X=y
CONFIG_PCMCIA_XIRCOM=y
CONFIG_NET_VENDOR_DLINK=y
CONFIG_DE600=y
CONFIG_DE620=y
CONFIG_DL2K=y
CONFIG_SUNDANCE=y
CONFIG_SUNDANCE_MMIO=y
CONFIG_NET_VENDOR_EMULEX=y
CONFIG_BE2NET=y
CONFIG_NET_VENDOR_EXAR=y
CONFIG_S2IO=y
CONFIG_VXGE=y
CONFIG_VXGE_DEBUG_TRACE_ALL=y
CONFIG_NET_VENDOR_FUJITSU=y
CONFIG_PCMCIA_FMVJ18X=y
CONFIG_NET_VENDOR_HP=y
CONFIG_HP100=y
CONFIG_NET_VENDOR_INTEL=y
CONFIG_E100=y
CONFIG_E1000=y
CONFIG_E1000E=y
CONFIG_IGB=y
CONFIG_IGB_DCA=y
CONFIG_IGB_PTP=y
CONFIG_IGBVF=y
CONFIG_IXGB=y
CONFIG_IXGBE=y
CONFIG_IXGBE_HWMON=y
CONFIG_IXGBE_DCA=y
CONFIG_IXGBE_DCB=y
CONFIG_IXGBE_PTP=y
CONFIG_IXGBEVF=y
CONFIG_NET_VENDOR_I825XX=y
CONFIG_ZNET=y
CONFIG_IP1000=y
CONFIG_JME=y
CONFIG_NET_VENDOR_MARVELL=y
CONFIG_SKGE=y
CONFIG_SKGE_DEBUG=y
CONFIG_SKGE_GENESIS=y
CONFIG_SKY2=y
CONFIG_SKY2_DEBUG=y
CONFIG_NET_VENDOR_MELLANOX=y
CONFIG_MLX4_EN=y
CONFIG_MLX4_EN_DCB=y
CONFIG_MLX4_CORE=y
CONFIG_MLX4_DEBUG=y
CONFIG_NET_VENDOR_MICREL=y
CONFIG_KS8842=y
CONFIG_KS8851=y
CONFIG_KS8851_MLL=y
CONFIG_KSZ884X_PCI=y
CONFIG_NET_VENDOR_MICROCHIP=y
CONFIG_ENC28J60=y
CONFIG_ENC28J60_WRITEVERIFY=y
CONFIG_NET_VENDOR_MYRI=y
CONFIG_MYRI10GE=y
CONFIG_MYRI10GE_DCA=y
CONFIG_FEALNX=y
CONFIG_NET_VENDOR_NATSEMI=y
CONFIG_NATSEMI=y
CONFIG_NS83820=y
CONFIG_NET_VENDOR_8390=y
CONFIG_PCMCIA_AXNET=y
CONFIG_NE2K_PCI=y
CONFIG_PCMCIA_PCNET=y
CONFIG_NET_VENDOR_NVIDIA=y
CONFIG_FORCEDETH=y
CONFIG_NET_VENDOR_OKI=y
CONFIG_PCH_GBE=y
CONFIG_ETHOC=y
CONFIG_NET_PACKET_ENGINE=y
CONFIG_HAMACHI=y
CONFIG_YELLOWFIN=y
CONFIG_NET_VENDOR_QLOGIC=y
CONFIG_QLA3XXX=y
CONFIG_QLCNIC=y
CONFIG_QLGE=y
CONFIG_NETXEN_NIC=y
CONFIG_NET_VENDOR_REALTEK=y
CONFIG_ATP=y
CONFIG_8139CP=y
CONFIG_8139TOO=y
CONFIG_8139TOO_PIO=y
CONFIG_8139TOO_TUNE_TWISTER=y
CONFIG_8139TOO_8129=y
CONFIG_8139_OLD_RX_RESET=y
CONFIG_R8169=y
CONFIG_NET_VENDOR_RDC=y
CONFIG_R6040=y
CONFIG_NET_VENDOR_SEEQ=y
CONFIG_SEEQ8005=y
CONFIG_NET_VENDOR_SILAN=y
CONFIG_SC92031=y
CONFIG_NET_VENDOR_SIS=y
CONFIG_SIS900=y
CONFIG_SIS190=y
CONFIG_SFC=y
CONFIG_SFC_MTD=y
CONFIG_SFC_MCDI_MON=y
CONFIG_SFC_SRIOV=y
CONFIG_NET_VENDOR_SMSC=y
CONFIG_PCMCIA_SMC91C92=y
CONFIG_EPIC100=y
CONFIG_SMSC9420=y
CONFIG_NET_VENDOR_STMICRO=y
CONFIG_STMMAC_ETH=y
CONFIG_STMMAC_PLATFORM=y
CONFIG_STMMAC_PCI=y
CONFIG_STMMAC_DEBUG_FS=y
CONFIG_STMMAC_DA=y
# CONFIG_STMMAC_RING is not set
CONFIG_STMMAC_CHAINED=y
CONFIG_NET_VENDOR_SUN=y
CONFIG_HAPPYMEAL=y
CONFIG_SUNGEM=y
CONFIG_CASSINI=y
CONFIG_NIU=y
CONFIG_NET_VENDOR_TEHUTI=y
CONFIG_TEHUTI=y
CONFIG_NET_VENDOR_TI=y
CONFIG_TLAN=y
CONFIG_NET_VENDOR_VIA=y
CONFIG_VIA_RHINE=y
CONFIG_VIA_RHINE_MMIO=y
CONFIG_VIA_VELOCITY=y
CONFIG_NET_VENDOR_WIZNET=y
CONFIG_WIZNET_W5100=y
CONFIG_WIZNET_W5300=y
# CONFIG_WIZNET_BUS_DIRECT is not set
# CONFIG_WIZNET_BUS_INDIRECT is not set
CONFIG_WIZNET_BUS_ANY=y
CONFIG_NET_VENDOR_XIRCOM=y
CONFIG_PCMCIA_XIRC2PS=y
CONFIG_FDDI=y
CONFIG_DEFXX=y
# CONFIG_DEFXX_MMIO is not set
CONFIG_SKFP=y
CONFIG_HIPPI=y
CONFIG_ROADRUNNER=y
CONFIG_ROADRUNNER_LARGE_RINGS=y
CONFIG_NET_SB1000=y
CONFIG_PHYLIB=y

#
# MII PHY device drivers
#
CONFIG_AMD_PHY=y
CONFIG_MARVELL_PHY=y
CONFIG_DAVICOM_PHY=y
CONFIG_QSEMI_PHY=y
CONFIG_LXT_PHY=y
CONFIG_CICADA_PHY=y
CONFIG_VITESSE_PHY=y
CONFIG_SMSC_PHY=y
CONFIG_BROADCOM_PHY=y
CONFIG_BCM87XX_PHY=y
CONFIG_ICPLUS_PHY=y
CONFIG_REALTEK_PHY=y
CONFIG_NATIONAL_PHY=y
CONFIG_STE10XP=y
CONFIG_LSI_ET1011C_PHY=y
CONFIG_MICREL_PHY=y
CONFIG_FIXED_PHY=y
CONFIG_MDIO_BITBANG=y
CONFIG_MDIO_GPIO=y
CONFIG_MICREL_KS8995MA=y
CONFIG_PLIP=y
CONFIG_PPP=y
CONFIG_PPP_BSDCOMP=y
CONFIG_PPP_DEFLATE=y
CONFIG_PPP_FILTER=y
CONFIG_PPP_MPPE=y
CONFIG_PPP_MULTILINK=y
CONFIG_PPPOATM=y
CONFIG_PPPOE=y
CONFIG_PPTP=y
CONFIG_PPPOL2TP=y
CONFIG_PPP_ASYNC=y
CONFIG_PPP_SYNC_TTY=y
CONFIG_SLIP=y
CONFIG_SLHC=y
CONFIG_SLIP_COMPRESSED=y
CONFIG_SLIP_SMART=y
CONFIG_SLIP_MODE_SLIP6=y

#
# USB Network Adapters
#
CONFIG_USB_CATC=y
CONFIG_USB_KAWETH=y
CONFIG_USB_PEGASUS=y
CONFIG_USB_RTL8150=y
CONFIG_USB_USBNET=y
CONFIG_USB_NET_AX8817X=y
CONFIG_USB_NET_CDCETHER=y
CONFIG_USB_NET_CDC_EEM=y
CONFIG_USB_NET_CDC_NCM=y
CONFIG_USB_NET_DM9601=y
CONFIG_USB_NET_SMSC75XX=y
CONFIG_USB_NET_SMSC95XX=y
CONFIG_USB_NET_GL620A=y
CONFIG_USB_NET_NET1080=y
CONFIG_USB_NET_PLUSB=y
CONFIG_USB_NET_MCS7830=y
CONFIG_USB_NET_RNDIS_HOST=y
CONFIG_USB_NET_CDC_SUBSET=y
CONFIG_USB_ALI_M5632=y
CONFIG_USB_AN2720=y
CONFIG_USB_BELKIN=y
CONFIG_USB_ARMLINUX=y
CONFIG_USB_EPSON2888=y
CONFIG_USB_KC2190=y
CONFIG_USB_NET_ZAURUS=y
CONFIG_USB_NET_CX82310_ETH=y
CONFIG_USB_NET_KALMIA=y
CONFIG_USB_NET_QMI_WWAN=y
CONFIG_USB_HSO=y
CONFIG_USB_NET_INT51X1=y
CONFIG_USB_CDC_PHONET=y
CONFIG_USB_IPHETH=y
CONFIG_USB_SIERRA_NET=y
CONFIG_USB_VL600=y
CONFIG_WLAN=y
CONFIG_PCMCIA_RAYCS=y
CONFIG_LIBERTAS_THINFIRM=y
CONFIG_LIBERTAS_THINFIRM_DEBUG=y
CONFIG_LIBERTAS_THINFIRM_USB=y
CONFIG_AIRO=y
CONFIG_ATMEL=y
CONFIG_PCI_ATMEL=y
CONFIG_PCMCIA_ATMEL=y
CONFIG_AT76C50X_USB=y
CONFIG_AIRO_CS=y
CONFIG_PCMCIA_WL3501=y
CONFIG_PRISM54=y
CONFIG_USB_ZD1201=y
CONFIG_USB_NET_RNDIS_WLAN=y
CONFIG_RTL8180=y
CONFIG_RTL8187=y
CONFIG_RTL8187_LEDS=y
CONFIG_ADM8211=y
CONFIG_MAC80211_HWSIM=y
CONFIG_MWL8K=y
CONFIG_ATH_COMMON=y
CONFIG_ATH_DEBUG=y
CONFIG_ATH5K=y
CONFIG_ATH5K_DEBUG=y
CONFIG_ATH5K_TRACER=y
CONFIG_ATH5K_PCI=y
CONFIG_ATH9K_HW=y
CONFIG_ATH9K_COMMON=y
CONFIG_ATH9K_DFS_DEBUGFS=y
CONFIG_ATH9K_BTCOEX_SUPPORT=y
CONFIG_ATH9K=y
CONFIG_ATH9K_PCI=y
CONFIG_ATH9K_AHB=y
CONFIG_ATH9K_DEBUGFS=y
CONFIG_ATH9K_DFS_CERTIFIED=y
CONFIG_ATH9K_MAC_DEBUG=y
CONFIG_ATH9K_RATE_CONTROL=y
CONFIG_ATH9K_HTC=y
CONFIG_ATH9K_HTC_DEBUGFS=y
CONFIG_CARL9170=y
CONFIG_CARL9170_LEDS=y
CONFIG_CARL9170_DEBUGFS=y
CONFIG_CARL9170_WPC=y
CONFIG_CARL9170_HWRNG=y
CONFIG_ATH6KL=y
# CONFIG_ATH6KL_SDIO is not set
# CONFIG_ATH6KL_USB is not set
# CONFIG_ATH6KL_DEBUG is not set
CONFIG_B43=y
CONFIG_B43_SSB=y
CONFIG_B43_PCI_AUTOSELECT=y
CONFIG_B43_PCICORE_AUTOSELECT=y
CONFIG_B43_PCMCIA=y
CONFIG_B43_SDIO=y
CONFIG_B43_PIO=y
CONFIG_B43_PHY_N=y
CONFIG_B43_PHY_LP=y
CONFIG_B43_PHY_HT=y
CONFIG_B43_LEDS=y
CONFIG_B43_HWRNG=y
CONFIG_B43_DEBUG=y
CONFIG_B43LEGACY=y
CONFIG_B43LEGACY_PCI_AUTOSELECT=y
CONFIG_B43LEGACY_PCICORE_AUTOSELECT=y
CONFIG_B43LEGACY_LEDS=y
CONFIG_B43LEGACY_HWRNG=y
CONFIG_B43LEGACY_DEBUG=y
CONFIG_B43LEGACY_DMA=y
CONFIG_B43LEGACY_PIO=y
CONFIG_B43LEGACY_DMA_AND_PIO_MODE=y
# CONFIG_B43LEGACY_DMA_MODE is not set
# CONFIG_B43LEGACY_PIO_MODE is not set
CONFIG_BRCMUTIL=y
CONFIG_BRCMFMAC=y
CONFIG_BRCMFMAC_SDIO=y
CONFIG_BRCMFMAC_SDIO_OOB=y
CONFIG_BRCMFMAC_USB=y
CONFIG_BRCMDBG=y
CONFIG_HOSTAP=y
CONFIG_HOSTAP_FIRMWARE=y
CONFIG_HOSTAP_FIRMWARE_NVRAM=y
CONFIG_HOSTAP_PLX=y
CONFIG_HOSTAP_PCI=y
CONFIG_HOSTAP_CS=y
CONFIG_IPW2100=y
CONFIG_IPW2100_MONITOR=y
CONFIG_IPW2100_DEBUG=y
CONFIG_IPW2200=y
CONFIG_IPW2200_MONITOR=y
CONFIG_IPW2200_RADIOTAP=y
CONFIG_IPW2200_PROMISCUOUS=y
CONFIG_IPW2200_QOS=y
CONFIG_IPW2200_DEBUG=y
CONFIG_LIBIPW=y
CONFIG_LIBIPW_DEBUG=y
CONFIG_IWLWIFI=y
CONFIG_IWLDVM=y

#
# Debugging Options
#
CONFIG_IWLWIFI_DEBUG=y
CONFIG_IWLWIFI_DEBUGFS=y
CONFIG_IWLWIFI_DEBUG_EXPERIMENTAL_UCODE=y
CONFIG_IWLWIFI_DEVICE_TRACING=y
CONFIG_IWLWIFI_DEVICE_TESTMODE=y
CONFIG_IWLWIFI_P2P=y
CONFIG_IWLWIFI_EXPERIMENTAL_MFP=y
CONFIG_IWLEGACY=y
CONFIG_IWL4965=y
CONFIG_IWL3945=y

#
# iwl3945 / iwl4965 Debugging Options
#
CONFIG_IWLEGACY_DEBUG=y
CONFIG_IWLEGACY_DEBUGFS=y
CONFIG_IWM=y
CONFIG_IWM_DEBUG=y
CONFIG_IWM_TRACING=y
CONFIG_LIBERTAS=y
CONFIG_LIBERTAS_USB=y
CONFIG_LIBERTAS_CS=y
CONFIG_LIBERTAS_SDIO=y
CONFIG_LIBERTAS_SPI=y
CONFIG_LIBERTAS_DEBUG=y
CONFIG_LIBERTAS_MESH=y
CONFIG_HERMES=y
CONFIG_HERMES_PRISM=y
CONFIG_HERMES_CACHE_FW_ON_INIT=y
CONFIG_PLX_HERMES=y
CONFIG_TMD_HERMES=y
CONFIG_NORTEL_HERMES=y
CONFIG_PCI_HERMES=y
CONFIG_PCMCIA_HERMES=y
CONFIG_PCMCIA_SPECTRUM=y
CONFIG_ORINOCO_USB=y
CONFIG_P54_COMMON=y
CONFIG_P54_USB=y
CONFIG_P54_PCI=y
CONFIG_P54_SPI=y
CONFIG_P54_SPI_DEFAULT_EEPROM=y
CONFIG_P54_LEDS=y
# CONFIG_RT2X00 is not set
CONFIG_RTL8192CE=y
CONFIG_RTL8192SE=y
CONFIG_RTL8192DE=y
CONFIG_RTL8192CU=y
CONFIG_RTLWIFI=y
CONFIG_RTLWIFI_DEBUG=y
CONFIG_RTL8192C_COMMON=y
CONFIG_WL_TI=y
CONFIG_WL1251=y
CONFIG_WL1251_SPI=y
CONFIG_WL1251_SDIO=y
CONFIG_WL12XX=y
CONFIG_WL18XX=y
CONFIG_WLCORE=y
CONFIG_WLCORE_SPI=y
CONFIG_WLCORE_SDIO=y
CONFIG_WL12XX_PLATFORM_DATA=y
CONFIG_ZD1211RW=y
CONFIG_ZD1211RW_DEBUG=y
CONFIG_MWIFIEX=y
CONFIG_MWIFIEX_SDIO=y
CONFIG_MWIFIEX_PCIE=y
CONFIG_MWIFIEX_USB=y

#
# WiMAX Wireless Broadband devices
#
CONFIG_WIMAX_I2400M=y
CONFIG_WIMAX_I2400M_USB=y
CONFIG_WIMAX_I2400M_SDIO=y
CONFIG_WIMAX_IWMC3200_SDIO=y
CONFIG_WIMAX_I2400M_DEBUG_LEVEL=8
CONFIG_WAN=y
CONFIG_LANMEDIA=y
CONFIG_HDLC=y
CONFIG_HDLC_RAW=y
CONFIG_HDLC_RAW_ETH=y
CONFIG_HDLC_CISCO=y
CONFIG_HDLC_FR=y
CONFIG_HDLC_PPP=y
CONFIG_HDLC_X25=y
CONFIG_PCI200SYN=y
CONFIG_WANXL=y
CONFIG_PC300TOO=y
CONFIG_FARSYNC=y
CONFIG_DLCI=y
CONFIG_DLCI_MAX=8
CONFIG_WAN_ROUTER_DRIVERS=y
CONFIG_CYCLADES_SYNC=y
CONFIG_CYCLOMX_X25=y
CONFIG_LAPBETHER=y
CONFIG_X25_ASY=y
CONFIG_SBNI=y
CONFIG_SBNI_MULTILINE=y
CONFIG_XEN_NETDEV_FRONTEND=y
CONFIG_XEN_NETDEV_BACKEND=y
CONFIG_VMXNET3=y
CONFIG_HYPERV_NET=y
CONFIG_ISDN=y
CONFIG_ISDN_I4L=y
CONFIG_ISDN_PPP=y
CONFIG_ISDN_PPP_VJ=y
CONFIG_ISDN_MPP=y
CONFIG_IPPP_FILTER=y
CONFIG_ISDN_PPP_BSDCOMP=y
CONFIG_ISDN_AUDIO=y
CONFIG_ISDN_TTY_FAX=y
CONFIG_ISDN_X25=y

#
# ISDN feature submodules
#
CONFIG_ISDN_DIVERSION=y

#
# ISDN4Linux hardware drivers
#

#
# Passive cards
#
# CONFIG_ISDN_DRV_HISAX is not set

#
# Active cards
#
CONFIG_ISDN_CAPI=y
CONFIG_ISDN_DRV_AVMB1_VERBOSE_REASON=y
CONFIG_CAPI_TRACE=y
CONFIG_ISDN_CAPI_MIDDLEWARE=y
CONFIG_ISDN_CAPI_CAPI20=y
CONFIG_ISDN_CAPI_CAPIDRV=y

#
# CAPI hardware drivers
#
CONFIG_CAPI_AVM=y
# CONFIG_ISDN_DRV_AVMB1_B1PCI is not set
# CONFIG_ISDN_DRV_AVMB1_B1PCMCIA is not set
# CONFIG_ISDN_DRV_AVMB1_T1PCI is not set
# CONFIG_ISDN_DRV_AVMB1_C4 is not set
# CONFIG_CAPI_EICON is not set
CONFIG_ISDN_DRV_GIGASET=y
CONFIG_GIGASET_CAPI=y
# CONFIG_GIGASET_I4L is not set
# CONFIG_GIGASET_DUMMYLL is not set
CONFIG_GIGASET_BASE=y
CONFIG_GIGASET_M105=y
CONFIG_GIGASET_M101=y
CONFIG_GIGASET_DEBUG=y
CONFIG_MISDN=y
CONFIG_MISDN_DSP=y
CONFIG_MISDN_L1OIP=y

#
# mISDN hardware drivers
#
# CONFIG_MISDN_HFCPCI is not set
# CONFIG_MISDN_HFCMULTI is not set
# CONFIG_MISDN_HFCUSB is not set
# CONFIG_MISDN_AVMFRITZ is not set
# CONFIG_MISDN_SPEEDFAX is not set
# CONFIG_MISDN_INFINEON is not set
# CONFIG_MISDN_W6692 is not set
# CONFIG_MISDN_NETJET is not set

#
# Input device support
#
CONFIG_INPUT=y
CONFIG_INPUT_FF_MEMLESS=y
CONFIG_INPUT_POLLDEV=y
CONFIG_INPUT_SPARSEKMAP=y
CONFIG_INPUT_MATRIXKMAP=y

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
CONFIG_INPUT_JOYDEV=y
CONFIG_INPUT_EVDEV=y
CONFIG_INPUT_EVBUG=y

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
# CONFIG_KEYBOARD_ADP5588 is not set
# CONFIG_KEYBOARD_ADP5589 is not set
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_QT1070 is not set
# CONFIG_KEYBOARD_QT2160 is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_GPIO is not set
# CONFIG_KEYBOARD_GPIO_POLLED is not set
# CONFIG_KEYBOARD_TCA6416 is not set
# CONFIG_KEYBOARD_TCA8418 is not set
# CONFIG_KEYBOARD_MATRIX is not set
# CONFIG_KEYBOARD_LM8323 is not set
CONFIG_KEYBOARD_LM8333=y
# CONFIG_KEYBOARD_MAX7359 is not set
# CONFIG_KEYBOARD_MCS is not set
# CONFIG_KEYBOARD_MPR121 is not set
# CONFIG_KEYBOARD_NEWTON is not set
# CONFIG_KEYBOARD_OPENCORES is not set
# CONFIG_KEYBOARD_STOWAWAY is not set
# CONFIG_KEYBOARD_SUNKBD is not set
CONFIG_KEYBOARD_OMAP4=y
# CONFIG_KEYBOARD_XTKBD is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
CONFIG_MOUSE_PS2_ALPS=y
CONFIG_MOUSE_PS2_LOGIPS2PP=y
CONFIG_MOUSE_PS2_SYNAPTICS=y
CONFIG_MOUSE_PS2_LIFEBOOK=y
CONFIG_MOUSE_PS2_TRACKPOINT=y
# CONFIG_MOUSE_PS2_ELANTECH is not set
# CONFIG_MOUSE_PS2_SENTELIC is not set
# CONFIG_MOUSE_PS2_TOUCHKIT is not set
# CONFIG_MOUSE_SERIAL is not set
# CONFIG_MOUSE_APPLETOUCH is not set
# CONFIG_MOUSE_BCM5974 is not set
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_MOUSE_GPIO is not set
CONFIG_MOUSE_SYNAPTICS_I2C=y
CONFIG_MOUSE_SYNAPTICS_USB=y
CONFIG_INPUT_JOYSTICK=y
CONFIG_JOYSTICK_ANALOG=y
# CONFIG_JOYSTICK_A3D is not set
# CONFIG_JOYSTICK_ADI is not set
# CONFIG_JOYSTICK_COBRA is not set
# CONFIG_JOYSTICK_GF2K is not set
# CONFIG_JOYSTICK_GRIP is not set
# CONFIG_JOYSTICK_GRIP_MP is not set
# CONFIG_JOYSTICK_GUILLEMOT is not set
# CONFIG_JOYSTICK_INTERACT is not set
# CONFIG_JOYSTICK_SIDEWINDER is not set
# CONFIG_JOYSTICK_TMDC is not set
# CONFIG_JOYSTICK_IFORCE is not set
# CONFIG_JOYSTICK_WARRIOR is not set
# CONFIG_JOYSTICK_MAGELLAN is not set
# CONFIG_JOYSTICK_SPACEORB is not set
# CONFIG_JOYSTICK_SPACEBALL is not set
# CONFIG_JOYSTICK_STINGER is not set
# CONFIG_JOYSTICK_TWIDJOY is not set
# CONFIG_JOYSTICK_ZHENHUA is not set
# CONFIG_JOYSTICK_DB9 is not set
# CONFIG_JOYSTICK_GAMECON is not set
# CONFIG_JOYSTICK_TURBOGRAFX is not set
# CONFIG_JOYSTICK_AS5011 is not set
# CONFIG_JOYSTICK_JOYDUMP is not set
# CONFIG_JOYSTICK_XPAD is not set
# CONFIG_JOYSTICK_WALKERA0701 is not set
CONFIG_INPUT_TABLET=y
# CONFIG_TABLET_USB_ACECAD is not set
# CONFIG_TABLET_USB_AIPTEK is not set
# CONFIG_TABLET_USB_GTCO is not set
# CONFIG_TABLET_USB_HANWANG is not set
# CONFIG_TABLET_USB_KBTAB is not set
# CONFIG_TABLET_USB_WACOM is not set
CONFIG_INPUT_TOUCHSCREEN=y
# CONFIG_TOUCHSCREEN_88PM860X is not set
# CONFIG_TOUCHSCREEN_ADS7846 is not set
# CONFIG_TOUCHSCREEN_AD7877 is not set
# CONFIG_TOUCHSCREEN_AD7879 is not set
# CONFIG_TOUCHSCREEN_ATMEL_MXT is not set
# CONFIG_TOUCHSCREEN_AUO_PIXCIR is not set
# CONFIG_TOUCHSCREEN_BU21013 is not set
# CONFIG_TOUCHSCREEN_CY8CTMG110 is not set
CONFIG_TOUCHSCREEN_CYTTSP_CORE=y
CONFIG_TOUCHSCREEN_CYTTSP_I2C=y
CONFIG_TOUCHSCREEN_CYTTSP_SPI=y
# CONFIG_TOUCHSCREEN_DYNAPRO is not set
# CONFIG_TOUCHSCREEN_HAMPSHIRE is not set
# CONFIG_TOUCHSCREEN_EETI is not set
# CONFIG_TOUCHSCREEN_EGALAX is not set
# CONFIG_TOUCHSCREEN_FUJITSU is not set
CONFIG_TOUCHSCREEN_ILI210X=y
# CONFIG_TOUCHSCREEN_GUNZE is not set
# CONFIG_TOUCHSCREEN_ELO is not set
# CONFIG_TOUCHSCREEN_WACOM_W8001 is not set
CONFIG_TOUCHSCREEN_WACOM_I2C=y
# CONFIG_TOUCHSCREEN_MAX11801 is not set
# CONFIG_TOUCHSCREEN_MCS5000 is not set
# CONFIG_TOUCHSCREEN_MTOUCH is not set
# CONFIG_TOUCHSCREEN_INEXIO is not set
# CONFIG_TOUCHSCREEN_MK712 is not set
# CONFIG_TOUCHSCREEN_PENMOUNT is not set
# CONFIG_TOUCHSCREEN_TOUCHRIGHT is not set
# CONFIG_TOUCHSCREEN_TOUCHWIN is not set
# CONFIG_TOUCHSCREEN_PIXCIR is not set
# CONFIG_TOUCHSCREEN_USB_COMPOSITE is not set
CONFIG_TOUCHSCREEN_MC13783=y
# CONFIG_TOUCHSCREEN_TOUCHIT213 is not set
# CONFIG_TOUCHSCREEN_TSC_SERIO is not set
# CONFIG_TOUCHSCREEN_TSC2005 is not set
# CONFIG_TOUCHSCREEN_TSC2007 is not set
# CONFIG_TOUCHSCREEN_ST1232 is not set
# CONFIG_TOUCHSCREEN_TPS6507X is not set
CONFIG_INPUT_MISC=y
# CONFIG_INPUT_88PM860X_ONKEY is not set
# CONFIG_INPUT_AD714X is not set
# CONFIG_INPUT_BMA150 is not set
# CONFIG_INPUT_PCSPKR is not set
CONFIG_INPUT_MC13783_PWRBUTTON=y
# CONFIG_INPUT_MMA8450 is not set
# CONFIG_INPUT_MPU3050 is not set
# CONFIG_INPUT_APANEL is not set
# CONFIG_INPUT_GP2A is not set
# CONFIG_INPUT_GPIO_TILT_POLLED is not set
# CONFIG_INPUT_ATLAS_BTNS is not set
# CONFIG_INPUT_ATI_REMOTE2 is not set
# CONFIG_INPUT_KEYSPAN_REMOTE is not set
# CONFIG_INPUT_KXTJ9 is not set
# CONFIG_INPUT_POWERMATE is not set
# CONFIG_INPUT_YEALINK is not set
# CONFIG_INPUT_CM109 is not set
CONFIG_INPUT_TWL6040_VIBRA=y
# CONFIG_INPUT_UINPUT is not set
# CONFIG_INPUT_PCF8574 is not set
# CONFIG_INPUT_GPIO_ROTARY_ENCODER is not set
# CONFIG_INPUT_ADXL34X is not set
# CONFIG_INPUT_CMA3000 is not set
CONFIG_INPUT_XEN_KBDDEV_FRONTEND=y

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_SERPORT=y
CONFIG_SERIO_CT82C710=y
CONFIG_SERIO_PARKBD=y
CONFIG_SERIO_PCIPS2=y
CONFIG_SERIO_LIBPS2=y
CONFIG_SERIO_RAW=y
CONFIG_SERIO_ALTERA_PS2=y
CONFIG_SERIO_PS2MULT=y
CONFIG_GAMEPORT=y
CONFIG_GAMEPORT_NS558=y
CONFIG_GAMEPORT_L4=y
CONFIG_GAMEPORT_EMU10K1=y
CONFIG_GAMEPORT_FM801=y

#
# Character devices
#
CONFIG_VT=y
CONFIG_CONSOLE_TRANSLATIONS=y
CONFIG_VT_CONSOLE=y
CONFIG_VT_CONSOLE_SLEEP=y
CONFIG_HW_CONSOLE=y
CONFIG_VT_HW_CONSOLE_BINDING=y
CONFIG_UNIX98_PTYS=y
CONFIG_DEVPTS_MULTIPLE_INSTANCES=y
CONFIG_LEGACY_PTYS=y
CONFIG_LEGACY_PTY_COUNT=256
CONFIG_SERIAL_NONSTANDARD=y
CONFIG_ROCKETPORT=y
CONFIG_CYCLADES=y
CONFIG_CYZ_INTR=y
CONFIG_MOXA_INTELLIO=y
CONFIG_MOXA_SMARTIO=y
CONFIG_SYNCLINK=y
CONFIG_SYNCLINKMP=y
CONFIG_SYNCLINK_GT=y
CONFIG_NOZOMI=y
CONFIG_ISI=y
CONFIG_N_HDLC=y
CONFIG_N_GSM=y
CONFIG_TRACE_ROUTER=y
CONFIG_TRACE_SINK=y
CONFIG_DEVKMEM=y
CONFIG_STALDRV=y

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_SERIAL_8250_PCI=y
CONFIG_SERIAL_8250_PNP=y
CONFIG_SERIAL_8250_CS=y
CONFIG_SERIAL_8250_NR_UARTS=32
CONFIG_SERIAL_8250_RUNTIME_UARTS=4
CONFIG_SERIAL_8250_EXTENDED=y
CONFIG_SERIAL_8250_MANY_PORTS=y
CONFIG_SERIAL_8250_SHARE_IRQ=y
CONFIG_SERIAL_8250_DETECT_IRQ=y
CONFIG_SERIAL_8250_RSA=y

#
# Non-8250 serial port support
#
CONFIG_SERIAL_MAX3100=y
CONFIG_SERIAL_MAX3107=y
CONFIG_SERIAL_MFD_HSU=y
CONFIG_SERIAL_MFD_HSU_CONSOLE=y
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_CONSOLE_POLL=y
CONFIG_SERIAL_JSM=y
CONFIG_SERIAL_TIMBERDALE=y
CONFIG_SERIAL_ALTERA_JTAGUART=y
CONFIG_SERIAL_ALTERA_JTAGUART_CONSOLE=y
CONFIG_SERIAL_ALTERA_JTAGUART_CONSOLE_BYPASS=y
CONFIG_SERIAL_ALTERA_UART=y
CONFIG_SERIAL_ALTERA_UART_MAXPORTS=4
CONFIG_SERIAL_ALTERA_UART_BAUDRATE=115200
CONFIG_SERIAL_ALTERA_UART_CONSOLE=y
CONFIG_SERIAL_IFX6X60=y
CONFIG_SERIAL_PCH_UART=y
CONFIG_SERIAL_PCH_UART_CONSOLE=y
CONFIG_SERIAL_XILINX_PS_UART=y
CONFIG_SERIAL_XILINX_PS_UART_CONSOLE=y
CONFIG_TTY_PRINTK=y
CONFIG_PRINTER=y
CONFIG_LP_CONSOLE=y
CONFIG_PPDEV=y
CONFIG_HVC_DRIVER=y
CONFIG_HVC_IRQ=y
CONFIG_HVC_XEN=y
CONFIG_HVC_XEN_FRONTEND=y
CONFIG_VIRTIO_CONSOLE=y
# CONFIG_IPMI_HANDLER is not set
CONFIG_HW_RANDOM=y
CONFIG_HW_RANDOM_TIMERIOMEM=y
CONFIG_HW_RANDOM_INTEL=y
CONFIG_HW_RANDOM_AMD=y
CONFIG_HW_RANDOM_VIA=y
CONFIG_HW_RANDOM_VIRTIO=y
CONFIG_NVRAM=y
# CONFIG_R3964 is not set
# CONFIG_APPLICOM is not set

#
# PCMCIA character devices
#
# CONFIG_SYNCLINK_CS is not set
# CONFIG_CARDMAN_4000 is not set
# CONFIG_CARDMAN_4040 is not set
# CONFIG_IPWIRELESS is not set
# CONFIG_MWAVE is not set
CONFIG_RAW_DRIVER=y
CONFIG_MAX_RAW_DEVS=256
CONFIG_HPET=y
CONFIG_HPET_MMAP=y
CONFIG_HANGCHECK_TIMER=y
CONFIG_UV_MMTIMER=y
CONFIG_TCG_TPM=y
CONFIG_TCG_TIS=y
CONFIG_TCG_NSC=y
CONFIG_TCG_ATMEL=y
CONFIG_TCG_INFINEON=y
# CONFIG_TELCLOCK is not set
CONFIG_DEVPORT=y
CONFIG_I2C=y
CONFIG_I2C_BOARDINFO=y
CONFIG_I2C_COMPAT=y
CONFIG_I2C_CHARDEV=y
CONFIG_I2C_MUX=y

#
# Multiplexer I2C Chip support
#
# CONFIG_I2C_MUX_GPIO is not set
# CONFIG_I2C_MUX_PCA9541 is not set
# CONFIG_I2C_MUX_PCA954x is not set
CONFIG_I2C_HELPER_AUTO=y
CONFIG_I2C_ALGOBIT=y

#
# I2C Hardware Bus support
#

#
# PC SMBus host controller drivers
#
# CONFIG_I2C_ALI1535 is not set
# CONFIG_I2C_ALI1563 is not set
# CONFIG_I2C_ALI15X3 is not set
# CONFIG_I2C_AMD756 is not set
# CONFIG_I2C_AMD8111 is not set
CONFIG_I2C_I801=y
# CONFIG_I2C_ISCH is not set
# CONFIG_I2C_PIIX4 is not set
# CONFIG_I2C_NFORCE2 is not set
# CONFIG_I2C_SIS5595 is not set
# CONFIG_I2C_SIS630 is not set
# CONFIG_I2C_SIS96X is not set
# CONFIG_I2C_VIA is not set
# CONFIG_I2C_VIAPRO is not set

#
# ACPI drivers
#
# CONFIG_I2C_SCMI is not set

#
# I2C system bus drivers (mostly embedded / system-on-chip)
#
CONFIG_I2C_DESIGNWARE_PCI=y
# CONFIG_I2C_EG20T is not set
# CONFIG_I2C_GPIO is not set
# CONFIG_I2C_INTEL_MID is not set
# CONFIG_I2C_OCORES is not set
# CONFIG_I2C_PCA_PLATFORM is not set
# CONFIG_I2C_PXA_PCI is not set
# CONFIG_I2C_SIMTEC is not set
# CONFIG_I2C_XILINX is not set

#
# External I2C/SMBus adapter drivers
#
# CONFIG_I2C_DIOLAN_U2C is not set
# CONFIG_I2C_PARPORT is not set
# CONFIG_I2C_PARPORT_LIGHT is not set
# CONFIG_I2C_TAOS_EVM is not set
# CONFIG_I2C_TINY_USB is not set

#
# Other I2C/SMBus bus drivers
#
CONFIG_I2C_DEBUG_CORE=y
CONFIG_I2C_DEBUG_ALGO=y
CONFIG_I2C_DEBUG_BUS=y
CONFIG_SPI=y
CONFIG_SPI_DEBUG=y
CONFIG_SPI_MASTER=y

#
# SPI Master Controller Drivers
#
# CONFIG_SPI_ALTERA is not set
# CONFIG_SPI_BITBANG is not set
# CONFIG_SPI_BUTTERFLY is not set
# CONFIG_SPI_GPIO is not set
# CONFIG_SPI_LM70_LLP is not set
# CONFIG_SPI_OC_TINY is not set
# CONFIG_SPI_PXA2XX_PCI is not set
# CONFIG_SPI_TOPCLIFF_PCH is not set
# CONFIG_SPI_XILINX is not set
# CONFIG_SPI_DESIGNWARE is not set

#
# SPI Protocol Masters
#
CONFIG_SPI_SPIDEV=y
CONFIG_SPI_TLE62X0=y
CONFIG_HSI=y
CONFIG_HSI_BOARDINFO=y

#
# HSI clients
#
CONFIG_HSI_CHAR=y

#
# PPS support
#
CONFIG_PPS=y
# CONFIG_PPS_DEBUG is not set

#
# PPS clients support
#
CONFIG_PPS_CLIENT_KTIMER=y
CONFIG_PPS_CLIENT_LDISC=y
CONFIG_PPS_CLIENT_PARPORT=y
CONFIG_PPS_CLIENT_GPIO=y

#
# PPS generators support
#

#
# PTP clock support
#
CONFIG_PTP_1588_CLOCK=y
CONFIG_DP83640_PHY=y
# CONFIG_PTP_1588_CLOCK_PCH is not set
CONFIG_ARCH_WANT_OPTIONAL_GPIOLIB=y
CONFIG_GPIOLIB=y
CONFIG_DEBUG_GPIO=y
CONFIG_GPIO_SYSFS=y
CONFIG_GPIO_GENERIC=y

#
# Memory mapped GPIO drivers:
#
CONFIG_GPIO_GENERIC_PLATFORM=y
# CONFIG_GPIO_IT8761E is not set
# CONFIG_GPIO_SCH is not set
CONFIG_GPIO_ICH=y
# CONFIG_GPIO_VX855 is not set

#
# I2C GPIO expanders:
#
# CONFIG_GPIO_MAX7300 is not set
# CONFIG_GPIO_MAX732X is not set
# CONFIG_GPIO_PCA953X is not set
# CONFIG_GPIO_PCF857X is not set
CONFIG_GPIO_RC5T583=y
# CONFIG_GPIO_SX150X is not set
# CONFIG_GPIO_ADP5588 is not set

#
# PCI GPIO expanders:
#
# CONFIG_GPIO_BT8XX is not set
# CONFIG_GPIO_LANGWELL is not set
# CONFIG_GPIO_PCH is not set
# CONFIG_GPIO_ML_IOH is not set
# CONFIG_GPIO_RDC321X is not set

#
# SPI GPIO expanders:
#
# CONFIG_GPIO_MAX7301 is not set
# CONFIG_GPIO_MCP23S08 is not set
# CONFIG_GPIO_MC33880 is not set
# CONFIG_GPIO_74X164 is not set

#
# AC97 GPIO expanders:
#

#
# MODULbus GPIO expanders:
#
CONFIG_W1=y
CONFIG_W1_CON=y

#
# 1-wire Bus Masters
#
CONFIG_W1_MASTER_MATROX=y
CONFIG_W1_MASTER_DS2490=y
CONFIG_W1_MASTER_DS2482=y
CONFIG_W1_MASTER_DS1WM=y
CONFIG_W1_MASTER_GPIO=y

#
# 1-wire Slaves
#
CONFIG_W1_SLAVE_THERM=y
CONFIG_W1_SLAVE_SMEM=y
CONFIG_W1_SLAVE_DS2408=y
CONFIG_W1_SLAVE_DS2423=y
CONFIG_W1_SLAVE_DS2431=y
CONFIG_W1_SLAVE_DS2433=y
CONFIG_W1_SLAVE_DS2433_CRC=y
CONFIG_W1_SLAVE_DS2760=y
CONFIG_W1_SLAVE_DS2780=y
CONFIG_W1_SLAVE_DS2781=y
CONFIG_W1_SLAVE_DS28E04=y
CONFIG_W1_SLAVE_BQ27000=y
CONFIG_POWER_SUPPLY=y
# CONFIG_POWER_SUPPLY_DEBUG is not set
# CONFIG_PDA_POWER is not set
# CONFIG_TEST_POWER is not set
CONFIG_BATTERY_DS2760=y
# CONFIG_BATTERY_DS2780 is not set
CONFIG_BATTERY_DS2781=y
# CONFIG_BATTERY_DS2782 is not set
CONFIG_BATTERY_SBS=y
# CONFIG_BATTERY_BQ27x00 is not set
# CONFIG_BATTERY_MAX17040 is not set
# CONFIG_BATTERY_MAX17042 is not set
# CONFIG_CHARGER_ISP1704 is not set
# CONFIG_CHARGER_MAX8903 is not set
CONFIG_CHARGER_LP8727=y
# CONFIG_CHARGER_GPIO is not set
CONFIG_CHARGER_MANAGER=y
# CONFIG_CHARGER_SMB347 is not set
CONFIG_HWMON=y
# CONFIG_HWMON_VID is not set
# CONFIG_HWMON_DEBUG_CHIP is not set

#
# Native drivers
#
# CONFIG_SENSORS_ABITUGURU is not set
# CONFIG_SENSORS_ABITUGURU3 is not set
# CONFIG_SENSORS_AD7314 is not set
# CONFIG_SENSORS_AD7414 is not set
# CONFIG_SENSORS_AD7418 is not set
# CONFIG_SENSORS_ADCXX is not set
# CONFIG_SENSORS_ADM1021 is not set
# CONFIG_SENSORS_ADM1025 is not set
# CONFIG_SENSORS_ADM1026 is not set
# CONFIG_SENSORS_ADM1029 is not set
# CONFIG_SENSORS_ADM1031 is not set
# CONFIG_SENSORS_ADM9240 is not set
# CONFIG_SENSORS_ADT7411 is not set
# CONFIG_SENSORS_ADT7462 is not set
# CONFIG_SENSORS_ADT7470 is not set
# CONFIG_SENSORS_ADT7475 is not set
# CONFIG_SENSORS_ASC7621 is not set
# CONFIG_SENSORS_K8TEMP is not set
# CONFIG_SENSORS_K10TEMP is not set
# CONFIG_SENSORS_FAM15H_POWER is not set
# CONFIG_SENSORS_ASB100 is not set
# CONFIG_SENSORS_ATXP1 is not set
# CONFIG_SENSORS_DS620 is not set
# CONFIG_SENSORS_DS1621 is not set
# CONFIG_SENSORS_I5K_AMB is not set
# CONFIG_SENSORS_F71805F is not set
# CONFIG_SENSORS_F71882FG is not set
# CONFIG_SENSORS_F75375S is not set
# CONFIG_SENSORS_FSCHMD is not set
# CONFIG_SENSORS_G760A is not set
# CONFIG_SENSORS_GL518SM is not set
# CONFIG_SENSORS_GL520SM is not set
# CONFIG_SENSORS_GPIO_FAN is not set
CONFIG_SENSORS_CORETEMP=y
# CONFIG_SENSORS_IT87 is not set
# CONFIG_SENSORS_JC42 is not set
# CONFIG_SENSORS_LINEAGE is not set
# CONFIG_SENSORS_LM63 is not set
# CONFIG_SENSORS_LM70 is not set
# CONFIG_SENSORS_LM73 is not set
# CONFIG_SENSORS_LM75 is not set
# CONFIG_SENSORS_LM77 is not set
# CONFIG_SENSORS_LM78 is not set
# CONFIG_SENSORS_LM80 is not set
# CONFIG_SENSORS_LM83 is not set
# CONFIG_SENSORS_LM85 is not set
# CONFIG_SENSORS_LM87 is not set
# CONFIG_SENSORS_LM90 is not set
# CONFIG_SENSORS_LM92 is not set
# CONFIG_SENSORS_LM93 is not set
# CONFIG_SENSORS_LTC4151 is not set
# CONFIG_SENSORS_LTC4215 is not set
# CONFIG_SENSORS_LTC4245 is not set
# CONFIG_SENSORS_LTC4261 is not set
# CONFIG_SENSORS_LM95241 is not set
# CONFIG_SENSORS_LM95245 is not set
# CONFIG_SENSORS_MAX1111 is not set
# CONFIG_SENSORS_MAX16065 is not set
# CONFIG_SENSORS_MAX1619 is not set
# CONFIG_SENSORS_MAX1668 is not set
# CONFIG_SENSORS_MAX6639 is not set
# CONFIG_SENSORS_MAX6642 is not set
# CONFIG_SENSORS_MAX6650 is not set
CONFIG_SENSORS_MCP3021=y
# CONFIG_SENSORS_NTC_THERMISTOR is not set
# CONFIG_SENSORS_PC87360 is not set
# CONFIG_SENSORS_PC87427 is not set
# CONFIG_SENSORS_PCF8591 is not set
# CONFIG_PMBUS is not set
# CONFIG_SENSORS_SHT15 is not set
# CONFIG_SENSORS_SHT21 is not set
# CONFIG_SENSORS_SIS5595 is not set
# CONFIG_SENSORS_SMM665 is not set
# CONFIG_SENSORS_DME1737 is not set
# CONFIG_SENSORS_EMC1403 is not set
# CONFIG_SENSORS_EMC2103 is not set
# CONFIG_SENSORS_EMC6W201 is not set
# CONFIG_SENSORS_SMSC47M1 is not set
# CONFIG_SENSORS_SMSC47M192 is not set
# CONFIG_SENSORS_SMSC47B397 is not set
# CONFIG_SENSORS_SCH56XX_COMMON is not set
# CONFIG_SENSORS_SCH5627 is not set
# CONFIG_SENSORS_SCH5636 is not set
# CONFIG_SENSORS_ADS1015 is not set
# CONFIG_SENSORS_ADS7828 is not set
# CONFIG_SENSORS_ADS7871 is not set
# CONFIG_SENSORS_AMC6821 is not set
CONFIG_SENSORS_INA2XX=y
# CONFIG_SENSORS_THMC50 is not set
# CONFIG_SENSORS_TMP102 is not set
# CONFIG_SENSORS_TMP401 is not set
# CONFIG_SENSORS_TMP421 is not set
# CONFIG_SENSORS_VIA_CPUTEMP is not set
# CONFIG_SENSORS_VIA686A is not set
# CONFIG_SENSORS_VT1211 is not set
# CONFIG_SENSORS_VT8231 is not set
# CONFIG_SENSORS_W83781D is not set
# CONFIG_SENSORS_W83791D is not set
# CONFIG_SENSORS_W83792D is not set
# CONFIG_SENSORS_W83793 is not set
# CONFIG_SENSORS_W83795 is not set
# CONFIG_SENSORS_W83L785TS is not set
# CONFIG_SENSORS_W83L786NG is not set
# CONFIG_SENSORS_W83627HF is not set
# CONFIG_SENSORS_W83627EHF is not set
# CONFIG_SENSORS_APPLESMC is not set
CONFIG_SENSORS_MC13783_ADC=y

#
# ACPI drivers
#
CONFIG_SENSORS_ACPI_POWER=y
# CONFIG_SENSORS_ATK0110 is not set
CONFIG_THERMAL=y
CONFIG_THERMAL_HWMON=y
CONFIG_WATCHDOG=y
CONFIG_WATCHDOG_CORE=y
# CONFIG_WATCHDOG_NOWAYOUT is not set

#
# Watchdog Device Drivers
#
# CONFIG_SOFT_WATCHDOG is not set
# CONFIG_ACQUIRE_WDT is not set
# CONFIG_ADVANTECH_WDT is not set
# CONFIG_ALIM1535_WDT is not set
# CONFIG_ALIM7101_WDT is not set
# CONFIG_F71808E_WDT is not set
# CONFIG_SP5100_TCO is not set
# CONFIG_SC520_WDT is not set
# CONFIG_SBC_FITPC2_WATCHDOG is not set
# CONFIG_EUROTECH_WDT is not set
# CONFIG_IB700_WDT is not set
# CONFIG_IBMASR is not set
# CONFIG_WAFER_WDT is not set
# CONFIG_I6300ESB_WDT is not set
CONFIG_IE6XX_WDT=y
# CONFIG_ITCO_WDT is not set
# CONFIG_IT8712F_WDT is not set
# CONFIG_IT87_WDT is not set
# CONFIG_HP_WATCHDOG is not set
# CONFIG_SC1200_WDT is not set
# CONFIG_PC87413_WDT is not set
# CONFIG_NV_TCO is not set
# CONFIG_60XX_WDT is not set
# CONFIG_SBC8360_WDT is not set
# CONFIG_CPU5_WDT is not set
# CONFIG_SMSC_SCH311X_WDT is not set
# CONFIG_SMSC37B787_WDT is not set
# CONFIG_VIA_WDT is not set
# CONFIG_W83627HF_WDT is not set
# CONFIG_W83697HF_WDT is not set
# CONFIG_W83697UG_WDT is not set
# CONFIG_W83877F_WDT is not set
# CONFIG_W83977F_WDT is not set
# CONFIG_MACHZ_WDT is not set
# CONFIG_SBC_EPX_C3_WATCHDOG is not set
CONFIG_XEN_WDT=y

#
# PCI-based Watchdog Cards
#
# CONFIG_PCIPCWATCHDOG is not set
# CONFIG_WDTPCI is not set

#
# USB-based Watchdog Cards
#
# CONFIG_USBPCWATCHDOG is not set
CONFIG_SSB_POSSIBLE=y

#
# Sonics Silicon Backplane
#
CONFIG_SSB=y
CONFIG_SSB_SPROM=y
CONFIG_SSB_BLOCKIO=y
CONFIG_SSB_PCIHOST_POSSIBLE=y
CONFIG_SSB_PCIHOST=y
CONFIG_SSB_B43_PCI_BRIDGE=y
CONFIG_SSB_PCMCIAHOST_POSSIBLE=y
CONFIG_SSB_PCMCIAHOST=y
CONFIG_SSB_SDIOHOST_POSSIBLE=y
CONFIG_SSB_SDIOHOST=y
# CONFIG_SSB_SILENT is not set
CONFIG_SSB_DEBUG=y
CONFIG_SSB_DRIVER_PCICORE_POSSIBLE=y
CONFIG_SSB_DRIVER_PCICORE=y
CONFIG_BCMA_POSSIBLE=y

#
# Broadcom specific AMBA
#
# CONFIG_BCMA is not set

#
# Multifunction device drivers
#
CONFIG_MFD_CORE=y
CONFIG_MFD_88PM860X=y
CONFIG_MFD_SM501=y
# CONFIG_MFD_SM501_GPIO is not set
CONFIG_HTC_PASIC3=y
# CONFIG_HTC_I2CPLD is not set
CONFIG_MFD_LM3533=y
CONFIG_TPS6105X=y
# CONFIG_TPS65010 is not set
CONFIG_TPS6507X=y
CONFIG_MFD_TPS65217=y
# CONFIG_MFD_TPS6586X is not set
# CONFIG_MFD_TPS65910 is not set
# CONFIG_MFD_TPS65912_I2C is not set
# CONFIG_MFD_TPS65912_SPI is not set
# CONFIG_TWL4030_CORE is not set
CONFIG_TWL6040_CORE=y
# CONFIG_MFD_STMPE is not set
# CONFIG_MFD_TC3589X is not set
# CONFIG_MFD_TMIO is not set
# CONFIG_PMIC_DA903X is not set
# CONFIG_MFD_DA9052_SPI is not set
# CONFIG_MFD_DA9052_I2C is not set
# CONFIG_PMIC_ADP5520 is not set
CONFIG_MFD_MAX77686=y
CONFIG_MFD_MAX77693=y
# CONFIG_MFD_MAX8925 is not set
# CONFIG_MFD_MAX8997 is not set
# CONFIG_MFD_MAX8998 is not set
CONFIG_MFD_S5M_CORE=y
# CONFIG_MFD_WM8400 is not set
# CONFIG_MFD_WM831X_I2C is not set
# CONFIG_MFD_WM831X_SPI is not set
# CONFIG_MFD_WM8350_I2C is not set
# CONFIG_MFD_WM8994 is not set
# CONFIG_MFD_PCF50633 is not set
CONFIG_MFD_MC13783=y
CONFIG_MFD_MC13XXX=y
CONFIG_MFD_MC13XXX_SPI=y
CONFIG_MFD_MC13XXX_I2C=y
# CONFIG_ABX500_CORE is not set
# CONFIG_EZX_PCAP is not set
# CONFIG_MFD_CS5535 is not set
# CONFIG_MFD_TIMBERDALE is not set
CONFIG_LPC_SCH=y
CONFIG_LPC_ICH=y
# CONFIG_MFD_RDC321X is not set
# CONFIG_MFD_JANZ_CMODIO is not set
# CONFIG_MFD_VX855 is not set
# CONFIG_MFD_WL1273_CORE is not set
CONFIG_MFD_TPS65090=y
# CONFIG_MFD_AAT2870_CORE is not set
CONFIG_MFD_RC5T583=y
CONFIG_MFD_PALMAS=y
CONFIG_REGULATOR=y
# CONFIG_REGULATOR_DEBUG is not set
# CONFIG_REGULATOR_DUMMY is not set
CONFIG_REGULATOR_FIXED_VOLTAGE=y
# CONFIG_REGULATOR_VIRTUAL_CONSUMER is not set
# CONFIG_REGULATOR_USERSPACE_CONSUMER is not set
# CONFIG_REGULATOR_GPIO is not set
# CONFIG_REGULATOR_AD5398 is not set
CONFIG_REGULATOR_MC13XXX_CORE=y
CONFIG_REGULATOR_MC13783=y
CONFIG_REGULATOR_MC13892=y
# CONFIG_REGULATOR_ISL6271A is not set
# CONFIG_REGULATOR_88PM8607 is not set
# CONFIG_REGULATOR_MAX1586 is not set
# CONFIG_REGULATOR_MAX8649 is not set
# CONFIG_REGULATOR_MAX8660 is not set
# CONFIG_REGULATOR_MAX8952 is not set
CONFIG_REGULATOR_MAX77686=y
# CONFIG_REGULATOR_LP3971 is not set
# CONFIG_REGULATOR_LP3972 is not set
CONFIG_REGULATOR_LP872X=y
CONFIG_REGULATOR_RC5T583=y
CONFIG_REGULATOR_S5M8767=y
CONFIG_REGULATOR_PALMAS=y
CONFIG_REGULATOR_TPS6105X=y
CONFIG_REGULATOR_TPS62360=y
# CONFIG_REGULATOR_TPS65023 is not set
# CONFIG_REGULATOR_TPS6507X is not set
CONFIG_REGULATOR_TPS65090=y
CONFIG_REGULATOR_TPS65217=y
# CONFIG_REGULATOR_TPS6524X is not set
CONFIG_MEDIA_SUPPORT=y

#
# Multimedia core support
#
CONFIG_MEDIA_CONTROLLER=y
CONFIG_VIDEO_DEV=y
CONFIG_VIDEO_V4L2_COMMON=y
CONFIG_VIDEO_V4L2_SUBDEV_API=y
CONFIG_DVB_CORE=y
# CONFIG_DVB_NET is not set
CONFIG_VIDEO_MEDIA=y

#
# Multimedia drivers
#
CONFIG_RC_CORE=y
CONFIG_LIRC=y
CONFIG_RC_MAP=y
CONFIG_IR_NEC_DECODER=y
CONFIG_IR_RC5_DECODER=y
CONFIG_IR_RC6_DECODER=y
CONFIG_IR_JVC_DECODER=y
CONFIG_IR_SONY_DECODER=y
CONFIG_IR_RC5_SZ_DECODER=y
CONFIG_IR_SANYO_DECODER=y
CONFIG_IR_MCE_KBD_DECODER=y
CONFIG_IR_LIRC_CODEC=y
# CONFIG_RC_ATI_REMOTE is not set
# CONFIG_IR_ENE is not set
# CONFIG_IR_IMON is not set
# CONFIG_IR_MCEUSB is not set
# CONFIG_IR_ITE_CIR is not set
# CONFIG_IR_FINTEK is not set
# CONFIG_IR_NUVOTON is not set
# CONFIG_IR_REDRAT3 is not set
# CONFIG_IR_STREAMZAP is not set
# CONFIG_IR_WINBOND_CIR is not set
# CONFIG_RC_LOOPBACK is not set
# CONFIG_IR_GPIO_CIR is not set
CONFIG_MEDIA_TUNER=y
CONFIG_MEDIA_TUNER_CUSTOMISE=y

#
# Customize TV tuners
#
CONFIG_MEDIA_TUNER_SIMPLE=y
CONFIG_MEDIA_TUNER_TDA8290=y
CONFIG_MEDIA_TUNER_TDA827X=y
CONFIG_MEDIA_TUNER_TDA18271=y
CONFIG_MEDIA_TUNER_TDA9887=y
CONFIG_MEDIA_TUNER_TEA5761=y
CONFIG_MEDIA_TUNER_TEA5767=y
CONFIG_MEDIA_TUNER_MT20XX=y
CONFIG_MEDIA_TUNER_MT2060=y
CONFIG_MEDIA_TUNER_MT2063=y
CONFIG_MEDIA_TUNER_MT2266=y
CONFIG_MEDIA_TUNER_MT2131=y
CONFIG_MEDIA_TUNER_QT1010=y
CONFIG_MEDIA_TUNER_XC2028=y
CONFIG_MEDIA_TUNER_XC5000=y
CONFIG_MEDIA_TUNER_XC4000=y
CONFIG_MEDIA_TUNER_MXL5005S=y
CONFIG_MEDIA_TUNER_MXL5007T=y
CONFIG_MEDIA_TUNER_MC44S803=y
CONFIG_MEDIA_TUNER_MAX2165=y
CONFIG_MEDIA_TUNER_TDA18218=y
CONFIG_MEDIA_TUNER_FC0011=y
CONFIG_MEDIA_TUNER_FC0012=y
CONFIG_MEDIA_TUNER_FC0013=y
CONFIG_MEDIA_TUNER_TDA18212=y
CONFIG_MEDIA_TUNER_TUA9001=y
CONFIG_VIDEO_V4L2=y
CONFIG_VIDEOBUF2_CORE=y
CONFIG_VIDEOBUF2_MEMOPS=y
CONFIG_VIDEOBUF2_DMA_CONTIG=y
CONFIG_VIDEOBUF2_VMALLOC=y
CONFIG_VIDEO_CAPTURE_DRIVERS=y
CONFIG_VIDEO_ADV_DEBUG=y
CONFIG_VIDEO_FIXED_MINOR_RANGES=y
CONFIG_VIDEO_HELPER_CHIPS_AUTO=y
CONFIG_VIDEO_IR_I2C=y

#
# Audio decoders, processors and mixers
#

#
# RDS decoders
#

#
# Video decoders
#

#
# Video and audio decoders
#

#
# MPEG video encoders
#

#
# Video encoders
#

#
# Camera sensor devices
#

#
# Flash devices
#

#
# Video improvement chips
#

#
# Miscelaneous helper chips
#
CONFIG_VIDEO_VIVI=y
CONFIG_V4L_USB_DRIVERS=y
# CONFIG_VIDEO_AU0828 is not set
# CONFIG_USB_VIDEO_CLASS is not set
CONFIG_USB_VIDEO_CLASS_INPUT_EVDEV=y
CONFIG_USB_GSPCA=y
# CONFIG_USB_M5602 is not set
# CONFIG_USB_STV06XX is not set
# CONFIG_USB_GL860 is not set
# CONFIG_USB_GSPCA_BENQ is not set
# CONFIG_USB_GSPCA_CONEX is not set
# CONFIG_USB_GSPCA_CPIA1 is not set
# CONFIG_USB_GSPCA_ETOMS is not set
# CONFIG_USB_GSPCA_FINEPIX is not set
# CONFIG_USB_GSPCA_JEILINJ is not set
CONFIG_USB_GSPCA_JL2005BCD=y
# CONFIG_USB_GSPCA_KINECT is not set
# CONFIG_USB_GSPCA_KONICA is not set
# CONFIG_USB_GSPCA_MARS is not set
# CONFIG_USB_GSPCA_MR97310A is not set
# CONFIG_USB_GSPCA_NW80X is not set
# CONFIG_USB_GSPCA_OV519 is not set
# CONFIG_USB_GSPCA_OV534 is not set
# CONFIG_USB_GSPCA_OV534_9 is not set
# CONFIG_USB_GSPCA_PAC207 is not set
# CONFIG_USB_GSPCA_PAC7302 is not set
# CONFIG_USB_GSPCA_PAC7311 is not set
# CONFIG_USB_GSPCA_SE401 is not set
# CONFIG_USB_GSPCA_SN9C2028 is not set
# CONFIG_USB_GSPCA_SN9C20X is not set
# CONFIG_USB_GSPCA_SONIXB is not set
# CONFIG_USB_GSPCA_SONIXJ is not set
# CONFIG_USB_GSPCA_SPCA500 is not set
# CONFIG_USB_GSPCA_SPCA501 is not set
# CONFIG_USB_GSPCA_SPCA505 is not set
# CONFIG_USB_GSPCA_SPCA506 is not set
# CONFIG_USB_GSPCA_SPCA508 is not set
# CONFIG_USB_GSPCA_SPCA561 is not set
# CONFIG_USB_GSPCA_SPCA1528 is not set
# CONFIG_USB_GSPCA_SQ905 is not set
# CONFIG_USB_GSPCA_SQ905C is not set
# CONFIG_USB_GSPCA_SQ930X is not set
# CONFIG_USB_GSPCA_STK014 is not set
# CONFIG_USB_GSPCA_STV0680 is not set
# CONFIG_USB_GSPCA_SUNPLUS is not set
# CONFIG_USB_GSPCA_T613 is not set
# CONFIG_USB_GSPCA_TOPRO is not set
# CONFIG_USB_GSPCA_TV8532 is not set
# CONFIG_USB_GSPCA_VC032X is not set
# CONFIG_USB_GSPCA_VICAM is not set
# CONFIG_USB_GSPCA_XIRLINK_CIT is not set
# CONFIG_USB_GSPCA_ZC3XX is not set
# CONFIG_VIDEO_PVRUSB2 is not set
# CONFIG_VIDEO_HDPVR is not set
# CONFIG_VIDEO_EM28XX is not set
# CONFIG_VIDEO_CX231XX is not set
# CONFIG_VIDEO_TM6000 is not set
# CONFIG_VIDEO_USBVISION is not set
# CONFIG_USB_SN9C102 is not set
# CONFIG_USB_PWC is not set
# CONFIG_VIDEO_CPIA2 is not set
# CONFIG_USB_ZR364XX is not set
# CONFIG_USB_STKWEBCAM is not set
# CONFIG_USB_S2255 is not set
CONFIG_V4L_PCI_DRIVERS=y
# CONFIG_VIDEO_BT848 is not set
# CONFIG_VIDEO_CX18 is not set
# CONFIG_VIDEO_CX25821 is not set
# CONFIG_VIDEO_CX88 is not set
# CONFIG_VIDEO_HEXIUM_GEMINI is not set
# CONFIG_VIDEO_HEXIUM_ORION is not set
# CONFIG_VIDEO_IVTV is not set
# CONFIG_VIDEO_MEYE is not set
# CONFIG_VIDEO_MXB is not set
# CONFIG_VIDEO_SAA7134 is not set
# CONFIG_VIDEO_SAA7164 is not set
# CONFIG_VIDEO_ZORAN is not set
CONFIG_V4L_ISA_PARPORT_DRIVERS=y
# CONFIG_VIDEO_BWQCAM is not set
# CONFIG_VIDEO_CQCAM is not set
# CONFIG_VIDEO_W9966 is not set
CONFIG_V4L_PLATFORM_DRIVERS=y
# CONFIG_VIDEO_CAFE_CCIC is not set
# CONFIG_VIDEO_VIA_CAMERA is not set
# CONFIG_VIDEO_TIMBERDALE is not set
# CONFIG_SOC_CAMERA is not set
CONFIG_V4L_MEM2MEM_DRIVERS=y
# CONFIG_VIDEO_MEM2MEM_TESTDEV is not set
CONFIG_RADIO_ADAPTERS=y
# CONFIG_RADIO_SI470X is not set
# CONFIG_USB_MR800 is not set
# CONFIG_USB_DSBR is not set
# CONFIG_I2C_SI4713 is not set
# CONFIG_RADIO_SI4713 is not set
# CONFIG_USB_KEENE is not set
# CONFIG_RADIO_TEA5764 is not set
# CONFIG_RADIO_SAA7706H is not set
# CONFIG_RADIO_TEF6862 is not set
# CONFIG_RADIO_WL1273 is not set

#
# Texas Instruments WL128x FM driver (ST based)
#
# CONFIG_RADIO_WL128X is not set
CONFIG_DVB_MAX_ADAPTERS=8
CONFIG_DVB_DYNAMIC_MINORS=y
CONFIG_DVB_CAPTURE_DRIVERS=y

#
# Supported SAA7146 based PCI Adapters
#
# CONFIG_TTPCI_EEPROM is not set
# CONFIG_DVB_AV7110 is not set
# CONFIG_DVB_BUDGET_CORE is not set

#
# Supported USB Adapters
#
# CONFIG_DVB_USB is not set
# CONFIG_DVB_TTUSB_BUDGET is not set
# CONFIG_DVB_TTUSB_DEC is not set
# CONFIG_SMS_SIANO_MDTV is not set

#
# Supported FlexCopII (B2C2) Adapters
#
# CONFIG_DVB_B2C2_FLEXCOP is not set

#
# Supported BT878 Adapters
#

#
# Supported Pluto2 Adapters
#
# CONFIG_DVB_PLUTO2 is not set

#
# Supported SDMC DM1105 Adapters
#
# CONFIG_DVB_DM1105 is not set

#
# Supported FireWire (IEEE 1394) Adapters
#
# CONFIG_DVB_FIREDTV is not set

#
# Supported Earthsoft PT1 Adapters
#
# CONFIG_DVB_PT1 is not set

#
# Supported Mantis Adapters
#
# CONFIG_MANTIS_CORE is not set

#
# Supported nGene Adapters
#
# CONFIG_DVB_NGENE is not set

#
# Supported ddbridge ('Octopus') Adapters
#
# CONFIG_DVB_DDBRIDGE is not set

#
# Supported DVB Frontends
#
CONFIG_DVB_FE_CUSTOMISE=y

#
# Customise DVB Frontends
#

#
# Multistandard (satellite) frontends
#
CONFIG_DVB_STB0899=y
CONFIG_DVB_STB6100=y
CONFIG_DVB_STV090x=y
CONFIG_DVB_STV6110x=y

#
# Multistandard (cable + terrestrial) frontends
#
CONFIG_DVB_DRXK=y
CONFIG_DVB_TDA18271C2DD=y

#
# DVB-S (satellite) frontends
#
CONFIG_DVB_CX24110=y
CONFIG_DVB_CX24123=y
CONFIG_DVB_MT312=y
CONFIG_DVB_ZL10036=y
CONFIG_DVB_ZL10039=y
CONFIG_DVB_S5H1420=y
CONFIG_DVB_STV0288=y
CONFIG_DVB_STB6000=y
CONFIG_DVB_STV0299=y
CONFIG_DVB_STV6110=y
CONFIG_DVB_STV0900=y
CONFIG_DVB_TDA8083=y
CONFIG_DVB_TDA10086=y
CONFIG_DVB_TDA8261=y
CONFIG_DVB_VES1X93=y
CONFIG_DVB_TUNER_ITD1000=y
CONFIG_DVB_TUNER_CX24113=y
CONFIG_DVB_TDA826X=y
CONFIG_DVB_TUA6100=y
CONFIG_DVB_CX24116=y
CONFIG_DVB_SI21XX=y
CONFIG_DVB_DS3000=y
CONFIG_DVB_MB86A16=y
CONFIG_DVB_TDA10071=y

#
# DVB-T (terrestrial) frontends
#
CONFIG_DVB_SP8870=y
CONFIG_DVB_SP887X=y
CONFIG_DVB_CX22700=y
CONFIG_DVB_CX22702=y
CONFIG_DVB_S5H1432=y
CONFIG_DVB_DRXD=y
CONFIG_DVB_L64781=y
CONFIG_DVB_TDA1004X=y
CONFIG_DVB_NXT6000=y
CONFIG_DVB_MT352=y
CONFIG_DVB_ZL10353=y
CONFIG_DVB_DIB3000MB=y
CONFIG_DVB_DIB3000MC=y
CONFIG_DVB_DIB7000M=y
CONFIG_DVB_DIB7000P=y
CONFIG_DVB_DIB9000=y
CONFIG_DVB_TDA10048=y
CONFIG_DVB_AF9013=y
CONFIG_DVB_EC100=y
CONFIG_DVB_HD29L2=y
CONFIG_DVB_STV0367=y
CONFIG_DVB_CXD2820R=y
CONFIG_DVB_RTL2830=y

#
# DVB-C (cable) frontends
#
CONFIG_DVB_VES1820=y
CONFIG_DVB_TDA10021=y
CONFIG_DVB_TDA10023=y
CONFIG_DVB_STV0297=y

#
# ATSC (North American/Korean Terrestrial/Cable DTV) frontends
#
CONFIG_DVB_NXT200X=y
CONFIG_DVB_OR51211=y
CONFIG_DVB_OR51132=y
CONFIG_DVB_BCM3510=y
CONFIG_DVB_LGDT330X=y
CONFIG_DVB_LGDT3305=y
CONFIG_DVB_LG2160=y
CONFIG_DVB_S5H1409=y
CONFIG_DVB_AU8522=y
CONFIG_DVB_AU8522_DTV=y
CONFIG_DVB_AU8522_V4L=y
CONFIG_DVB_S5H1411=y

#
# ISDB-T (terrestrial) frontends
#
CONFIG_DVB_S921=y
CONFIG_DVB_DIB8000=y
CONFIG_DVB_MB86A20S=y

#
# Digital terrestrial only tuners/PLL
#
CONFIG_DVB_PLL=y
CONFIG_DVB_TUNER_DIB0070=y
CONFIG_DVB_TUNER_DIB0090=y

#
# SEC control devices for DVB-S
#
CONFIG_DVB_LNBP21=y
CONFIG_DVB_LNBP22=y
CONFIG_DVB_ISL6405=y
CONFIG_DVB_ISL6421=y
CONFIG_DVB_ISL6423=y
CONFIG_DVB_A8293=y
CONFIG_DVB_LGS8GL5=y
CONFIG_DVB_LGS8GXX=y
CONFIG_DVB_ATBM8830=y
CONFIG_DVB_TDA665x=y
CONFIG_DVB_IX2505V=y
CONFIG_DVB_IT913X_FE=y
CONFIG_DVB_M88RS2000=y
CONFIG_DVB_AF9033=y

#
# Tools to develop new frontends
#
# CONFIG_DVB_DUMMY_FE is not set

#
# Graphics support
#
CONFIG_AGP=y
CONFIG_AGP_AMD64=y
CONFIG_AGP_INTEL=y
CONFIG_AGP_SIS=y
CONFIG_AGP_VIA=y
CONFIG_VGA_ARB=y
CONFIG_VGA_ARB_MAX_GPUS=16
CONFIG_VGA_SWITCHEROO=y
CONFIG_DRM=y
CONFIG_DRM_USB=y
CONFIG_DRM_KMS_HELPER=y
CONFIG_DRM_LOAD_EDID_FIRMWARE=y
CONFIG_DRM_TTM=y
CONFIG_DRM_TDFX=y
CONFIG_DRM_R128=y
CONFIG_DRM_RADEON=y
CONFIG_DRM_RADEON_KMS=y
CONFIG_DRM_NOUVEAU=y
CONFIG_DRM_NOUVEAU_BACKLIGHT=y
CONFIG_DRM_NOUVEAU_DEBUG=y

#
# I2C encoder or helper chips
#
CONFIG_DRM_I2C_CH7006=y
CONFIG_DRM_I2C_SIL164=y
CONFIG_DRM_I915=y
CONFIG_DRM_I915_KMS=y
CONFIG_DRM_MGA=y
CONFIG_DRM_SIS=y
CONFIG_DRM_VIA=y
CONFIG_DRM_SAVAGE=y
CONFIG_DRM_VMWGFX=y
CONFIG_DRM_GMA500=y
CONFIG_DRM_GMA600=y
CONFIG_DRM_GMA3600=y
CONFIG_DRM_UDL=y
CONFIG_DRM_AST=y
CONFIG_DRM_MGAG200=y
CONFIG_DRM_CIRRUS_QEMU=y
CONFIG_STUB_POULSBO=y
CONFIG_VGASTATE=y
CONFIG_VIDEO_OUTPUT_CONTROL=y
CONFIG_FB=y
CONFIG_FIRMWARE_EDID=y
CONFIG_FB_DDC=y
CONFIG_FB_BOOT_VESA_SUPPORT=y
CONFIG_FB_CFB_FILLRECT=y
CONFIG_FB_CFB_COPYAREA=y
CONFIG_FB_CFB_IMAGEBLIT=y
# CONFIG_FB_CFB_REV_PIXELS_IN_BYTE is not set
CONFIG_FB_SYS_FILLRECT=y
CONFIG_FB_SYS_COPYAREA=y
CONFIG_FB_SYS_IMAGEBLIT=y
CONFIG_FB_FOREIGN_ENDIAN=y
CONFIG_FB_BOTH_ENDIAN=y
# CONFIG_FB_BIG_ENDIAN is not set
# CONFIG_FB_LITTLE_ENDIAN is not set
CONFIG_FB_SYS_FOPS=y
# CONFIG_FB_WMT_GE_ROPS is not set
CONFIG_FB_DEFERRED_IO=y
CONFIG_FB_HECUBA=y
CONFIG_FB_SVGALIB=y
# CONFIG_FB_MACMODES is not set
CONFIG_FB_BACKLIGHT=y
CONFIG_FB_MODE_HELPERS=y
CONFIG_FB_TILEBLITTING=y

#
# Frame buffer hardware drivers
#
CONFIG_FB_CIRRUS=y
CONFIG_FB_PM2=y
CONFIG_FB_PM2_FIFO_DISCONNECT=y
CONFIG_FB_CYBER2000=y
CONFIG_FB_CYBER2000_DDC=y
CONFIG_FB_ARC=y
CONFIG_FB_ASILIANT=y
CONFIG_FB_IMSTT=y
CONFIG_FB_VGA16=y
CONFIG_FB_UVESA=y
CONFIG_FB_VESA=y
CONFIG_FB_EFI=y
CONFIG_FB_N411=y
CONFIG_FB_HGA=y
CONFIG_FB_S1D13XXX=y
CONFIG_FB_NVIDIA=y
CONFIG_FB_NVIDIA_I2C=y
CONFIG_FB_NVIDIA_DEBUG=y
CONFIG_FB_NVIDIA_BACKLIGHT=y
CONFIG_FB_RIVA=y
CONFIG_FB_RIVA_I2C=y
CONFIG_FB_RIVA_DEBUG=y
CONFIG_FB_RIVA_BACKLIGHT=y
CONFIG_FB_I740=y
CONFIG_FB_LE80578=y
CONFIG_FB_CARILLO_RANCH=y
CONFIG_FB_MATROX=y
CONFIG_FB_MATROX_MILLENIUM=y
CONFIG_FB_MATROX_MYSTIQUE=y
CONFIG_FB_MATROX_G=y
CONFIG_FB_MATROX_I2C=y
CONFIG_FB_MATROX_MAVEN=y
CONFIG_FB_RADEON=y
CONFIG_FB_RADEON_I2C=y
CONFIG_FB_RADEON_BACKLIGHT=y
CONFIG_FB_RADEON_DEBUG=y
CONFIG_FB_ATY128=y
CONFIG_FB_ATY128_BACKLIGHT=y
CONFIG_FB_ATY=y
CONFIG_FB_ATY_CT=y
CONFIG_FB_ATY_GENERIC_LCD=y
CONFIG_FB_ATY_GX=y
CONFIG_FB_ATY_BACKLIGHT=y
CONFIG_FB_S3=y
CONFIG_FB_S3_DDC=y
CONFIG_FB_SAVAGE=y
CONFIG_FB_SAVAGE_I2C=y
CONFIG_FB_SAVAGE_ACCEL=y
CONFIG_FB_SIS=y
CONFIG_FB_SIS_300=y
CONFIG_FB_SIS_315=y
CONFIG_FB_VIA=y
CONFIG_FB_VIA_DIRECT_PROCFS=y
CONFIG_FB_VIA_X_COMPATIBILITY=y
CONFIG_FB_NEOMAGIC=y
CONFIG_FB_KYRO=y
CONFIG_FB_3DFX=y
CONFIG_FB_3DFX_ACCEL=y
CONFIG_FB_3DFX_I2C=y
CONFIG_FB_VOODOO1=y
CONFIG_FB_VT8623=y
CONFIG_FB_TRIDENT=y
CONFIG_FB_ARK=y
CONFIG_FB_PM3=y
CONFIG_FB_CARMINE=y
CONFIG_FB_CARMINE_DRAM_EVAL=y
# CONFIG_CARMINE_DRAM_CUSTOM is not set
CONFIG_FB_GEODE=y
CONFIG_FB_GEODE_LX=y
CONFIG_FB_GEODE_GX=y
CONFIG_FB_GEODE_GX1=y
CONFIG_FB_TMIO=y
# CONFIG_FB_TMIO_ACCELL is not set
CONFIG_FB_SM501=y
CONFIG_FB_SMSCUFX=y
CONFIG_FB_UDL=y
CONFIG_FB_VIRTUAL=y
CONFIG_XEN_FBDEV_FRONTEND=y
CONFIG_FB_METRONOME=y
CONFIG_FB_MB862XX=y
CONFIG_FB_MB862XX_PCI_GDC=y
CONFIG_FB_MB862XX_I2C=y
CONFIG_FB_BROADSHEET=y
CONFIG_FB_AUO_K190X=y
CONFIG_FB_AUO_K1900=y
CONFIG_FB_AUO_K1901=y
CONFIG_EXYNOS_VIDEO=y
CONFIG_BACKLIGHT_LCD_SUPPORT=y
CONFIG_LCD_CLASS_DEVICE=y
CONFIG_LCD_L4F00242T03=y
CONFIG_LCD_LMS283GF05=y
CONFIG_LCD_LTV350QV=y
CONFIG_LCD_ILI9320=y
CONFIG_LCD_TDO24M=y
CONFIG_LCD_VGG2432A4=y
CONFIG_LCD_PLATFORM=y
CONFIG_LCD_S6E63M0=y
CONFIG_LCD_LD9040=y
CONFIG_LCD_AMS369FG06=y
CONFIG_BACKLIGHT_CLASS_DEVICE=y
CONFIG_BACKLIGHT_GENERIC=y
CONFIG_BACKLIGHT_LM3533=y
CONFIG_BACKLIGHT_PROGEAR=y
CONFIG_BACKLIGHT_CARILLO_RANCH=y
CONFIG_BACKLIGHT_PWM=y
CONFIG_BACKLIGHT_APPLE=y
CONFIG_BACKLIGHT_SAHARA=y
CONFIG_BACKLIGHT_ADP8860=y
CONFIG_BACKLIGHT_ADP8870=y
CONFIG_BACKLIGHT_88PM860X=y
CONFIG_BACKLIGHT_LP855X=y

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
CONFIG_VGACON_SOFT_SCROLLBACK=y
CONFIG_VGACON_SOFT_SCROLLBACK_SIZE=64
CONFIG_DUMMY_CONSOLE=y
CONFIG_FRAMEBUFFER_CONSOLE=y
CONFIG_FRAMEBUFFER_CONSOLE_DETECT_PRIMARY=y
CONFIG_FRAMEBUFFER_CONSOLE_ROTATION=y
CONFIG_FONTS=y
CONFIG_FONT_8x8=y
CONFIG_FONT_8x16=y
CONFIG_FONT_6x11=y
CONFIG_FONT_7x14=y
CONFIG_FONT_PEARL_8x8=y
CONFIG_FONT_ACORN_8x8=y
CONFIG_FONT_MINI_4x6=y
CONFIG_FONT_SUN8x16=y
CONFIG_FONT_SUN12x22=y
CONFIG_FONT_10x18=y
CONFIG_LOGO=y
CONFIG_LOGO_LINUX_MONO=y
CONFIG_LOGO_LINUX_VGA16=y
CONFIG_LOGO_LINUX_CLUT224=y
# CONFIG_SOUND is not set

#
# HID support
#
CONFIG_HID=y
CONFIG_HID_BATTERY_STRENGTH=y
CONFIG_HIDRAW=y
CONFIG_UHID=y
CONFIG_HID_GENERIC=y

#
# Special HID drivers
#
CONFIG_HID_A4TECH=y
CONFIG_HID_ACRUX=y
CONFIG_HID_ACRUX_FF=y
CONFIG_HID_APPLE=y
CONFIG_HID_AUREAL=y
CONFIG_HID_BELKIN=y
CONFIG_HID_CHERRY=y
CONFIG_HID_CHICONY=y
CONFIG_HID_CYPRESS=y
CONFIG_HID_DRAGONRISE=y
CONFIG_DRAGONRISE_FF=y
CONFIG_HID_EMS_FF=y
CONFIG_HID_ELECOM=y
CONFIG_HID_EZKEY=y
CONFIG_HID_HOLTEK=y
CONFIG_HOLTEK_FF=y
CONFIG_HID_KEYTOUCH=y
CONFIG_HID_KYE=y
CONFIG_HID_UCLOGIC=y
CONFIG_HID_WALTOP=y
CONFIG_HID_GYRATION=y
CONFIG_HID_TWINHAN=y
CONFIG_HID_KENSINGTON=y
CONFIG_HID_LCPOWER=y
CONFIG_HID_LENOVO_TPKBD=y
CONFIG_HID_LOGITECH=y
CONFIG_HID_LOGITECH_DJ=y
CONFIG_LOGITECH_FF=y
CONFIG_LOGIRUMBLEPAD2_FF=y
CONFIG_LOGIG940_FF=y
CONFIG_LOGIWHEELS_FF=y
CONFIG_HID_MAGICMOUSE=y
CONFIG_HID_MICROSOFT=y
CONFIG_HID_MONTEREY=y
CONFIG_HID_MULTITOUCH=y
CONFIG_HID_NTRIG=y
CONFIG_HID_ORTEK=y
CONFIG_HID_PANTHERLORD=y
CONFIG_PANTHERLORD_FF=y
CONFIG_HID_PETALYNX=y
CONFIG_HID_PICOLCD=y
CONFIG_HID_PICOLCD_FB=y
CONFIG_HID_PICOLCD_BACKLIGHT=y
CONFIG_HID_PICOLCD_LCD=y
CONFIG_HID_PICOLCD_LEDS=y
CONFIG_HID_PRIMAX=y
CONFIG_HID_ROCCAT=y
CONFIG_HID_SAITEK=y
CONFIG_HID_SAMSUNG=y
CONFIG_HID_SONY=y
CONFIG_HID_SPEEDLINK=y
CONFIG_HID_SUNPLUS=y
CONFIG_HID_GREENASIA=y
CONFIG_GREENASIA_FF=y
CONFIG_HID_HYPERV_MOUSE=y
CONFIG_HID_SMARTJOYPLUS=y
CONFIG_SMARTJOYPLUS_FF=y
CONFIG_HID_TIVO=y
CONFIG_HID_TOPSEED=y
CONFIG_HID_THRUSTMASTER=y
CONFIG_THRUSTMASTER_FF=y
CONFIG_HID_WACOM=y
CONFIG_HID_WIIMOTE=y
CONFIG_HID_WIIMOTE_EXT=y
CONFIG_HID_ZEROPLUS=y
CONFIG_ZEROPLUS_FF=y
CONFIG_HID_ZYDACRON=y

#
# USB HID support
#
CONFIG_USB_HID=y
CONFIG_HID_PID=y
CONFIG_USB_HIDDEV=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB_ARCH_HAS_EHCI=y
CONFIG_USB_ARCH_HAS_XHCI=y
CONFIG_USB_SUPPORT=y
CONFIG_USB_COMMON=y
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB=y
CONFIG_USB_DEBUG=y
CONFIG_USB_ANNOUNCE_NEW_DEVICES=y

#
# Miscellaneous USB options
#
CONFIG_USB_DYNAMIC_MINORS=y
CONFIG_USB_SUSPEND=y
CONFIG_USB_OTG=y
CONFIG_USB_OTG_WHITELIST=y
CONFIG_USB_OTG_BLACKLIST_HUB=y
# CONFIG_USB_DWC3 is not set
CONFIG_USB_MON=y
CONFIG_USB_WUSB=y
CONFIG_USB_WUSB_CBAF=y
CONFIG_USB_WUSB_CBAF_DEBUG=y

#
# USB Host Controller Drivers
#
CONFIG_USB_C67X00_HCD=y
CONFIG_USB_XHCI_HCD=y
CONFIG_USB_XHCI_HCD_DEBUGGING=y
CONFIG_USB_EHCI_HCD=y
CONFIG_USB_EHCI_ROOT_HUB_TT=y
CONFIG_USB_EHCI_TT_NEWSCHED=y
CONFIG_USB_OXU210HP_HCD=y
CONFIG_USB_ISP116X_HCD=y
CONFIG_USB_ISP1760_HCD=y
CONFIG_USB_ISP1362_HCD=y
CONFIG_USB_OHCI_HCD=y
# CONFIG_USB_OHCI_HCD_SSB is not set
CONFIG_USB_OHCI_HCD_PLATFORM=y
CONFIG_USB_EHCI_HCD_PLATFORM=y
# CONFIG_USB_OHCI_BIG_ENDIAN_DESC is not set
# CONFIG_USB_OHCI_BIG_ENDIAN_MMIO is not set
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
CONFIG_USB_UHCI_HCD=y
# CONFIG_USB_U132_HCD is not set
CONFIG_USB_SL811_HCD=y
CONFIG_USB_SL811_HCD_ISO=y
CONFIG_USB_SL811_CS=y
CONFIG_USB_R8A66597_HCD=y
CONFIG_USB_WHCI_HCD=y
CONFIG_USB_HWA_HCD=y
CONFIG_USB_HCD_SSB=y
# CONFIG_USB_MUSB_HDRC is not set
CONFIG_USB_CHIPIDEA=y
# CONFIG_USB_CHIPIDEA_UDC is not set
CONFIG_USB_CHIPIDEA_HOST=y
CONFIG_USB_CHIPIDEA_DEBUG=y
# CONFIG_USB_RENESAS_USBHS is not set

#
# USB Device Class drivers
#
CONFIG_USB_ACM=y
CONFIG_USB_PRINTER=y
CONFIG_USB_WDM=y
CONFIG_USB_TMC=y

#
# NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may
#

#
# also be needed; see USB_STORAGE Help for more info
#
CONFIG_USB_STORAGE=y
CONFIG_USB_STORAGE_DEBUG=y
CONFIG_USB_STORAGE_REALTEK=y
CONFIG_REALTEK_AUTOPM=y
CONFIG_USB_STORAGE_DATAFAB=y
CONFIG_USB_STORAGE_FREECOM=y
CONFIG_USB_STORAGE_ISD200=y
CONFIG_USB_STORAGE_USBAT=y
CONFIG_USB_STORAGE_SDDR09=y
CONFIG_USB_STORAGE_SDDR55=y
CONFIG_USB_STORAGE_JUMPSHOT=y
CONFIG_USB_STORAGE_ALAUDA=y
CONFIG_USB_STORAGE_ONETOUCH=y
CONFIG_USB_STORAGE_KARMA=y
CONFIG_USB_STORAGE_CYPRESS_ATACB=y
CONFIG_USB_STORAGE_ENE_UB6250=y
CONFIG_USB_UAS=y
CONFIG_USB_LIBUSUAL=y

#
# USB Imaging devices
#
CONFIG_USB_MDC800=y
CONFIG_USB_MICROTEK=y

#
# USB port drivers
#
CONFIG_USB_USS720=y
CONFIG_USB_SERIAL=y
CONFIG_USB_SERIAL_CONSOLE=y
CONFIG_USB_EZUSB=y
CONFIG_USB_SERIAL_GENERIC=y
CONFIG_USB_SERIAL_AIRCABLE=y
CONFIG_USB_SERIAL_ARK3116=y
CONFIG_USB_SERIAL_BELKIN=y
CONFIG_USB_SERIAL_CH341=y
CONFIG_USB_SERIAL_WHITEHEAT=y
CONFIG_USB_SERIAL_DIGI_ACCELEPORT=y
CONFIG_USB_SERIAL_CP210X=y
CONFIG_USB_SERIAL_CYPRESS_M8=y
CONFIG_USB_SERIAL_EMPEG=y
CONFIG_USB_SERIAL_FTDI_SIO=y
CONFIG_USB_SERIAL_FUNSOFT=y
CONFIG_USB_SERIAL_VISOR=y
CONFIG_USB_SERIAL_IPAQ=y
CONFIG_USB_SERIAL_IR=y
CONFIG_USB_SERIAL_EDGEPORT=y
CONFIG_USB_SERIAL_EDGEPORT_TI=y
CONFIG_USB_SERIAL_F81232=y
CONFIG_USB_SERIAL_GARMIN=y
CONFIG_USB_SERIAL_IPW=y
CONFIG_USB_SERIAL_IUU=y
CONFIG_USB_SERIAL_KEYSPAN_PDA=y
CONFIG_USB_SERIAL_KEYSPAN=y
CONFIG_USB_SERIAL_KEYSPAN_MPR=y
CONFIG_USB_SERIAL_KEYSPAN_USA28=y
CONFIG_USB_SERIAL_KEYSPAN_USA28X=y
CONFIG_USB_SERIAL_KEYSPAN_USA28XA=y
CONFIG_USB_SERIAL_KEYSPAN_USA28XB=y
CONFIG_USB_SERIAL_KEYSPAN_USA19=y
CONFIG_USB_SERIAL_KEYSPAN_USA18X=y
CONFIG_USB_SERIAL_KEYSPAN_USA19W=y
CONFIG_USB_SERIAL_KEYSPAN_USA19QW=y
CONFIG_USB_SERIAL_KEYSPAN_USA19QI=y
CONFIG_USB_SERIAL_KEYSPAN_USA49W=y
CONFIG_USB_SERIAL_KEYSPAN_USA49WLC=y
CONFIG_USB_SERIAL_KLSI=y
CONFIG_USB_SERIAL_KOBIL_SCT=y
CONFIG_USB_SERIAL_MCT_U232=y
CONFIG_USB_SERIAL_METRO=y
CONFIG_USB_SERIAL_MOS7720=y
CONFIG_USB_SERIAL_MOS7715_PARPORT=y
CONFIG_USB_SERIAL_MOS7840=y
CONFIG_USB_SERIAL_MOTOROLA=y
CONFIG_USB_SERIAL_NAVMAN=y
CONFIG_USB_SERIAL_PL2303=y
CONFIG_USB_SERIAL_OTI6858=y
CONFIG_USB_SERIAL_QCAUX=y
CONFIG_USB_SERIAL_QUALCOMM=y
CONFIG_USB_SERIAL_SPCP8X5=y
CONFIG_USB_SERIAL_HP4X=y
CONFIG_USB_SERIAL_SAFE=y
CONFIG_USB_SERIAL_SAFE_PADDED=y
CONFIG_USB_SERIAL_SIEMENS_MPI=y
CONFIG_USB_SERIAL_SIERRAWIRELESS=y
CONFIG_USB_SERIAL_SYMBOL=y
CONFIG_USB_SERIAL_TI=y
CONFIG_USB_SERIAL_CYBERJACK=y
CONFIG_USB_SERIAL_XIRCOM=y
CONFIG_USB_SERIAL_WWAN=y
CONFIG_USB_SERIAL_OPTION=y
CONFIG_USB_SERIAL_OMNINET=y
CONFIG_USB_SERIAL_OPTICON=y
CONFIG_USB_SERIAL_VIVOPAY_SERIAL=y
CONFIG_USB_SERIAL_ZIO=y
CONFIG_USB_SERIAL_SSU100=y
CONFIG_USB_SERIAL_QT2=y
CONFIG_USB_SERIAL_DEBUG=y

#
# USB Miscellaneous drivers
#
CONFIG_USB_EMI62=y
CONFIG_USB_EMI26=y
CONFIG_USB_ADUTUX=y
CONFIG_USB_SEVSEG=y
CONFIG_USB_RIO500=y
CONFIG_USB_LEGOTOWER=y
CONFIG_USB_LCD=y
CONFIG_USB_LED=y
CONFIG_USB_CYPRESS_CY7C63=y
CONFIG_USB_CYTHERM=y
CONFIG_USB_IDMOUSE=y
CONFIG_USB_FTDI_ELAN=y
CONFIG_USB_APPLEDISPLAY=y
CONFIG_USB_SISUSBVGA=y
CONFIG_USB_SISUSBVGA_CON=y
CONFIG_USB_LD=y
CONFIG_USB_TRANCEVIBRATOR=y
CONFIG_USB_IOWARRIOR=y
CONFIG_USB_TEST=y
CONFIG_USB_ISIGHTFW=y
CONFIG_USB_YUREX=y

#
# USB Physical Layer drivers
#
CONFIG_USB_ISP1301=y
CONFIG_USB_ATM=y
CONFIG_USB_SPEEDTOUCH=y
CONFIG_USB_CXACRU=y
CONFIG_USB_UEAGLEATM=y
CONFIG_USB_XUSBATM=y
CONFIG_USB_GADGET=y
CONFIG_USB_GADGET_DEBUG=y
CONFIG_USB_GADGET_DEBUG_FILES=y
CONFIG_USB_GADGET_DEBUG_FS=y
CONFIG_USB_GADGET_VBUS_DRAW=2
CONFIG_USB_GADGET_STORAGE_NUM_BUFFERS=2

#
# USB Peripheral Controller
#
CONFIG_USB_R8A66597=y
CONFIG_USB_MV_UDC=y
CONFIG_USB_M66592=y
CONFIG_USB_AMD5536UDC=y
CONFIG_USB_NET2272=y
CONFIG_USB_NET2272_DMA=y
CONFIG_USB_NET2280=y
CONFIG_USB_GOKU=y
CONFIG_USB_EG20T=y
CONFIG_USB_DUMMY_HCD=y
CONFIG_USB_GADGET_DUALSPEED=y
CONFIG_USB_GADGET_SUPERSPEED=y
# CONFIG_USB_ZERO is not set
CONFIG_USB_ETH=y
CONFIG_USB_ETH_RNDIS=y
CONFIG_USB_ETH_EEM=y
# CONFIG_USB_G_NCM is not set
# CONFIG_USB_GADGETFS is not set
# CONFIG_USB_FUNCTIONFS is not set
# CONFIG_USB_FILE_STORAGE is not set
# CONFIG_USB_MASS_STORAGE is not set
# CONFIG_USB_GADGET_TARGET is not set
# CONFIG_USB_G_SERIAL is not set
# CONFIG_USB_G_PRINTER is not set
# CONFIG_USB_CDC_COMPOSITE is not set
# CONFIG_USB_G_NOKIA is not set
# CONFIG_USB_G_ACM_MS is not set
# CONFIG_USB_G_MULTI is not set
# CONFIG_USB_G_HID is not set
# CONFIG_USB_G_DBGP is not set
# CONFIG_USB_G_WEBCAM is not set

#
# OTG and related infrastructure
#
CONFIG_USB_OTG_UTILS=y
CONFIG_USB_GPIO_VBUS=y
CONFIG_NOP_USB_XCEIV=y
CONFIG_UWB=y
CONFIG_UWB_HWA=y
CONFIG_UWB_WHCI=y
CONFIG_UWB_I1480U=y
CONFIG_MMC=y
CONFIG_MMC_DEBUG=y
# CONFIG_MMC_UNSAFE_RESUME is not set
CONFIG_MMC_CLKGATE=y

#
# MMC/SD/SDIO Card Drivers
#
CONFIG_MMC_BLOCK=y
CONFIG_MMC_BLOCK_MINORS=8
CONFIG_MMC_BLOCK_BOUNCE=y
CONFIG_SDIO_UART=y
CONFIG_MMC_TEST=y

#
# MMC/SD/SDIO Host Controller Drivers
#
CONFIG_MMC_SDHCI=y
CONFIG_MMC_SDHCI_PCI=y
CONFIG_MMC_RICOH_MMC=y
CONFIG_MMC_SDHCI_PLTFM=y
CONFIG_MMC_WBSD=y
CONFIG_MMC_TIFM_SD=y
CONFIG_MMC_SPI=y
CONFIG_MMC_SDRICOH_CS=y
CONFIG_MMC_CB710=y
CONFIG_MMC_VIA_SDMMC=y
CONFIG_MMC_VUB300=y
CONFIG_MMC_USHC=y
CONFIG_MEMSTICK=y
CONFIG_MEMSTICK_DEBUG=y

#
# MemoryStick drivers
#
CONFIG_MEMSTICK_UNSAFE_RESUME=y
CONFIG_MSPRO_BLOCK=y

#
# MemoryStick Host Controller Drivers
#
CONFIG_MEMSTICK_TIFM_MS=y
CONFIG_MEMSTICK_JMICRON_38X=y
CONFIG_MEMSTICK_R592=y
CONFIG_NEW_LEDS=y
CONFIG_LEDS_CLASS=y

#
# LED drivers
#
CONFIG_LEDS_88PM860X=y
CONFIG_LEDS_LM3530=y
CONFIG_LEDS_LM3533=y
CONFIG_LEDS_PCA9532=y
CONFIG_LEDS_PCA9532_GPIO=y
CONFIG_LEDS_GPIO=y
CONFIG_LEDS_LP3944=y
CONFIG_LEDS_LP5521=y
CONFIG_LEDS_LP5523=y
CONFIG_LEDS_CLEVO_MAIL=y
CONFIG_LEDS_PCA955X=y
CONFIG_LEDS_PCA9633=y
CONFIG_LEDS_DAC124S085=y
CONFIG_LEDS_REGULATOR=y
CONFIG_LEDS_BD2802=y
CONFIG_LEDS_INTEL_SS4200=y
CONFIG_LEDS_LT3593=y
CONFIG_LEDS_DELL_NETBOOKS=y
CONFIG_LEDS_MC13783=y
CONFIG_LEDS_TCA6507=y
CONFIG_LEDS_LM3556=y
CONFIG_LEDS_OT200=y
CONFIG_LEDS_TRIGGERS=y

#
# LED Triggers
#
CONFIG_LEDS_TRIGGER_TIMER=y
CONFIG_LEDS_TRIGGER_ONESHOT=y
CONFIG_LEDS_TRIGGER_HEARTBEAT=y
CONFIG_LEDS_TRIGGER_BACKLIGHT=y
CONFIG_LEDS_TRIGGER_CPU=y
CONFIG_LEDS_TRIGGER_GPIO=y
CONFIG_LEDS_TRIGGER_DEFAULT_ON=y

#
# iptables trigger is under Netfilter config (LED target)
#
CONFIG_LEDS_TRIGGER_TRANSIENT=y
CONFIG_ACCESSIBILITY=y
CONFIG_A11Y_BRAILLE_CONSOLE=y
CONFIG_INFINIBAND=y
CONFIG_INFINIBAND_USER_MAD=y
CONFIG_INFINIBAND_USER_ACCESS=y
CONFIG_INFINIBAND_USER_MEM=y
CONFIG_INFINIBAND_ADDR_TRANS=y
CONFIG_INFINIBAND_MTHCA=y
CONFIG_INFINIBAND_MTHCA_DEBUG=y
CONFIG_INFINIBAND_IPATH=y
CONFIG_INFINIBAND_QIB=y
CONFIG_INFINIBAND_AMSO1100=y
CONFIG_INFINIBAND_AMSO1100_DEBUG=y
CONFIG_INFINIBAND_CXGB3=y
CONFIG_INFINIBAND_CXGB3_DEBUG=y
CONFIG_INFINIBAND_CXGB4=y
CONFIG_MLX4_INFINIBAND=y
CONFIG_INFINIBAND_NES=y
CONFIG_INFINIBAND_NES_DEBUG=y
CONFIG_INFINIBAND_OCRDMA=y
CONFIG_INFINIBAND_IPOIB=y
CONFIG_INFINIBAND_IPOIB_CM=y
CONFIG_INFINIBAND_IPOIB_DEBUG=y
CONFIG_INFINIBAND_IPOIB_DEBUG_DATA=y
CONFIG_INFINIBAND_SRP=y
CONFIG_INFINIBAND_SRPT=y
CONFIG_INFINIBAND_ISER=y
CONFIG_EDAC=y

#
# Reporting subsystems
#
CONFIG_EDAC_LEGACY_SYSFS=y
CONFIG_EDAC_DEBUG=y
CONFIG_EDAC_DECODE_MCE=y
CONFIG_EDAC_MCE_INJ=y
CONFIG_EDAC_MM_EDAC=y
CONFIG_EDAC_AMD64=y
CONFIG_EDAC_AMD64_ERROR_INJECTION=y
CONFIG_EDAC_E752X=y
CONFIG_EDAC_I82975X=y
CONFIG_EDAC_I3000=y
CONFIG_EDAC_I3200=y
CONFIG_EDAC_X38=y
CONFIG_EDAC_I5400=y
CONFIG_EDAC_I7CORE=y
CONFIG_EDAC_I5000=y
CONFIG_EDAC_I5100=y
CONFIG_EDAC_I7300=y
CONFIG_EDAC_SBRIDGE=y
CONFIG_RTC_LIB=y
CONFIG_RTC_CLASS=y
CONFIG_RTC_HCTOSYS=y
CONFIG_RTC_HCTOSYS_DEVICE="rtc0"
CONFIG_RTC_DEBUG=y

#
# RTC interfaces
#
CONFIG_RTC_INTF_SYSFS=y
CONFIG_RTC_INTF_PROC=y
CONFIG_RTC_INTF_DEV=y
CONFIG_RTC_INTF_DEV_UIE_EMUL=y
CONFIG_RTC_DRV_TEST=y

#
# I2C RTC drivers
#
CONFIG_RTC_DRV_88PM860X=y
CONFIG_RTC_DRV_DS1307=y
CONFIG_RTC_DRV_DS1374=y
CONFIG_RTC_DRV_DS1672=y
CONFIG_RTC_DRV_DS3232=y
CONFIG_RTC_DRV_MAX6900=y
CONFIG_RTC_DRV_RS5C372=y
CONFIG_RTC_DRV_ISL1208=y
CONFIG_RTC_DRV_ISL12022=y
CONFIG_RTC_DRV_X1205=y
CONFIG_RTC_DRV_PCF8563=y
CONFIG_RTC_DRV_PCF8583=y
CONFIG_RTC_DRV_M41T80=y
CONFIG_RTC_DRV_M41T80_WDT=y
CONFIG_RTC_DRV_BQ32K=y
CONFIG_RTC_DRV_S35390A=y
CONFIG_RTC_DRV_FM3130=y
CONFIG_RTC_DRV_RX8581=y
CONFIG_RTC_DRV_RX8025=y
CONFIG_RTC_DRV_EM3027=y
CONFIG_RTC_DRV_RV3029C2=y

#
# SPI RTC drivers
#
CONFIG_RTC_DRV_M41T93=y
CONFIG_RTC_DRV_M41T94=y
CONFIG_RTC_DRV_DS1305=y
CONFIG_RTC_DRV_DS1390=y
CONFIG_RTC_DRV_MAX6902=y
CONFIG_RTC_DRV_R9701=y
CONFIG_RTC_DRV_RS5C348=y
CONFIG_RTC_DRV_DS3234=y
CONFIG_RTC_DRV_PCF2123=y

#
# Platform RTC drivers
#
CONFIG_RTC_DRV_CMOS=y
CONFIG_RTC_DRV_DS1286=y
CONFIG_RTC_DRV_DS1511=y
CONFIG_RTC_DRV_DS1553=y
CONFIG_RTC_DRV_DS1742=y
CONFIG_RTC_DRV_STK17TA8=y
CONFIG_RTC_DRV_M48T86=y
CONFIG_RTC_DRV_M48T35=y
CONFIG_RTC_DRV_M48T59=y
CONFIG_RTC_DRV_MSM6242=y
CONFIG_RTC_DRV_BQ4802=y
CONFIG_RTC_DRV_RP5C01=y
CONFIG_RTC_DRV_V3020=y

#
# on-CPU RTC drivers
#
CONFIG_RTC_DRV_MC13XXX=y
CONFIG_DMADEVICES=y
CONFIG_DMADEVICES_DEBUG=y
CONFIG_DMADEVICES_VDEBUG=y

#
# DMA Devices
#
CONFIG_INTEL_MID_DMAC=y
CONFIG_INTEL_IOATDMA=y
CONFIG_TIMB_DMA=y
CONFIG_PCH_DMA=y
CONFIG_DMA_ENGINE=y

#
# DMA Clients
#
CONFIG_NET_DMA=y
CONFIG_ASYNC_TX_DMA=y
CONFIG_DMATEST=y
CONFIG_DCA=y
CONFIG_AUXDISPLAY=y
CONFIG_KS0108=y
CONFIG_KS0108_PORT=0x378
CONFIG_KS0108_DELAY=2
CONFIG_CFAG12864B=y
CONFIG_CFAG12864B_RATE=20
CONFIG_UIO=y
CONFIG_UIO_CIF=y
CONFIG_UIO_PDRV=y
CONFIG_UIO_PDRV_GENIRQ=y
CONFIG_UIO_AEC=y
CONFIG_UIO_SERCOS3=y
CONFIG_UIO_PCI_GENERIC=y
CONFIG_UIO_NETX=y
CONFIG_VFIO_IOMMU_TYPE1=y
CONFIG_VFIO=y
CONFIG_VFIO_PCI=y
CONFIG_VIRTIO=y
CONFIG_VIRTIO_RING=y

#
# Virtio drivers
#
CONFIG_VIRTIO_PCI=y
CONFIG_VIRTIO_BALLOON=y
CONFIG_VIRTIO_MMIO=y
CONFIG_VIRTIO_MMIO_CMDLINE_DEVICES=y

#
# Microsoft Hyper-V guest support
#
CONFIG_HYPERV=y
CONFIG_HYPERV_UTILS=y

#
# Xen driver support
#
CONFIG_XEN_BALLOON=y
CONFIG_XEN_SELFBALLOONING=y
CONFIG_XEN_BALLOON_MEMORY_HOTPLUG=y
CONFIG_XEN_SCRUB_PAGES=y
CONFIG_XEN_DEV_EVTCHN=y
CONFIG_XEN_BACKEND=y
CONFIG_XENFS=y
CONFIG_XEN_COMPAT_XENFS=y
CONFIG_XEN_SYS_HYPERVISOR=y
CONFIG_XEN_XENBUS_FRONTEND=y
CONFIG_XEN_GNTDEV=y
CONFIG_XEN_GRANT_DEV_ALLOC=y
CONFIG_SWIOTLB_XEN=y
CONFIG_XEN_TMEM=y
CONFIG_XEN_PCIDEV_BACKEND=y
CONFIG_XEN_PRIVCMD=y
CONFIG_XEN_ACPI_PROCESSOR=y
CONFIG_XEN_MCE_LOG=y
CONFIG_STAGING=y
CONFIG_ET131X=y
CONFIG_SLICOSS=y
CONFIG_USBIP_CORE=y
# CONFIG_USBIP_VHCI_HCD is not set
CONFIG_USBIP_HOST=y
CONFIG_USBIP_DEBUG=y
CONFIG_W35UND=y
CONFIG_PRISM2_USB=y
CONFIG_ECHO=y
CONFIG_ASUS_OLED=y
CONFIG_PANEL=y
CONFIG_PANEL_PARPORT=0
CONFIG_PANEL_PROFILE=5
CONFIG_PANEL_CHANGE_MESSAGE=y
CONFIG_PANEL_BOOT_MESSAGE=""
CONFIG_R8712U=y
CONFIG_RTS_PSTOR=y
CONFIG_RTS_PSTOR_DEBUG=y
CONFIG_RTS5139=y
CONFIG_RTS5139_DEBUG=y
CONFIG_TRANZPORT=y
CONFIG_IDE_PHISON=y
# CONFIG_USB_SERIAL_QUATECH2 is not set
CONFIG_DX_SEP=y

#
# IIO staging drivers
#
CONFIG_IIO_ST_HWMON=y
CONFIG_IIO_SW_RING=y

#
# Accelerometers
#
CONFIG_ADIS16201=y
CONFIG_ADIS16203=y
CONFIG_ADIS16204=y
CONFIG_ADIS16209=y
CONFIG_ADIS16220=y
CONFIG_ADIS16240=y
CONFIG_KXSD9=y
CONFIG_LIS3L02DQ=y
CONFIG_LIS3L02DQ_BUF_KFIFO=y
# CONFIG_LIS3L02DQ_BUF_RING_SW is not set
CONFIG_SCA3000=y

#
# Analog to digital converters
#
CONFIG_AD7291=y
CONFIG_AD7298=y
CONFIG_AD7606=y
CONFIG_AD7606_IFACE_PARALLEL=y
CONFIG_AD7606_IFACE_SPI=y
CONFIG_AD799X=y
CONFIG_AD799X_RING_BUFFER=y
CONFIG_AD7476=y
CONFIG_AD7887=y
CONFIG_AD7780=y
CONFIG_AD7793=y
CONFIG_AD7816=y
CONFIG_AD7192=y
CONFIG_ADT7310=y
CONFIG_ADT7410=y
CONFIG_AD7280=y
CONFIG_MAX1363=y
CONFIG_MAX1363_RING_BUFFER=y

#
# Analog digital bi-direction converters
#
CONFIG_ADT7316=y
CONFIG_ADT7316_SPI=y
CONFIG_ADT7316_I2C=y

#
# Capacitance to digital converters
#
CONFIG_AD7150=y
CONFIG_AD7152=y
CONFIG_AD7746=y

#
# Direct Digital Synthesis
#
CONFIG_AD5930=y
CONFIG_AD9832=y
CONFIG_AD9834=y
CONFIG_AD9850=y
CONFIG_AD9852=y
CONFIG_AD9910=y
CONFIG_AD9951=y

#
# Digital gyroscope sensors
#
CONFIG_ADIS16060=y
CONFIG_ADIS16080=y
CONFIG_ADIS16130=y
CONFIG_ADIS16260=y
CONFIG_ADXRS450=y

#
# Network Analyzer, Impedance Converters
#
CONFIG_AD5933=y

#
# Inertial measurement units
#
CONFIG_ADIS16400=y

#
# Light sensors
#
CONFIG_SENSORS_ISL29018=y
CONFIG_SENSORS_ISL29028=y
CONFIG_SENSORS_TSL2563=y
CONFIG_TSL2583=y
CONFIG_TSL2x7x=y

#
# Magnetometer sensors
#
CONFIG_SENSORS_AK8975=y
CONFIG_SENSORS_HMC5843=y

#
# Active energy metering IC
#
CONFIG_ADE7753=y
CONFIG_ADE7754=y
CONFIG_ADE7758=y
CONFIG_ADE7759=y
CONFIG_ADE7854=y
CONFIG_ADE7854_I2C=y
CONFIG_ADE7854_SPI=y

#
# Resolver to digital converters
#
CONFIG_AD2S90=y
CONFIG_AD2S1200=y
CONFIG_AD2S1210=y

#
# Triggers - standalone
#
CONFIG_IIO_PERIODIC_RTC_TRIGGER=y
CONFIG_IIO_GPIO_TRIGGER=y
CONFIG_IIO_SYSFS_TRIGGER=y
CONFIG_IIO_DUMMY_EVGEN=y
CONFIG_IIO_SIMPLE_DUMMY=y
CONFIG_IIO_SIMPLE_DUMMY_EVENTS=y
CONFIG_IIO_SIMPLE_DUMMY_BUFFER=y
CONFIG_ZRAM=y
CONFIG_ZRAM_DEBUG=y
CONFIG_ZCACHE=y
CONFIG_ZSMALLOC=y
CONFIG_WLAGS49_H2=y
CONFIG_WLAGS49_H25=y
CONFIG_FB_SM7XX=y
CONFIG_CRYSTALHD=y
# CONFIG_CXT1E1 is not set
CONFIG_FB_XGI=y
CONFIG_ACPI_QUICKSTART=y
# CONFIG_SBE_2T3E3 is not set
CONFIG_BCM_WIMAX=y
CONFIG_FT1000=y
CONFIG_FT1000_USB=y
CONFIG_FT1000_PCMCIA=y

#
# Speakup console speech
#
CONFIG_SPEAKUP=y
CONFIG_SPEAKUP_SYNTH_ACNTSA=y
CONFIG_SPEAKUP_SYNTH_ACNTPC=y
CONFIG_SPEAKUP_SYNTH_APOLLO=y
CONFIG_SPEAKUP_SYNTH_AUDPTR=y
CONFIG_SPEAKUP_SYNTH_BNS=y
CONFIG_SPEAKUP_SYNTH_DECTLK=y
CONFIG_SPEAKUP_SYNTH_DECEXT=y
CONFIG_SPEAKUP_SYNTH_DTLK=y
CONFIG_SPEAKUP_SYNTH_KEYPC=y
CONFIG_SPEAKUP_SYNTH_LTLK=y
CONFIG_SPEAKUP_SYNTH_SOFT=y
CONFIG_SPEAKUP_SYNTH_SPKOUT=y
CONFIG_SPEAKUP_SYNTH_TXPRT=y
CONFIG_SPEAKUP_SYNTH_DUMMY=y
CONFIG_TOUCHSCREEN_CLEARPAD_TM1217=y
CONFIG_TOUCHSCREEN_SYNAPTICS_I2C_RMI4=y
CONFIG_STAGING_MEDIA=y
CONFIG_DVB_AS102=y
CONFIG_DVB_CXD2099=y
CONFIG_VIDEO_DT3155=y
CONFIG_DT3155_CCIR=y
CONFIG_DT3155_STREAMING=y
CONFIG_LIRC_STAGING=y
CONFIG_LIRC_BT829=y
CONFIG_LIRC_IGORPLUGUSB=y
CONFIG_LIRC_IMON=y
CONFIG_LIRC_PARALLEL=y
CONFIG_LIRC_SASEM=y
CONFIG_LIRC_SERIAL=y
CONFIG_LIRC_SERIAL_TRANSMITTER=y
CONFIG_LIRC_SIR=y
CONFIG_LIRC_TTUSBIR=y
CONFIG_LIRC_ZILOG=y

#
# Android
#
CONFIG_ANDROID=y
CONFIG_ANDROID_BINDER_IPC=y
CONFIG_ASHMEM=y
CONFIG_ANDROID_LOGGER=y
CONFIG_ANDROID_TIMED_OUTPUT=y
CONFIG_ANDROID_TIMED_GPIO=y
CONFIG_ANDROID_LOW_MEMORY_KILLER=y
CONFIG_ANDROID_INTF_ALARM_DEV=y
CONFIG_PHONE=y
CONFIG_PHONE_IXJ=y
CONFIG_PHONE_IXJ_PCMCIA=y
CONFIG_USB_WPAN_HCD=y
CONFIG_IPACK_BUS=y
CONFIG_BOARD_TPCI200=y
CONFIG_SERIAL_IPOCTAL=y
CONFIG_WIMAX_GDM72XX=y
CONFIG_WIMAX_GDM72XX_QOS=y
CONFIG_WIMAX_GDM72XX_K_MODE=y
CONFIG_WIMAX_GDM72XX_WIMAX2=y
CONFIG_WIMAX_GDM72XX_USB=y
# CONFIG_WIMAX_GDM72XX_SDIO is not set
CONFIG_WIMAX_GDM72XX_USB_PM=y
CONFIG_CSR_WIFI=y
CONFIG_X86_PLATFORM_DEVICES=y
CONFIG_ACER_WMI=y
CONFIG_ACERHDF=y
CONFIG_ASUS_LAPTOP=y
CONFIG_DELL_LAPTOP=y
CONFIG_DELL_WMI=y
CONFIG_DELL_WMI_AIO=y
CONFIG_FUJITSU_LAPTOP=y
CONFIG_FUJITSU_LAPTOP_DEBUG=y
CONFIG_FUJITSU_TABLET=y
CONFIG_AMILO_RFKILL=y
CONFIG_HP_ACCEL=y
CONFIG_HP_WMI=y
CONFIG_MSI_LAPTOP=y
CONFIG_PANASONIC_LAPTOP=y
CONFIG_COMPAL_LAPTOP=y
CONFIG_SONY_LAPTOP=y
CONFIG_SONYPI_COMPAT=y
CONFIG_IDEAPAD_LAPTOP=y
CONFIG_THINKPAD_ACPI=y
CONFIG_THINKPAD_ACPI_DEBUGFACILITIES=y
CONFIG_THINKPAD_ACPI_DEBUG=y
CONFIG_THINKPAD_ACPI_UNSAFE_LEDS=y
CONFIG_THINKPAD_ACPI_VIDEO=y
CONFIG_THINKPAD_ACPI_HOTKEY_POLL=y
CONFIG_SENSORS_HDAPS=y
CONFIG_INTEL_MENLOW=y
CONFIG_EEEPC_LAPTOP=y
CONFIG_ASUS_WMI=y
CONFIG_ASUS_NB_WMI=y
CONFIG_EEEPC_WMI=y
CONFIG_ACPI_WMI=y
CONFIG_MSI_WMI=y
CONFIG_TOPSTAR_LAPTOP=y
CONFIG_ACPI_TOSHIBA=y
CONFIG_TOSHIBA_BT_RFKILL=y
CONFIG_ACPI_CMPC=y
CONFIG_INTEL_IPS=y
CONFIG_IBM_RTL=y
CONFIG_XO15_EBOOK=y
CONFIG_SAMSUNG_LAPTOP=y
CONFIG_MXM_WMI=y
CONFIG_INTEL_OAKTRAIL=y
CONFIG_SAMSUNG_Q10=y
CONFIG_APPLE_GMUX=y

#
# Hardware Spinlock drivers
#
CONFIG_CLKEVT_I8253=y
CONFIG_I8253_LOCK=y
CONFIG_CLKBLD_I8253=y
CONFIG_IOMMU_API=y
CONFIG_IOMMU_SUPPORT=y
CONFIG_AMD_IOMMU=y
CONFIG_AMD_IOMMU_STATS=y
CONFIG_AMD_IOMMU_V2=y
CONFIG_DMAR_TABLE=y
CONFIG_INTEL_IOMMU=y
CONFIG_INTEL_IOMMU_DEFAULT_ON=y
CONFIG_INTEL_IOMMU_FLOPPY_WA=y
CONFIG_IRQ_REMAP=y

#
# Remoteproc drivers (EXPERIMENTAL)
#

#
# Rpmsg drivers (EXPERIMENTAL)
#
CONFIG_VIRT_DRIVERS=y
CONFIG_PM_DEVFREQ=y

#
# DEVFREQ Governors
#
CONFIG_DEVFREQ_GOV_SIMPLE_ONDEMAND=y
CONFIG_DEVFREQ_GOV_PERFORMANCE=y
CONFIG_DEVFREQ_GOV_POWERSAVE=y
CONFIG_DEVFREQ_GOV_USERSPACE=y

#
# DEVFREQ Drivers
#
CONFIG_EXTCON=y

#
# Extcon Device Drivers
#
CONFIG_EXTCON_GPIO=y
CONFIG_MEMORY=y
CONFIG_IIO=y
CONFIG_IIO_BUFFER=y
CONFIG_IIO_KFIFO_BUF=y
CONFIG_IIO_TRIGGERED_BUFFER=y
CONFIG_IIO_TRIGGER=y
CONFIG_IIO_CONSUMERS_PER_TRIGGER=2

#
# Analog to digital converters
#

#
# Amplifiers
#
CONFIG_AD8366=y

#
# Light sensors
#
CONFIG_SENSORS_LM3533=y
CONFIG_VCNL4000=y

#
# Frequency Synthesizers DDS/PLL
#

#
# Clock Generator/Distribution
#
CONFIG_AD9523=y

#
# Phase-Locked Loop (PLL) frequency synthesizers
#
CONFIG_ADF4350=y

#
# Digital to analog converters
#
CONFIG_AD5064=y
CONFIG_AD5360=y
CONFIG_AD5380=y
CONFIG_AD5421=y
CONFIG_AD5624R_SPI=y
CONFIG_AD5446=y
CONFIG_AD5504=y
CONFIG_AD5764=y
CONFIG_AD5791=y
CONFIG_AD5686=y
CONFIG_MAX517=y
CONFIG_MCP4725=y
CONFIG_VME_BUS=y

#
# VME Bridge Drivers
#
CONFIG_VME_CA91CX42=y
CONFIG_VME_TSI148=y

#
# VME Board Drivers
#
CONFIG_VMIVME_7805=y

#
# VME Device Drivers
#
CONFIG_VME_USER=y
CONFIG_VME_PIO2=y
CONFIG_PWM=y

#
# Firmware Drivers
#
CONFIG_EDD=y
# CONFIG_EDD_OFF is not set
CONFIG_FIRMWARE_MEMMAP=y
CONFIG_EFI_VARS=y
CONFIG_DELL_RBU=y
CONFIG_DCDBAS=y
CONFIG_DMIID=y
CONFIG_DMI_SYSFS=y
CONFIG_ISCSI_IBFT_FIND=y
CONFIG_ISCSI_IBFT=y
CONFIG_GOOGLE_FIRMWARE=y

#
# Google Firmware Drivers
#
CONFIG_GOOGLE_SMI=y
CONFIG_GOOGLE_MEMCONSOLE=y

#
# File systems
#
CONFIG_DCACHE_WORD_ACCESS=y
CONFIG_EXT2_FS=y
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
CONFIG_EXT2_FS_SECURITY=y
CONFIG_EXT2_FS_XIP=y
CONFIG_EXT3_FS=y
CONFIG_EXT3_DEFAULTS_TO_ORDERED=y
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
CONFIG_EXT3_FS_SECURITY=y
CONFIG_EXT4_FS=y
CONFIG_EXT4_FS_XATTR=y
CONFIG_EXT4_FS_POSIX_ACL=y
CONFIG_EXT4_FS_SECURITY=y
CONFIG_EXT4_DEBUG=y
CONFIG_FS_XIP=y
CONFIG_JBD=y
CONFIG_JBD_DEBUG=y
CONFIG_JBD2=y
CONFIG_JBD2_DEBUG=y
CONFIG_FS_MBCACHE=y
CONFIG_REISERFS_FS=y
CONFIG_REISERFS_CHECK=y
CONFIG_REISERFS_PROC_INFO=y
CONFIG_REISERFS_FS_XATTR=y
CONFIG_REISERFS_FS_POSIX_ACL=y
CONFIG_REISERFS_FS_SECURITY=y
CONFIG_JFS_FS=y
CONFIG_JFS_POSIX_ACL=y
CONFIG_JFS_SECURITY=y
CONFIG_JFS_DEBUG=y
CONFIG_JFS_STATISTICS=y
CONFIG_XFS_FS=y
CONFIG_XFS_QUOTA=y
CONFIG_XFS_POSIX_ACL=y
CONFIG_XFS_RT=y
CONFIG_XFS_DEBUG=y
CONFIG_GFS2_FS=y
CONFIG_GFS2_FS_LOCKING_DLM=y
CONFIG_OCFS2_FS=y
CONFIG_OCFS2_FS_O2CB=y
CONFIG_OCFS2_FS_USERSPACE_CLUSTER=y
CONFIG_OCFS2_FS_STATS=y
CONFIG_OCFS2_DEBUG_MASKLOG=y
CONFIG_OCFS2_DEBUG_FS=y
CONFIG_BTRFS_FS=y
CONFIG_BTRFS_FS_POSIX_ACL=y
CONFIG_BTRFS_FS_CHECK_INTEGRITY=y
CONFIG_NILFS2_FS=y
CONFIG_FS_POSIX_ACL=y
CONFIG_EXPORTFS=y
CONFIG_FILE_LOCKING=y
CONFIG_FSNOTIFY=y
CONFIG_DNOTIFY=y
CONFIG_INOTIFY_USER=y
CONFIG_FANOTIFY=y
CONFIG_FANOTIFY_ACCESS_PERMISSIONS=y
CONFIG_QUOTA=y
CONFIG_QUOTA_NETLINK_INTERFACE=y
# CONFIG_PRINT_QUOTA_WARNING is not set
CONFIG_QUOTA_DEBUG=y
CONFIG_QUOTA_TREE=y
CONFIG_QFMT_V1=y
CONFIG_QFMT_V2=y
CONFIG_QUOTACTL=y
CONFIG_QUOTACTL_COMPAT=y
CONFIG_AUTOFS4_FS=y
CONFIG_FUSE_FS=y
CONFIG_CUSE=y
CONFIG_GENERIC_ACL=y

#
# Caches
#
CONFIG_FSCACHE=y
CONFIG_FSCACHE_STATS=y
CONFIG_FSCACHE_HISTOGRAM=y
CONFIG_FSCACHE_DEBUG=y
CONFIG_FSCACHE_OBJECT_LIST=y
CONFIG_CACHEFILES=y
CONFIG_CACHEFILES_DEBUG=y
CONFIG_CACHEFILES_HISTOGRAM=y

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_UDF_FS=y
CONFIG_UDF_NLS=y

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=y
CONFIG_MSDOS_FS=y
CONFIG_VFAT_FS=y
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
CONFIG_NTFS_FS=y
CONFIG_NTFS_DEBUG=y
CONFIG_NTFS_RW=y

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_PROC_VMCORE=y
CONFIG_PROC_SYSCTL=y
CONFIG_PROC_PAGE_MONITOR=y
CONFIG_SYSFS=y
CONFIG_TMPFS=y
CONFIG_TMPFS_POSIX_ACL=y
CONFIG_TMPFS_XATTR=y
CONFIG_HUGETLBFS=y
CONFIG_HUGETLB_PAGE=y
CONFIG_CONFIGFS_FS=y
CONFIG_MISC_FILESYSTEMS=y
CONFIG_ADFS_FS=y
CONFIG_ADFS_FS_RW=y
CONFIG_AFFS_FS=y
CONFIG_ECRYPT_FS=y
CONFIG_HFS_FS=y
CONFIG_HFSPLUS_FS=y
CONFIG_BEFS_FS=y
CONFIG_BEFS_DEBUG=y
CONFIG_BFS_FS=y
CONFIG_EFS_FS=y
CONFIG_JFFS2_FS=y
CONFIG_JFFS2_FS_DEBUG=0
CONFIG_JFFS2_FS_WRITEBUFFER=y
CONFIG_JFFS2_FS_WBUF_VERIFY=y
CONFIG_JFFS2_SUMMARY=y
CONFIG_JFFS2_FS_XATTR=y
CONFIG_JFFS2_FS_POSIX_ACL=y
CONFIG_JFFS2_FS_SECURITY=y
CONFIG_JFFS2_COMPRESSION_OPTIONS=y
CONFIG_JFFS2_ZLIB=y
CONFIG_JFFS2_LZO=y
CONFIG_JFFS2_RTIME=y
CONFIG_JFFS2_RUBIN=y
# CONFIG_JFFS2_CMODE_NONE is not set
CONFIG_JFFS2_CMODE_PRIORITY=y
# CONFIG_JFFS2_CMODE_SIZE is not set
# CONFIG_JFFS2_CMODE_FAVOURLZO is not set
CONFIG_UBIFS_FS=y
CONFIG_UBIFS_FS_ADVANCED_COMPR=y
CONFIG_UBIFS_FS_LZO=y
CONFIG_UBIFS_FS_ZLIB=y
CONFIG_LOGFS=y
CONFIG_CRAMFS=y
CONFIG_SQUASHFS=y
CONFIG_SQUASHFS_XATTR=y
CONFIG_SQUASHFS_ZLIB=y
CONFIG_SQUASHFS_LZO=y
CONFIG_SQUASHFS_XZ=y
CONFIG_SQUASHFS_4K_DEVBLK_SIZE=y
CONFIG_SQUASHFS_EMBEDDED=y
CONFIG_SQUASHFS_FRAGMENT_CACHE_SIZE=3
CONFIG_VXFS_FS=y
CONFIG_MINIX_FS=y
CONFIG_OMFS_FS=y
CONFIG_HPFS_FS=y
CONFIG_QNX4FS_FS=y
CONFIG_QNX6FS_FS=y
CONFIG_QNX6FS_DEBUG=y
CONFIG_ROMFS_FS=y
CONFIG_ROMFS_BACKED_BY_BLOCK=y
# CONFIG_ROMFS_BACKED_BY_MTD is not set
# CONFIG_ROMFS_BACKED_BY_BOTH is not set
CONFIG_ROMFS_ON_BLOCK=y
CONFIG_PSTORE=y
CONFIG_PSTORE_CONSOLE=y
CONFIG_PSTORE_RAM=y
CONFIG_SYSV_FS=y
CONFIG_UFS_FS=y
CONFIG_UFS_FS_WRITE=y
CONFIG_UFS_DEBUG=y
CONFIG_EXOFS_FS=y
CONFIG_EXOFS_DEBUG=y
CONFIG_ORE=y
CONFIG_NETWORK_FILESYSTEMS=y
CONFIG_NFS_FS=y
CONFIG_NFS_V2=y
CONFIG_NFS_V3=y
CONFIG_NFS_V3_ACL=y
CONFIG_NFS_V4=y
CONFIG_NFS_V4_1=y
CONFIG_PNFS_FILE_LAYOUT=y
CONFIG_PNFS_BLOCK=y
CONFIG_PNFS_OBJLAYOUT=y
CONFIG_NFS_V4_1_IMPLEMENTATION_ID_DOMAIN="y"
CONFIG_ROOT_NFS=y
CONFIG_NFS_FSCACHE=y
CONFIG_NFS_USE_LEGACY_DNS=y
CONFIG_NFS_DEBUG=y
CONFIG_NFSD=y
CONFIG_NFSD_V2_ACL=y
CONFIG_NFSD_V3=y
CONFIG_NFSD_V3_ACL=y
CONFIG_NFSD_V4=y
CONFIG_NFSD_FAULT_INJECTION=y
CONFIG_LOCKD=y
CONFIG_LOCKD_V4=y
CONFIG_NFS_ACL_SUPPORT=y
CONFIG_NFS_COMMON=y
CONFIG_SUNRPC=y
CONFIG_SUNRPC_GSS=y
CONFIG_SUNRPC_BACKCHANNEL=y
CONFIG_SUNRPC_XPRT_RDMA=y
CONFIG_RPCSEC_GSS_KRB5=y
CONFIG_SUNRPC_DEBUG=y
CONFIG_CEPH_FS=y
CONFIG_CIFS=y
CONFIG_CIFS_STATS=y
CONFIG_CIFS_STATS2=y
CONFIG_CIFS_WEAK_PW_HASH=y
CONFIG_CIFS_UPCALL=y
CONFIG_CIFS_XATTR=y
CONFIG_CIFS_POSIX=y
CONFIG_CIFS_DEBUG2=y
CONFIG_CIFS_DFS_UPCALL=y
CONFIG_CIFS_FSCACHE=y
CONFIG_CIFS_ACL=y
CONFIG_NCP_FS=y
CONFIG_NCPFS_PACKET_SIGNING=y
CONFIG_NCPFS_IOCTL_LOCKING=y
CONFIG_NCPFS_STRONG=y
CONFIG_NCPFS_NFS_NS=y
CONFIG_NCPFS_OS2_NS=y
CONFIG_NCPFS_SMALLDOS=y
CONFIG_NCPFS_NLS=y
CONFIG_NCPFS_EXTRAS=y
CONFIG_CODA_FS=y
CONFIG_AFS_FS=y
CONFIG_AFS_DEBUG=y
CONFIG_AFS_FSCACHE=y
CONFIG_9P_FS=y
CONFIG_9P_FSCACHE=y
CONFIG_9P_FS_POSIX_ACL=y
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="utf8"
CONFIG_NLS_CODEPAGE_437=y
# CONFIG_NLS_CODEPAGE_737 is not set
# CONFIG_NLS_CODEPAGE_775 is not set
# CONFIG_NLS_CODEPAGE_850 is not set
# CONFIG_NLS_CODEPAGE_852 is not set
# CONFIG_NLS_CODEPAGE_855 is not set
# CONFIG_NLS_CODEPAGE_857 is not set
# CONFIG_NLS_CODEPAGE_860 is not set
# CONFIG_NLS_CODEPAGE_861 is not set
# CONFIG_NLS_CODEPAGE_862 is not set
# CONFIG_NLS_CODEPAGE_863 is not set
# CONFIG_NLS_CODEPAGE_864 is not set
# CONFIG_NLS_CODEPAGE_865 is not set
# CONFIG_NLS_CODEPAGE_866 is not set
# CONFIG_NLS_CODEPAGE_869 is not set
# CONFIG_NLS_CODEPAGE_936 is not set
# CONFIG_NLS_CODEPAGE_950 is not set
# CONFIG_NLS_CODEPAGE_932 is not set
# CONFIG_NLS_CODEPAGE_949 is not set
# CONFIG_NLS_CODEPAGE_874 is not set
# CONFIG_NLS_ISO8859_8 is not set
# CONFIG_NLS_CODEPAGE_1250 is not set
# CONFIG_NLS_CODEPAGE_1251 is not set
CONFIG_NLS_ASCII=y
CONFIG_NLS_ISO8859_1=y
# CONFIG_NLS_ISO8859_2 is not set
# CONFIG_NLS_ISO8859_3 is not set
# CONFIG_NLS_ISO8859_4 is not set
# CONFIG_NLS_ISO8859_5 is not set
# CONFIG_NLS_ISO8859_6 is not set
# CONFIG_NLS_ISO8859_7 is not set
# CONFIG_NLS_ISO8859_9 is not set
# CONFIG_NLS_ISO8859_13 is not set
# CONFIG_NLS_ISO8859_14 is not set
# CONFIG_NLS_ISO8859_15 is not set
# CONFIG_NLS_KOI8_R is not set
# CONFIG_NLS_KOI8_U is not set
# CONFIG_NLS_MAC_ROMAN is not set
# CONFIG_NLS_MAC_CELTIC is not set
# CONFIG_NLS_MAC_CENTEURO is not set
# CONFIG_NLS_MAC_CROATIAN is not set
# CONFIG_NLS_MAC_CYRILLIC is not set
# CONFIG_NLS_MAC_GAELIC is not set
# CONFIG_NLS_MAC_GREEK is not set
# CONFIG_NLS_MAC_ICELAND is not set
# CONFIG_NLS_MAC_INUIT is not set
# CONFIG_NLS_MAC_ROMANIAN is not set
# CONFIG_NLS_MAC_TURKISH is not set
CONFIG_NLS_UTF8=y
CONFIG_DLM=y
CONFIG_DLM_DEBUG=y
CONFIG_PROTECTED_LINKS=y
CONFIG_PROTECTED_SYMLINKS=y
CONFIG_PROTECTED_SYMLINKS_SYSCTL=1
CONFIG_PROTECTED_HARDLINKS=y
CONFIG_PROTECTED_HARDLINKS_SYSCTL=1

#
# Kernel hacking
#
CONFIG_TRACE_IRQFLAGS_SUPPORT=y
CONFIG_PRINTK_TIME=y
CONFIG_DEFAULT_MESSAGE_LOGLEVEL=4
# CONFIG_ENABLE_WARN_DEPRECATED is not set
CONFIG_ENABLE_MUST_CHECK=y
CONFIG_FRAME_WARN=2048
CONFIG_MAGIC_SYSRQ=y
# CONFIG_STRIP_ASM_SYMS is not set
CONFIG_READABLE_ASM=y
# CONFIG_UNUSED_SYMBOLS is not set
CONFIG_DEBUG_FS=y
# CONFIG_HEADERS_CHECK is not set
CONFIG_DEBUG_SECTION_MISMATCH=y
CONFIG_DEBUG_KERNEL=y
CONFIG_DEBUG_SHIRQ=y
CONFIG_LOCKUP_DETECTOR=y
CONFIG_HARDLOCKUP_DETECTOR=y
CONFIG_BOOTPARAM_HARDLOCKUP_PANIC=y
CONFIG_BOOTPARAM_HARDLOCKUP_PANIC_VALUE=1
CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC=y
CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC_VALUE=1
# CONFIG_PANIC_ON_OOPS is not set
CONFIG_PANIC_ON_OOPS_VALUE=0
CONFIG_DETECT_HUNG_TASK=y
CONFIG_DEFAULT_HUNG_TASK_TIMEOUT=120
# CONFIG_BOOTPARAM_HUNG_TASK_PANIC is not set
CONFIG_BOOTPARAM_HUNG_TASK_PANIC_VALUE=0
CONFIG_SCHED_DEBUG=y
CONFIG_SCHEDSTATS=y
CONFIG_TIMER_STATS=y
CONFIG_DEBUG_OBJECTS=y
# CONFIG_DEBUG_OBJECTS_SELFTEST is not set
CONFIG_DEBUG_OBJECTS_FREE=y
CONFIG_DEBUG_OBJECTS_TIMERS=y
CONFIG_DEBUG_OBJECTS_WORK=y
CONFIG_DEBUG_OBJECTS_RCU_HEAD=y
CONFIG_DEBUG_OBJECTS_PERCPU_COUNTER=y
CONFIG_DEBUG_OBJECTS_ENABLE_DEFAULT=1
# CONFIG_SLUB_DEBUG_ON is not set
CONFIG_SLUB_STATS=y
CONFIG_DEBUG_KMEMLEAK=y
CONFIG_DEBUG_KMEMLEAK_EARLY_LOG_SIZE=400
# CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is not set
CONFIG_DEBUG_PREEMPT=y
CONFIG_DEBUG_RT_MUTEXES=y
CONFIG_DEBUG_PI_LIST=y
CONFIG_RT_MUTEX_TESTER=y
CONFIG_DEBUG_SPINLOCK=y
CONFIG_DEBUG_MUTEXES=y
CONFIG_DEBUG_LOCK_ALLOC=y
CONFIG_PROVE_LOCKING=y
CONFIG_PROVE_RCU=y
CONFIG_PROVE_RCU_REPEATEDLY=y
CONFIG_SPARSE_RCU_POINTER=y
CONFIG_LOCKDEP=y
CONFIG_LOCK_STAT=y
CONFIG_DEBUG_LOCKDEP=y
CONFIG_TRACE_IRQFLAGS=y
CONFIG_DEBUG_ATOMIC_SLEEP=y
CONFIG_DEBUG_LOCKING_API_SELFTESTS=y
CONFIG_STACKTRACE=y
CONFIG_DEBUG_STACK_USAGE=y
CONFIG_DEBUG_KOBJECT=y
CONFIG_DEBUG_BUGVERBOSE=y
CONFIG_DEBUG_INFO=y
# CONFIG_DEBUG_INFO_REDUCED is not set
CONFIG_DEBUG_VM=y
CONFIG_DEBUG_VIRTUAL=y
CONFIG_DEBUG_WRITECOUNT=y
CONFIG_DEBUG_MEMORY_INIT=y
CONFIG_DEBUG_LIST=y
CONFIG_TEST_LIST_SORT=y
CONFIG_DEBUG_SG=y
CONFIG_DEBUG_NOTIFIERS=y
CONFIG_DEBUG_CREDENTIALS=y
CONFIG_ARCH_WANT_FRAME_POINTERS=y
CONFIG_FRAME_POINTER=y
# CONFIG_BOOT_PRINTK_DELAY is not set
CONFIG_RCU_TORTURE_TEST=y
CONFIG_RCU_TORTURE_TEST_RUNNABLE=y
CONFIG_RCU_CPU_STALL_TIMEOUT=60
CONFIG_RCU_CPU_STALL_VERBOSE=y
CONFIG_RCU_CPU_STALL_INFO=y
CONFIG_RCU_TRACE=y
CONFIG_BACKTRACE_SELF_TEST=y
CONFIG_DEBUG_BLOCK_EXT_DEVT=y
CONFIG_DEBUG_FORCE_WEAK_PER_CPU=y
CONFIG_DEBUG_PER_CPU_MAPS=y
CONFIG_LKDTM=y
CONFIG_CPU_NOTIFIER_ERROR_INJECT=y
CONFIG_FAULT_INJECTION=y
CONFIG_FAILSLAB=y
CONFIG_FAIL_PAGE_ALLOC=y
CONFIG_FAIL_MAKE_REQUEST=y
CONFIG_FAIL_IO_TIMEOUT=y
CONFIG_FAIL_MMC_REQUEST=y
CONFIG_FAULT_INJECTION_DEBUG_FS=y
CONFIG_LATENCYTOP=y
CONFIG_DEBUG_PAGEALLOC=y
CONFIG_WANT_PAGE_DEBUG_FLAGS=y
CONFIG_PAGE_GUARD=y
CONFIG_USER_STACKTRACE_SUPPORT=y
CONFIG_NOP_TRACER=y
CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_FP_TEST=y
CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
CONFIG_HAVE_C_RECORDMCOUNT=y
CONFIG_RING_BUFFER=y
CONFIG_EVENT_TRACING=y
CONFIG_EVENT_POWER_TRACING_DEPRECATED=y
CONFIG_CONTEXT_SWITCH_TRACER=y
CONFIG_RING_BUFFER_ALLOW_SWAP=y
CONFIG_TRACING=y
CONFIG_TRACING_SUPPORT=y
CONFIG_FTRACE=y
# CONFIG_FUNCTION_TRACER is not set
# CONFIG_IRQSOFF_TRACER is not set
# CONFIG_PREEMPT_TRACER is not set
# CONFIG_SCHED_TRACER is not set
# CONFIG_ENABLE_DEFAULT_TRACERS is not set
# CONFIG_FTRACE_SYSCALLS is not set
CONFIG_BRANCH_PROFILE_NONE=y
# CONFIG_PROFILE_ANNOTATED_BRANCHES is not set
# CONFIG_PROFILE_ALL_BRANCHES is not set
# CONFIG_STACK_TRACER is not set
# CONFIG_BLK_DEV_IO_TRACE is not set
CONFIG_UPROBE_EVENT=y
CONFIG_PROBE_EVENTS=y
# CONFIG_MMIOTRACE is not set
# CONFIG_RING_BUFFER_BENCHMARK is not set
CONFIG_PROVIDE_OHCI1394_DMA_INIT=y
CONFIG_FIREWIRE_OHCI_REMOTE_DMA=y
CONFIG_DYNAMIC_DEBUG=y
CONFIG_DMA_API_DEBUG=y
CONFIG_ATOMIC64_SELFTEST=y
CONFIG_ASYNC_RAID6_TEST=y
# CONFIG_SAMPLES is not set
CONFIG_HAVE_ARCH_KGDB=y
CONFIG_KGDB=y
CONFIG_KGDB_SERIAL_CONSOLE=y
CONFIG_KGDB_TESTS=y
# CONFIG_KGDB_TESTS_ON_BOOT is not set
CONFIG_KGDB_LOW_LEVEL_TRAP=y
CONFIG_KGDB_KDB=y
CONFIG_KDB_KEYBOARD=y
CONFIG_HAVE_ARCH_KMEMCHECK=y
# CONFIG_KMEMCHECK is not set
CONFIG_TEST_KSTRTOX=y
# CONFIG_STRICT_DEVMEM is not set
CONFIG_X86_VERBOSE_BOOTUP=y
CONFIG_EARLY_PRINTK=y
CONFIG_EARLY_PRINTK_DBGP=y
CONFIG_DEBUG_STACKOVERFLOW=y
CONFIG_X86_PTDUMP=y
CONFIG_DEBUG_RODATA=y
CONFIG_DEBUG_RODATA_TEST=y
CONFIG_IOMMU_DEBUG=y
CONFIG_IOMMU_STRESS=y
CONFIG_IOMMU_LEAK=y
CONFIG_HAVE_MMIOTRACE_SUPPORT=y
CONFIG_IO_DELAY_TYPE_0X80=0
CONFIG_IO_DELAY_TYPE_0XED=1
CONFIG_IO_DELAY_TYPE_UDELAY=2
CONFIG_IO_DELAY_TYPE_NONE=3
CONFIG_IO_DELAY_0X80=y
# CONFIG_IO_DELAY_0XED is not set
# CONFIG_IO_DELAY_UDELAY is not set
# CONFIG_IO_DELAY_NONE is not set
CONFIG_DEFAULT_IO_DELAY_TYPE=0
CONFIG_DEBUG_BOOT_PARAMS=y
CONFIG_CPA_DEBUG=y
CONFIG_OPTIMIZE_INLINING=y
CONFIG_DEBUG_STRICT_USER_COPY_CHECKS=y
CONFIG_DEBUG_NMI_SELFTEST=y

#
# Security options
#
CONFIG_KEYS=y
CONFIG_TRUSTED_KEYS=y
CONFIG_ENCRYPTED_KEYS=y
CONFIG_KEYS_DEBUG_PROC_KEYS=y
# CONFIG_SECURITY_DMESG_RESTRICT is not set
CONFIG_SECURITY=y
CONFIG_SECURITYFS=y
CONFIG_SECURITY_NETWORK=y
CONFIG_SECURITY_NETWORK_XFRM=y
CONFIG_SECURITY_PATH=y
# CONFIG_INTEL_TXT is not set
CONFIG_LSM_MMAP_MIN_ADDR=65536
CONFIG_SECURITY_SELINUX=y
# CONFIG_SECURITY_SELINUX_BOOTPARAM is not set
# CONFIG_SECURITY_SELINUX_DISABLE is not set
CONFIG_SECURITY_SELINUX_DEVELOP=y
CONFIG_SECURITY_SELINUX_AVC_STATS=y
CONFIG_SECURITY_SELINUX_CHECKREQPROT_VALUE=1
CONFIG_SECURITY_SELINUX_POLICYDB_VERSION_MAX=y
CONFIG_SECURITY_SELINUX_POLICYDB_VERSION_MAX_VALUE=19
CONFIG_SECURITY_SMACK=y
CONFIG_SECURITY_TOMOYO=y
CONFIG_SECURITY_TOMOYO_MAX_ACCEPT_ENTRY=2048
CONFIG_SECURITY_TOMOYO_MAX_AUDIT_LOG=1024
CONFIG_SECURITY_TOMOYO_OMIT_USERSPACE_LOADER=y
CONFIG_SECURITY_APPARMOR=y
CONFIG_SECURITY_APPARMOR_BOOTPARAM_VALUE=1
CONFIG_SECURITY_YAMA=y
CONFIG_INTEGRITY=y
CONFIG_INTEGRITY_SIGNATURE=y
CONFIG_IMA=y
CONFIG_IMA_MEASURE_PCR_IDX=10
CONFIG_IMA_AUDIT=y
CONFIG_IMA_LSM_RULES=y
CONFIG_EVM=y
# CONFIG_DEFAULT_SECURITY_SELINUX is not set
# CONFIG_DEFAULT_SECURITY_SMACK is not set
# CONFIG_DEFAULT_SECURITY_TOMOYO is not set
# CONFIG_DEFAULT_SECURITY_APPARMOR is not set
# CONFIG_DEFAULT_SECURITY_YAMA is not set
CONFIG_DEFAULT_SECURITY_DAC=y
CONFIG_DEFAULT_SECURITY=""
CONFIG_XOR_BLOCKS=y
CONFIG_ASYNC_CORE=y
CONFIG_ASYNC_MEMCPY=y
CONFIG_ASYNC_XOR=y
CONFIG_ASYNC_PQ=y
CONFIG_ASYNC_RAID6_RECOV=y
CONFIG_ASYNC_TX_DISABLE_PQ_VAL_DMA=y
CONFIG_ASYNC_TX_DISABLE_XOR_VAL_DMA=y
CONFIG_CRYPTO=y

#
# Crypto core or helper
#
CONFIG_CRYPTO_ALGAPI=y
CONFIG_CRYPTO_ALGAPI2=y
CONFIG_CRYPTO_AEAD=y
CONFIG_CRYPTO_AEAD2=y
CONFIG_CRYPTO_BLKCIPHER=y
CONFIG_CRYPTO_BLKCIPHER2=y
CONFIG_CRYPTO_HASH=y
CONFIG_CRYPTO_HASH2=y
CONFIG_CRYPTO_RNG=y
CONFIG_CRYPTO_RNG2=y
CONFIG_CRYPTO_PCOMP=y
CONFIG_CRYPTO_PCOMP2=y
CONFIG_CRYPTO_MANAGER=y
CONFIG_CRYPTO_MANAGER2=y
CONFIG_CRYPTO_USER=y
CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y
CONFIG_CRYPTO_GF128MUL=y
CONFIG_CRYPTO_NULL=y
CONFIG_CRYPTO_PCRYPT=y
CONFIG_CRYPTO_WORKQUEUE=y
CONFIG_CRYPTO_CRYPTD=y
CONFIG_CRYPTO_AUTHENC=y
CONFIG_CRYPTO_ABLK_HELPER_X86=y
CONFIG_CRYPTO_GLUE_HELPER_X86=y

#
# Authenticated Encryption with Associated Data
#
CONFIG_CRYPTO_CCM=y
CONFIG_CRYPTO_GCM=y
CONFIG_CRYPTO_SEQIV=y

#
# Block modes
#
CONFIG_CRYPTO_CBC=y
CONFIG_CRYPTO_CTR=y
CONFIG_CRYPTO_CTS=y
CONFIG_CRYPTO_ECB=y
CONFIG_CRYPTO_LRW=y
CONFIG_CRYPTO_PCBC=y
CONFIG_CRYPTO_XTS=y

#
# Hash modes
#
CONFIG_CRYPTO_HMAC=y
CONFIG_CRYPTO_XCBC=y
CONFIG_CRYPTO_VMAC=y

#
# Digest
#
CONFIG_CRYPTO_CRC32C=y
CONFIG_CRYPTO_CRC32C_INTEL=y
CONFIG_CRYPTO_GHASH=y
CONFIG_CRYPTO_MD4=y
CONFIG_CRYPTO_MD5=y
CONFIG_CRYPTO_MICHAEL_MIC=y
CONFIG_CRYPTO_RMD128=y
CONFIG_CRYPTO_RMD160=y
CONFIG_CRYPTO_RMD256=y
CONFIG_CRYPTO_RMD320=y
CONFIG_CRYPTO_SHA1=y
CONFIG_CRYPTO_SHA1_SSSE3=y
CONFIG_CRYPTO_SHA256=y
CONFIG_CRYPTO_SHA512=y
CONFIG_CRYPTO_TGR192=y
CONFIG_CRYPTO_WP512=y
CONFIG_CRYPTO_GHASH_CLMUL_NI_INTEL=y

#
# Ciphers
#
CONFIG_CRYPTO_AES=y
CONFIG_CRYPTO_AES_X86_64=y
CONFIG_CRYPTO_AES_NI_INTEL=y
CONFIG_CRYPTO_ANUBIS=y
CONFIG_CRYPTO_ARC4=y
CONFIG_CRYPTO_BLOWFISH=y
CONFIG_CRYPTO_BLOWFISH_COMMON=y
CONFIG_CRYPTO_BLOWFISH_X86_64=y
CONFIG_CRYPTO_CAMELLIA=y
CONFIG_CRYPTO_CAMELLIA_X86_64=y
CONFIG_CRYPTO_CAST5=y
CONFIG_CRYPTO_CAST6=y
CONFIG_CRYPTO_DES=y
CONFIG_CRYPTO_FCRYPT=y
CONFIG_CRYPTO_KHAZAD=y
CONFIG_CRYPTO_SALSA20=y
CONFIG_CRYPTO_SALSA20_X86_64=y
CONFIG_CRYPTO_SEED=y
CONFIG_CRYPTO_SERPENT=y
CONFIG_CRYPTO_SERPENT_SSE2_X86_64=y
CONFIG_CRYPTO_SERPENT_AVX_X86_64=y
CONFIG_CRYPTO_TEA=y
CONFIG_CRYPTO_TWOFISH=y
CONFIG_CRYPTO_TWOFISH_COMMON=y
CONFIG_CRYPTO_TWOFISH_X86_64=y
CONFIG_CRYPTO_TWOFISH_X86_64_3WAY=y
CONFIG_CRYPTO_TWOFISH_AVX_X86_64=y

#
# Compression
#
CONFIG_CRYPTO_DEFLATE=y
CONFIG_CRYPTO_ZLIB=y
CONFIG_CRYPTO_LZO=y

#
# Random Number Generation
#
CONFIG_CRYPTO_ANSI_CPRNG=y
CONFIG_CRYPTO_USER_API=y
CONFIG_CRYPTO_USER_API_HASH=y
CONFIG_CRYPTO_USER_API_SKCIPHER=y
CONFIG_CRYPTO_HW=y
CONFIG_CRYPTO_DEV_PADLOCK=y
CONFIG_CRYPTO_DEV_PADLOCK_AES=y
CONFIG_CRYPTO_DEV_PADLOCK_SHA=y
CONFIG_HAVE_KVM=y
CONFIG_HAVE_KVM_IRQCHIP=y
CONFIG_HAVE_KVM_EVENTFD=y
CONFIG_KVM_APIC_ARCHITECTURE=y
CONFIG_KVM_MMIO=y
CONFIG_KVM_ASYNC_PF=y
CONFIG_HAVE_KVM_MSI=y
CONFIG_VIRTUALIZATION=y
CONFIG_KVM=y
CONFIG_KVM_INTEL=y
CONFIG_KVM_AMD=y
CONFIG_KVM_MMU_AUDIT=y
CONFIG_VHOST_NET=y
CONFIG_BINARY_PRINTF=y

#
# Library routines
#
CONFIG_RAID6_PQ=y
CONFIG_BITREVERSE=y
CONFIG_GENERIC_STRNCPY_FROM_USER=y
CONFIG_GENERIC_STRNLEN_USER=y
CONFIG_GENERIC_FIND_FIRST_BIT=y
CONFIG_GENERIC_PCI_IOMAP=y
CONFIG_GENERIC_IOMAP=y
CONFIG_GENERIC_IO=y
CONFIG_CRC_CCITT=y
CONFIG_CRC16=y
CONFIG_CRC_T10DIF=y
CONFIG_CRC_ITU_T=y
CONFIG_CRC32=y
CONFIG_CRC32_SELFTEST=y
CONFIG_CRC32_SLICEBY8=y
# CONFIG_CRC32_SLICEBY4 is not set
# CONFIG_CRC32_SARWATE is not set
# CONFIG_CRC32_BIT is not set
CONFIG_CRC7=y
CONFIG_LIBCRC32C=y
CONFIG_CRC8=y
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=y
CONFIG_LZO_COMPRESS=y
CONFIG_LZO_DECOMPRESS=y
CONFIG_XZ_DEC=y
CONFIG_XZ_DEC_X86=y
CONFIG_XZ_DEC_POWERPC=y
CONFIG_XZ_DEC_IA64=y
CONFIG_XZ_DEC_ARM=y
CONFIG_XZ_DEC_ARMTHUMB=y
CONFIG_XZ_DEC_SPARC=y
CONFIG_XZ_DEC_BCJ=y
CONFIG_XZ_DEC_TEST=y
CONFIG_GENERIC_ALLOCATOR=y
CONFIG_REED_SOLOMON=y
CONFIG_REED_SOLOMON_ENC8=y
CONFIG_REED_SOLOMON_DEC8=y
CONFIG_REED_SOLOMON_DEC16=y
CONFIG_BCH=y
CONFIG_BCH_CONST_PARAMS=y
CONFIG_TEXTSEARCH=y
CONFIG_TEXTSEARCH_KMP=y
CONFIG_TEXTSEARCH_BM=y
CONFIG_TEXTSEARCH_FSM=y
CONFIG_BTREE=y
CONFIG_HAS_IOMEM=y
CONFIG_HAS_IOPORT=y
CONFIG_HAS_DMA=y
CONFIG_CHECK_SIGNATURE=y
CONFIG_CPUMASK_OFFSTACK=y
CONFIG_CPU_RMAP=y
CONFIG_DQL=y
CONFIG_NLATTR=y
CONFIG_LRU_CACHE=y
CONFIG_AVERAGE=y
CONFIG_CLZ_TAB=y
CONFIG_CORDIC=y
CONFIG_DDR=y
CONFIG_MPILIB=y
CONFIG_SIGNATURE=y

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-30 13:28       ` Sasha Levin
@ 2012-06-30 13:58         ` Paul E. McKenney
  0 siblings, 0 replies; 20+ messages in thread
From: Paul E. McKenney @ 2012-06-30 13:58 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Dave Jones, linux-kernel, Peter Zijlstra

On Sat, Jun 30, 2012 at 03:28:09PM +0200, Sasha Levin wrote:
> On Sat, 2012-06-30 at 06:14 -0700, Paul E. McKenney wrote:
> > On Sat, Jun 30, 2012 at 01:36:48PM +0200, Sasha Levin wrote:
> > > Hi Paul,
> > > 
> > > On Fri, 2012-06-29 at 10:23 -0700, Paul E. McKenney wrote:
> > > > Please see below for an untested patch that gets RCU out of this loop,
> > > > but it is quite possible that something else is involved here, so it would
> > > > be very good to get a lockdep run, if possible.  My concern stems from the
> > > > fact that interrupts were enabled during the call to __rcu_read_unlock()
> > > > -- otherwise it would not have been preempted -- so the runqueue locks
> > > > were presumably not held on entry to __rcu_read_unlock(). 
> > > 
> > > I'll continue with the good news/bad news theme.
> > > 
> > > Good news - the original problem I've reported seems to be gone.
> > > 
> > > Bad news - I'm getting the following instead:
> > 
> > Interesting...
> > 
> > You are still running with lockdep?
> 
> It should be on, yes. I don't see anything in dmesg which would suggest
> it got disabled before this spew.

It would be very helpful to see where that spinlock was acquired.  ;-)
I am wondering if someone mistakenly enabled irqs while holding it.

> I've attached my .config. I'm starting the kernel with "sched_debug
> slub_debug=FZPU numa=fake=10" as well.

Looking forward to seeing the result...

							Thanx, Paul

> #
> # Automatically generated file; DO NOT EDIT.
> # Linux/x86_64 3.5.0-rc4 Kernel Configuration
> #
> CONFIG_64BIT=y
> # CONFIG_X86_32 is not set
> CONFIG_X86_64=y
> CONFIG_X86=y
> CONFIG_INSTRUCTION_DECODER=y
> CONFIG_OUTPUT_FORMAT="elf64-x86-64"
> CONFIG_ARCH_DEFCONFIG="arch/x86/configs/x86_64_defconfig"
> CONFIG_LOCKDEP_SUPPORT=y
> CONFIG_STACKTRACE_SUPPORT=y
> CONFIG_HAVE_LATENCYTOP_SUPPORT=y
> CONFIG_MMU=y
> CONFIG_NEED_DMA_MAP_STATE=y
> CONFIG_NEED_SG_DMA_LENGTH=y
> CONFIG_GENERIC_ISA_DMA=y
> CONFIG_GENERIC_BUG=y
> CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y
> CONFIG_GENERIC_HWEIGHT=y
> CONFIG_GENERIC_GPIO=y
> CONFIG_ARCH_MAY_HAVE_PC_FDC=y
> # CONFIG_RWSEM_GENERIC_SPINLOCK is not set
> CONFIG_RWSEM_XCHGADD_ALGORITHM=y
> CONFIG_GENERIC_CALIBRATE_DELAY=y
> CONFIG_ARCH_HAS_CPU_RELAX=y
> CONFIG_ARCH_HAS_DEFAULT_IDLE=y
> CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
> CONFIG_ARCH_HAS_CPU_AUTOPROBE=y
> CONFIG_HAVE_SETUP_PER_CPU_AREA=y
> CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
> CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
> CONFIG_ARCH_HIBERNATION_POSSIBLE=y
> CONFIG_ARCH_SUSPEND_POSSIBLE=y
> CONFIG_ZONE_DMA32=y
> CONFIG_AUDIT_ARCH=y
> CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
> CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
> CONFIG_HAVE_INTEL_TXT=y
> CONFIG_X86_64_SMP=y
> CONFIG_X86_HT=y
> CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-rdi -fcall-saved-rsi -fcall-saved-rdx -fcall-saved-rcx -fcall-saved-r8 -fcall-saved-r9 -fcall-saved-r10 -fcall-saved-r11"
> CONFIG_ARCH_CPU_PROBE_RELEASE=y
> CONFIG_ARCH_SUPPORTS_UPROBES=y
> CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
> CONFIG_HAVE_IRQ_WORK=y
> CONFIG_IRQ_WORK=y
> CONFIG_BUILDTIME_EXTABLE_SORT=y
> 
> #
> # General setup
> #
> CONFIG_EXPERIMENTAL=y
> CONFIG_INIT_ENV_ARG_LIMIT=32
> CONFIG_CROSS_COMPILE=""
> CONFIG_LOCALVERSION="-sasha"
> CONFIG_LOCALVERSION_AUTO=y
> CONFIG_HAVE_KERNEL_GZIP=y
> CONFIG_HAVE_KERNEL_BZIP2=y
> CONFIG_HAVE_KERNEL_LZMA=y
> CONFIG_HAVE_KERNEL_XZ=y
> CONFIG_HAVE_KERNEL_LZO=y
> CONFIG_KERNEL_GZIP=y
> # CONFIG_KERNEL_BZIP2 is not set
> # CONFIG_KERNEL_LZMA is not set
> # CONFIG_KERNEL_XZ is not set
> # CONFIG_KERNEL_LZO is not set
> CONFIG_DEFAULT_HOSTNAME="(none)"
> CONFIG_SWAP=y
> CONFIG_SYSVIPC=y
> CONFIG_SYSVIPC_SYSCTL=y
> CONFIG_POSIX_MQUEUE=y
> CONFIG_POSIX_MQUEUE_SYSCTL=y
> CONFIG_BSD_PROCESS_ACCT=y
> CONFIG_BSD_PROCESS_ACCT_V3=y
> CONFIG_FHANDLE=y
> CONFIG_TASKSTATS=y
> CONFIG_TASK_DELAY_ACCT=y
> CONFIG_TASK_XACCT=y
> CONFIG_TASK_IO_ACCOUNTING=y
> CONFIG_AUDIT=y
> CONFIG_AUDITSYSCALL=y
> CONFIG_AUDIT_WATCH=y
> CONFIG_AUDIT_TREE=y
> CONFIG_AUDIT_LOGINUID_IMMUTABLE=y
> CONFIG_HAVE_GENERIC_HARDIRQS=y
> 
> #
> # IRQ subsystem
> #
> CONFIG_GENERIC_HARDIRQS=y
> CONFIG_GENERIC_IRQ_PROBE=y
> CONFIG_GENERIC_IRQ_SHOW=y
> CONFIG_GENERIC_PENDING_IRQ=y
> CONFIG_IRQ_DOMAIN=y
> CONFIG_IRQ_DOMAIN_DEBUG=y
> CONFIG_IRQ_FORCED_THREADING=y
> CONFIG_SPARSE_IRQ=y
> CONFIG_CLOCKSOURCE_WATCHDOG=y
> CONFIG_ARCH_CLOCKSOURCE_DATA=y
> CONFIG_GENERIC_TIME_VSYSCALL=y
> CONFIG_GENERIC_CLOCKEVENTS=y
> CONFIG_GENERIC_CLOCKEVENTS_BUILD=y
> CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
> CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
> CONFIG_GENERIC_CMOS_UPDATE=y
> 
> #
> # Timers subsystem
> #
> CONFIG_TICK_ONESHOT=y
> CONFIG_NO_HZ=y
> CONFIG_HIGH_RES_TIMERS=y
> 
> #
> # RCU Subsystem
> #
> CONFIG_TREE_PREEMPT_RCU=y
> CONFIG_PREEMPT_RCU=y
> CONFIG_RCU_FANOUT=64
> CONFIG_RCU_FANOUT_LEAF=16
> # CONFIG_RCU_FANOUT_EXACT is not set
> CONFIG_RCU_FAST_NO_HZ=y
> CONFIG_TREE_RCU_TRACE=y
> CONFIG_RCU_BOOST=y
> CONFIG_RCU_BOOST_PRIO=1
> CONFIG_RCU_BOOST_DELAY=500
> CONFIG_IKCONFIG=y
> CONFIG_IKCONFIG_PROC=y
> CONFIG_LOG_BUF_SHIFT=18
> CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
> CONFIG_CGROUPS=y
> CONFIG_CGROUP_DEBUG=y
> CONFIG_CGROUP_FREEZER=y
> CONFIG_CGROUP_DEVICE=y
> CONFIG_CPUSETS=y
> CONFIG_PROC_PID_CPUSET=y
> CONFIG_CGROUP_CPUACCT=y
> CONFIG_RESOURCE_COUNTERS=y
> # CONFIG_CGROUP_MEM_RES_CTLR is not set
> CONFIG_CGROUP_HUGETLB_RES_CTLR=y
> CONFIG_CGROUP_PERF=y
> CONFIG_CGROUP_SCHED=y
> CONFIG_FAIR_GROUP_SCHED=y
> CONFIG_CFS_BANDWIDTH=y
> CONFIG_RT_GROUP_SCHED=y
> CONFIG_BLK_CGROUP=y
> CONFIG_DEBUG_BLK_CGROUP=y
> CONFIG_CHECKPOINT_RESTORE=y
> CONFIG_NAMESPACES=y
> CONFIG_UTS_NS=y
> CONFIG_IPC_NS=y
> CONFIG_PID_NS=y
> CONFIG_NET_NS=y
> CONFIG_SCHED_AUTOGROUP=y
> CONFIG_MM_OWNER=y
> CONFIG_SYSFS_DEPRECATED=y
> CONFIG_SYSFS_DEPRECATED_V2=y
> CONFIG_RELAY=y
> # CONFIG_BLK_DEV_INITRD is not set
> # CONFIG_CC_OPTIMIZE_FOR_SIZE is not set
> CONFIG_SYSCTL=y
> CONFIG_ANON_INODES=y
> CONFIG_EXPERT=y
> CONFIG_UID16=y
> CONFIG_SYSCTL_SYSCALL=y
> CONFIG_KALLSYMS=y
> CONFIG_KALLSYMS_ALL=y
> CONFIG_HOTPLUG=y
> CONFIG_PRINTK=y
> CONFIG_BUG=y
> CONFIG_ELF_CORE=y
> CONFIG_PCSPKR_PLATFORM=y
> CONFIG_HAVE_PCSPKR_PLATFORM=y
> CONFIG_BASE_FULL=y
> CONFIG_FUTEX=y
> CONFIG_EPOLL=y
> CONFIG_SIGNALFD=y
> CONFIG_TIMERFD=y
> CONFIG_EVENTFD=y
> CONFIG_SHMEM=y
> CONFIG_AIO=y
> CONFIG_EMBEDDED=y
> CONFIG_HAVE_PERF_EVENTS=y
> CONFIG_PERF_USE_VMALLOC=y
> 
> #
> # Kernel Performance Events And Counters
> #
> CONFIG_PERF_EVENTS=y
> CONFIG_DEBUG_PERF_USE_VMALLOC=y
> CONFIG_VM_EVENT_COUNTERS=y
> CONFIG_PCI_QUIRKS=y
> CONFIG_SLUB_DEBUG=y
> CONFIG_COMPAT_BRK=y
> # CONFIG_SLAB is not set
> CONFIG_SLUB=y
> # CONFIG_SLOB is not set
> CONFIG_PROFILING=y
> CONFIG_TRACEPOINTS=y
> CONFIG_OPROFILE=y
> CONFIG_OPROFILE_EVENT_MULTIPLEX=y
> CONFIG_HAVE_OPROFILE=y
> CONFIG_OPROFILE_NMI_TIMER=y
> CONFIG_JUMP_LABEL=y
> CONFIG_UPROBES=y
> CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
> CONFIG_USER_RETURN_NOTIFIER=y
> CONFIG_HAVE_IOREMAP_PROT=y
> CONFIG_HAVE_KPROBES=y
> CONFIG_HAVE_KRETPROBES=y
> CONFIG_HAVE_OPTPROBES=y
> CONFIG_HAVE_ARCH_TRACEHOOK=y
> CONFIG_HAVE_DMA_ATTRS=y
> CONFIG_USE_GENERIC_SMP_HELPERS=y
> CONFIG_GENERIC_SMP_IDLE_THREAD=y
> CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
> CONFIG_HAVE_DMA_API_DEBUG=y
> CONFIG_HAVE_HW_BREAKPOINT=y
> CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
> CONFIG_HAVE_USER_RETURN_NOTIFIER=y
> CONFIG_HAVE_PERF_EVENTS_NMI=y
> CONFIG_HAVE_ARCH_JUMP_LABEL=y
> CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
> CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
> CONFIG_HAVE_CMPXCHG_LOCAL=y
> CONFIG_HAVE_CMPXCHG_DOUBLE=y
> CONFIG_ARCH_WANT_OLD_COMPAT_IPC=y
> CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
> CONFIG_SECCOMP_FILTER=y
> 
> #
> # GCOV-based kernel profiling
> #
> # CONFIG_GCOV_KERNEL is not set
> # CONFIG_HAVE_GENERIC_DMA_COHERENT is not set
> CONFIG_SLABINFO=y
> CONFIG_RT_MUTEXES=y
> CONFIG_BASE_SMALL=0
> # CONFIG_MODULES is not set
> CONFIG_STOP_MACHINE=y
> CONFIG_BLOCK=y
> CONFIG_BLK_DEV_BSG=y
> CONFIG_BLK_DEV_BSGLIB=y
> CONFIG_BLK_DEV_INTEGRITY=y
> CONFIG_BLK_DEV_THROTTLING=y
> 
> #
> # Partition Types
> #
> CONFIG_PARTITION_ADVANCED=y
> CONFIG_ACORN_PARTITION=y
> CONFIG_ACORN_PARTITION_CUMANA=y
> CONFIG_ACORN_PARTITION_EESOX=y
> CONFIG_ACORN_PARTITION_ICS=y
> CONFIG_ACORN_PARTITION_ADFS=y
> CONFIG_ACORN_PARTITION_POWERTEC=y
> CONFIG_ACORN_PARTITION_RISCIX=y
> CONFIG_OSF_PARTITION=y
> CONFIG_AMIGA_PARTITION=y
> CONFIG_ATARI_PARTITION=y
> CONFIG_MAC_PARTITION=y
> CONFIG_MSDOS_PARTITION=y
> CONFIG_BSD_DISKLABEL=y
> CONFIG_MINIX_SUBPARTITION=y
> CONFIG_SOLARIS_X86_PARTITION=y
> CONFIG_UNIXWARE_DISKLABEL=y
> CONFIG_LDM_PARTITION=y
> CONFIG_LDM_DEBUG=y
> CONFIG_SGI_PARTITION=y
> CONFIG_ULTRIX_PARTITION=y
> CONFIG_SUN_PARTITION=y
> CONFIG_KARMA_PARTITION=y
> CONFIG_EFI_PARTITION=y
> CONFIG_SYSV68_PARTITION=y
> CONFIG_BLOCK_COMPAT=y
> 
> #
> # IO Schedulers
> #
> CONFIG_IOSCHED_NOOP=y
> CONFIG_IOSCHED_DEADLINE=y
> CONFIG_IOSCHED_CFQ=y
> CONFIG_CFQ_GROUP_IOSCHED=y
> # CONFIG_DEFAULT_DEADLINE is not set
> CONFIG_DEFAULT_CFQ=y
> # CONFIG_DEFAULT_NOOP is not set
> CONFIG_DEFAULT_IOSCHED="cfq"
> CONFIG_PREEMPT_NOTIFIERS=y
> CONFIG_PADATA=y
> # CONFIG_INLINE_SPIN_TRYLOCK is not set
> # CONFIG_INLINE_SPIN_TRYLOCK_BH is not set
> # CONFIG_INLINE_SPIN_LOCK is not set
> # CONFIG_INLINE_SPIN_LOCK_BH is not set
> # CONFIG_INLINE_SPIN_LOCK_IRQ is not set
> # CONFIG_INLINE_SPIN_LOCK_IRQSAVE is not set
> CONFIG_UNINLINE_SPIN_UNLOCK=y
> # CONFIG_INLINE_SPIN_UNLOCK_BH is not set
> # CONFIG_INLINE_SPIN_UNLOCK_IRQ is not set
> # CONFIG_INLINE_SPIN_UNLOCK_IRQRESTORE is not set
> # CONFIG_INLINE_READ_TRYLOCK is not set
> # CONFIG_INLINE_READ_LOCK is not set
> # CONFIG_INLINE_READ_LOCK_BH is not set
> # CONFIG_INLINE_READ_LOCK_IRQ is not set
> # CONFIG_INLINE_READ_LOCK_IRQSAVE is not set
> # CONFIG_INLINE_READ_UNLOCK is not set
> # CONFIG_INLINE_READ_UNLOCK_BH is not set
> # CONFIG_INLINE_READ_UNLOCK_IRQ is not set
> # CONFIG_INLINE_READ_UNLOCK_IRQRESTORE is not set
> # CONFIG_INLINE_WRITE_TRYLOCK is not set
> # CONFIG_INLINE_WRITE_LOCK is not set
> # CONFIG_INLINE_WRITE_LOCK_BH is not set
> # CONFIG_INLINE_WRITE_LOCK_IRQ is not set
> # CONFIG_INLINE_WRITE_LOCK_IRQSAVE is not set
> # CONFIG_INLINE_WRITE_UNLOCK is not set
> # CONFIG_INLINE_WRITE_UNLOCK_BH is not set
> # CONFIG_INLINE_WRITE_UNLOCK_IRQ is not set
> # CONFIG_INLINE_WRITE_UNLOCK_IRQRESTORE is not set
> # CONFIG_MUTEX_SPIN_ON_OWNER is not set
> CONFIG_FREEZER=y
> 
> #
> # Processor type and features
> #
> CONFIG_ZONE_DMA=y
> CONFIG_SMP=y
> CONFIG_X86_X2APIC=y
> CONFIG_X86_MPPARSE=y
> CONFIG_X86_EXTENDED_PLATFORM=y
> CONFIG_X86_NUMACHIP=y
> CONFIG_X86_VSMP=y
> CONFIG_X86_UV=y
> CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y
> CONFIG_SCHED_OMIT_FRAME_POINTER=y
> CONFIG_KVMTOOL_TEST_ENABLE=y
> CONFIG_PARAVIRT_GUEST=y
> CONFIG_PARAVIRT_TIME_ACCOUNTING=y
> CONFIG_XEN=y
> CONFIG_XEN_DOM0=y
> CONFIG_XEN_PRIVILEGED_GUEST=y
> CONFIG_XEN_PVHVM=y
> CONFIG_XEN_MAX_DOMAIN_MEMORY=500
> CONFIG_XEN_SAVE_RESTORE=y
> CONFIG_XEN_DEBUG_FS=y
> CONFIG_KVM_CLOCK=y
> CONFIG_KVM_GUEST=y
> CONFIG_PARAVIRT=y
> CONFIG_PARAVIRT_SPINLOCKS=y
> CONFIG_PARAVIRT_CLOCK=y
> CONFIG_PARAVIRT_DEBUG=y
> CONFIG_NO_BOOTMEM=y
> CONFIG_MEMTEST=y
> # CONFIG_MK8 is not set
> # CONFIG_MPSC is not set
> CONFIG_MCORE2=y
> # CONFIG_MATOM is not set
> # CONFIG_GENERIC_CPU is not set
> CONFIG_X86_INTERNODE_CACHE_SHIFT=12
> CONFIG_X86_CMPXCHG=y
> CONFIG_X86_L1_CACHE_SHIFT=6
> CONFIG_X86_XADD=y
> CONFIG_X86_WP_WORKS_OK=y
> CONFIG_X86_INTEL_USERCOPY=y
> CONFIG_X86_USE_PPRO_CHECKSUM=y
> CONFIG_X86_P6_NOP=y
> CONFIG_X86_TSC=y
> CONFIG_X86_CMPXCHG64=y
> CONFIG_X86_CMOV=y
> CONFIG_X86_MINIMUM_CPU_FAMILY=64
> CONFIG_X86_DEBUGCTLMSR=y
> CONFIG_PROCESSOR_SELECT=y
> CONFIG_CPU_SUP_INTEL=y
> CONFIG_CPU_SUP_AMD=y
> CONFIG_CPU_SUP_CENTAUR=y
> CONFIG_HPET_TIMER=y
> CONFIG_HPET_EMULATE_RTC=y
> CONFIG_DMI=y
> CONFIG_GART_IOMMU=y
> CONFIG_CALGARY_IOMMU=y
> CONFIG_CALGARY_IOMMU_ENABLED_BY_DEFAULT=y
> CONFIG_SWIOTLB=y
> CONFIG_IOMMU_HELPER=y
> CONFIG_MAXSMP=y
> CONFIG_NR_CPUS=4096
> CONFIG_SCHED_SMT=y
> CONFIG_SCHED_MC=y
> CONFIG_IRQ_TIME_ACCOUNTING=y
> # CONFIG_PREEMPT_NONE is not set
> # CONFIG_PREEMPT_VOLUNTARY is not set
> CONFIG_PREEMPT=y
> CONFIG_PREEMPT_COUNT=y
> CONFIG_X86_LOCAL_APIC=y
> CONFIG_X86_IO_APIC=y
> CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS=y
> CONFIG_X86_MCE=y
> CONFIG_X86_MCE_INTEL=y
> CONFIG_X86_MCE_AMD=y
> CONFIG_X86_MCE_THRESHOLD=y
> CONFIG_X86_MCE_INJECT=y
> CONFIG_X86_THERMAL_VECTOR=y
> CONFIG_I8K=y
> CONFIG_MICROCODE=y
> CONFIG_MICROCODE_INTEL=y
> CONFIG_MICROCODE_AMD=y
> CONFIG_MICROCODE_OLD_INTERFACE=y
> CONFIG_X86_MSR=y
> CONFIG_X86_CPUID=y
> CONFIG_ARCH_PHYS_ADDR_T_64BIT=y
> CONFIG_ARCH_DMA_ADDR_T_64BIT=y
> CONFIG_DIRECT_GBPAGES=y
> CONFIG_NUMA=y
> CONFIG_AMD_NUMA=y
> CONFIG_X86_64_ACPI_NUMA=y
> CONFIG_NODES_SPAN_OTHER_NODES=y
> CONFIG_NUMA_EMU=y
> CONFIG_NODES_SHIFT=10
> CONFIG_ARCH_SPARSEMEM_ENABLE=y
> CONFIG_ARCH_SPARSEMEM_DEFAULT=y
> CONFIG_ARCH_SELECT_MEMORY_MODEL=y
> CONFIG_ARCH_MEMORY_PROBE=y
> CONFIG_ARCH_PROC_KCORE_TEXT=y
> CONFIG_ILLEGAL_POINTER_VALUE=0xdead000000000000
> CONFIG_SELECT_MEMORY_MODEL=y
> CONFIG_SPARSEMEM_MANUAL=y
> CONFIG_SPARSEMEM=y
> CONFIG_NEED_MULTIPLE_NODES=y
> CONFIG_HAVE_MEMORY_PRESENT=y
> CONFIG_SPARSEMEM_EXTREME=y
> CONFIG_SPARSEMEM_VMEMMAP_ENABLE=y
> CONFIG_SPARSEMEM_ALLOC_MEM_MAP_TOGETHER=y
> CONFIG_SPARSEMEM_VMEMMAP=y
> CONFIG_HAVE_MEMBLOCK=y
> CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
> CONFIG_ARCH_DISCARD_MEMBLOCK=y
> CONFIG_MEMORY_HOTPLUG=y
> CONFIG_MEMORY_HOTPLUG_SPARSE=y
> CONFIG_MEMORY_HOTREMOVE=y
> CONFIG_PAGEFLAGS_EXTENDED=y
> CONFIG_SPLIT_PTLOCK_CPUS=999999
> CONFIG_COMPACTION=y
> CONFIG_MIGRATION=y
> CONFIG_PHYS_ADDR_T_64BIT=y
> CONFIG_ZONE_DMA_FLAG=1
> CONFIG_BOUNCE=y
> CONFIG_VIRT_TO_BUS=y
> CONFIG_MMU_NOTIFIER=y
> CONFIG_KSM=y
> CONFIG_DEFAULT_MMAP_MIN_ADDR=4096
> CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=y
> CONFIG_MEMORY_FAILURE=y
> CONFIG_HWPOISON_INJECT=y
> CONFIG_TRANSPARENT_HUGEPAGE=y
> CONFIG_TRANSPARENT_HUGEPAGE_ALWAYS=y
> # CONFIG_TRANSPARENT_HUGEPAGE_MADVISE is not set
> CONFIG_CROSS_MEMORY_ATTACH=y
> CONFIG_CLEANCACHE=y
> CONFIG_FRONTSWAP=y
> CONFIG_X86_CHECK_BIOS_CORRUPTION=y
> CONFIG_X86_BOOTPARAM_MEMORY_CORRUPTION_CHECK=y
> CONFIG_X86_RESERVE_LOW=64
> CONFIG_MTRR=y
> CONFIG_MTRR_SANITIZER=y
> CONFIG_MTRR_SANITIZER_ENABLE_DEFAULT=0
> CONFIG_MTRR_SANITIZER_SPARE_REG_NR_DEFAULT=1
> CONFIG_X86_PAT=y
> CONFIG_ARCH_USES_PG_UNCACHED=y
> CONFIG_ARCH_RANDOM=y
> CONFIG_EFI=y
> CONFIG_EFI_STUB=y
> CONFIG_SECCOMP=y
> CONFIG_CC_STACKPROTECTOR=y
> # CONFIG_HZ_100 is not set
> # CONFIG_HZ_250 is not set
> # CONFIG_HZ_300 is not set
> CONFIG_HZ_1000=y
> CONFIG_HZ=1000
> CONFIG_SCHED_HRTICK=y
> CONFIG_KEXEC=y
> CONFIG_CRASH_DUMP=y
> CONFIG_KEXEC_JUMP=y
> CONFIG_PHYSICAL_START=0x1000000
> CONFIG_RELOCATABLE=y
> CONFIG_PHYSICAL_ALIGN=0x1000000
> CONFIG_HOTPLUG_CPU=y
> CONFIG_COMPAT_VDSO=y
> CONFIG_CMDLINE_BOOL=y
> CONFIG_CMDLINE=""
> # CONFIG_CMDLINE_OVERRIDE is not set
> CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
> CONFIG_ARCH_ENABLE_MEMORY_HOTREMOVE=y
> CONFIG_USE_PERCPU_NUMA_NODE_ID=y
> 
> #
> # Power management and ACPI options
> #
> CONFIG_ARCH_HIBERNATION_HEADER=y
> CONFIG_SUSPEND=y
> CONFIG_SUSPEND_FREEZER=y
> CONFIG_HIBERNATE_CALLBACKS=y
> CONFIG_HIBERNATION=y
> CONFIG_PM_STD_PARTITION=""
> CONFIG_PM_SLEEP=y
> CONFIG_PM_SLEEP_SMP=y
> CONFIG_PM_AUTOSLEEP=y
> CONFIG_PM_WAKELOCKS=y
> CONFIG_PM_WAKELOCKS_LIMIT=0
> CONFIG_PM_WAKELOCKS_GC=y
> CONFIG_PM_RUNTIME=y
> CONFIG_PM=y
> CONFIG_PM_DEBUG=y
> CONFIG_PM_ADVANCED_DEBUG=y
> # CONFIG_PM_TEST_SUSPEND is not set
> CONFIG_PM_SLEEP_DEBUG=y
> CONFIG_PM_TRACE=y
> CONFIG_PM_TRACE_RTC=y
> CONFIG_ACPI=y
> CONFIG_ACPI_SLEEP=y
> CONFIG_ACPI_PROCFS=y
> CONFIG_ACPI_PROCFS_POWER=y
> CONFIG_ACPI_EC_DEBUGFS=y
> CONFIG_ACPI_PROC_EVENT=y
> CONFIG_ACPI_AC=y
> CONFIG_ACPI_BATTERY=y
> CONFIG_ACPI_BUTTON=y
> CONFIG_ACPI_VIDEO=y
> CONFIG_ACPI_FAN=y
> CONFIG_ACPI_DOCK=y
> CONFIG_ACPI_PROCESSOR=y
> CONFIG_ACPI_HOTPLUG_CPU=y
> CONFIG_ACPI_PROCESSOR_AGGREGATOR=y
> CONFIG_ACPI_THERMAL=y
> CONFIG_ACPI_NUMA=y
> # CONFIG_ACPI_CUSTOM_DSDT is not set
> CONFIG_ACPI_BLACKLIST_YEAR=0
> CONFIG_ACPI_DEBUG=y
> CONFIG_ACPI_DEBUG_FUNC_TRACE=y
> CONFIG_ACPI_PCI_SLOT=y
> CONFIG_X86_PM_TIMER=y
> CONFIG_ACPI_CONTAINER=y
> CONFIG_ACPI_HOTPLUG_MEMORY=y
> CONFIG_ACPI_SBS=y
> CONFIG_ACPI_HED=y
> CONFIG_ACPI_CUSTOM_METHOD=y
> CONFIG_ACPI_BGRT=y
> CONFIG_ACPI_APEI=y
> CONFIG_ACPI_APEI_GHES=y
> CONFIG_ACPI_APEI_PCIEAER=y
> CONFIG_ACPI_APEI_MEMORY_FAILURE=y
> CONFIG_ACPI_APEI_EINJ=y
> CONFIG_ACPI_APEI_ERST_DEBUG=y
> CONFIG_SFI=y
> 
> #
> # CPU Frequency scaling
> #
> CONFIG_CPU_FREQ=y
> CONFIG_CPU_FREQ_TABLE=y
> CONFIG_CPU_FREQ_STAT=y
> CONFIG_CPU_FREQ_STAT_DETAILS=y
> # CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE is not set
> # CONFIG_CPU_FREQ_DEFAULT_GOV_POWERSAVE is not set
> CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE=y
> # CONFIG_CPU_FREQ_DEFAULT_GOV_ONDEMAND is not set
> # CONFIG_CPU_FREQ_DEFAULT_GOV_CONSERVATIVE is not set
> CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
> CONFIG_CPU_FREQ_GOV_POWERSAVE=y
> CONFIG_CPU_FREQ_GOV_USERSPACE=y
> CONFIG_CPU_FREQ_GOV_ONDEMAND=y
> CONFIG_CPU_FREQ_GOV_CONSERVATIVE=y
> 
> #
> # x86 CPU frequency scaling drivers
> #
> CONFIG_X86_PCC_CPUFREQ=y
> CONFIG_X86_ACPI_CPUFREQ=y
> CONFIG_X86_POWERNOW_K8=y
> CONFIG_X86_SPEEDSTEP_CENTRINO=y
> CONFIG_X86_P4_CLOCKMOD=y
> 
> #
> # shared options
> #
> CONFIG_X86_SPEEDSTEP_LIB=y
> CONFIG_CPU_IDLE=y
> CONFIG_CPU_IDLE_GOV_LADDER=y
> CONFIG_CPU_IDLE_GOV_MENU=y
> # CONFIG_ARCH_NEEDS_CPU_IDLE_COUPLED is not set
> CONFIG_INTEL_IDLE=y
> 
> #
> # Memory power savings
> #
> CONFIG_I7300_IDLE_IOAT_CHANNEL=y
> CONFIG_I7300_IDLE=y
> 
> #
> # Bus options (PCI etc.)
> #
> CONFIG_PCI=y
> CONFIG_PCI_DIRECT=y
> CONFIG_PCI_MMCONFIG=y
> CONFIG_PCI_XEN=y
> CONFIG_PCI_DOMAINS=y
> CONFIG_PCI_CNB20LE_QUIRK=y
> CONFIG_PCIEPORTBUS=y
> CONFIG_HOTPLUG_PCI_PCIE=y
> CONFIG_PCIEAER=y
> CONFIG_PCIE_ECRC=y
> CONFIG_PCIEAER_INJECT=y
> CONFIG_PCIEASPM=y
> CONFIG_PCIEASPM_DEBUG=y
> CONFIG_PCIEASPM_DEFAULT=y
> # CONFIG_PCIEASPM_POWERSAVE is not set
> # CONFIG_PCIEASPM_PERFORMANCE is not set
> CONFIG_PCIE_PME=y
> CONFIG_ARCH_SUPPORTS_MSI=y
> CONFIG_PCI_MSI=y
> CONFIG_PCI_DEBUG=y
> CONFIG_PCI_REALLOC_ENABLE_AUTO=y
> CONFIG_PCI_STUB=y
> CONFIG_XEN_PCIDEV_FRONTEND=y
> CONFIG_HT_IRQ=y
> CONFIG_PCI_ATS=y
> CONFIG_PCI_IOV=y
> CONFIG_PCI_PRI=y
> CONFIG_PCI_PASID=y
> CONFIG_PCI_IOAPIC=y
> CONFIG_PCI_LABEL=y
> CONFIG_ISA_DMA_API=y
> CONFIG_AMD_NB=y
> CONFIG_PCCARD=y
> CONFIG_PCMCIA=y
> CONFIG_PCMCIA_LOAD_CIS=y
> CONFIG_CARDBUS=y
> 
> #
> # PC-card bridges
> #
> CONFIG_YENTA=y
> CONFIG_YENTA_O2=y
> CONFIG_YENTA_RICOH=y
> CONFIG_YENTA_TI=y
> CONFIG_YENTA_ENE_TUNE=y
> CONFIG_YENTA_TOSHIBA=y
> CONFIG_PD6729=y
> CONFIG_I82092=y
> CONFIG_PCCARD_NONSTATIC=y
> CONFIG_HOTPLUG_PCI=y
> CONFIG_HOTPLUG_PCI_FAKE=y
> CONFIG_HOTPLUG_PCI_ACPI=y
> CONFIG_HOTPLUG_PCI_ACPI_IBM=y
> CONFIG_HOTPLUG_PCI_CPCI=y
> CONFIG_HOTPLUG_PCI_CPCI_ZT5550=y
> CONFIG_HOTPLUG_PCI_CPCI_GENERIC=y
> CONFIG_HOTPLUG_PCI_SHPC=y
> CONFIG_RAPIDIO=y
> CONFIG_RAPIDIO_TSI721=y
> CONFIG_RAPIDIO_DISC_TIMEOUT=30
> CONFIG_RAPIDIO_ENABLE_RX_TX_PORTS=y
> CONFIG_RAPIDIO_DMA_ENGINE=y
> CONFIG_RAPIDIO_DEBUG=y
> CONFIG_RAPIDIO_TSI57X=y
> CONFIG_RAPIDIO_CPS_XX=y
> CONFIG_RAPIDIO_TSI568=y
> CONFIG_RAPIDIO_CPS_GEN2=y
> CONFIG_RAPIDIO_TSI500=y
> 
> #
> # Executable file formats / Emulations
> #
> CONFIG_BINFMT_ELF=y
> CONFIG_COMPAT_BINFMT_ELF=y
> CONFIG_ARCH_BINFMT_ELF_RANDOMIZE_PIE=y
> CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=y
> # CONFIG_HAVE_AOUT is not set
> CONFIG_BINFMT_MISC=y
> CONFIG_IA32_EMULATION=y
> CONFIG_IA32_AOUT=y
> CONFIG_X86_X32=y
> CONFIG_COMPAT=y
> CONFIG_COMPAT_FOR_U64_ALIGNMENT=y
> CONFIG_SYSVIPC_COMPAT=y
> CONFIG_KEYS_COMPAT=y
> CONFIG_HAVE_TEXT_POKE_SMP=y
> CONFIG_X86_DEV_DMA_OPS=y
> CONFIG_NET=y
> CONFIG_COMPAT_NETLINK_MESSAGES=y
> 
> #
> # Networking options
> #
> CONFIG_PACKET=y
> CONFIG_UNIX=y
> CONFIG_UNIX_DIAG=y
> CONFIG_XFRM=y
> CONFIG_XFRM_ALGO=y
> CONFIG_XFRM_USER=y
> CONFIG_XFRM_SUB_POLICY=y
> CONFIG_XFRM_MIGRATE=y
> CONFIG_XFRM_STATISTICS=y
> CONFIG_XFRM_IPCOMP=y
> CONFIG_NET_KEY=y
> CONFIG_NET_KEY_MIGRATE=y
> CONFIG_INET=y
> CONFIG_IP_MULTICAST=y
> CONFIG_IP_ADVANCED_ROUTER=y
> CONFIG_IP_FIB_TRIE_STATS=y
> CONFIG_IP_MULTIPLE_TABLES=y
> CONFIG_IP_ROUTE_MULTIPATH=y
> CONFIG_IP_ROUTE_VERBOSE=y
> CONFIG_IP_ROUTE_CLASSID=y
> CONFIG_IP_PNP=y
> CONFIG_IP_PNP_DHCP=y
> CONFIG_IP_PNP_BOOTP=y
> CONFIG_IP_PNP_RARP=y
> CONFIG_NET_IPIP=y
> CONFIG_NET_IPGRE_DEMUX=y
> CONFIG_NET_IPGRE=y
> CONFIG_NET_IPGRE_BROADCAST=y
> CONFIG_IP_MROUTE=y
> CONFIG_IP_MROUTE_MULTIPLE_TABLES=y
> CONFIG_IP_PIMSM_V1=y
> CONFIG_IP_PIMSM_V2=y
> CONFIG_ARPD=y
> CONFIG_SYN_COOKIES=y
> CONFIG_INET_AH=y
> CONFIG_INET_ESP=y
> CONFIG_INET_IPCOMP=y
> CONFIG_INET_XFRM_TUNNEL=y
> CONFIG_INET_TUNNEL=y
> CONFIG_INET_XFRM_MODE_TRANSPORT=y
> CONFIG_INET_XFRM_MODE_TUNNEL=y
> CONFIG_INET_XFRM_MODE_BEET=y
> CONFIG_INET_LRO=y
> CONFIG_INET_DIAG=y
> CONFIG_INET_TCP_DIAG=y
> CONFIG_INET_UDP_DIAG=y
> CONFIG_TCP_CONG_ADVANCED=y
> # CONFIG_TCP_CONG_BIC is not set
> CONFIG_TCP_CONG_CUBIC=y
> # CONFIG_TCP_CONG_WESTWOOD is not set
> # CONFIG_TCP_CONG_HTCP is not set
> # CONFIG_TCP_CONG_HSTCP is not set
> # CONFIG_TCP_CONG_HYBLA is not set
> # CONFIG_TCP_CONG_VEGAS is not set
> # CONFIG_TCP_CONG_SCALABLE is not set
> # CONFIG_TCP_CONG_LP is not set
> # CONFIG_TCP_CONG_VENO is not set
> # CONFIG_TCP_CONG_YEAH is not set
> # CONFIG_TCP_CONG_ILLINOIS is not set
> CONFIG_DEFAULT_CUBIC=y
> # CONFIG_DEFAULT_RENO is not set
> CONFIG_DEFAULT_TCP_CONG="cubic"
> CONFIG_TCP_MD5SIG=y
> CONFIG_IPV6=y
> CONFIG_IPV6_PRIVACY=y
> CONFIG_IPV6_ROUTER_PREF=y
> CONFIG_IPV6_ROUTE_INFO=y
> CONFIG_IPV6_OPTIMISTIC_DAD=y
> CONFIG_INET6_AH=y
> CONFIG_INET6_ESP=y
> CONFIG_INET6_IPCOMP=y
> CONFIG_IPV6_MIP6=y
> CONFIG_INET6_XFRM_TUNNEL=y
> CONFIG_INET6_TUNNEL=y
> CONFIG_INET6_XFRM_MODE_TRANSPORT=y
> CONFIG_INET6_XFRM_MODE_TUNNEL=y
> CONFIG_INET6_XFRM_MODE_BEET=y
> CONFIG_INET6_XFRM_MODE_ROUTEOPTIMIZATION=y
> CONFIG_IPV6_SIT=y
> CONFIG_IPV6_SIT_6RD=y
> CONFIG_IPV6_NDISC_NODETYPE=y
> CONFIG_IPV6_TUNNEL=y
> CONFIG_IPV6_MULTIPLE_TABLES=y
> CONFIG_IPV6_SUBTREES=y
> CONFIG_IPV6_MROUTE=y
> CONFIG_IPV6_MROUTE_MULTIPLE_TABLES=y
> CONFIG_IPV6_PIMSM_V2=y
> CONFIG_NETLABEL=y
> CONFIG_NETWORK_SECMARK=y
> CONFIG_NETWORK_PHY_TIMESTAMPING=y
> CONFIG_NETFILTER=y
> CONFIG_NETFILTER_DEBUG=y
> CONFIG_NETFILTER_ADVANCED=y
> CONFIG_BRIDGE_NETFILTER=y
> 
> #
> # Core Netfilter Configuration
> #
> CONFIG_NETFILTER_NETLINK=y
> CONFIG_NETFILTER_NETLINK_ACCT=y
> CONFIG_NETFILTER_NETLINK_QUEUE=y
> CONFIG_NETFILTER_NETLINK_LOG=y
> CONFIG_NF_CONNTRACK=y
> CONFIG_NF_CONNTRACK_MARK=y
> CONFIG_NF_CONNTRACK_SECMARK=y
> CONFIG_NF_CONNTRACK_ZONES=y
> CONFIG_NF_CONNTRACK_PROCFS=y
> CONFIG_NF_CONNTRACK_EVENTS=y
> CONFIG_NF_CONNTRACK_TIMEOUT=y
> CONFIG_NF_CONNTRACK_TIMESTAMP=y
> CONFIG_NF_CT_PROTO_DCCP=y
> CONFIG_NF_CT_PROTO_GRE=y
> CONFIG_NF_CT_PROTO_SCTP=y
> CONFIG_NF_CT_PROTO_UDPLITE=y
> CONFIG_NF_CONNTRACK_AMANDA=y
> CONFIG_NF_CONNTRACK_FTP=y
> CONFIG_NF_CONNTRACK_H323=y
> CONFIG_NF_CONNTRACK_IRC=y
> CONFIG_NF_CONNTRACK_BROADCAST=y
> CONFIG_NF_CONNTRACK_NETBIOS_NS=y
> CONFIG_NF_CONNTRACK_SNMP=y
> CONFIG_NF_CONNTRACK_PPTP=y
> CONFIG_NF_CONNTRACK_SANE=y
> CONFIG_NF_CONNTRACK_SIP=y
> CONFIG_NF_CONNTRACK_TFTP=y
> CONFIG_NF_CT_NETLINK=y
> CONFIG_NF_CT_NETLINK_TIMEOUT=y
> CONFIG_NF_CT_NETLINK_HELPER=y
> CONFIG_NETFILTER_NETLINK_QUEUE_CT=y
> CONFIG_NETFILTER_TPROXY=y
> CONFIG_NETFILTER_XTABLES=y
> 
> #
> # Xtables combined modules
> #
> CONFIG_NETFILTER_XT_MARK=y
> CONFIG_NETFILTER_XT_CONNMARK=y
> CONFIG_NETFILTER_XT_SET=y
> 
> #
> # Xtables targets
> #
> CONFIG_NETFILTER_XT_TARGET_AUDIT=y
> CONFIG_NETFILTER_XT_TARGET_CHECKSUM=y
> CONFIG_NETFILTER_XT_TARGET_CLASSIFY=y
> CONFIG_NETFILTER_XT_TARGET_CONNMARK=y
> CONFIG_NETFILTER_XT_TARGET_CONNSECMARK=y
> CONFIG_NETFILTER_XT_TARGET_CT=y
> CONFIG_NETFILTER_XT_TARGET_DSCP=y
> CONFIG_NETFILTER_XT_TARGET_HL=y
> CONFIG_NETFILTER_XT_TARGET_HMARK=y
> CONFIG_NETFILTER_XT_TARGET_IDLETIMER=y
> CONFIG_NETFILTER_XT_TARGET_LED=y
> CONFIG_NETFILTER_XT_TARGET_LOG=y
> CONFIG_NETFILTER_XT_TARGET_MARK=y
> CONFIG_NETFILTER_XT_TARGET_NFLOG=y
> CONFIG_NETFILTER_XT_TARGET_NFQUEUE=y
> CONFIG_NETFILTER_XT_TARGET_NOTRACK=y
> CONFIG_NETFILTER_XT_TARGET_RATEEST=y
> CONFIG_NETFILTER_XT_TARGET_TEE=y
> CONFIG_NETFILTER_XT_TARGET_TPROXY=y
> CONFIG_NETFILTER_XT_TARGET_TRACE=y
> CONFIG_NETFILTER_XT_TARGET_SECMARK=y
> CONFIG_NETFILTER_XT_TARGET_TCPMSS=y
> CONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP=y
> 
> #
> # Xtables matches
> #
> CONFIG_NETFILTER_XT_MATCH_ADDRTYPE=y
> CONFIG_NETFILTER_XT_MATCH_CLUSTER=y
> CONFIG_NETFILTER_XT_MATCH_COMMENT=y
> CONFIG_NETFILTER_XT_MATCH_CONNBYTES=y
> CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=y
> CONFIG_NETFILTER_XT_MATCH_CONNMARK=y
> CONFIG_NETFILTER_XT_MATCH_CONNTRACK=y
> CONFIG_NETFILTER_XT_MATCH_CPU=y
> CONFIG_NETFILTER_XT_MATCH_DCCP=y
> CONFIG_NETFILTER_XT_MATCH_DEVGROUP=y
> CONFIG_NETFILTER_XT_MATCH_DSCP=y
> CONFIG_NETFILTER_XT_MATCH_ECN=y
> CONFIG_NETFILTER_XT_MATCH_ESP=y
> CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=y
> CONFIG_NETFILTER_XT_MATCH_HELPER=y
> CONFIG_NETFILTER_XT_MATCH_HL=y
> CONFIG_NETFILTER_XT_MATCH_IPRANGE=y
> CONFIG_NETFILTER_XT_MATCH_IPVS=y
> CONFIG_NETFILTER_XT_MATCH_LENGTH=y
> CONFIG_NETFILTER_XT_MATCH_LIMIT=y
> CONFIG_NETFILTER_XT_MATCH_MAC=y
> CONFIG_NETFILTER_XT_MATCH_MARK=y
> CONFIG_NETFILTER_XT_MATCH_MULTIPORT=y
> CONFIG_NETFILTER_XT_MATCH_NFACCT=y
> CONFIG_NETFILTER_XT_MATCH_OSF=y
> CONFIG_NETFILTER_XT_MATCH_OWNER=y
> CONFIG_NETFILTER_XT_MATCH_POLICY=y
> CONFIG_NETFILTER_XT_MATCH_PHYSDEV=y
> CONFIG_NETFILTER_XT_MATCH_PKTTYPE=y
> CONFIG_NETFILTER_XT_MATCH_QUOTA=y
> CONFIG_NETFILTER_XT_MATCH_RATEEST=y
> CONFIG_NETFILTER_XT_MATCH_REALM=y
> CONFIG_NETFILTER_XT_MATCH_RECENT=y
> CONFIG_NETFILTER_XT_MATCH_SCTP=y
> CONFIG_NETFILTER_XT_MATCH_SOCKET=y
> CONFIG_NETFILTER_XT_MATCH_STATE=y
> CONFIG_NETFILTER_XT_MATCH_STATISTIC=y
> CONFIG_NETFILTER_XT_MATCH_STRING=y
> CONFIG_NETFILTER_XT_MATCH_TCPMSS=y
> CONFIG_NETFILTER_XT_MATCH_TIME=y
> CONFIG_NETFILTER_XT_MATCH_U32=y
> CONFIG_IP_SET=y
> CONFIG_IP_SET_MAX=256
> CONFIG_IP_SET_BITMAP_IP=y
> CONFIG_IP_SET_BITMAP_IPMAC=y
> CONFIG_IP_SET_BITMAP_PORT=y
> CONFIG_IP_SET_HASH_IP=y
> CONFIG_IP_SET_HASH_IPPORT=y
> CONFIG_IP_SET_HASH_IPPORTIP=y
> CONFIG_IP_SET_HASH_IPPORTNET=y
> CONFIG_IP_SET_HASH_NET=y
> CONFIG_IP_SET_HASH_NETPORT=y
> CONFIG_IP_SET_HASH_NETIFACE=y
> CONFIG_IP_SET_LIST_SET=y
> CONFIG_IP_VS=y
> CONFIG_IP_VS_IPV6=y
> CONFIG_IP_VS_DEBUG=y
> CONFIG_IP_VS_TAB_BITS=12
> 
> #
> # IPVS transport protocol load balancing support
> #
> CONFIG_IP_VS_PROTO_TCP=y
> CONFIG_IP_VS_PROTO_UDP=y
> CONFIG_IP_VS_PROTO_AH_ESP=y
> CONFIG_IP_VS_PROTO_ESP=y
> CONFIG_IP_VS_PROTO_AH=y
> CONFIG_IP_VS_PROTO_SCTP=y
> 
> #
> # IPVS scheduler
> #
> CONFIG_IP_VS_RR=y
> CONFIG_IP_VS_WRR=y
> CONFIG_IP_VS_LC=y
> CONFIG_IP_VS_WLC=y
> CONFIG_IP_VS_LBLC=y
> CONFIG_IP_VS_LBLCR=y
> CONFIG_IP_VS_DH=y
> CONFIG_IP_VS_SH=y
> CONFIG_IP_VS_SED=y
> CONFIG_IP_VS_NQ=y
> 
> #
> # IPVS SH scheduler
> #
> CONFIG_IP_VS_SH_TAB_BITS=8
> 
> #
> # IPVS application helper
> #
> CONFIG_IP_VS_FTP=y
> CONFIG_IP_VS_NFCT=y
> CONFIG_IP_VS_PE_SIP=y
> 
> #
> # IP: Netfilter Configuration
> #
> CONFIG_NF_DEFRAG_IPV4=y
> CONFIG_NF_CONNTRACK_IPV4=y
> CONFIG_NF_CONNTRACK_PROC_COMPAT=y
> CONFIG_IP_NF_QUEUE=y
> CONFIG_IP_NF_IPTABLES=y
> CONFIG_IP_NF_MATCH_AH=y
> CONFIG_IP_NF_MATCH_ECN=y
> CONFIG_IP_NF_MATCH_RPFILTER=y
> CONFIG_IP_NF_MATCH_TTL=y
> CONFIG_IP_NF_FILTER=y
> CONFIG_IP_NF_TARGET_REJECT=y
> CONFIG_IP_NF_TARGET_ULOG=y
> CONFIG_NF_NAT=y
> CONFIG_NF_NAT_NEEDED=y
> CONFIG_IP_NF_TARGET_MASQUERADE=y
> CONFIG_IP_NF_TARGET_NETMAP=y
> CONFIG_IP_NF_TARGET_REDIRECT=y
> CONFIG_NF_NAT_SNMP_BASIC=y
> CONFIG_NF_NAT_PROTO_DCCP=y
> CONFIG_NF_NAT_PROTO_GRE=y
> CONFIG_NF_NAT_PROTO_UDPLITE=y
> CONFIG_NF_NAT_PROTO_SCTP=y
> CONFIG_NF_NAT_FTP=y
> CONFIG_NF_NAT_IRC=y
> CONFIG_NF_NAT_TFTP=y
> CONFIG_NF_NAT_AMANDA=y
> CONFIG_NF_NAT_PPTP=y
> CONFIG_NF_NAT_H323=y
> CONFIG_NF_NAT_SIP=y
> CONFIG_IP_NF_MANGLE=y
> CONFIG_IP_NF_TARGET_CLUSTERIP=y
> CONFIG_IP_NF_TARGET_ECN=y
> CONFIG_IP_NF_TARGET_TTL=y
> CONFIG_IP_NF_RAW=y
> CONFIG_IP_NF_SECURITY=y
> CONFIG_IP_NF_ARPTABLES=y
> CONFIG_IP_NF_ARPFILTER=y
> CONFIG_IP_NF_ARP_MANGLE=y
> 
> #
> # IPv6: Netfilter Configuration
> #
> CONFIG_NF_DEFRAG_IPV6=y
> CONFIG_NF_CONNTRACK_IPV6=y
> CONFIG_IP6_NF_IPTABLES=y
> CONFIG_IP6_NF_MATCH_AH=y
> CONFIG_IP6_NF_MATCH_EUI64=y
> CONFIG_IP6_NF_MATCH_FRAG=y
> CONFIG_IP6_NF_MATCH_OPTS=y
> CONFIG_IP6_NF_MATCH_HL=y
> CONFIG_IP6_NF_MATCH_IPV6HEADER=y
> CONFIG_IP6_NF_MATCH_MH=y
> CONFIG_IP6_NF_MATCH_RPFILTER=y
> CONFIG_IP6_NF_MATCH_RT=y
> CONFIG_IP6_NF_TARGET_HL=y
> CONFIG_IP6_NF_FILTER=y
> CONFIG_IP6_NF_TARGET_REJECT=y
> CONFIG_IP6_NF_MANGLE=y
> CONFIG_IP6_NF_RAW=y
> CONFIG_IP6_NF_SECURITY=y
> 
> #
> # DECnet: Netfilter Configuration
> #
> CONFIG_DECNET_NF_GRABULATOR=y
> CONFIG_BRIDGE_NF_EBTABLES=y
> CONFIG_BRIDGE_EBT_BROUTE=y
> CONFIG_BRIDGE_EBT_T_FILTER=y
> CONFIG_BRIDGE_EBT_T_NAT=y
> CONFIG_BRIDGE_EBT_802_3=y
> CONFIG_BRIDGE_EBT_AMONG=y
> CONFIG_BRIDGE_EBT_ARP=y
> CONFIG_BRIDGE_EBT_IP=y
> CONFIG_BRIDGE_EBT_IP6=y
> CONFIG_BRIDGE_EBT_LIMIT=y
> CONFIG_BRIDGE_EBT_MARK=y
> CONFIG_BRIDGE_EBT_PKTTYPE=y
> CONFIG_BRIDGE_EBT_STP=y
> CONFIG_BRIDGE_EBT_VLAN=y
> CONFIG_BRIDGE_EBT_ARPREPLY=y
> CONFIG_BRIDGE_EBT_DNAT=y
> CONFIG_BRIDGE_EBT_MARK_T=y
> CONFIG_BRIDGE_EBT_REDIRECT=y
> CONFIG_BRIDGE_EBT_SNAT=y
> CONFIG_BRIDGE_EBT_LOG=y
> CONFIG_BRIDGE_EBT_ULOG=y
> CONFIG_BRIDGE_EBT_NFLOG=y
> CONFIG_IP_DCCP=y
> CONFIG_INET_DCCP_DIAG=y
> 
> #
> # DCCP CCIDs Configuration (EXPERIMENTAL)
> #
> CONFIG_IP_DCCP_CCID2_DEBUG=y
> CONFIG_IP_DCCP_CCID3=y
> CONFIG_IP_DCCP_CCID3_DEBUG=y
> CONFIG_IP_DCCP_TFRC_LIB=y
> CONFIG_IP_DCCP_TFRC_DEBUG=y
> 
> #
> # DCCP Kernel Hacking
> #
> CONFIG_IP_DCCP_DEBUG=y
> CONFIG_IP_SCTP=y
> CONFIG_SCTP_DBG_MSG=y
> CONFIG_SCTP_DBG_OBJCNT=y
> # CONFIG_SCTP_HMAC_NONE is not set
> # CONFIG_SCTP_HMAC_SHA1 is not set
> CONFIG_SCTP_HMAC_MD5=y
> CONFIG_RDS=y
> CONFIG_RDS_RDMA=y
> CONFIG_RDS_TCP=y
> CONFIG_RDS_DEBUG=y
> CONFIG_TIPC=y
> CONFIG_TIPC_ADVANCED=y
> CONFIG_TIPC_PORTS=8191
> CONFIG_TIPC_LOG=0
> CONFIG_TIPC_DEBUG=y
> CONFIG_ATM=y
> CONFIG_ATM_CLIP=y
> # CONFIG_ATM_CLIP_NO_ICMP is not set
> CONFIG_ATM_LANE=y
> CONFIG_ATM_MPOA=y
> CONFIG_ATM_BR2684=y
> CONFIG_ATM_BR2684_IPFILTER=y
> CONFIG_L2TP=y
> CONFIG_L2TP_DEBUGFS=y
> CONFIG_L2TP_V3=y
> CONFIG_L2TP_IP=y
> CONFIG_L2TP_ETH=y
> CONFIG_STP=y
> CONFIG_GARP=y
> CONFIG_BRIDGE=y
> CONFIG_BRIDGE_IGMP_SNOOPING=y
> CONFIG_NET_DSA=y
> CONFIG_NET_DSA_TAG_DSA=y
> CONFIG_NET_DSA_TAG_EDSA=y
> CONFIG_NET_DSA_TAG_TRAILER=y
> CONFIG_VLAN_8021Q=y
> CONFIG_VLAN_8021Q_GVRP=y
> CONFIG_DECNET=y
> CONFIG_DECNET_ROUTER=y
> CONFIG_LLC=y
> # CONFIG_LLC2 is not set
> CONFIG_IPX=y
> CONFIG_IPX_INTERN=y
> CONFIG_ATALK=y
> CONFIG_DEV_APPLETALK=y
> CONFIG_IPDDP=y
> CONFIG_IPDDP_ENCAP=y
> CONFIG_IPDDP_DECAP=y
> CONFIG_X25=y
> CONFIG_LAPB=y
> CONFIG_WAN_ROUTER=y
> CONFIG_PHONET=y
> CONFIG_IEEE802154=y
> CONFIG_IEEE802154_6LOWPAN=y
> CONFIG_MAC802154=y
> CONFIG_NET_SCHED=y
> 
> #
> # Queueing/Scheduling
> #
> CONFIG_NET_SCH_CBQ=y
> CONFIG_NET_SCH_HTB=y
> CONFIG_NET_SCH_HFSC=y
> CONFIG_NET_SCH_ATM=y
> CONFIG_NET_SCH_PRIO=y
> CONFIG_NET_SCH_MULTIQ=y
> CONFIG_NET_SCH_RED=y
> CONFIG_NET_SCH_SFB=y
> CONFIG_NET_SCH_SFQ=y
> CONFIG_NET_SCH_TEQL=y
> CONFIG_NET_SCH_TBF=y
> CONFIG_NET_SCH_GRED=y
> CONFIG_NET_SCH_DSMARK=y
> CONFIG_NET_SCH_NETEM=y
> CONFIG_NET_SCH_DRR=y
> CONFIG_NET_SCH_MQPRIO=y
> CONFIG_NET_SCH_CHOKE=y
> CONFIG_NET_SCH_QFQ=y
> CONFIG_NET_SCH_CODEL=y
> CONFIG_NET_SCH_FQ_CODEL=y
> CONFIG_NET_SCH_INGRESS=y
> CONFIG_NET_SCH_PLUG=y
> 
> #
> # Classification
> #
> CONFIG_NET_CLS=y
> CONFIG_NET_CLS_BASIC=y
> CONFIG_NET_CLS_TCINDEX=y
> CONFIG_NET_CLS_ROUTE4=y
> CONFIG_NET_CLS_FW=y
> CONFIG_NET_CLS_U32=y
> CONFIG_CLS_U32_PERF=y
> CONFIG_CLS_U32_MARK=y
> CONFIG_NET_CLS_RSVP=y
> CONFIG_NET_CLS_RSVP6=y
> CONFIG_NET_CLS_FLOW=y
> CONFIG_NET_CLS_CGROUP=y
> CONFIG_NET_EMATCH=y
> CONFIG_NET_EMATCH_STACK=32
> CONFIG_NET_EMATCH_CMP=y
> CONFIG_NET_EMATCH_NBYTE=y
> CONFIG_NET_EMATCH_U32=y
> CONFIG_NET_EMATCH_META=y
> CONFIG_NET_EMATCH_TEXT=y
> CONFIG_NET_CLS_ACT=y
> CONFIG_NET_ACT_POLICE=y
> CONFIG_NET_ACT_GACT=y
> CONFIG_GACT_PROB=y
> CONFIG_NET_ACT_MIRRED=y
> CONFIG_NET_ACT_IPT=y
> CONFIG_NET_ACT_NAT=y
> CONFIG_NET_ACT_PEDIT=y
> CONFIG_NET_ACT_SIMP=y
> CONFIG_NET_ACT_SKBEDIT=y
> CONFIG_NET_ACT_CSUM=y
> CONFIG_NET_CLS_IND=y
> CONFIG_NET_SCH_FIFO=y
> CONFIG_DCB=y
> CONFIG_DNS_RESOLVER=y
> CONFIG_BATMAN_ADV=y
> CONFIG_BATMAN_ADV_BLA=y
> CONFIG_BATMAN_ADV_DEBUG=y
> CONFIG_OPENVSWITCH=y
> CONFIG_RPS=y
> CONFIG_RFS_ACCEL=y
> CONFIG_XPS=y
> CONFIG_NETPRIO_CGROUP=y
> CONFIG_BQL=y
> 
> #
> # Network testing
> #
> # CONFIG_NET_PKTGEN is not set
> CONFIG_NET_DROP_MONITOR=y
> CONFIG_HAMRADIO=y
> 
> #
> # Packet Radio protocols
> #
> CONFIG_AX25=y
> CONFIG_AX25_DAMA_SLAVE=y
> CONFIG_NETROM=y
> CONFIG_ROSE=y
> 
> #
> # AX.25 network device drivers
> #
> CONFIG_MKISS=y
> CONFIG_6PACK=y
> CONFIG_BPQETHER=y
> CONFIG_BAYCOM_SER_FDX=y
> CONFIG_BAYCOM_SER_HDX=y
> CONFIG_BAYCOM_PAR=y
> CONFIG_YAM=y
> CONFIG_CAN=y
> CONFIG_CAN_RAW=y
> CONFIG_CAN_BCM=y
> CONFIG_CAN_GW=y
> 
> #
> # CAN Device Drivers
> #
> CONFIG_CAN_VCAN=y
> CONFIG_CAN_SLCAN=y
> CONFIG_CAN_DEV=y
> CONFIG_CAN_CALC_BITTIMING=y
> # CONFIG_CAN_MCP251X is not set
> # CONFIG_PCH_CAN is not set
> # CONFIG_CAN_SJA1000 is not set
> # CONFIG_CAN_C_CAN is not set
> # CONFIG_CAN_CC770 is not set
> 
> #
> # CAN USB interfaces
> #
> # CONFIG_CAN_EMS_USB is not set
> # CONFIG_CAN_ESD_USB2 is not set
> CONFIG_CAN_PEAK_USB=y
> CONFIG_CAN_SOFTING=y
> CONFIG_CAN_SOFTING_CS=y
> CONFIG_CAN_DEBUG_DEVICES=y
> CONFIG_IRDA=y
> 
> #
> # IrDA protocols
> #
> CONFIG_IRLAN=y
> CONFIG_IRNET=y
> CONFIG_IRCOMM=y
> CONFIG_IRDA_ULTRA=y
> 
> #
> # IrDA options
> #
> CONFIG_IRDA_CACHE_LAST_LSAP=y
> CONFIG_IRDA_FAST_RR=y
> CONFIG_IRDA_DEBUG=y
> 
> #
> # Infrared-port device drivers
> #
> 
> #
> # SIR device drivers
> #
> CONFIG_IRTTY_SIR=y
> 
> #
> # Dongle support
> #
> CONFIG_DONGLE=y
> # CONFIG_ESI_DONGLE is not set
> # CONFIG_ACTISYS_DONGLE is not set
> # CONFIG_TEKRAM_DONGLE is not set
> # CONFIG_TOIM3232_DONGLE is not set
> # CONFIG_LITELINK_DONGLE is not set
> # CONFIG_MA600_DONGLE is not set
> # CONFIG_GIRBIL_DONGLE is not set
> # CONFIG_MCP2120_DONGLE is not set
> # CONFIG_OLD_BELKIN_DONGLE is not set
> # CONFIG_ACT200L_DONGLE is not set
> # CONFIG_KINGSUN_DONGLE is not set
> # CONFIG_KSDAZZLE_DONGLE is not set
> # CONFIG_KS959_DONGLE is not set
> 
> #
> # FIR device drivers
> #
> # CONFIG_USB_IRDA is not set
> # CONFIG_SIGMATEL_FIR is not set
> # CONFIG_NSC_FIR is not set
> # CONFIG_WINBOND_FIR is not set
> # CONFIG_SMC_IRCC_FIR is not set
> # CONFIG_ALI_FIR is not set
> # CONFIG_VLSI_FIR is not set
> # CONFIG_VIA_FIR is not set
> # CONFIG_MCS_FIR is not set
> CONFIG_BT=y
> CONFIG_BT_RFCOMM=y
> CONFIG_BT_RFCOMM_TTY=y
> CONFIG_BT_BNEP=y
> CONFIG_BT_BNEP_MC_FILTER=y
> CONFIG_BT_BNEP_PROTO_FILTER=y
> CONFIG_BT_CMTP=y
> CONFIG_BT_HIDP=y
> 
> #
> # Bluetooth device drivers
> #
> CONFIG_BT_HCIBTUSB=y
> CONFIG_BT_HCIBTSDIO=y
> CONFIG_BT_HCIUART=y
> CONFIG_BT_HCIUART_H4=y
> CONFIG_BT_HCIUART_BCSP=y
> CONFIG_BT_HCIUART_ATH3K=y
> CONFIG_BT_HCIUART_LL=y
> # CONFIG_BT_HCIBCM203X is not set
> # CONFIG_BT_HCIBPA10X is not set
> # CONFIG_BT_HCIBFUSB is not set
> # CONFIG_BT_HCIDTL1 is not set
> # CONFIG_BT_HCIBT3C is not set
> # CONFIG_BT_HCIBLUECARD is not set
> # CONFIG_BT_HCIBTUART is not set
> CONFIG_BT_HCIVHCI=y
> # CONFIG_BT_MRVL is not set
> CONFIG_BT_ATH3K=y
> # CONFIG_BT_WILINK is not set
> CONFIG_AF_RXRPC=y
> CONFIG_AF_RXRPC_DEBUG=y
> CONFIG_RXKAD=y
> CONFIG_FIB_RULES=y
> CONFIG_WIRELESS=y
> CONFIG_WIRELESS_EXT=y
> CONFIG_WEXT_CORE=y
> CONFIG_WEXT_PROC=y
> CONFIG_WEXT_SPY=y
> CONFIG_WEXT_PRIV=y
> CONFIG_CFG80211=y
> CONFIG_NL80211_TESTMODE=y
> CONFIG_CFG80211_DEVELOPER_WARNINGS=y
> CONFIG_CFG80211_REG_DEBUG=y
> CONFIG_CFG80211_DEFAULT_PS=y
> CONFIG_CFG80211_DEBUGFS=y
> CONFIG_CFG80211_INTERNAL_REGDB=y
> CONFIG_CFG80211_WEXT=y
> CONFIG_LIB80211=y
> CONFIG_LIB80211_CRYPT_WEP=y
> CONFIG_LIB80211_CRYPT_CCMP=y
> CONFIG_LIB80211_CRYPT_TKIP=y
> CONFIG_LIB80211_DEBUG=y
> CONFIG_MAC80211=y
> CONFIG_MAC80211_HAS_RC=y
> CONFIG_MAC80211_RC_PID=y
> CONFIG_MAC80211_RC_MINSTREL=y
> CONFIG_MAC80211_RC_MINSTREL_HT=y
> # CONFIG_MAC80211_RC_DEFAULT_PID is not set
> CONFIG_MAC80211_RC_DEFAULT_MINSTREL=y
> CONFIG_MAC80211_RC_DEFAULT="minstrel_ht"
> CONFIG_MAC80211_MESH=y
> CONFIG_MAC80211_LEDS=y
> CONFIG_MAC80211_DEBUGFS=y
> CONFIG_MAC80211_MESSAGE_TRACING=y
> CONFIG_MAC80211_DEBUG_MENU=y
> CONFIG_MAC80211_NOINLINE=y
> CONFIG_MAC80211_VERBOSE_DEBUG=y
> CONFIG_MAC80211_MLME_DEBUG=y
> CONFIG_MAC80211_STA_DEBUG=y
> CONFIG_MAC80211_HT_DEBUG=y
> CONFIG_MAC80211_IBSS_DEBUG=y
> CONFIG_MAC80211_PS_DEBUG=y
> CONFIG_MAC80211_MPL_DEBUG=y
> CONFIG_MAC80211_MPATH_DEBUG=y
> CONFIG_MAC80211_MHWMP_DEBUG=y
> CONFIG_MAC80211_MESH_SYNC_DEBUG=y
> CONFIG_MAC80211_TDLS_DEBUG=y
> CONFIG_MAC80211_DEBUG_COUNTERS=y
> CONFIG_WIMAX=y
> CONFIG_WIMAX_DEBUG_LEVEL=8
> CONFIG_RFKILL=y
> CONFIG_RFKILL_LEDS=y
> CONFIG_RFKILL_INPUT=y
> CONFIG_RFKILL_REGULATOR=y
> CONFIG_NET_9P=y
> CONFIG_NET_9P_VIRTIO=y
> CONFIG_NET_9P_RDMA=y
> CONFIG_NET_9P_DEBUG=y
> CONFIG_CAIF=y
> CONFIG_CAIF_DEBUG=y
> CONFIG_CAIF_NETDEV=y
> CONFIG_CAIF_USB=y
> CONFIG_CEPH_LIB=y
> CONFIG_CEPH_LIB_PRETTYDEBUG=y
> CONFIG_CEPH_LIB_USE_DNS_RESOLVER=y
> CONFIG_NFC=y
> CONFIG_NFC_NCI=y
> CONFIG_NFC_HCI=y
> CONFIG_NFC_SHDLC=y
> CONFIG_NFC_LLCP=y
> 
> #
> # Near Field Communication (NFC) devices
> #
> CONFIG_PN544_NFC=y
> CONFIG_PN544_HCI_NFC=y
> CONFIG_NFC_PN533=y
> # CONFIG_NFC_WILINK is not set
> CONFIG_HAVE_BPF_JIT=y
> 
> #
> # Device Drivers
> #
> 
> #
> # Generic Driver Options
> #
> CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug"
> CONFIG_DEVTMPFS=y
> CONFIG_DEVTMPFS_MOUNT=y
> CONFIG_STANDALONE=y
> CONFIG_PREVENT_FIRMWARE_BUILD=y
> CONFIG_FW_LOADER=y
> CONFIG_FIRMWARE_IN_KERNEL=y
> CONFIG_EXTRA_FIRMWARE=""
> CONFIG_DEBUG_DRIVER=y
> CONFIG_DEBUG_DEVRES=y
> CONFIG_SYS_HYPERVISOR=y
> # CONFIG_GENERIC_CPU_DEVICES is not set
> CONFIG_REGMAP=y
> CONFIG_REGMAP_I2C=y
> CONFIG_REGMAP_SPI=y
> CONFIG_REGMAP_IRQ=y
> CONFIG_DMA_SHARED_BUFFER=y
> CONFIG_CONNECTOR=y
> CONFIG_PROC_EVENTS=y
> CONFIG_MTD=y
> CONFIG_MTD_REDBOOT_PARTS=y
> CONFIG_MTD_REDBOOT_DIRECTORY_BLOCK=-1
> CONFIG_MTD_REDBOOT_PARTS_UNALLOCATED=y
> CONFIG_MTD_REDBOOT_PARTS_READONLY=y
> CONFIG_MTD_CMDLINE_PARTS=y
> CONFIG_MTD_AR7_PARTS=y
> 
> #
> # User Modules And Translation Layers
> #
> CONFIG_MTD_CHAR=y
> CONFIG_HAVE_MTD_OTP=y
> CONFIG_MTD_BLKDEVS=y
> CONFIG_MTD_BLOCK=y
> CONFIG_FTL=y
> CONFIG_NFTL=y
> CONFIG_NFTL_RW=y
> CONFIG_INFTL=y
> CONFIG_RFD_FTL=y
> CONFIG_SSFDC=y
> CONFIG_SM_FTL=y
> CONFIG_MTD_OOPS=y
> CONFIG_MTD_SWAP=y
> 
> #
> # RAM/ROM/Flash chip drivers
> #
> CONFIG_MTD_CFI=y
> CONFIG_MTD_JEDECPROBE=y
> CONFIG_MTD_GEN_PROBE=y
> CONFIG_MTD_CFI_ADV_OPTIONS=y
> CONFIG_MTD_CFI_NOSWAP=y
> # CONFIG_MTD_CFI_BE_BYTE_SWAP is not set
> # CONFIG_MTD_CFI_LE_BYTE_SWAP is not set
> CONFIG_MTD_CFI_GEOMETRY=y
> CONFIG_MTD_MAP_BANK_WIDTH_1=y
> CONFIG_MTD_MAP_BANK_WIDTH_2=y
> CONFIG_MTD_MAP_BANK_WIDTH_4=y
> CONFIG_MTD_MAP_BANK_WIDTH_8=y
> CONFIG_MTD_MAP_BANK_WIDTH_16=y
> CONFIG_MTD_MAP_BANK_WIDTH_32=y
> CONFIG_MTD_CFI_I1=y
> CONFIG_MTD_CFI_I2=y
> CONFIG_MTD_CFI_I4=y
> CONFIG_MTD_CFI_I8=y
> CONFIG_MTD_OTP=y
> CONFIG_MTD_CFI_INTELEXT=y
> CONFIG_MTD_CFI_AMDSTD=y
> CONFIG_MTD_CFI_STAA=y
> CONFIG_MTD_CFI_UTIL=y
> CONFIG_MTD_RAM=y
> CONFIG_MTD_ROM=y
> CONFIG_MTD_ABSENT=y
> 
> #
> # Mapping drivers for chip access
> #
> CONFIG_MTD_COMPLEX_MAPPINGS=y
> CONFIG_MTD_PHYSMAP=y
> CONFIG_MTD_PHYSMAP_COMPAT=y
> CONFIG_MTD_PHYSMAP_START=0x8000000
> CONFIG_MTD_PHYSMAP_LEN=0
> CONFIG_MTD_PHYSMAP_BANKWIDTH=2
> CONFIG_MTD_SC520CDP=y
> CONFIG_MTD_NETSC520=y
> CONFIG_MTD_TS5500=y
> CONFIG_MTD_SBC_GXX=y
> CONFIG_MTD_AMD76XROM=y
> CONFIG_MTD_ICHXROM=y
> CONFIG_MTD_ESB2ROM=y
> CONFIG_MTD_CK804XROM=y
> CONFIG_MTD_SCB2_FLASH=y
> CONFIG_MTD_NETtel=y
> CONFIG_MTD_L440GX=y
> CONFIG_MTD_PCI=y
> CONFIG_MTD_PCMCIA=y
> CONFIG_MTD_PCMCIA_ANONYMOUS=y
> CONFIG_MTD_GPIO_ADDR=y
> CONFIG_MTD_INTEL_VR_NOR=y
> CONFIG_MTD_PLATRAM=y
> CONFIG_MTD_LATCH_ADDR=y
> 
> #
> # Self-contained MTD device drivers
> #
> # CONFIG_MTD_PMC551 is not set
> CONFIG_MTD_DATAFLASH=y
> CONFIG_MTD_DATAFLASH_WRITE_VERIFY=y
> CONFIG_MTD_DATAFLASH_OTP=y
> CONFIG_MTD_M25P80=y
> CONFIG_M25PXX_USE_FAST_READ=y
> CONFIG_MTD_SST25L=y
> CONFIG_MTD_SLRAM=y
> CONFIG_MTD_PHRAM=y
> CONFIG_MTD_MTDRAM=y
> CONFIG_MTDRAM_TOTAL_SIZE=4096
> CONFIG_MTDRAM_ERASE_SIZE=128
> CONFIG_MTDRAM_ABS_POS=0
> CONFIG_MTD_BLOCK2MTD=y
> 
> #
> # Disk-On-Chip Device Drivers
> #
> CONFIG_MTD_DOC2000=y
> CONFIG_MTD_DOC2001=y
> CONFIG_MTD_DOC2001PLUS=y
> CONFIG_MTD_DOCG3=y
> CONFIG_BCH_CONST_M=14
> CONFIG_BCH_CONST_T=4
> CONFIG_MTD_DOCPROBE=y
> CONFIG_MTD_DOCECC=y
> CONFIG_MTD_DOCPROBE_ADVANCED=y
> CONFIG_MTD_DOCPROBE_ADDRESS=0x0
> CONFIG_MTD_DOCPROBE_HIGH=y
> CONFIG_MTD_DOCPROBE_55AA=y
> CONFIG_MTD_NAND_ECC=y
> CONFIG_MTD_NAND_ECC_SMC=y
> CONFIG_MTD_NAND=y
> CONFIG_MTD_NAND_VERIFY_WRITE=y
> CONFIG_MTD_NAND_BCH=y
> CONFIG_MTD_NAND_ECC_BCH=y
> CONFIG_MTD_SM_COMMON=y
> CONFIG_MTD_NAND_MUSEUM_IDS=y
> CONFIG_MTD_NAND_DENALI=y
> CONFIG_MTD_NAND_DENALI_SCRATCH_REG_ADDR=0xFF108018
> CONFIG_MTD_NAND_IDS=y
> CONFIG_MTD_NAND_RICOH=y
> CONFIG_MTD_NAND_DISKONCHIP=y
> CONFIG_MTD_NAND_DISKONCHIP_PROBE_ADVANCED=y
> CONFIG_MTD_NAND_DISKONCHIP_PROBE_ADDRESS=0
> CONFIG_MTD_NAND_DISKONCHIP_PROBE_HIGH=y
> CONFIG_MTD_NAND_DISKONCHIP_BBTWRITE=y
> CONFIG_MTD_NAND_DOCG4=y
> CONFIG_MTD_NAND_CAFE=y
> CONFIG_MTD_NAND_NANDSIM=y
> CONFIG_MTD_NAND_PLATFORM=y
> CONFIG_MTD_ALAUDA=y
> CONFIG_MTD_ONENAND=y
> CONFIG_MTD_ONENAND_VERIFY_WRITE=y
> CONFIG_MTD_ONENAND_GENERIC=y
> CONFIG_MTD_ONENAND_OTP=y
> CONFIG_MTD_ONENAND_2X_PROGRAM=y
> CONFIG_MTD_ONENAND_SIM=y
> 
> #
> # LPDDR flash memory drivers
> #
> CONFIG_MTD_LPDDR=y
> CONFIG_MTD_QINFO_PROBE=y
> CONFIG_MTD_UBI=y
> CONFIG_MTD_UBI_WL_THRESHOLD=4096
> CONFIG_MTD_UBI_BEB_RESERVE=1
> CONFIG_MTD_UBI_GLUEBI=y
> CONFIG_PARPORT=y
> CONFIG_PARPORT_PC=y
> CONFIG_PARPORT_SERIAL=y
> CONFIG_PARPORT_PC_FIFO=y
> CONFIG_PARPORT_PC_SUPERIO=y
> CONFIG_PARPORT_PC_PCMCIA=y
> # CONFIG_PARPORT_GSC is not set
> CONFIG_PARPORT_AX88796=y
> CONFIG_PARPORT_1284=y
> CONFIG_PARPORT_NOT_PC=y
> CONFIG_PNP=y
> CONFIG_PNP_DEBUG_MESSAGES=y
> 
> #
> # Protocols
> #
> CONFIG_PNPACPI=y
> CONFIG_BLK_DEV=y
> CONFIG_BLK_DEV_FD=y
> # CONFIG_PARIDE is not set
> CONFIG_BLK_DEV_PCIESSD_MTIP32XX=y
> CONFIG_BLK_CPQ_DA=y
> CONFIG_BLK_CPQ_CISS_DA=y
> CONFIG_CISS_SCSI_TAPE=y
> CONFIG_BLK_DEV_DAC960=y
> CONFIG_BLK_DEV_UMEM=y
> # CONFIG_BLK_DEV_COW_COMMON is not set
> CONFIG_BLK_DEV_LOOP=y
> CONFIG_BLK_DEV_LOOP_MIN_COUNT=8
> CONFIG_BLK_DEV_CRYPTOLOOP=y
> CONFIG_BLK_DEV_DRBD=y
> CONFIG_DRBD_FAULT_INJECTION=y
> CONFIG_BLK_DEV_NBD=y
> CONFIG_BLK_DEV_NVME=y
> CONFIG_BLK_DEV_OSD=y
> CONFIG_BLK_DEV_SX8=y
> CONFIG_BLK_DEV_UB=y
> CONFIG_BLK_DEV_RAM=y
> CONFIG_BLK_DEV_RAM_COUNT=16
> CONFIG_BLK_DEV_RAM_SIZE=16384
> CONFIG_BLK_DEV_XIP=y
> CONFIG_CDROM_PKTCDVD=y
> CONFIG_CDROM_PKTCDVD_BUFFERS=8
> CONFIG_CDROM_PKTCDVD_WCACHE=y
> CONFIG_ATA_OVER_ETH=y
> CONFIG_XEN_BLKDEV_FRONTEND=y
> CONFIG_XEN_BLKDEV_BACKEND=y
> CONFIG_VIRTIO_BLK=y
> CONFIG_BLK_DEV_HD=y
> CONFIG_BLK_DEV_RBD=y
> 
> #
> # Misc devices
> #
> CONFIG_SENSORS_LIS3LV02D=y
> CONFIG_AD525X_DPOT=y
> CONFIG_AD525X_DPOT_I2C=y
> CONFIG_AD525X_DPOT_SPI=y
> CONFIG_IBM_ASM=y
> CONFIG_PHANTOM=y
> CONFIG_INTEL_MID_PTI=y
> CONFIG_SGI_IOC4=y
> CONFIG_TIFM_CORE=y
> CONFIG_TIFM_7XX1=y
> CONFIG_ICS932S401=y
> CONFIG_ENCLOSURE_SERVICES=y
> # CONFIG_SGI_XP is not set
> CONFIG_HP_ILO=y
> # CONFIG_SGI_GRU is not set
> CONFIG_APDS9802ALS=y
> CONFIG_ISL29003=y
> CONFIG_ISL29020=y
> CONFIG_SENSORS_TSL2550=y
> CONFIG_SENSORS_BH1780=y
> CONFIG_SENSORS_BH1770=y
> CONFIG_SENSORS_APDS990X=y
> CONFIG_HMC6352=y
> CONFIG_DS1682=y
> CONFIG_TI_DAC7512=y
> CONFIG_VMWARE_BALLOON=y
> CONFIG_BMP085=y
> CONFIG_BMP085_I2C=y
> CONFIG_BMP085_SPI=y
> CONFIG_PCH_PHUB=y
> CONFIG_USB_SWITCH_FSA9480=y
> CONFIG_C2PORT=y
> CONFIG_C2PORT_DURAMAR_2150=y
> 
> #
> # EEPROM support
> #
> CONFIG_EEPROM_AT24=y
> CONFIG_EEPROM_AT25=y
> CONFIG_EEPROM_LEGACY=y
> CONFIG_EEPROM_MAX6875=y
> CONFIG_EEPROM_93CX6=y
> CONFIG_EEPROM_93XX46=y
> CONFIG_CB710_CORE=y
> CONFIG_CB710_DEBUG=y
> CONFIG_CB710_DEBUG_ASSUMPTIONS=y
> CONFIG_IWMC3200TOP=y
> CONFIG_IWMC3200TOP_DEBUG=y
> CONFIG_IWMC3200TOP_DEBUGFS=y
> 
> #
> # Texas Instruments shared transport line discipline
> #
> CONFIG_TI_ST=y
> CONFIG_SENSORS_LIS3_I2C=y
> 
> #
> # Altera FPGA firmware download module
> #
> CONFIG_ALTERA_STAPL=y
> CONFIG_INTEL_MEI=y
> CONFIG_HAVE_IDE=y
> # CONFIG_IDE is not set
> 
> #
> # SCSI device support
> #
> CONFIG_SCSI_MOD=y
> CONFIG_RAID_ATTRS=y
> CONFIG_SCSI=y
> CONFIG_SCSI_DMA=y
> CONFIG_SCSI_TGT=y
> CONFIG_SCSI_NETLINK=y
> CONFIG_SCSI_PROC_FS=y
> 
> #
> # SCSI support type (disk, tape, CD-ROM)
> #
> CONFIG_BLK_DEV_SD=y
> CONFIG_CHR_DEV_ST=y
> CONFIG_CHR_DEV_OSST=y
> CONFIG_BLK_DEV_SR=y
> CONFIG_BLK_DEV_SR_VENDOR=y
> CONFIG_CHR_DEV_SG=y
> CONFIG_CHR_DEV_SCH=y
> CONFIG_SCSI_ENCLOSURE=y
> CONFIG_SCSI_MULTI_LUN=y
> CONFIG_SCSI_CONSTANTS=y
> CONFIG_SCSI_LOGGING=y
> CONFIG_SCSI_SCAN_ASYNC=y
> 
> #
> # SCSI Transports
> #
> CONFIG_SCSI_SPI_ATTRS=y
> CONFIG_SCSI_FC_ATTRS=y
> CONFIG_SCSI_FC_TGT_ATTRS=y
> CONFIG_SCSI_ISCSI_ATTRS=y
> CONFIG_SCSI_SAS_ATTRS=y
> CONFIG_SCSI_SAS_LIBSAS=y
> CONFIG_SCSI_SAS_ATA=y
> CONFIG_SCSI_SAS_HOST_SMP=y
> CONFIG_SCSI_SRP_ATTRS=y
> CONFIG_SCSI_SRP_TGT_ATTRS=y
> CONFIG_SCSI_LOWLEVEL=y
> CONFIG_ISCSI_TCP=y
> CONFIG_ISCSI_BOOT_SYSFS=y
> CONFIG_SCSI_CXGB3_ISCSI=y
> CONFIG_SCSI_CXGB4_ISCSI=y
> CONFIG_SCSI_BNX2_ISCSI=y
> CONFIG_SCSI_BNX2X_FCOE=y
> CONFIG_BE2ISCSI=y
> CONFIG_BLK_DEV_3W_XXXX_RAID=y
> CONFIG_SCSI_HPSA=y
> CONFIG_SCSI_3W_9XXX=y
> CONFIG_SCSI_3W_SAS=y
> CONFIG_SCSI_ACARD=y
> CONFIG_SCSI_AACRAID=y
> CONFIG_SCSI_AIC7XXX=y
> CONFIG_AIC7XXX_CMDS_PER_DEVICE=32
> CONFIG_AIC7XXX_RESET_DELAY_MS=5000
> CONFIG_AIC7XXX_DEBUG_ENABLE=y
> CONFIG_AIC7XXX_DEBUG_MASK=0
> CONFIG_AIC7XXX_REG_PRETTY_PRINT=y
> CONFIG_SCSI_AIC7XXX_OLD=y
> CONFIG_SCSI_AIC79XX=y
> CONFIG_AIC79XX_CMDS_PER_DEVICE=32
> CONFIG_AIC79XX_RESET_DELAY_MS=5000
> CONFIG_AIC79XX_DEBUG_ENABLE=y
> CONFIG_AIC79XX_DEBUG_MASK=0
> CONFIG_AIC79XX_REG_PRETTY_PRINT=y
> CONFIG_SCSI_AIC94XX=y
> CONFIG_AIC94XX_DEBUG=y
> CONFIG_SCSI_MVSAS=y
> CONFIG_SCSI_MVSAS_DEBUG=y
> CONFIG_SCSI_MVSAS_TASKLET=y
> CONFIG_SCSI_MVUMI=y
> CONFIG_SCSI_DPT_I2O=y
> CONFIG_SCSI_ADVANSYS=y
> CONFIG_SCSI_ARCMSR=y
> CONFIG_MEGARAID_NEWGEN=y
> CONFIG_MEGARAID_MM=y
> CONFIG_MEGARAID_MAILBOX=y
> CONFIG_MEGARAID_LEGACY=y
> CONFIG_MEGARAID_SAS=y
> CONFIG_SCSI_MPT2SAS=y
> CONFIG_SCSI_MPT2SAS_MAX_SGE=128
> CONFIG_SCSI_MPT2SAS_LOGGING=y
> CONFIG_SCSI_UFSHCD=y
> CONFIG_SCSI_HPTIOP=y
> CONFIG_SCSI_BUSLOGIC=y
> CONFIG_VMWARE_PVSCSI=y
> CONFIG_HYPERV_STORAGE=y
> CONFIG_LIBFC=y
> CONFIG_LIBFCOE=y
> CONFIG_FCOE=y
> CONFIG_FCOE_FNIC=y
> CONFIG_SCSI_DMX3191D=y
> CONFIG_SCSI_EATA=y
> CONFIG_SCSI_EATA_TAGGED_QUEUE=y
> CONFIG_SCSI_EATA_LINKED_COMMANDS=y
> CONFIG_SCSI_EATA_MAX_TAGS=16
> CONFIG_SCSI_FUTURE_DOMAIN=y
> CONFIG_SCSI_GDTH=y
> CONFIG_SCSI_ISCI=y
> CONFIG_SCSI_IPS=y
> CONFIG_SCSI_INITIO=y
> CONFIG_SCSI_INIA100=y
> CONFIG_SCSI_PPA=y
> CONFIG_SCSI_IMM=y
> CONFIG_SCSI_IZIP_EPP16=y
> CONFIG_SCSI_IZIP_SLOW_CTR=y
> CONFIG_SCSI_STEX=y
> CONFIG_SCSI_SYM53C8XX_2=y
> CONFIG_SCSI_SYM53C8XX_DMA_ADDRESSING_MODE=1
> CONFIG_SCSI_SYM53C8XX_DEFAULT_TAGS=16
> CONFIG_SCSI_SYM53C8XX_MAX_TAGS=64
> CONFIG_SCSI_SYM53C8XX_MMIO=y
> CONFIG_SCSI_IPR=y
> CONFIG_SCSI_IPR_TRACE=y
> CONFIG_SCSI_IPR_DUMP=y
> CONFIG_SCSI_QLOGIC_1280=y
> CONFIG_SCSI_QLA_FC=y
> CONFIG_TCM_QLA2XXX=y
> CONFIG_SCSI_QLA_ISCSI=y
> # CONFIG_SCSI_LPFC is not set
> CONFIG_SCSI_DC395x=y
> CONFIG_SCSI_DC390T=y
> CONFIG_SCSI_DEBUG=y
> CONFIG_SCSI_PMCRAID=y
> CONFIG_SCSI_PM8001=y
> CONFIG_SCSI_SRP=y
> CONFIG_SCSI_BFA_FC=y
> CONFIG_SCSI_VIRTIO=y
> CONFIG_SCSI_LOWLEVEL_PCMCIA=y
> CONFIG_SCSI_DH=y
> # CONFIG_SCSI_DH_RDAC is not set
> # CONFIG_SCSI_DH_HP_SW is not set
> # CONFIG_SCSI_DH_EMC is not set
> # CONFIG_SCSI_DH_ALUA is not set
> CONFIG_SCSI_OSD_INITIATOR=y
> CONFIG_SCSI_OSD_ULD=y
> CONFIG_SCSI_OSD_DPRINT_SENSE=1
> # CONFIG_SCSI_OSD_DEBUG is not set
> CONFIG_ATA=y
> # CONFIG_ATA_NONSTANDARD is not set
> CONFIG_ATA_VERBOSE_ERROR=y
> CONFIG_ATA_ACPI=y
> CONFIG_SATA_PMP=y
> 
> #
> # Controllers with non-SFF native interface
> #
> CONFIG_SATA_AHCI=y
> CONFIG_SATA_AHCI_PLATFORM=y
> CONFIG_SATA_INIC162X=y
> CONFIG_SATA_ACARD_AHCI=y
> CONFIG_SATA_SIL24=y
> CONFIG_ATA_SFF=y
> 
> #
> # SFF controllers with custom DMA interface
> #
> CONFIG_PDC_ADMA=y
> CONFIG_SATA_QSTOR=y
> CONFIG_SATA_SX4=y
> CONFIG_ATA_BMDMA=y
> 
> #
> # SATA SFF controllers with BMDMA
> #
> CONFIG_ATA_PIIX=y
> CONFIG_SATA_MV=y
> CONFIG_SATA_NV=y
> CONFIG_SATA_PROMISE=y
> CONFIG_SATA_SIL=y
> CONFIG_SATA_SIS=y
> CONFIG_SATA_SVW=y
> CONFIG_SATA_ULI=y
> CONFIG_SATA_VIA=y
> CONFIG_SATA_VITESSE=y
> 
> #
> # PATA SFF controllers with BMDMA
> #
> CONFIG_PATA_ALI=y
> CONFIG_PATA_AMD=y
> CONFIG_PATA_ARASAN_CF=y
> CONFIG_PATA_ARTOP=y
> CONFIG_PATA_ATIIXP=y
> CONFIG_PATA_ATP867X=y
> CONFIG_PATA_CMD64X=y
> CONFIG_PATA_CS5520=y
> CONFIG_PATA_CS5530=y
> CONFIG_PATA_CS5536=y
> CONFIG_PATA_CYPRESS=y
> CONFIG_PATA_EFAR=y
> CONFIG_PATA_HPT366=y
> CONFIG_PATA_HPT37X=y
> CONFIG_PATA_HPT3X2N=y
> CONFIG_PATA_HPT3X3=y
> CONFIG_PATA_HPT3X3_DMA=y
> CONFIG_PATA_IT8213=y
> CONFIG_PATA_IT821X=y
> CONFIG_PATA_JMICRON=y
> CONFIG_PATA_MARVELL=y
> CONFIG_PATA_NETCELL=y
> CONFIG_PATA_NINJA32=y
> CONFIG_PATA_NS87415=y
> CONFIG_PATA_OLDPIIX=y
> CONFIG_PATA_OPTIDMA=y
> CONFIG_PATA_PDC2027X=y
> CONFIG_PATA_PDC_OLD=y
> CONFIG_PATA_RADISYS=y
> CONFIG_PATA_RDC=y
> CONFIG_PATA_SC1200=y
> CONFIG_PATA_SCH=y
> CONFIG_PATA_SERVERWORKS=y
> CONFIG_PATA_SIL680=y
> CONFIG_PATA_SIS=y
> CONFIG_PATA_TOSHIBA=y
> CONFIG_PATA_TRIFLEX=y
> CONFIG_PATA_VIA=y
> CONFIG_PATA_WINBOND=y
> 
> #
> # PIO-only SFF controllers
> #
> CONFIG_PATA_CMD640_PCI=y
> CONFIG_PATA_MPIIX=y
> CONFIG_PATA_NS87410=y
> CONFIG_PATA_OPTI=y
> CONFIG_PATA_PCMCIA=y
> CONFIG_PATA_PLATFORM=y
> CONFIG_PATA_RZ1000=y
> 
> #
> # Generic fallback / legacy drivers
> #
> CONFIG_PATA_ACPI=y
> CONFIG_ATA_GENERIC=y
> CONFIG_PATA_LEGACY=y
> CONFIG_MD=y
> CONFIG_BLK_DEV_MD=y
> CONFIG_MD_AUTODETECT=y
> CONFIG_MD_LINEAR=y
> CONFIG_MD_RAID0=y
> CONFIG_MD_RAID1=y
> CONFIG_MD_RAID10=y
> CONFIG_MD_RAID456=y
> CONFIG_MULTICORE_RAID456=y
> CONFIG_MD_MULTIPATH=y
> CONFIG_MD_FAULTY=y
> CONFIG_BLK_DEV_DM=y
> CONFIG_DM_DEBUG=y
> CONFIG_DM_BUFIO=y
> CONFIG_DM_PERSISTENT_DATA=y
> CONFIG_DM_CRYPT=y
> CONFIG_DM_SNAPSHOT=y
> CONFIG_DM_THIN_PROVISIONING=y
> CONFIG_DM_DEBUG_BLOCK_STACK_TRACING=y
> CONFIG_DM_DEBUG_SPACE_MAPS=y
> CONFIG_DM_MIRROR=y
> CONFIG_DM_RAID=y
> CONFIG_DM_LOG_USERSPACE=y
> CONFIG_DM_ZERO=y
> CONFIG_DM_MULTIPATH=y
> CONFIG_DM_MULTIPATH_QL=y
> CONFIG_DM_MULTIPATH_ST=y
> CONFIG_DM_DELAY=y
> CONFIG_DM_UEVENT=y
> CONFIG_DM_FLAKEY=y
> CONFIG_DM_VERITY=y
> CONFIG_TARGET_CORE=y
> CONFIG_TCM_IBLOCK=y
> CONFIG_TCM_FILEIO=y
> CONFIG_TCM_PSCSI=y
> CONFIG_LOOPBACK_TARGET=y
> CONFIG_TCM_FC=y
> CONFIG_ISCSI_TARGET=y
> CONFIG_SBP_TARGET=y
> CONFIG_FUSION=y
> CONFIG_FUSION_SPI=y
> CONFIG_FUSION_FC=y
> CONFIG_FUSION_SAS=y
> CONFIG_FUSION_MAX_SGE=128
> CONFIG_FUSION_CTL=y
> CONFIG_FUSION_LAN=y
> CONFIG_FUSION_LOGGING=y
> 
> #
> # IEEE 1394 (FireWire) support
> #
> CONFIG_FIREWIRE=y
> CONFIG_FIREWIRE_OHCI=y
> CONFIG_FIREWIRE_SBP2=y
> CONFIG_FIREWIRE_NET=y
> CONFIG_FIREWIRE_NOSY=y
> CONFIG_I2O=y
> CONFIG_I2O_LCT_NOTIFY_ON_CHANGES=y
> CONFIG_I2O_EXT_ADAPTEC=y
> CONFIG_I2O_EXT_ADAPTEC_DMA64=y
> CONFIG_I2O_CONFIG=y
> CONFIG_I2O_CONFIG_OLD_IOCTL=y
> CONFIG_I2O_BUS=y
> CONFIG_I2O_BLOCK=y
> CONFIG_I2O_SCSI=y
> CONFIG_I2O_PROC=y
> CONFIG_MACINTOSH_DRIVERS=y
> CONFIG_MAC_EMUMOUSEBTN=y
> CONFIG_NETDEVICES=y
> CONFIG_NET_CORE=y
> CONFIG_BONDING=y
> CONFIG_DUMMY=y
> CONFIG_EQUALIZER=y
> CONFIG_NET_FC=y
> CONFIG_MII=y
> CONFIG_IEEE802154_DRIVERS=y
> CONFIG_IEEE802154_FAKEHARD=y
> CONFIG_IEEE802154_FAKELB=y
> CONFIG_IEEE802154_AT86RF230=y
> CONFIG_IFB=y
> CONFIG_NET_TEAM=y
> CONFIG_NET_TEAM_MODE_ROUNDROBIN=y
> CONFIG_NET_TEAM_MODE_ACTIVEBACKUP=y
> CONFIG_NET_TEAM_MODE_LOADBALANCE=y
> CONFIG_MACVLAN=y
> CONFIG_MACVTAP=y
> CONFIG_NETCONSOLE=y
> CONFIG_NETCONSOLE_DYNAMIC=y
> CONFIG_NETPOLL=y
> CONFIG_NETPOLL_TRAP=y
> CONFIG_NET_POLL_CONTROLLER=y
> CONFIG_RIONET=y
> CONFIG_RIONET_TX_SIZE=128
> CONFIG_RIONET_RX_SIZE=128
> CONFIG_TUN=y
> CONFIG_VETH=y
> CONFIG_VIRTIO_NET=y
> CONFIG_SUNGEM_PHY=y
> CONFIG_ARCNET=y
> CONFIG_ARCNET_1201=y
> CONFIG_ARCNET_1051=y
> CONFIG_ARCNET_RAW=y
> CONFIG_ARCNET_CAP=y
> CONFIG_ARCNET_COM90xx=y
> CONFIG_ARCNET_COM90xxIO=y
> CONFIG_ARCNET_RIM_I=y
> CONFIG_ARCNET_COM20020=y
> CONFIG_ARCNET_COM20020_PCI=y
> CONFIG_ARCNET_COM20020_CS=y
> CONFIG_ATM_DRIVERS=y
> CONFIG_ATM_DUMMY=y
> CONFIG_ATM_TCP=y
> CONFIG_ATM_LANAI=y
> CONFIG_ATM_ENI=y
> CONFIG_ATM_ENI_DEBUG=y
> CONFIG_ATM_ENI_TUNE_BURST=y
> CONFIG_ATM_ENI_BURST_TX_16W=y
> CONFIG_ATM_ENI_BURST_TX_8W=y
> CONFIG_ATM_ENI_BURST_TX_4W=y
> CONFIG_ATM_ENI_BURST_TX_2W=y
> CONFIG_ATM_ENI_BURST_RX_16W=y
> CONFIG_ATM_ENI_BURST_RX_8W=y
> CONFIG_ATM_ENI_BURST_RX_4W=y
> CONFIG_ATM_ENI_BURST_RX_2W=y
> CONFIG_ATM_FIRESTREAM=y
> CONFIG_ATM_ZATM=y
> CONFIG_ATM_ZATM_DEBUG=y
> CONFIG_ATM_NICSTAR=y
> CONFIG_ATM_NICSTAR_USE_SUNI=y
> CONFIG_ATM_NICSTAR_USE_IDT77105=y
> CONFIG_ATM_IDT77252=y
> CONFIG_ATM_IDT77252_DEBUG=y
> CONFIG_ATM_IDT77252_RCV_ALL=y
> CONFIG_ATM_IDT77252_USE_SUNI=y
> CONFIG_ATM_AMBASSADOR=y
> CONFIG_ATM_AMBASSADOR_DEBUG=y
> CONFIG_ATM_HORIZON=y
> CONFIG_ATM_HORIZON_DEBUG=y
> CONFIG_ATM_IA=y
> CONFIG_ATM_IA_DEBUG=y
> CONFIG_ATM_FORE200E=y
> CONFIG_ATM_FORE200E_USE_TASKLET=y
> CONFIG_ATM_FORE200E_TX_RETRY=16
> CONFIG_ATM_FORE200E_DEBUG=0
> CONFIG_ATM_HE=y
> CONFIG_ATM_HE_USE_SUNI=y
> CONFIG_ATM_SOLOS=y
> 
> #
> # CAIF transport drivers
> #
> CONFIG_CAIF_TTY=y
> CONFIG_CAIF_SPI_SLAVE=y
> CONFIG_CAIF_SPI_SYNC=y
> CONFIG_CAIF_HSI=y
> 
> #
> # Distributed Switch Architecture drivers
> #
> CONFIG_NET_DSA_MV88E6XXX=y
> CONFIG_NET_DSA_MV88E6060=y
> CONFIG_NET_DSA_MV88E6XXX_NEED_PPU=y
> CONFIG_NET_DSA_MV88E6131=y
> CONFIG_NET_DSA_MV88E6123_61_65=y
> CONFIG_ETHERNET=y
> CONFIG_MDIO=y
> CONFIG_NET_VENDOR_3COM=y
> CONFIG_PCMCIA_3C574=y
> CONFIG_PCMCIA_3C589=y
> CONFIG_VORTEX=y
> CONFIG_TYPHOON=y
> CONFIG_NET_VENDOR_ADAPTEC=y
> CONFIG_ADAPTEC_STARFIRE=y
> CONFIG_NET_VENDOR_ALTEON=y
> CONFIG_ACENIC=y
> CONFIG_ACENIC_OMIT_TIGON_I=y
> CONFIG_NET_VENDOR_AMD=y
> CONFIG_AMD8111_ETH=y
> CONFIG_PCNET32=y
> CONFIG_PCMCIA_NMCLAN=y
> CONFIG_NET_VENDOR_ATHEROS=y
> CONFIG_ATL2=y
> CONFIG_ATL1=y
> CONFIG_ATL1E=y
> CONFIG_ATL1C=y
> CONFIG_NET_VENDOR_BROADCOM=y
> CONFIG_B44=y
> CONFIG_B44_PCI_AUTOSELECT=y
> CONFIG_B44_PCICORE_AUTOSELECT=y
> CONFIG_B44_PCI=y
> CONFIG_BNX2=y
> CONFIG_CNIC=y
> CONFIG_TIGON3=y
> CONFIG_BNX2X=y
> CONFIG_NET_VENDOR_BROCADE=y
> CONFIG_BNA=y
> CONFIG_NET_CALXEDA_XGMAC=y
> CONFIG_NET_VENDOR_CHELSIO=y
> CONFIG_CHELSIO_T1=y
> CONFIG_CHELSIO_T1_1G=y
> CONFIG_CHELSIO_T3=y
> CONFIG_CHELSIO_T4=y
> CONFIG_CHELSIO_T4VF=y
> CONFIG_NET_VENDOR_CISCO=y
> CONFIG_ENIC=y
> CONFIG_DNET=y
> CONFIG_NET_VENDOR_DEC=y
> CONFIG_NET_TULIP=y
> CONFIG_DE2104X=y
> CONFIG_DE2104X_DSL=0
> CONFIG_TULIP=y
> CONFIG_TULIP_MWI=y
> CONFIG_TULIP_MMIO=y
> CONFIG_TULIP_NAPI=y
> CONFIG_TULIP_NAPI_HW_MITIGATION=y
> CONFIG_DE4X5=y
> CONFIG_WINBOND_840=y
> CONFIG_DM9102=y
> CONFIG_ULI526X=y
> CONFIG_PCMCIA_XIRCOM=y
> CONFIG_NET_VENDOR_DLINK=y
> CONFIG_DE600=y
> CONFIG_DE620=y
> CONFIG_DL2K=y
> CONFIG_SUNDANCE=y
> CONFIG_SUNDANCE_MMIO=y
> CONFIG_NET_VENDOR_EMULEX=y
> CONFIG_BE2NET=y
> CONFIG_NET_VENDOR_EXAR=y
> CONFIG_S2IO=y
> CONFIG_VXGE=y
> CONFIG_VXGE_DEBUG_TRACE_ALL=y
> CONFIG_NET_VENDOR_FUJITSU=y
> CONFIG_PCMCIA_FMVJ18X=y
> CONFIG_NET_VENDOR_HP=y
> CONFIG_HP100=y
> CONFIG_NET_VENDOR_INTEL=y
> CONFIG_E100=y
> CONFIG_E1000=y
> CONFIG_E1000E=y
> CONFIG_IGB=y
> CONFIG_IGB_DCA=y
> CONFIG_IGB_PTP=y
> CONFIG_IGBVF=y
> CONFIG_IXGB=y
> CONFIG_IXGBE=y
> CONFIG_IXGBE_HWMON=y
> CONFIG_IXGBE_DCA=y
> CONFIG_IXGBE_DCB=y
> CONFIG_IXGBE_PTP=y
> CONFIG_IXGBEVF=y
> CONFIG_NET_VENDOR_I825XX=y
> CONFIG_ZNET=y
> CONFIG_IP1000=y
> CONFIG_JME=y
> CONFIG_NET_VENDOR_MARVELL=y
> CONFIG_SKGE=y
> CONFIG_SKGE_DEBUG=y
> CONFIG_SKGE_GENESIS=y
> CONFIG_SKY2=y
> CONFIG_SKY2_DEBUG=y
> CONFIG_NET_VENDOR_MELLANOX=y
> CONFIG_MLX4_EN=y
> CONFIG_MLX4_EN_DCB=y
> CONFIG_MLX4_CORE=y
> CONFIG_MLX4_DEBUG=y
> CONFIG_NET_VENDOR_MICREL=y
> CONFIG_KS8842=y
> CONFIG_KS8851=y
> CONFIG_KS8851_MLL=y
> CONFIG_KSZ884X_PCI=y
> CONFIG_NET_VENDOR_MICROCHIP=y
> CONFIG_ENC28J60=y
> CONFIG_ENC28J60_WRITEVERIFY=y
> CONFIG_NET_VENDOR_MYRI=y
> CONFIG_MYRI10GE=y
> CONFIG_MYRI10GE_DCA=y
> CONFIG_FEALNX=y
> CONFIG_NET_VENDOR_NATSEMI=y
> CONFIG_NATSEMI=y
> CONFIG_NS83820=y
> CONFIG_NET_VENDOR_8390=y
> CONFIG_PCMCIA_AXNET=y
> CONFIG_NE2K_PCI=y
> CONFIG_PCMCIA_PCNET=y
> CONFIG_NET_VENDOR_NVIDIA=y
> CONFIG_FORCEDETH=y
> CONFIG_NET_VENDOR_OKI=y
> CONFIG_PCH_GBE=y
> CONFIG_ETHOC=y
> CONFIG_NET_PACKET_ENGINE=y
> CONFIG_HAMACHI=y
> CONFIG_YELLOWFIN=y
> CONFIG_NET_VENDOR_QLOGIC=y
> CONFIG_QLA3XXX=y
> CONFIG_QLCNIC=y
> CONFIG_QLGE=y
> CONFIG_NETXEN_NIC=y
> CONFIG_NET_VENDOR_REALTEK=y
> CONFIG_ATP=y
> CONFIG_8139CP=y
> CONFIG_8139TOO=y
> CONFIG_8139TOO_PIO=y
> CONFIG_8139TOO_TUNE_TWISTER=y
> CONFIG_8139TOO_8129=y
> CONFIG_8139_OLD_RX_RESET=y
> CONFIG_R8169=y
> CONFIG_NET_VENDOR_RDC=y
> CONFIG_R6040=y
> CONFIG_NET_VENDOR_SEEQ=y
> CONFIG_SEEQ8005=y
> CONFIG_NET_VENDOR_SILAN=y
> CONFIG_SC92031=y
> CONFIG_NET_VENDOR_SIS=y
> CONFIG_SIS900=y
> CONFIG_SIS190=y
> CONFIG_SFC=y
> CONFIG_SFC_MTD=y
> CONFIG_SFC_MCDI_MON=y
> CONFIG_SFC_SRIOV=y
> CONFIG_NET_VENDOR_SMSC=y
> CONFIG_PCMCIA_SMC91C92=y
> CONFIG_EPIC100=y
> CONFIG_SMSC9420=y
> CONFIG_NET_VENDOR_STMICRO=y
> CONFIG_STMMAC_ETH=y
> CONFIG_STMMAC_PLATFORM=y
> CONFIG_STMMAC_PCI=y
> CONFIG_STMMAC_DEBUG_FS=y
> CONFIG_STMMAC_DA=y
> # CONFIG_STMMAC_RING is not set
> CONFIG_STMMAC_CHAINED=y
> CONFIG_NET_VENDOR_SUN=y
> CONFIG_HAPPYMEAL=y
> CONFIG_SUNGEM=y
> CONFIG_CASSINI=y
> CONFIG_NIU=y
> CONFIG_NET_VENDOR_TEHUTI=y
> CONFIG_TEHUTI=y
> CONFIG_NET_VENDOR_TI=y
> CONFIG_TLAN=y
> CONFIG_NET_VENDOR_VIA=y
> CONFIG_VIA_RHINE=y
> CONFIG_VIA_RHINE_MMIO=y
> CONFIG_VIA_VELOCITY=y
> CONFIG_NET_VENDOR_WIZNET=y
> CONFIG_WIZNET_W5100=y
> CONFIG_WIZNET_W5300=y
> # CONFIG_WIZNET_BUS_DIRECT is not set
> # CONFIG_WIZNET_BUS_INDIRECT is not set
> CONFIG_WIZNET_BUS_ANY=y
> CONFIG_NET_VENDOR_XIRCOM=y
> CONFIG_PCMCIA_XIRC2PS=y
> CONFIG_FDDI=y
> CONFIG_DEFXX=y
> # CONFIG_DEFXX_MMIO is not set
> CONFIG_SKFP=y
> CONFIG_HIPPI=y
> CONFIG_ROADRUNNER=y
> CONFIG_ROADRUNNER_LARGE_RINGS=y
> CONFIG_NET_SB1000=y
> CONFIG_PHYLIB=y
> 
> #
> # MII PHY device drivers
> #
> CONFIG_AMD_PHY=y
> CONFIG_MARVELL_PHY=y
> CONFIG_DAVICOM_PHY=y
> CONFIG_QSEMI_PHY=y
> CONFIG_LXT_PHY=y
> CONFIG_CICADA_PHY=y
> CONFIG_VITESSE_PHY=y
> CONFIG_SMSC_PHY=y
> CONFIG_BROADCOM_PHY=y
> CONFIG_BCM87XX_PHY=y
> CONFIG_ICPLUS_PHY=y
> CONFIG_REALTEK_PHY=y
> CONFIG_NATIONAL_PHY=y
> CONFIG_STE10XP=y
> CONFIG_LSI_ET1011C_PHY=y
> CONFIG_MICREL_PHY=y
> CONFIG_FIXED_PHY=y
> CONFIG_MDIO_BITBANG=y
> CONFIG_MDIO_GPIO=y
> CONFIG_MICREL_KS8995MA=y
> CONFIG_PLIP=y
> CONFIG_PPP=y
> CONFIG_PPP_BSDCOMP=y
> CONFIG_PPP_DEFLATE=y
> CONFIG_PPP_FILTER=y
> CONFIG_PPP_MPPE=y
> CONFIG_PPP_MULTILINK=y
> CONFIG_PPPOATM=y
> CONFIG_PPPOE=y
> CONFIG_PPTP=y
> CONFIG_PPPOL2TP=y
> CONFIG_PPP_ASYNC=y
> CONFIG_PPP_SYNC_TTY=y
> CONFIG_SLIP=y
> CONFIG_SLHC=y
> CONFIG_SLIP_COMPRESSED=y
> CONFIG_SLIP_SMART=y
> CONFIG_SLIP_MODE_SLIP6=y
> 
> #
> # USB Network Adapters
> #
> CONFIG_USB_CATC=y
> CONFIG_USB_KAWETH=y
> CONFIG_USB_PEGASUS=y
> CONFIG_USB_RTL8150=y
> CONFIG_USB_USBNET=y
> CONFIG_USB_NET_AX8817X=y
> CONFIG_USB_NET_CDCETHER=y
> CONFIG_USB_NET_CDC_EEM=y
> CONFIG_USB_NET_CDC_NCM=y
> CONFIG_USB_NET_DM9601=y
> CONFIG_USB_NET_SMSC75XX=y
> CONFIG_USB_NET_SMSC95XX=y
> CONFIG_USB_NET_GL620A=y
> CONFIG_USB_NET_NET1080=y
> CONFIG_USB_NET_PLUSB=y
> CONFIG_USB_NET_MCS7830=y
> CONFIG_USB_NET_RNDIS_HOST=y
> CONFIG_USB_NET_CDC_SUBSET=y
> CONFIG_USB_ALI_M5632=y
> CONFIG_USB_AN2720=y
> CONFIG_USB_BELKIN=y
> CONFIG_USB_ARMLINUX=y
> CONFIG_USB_EPSON2888=y
> CONFIG_USB_KC2190=y
> CONFIG_USB_NET_ZAURUS=y
> CONFIG_USB_NET_CX82310_ETH=y
> CONFIG_USB_NET_KALMIA=y
> CONFIG_USB_NET_QMI_WWAN=y
> CONFIG_USB_HSO=y
> CONFIG_USB_NET_INT51X1=y
> CONFIG_USB_CDC_PHONET=y
> CONFIG_USB_IPHETH=y
> CONFIG_USB_SIERRA_NET=y
> CONFIG_USB_VL600=y
> CONFIG_WLAN=y
> CONFIG_PCMCIA_RAYCS=y
> CONFIG_LIBERTAS_THINFIRM=y
> CONFIG_LIBERTAS_THINFIRM_DEBUG=y
> CONFIG_LIBERTAS_THINFIRM_USB=y
> CONFIG_AIRO=y
> CONFIG_ATMEL=y
> CONFIG_PCI_ATMEL=y
> CONFIG_PCMCIA_ATMEL=y
> CONFIG_AT76C50X_USB=y
> CONFIG_AIRO_CS=y
> CONFIG_PCMCIA_WL3501=y
> CONFIG_PRISM54=y
> CONFIG_USB_ZD1201=y
> CONFIG_USB_NET_RNDIS_WLAN=y
> CONFIG_RTL8180=y
> CONFIG_RTL8187=y
> CONFIG_RTL8187_LEDS=y
> CONFIG_ADM8211=y
> CONFIG_MAC80211_HWSIM=y
> CONFIG_MWL8K=y
> CONFIG_ATH_COMMON=y
> CONFIG_ATH_DEBUG=y
> CONFIG_ATH5K=y
> CONFIG_ATH5K_DEBUG=y
> CONFIG_ATH5K_TRACER=y
> CONFIG_ATH5K_PCI=y
> CONFIG_ATH9K_HW=y
> CONFIG_ATH9K_COMMON=y
> CONFIG_ATH9K_DFS_DEBUGFS=y
> CONFIG_ATH9K_BTCOEX_SUPPORT=y
> CONFIG_ATH9K=y
> CONFIG_ATH9K_PCI=y
> CONFIG_ATH9K_AHB=y
> CONFIG_ATH9K_DEBUGFS=y
> CONFIG_ATH9K_DFS_CERTIFIED=y
> CONFIG_ATH9K_MAC_DEBUG=y
> CONFIG_ATH9K_RATE_CONTROL=y
> CONFIG_ATH9K_HTC=y
> CONFIG_ATH9K_HTC_DEBUGFS=y
> CONFIG_CARL9170=y
> CONFIG_CARL9170_LEDS=y
> CONFIG_CARL9170_DEBUGFS=y
> CONFIG_CARL9170_WPC=y
> CONFIG_CARL9170_HWRNG=y
> CONFIG_ATH6KL=y
> # CONFIG_ATH6KL_SDIO is not set
> # CONFIG_ATH6KL_USB is not set
> # CONFIG_ATH6KL_DEBUG is not set
> CONFIG_B43=y
> CONFIG_B43_SSB=y
> CONFIG_B43_PCI_AUTOSELECT=y
> CONFIG_B43_PCICORE_AUTOSELECT=y
> CONFIG_B43_PCMCIA=y
> CONFIG_B43_SDIO=y
> CONFIG_B43_PIO=y
> CONFIG_B43_PHY_N=y
> CONFIG_B43_PHY_LP=y
> CONFIG_B43_PHY_HT=y
> CONFIG_B43_LEDS=y
> CONFIG_B43_HWRNG=y
> CONFIG_B43_DEBUG=y
> CONFIG_B43LEGACY=y
> CONFIG_B43LEGACY_PCI_AUTOSELECT=y
> CONFIG_B43LEGACY_PCICORE_AUTOSELECT=y
> CONFIG_B43LEGACY_LEDS=y
> CONFIG_B43LEGACY_HWRNG=y
> CONFIG_B43LEGACY_DEBUG=y
> CONFIG_B43LEGACY_DMA=y
> CONFIG_B43LEGACY_PIO=y
> CONFIG_B43LEGACY_DMA_AND_PIO_MODE=y
> # CONFIG_B43LEGACY_DMA_MODE is not set
> # CONFIG_B43LEGACY_PIO_MODE is not set
> CONFIG_BRCMUTIL=y
> CONFIG_BRCMFMAC=y
> CONFIG_BRCMFMAC_SDIO=y
> CONFIG_BRCMFMAC_SDIO_OOB=y
> CONFIG_BRCMFMAC_USB=y
> CONFIG_BRCMDBG=y
> CONFIG_HOSTAP=y
> CONFIG_HOSTAP_FIRMWARE=y
> CONFIG_HOSTAP_FIRMWARE_NVRAM=y
> CONFIG_HOSTAP_PLX=y
> CONFIG_HOSTAP_PCI=y
> CONFIG_HOSTAP_CS=y
> CONFIG_IPW2100=y
> CONFIG_IPW2100_MONITOR=y
> CONFIG_IPW2100_DEBUG=y
> CONFIG_IPW2200=y
> CONFIG_IPW2200_MONITOR=y
> CONFIG_IPW2200_RADIOTAP=y
> CONFIG_IPW2200_PROMISCUOUS=y
> CONFIG_IPW2200_QOS=y
> CONFIG_IPW2200_DEBUG=y
> CONFIG_LIBIPW=y
> CONFIG_LIBIPW_DEBUG=y
> CONFIG_IWLWIFI=y
> CONFIG_IWLDVM=y
> 
> #
> # Debugging Options
> #
> CONFIG_IWLWIFI_DEBUG=y
> CONFIG_IWLWIFI_DEBUGFS=y
> CONFIG_IWLWIFI_DEBUG_EXPERIMENTAL_UCODE=y
> CONFIG_IWLWIFI_DEVICE_TRACING=y
> CONFIG_IWLWIFI_DEVICE_TESTMODE=y
> CONFIG_IWLWIFI_P2P=y
> CONFIG_IWLWIFI_EXPERIMENTAL_MFP=y
> CONFIG_IWLEGACY=y
> CONFIG_IWL4965=y
> CONFIG_IWL3945=y
> 
> #
> # iwl3945 / iwl4965 Debugging Options
> #
> CONFIG_IWLEGACY_DEBUG=y
> CONFIG_IWLEGACY_DEBUGFS=y
> CONFIG_IWM=y
> CONFIG_IWM_DEBUG=y
> CONFIG_IWM_TRACING=y
> CONFIG_LIBERTAS=y
> CONFIG_LIBERTAS_USB=y
> CONFIG_LIBERTAS_CS=y
> CONFIG_LIBERTAS_SDIO=y
> CONFIG_LIBERTAS_SPI=y
> CONFIG_LIBERTAS_DEBUG=y
> CONFIG_LIBERTAS_MESH=y
> CONFIG_HERMES=y
> CONFIG_HERMES_PRISM=y
> CONFIG_HERMES_CACHE_FW_ON_INIT=y
> CONFIG_PLX_HERMES=y
> CONFIG_TMD_HERMES=y
> CONFIG_NORTEL_HERMES=y
> CONFIG_PCI_HERMES=y
> CONFIG_PCMCIA_HERMES=y
> CONFIG_PCMCIA_SPECTRUM=y
> CONFIG_ORINOCO_USB=y
> CONFIG_P54_COMMON=y
> CONFIG_P54_USB=y
> CONFIG_P54_PCI=y
> CONFIG_P54_SPI=y
> CONFIG_P54_SPI_DEFAULT_EEPROM=y
> CONFIG_P54_LEDS=y
> # CONFIG_RT2X00 is not set
> CONFIG_RTL8192CE=y
> CONFIG_RTL8192SE=y
> CONFIG_RTL8192DE=y
> CONFIG_RTL8192CU=y
> CONFIG_RTLWIFI=y
> CONFIG_RTLWIFI_DEBUG=y
> CONFIG_RTL8192C_COMMON=y
> CONFIG_WL_TI=y
> CONFIG_WL1251=y
> CONFIG_WL1251_SPI=y
> CONFIG_WL1251_SDIO=y
> CONFIG_WL12XX=y
> CONFIG_WL18XX=y
> CONFIG_WLCORE=y
> CONFIG_WLCORE_SPI=y
> CONFIG_WLCORE_SDIO=y
> CONFIG_WL12XX_PLATFORM_DATA=y
> CONFIG_ZD1211RW=y
> CONFIG_ZD1211RW_DEBUG=y
> CONFIG_MWIFIEX=y
> CONFIG_MWIFIEX_SDIO=y
> CONFIG_MWIFIEX_PCIE=y
> CONFIG_MWIFIEX_USB=y
> 
> #
> # WiMAX Wireless Broadband devices
> #
> CONFIG_WIMAX_I2400M=y
> CONFIG_WIMAX_I2400M_USB=y
> CONFIG_WIMAX_I2400M_SDIO=y
> CONFIG_WIMAX_IWMC3200_SDIO=y
> CONFIG_WIMAX_I2400M_DEBUG_LEVEL=8
> CONFIG_WAN=y
> CONFIG_LANMEDIA=y
> CONFIG_HDLC=y
> CONFIG_HDLC_RAW=y
> CONFIG_HDLC_RAW_ETH=y
> CONFIG_HDLC_CISCO=y
> CONFIG_HDLC_FR=y
> CONFIG_HDLC_PPP=y
> CONFIG_HDLC_X25=y
> CONFIG_PCI200SYN=y
> CONFIG_WANXL=y
> CONFIG_PC300TOO=y
> CONFIG_FARSYNC=y
> CONFIG_DLCI=y
> CONFIG_DLCI_MAX=8
> CONFIG_WAN_ROUTER_DRIVERS=y
> CONFIG_CYCLADES_SYNC=y
> CONFIG_CYCLOMX_X25=y
> CONFIG_LAPBETHER=y
> CONFIG_X25_ASY=y
> CONFIG_SBNI=y
> CONFIG_SBNI_MULTILINE=y
> CONFIG_XEN_NETDEV_FRONTEND=y
> CONFIG_XEN_NETDEV_BACKEND=y
> CONFIG_VMXNET3=y
> CONFIG_HYPERV_NET=y
> CONFIG_ISDN=y
> CONFIG_ISDN_I4L=y
> CONFIG_ISDN_PPP=y
> CONFIG_ISDN_PPP_VJ=y
> CONFIG_ISDN_MPP=y
> CONFIG_IPPP_FILTER=y
> CONFIG_ISDN_PPP_BSDCOMP=y
> CONFIG_ISDN_AUDIO=y
> CONFIG_ISDN_TTY_FAX=y
> CONFIG_ISDN_X25=y
> 
> #
> # ISDN feature submodules
> #
> CONFIG_ISDN_DIVERSION=y
> 
> #
> # ISDN4Linux hardware drivers
> #
> 
> #
> # Passive cards
> #
> # CONFIG_ISDN_DRV_HISAX is not set
> 
> #
> # Active cards
> #
> CONFIG_ISDN_CAPI=y
> CONFIG_ISDN_DRV_AVMB1_VERBOSE_REASON=y
> CONFIG_CAPI_TRACE=y
> CONFIG_ISDN_CAPI_MIDDLEWARE=y
> CONFIG_ISDN_CAPI_CAPI20=y
> CONFIG_ISDN_CAPI_CAPIDRV=y
> 
> #
> # CAPI hardware drivers
> #
> CONFIG_CAPI_AVM=y
> # CONFIG_ISDN_DRV_AVMB1_B1PCI is not set
> # CONFIG_ISDN_DRV_AVMB1_B1PCMCIA is not set
> # CONFIG_ISDN_DRV_AVMB1_T1PCI is not set
> # CONFIG_ISDN_DRV_AVMB1_C4 is not set
> # CONFIG_CAPI_EICON is not set
> CONFIG_ISDN_DRV_GIGASET=y
> CONFIG_GIGASET_CAPI=y
> # CONFIG_GIGASET_I4L is not set
> # CONFIG_GIGASET_DUMMYLL is not set
> CONFIG_GIGASET_BASE=y
> CONFIG_GIGASET_M105=y
> CONFIG_GIGASET_M101=y
> CONFIG_GIGASET_DEBUG=y
> CONFIG_MISDN=y
> CONFIG_MISDN_DSP=y
> CONFIG_MISDN_L1OIP=y
> 
> #
> # mISDN hardware drivers
> #
> # CONFIG_MISDN_HFCPCI is not set
> # CONFIG_MISDN_HFCMULTI is not set
> # CONFIG_MISDN_HFCUSB is not set
> # CONFIG_MISDN_AVMFRITZ is not set
> # CONFIG_MISDN_SPEEDFAX is not set
> # CONFIG_MISDN_INFINEON is not set
> # CONFIG_MISDN_W6692 is not set
> # CONFIG_MISDN_NETJET is not set
> 
> #
> # Input device support
> #
> CONFIG_INPUT=y
> CONFIG_INPUT_FF_MEMLESS=y
> CONFIG_INPUT_POLLDEV=y
> CONFIG_INPUT_SPARSEKMAP=y
> CONFIG_INPUT_MATRIXKMAP=y
> 
> #
> # Userland interfaces
> #
> CONFIG_INPUT_MOUSEDEV=y
> CONFIG_INPUT_MOUSEDEV_PSAUX=y
> CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
> CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
> CONFIG_INPUT_JOYDEV=y
> CONFIG_INPUT_EVDEV=y
> CONFIG_INPUT_EVBUG=y
> 
> #
> # Input Device Drivers
> #
> CONFIG_INPUT_KEYBOARD=y
> # CONFIG_KEYBOARD_ADP5588 is not set
> # CONFIG_KEYBOARD_ADP5589 is not set
> CONFIG_KEYBOARD_ATKBD=y
> # CONFIG_KEYBOARD_QT1070 is not set
> # CONFIG_KEYBOARD_QT2160 is not set
> # CONFIG_KEYBOARD_LKKBD is not set
> # CONFIG_KEYBOARD_GPIO is not set
> # CONFIG_KEYBOARD_GPIO_POLLED is not set
> # CONFIG_KEYBOARD_TCA6416 is not set
> # CONFIG_KEYBOARD_TCA8418 is not set
> # CONFIG_KEYBOARD_MATRIX is not set
> # CONFIG_KEYBOARD_LM8323 is not set
> CONFIG_KEYBOARD_LM8333=y
> # CONFIG_KEYBOARD_MAX7359 is not set
> # CONFIG_KEYBOARD_MCS is not set
> # CONFIG_KEYBOARD_MPR121 is not set
> # CONFIG_KEYBOARD_NEWTON is not set
> # CONFIG_KEYBOARD_OPENCORES is not set
> # CONFIG_KEYBOARD_STOWAWAY is not set
> # CONFIG_KEYBOARD_SUNKBD is not set
> CONFIG_KEYBOARD_OMAP4=y
> # CONFIG_KEYBOARD_XTKBD is not set
> CONFIG_INPUT_MOUSE=y
> CONFIG_MOUSE_PS2=y
> CONFIG_MOUSE_PS2_ALPS=y
> CONFIG_MOUSE_PS2_LOGIPS2PP=y
> CONFIG_MOUSE_PS2_SYNAPTICS=y
> CONFIG_MOUSE_PS2_LIFEBOOK=y
> CONFIG_MOUSE_PS2_TRACKPOINT=y
> # CONFIG_MOUSE_PS2_ELANTECH is not set
> # CONFIG_MOUSE_PS2_SENTELIC is not set
> # CONFIG_MOUSE_PS2_TOUCHKIT is not set
> # CONFIG_MOUSE_SERIAL is not set
> # CONFIG_MOUSE_APPLETOUCH is not set
> # CONFIG_MOUSE_BCM5974 is not set
> # CONFIG_MOUSE_VSXXXAA is not set
> # CONFIG_MOUSE_GPIO is not set
> CONFIG_MOUSE_SYNAPTICS_I2C=y
> CONFIG_MOUSE_SYNAPTICS_USB=y
> CONFIG_INPUT_JOYSTICK=y
> CONFIG_JOYSTICK_ANALOG=y
> # CONFIG_JOYSTICK_A3D is not set
> # CONFIG_JOYSTICK_ADI is not set
> # CONFIG_JOYSTICK_COBRA is not set
> # CONFIG_JOYSTICK_GF2K is not set
> # CONFIG_JOYSTICK_GRIP is not set
> # CONFIG_JOYSTICK_GRIP_MP is not set
> # CONFIG_JOYSTICK_GUILLEMOT is not set
> # CONFIG_JOYSTICK_INTERACT is not set
> # CONFIG_JOYSTICK_SIDEWINDER is not set
> # CONFIG_JOYSTICK_TMDC is not set
> # CONFIG_JOYSTICK_IFORCE is not set
> # CONFIG_JOYSTICK_WARRIOR is not set
> # CONFIG_JOYSTICK_MAGELLAN is not set
> # CONFIG_JOYSTICK_SPACEORB is not set
> # CONFIG_JOYSTICK_SPACEBALL is not set
> # CONFIG_JOYSTICK_STINGER is not set
> # CONFIG_JOYSTICK_TWIDJOY is not set
> # CONFIG_JOYSTICK_ZHENHUA is not set
> # CONFIG_JOYSTICK_DB9 is not set
> # CONFIG_JOYSTICK_GAMECON is not set
> # CONFIG_JOYSTICK_TURBOGRAFX is not set
> # CONFIG_JOYSTICK_AS5011 is not set
> # CONFIG_JOYSTICK_JOYDUMP is not set
> # CONFIG_JOYSTICK_XPAD is not set
> # CONFIG_JOYSTICK_WALKERA0701 is not set
> CONFIG_INPUT_TABLET=y
> # CONFIG_TABLET_USB_ACECAD is not set
> # CONFIG_TABLET_USB_AIPTEK is not set
> # CONFIG_TABLET_USB_GTCO is not set
> # CONFIG_TABLET_USB_HANWANG is not set
> # CONFIG_TABLET_USB_KBTAB is not set
> # CONFIG_TABLET_USB_WACOM is not set
> CONFIG_INPUT_TOUCHSCREEN=y
> # CONFIG_TOUCHSCREEN_88PM860X is not set
> # CONFIG_TOUCHSCREEN_ADS7846 is not set
> # CONFIG_TOUCHSCREEN_AD7877 is not set
> # CONFIG_TOUCHSCREEN_AD7879 is not set
> # CONFIG_TOUCHSCREEN_ATMEL_MXT is not set
> # CONFIG_TOUCHSCREEN_AUO_PIXCIR is not set
> # CONFIG_TOUCHSCREEN_BU21013 is not set
> # CONFIG_TOUCHSCREEN_CY8CTMG110 is not set
> CONFIG_TOUCHSCREEN_CYTTSP_CORE=y
> CONFIG_TOUCHSCREEN_CYTTSP_I2C=y
> CONFIG_TOUCHSCREEN_CYTTSP_SPI=y
> # CONFIG_TOUCHSCREEN_DYNAPRO is not set
> # CONFIG_TOUCHSCREEN_HAMPSHIRE is not set
> # CONFIG_TOUCHSCREEN_EETI is not set
> # CONFIG_TOUCHSCREEN_EGALAX is not set
> # CONFIG_TOUCHSCREEN_FUJITSU is not set
> CONFIG_TOUCHSCREEN_ILI210X=y
> # CONFIG_TOUCHSCREEN_GUNZE is not set
> # CONFIG_TOUCHSCREEN_ELO is not set
> # CONFIG_TOUCHSCREEN_WACOM_W8001 is not set
> CONFIG_TOUCHSCREEN_WACOM_I2C=y
> # CONFIG_TOUCHSCREEN_MAX11801 is not set
> # CONFIG_TOUCHSCREEN_MCS5000 is not set
> # CONFIG_TOUCHSCREEN_MTOUCH is not set
> # CONFIG_TOUCHSCREEN_INEXIO is not set
> # CONFIG_TOUCHSCREEN_MK712 is not set
> # CONFIG_TOUCHSCREEN_PENMOUNT is not set
> # CONFIG_TOUCHSCREEN_TOUCHRIGHT is not set
> # CONFIG_TOUCHSCREEN_TOUCHWIN is not set
> # CONFIG_TOUCHSCREEN_PIXCIR is not set
> # CONFIG_TOUCHSCREEN_USB_COMPOSITE is not set
> CONFIG_TOUCHSCREEN_MC13783=y
> # CONFIG_TOUCHSCREEN_TOUCHIT213 is not set
> # CONFIG_TOUCHSCREEN_TSC_SERIO is not set
> # CONFIG_TOUCHSCREEN_TSC2005 is not set
> # CONFIG_TOUCHSCREEN_TSC2007 is not set
> # CONFIG_TOUCHSCREEN_ST1232 is not set
> # CONFIG_TOUCHSCREEN_TPS6507X is not set
> CONFIG_INPUT_MISC=y
> # CONFIG_INPUT_88PM860X_ONKEY is not set
> # CONFIG_INPUT_AD714X is not set
> # CONFIG_INPUT_BMA150 is not set
> # CONFIG_INPUT_PCSPKR is not set
> CONFIG_INPUT_MC13783_PWRBUTTON=y
> # CONFIG_INPUT_MMA8450 is not set
> # CONFIG_INPUT_MPU3050 is not set
> # CONFIG_INPUT_APANEL is not set
> # CONFIG_INPUT_GP2A is not set
> # CONFIG_INPUT_GPIO_TILT_POLLED is not set
> # CONFIG_INPUT_ATLAS_BTNS is not set
> # CONFIG_INPUT_ATI_REMOTE2 is not set
> # CONFIG_INPUT_KEYSPAN_REMOTE is not set
> # CONFIG_INPUT_KXTJ9 is not set
> # CONFIG_INPUT_POWERMATE is not set
> # CONFIG_INPUT_YEALINK is not set
> # CONFIG_INPUT_CM109 is not set
> CONFIG_INPUT_TWL6040_VIBRA=y
> # CONFIG_INPUT_UINPUT is not set
> # CONFIG_INPUT_PCF8574 is not set
> # CONFIG_INPUT_GPIO_ROTARY_ENCODER is not set
> # CONFIG_INPUT_ADXL34X is not set
> # CONFIG_INPUT_CMA3000 is not set
> CONFIG_INPUT_XEN_KBDDEV_FRONTEND=y
> 
> #
> # Hardware I/O ports
> #
> CONFIG_SERIO=y
> CONFIG_SERIO_I8042=y
> CONFIG_SERIO_SERPORT=y
> CONFIG_SERIO_CT82C710=y
> CONFIG_SERIO_PARKBD=y
> CONFIG_SERIO_PCIPS2=y
> CONFIG_SERIO_LIBPS2=y
> CONFIG_SERIO_RAW=y
> CONFIG_SERIO_ALTERA_PS2=y
> CONFIG_SERIO_PS2MULT=y
> CONFIG_GAMEPORT=y
> CONFIG_GAMEPORT_NS558=y
> CONFIG_GAMEPORT_L4=y
> CONFIG_GAMEPORT_EMU10K1=y
> CONFIG_GAMEPORT_FM801=y
> 
> #
> # Character devices
> #
> CONFIG_VT=y
> CONFIG_CONSOLE_TRANSLATIONS=y
> CONFIG_VT_CONSOLE=y
> CONFIG_VT_CONSOLE_SLEEP=y
> CONFIG_HW_CONSOLE=y
> CONFIG_VT_HW_CONSOLE_BINDING=y
> CONFIG_UNIX98_PTYS=y
> CONFIG_DEVPTS_MULTIPLE_INSTANCES=y
> CONFIG_LEGACY_PTYS=y
> CONFIG_LEGACY_PTY_COUNT=256
> CONFIG_SERIAL_NONSTANDARD=y
> CONFIG_ROCKETPORT=y
> CONFIG_CYCLADES=y
> CONFIG_CYZ_INTR=y
> CONFIG_MOXA_INTELLIO=y
> CONFIG_MOXA_SMARTIO=y
> CONFIG_SYNCLINK=y
> CONFIG_SYNCLINKMP=y
> CONFIG_SYNCLINK_GT=y
> CONFIG_NOZOMI=y
> CONFIG_ISI=y
> CONFIG_N_HDLC=y
> CONFIG_N_GSM=y
> CONFIG_TRACE_ROUTER=y
> CONFIG_TRACE_SINK=y
> CONFIG_DEVKMEM=y
> CONFIG_STALDRV=y
> 
> #
> # Serial drivers
> #
> CONFIG_SERIAL_8250=y
> CONFIG_SERIAL_8250_CONSOLE=y
> CONFIG_FIX_EARLYCON_MEM=y
> CONFIG_SERIAL_8250_PCI=y
> CONFIG_SERIAL_8250_PNP=y
> CONFIG_SERIAL_8250_CS=y
> CONFIG_SERIAL_8250_NR_UARTS=32
> CONFIG_SERIAL_8250_RUNTIME_UARTS=4
> CONFIG_SERIAL_8250_EXTENDED=y
> CONFIG_SERIAL_8250_MANY_PORTS=y
> CONFIG_SERIAL_8250_SHARE_IRQ=y
> CONFIG_SERIAL_8250_DETECT_IRQ=y
> CONFIG_SERIAL_8250_RSA=y
> 
> #
> # Non-8250 serial port support
> #
> CONFIG_SERIAL_MAX3100=y
> CONFIG_SERIAL_MAX3107=y
> CONFIG_SERIAL_MFD_HSU=y
> CONFIG_SERIAL_MFD_HSU_CONSOLE=y
> CONFIG_SERIAL_CORE=y
> CONFIG_SERIAL_CORE_CONSOLE=y
> CONFIG_CONSOLE_POLL=y
> CONFIG_SERIAL_JSM=y
> CONFIG_SERIAL_TIMBERDALE=y
> CONFIG_SERIAL_ALTERA_JTAGUART=y
> CONFIG_SERIAL_ALTERA_JTAGUART_CONSOLE=y
> CONFIG_SERIAL_ALTERA_JTAGUART_CONSOLE_BYPASS=y
> CONFIG_SERIAL_ALTERA_UART=y
> CONFIG_SERIAL_ALTERA_UART_MAXPORTS=4
> CONFIG_SERIAL_ALTERA_UART_BAUDRATE=115200
> CONFIG_SERIAL_ALTERA_UART_CONSOLE=y
> CONFIG_SERIAL_IFX6X60=y
> CONFIG_SERIAL_PCH_UART=y
> CONFIG_SERIAL_PCH_UART_CONSOLE=y
> CONFIG_SERIAL_XILINX_PS_UART=y
> CONFIG_SERIAL_XILINX_PS_UART_CONSOLE=y
> CONFIG_TTY_PRINTK=y
> CONFIG_PRINTER=y
> CONFIG_LP_CONSOLE=y
> CONFIG_PPDEV=y
> CONFIG_HVC_DRIVER=y
> CONFIG_HVC_IRQ=y
> CONFIG_HVC_XEN=y
> CONFIG_HVC_XEN_FRONTEND=y
> CONFIG_VIRTIO_CONSOLE=y
> # CONFIG_IPMI_HANDLER is not set
> CONFIG_HW_RANDOM=y
> CONFIG_HW_RANDOM_TIMERIOMEM=y
> CONFIG_HW_RANDOM_INTEL=y
> CONFIG_HW_RANDOM_AMD=y
> CONFIG_HW_RANDOM_VIA=y
> CONFIG_HW_RANDOM_VIRTIO=y
> CONFIG_NVRAM=y
> # CONFIG_R3964 is not set
> # CONFIG_APPLICOM is not set
> 
> #
> # PCMCIA character devices
> #
> # CONFIG_SYNCLINK_CS is not set
> # CONFIG_CARDMAN_4000 is not set
> # CONFIG_CARDMAN_4040 is not set
> # CONFIG_IPWIRELESS is not set
> # CONFIG_MWAVE is not set
> CONFIG_RAW_DRIVER=y
> CONFIG_MAX_RAW_DEVS=256
> CONFIG_HPET=y
> CONFIG_HPET_MMAP=y
> CONFIG_HANGCHECK_TIMER=y
> CONFIG_UV_MMTIMER=y
> CONFIG_TCG_TPM=y
> CONFIG_TCG_TIS=y
> CONFIG_TCG_NSC=y
> CONFIG_TCG_ATMEL=y
> CONFIG_TCG_INFINEON=y
> # CONFIG_TELCLOCK is not set
> CONFIG_DEVPORT=y
> CONFIG_I2C=y
> CONFIG_I2C_BOARDINFO=y
> CONFIG_I2C_COMPAT=y
> CONFIG_I2C_CHARDEV=y
> CONFIG_I2C_MUX=y
> 
> #
> # Multiplexer I2C Chip support
> #
> # CONFIG_I2C_MUX_GPIO is not set
> # CONFIG_I2C_MUX_PCA9541 is not set
> # CONFIG_I2C_MUX_PCA954x is not set
> CONFIG_I2C_HELPER_AUTO=y
> CONFIG_I2C_ALGOBIT=y
> 
> #
> # I2C Hardware Bus support
> #
> 
> #
> # PC SMBus host controller drivers
> #
> # CONFIG_I2C_ALI1535 is not set
> # CONFIG_I2C_ALI1563 is not set
> # CONFIG_I2C_ALI15X3 is not set
> # CONFIG_I2C_AMD756 is not set
> # CONFIG_I2C_AMD8111 is not set
> CONFIG_I2C_I801=y
> # CONFIG_I2C_ISCH is not set
> # CONFIG_I2C_PIIX4 is not set
> # CONFIG_I2C_NFORCE2 is not set
> # CONFIG_I2C_SIS5595 is not set
> # CONFIG_I2C_SIS630 is not set
> # CONFIG_I2C_SIS96X is not set
> # CONFIG_I2C_VIA is not set
> # CONFIG_I2C_VIAPRO is not set
> 
> #
> # ACPI drivers
> #
> # CONFIG_I2C_SCMI is not set
> 
> #
> # I2C system bus drivers (mostly embedded / system-on-chip)
> #
> CONFIG_I2C_DESIGNWARE_PCI=y
> # CONFIG_I2C_EG20T is not set
> # CONFIG_I2C_GPIO is not set
> # CONFIG_I2C_INTEL_MID is not set
> # CONFIG_I2C_OCORES is not set
> # CONFIG_I2C_PCA_PLATFORM is not set
> # CONFIG_I2C_PXA_PCI is not set
> # CONFIG_I2C_SIMTEC is not set
> # CONFIG_I2C_XILINX is not set
> 
> #
> # External I2C/SMBus adapter drivers
> #
> # CONFIG_I2C_DIOLAN_U2C is not set
> # CONFIG_I2C_PARPORT is not set
> # CONFIG_I2C_PARPORT_LIGHT is not set
> # CONFIG_I2C_TAOS_EVM is not set
> # CONFIG_I2C_TINY_USB is not set
> 
> #
> # Other I2C/SMBus bus drivers
> #
> CONFIG_I2C_DEBUG_CORE=y
> CONFIG_I2C_DEBUG_ALGO=y
> CONFIG_I2C_DEBUG_BUS=y
> CONFIG_SPI=y
> CONFIG_SPI_DEBUG=y
> CONFIG_SPI_MASTER=y
> 
> #
> # SPI Master Controller Drivers
> #
> # CONFIG_SPI_ALTERA is not set
> # CONFIG_SPI_BITBANG is not set
> # CONFIG_SPI_BUTTERFLY is not set
> # CONFIG_SPI_GPIO is not set
> # CONFIG_SPI_LM70_LLP is not set
> # CONFIG_SPI_OC_TINY is not set
> # CONFIG_SPI_PXA2XX_PCI is not set
> # CONFIG_SPI_TOPCLIFF_PCH is not set
> # CONFIG_SPI_XILINX is not set
> # CONFIG_SPI_DESIGNWARE is not set
> 
> #
> # SPI Protocol Masters
> #
> CONFIG_SPI_SPIDEV=y
> CONFIG_SPI_TLE62X0=y
> CONFIG_HSI=y
> CONFIG_HSI_BOARDINFO=y
> 
> #
> # HSI clients
> #
> CONFIG_HSI_CHAR=y
> 
> #
> # PPS support
> #
> CONFIG_PPS=y
> # CONFIG_PPS_DEBUG is not set
> 
> #
> # PPS clients support
> #
> CONFIG_PPS_CLIENT_KTIMER=y
> CONFIG_PPS_CLIENT_LDISC=y
> CONFIG_PPS_CLIENT_PARPORT=y
> CONFIG_PPS_CLIENT_GPIO=y
> 
> #
> # PPS generators support
> #
> 
> #
> # PTP clock support
> #
> CONFIG_PTP_1588_CLOCK=y
> CONFIG_DP83640_PHY=y
> # CONFIG_PTP_1588_CLOCK_PCH is not set
> CONFIG_ARCH_WANT_OPTIONAL_GPIOLIB=y
> CONFIG_GPIOLIB=y
> CONFIG_DEBUG_GPIO=y
> CONFIG_GPIO_SYSFS=y
> CONFIG_GPIO_GENERIC=y
> 
> #
> # Memory mapped GPIO drivers:
> #
> CONFIG_GPIO_GENERIC_PLATFORM=y
> # CONFIG_GPIO_IT8761E is not set
> # CONFIG_GPIO_SCH is not set
> CONFIG_GPIO_ICH=y
> # CONFIG_GPIO_VX855 is not set
> 
> #
> # I2C GPIO expanders:
> #
> # CONFIG_GPIO_MAX7300 is not set
> # CONFIG_GPIO_MAX732X is not set
> # CONFIG_GPIO_PCA953X is not set
> # CONFIG_GPIO_PCF857X is not set
> CONFIG_GPIO_RC5T583=y
> # CONFIG_GPIO_SX150X is not set
> # CONFIG_GPIO_ADP5588 is not set
> 
> #
> # PCI GPIO expanders:
> #
> # CONFIG_GPIO_BT8XX is not set
> # CONFIG_GPIO_LANGWELL is not set
> # CONFIG_GPIO_PCH is not set
> # CONFIG_GPIO_ML_IOH is not set
> # CONFIG_GPIO_RDC321X is not set
> 
> #
> # SPI GPIO expanders:
> #
> # CONFIG_GPIO_MAX7301 is not set
> # CONFIG_GPIO_MCP23S08 is not set
> # CONFIG_GPIO_MC33880 is not set
> # CONFIG_GPIO_74X164 is not set
> 
> #
> # AC97 GPIO expanders:
> #
> 
> #
> # MODULbus GPIO expanders:
> #
> CONFIG_W1=y
> CONFIG_W1_CON=y
> 
> #
> # 1-wire Bus Masters
> #
> CONFIG_W1_MASTER_MATROX=y
> CONFIG_W1_MASTER_DS2490=y
> CONFIG_W1_MASTER_DS2482=y
> CONFIG_W1_MASTER_DS1WM=y
> CONFIG_W1_MASTER_GPIO=y
> 
> #
> # 1-wire Slaves
> #
> CONFIG_W1_SLAVE_THERM=y
> CONFIG_W1_SLAVE_SMEM=y
> CONFIG_W1_SLAVE_DS2408=y
> CONFIG_W1_SLAVE_DS2423=y
> CONFIG_W1_SLAVE_DS2431=y
> CONFIG_W1_SLAVE_DS2433=y
> CONFIG_W1_SLAVE_DS2433_CRC=y
> CONFIG_W1_SLAVE_DS2760=y
> CONFIG_W1_SLAVE_DS2780=y
> CONFIG_W1_SLAVE_DS2781=y
> CONFIG_W1_SLAVE_DS28E04=y
> CONFIG_W1_SLAVE_BQ27000=y
> CONFIG_POWER_SUPPLY=y
> # CONFIG_POWER_SUPPLY_DEBUG is not set
> # CONFIG_PDA_POWER is not set
> # CONFIG_TEST_POWER is not set
> CONFIG_BATTERY_DS2760=y
> # CONFIG_BATTERY_DS2780 is not set
> CONFIG_BATTERY_DS2781=y
> # CONFIG_BATTERY_DS2782 is not set
> CONFIG_BATTERY_SBS=y
> # CONFIG_BATTERY_BQ27x00 is not set
> # CONFIG_BATTERY_MAX17040 is not set
> # CONFIG_BATTERY_MAX17042 is not set
> # CONFIG_CHARGER_ISP1704 is not set
> # CONFIG_CHARGER_MAX8903 is not set
> CONFIG_CHARGER_LP8727=y
> # CONFIG_CHARGER_GPIO is not set
> CONFIG_CHARGER_MANAGER=y
> # CONFIG_CHARGER_SMB347 is not set
> CONFIG_HWMON=y
> # CONFIG_HWMON_VID is not set
> # CONFIG_HWMON_DEBUG_CHIP is not set
> 
> #
> # Native drivers
> #
> # CONFIG_SENSORS_ABITUGURU is not set
> # CONFIG_SENSORS_ABITUGURU3 is not set
> # CONFIG_SENSORS_AD7314 is not set
> # CONFIG_SENSORS_AD7414 is not set
> # CONFIG_SENSORS_AD7418 is not set
> # CONFIG_SENSORS_ADCXX is not set
> # CONFIG_SENSORS_ADM1021 is not set
> # CONFIG_SENSORS_ADM1025 is not set
> # CONFIG_SENSORS_ADM1026 is not set
> # CONFIG_SENSORS_ADM1029 is not set
> # CONFIG_SENSORS_ADM1031 is not set
> # CONFIG_SENSORS_ADM9240 is not set
> # CONFIG_SENSORS_ADT7411 is not set
> # CONFIG_SENSORS_ADT7462 is not set
> # CONFIG_SENSORS_ADT7470 is not set
> # CONFIG_SENSORS_ADT7475 is not set
> # CONFIG_SENSORS_ASC7621 is not set
> # CONFIG_SENSORS_K8TEMP is not set
> # CONFIG_SENSORS_K10TEMP is not set
> # CONFIG_SENSORS_FAM15H_POWER is not set
> # CONFIG_SENSORS_ASB100 is not set
> # CONFIG_SENSORS_ATXP1 is not set
> # CONFIG_SENSORS_DS620 is not set
> # CONFIG_SENSORS_DS1621 is not set
> # CONFIG_SENSORS_I5K_AMB is not set
> # CONFIG_SENSORS_F71805F is not set
> # CONFIG_SENSORS_F71882FG is not set
> # CONFIG_SENSORS_F75375S is not set
> # CONFIG_SENSORS_FSCHMD is not set
> # CONFIG_SENSORS_G760A is not set
> # CONFIG_SENSORS_GL518SM is not set
> # CONFIG_SENSORS_GL520SM is not set
> # CONFIG_SENSORS_GPIO_FAN is not set
> CONFIG_SENSORS_CORETEMP=y
> # CONFIG_SENSORS_IT87 is not set
> # CONFIG_SENSORS_JC42 is not set
> # CONFIG_SENSORS_LINEAGE is not set
> # CONFIG_SENSORS_LM63 is not set
> # CONFIG_SENSORS_LM70 is not set
> # CONFIG_SENSORS_LM73 is not set
> # CONFIG_SENSORS_LM75 is not set
> # CONFIG_SENSORS_LM77 is not set
> # CONFIG_SENSORS_LM78 is not set
> # CONFIG_SENSORS_LM80 is not set
> # CONFIG_SENSORS_LM83 is not set
> # CONFIG_SENSORS_LM85 is not set
> # CONFIG_SENSORS_LM87 is not set
> # CONFIG_SENSORS_LM90 is not set
> # CONFIG_SENSORS_LM92 is not set
> # CONFIG_SENSORS_LM93 is not set
> # CONFIG_SENSORS_LTC4151 is not set
> # CONFIG_SENSORS_LTC4215 is not set
> # CONFIG_SENSORS_LTC4245 is not set
> # CONFIG_SENSORS_LTC4261 is not set
> # CONFIG_SENSORS_LM95241 is not set
> # CONFIG_SENSORS_LM95245 is not set
> # CONFIG_SENSORS_MAX1111 is not set
> # CONFIG_SENSORS_MAX16065 is not set
> # CONFIG_SENSORS_MAX1619 is not set
> # CONFIG_SENSORS_MAX1668 is not set
> # CONFIG_SENSORS_MAX6639 is not set
> # CONFIG_SENSORS_MAX6642 is not set
> # CONFIG_SENSORS_MAX6650 is not set
> CONFIG_SENSORS_MCP3021=y
> # CONFIG_SENSORS_NTC_THERMISTOR is not set
> # CONFIG_SENSORS_PC87360 is not set
> # CONFIG_SENSORS_PC87427 is not set
> # CONFIG_SENSORS_PCF8591 is not set
> # CONFIG_PMBUS is not set
> # CONFIG_SENSORS_SHT15 is not set
> # CONFIG_SENSORS_SHT21 is not set
> # CONFIG_SENSORS_SIS5595 is not set
> # CONFIG_SENSORS_SMM665 is not set
> # CONFIG_SENSORS_DME1737 is not set
> # CONFIG_SENSORS_EMC1403 is not set
> # CONFIG_SENSORS_EMC2103 is not set
> # CONFIG_SENSORS_EMC6W201 is not set
> # CONFIG_SENSORS_SMSC47M1 is not set
> # CONFIG_SENSORS_SMSC47M192 is not set
> # CONFIG_SENSORS_SMSC47B397 is not set
> # CONFIG_SENSORS_SCH56XX_COMMON is not set
> # CONFIG_SENSORS_SCH5627 is not set
> # CONFIG_SENSORS_SCH5636 is not set
> # CONFIG_SENSORS_ADS1015 is not set
> # CONFIG_SENSORS_ADS7828 is not set
> # CONFIG_SENSORS_ADS7871 is not set
> # CONFIG_SENSORS_AMC6821 is not set
> CONFIG_SENSORS_INA2XX=y
> # CONFIG_SENSORS_THMC50 is not set
> # CONFIG_SENSORS_TMP102 is not set
> # CONFIG_SENSORS_TMP401 is not set
> # CONFIG_SENSORS_TMP421 is not set
> # CONFIG_SENSORS_VIA_CPUTEMP is not set
> # CONFIG_SENSORS_VIA686A is not set
> # CONFIG_SENSORS_VT1211 is not set
> # CONFIG_SENSORS_VT8231 is not set
> # CONFIG_SENSORS_W83781D is not set
> # CONFIG_SENSORS_W83791D is not set
> # CONFIG_SENSORS_W83792D is not set
> # CONFIG_SENSORS_W83793 is not set
> # CONFIG_SENSORS_W83795 is not set
> # CONFIG_SENSORS_W83L785TS is not set
> # CONFIG_SENSORS_W83L786NG is not set
> # CONFIG_SENSORS_W83627HF is not set
> # CONFIG_SENSORS_W83627EHF is not set
> # CONFIG_SENSORS_APPLESMC is not set
> CONFIG_SENSORS_MC13783_ADC=y
> 
> #
> # ACPI drivers
> #
> CONFIG_SENSORS_ACPI_POWER=y
> # CONFIG_SENSORS_ATK0110 is not set
> CONFIG_THERMAL=y
> CONFIG_THERMAL_HWMON=y
> CONFIG_WATCHDOG=y
> CONFIG_WATCHDOG_CORE=y
> # CONFIG_WATCHDOG_NOWAYOUT is not set
> 
> #
> # Watchdog Device Drivers
> #
> # CONFIG_SOFT_WATCHDOG is not set
> # CONFIG_ACQUIRE_WDT is not set
> # CONFIG_ADVANTECH_WDT is not set
> # CONFIG_ALIM1535_WDT is not set
> # CONFIG_ALIM7101_WDT is not set
> # CONFIG_F71808E_WDT is not set
> # CONFIG_SP5100_TCO is not set
> # CONFIG_SC520_WDT is not set
> # CONFIG_SBC_FITPC2_WATCHDOG is not set
> # CONFIG_EUROTECH_WDT is not set
> # CONFIG_IB700_WDT is not set
> # CONFIG_IBMASR is not set
> # CONFIG_WAFER_WDT is not set
> # CONFIG_I6300ESB_WDT is not set
> CONFIG_IE6XX_WDT=y
> # CONFIG_ITCO_WDT is not set
> # CONFIG_IT8712F_WDT is not set
> # CONFIG_IT87_WDT is not set
> # CONFIG_HP_WATCHDOG is not set
> # CONFIG_SC1200_WDT is not set
> # CONFIG_PC87413_WDT is not set
> # CONFIG_NV_TCO is not set
> # CONFIG_60XX_WDT is not set
> # CONFIG_SBC8360_WDT is not set
> # CONFIG_CPU5_WDT is not set
> # CONFIG_SMSC_SCH311X_WDT is not set
> # CONFIG_SMSC37B787_WDT is not set
> # CONFIG_VIA_WDT is not set
> # CONFIG_W83627HF_WDT is not set
> # CONFIG_W83697HF_WDT is not set
> # CONFIG_W83697UG_WDT is not set
> # CONFIG_W83877F_WDT is not set
> # CONFIG_W83977F_WDT is not set
> # CONFIG_MACHZ_WDT is not set
> # CONFIG_SBC_EPX_C3_WATCHDOG is not set
> CONFIG_XEN_WDT=y
> 
> #
> # PCI-based Watchdog Cards
> #
> # CONFIG_PCIPCWATCHDOG is not set
> # CONFIG_WDTPCI is not set
> 
> #
> # USB-based Watchdog Cards
> #
> # CONFIG_USBPCWATCHDOG is not set
> CONFIG_SSB_POSSIBLE=y
> 
> #
> # Sonics Silicon Backplane
> #
> CONFIG_SSB=y
> CONFIG_SSB_SPROM=y
> CONFIG_SSB_BLOCKIO=y
> CONFIG_SSB_PCIHOST_POSSIBLE=y
> CONFIG_SSB_PCIHOST=y
> CONFIG_SSB_B43_PCI_BRIDGE=y
> CONFIG_SSB_PCMCIAHOST_POSSIBLE=y
> CONFIG_SSB_PCMCIAHOST=y
> CONFIG_SSB_SDIOHOST_POSSIBLE=y
> CONFIG_SSB_SDIOHOST=y
> # CONFIG_SSB_SILENT is not set
> CONFIG_SSB_DEBUG=y
> CONFIG_SSB_DRIVER_PCICORE_POSSIBLE=y
> CONFIG_SSB_DRIVER_PCICORE=y
> CONFIG_BCMA_POSSIBLE=y
> 
> #
> # Broadcom specific AMBA
> #
> # CONFIG_BCMA is not set
> 
> #
> # Multifunction device drivers
> #
> CONFIG_MFD_CORE=y
> CONFIG_MFD_88PM860X=y
> CONFIG_MFD_SM501=y
> # CONFIG_MFD_SM501_GPIO is not set
> CONFIG_HTC_PASIC3=y
> # CONFIG_HTC_I2CPLD is not set
> CONFIG_MFD_LM3533=y
> CONFIG_TPS6105X=y
> # CONFIG_TPS65010 is not set
> CONFIG_TPS6507X=y
> CONFIG_MFD_TPS65217=y
> # CONFIG_MFD_TPS6586X is not set
> # CONFIG_MFD_TPS65910 is not set
> # CONFIG_MFD_TPS65912_I2C is not set
> # CONFIG_MFD_TPS65912_SPI is not set
> # CONFIG_TWL4030_CORE is not set
> CONFIG_TWL6040_CORE=y
> # CONFIG_MFD_STMPE is not set
> # CONFIG_MFD_TC3589X is not set
> # CONFIG_MFD_TMIO is not set
> # CONFIG_PMIC_DA903X is not set
> # CONFIG_MFD_DA9052_SPI is not set
> # CONFIG_MFD_DA9052_I2C is not set
> # CONFIG_PMIC_ADP5520 is not set
> CONFIG_MFD_MAX77686=y
> CONFIG_MFD_MAX77693=y
> # CONFIG_MFD_MAX8925 is not set
> # CONFIG_MFD_MAX8997 is not set
> # CONFIG_MFD_MAX8998 is not set
> CONFIG_MFD_S5M_CORE=y
> # CONFIG_MFD_WM8400 is not set
> # CONFIG_MFD_WM831X_I2C is not set
> # CONFIG_MFD_WM831X_SPI is not set
> # CONFIG_MFD_WM8350_I2C is not set
> # CONFIG_MFD_WM8994 is not set
> # CONFIG_MFD_PCF50633 is not set
> CONFIG_MFD_MC13783=y
> CONFIG_MFD_MC13XXX=y
> CONFIG_MFD_MC13XXX_SPI=y
> CONFIG_MFD_MC13XXX_I2C=y
> # CONFIG_ABX500_CORE is not set
> # CONFIG_EZX_PCAP is not set
> # CONFIG_MFD_CS5535 is not set
> # CONFIG_MFD_TIMBERDALE is not set
> CONFIG_LPC_SCH=y
> CONFIG_LPC_ICH=y
> # CONFIG_MFD_RDC321X is not set
> # CONFIG_MFD_JANZ_CMODIO is not set
> # CONFIG_MFD_VX855 is not set
> # CONFIG_MFD_WL1273_CORE is not set
> CONFIG_MFD_TPS65090=y
> # CONFIG_MFD_AAT2870_CORE is not set
> CONFIG_MFD_RC5T583=y
> CONFIG_MFD_PALMAS=y
> CONFIG_REGULATOR=y
> # CONFIG_REGULATOR_DEBUG is not set
> # CONFIG_REGULATOR_DUMMY is not set
> CONFIG_REGULATOR_FIXED_VOLTAGE=y
> # CONFIG_REGULATOR_VIRTUAL_CONSUMER is not set
> # CONFIG_REGULATOR_USERSPACE_CONSUMER is not set
> # CONFIG_REGULATOR_GPIO is not set
> # CONFIG_REGULATOR_AD5398 is not set
> CONFIG_REGULATOR_MC13XXX_CORE=y
> CONFIG_REGULATOR_MC13783=y
> CONFIG_REGULATOR_MC13892=y
> # CONFIG_REGULATOR_ISL6271A is not set
> # CONFIG_REGULATOR_88PM8607 is not set
> # CONFIG_REGULATOR_MAX1586 is not set
> # CONFIG_REGULATOR_MAX8649 is not set
> # CONFIG_REGULATOR_MAX8660 is not set
> # CONFIG_REGULATOR_MAX8952 is not set
> CONFIG_REGULATOR_MAX77686=y
> # CONFIG_REGULATOR_LP3971 is not set
> # CONFIG_REGULATOR_LP3972 is not set
> CONFIG_REGULATOR_LP872X=y
> CONFIG_REGULATOR_RC5T583=y
> CONFIG_REGULATOR_S5M8767=y
> CONFIG_REGULATOR_PALMAS=y
> CONFIG_REGULATOR_TPS6105X=y
> CONFIG_REGULATOR_TPS62360=y
> # CONFIG_REGULATOR_TPS65023 is not set
> # CONFIG_REGULATOR_TPS6507X is not set
> CONFIG_REGULATOR_TPS65090=y
> CONFIG_REGULATOR_TPS65217=y
> # CONFIG_REGULATOR_TPS6524X is not set
> CONFIG_MEDIA_SUPPORT=y
> 
> #
> # Multimedia core support
> #
> CONFIG_MEDIA_CONTROLLER=y
> CONFIG_VIDEO_DEV=y
> CONFIG_VIDEO_V4L2_COMMON=y
> CONFIG_VIDEO_V4L2_SUBDEV_API=y
> CONFIG_DVB_CORE=y
> # CONFIG_DVB_NET is not set
> CONFIG_VIDEO_MEDIA=y
> 
> #
> # Multimedia drivers
> #
> CONFIG_RC_CORE=y
> CONFIG_LIRC=y
> CONFIG_RC_MAP=y
> CONFIG_IR_NEC_DECODER=y
> CONFIG_IR_RC5_DECODER=y
> CONFIG_IR_RC6_DECODER=y
> CONFIG_IR_JVC_DECODER=y
> CONFIG_IR_SONY_DECODER=y
> CONFIG_IR_RC5_SZ_DECODER=y
> CONFIG_IR_SANYO_DECODER=y
> CONFIG_IR_MCE_KBD_DECODER=y
> CONFIG_IR_LIRC_CODEC=y
> # CONFIG_RC_ATI_REMOTE is not set
> # CONFIG_IR_ENE is not set
> # CONFIG_IR_IMON is not set
> # CONFIG_IR_MCEUSB is not set
> # CONFIG_IR_ITE_CIR is not set
> # CONFIG_IR_FINTEK is not set
> # CONFIG_IR_NUVOTON is not set
> # CONFIG_IR_REDRAT3 is not set
> # CONFIG_IR_STREAMZAP is not set
> # CONFIG_IR_WINBOND_CIR is not set
> # CONFIG_RC_LOOPBACK is not set
> # CONFIG_IR_GPIO_CIR is not set
> CONFIG_MEDIA_TUNER=y
> CONFIG_MEDIA_TUNER_CUSTOMISE=y
> 
> #
> # Customize TV tuners
> #
> CONFIG_MEDIA_TUNER_SIMPLE=y
> CONFIG_MEDIA_TUNER_TDA8290=y
> CONFIG_MEDIA_TUNER_TDA827X=y
> CONFIG_MEDIA_TUNER_TDA18271=y
> CONFIG_MEDIA_TUNER_TDA9887=y
> CONFIG_MEDIA_TUNER_TEA5761=y
> CONFIG_MEDIA_TUNER_TEA5767=y
> CONFIG_MEDIA_TUNER_MT20XX=y
> CONFIG_MEDIA_TUNER_MT2060=y
> CONFIG_MEDIA_TUNER_MT2063=y
> CONFIG_MEDIA_TUNER_MT2266=y
> CONFIG_MEDIA_TUNER_MT2131=y
> CONFIG_MEDIA_TUNER_QT1010=y
> CONFIG_MEDIA_TUNER_XC2028=y
> CONFIG_MEDIA_TUNER_XC5000=y
> CONFIG_MEDIA_TUNER_XC4000=y
> CONFIG_MEDIA_TUNER_MXL5005S=y
> CONFIG_MEDIA_TUNER_MXL5007T=y
> CONFIG_MEDIA_TUNER_MC44S803=y
> CONFIG_MEDIA_TUNER_MAX2165=y
> CONFIG_MEDIA_TUNER_TDA18218=y
> CONFIG_MEDIA_TUNER_FC0011=y
> CONFIG_MEDIA_TUNER_FC0012=y
> CONFIG_MEDIA_TUNER_FC0013=y
> CONFIG_MEDIA_TUNER_TDA18212=y
> CONFIG_MEDIA_TUNER_TUA9001=y
> CONFIG_VIDEO_V4L2=y
> CONFIG_VIDEOBUF2_CORE=y
> CONFIG_VIDEOBUF2_MEMOPS=y
> CONFIG_VIDEOBUF2_DMA_CONTIG=y
> CONFIG_VIDEOBUF2_VMALLOC=y
> CONFIG_VIDEO_CAPTURE_DRIVERS=y
> CONFIG_VIDEO_ADV_DEBUG=y
> CONFIG_VIDEO_FIXED_MINOR_RANGES=y
> CONFIG_VIDEO_HELPER_CHIPS_AUTO=y
> CONFIG_VIDEO_IR_I2C=y
> 
> #
> # Audio decoders, processors and mixers
> #
> 
> #
> # RDS decoders
> #
> 
> #
> # Video decoders
> #
> 
> #
> # Video and audio decoders
> #
> 
> #
> # MPEG video encoders
> #
> 
> #
> # Video encoders
> #
> 
> #
> # Camera sensor devices
> #
> 
> #
> # Flash devices
> #
> 
> #
> # Video improvement chips
> #
> 
> #
> # Miscelaneous helper chips
> #
> CONFIG_VIDEO_VIVI=y
> CONFIG_V4L_USB_DRIVERS=y
> # CONFIG_VIDEO_AU0828 is not set
> # CONFIG_USB_VIDEO_CLASS is not set
> CONFIG_USB_VIDEO_CLASS_INPUT_EVDEV=y
> CONFIG_USB_GSPCA=y
> # CONFIG_USB_M5602 is not set
> # CONFIG_USB_STV06XX is not set
> # CONFIG_USB_GL860 is not set
> # CONFIG_USB_GSPCA_BENQ is not set
> # CONFIG_USB_GSPCA_CONEX is not set
> # CONFIG_USB_GSPCA_CPIA1 is not set
> # CONFIG_USB_GSPCA_ETOMS is not set
> # CONFIG_USB_GSPCA_FINEPIX is not set
> # CONFIG_USB_GSPCA_JEILINJ is not set
> CONFIG_USB_GSPCA_JL2005BCD=y
> # CONFIG_USB_GSPCA_KINECT is not set
> # CONFIG_USB_GSPCA_KONICA is not set
> # CONFIG_USB_GSPCA_MARS is not set
> # CONFIG_USB_GSPCA_MR97310A is not set
> # CONFIG_USB_GSPCA_NW80X is not set
> # CONFIG_USB_GSPCA_OV519 is not set
> # CONFIG_USB_GSPCA_OV534 is not set
> # CONFIG_USB_GSPCA_OV534_9 is not set
> # CONFIG_USB_GSPCA_PAC207 is not set
> # CONFIG_USB_GSPCA_PAC7302 is not set
> # CONFIG_USB_GSPCA_PAC7311 is not set
> # CONFIG_USB_GSPCA_SE401 is not set
> # CONFIG_USB_GSPCA_SN9C2028 is not set
> # CONFIG_USB_GSPCA_SN9C20X is not set
> # CONFIG_USB_GSPCA_SONIXB is not set
> # CONFIG_USB_GSPCA_SONIXJ is not set
> # CONFIG_USB_GSPCA_SPCA500 is not set
> # CONFIG_USB_GSPCA_SPCA501 is not set
> # CONFIG_USB_GSPCA_SPCA505 is not set
> # CONFIG_USB_GSPCA_SPCA506 is not set
> # CONFIG_USB_GSPCA_SPCA508 is not set
> # CONFIG_USB_GSPCA_SPCA561 is not set
> # CONFIG_USB_GSPCA_SPCA1528 is not set
> # CONFIG_USB_GSPCA_SQ905 is not set
> # CONFIG_USB_GSPCA_SQ905C is not set
> # CONFIG_USB_GSPCA_SQ930X is not set
> # CONFIG_USB_GSPCA_STK014 is not set
> # CONFIG_USB_GSPCA_STV0680 is not set
> # CONFIG_USB_GSPCA_SUNPLUS is not set
> # CONFIG_USB_GSPCA_T613 is not set
> # CONFIG_USB_GSPCA_TOPRO is not set
> # CONFIG_USB_GSPCA_TV8532 is not set
> # CONFIG_USB_GSPCA_VC032X is not set
> # CONFIG_USB_GSPCA_VICAM is not set
> # CONFIG_USB_GSPCA_XIRLINK_CIT is not set
> # CONFIG_USB_GSPCA_ZC3XX is not set
> # CONFIG_VIDEO_PVRUSB2 is not set
> # CONFIG_VIDEO_HDPVR is not set
> # CONFIG_VIDEO_EM28XX is not set
> # CONFIG_VIDEO_CX231XX is not set
> # CONFIG_VIDEO_TM6000 is not set
> # CONFIG_VIDEO_USBVISION is not set
> # CONFIG_USB_SN9C102 is not set
> # CONFIG_USB_PWC is not set
> # CONFIG_VIDEO_CPIA2 is not set
> # CONFIG_USB_ZR364XX is not set
> # CONFIG_USB_STKWEBCAM is not set
> # CONFIG_USB_S2255 is not set
> CONFIG_V4L_PCI_DRIVERS=y
> # CONFIG_VIDEO_BT848 is not set
> # CONFIG_VIDEO_CX18 is not set
> # CONFIG_VIDEO_CX25821 is not set
> # CONFIG_VIDEO_CX88 is not set
> # CONFIG_VIDEO_HEXIUM_GEMINI is not set
> # CONFIG_VIDEO_HEXIUM_ORION is not set
> # CONFIG_VIDEO_IVTV is not set
> # CONFIG_VIDEO_MEYE is not set
> # CONFIG_VIDEO_MXB is not set
> # CONFIG_VIDEO_SAA7134 is not set
> # CONFIG_VIDEO_SAA7164 is not set
> # CONFIG_VIDEO_ZORAN is not set
> CONFIG_V4L_ISA_PARPORT_DRIVERS=y
> # CONFIG_VIDEO_BWQCAM is not set
> # CONFIG_VIDEO_CQCAM is not set
> # CONFIG_VIDEO_W9966 is not set
> CONFIG_V4L_PLATFORM_DRIVERS=y
> # CONFIG_VIDEO_CAFE_CCIC is not set
> # CONFIG_VIDEO_VIA_CAMERA is not set
> # CONFIG_VIDEO_TIMBERDALE is not set
> # CONFIG_SOC_CAMERA is not set
> CONFIG_V4L_MEM2MEM_DRIVERS=y
> # CONFIG_VIDEO_MEM2MEM_TESTDEV is not set
> CONFIG_RADIO_ADAPTERS=y
> # CONFIG_RADIO_SI470X is not set
> # CONFIG_USB_MR800 is not set
> # CONFIG_USB_DSBR is not set
> # CONFIG_I2C_SI4713 is not set
> # CONFIG_RADIO_SI4713 is not set
> # CONFIG_USB_KEENE is not set
> # CONFIG_RADIO_TEA5764 is not set
> # CONFIG_RADIO_SAA7706H is not set
> # CONFIG_RADIO_TEF6862 is not set
> # CONFIG_RADIO_WL1273 is not set
> 
> #
> # Texas Instruments WL128x FM driver (ST based)
> #
> # CONFIG_RADIO_WL128X is not set
> CONFIG_DVB_MAX_ADAPTERS=8
> CONFIG_DVB_DYNAMIC_MINORS=y
> CONFIG_DVB_CAPTURE_DRIVERS=y
> 
> #
> # Supported SAA7146 based PCI Adapters
> #
> # CONFIG_TTPCI_EEPROM is not set
> # CONFIG_DVB_AV7110 is not set
> # CONFIG_DVB_BUDGET_CORE is not set
> 
> #
> # Supported USB Adapters
> #
> # CONFIG_DVB_USB is not set
> # CONFIG_DVB_TTUSB_BUDGET is not set
> # CONFIG_DVB_TTUSB_DEC is not set
> # CONFIG_SMS_SIANO_MDTV is not set
> 
> #
> # Supported FlexCopII (B2C2) Adapters
> #
> # CONFIG_DVB_B2C2_FLEXCOP is not set
> 
> #
> # Supported BT878 Adapters
> #
> 
> #
> # Supported Pluto2 Adapters
> #
> # CONFIG_DVB_PLUTO2 is not set
> 
> #
> # Supported SDMC DM1105 Adapters
> #
> # CONFIG_DVB_DM1105 is not set
> 
> #
> # Supported FireWire (IEEE 1394) Adapters
> #
> # CONFIG_DVB_FIREDTV is not set
> 
> #
> # Supported Earthsoft PT1 Adapters
> #
> # CONFIG_DVB_PT1 is not set
> 
> #
> # Supported Mantis Adapters
> #
> # CONFIG_MANTIS_CORE is not set
> 
> #
> # Supported nGene Adapters
> #
> # CONFIG_DVB_NGENE is not set
> 
> #
> # Supported ddbridge ('Octopus') Adapters
> #
> # CONFIG_DVB_DDBRIDGE is not set
> 
> #
> # Supported DVB Frontends
> #
> CONFIG_DVB_FE_CUSTOMISE=y
> 
> #
> # Customise DVB Frontends
> #
> 
> #
> # Multistandard (satellite) frontends
> #
> CONFIG_DVB_STB0899=y
> CONFIG_DVB_STB6100=y
> CONFIG_DVB_STV090x=y
> CONFIG_DVB_STV6110x=y
> 
> #
> # Multistandard (cable + terrestrial) frontends
> #
> CONFIG_DVB_DRXK=y
> CONFIG_DVB_TDA18271C2DD=y
> 
> #
> # DVB-S (satellite) frontends
> #
> CONFIG_DVB_CX24110=y
> CONFIG_DVB_CX24123=y
> CONFIG_DVB_MT312=y
> CONFIG_DVB_ZL10036=y
> CONFIG_DVB_ZL10039=y
> CONFIG_DVB_S5H1420=y
> CONFIG_DVB_STV0288=y
> CONFIG_DVB_STB6000=y
> CONFIG_DVB_STV0299=y
> CONFIG_DVB_STV6110=y
> CONFIG_DVB_STV0900=y
> CONFIG_DVB_TDA8083=y
> CONFIG_DVB_TDA10086=y
> CONFIG_DVB_TDA8261=y
> CONFIG_DVB_VES1X93=y
> CONFIG_DVB_TUNER_ITD1000=y
> CONFIG_DVB_TUNER_CX24113=y
> CONFIG_DVB_TDA826X=y
> CONFIG_DVB_TUA6100=y
> CONFIG_DVB_CX24116=y
> CONFIG_DVB_SI21XX=y
> CONFIG_DVB_DS3000=y
> CONFIG_DVB_MB86A16=y
> CONFIG_DVB_TDA10071=y
> 
> #
> # DVB-T (terrestrial) frontends
> #
> CONFIG_DVB_SP8870=y
> CONFIG_DVB_SP887X=y
> CONFIG_DVB_CX22700=y
> CONFIG_DVB_CX22702=y
> CONFIG_DVB_S5H1432=y
> CONFIG_DVB_DRXD=y
> CONFIG_DVB_L64781=y
> CONFIG_DVB_TDA1004X=y
> CONFIG_DVB_NXT6000=y
> CONFIG_DVB_MT352=y
> CONFIG_DVB_ZL10353=y
> CONFIG_DVB_DIB3000MB=y
> CONFIG_DVB_DIB3000MC=y
> CONFIG_DVB_DIB7000M=y
> CONFIG_DVB_DIB7000P=y
> CONFIG_DVB_DIB9000=y
> CONFIG_DVB_TDA10048=y
> CONFIG_DVB_AF9013=y
> CONFIG_DVB_EC100=y
> CONFIG_DVB_HD29L2=y
> CONFIG_DVB_STV0367=y
> CONFIG_DVB_CXD2820R=y
> CONFIG_DVB_RTL2830=y
> 
> #
> # DVB-C (cable) frontends
> #
> CONFIG_DVB_VES1820=y
> CONFIG_DVB_TDA10021=y
> CONFIG_DVB_TDA10023=y
> CONFIG_DVB_STV0297=y
> 
> #
> # ATSC (North American/Korean Terrestrial/Cable DTV) frontends
> #
> CONFIG_DVB_NXT200X=y
> CONFIG_DVB_OR51211=y
> CONFIG_DVB_OR51132=y
> CONFIG_DVB_BCM3510=y
> CONFIG_DVB_LGDT330X=y
> CONFIG_DVB_LGDT3305=y
> CONFIG_DVB_LG2160=y
> CONFIG_DVB_S5H1409=y
> CONFIG_DVB_AU8522=y
> CONFIG_DVB_AU8522_DTV=y
> CONFIG_DVB_AU8522_V4L=y
> CONFIG_DVB_S5H1411=y
> 
> #
> # ISDB-T (terrestrial) frontends
> #
> CONFIG_DVB_S921=y
> CONFIG_DVB_DIB8000=y
> CONFIG_DVB_MB86A20S=y
> 
> #
> # Digital terrestrial only tuners/PLL
> #
> CONFIG_DVB_PLL=y
> CONFIG_DVB_TUNER_DIB0070=y
> CONFIG_DVB_TUNER_DIB0090=y
> 
> #
> # SEC control devices for DVB-S
> #
> CONFIG_DVB_LNBP21=y
> CONFIG_DVB_LNBP22=y
> CONFIG_DVB_ISL6405=y
> CONFIG_DVB_ISL6421=y
> CONFIG_DVB_ISL6423=y
> CONFIG_DVB_A8293=y
> CONFIG_DVB_LGS8GL5=y
> CONFIG_DVB_LGS8GXX=y
> CONFIG_DVB_ATBM8830=y
> CONFIG_DVB_TDA665x=y
> CONFIG_DVB_IX2505V=y
> CONFIG_DVB_IT913X_FE=y
> CONFIG_DVB_M88RS2000=y
> CONFIG_DVB_AF9033=y
> 
> #
> # Tools to develop new frontends
> #
> # CONFIG_DVB_DUMMY_FE is not set
> 
> #
> # Graphics support
> #
> CONFIG_AGP=y
> CONFIG_AGP_AMD64=y
> CONFIG_AGP_INTEL=y
> CONFIG_AGP_SIS=y
> CONFIG_AGP_VIA=y
> CONFIG_VGA_ARB=y
> CONFIG_VGA_ARB_MAX_GPUS=16
> CONFIG_VGA_SWITCHEROO=y
> CONFIG_DRM=y
> CONFIG_DRM_USB=y
> CONFIG_DRM_KMS_HELPER=y
> CONFIG_DRM_LOAD_EDID_FIRMWARE=y
> CONFIG_DRM_TTM=y
> CONFIG_DRM_TDFX=y
> CONFIG_DRM_R128=y
> CONFIG_DRM_RADEON=y
> CONFIG_DRM_RADEON_KMS=y
> CONFIG_DRM_NOUVEAU=y
> CONFIG_DRM_NOUVEAU_BACKLIGHT=y
> CONFIG_DRM_NOUVEAU_DEBUG=y
> 
> #
> # I2C encoder or helper chips
> #
> CONFIG_DRM_I2C_CH7006=y
> CONFIG_DRM_I2C_SIL164=y
> CONFIG_DRM_I915=y
> CONFIG_DRM_I915_KMS=y
> CONFIG_DRM_MGA=y
> CONFIG_DRM_SIS=y
> CONFIG_DRM_VIA=y
> CONFIG_DRM_SAVAGE=y
> CONFIG_DRM_VMWGFX=y
> CONFIG_DRM_GMA500=y
> CONFIG_DRM_GMA600=y
> CONFIG_DRM_GMA3600=y
> CONFIG_DRM_UDL=y
> CONFIG_DRM_AST=y
> CONFIG_DRM_MGAG200=y
> CONFIG_DRM_CIRRUS_QEMU=y
> CONFIG_STUB_POULSBO=y
> CONFIG_VGASTATE=y
> CONFIG_VIDEO_OUTPUT_CONTROL=y
> CONFIG_FB=y
> CONFIG_FIRMWARE_EDID=y
> CONFIG_FB_DDC=y
> CONFIG_FB_BOOT_VESA_SUPPORT=y
> CONFIG_FB_CFB_FILLRECT=y
> CONFIG_FB_CFB_COPYAREA=y
> CONFIG_FB_CFB_IMAGEBLIT=y
> # CONFIG_FB_CFB_REV_PIXELS_IN_BYTE is not set
> CONFIG_FB_SYS_FILLRECT=y
> CONFIG_FB_SYS_COPYAREA=y
> CONFIG_FB_SYS_IMAGEBLIT=y
> CONFIG_FB_FOREIGN_ENDIAN=y
> CONFIG_FB_BOTH_ENDIAN=y
> # CONFIG_FB_BIG_ENDIAN is not set
> # CONFIG_FB_LITTLE_ENDIAN is not set
> CONFIG_FB_SYS_FOPS=y
> # CONFIG_FB_WMT_GE_ROPS is not set
> CONFIG_FB_DEFERRED_IO=y
> CONFIG_FB_HECUBA=y
> CONFIG_FB_SVGALIB=y
> # CONFIG_FB_MACMODES is not set
> CONFIG_FB_BACKLIGHT=y
> CONFIG_FB_MODE_HELPERS=y
> CONFIG_FB_TILEBLITTING=y
> 
> #
> # Frame buffer hardware drivers
> #
> CONFIG_FB_CIRRUS=y
> CONFIG_FB_PM2=y
> CONFIG_FB_PM2_FIFO_DISCONNECT=y
> CONFIG_FB_CYBER2000=y
> CONFIG_FB_CYBER2000_DDC=y
> CONFIG_FB_ARC=y
> CONFIG_FB_ASILIANT=y
> CONFIG_FB_IMSTT=y
> CONFIG_FB_VGA16=y
> CONFIG_FB_UVESA=y
> CONFIG_FB_VESA=y
> CONFIG_FB_EFI=y
> CONFIG_FB_N411=y
> CONFIG_FB_HGA=y
> CONFIG_FB_S1D13XXX=y
> CONFIG_FB_NVIDIA=y
> CONFIG_FB_NVIDIA_I2C=y
> CONFIG_FB_NVIDIA_DEBUG=y
> CONFIG_FB_NVIDIA_BACKLIGHT=y
> CONFIG_FB_RIVA=y
> CONFIG_FB_RIVA_I2C=y
> CONFIG_FB_RIVA_DEBUG=y
> CONFIG_FB_RIVA_BACKLIGHT=y
> CONFIG_FB_I740=y
> CONFIG_FB_LE80578=y
> CONFIG_FB_CARILLO_RANCH=y
> CONFIG_FB_MATROX=y
> CONFIG_FB_MATROX_MILLENIUM=y
> CONFIG_FB_MATROX_MYSTIQUE=y
> CONFIG_FB_MATROX_G=y
> CONFIG_FB_MATROX_I2C=y
> CONFIG_FB_MATROX_MAVEN=y
> CONFIG_FB_RADEON=y
> CONFIG_FB_RADEON_I2C=y
> CONFIG_FB_RADEON_BACKLIGHT=y
> CONFIG_FB_RADEON_DEBUG=y
> CONFIG_FB_ATY128=y
> CONFIG_FB_ATY128_BACKLIGHT=y
> CONFIG_FB_ATY=y
> CONFIG_FB_ATY_CT=y
> CONFIG_FB_ATY_GENERIC_LCD=y
> CONFIG_FB_ATY_GX=y
> CONFIG_FB_ATY_BACKLIGHT=y
> CONFIG_FB_S3=y
> CONFIG_FB_S3_DDC=y
> CONFIG_FB_SAVAGE=y
> CONFIG_FB_SAVAGE_I2C=y
> CONFIG_FB_SAVAGE_ACCEL=y
> CONFIG_FB_SIS=y
> CONFIG_FB_SIS_300=y
> CONFIG_FB_SIS_315=y
> CONFIG_FB_VIA=y
> CONFIG_FB_VIA_DIRECT_PROCFS=y
> CONFIG_FB_VIA_X_COMPATIBILITY=y
> CONFIG_FB_NEOMAGIC=y
> CONFIG_FB_KYRO=y
> CONFIG_FB_3DFX=y
> CONFIG_FB_3DFX_ACCEL=y
> CONFIG_FB_3DFX_I2C=y
> CONFIG_FB_VOODOO1=y
> CONFIG_FB_VT8623=y
> CONFIG_FB_TRIDENT=y
> CONFIG_FB_ARK=y
> CONFIG_FB_PM3=y
> CONFIG_FB_CARMINE=y
> CONFIG_FB_CARMINE_DRAM_EVAL=y
> # CONFIG_CARMINE_DRAM_CUSTOM is not set
> CONFIG_FB_GEODE=y
> CONFIG_FB_GEODE_LX=y
> CONFIG_FB_GEODE_GX=y
> CONFIG_FB_GEODE_GX1=y
> CONFIG_FB_TMIO=y
> # CONFIG_FB_TMIO_ACCELL is not set
> CONFIG_FB_SM501=y
> CONFIG_FB_SMSCUFX=y
> CONFIG_FB_UDL=y
> CONFIG_FB_VIRTUAL=y
> CONFIG_XEN_FBDEV_FRONTEND=y
> CONFIG_FB_METRONOME=y
> CONFIG_FB_MB862XX=y
> CONFIG_FB_MB862XX_PCI_GDC=y
> CONFIG_FB_MB862XX_I2C=y
> CONFIG_FB_BROADSHEET=y
> CONFIG_FB_AUO_K190X=y
> CONFIG_FB_AUO_K1900=y
> CONFIG_FB_AUO_K1901=y
> CONFIG_EXYNOS_VIDEO=y
> CONFIG_BACKLIGHT_LCD_SUPPORT=y
> CONFIG_LCD_CLASS_DEVICE=y
> CONFIG_LCD_L4F00242T03=y
> CONFIG_LCD_LMS283GF05=y
> CONFIG_LCD_LTV350QV=y
> CONFIG_LCD_ILI9320=y
> CONFIG_LCD_TDO24M=y
> CONFIG_LCD_VGG2432A4=y
> CONFIG_LCD_PLATFORM=y
> CONFIG_LCD_S6E63M0=y
> CONFIG_LCD_LD9040=y
> CONFIG_LCD_AMS369FG06=y
> CONFIG_BACKLIGHT_CLASS_DEVICE=y
> CONFIG_BACKLIGHT_GENERIC=y
> CONFIG_BACKLIGHT_LM3533=y
> CONFIG_BACKLIGHT_PROGEAR=y
> CONFIG_BACKLIGHT_CARILLO_RANCH=y
> CONFIG_BACKLIGHT_PWM=y
> CONFIG_BACKLIGHT_APPLE=y
> CONFIG_BACKLIGHT_SAHARA=y
> CONFIG_BACKLIGHT_ADP8860=y
> CONFIG_BACKLIGHT_ADP8870=y
> CONFIG_BACKLIGHT_88PM860X=y
> CONFIG_BACKLIGHT_LP855X=y
> 
> #
> # Console display driver support
> #
> CONFIG_VGA_CONSOLE=y
> CONFIG_VGACON_SOFT_SCROLLBACK=y
> CONFIG_VGACON_SOFT_SCROLLBACK_SIZE=64
> CONFIG_DUMMY_CONSOLE=y
> CONFIG_FRAMEBUFFER_CONSOLE=y
> CONFIG_FRAMEBUFFER_CONSOLE_DETECT_PRIMARY=y
> CONFIG_FRAMEBUFFER_CONSOLE_ROTATION=y
> CONFIG_FONTS=y
> CONFIG_FONT_8x8=y
> CONFIG_FONT_8x16=y
> CONFIG_FONT_6x11=y
> CONFIG_FONT_7x14=y
> CONFIG_FONT_PEARL_8x8=y
> CONFIG_FONT_ACORN_8x8=y
> CONFIG_FONT_MINI_4x6=y
> CONFIG_FONT_SUN8x16=y
> CONFIG_FONT_SUN12x22=y
> CONFIG_FONT_10x18=y
> CONFIG_LOGO=y
> CONFIG_LOGO_LINUX_MONO=y
> CONFIG_LOGO_LINUX_VGA16=y
> CONFIG_LOGO_LINUX_CLUT224=y
> # CONFIG_SOUND is not set
> 
> #
> # HID support
> #
> CONFIG_HID=y
> CONFIG_HID_BATTERY_STRENGTH=y
> CONFIG_HIDRAW=y
> CONFIG_UHID=y
> CONFIG_HID_GENERIC=y
> 
> #
> # Special HID drivers
> #
> CONFIG_HID_A4TECH=y
> CONFIG_HID_ACRUX=y
> CONFIG_HID_ACRUX_FF=y
> CONFIG_HID_APPLE=y
> CONFIG_HID_AUREAL=y
> CONFIG_HID_BELKIN=y
> CONFIG_HID_CHERRY=y
> CONFIG_HID_CHICONY=y
> CONFIG_HID_CYPRESS=y
> CONFIG_HID_DRAGONRISE=y
> CONFIG_DRAGONRISE_FF=y
> CONFIG_HID_EMS_FF=y
> CONFIG_HID_ELECOM=y
> CONFIG_HID_EZKEY=y
> CONFIG_HID_HOLTEK=y
> CONFIG_HOLTEK_FF=y
> CONFIG_HID_KEYTOUCH=y
> CONFIG_HID_KYE=y
> CONFIG_HID_UCLOGIC=y
> CONFIG_HID_WALTOP=y
> CONFIG_HID_GYRATION=y
> CONFIG_HID_TWINHAN=y
> CONFIG_HID_KENSINGTON=y
> CONFIG_HID_LCPOWER=y
> CONFIG_HID_LENOVO_TPKBD=y
> CONFIG_HID_LOGITECH=y
> CONFIG_HID_LOGITECH_DJ=y
> CONFIG_LOGITECH_FF=y
> CONFIG_LOGIRUMBLEPAD2_FF=y
> CONFIG_LOGIG940_FF=y
> CONFIG_LOGIWHEELS_FF=y
> CONFIG_HID_MAGICMOUSE=y
> CONFIG_HID_MICROSOFT=y
> CONFIG_HID_MONTEREY=y
> CONFIG_HID_MULTITOUCH=y
> CONFIG_HID_NTRIG=y
> CONFIG_HID_ORTEK=y
> CONFIG_HID_PANTHERLORD=y
> CONFIG_PANTHERLORD_FF=y
> CONFIG_HID_PETALYNX=y
> CONFIG_HID_PICOLCD=y
> CONFIG_HID_PICOLCD_FB=y
> CONFIG_HID_PICOLCD_BACKLIGHT=y
> CONFIG_HID_PICOLCD_LCD=y
> CONFIG_HID_PICOLCD_LEDS=y
> CONFIG_HID_PRIMAX=y
> CONFIG_HID_ROCCAT=y
> CONFIG_HID_SAITEK=y
> CONFIG_HID_SAMSUNG=y
> CONFIG_HID_SONY=y
> CONFIG_HID_SPEEDLINK=y
> CONFIG_HID_SUNPLUS=y
> CONFIG_HID_GREENASIA=y
> CONFIG_GREENASIA_FF=y
> CONFIG_HID_HYPERV_MOUSE=y
> CONFIG_HID_SMARTJOYPLUS=y
> CONFIG_SMARTJOYPLUS_FF=y
> CONFIG_HID_TIVO=y
> CONFIG_HID_TOPSEED=y
> CONFIG_HID_THRUSTMASTER=y
> CONFIG_THRUSTMASTER_FF=y
> CONFIG_HID_WACOM=y
> CONFIG_HID_WIIMOTE=y
> CONFIG_HID_WIIMOTE_EXT=y
> CONFIG_HID_ZEROPLUS=y
> CONFIG_ZEROPLUS_FF=y
> CONFIG_HID_ZYDACRON=y
> 
> #
> # USB HID support
> #
> CONFIG_USB_HID=y
> CONFIG_HID_PID=y
> CONFIG_USB_HIDDEV=y
> CONFIG_USB_ARCH_HAS_OHCI=y
> CONFIG_USB_ARCH_HAS_EHCI=y
> CONFIG_USB_ARCH_HAS_XHCI=y
> CONFIG_USB_SUPPORT=y
> CONFIG_USB_COMMON=y
> CONFIG_USB_ARCH_HAS_HCD=y
> CONFIG_USB=y
> CONFIG_USB_DEBUG=y
> CONFIG_USB_ANNOUNCE_NEW_DEVICES=y
> 
> #
> # Miscellaneous USB options
> #
> CONFIG_USB_DYNAMIC_MINORS=y
> CONFIG_USB_SUSPEND=y
> CONFIG_USB_OTG=y
> CONFIG_USB_OTG_WHITELIST=y
> CONFIG_USB_OTG_BLACKLIST_HUB=y
> # CONFIG_USB_DWC3 is not set
> CONFIG_USB_MON=y
> CONFIG_USB_WUSB=y
> CONFIG_USB_WUSB_CBAF=y
> CONFIG_USB_WUSB_CBAF_DEBUG=y
> 
> #
> # USB Host Controller Drivers
> #
> CONFIG_USB_C67X00_HCD=y
> CONFIG_USB_XHCI_HCD=y
> CONFIG_USB_XHCI_HCD_DEBUGGING=y
> CONFIG_USB_EHCI_HCD=y
> CONFIG_USB_EHCI_ROOT_HUB_TT=y
> CONFIG_USB_EHCI_TT_NEWSCHED=y
> CONFIG_USB_OXU210HP_HCD=y
> CONFIG_USB_ISP116X_HCD=y
> CONFIG_USB_ISP1760_HCD=y
> CONFIG_USB_ISP1362_HCD=y
> CONFIG_USB_OHCI_HCD=y
> # CONFIG_USB_OHCI_HCD_SSB is not set
> CONFIG_USB_OHCI_HCD_PLATFORM=y
> CONFIG_USB_EHCI_HCD_PLATFORM=y
> # CONFIG_USB_OHCI_BIG_ENDIAN_DESC is not set
> # CONFIG_USB_OHCI_BIG_ENDIAN_MMIO is not set
> CONFIG_USB_OHCI_LITTLE_ENDIAN=y
> CONFIG_USB_UHCI_HCD=y
> # CONFIG_USB_U132_HCD is not set
> CONFIG_USB_SL811_HCD=y
> CONFIG_USB_SL811_HCD_ISO=y
> CONFIG_USB_SL811_CS=y
> CONFIG_USB_R8A66597_HCD=y
> CONFIG_USB_WHCI_HCD=y
> CONFIG_USB_HWA_HCD=y
> CONFIG_USB_HCD_SSB=y
> # CONFIG_USB_MUSB_HDRC is not set
> CONFIG_USB_CHIPIDEA=y
> # CONFIG_USB_CHIPIDEA_UDC is not set
> CONFIG_USB_CHIPIDEA_HOST=y
> CONFIG_USB_CHIPIDEA_DEBUG=y
> # CONFIG_USB_RENESAS_USBHS is not set
> 
> #
> # USB Device Class drivers
> #
> CONFIG_USB_ACM=y
> CONFIG_USB_PRINTER=y
> CONFIG_USB_WDM=y
> CONFIG_USB_TMC=y
> 
> #
> # NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may
> #
> 
> #
> # also be needed; see USB_STORAGE Help for more info
> #
> CONFIG_USB_STORAGE=y
> CONFIG_USB_STORAGE_DEBUG=y
> CONFIG_USB_STORAGE_REALTEK=y
> CONFIG_REALTEK_AUTOPM=y
> CONFIG_USB_STORAGE_DATAFAB=y
> CONFIG_USB_STORAGE_FREECOM=y
> CONFIG_USB_STORAGE_ISD200=y
> CONFIG_USB_STORAGE_USBAT=y
> CONFIG_USB_STORAGE_SDDR09=y
> CONFIG_USB_STORAGE_SDDR55=y
> CONFIG_USB_STORAGE_JUMPSHOT=y
> CONFIG_USB_STORAGE_ALAUDA=y
> CONFIG_USB_STORAGE_ONETOUCH=y
> CONFIG_USB_STORAGE_KARMA=y
> CONFIG_USB_STORAGE_CYPRESS_ATACB=y
> CONFIG_USB_STORAGE_ENE_UB6250=y
> CONFIG_USB_UAS=y
> CONFIG_USB_LIBUSUAL=y
> 
> #
> # USB Imaging devices
> #
> CONFIG_USB_MDC800=y
> CONFIG_USB_MICROTEK=y
> 
> #
> # USB port drivers
> #
> CONFIG_USB_USS720=y
> CONFIG_USB_SERIAL=y
> CONFIG_USB_SERIAL_CONSOLE=y
> CONFIG_USB_EZUSB=y
> CONFIG_USB_SERIAL_GENERIC=y
> CONFIG_USB_SERIAL_AIRCABLE=y
> CONFIG_USB_SERIAL_ARK3116=y
> CONFIG_USB_SERIAL_BELKIN=y
> CONFIG_USB_SERIAL_CH341=y
> CONFIG_USB_SERIAL_WHITEHEAT=y
> CONFIG_USB_SERIAL_DIGI_ACCELEPORT=y
> CONFIG_USB_SERIAL_CP210X=y
> CONFIG_USB_SERIAL_CYPRESS_M8=y
> CONFIG_USB_SERIAL_EMPEG=y
> CONFIG_USB_SERIAL_FTDI_SIO=y
> CONFIG_USB_SERIAL_FUNSOFT=y
> CONFIG_USB_SERIAL_VISOR=y
> CONFIG_USB_SERIAL_IPAQ=y
> CONFIG_USB_SERIAL_IR=y
> CONFIG_USB_SERIAL_EDGEPORT=y
> CONFIG_USB_SERIAL_EDGEPORT_TI=y
> CONFIG_USB_SERIAL_F81232=y
> CONFIG_USB_SERIAL_GARMIN=y
> CONFIG_USB_SERIAL_IPW=y
> CONFIG_USB_SERIAL_IUU=y
> CONFIG_USB_SERIAL_KEYSPAN_PDA=y
> CONFIG_USB_SERIAL_KEYSPAN=y
> CONFIG_USB_SERIAL_KEYSPAN_MPR=y
> CONFIG_USB_SERIAL_KEYSPAN_USA28=y
> CONFIG_USB_SERIAL_KEYSPAN_USA28X=y
> CONFIG_USB_SERIAL_KEYSPAN_USA28XA=y
> CONFIG_USB_SERIAL_KEYSPAN_USA28XB=y
> CONFIG_USB_SERIAL_KEYSPAN_USA19=y
> CONFIG_USB_SERIAL_KEYSPAN_USA18X=y
> CONFIG_USB_SERIAL_KEYSPAN_USA19W=y
> CONFIG_USB_SERIAL_KEYSPAN_USA19QW=y
> CONFIG_USB_SERIAL_KEYSPAN_USA19QI=y
> CONFIG_USB_SERIAL_KEYSPAN_USA49W=y
> CONFIG_USB_SERIAL_KEYSPAN_USA49WLC=y
> CONFIG_USB_SERIAL_KLSI=y
> CONFIG_USB_SERIAL_KOBIL_SCT=y
> CONFIG_USB_SERIAL_MCT_U232=y
> CONFIG_USB_SERIAL_METRO=y
> CONFIG_USB_SERIAL_MOS7720=y
> CONFIG_USB_SERIAL_MOS7715_PARPORT=y
> CONFIG_USB_SERIAL_MOS7840=y
> CONFIG_USB_SERIAL_MOTOROLA=y
> CONFIG_USB_SERIAL_NAVMAN=y
> CONFIG_USB_SERIAL_PL2303=y
> CONFIG_USB_SERIAL_OTI6858=y
> CONFIG_USB_SERIAL_QCAUX=y
> CONFIG_USB_SERIAL_QUALCOMM=y
> CONFIG_USB_SERIAL_SPCP8X5=y
> CONFIG_USB_SERIAL_HP4X=y
> CONFIG_USB_SERIAL_SAFE=y
> CONFIG_USB_SERIAL_SAFE_PADDED=y
> CONFIG_USB_SERIAL_SIEMENS_MPI=y
> CONFIG_USB_SERIAL_SIERRAWIRELESS=y
> CONFIG_USB_SERIAL_SYMBOL=y
> CONFIG_USB_SERIAL_TI=y
> CONFIG_USB_SERIAL_CYBERJACK=y
> CONFIG_USB_SERIAL_XIRCOM=y
> CONFIG_USB_SERIAL_WWAN=y
> CONFIG_USB_SERIAL_OPTION=y
> CONFIG_USB_SERIAL_OMNINET=y
> CONFIG_USB_SERIAL_OPTICON=y
> CONFIG_USB_SERIAL_VIVOPAY_SERIAL=y
> CONFIG_USB_SERIAL_ZIO=y
> CONFIG_USB_SERIAL_SSU100=y
> CONFIG_USB_SERIAL_QT2=y
> CONFIG_USB_SERIAL_DEBUG=y
> 
> #
> # USB Miscellaneous drivers
> #
> CONFIG_USB_EMI62=y
> CONFIG_USB_EMI26=y
> CONFIG_USB_ADUTUX=y
> CONFIG_USB_SEVSEG=y
> CONFIG_USB_RIO500=y
> CONFIG_USB_LEGOTOWER=y
> CONFIG_USB_LCD=y
> CONFIG_USB_LED=y
> CONFIG_USB_CYPRESS_CY7C63=y
> CONFIG_USB_CYTHERM=y
> CONFIG_USB_IDMOUSE=y
> CONFIG_USB_FTDI_ELAN=y
> CONFIG_USB_APPLEDISPLAY=y
> CONFIG_USB_SISUSBVGA=y
> CONFIG_USB_SISUSBVGA_CON=y
> CONFIG_USB_LD=y
> CONFIG_USB_TRANCEVIBRATOR=y
> CONFIG_USB_IOWARRIOR=y
> CONFIG_USB_TEST=y
> CONFIG_USB_ISIGHTFW=y
> CONFIG_USB_YUREX=y
> 
> #
> # USB Physical Layer drivers
> #
> CONFIG_USB_ISP1301=y
> CONFIG_USB_ATM=y
> CONFIG_USB_SPEEDTOUCH=y
> CONFIG_USB_CXACRU=y
> CONFIG_USB_UEAGLEATM=y
> CONFIG_USB_XUSBATM=y
> CONFIG_USB_GADGET=y
> CONFIG_USB_GADGET_DEBUG=y
> CONFIG_USB_GADGET_DEBUG_FILES=y
> CONFIG_USB_GADGET_DEBUG_FS=y
> CONFIG_USB_GADGET_VBUS_DRAW=2
> CONFIG_USB_GADGET_STORAGE_NUM_BUFFERS=2
> 
> #
> # USB Peripheral Controller
> #
> CONFIG_USB_R8A66597=y
> CONFIG_USB_MV_UDC=y
> CONFIG_USB_M66592=y
> CONFIG_USB_AMD5536UDC=y
> CONFIG_USB_NET2272=y
> CONFIG_USB_NET2272_DMA=y
> CONFIG_USB_NET2280=y
> CONFIG_USB_GOKU=y
> CONFIG_USB_EG20T=y
> CONFIG_USB_DUMMY_HCD=y
> CONFIG_USB_GADGET_DUALSPEED=y
> CONFIG_USB_GADGET_SUPERSPEED=y
> # CONFIG_USB_ZERO is not set
> CONFIG_USB_ETH=y
> CONFIG_USB_ETH_RNDIS=y
> CONFIG_USB_ETH_EEM=y
> # CONFIG_USB_G_NCM is not set
> # CONFIG_USB_GADGETFS is not set
> # CONFIG_USB_FUNCTIONFS is not set
> # CONFIG_USB_FILE_STORAGE is not set
> # CONFIG_USB_MASS_STORAGE is not set
> # CONFIG_USB_GADGET_TARGET is not set
> # CONFIG_USB_G_SERIAL is not set
> # CONFIG_USB_G_PRINTER is not set
> # CONFIG_USB_CDC_COMPOSITE is not set
> # CONFIG_USB_G_NOKIA is not set
> # CONFIG_USB_G_ACM_MS is not set
> # CONFIG_USB_G_MULTI is not set
> # CONFIG_USB_G_HID is not set
> # CONFIG_USB_G_DBGP is not set
> # CONFIG_USB_G_WEBCAM is not set
> 
> #
> # OTG and related infrastructure
> #
> CONFIG_USB_OTG_UTILS=y
> CONFIG_USB_GPIO_VBUS=y
> CONFIG_NOP_USB_XCEIV=y
> CONFIG_UWB=y
> CONFIG_UWB_HWA=y
> CONFIG_UWB_WHCI=y
> CONFIG_UWB_I1480U=y
> CONFIG_MMC=y
> CONFIG_MMC_DEBUG=y
> # CONFIG_MMC_UNSAFE_RESUME is not set
> CONFIG_MMC_CLKGATE=y
> 
> #
> # MMC/SD/SDIO Card Drivers
> #
> CONFIG_MMC_BLOCK=y
> CONFIG_MMC_BLOCK_MINORS=8
> CONFIG_MMC_BLOCK_BOUNCE=y
> CONFIG_SDIO_UART=y
> CONFIG_MMC_TEST=y
> 
> #
> # MMC/SD/SDIO Host Controller Drivers
> #
> CONFIG_MMC_SDHCI=y
> CONFIG_MMC_SDHCI_PCI=y
> CONFIG_MMC_RICOH_MMC=y
> CONFIG_MMC_SDHCI_PLTFM=y
> CONFIG_MMC_WBSD=y
> CONFIG_MMC_TIFM_SD=y
> CONFIG_MMC_SPI=y
> CONFIG_MMC_SDRICOH_CS=y
> CONFIG_MMC_CB710=y
> CONFIG_MMC_VIA_SDMMC=y
> CONFIG_MMC_VUB300=y
> CONFIG_MMC_USHC=y
> CONFIG_MEMSTICK=y
> CONFIG_MEMSTICK_DEBUG=y
> 
> #
> # MemoryStick drivers
> #
> CONFIG_MEMSTICK_UNSAFE_RESUME=y
> CONFIG_MSPRO_BLOCK=y
> 
> #
> # MemoryStick Host Controller Drivers
> #
> CONFIG_MEMSTICK_TIFM_MS=y
> CONFIG_MEMSTICK_JMICRON_38X=y
> CONFIG_MEMSTICK_R592=y
> CONFIG_NEW_LEDS=y
> CONFIG_LEDS_CLASS=y
> 
> #
> # LED drivers
> #
> CONFIG_LEDS_88PM860X=y
> CONFIG_LEDS_LM3530=y
> CONFIG_LEDS_LM3533=y
> CONFIG_LEDS_PCA9532=y
> CONFIG_LEDS_PCA9532_GPIO=y
> CONFIG_LEDS_GPIO=y
> CONFIG_LEDS_LP3944=y
> CONFIG_LEDS_LP5521=y
> CONFIG_LEDS_LP5523=y
> CONFIG_LEDS_CLEVO_MAIL=y
> CONFIG_LEDS_PCA955X=y
> CONFIG_LEDS_PCA9633=y
> CONFIG_LEDS_DAC124S085=y
> CONFIG_LEDS_REGULATOR=y
> CONFIG_LEDS_BD2802=y
> CONFIG_LEDS_INTEL_SS4200=y
> CONFIG_LEDS_LT3593=y
> CONFIG_LEDS_DELL_NETBOOKS=y
> CONFIG_LEDS_MC13783=y
> CONFIG_LEDS_TCA6507=y
> CONFIG_LEDS_LM3556=y
> CONFIG_LEDS_OT200=y
> CONFIG_LEDS_TRIGGERS=y
> 
> #
> # LED Triggers
> #
> CONFIG_LEDS_TRIGGER_TIMER=y
> CONFIG_LEDS_TRIGGER_ONESHOT=y
> CONFIG_LEDS_TRIGGER_HEARTBEAT=y
> CONFIG_LEDS_TRIGGER_BACKLIGHT=y
> CONFIG_LEDS_TRIGGER_CPU=y
> CONFIG_LEDS_TRIGGER_GPIO=y
> CONFIG_LEDS_TRIGGER_DEFAULT_ON=y
> 
> #
> # iptables trigger is under Netfilter config (LED target)
> #
> CONFIG_LEDS_TRIGGER_TRANSIENT=y
> CONFIG_ACCESSIBILITY=y
> CONFIG_A11Y_BRAILLE_CONSOLE=y
> CONFIG_INFINIBAND=y
> CONFIG_INFINIBAND_USER_MAD=y
> CONFIG_INFINIBAND_USER_ACCESS=y
> CONFIG_INFINIBAND_USER_MEM=y
> CONFIG_INFINIBAND_ADDR_TRANS=y
> CONFIG_INFINIBAND_MTHCA=y
> CONFIG_INFINIBAND_MTHCA_DEBUG=y
> CONFIG_INFINIBAND_IPATH=y
> CONFIG_INFINIBAND_QIB=y
> CONFIG_INFINIBAND_AMSO1100=y
> CONFIG_INFINIBAND_AMSO1100_DEBUG=y
> CONFIG_INFINIBAND_CXGB3=y
> CONFIG_INFINIBAND_CXGB3_DEBUG=y
> CONFIG_INFINIBAND_CXGB4=y
> CONFIG_MLX4_INFINIBAND=y
> CONFIG_INFINIBAND_NES=y
> CONFIG_INFINIBAND_NES_DEBUG=y
> CONFIG_INFINIBAND_OCRDMA=y
> CONFIG_INFINIBAND_IPOIB=y
> CONFIG_INFINIBAND_IPOIB_CM=y
> CONFIG_INFINIBAND_IPOIB_DEBUG=y
> CONFIG_INFINIBAND_IPOIB_DEBUG_DATA=y
> CONFIG_INFINIBAND_SRP=y
> CONFIG_INFINIBAND_SRPT=y
> CONFIG_INFINIBAND_ISER=y
> CONFIG_EDAC=y
> 
> #
> # Reporting subsystems
> #
> CONFIG_EDAC_LEGACY_SYSFS=y
> CONFIG_EDAC_DEBUG=y
> CONFIG_EDAC_DECODE_MCE=y
> CONFIG_EDAC_MCE_INJ=y
> CONFIG_EDAC_MM_EDAC=y
> CONFIG_EDAC_AMD64=y
> CONFIG_EDAC_AMD64_ERROR_INJECTION=y
> CONFIG_EDAC_E752X=y
> CONFIG_EDAC_I82975X=y
> CONFIG_EDAC_I3000=y
> CONFIG_EDAC_I3200=y
> CONFIG_EDAC_X38=y
> CONFIG_EDAC_I5400=y
> CONFIG_EDAC_I7CORE=y
> CONFIG_EDAC_I5000=y
> CONFIG_EDAC_I5100=y
> CONFIG_EDAC_I7300=y
> CONFIG_EDAC_SBRIDGE=y
> CONFIG_RTC_LIB=y
> CONFIG_RTC_CLASS=y
> CONFIG_RTC_HCTOSYS=y
> CONFIG_RTC_HCTOSYS_DEVICE="rtc0"
> CONFIG_RTC_DEBUG=y
> 
> #
> # RTC interfaces
> #
> CONFIG_RTC_INTF_SYSFS=y
> CONFIG_RTC_INTF_PROC=y
> CONFIG_RTC_INTF_DEV=y
> CONFIG_RTC_INTF_DEV_UIE_EMUL=y
> CONFIG_RTC_DRV_TEST=y
> 
> #
> # I2C RTC drivers
> #
> CONFIG_RTC_DRV_88PM860X=y
> CONFIG_RTC_DRV_DS1307=y
> CONFIG_RTC_DRV_DS1374=y
> CONFIG_RTC_DRV_DS1672=y
> CONFIG_RTC_DRV_DS3232=y
> CONFIG_RTC_DRV_MAX6900=y
> CONFIG_RTC_DRV_RS5C372=y
> CONFIG_RTC_DRV_ISL1208=y
> CONFIG_RTC_DRV_ISL12022=y
> CONFIG_RTC_DRV_X1205=y
> CONFIG_RTC_DRV_PCF8563=y
> CONFIG_RTC_DRV_PCF8583=y
> CONFIG_RTC_DRV_M41T80=y
> CONFIG_RTC_DRV_M41T80_WDT=y
> CONFIG_RTC_DRV_BQ32K=y
> CONFIG_RTC_DRV_S35390A=y
> CONFIG_RTC_DRV_FM3130=y
> CONFIG_RTC_DRV_RX8581=y
> CONFIG_RTC_DRV_RX8025=y
> CONFIG_RTC_DRV_EM3027=y
> CONFIG_RTC_DRV_RV3029C2=y
> 
> #
> # SPI RTC drivers
> #
> CONFIG_RTC_DRV_M41T93=y
> CONFIG_RTC_DRV_M41T94=y
> CONFIG_RTC_DRV_DS1305=y
> CONFIG_RTC_DRV_DS1390=y
> CONFIG_RTC_DRV_MAX6902=y
> CONFIG_RTC_DRV_R9701=y
> CONFIG_RTC_DRV_RS5C348=y
> CONFIG_RTC_DRV_DS3234=y
> CONFIG_RTC_DRV_PCF2123=y
> 
> #
> # Platform RTC drivers
> #
> CONFIG_RTC_DRV_CMOS=y
> CONFIG_RTC_DRV_DS1286=y
> CONFIG_RTC_DRV_DS1511=y
> CONFIG_RTC_DRV_DS1553=y
> CONFIG_RTC_DRV_DS1742=y
> CONFIG_RTC_DRV_STK17TA8=y
> CONFIG_RTC_DRV_M48T86=y
> CONFIG_RTC_DRV_M48T35=y
> CONFIG_RTC_DRV_M48T59=y
> CONFIG_RTC_DRV_MSM6242=y
> CONFIG_RTC_DRV_BQ4802=y
> CONFIG_RTC_DRV_RP5C01=y
> CONFIG_RTC_DRV_V3020=y
> 
> #
> # on-CPU RTC drivers
> #
> CONFIG_RTC_DRV_MC13XXX=y
> CONFIG_DMADEVICES=y
> CONFIG_DMADEVICES_DEBUG=y
> CONFIG_DMADEVICES_VDEBUG=y
> 
> #
> # DMA Devices
> #
> CONFIG_INTEL_MID_DMAC=y
> CONFIG_INTEL_IOATDMA=y
> CONFIG_TIMB_DMA=y
> CONFIG_PCH_DMA=y
> CONFIG_DMA_ENGINE=y
> 
> #
> # DMA Clients
> #
> CONFIG_NET_DMA=y
> CONFIG_ASYNC_TX_DMA=y
> CONFIG_DMATEST=y
> CONFIG_DCA=y
> CONFIG_AUXDISPLAY=y
> CONFIG_KS0108=y
> CONFIG_KS0108_PORT=0x378
> CONFIG_KS0108_DELAY=2
> CONFIG_CFAG12864B=y
> CONFIG_CFAG12864B_RATE=20
> CONFIG_UIO=y
> CONFIG_UIO_CIF=y
> CONFIG_UIO_PDRV=y
> CONFIG_UIO_PDRV_GENIRQ=y
> CONFIG_UIO_AEC=y
> CONFIG_UIO_SERCOS3=y
> CONFIG_UIO_PCI_GENERIC=y
> CONFIG_UIO_NETX=y
> CONFIG_VFIO_IOMMU_TYPE1=y
> CONFIG_VFIO=y
> CONFIG_VFIO_PCI=y
> CONFIG_VIRTIO=y
> CONFIG_VIRTIO_RING=y
> 
> #
> # Virtio drivers
> #
> CONFIG_VIRTIO_PCI=y
> CONFIG_VIRTIO_BALLOON=y
> CONFIG_VIRTIO_MMIO=y
> CONFIG_VIRTIO_MMIO_CMDLINE_DEVICES=y
> 
> #
> # Microsoft Hyper-V guest support
> #
> CONFIG_HYPERV=y
> CONFIG_HYPERV_UTILS=y
> 
> #
> # Xen driver support
> #
> CONFIG_XEN_BALLOON=y
> CONFIG_XEN_SELFBALLOONING=y
> CONFIG_XEN_BALLOON_MEMORY_HOTPLUG=y
> CONFIG_XEN_SCRUB_PAGES=y
> CONFIG_XEN_DEV_EVTCHN=y
> CONFIG_XEN_BACKEND=y
> CONFIG_XENFS=y
> CONFIG_XEN_COMPAT_XENFS=y
> CONFIG_XEN_SYS_HYPERVISOR=y
> CONFIG_XEN_XENBUS_FRONTEND=y
> CONFIG_XEN_GNTDEV=y
> CONFIG_XEN_GRANT_DEV_ALLOC=y
> CONFIG_SWIOTLB_XEN=y
> CONFIG_XEN_TMEM=y
> CONFIG_XEN_PCIDEV_BACKEND=y
> CONFIG_XEN_PRIVCMD=y
> CONFIG_XEN_ACPI_PROCESSOR=y
> CONFIG_XEN_MCE_LOG=y
> CONFIG_STAGING=y
> CONFIG_ET131X=y
> CONFIG_SLICOSS=y
> CONFIG_USBIP_CORE=y
> # CONFIG_USBIP_VHCI_HCD is not set
> CONFIG_USBIP_HOST=y
> CONFIG_USBIP_DEBUG=y
> CONFIG_W35UND=y
> CONFIG_PRISM2_USB=y
> CONFIG_ECHO=y
> CONFIG_ASUS_OLED=y
> CONFIG_PANEL=y
> CONFIG_PANEL_PARPORT=0
> CONFIG_PANEL_PROFILE=5
> CONFIG_PANEL_CHANGE_MESSAGE=y
> CONFIG_PANEL_BOOT_MESSAGE=""
> CONFIG_R8712U=y
> CONFIG_RTS_PSTOR=y
> CONFIG_RTS_PSTOR_DEBUG=y
> CONFIG_RTS5139=y
> CONFIG_RTS5139_DEBUG=y
> CONFIG_TRANZPORT=y
> CONFIG_IDE_PHISON=y
> # CONFIG_USB_SERIAL_QUATECH2 is not set
> CONFIG_DX_SEP=y
> 
> #
> # IIO staging drivers
> #
> CONFIG_IIO_ST_HWMON=y
> CONFIG_IIO_SW_RING=y
> 
> #
> # Accelerometers
> #
> CONFIG_ADIS16201=y
> CONFIG_ADIS16203=y
> CONFIG_ADIS16204=y
> CONFIG_ADIS16209=y
> CONFIG_ADIS16220=y
> CONFIG_ADIS16240=y
> CONFIG_KXSD9=y
> CONFIG_LIS3L02DQ=y
> CONFIG_LIS3L02DQ_BUF_KFIFO=y
> # CONFIG_LIS3L02DQ_BUF_RING_SW is not set
> CONFIG_SCA3000=y
> 
> #
> # Analog to digital converters
> #
> CONFIG_AD7291=y
> CONFIG_AD7298=y
> CONFIG_AD7606=y
> CONFIG_AD7606_IFACE_PARALLEL=y
> CONFIG_AD7606_IFACE_SPI=y
> CONFIG_AD799X=y
> CONFIG_AD799X_RING_BUFFER=y
> CONFIG_AD7476=y
> CONFIG_AD7887=y
> CONFIG_AD7780=y
> CONFIG_AD7793=y
> CONFIG_AD7816=y
> CONFIG_AD7192=y
> CONFIG_ADT7310=y
> CONFIG_ADT7410=y
> CONFIG_AD7280=y
> CONFIG_MAX1363=y
> CONFIG_MAX1363_RING_BUFFER=y
> 
> #
> # Analog digital bi-direction converters
> #
> CONFIG_ADT7316=y
> CONFIG_ADT7316_SPI=y
> CONFIG_ADT7316_I2C=y
> 
> #
> # Capacitance to digital converters
> #
> CONFIG_AD7150=y
> CONFIG_AD7152=y
> CONFIG_AD7746=y
> 
> #
> # Direct Digital Synthesis
> #
> CONFIG_AD5930=y
> CONFIG_AD9832=y
> CONFIG_AD9834=y
> CONFIG_AD9850=y
> CONFIG_AD9852=y
> CONFIG_AD9910=y
> CONFIG_AD9951=y
> 
> #
> # Digital gyroscope sensors
> #
> CONFIG_ADIS16060=y
> CONFIG_ADIS16080=y
> CONFIG_ADIS16130=y
> CONFIG_ADIS16260=y
> CONFIG_ADXRS450=y
> 
> #
> # Network Analyzer, Impedance Converters
> #
> CONFIG_AD5933=y
> 
> #
> # Inertial measurement units
> #
> CONFIG_ADIS16400=y
> 
> #
> # Light sensors
> #
> CONFIG_SENSORS_ISL29018=y
> CONFIG_SENSORS_ISL29028=y
> CONFIG_SENSORS_TSL2563=y
> CONFIG_TSL2583=y
> CONFIG_TSL2x7x=y
> 
> #
> # Magnetometer sensors
> #
> CONFIG_SENSORS_AK8975=y
> CONFIG_SENSORS_HMC5843=y
> 
> #
> # Active energy metering IC
> #
> CONFIG_ADE7753=y
> CONFIG_ADE7754=y
> CONFIG_ADE7758=y
> CONFIG_ADE7759=y
> CONFIG_ADE7854=y
> CONFIG_ADE7854_I2C=y
> CONFIG_ADE7854_SPI=y
> 
> #
> # Resolver to digital converters
> #
> CONFIG_AD2S90=y
> CONFIG_AD2S1200=y
> CONFIG_AD2S1210=y
> 
> #
> # Triggers - standalone
> #
> CONFIG_IIO_PERIODIC_RTC_TRIGGER=y
> CONFIG_IIO_GPIO_TRIGGER=y
> CONFIG_IIO_SYSFS_TRIGGER=y
> CONFIG_IIO_DUMMY_EVGEN=y
> CONFIG_IIO_SIMPLE_DUMMY=y
> CONFIG_IIO_SIMPLE_DUMMY_EVENTS=y
> CONFIG_IIO_SIMPLE_DUMMY_BUFFER=y
> CONFIG_ZRAM=y
> CONFIG_ZRAM_DEBUG=y
> CONFIG_ZCACHE=y
> CONFIG_ZSMALLOC=y
> CONFIG_WLAGS49_H2=y
> CONFIG_WLAGS49_H25=y
> CONFIG_FB_SM7XX=y
> CONFIG_CRYSTALHD=y
> # CONFIG_CXT1E1 is not set
> CONFIG_FB_XGI=y
> CONFIG_ACPI_QUICKSTART=y
> # CONFIG_SBE_2T3E3 is not set
> CONFIG_BCM_WIMAX=y
> CONFIG_FT1000=y
> CONFIG_FT1000_USB=y
> CONFIG_FT1000_PCMCIA=y
> 
> #
> # Speakup console speech
> #
> CONFIG_SPEAKUP=y
> CONFIG_SPEAKUP_SYNTH_ACNTSA=y
> CONFIG_SPEAKUP_SYNTH_ACNTPC=y
> CONFIG_SPEAKUP_SYNTH_APOLLO=y
> CONFIG_SPEAKUP_SYNTH_AUDPTR=y
> CONFIG_SPEAKUP_SYNTH_BNS=y
> CONFIG_SPEAKUP_SYNTH_DECTLK=y
> CONFIG_SPEAKUP_SYNTH_DECEXT=y
> CONFIG_SPEAKUP_SYNTH_DTLK=y
> CONFIG_SPEAKUP_SYNTH_KEYPC=y
> CONFIG_SPEAKUP_SYNTH_LTLK=y
> CONFIG_SPEAKUP_SYNTH_SOFT=y
> CONFIG_SPEAKUP_SYNTH_SPKOUT=y
> CONFIG_SPEAKUP_SYNTH_TXPRT=y
> CONFIG_SPEAKUP_SYNTH_DUMMY=y
> CONFIG_TOUCHSCREEN_CLEARPAD_TM1217=y
> CONFIG_TOUCHSCREEN_SYNAPTICS_I2C_RMI4=y
> CONFIG_STAGING_MEDIA=y
> CONFIG_DVB_AS102=y
> CONFIG_DVB_CXD2099=y
> CONFIG_VIDEO_DT3155=y
> CONFIG_DT3155_CCIR=y
> CONFIG_DT3155_STREAMING=y
> CONFIG_LIRC_STAGING=y
> CONFIG_LIRC_BT829=y
> CONFIG_LIRC_IGORPLUGUSB=y
> CONFIG_LIRC_IMON=y
> CONFIG_LIRC_PARALLEL=y
> CONFIG_LIRC_SASEM=y
> CONFIG_LIRC_SERIAL=y
> CONFIG_LIRC_SERIAL_TRANSMITTER=y
> CONFIG_LIRC_SIR=y
> CONFIG_LIRC_TTUSBIR=y
> CONFIG_LIRC_ZILOG=y
> 
> #
> # Android
> #
> CONFIG_ANDROID=y
> CONFIG_ANDROID_BINDER_IPC=y
> CONFIG_ASHMEM=y
> CONFIG_ANDROID_LOGGER=y
> CONFIG_ANDROID_TIMED_OUTPUT=y
> CONFIG_ANDROID_TIMED_GPIO=y
> CONFIG_ANDROID_LOW_MEMORY_KILLER=y
> CONFIG_ANDROID_INTF_ALARM_DEV=y
> CONFIG_PHONE=y
> CONFIG_PHONE_IXJ=y
> CONFIG_PHONE_IXJ_PCMCIA=y
> CONFIG_USB_WPAN_HCD=y
> CONFIG_IPACK_BUS=y
> CONFIG_BOARD_TPCI200=y
> CONFIG_SERIAL_IPOCTAL=y
> CONFIG_WIMAX_GDM72XX=y
> CONFIG_WIMAX_GDM72XX_QOS=y
> CONFIG_WIMAX_GDM72XX_K_MODE=y
> CONFIG_WIMAX_GDM72XX_WIMAX2=y
> CONFIG_WIMAX_GDM72XX_USB=y
> # CONFIG_WIMAX_GDM72XX_SDIO is not set
> CONFIG_WIMAX_GDM72XX_USB_PM=y
> CONFIG_CSR_WIFI=y
> CONFIG_X86_PLATFORM_DEVICES=y
> CONFIG_ACER_WMI=y
> CONFIG_ACERHDF=y
> CONFIG_ASUS_LAPTOP=y
> CONFIG_DELL_LAPTOP=y
> CONFIG_DELL_WMI=y
> CONFIG_DELL_WMI_AIO=y
> CONFIG_FUJITSU_LAPTOP=y
> CONFIG_FUJITSU_LAPTOP_DEBUG=y
> CONFIG_FUJITSU_TABLET=y
> CONFIG_AMILO_RFKILL=y
> CONFIG_HP_ACCEL=y
> CONFIG_HP_WMI=y
> CONFIG_MSI_LAPTOP=y
> CONFIG_PANASONIC_LAPTOP=y
> CONFIG_COMPAL_LAPTOP=y
> CONFIG_SONY_LAPTOP=y
> CONFIG_SONYPI_COMPAT=y
> CONFIG_IDEAPAD_LAPTOP=y
> CONFIG_THINKPAD_ACPI=y
> CONFIG_THINKPAD_ACPI_DEBUGFACILITIES=y
> CONFIG_THINKPAD_ACPI_DEBUG=y
> CONFIG_THINKPAD_ACPI_UNSAFE_LEDS=y
> CONFIG_THINKPAD_ACPI_VIDEO=y
> CONFIG_THINKPAD_ACPI_HOTKEY_POLL=y
> CONFIG_SENSORS_HDAPS=y
> CONFIG_INTEL_MENLOW=y
> CONFIG_EEEPC_LAPTOP=y
> CONFIG_ASUS_WMI=y
> CONFIG_ASUS_NB_WMI=y
> CONFIG_EEEPC_WMI=y
> CONFIG_ACPI_WMI=y
> CONFIG_MSI_WMI=y
> CONFIG_TOPSTAR_LAPTOP=y
> CONFIG_ACPI_TOSHIBA=y
> CONFIG_TOSHIBA_BT_RFKILL=y
> CONFIG_ACPI_CMPC=y
> CONFIG_INTEL_IPS=y
> CONFIG_IBM_RTL=y
> CONFIG_XO15_EBOOK=y
> CONFIG_SAMSUNG_LAPTOP=y
> CONFIG_MXM_WMI=y
> CONFIG_INTEL_OAKTRAIL=y
> CONFIG_SAMSUNG_Q10=y
> CONFIG_APPLE_GMUX=y
> 
> #
> # Hardware Spinlock drivers
> #
> CONFIG_CLKEVT_I8253=y
> CONFIG_I8253_LOCK=y
> CONFIG_CLKBLD_I8253=y
> CONFIG_IOMMU_API=y
> CONFIG_IOMMU_SUPPORT=y
> CONFIG_AMD_IOMMU=y
> CONFIG_AMD_IOMMU_STATS=y
> CONFIG_AMD_IOMMU_V2=y
> CONFIG_DMAR_TABLE=y
> CONFIG_INTEL_IOMMU=y
> CONFIG_INTEL_IOMMU_DEFAULT_ON=y
> CONFIG_INTEL_IOMMU_FLOPPY_WA=y
> CONFIG_IRQ_REMAP=y
> 
> #
> # Remoteproc drivers (EXPERIMENTAL)
> #
> 
> #
> # Rpmsg drivers (EXPERIMENTAL)
> #
> CONFIG_VIRT_DRIVERS=y
> CONFIG_PM_DEVFREQ=y
> 
> #
> # DEVFREQ Governors
> #
> CONFIG_DEVFREQ_GOV_SIMPLE_ONDEMAND=y
> CONFIG_DEVFREQ_GOV_PERFORMANCE=y
> CONFIG_DEVFREQ_GOV_POWERSAVE=y
> CONFIG_DEVFREQ_GOV_USERSPACE=y
> 
> #
> # DEVFREQ Drivers
> #
> CONFIG_EXTCON=y
> 
> #
> # Extcon Device Drivers
> #
> CONFIG_EXTCON_GPIO=y
> CONFIG_MEMORY=y
> CONFIG_IIO=y
> CONFIG_IIO_BUFFER=y
> CONFIG_IIO_KFIFO_BUF=y
> CONFIG_IIO_TRIGGERED_BUFFER=y
> CONFIG_IIO_TRIGGER=y
> CONFIG_IIO_CONSUMERS_PER_TRIGGER=2
> 
> #
> # Analog to digital converters
> #
> 
> #
> # Amplifiers
> #
> CONFIG_AD8366=y
> 
> #
> # Light sensors
> #
> CONFIG_SENSORS_LM3533=y
> CONFIG_VCNL4000=y
> 
> #
> # Frequency Synthesizers DDS/PLL
> #
> 
> #
> # Clock Generator/Distribution
> #
> CONFIG_AD9523=y
> 
> #
> # Phase-Locked Loop (PLL) frequency synthesizers
> #
> CONFIG_ADF4350=y
> 
> #
> # Digital to analog converters
> #
> CONFIG_AD5064=y
> CONFIG_AD5360=y
> CONFIG_AD5380=y
> CONFIG_AD5421=y
> CONFIG_AD5624R_SPI=y
> CONFIG_AD5446=y
> CONFIG_AD5504=y
> CONFIG_AD5764=y
> CONFIG_AD5791=y
> CONFIG_AD5686=y
> CONFIG_MAX517=y
> CONFIG_MCP4725=y
> CONFIG_VME_BUS=y
> 
> #
> # VME Bridge Drivers
> #
> CONFIG_VME_CA91CX42=y
> CONFIG_VME_TSI148=y
> 
> #
> # VME Board Drivers
> #
> CONFIG_VMIVME_7805=y
> 
> #
> # VME Device Drivers
> #
> CONFIG_VME_USER=y
> CONFIG_VME_PIO2=y
> CONFIG_PWM=y
> 
> #
> # Firmware Drivers
> #
> CONFIG_EDD=y
> # CONFIG_EDD_OFF is not set
> CONFIG_FIRMWARE_MEMMAP=y
> CONFIG_EFI_VARS=y
> CONFIG_DELL_RBU=y
> CONFIG_DCDBAS=y
> CONFIG_DMIID=y
> CONFIG_DMI_SYSFS=y
> CONFIG_ISCSI_IBFT_FIND=y
> CONFIG_ISCSI_IBFT=y
> CONFIG_GOOGLE_FIRMWARE=y
> 
> #
> # Google Firmware Drivers
> #
> CONFIG_GOOGLE_SMI=y
> CONFIG_GOOGLE_MEMCONSOLE=y
> 
> #
> # File systems
> #
> CONFIG_DCACHE_WORD_ACCESS=y
> CONFIG_EXT2_FS=y
> CONFIG_EXT2_FS_XATTR=y
> CONFIG_EXT2_FS_POSIX_ACL=y
> CONFIG_EXT2_FS_SECURITY=y
> CONFIG_EXT2_FS_XIP=y
> CONFIG_EXT3_FS=y
> CONFIG_EXT3_DEFAULTS_TO_ORDERED=y
> CONFIG_EXT3_FS_XATTR=y
> CONFIG_EXT3_FS_POSIX_ACL=y
> CONFIG_EXT3_FS_SECURITY=y
> CONFIG_EXT4_FS=y
> CONFIG_EXT4_FS_XATTR=y
> CONFIG_EXT4_FS_POSIX_ACL=y
> CONFIG_EXT4_FS_SECURITY=y
> CONFIG_EXT4_DEBUG=y
> CONFIG_FS_XIP=y
> CONFIG_JBD=y
> CONFIG_JBD_DEBUG=y
> CONFIG_JBD2=y
> CONFIG_JBD2_DEBUG=y
> CONFIG_FS_MBCACHE=y
> CONFIG_REISERFS_FS=y
> CONFIG_REISERFS_CHECK=y
> CONFIG_REISERFS_PROC_INFO=y
> CONFIG_REISERFS_FS_XATTR=y
> CONFIG_REISERFS_FS_POSIX_ACL=y
> CONFIG_REISERFS_FS_SECURITY=y
> CONFIG_JFS_FS=y
> CONFIG_JFS_POSIX_ACL=y
> CONFIG_JFS_SECURITY=y
> CONFIG_JFS_DEBUG=y
> CONFIG_JFS_STATISTICS=y
> CONFIG_XFS_FS=y
> CONFIG_XFS_QUOTA=y
> CONFIG_XFS_POSIX_ACL=y
> CONFIG_XFS_RT=y
> CONFIG_XFS_DEBUG=y
> CONFIG_GFS2_FS=y
> CONFIG_GFS2_FS_LOCKING_DLM=y
> CONFIG_OCFS2_FS=y
> CONFIG_OCFS2_FS_O2CB=y
> CONFIG_OCFS2_FS_USERSPACE_CLUSTER=y
> CONFIG_OCFS2_FS_STATS=y
> CONFIG_OCFS2_DEBUG_MASKLOG=y
> CONFIG_OCFS2_DEBUG_FS=y
> CONFIG_BTRFS_FS=y
> CONFIG_BTRFS_FS_POSIX_ACL=y
> CONFIG_BTRFS_FS_CHECK_INTEGRITY=y
> CONFIG_NILFS2_FS=y
> CONFIG_FS_POSIX_ACL=y
> CONFIG_EXPORTFS=y
> CONFIG_FILE_LOCKING=y
> CONFIG_FSNOTIFY=y
> CONFIG_DNOTIFY=y
> CONFIG_INOTIFY_USER=y
> CONFIG_FANOTIFY=y
> CONFIG_FANOTIFY_ACCESS_PERMISSIONS=y
> CONFIG_QUOTA=y
> CONFIG_QUOTA_NETLINK_INTERFACE=y
> # CONFIG_PRINT_QUOTA_WARNING is not set
> CONFIG_QUOTA_DEBUG=y
> CONFIG_QUOTA_TREE=y
> CONFIG_QFMT_V1=y
> CONFIG_QFMT_V2=y
> CONFIG_QUOTACTL=y
> CONFIG_QUOTACTL_COMPAT=y
> CONFIG_AUTOFS4_FS=y
> CONFIG_FUSE_FS=y
> CONFIG_CUSE=y
> CONFIG_GENERIC_ACL=y
> 
> #
> # Caches
> #
> CONFIG_FSCACHE=y
> CONFIG_FSCACHE_STATS=y
> CONFIG_FSCACHE_HISTOGRAM=y
> CONFIG_FSCACHE_DEBUG=y
> CONFIG_FSCACHE_OBJECT_LIST=y
> CONFIG_CACHEFILES=y
> CONFIG_CACHEFILES_DEBUG=y
> CONFIG_CACHEFILES_HISTOGRAM=y
> 
> #
> # CD-ROM/DVD Filesystems
> #
> CONFIG_ISO9660_FS=y
> CONFIG_JOLIET=y
> CONFIG_ZISOFS=y
> CONFIG_UDF_FS=y
> CONFIG_UDF_NLS=y
> 
> #
> # DOS/FAT/NT Filesystems
> #
> CONFIG_FAT_FS=y
> CONFIG_MSDOS_FS=y
> CONFIG_VFAT_FS=y
> CONFIG_FAT_DEFAULT_CODEPAGE=437
> CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
> CONFIG_NTFS_FS=y
> CONFIG_NTFS_DEBUG=y
> CONFIG_NTFS_RW=y
> 
> #
> # Pseudo filesystems
> #
> CONFIG_PROC_FS=y
> CONFIG_PROC_KCORE=y
> CONFIG_PROC_VMCORE=y
> CONFIG_PROC_SYSCTL=y
> CONFIG_PROC_PAGE_MONITOR=y
> CONFIG_SYSFS=y
> CONFIG_TMPFS=y
> CONFIG_TMPFS_POSIX_ACL=y
> CONFIG_TMPFS_XATTR=y
> CONFIG_HUGETLBFS=y
> CONFIG_HUGETLB_PAGE=y
> CONFIG_CONFIGFS_FS=y
> CONFIG_MISC_FILESYSTEMS=y
> CONFIG_ADFS_FS=y
> CONFIG_ADFS_FS_RW=y
> CONFIG_AFFS_FS=y
> CONFIG_ECRYPT_FS=y
> CONFIG_HFS_FS=y
> CONFIG_HFSPLUS_FS=y
> CONFIG_BEFS_FS=y
> CONFIG_BEFS_DEBUG=y
> CONFIG_BFS_FS=y
> CONFIG_EFS_FS=y
> CONFIG_JFFS2_FS=y
> CONFIG_JFFS2_FS_DEBUG=0
> CONFIG_JFFS2_FS_WRITEBUFFER=y
> CONFIG_JFFS2_FS_WBUF_VERIFY=y
> CONFIG_JFFS2_SUMMARY=y
> CONFIG_JFFS2_FS_XATTR=y
> CONFIG_JFFS2_FS_POSIX_ACL=y
> CONFIG_JFFS2_FS_SECURITY=y
> CONFIG_JFFS2_COMPRESSION_OPTIONS=y
> CONFIG_JFFS2_ZLIB=y
> CONFIG_JFFS2_LZO=y
> CONFIG_JFFS2_RTIME=y
> CONFIG_JFFS2_RUBIN=y
> # CONFIG_JFFS2_CMODE_NONE is not set
> CONFIG_JFFS2_CMODE_PRIORITY=y
> # CONFIG_JFFS2_CMODE_SIZE is not set
> # CONFIG_JFFS2_CMODE_FAVOURLZO is not set
> CONFIG_UBIFS_FS=y
> CONFIG_UBIFS_FS_ADVANCED_COMPR=y
> CONFIG_UBIFS_FS_LZO=y
> CONFIG_UBIFS_FS_ZLIB=y
> CONFIG_LOGFS=y
> CONFIG_CRAMFS=y
> CONFIG_SQUASHFS=y
> CONFIG_SQUASHFS_XATTR=y
> CONFIG_SQUASHFS_ZLIB=y
> CONFIG_SQUASHFS_LZO=y
> CONFIG_SQUASHFS_XZ=y
> CONFIG_SQUASHFS_4K_DEVBLK_SIZE=y
> CONFIG_SQUASHFS_EMBEDDED=y
> CONFIG_SQUASHFS_FRAGMENT_CACHE_SIZE=3
> CONFIG_VXFS_FS=y
> CONFIG_MINIX_FS=y
> CONFIG_OMFS_FS=y
> CONFIG_HPFS_FS=y
> CONFIG_QNX4FS_FS=y
> CONFIG_QNX6FS_FS=y
> CONFIG_QNX6FS_DEBUG=y
> CONFIG_ROMFS_FS=y
> CONFIG_ROMFS_BACKED_BY_BLOCK=y
> # CONFIG_ROMFS_BACKED_BY_MTD is not set
> # CONFIG_ROMFS_BACKED_BY_BOTH is not set
> CONFIG_ROMFS_ON_BLOCK=y
> CONFIG_PSTORE=y
> CONFIG_PSTORE_CONSOLE=y
> CONFIG_PSTORE_RAM=y
> CONFIG_SYSV_FS=y
> CONFIG_UFS_FS=y
> CONFIG_UFS_FS_WRITE=y
> CONFIG_UFS_DEBUG=y
> CONFIG_EXOFS_FS=y
> CONFIG_EXOFS_DEBUG=y
> CONFIG_ORE=y
> CONFIG_NETWORK_FILESYSTEMS=y
> CONFIG_NFS_FS=y
> CONFIG_NFS_V2=y
> CONFIG_NFS_V3=y
> CONFIG_NFS_V3_ACL=y
> CONFIG_NFS_V4=y
> CONFIG_NFS_V4_1=y
> CONFIG_PNFS_FILE_LAYOUT=y
> CONFIG_PNFS_BLOCK=y
> CONFIG_PNFS_OBJLAYOUT=y
> CONFIG_NFS_V4_1_IMPLEMENTATION_ID_DOMAIN="y"
> CONFIG_ROOT_NFS=y
> CONFIG_NFS_FSCACHE=y
> CONFIG_NFS_USE_LEGACY_DNS=y
> CONFIG_NFS_DEBUG=y
> CONFIG_NFSD=y
> CONFIG_NFSD_V2_ACL=y
> CONFIG_NFSD_V3=y
> CONFIG_NFSD_V3_ACL=y
> CONFIG_NFSD_V4=y
> CONFIG_NFSD_FAULT_INJECTION=y
> CONFIG_LOCKD=y
> CONFIG_LOCKD_V4=y
> CONFIG_NFS_ACL_SUPPORT=y
> CONFIG_NFS_COMMON=y
> CONFIG_SUNRPC=y
> CONFIG_SUNRPC_GSS=y
> CONFIG_SUNRPC_BACKCHANNEL=y
> CONFIG_SUNRPC_XPRT_RDMA=y
> CONFIG_RPCSEC_GSS_KRB5=y
> CONFIG_SUNRPC_DEBUG=y
> CONFIG_CEPH_FS=y
> CONFIG_CIFS=y
> CONFIG_CIFS_STATS=y
> CONFIG_CIFS_STATS2=y
> CONFIG_CIFS_WEAK_PW_HASH=y
> CONFIG_CIFS_UPCALL=y
> CONFIG_CIFS_XATTR=y
> CONFIG_CIFS_POSIX=y
> CONFIG_CIFS_DEBUG2=y
> CONFIG_CIFS_DFS_UPCALL=y
> CONFIG_CIFS_FSCACHE=y
> CONFIG_CIFS_ACL=y
> CONFIG_NCP_FS=y
> CONFIG_NCPFS_PACKET_SIGNING=y
> CONFIG_NCPFS_IOCTL_LOCKING=y
> CONFIG_NCPFS_STRONG=y
> CONFIG_NCPFS_NFS_NS=y
> CONFIG_NCPFS_OS2_NS=y
> CONFIG_NCPFS_SMALLDOS=y
> CONFIG_NCPFS_NLS=y
> CONFIG_NCPFS_EXTRAS=y
> CONFIG_CODA_FS=y
> CONFIG_AFS_FS=y
> CONFIG_AFS_DEBUG=y
> CONFIG_AFS_FSCACHE=y
> CONFIG_9P_FS=y
> CONFIG_9P_FSCACHE=y
> CONFIG_9P_FS_POSIX_ACL=y
> CONFIG_NLS=y
> CONFIG_NLS_DEFAULT="utf8"
> CONFIG_NLS_CODEPAGE_437=y
> # CONFIG_NLS_CODEPAGE_737 is not set
> # CONFIG_NLS_CODEPAGE_775 is not set
> # CONFIG_NLS_CODEPAGE_850 is not set
> # CONFIG_NLS_CODEPAGE_852 is not set
> # CONFIG_NLS_CODEPAGE_855 is not set
> # CONFIG_NLS_CODEPAGE_857 is not set
> # CONFIG_NLS_CODEPAGE_860 is not set
> # CONFIG_NLS_CODEPAGE_861 is not set
> # CONFIG_NLS_CODEPAGE_862 is not set
> # CONFIG_NLS_CODEPAGE_863 is not set
> # CONFIG_NLS_CODEPAGE_864 is not set
> # CONFIG_NLS_CODEPAGE_865 is not set
> # CONFIG_NLS_CODEPAGE_866 is not set
> # CONFIG_NLS_CODEPAGE_869 is not set
> # CONFIG_NLS_CODEPAGE_936 is not set
> # CONFIG_NLS_CODEPAGE_950 is not set
> # CONFIG_NLS_CODEPAGE_932 is not set
> # CONFIG_NLS_CODEPAGE_949 is not set
> # CONFIG_NLS_CODEPAGE_874 is not set
> # CONFIG_NLS_ISO8859_8 is not set
> # CONFIG_NLS_CODEPAGE_1250 is not set
> # CONFIG_NLS_CODEPAGE_1251 is not set
> CONFIG_NLS_ASCII=y
> CONFIG_NLS_ISO8859_1=y
> # CONFIG_NLS_ISO8859_2 is not set
> # CONFIG_NLS_ISO8859_3 is not set
> # CONFIG_NLS_ISO8859_4 is not set
> # CONFIG_NLS_ISO8859_5 is not set
> # CONFIG_NLS_ISO8859_6 is not set
> # CONFIG_NLS_ISO8859_7 is not set
> # CONFIG_NLS_ISO8859_9 is not set
> # CONFIG_NLS_ISO8859_13 is not set
> # CONFIG_NLS_ISO8859_14 is not set
> # CONFIG_NLS_ISO8859_15 is not set
> # CONFIG_NLS_KOI8_R is not set
> # CONFIG_NLS_KOI8_U is not set
> # CONFIG_NLS_MAC_ROMAN is not set
> # CONFIG_NLS_MAC_CELTIC is not set
> # CONFIG_NLS_MAC_CENTEURO is not set
> # CONFIG_NLS_MAC_CROATIAN is not set
> # CONFIG_NLS_MAC_CYRILLIC is not set
> # CONFIG_NLS_MAC_GAELIC is not set
> # CONFIG_NLS_MAC_GREEK is not set
> # CONFIG_NLS_MAC_ICELAND is not set
> # CONFIG_NLS_MAC_INUIT is not set
> # CONFIG_NLS_MAC_ROMANIAN is not set
> # CONFIG_NLS_MAC_TURKISH is not set
> CONFIG_NLS_UTF8=y
> CONFIG_DLM=y
> CONFIG_DLM_DEBUG=y
> CONFIG_PROTECTED_LINKS=y
> CONFIG_PROTECTED_SYMLINKS=y
> CONFIG_PROTECTED_SYMLINKS_SYSCTL=1
> CONFIG_PROTECTED_HARDLINKS=y
> CONFIG_PROTECTED_HARDLINKS_SYSCTL=1
> 
> #
> # Kernel hacking
> #
> CONFIG_TRACE_IRQFLAGS_SUPPORT=y
> CONFIG_PRINTK_TIME=y
> CONFIG_DEFAULT_MESSAGE_LOGLEVEL=4
> # CONFIG_ENABLE_WARN_DEPRECATED is not set
> CONFIG_ENABLE_MUST_CHECK=y
> CONFIG_FRAME_WARN=2048
> CONFIG_MAGIC_SYSRQ=y
> # CONFIG_STRIP_ASM_SYMS is not set
> CONFIG_READABLE_ASM=y
> # CONFIG_UNUSED_SYMBOLS is not set
> CONFIG_DEBUG_FS=y
> # CONFIG_HEADERS_CHECK is not set
> CONFIG_DEBUG_SECTION_MISMATCH=y
> CONFIG_DEBUG_KERNEL=y
> CONFIG_DEBUG_SHIRQ=y
> CONFIG_LOCKUP_DETECTOR=y
> CONFIG_HARDLOCKUP_DETECTOR=y
> CONFIG_BOOTPARAM_HARDLOCKUP_PANIC=y
> CONFIG_BOOTPARAM_HARDLOCKUP_PANIC_VALUE=1
> CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC=y
> CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC_VALUE=1
> # CONFIG_PANIC_ON_OOPS is not set
> CONFIG_PANIC_ON_OOPS_VALUE=0
> CONFIG_DETECT_HUNG_TASK=y
> CONFIG_DEFAULT_HUNG_TASK_TIMEOUT=120
> # CONFIG_BOOTPARAM_HUNG_TASK_PANIC is not set
> CONFIG_BOOTPARAM_HUNG_TASK_PANIC_VALUE=0
> CONFIG_SCHED_DEBUG=y
> CONFIG_SCHEDSTATS=y
> CONFIG_TIMER_STATS=y
> CONFIG_DEBUG_OBJECTS=y
> # CONFIG_DEBUG_OBJECTS_SELFTEST is not set
> CONFIG_DEBUG_OBJECTS_FREE=y
> CONFIG_DEBUG_OBJECTS_TIMERS=y
> CONFIG_DEBUG_OBJECTS_WORK=y
> CONFIG_DEBUG_OBJECTS_RCU_HEAD=y
> CONFIG_DEBUG_OBJECTS_PERCPU_COUNTER=y
> CONFIG_DEBUG_OBJECTS_ENABLE_DEFAULT=1
> # CONFIG_SLUB_DEBUG_ON is not set
> CONFIG_SLUB_STATS=y
> CONFIG_DEBUG_KMEMLEAK=y
> CONFIG_DEBUG_KMEMLEAK_EARLY_LOG_SIZE=400
> # CONFIG_DEBUG_KMEMLEAK_DEFAULT_OFF is not set
> CONFIG_DEBUG_PREEMPT=y
> CONFIG_DEBUG_RT_MUTEXES=y
> CONFIG_DEBUG_PI_LIST=y
> CONFIG_RT_MUTEX_TESTER=y
> CONFIG_DEBUG_SPINLOCK=y
> CONFIG_DEBUG_MUTEXES=y
> CONFIG_DEBUG_LOCK_ALLOC=y
> CONFIG_PROVE_LOCKING=y
> CONFIG_PROVE_RCU=y
> CONFIG_PROVE_RCU_REPEATEDLY=y
> CONFIG_SPARSE_RCU_POINTER=y
> CONFIG_LOCKDEP=y
> CONFIG_LOCK_STAT=y
> CONFIG_DEBUG_LOCKDEP=y
> CONFIG_TRACE_IRQFLAGS=y
> CONFIG_DEBUG_ATOMIC_SLEEP=y
> CONFIG_DEBUG_LOCKING_API_SELFTESTS=y
> CONFIG_STACKTRACE=y
> CONFIG_DEBUG_STACK_USAGE=y
> CONFIG_DEBUG_KOBJECT=y
> CONFIG_DEBUG_BUGVERBOSE=y
> CONFIG_DEBUG_INFO=y
> # CONFIG_DEBUG_INFO_REDUCED is not set
> CONFIG_DEBUG_VM=y
> CONFIG_DEBUG_VIRTUAL=y
> CONFIG_DEBUG_WRITECOUNT=y
> CONFIG_DEBUG_MEMORY_INIT=y
> CONFIG_DEBUG_LIST=y
> CONFIG_TEST_LIST_SORT=y
> CONFIG_DEBUG_SG=y
> CONFIG_DEBUG_NOTIFIERS=y
> CONFIG_DEBUG_CREDENTIALS=y
> CONFIG_ARCH_WANT_FRAME_POINTERS=y
> CONFIG_FRAME_POINTER=y
> # CONFIG_BOOT_PRINTK_DELAY is not set
> CONFIG_RCU_TORTURE_TEST=y
> CONFIG_RCU_TORTURE_TEST_RUNNABLE=y
> CONFIG_RCU_CPU_STALL_TIMEOUT=60
> CONFIG_RCU_CPU_STALL_VERBOSE=y
> CONFIG_RCU_CPU_STALL_INFO=y
> CONFIG_RCU_TRACE=y
> CONFIG_BACKTRACE_SELF_TEST=y
> CONFIG_DEBUG_BLOCK_EXT_DEVT=y
> CONFIG_DEBUG_FORCE_WEAK_PER_CPU=y
> CONFIG_DEBUG_PER_CPU_MAPS=y
> CONFIG_LKDTM=y
> CONFIG_CPU_NOTIFIER_ERROR_INJECT=y
> CONFIG_FAULT_INJECTION=y
> CONFIG_FAILSLAB=y
> CONFIG_FAIL_PAGE_ALLOC=y
> CONFIG_FAIL_MAKE_REQUEST=y
> CONFIG_FAIL_IO_TIMEOUT=y
> CONFIG_FAIL_MMC_REQUEST=y
> CONFIG_FAULT_INJECTION_DEBUG_FS=y
> CONFIG_LATENCYTOP=y
> CONFIG_DEBUG_PAGEALLOC=y
> CONFIG_WANT_PAGE_DEBUG_FLAGS=y
> CONFIG_PAGE_GUARD=y
> CONFIG_USER_STACKTRACE_SUPPORT=y
> CONFIG_NOP_TRACER=y
> CONFIG_HAVE_FUNCTION_TRACER=y
> CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
> CONFIG_HAVE_FUNCTION_GRAPH_FP_TEST=y
> CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y
> CONFIG_HAVE_DYNAMIC_FTRACE=y
> CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
> CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
> CONFIG_HAVE_C_RECORDMCOUNT=y
> CONFIG_RING_BUFFER=y
> CONFIG_EVENT_TRACING=y
> CONFIG_EVENT_POWER_TRACING_DEPRECATED=y
> CONFIG_CONTEXT_SWITCH_TRACER=y
> CONFIG_RING_BUFFER_ALLOW_SWAP=y
> CONFIG_TRACING=y
> CONFIG_TRACING_SUPPORT=y
> CONFIG_FTRACE=y
> # CONFIG_FUNCTION_TRACER is not set
> # CONFIG_IRQSOFF_TRACER is not set
> # CONFIG_PREEMPT_TRACER is not set
> # CONFIG_SCHED_TRACER is not set
> # CONFIG_ENABLE_DEFAULT_TRACERS is not set
> # CONFIG_FTRACE_SYSCALLS is not set
> CONFIG_BRANCH_PROFILE_NONE=y
> # CONFIG_PROFILE_ANNOTATED_BRANCHES is not set
> # CONFIG_PROFILE_ALL_BRANCHES is not set
> # CONFIG_STACK_TRACER is not set
> # CONFIG_BLK_DEV_IO_TRACE is not set
> CONFIG_UPROBE_EVENT=y
> CONFIG_PROBE_EVENTS=y
> # CONFIG_MMIOTRACE is not set
> # CONFIG_RING_BUFFER_BENCHMARK is not set
> CONFIG_PROVIDE_OHCI1394_DMA_INIT=y
> CONFIG_FIREWIRE_OHCI_REMOTE_DMA=y
> CONFIG_DYNAMIC_DEBUG=y
> CONFIG_DMA_API_DEBUG=y
> CONFIG_ATOMIC64_SELFTEST=y
> CONFIG_ASYNC_RAID6_TEST=y
> # CONFIG_SAMPLES is not set
> CONFIG_HAVE_ARCH_KGDB=y
> CONFIG_KGDB=y
> CONFIG_KGDB_SERIAL_CONSOLE=y
> CONFIG_KGDB_TESTS=y
> # CONFIG_KGDB_TESTS_ON_BOOT is not set
> CONFIG_KGDB_LOW_LEVEL_TRAP=y
> CONFIG_KGDB_KDB=y
> CONFIG_KDB_KEYBOARD=y
> CONFIG_HAVE_ARCH_KMEMCHECK=y
> # CONFIG_KMEMCHECK is not set
> CONFIG_TEST_KSTRTOX=y
> # CONFIG_STRICT_DEVMEM is not set
> CONFIG_X86_VERBOSE_BOOTUP=y
> CONFIG_EARLY_PRINTK=y
> CONFIG_EARLY_PRINTK_DBGP=y
> CONFIG_DEBUG_STACKOVERFLOW=y
> CONFIG_X86_PTDUMP=y
> CONFIG_DEBUG_RODATA=y
> CONFIG_DEBUG_RODATA_TEST=y
> CONFIG_IOMMU_DEBUG=y
> CONFIG_IOMMU_STRESS=y
> CONFIG_IOMMU_LEAK=y
> CONFIG_HAVE_MMIOTRACE_SUPPORT=y
> CONFIG_IO_DELAY_TYPE_0X80=0
> CONFIG_IO_DELAY_TYPE_0XED=1
> CONFIG_IO_DELAY_TYPE_UDELAY=2
> CONFIG_IO_DELAY_TYPE_NONE=3
> CONFIG_IO_DELAY_0X80=y
> # CONFIG_IO_DELAY_0XED is not set
> # CONFIG_IO_DELAY_UDELAY is not set
> # CONFIG_IO_DELAY_NONE is not set
> CONFIG_DEFAULT_IO_DELAY_TYPE=0
> CONFIG_DEBUG_BOOT_PARAMS=y
> CONFIG_CPA_DEBUG=y
> CONFIG_OPTIMIZE_INLINING=y
> CONFIG_DEBUG_STRICT_USER_COPY_CHECKS=y
> CONFIG_DEBUG_NMI_SELFTEST=y
> 
> #
> # Security options
> #
> CONFIG_KEYS=y
> CONFIG_TRUSTED_KEYS=y
> CONFIG_ENCRYPTED_KEYS=y
> CONFIG_KEYS_DEBUG_PROC_KEYS=y
> # CONFIG_SECURITY_DMESG_RESTRICT is not set
> CONFIG_SECURITY=y
> CONFIG_SECURITYFS=y
> CONFIG_SECURITY_NETWORK=y
> CONFIG_SECURITY_NETWORK_XFRM=y
> CONFIG_SECURITY_PATH=y
> # CONFIG_INTEL_TXT is not set
> CONFIG_LSM_MMAP_MIN_ADDR=65536
> CONFIG_SECURITY_SELINUX=y
> # CONFIG_SECURITY_SELINUX_BOOTPARAM is not set
> # CONFIG_SECURITY_SELINUX_DISABLE is not set
> CONFIG_SECURITY_SELINUX_DEVELOP=y
> CONFIG_SECURITY_SELINUX_AVC_STATS=y
> CONFIG_SECURITY_SELINUX_CHECKREQPROT_VALUE=1
> CONFIG_SECURITY_SELINUX_POLICYDB_VERSION_MAX=y
> CONFIG_SECURITY_SELINUX_POLICYDB_VERSION_MAX_VALUE=19
> CONFIG_SECURITY_SMACK=y
> CONFIG_SECURITY_TOMOYO=y
> CONFIG_SECURITY_TOMOYO_MAX_ACCEPT_ENTRY=2048
> CONFIG_SECURITY_TOMOYO_MAX_AUDIT_LOG=1024
> CONFIG_SECURITY_TOMOYO_OMIT_USERSPACE_LOADER=y
> CONFIG_SECURITY_APPARMOR=y
> CONFIG_SECURITY_APPARMOR_BOOTPARAM_VALUE=1
> CONFIG_SECURITY_YAMA=y
> CONFIG_INTEGRITY=y
> CONFIG_INTEGRITY_SIGNATURE=y
> CONFIG_IMA=y
> CONFIG_IMA_MEASURE_PCR_IDX=10
> CONFIG_IMA_AUDIT=y
> CONFIG_IMA_LSM_RULES=y
> CONFIG_EVM=y
> # CONFIG_DEFAULT_SECURITY_SELINUX is not set
> # CONFIG_DEFAULT_SECURITY_SMACK is not set
> # CONFIG_DEFAULT_SECURITY_TOMOYO is not set
> # CONFIG_DEFAULT_SECURITY_APPARMOR is not set
> # CONFIG_DEFAULT_SECURITY_YAMA is not set
> CONFIG_DEFAULT_SECURITY_DAC=y
> CONFIG_DEFAULT_SECURITY=""
> CONFIG_XOR_BLOCKS=y
> CONFIG_ASYNC_CORE=y
> CONFIG_ASYNC_MEMCPY=y
> CONFIG_ASYNC_XOR=y
> CONFIG_ASYNC_PQ=y
> CONFIG_ASYNC_RAID6_RECOV=y
> CONFIG_ASYNC_TX_DISABLE_PQ_VAL_DMA=y
> CONFIG_ASYNC_TX_DISABLE_XOR_VAL_DMA=y
> CONFIG_CRYPTO=y
> 
> #
> # Crypto core or helper
> #
> CONFIG_CRYPTO_ALGAPI=y
> CONFIG_CRYPTO_ALGAPI2=y
> CONFIG_CRYPTO_AEAD=y
> CONFIG_CRYPTO_AEAD2=y
> CONFIG_CRYPTO_BLKCIPHER=y
> CONFIG_CRYPTO_BLKCIPHER2=y
> CONFIG_CRYPTO_HASH=y
> CONFIG_CRYPTO_HASH2=y
> CONFIG_CRYPTO_RNG=y
> CONFIG_CRYPTO_RNG2=y
> CONFIG_CRYPTO_PCOMP=y
> CONFIG_CRYPTO_PCOMP2=y
> CONFIG_CRYPTO_MANAGER=y
> CONFIG_CRYPTO_MANAGER2=y
> CONFIG_CRYPTO_USER=y
> CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y
> CONFIG_CRYPTO_GF128MUL=y
> CONFIG_CRYPTO_NULL=y
> CONFIG_CRYPTO_PCRYPT=y
> CONFIG_CRYPTO_WORKQUEUE=y
> CONFIG_CRYPTO_CRYPTD=y
> CONFIG_CRYPTO_AUTHENC=y
> CONFIG_CRYPTO_ABLK_HELPER_X86=y
> CONFIG_CRYPTO_GLUE_HELPER_X86=y
> 
> #
> # Authenticated Encryption with Associated Data
> #
> CONFIG_CRYPTO_CCM=y
> CONFIG_CRYPTO_GCM=y
> CONFIG_CRYPTO_SEQIV=y
> 
> #
> # Block modes
> #
> CONFIG_CRYPTO_CBC=y
> CONFIG_CRYPTO_CTR=y
> CONFIG_CRYPTO_CTS=y
> CONFIG_CRYPTO_ECB=y
> CONFIG_CRYPTO_LRW=y
> CONFIG_CRYPTO_PCBC=y
> CONFIG_CRYPTO_XTS=y
> 
> #
> # Hash modes
> #
> CONFIG_CRYPTO_HMAC=y
> CONFIG_CRYPTO_XCBC=y
> CONFIG_CRYPTO_VMAC=y
> 
> #
> # Digest
> #
> CONFIG_CRYPTO_CRC32C=y
> CONFIG_CRYPTO_CRC32C_INTEL=y
> CONFIG_CRYPTO_GHASH=y
> CONFIG_CRYPTO_MD4=y
> CONFIG_CRYPTO_MD5=y
> CONFIG_CRYPTO_MICHAEL_MIC=y
> CONFIG_CRYPTO_RMD128=y
> CONFIG_CRYPTO_RMD160=y
> CONFIG_CRYPTO_RMD256=y
> CONFIG_CRYPTO_RMD320=y
> CONFIG_CRYPTO_SHA1=y
> CONFIG_CRYPTO_SHA1_SSSE3=y
> CONFIG_CRYPTO_SHA256=y
> CONFIG_CRYPTO_SHA512=y
> CONFIG_CRYPTO_TGR192=y
> CONFIG_CRYPTO_WP512=y
> CONFIG_CRYPTO_GHASH_CLMUL_NI_INTEL=y
> 
> #
> # Ciphers
> #
> CONFIG_CRYPTO_AES=y
> CONFIG_CRYPTO_AES_X86_64=y
> CONFIG_CRYPTO_AES_NI_INTEL=y
> CONFIG_CRYPTO_ANUBIS=y
> CONFIG_CRYPTO_ARC4=y
> CONFIG_CRYPTO_BLOWFISH=y
> CONFIG_CRYPTO_BLOWFISH_COMMON=y
> CONFIG_CRYPTO_BLOWFISH_X86_64=y
> CONFIG_CRYPTO_CAMELLIA=y
> CONFIG_CRYPTO_CAMELLIA_X86_64=y
> CONFIG_CRYPTO_CAST5=y
> CONFIG_CRYPTO_CAST6=y
> CONFIG_CRYPTO_DES=y
> CONFIG_CRYPTO_FCRYPT=y
> CONFIG_CRYPTO_KHAZAD=y
> CONFIG_CRYPTO_SALSA20=y
> CONFIG_CRYPTO_SALSA20_X86_64=y
> CONFIG_CRYPTO_SEED=y
> CONFIG_CRYPTO_SERPENT=y
> CONFIG_CRYPTO_SERPENT_SSE2_X86_64=y
> CONFIG_CRYPTO_SERPENT_AVX_X86_64=y
> CONFIG_CRYPTO_TEA=y
> CONFIG_CRYPTO_TWOFISH=y
> CONFIG_CRYPTO_TWOFISH_COMMON=y
> CONFIG_CRYPTO_TWOFISH_X86_64=y
> CONFIG_CRYPTO_TWOFISH_X86_64_3WAY=y
> CONFIG_CRYPTO_TWOFISH_AVX_X86_64=y
> 
> #
> # Compression
> #
> CONFIG_CRYPTO_DEFLATE=y
> CONFIG_CRYPTO_ZLIB=y
> CONFIG_CRYPTO_LZO=y
> 
> #
> # Random Number Generation
> #
> CONFIG_CRYPTO_ANSI_CPRNG=y
> CONFIG_CRYPTO_USER_API=y
> CONFIG_CRYPTO_USER_API_HASH=y
> CONFIG_CRYPTO_USER_API_SKCIPHER=y
> CONFIG_CRYPTO_HW=y
> CONFIG_CRYPTO_DEV_PADLOCK=y
> CONFIG_CRYPTO_DEV_PADLOCK_AES=y
> CONFIG_CRYPTO_DEV_PADLOCK_SHA=y
> CONFIG_HAVE_KVM=y
> CONFIG_HAVE_KVM_IRQCHIP=y
> CONFIG_HAVE_KVM_EVENTFD=y
> CONFIG_KVM_APIC_ARCHITECTURE=y
> CONFIG_KVM_MMIO=y
> CONFIG_KVM_ASYNC_PF=y
> CONFIG_HAVE_KVM_MSI=y
> CONFIG_VIRTUALIZATION=y
> CONFIG_KVM=y
> CONFIG_KVM_INTEL=y
> CONFIG_KVM_AMD=y
> CONFIG_KVM_MMU_AUDIT=y
> CONFIG_VHOST_NET=y
> CONFIG_BINARY_PRINTF=y
> 
> #
> # Library routines
> #
> CONFIG_RAID6_PQ=y
> CONFIG_BITREVERSE=y
> CONFIG_GENERIC_STRNCPY_FROM_USER=y
> CONFIG_GENERIC_STRNLEN_USER=y
> CONFIG_GENERIC_FIND_FIRST_BIT=y
> CONFIG_GENERIC_PCI_IOMAP=y
> CONFIG_GENERIC_IOMAP=y
> CONFIG_GENERIC_IO=y
> CONFIG_CRC_CCITT=y
> CONFIG_CRC16=y
> CONFIG_CRC_T10DIF=y
> CONFIG_CRC_ITU_T=y
> CONFIG_CRC32=y
> CONFIG_CRC32_SELFTEST=y
> CONFIG_CRC32_SLICEBY8=y
> # CONFIG_CRC32_SLICEBY4 is not set
> # CONFIG_CRC32_SARWATE is not set
> # CONFIG_CRC32_BIT is not set
> CONFIG_CRC7=y
> CONFIG_LIBCRC32C=y
> CONFIG_CRC8=y
> CONFIG_ZLIB_INFLATE=y
> CONFIG_ZLIB_DEFLATE=y
> CONFIG_LZO_COMPRESS=y
> CONFIG_LZO_DECOMPRESS=y
> CONFIG_XZ_DEC=y
> CONFIG_XZ_DEC_X86=y
> CONFIG_XZ_DEC_POWERPC=y
> CONFIG_XZ_DEC_IA64=y
> CONFIG_XZ_DEC_ARM=y
> CONFIG_XZ_DEC_ARMTHUMB=y
> CONFIG_XZ_DEC_SPARC=y
> CONFIG_XZ_DEC_BCJ=y
> CONFIG_XZ_DEC_TEST=y
> CONFIG_GENERIC_ALLOCATOR=y
> CONFIG_REED_SOLOMON=y
> CONFIG_REED_SOLOMON_ENC8=y
> CONFIG_REED_SOLOMON_DEC8=y
> CONFIG_REED_SOLOMON_DEC16=y
> CONFIG_BCH=y
> CONFIG_BCH_CONST_PARAMS=y
> CONFIG_TEXTSEARCH=y
> CONFIG_TEXTSEARCH_KMP=y
> CONFIG_TEXTSEARCH_BM=y
> CONFIG_TEXTSEARCH_FSM=y
> CONFIG_BTREE=y
> CONFIG_HAS_IOMEM=y
> CONFIG_HAS_IOPORT=y
> CONFIG_HAS_DMA=y
> CONFIG_CHECK_SIGNATURE=y
> CONFIG_CPUMASK_OFFSTACK=y
> CONFIG_CPU_RMAP=y
> CONFIG_DQL=y
> CONFIG_NLATTR=y
> CONFIG_LRU_CACHE=y
> CONFIG_AVERAGE=y
> CONFIG_CLZ_TAB=y
> CONFIG_CORDIC=y
> CONFIG_DDR=y
> CONFIG_MPILIB=y
> CONFIG_SIGNATURE=y


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-06-29 21:40   ` Sasha Levin
  2012-06-29 22:27     ` Paul E. McKenney
@ 2012-07-02 10:32     ` Peter Zijlstra
  2012-07-02 11:35       ` Paul E. McKenney
  1 sibling, 1 reply; 20+ messages in thread
From: Peter Zijlstra @ 2012-07-02 10:32 UTC (permalink / raw)
  To: Sasha Levin; +Cc: paulmck, Dave Jones, linux-kernel

On Fri, 2012-06-29 at 23:40 +0200, Sasha Levin wrote:
> 
> The bad news are that what you saw was a lockdep enabled run
> (CONFIG_PROVE_RCU is enabled, and lockdep was enabled). There were no
> lockdep warnings at any point while reproducing it. 

rcu_switch_from() -> rcu_preempt_note_context_switch() is called _after_
the lockdep context switch annotation. Therefore lockdep things the prev
task isn't holding any locks anymore.



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-02 10:32     ` Peter Zijlstra
@ 2012-07-02 11:35       ` Paul E. McKenney
  2012-07-02 11:59         ` Peter Zijlstra
  0 siblings, 1 reply; 20+ messages in thread
From: Paul E. McKenney @ 2012-07-02 11:35 UTC (permalink / raw)
  To: Peter Zijlstra; +Cc: Sasha Levin, Dave Jones, linux-kernel

On Mon, Jul 02, 2012 at 12:32:19PM +0200, Peter Zijlstra wrote:
> On Fri, 2012-06-29 at 23:40 +0200, Sasha Levin wrote:
> > 
> > The bad news are that what you saw was a lockdep enabled run
> > (CONFIG_PROVE_RCU is enabled, and lockdep was enabled). There were no
> > lockdep warnings at any point while reproducing it. 
> 
> rcu_switch_from() -> rcu_preempt_note_context_switch() is called _after_
> the lockdep context switch annotation. Therefore lockdep things the prev
> task isn't holding any locks anymore.

In other words, moving rcu_preempt_note_context_switch() deeper into
the scheduler is totally bogus, and I need to move it back out into the
original rcu_note_context_switch(), reverting 616c310e (Move PREEMPT_RCU
preemption to switch_to() invocation), correct?

Sigh.  "It seemed like a good idea at the time."

							Thanx, Paul


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-02 11:35       ` Paul E. McKenney
@ 2012-07-02 11:59         ` Peter Zijlstra
  2012-07-02 13:12           ` Sasha Levin
  0 siblings, 1 reply; 20+ messages in thread
From: Peter Zijlstra @ 2012-07-02 11:59 UTC (permalink / raw)
  To: paulmck; +Cc: Sasha Levin, Dave Jones, linux-kernel

On Mon, 2012-07-02 at 04:35 -0700, Paul E. McKenney wrote:
> On Mon, Jul 02, 2012 at 12:32:19PM +0200, Peter Zijlstra wrote:
> > On Fri, 2012-06-29 at 23:40 +0200, Sasha Levin wrote:
> > > 
> > > The bad news are that what you saw was a lockdep enabled run
> > > (CONFIG_PROVE_RCU is enabled, and lockdep was enabled). There were no
> > > lockdep warnings at any point while reproducing it. 
> > 
> > rcu_switch_from() -> rcu_preempt_note_context_switch() is called _after_
> > the lockdep context switch annotation. Therefore lockdep things the prev
> > task isn't holding any locks anymore.
> 
> In other words, moving rcu_preempt_note_context_switch() deeper into
> the scheduler is totally bogus, and I need to move it back out into the
> original rcu_note_context_switch(), reverting 616c310e (Move PREEMPT_RCU
> preemption to switch_to() invocation), correct?
> 
> Sigh.  "It seemed like a good idea at the time."

It only needs moving back before that spin_release() thing. But unless
there's a reason to do it later, something like the below might be the
right thing. 

---
 kernel/sched/core.c |    2 +-
 1 files changed, 1 insertions(+), 1 deletions(-)

diff --git a/kernel/sched/core.c b/kernel/sched/core.c
index 9bb7d28..7e20e6c 100644
--- a/kernel/sched/core.c
+++ b/kernel/sched/core.c
@@ -1914,6 +1914,7 @@ prepare_task_switch(struct rq *rq, struct task_struct *prev,
 	sched_info_switch(prev, next);
 	perf_event_task_sched_out(prev, next);
 	fire_sched_out_preempt_notifiers(prev, next);
+	rcu_switch_from(prev);
 	prepare_lock_switch(rq, next);
 	prepare_arch_switch(next);
 	trace_sched_switch(prev, next);
@@ -2082,7 +2083,6 @@ context_switch(struct rq *rq, struct task_struct *prev,
 #endif
 
 	/* Here we just switch the register state and the stack. */
-	rcu_switch_from(prev);
 	switch_to(prev, next, prev);
 
 	barrier();


^ permalink raw reply related	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-02 11:59         ` Peter Zijlstra
@ 2012-07-02 13:12           ` Sasha Levin
  2012-07-02 13:33             ` Paul E. McKenney
  0 siblings, 1 reply; 20+ messages in thread
From: Sasha Levin @ 2012-07-02 13:12 UTC (permalink / raw)
  To: Peter Zijlstra; +Cc: paulmck, Dave Jones, linux-kernel

On Mon, 2012-07-02 at 13:59 +0200, Peter Zijlstra wrote:
> It only needs moving back before that spin_release() thing. But unless
> there's a reason to do it later, something like the below might be the
> right thing. 
> 
> ---
>  kernel/sched/core.c |    2 +-
>  1 files changed, 1 insertions(+), 1 deletions(-)
> 
> diff --git a/kernel/sched/core.c b/kernel/sched/core.c
> index 9bb7d28..7e20e6c 100644
> --- a/kernel/sched/core.c
> +++ b/kernel/sched/core.c
> @@ -1914,6 +1914,7 @@ prepare_task_switch(struct rq *rq, struct task_struct *prev,
>  	sched_info_switch(prev, next);
>  	perf_event_task_sched_out(prev, next);
>  	fire_sched_out_preempt_notifiers(prev, next);
> +	rcu_switch_from(prev);
>  	prepare_lock_switch(rq, next);
>  	prepare_arch_switch(next);
>  	trace_sched_switch(prev, next);
> @@ -2082,7 +2083,6 @@ context_switch(struct rq *rq, struct task_struct *prev,
>  #endif
>  
>  	/* Here we just switch the register state and the stack. */
> -	rcu_switch_from(prev);
>  	switch_to(prev, next, prev);
>  
>  	barrier();
> 

With this patch applied, I'm seeing the following:

[   37.047889] ======================================================
[   37.048018] [ INFO: possible circular locking dependency detected ]
[   37.048018] 3.5.0-rc5-next-20120702-sasha-00007-gefea299 #493 Tainted: G        W   
[   37.048018] -------------------------------------------------------
[   37.048018] rcu_torture_rea/2545 is trying to acquire lock:
[   37.048018]  (&rsp->gp_wq){..-...}, at: [<ffffffff81128b5d>] __wake_up+0x2d/0x70
[   37.048018] 
[   37.048018] but task is already holding lock:
[   37.048018]  (&rq->lock){-.-.-.}, at: [<ffffffff83738420>] __schedule+0x1a0/0x870
[   37.048018] 
[   37.048018] which lock already depends on the new lock.
[   37.048018] 
[   37.048018] 
[   37.048018] the existing dependency chain (in reverse order) is:
[   37.048018] 
-> #2 (&rq->lock){-.-.-.}:
[   37.048018]        [<ffffffff81163813>] validate_chain+0x6a3/0x790
[   37.048018]        [<ffffffff81163d13>] __lock_acquire+0x413/0x4b0
[   37.048018]        [<ffffffff81163f3a>] lock_acquire+0x18a/0x1e0
[   37.048018]        [<ffffffff83739c1b>] _raw_spin_lock+0x3b/0x70
[   37.048018]        [<ffffffff81133401>] wake_up_new_task+0x131/0x270
[   37.048018]        [<ffffffff810eadea>] do_fork+0x27a/0x300
[   37.048018]        [<ffffffff81071e71>] kernel_thread+0x71/0x80
[   37.048018]        [<ffffffff83646701>] rest_init+0x21/0x140
[   37.048018]        [<ffffffff850d8091>] start_kernel+0x3e1/0x3ee
[   37.048018]        [<ffffffff850d7324>] x86_64_start_reservations+0xff/0x104
[   37.048018]        [<ffffffff850d747e>] x86_64_start_kernel+0x155/0x164
[   37.048018] 
-> #1 (&p->pi_lock){-.-.-.}:
[   37.048018]        [<ffffffff81163813>] validate_chain+0x6a3/0x790
[   37.048018]        [<ffffffff81163d13>] __lock_acquire+0x413/0x4b0
[   37.048018]        [<ffffffff81163f3a>] lock_acquire+0x18a/0x1e0
[   37.048018]        [<ffffffff83739db1>] _raw_spin_lock_irqsave+0x81/0xc0
[   37.048018]        [<ffffffff81133034>] try_to_wake_up+0x34/0x290
[   37.048018]        [<ffffffff8113329d>] default_wake_function+0xd/0x10
[   37.048018]        [<ffffffff8111ad48>] autoremove_wake_function+0x18/0x40
[   37.048018]        [<ffffffff81125b92>] __wake_up_common+0x52/0x90
[   37.048018]        [<ffffffff81128b73>] __wake_up+0x43/0x70
[   37.048018]        [<ffffffff811a4715>] rcu_start_gp+0x85/0xb0
[   37.048018]        [<ffffffff811ab1c2>] __rcu_process_callbacks+0x142/0x170
[   37.048018]        [<ffffffff811ab270>] rcu_process_callbacks+0x80/0xb0
[   37.048018]        [<ffffffff810f6061>] __do_softirq+0x221/0x460
[   37.048018]        [<ffffffff810f639d>] run_ksoftirqd+0xfd/0x230
[   37.048018]        [<ffffffff8111a502>] kthread+0xb2/0xc0
[   37.048018]        [<ffffffff8373c8c4>] kernel_thread_helper+0x4/0x10
[   37.048018] 
-> #0 (&rsp->gp_wq){..-...}:
[   37.048018]        [<ffffffff81162dbf>] check_prev_add+0x11f/0x4d0
[   37.048018]        [<ffffffff81163813>] validate_chain+0x6a3/0x790
[   37.048018]        [<ffffffff81163d13>] __lock_acquire+0x413/0x4b0
[   37.048018]        [<ffffffff81163f3a>] lock_acquire+0x18a/0x1e0
[   37.048018]        [<ffffffff83739db1>] _raw_spin_lock_irqsave+0x81/0xc0
[   37.048018]        [<ffffffff81128b5d>] __wake_up+0x2d/0x70
[   37.048018]        [<ffffffff811a47b3>] rcu_report_qs_rsp+0x73/0x80
[   37.048018]        [<ffffffff811a7c9d>] rcu_report_qs_rnp+0x26d/0x2c0
[   37.048018]        [<ffffffff811a8c2e>] rcu_report_unblock_qs_rnp+0x7e/0x90
[   37.048018]        [<ffffffff811a9530>] rcu_read_unlock_special+0x330/0x400
[   37.048018]        [<ffffffff811a982a>] rcu_preempt_note_context_switch+0x22a/0x300
[   37.048018]        [<ffffffff8373870c>] __schedule+0x48c/0x870
[   37.048018]        [<ffffffff83739074>] preempt_schedule_irq+0x94/0xd0
[   37.048018]        [<ffffffff8373aee6>] retint_kernel+0x26/0x30
[   37.048018]        [<ffffffff811a337d>] rcu_torture_read_unlock+0x5d/0x60
[   37.048018]        [<ffffffff811a361d>] rcu_torture_reader+0x29d/0x380
[   37.048018]        [<ffffffff8111a502>] kthread+0xb2/0xc0
[   37.048018]        [<ffffffff8373c8c4>] kernel_thread_helper+0x4/0x10
[   37.048018] 
[   37.048018] other info that might help us debug this:
[   37.048018] 
[   37.048018] Chain exists of:
  &rsp->gp_wq --> &p->pi_lock --> &rq->lock

[   37.048018]  Possible unsafe locking scenario:
[   37.048018] 
[   37.048018]        CPU0                    CPU1
[   37.048018]        ----                    ----
[   37.048018]   lock(&rq->lock);
[   37.048018]                                lock(&p->pi_lock);
[   37.048018]                                lock(&rq->lock);
[   37.048018]   lock(&rsp->gp_wq);
[   37.048018] 
[   37.048018]  *** DEADLOCK ***
[   37.048018] 
[   37.048018] 1 lock held by rcu_torture_rea/2545:
[   37.048018]  #0:  (&rq->lock){-.-.-.}, at: [<ffffffff83738420>] __schedule+0x1a0/0x870
[   37.048018] 
[   37.048018] stack backtrace:
[   37.048018] Pid: 2545, comm: rcu_torture_rea Tainted: G        W    3.5.0-rc5-next-20120702-sasha-00007-gefea299 #493
[   37.048018] Call Trace:
[   37.048018]  [<ffffffff81160da5>] print_circular_bug+0x105/0x120
[   37.048018]  [<ffffffff81162dbf>] check_prev_add+0x11f/0x4d0
[   37.048018]  [<ffffffff81163813>] validate_chain+0x6a3/0x790
[   37.048018]  [<ffffffff81135488>] ? sched_clock_cpu+0x108/0x120
[   37.048018]  [<ffffffff81163d13>] __lock_acquire+0x413/0x4b0
[   37.048018]  [<ffffffff81163f3a>] lock_acquire+0x18a/0x1e0
[   37.048018]  [<ffffffff81128b5d>] ? __wake_up+0x2d/0x70
[   37.048018]  [<ffffffff83739db1>] _raw_spin_lock_irqsave+0x81/0xc0
[   37.048018]  [<ffffffff81128b5d>] ? __wake_up+0x2d/0x70
[   37.048018]  [<ffffffff81128b5d>] __wake_up+0x2d/0x70
[   37.048018]  [<ffffffff811a47b3>] rcu_report_qs_rsp+0x73/0x80
[   37.048018]  [<ffffffff811a7c9d>] rcu_report_qs_rnp+0x26d/0x2c0
[   37.048018]  [<ffffffff811a8c2e>] rcu_report_unblock_qs_rnp+0x7e/0x90
[   37.048018]  [<ffffffff811a9530>] rcu_read_unlock_special+0x330/0x400
[   37.048018]  [<ffffffff811604a4>] ? __lock_acquired+0x2a4/0x2e0
[   37.048018]  [<ffffffff811a982a>] rcu_preempt_note_context_switch+0x22a/0x300
[   37.048018]  [<ffffffff8373870c>] __schedule+0x48c/0x870
[   37.048018]  [<ffffffff83738abd>] ? __schedule+0x83d/0x870
[   37.048018]  [<ffffffff83739074>] preempt_schedule_irq+0x94/0xd0
[   37.048018]  [<ffffffff8373aee6>] retint_kernel+0x26/0x30
[   37.048018]  [<ffffffff811a9200>] ? rcu_preempt_qs+0x120/0x120
[   37.048018]  [<ffffffff811161dd>] ? __rcu_read_unlock+0x4d/0xa0
[   37.048018]  [<ffffffff811a337d>] rcu_torture_read_unlock+0x5d/0x60
[   37.048018]  [<ffffffff811a361d>] rcu_torture_reader+0x29d/0x380
[   37.048018]  [<ffffffff811a2160>] ? T.861+0x50/0x50
[   37.048018]  [<ffffffff811a3380>] ? rcu_torture_read_unlock+0x60/0x60
[   37.048018]  [<ffffffff8111a502>] kthread+0xb2/0xc0
[   37.048018]  [<ffffffff8373c8c4>] kernel_thread_helper+0x4/0x10
[   37.048018]  [<ffffffff8373adb4>] ? retint_restore_args+0x13/0x13
[   37.048018]  [<ffffffff8111a450>] ? __init_kthread_worker+0x70/0x70
[   37.048018]  [<ffffffff8373c8c0>] ? gs_change+0x13/0x13


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-02 13:12           ` Sasha Levin
@ 2012-07-02 13:33             ` Paul E. McKenney
  2012-07-02 14:22               ` Paul E. McKenney
  0 siblings, 1 reply; 20+ messages in thread
From: Paul E. McKenney @ 2012-07-02 13:33 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Peter Zijlstra, Dave Jones, linux-kernel

On Mon, Jul 02, 2012 at 03:12:53PM +0200, Sasha Levin wrote:
> On Mon, 2012-07-02 at 13:59 +0200, Peter Zijlstra wrote:
> > It only needs moving back before that spin_release() thing. But unless
> > there's a reason to do it later, something like the below might be the
> > right thing. 
> > 
> > ---
> >  kernel/sched/core.c |    2 +-
> >  1 files changed, 1 insertions(+), 1 deletions(-)
> > 
> > diff --git a/kernel/sched/core.c b/kernel/sched/core.c
> > index 9bb7d28..7e20e6c 100644
> > --- a/kernel/sched/core.c
> > +++ b/kernel/sched/core.c
> > @@ -1914,6 +1914,7 @@ prepare_task_switch(struct rq *rq, struct task_struct *prev,
> >  	sched_info_switch(prev, next);
> >  	perf_event_task_sched_out(prev, next);
> >  	fire_sched_out_preempt_notifiers(prev, next);
> > +	rcu_switch_from(prev);
> >  	prepare_lock_switch(rq, next);
> >  	prepare_arch_switch(next);
> >  	trace_sched_switch(prev, next);
> > @@ -2082,7 +2083,6 @@ context_switch(struct rq *rq, struct task_struct *prev,
> >  #endif
> >  
> >  	/* Here we just switch the register state and the stack. */
> > -	rcu_switch_from(prev);
> >  	switch_to(prev, next, prev);
> >  
> >  	barrier();
> > 
> 
> With this patch applied, I'm seeing the following:
> 
> [   37.047889] ======================================================
> [   37.048018] [ INFO: possible circular locking dependency detected ]
> [   37.048018] 3.5.0-rc5-next-20120702-sasha-00007-gefea299 #493 Tainted: G        W   
> [   37.048018] -------------------------------------------------------
> [   37.048018] rcu_torture_rea/2545 is trying to acquire lock:
> [   37.048018]  (&rsp->gp_wq){..-...}, at: [<ffffffff81128b5d>] __wake_up+0x2d/0x70
> [   37.048018] 
> [   37.048018] but task is already holding lock:
> [   37.048018]  (&rq->lock){-.-.-.}, at: [<ffffffff83738420>] __schedule+0x1a0/0x870
> [   37.048018] 
> [   37.048018] which lock already depends on the new lock.
> [   37.048018] 
> [   37.048018] 
> [   37.048018] the existing dependency chain (in reverse order) is:
> [   37.048018] 
> -> #2 (&rq->lock){-.-.-.}:
> [   37.048018]        [<ffffffff81163813>] validate_chain+0x6a3/0x790
> [   37.048018]        [<ffffffff81163d13>] __lock_acquire+0x413/0x4b0
> [   37.048018]        [<ffffffff81163f3a>] lock_acquire+0x18a/0x1e0
> [   37.048018]        [<ffffffff83739c1b>] _raw_spin_lock+0x3b/0x70
> [   37.048018]        [<ffffffff81133401>] wake_up_new_task+0x131/0x270
> [   37.048018]        [<ffffffff810eadea>] do_fork+0x27a/0x300
> [   37.048018]        [<ffffffff81071e71>] kernel_thread+0x71/0x80
> [   37.048018]        [<ffffffff83646701>] rest_init+0x21/0x140
> [   37.048018]        [<ffffffff850d8091>] start_kernel+0x3e1/0x3ee
> [   37.048018]        [<ffffffff850d7324>] x86_64_start_reservations+0xff/0x104
> [   37.048018]        [<ffffffff850d747e>] x86_64_start_kernel+0x155/0x164
> [   37.048018] 
> -> #1 (&p->pi_lock){-.-.-.}:
> [   37.048018]        [<ffffffff81163813>] validate_chain+0x6a3/0x790
> [   37.048018]        [<ffffffff81163d13>] __lock_acquire+0x413/0x4b0
> [   37.048018]        [<ffffffff81163f3a>] lock_acquire+0x18a/0x1e0
> [   37.048018]        [<ffffffff83739db1>] _raw_spin_lock_irqsave+0x81/0xc0
> [   37.048018]        [<ffffffff81133034>] try_to_wake_up+0x34/0x290
> [   37.048018]        [<ffffffff8113329d>] default_wake_function+0xd/0x10
> [   37.048018]        [<ffffffff8111ad48>] autoremove_wake_function+0x18/0x40
> [   37.048018]        [<ffffffff81125b92>] __wake_up_common+0x52/0x90
> [   37.048018]        [<ffffffff81128b73>] __wake_up+0x43/0x70
> [   37.048018]        [<ffffffff811a4715>] rcu_start_gp+0x85/0xb0
> [   37.048018]        [<ffffffff811ab1c2>] __rcu_process_callbacks+0x142/0x170
> [   37.048018]        [<ffffffff811ab270>] rcu_process_callbacks+0x80/0xb0
> [   37.048018]        [<ffffffff810f6061>] __do_softirq+0x221/0x460
> [   37.048018]        [<ffffffff810f639d>] run_ksoftirqd+0xfd/0x230
> [   37.048018]        [<ffffffff8111a502>] kthread+0xb2/0xc0
> [   37.048018]        [<ffffffff8373c8c4>] kernel_thread_helper+0x4/0x10
> [   37.048018] 
> -> #0 (&rsp->gp_wq){..-...}:
> [   37.048018]        [<ffffffff81162dbf>] check_prev_add+0x11f/0x4d0
> [   37.048018]        [<ffffffff81163813>] validate_chain+0x6a3/0x790
> [   37.048018]        [<ffffffff81163d13>] __lock_acquire+0x413/0x4b0
> [   37.048018]        [<ffffffff81163f3a>] lock_acquire+0x18a/0x1e0
> [   37.048018]        [<ffffffff83739db1>] _raw_spin_lock_irqsave+0x81/0xc0
> [   37.048018]        [<ffffffff81128b5d>] __wake_up+0x2d/0x70
> [   37.048018]        [<ffffffff811a47b3>] rcu_report_qs_rsp+0x73/0x80
> [   37.048018]        [<ffffffff811a7c9d>] rcu_report_qs_rnp+0x26d/0x2c0
> [   37.048018]        [<ffffffff811a8c2e>] rcu_report_unblock_qs_rnp+0x7e/0x90
> [   37.048018]        [<ffffffff811a9530>] rcu_read_unlock_special+0x330/0x400
> [   37.048018]        [<ffffffff811a982a>] rcu_preempt_note_context_switch+0x22a/0x300
> [   37.048018]        [<ffffffff8373870c>] __schedule+0x48c/0x870
> [   37.048018]        [<ffffffff83739074>] preempt_schedule_irq+0x94/0xd0
> [   37.048018]        [<ffffffff8373aee6>] retint_kernel+0x26/0x30
> [   37.048018]        [<ffffffff811a337d>] rcu_torture_read_unlock+0x5d/0x60
> [   37.048018]        [<ffffffff811a361d>] rcu_torture_reader+0x29d/0x380
> [   37.048018]        [<ffffffff8111a502>] kthread+0xb2/0xc0
> [   37.048018]        [<ffffffff8373c8c4>] kernel_thread_helper+0x4/0x10
> [   37.048018] 
> [   37.048018] other info that might help us debug this:
> [   37.048018] 
> [   37.048018] Chain exists of:
>   &rsp->gp_wq --> &p->pi_lock --> &rq->lock
> 
> [   37.048018]  Possible unsafe locking scenario:
> [   37.048018] 
> [   37.048018]        CPU0                    CPU1
> [   37.048018]        ----                    ----
> [   37.048018]   lock(&rq->lock);
> [   37.048018]                                lock(&p->pi_lock);
> [   37.048018]                                lock(&rq->lock);
> [   37.048018]   lock(&rsp->gp_wq);
> [   37.048018] 
> [   37.048018]  *** DEADLOCK ***

OK, so it looks like the context-switch-time call into preemptible RCU
needs to be outside of the runqueue-lock critical section.  One way
to do this is be reverting 616c310e (Move PREEMPT_RCU preemption to
switch_to() invocation).  Sasha, could you please try this out?

							Thanx, Paul

> [   37.048018] 
> [   37.048018] 1 lock held by rcu_torture_rea/2545:
> [   37.048018]  #0:  (&rq->lock){-.-.-.}, at: [<ffffffff83738420>] __schedule+0x1a0/0x870
> [   37.048018] 
> [   37.048018] stack backtrace:
> [   37.048018] Pid: 2545, comm: rcu_torture_rea Tainted: G        W    3.5.0-rc5-next-20120702-sasha-00007-gefea299 #493
> [   37.048018] Call Trace:
> [   37.048018]  [<ffffffff81160da5>] print_circular_bug+0x105/0x120
> [   37.048018]  [<ffffffff81162dbf>] check_prev_add+0x11f/0x4d0
> [   37.048018]  [<ffffffff81163813>] validate_chain+0x6a3/0x790
> [   37.048018]  [<ffffffff81135488>] ? sched_clock_cpu+0x108/0x120
> [   37.048018]  [<ffffffff81163d13>] __lock_acquire+0x413/0x4b0
> [   37.048018]  [<ffffffff81163f3a>] lock_acquire+0x18a/0x1e0
> [   37.048018]  [<ffffffff81128b5d>] ? __wake_up+0x2d/0x70
> [   37.048018]  [<ffffffff83739db1>] _raw_spin_lock_irqsave+0x81/0xc0
> [   37.048018]  [<ffffffff81128b5d>] ? __wake_up+0x2d/0x70
> [   37.048018]  [<ffffffff81128b5d>] __wake_up+0x2d/0x70
> [   37.048018]  [<ffffffff811a47b3>] rcu_report_qs_rsp+0x73/0x80
> [   37.048018]  [<ffffffff811a7c9d>] rcu_report_qs_rnp+0x26d/0x2c0
> [   37.048018]  [<ffffffff811a8c2e>] rcu_report_unblock_qs_rnp+0x7e/0x90
> [   37.048018]  [<ffffffff811a9530>] rcu_read_unlock_special+0x330/0x400
> [   37.048018]  [<ffffffff811604a4>] ? __lock_acquired+0x2a4/0x2e0
> [   37.048018]  [<ffffffff811a982a>] rcu_preempt_note_context_switch+0x22a/0x300
> [   37.048018]  [<ffffffff8373870c>] __schedule+0x48c/0x870
> [   37.048018]  [<ffffffff83738abd>] ? __schedule+0x83d/0x870
> [   37.048018]  [<ffffffff83739074>] preempt_schedule_irq+0x94/0xd0
> [   37.048018]  [<ffffffff8373aee6>] retint_kernel+0x26/0x30
> [   37.048018]  [<ffffffff811a9200>] ? rcu_preempt_qs+0x120/0x120
> [   37.048018]  [<ffffffff811161dd>] ? __rcu_read_unlock+0x4d/0xa0
> [   37.048018]  [<ffffffff811a337d>] rcu_torture_read_unlock+0x5d/0x60
> [   37.048018]  [<ffffffff811a361d>] rcu_torture_reader+0x29d/0x380
> [   37.048018]  [<ffffffff811a2160>] ? T.861+0x50/0x50
> [   37.048018]  [<ffffffff811a3380>] ? rcu_torture_read_unlock+0x60/0x60
> [   37.048018]  [<ffffffff8111a502>] kthread+0xb2/0xc0
> [   37.048018]  [<ffffffff8373c8c4>] kernel_thread_helper+0x4/0x10
> [   37.048018]  [<ffffffff8373adb4>] ? retint_restore_args+0x13/0x13
> [   37.048018]  [<ffffffff8111a450>] ? __init_kthread_worker+0x70/0x70
> [   37.048018]  [<ffffffff8373c8c0>] ? gs_change+0x13/0x13
> 


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-02 13:33             ` Paul E. McKenney
@ 2012-07-02 14:22               ` Paul E. McKenney
  2012-07-02 14:36                 ` Sasha Levin
  0 siblings, 1 reply; 20+ messages in thread
From: Paul E. McKenney @ 2012-07-02 14:22 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Peter Zijlstra, Dave Jones, linux-kernel

On Mon, Jul 02, 2012 at 06:33:34AM -0700, Paul E. McKenney wrote:
> On Mon, Jul 02, 2012 at 03:12:53PM +0200, Sasha Levin wrote:
> > On Mon, 2012-07-02 at 13:59 +0200, Peter Zijlstra wrote:

[ . . . ]

> > [   37.048018]  *** DEADLOCK ***
> 
> OK, so it looks like the context-switch-time call into preemptible RCU
> needs to be outside of the runqueue-lock critical section.  One way
> to do this is be reverting 616c310e (Move PREEMPT_RCU preemption to
> switch_to() invocation).  Sasha, could you please try this out?

Hmmmm...  Here is a patch for this reversion on top of -rcu with
conflicts resolved.

							Thanx, Paul

------------------------------------------------------------------------

Revert "rcu: Move PREEMPT_RCU preemption to switch_to() invocation"

This reverts commit 616c310e83b872024271c915c1b9ab505b9efad9.
(Move PREEMPT_RCU preemption to switch_to() invocation).
Testing by Sasha Levin <levinsasha928@gmail.com> showed that this
can result in deadlock due to invoking the scheduler when one of
the runqueue locks is held.  Because this commit was simply a
performance optimization, revert it.

Conflicts (resolved):
    
    include/linux/rcutiny.h

diff --git a/arch/um/drivers/mconsole_kern.c b/arch/um/drivers/mconsole_kern.c
index 88e466b..43b39d6 100644
--- a/arch/um/drivers/mconsole_kern.c
+++ b/arch/um/drivers/mconsole_kern.c
@@ -705,7 +705,6 @@ static void stack_proc(void *arg)
 	struct task_struct *from = current, *to = arg;
 
 	to->thread.saved_task = from;
-	rcu_switch_from(from);
 	switch_to(from, to, from);
 }
 
diff --git a/include/linux/rcupdate.h b/include/linux/rcupdate.h
index 2f5d89b..115ead2 100644
--- a/include/linux/rcupdate.h
+++ b/include/linux/rcupdate.h
@@ -185,7 +185,6 @@ static inline int rcu_preempt_depth(void)
 /* Internal to kernel */
 extern void rcu_sched_qs(int cpu);
 extern void rcu_bh_qs(int cpu);
-extern void rcu_preempt_note_context_switch(void);
 extern void rcu_check_callbacks(int cpu, int user);
 struct notifier_block;
 extern void rcu_idle_enter(void);
diff --git a/include/linux/rcutiny.h b/include/linux/rcutiny.h
index 854dc4c..4e56a9c 100644
--- a/include/linux/rcutiny.h
+++ b/include/linux/rcutiny.h
@@ -87,6 +87,10 @@ static inline void kfree_call_rcu(struct rcu_head *head,
 
 #ifdef CONFIG_TINY_RCU
 
+static inline void rcu_preempt_note_context_switch(void)
+{
+}
+
 static inline int rcu_needs_cpu(int cpu, unsigned long *delta_jiffies)
 {
 	*delta_jiffies = ULONG_MAX;
@@ -95,6 +99,7 @@ static inline int rcu_needs_cpu(int cpu, unsigned long *delta_jiffies)
 
 #else /* #ifdef CONFIG_TINY_RCU */
 
+void rcu_preempt_note_context_switch(void);
 int rcu_preempt_needs_cpu(void);
 
 static inline int rcu_needs_cpu(int cpu, unsigned long *delta_jiffies)
@@ -108,6 +113,7 @@ static inline int rcu_needs_cpu(int cpu, unsigned long *delta_jiffies)
 static inline void rcu_note_context_switch(int cpu)
 {
 	rcu_sched_qs(cpu);
+	rcu_preempt_note_context_switch();
 }
 
 /*
diff --git a/include/linux/sched.h b/include/linux/sched.h
index 4059c0f..06a4c5f 100644
--- a/include/linux/sched.h
+++ b/include/linux/sched.h
@@ -1871,22 +1871,12 @@ static inline void rcu_copy_process(struct task_struct *p)
 	INIT_LIST_HEAD(&p->rcu_node_entry);
 }
 
-static inline void rcu_switch_from(struct task_struct *prev)
-{
-	if (prev->rcu_read_lock_nesting != 0)
-		rcu_preempt_note_context_switch();
-}
-
 #else
 
 static inline void rcu_copy_process(struct task_struct *p)
 {
 }
 
-static inline void rcu_switch_from(struct task_struct *prev)
-{
-}
-
 #endif
 
 #ifdef CONFIG_SMP
diff --git a/kernel/rcutree.c b/kernel/rcutree.c
index b9e6aaf..955f18c 100644
--- a/kernel/rcutree.c
+++ b/kernel/rcutree.c
@@ -203,6 +203,7 @@ void rcu_note_context_switch(int cpu)
 {
 	trace_rcu_utilization("Start context switch");
 	rcu_sched_qs(cpu);
+	rcu_preempt_note_context_switch(cpu);
 	trace_rcu_utilization("End context switch");
 }
 EXPORT_SYMBOL_GPL(rcu_note_context_switch);
diff --git a/kernel/rcutree.h b/kernel/rcutree.h
index 86a40b5..b9065dd 100644
--- a/kernel/rcutree.h
+++ b/kernel/rcutree.h
@@ -467,6 +467,7 @@ DECLARE_PER_CPU(char, rcu_cpu_has_work);
 /* Forward declarations for rcutree_plugin.h */
 static void rcu_bootup_announce(void);
 long rcu_batches_completed(void);
+static void rcu_preempt_note_context_switch(int cpu);
 static int rcu_preempt_blocked_readers_cgp(struct rcu_node *rnp);
 #ifdef CONFIG_HOTPLUG_CPU
 static void rcu_report_unblock_qs_rnp(struct rcu_node *rnp,
diff --git a/kernel/rcutree_plugin.h b/kernel/rcutree_plugin.h
index dde457e..cf15a61 100644
--- a/kernel/rcutree_plugin.h
+++ b/kernel/rcutree_plugin.h
@@ -158,7 +158,7 @@ static void rcu_preempt_qs(int cpu)
  *
  * Caller must disable preemption.
  */
-void rcu_preempt_note_context_switch(void)
+static void rcu_preempt_note_context_switch(int cpu)
 {
 	struct task_struct *t = current;
 	unsigned long flags;
@@ -169,7 +169,7 @@ void rcu_preempt_note_context_switch(void)
 	    (t->rcu_read_unlock_special & RCU_READ_UNLOCK_BLOCKED) == 0) {
 
 		/* Possibly blocking in an RCU read-side critical section. */
-		rdp = __this_cpu_ptr(rcu_preempt_state.rda);
+		rdp = per_cpu_ptr(rcu_preempt_state.rda, cpu);
 		rnp = rdp->mynode;
 		raw_spin_lock_irqsave(&rnp->lock, flags);
 		t->rcu_read_unlock_special |= RCU_READ_UNLOCK_BLOCKED;
@@ -233,7 +233,7 @@ void rcu_preempt_note_context_switch(void)
 	 * means that we continue to block the current grace period.
 	 */
 	local_irq_save(flags);
-	rcu_preempt_qs(smp_processor_id());
+	rcu_preempt_qs(cpu);
 	local_irq_restore(flags);
 }
 
@@ -902,6 +902,14 @@ void rcu_force_quiescent_state(void)
 EXPORT_SYMBOL_GPL(rcu_force_quiescent_state);
 
 /*
+ * Because preemptible RCU does not exist, we never have to check for
+ * CPUs being in quiescent states.
+ */
+static void rcu_preempt_note_context_switch(int cpu)
+{
+}
+
+/*
  * Because preemptible RCU does not exist, there are never any preempted
  * RCU readers.
  */
diff --git a/kernel/sched/core.c b/kernel/sched/core.c
index d5594a4..eaead2d 100644
--- a/kernel/sched/core.c
+++ b/kernel/sched/core.c
@@ -2081,7 +2081,6 @@ context_switch(struct rq *rq, struct task_struct *prev,
 #endif
 
 	/* Here we just switch the register state and the stack. */
-	rcu_switch_from(prev);
 	switch_to(prev, next, prev);
 
 	barrier();


^ permalink raw reply related	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-02 14:22               ` Paul E. McKenney
@ 2012-07-02 14:36                 ` Sasha Levin
  2012-07-02 14:59                   ` Paul E. McKenney
  0 siblings, 1 reply; 20+ messages in thread
From: Sasha Levin @ 2012-07-02 14:36 UTC (permalink / raw)
  To: paulmck; +Cc: Peter Zijlstra, Dave Jones, linux-kernel

On Mon, 2012-07-02 at 07:22 -0700, Paul E. McKenney wrote:
> > OK, so it looks like the context-switch-time call into preemptible RCU
> > needs to be outside of the runqueue-lock critical section.  One way
> > to do this is be reverting 616c310e (Move PREEMPT_RCU preemption to
> > switch_to() invocation).  Sasha, could you please try this out?
> 
> Hmmmm...  Here is a patch for this reversion on top of -rcu with
> conflicts resolved. 

It looks like how I've resolved it.

Just for clarity, the only rcu related patch I have on top of -next is
this reversal one. I've dropped anything we tested before.

Looks like its running fine for a bit now (~10 min). I'll ping if
anything changes, but on the other tests it has usually failed at this
point.


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-02 14:36                 ` Sasha Levin
@ 2012-07-02 14:59                   ` Paul E. McKenney
  2012-07-04 14:54                     ` Sasha Levin
  0 siblings, 1 reply; 20+ messages in thread
From: Paul E. McKenney @ 2012-07-02 14:59 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Peter Zijlstra, Dave Jones, linux-kernel

On Mon, Jul 02, 2012 at 04:36:53PM +0200, Sasha Levin wrote:
> On Mon, 2012-07-02 at 07:22 -0700, Paul E. McKenney wrote:
> > > OK, so it looks like the context-switch-time call into preemptible RCU
> > > needs to be outside of the runqueue-lock critical section.  One way
> > > to do this is be reverting 616c310e (Move PREEMPT_RCU preemption to
> > > switch_to() invocation).  Sasha, could you please try this out?
> > 
> > Hmmmm...  Here is a patch for this reversion on top of -rcu with
> > conflicts resolved. 
> 
> It looks like how I've resolved it.

Good show!!!

> Just for clarity, the only rcu related patch I have on top of -next is
> this reversal one. I've dropped anything we tested before.
> 
> Looks like its running fine for a bit now (~10 min). I'll ping if
> anything changes, but on the other tests it has usually failed at this
> point.

If testing goes well (both yours and mine), I will be submitting this
as urgent, since it is a 3.5 regression.  If they don't take it, I will
queue it for 3.6.

							Thanx, Paul


^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-02 14:59                   ` Paul E. McKenney
@ 2012-07-04 14:54                     ` Sasha Levin
  2012-07-04 19:07                       ` Paul E. McKenney
  0 siblings, 1 reply; 20+ messages in thread
From: Sasha Levin @ 2012-07-04 14:54 UTC (permalink / raw)
  To: paulmck; +Cc: Peter Zijlstra, Dave Jones, linux-kernel

On Mon, 2012-07-02 at 07:59 -0700, Paul E. McKenney wrote:
> On Mon, Jul 02, 2012 at 04:36:53PM +0200, Sasha Levin wrote:
> > Looks like its running fine for a bit now (~10 min). I'll ping if
> > anything changes, but on the other tests it has usually failed at this
> > point.
> If testing goes well (both yours and mine), I will be submitting this
> as urgent, since it is a 3.5 regression.  If they don't take it, I will
> queue it for 3.6.

2 days later, and this didn't reproduce. I think we can say it's solved.



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970
  2012-07-04 14:54                     ` Sasha Levin
@ 2012-07-04 19:07                       ` Paul E. McKenney
  0 siblings, 0 replies; 20+ messages in thread
From: Paul E. McKenney @ 2012-07-04 19:07 UTC (permalink / raw)
  To: Sasha Levin; +Cc: Peter Zijlstra, Dave Jones, linux-kernel

On Wed, Jul 04, 2012 at 04:54:51PM +0200, Sasha Levin wrote:
> On Mon, 2012-07-02 at 07:59 -0700, Paul E. McKenney wrote:
> > On Mon, Jul 02, 2012 at 04:36:53PM +0200, Sasha Levin wrote:
> > > Looks like its running fine for a bit now (~10 min). I'll ping if
> > > anything changes, but on the other tests it has usually failed at this
> > > point.
> > If testing goes well (both yours and mine), I will be submitting this
> > as urgent, since it is a 3.5 regression.  If they don't take it, I will
> > queue it for 3.6.
> 
> 2 days later, and this didn't reproduce. I think we can say it's solved.

Very good, and thank you very much for all your testing efforts!

I have added a ten-microsecond delay to __rcu_read_unlock() under a
new CONFIG_RCU_PROVE_DELAY, and have added this to my testing regimen.
And I guess I have also added it in a probabilistic manner to the various
randconfig testing out there.  ;-)

Or will have when it hits mainline, probably 3.7.

							Thanx, Paul


^ permalink raw reply	[flat|nested] 20+ messages in thread

end of thread, other threads:[~2012-07-04 19:07 UTC | newest]

Thread overview: 20+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-06-29 10:09 rcu: BUG: spinlock recursion on CPU#3, trinity-child19/5970 Sasha Levin
2012-06-29 17:23 ` Paul E. McKenney
2012-06-29 21:40   ` Sasha Levin
2012-06-29 22:27     ` Paul E. McKenney
2012-06-29 22:40       ` Sasha Levin
2012-06-29 23:01         ` Paul E. McKenney
2012-07-02 10:32     ` Peter Zijlstra
2012-07-02 11:35       ` Paul E. McKenney
2012-07-02 11:59         ` Peter Zijlstra
2012-07-02 13:12           ` Sasha Levin
2012-07-02 13:33             ` Paul E. McKenney
2012-07-02 14:22               ` Paul E. McKenney
2012-07-02 14:36                 ` Sasha Levin
2012-07-02 14:59                   ` Paul E. McKenney
2012-07-04 14:54                     ` Sasha Levin
2012-07-04 19:07                       ` Paul E. McKenney
2012-06-30 11:36   ` Sasha Levin
2012-06-30 13:14     ` Paul E. McKenney
2012-06-30 13:28       ` Sasha Levin
2012-06-30 13:58         ` Paul E. McKenney

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.