* [BUG] kernel freezes with latest tree
@ 2012-01-10 4:57 Eric Dumazet
2012-01-10 5:03 ` Eric Dumazet
0 siblings, 1 reply; 28+ messages in thread
From: Eric Dumazet @ 2012-01-10 4:57 UTC (permalink / raw)
To: Linus Torvalds; +Cc: linux-kernel
Hi Linus
I got some freezes on two different machines, using latest kernel.
while :; do hackbench 10 thread 4000; done
Not sure I'll have time today to find the problem.
It might be related to "perf top" also being run at least once.
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 4:57 [BUG] kernel freezes with latest tree Eric Dumazet
@ 2012-01-10 5:03 ` Eric Dumazet
2012-01-10 8:16 ` Eric Dumazet
0 siblings, 1 reply; 28+ messages in thread
From: Eric Dumazet @ 2012-01-10 5:03 UTC (permalink / raw)
To: Linus Torvalds; +Cc: linux-kernel
Le mardi 10 janvier 2012 à 05:57 +0100, Eric Dumazet a écrit :
> Hi Linus
>
> I got some freezes on two different machines, using latest kernel.
>
> while :; do hackbench 10 thread 4000; done
>
> Not sure I'll have time today to find the problem.
>
> It might be related to "perf top" also being run at least once.
>
Hmm, I can trigger the bug without ever using "perf".
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 5:03 ` Eric Dumazet
@ 2012-01-10 8:16 ` Eric Dumazet
2012-01-10 16:13 ` Eric Dumazet
2012-01-10 16:16 ` Linus Torvalds
0 siblings, 2 replies; 28+ messages in thread
From: Eric Dumazet @ 2012-01-10 8:16 UTC (permalink / raw)
To: Linus Torvalds; +Cc: linux-kernel
Le mardi 10 janvier 2012 à 06:03 +0100, Eric Dumazet a écrit :
> Le mardi 10 janvier 2012 à 05:57 +0100, Eric Dumazet a écrit :
> > Hi Linus
> >
> > I got some freezes on two different machines, using latest kernel.
> >
> > while :; do hackbench 10 thread 4000; done
> >
> > Not sure I'll have time today to find the problem.
> >
> > It might be related to "perf top" also being run at least once.
> >
>
> Hmm, I can trigger the bug without ever using "perf".
>
>
OK I managed to bisect it, but I have to run now.
$ git bisect log
git bisect start
# bad: [31ae26ae7ba5ff6209b9ec5d1e1ba9442d6b87e6] Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6
git bisect bad 31ae26ae7ba5ff6209b9ec5d1e1ba9442d6b87e6
# good: [805a6af8dba5dfdd35ec35dc52ec0122400b2610] Linux 3.2
git bisect good 805a6af8dba5dfdd35ec35dc52ec0122400b2610
# bad: [e4e88f31bcb5f05f24b9ae518d4ecb44e1a7774d] Merge branch 'next' of git://git.kernel.org/pub/scm/linux/kernel/git/benh/powerpc
git bisect bad e4e88f31bcb5f05f24b9ae518d4ecb44e1a7774d
# good: [ab9c17a009ee8eb8c667f22dc0be0709effceab9] mlx4_core: Modify driver initialization flow to accommodate SRIOV for Ethernet
git bisect good ab9c17a009ee8eb8c667f22dc0be0709effceab9
# good: [117ff42fd43e92d24c6aa6f3e4f0f1e1edada140] Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
git bisect good 117ff42fd43e92d24c6aa6f3e4f0f1e1edada140
# bad: [67b0243131150391125d8d0beb5359d7aec78b55] Merge branch 'x86-apic-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad 67b0243131150391125d8d0beb5359d7aec78b55
# good: [423d091dfe58d3109d84c408810a7cfa82f6f184] Merge branch 'core-rcu-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 423d091dfe58d3109d84c408810a7cfa82f6f184
# good: [f1ac18af219835fd5b8e19c14d2dd75c55f78737] perf: Add support for PERF_HW_COUNT_REF_CPU_CYCLES
git bisect good f1ac18af219835fd5b8e19c14d2dd75c55f78737
# good: [1ac9bc6943edf7d181b4b1cc734981350d4f6bae] sched/tracing: Add a new tracepoint for sleeptime
git bisect good 1ac9bc6943edf7d181b4b1cc734981350d4f6bae
# bad: [0db49b72bce26341274b74fd968501489a361ae3] Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad 0db49b72bce26341274b74fd968501489a361ae3
# good: [1b5495043d5bc058def21f9b66fd8feaa794eb44] perf tools: Moving code in some files
git bisect good 1b5495043d5bc058def21f9b66fd8feaa794eb44
# good: [29c9862f1b818bf4caa4c48a30dbe5f25c84ee08] perf session: Remove impossible condition check
git bisect good 29c9862f1b818bf4caa4c48a30dbe5f25c84ee08
# good: [466e2876bcb9ddc9b92502c46689679bee7d72a0] perf script: Kill script_spec__delete
git bisect good 466e2876bcb9ddc9b92502c46689679bee7d72a0
# good: [35b740e4662ef386f0c60e1b60aaf5b44db9914c] Merge branch 'perf-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 35b740e4662ef386f0c60e1b60aaf5b44db9914c
Could it be a merge error ?
commit 0db49b72bce26341274b74fd968501489a361ae3
Merge: 35b740e 1ac9bc6
Author: Linus Torvalds <torvalds@linux-foundation.org>
Date: Fri Jan 6 08:33:28 2012 -0800
Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
* 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (40 commits)
sched/tracing: Add a new tracepoint for sleeptime
sched: Disable scheduler warnings during oopses
sched: Fix cgroup movement of waking process
sched: Fix cgroup movement of newly created process
sched: Fix cgroup movement of forking process
sched: Remove cfs bandwidth period check in tg_set_cfs_period()
sched: Fix load-balance lock-breaking
sched: Replace all_pinned with a generic flags field
sched: Only queue remote wakeups when crossing cache boundaries
sched: Add missing rcu_dereference() around ->real_parent usage
[S390] fix cputime overflow in uptime_proc_show
[S390] cputime: add sparse checking and cleanup
sched: Mark parent and real_parent as __rcu
sched, nohz: Fix missing RCU read lock
sched, nohz: Set the NOHZ_BALANCE_KICK flag for idle load balancer
sched, nohz: Fix the idle cpu check in nohz_idle_balance
sched: Use jump_labels for sched_feat
sched/accounting: Fix parameter passing in task_group_account_field
sched/accounting: Fix user/system tick double accounting
sched/accounting: Re-use scheduler statistics for the root cgroup
...
Fix up conflicts in
- arch/ia64/include/asm/cputime.h, include/asm-generic/cputime.h
usecs_to_cputime64() vs the sparse cleanups
- kernel/sched/fair.c, kernel/time/tick-sched.c
scheduler changes in multiple branches
diff --cc arch/ia64/include/asm/cputime.h
index 5a274af,461e52f..3deac95
--- a/arch/ia64/include/asm/cputime.h
+++ b/arch/ia64/include/asm/cputime.h
@@@ -58,9 -46,10 +46,12 @@@ typedef u64 __nocast cputime64_t
/*
* Convert cputime <-> microseconds
*/
- #define cputime_to_usecs(__ct) ((__ct) / NSEC_PER_USEC)
- #define usecs_to_cputime(__usecs) ((__usecs) * NSEC_PER_USEC)
- #define usecs_to_cputime64(__usecs) usecs_to_cputime(__usecs)
+ #define cputime_to_usecs(__ct) \
+ ((__force u64)(__ct) / NSEC_PER_USEC)
+ #define usecs_to_cputime(__usecs) \
+ (__force cputime_t)((__usecs) * NSEC_PER_USEC)
++#define usecs_to_cputime64(__usecs) \
++ (__force cputime64_t)((__usecs) * NSEC_PER_USEC)
/*
* Convert cputime <-> seconds
diff --cc arch/powerpc/include/asm/cputime.h
index 98b7c4b,e94935c..6ec1c38
--- a/arch/powerpc/include/asm/cputime.h
+++ b/arch/powerpc/include/asm/cputime.h
@@@ -147,11 -131,9 +131,11 @@@ static inline cputime_t usecs_to_cputim
}
if (sec)
ct += (cputime_t) sec * tb_ticks_per_sec;
- return ct;
+ return (__force cputime_t) ct;
}
+#define usecs_to_cputime64(us) usecs_to_cputime(us)
+
/*
* Convert cputime <-> seconds
*/
diff --cc arch/s390/include/asm/cputime.h
index b9acaaa,0887a04..c23c390
--- a/arch/s390/include/asm/cputime.h
+++ b/arch/s390/include/asm/cputime.h
@@@ -75,20 -62,16 +62,18 @@@ static inline cputime64_t jiffies64_to_
/*
* Convert cputime to microseconds and back.
*/
- static inline unsigned int
- cputime_to_usecs(const cputime_t cputime)
+ static inline unsigned int cputime_to_usecs(const cputime_t cputime)
{
- return cputime_div(cputime, 4096);
+ return (__force unsigned long long) cputime >> 12;
}
- static inline cputime_t
- usecs_to_cputime(const unsigned int m)
+ static inline cputime_t usecs_to_cputime(const unsigned int m)
{
- return (cputime_t) m * 4096;
+ return (__force cputime_t)(m * 4096ULL);
}
+#define usecs_to_cputime64(m) usecs_to_cputime(m)
+
/*
* Convert cputime to milliseconds and back.
*/
diff --cc fs/proc/stat.c
index 0855e6f,2527a68..d76ca6a
--- a/fs/proc/stat.c
+++ b/fs/proc/stat.c
@@@ -29,10 -28,10 +28,10 @@@ static u64 get_idle_time(int cpu
if (idle_time == -1ULL) {
/* !NO_HZ so we can rely on cpustat.idle */
- idle = kstat_cpu(cpu).cpustat.idle;
- idle = cputime64_add(idle, arch_idle_time(cpu));
+ idle = kcpustat_cpu(cpu).cpustat[CPUTIME_IDLE];
+ idle += arch_idle_time(cpu);
} else
- idle = nsecs_to_jiffies64(1000 * idle_time);
+ idle = usecs_to_cputime64(idle_time);
return idle;
}
@@@ -44,9 -42,9 +42,9 @@@ static u64 get_iowait_time(int cpu
if (iowait_time == -1ULL)
/* !NO_HZ so we can rely on cpustat.iowait */
- iowait = kstat_cpu(cpu).cpustat.iowait;
+ iowait = kcpustat_cpu(cpu).cpustat[CPUTIME_IOWAIT];
else
- iowait = nsecs_to_jiffies64(1000 * iowait_time);
+ iowait = usecs_to_cputime64(iowait_time);
return iowait;
}
diff --cc include/asm-generic/cputime.h
index 12a1764,77202e2..9a62937
--- a/include/asm-generic/cputime.h
+++ b/include/asm-generic/cputime.h
@@@ -38,9 -23,10 +23,12 @@@ typedef u64 __nocast cputime64_t
/*
* Convert cputime to microseconds and back.
*/
- #define cputime_to_usecs(__ct) jiffies_to_usecs(__ct)
- #define usecs_to_cputime(__msecs) usecs_to_jiffies(__msecs)
- #define usecs_to_cputime64(__msecs) nsecs_to_jiffies64((__msecs) * 1000)
+ #define cputime_to_usecs(__ct) \
- jiffies_to_usecs(cputime_to_jiffies(__ct));
-#define usecs_to_cputime(__msecs) \
- jiffies_to_cputime(usecs_to_jiffies(__msecs));
++ jiffies_to_usecs(cputime_to_jiffies(__ct))
++#define usecs_to_cputime(__usec) \
++ jiffies_to_cputime(usecs_to_jiffies(__usec))
++#define usecs_to_cputime64(__usec) \
++ jiffies64_to_cputime64(nsecs_to_jiffies64((__usec) * 1000))
/*
* Convert cputime to seconds and back.
diff --cc kernel/time/tick-sched.c
index 0ec8b83,31cc061..7656642
--- a/kernel/time/tick-sched.c
+++ b/kernel/time/tick-sched.c
@@@ -446,56 -481,8 +446,64 @@@ out
ts->next_jiffies = next_jiffies;
ts->last_jiffies = last_jiffies;
ts->sleep_length = ktime_sub(dev->next_event, now);
-end:
- local_irq_restore(flags);
+}
+
+/**
+ * tick_nohz_idle_enter - stop the idle tick from the idle task
+ *
+ * When the next event is more than a tick into the future, stop the idle tick
+ * Called when we start the idle loop.
+ *
+ * The arch is responsible of calling:
+ *
+ * - rcu_idle_enter() after its last use of RCU before the CPU is put
+ * to sleep.
+ * - rcu_idle_exit() before the first use of RCU after the CPU is woken up.
+ */
+void tick_nohz_idle_enter(void)
+{
+ struct tick_sched *ts;
+
+ WARN_ON_ONCE(irqs_disabled());
+
++ /*
++ * Update the idle state in the scheduler domain hierarchy
++ * when tick_nohz_stop_sched_tick() is called from the idle loop.
++ * State will be updated to busy during the first busy tick after
++ * exiting idle.
++ */
++ set_cpu_sd_state_idle();
++
+ local_irq_disable();
+
+ ts = &__get_cpu_var(tick_cpu_sched);
+ /*
+ * set ts->inidle unconditionally. even if the system did not
+ * switch to nohz mode the cpu frequency governers rely on the
+ * update of the idle time accounting in tick_nohz_start_idle().
+ */
+ ts->inidle = 1;
+ tick_nohz_stop_sched_tick(ts);
+
+ local_irq_enable();
+}
+
+/**
+ * tick_nohz_irq_exit - update next tick event from interrupt exit
+ *
+ * When an interrupt fires while we are idle and it doesn't cause
+ * a reschedule, it may still add, modify or delete a timer, enqueue
+ * an RCU callback, etc...
+ * So we need to re-calculate and reprogram the next tick event.
+ */
+void tick_nohz_irq_exit(void)
+{
+ struct tick_sched *ts = &__get_cpu_var(tick_cpu_sched);
+
+ if (!ts->inidle)
+ return;
+
+ tick_nohz_stop_sched_tick(ts);
}
/**
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 8:16 ` Eric Dumazet
@ 2012-01-10 16:13 ` Eric Dumazet
2012-01-10 16:28 ` Linus Torvalds
2012-01-10 16:16 ` Linus Torvalds
1 sibling, 1 reply; 28+ messages in thread
From: Eric Dumazet @ 2012-01-10 16:13 UTC (permalink / raw)
To: Linus Torvalds; +Cc: linux-kernel
Le mardi 10 janvier 2012 à 09:16 +0100, Eric Dumazet a écrit :
> Le mardi 10 janvier 2012 à 06:03 +0100, Eric Dumazet a écrit :
> > Le mardi 10 janvier 2012 à 05:57 +0100, Eric Dumazet a écrit :
> > > Hi Linus
> > >
> > > I got some freezes on two different machines, using latest kernel.
> > >
> > > while :; do hackbench 10 thread 4000; done
> > >
> > > Not sure I'll have time today to find the problem.
> > >
> > > It might be related to "perf top" also being run at least once.
> > >
> >
> > Hmm, I can trigger the bug without ever using "perf".
> >
> >
>
> OK I managed to bisect it, but I have to run now.
>
> $ git bisect log
> git bisect start
> # bad: [31ae26ae7ba5ff6209b9ec5d1e1ba9442d6b87e6] Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6
> git bisect bad 31ae26ae7ba5ff6209b9ec5d1e1ba9442d6b87e6
> # good: [805a6af8dba5dfdd35ec35dc52ec0122400b2610] Linux 3.2
> git bisect good 805a6af8dba5dfdd35ec35dc52ec0122400b2610
> # bad: [e4e88f31bcb5f05f24b9ae518d4ecb44e1a7774d] Merge branch 'next' of git://git.kernel.org/pub/scm/linux/kernel/git/benh/powerpc
> git bisect bad e4e88f31bcb5f05f24b9ae518d4ecb44e1a7774d
> # good: [ab9c17a009ee8eb8c667f22dc0be0709effceab9] mlx4_core: Modify driver initialization flow to accommodate SRIOV for Ethernet
> git bisect good ab9c17a009ee8eb8c667f22dc0be0709effceab9
> # good: [117ff42fd43e92d24c6aa6f3e4f0f1e1edada140] Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
> git bisect good 117ff42fd43e92d24c6aa6f3e4f0f1e1edada140
> # bad: [67b0243131150391125d8d0beb5359d7aec78b55] Merge branch 'x86-apic-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
> git bisect bad 67b0243131150391125d8d0beb5359d7aec78b55
> # good: [423d091dfe58d3109d84c408810a7cfa82f6f184] Merge branch 'core-rcu-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
> git bisect good 423d091dfe58d3109d84c408810a7cfa82f6f184
> # good: [f1ac18af219835fd5b8e19c14d2dd75c55f78737] perf: Add support for PERF_HW_COUNT_REF_CPU_CYCLES
> git bisect good f1ac18af219835fd5b8e19c14d2dd75c55f78737
> # good: [1ac9bc6943edf7d181b4b1cc734981350d4f6bae] sched/tracing: Add a new tracepoint for sleeptime
> git bisect good 1ac9bc6943edf7d181b4b1cc734981350d4f6bae
> # bad: [0db49b72bce26341274b74fd968501489a361ae3] Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
> git bisect bad 0db49b72bce26341274b74fd968501489a361ae3
> # good: [1b5495043d5bc058def21f9b66fd8feaa794eb44] perf tools: Moving code in some files
> git bisect good 1b5495043d5bc058def21f9b66fd8feaa794eb44
> # good: [29c9862f1b818bf4caa4c48a30dbe5f25c84ee08] perf session: Remove impossible condition check
> git bisect good 29c9862f1b818bf4caa4c48a30dbe5f25c84ee08
> # good: [466e2876bcb9ddc9b92502c46689679bee7d72a0] perf script: Kill script_spec__delete
> git bisect good 466e2876bcb9ddc9b92502c46689679bee7d72a0
> # good: [35b740e4662ef386f0c60e1b60aaf5b44db9914c] Merge branch 'perf-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
> git bisect good 35b740e4662ef386f0c60e1b60aaf5b44db9914c
>
>
> Could it be a merge error ?
>
> commit 0db49b72bce26341274b74fd968501489a361ae3
> Merge: 35b740e 1ac9bc6
> Author: Linus Torvalds <torvalds@linux-foundation.org>
> Date: Fri Jan 6 08:33:28 2012 -0800
Here are two traces of the lockups, since I had some free time to reproduce the
bug on current tree (plus a minor change in bnx2 driver to avoid a
netconsole related stack trace)
1st one : PREEMPT is enabled (CONFIG_PREEMPT=y)
-----------------------------------------------
[ 3753.138509] ------------[ cut here ]------------
[ 3753.138509] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 3753.138509] Hardware name: ProLiant BL460c G1
[ 3753.138509] Watchdog detected hard LOCKUP on cpu 5
[ 3753.138509] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 3753.138509] Pid: 5449, comm: IVR Not tainted 3.2.0-05066-g31ae26a-dirty #761
[ 3753.138509] Call Trace:
[ 3753.138509] [<c022b2c2>] warn_slowpath_common+0x72/0xa0
[ 3753.138509] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.138509] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.138509] [<c0284eb0>] ? watchdog_timer_fn+0x170/0x170
[ 3753.138509] [<c022b393>] warn_slowpath_fmt+0x33/0x40
[ 3753.138509] [<c0284f4c>] watchdog_overflow_callback+0x9c/0xc0
[ 3753.138509] [<c02aed6a>] __perf_event_overflow+0x9a/0x240
[ 3753.138509] [<c02af695>] perf_event_overflow+0x15/0x20
[ 3753.138509] [<c0213fd9>] intel_pmu_handle_irq+0x129/0x250
[ 3753.138509] [<c03b4388>] ? cpumask_next_and+0x28/0x40
[ 3753.138509] [<c020f540>] perf_event_nmi_handler+0x20/0x30
[ 3753.138509] [<c0205f18>] nmi_handle.clone.0+0x38/0x50
[ 3753.138509] [<c02060e4>] do_nmi+0x1b4/0x350
[ 3753.138509] [<c061969d>] nmi_stack_correct+0x28/0x2d
[ 3753.138509] [<c06189f4>] ? _raw_spin_lock+0x34/0x40
[ 3753.138509] [<c02613c1>] load_balance+0x361/0x560
[ 3753.138509] [<c0261912>] idle_balance+0xd2/0x150
[ 3753.138509] [<c0617919>] __schedule+0x5e9/0x6b0
[ 3753.138509] [<c03bbca0>] ? timerqueue_add+0x60/0xc0
[ 3753.138509] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.138509] [<c025a1fb>] ? sub_preempt_count+0x7b/0xb0
[ 3753.138509] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.138509] [<c025a2ab>] ? add_preempt_count+0x7b/0xc0
[ 3753.138509] [<c0618637>] ? _raw_spin_unlock_irqrestore+0x17/0x40
[ 3753.138509] [<c0617a65>] schedule+0x35/0x50
[ 3753.138509] [<c0616bfc>] schedule_hrtimeout_range_clock+0xcc/0x180
[ 3753.138509] [<c0250310>] ? update_rmtp+0x80/0x80
[ 3753.138509] [<c02511d6>] ? hrtimer_start_range_ns+0x26/0x30
[ 3753.138509] [<c0616cc7>] schedule_hrtimeout_range+0x17/0x20
[ 3753.138509] [<c0305f5e>] poll_schedule_timeout+0x3e/0x60
[ 3753.138509] [<c0306822>] do_select+0x552/0x690
[ 3753.138509] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.138509] [<c0306030>] ? poll_freewait+0xb0/0xb0
[ 3753.138509] [<c022489b>] ? __change_page_attr_set_clr+0xbb/0x8f0
[ 3753.138509] [<c02ba9de>] ? __alloc_pages_nodemask+0xde/0x600
[ 3753.138509] [<c022489b>] ? __change_page_attr_set_clr+0xbb/0x8f0
[ 3753.138509] [<c0209665>] ? native_sched_clock+0x25/0xc0
[ 3753.138509] [<c0209665>] ? native_sched_clock+0x25/0xc0
[ 3753.138509] [<c025dd12>] ? sched_clock_local+0xe2/0x1e0
[ 3753.138509] [<c0209665>] ? native_sched_clock+0x25/0xc0
[ 3753.138509] [<c025dd12>] ? sched_clock_local+0xe2/0x1e0
[ 3753.138509] [<c025df99>] ? sched_clock_cpu+0x119/0x1b0
[ 3753.138509] [<c0259632>] ? check_preempt_curr+0x72/0x90
[ 3753.138509] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.138509] [<c025a1fb>] ? sub_preempt_count+0x7b/0xb0
[ 3753.138509] [<c0231854>] ? irq_exit+0x74/0xb0
[ 3753.138509] [<c025bb73>] ? scheduler_ipi+0x73/0xc0
[ 3753.138509] [<c021b997>] ? smp_reschedule_interrupt+0x27/0x30
[ 3753.138509] [<c0618ce2>] ? reschedule_interrupt+0x2a/0x30
[ 3753.138509] [<c0306ab2>] core_sys_select+0x152/0x280
[ 3753.138509] [<c0209665>] ? native_sched_clock+0x25/0xc0
[ 3753.138509] [<c025dd12>] ? sched_clock_local+0xe2/0x1e0
[ 3753.138509] [<c0209665>] ? native_sched_clock+0x25/0xc0
[ 3753.138509] [<c025dd12>] ? sched_clock_local+0xe2/0x1e0
[ 3753.138509] [<c0266f87>] ? ktime_get_ts+0xe7/0x110
[ 3753.138509] [<c0266f87>] ? ktime_get_ts+0xe7/0x110
[ 3753.138509] [<c0306c11>] sys_select+0x31/0xb0
[ 3753.138509] [<c061984c>] sysenter_do_call+0x12/0x22
[ 3753.138509] ---[ end trace 994a369c06c2c208 ]---
[ 3753.061448] ------------[ cut here ]------------
[ 3753.061448] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 3753.061448] Hardware name: ProLiant BL460c G1
[ 3753.061448] Watchdog detected hard LOCKUP on cpu 7
[ 3753.061448] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 3753.061448] Pid: 8922, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #761
[ 3753.061448] Call Trace:
[ 3753.061448] [<c022b2c2>] warn_slowpath_common+0x72/0xa0
[ 3753.061448] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.061448] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.061448] [<c0284eb0>] ? watchdog_timer_fn+0x170/0x170
[ 3753.061448] [<c022b393>] warn_slowpath_fmt+0x33/0x40
[ 3753.061448] [<c0284f4c>] watchdog_overflow_callback+0x9c/0xc0
[ 3753.061448] [<c02aed6a>] __perf_event_overflow+0x9a/0x240
[ 3753.061448] [<c02af695>] perf_event_overflow+0x15/0x20
[ 3753.061448] [<c0213fd9>] intel_pmu_handle_irq+0x129/0x250
[ 3753.061448] [<c021401b>] ? intel_pmu_handle_irq+0x16b/0x250
[ 3753.061448] [<c03b4388>] ? cpumask_next_and+0x28/0x40
[ 3753.061448] [<c020f540>] perf_event_nmi_handler+0x20/0x30
[ 3753.061448] [<c0205f18>] nmi_handle.clone.0+0x38/0x50
[ 3753.061448] [<c0205fde>] do_nmi+0xae/0x350
[ 3753.061448] [<c061969d>] nmi_stack_correct+0x28/0x2d
[ 3753.061448] [<c06189f2>] ? _raw_spin_lock+0x32/0x40
[ 3753.061448] [<c02613c1>] load_balance+0x361/0x560
[ 3753.061448] [<c0261912>] idle_balance+0xd2/0x150
[ 3753.061448] [<c0617919>] __schedule+0x5e9/0x6b0
[ 3753.061448] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.061448] [<c025a1fb>] ? sub_preempt_count+0x7b/0xb0
[ 3753.061448] [<c02b723e>] ? __probe_kernel_read+0x4e/0x90
[ 3753.061448] [<c0617a65>] schedule+0x35/0x50
[ 3753.061448] [<c06160cd>] schedule_timeout+0x21d/0x2a0
[ 3753.061448] [<c04e0f41>] ? __alloc_skb+0x31/0x110
[ 3753.061448] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.061448] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.061448] [<c025a1fb>] ? sub_preempt_count+0x7b/0xb0
[ 3753.061448] [<c0618637>] ? _raw_spin_unlock_irqrestore+0x17/0x40
[ 3753.061448] [<c024cc68>] ? prepare_to_wait+0x48/0x70
[ 3753.061448] [<c04dcc1c>] sock_alloc_send_pskb+0x12c/0x290
[ 3753.061448] [<c024ca10>] ? wake_up_bit+0x30/0x30
[ 3753.061448] [<c04dcd9d>] sock_alloc_send_skb+0x1d/0x30
[ 3753.061448] [<c056ed7f>] unix_stream_sendmsg+0x26f/0x3b0
[ 3753.061448] [<c04d86a8>] sock_aio_write+0xf8/0x110
[ 3753.061448] [<c02f4ddc>] do_sync_write+0xac/0xf0
[ 3753.061448] [<c02f5926>] vfs_write+0x126/0x140
[ 3753.061448] [<c02f6d87>] ? fget_light+0x77/0xe0
[ 3753.061448] [<c02f5b22>] sys_write+0x42/0x70
[ 3753.061448] [<c061984c>] sysenter_do_call+0x12/0x22
[ 3753.061448] ---[ end trace 994a369c06c2c209 ]---
[ 3776.910004] BUG: soft lockup - CPU#3 stuck for 22s! [hackbench:9191]
[ 3776.910040] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 3776.910114] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 3776.910187]
[ 3776.910207] Pid: 9191, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #761 HP ProLiant BL460c G1
[ 3776.910262] EIP: 0060:[<c026136a>] EFLAGS: 00000202 CPU: 3
[ 3776.910290] EIP is at load_balance+0x30a/0x560
[ 3776.910316] EAX: 00000000 EBX: 00000000 ECX: 00000001 EDX: 00000100
[ 3776.910345] ESI: f4d9f060 EDI: 00000021 EBP: f4d5df6c ESP: f4d5df0c
[ 3776.910373] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
[ 3776.910401] Process hackbench (pid: 9191, ti=f4d5c000 task=f1a9a7e0 task.ti=ec502000)
[ 3776.910446] Stack:
[ 3776.910467] 00000001 f50c2c74 f4d5df90 00000202 f4d32348 f4d3231c f4d32300 f50c6ec0
[ 3776.910533] c0883ec0 00001133 c0883ec0 f50c2c74 f5086ec0 00001133 00000000 00000003
[ 3776.910598] 00000002 f5086f34 00001133 00001133 00001133 f4d32300 000544dc 00000007
[ 3776.910663] Call Trace:
[ 3776.910687] [<c0261649>] rebalance_domains+0x89/0x160
[ 3776.910716] [<c026175d>] run_rebalance_domains+0x3d/0x120
[ 3776.910745] [<c023146a>] __do_softirq+0x8a/0x1e0
[ 3776.910772] [<c02313e0>] ? local_bh_enable+0xa0/0xa0
[ 3776.910798] <IRQ>
[ 3776.910822] [<c023186e>] ? irq_exit+0x8e/0xb0
[ 3776.910849] [<c0619f38>] ? smp_apic_timer_interrupt+0x58/0x87
[ 3776.910880] [<c02eea10>] ? kmem_cache_free+0x110/0x120
[ 3776.910907] [<c04e094d>] ? __kfree_skb+0x3d/0x90
[ 3776.910934] [<c06193fe>] ? apic_timer_interrupt+0x2a/0x30
[ 3776.910962] [<c056fdbf>] ? unix_stream_recvmsg+0x18f/0x590
[ 3776.910990] [<c024ca10>] ? wake_up_bit+0x30/0x30
[ 3776.911017] [<c04d87c7>] ? sock_aio_read+0x107/0x110
[ 3776.911045] [<c02f4ecc>] ? do_sync_read+0xac/0xf0
[ 3776.911073] [<c02f5a5f>] ? vfs_read+0x11f/0x130
[ 3776.911099] [<c02f6d87>] ? fget_light+0x77/0xe0
[ 3776.911131] [<c02f5ab2>] ? sys_read+0x42/0x70
[ 3776.911158] [<c061984c>] ? sysenter_do_call+0x12/0x22
[ 3776.911185] Code: d8 39 4d c4 76 08 85 c0 0f 85 eb fe ff ff 8b 45 bc 31 db 83 7d d8 00 0f 95 c3 e8 02 73 3b 00 8b 45 d0 e8 fa 72 3b 00 ff 75 ac 9d <85> db 0f 85 a2 00 00 00 f6 45 e0 04 0f 85 f7 00 00 00 f6 45 e0
[ 3776.911525] Call Trace:
[ 3776.911548] [<c0261649>] rebalance_domains+0x89/0x160
[ 3776.911575] [<c026175d>] run_rebalance_domains+0x3d/0x120
[ 3776.911603] [<c023146a>] __do_softirq+0x8a/0x1e0
[ 3776.911630] [<c02313e0>] ? local_bh_enable+0xa0/0xa0
[ 3776.911656] <IRQ> [<c023186e>] ? irq_exit+0x8e/0xb0
[ 3776.911686] [<c0619f38>] ? smp_apic_timer_interrupt+0x58/0x87
[ 3776.911715] [<c02eea10>] ? kmem_cache_free+0x110/0x120
[ 3776.911742] [<c04e094d>] ? __kfree_skb+0x3d/0x90
[ 3776.911768] [<c06193fe>] ? apic_timer_interrupt+0x2a/0x30
[ 3776.911796] [<c056fdbf>] ? unix_stream_recvmsg+0x18f/0x590
[ 3776.911825] [<c024ca10>] ? wake_up_bit+0x30/0x30
[ 3776.911851] [<c04d87c7>] ? sock_aio_read+0x107/0x110
[ 3776.911879] [<c02f4ecc>] ? do_sync_read+0xac/0xf0
[ 3776.911906] [<c02f5a5f>] ? vfs_read+0x11f/0x130
[ 3776.911933] [<c02f6d87>] ? fget_light+0x77/0xe0
[ 3776.911959] [<c02f5ab2>] ? sys_read+0x42/0x70
[ 3776.911985] [<c061984c>] ? sysenter_do_call+0x12/0x22
[ 3776.912011] Kernel panic - not syncing: softlockup: hung tasks
[ 3753.128530] ------------[ cut here ]------------
[ 3753.128530] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 3753.128530] Hardware name: ProLiant BL460c G1
[ 3753.128530] Watchdog detected hard LOCKUP on cpu 1
[ 3753.128530] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 3753.128530] Pid: 9073, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #761
[ 3753.128530] Call Trace:
[ 3753.128530] [<c022b2c2>] warn_slowpath_common+0x72/0xa0
[ 3753.128530] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.128530] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.128530] [<c0284eb0>] ? watchdog_timer_fn+0x170/0x170
[ 3753.128530] [<c022b393>] warn_slowpath_fmt+0x33/0x40
[ 3753.128530] [<c0284f4c>] watchdog_overflow_callback+0x9c/0xc0
[ 3753.128530] [<c02aed6a>] __perf_event_overflow+0x9a/0x240
[ 3753.128530] [<c02af695>] perf_event_overflow+0x15/0x20
[ 3753.128530] [<c0213fd9>] intel_pmu_handle_irq+0x129/0x250
[ 3753.128530] [<c021401b>] ? intel_pmu_handle_irq+0x16b/0x250
[ 3753.128530] [<c03b4388>] ? cpumask_next_and+0x28/0x40
[ 3753.128530] [<c020f540>] perf_event_nmi_handler+0x20/0x30
[ 3753.128530] [<c0205f18>] nmi_handle.clone.0+0x38/0x50
[ 3753.128530] [<c0205fde>] do_nmi+0xae/0x350
[ 3753.128530] [<c061969d>] nmi_stack_correct+0x28/0x2d
[ 3753.128530] [<c06189f0>] ? _raw_spin_lock+0x30/0x40
[ 3753.128530] [<c0261208>] load_balance+0x1a8/0x560
[ 3753.128530] [<c0261912>] idle_balance+0xd2/0x150
[ 3753.128530] [<c0617919>] __schedule+0x5e9/0x6b0
[ 3753.128530] [<c02ee769>] ? __slab_free+0x1b9/0x350
[ 3753.128530] [<c0619f38>] ? smp_apic_timer_interrupt+0x58/0x87
[ 3753.128530] [<c025a1fb>] ? sub_preempt_count+0x7b/0xb0
[ 3753.128530] [<c0617a65>] schedule+0x35/0x50
[ 3753.128530] [<c06160cd>] schedule_timeout+0x21d/0x2a0
[ 3753.128530] [<c02eea10>] ? kmem_cache_free+0x110/0x120
[ 3753.128530] [<c04e094d>] ? __kfree_skb+0x3d/0x90
[ 3753.128530] [<c04e094d>] ? __kfree_skb+0x3d/0x90
[ 3753.128530] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.128530] [<c025a1fb>] ? sub_preempt_count+0x7b/0xb0
[ 3753.128530] [<c056ffbe>] unix_stream_recvmsg+0x38e/0x590
[ 3753.128530] [<c024ca10>] ? wake_up_bit+0x30/0x30
[ 3753.128530] [<c04d87c7>] sock_aio_read+0x107/0x110
[ 3753.128530] [<c02f4ecc>] do_sync_read+0xac/0xf0
[ 3753.128530] [<c025dd12>] ? sched_clock_local+0xe2/0x1e0
[ 3753.128530] [<c025df99>] ? sched_clock_cpu+0x119/0x1b0
[ 3753.128530] [<c02f5a5f>] vfs_read+0x11f/0x130
[ 3753.128530] [<c02f6d87>] ? fget_light+0x77/0xe0
[ 3753.128530] [<c02f5ab2>] sys_read+0x42/0x70
[ 3753.128530] [<c061984c>] sysenter_do_call+0x12/0x22
[ 3753.128530] ---[ end trace 994a369c06c2c20a ]---
[ 3753.060025] ------------[ cut here ]------------
[ 3753.060025] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 3753.060025] Hardware name: ProLiant BL460c G1
[ 3753.060025] Watchdog detected hard LOCKUP on cpu 0
[ 3753.060025] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 3753.060025] Pid: 9083, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #761
[ 3753.060025] Call Trace:
[ 3753.060025] [<c022b2c2>] warn_slowpath_common+0x72/0xa0
[ 3753.060025] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.060025] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.060025] [<c0284eb0>] ? watchdog_timer_fn+0x170/0x170
[ 3753.060025] [<c022b393>] warn_slowpath_fmt+0x33/0x40
[ 3753.060025] [<c0284f4c>] watchdog_overflow_callback+0x9c/0xc0
[ 3753.060025] [<c02aed6a>] __perf_event_overflow+0x9a/0x240
[ 3753.060025] [<c02af695>] perf_event_overflow+0x15/0x20
[ 3753.060025] [<c0213fd9>] intel_pmu_handle_irq+0x129/0x250
[ 3753.060025] [<c025a1fb>] ? sub_preempt_count+0x7b/0xb0
[ 3753.060025] [<c020f540>] perf_event_nmi_handler+0x20/0x30
[ 3753.060025] [<c0205f18>] nmi_handle.clone.0+0x38/0x50
[ 3753.060025] [<c0205fde>] do_nmi+0xae/0x350
[ 3753.060025] [<c04e0f41>] ? __alloc_skb+0x31/0x110
[ 3753.060025] [<c061969d>] nmi_stack_correct+0x28/0x2d
[ 3753.060025] [<c025007b>] ? hrtimer_force_reprogram+0x4b/0xe0
[ 3753.060025] [<c06189b0>] ? _raw_spin_lock_irqsave+0x30/0x40
[ 3753.060025] [<c0257964>] __wake_up_sync_key+0x24/0x60
[ 3753.060025] [<c04dc59d>] sock_def_readable+0x3d/0x70
[ 3753.060025] [<c056ed27>] unix_stream_sendmsg+0x217/0x3b0
[ 3753.060025] [<c04d86a8>] sock_aio_write+0xf8/0x110
[ 3753.060025] [<c02f4ddc>] do_sync_write+0xac/0xf0
[ 3753.060025] [<c02f5926>] vfs_write+0x126/0x140
[ 3753.060025] [<c02f6d87>] ? fget_light+0x77/0xe0
[ 3753.060025] [<c02f5b22>] sys_write+0x42/0x70
[ 3753.060025] [<c061984c>] sysenter_do_call+0x12/0x22
[ 3753.060025] ---[ end trace 994a369c06c2c20b ]---
[ 3753.110224] ------------[ cut here ]------------
[ 3753.110224] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 3753.110224] Hardware name: ProLiant BL460c G1
[ 3753.110224] Watchdog detected hard LOCKUP on cpu 4
[ 3753.110224] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 3753.110224] Pid: 9077, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #761
[ 3753.110224] Call Trace:
[ 3753.110224] [<c022b2c2>] warn_slowpath_common+0x72/0xa0
[ 3753.110224] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.110224] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.110224] [<c0284eb0>] ? watchdog_timer_fn+0x170/0x170
[ 3753.110224] [<c022b393>] warn_slowpath_fmt+0x33/0x40
[ 3753.110224] [<c0284f4c>] watchdog_overflow_callback+0x9c/0xc0
[ 3753.110224] [<c02aed6a>] __perf_event_overflow+0x9a/0x240
[ 3753.110224] [<c02af695>] perf_event_overflow+0x15/0x20
[ 3753.110224] [<c0213fd9>] intel_pmu_handle_irq+0x129/0x250
[ 3753.110224] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.110224] [<c02edc81>] ? get_partial_node.clone.38+0x231/0x290
[ 3753.110224] [<c0259632>] ? check_preempt_curr+0x72/0x90
[ 3753.110224] [<c020f540>] perf_event_nmi_handler+0x20/0x30
[ 3753.110224] [<c0205f18>] nmi_handle.clone.0+0x38/0x50
[ 3753.110224] [<c0205fde>] do_nmi+0xae/0x350
[ 3753.110224] [<c025a14b>] ? get_parent_ip+0xb/0x40
[ 3753.110224] [<c061969d>] nmi_stack_correct+0x28/0x2d
[ 3753.110224] [<c04e007b>] ? sock_queue_err_skb+0x9b/0xb0
[ 3753.110224] [<c025c40f>] ? try_to_wake_up+0x8f/0x220
[ 3753.110224] [<c025c5b0>] default_wake_function+0x10/0x20
[ 3753.110224] [<c024ca30>] autoremove_wake_function+0x20/0x40
[ 3753.110224] [<c0254508>] __wake_up_common+0x48/0x70
[ 3753.110224] [<c0257983>] __wake_up_sync_key+0x43/0x60
[ 3753.110224] [<c04dc59d>] sock_def_readable+0x3d/0x70
[ 3753.110224] [<c056ed27>] unix_stream_sendmsg+0x217/0x3b0
[ 3753.110224] [<c04d86a8>] sock_aio_write+0xf8/0x110
[ 3753.110224] [<c02f4ddc>] do_sync_write+0xac/0xf0
[ 3753.110224] [<c02f5926>] vfs_write+0x126/0x140
[ 3753.110224] [<c02f6d87>] ? fget_light+0x77/0xe0
[ 3753.110224] [<c02f5b22>] sys_write+0x42/0x70
[ 3753.110224] [<c061984c>] sysenter_do_call+0x12/0x22
[ 3753.110224] ---[ end trace 994a369c06c2c20c ]---
[ 3753.070006] ------------[ cut here ]------------
[ 3753.070006] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 3753.070006] Hardware name: ProLiant BL460c G1
[ 3753.070006] Watchdog detected hard LOCKUP on cpu 2
[ 3753.070006] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 3753.070006] Pid: 8897, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #761
[ 3753.070006] Call Trace:
[ 3753.070006] [<c022b2c2>] warn_slowpath_common+0x72/0xa0
[ 3753.070006] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.070006] [<c0284f4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 3753.070006] [<c0284eb0>] ? watchdog_timer_fn+0x170/0x170
[ 3753.070006] [<c022b393>] warn_slowpath_fmt+0x33/0x40
[ 3753.070006] [<c0284f4c>] watchdog_overflow_callback+0x9c/0xc0
[ 3753.070006] [<c02aed6a>] __perf_event_overflow+0x9a/0x240
[ 3753.070006] [<c0616c8d>] ? schedule_hrtimeout_range_clock+0x15d/0x180
[ 3753.070006] [<c02af695>] perf_event_overflow+0x15/0x20
[ 3753.070006] [<c0213fd9>] intel_pmu_handle_irq+0x129/0x250
[ 3753.070006] [<c020f540>] perf_event_nmi_handler+0x20/0x30
[ 3753.070006] [<c0205f18>] nmi_handle.clone.0+0x38/0x50
[ 3753.070006] [<c0205fde>] do_nmi+0xae/0x350
[ 3753.070006] [<c025a1fb>] ? sub_preempt_count+0x7b/0xb0
[ 3753.070006] [<c0618675>] ? _raw_spin_unlock+0x15/0x40
[ 3753.070006] [<c061969d>] nmi_stack_correct+0x28/0x2d
[ 3753.070006] [<c025c40d>] ? try_to_wake_up+0x8d/0x220
[ 3753.070006] [<c02ba12f>] ? __free_pages+0x1f/0x40
[ 3753.070006] [<c025c5b0>] default_wake_function+0x10/0x20
[ 3753.070006] [<c024ca30>] autoremove_wake_function+0x20/0x40
[ 3753.070006] [<c0254508>] __wake_up_common+0x48/0x70
[ 3753.070006] [<c0257983>] __wake_up_sync_key+0x43/0x60
[ 3753.070006] [<c056f6ee>] unix_write_space+0x4e/0x90
[ 3753.070006] [<c04dd028>] sock_wfree+0x48/0x50
[ 3753.070006] [<c056fc10>] unix_destruct_scm+0x80/0xa0
[ 3753.070006] [<c04e0b9d>] skb_release_head_state+0x4d/0xe0
[ 3753.070006] [<c04e0920>] __kfree_skb+0x10/0x90
[ 3753.070006] [<c04e09c7>] consume_skb+0x27/0x90
[ 3753.070006] [<c056fe23>] unix_stream_recvmsg+0x1f3/0x590
[ 3753.070006] [<c024ca10>] ? wake_up_bit+0x30/0x30
[ 3753.070006] [<c04d87c7>] sock_aio_read+0x107/0x110
[ 3753.070006] [<c02f4ecc>] do_sync_read+0xac/0xf0
[ 3753.070006] [<c02f5a5f>] vfs_read+0x11f/0x130
[ 3753.070006] [<c02f6d87>] ? fget_light+0x77/0xe0
[ 3753.070006] [<c02f5ab2>] sys_read+0x42/0x70
[ 3753.070006] [<c061984c>] sysenter_do_call+0x12/0x22
[ 3753.070006] ---[ end trace 994a369c06c2c20d ]---
2nd one (CONFIG_PREEMPT_NONE=y)
-------------------------------
[ 241.920003] ------------[ cut here ]------------
[ 241.920003] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 241.920003] Hardware name: ProLiant BL460c G1
[ 241.920003] Watchdog detected hard LOCKUP on cpu 0
[ 241.920003] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 241.920003] Pid: 8977, comm: hackbench Not tainted 3.2.0-05066-g31ae26a-dirty #762
[ 241.920003] Call Trace:
[ 241.920003] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 241.920003] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.920003] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.920003] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 241.920003] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 241.920003] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 241.920003] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 241.920003] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 241.920003] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 241.920003] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 241.920003] [<c025dee0>] ? find_busiest_group+0x150/0xae0
[ 241.920003] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 241.920003] [<c0205d87>] do_nmi+0xb7/0x350
[ 241.920003] [<c0607ac9>] nmi_stack_correct+0x28/0x2d
[ 241.920003] [<c0606c14>] ? _raw_spin_lock+0x24/0x30
[ 241.920003] [<c025ea24>] load_balance+0x1b4/0x500
[ 241.920003] [<c025f092>] idle_balance+0xc2/0x140
[ 241.920003] [<c06060de>] __schedule+0x4be/0x650
[ 241.920003] [<c02e8485>] ? __slab_free+0x155/0x270
[ 241.920003] [<c0606325>] schedule+0x35/0x50
[ 241.920003] [<c0604b3d>] schedule_timeout+0x1dd/0x250
[ 241.920003] [<c0560ee0>] ? unix_destruct_scm+0x80/0xa0
[ 241.920003] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.920003] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.920003] [<c024ae88>] ? prepare_to_wait+0x48/0x70
[ 241.920003] [<c05612ed>] unix_stream_recvmsg+0x3ed/0x570
[ 241.920003] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 241.920003] [<c04cb997>] sock_aio_read+0x107/0x110
[ 241.920003] [<c02ee7ac>] do_sync_read+0xac/0xf0
[ 241.920003] [<c0230407>] ? irq_exit+0x67/0xa0
[ 241.920003] [<c0608349>] ? smp_apic_timer_interrupt+0x59/0x88
[ 241.920003] [<c025b829>] ? sched_clock_cpu+0x109/0x1a0
[ 241.920003] [<c02ef31f>] vfs_read+0x11f/0x130
[ 241.920003] [<c02ef372>] sys_read+0x42/0x70
[ 241.920003] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 241.920003] ---[ end trace 066d964ca98ab480 ]---
[ 241.835214] ------------[ cut here ]------------
[ 241.835214] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 241.835214] Hardware name: ProLiant BL460c G1
[ 241.835214] Watchdog detected hard LOCKUP on cpu 3
[ 241.835214] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 241.835214] Pid: 8836, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #762
[ 241.835214] Call Trace:
[ 241.835214] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 241.835214] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.835214] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.835214] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 241.835214] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 241.835214] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 241.835214] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 241.835214] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 241.835214] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 241.835214] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 241.835214] [<c025b5b2>] ? sched_clock_local+0xe2/0x1e0
[ 241.835214] [<c025b784>] ? sched_clock_cpu+0x64/0x1a0
[ 241.835214] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 241.835214] [<c0205d87>] do_nmi+0xb7/0x350
[ 241.835214] [<c0607ac9>] nmi_stack_correct+0x28/0x2d
[ 241.835214] [<c0259d32>] ? try_to_wake_up+0xa2/0x220
[ 241.835214] [<c0259ec0>] default_wake_function+0x10/0x20
[ 241.835214] [<c024ac50>] autoremove_wake_function+0x20/0x40
[ 241.835214] [<c0252418>] __wake_up_common+0x48/0x70
[ 241.835214] [<c02558b3>] __wake_up_sync_key+0x43/0x60
[ 241.835214] [<c04cf528>] sock_def_readable+0x38/0x60
[ 241.835214] [<c0560095>] unix_stream_sendmsg+0x215/0x3a0
[ 241.835214] [<c04cb878>] sock_aio_write+0xf8/0x110
[ 241.835214] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 241.835214] [<c02ef1e6>] vfs_write+0x126/0x140
[ 241.835214] [<c02ef3e2>] sys_write+0x42/0x70
[ 241.835214] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 241.835214] ---[ end trace 066d964ca98ab481 ]---
[ 241.344106] ------------[ cut here ]------------
[ 241.344106] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 241.344106] Hardware name: ProLiant BL460c G1
[ 241.344106] Watchdog detected hard LOCKUP on cpu 1
[ 241.344106] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 241.344106] Pid: 8622, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #762
[ 241.344106] Call Trace:
[ 241.344106] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 241.344106] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.344106] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.344106] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 241.344106] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 241.344106] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 241.344106] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 241.344106] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 241.344106] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 241.344106] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 241.344106] [<c0560e60>] ? unix_seqpacket_recvmsg+0x50/0x50
[ 241.344106] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 241.344106] [<c0205d87>] do_nmi+0xb7/0x350
[ 241.344106] [<c0607ac9>] nmi_stack_correct+0x28/0x2d
[ 241.344106] [<c04c007b>] ? hidinput_connect+0xa8b/0x2720
[ 241.344106] [<c0606c42>] ? _raw_spin_lock_irqsave+0x22/0x30
[ 241.344106] [<c0255894>] __wake_up_sync_key+0x24/0x60
[ 241.344106] [<c03b4c57>] ? _copy_from_user+0x37/0x60
[ 241.344106] [<c04cf528>] sock_def_readable+0x38/0x60
[ 241.344106] [<c0560095>] unix_stream_sendmsg+0x215/0x3a0
[ 241.344106] [<c04cb878>] sock_aio_write+0xf8/0x110
[ 241.344106] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 241.344106] [<c02ef1e6>] vfs_write+0x126/0x140
[ 241.344106] [<c02ef3e2>] sys_write+0x42/0x70
[ 241.344106] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 241.344106] ---[ end trace 066d964ca98ab482 ]---
[ 241.419616] ------------[ cut here ]------------
[ 241.419616] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 241.419616] Hardware name: ProLiant BL460c G1
[ 241.419616] Watchdog detected hard LOCKUP on cpu 4
[ 241.419616] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 241.419616] Pid: 8637, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #762
[ 241.419616] Call Trace:
[ 241.419616] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 241.419616] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.419616] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.419616] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 241.419616] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 241.419616] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 241.419616] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 241.419616] [<c02ff240>] ? poll_freewait+0xb0/0xb0
[ 241.419616] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 241.419616] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 241.419616] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 241.419616] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 241.419616] [<c0205d87>] do_nmi+0xb7/0x350
[ 241.419616] [<c0607ac9>] nmi_stack_correct+0x28/0x2d
[ 241.419616] [<c0259d32>] ? try_to_wake_up+0xa2/0x220
[ 241.419616] [<c0259ec0>] default_wake_function+0x10/0x20
[ 241.419616] [<c024ac50>] autoremove_wake_function+0x20/0x40
[ 241.419616] [<c0252418>] __wake_up_common+0x48/0x70
[ 241.419616] [<c02558b3>] __wake_up_sync_key+0x43/0x60
[ 241.419616] [<c04cf528>] sock_def_readable+0x38/0x60
[ 241.419616] [<c0560095>] unix_stream_sendmsg+0x215/0x3a0
[ 241.419616] [<c04cb878>] sock_aio_write+0xf8/0x110
[ 241.419616] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 241.419616] [<c02ef1e6>] vfs_write+0x126/0x140
[ 241.419616] [<c02ef3e2>] sys_write+0x42/0x70
[ 241.419616] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 241.419616] ---[ end trace 066d964ca98ab483 ]---
[ 241.897579] ------------[ cut here ]------------
[ 241.897579] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 241.897579] Hardware name: ProLiant BL460c G1
[ 241.897579] Watchdog detected hard LOCKUP on cpu 7
[ 241.897579] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 241.897579] Pid: 8814, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #762
[ 241.897579] Call Trace:
[ 241.897579] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 241.897579] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.897579] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.897579] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 241.897579] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 241.897579] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 241.897579] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 241.897579] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 241.897579] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 241.897579] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 241.897579] [<c021367b>] ? intel_pmu_handle_irq+0x16b/0x250
[ 241.897579] [<c025dee0>] ? find_busiest_group+0x150/0xae0
[ 241.897579] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 241.897579] [<c0205d87>] do_nmi+0xb7/0x350
[ 241.897579] [<c0607ac9>] nmi_stack_correct+0x28/0x2d
[ 241.897579] [<c0606c14>] ? _raw_spin_lock+0x24/0x30
[ 241.897579] [<c025ebc8>] load_balance+0x358/0x500
[ 241.897579] [<c025f092>] idle_balance+0xc2/0x140
[ 241.897579] [<c06060de>] __schedule+0x4be/0x650
[ 241.897579] [<c02e8485>] ? __slab_free+0x155/0x270
[ 241.897579] [<c02eb1d6>] ? __kmalloc_node_track_caller+0xf6/0x1b0
[ 241.897579] [<c0606325>] schedule+0x35/0x50
[ 241.897579] [<c0604b3d>] schedule_timeout+0x1dd/0x250
[ 241.897579] [<c0560ee0>] ? unix_destruct_scm+0x80/0xa0
[ 241.897579] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.897579] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.897579] [<c024ae88>] ? prepare_to_wait+0x48/0x70
[ 241.897579] [<c05612ed>] unix_stream_recvmsg+0x3ed/0x570
[ 241.897579] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 241.897579] [<c04cb997>] sock_aio_read+0x107/0x110
[ 241.897579] [<c02ee7ac>] do_sync_read+0xac/0xf0
[ 241.897579] [<c02880f2>] ? call_rcu_sched+0x12/0x20
[ 241.897579] [<c02ef31f>] vfs_read+0x11f/0x130
[ 241.897579] [<c02ef372>] sys_read+0x42/0x70
[ 241.897579] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 241.897579] ---[ end trace 066d964ca98ab484 ]---
[ 241.736351] ------------[ cut here ]------------
[ 241.736351] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 241.736351] Hardware name: ProLiant BL460c G1
[ 241.736351] Watchdog detected hard LOCKUP on cpu 2
[ 241.736351] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 241.736351] Pid: 8725, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #762
[ 241.736351] Call Trace:
[ 241.736351] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 241.736351] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.736351] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.736351] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 241.736351] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 241.736351] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 241.736351] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 241.736351] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 241.736351] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 241.736351] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 241.736351] [<c025dee0>] ? find_busiest_group+0x150/0xae0
[ 241.736351] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 241.736351] [<c0205d87>] do_nmi+0xb7/0x350
[ 241.736351] [<c0607ac9>] nmi_stack_correct+0x28/0x2d
[ 241.736351] [<c0606c14>] ? _raw_spin_lock+0x24/0x30
[ 241.736351] [<c025ebc8>] load_balance+0x358/0x500
[ 241.736351] [<c025f092>] idle_balance+0xc2/0x140
[ 241.736351] [<c06060de>] __schedule+0x4be/0x650
[ 241.736351] [<c0259d23>] ? try_to_wake_up+0x93/0x220
[ 241.736351] [<c02e8485>] ? __slab_free+0x155/0x270
[ 241.736351] [<c0606325>] schedule+0x35/0x50
[ 241.736351] [<c0604b3d>] schedule_timeout+0x1dd/0x250
[ 241.736351] [<c0560ee0>] ? unix_destruct_scm+0x80/0xa0
[ 241.736351] [<c02e8688>] ? kmem_cache_free+0xe8/0x100
[ 241.736351] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.736351] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.736351] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.736351] [<c024ae88>] ? prepare_to_wait+0x48/0x70
[ 241.736351] [<c05612ed>] unix_stream_recvmsg+0x3ed/0x570
[ 241.736351] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 241.736351] [<c04cb997>] sock_aio_read+0x107/0x110
[ 241.736351] [<c02ee7ac>] do_sync_read+0xac/0xf0
[ 241.736351] [<c03ae5dc>] ? rb_insert_color+0xcc/0x110
[ 241.736351] [<c0230407>] ? irq_exit+0x67/0xa0
[ 241.736351] [<c0608349>] ? smp_apic_timer_interrupt+0x59/0x88
[ 241.736351] [<c02eee3a>] ? rw_verify_area+0x4a/0x100
[ 241.736351] [<c02ef31f>] vfs_read+0x11f/0x130
[ 241.736351] [<c02ef372>] sys_read+0x42/0x70
[ 241.736351] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 241.736351] ---[ end trace 066d964ca98ab485 ]---
[ 241.344282] ------------[ cut here ]------------
[ 241.344282] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 241.344282] Hardware name: ProLiant BL460c G1
[ 241.344282] Watchdog detected hard LOCKUP on cpu 5
[ 241.344282] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 241.344282] Pid: 8600, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #762
[ 241.344282] Call Trace:
[ 241.344282] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 241.344282] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.344282] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.344282] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 241.344282] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 241.344282] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 241.344282] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 241.344282] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 241.344282] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 241.344282] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 241.344282] [<c021367b>] ? intel_pmu_handle_irq+0x16b/0x250
[ 241.344282] [<c025dee0>] ? find_busiest_group+0x150/0xae0
[ 241.344282] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 241.344282] [<c0205d87>] do_nmi+0xb7/0x350
[ 241.344282] [<c0607ac9>] nmi_stack_correct+0x28/0x2d
[ 241.344282] [<c0606c14>] ? _raw_spin_lock+0x24/0x30
[ 241.344282] [<c025ebc8>] load_balance+0x358/0x500
[ 241.344282] [<c025f092>] idle_balance+0xc2/0x140
[ 241.344282] [<c06060de>] __schedule+0x4be/0x650
[ 241.344282] [<c025dee0>] ? find_busiest_group+0x150/0xae0
[ 241.344282] [<c02e8485>] ? __slab_free+0x155/0x270
[ 241.344282] [<c02eb1d6>] ? __kmalloc_node_track_caller+0xf6/0x1b0
[ 241.344282] [<c0606325>] schedule+0x35/0x50
[ 241.344282] [<c0604b3d>] schedule_timeout+0x1dd/0x250
[ 241.344282] [<c0560ee0>] ? unix_destruct_scm+0x80/0xa0
[ 241.344282] [<c02e8688>] ? kmem_cache_free+0xe8/0x100
[ 241.344282] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.344282] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.344282] [<c04d379d>] ? __kfree_skb+0x3d/0x90
[ 241.344282] [<c024ae88>] ? prepare_to_wait+0x48/0x70
[ 241.344282] [<c05612ed>] unix_stream_recvmsg+0x3ed/0x570
[ 241.344282] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 241.344282] [<c04cb997>] sock_aio_read+0x107/0x110
[ 241.344282] [<c02ee7ac>] do_sync_read+0xac/0xf0
[ 241.344282] [<c0222f2b>] ? do_page_fault+0x16b/0x3d0
[ 241.344282] [<c02ef31f>] vfs_read+0x11f/0x130
[ 241.344282] [<c02ef372>] sys_read+0x42/0x70
[ 241.344282] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 241.344282] ---[ end trace 066d964ca98ab486 ]---
[ 241.750004] ------------[ cut here ]------------
[ 241.750004] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 241.750004] Hardware name: ProLiant BL460c G1
[ 241.750004] Watchdog detected hard LOCKUP on cpu 6
[ 241.750004] Modules linked in: netconsole xt_hashlimit ipmi_devintf ipmi_si ipmi_msghandler af_packet tg3 bonding
[ 241.750004] Pid: 8745, comm: hackbench Tainted: G W 3.2.0-05066-g31ae26a-dirty #762
[ 241.750004] Call Trace:
[ 241.750004] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 241.750004] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.750004] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 241.750004] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 241.750004] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 241.750004] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 241.750004] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 241.750004] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 241.750004] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 241.750004] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 241.750004] [<c025b5b2>] ? sched_clock_local+0xe2/0x1e0
[ 241.750004] [<c025b829>] ? sched_clock_cpu+0x109/0x1a0
[ 241.750004] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 241.750004] [<c0205d87>] do_nmi+0xb7/0x350
[ 241.750004] [<c0607ac9>] nmi_stack_correct+0x28/0x2d
[ 241.750004] [<c0259d32>] ? try_to_wake_up+0xa2/0x220
[ 241.750004] [<c0259ec0>] default_wake_function+0x10/0x20
[ 241.750004] [<c024ac50>] autoremove_wake_function+0x20/0x40
[ 241.750004] [<c0252418>] __wake_up_common+0x48/0x70
[ 241.750004] [<c02558b3>] __wake_up_sync_key+0x43/0x60
[ 241.750004] [<c04cf528>] sock_def_readable+0x38/0x60
[ 241.750004] [<c0560095>] unix_stream_sendmsg+0x215/0x3a0
[ 241.750004] [<c04cb878>] sock_aio_write+0xf8/0x110
[ 241.750004] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 241.750004] [<c03ae78a>] ? rb_erase+0x16a/0x290
[ 241.750004] [<c0230407>] ? irq_exit+0x67/0xa0
[ 241.750004] [<c0608349>] ? smp_apic_timer_interrupt+0x59/0x88
[ 241.750004] [<c02ef1e6>] vfs_write+0x126/0x140
[ 241.750004] [<c02ef3e2>] sys_write+0x42/0x70
[ 241.750004] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 241.750004] ---[ end trace 066d964ca98ab487 ]---
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 8:16 ` Eric Dumazet
2012-01-10 16:13 ` Eric Dumazet
@ 2012-01-10 16:16 ` Linus Torvalds
2012-01-10 16:33 ` Eric Dumazet
1 sibling, 1 reply; 28+ messages in thread
From: Linus Torvalds @ 2012-01-10 16:16 UTC (permalink / raw)
To: Eric Dumazet, Ingo Molnar, Thomas Gleixner, Peter Zijlstra,
Martin Schwidefsky
Cc: linux-kernel
[ Added Ingo & co to the cc, so I'm leaving things quoted. ]
On Tue, Jan 10, 2012 at 12:16 AM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
> Le mardi 10 janvier 2012 à 06:03 +0100, Eric Dumazet a écrit :
>> Le mardi 10 janvier 2012 à 05:57 +0100, Eric Dumazet a écrit :
>> > Hi Linus
>> >
>> > I got some freezes on two different machines, using latest kernel.
>> >
>> > while :; do hackbench 10 thread 4000; done
>> >
>> > Not sure I'll have time today to find the problem.
>> >
>> > It might be related to "perf top" also being run at least once.
>> >
>>
>> Hmm, I can trigger the bug without ever using "perf".
>
> OK I managed to bisect it, but I have to run now.
Good. The bisection certainly helps.
> $ git bisect log
[ snipped ]
> Could it be a merge error ?
>
> commit 0db49b72bce26341274b74fd968501489a361ae3
> Merge: 35b740e 1ac9bc6
> Author: Linus Torvalds <torvalds@linux-foundation.org>
> Date: Fri Jan 6 08:33:28 2012 -0800
>
> Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
That's one of the merges this window that I sent out a query message
for, because I wasn't happy with it, and stopped at that point waiting
for people to validate the end result.
Nobody complained about it, but the first thing to try would be one of
my questions about that merge: can you move the call to
set_cpu_sd_state_idle();
(along with the comment above it) in tick_nohz_idle_enter()
(kernel/time/tick-sched.c) to just *below* the "local_irq_disable()"?
I also questioned the interaction between the sparse cleanups and
usecs_to_cputime64(), but people said they were fine.. But your report
will probably make people double-check.
Guys?
Linus
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 16:13 ` Eric Dumazet
@ 2012-01-10 16:28 ` Linus Torvalds
2012-01-10 16:37 ` Eric Dumazet
0 siblings, 1 reply; 28+ messages in thread
From: Linus Torvalds @ 2012-01-10 16:28 UTC (permalink / raw)
To: Eric Dumazet, Ingo Molnar, Thomas Gleixner, Peter Zijlstra,
Martin Schwidefsky
Cc: linux-kernel
On Tue, Jan 10, 2012 at 8:13 AM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
>
> Here are two traces of the lockups, since I had some free time to reproduce the
> bug on current tree (plus a minor change in bnx2 driver to avoid a
> netconsole related stack trace)
Hmm. You have load_balance() and idle_balance() there in the trace, so
I'm getting more hopeful that it really is just the fact that
set_cpu_sd_state_idle() really needs to just be run with interrupts
disabled. That was my main concern about that merge, so if it's that,
I'll be relieved.
If you can please try that change out, that would be great.
[ And if that's not it - Ingo & co, please check out the traces on lkml ]
Linus
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 16:16 ` Linus Torvalds
@ 2012-01-10 16:33 ` Eric Dumazet
0 siblings, 0 replies; 28+ messages in thread
From: Eric Dumazet @ 2012-01-10 16:33 UTC (permalink / raw)
To: Linus Torvalds
Cc: Ingo Molnar, Thomas Gleixner, Peter Zijlstra, Martin Schwidefsky,
linux-kernel
Le mardi 10 janvier 2012 à 08:16 -0800, Linus Torvalds a écrit :
>
> That's one of the merges this window that I sent out a query message
> for, because I wasn't happy with it, and stopped at that point waiting
> for people to validate the end result.
>
> Nobody complained about it, but the first thing to try would be one of
> my questions about that merge: can you move the call to
>
> set_cpu_sd_state_idle();
>
> (along with the comment above it) in tick_nohz_idle_enter()
> (kernel/time/tick-sched.c) to just *below* the "local_irq_disable()"?
>
> I also questioned the interaction between the sparse cleanups and
> usecs_to_cputime64(), but people said they were fine.. But your report
> will probably make people double-check.
>
Hmm, I tried your suggestion but still get a lockup.
(please ignore the bnx2 netpoll problem, I'll post a patch on net-next
later)
[ 106.499348] ------------[ cut here ]------------
[ 106.499348] WARNING: at kernel/watchdog.c:241
watchdog_overflow_callback+0x9c/0xc0()
[ 106.499348] Hardware name: ProLiant BL460c G1
[ 106.499348] Watchdog detected hard LOCKUP on cpu 0
[ 106.499348] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 106.499348] Pid: 5727, comm: hackbench Not tainted
3.2.0-05066-g31ae26a-dirty #774
[ 106.499348] Call Trace:
[ 106.499348] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.499348] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] ------------[ cut here ]------------
[ 106.499348] WARNING: at kernel/softirq.c:159 local_bh_enable_ip
+0x58/0x80()
[ 106.499348] Hardware name: ProLiant BL460c G1
[ 106.499348] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 106.499348] Pid: 5727, comm: hackbench Not tainted
3.2.0-05066-g31ae26a-dirty #774
[ 106.499348] Call Trace:
[ 106.499348] [<c06048f2>] ? printk+0x1d/0x23
[ 106.499348] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.499348] [<c022ffd8>] ? local_bh_enable_ip+0x58/0x80
[ 106.499348] [<c022ffd8>] ? local_bh_enable_ip+0x58/0x80
[ 106.499348] [<c022a262>] warn_slowpath_null+0x22/0x30
[ 106.499348] [<c022ffd8>] local_bh_enable_ip+0x58/0x80
[ 106.499348] [<c0606e03>] _raw_spin_unlock_bh+0x13/0x20
[ 106.499348] [<c047046b>] bnx2_reg_rd_ind+0x3b/0x50
[ 106.499348] [<c0470493>] bnx2_shmem_rd+0x13/0x20
[ 106.499348] [<c047af03>] bnx2_poll+0x103/0x200
[ 106.499348] [<c04f1c50>] netpoll_poll_dev+0x410/0x4c0
[ 106.499348] [<c02b21b4>] ? __probe_kernel_read+0x24/0x40
[ 106.499348] [<c02eb1d6>] ? __kmalloc_node_track_caller+0xf6/0x1b0
[ 106.499348] [<c04f1e18>] netpoll_send_skb_on_dev+0x118/0x1d0
[ 106.499348] [<c04d3d49>] ? __alloc_skb+0x69/0x110
[ 106.499348] [<c04f17ed>] ? find_skb.clone.30+0x3d/0x90
[ 106.499348] [<c04f209a>] netpoll_send_udp+0x1ca/0x1f0
[ 106.499348] [<f8716214>] write_msg+0x84/0xb0 [netconsole]
[ 106.499348] [<f8716190>] ? netconsole_netdev_event+0x190/0x190
[netconsole]
[ 106.499348] [<c022a38b>] __call_console_drivers+0x7b/0x90
[ 106.499348] [<c022a3ee>] _call_console_drivers+0x4e/0x80
[ 106.499348] [<c022a813>] console_unlock+0xf3/0x210
[ 106.499348] [<c022ad39>] vprintk+0x2d9/0x3d0
[ 106.499348] [<c02501f9>] ? up+0x29/0x40
[ 106.499348] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c06048f2>] printk+0x1d/0x23
[ 106.499348] [<c0205772>] printk_address+0x32/0x40
[ 106.499348] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c02057b0>] print_trace_address+0x30/0x40
[ 106.499348] [<c02056bc>] print_context_stack+0x7c/0x100
[ 106.499348] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c020474f>] dump_trace+0x7f/0xf0
[ 106.499348] [<c020580c>] show_trace_log_lvl+0x4c/0x60
[ 106.499348] [<c020583f>] show_trace+0x1f/0x30
[ 106.499348] [<c0604778>] dump_stack+0x73/0x7a
[ 106.499348] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.499348] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 106.499348] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 106.499348] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 106.499348] [<c02ff240>] ? poll_freewait+0xb0/0xb0
[ 106.499348] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.499348] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 106.499348] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 106.499348] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 106.499348] [<c0205d87>] do_nmi+0xb7/0x350
[ 106.499348] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 106.499348] [<c0259d32>] ? try_to_wake_up+0xa2/0x220
[ 106.499348] [<c0259ec0>] default_wake_function+0x10/0x20
[ 106.499348] [<c024ac50>] autoremove_wake_function+0x20/0x40
[ 106.499348] [<c0252418>] __wake_up_common+0x48/0x70
[ 106.499348] [<c02558b3>] __wake_up_sync_key+0x43/0x60
[ 106.499348] [<c04cf4f8>] sock_def_readable+0x38/0x60
[ 106.499348] [<c0560065>] unix_stream_sendmsg+0x215/0x3a0
[ 106.499348] [<c04cb848>] sock_aio_write+0xf8/0x110
[ 106.499348] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 106.499348] [<c02ef1e6>] vfs_write+0x126/0x140
[ 106.499348] [<c02ef3e2>] sys_write+0x42/0x70
[ 106.499348] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 106.499348] ---[ end trace 68da413eff30529e ]---
[ 106.499348] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 106.499348] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 106.499348] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 106.499348] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 106.499348] [<c02ff240>] ? poll_freewait+0xb0/0xb0
[ 106.499348] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.499348] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 106.499348] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 106.499348] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 106.499348] [<c0205d87>] do_nmi+0xb7/0x350
[ 106.499348] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 106.499348] [<c0259d32>] ? try_to_wake_up+0xa2/0x220
[ 106.499348] [<c0259ec0>] default_wake_function+0x10/0x20
[ 106.499348] [<c024ac50>] autoremove_wake_function+0x20/0x40
[ 106.499348] [<c0252418>] __wake_up_common+0x48/0x70
[ 106.499348] [<c02558b3>] __wake_up_sync_key+0x43/0x60
[ 106.499348] [<c04cf4f8>] sock_def_readable+0x38/0x60
[ 106.499348] [<c0560065>] unix_stream_sendmsg+0x215/0x3a0
[ 106.499348] [<c04cb848>] sock_aio_write+0xf8/0x110
[ 106.499348] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 106.499348] [<c02ef1e6>] vfs_write+0x126/0x140
[ 106.499348] [<c02ef3e2>] sys_write+0x42/0x70
[ 106.499348] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 106.499348] ---[ end trace 68da413eff30529f ]---
[ 106.551612] ------------[ cut here ]------------
[ 106.551612] WARNING: at kernel/watchdog.c:241
watchdog_overflow_callback+0x9c/0xc0()
[ 106.551612] Hardware name: ProLiant BL460c G1
[ 106.551612] Watchdog detected hard LOCKUP on cpu 4
[ 106.551612] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 106.551612] Pid: 5697, comm: hackbench Tainted: G W
3.2.0-05066-g31ae26a-dirty #774
[ 106.551612] Call Trace:
[ 106.551612] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.551612] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.551612] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.551612] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 106.551612] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 106.551612] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 106.551612] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 106.551612] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.551612] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 106.551612] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 106.551612] [<c025dee0>] ? find_busiest_group+0x150/0xae0
[ 106.551612] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 106.551612] [<c0205d87>] do_nmi+0xb7/0x350
[ 106.551612] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 106.551612] [<c0606be4>] ? _raw_spin_lock+0x24/0x30
[ 106.551612] [<c025ebc8>] load_balance+0x358/0x500
[ 106.551612] [<c025f092>] idle_balance+0xc2/0x140
[ 106.551612] [<c06060ae>] __schedule+0x4be/0x650
[ 106.551612] [<c02e8485>] ? __slab_free+0x155/0x270
[ 106.551612] [<c06062f5>] schedule+0x35/0x50
[ 106.551612] [<c0604b0d>] schedule_timeout+0x1dd/0x250
[ 106.551612] [<c0560eb0>] ? unix_destruct_scm+0x80/0xa0
[ 106.551612] [<c02e8688>] ? kmem_cache_free+0xe8/0x100
[ 106.551612] [<c04d376d>] ? __kfree_skb+0x3d/0x90
[ 106.551612] [<c04d376d>] ? __kfree_skb+0x3d/0x90
[ 106.551612] [<c04d376d>] ? __kfree_skb+0x3d/0x90
[ 106.551612] [<c024ae88>] ? prepare_to_wait+0x48/0x70
[ 106.551612] [<c05612bd>] unix_stream_recvmsg+0x3ed/0x570
[ 106.551612] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 106.551612] [<c04cb967>] sock_aio_read+0x107/0x110
[ 106.551612] [<c02ee7ac>] do_sync_read+0xac/0xf0
[ 106.551612] [<c0230407>] ? irq_exit+0x67/0xa0
[ 106.551612] [<c0608349>] ? smp_apic_timer_interrupt+0x59/0x88
[ 106.551612] [<c025b829>] ? sched_clock_cpu+0x109/0x1a0
[ 106.551612] [<c02ef31f>] vfs_read+0x11f/0x130
[ 106.551612] [<c02ef372>] sys_read+0x42/0x70
[ 106.551612] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 106.551612] ---[ end trace 68da413eff3052a0 ]---
[ 106.642705] ------------[ cut here ]------------
[ 106.642705] WARNING: at kernel/watchdog.c:241
watchdog_overflow_callback+0x9c/0xc0()
[ 106.642705] Hardware name: ProLiant BL460c G1
[ 106.642705] Watchdog detected hard LOCKUP on cpu 1
[ 106.642705] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 106.642705] Pid: 5607, comm: hackbench Tainted: G W
3.2.0-05066-g31ae26a-dirty #774
[ 106.642705] Call Trace:
[ 106.642705] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.642705] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.642705] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.642705] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 106.642705] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 106.642705] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 106.642705] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 106.642705] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.642705] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 106.642705] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 106.642705] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 106.642705] [<c0205d87>] do_nmi+0xb7/0x350
[ 106.642705] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.642705] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 106.642705] [<c021007b>] ? x86_perf_event_set_period+0xcb/0x210
[ 106.642705] [<c0259d32>] ? try_to_wake_up+0xa2/0x220
[ 106.642705] [<c0259ec0>] default_wake_function+0x10/0x20
[ 106.642705] [<c024ac50>] autoremove_wake_function+0x20/0x40
[ 106.642705] [<c0252418>] __wake_up_common+0x48/0x70
[ 106.642705] [<c02558b3>] __wake_up_sync_key+0x43/0x60
[ 106.642705] [<c04cf4f8>] sock_def_readable+0x38/0x60
[ 106.642705] [<c0560065>] unix_stream_sendmsg+0x215/0x3a0
[ 106.642705] [<c04cb848>] sock_aio_write+0xf8/0x110
[ 106.642705] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 106.642705] [<c03ae78a>] ? rb_erase+0x16a/0x290
[ 106.642705] [<c0230407>] ? irq_exit+0x67/0xa0
[ 106.642705] [<c0608349>] ? smp_apic_timer_interrupt+0x59/0x88
[ 106.642705] [<c02ef1e6>] vfs_write+0x126/0x140
[ 106.642705] [<c02ef3e2>] sys_write+0x42/0x70
[ 106.642705] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 106.642705] ---[ end trace 68da413eff3052a1 ]---
[ 107.650001] ------------[ cut here ]------------
[ 107.650001] WARNING: at kernel/watchdog.c:241
watchdog_overflow_callback+0x9c/0xc0()
[ 107.650001] Hardware name: ProLiant BL460c G1
[ 107.650001] Watchdog detected hard LOCKUP on cpu 5
[ 107.650001] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 107.650001] Pid: 5844, comm: hackbench Tainted: G W
3.2.0-05066-g31ae26a-dirty #774
[ 107.650001] Call Trace:
[ 107.650001] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 107.650001] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 107.650001] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 107.650001] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 107.650001] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 107.650001] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 107.650001] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 107.650001] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 107.650001] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 107.650001] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 107.650001] [<c02a80f0>] ? perf_event_update_userpage+0x10/0x150
[ 107.650001] [<c02a80f0>] ? perf_event_update_userpage+0x10/0x150
[ 107.650001] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 107.650001] [<c0205d87>] do_nmi+0xb7/0x350
[ 107.650001] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 107.650001] [<c025de79>] ? find_busiest_group+0xe9/0xae0
[ 107.650001] [<c025e8df>] load_balance+0x6f/0x500
[ 107.650001] [<c025f092>] idle_balance+0xc2/0x140
[ 107.650001] [<c06060ae>] __schedule+0x4be/0x650
[ 107.650001] [<c030359d>] ? d_hash_and_lookup+0x5d/0x80
[ 107.650001] [<c02880f2>] ? call_rcu_sched+0x12/0x20
[ 107.650001] [<c02880f2>] ? call_rcu_sched+0x12/0x20
[ 107.650001] [<c022c4bd>] ? release_task+0x1dd/0x310
[ 107.650001] [<c06062f5>] schedule+0x35/0x50
[ 107.650001] [<c022d838>] do_exit+0x4f8/0x760
[ 107.650001] [<c02ef1bc>] ? vfs_write+0xfc/0x140
[ 107.650001] [<c022dc88>] sys_exit+0x18/0x20
[ 107.650001] [<c0606f9d>] syscall_call+0x7/0xb
[ 107.650001] ---[ end trace 68da413eff3052a2 ]---
[ 106.620008] ------------[ cut here ]------------
[ 106.620008] WARNING: at kernel/watchdog.c:241
watchdog_overflow_callback+0x9c/0xc0()
[ 106.620008] Hardware name: ProLiant BL460c G1
[ 106.620008] Watchdog detected hard LOCKUP on cpu 2
[ 106.620008] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 106.620008] Pid: 5876, comm: hackbench Tainted: G W
3.2.0-05066-g31ae26a-dirty #774
[ 106.620008] Call Trace:
[ 106.620008] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.620008] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.620008] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.620008] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 106.620008] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 106.620008] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 106.620008] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 106.620008] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.620008] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 106.620008] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 106.620008] [<c0605de7>] ? __schedule+0x1f7/0x650
[ 106.620008] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 106.620008] [<c0205d87>] do_nmi+0xb7/0x350
[ 106.620008] [<c0560e30>] ? unix_seqpacket_recvmsg+0x50/0x50
[ 106.620008] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 106.620008] [<c0606c14>] ? _raw_spin_lock_irqsave+0x24/0x30
[ 106.620008] [<c024ae62>] prepare_to_wait+0x22/0x70
[ 106.620008] [<c04cfb25>] sock_alloc_send_pskb+0x105/0x290
[ 106.620008] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 106.620008] [<c04cfccd>] sock_alloc_send_skb+0x1d/0x30
[ 106.620008] [<c05600bd>] unix_stream_sendmsg+0x26d/0x3a0
[ 106.620008] [<c04cb848>] sock_aio_write+0xf8/0x110
[ 106.620008] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 106.620008] [<c02ef1e6>] vfs_write+0x126/0x140
[ 106.620008] [<c02ef3e2>] sys_write+0x42/0x70
[ 106.620008] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 106.620008] ---[ end trace 68da413eff3052a3 ]---
[ 106.630004] ------------[ cut here ]------------
[ 106.630004] WARNING: at kernel/watchdog.c:241
watchdog_overflow_callback+0x9c/0xc0()
[ 106.630004] Hardware name: ProLiant BL460c G1
[ 106.630004] Watchdog detected hard LOCKUP on cpu 7
[ 106.630004] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 106.630004] Pid: 5580, comm: hackbench Tainted: G W
3.2.0-05066-g31ae26a-dirty #774
[ 106.630004] Call Trace:
[ 106.630004] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.630004] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.630004] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.630004] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 106.630004] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 106.630004] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 106.630004] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 106.630004] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.630004] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 106.630004] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 106.630004] [<c025b829>] ? sched_clock_cpu+0x109/0x1a0
[ 106.630004] [<c025b829>] ? sched_clock_cpu+0x109/0x1a0
[ 106.630004] [<c02a80f0>] ? perf_event_update_userpage+0x10/0x150
[ 106.630004] [<c02a80f0>] ? perf_event_update_userpage+0x10/0x150
[ 106.630004] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 106.630004] [<c0205d87>] do_nmi+0xb7/0x350
[ 106.630004] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.630004] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 106.630004] [<c025ddc8>] ? find_busiest_group+0x38/0xae0
[ 106.630004] [<c025e8df>] load_balance+0x6f/0x500
[ 106.630004] [<c025f092>] idle_balance+0xc2/0x140
[ 106.630004] [<c06060ae>] __schedule+0x4be/0x650
[ 106.630004] [<c02b4f8f>] ? __free_pages+0x1f/0x40
[ 106.630004] [<c02e65d7>] ? __free_slab+0xa7/0x130
[ 106.630004] [<c02e8485>] ? __slab_free+0x155/0x270
[ 106.630004] [<c02eb1d6>] ? __kmalloc_node_track_caller+0xf6/0x1b0
[ 106.630004] [<c06062f5>] schedule+0x35/0x50
[ 106.630004] [<c0604b0d>] schedule_timeout+0x1dd/0x250
[ 106.630004] [<c0560eb0>] ? unix_destruct_scm+0x80/0xa0
[ 106.630004] [<c02e8688>] ? kmem_cache_free+0xe8/0x100
[ 106.630004] [<c04d376d>] ? __kfree_skb+0x3d/0x90
[ 106.630004] [<c04d376d>] ? __kfree_skb+0x3d/0x90
[ 106.630004] [<c04d376d>] ? __kfree_skb+0x3d/0x90
[ 106.630004] [<c024ae88>] ? prepare_to_wait+0x48/0x70
[ 106.630004] [<c05612bd>] unix_stream_recvmsg+0x3ed/0x570
[ 106.630004] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 106.630004] [<c04cb967>] sock_aio_read+0x107/0x110
[ 106.630004] [<c02ee7ac>] do_sync_read+0xac/0xf0
[ 106.630004] [<c025b5b2>] ? sched_clock_local+0xe2/0x1e0
[ 106.630004] [<c025b829>] ? sched_clock_cpu+0x109/0x1a0
[ 106.630004] [<c02ef31f>] vfs_read+0x11f/0x130
[ 106.630004] [<c02ef372>] sys_read+0x42/0x70
[ 106.630004] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 106.630004] ---[ end trace 68da413eff3052a4 ]---
[ 106.755402] ------------[ cut here ]------------
[ 106.755402] WARNING: at kernel/watchdog.c:241
watchdog_overflow_callback+0x9c/0xc0()
[ 106.755402] Hardware name: ProLiant BL460c G1
[ 106.755402] Watchdog detected hard LOCKUP on cpu 6
[ 106.755402] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 106.755402] Pid: 5863, comm: hackbench Tainted: G W
3.2.0-05066-g31ae26a-dirty #774
[ 106.755402] Call Trace:
[ 106.755402] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.755402] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.755402] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.755402] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 106.755402] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 106.755402] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 106.755402] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 106.755402] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.755402] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 106.755402] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 106.755402] [<c025b5b2>] ? sched_clock_local+0xe2/0x1e0
[ 106.755402] [<c025b784>] ? sched_clock_cpu+0x64/0x1a0
[ 106.755402] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 106.755402] [<c0205d87>] do_nmi+0xb7/0x350
[ 106.755402] [<c025ceb3>] ? check_preempt_wakeup+0xb3/0x180
[ 106.755402] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 106.755402] [<c0259d30>] ? try_to_wake_up+0xa0/0x220
[ 106.755402] [<c0259ec0>] default_wake_function+0x10/0x20
[ 106.755402] [<c024ac50>] autoremove_wake_function+0x20/0x40
[ 106.755402] [<c0252418>] __wake_up_common+0x48/0x70
[ 106.755402] [<c02558b3>] __wake_up_sync_key+0x43/0x60
[ 106.755402] [<c0560399>] unix_write_space+0x49/0x80
[ 106.755402] [<c04cff58>] sock_wfree+0x48/0x50
[ 106.755402] [<c0560eb0>] unix_destruct_scm+0x80/0xa0
[ 106.755402] [<c04d396d>] skb_release_head_state+0x4d/0xe0
[ 106.755402] [<c04d3740>] __kfree_skb+0x10/0x90
[ 106.755402] [<c04d37e7>] consume_skb+0x27/0x70
[ 106.755402] [<c05610b6>] unix_stream_recvmsg+0x1e6/0x570
[ 106.755402] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 106.755402] [<c04cb967>] sock_aio_read+0x107/0x110
[ 106.755402] [<c02ee7ac>] do_sync_read+0xac/0xf0
[ 106.755402] [<c02ef31f>] vfs_read+0x11f/0x130
[ 106.755402] [<c02ef372>] sys_read+0x42/0x70
[ 106.755402] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 106.755402] ---[ end trace 68da413eff3052a5 ]---
[ 106.610006] ------------[ cut here ]------------
[ 106.610006] WARNING: at kernel/watchdog.c:241
watchdog_overflow_callback+0x9c/0xc0()
[ 106.610006] Hardware name: ProLiant BL460c G1
[ 106.610006] Watchdog detected hard LOCKUP on cpu 3
[ 106.610006] Modules linked in: netconsole xt_hashlimit af_packet tg3
bonding
[ 106.610006] Pid: 5887, comm: hackbench Tainted: G W
3.2.0-05066-g31ae26a-dirty #774
[ 106.610006] Call Trace:
[ 106.610006] [<c022a212>] warn_slowpath_common+0x72/0xa0
[ 106.610006] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.610006] [<c0281c4c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 106.610006] [<c0281bb0>] ? watchdog_timer_fn+0x170/0x170
[ 106.610006] [<c022a2e3>] warn_slowpath_fmt+0x33/0x40
[ 106.610006] [<c0281c4c>] watchdog_overflow_callback+0x9c/0xc0
[ 106.610006] [<c02a9f9a>] __perf_event_overflow+0x9a/0x240
[ 106.610006] [<c02100c8>] ? x86_perf_event_set_period+0x118/0x210
[ 106.610006] [<c02aa7f5>] perf_event_overflow+0x15/0x20
[ 106.610006] [<c0213639>] intel_pmu_handle_irq+0x129/0x250
[ 106.610006] [<c03a90c8>] ? cpumask_next_and+0x28/0x40
[ 106.610006] [<c020ed80>] perf_event_nmi_handler+0x20/0x30
[ 106.610006] [<c0205d87>] do_nmi+0xb7/0x350
[ 106.610006] [<c0607a99>] nmi_stack_correct+0x28/0x2d
[ 106.610006] [<c025ea97>] ? load_balance+0x227/0x500
[ 106.610006] [<c025f092>] idle_balance+0xc2/0x140
[ 106.610006] [<c06060ae>] __schedule+0x4be/0x650
[ 106.610006] [<c025951e>] ? scheduler_ipi+0x7e/0xc0
[ 106.610006] [<c06070de>] ? reschedule_interrupt+0x2a/0x30
[ 106.610006] [<c03b48ba>] ? __copy_from_user_ll_nozero+0x4a/0x80
[ 106.610006] [<c06062f5>] schedule+0x35/0x50
[ 106.610006] [<c0604b0d>] schedule_timeout+0x1dd/0x250
[ 106.610006] [<c024ae88>] ? prepare_to_wait+0x48/0x70
[ 106.610006] [<c04cfb4c>] sock_alloc_send_pskb+0x12c/0x290
[ 106.610006] [<c024ac30>] ? wake_up_bit+0x30/0x30
[ 106.610006] [<c04cfccd>] sock_alloc_send_skb+0x1d/0x30
[ 106.610006] [<c05600bd>] unix_stream_sendmsg+0x26d/0x3a0
[ 106.610006] [<c04cb848>] sock_aio_write+0xf8/0x110
[ 106.610006] [<c02ee6bc>] do_sync_write+0xac/0xf0
[ 106.610006] [<c03ae5dc>] ? rb_insert_color+0xcc/0x110
[ 106.610006] [<c02ef1e6>] vfs_write+0x126/0x140
[ 106.610006] [<c02ef3e2>] sys_write+0x42/0x70
[ 106.610006] [<c0607c4c>] sysenter_do_call+0x12/0x22
[ 106.610006] ---[ end trace 68da413eff3052a6 ]---
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 16:28 ` Linus Torvalds
@ 2012-01-10 16:37 ` Eric Dumazet
2012-01-10 16:49 ` Linus Torvalds
0 siblings, 1 reply; 28+ messages in thread
From: Eric Dumazet @ 2012-01-10 16:37 UTC (permalink / raw)
To: Linus Torvalds
Cc: Ingo Molnar, Thomas Gleixner, Peter Zijlstra, Martin Schwidefsky,
linux-kernel
Le mardi 10 janvier 2012 à 08:28 -0800, Linus Torvalds a écrit :
> On Tue, Jan 10, 2012 at 8:13 AM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
> >
> > Here are two traces of the lockups, since I had some free time to reproduce the
> > bug on current tree (plus a minor change in bnx2 driver to avoid a
> > netconsole related stack trace)
>
> Hmm. You have load_balance() and idle_balance() there in the trace, so
> I'm getting more hopeful that it really is just the fact that
> set_cpu_sd_state_idle() really needs to just be run with interrupts
> disabled. That was my main concern about that merge, so if it's that,
> I'll be relieved.
>
> If you can please try that change out, that would be great.
>
> [ And if that's not it - Ingo & co, please check out the traces on lkml ]
>
Just to make sure I understood well, here is what I tested :
diff --git a/kernel/time/tick-sched.c b/kernel/time/tick-sched.c
index 7656642..acd88a1 100644
--- a/kernel/time/tick-sched.c
+++ b/kernel/time/tick-sched.c
@@ -466,6 +466,8 @@ void tick_nohz_idle_enter(void)
WARN_ON_ONCE(irqs_disabled());
+ local_irq_disable();
+
/*
* Update the idle state in the scheduler domain hierarchy
* when tick_nohz_stop_sched_tick() is called from the idle loop.
@@ -474,8 +476,6 @@ void tick_nohz_idle_enter(void)
*/
set_cpu_sd_state_idle();
- local_irq_disable();
-
ts = &__get_cpu_var(tick_cpu_sched);
/*
* set ts->inidle unconditionally. even if the system did not
^ permalink raw reply related [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 16:37 ` Eric Dumazet
@ 2012-01-10 16:49 ` Linus Torvalds
2012-01-10 16:53 ` Eric Dumazet
0 siblings, 1 reply; 28+ messages in thread
From: Linus Torvalds @ 2012-01-10 16:49 UTC (permalink / raw)
To: Eric Dumazet
Cc: Ingo Molnar, Thomas Gleixner, Peter Zijlstra, Martin Schwidefsky,
linux-kernel
[-- Attachment #1: Type: text/plain, Size: 934 bytes --]
On Tue, Jan 10, 2012 at 8:37 AM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
>
> Just to make sure I understood well, here is what I tested :
Yup, that was it.
That was the obvious thing about the merge to check.
I suspect that what remains is now the sparse cleanups and
usecs_to_cputime64() interaction. I note that you are running on a
32-bit setup, which is where such problems would show up (because any
new casts to "unsigned long" due to the forced sparse casting would
now actually truncate a 64-bit value down.
Just to test that theory, can you try this attached patch that simply
removes the casts? That's what we used to have before adding the
stricter type-checking (other things changed too, so this may not make
any difference, but this is a "test a small change to *maybe* narrow
things down")
Martin - mind re-running sparse on the 32-bit case to see if that
shows some messed-up case?
Linus
[-- Attachment #2: patch.diff --]
[-- Type: text/x-patch, Size: 991 bytes --]
include/asm-generic/cputime.h | 8 ++++----
1 files changed, 4 insertions(+), 4 deletions(-)
diff --git a/include/asm-generic/cputime.h b/include/asm-generic/cputime.h
index 9a62937c56ca..aa8bb708085b 100644
--- a/include/asm-generic/cputime.h
+++ b/include/asm-generic/cputime.h
@@ -7,14 +7,14 @@
typedef unsigned long __nocast cputime_t;
#define cputime_one_jiffy jiffies_to_cputime(1)
-#define cputime_to_jiffies(__ct) (__force unsigned long)(__ct)
+#define cputime_to_jiffies(__ct) (__ct)
#define cputime_to_scaled(__ct) (__ct)
-#define jiffies_to_cputime(__hz) (__force cputime_t)(__hz)
+#define jiffies_to_cputime(__hz) (__hz)
typedef u64 __nocast cputime64_t;
-#define cputime64_to_jiffies64(__ct) (__force u64)(__ct)
-#define jiffies64_to_cputime64(__jif) (__force cputime64_t)(__jif)
+#define cputime64_to_jiffies64(__ct) (__ct)
+#define jiffies64_to_cputime64(__jif) (__jif)
#define nsecs_to_cputime64(__ct) \
jiffies64_to_cputime64(nsecs_to_jiffies64(__ct))
^ permalink raw reply related [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 16:49 ` Linus Torvalds
@ 2012-01-10 16:53 ` Eric Dumazet
2012-01-10 17:00 ` Linus Torvalds
0 siblings, 1 reply; 28+ messages in thread
From: Eric Dumazet @ 2012-01-10 16:53 UTC (permalink / raw)
To: Linus Torvalds
Cc: Ingo Molnar, Thomas Gleixner, Peter Zijlstra, Martin Schwidefsky,
linux-kernel
Le mardi 10 janvier 2012 à 08:49 -0800, Linus Torvalds a écrit :
> On Tue, Jan 10, 2012 at 8:37 AM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
> >
> > Just to make sure I understood well, here is what I tested :
>
> Yup, that was it.
>
> That was the obvious thing about the merge to check.
>
> I suspect that what remains is now the sparse cleanups and
> usecs_to_cputime64() interaction. I note that you are running on a
> 32-bit setup, which is where such problems would show up (because any
> new casts to "unsigned long" due to the forced sparse casting would
> now actually truncate a 64-bit value down.
>
> Just to test that theory, can you try this attached patch that simply
> removes the casts? That's what we used to have before adding the
> stricter type-checking (other things changed too, so this may not make
> any difference, but this is a "test a small change to *maybe* narrow
> things down")
>
> Martin - mind re-running sparse on the 32-bit case to see if that
> shows some messed-up case?
>
> Linus
I am compiling your patch, but I want to point out that I got also
lockups on my 64bit dev machine.
(But alas, my git bisect attempt on it stopped on un bootable kernels)
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 16:53 ` Eric Dumazet
@ 2012-01-10 17:00 ` Linus Torvalds
2012-01-10 19:32 ` Ingo Molnar
2012-01-10 22:23 ` Eric Dumazet
0 siblings, 2 replies; 28+ messages in thread
From: Linus Torvalds @ 2012-01-10 17:00 UTC (permalink / raw)
To: Eric Dumazet
Cc: Ingo Molnar, Thomas Gleixner, Peter Zijlstra, Martin Schwidefsky,
linux-kernel
On Tue, Jan 10, 2012 at 8:53 AM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
>
> I am compiling your patch, but I want to point out that I got also
> lockups on my 64bit dev machine.
Ok. On 64-bit, I think all the casts should be no-ops, so none of the
cputime changes should matter.
I'm out of ideas. Those were the only two areas that had any merge
issues at all that I can think of. How confident are you of the
bisect? Is the lockup so reliable that you know you got it every time
you tried, and there isn't a question of "maybe I didn't let the
test-case run quite long enough" occasionally? The one downside of
bisection is that if any of the good/bad choices aren't right, you'll
end up with not just the wrong bisect, you can end up somewhere
*totally* wrong.
So it might be worth checking both parents of that merge individually,
and making doubly sure that both of them are really really solid and
don't see the problem. Just to make sure.
Has anybody seen other reports like this?
Linus
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 17:00 ` Linus Torvalds
@ 2012-01-10 19:32 ` Ingo Molnar
2012-01-10 22:23 ` Eric Dumazet
1 sibling, 0 replies; 28+ messages in thread
From: Ingo Molnar @ 2012-01-10 19:32 UTC (permalink / raw)
To: Linus Torvalds
Cc: Eric Dumazet, Thomas Gleixner, Peter Zijlstra,
Martin Schwidefsky, linux-kernel
* Linus Torvalds <torvalds@linux-foundation.org> wrote:
> Has anybody seen other reports like this?
No.
And something generic as the scheduler time changes ought to
trigger widely - i've booted up thousands and thousands of
random kernels with your merge in place - which kind of coverage
tends to trigger generic lockups and races.
So i'd suspect either an environment dependent bug that random
testing on a low number of specific systems cannot cover:
- build environment dependent (compiler?) bug
- hw environment dependent bug
- or sw environment dependent bug
... or a mis-bisection.
Thanks,
Ingo
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 17:00 ` Linus Torvalds
2012-01-10 19:32 ` Ingo Molnar
@ 2012-01-10 22:23 ` Eric Dumazet
2012-01-10 23:44 ` Linus Torvalds
1 sibling, 1 reply; 28+ messages in thread
From: Eric Dumazet @ 2012-01-10 22:23 UTC (permalink / raw)
To: Linus Torvalds
Cc: Ingo Molnar, Thomas Gleixner, Peter Zijlstra, Martin Schwidefsky,
linux-kernel
Le mardi 10 janvier 2012 à 09:00 -0800, Linus Torvalds a écrit :
> On Tue, Jan 10, 2012 at 8:53 AM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
> >
> > I am compiling your patch, but I want to point out that I got also
> > lockups on my 64bit dev machine.
>
> Ok. On 64-bit, I think all the casts should be no-ops, so none of the
> cputime changes should matter.
>
> I'm out of ideas. Those were the only two areas that had any merge
> issues at all that I can think of. How confident are you of the
> bisect? Is the lockup so reliable that you know you got it every time
> you tried, and there isn't a question of "maybe I didn't let the
> test-case run quite long enough" occasionally? The one downside of
> bisection is that if any of the good/bad choices aren't right, you'll
> end up with not just the wrong bisect, you can end up somewhere
> *totally* wrong.
>
> So it might be worth checking both parents of that merge individually,
> and making doubly sure that both of them are really really solid and
> don't see the problem. Just to make sure.
>
> Has anybody seen other reports like this?
>
The 32bit kernel host is a dual quad core 2x4x1 : Intel(R) Xeon(R) CPU
E5450@3.00GHz
I have a lockup in less than 6 hackbench run so this is really
fast to reproduce, and I let the 'good run' running at least 5
minutes.
Only 'hardware known problem' on this platform is the one I reported ~one year ago.
[ 0.130000] Performance Events: PEBS fmt0+, Core2 events, Broken BIOS detected, complain to your hardware vendor.
(And the other machine, 64bit kernel has a simular issue : HP blades...)
[ 0.126963] Performance Events: PEBS fmt1+, Nehalem events, Broken BIOS detected, complain to your hardware vendor.
But last thousand++ builds I did on this machine were working fine,
perf tool working fine too. This is my main linux dev machine :(
Maybe a recent change in NMI handling, or perf events ?
No idea why the bisection (I redid it carefully : same result) points to the above commit.
Hmm...
The .config is :
#
# Automatically generated file; DO NOT EDIT.
# Linux/i386 3.2.0 Kernel Configuration
#
# CONFIG_64BIT is not set
CONFIG_X86_32=y
# CONFIG_X86_64 is not set
CONFIG_X86=y
CONFIG_INSTRUCTION_DECODER=y
CONFIG_OUTPUT_FORMAT="elf32-i386"
CONFIG_ARCH_DEFCONFIG="arch/x86/configs/i386_defconfig"
CONFIG_GENERIC_CMOS_UPDATE=y
CONFIG_CLOCKSOURCE_WATCHDOG=y
CONFIG_GENERIC_CLOCKEVENTS=y
CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_HAVE_LATENCYTOP_SUPPORT=y
CONFIG_MMU=y
CONFIG_ZONE_DMA=y
# CONFIG_NEED_DMA_MAP_STATE is not set
CONFIG_NEED_SG_DMA_LENGTH=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
# CONFIG_RWSEM_GENERIC_SPINLOCK is not set
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_ARCH_HAS_CPU_IDLE_WAIT=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
# CONFIG_GENERIC_TIME_VSYSCALL is not set
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_ARCH_HAS_DEFAULT_IDLE=y
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_ARCH_SUSPEND_POSSIBLE=y
# CONFIG_ZONE_DMA32 is not set
# CONFIG_AUDIT_ARCH is not set
CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_X86_32_SMP=y
CONFIG_X86_HT=y
CONFIG_X86_32_LAZY_GS=y
CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-ecx -fcall-saved-edx"
CONFIG_KTIME_SCALAR=y
CONFIG_ARCH_CPU_PROBE_RELEASE=y
CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
CONFIG_HAVE_IRQ_WORK=y
CONFIG_IRQ_WORK=y
#
# General setup
#
CONFIG_EXPERIMENTAL=y
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_CROSS_COMPILE=""
CONFIG_LOCALVERSION=""
CONFIG_LOCALVERSION_AUTO=y
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_HAVE_KERNEL_LZO=y
CONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_LZO is not set
CONFIG_DEFAULT_HOSTNAME="(none)"
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_SYSVIPC_SYSCTL=y
CONFIG_POSIX_MQUEUE=y
CONFIG_POSIX_MQUEUE_SYSCTL=y
CONFIG_BSD_PROCESS_ACCT=y
# CONFIG_BSD_PROCESS_ACCT_V3 is not set
CONFIG_FHANDLE=y
# CONFIG_TASKSTATS is not set
CONFIG_AUDIT=y
CONFIG_AUDITSYSCALL=y
CONFIG_AUDIT_WATCH=y
CONFIG_AUDIT_TREE=y
CONFIG_HAVE_GENERIC_HARDIRQS=y
#
# IRQ subsystem
#
CONFIG_GENERIC_HARDIRQS=y
CONFIG_HAVE_SPARSE_IRQ=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_GENERIC_IRQ_SHOW=y
CONFIG_GENERIC_PENDING_IRQ=y
CONFIG_IRQ_FORCED_THREADING=y
CONFIG_SPARSE_IRQ=y
#
# RCU Subsystem
#
CONFIG_TREE_RCU=y
# CONFIG_PREEMPT_RCU is not set
CONFIG_RCU_TRACE=y
CONFIG_RCU_FANOUT=32
# CONFIG_RCU_FANOUT_EXACT is not set
# CONFIG_RCU_FAST_NO_HZ is not set
CONFIG_TREE_RCU_TRACE=y
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_LOG_BUF_SHIFT=20
CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
# CONFIG_CGROUPS is not set
CONFIG_NAMESPACES=y
# CONFIG_UTS_NS is not set
# CONFIG_IPC_NS is not set
# CONFIG_USER_NS is not set
# CONFIG_PID_NS is not set
# CONFIG_NET_NS is not set
# CONFIG_SCHED_AUTOGROUP is not set
CONFIG_SYSFS_DEPRECATED=y
CONFIG_SYSFS_DEPRECATED_V2=y
CONFIG_RELAY=y
CONFIG_BLK_DEV_INITRD=y
CONFIG_INITRAMFS_SOURCE=""
CONFIG_RD_GZIP=y
# CONFIG_RD_BZIP2 is not set
# CONFIG_RD_LZMA is not set
# CONFIG_RD_XZ is not set
# CONFIG_RD_LZO is not set
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not set
CONFIG_SYSCTL=y
CONFIG_ANON_INODES=y
CONFIG_EXPERT=y
CONFIG_UID16=y
CONFIG_SYSCTL_SYSCALL=y
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
CONFIG_HOTPLUG=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_PCSPKR_PLATFORM=y
CONFIG_HAVE_PCSPKR_PLATFORM=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SIGNALFD=y
CONFIG_TIMERFD=y
CONFIG_EVENTFD=y
CONFIG_SHMEM=y
CONFIG_AIO=y
CONFIG_EMBEDDED=y
CONFIG_HAVE_PERF_EVENTS=y
#
# Kernel Performance Events And Counters
#
CONFIG_PERF_EVENTS=y
CONFIG_PERF_COUNTERS=y
# CONFIG_DEBUG_PERF_USE_VMALLOC is not set
CONFIG_VM_EVENT_COUNTERS=y
CONFIG_PCI_QUIRKS=y
CONFIG_SLUB_DEBUG=y
CONFIG_COMPAT_BRK=y
# CONFIG_SLAB is not set
CONFIG_SLUB=y
# CONFIG_SLOB is not set
# CONFIG_PROFILING is not set
CONFIG_TRACEPOINTS=y
CONFIG_HAVE_OPROFILE=y
CONFIG_OPROFILE_NMI_TIMER=y
# CONFIG_KPROBES is not set
CONFIG_JUMP_LABEL=y
CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_HAVE_KPROBES=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_DMA_ATTRS=y
CONFIG_USE_GENERIC_SMP_HELPERS=y
CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
CONFIG_HAVE_DMA_API_DEBUG=y
CONFIG_HAVE_HW_BREAKPOINT=y
CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
CONFIG_HAVE_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_PERF_EVENTS_NMI=y
CONFIG_HAVE_ARCH_JUMP_LABEL=y
CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
#
# GCOV-based kernel profiling
#
# CONFIG_GCOV_KERNEL is not set
CONFIG_HAVE_GENERIC_DMA_COHERENT=y
CONFIG_SLABINFO=y
CONFIG_RT_MUTEXES=y
CONFIG_BASE_SMALL=0
CONFIG_MODULES=y
# CONFIG_MODULE_FORCE_LOAD is not set
CONFIG_MODULE_UNLOAD=y
CONFIG_MODULE_FORCE_UNLOAD=y
CONFIG_MODVERSIONS=y
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_STOP_MACHINE=y
CONFIG_BLOCK=y
CONFIG_LBDAF=y
# CONFIG_BLK_DEV_BSG is not set
# CONFIG_BLK_DEV_BSGLIB is not set
# CONFIG_BLK_DEV_INTEGRITY is not set
#
# Partition Types
#
# CONFIG_PARTITION_ADVANCED is not set
CONFIG_MSDOS_PARTITION=y
#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_DEFAULT_DEADLINE is not set
CONFIG_DEFAULT_CFQ=y
# CONFIG_DEFAULT_NOOP is not set
CONFIG_DEFAULT_IOSCHED="cfq"
# CONFIG_INLINE_SPIN_TRYLOCK is not set
# CONFIG_INLINE_SPIN_TRYLOCK_BH is not set
# CONFIG_INLINE_SPIN_LOCK is not set
# CONFIG_INLINE_SPIN_LOCK_BH is not set
# CONFIG_INLINE_SPIN_LOCK_IRQ is not set
# CONFIG_INLINE_SPIN_LOCK_IRQSAVE is not set
CONFIG_INLINE_SPIN_UNLOCK=y
# CONFIG_INLINE_SPIN_UNLOCK_BH is not set
CONFIG_INLINE_SPIN_UNLOCK_IRQ=y
# CONFIG_INLINE_SPIN_UNLOCK_IRQRESTORE is not set
# CONFIG_INLINE_READ_TRYLOCK is not set
# CONFIG_INLINE_READ_LOCK is not set
# CONFIG_INLINE_READ_LOCK_BH is not set
# CONFIG_INLINE_READ_LOCK_IRQ is not set
# CONFIG_INLINE_READ_LOCK_IRQSAVE is not set
CONFIG_INLINE_READ_UNLOCK=y
# CONFIG_INLINE_READ_UNLOCK_BH is not set
CONFIG_INLINE_READ_UNLOCK_IRQ=y
# CONFIG_INLINE_READ_UNLOCK_IRQRESTORE is not set
# CONFIG_INLINE_WRITE_TRYLOCK is not set
# CONFIG_INLINE_WRITE_LOCK is not set
# CONFIG_INLINE_WRITE_LOCK_BH is not set
# CONFIG_INLINE_WRITE_LOCK_IRQ is not set
# CONFIG_INLINE_WRITE_LOCK_IRQSAVE is not set
CONFIG_INLINE_WRITE_UNLOCK=y
# CONFIG_INLINE_WRITE_UNLOCK_BH is not set
CONFIG_INLINE_WRITE_UNLOCK_IRQ=y
# CONFIG_INLINE_WRITE_UNLOCK_IRQRESTORE is not set
CONFIG_MUTEX_SPIN_ON_OWNER=y
# CONFIG_FREEZER is not set
#
# Processor type and features
#
CONFIG_TICK_ONESHOT=y
CONFIG_NO_HZ=y
CONFIG_HIGH_RES_TIMERS=y
CONFIG_GENERIC_CLOCKEVENTS_BUILD=y
CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
CONFIG_SMP=y
CONFIG_X86_MPPARSE=y
CONFIG_X86_BIGSMP=y
CONFIG_X86_EXTENDED_PLATFORM=y
# CONFIG_X86_WANT_INTEL_MID is not set
# CONFIG_X86_RDC321X is not set
# CONFIG_X86_32_NON_STANDARD is not set
# CONFIG_X86_32_IRIS is not set
CONFIG_SCHED_OMIT_FRAME_POINTER=y
# CONFIG_PARAVIRT_GUEST is not set
CONFIG_NO_BOOTMEM=y
# CONFIG_MEMTEST is not set
# CONFIG_M386 is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
# CONFIG_MPENTIUMIII is not set
# CONFIG_MPENTIUMM is not set
# CONFIG_MPENTIUM4 is not set
# CONFIG_MK6 is not set
# CONFIG_MK7 is not set
# CONFIG_MK8 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MEFFICEON is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MELAN is not set
# CONFIG_MGEODEGX1 is not set
# CONFIG_MGEODE_LX is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
# CONFIG_MVIAC7 is not set
CONFIG_MCORE2=y
# CONFIG_MATOM is not set
# CONFIG_X86_GENERIC is not set
CONFIG_X86_INTERNODE_CACHE_SHIFT=7
CONFIG_X86_CMPXCHG=y
CONFIG_CMPXCHG_LOCAL=y
CONFIG_CMPXCHG_DOUBLE=y
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_X86_XADD=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_X86_TSC=y
CONFIG_X86_CMPXCHG64=y
CONFIG_X86_CMOV=y
CONFIG_X86_MINIMUM_CPU_FAMILY=5
CONFIG_X86_DEBUGCTLMSR=y
CONFIG_PROCESSOR_SELECT=y
CONFIG_CPU_SUP_INTEL=y
# CONFIG_CPU_SUP_CYRIX_32 is not set
# CONFIG_CPU_SUP_AMD is not set
# CONFIG_CPU_SUP_CENTAUR is not set
# CONFIG_CPU_SUP_TRANSMETA_32 is not set
# CONFIG_CPU_SUP_UMC_32 is not set
CONFIG_HPET_TIMER=y
CONFIG_DMI=y
# CONFIG_IOMMU_HELPER is not set
CONFIG_NR_CPUS=32
CONFIG_SCHED_SMT=y
CONFIG_SCHED_MC=y
CONFIG_IRQ_TIME_ACCOUNTING=y
CONFIG_PREEMPT_NONE=y
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT is not set
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
# CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS is not set
CONFIG_X86_MCE=y
CONFIG_X86_MCE_INTEL=y
CONFIG_X86_MCE_AMD=y
# CONFIG_X86_ANCIENT_MCE is not set
CONFIG_X86_MCE_THRESHOLD=y
# CONFIG_X86_MCE_INJECT is not set
CONFIG_X86_THERMAL_VECTOR=y
CONFIG_VM86=y
# CONFIG_TOSHIBA is not set
# CONFIG_I8K is not set
# CONFIG_X86_REBOOTFIXUPS is not set
# CONFIG_MICROCODE is not set
# CONFIG_X86_MSR is not set
# CONFIG_X86_CPUID is not set
# CONFIG_NOHIGHMEM is not set
# CONFIG_HIGHMEM4G is not set
CONFIG_HIGHMEM64G=y
CONFIG_VMSPLIT_3G=y
# CONFIG_VMSPLIT_2G is not set
# CONFIG_VMSPLIT_1G is not set
CONFIG_PAGE_OFFSET=0xC0000000
CONFIG_HIGHMEM=y
CONFIG_X86_PAE=y
CONFIG_ARCH_PHYS_ADDR_T_64BIT=y
CONFIG_ARCH_DMA_ADDR_T_64BIT=y
CONFIG_NUMA=y
# CONFIG_NUMA_EMU is not set
CONFIG_NODES_SHIFT=3
CONFIG_HAVE_ARCH_BOOTMEM=y
CONFIG_HAVE_ARCH_ALLOC_REMAP=y
CONFIG_NEED_NODE_MEMMAP_SIZE=y
CONFIG_ARCH_DISCONTIGMEM_ENABLE=y
CONFIG_ARCH_DISCONTIGMEM_DEFAULT=y
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_ILLEGAL_POINTER_VALUE=0
CONFIG_SELECT_MEMORY_MODEL=y
# CONFIG_DISCONTIGMEM_MANUAL is not set
CONFIG_SPARSEMEM_MANUAL=y
CONFIG_SPARSEMEM=y
CONFIG_NEED_MULTIPLE_NODES=y
CONFIG_HAVE_MEMORY_PRESENT=y
CONFIG_SPARSEMEM_STATIC=y
CONFIG_HAVE_MEMBLOCK=y
CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
CONFIG_ARCH_DISCARD_MEMBLOCK=y
# CONFIG_MEMORY_HOTPLUG is not set
CONFIG_SPLIT_PTLOCK_CPUS=4
# CONFIG_COMPACTION is not set
CONFIG_MIGRATION=y
CONFIG_PHYS_ADDR_T_64BIT=y
CONFIG_ZONE_DMA_FLAG=1
CONFIG_BOUNCE=y
CONFIG_VIRT_TO_BUS=y
# CONFIG_KSM is not set
CONFIG_DEFAULT_MMAP_MIN_ADDR=4096
# CONFIG_TRANSPARENT_HUGEPAGE is not set
# CONFIG_CLEANCACHE is not set
# CONFIG_HIGHPTE is not set
# CONFIG_X86_CHECK_BIOS_CORRUPTION is not set
CONFIG_X86_RESERVE_LOW=64
# CONFIG_MATH_EMULATION is not set
CONFIG_MTRR=y
# CONFIG_MTRR_SANITIZER is not set
# CONFIG_X86_PAT is not set
CONFIG_ARCH_RANDOM=y
# CONFIG_EFI is not set
CONFIG_SECCOMP=y
# CONFIG_CC_STACKPROTECTOR is not set
CONFIG_HZ_100=y
# CONFIG_HZ_250 is not set
# CONFIG_HZ_300 is not set
# CONFIG_HZ_1000 is not set
CONFIG_HZ=100
CONFIG_SCHED_HRTICK=y
# CONFIG_KEXEC is not set
# CONFIG_CRASH_DUMP is not set
CONFIG_PHYSICAL_START=0x200000
# CONFIG_RELOCATABLE is not set
CONFIG_PHYSICAL_ALIGN=0x200000
CONFIG_HOTPLUG_CPU=y
CONFIG_COMPAT_VDSO=y
# CONFIG_CMDLINE_BOOL is not set
CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
CONFIG_USE_PERCPU_NUMA_NODE_ID=y
#
# Power management and ACPI options
#
# CONFIG_SUSPEND is not set
# CONFIG_HIBERNATION is not set
# CONFIG_PM_RUNTIME is not set
CONFIG_ACPI=y
# CONFIG_ACPI_PROCFS is not set
# CONFIG_ACPI_PROCFS_POWER is not set
# CONFIG_ACPI_EC_DEBUGFS is not set
CONFIG_ACPI_PROC_EVENT=y
CONFIG_ACPI_AC=y
CONFIG_ACPI_BATTERY=y
CONFIG_ACPI_BUTTON=y
CONFIG_ACPI_FAN=y
# CONFIG_ACPI_DOCK is not set
CONFIG_ACPI_PROCESSOR=y
# CONFIG_ACPI_IPMI is not set
CONFIG_ACPI_HOTPLUG_CPU=y
# CONFIG_ACPI_PROCESSOR_AGGREGATOR is not set
CONFIG_ACPI_THERMAL=y
CONFIG_ACPI_NUMA=y
# CONFIG_ACPI_CUSTOM_DSDT is not set
CONFIG_ACPI_BLACKLIST_YEAR=0
# CONFIG_ACPI_DEBUG is not set
# CONFIG_ACPI_PCI_SLOT is not set
CONFIG_X86_PM_TIMER=y
CONFIG_ACPI_CONTAINER=y
# CONFIG_ACPI_SBS is not set
# CONFIG_ACPI_HED is not set
# CONFIG_ACPI_CUSTOM_METHOD is not set
# CONFIG_ACPI_APEI is not set
# CONFIG_SFI is not set
#
# CPU Frequency scaling
#
CONFIG_CPU_FREQ=y
CONFIG_CPU_FREQ_TABLE=y
CONFIG_CPU_FREQ_STAT=y
# CONFIG_CPU_FREQ_STAT_DETAILS is not set
CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_POWERSAVE is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_ONDEMAND is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_CONSERVATIVE is not set
CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
CONFIG_CPU_FREQ_GOV_POWERSAVE=m
CONFIG_CPU_FREQ_GOV_USERSPACE=m
CONFIG_CPU_FREQ_GOV_ONDEMAND=y
# CONFIG_CPU_FREQ_GOV_CONSERVATIVE is not set
#
# x86 CPU frequency scaling drivers
#
# CONFIG_X86_PCC_CPUFREQ is not set
CONFIG_X86_ACPI_CPUFREQ=y
# CONFIG_X86_POWERNOW_K6 is not set
# CONFIG_X86_POWERNOW_K7 is not set
# CONFIG_X86_POWERNOW_K8 is not set
# CONFIG_X86_GX_SUSPMOD is not set
# CONFIG_X86_SPEEDSTEP_CENTRINO is not set
# CONFIG_X86_SPEEDSTEP_ICH is not set
# CONFIG_X86_SPEEDSTEP_SMI is not set
# CONFIG_X86_P4_CLOCKMOD is not set
# CONFIG_X86_CPUFREQ_NFORCE2 is not set
# CONFIG_X86_LONGRUN is not set
# CONFIG_X86_LONGHAUL is not set
# CONFIG_X86_E_POWERSAVER is not set
#
# shared options
#
# CONFIG_X86_SPEEDSTEP_LIB is not set
CONFIG_CPU_IDLE=y
CONFIG_CPU_IDLE_GOV_LADDER=y
CONFIG_CPU_IDLE_GOV_MENU=y
# CONFIG_INTEL_IDLE is not set
#
# Bus options (PCI etc.)
#
CONFIG_PCI=y
# CONFIG_PCI_GOBIOS is not set
# CONFIG_PCI_GOMMCONFIG is not set
# CONFIG_PCI_GODIRECT is not set
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_PCI_DOMAINS=y
# CONFIG_PCI_CNB20LE_QUIRK is not set
CONFIG_PCIEPORTBUS=y
CONFIG_PCIEAER=y
# CONFIG_PCIE_ECRC is not set
# CONFIG_PCIEAER_INJECT is not set
# CONFIG_PCIEASPM is not set
CONFIG_ARCH_SUPPORTS_MSI=y
CONFIG_PCI_MSI=y
# CONFIG_PCI_DEBUG is not set
# CONFIG_PCI_STUB is not set
CONFIG_HT_IRQ=y
# CONFIG_PCI_IOV is not set
# CONFIG_PCI_PRI is not set
# CONFIG_PCI_PASID is not set
CONFIG_PCI_IOAPIC=y
CONFIG_PCI_LABEL=y
CONFIG_ISA_DMA_API=y
# CONFIG_ISA is not set
# CONFIG_MCA is not set
# CONFIG_SCx200 is not set
# CONFIG_ALIX is not set
# CONFIG_PCCARD is not set
# CONFIG_HOTPLUG_PCI is not set
# CONFIG_RAPIDIO is not set
#
# Executable file formats / Emulations
#
CONFIG_BINFMT_ELF=y
# CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS is not set
CONFIG_HAVE_AOUT=y
# CONFIG_BINFMT_AOUT is not set
CONFIG_BINFMT_MISC=y
CONFIG_HAVE_ATOMIC_IOMAP=y
CONFIG_HAVE_TEXT_POKE_SMP=y
CONFIG_NET=y
#
# Networking options
#
CONFIG_PACKET=m
CONFIG_UNIX=y
# CONFIG_UNIX_DIAG is not set
CONFIG_XFRM=y
# CONFIG_XFRM_USER is not set
# CONFIG_XFRM_SUB_POLICY is not set
# CONFIG_XFRM_MIGRATE is not set
# CONFIG_XFRM_STATISTICS is not set
CONFIG_XFRM_IPCOMP=y
# CONFIG_NET_KEY is not set
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_ADVANCED_ROUTER=y
# CONFIG_IP_FIB_TRIE_STATS is not set
CONFIG_IP_MULTIPLE_TABLES=y
# CONFIG_IP_ROUTE_MULTIPATH is not set
CONFIG_IP_ROUTE_VERBOSE=y
CONFIG_IP_ROUTE_CLASSID=y
# CONFIG_IP_PNP is not set
CONFIG_NET_IPIP=m
CONFIG_NET_IPGRE_DEMUX=m
CONFIG_NET_IPGRE=m
# CONFIG_NET_IPGRE_BROADCAST is not set
CONFIG_IP_MROUTE=y
# CONFIG_IP_MROUTE_MULTIPLE_TABLES is not set
CONFIG_IP_PIMSM_V1=y
CONFIG_IP_PIMSM_V2=y
# CONFIG_ARPD is not set
CONFIG_SYN_COOKIES=y
CONFIG_INET_AH=y
CONFIG_INET_ESP=y
CONFIG_INET_IPCOMP=y
CONFIG_INET_XFRM_TUNNEL=y
CONFIG_INET_TUNNEL=y
CONFIG_INET_XFRM_MODE_TRANSPORT=y
CONFIG_INET_XFRM_MODE_TUNNEL=y
CONFIG_INET_XFRM_MODE_BEET=y
# CONFIG_INET_LRO is not set
CONFIG_INET_DIAG=y
CONFIG_INET_TCP_DIAG=y
# CONFIG_INET_UDP_DIAG is not set
CONFIG_TCP_CONG_ADVANCED=y
CONFIG_TCP_CONG_BIC=y
CONFIG_TCP_CONG_CUBIC=m
CONFIG_TCP_CONG_WESTWOOD=m
CONFIG_TCP_CONG_HTCP=m
# CONFIG_TCP_CONG_HSTCP is not set
# CONFIG_TCP_CONG_HYBLA is not set
# CONFIG_TCP_CONG_VEGAS is not set
# CONFIG_TCP_CONG_SCALABLE is not set
# CONFIG_TCP_CONG_LP is not set
# CONFIG_TCP_CONG_VENO is not set
# CONFIG_TCP_CONG_YEAH is not set
# CONFIG_TCP_CONG_ILLINOIS is not set
CONFIG_DEFAULT_BIC=y
# CONFIG_DEFAULT_RENO is not set
CONFIG_DEFAULT_TCP_CONG="bic"
# CONFIG_TCP_MD5SIG is not set
CONFIG_IPV6=y
CONFIG_IPV6_PRIVACY=y
CONFIG_IPV6_ROUTER_PREF=y
CONFIG_IPV6_ROUTE_INFO=y
CONFIG_IPV6_OPTIMISTIC_DAD=y
CONFIG_INET6_AH=m
CONFIG_INET6_ESP=m
CONFIG_INET6_IPCOMP=m
CONFIG_IPV6_MIP6=m
CONFIG_INET6_XFRM_TUNNEL=m
CONFIG_INET6_TUNNEL=m
CONFIG_INET6_XFRM_MODE_TRANSPORT=m
CONFIG_INET6_XFRM_MODE_TUNNEL=m
CONFIG_INET6_XFRM_MODE_BEET=m
CONFIG_INET6_XFRM_MODE_ROUTEOPTIMIZATION=m
CONFIG_IPV6_SIT=m
CONFIG_IPV6_SIT_6RD=y
CONFIG_IPV6_NDISC_NODETYPE=y
CONFIG_IPV6_TUNNEL=m
CONFIG_IPV6_MULTIPLE_TABLES=y
CONFIG_IPV6_SUBTREES=y
CONFIG_IPV6_MROUTE=y
CONFIG_IPV6_MROUTE_MULTIPLE_TABLES=y
CONFIG_IPV6_PIMSM_V2=y
# CONFIG_NETWORK_SECMARK is not set
# CONFIG_NETWORK_PHY_TIMESTAMPING is not set
CONFIG_NETFILTER=y
CONFIG_NETFILTER_DEBUG=y
CONFIG_NETFILTER_ADVANCED=y
CONFIG_BRIDGE_NETFILTER=y
#
# Core Netfilter Configuration
#
CONFIG_NETFILTER_NETLINK=y
# CONFIG_NETFILTER_NETLINK_ACCT is not set
CONFIG_NETFILTER_NETLINK_QUEUE=m
CONFIG_NETFILTER_NETLINK_LOG=y
CONFIG_NF_CONNTRACK=m
CONFIG_NF_CONNTRACK_MARK=y
CONFIG_NF_CONNTRACK_PROCFS=y
CONFIG_NF_CONNTRACK_EVENTS=y
# CONFIG_NF_CONNTRACK_TIMESTAMP is not set
# CONFIG_NF_CT_PROTO_DCCP is not set
# CONFIG_NF_CT_PROTO_SCTP is not set
# CONFIG_NF_CT_PROTO_UDPLITE is not set
# CONFIG_NF_CONNTRACK_AMANDA is not set
# CONFIG_NF_CONNTRACK_FTP is not set
# CONFIG_NF_CONNTRACK_H323 is not set
# CONFIG_NF_CONNTRACK_IRC is not set
# CONFIG_NF_CONNTRACK_NETBIOS_NS is not set
# CONFIG_NF_CONNTRACK_SNMP is not set
# CONFIG_NF_CONNTRACK_PPTP is not set
# CONFIG_NF_CONNTRACK_SANE is not set
CONFIG_NF_CONNTRACK_SIP=m
# CONFIG_NF_CONNTRACK_TFTP is not set
CONFIG_NF_CT_NETLINK=m
# CONFIG_NETFILTER_TPROXY is not set
CONFIG_NETFILTER_XTABLES=y
#
# Xtables combined modules
#
# CONFIG_NETFILTER_XT_MARK is not set
# CONFIG_NETFILTER_XT_CONNMARK is not set
#
# Xtables targets
#
# CONFIG_NETFILTER_XT_TARGET_AUDIT is not set
# CONFIG_NETFILTER_XT_TARGET_CHECKSUM is not set
# CONFIG_NETFILTER_XT_TARGET_CLASSIFY is not set
# CONFIG_NETFILTER_XT_TARGET_CONNMARK is not set
# CONFIG_NETFILTER_XT_TARGET_CT is not set
# CONFIG_NETFILTER_XT_TARGET_DSCP is not set
# CONFIG_NETFILTER_XT_TARGET_HL is not set
# CONFIG_NETFILTER_XT_TARGET_IDLETIMER is not set
# CONFIG_NETFILTER_XT_TARGET_MARK is not set
# CONFIG_NETFILTER_XT_TARGET_NFLOG is not set
# CONFIG_NETFILTER_XT_TARGET_NFQUEUE is not set
CONFIG_NETFILTER_XT_TARGET_NOTRACK=m
CONFIG_NETFILTER_XT_TARGET_RATEEST=m
CONFIG_NETFILTER_XT_TARGET_TEE=m
# CONFIG_NETFILTER_XT_TARGET_TRACE is not set
# CONFIG_NETFILTER_XT_TARGET_TCPMSS is not set
# CONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP is not set
#
# Xtables matches
#
# CONFIG_NETFILTER_XT_MATCH_ADDRTYPE is not set
# CONFIG_NETFILTER_XT_MATCH_CLUSTER is not set
# CONFIG_NETFILTER_XT_MATCH_COMMENT is not set
CONFIG_NETFILTER_XT_MATCH_CONNBYTES=m
CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=m
# CONFIG_NETFILTER_XT_MATCH_CONNMARK is not set
CONFIG_NETFILTER_XT_MATCH_CONNTRACK=m
CONFIG_NETFILTER_XT_MATCH_CPU=m
# CONFIG_NETFILTER_XT_MATCH_DCCP is not set
# CONFIG_NETFILTER_XT_MATCH_DEVGROUP is not set
# CONFIG_NETFILTER_XT_MATCH_DSCP is not set
# CONFIG_NETFILTER_XT_MATCH_ECN is not set
# CONFIG_NETFILTER_XT_MATCH_ESP is not set
CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=m
# CONFIG_NETFILTER_XT_MATCH_HELPER is not set
# CONFIG_NETFILTER_XT_MATCH_HL is not set
# CONFIG_NETFILTER_XT_MATCH_IPRANGE is not set
CONFIG_NETFILTER_XT_MATCH_IPVS=m
CONFIG_NETFILTER_XT_MATCH_LENGTH=y
# CONFIG_NETFILTER_XT_MATCH_LIMIT is not set
# CONFIG_NETFILTER_XT_MATCH_MAC is not set
# CONFIG_NETFILTER_XT_MATCH_MARK is not set
# CONFIG_NETFILTER_XT_MATCH_MULTIPORT is not set
# CONFIG_NETFILTER_XT_MATCH_NFACCT is not set
# CONFIG_NETFILTER_XT_MATCH_OSF is not set
# CONFIG_NETFILTER_XT_MATCH_OWNER is not set
# CONFIG_NETFILTER_XT_MATCH_POLICY is not set
# CONFIG_NETFILTER_XT_MATCH_PHYSDEV is not set
# CONFIG_NETFILTER_XT_MATCH_PKTTYPE is not set
# CONFIG_NETFILTER_XT_MATCH_QUOTA is not set
# CONFIG_NETFILTER_XT_MATCH_RATEEST is not set
# CONFIG_NETFILTER_XT_MATCH_REALM is not set
CONFIG_NETFILTER_XT_MATCH_RECENT=m
# CONFIG_NETFILTER_XT_MATCH_SCTP is not set
CONFIG_NETFILTER_XT_MATCH_STATE=m
# CONFIG_NETFILTER_XT_MATCH_STATISTIC is not set
# CONFIG_NETFILTER_XT_MATCH_STRING is not set
# CONFIG_NETFILTER_XT_MATCH_TCPMSS is not set
# CONFIG_NETFILTER_XT_MATCH_TIME is not set
CONFIG_NETFILTER_XT_MATCH_U32=y
# CONFIG_IP_SET is not set
CONFIG_IP_VS=m
CONFIG_IP_VS_IPV6=y
CONFIG_IP_VS_DEBUG=y
CONFIG_IP_VS_TAB_BITS=12
#
# IPVS transport protocol load balancing support
#
# CONFIG_IP_VS_PROTO_TCP is not set
# CONFIG_IP_VS_PROTO_UDP is not set
# CONFIG_IP_VS_PROTO_AH_ESP is not set
# CONFIG_IP_VS_PROTO_ESP is not set
# CONFIG_IP_VS_PROTO_AH is not set
# CONFIG_IP_VS_PROTO_SCTP is not set
#
# IPVS scheduler
#
CONFIG_IP_VS_RR=m
CONFIG_IP_VS_WRR=m
CONFIG_IP_VS_LC=m
CONFIG_IP_VS_WLC=m
CONFIG_IP_VS_LBLC=m
CONFIG_IP_VS_LBLCR=m
CONFIG_IP_VS_DH=m
CONFIG_IP_VS_SH=m
CONFIG_IP_VS_SED=m
CONFIG_IP_VS_NQ=m
#
# IPVS SH scheduler
#
CONFIG_IP_VS_SH_TAB_BITS=8
#
# IPVS application helper
#
# CONFIG_IP_VS_NFCT is not set
#
# IP: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV4=m
CONFIG_NF_CONNTRACK_IPV4=m
CONFIG_NF_CONNTRACK_PROC_COMPAT=y
# CONFIG_IP_NF_QUEUE is not set
CONFIG_IP_NF_IPTABLES=y
# CONFIG_IP_NF_MATCH_AH is not set
# CONFIG_IP_NF_MATCH_ECN is not set
# CONFIG_IP_NF_MATCH_RPFILTER is not set
# CONFIG_IP_NF_MATCH_TTL is not set
CONFIG_IP_NF_FILTER=y
CONFIG_IP_NF_TARGET_REJECT=m
CONFIG_IP_NF_TARGET_LOG=m
CONFIG_IP_NF_TARGET_ULOG=m
CONFIG_NF_NAT=m
CONFIG_NF_NAT_NEEDED=y
CONFIG_IP_NF_TARGET_MASQUERADE=m
# CONFIG_IP_NF_TARGET_NETMAP is not set
CONFIG_IP_NF_TARGET_REDIRECT=m
# CONFIG_NF_NAT_FTP is not set
# CONFIG_NF_NAT_IRC is not set
# CONFIG_NF_NAT_TFTP is not set
# CONFIG_NF_NAT_AMANDA is not set
# CONFIG_NF_NAT_PPTP is not set
# CONFIG_NF_NAT_H323 is not set
CONFIG_NF_NAT_SIP=m
CONFIG_IP_NF_MANGLE=m
# CONFIG_IP_NF_TARGET_CLUSTERIP is not set
# CONFIG_IP_NF_TARGET_ECN is not set
# CONFIG_IP_NF_TARGET_TTL is not set
CONFIG_IP_NF_RAW=y
# CONFIG_IP_NF_ARPTABLES is not set
#
# IPv6: Netfilter Configuration
#
# CONFIG_NF_DEFRAG_IPV6 is not set
# CONFIG_NF_CONNTRACK_IPV6 is not set
# CONFIG_IP6_NF_QUEUE is not set
CONFIG_IP6_NF_IPTABLES=m
# CONFIG_IP6_NF_MATCH_AH is not set
# CONFIG_IP6_NF_MATCH_EUI64 is not set
# CONFIG_IP6_NF_MATCH_FRAG is not set
# CONFIG_IP6_NF_MATCH_OPTS is not set
# CONFIG_IP6_NF_MATCH_HL is not set
# CONFIG_IP6_NF_MATCH_IPV6HEADER is not set
# CONFIG_IP6_NF_MATCH_MH is not set
# CONFIG_IP6_NF_MATCH_RPFILTER is not set
# CONFIG_IP6_NF_MATCH_RT is not set
# CONFIG_IP6_NF_TARGET_HL is not set
# CONFIG_IP6_NF_TARGET_LOG is not set
CONFIG_IP6_NF_FILTER=m
# CONFIG_IP6_NF_TARGET_REJECT is not set
CONFIG_IP6_NF_MANGLE=m
CONFIG_IP6_NF_RAW=m
# CONFIG_BRIDGE_NF_EBTABLES is not set
# CONFIG_IP_DCCP is not set
# CONFIG_IP_SCTP is not set
# CONFIG_RDS is not set
# CONFIG_TIPC is not set
# CONFIG_ATM is not set
CONFIG_L2TP=m
# CONFIG_L2TP_DEBUGFS is not set
# CONFIG_L2TP_V3 is not set
CONFIG_STP=m
CONFIG_BRIDGE=m
# CONFIG_BRIDGE_IGMP_SNOOPING is not set
# CONFIG_NET_DSA is not set
CONFIG_VLAN_8021Q=y
# CONFIG_VLAN_8021Q_GVRP is not set
# CONFIG_DECNET is not set
CONFIG_LLC=m
# CONFIG_LLC2 is not set
CONFIG_IPX=m
CONFIG_IPX_INTERN=y
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_ECONET is not set
# CONFIG_WAN_ROUTER is not set
# CONFIG_PHONET is not set
# CONFIG_IEEE802154 is not set
CONFIG_NET_SCHED=y
#
# Queueing/Scheduling
#
CONFIG_NET_SCH_CBQ=y
CONFIG_NET_SCH_HTB=m
CONFIG_NET_SCH_HFSC=m
CONFIG_NET_SCH_PRIO=m
# CONFIG_NET_SCH_MULTIQ is not set
CONFIG_NET_SCH_RED=m
# CONFIG_NET_SCH_SFB is not set
CONFIG_NET_SCH_SFQ=m
CONFIG_NET_SCH_TEQL=m
CONFIG_NET_SCH_TBF=m
CONFIG_NET_SCH_GRED=m
CONFIG_NET_SCH_DSMARK=m
CONFIG_NET_SCH_NETEM=y
# CONFIG_NET_SCH_DRR is not set
# CONFIG_NET_SCH_MQPRIO is not set
# CONFIG_NET_SCH_CHOKE is not set
CONFIG_NET_SCH_QFQ=m
CONFIG_NET_SCH_INGRESS=m
#
# Classification
#
CONFIG_NET_CLS=y
# CONFIG_NET_CLS_BASIC is not set
CONFIG_NET_CLS_TCINDEX=m
CONFIG_NET_CLS_ROUTE4=m
CONFIG_NET_CLS_FW=m
CONFIG_NET_CLS_U32=y
CONFIG_CLS_U32_PERF=y
CONFIG_CLS_U32_MARK=y
CONFIG_NET_CLS_RSVP=m
CONFIG_NET_CLS_RSVP6=m
# CONFIG_NET_CLS_FLOW is not set
# CONFIG_NET_EMATCH is not set
CONFIG_NET_CLS_ACT=y
CONFIG_NET_ACT_POLICE=y
CONFIG_NET_ACT_GACT=y
# CONFIG_GACT_PROB is not set
CONFIG_NET_ACT_MIRRED=m
# CONFIG_NET_ACT_IPT is not set
# CONFIG_NET_ACT_NAT is not set
CONFIG_NET_ACT_PEDIT=m
# CONFIG_NET_ACT_SIMP is not set
CONFIG_NET_ACT_SKBEDIT=m
# CONFIG_NET_ACT_CSUM is not set
# CONFIG_NET_CLS_IND is not set
CONFIG_NET_SCH_FIFO=y
# CONFIG_DCB is not set
CONFIG_DNS_RESOLVER=y
# CONFIG_BATMAN_ADV is not set
# CONFIG_OPENVSWITCH is not set
CONFIG_RPS=y
CONFIG_RFS_ACCEL=y
CONFIG_XPS=y
CONFIG_BQL=y
#
# Network testing
#
CONFIG_NET_PKTGEN=m
# CONFIG_NET_DROP_MONITOR is not set
# CONFIG_HAMRADIO is not set
# CONFIG_CAN is not set
# CONFIG_IRDA is not set
# CONFIG_BT is not set
CONFIG_AF_RXRPC=m
# CONFIG_AF_RXRPC_DEBUG is not set
# CONFIG_RXKAD is not set
CONFIG_FIB_RULES=y
CONFIG_WIRELESS=y
CONFIG_WEXT_CORE=y
CONFIG_WEXT_PROC=y
CONFIG_CFG80211=y
# CONFIG_NL80211_TESTMODE is not set
# CONFIG_CFG80211_DEVELOPER_WARNINGS is not set
# CONFIG_CFG80211_REG_DEBUG is not set
CONFIG_CFG80211_DEFAULT_PS=y
# CONFIG_CFG80211_DEBUGFS is not set
# CONFIG_CFG80211_INTERNAL_REGDB is not set
CONFIG_CFG80211_WEXT=y
CONFIG_WIRELESS_EXT_SYSFS=y
# CONFIG_LIB80211 is not set
CONFIG_MAC80211=y
CONFIG_MAC80211_HAS_RC=y
# CONFIG_MAC80211_RC_PID is not set
CONFIG_MAC80211_RC_MINSTREL=y
CONFIG_MAC80211_RC_MINSTREL_HT=y
CONFIG_MAC80211_RC_DEFAULT_MINSTREL=y
CONFIG_MAC80211_RC_DEFAULT="minstrel_ht"
# CONFIG_MAC80211_MESH is not set
CONFIG_MAC80211_DEBUGFS=y
# CONFIG_MAC80211_DEBUG_MENU is not set
# CONFIG_WIMAX is not set
# CONFIG_RFKILL is not set
# CONFIG_NET_9P is not set
# CONFIG_CAIF is not set
# CONFIG_CEPH_LIB is not set
# CONFIG_NFC is not set
#
# Device Drivers
#
#
# Generic Driver Options
#
CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug"
# CONFIG_DEVTMPFS is not set
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=y
CONFIG_FIRMWARE_IN_KERNEL=y
CONFIG_EXTRA_FIRMWARE=""
# CONFIG_DEBUG_DRIVER is not set
# CONFIG_DEBUG_DEVRES is not set
# CONFIG_SYS_HYPERVISOR is not set
# CONFIG_DMA_SHARED_BUFFER is not set
# CONFIG_CONNECTOR is not set
# CONFIG_MTD is not set
# CONFIG_PARPORT is not set
CONFIG_PNP=y
CONFIG_PNP_DEBUG_MESSAGES=y
#
# Protocols
#
CONFIG_PNPACPI=y
CONFIG_BLK_DEV=y
# CONFIG_BLK_DEV_FD is not set
CONFIG_BLK_CPQ_DA=y
CONFIG_BLK_CPQ_CISS_DA=y
# CONFIG_CISS_SCSI_TAPE is not set
# CONFIG_BLK_DEV_DAC960 is not set
# CONFIG_BLK_DEV_UMEM is not set
# CONFIG_BLK_DEV_COW_COMMON is not set
# CONFIG_BLK_DEV_LOOP is not set
#
# DRBD disabled because PROC_FS, INET or CONNECTOR not selected
#
# CONFIG_BLK_DEV_NBD is not set
# CONFIG_BLK_DEV_SX8 is not set
# CONFIG_BLK_DEV_UB is not set
CONFIG_BLK_DEV_RAM=y
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=8192
# CONFIG_BLK_DEV_XIP is not set
# CONFIG_CDROM_PKTCDVD is not set
# CONFIG_ATA_OVER_ETH is not set
# CONFIG_BLK_DEV_HD is not set
# CONFIG_BLK_DEV_RBD is not set
# CONFIG_SENSORS_LIS3LV02D is not set
CONFIG_MISC_DEVICES=y
# CONFIG_AD525X_DPOT is not set
# CONFIG_IBM_ASM is not set
# CONFIG_PHANTOM is not set
# CONFIG_INTEL_MID_PTI is not set
# CONFIG_SGI_IOC4 is not set
# CONFIG_TIFM_CORE is not set
# CONFIG_ICS932S401 is not set
# CONFIG_ENCLOSURE_SERVICES is not set
CONFIG_HP_ILO=m
# CONFIG_APDS9802ALS is not set
# CONFIG_ISL29003 is not set
# CONFIG_ISL29020 is not set
# CONFIG_SENSORS_TSL2550 is not set
# CONFIG_SENSORS_BH1780 is not set
# CONFIG_SENSORS_BH1770 is not set
# CONFIG_SENSORS_APDS990X is not set
# CONFIG_HMC6352 is not set
# CONFIG_DS1682 is not set
# CONFIG_VMWARE_BALLOON is not set
# CONFIG_BMP085 is not set
# CONFIG_PCH_PHUB is not set
# CONFIG_USB_SWITCH_FSA9480 is not set
# CONFIG_C2PORT is not set
#
# EEPROM support
#
# CONFIG_EEPROM_AT24 is not set
# CONFIG_EEPROM_LEGACY is not set
# CONFIG_EEPROM_MAX6875 is not set
# CONFIG_EEPROM_93CX6 is not set
# CONFIG_CB710_CORE is not set
#
# Texas Instruments shared transport line discipline
#
# CONFIG_SENSORS_LIS3_I2C is not set
#
# Altera FPGA firmware download module
#
# CONFIG_ALTERA_STAPL is not set
CONFIG_HAVE_IDE=y
CONFIG_IDE=y
#
# Please see Documentation/ide/ide.txt for help/info on IDE drives
#
CONFIG_IDE_XFER_MODE=y
CONFIG_IDE_TIMINGS=y
# CONFIG_BLK_DEV_IDE_SATA is not set
CONFIG_IDE_GD=y
CONFIG_IDE_GD_ATA=y
# CONFIG_IDE_GD_ATAPI is not set
# CONFIG_BLK_DEV_IDECD is not set
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDEACPI is not set
# CONFIG_IDE_TASK_IOCTL is not set
CONFIG_IDE_PROC_FS=y
#
# IDE chipset support/bugfixes
#
CONFIG_IDE_GENERIC=y
# CONFIG_BLK_DEV_PLATFORM is not set
CONFIG_BLK_DEV_CMD640=y
# CONFIG_BLK_DEV_CMD640_ENHANCED is not set
# CONFIG_BLK_DEV_IDEPNP is not set
CONFIG_BLK_DEV_IDEDMA_SFF=y
#
# PCI IDE chipsets support
#
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_PCIBUS_ORDER=y
# CONFIG_BLK_DEV_OFFBOARD is not set
CONFIG_BLK_DEV_GENERIC=y
# CONFIG_BLK_DEV_OPTI621 is not set
# CONFIG_BLK_DEV_RZ1000 is not set
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_AEC62XX is not set
# CONFIG_BLK_DEV_ALI15X3 is not set
# CONFIG_BLK_DEV_AMD74XX is not set
# CONFIG_BLK_DEV_ATIIXP is not set
# CONFIG_BLK_DEV_CMD64X is not set
# CONFIG_BLK_DEV_TRIFLEX is not set
# CONFIG_BLK_DEV_CS5520 is not set
# CONFIG_BLK_DEV_CS5530 is not set
# CONFIG_BLK_DEV_CS5535 is not set
# CONFIG_BLK_DEV_CS5536 is not set
# CONFIG_BLK_DEV_HPT366 is not set
# CONFIG_BLK_DEV_JMICRON is not set
# CONFIG_BLK_DEV_SC1200 is not set
CONFIG_BLK_DEV_PIIX=y
# CONFIG_BLK_DEV_IT8172 is not set
# CONFIG_BLK_DEV_IT8213 is not set
# CONFIG_BLK_DEV_IT821X is not set
# CONFIG_BLK_DEV_NS87415 is not set
# CONFIG_BLK_DEV_PDC202XX_OLD is not set
# CONFIG_BLK_DEV_PDC202XX_NEW is not set
# CONFIG_BLK_DEV_SVWKS is not set
# CONFIG_BLK_DEV_SIIMAGE is not set
# CONFIG_BLK_DEV_SIS5513 is not set
# CONFIG_BLK_DEV_SLC90E66 is not set
# CONFIG_BLK_DEV_TRM290 is not set
# CONFIG_BLK_DEV_VIA82CXXX is not set
# CONFIG_BLK_DEV_TC86C001 is not set
CONFIG_BLK_DEV_IDEDMA=y
#
# SCSI device support
#
CONFIG_SCSI_MOD=y
# CONFIG_RAID_ATTRS is not set
CONFIG_SCSI=y
CONFIG_SCSI_DMA=y
# CONFIG_SCSI_TGT is not set
CONFIG_SCSI_NETLINK=y
CONFIG_SCSI_PROC_FS=y
#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=y
# CONFIG_CHR_DEV_ST is not set
# CONFIG_CHR_DEV_OSST is not set
# CONFIG_BLK_DEV_SR is not set
CONFIG_CHR_DEV_SG=y
# CONFIG_CHR_DEV_SCH is not set
CONFIG_SCSI_MULTI_LUN=y
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y
# CONFIG_SCSI_SCAN_ASYNC is not set
CONFIG_SCSI_WAIT_SCAN=m
#
# SCSI Transports
#
CONFIG_SCSI_SPI_ATTRS=m
CONFIG_SCSI_FC_ATTRS=m
# CONFIG_SCSI_ISCSI_ATTRS is not set
# CONFIG_SCSI_SAS_ATTRS is not set
# CONFIG_SCSI_SAS_LIBSAS is not set
# CONFIG_SCSI_SRP_ATTRS is not set
CONFIG_SCSI_LOWLEVEL=y
# CONFIG_ISCSI_TCP is not set
# CONFIG_ISCSI_BOOT_SYSFS is not set
# CONFIG_SCSI_CXGB3_ISCSI is not set
# CONFIG_SCSI_CXGB4_ISCSI is not set
# CONFIG_SCSI_BNX2_ISCSI is not set
# CONFIG_SCSI_BNX2X_FCOE is not set
# CONFIG_BE2ISCSI is not set
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
# CONFIG_SCSI_HPSA is not set
# CONFIG_SCSI_3W_9XXX is not set
# CONFIG_SCSI_3W_SAS is not set
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC7XXX_OLD is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_SCSI_AIC94XX is not set
# CONFIG_SCSI_MVSAS is not set
# CONFIG_SCSI_MVUMI is not set
# CONFIG_SCSI_DPT_I2O is not set
# CONFIG_SCSI_ADVANSYS is not set
# CONFIG_SCSI_ARCMSR is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_MEGARAID_SAS is not set
# CONFIG_SCSI_MPT2SAS is not set
# CONFIG_SCSI_HPTIOP is not set
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_VMWARE_PVSCSI is not set
# CONFIG_LIBFC is not set
# CONFIG_LIBFCOE is not set
# CONFIG_FCOE is not set
# CONFIG_FCOE_FNIC is not set
# CONFIG_SCSI_DMX3191D is not set
# CONFIG_SCSI_EATA is not set
# CONFIG_SCSI_FUTURE_DOMAIN is not set
# CONFIG_SCSI_GDTH is not set
# CONFIG_SCSI_ISCI is not set
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INITIO is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_STEX is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
# CONFIG_SCSI_QLA_FC is not set
# CONFIG_SCSI_QLA_ISCSI is not set
# CONFIG_SCSI_LPFC is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_DC390T is not set
# CONFIG_SCSI_NSP32 is not set
# CONFIG_SCSI_DEBUG is not set
# CONFIG_SCSI_PMCRAID is not set
# CONFIG_SCSI_PM8001 is not set
# CONFIG_SCSI_SRP is not set
# CONFIG_SCSI_BFA_FC is not set
# CONFIG_SCSI_DH is not set
# CONFIG_SCSI_OSD_INITIATOR is not set
# CONFIG_ATA is not set
CONFIG_MD=y
CONFIG_BLK_DEV_MD=m
CONFIG_MD_LINEAR=m
CONFIG_MD_RAID0=m
CONFIG_MD_RAID1=m
# CONFIG_MD_RAID10 is not set
# CONFIG_MD_RAID456 is not set
CONFIG_MD_MULTIPATH=m
# CONFIG_MD_FAULTY is not set
CONFIG_BLK_DEV_DM=y
# CONFIG_DM_DEBUG is not set
CONFIG_DM_CRYPT=m
CONFIG_DM_SNAPSHOT=m
# CONFIG_DM_THIN_PROVISIONING is not set
CONFIG_DM_MIRROR=m
# CONFIG_DM_RAID is not set
# CONFIG_DM_LOG_USERSPACE is not set
CONFIG_DM_ZERO=m
# CONFIG_DM_MULTIPATH is not set
# CONFIG_DM_DELAY is not set
# CONFIG_DM_UEVENT is not set
# CONFIG_DM_FLAKEY is not set
# CONFIG_TARGET_CORE is not set
# CONFIG_FUSION is not set
#
# IEEE 1394 (FireWire) support
#
# CONFIG_FIREWIRE is not set
# CONFIG_FIREWIRE_NOSY is not set
# CONFIG_I2O is not set
# CONFIG_MACINTOSH_DRIVERS is not set
CONFIG_NETDEVICES=y
CONFIG_NET_CORE=y
CONFIG_BONDING=m
CONFIG_DUMMY=m
CONFIG_EQUALIZER=m
# CONFIG_NET_FC is not set
CONFIG_MII=m
CONFIG_IFB=m
# CONFIG_NET_TEAM is not set
CONFIG_MACVLAN=m
# CONFIG_MACVTAP is not set
CONFIG_NETCONSOLE=m
CONFIG_NETPOLL=y
# CONFIG_NETPOLL_TRAP is not set
CONFIG_NET_POLL_CONTROLLER=y
CONFIG_TUN=m
CONFIG_VETH=m
# CONFIG_ARCNET is not set
#
# CAIF transport drivers
#
CONFIG_ETHERNET=y
CONFIG_MDIO=m
# CONFIG_NET_VENDOR_3COM is not set
CONFIG_NET_VENDOR_ADAPTEC=y
# CONFIG_ADAPTEC_STARFIRE is not set
CONFIG_NET_VENDOR_ALTEON=y
# CONFIG_ACENIC is not set
CONFIG_NET_VENDOR_AMD=y
# CONFIG_AMD8111_ETH is not set
# CONFIG_PCNET32 is not set
CONFIG_NET_VENDOR_ATHEROS=y
# CONFIG_ATL2 is not set
# CONFIG_ATL1 is not set
# CONFIG_ATL1E is not set
# CONFIG_ATL1C is not set
CONFIG_NET_VENDOR_BROADCOM=y
# CONFIG_B44 is not set
CONFIG_BNX2=y
# CONFIG_CNIC is not set
CONFIG_TIGON3=m
CONFIG_BNX2X=m
CONFIG_NET_VENDOR_BROCADE=y
# CONFIG_BNA is not set
# CONFIG_NET_CALXEDA_XGMAC is not set
CONFIG_NET_VENDOR_CHELSIO=y
# CONFIG_CHELSIO_T1 is not set
# CONFIG_CHELSIO_T3 is not set
# CONFIG_CHELSIO_T4 is not set
# CONFIG_CHELSIO_T4VF is not set
CONFIG_NET_VENDOR_CISCO=y
# CONFIG_ENIC is not set
# CONFIG_DNET is not set
CONFIG_NET_VENDOR_DEC=y
# CONFIG_NET_TULIP is not set
CONFIG_NET_VENDOR_DLINK=y
# CONFIG_DL2K is not set
# CONFIG_SUNDANCE is not set
CONFIG_NET_VENDOR_EMULEX=y
# CONFIG_BE2NET is not set
CONFIG_NET_VENDOR_EXAR=y
# CONFIG_S2IO is not set
# CONFIG_VXGE is not set
CONFIG_NET_VENDOR_HP=y
# CONFIG_HP100 is not set
CONFIG_NET_VENDOR_INTEL=y
# CONFIG_E100 is not set
# CONFIG_E1000 is not set
# CONFIG_E1000E is not set
# CONFIG_IGB is not set
# CONFIG_IGBVF is not set
# CONFIG_IXGB is not set
# CONFIG_IXGBE is not set
# CONFIG_IXGBEVF is not set
CONFIG_NET_VENDOR_I825XX=y
# CONFIG_ZNET is not set
# CONFIG_IP1000 is not set
# CONFIG_JME is not set
CONFIG_NET_VENDOR_MARVELL=y
# CONFIG_SKGE is not set
# CONFIG_SKY2 is not set
CONFIG_NET_VENDOR_MELLANOX=y
# CONFIG_MLX4_EN is not set
# CONFIG_MLX4_CORE is not set
CONFIG_NET_VENDOR_MICREL=y
# CONFIG_KS8851_MLL is not set
# CONFIG_KSZ884X_PCI is not set
CONFIG_NET_VENDOR_MYRI=y
# CONFIG_MYRI10GE is not set
# CONFIG_FEALNX is not set
CONFIG_NET_VENDOR_NATSEMI=y
# CONFIG_NATSEMI is not set
# CONFIG_NS83820 is not set
CONFIG_NET_VENDOR_8390=y
# CONFIG_NE2K_PCI is not set
CONFIG_NET_VENDOR_NVIDIA=y
CONFIG_FORCEDETH=y
CONFIG_NET_VENDOR_OKI=y
# CONFIG_PCH_GBE is not set
# CONFIG_ETHOC is not set
# CONFIG_NET_PACKET_ENGINE is not set
CONFIG_NET_VENDOR_QLOGIC=y
# CONFIG_QLA3XXX is not set
# CONFIG_QLCNIC is not set
# CONFIG_QLGE is not set
# CONFIG_NETXEN_NIC is not set
CONFIG_NET_VENDOR_REALTEK=y
# CONFIG_8139CP is not set
# CONFIG_8139TOO is not set
# CONFIG_R8169 is not set
CONFIG_NET_VENDOR_RDC=y
# CONFIG_R6040 is not set
CONFIG_NET_VENDOR_SEEQ=y
# CONFIG_SEEQ8005 is not set
CONFIG_NET_VENDOR_SILAN=y
# CONFIG_SC92031 is not set
CONFIG_NET_VENDOR_SIS=y
# CONFIG_SIS900 is not set
# CONFIG_SIS190 is not set
# CONFIG_SFC is not set
CONFIG_NET_VENDOR_SMSC=y
# CONFIG_EPIC100 is not set
# CONFIG_SMSC9420 is not set
CONFIG_NET_VENDOR_STMICRO=y
# CONFIG_STMMAC_ETH is not set
CONFIG_NET_VENDOR_SUN=y
# CONFIG_HAPPYMEAL is not set
# CONFIG_SUNGEM is not set
# CONFIG_CASSINI is not set
# CONFIG_NIU is not set
CONFIG_NET_VENDOR_TEHUTI=y
# CONFIG_TEHUTI is not set
CONFIG_NET_VENDOR_TI=y
# CONFIG_TLAN is not set
CONFIG_NET_VENDOR_VIA=y
# CONFIG_VIA_RHINE is not set
# CONFIG_VIA_VELOCITY is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_NET_SB1000 is not set
CONFIG_PHYLIB=y
#
# MII PHY device drivers
#
# CONFIG_MARVELL_PHY is not set
# CONFIG_DAVICOM_PHY is not set
# CONFIG_QSEMI_PHY is not set
# CONFIG_LXT_PHY is not set
# CONFIG_CICADA_PHY is not set
# CONFIG_VITESSE_PHY is not set
# CONFIG_SMSC_PHY is not set
CONFIG_BROADCOM_PHY=y
# CONFIG_ICPLUS_PHY is not set
# CONFIG_REALTEK_PHY is not set
# CONFIG_NATIONAL_PHY is not set
# CONFIG_STE10XP is not set
# CONFIG_LSI_ET1011C_PHY is not set
# CONFIG_MICREL_PHY is not set
# CONFIG_FIXED_PHY is not set
# CONFIG_MDIO_BITBANG is not set
CONFIG_PPP=m
CONFIG_PPP_BSDCOMP=m
CONFIG_PPP_DEFLATE=m
CONFIG_PPP_FILTER=y
CONFIG_PPP_MPPE=m
CONFIG_PPP_MULTILINK=y
CONFIG_PPPOE=m
# CONFIG_PPTP is not set
# CONFIG_PPPOL2TP is not set
CONFIG_PPP_ASYNC=m
CONFIG_PPP_SYNC_TTY=m
# CONFIG_SLIP is not set
CONFIG_SLHC=m
# CONFIG_TR is not set
#
# USB Network Adapters
#
# CONFIG_USB_CATC is not set
# CONFIG_USB_KAWETH is not set
# CONFIG_USB_PEGASUS is not set
# CONFIG_USB_RTL8150 is not set
# CONFIG_USB_USBNET is not set
# CONFIG_USB_IPHETH is not set
# CONFIG_WLAN is not set
#
# Enable WiMAX (Networking options) to see the WiMAX drivers
#
# CONFIG_WAN is not set
# CONFIG_VMXNET3 is not set
# CONFIG_ISDN is not set
# CONFIG_PHONE is not set
#
# Input device support
#
CONFIG_INPUT=y
# CONFIG_INPUT_FF_MEMLESS is not set
# CONFIG_INPUT_POLLDEV is not set
# CONFIG_INPUT_SPARSEKMAP is not set
#
# Userland interfaces
#
# CONFIG_INPUT_MOUSEDEV is not set
# CONFIG_INPUT_JOYDEV is not set
# CONFIG_INPUT_EVDEV is not set
# CONFIG_INPUT_EVBUG is not set
#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
# CONFIG_KEYBOARD_ADP5588 is not set
# CONFIG_KEYBOARD_ADP5589 is not set
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_QT1070 is not set
# CONFIG_KEYBOARD_QT2160 is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_TCA6416 is not set
# CONFIG_KEYBOARD_MAX7359 is not set
# CONFIG_KEYBOARD_MCS is not set
# CONFIG_KEYBOARD_MPR121 is not set
# CONFIG_KEYBOARD_NEWTON is not set
# CONFIG_KEYBOARD_OPENCORES is not set
# CONFIG_KEYBOARD_STOWAWAY is not set
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_XTKBD is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=m
CONFIG_MOUSE_PS2_ALPS=y
CONFIG_MOUSE_PS2_LOGIPS2PP=y
CONFIG_MOUSE_PS2_SYNAPTICS=y
CONFIG_MOUSE_PS2_LIFEBOOK=y
CONFIG_MOUSE_PS2_TRACKPOINT=y
# CONFIG_MOUSE_PS2_ELANTECH is not set
# CONFIG_MOUSE_PS2_SENTELIC is not set
# CONFIG_MOUSE_PS2_TOUCHKIT is not set
# CONFIG_MOUSE_SERIAL is not set
# CONFIG_MOUSE_APPLETOUCH is not set
# CONFIG_MOUSE_BCM5974 is not set
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_MOUSE_SYNAPTICS_I2C is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TABLET is not set
CONFIG_INPUT_TOUCHSCREEN=y
# CONFIG_TOUCHSCREEN_AD7879 is not set
# CONFIG_TOUCHSCREEN_ATMEL_MXT is not set
# CONFIG_TOUCHSCREEN_BU21013 is not set
# CONFIG_TOUCHSCREEN_DYNAPRO is not set
# CONFIG_TOUCHSCREEN_HAMPSHIRE is not set
# CONFIG_TOUCHSCREEN_EETI is not set
# CONFIG_TOUCHSCREEN_FUJITSU is not set
# CONFIG_TOUCHSCREEN_GUNZE is not set
# CONFIG_TOUCHSCREEN_ELO is not set
# CONFIG_TOUCHSCREEN_WACOM_W8001 is not set
# CONFIG_TOUCHSCREEN_MAX11801 is not set
# CONFIG_TOUCHSCREEN_MCS5000 is not set
# CONFIG_TOUCHSCREEN_MTOUCH is not set
# CONFIG_TOUCHSCREEN_INEXIO is not set
# CONFIG_TOUCHSCREEN_MK712 is not set
# CONFIG_TOUCHSCREEN_PENMOUNT is not set
# CONFIG_TOUCHSCREEN_TOUCHRIGHT is not set
# CONFIG_TOUCHSCREEN_TOUCHWIN is not set
# CONFIG_TOUCHSCREEN_USB_COMPOSITE is not set
# CONFIG_TOUCHSCREEN_TOUCHIT213 is not set
# CONFIG_TOUCHSCREEN_TSC_SERIO is not set
# CONFIG_TOUCHSCREEN_TSC2007 is not set
# CONFIG_TOUCHSCREEN_ST1232 is not set
# CONFIG_TOUCHSCREEN_TPS6507X is not set
CONFIG_INPUT_MISC=y
# CONFIG_INPUT_AD714X is not set
# CONFIG_INPUT_BMA150 is not set
# CONFIG_INPUT_PCSPKR is not set
# CONFIG_INPUT_MMA8450 is not set
# CONFIG_INPUT_MPU3050 is not set
# CONFIG_INPUT_WISTRON_BTNS is not set
# CONFIG_INPUT_ATLAS_BTNS is not set
# CONFIG_INPUT_ATI_REMOTE2 is not set
# CONFIG_INPUT_KEYSPAN_REMOTE is not set
# CONFIG_INPUT_KXTJ9 is not set
# CONFIG_INPUT_POWERMATE is not set
# CONFIG_INPUT_YEALINK is not set
# CONFIG_INPUT_CM109 is not set
# CONFIG_INPUT_UINPUT is not set
# CONFIG_INPUT_PCF8574 is not set
# CONFIG_INPUT_ADXL34X is not set
# CONFIG_INPUT_CMA3000 is not set
#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
# CONFIG_SERIO_SERPORT is not set
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PCIPS2 is not set
CONFIG_SERIO_LIBPS2=y
# CONFIG_SERIO_RAW is not set
# CONFIG_SERIO_ALTERA_PS2 is not set
# CONFIG_SERIO_PS2MULT is not set
# CONFIG_GAMEPORT is not set
#
# Character devices
#
CONFIG_VT=y
CONFIG_CONSOLE_TRANSLATIONS=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
# CONFIG_VT_HW_CONSOLE_BINDING is not set
CONFIG_UNIX98_PTYS=y
# CONFIG_DEVPTS_MULTIPLE_INSTANCES is not set
CONFIG_LEGACY_PTYS=y
CONFIG_LEGACY_PTY_COUNT=256
# CONFIG_SERIAL_NONSTANDARD is not set
# CONFIG_NOZOMI is not set
# CONFIG_N_GSM is not set
# CONFIG_TRACE_SINK is not set
CONFIG_DEVKMEM=y
#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_SERIAL_8250_PCI=y
CONFIG_SERIAL_8250_PNP=y
CONFIG_SERIAL_8250_NR_UARTS=4
CONFIG_SERIAL_8250_RUNTIME_UARTS=4
CONFIG_SERIAL_8250_EXTENDED=y
CONFIG_SERIAL_8250_MANY_PORTS=y
CONFIG_SERIAL_8250_SHARE_IRQ=y
# CONFIG_SERIAL_8250_DETECT_IRQ is not set
CONFIG_SERIAL_8250_RSA=y
#
# Non-8250 serial port support
#
# CONFIG_SERIAL_MFD_HSU is not set
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
# CONFIG_SERIAL_JSM is not set
# CONFIG_SERIAL_TIMBERDALE is not set
# CONFIG_SERIAL_ALTERA_JTAGUART is not set
# CONFIG_SERIAL_ALTERA_UART is not set
# CONFIG_SERIAL_PCH_UART is not set
# CONFIG_SERIAL_XILINX_PS_UART is not set
# CONFIG_TTY_PRINTK is not set
CONFIG_IPMI_HANDLER=m
# CONFIG_IPMI_PANIC_EVENT is not set
CONFIG_IPMI_DEVICE_INTERFACE=m
CONFIG_IPMI_SI=m
CONFIG_IPMI_WATCHDOG=m
CONFIG_IPMI_POWEROFF=m
CONFIG_HW_RANDOM=y
# CONFIG_HW_RANDOM_TIMERIOMEM is not set
CONFIG_HW_RANDOM_INTEL=y
# CONFIG_HW_RANDOM_AMD is not set
CONFIG_HW_RANDOM_GEODE=y
CONFIG_HW_RANDOM_VIA=y
# CONFIG_NVRAM is not set
# CONFIG_RTC is not set
# CONFIG_GEN_RTC is not set
# CONFIG_R3964 is not set
# CONFIG_APPLICOM is not set
# CONFIG_SONYPI is not set
# CONFIG_MWAVE is not set
# CONFIG_PC8736x_GPIO is not set
# CONFIG_NSC_GPIO is not set
# CONFIG_RAW_DRIVER is not set
CONFIG_HPET=y
CONFIG_HPET_MMAP=y
# CONFIG_HANGCHECK_TIMER is not set
# CONFIG_TCG_TPM is not set
# CONFIG_TELCLOCK is not set
CONFIG_DEVPORT=y
# CONFIG_RAMOOPS is not set
CONFIG_I2C=y
CONFIG_I2C_BOARDINFO=y
CONFIG_I2C_COMPAT=y
CONFIG_I2C_CHARDEV=y
# CONFIG_I2C_MUX is not set
CONFIG_I2C_HELPER_AUTO=y
CONFIG_I2C_SMBUS=m
CONFIG_I2C_ALGOBIT=m
#
# I2C Hardware Bus support
#
#
# PC SMBus host controller drivers
#
CONFIG_I2C_ALI1535=m
CONFIG_I2C_ALI1563=m
CONFIG_I2C_ALI15X3=m
CONFIG_I2C_AMD756=m
# CONFIG_I2C_AMD756_S4882 is not set
CONFIG_I2C_AMD8111=m
CONFIG_I2C_I801=m
# CONFIG_I2C_ISCH is not set
CONFIG_I2C_PIIX4=m
CONFIG_I2C_NFORCE2=m
# CONFIG_I2C_NFORCE2_S4985 is not set
CONFIG_I2C_SIS5595=m
CONFIG_I2C_SIS630=m
CONFIG_I2C_SIS96X=m
CONFIG_I2C_VIA=m
CONFIG_I2C_VIAPRO=m
#
# ACPI drivers
#
# CONFIG_I2C_SCMI is not set
#
# I2C system bus drivers (mostly embedded / system-on-chip)
#
# CONFIG_I2C_DESIGNWARE_PCI is not set
# CONFIG_I2C_INTEL_MID is not set
# CONFIG_I2C_OCORES is not set
# CONFIG_I2C_PCA_PLATFORM is not set
# CONFIG_I2C_PXA_PCI is not set
# CONFIG_I2C_SIMTEC is not set
# CONFIG_I2C_XILINX is not set
# CONFIG_I2C_EG20T is not set
#
# External I2C/SMBus adapter drivers
#
# CONFIG_I2C_DIOLAN_U2C is not set
CONFIG_I2C_PARPORT_LIGHT=m
# CONFIG_I2C_TAOS_EVM is not set
# CONFIG_I2C_TINY_USB is not set
#
# Other I2C/SMBus bus drivers
#
# CONFIG_I2C_STUB is not set
# CONFIG_SCx200_ACB is not set
# CONFIG_I2C_DEBUG_CORE is not set
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
# CONFIG_SPI is not set
#
# PPS support
#
# CONFIG_PPS is not set
#
# PPS generators support
#
#
# PTP clock support
#
#
# Enable Device Drivers -> PPS to see the PTP clock options.
#
CONFIG_ARCH_WANT_OPTIONAL_GPIOLIB=y
# CONFIG_GPIOLIB is not set
# CONFIG_W1 is not set
CONFIG_POWER_SUPPLY=y
# CONFIG_POWER_SUPPLY_DEBUG is not set
# CONFIG_PDA_POWER is not set
# CONFIG_TEST_POWER is not set
# CONFIG_BATTERY_DS2780 is not set
# CONFIG_BATTERY_DS2782 is not set
# CONFIG_BATTERY_BQ20Z75 is not set
# CONFIG_BATTERY_BQ27x00 is not set
# CONFIG_BATTERY_MAX17040 is not set
# CONFIG_BATTERY_MAX17042 is not set
# CONFIG_CHARGER_MAX8903 is not set
CONFIG_HWMON=y
# CONFIG_HWMON_VID is not set
# CONFIG_HWMON_DEBUG_CHIP is not set
#
# Native drivers
#
# CONFIG_SENSORS_ABITUGURU is not set
# CONFIG_SENSORS_ABITUGURU3 is not set
# CONFIG_SENSORS_AD7414 is not set
# CONFIG_SENSORS_AD7418 is not set
# CONFIG_SENSORS_ADM1021 is not set
# CONFIG_SENSORS_ADM1025 is not set
# CONFIG_SENSORS_ADM1026 is not set
# CONFIG_SENSORS_ADM1029 is not set
# CONFIG_SENSORS_ADM1031 is not set
# CONFIG_SENSORS_ADM9240 is not set
# CONFIG_SENSORS_ADT7411 is not set
# CONFIG_SENSORS_ADT7462 is not set
# CONFIG_SENSORS_ADT7470 is not set
# CONFIG_SENSORS_ADT7475 is not set
# CONFIG_SENSORS_ASC7621 is not set
# CONFIG_SENSORS_K8TEMP is not set
# CONFIG_SENSORS_K10TEMP is not set
# CONFIG_SENSORS_FAM15H_POWER is not set
# CONFIG_SENSORS_ASB100 is not set
# CONFIG_SENSORS_ATXP1 is not set
# CONFIG_SENSORS_DS620 is not set
# CONFIG_SENSORS_DS1621 is not set
# CONFIG_SENSORS_I5K_AMB is not set
# CONFIG_SENSORS_F71805F is not set
# CONFIG_SENSORS_F71882FG is not set
# CONFIG_SENSORS_F75375S is not set
# CONFIG_SENSORS_FSCHMD is not set
# CONFIG_SENSORS_G760A is not set
# CONFIG_SENSORS_GL518SM is not set
# CONFIG_SENSORS_GL520SM is not set
CONFIG_SENSORS_CORETEMP=y
# CONFIG_SENSORS_IBMAEM is not set
# CONFIG_SENSORS_IBMPEX is not set
# CONFIG_SENSORS_IT87 is not set
# CONFIG_SENSORS_JC42 is not set
# CONFIG_SENSORS_LINEAGE is not set
# CONFIG_SENSORS_LM63 is not set
# CONFIG_SENSORS_LM73 is not set
# CONFIG_SENSORS_LM75 is not set
# CONFIG_SENSORS_LM77 is not set
# CONFIG_SENSORS_LM78 is not set
# CONFIG_SENSORS_LM80 is not set
# CONFIG_SENSORS_LM83 is not set
# CONFIG_SENSORS_LM85 is not set
# CONFIG_SENSORS_LM87 is not set
# CONFIG_SENSORS_LM90 is not set
# CONFIG_SENSORS_LM92 is not set
# CONFIG_SENSORS_LM93 is not set
# CONFIG_SENSORS_LTC4151 is not set
# CONFIG_SENSORS_LTC4215 is not set
# CONFIG_SENSORS_LTC4245 is not set
# CONFIG_SENSORS_LTC4261 is not set
# CONFIG_SENSORS_LM95241 is not set
# CONFIG_SENSORS_LM95245 is not set
# CONFIG_SENSORS_MAX16065 is not set
# CONFIG_SENSORS_MAX1619 is not set
# CONFIG_SENSORS_MAX1668 is not set
# CONFIG_SENSORS_MAX6639 is not set
# CONFIG_SENSORS_MAX6642 is not set
# CONFIG_SENSORS_MAX6650 is not set
# CONFIG_SENSORS_NTC_THERMISTOR is not set
# CONFIG_SENSORS_PC87360 is not set
# CONFIG_SENSORS_PC87427 is not set
CONFIG_SENSORS_PCF8591=m
# CONFIG_PMBUS is not set
# CONFIG_SENSORS_SHT21 is not set
# CONFIG_SENSORS_SIS5595 is not set
# CONFIG_SENSORS_SMM665 is not set
# CONFIG_SENSORS_DME1737 is not set
# CONFIG_SENSORS_EMC1403 is not set
# CONFIG_SENSORS_EMC2103 is not set
# CONFIG_SENSORS_EMC6W201 is not set
# CONFIG_SENSORS_SMSC47M1 is not set
# CONFIG_SENSORS_SMSC47M192 is not set
# CONFIG_SENSORS_SMSC47B397 is not set
# CONFIG_SENSORS_SCH56XX_COMMON is not set
# CONFIG_SENSORS_SCH5627 is not set
# CONFIG_SENSORS_SCH5636 is not set
# CONFIG_SENSORS_ADS1015 is not set
# CONFIG_SENSORS_ADS7828 is not set
# CONFIG_SENSORS_AMC6821 is not set
# CONFIG_SENSORS_THMC50 is not set
# CONFIG_SENSORS_TMP102 is not set
# CONFIG_SENSORS_TMP401 is not set
# CONFIG_SENSORS_TMP421 is not set
# CONFIG_SENSORS_VIA_CPUTEMP is not set
# CONFIG_SENSORS_VIA686A is not set
# CONFIG_SENSORS_VT1211 is not set
# CONFIG_SENSORS_VT8231 is not set
# CONFIG_SENSORS_W83781D is not set
# CONFIG_SENSORS_W83791D is not set
# CONFIG_SENSORS_W83792D is not set
# CONFIG_SENSORS_W83793 is not set
# CONFIG_SENSORS_W83795 is not set
# CONFIG_SENSORS_W83L785TS is not set
# CONFIG_SENSORS_W83L786NG is not set
# CONFIG_SENSORS_W83627HF is not set
# CONFIG_SENSORS_W83627EHF is not set
# CONFIG_SENSORS_APPLESMC is not set
#
# ACPI drivers
#
# CONFIG_SENSORS_ACPI_POWER is not set
# CONFIG_SENSORS_ATK0110 is not set
CONFIG_THERMAL=y
CONFIG_THERMAL_HWMON=y
CONFIG_WATCHDOG=y
# CONFIG_WATCHDOG_CORE is not set
# CONFIG_WATCHDOG_NOWAYOUT is not set
#
# Watchdog Device Drivers
#
# CONFIG_SOFT_WATCHDOG is not set
# CONFIG_ACQUIRE_WDT is not set
# CONFIG_ADVANTECH_WDT is not set
# CONFIG_ALIM1535_WDT is not set
# CONFIG_ALIM7101_WDT is not set
# CONFIG_F71808E_WDT is not set
# CONFIG_SP5100_TCO is not set
# CONFIG_SC520_WDT is not set
# CONFIG_SBC_FITPC2_WATCHDOG is not set
# CONFIG_EUROTECH_WDT is not set
# CONFIG_IB700_WDT is not set
# CONFIG_IBMASR is not set
# CONFIG_WAFER_WDT is not set
# CONFIG_I6300ESB_WDT is not set
# CONFIG_ITCO_WDT is not set
# CONFIG_IT8712F_WDT is not set
# CONFIG_IT87_WDT is not set
# CONFIG_HP_WATCHDOG is not set
# CONFIG_SC1200_WDT is not set
# CONFIG_PC87413_WDT is not set
# CONFIG_NV_TCO is not set
# CONFIG_60XX_WDT is not set
# CONFIG_SBC8360_WDT is not set
# CONFIG_SBC7240_WDT is not set
# CONFIG_CPU5_WDT is not set
# CONFIG_SMSC_SCH311X_WDT is not set
# CONFIG_SMSC37B787_WDT is not set
# CONFIG_W83627HF_WDT is not set
# CONFIG_W83697HF_WDT is not set
# CONFIG_W83697UG_WDT is not set
# CONFIG_W83877F_WDT is not set
# CONFIG_W83977F_WDT is not set
# CONFIG_MACHZ_WDT is not set
# CONFIG_SBC_EPX_C3_WATCHDOG is not set
#
# PCI-based Watchdog Cards
#
# CONFIG_PCIPCWATCHDOG is not set
# CONFIG_WDTPCI is not set
#
# USB-based Watchdog Cards
#
# CONFIG_USBPCWATCHDOG is not set
CONFIG_SSB_POSSIBLE=y
#
# Sonics Silicon Backplane
#
# CONFIG_SSB is not set
CONFIG_BCMA_POSSIBLE=y
#
# Broadcom specific AMBA
#
# CONFIG_BCMA is not set
#
# Multifunction device drivers
#
# CONFIG_MFD_CORE is not set
# CONFIG_MFD_88PM860X is not set
# CONFIG_MFD_SM501 is not set
# CONFIG_HTC_PASIC3 is not set
# CONFIG_TPS6105X is not set
# CONFIG_TPS6507X is not set
# CONFIG_TWL4030_CORE is not set
# CONFIG_MFD_STMPE is not set
# CONFIG_MFD_TC3589X is not set
# CONFIG_MFD_TMIO is not set
# CONFIG_PMIC_DA903X is not set
# CONFIG_MFD_DA9052_I2C is not set
# CONFIG_PMIC_ADP5520 is not set
# CONFIG_MFD_MAX8925 is not set
# CONFIG_MFD_MAX8997 is not set
# CONFIG_MFD_MAX8998 is not set
# CONFIG_MFD_WM8400 is not set
# CONFIG_MFD_WM831X_I2C is not set
# CONFIG_MFD_WM8350_I2C is not set
# CONFIG_MFD_WM8994 is not set
# CONFIG_MFD_PCF50633 is not set
# CONFIG_ABX500_CORE is not set
# CONFIG_MFD_CS5535 is not set
# CONFIG_LPC_SCH is not set
# CONFIG_MFD_RDC321X is not set
# CONFIG_MFD_JANZ_CMODIO is not set
# CONFIG_MFD_VX855 is not set
# CONFIG_MFD_WL1273_CORE is not set
# CONFIG_REGULATOR is not set
# CONFIG_MEDIA_SUPPORT is not set
#
# Graphics support
#
CONFIG_AGP=y
# CONFIG_AGP_ALI is not set
# CONFIG_AGP_ATI is not set
# CONFIG_AGP_AMD is not set
# CONFIG_AGP_INTEL is not set
# CONFIG_AGP_NVIDIA is not set
# CONFIG_AGP_SIS is not set
# CONFIG_AGP_SWORKS is not set
# CONFIG_AGP_VIA is not set
# CONFIG_AGP_EFFICEON is not set
CONFIG_VGA_ARB=y
CONFIG_VGA_ARB_MAX_GPUS=16
# CONFIG_VGA_SWITCHEROO is not set
# CONFIG_DRM is not set
# CONFIG_STUB_POULSBO is not set
# CONFIG_VGASTATE is not set
# CONFIG_VIDEO_OUTPUT_CONTROL is not set
CONFIG_FB=y
# CONFIG_FIRMWARE_EDID is not set
# CONFIG_FB_DDC is not set
# CONFIG_FB_BOOT_VESA_SUPPORT is not set
# CONFIG_FB_CFB_FILLRECT is not set
# CONFIG_FB_CFB_COPYAREA is not set
# CONFIG_FB_CFB_IMAGEBLIT is not set
# CONFIG_FB_CFB_REV_PIXELS_IN_BYTE is not set
CONFIG_FB_SYS_FILLRECT=m
CONFIG_FB_SYS_COPYAREA=m
CONFIG_FB_SYS_IMAGEBLIT=m
# CONFIG_FB_FOREIGN_ENDIAN is not set
CONFIG_FB_SYS_FOPS=m
# CONFIG_FB_WMT_GE_ROPS is not set
# CONFIG_FB_SVGALIB is not set
# CONFIG_FB_MACMODES is not set
# CONFIG_FB_BACKLIGHT is not set
CONFIG_FB_MODE_HELPERS=y
CONFIG_FB_TILEBLITTING=y
#
# Frame buffer hardware drivers
#
# CONFIG_FB_CIRRUS is not set
# CONFIG_FB_PM2 is not set
# CONFIG_FB_CYBER2000 is not set
# CONFIG_FB_ARC is not set
# CONFIG_FB_ASILIANT is not set
# CONFIG_FB_IMSTT is not set
# CONFIG_FB_VGA16 is not set
# CONFIG_FB_VESA is not set
# CONFIG_FB_N411 is not set
# CONFIG_FB_HGA is not set
# CONFIG_FB_S1D13XXX is not set
# CONFIG_FB_NVIDIA is not set
# CONFIG_FB_RIVA is not set
# CONFIG_FB_LE80578 is not set
# CONFIG_FB_MATROX is not set
# CONFIG_FB_RADEON is not set
# CONFIG_FB_ATY128 is not set
# CONFIG_FB_ATY is not set
# CONFIG_FB_S3 is not set
# CONFIG_FB_SAVAGE is not set
# CONFIG_FB_SIS is not set
# CONFIG_FB_VIA is not set
# CONFIG_FB_NEOMAGIC is not set
# CONFIG_FB_KYRO is not set
# CONFIG_FB_3DFX is not set
# CONFIG_FB_VOODOO1 is not set
# CONFIG_FB_VT8623 is not set
# CONFIG_FB_TRIDENT is not set
# CONFIG_FB_ARK is not set
# CONFIG_FB_PM3 is not set
# CONFIG_FB_CARMINE is not set
# CONFIG_FB_GEODE is not set
# CONFIG_FB_SMSCUFX is not set
# CONFIG_FB_UDL is not set
CONFIG_FB_VIRTUAL=m
# CONFIG_FB_METRONOME is not set
# CONFIG_FB_MB862XX is not set
# CONFIG_FB_BROADSHEET is not set
CONFIG_BACKLIGHT_LCD_SUPPORT=y
CONFIG_LCD_CLASS_DEVICE=m
# CONFIG_LCD_PLATFORM is not set
CONFIG_BACKLIGHT_CLASS_DEVICE=y
CONFIG_BACKLIGHT_GENERIC=y
# CONFIG_BACKLIGHT_PROGEAR is not set
# CONFIG_BACKLIGHT_APPLE is not set
# CONFIG_BACKLIGHT_SAHARA is not set
# CONFIG_BACKLIGHT_ADP8860 is not set
# CONFIG_BACKLIGHT_ADP8870 is not set
#
# Display device support
#
# CONFIG_DISPLAY_SUPPORT is not set
#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
# CONFIG_VGACON_SOFT_SCROLLBACK is not set
CONFIG_DUMMY_CONSOLE=y
CONFIG_FRAMEBUFFER_CONSOLE=m
# CONFIG_FRAMEBUFFER_CONSOLE_DETECT_PRIMARY is not set
# CONFIG_FRAMEBUFFER_CONSOLE_ROTATION is not set
# CONFIG_FONTS is not set
CONFIG_FONT_8x8=y
CONFIG_FONT_8x16=y
# CONFIG_LOGO is not set
# CONFIG_SOUND is not set
CONFIG_HID_SUPPORT=y
CONFIG_HID=y
# CONFIG_HIDRAW is not set
#
# USB Input Devices
#
CONFIG_USB_HID=y
# CONFIG_HID_PID is not set
# CONFIG_USB_HIDDEV is not set
#
# Special HID drivers
#
CONFIG_HID_A4TECH=y
# CONFIG_HID_ACRUX is not set
CONFIG_HID_APPLE=y
CONFIG_HID_BELKIN=y
CONFIG_HID_CHERRY=y
CONFIG_HID_CHICONY=y
CONFIG_HID_CYPRESS=y
# CONFIG_HID_DRAGONRISE is not set
# CONFIG_HID_EMS_FF is not set
CONFIG_HID_EZKEY=y
# CONFIG_HID_HOLTEK is not set
# CONFIG_HID_KEYTOUCH is not set
# CONFIG_HID_KYE is not set
# CONFIG_HID_UCLOGIC is not set
# CONFIG_HID_WALTOP is not set
CONFIG_HID_GYRATION=y
# CONFIG_HID_TWINHAN is not set
# CONFIG_HID_KENSINGTON is not set
# CONFIG_HID_LCPOWER is not set
CONFIG_HID_LOGITECH=y
CONFIG_HID_LOGITECH_DJ=m
# CONFIG_LOGITECH_FF is not set
# CONFIG_LOGIRUMBLEPAD2_FF is not set
# CONFIG_LOGIG940_FF is not set
# CONFIG_LOGIWHEELS_FF is not set
CONFIG_HID_MICROSOFT=y
CONFIG_HID_MONTEREY=y
# CONFIG_HID_MULTITOUCH is not set
# CONFIG_HID_NTRIG is not set
# CONFIG_HID_ORTEK is not set
CONFIG_HID_PANTHERLORD=y
# CONFIG_PANTHERLORD_FF is not set
CONFIG_HID_PETALYNX=y
# CONFIG_HID_PICOLCD is not set
# CONFIG_HID_PRIMAX is not set
# CONFIG_HID_QUANTA is not set
# CONFIG_HID_ROCCAT is not set
CONFIG_HID_SAMSUNG=y
CONFIG_HID_SONY=y
# CONFIG_HID_SPEEDLINK is not set
CONFIG_HID_SUNPLUS=y
# CONFIG_HID_GREENASIA is not set
# CONFIG_HID_SMARTJOYPLUS is not set
# CONFIG_HID_TOPSEED is not set
# CONFIG_HID_THRUSTMASTER is not set
# CONFIG_HID_ZEROPLUS is not set
# CONFIG_HID_ZYDACRON is not set
CONFIG_USB_SUPPORT=y
CONFIG_USB_COMMON=y
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB_ARCH_HAS_EHCI=y
CONFIG_USB_ARCH_HAS_XHCI=y
CONFIG_USB=y
# CONFIG_USB_DEBUG is not set
# CONFIG_USB_ANNOUNCE_NEW_DEVICES is not set
#
# Miscellaneous USB options
#
# CONFIG_USB_DEVICEFS is not set
CONFIG_USB_DEVICE_CLASS=y
# CONFIG_USB_DYNAMIC_MINORS is not set
# CONFIG_USB_OTG_WHITELIST is not set
# CONFIG_USB_OTG_BLACKLIST_HUB is not set
CONFIG_USB_MON=y
# CONFIG_USB_WUSB is not set
# CONFIG_USB_WUSB_CBAF is not set
#
# USB Host Controller Drivers
#
# CONFIG_USB_C67X00_HCD is not set
# CONFIG_USB_XHCI_HCD is not set
# CONFIG_USB_EHCI_HCD is not set
# CONFIG_USB_OXU210HP_HCD is not set
# CONFIG_USB_ISP116X_HCD is not set
# CONFIG_USB_ISP1760_HCD is not set
# CONFIG_USB_ISP1362_HCD is not set
# CONFIG_USB_OHCI_HCD is not set
CONFIG_USB_UHCI_HCD=y
# CONFIG_USB_SL811_HCD is not set
# CONFIG_USB_R8A66597_HCD is not set
# CONFIG_USB_WHCI_HCD is not set
# CONFIG_USB_HWA_HCD is not set
#
# USB Device Class drivers
#
# CONFIG_USB_ACM is not set
# CONFIG_USB_PRINTER is not set
# CONFIG_USB_WDM is not set
# CONFIG_USB_TMC is not set
#
# NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may
#
#
# also be needed; see USB_STORAGE Help for more info
#
# CONFIG_USB_STORAGE is not set
# CONFIG_USB_UAS is not set
# CONFIG_USB_LIBUSUAL is not set
#
# USB Imaging devices
#
# CONFIG_USB_MDC800 is not set
# CONFIG_USB_MICROTEK is not set
#
# USB port drivers
#
# CONFIG_USB_SERIAL is not set
#
# USB Miscellaneous drivers
#
# CONFIG_USB_EMI62 is not set
# CONFIG_USB_EMI26 is not set
# CONFIG_USB_ADUTUX is not set
# CONFIG_USB_SEVSEG is not set
# CONFIG_USB_RIO500 is not set
# CONFIG_USB_LEGOTOWER is not set
# CONFIG_USB_LCD is not set
# CONFIG_USB_LED is not set
# CONFIG_USB_CYPRESS_CY7C63 is not set
# CONFIG_USB_CYTHERM is not set
# CONFIG_USB_IDMOUSE is not set
# CONFIG_USB_FTDI_ELAN is not set
# CONFIG_USB_APPLEDISPLAY is not set
# CONFIG_USB_LD is not set
# CONFIG_USB_TRANCEVIBRATOR is not set
# CONFIG_USB_IOWARRIOR is not set
# CONFIG_USB_TEST is not set
# CONFIG_USB_ISIGHTFW is not set
# CONFIG_USB_YUREX is not set
# CONFIG_USB_GADGET is not set
#
# OTG and related infrastructure
#
# CONFIG_NOP_USB_XCEIV is not set
# CONFIG_UWB is not set
# CONFIG_MMC is not set
# CONFIG_MEMSTICK is not set
# CONFIG_NEW_LEDS is not set
# CONFIG_ACCESSIBILITY is not set
# CONFIG_INFINIBAND is not set
# CONFIG_EDAC is not set
# CONFIG_RTC_CLASS is not set
# CONFIG_DMADEVICES is not set
# CONFIG_AUXDISPLAY is not set
# CONFIG_UIO is not set
#
# Virtio drivers
#
# CONFIG_VIRTIO_PCI is not set
# CONFIG_VIRTIO_BALLOON is not set
# CONFIG_VIRTIO_MMIO is not set
#
# Microsoft Hyper-V guest support
#
# CONFIG_HYPERV is not set
# CONFIG_STAGING is not set
CONFIG_X86_PLATFORM_DEVICES=y
# CONFIG_ACERHDF is not set
# CONFIG_ASUS_LAPTOP is not set
# CONFIG_FUJITSU_LAPTOP is not set
# CONFIG_HP_ACCEL is not set
# CONFIG_PANASONIC_LAPTOP is not set
# CONFIG_THINKPAD_ACPI is not set
# CONFIG_SENSORS_HDAPS is not set
# CONFIG_INTEL_MENLOW is not set
# CONFIG_ACPI_WMI is not set
# CONFIG_ACPI_ASUS is not set
# CONFIG_TOPSTAR_LAPTOP is not set
# CONFIG_ACPI_TOSHIBA is not set
# CONFIG_TOSHIBA_BT_RFKILL is not set
# CONFIG_ACPI_CMPC is not set
# CONFIG_INTEL_IPS is not set
# CONFIG_IBM_RTL is not set
# CONFIG_XO15_EBOOK is not set
# CONFIG_SAMSUNG_Q10 is not set
#
# Hardware Spinlock drivers
#
CONFIG_CLKSRC_I8253=y
CONFIG_CLKEVT_I8253=y
CONFIG_I8253_LOCK=y
CONFIG_CLKBLD_I8253=y
CONFIG_IOMMU_SUPPORT=y
# CONFIG_INTEL_IOMMU is not set
# CONFIG_VIRT_DRIVERS is not set
# CONFIG_PM_DEVFREQ is not set
#
# Firmware Drivers
#
CONFIG_EDD=m
# CONFIG_EDD_OFF is not set
CONFIG_FIRMWARE_MEMMAP=y
# CONFIG_DELL_RBU is not set
# CONFIG_DCDBAS is not set
CONFIG_DMIID=y
# CONFIG_DMI_SYSFS is not set
# CONFIG_ISCSI_IBFT_FIND is not set
# CONFIG_SIGMA is not set
# CONFIG_GOOGLE_FIRMWARE is not set
#
# File systems
#
CONFIG_EXT2_FS=m
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
CONFIG_EXT2_FS_SECURITY=y
# CONFIG_EXT2_FS_XIP is not set
CONFIG_EXT3_FS=y
# CONFIG_EXT3_DEFAULTS_TO_ORDERED is not set
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
CONFIG_EXT3_FS_SECURITY=y
# CONFIG_EXT4_FS is not set
CONFIG_JBD=y
# CONFIG_JBD_DEBUG is not set
CONFIG_FS_MBCACHE=y
# CONFIG_REISERFS_FS is not set
# CONFIG_JFS_FS is not set
# CONFIG_XFS_FS is not set
# CONFIG_GFS2_FS is not set
# CONFIG_BTRFS_FS is not set
# CONFIG_NILFS2_FS is not set
CONFIG_FS_POSIX_ACL=y
CONFIG_EXPORTFS=y
CONFIG_FILE_LOCKING=y
CONFIG_FSNOTIFY=y
CONFIG_DNOTIFY=y
CONFIG_INOTIFY_USER=y
# CONFIG_FANOTIFY is not set
CONFIG_QUOTA=y
# CONFIG_QUOTA_NETLINK_INTERFACE is not set
CONFIG_PRINT_QUOTA_WARNING=y
# CONFIG_QUOTA_DEBUG is not set
CONFIG_QUOTA_TREE=m
CONFIG_QFMT_V1=m
CONFIG_QFMT_V2=m
CONFIG_QUOTACTL=y
CONFIG_AUTOFS4_FS=m
# CONFIG_FUSE_FS is not set
#
# Caches
#
CONFIG_FSCACHE=m
# CONFIG_FSCACHE_STATS is not set
# CONFIG_FSCACHE_HISTOGRAM is not set
# CONFIG_FSCACHE_DEBUG is not set
# CONFIG_FSCACHE_OBJECT_LIST is not set
CONFIG_CACHEFILES=m
# CONFIG_CACHEFILES_DEBUG is not set
# CONFIG_CACHEFILES_HISTOGRAM is not set
#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
# CONFIG_UDF_FS is not set
#
# DOS/FAT/NT Filesystems
#
# CONFIG_MSDOS_FS is not set
# CONFIG_VFAT_FS is not set
# CONFIG_NTFS_FS is not set
#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
# CONFIG_PROC_KCORE is not set
CONFIG_PROC_SYSCTL=y
CONFIG_PROC_PAGE_MONITOR=y
CONFIG_SYSFS=y
CONFIG_TMPFS=y
# CONFIG_TMPFS_POSIX_ACL is not set
# CONFIG_TMPFS_XATTR is not set
CONFIG_HUGETLBFS=y
CONFIG_HUGETLB_PAGE=y
# CONFIG_CONFIGFS_FS is not set
CONFIG_MISC_FILESYSTEMS=y
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_ECRYPT_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
# CONFIG_LOGFS is not set
# CONFIG_CRAMFS is not set
# CONFIG_SQUASHFS is not set
# CONFIG_VXFS_FS is not set
# CONFIG_MINIX_FS is not set
# CONFIG_OMFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
# CONFIG_ROMFS_FS is not set
# CONFIG_PSTORE is not set
# CONFIG_SYSV_FS is not set
# CONFIG_UFS_FS is not set
CONFIG_NETWORK_FILESYSTEMS=y
CONFIG_NFS_FS=m
CONFIG_NFS_V3=y
CONFIG_NFS_V3_ACL=y
# CONFIG_NFS_V4 is not set
CONFIG_NFS_FSCACHE=y
CONFIG_NFSD=m
CONFIG_NFSD_V2_ACL=y
CONFIG_NFSD_V3=y
CONFIG_NFSD_V3_ACL=y
# CONFIG_NFSD_V4 is not set
CONFIG_LOCKD=m
CONFIG_LOCKD_V4=y
CONFIG_NFS_ACL_SUPPORT=m
CONFIG_NFS_COMMON=y
CONFIG_SUNRPC=m
# CONFIG_CEPH_FS is not set
# CONFIG_CIFS is not set
# CONFIG_NCP_FS is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not set
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="cp437"
# CONFIG_NLS_CODEPAGE_437 is not set
# CONFIG_NLS_CODEPAGE_737 is not set
# CONFIG_NLS_CODEPAGE_775 is not set
CONFIG_NLS_CODEPAGE_850=y
# CONFIG_NLS_CODEPAGE_852 is not set
# CONFIG_NLS_CODEPAGE_855 is not set
# CONFIG_NLS_CODEPAGE_857 is not set
# CONFIG_NLS_CODEPAGE_860 is not set
# CONFIG_NLS_CODEPAGE_861 is not set
# CONFIG_NLS_CODEPAGE_862 is not set
# CONFIG_NLS_CODEPAGE_863 is not set
# CONFIG_NLS_CODEPAGE_864 is not set
# CONFIG_NLS_CODEPAGE_865 is not set
# CONFIG_NLS_CODEPAGE_866 is not set
# CONFIG_NLS_CODEPAGE_869 is not set
# CONFIG_NLS_CODEPAGE_936 is not set
# CONFIG_NLS_CODEPAGE_950 is not set
# CONFIG_NLS_CODEPAGE_932 is not set
# CONFIG_NLS_CODEPAGE_949 is not set
# CONFIG_NLS_CODEPAGE_874 is not set
# CONFIG_NLS_ISO8859_8 is not set
# CONFIG_NLS_CODEPAGE_1250 is not set
# CONFIG_NLS_CODEPAGE_1251 is not set
CONFIG_NLS_ASCII=y
CONFIG_NLS_ISO8859_1=y
# CONFIG_NLS_ISO8859_2 is not set
# CONFIG_NLS_ISO8859_3 is not set
# CONFIG_NLS_ISO8859_4 is not set
# CONFIG_NLS_ISO8859_5 is not set
# CONFIG_NLS_ISO8859_6 is not set
# CONFIG_NLS_ISO8859_7 is not set
# CONFIG_NLS_ISO8859_9 is not set
# CONFIG_NLS_ISO8859_13 is not set
# CONFIG_NLS_ISO8859_14 is not set
CONFIG_NLS_ISO8859_15=y
# CONFIG_NLS_KOI8_R is not set
# CONFIG_NLS_KOI8_U is not set
CONFIG_NLS_UTF8=y
#
# Kernel hacking
#
CONFIG_TRACE_IRQFLAGS_SUPPORT=y
CONFIG_PRINTK_TIME=y
CONFIG_DEFAULT_MESSAGE_LOGLEVEL=4
CONFIG_ENABLE_WARN_DEPRECATED=y
CONFIG_ENABLE_MUST_CHECK=y
CONFIG_FRAME_WARN=1024
CONFIG_MAGIC_SYSRQ=y
# CONFIG_STRIP_ASM_SYMS is not set
CONFIG_UNUSED_SYMBOLS=y
CONFIG_DEBUG_FS=y
# CONFIG_HEADERS_CHECK is not set
# CONFIG_DEBUG_SECTION_MISMATCH is not set
CONFIG_DEBUG_KERNEL=y
# CONFIG_DEBUG_SHIRQ is not set
CONFIG_LOCKUP_DETECTOR=y
CONFIG_HARDLOCKUP_DETECTOR=y
# CONFIG_BOOTPARAM_HARDLOCKUP_PANIC is not set
CONFIG_BOOTPARAM_HARDLOCKUP_PANIC_VALUE=0
CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC=y
CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC_VALUE=1
CONFIG_DETECT_HUNG_TASK=y
CONFIG_DEFAULT_HUNG_TASK_TIMEOUT=120
# CONFIG_BOOTPARAM_HUNG_TASK_PANIC is not set
CONFIG_BOOTPARAM_HUNG_TASK_PANIC_VALUE=0
CONFIG_SCHED_DEBUG=y
# CONFIG_SCHEDSTATS is not set
CONFIG_TIMER_STATS=y
# CONFIG_DEBUG_OBJECTS is not set
# CONFIG_SLUB_DEBUG_ON is not set
# CONFIG_SLUB_STATS is not set
# CONFIG_DEBUG_KMEMLEAK is not set
# CONFIG_DEBUG_RT_MUTEXES is not set
# CONFIG_RT_MUTEX_TESTER is not set
# CONFIG_DEBUG_SPINLOCK is not set
# CONFIG_DEBUG_MUTEXES is not set
# CONFIG_DEBUG_LOCK_ALLOC is not set
# CONFIG_PROVE_LOCKING is not set
CONFIG_SPARSE_RCU_POINTER=y
# CONFIG_LOCK_STAT is not set
# CONFIG_DEBUG_ATOMIC_SLEEP is not set
# CONFIG_DEBUG_LOCKING_API_SELFTESTS is not set
CONFIG_STACKTRACE=y
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_DEBUG_KOBJECT is not set
# CONFIG_DEBUG_HIGHMEM is not set
# CONFIG_DEBUG_BUGVERBOSE is not set
CONFIG_DEBUG_INFO=y
CONFIG_DEBUG_INFO_REDUCED=y
# CONFIG_DEBUG_VM is not set
# CONFIG_DEBUG_VIRTUAL is not set
# CONFIG_DEBUG_WRITECOUNT is not set
# CONFIG_DEBUG_MEMORY_INIT is not set
# CONFIG_DEBUG_LIST is not set
# CONFIG_TEST_LIST_SORT is not set
# CONFIG_DEBUG_SG is not set
# CONFIG_DEBUG_NOTIFIERS is not set
# CONFIG_DEBUG_CREDENTIALS is not set
CONFIG_ARCH_WANT_FRAME_POINTERS=y
CONFIG_FRAME_POINTER=y
# CONFIG_BOOT_PRINTK_DELAY is not set
# CONFIG_RCU_TORTURE_TEST is not set
CONFIG_RCU_CPU_STALL_TIMEOUT=60
# CONFIG_BACKTRACE_SELF_TEST is not set
# CONFIG_DEBUG_BLOCK_EXT_DEVT is not set
# CONFIG_DEBUG_FORCE_WEAK_PER_CPU is not set
# CONFIG_DEBUG_PER_CPU_MAPS is not set
# CONFIG_LKDTM is not set
# CONFIG_CPU_NOTIFIER_ERROR_INJECT is not set
# CONFIG_FAULT_INJECTION is not set
# CONFIG_LATENCYTOP is not set
# CONFIG_SYSCTL_SYSCALL_CHECK is not set
CONFIG_DEBUG_PAGEALLOC=y
CONFIG_USER_STACKTRACE_SUPPORT=y
CONFIG_NOP_TRACER=y
CONFIG_HAVE_FTRACE_NMI_ENTER=y
CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_FP_TEST=y
CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
CONFIG_HAVE_C_RECORDMCOUNT=y
CONFIG_RING_BUFFER=y
CONFIG_FTRACE_NMI_ENTER=y
CONFIG_EVENT_TRACING=y
CONFIG_EVENT_POWER_TRACING_DEPRECATED=y
CONFIG_CONTEXT_SWITCH_TRACER=y
CONFIG_TRACING=y
CONFIG_GENERIC_TRACER=y
CONFIG_TRACING_SUPPORT=y
CONFIG_FTRACE=y
CONFIG_FUNCTION_TRACER=y
CONFIG_FUNCTION_GRAPH_TRACER=y
# CONFIG_IRQSOFF_TRACER is not set
# CONFIG_SCHED_TRACER is not set
# CONFIG_FTRACE_SYSCALLS is not set
CONFIG_BRANCH_PROFILE_NONE=y
# CONFIG_PROFILE_ANNOTATED_BRANCHES is not set
# CONFIG_PROFILE_ALL_BRANCHES is not set
# CONFIG_STACK_TRACER is not set
# CONFIG_BLK_DEV_IO_TRACE is not set
CONFIG_DYNAMIC_FTRACE=y
# CONFIG_FUNCTION_PROFILER is not set
CONFIG_FTRACE_MCOUNT_RECORD=y
# CONFIG_FTRACE_STARTUP_TEST is not set
# CONFIG_MMIOTRACE is not set
# CONFIG_RING_BUFFER_BENCHMARK is not set
# CONFIG_PROVIDE_OHCI1394_DMA_INIT is not set
# CONFIG_DYNAMIC_DEBUG is not set
# CONFIG_DMA_API_DEBUG is not set
# CONFIG_ATOMIC64_SELFTEST is not set
# CONFIG_SAMPLES is not set
CONFIG_HAVE_ARCH_KGDB=y
# CONFIG_KGDB is not set
CONFIG_HAVE_ARCH_KMEMCHECK=y
# CONFIG_TEST_KSTRTOX is not set
# CONFIG_STRICT_DEVMEM is not set
CONFIG_X86_VERBOSE_BOOTUP=y
# CONFIG_EARLY_PRINTK is not set
# CONFIG_DEBUG_STACKOVERFLOW is not set
# CONFIG_X86_PTDUMP is not set
CONFIG_DEBUG_RODATA=y
CONFIG_DEBUG_RODATA_TEST=y
# CONFIG_DEBUG_SET_MODULE_RONX is not set
# CONFIG_DEBUG_NX_TEST is not set
CONFIG_DOUBLEFAULT=y
# CONFIG_IOMMU_STRESS is not set
CONFIG_HAVE_MMIOTRACE_SUPPORT=y
CONFIG_IO_DELAY_TYPE_0X80=0
CONFIG_IO_DELAY_TYPE_0XED=1
CONFIG_IO_DELAY_TYPE_UDELAY=2
CONFIG_IO_DELAY_TYPE_NONE=3
CONFIG_IO_DELAY_0X80=y
# CONFIG_IO_DELAY_0XED is not set
# CONFIG_IO_DELAY_UDELAY is not set
# CONFIG_IO_DELAY_NONE is not set
CONFIG_DEFAULT_IO_DELAY_TYPE=0
# CONFIG_DEBUG_BOOT_PARAMS is not set
# CONFIG_CPA_DEBUG is not set
# CONFIG_OPTIMIZE_INLINING is not set
# CONFIG_DEBUG_STRICT_USER_COPY_CHECKS is not set
#
# Security options
#
CONFIG_KEYS=y
# CONFIG_ENCRYPTED_KEYS is not set
# CONFIG_KEYS_DEBUG_PROC_KEYS is not set
# CONFIG_SECURITY_DMESG_RESTRICT is not set
# CONFIG_SECURITY is not set
# CONFIG_SECURITYFS is not set
CONFIG_DEFAULT_SECURITY_DAC=y
CONFIG_DEFAULT_SECURITY=""
CONFIG_CRYPTO=y
#
# Crypto core or helper
#
CONFIG_CRYPTO_ALGAPI=y
CONFIG_CRYPTO_ALGAPI2=y
CONFIG_CRYPTO_AEAD=y
CONFIG_CRYPTO_AEAD2=y
CONFIG_CRYPTO_BLKCIPHER=y
CONFIG_CRYPTO_BLKCIPHER2=y
CONFIG_CRYPTO_HASH=y
CONFIG_CRYPTO_HASH2=y
CONFIG_CRYPTO_RNG2=y
CONFIG_CRYPTO_PCOMP2=y
CONFIG_CRYPTO_MANAGER=y
CONFIG_CRYPTO_MANAGER2=y
# CONFIG_CRYPTO_USER is not set
CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y
# CONFIG_CRYPTO_GF128MUL is not set
CONFIG_CRYPTO_NULL=m
# CONFIG_CRYPTO_PCRYPT is not set
CONFIG_CRYPTO_WORKQUEUE=y
# CONFIG_CRYPTO_CRYPTD is not set
CONFIG_CRYPTO_AUTHENC=y
CONFIG_CRYPTO_TEST=m
#
# Authenticated Encryption with Associated Data
#
# CONFIG_CRYPTO_CCM is not set
# CONFIG_CRYPTO_GCM is not set
# CONFIG_CRYPTO_SEQIV is not set
#
# Block modes
#
CONFIG_CRYPTO_CBC=y
# CONFIG_CRYPTO_CTR is not set
# CONFIG_CRYPTO_CTS is not set
CONFIG_CRYPTO_ECB=y
# CONFIG_CRYPTO_LRW is not set
CONFIG_CRYPTO_PCBC=m
# CONFIG_CRYPTO_XTS is not set
#
# Hash modes
#
CONFIG_CRYPTO_HMAC=y
# CONFIG_CRYPTO_XCBC is not set
# CONFIG_CRYPTO_VMAC is not set
#
# Digest
#
CONFIG_CRYPTO_CRC32C=m
# CONFIG_CRYPTO_CRC32C_INTEL is not set
# CONFIG_CRYPTO_GHASH is not set
CONFIG_CRYPTO_MD4=m
CONFIG_CRYPTO_MD5=y
CONFIG_CRYPTO_MICHAEL_MIC=m
# CONFIG_CRYPTO_RMD128 is not set
# CONFIG_CRYPTO_RMD160 is not set
# CONFIG_CRYPTO_RMD256 is not set
# CONFIG_CRYPTO_RMD320 is not set
CONFIG_CRYPTO_SHA1=y
CONFIG_CRYPTO_SHA256=m
CONFIG_CRYPTO_SHA512=m
# CONFIG_CRYPTO_TGR192 is not set
# CONFIG_CRYPTO_WP512 is not set
#
# Ciphers
#
CONFIG_CRYPTO_AES=y
# CONFIG_CRYPTO_AES_586 is not set
# CONFIG_CRYPTO_AES_NI_INTEL is not set
# CONFIG_CRYPTO_ANUBIS is not set
CONFIG_CRYPTO_ARC4=y
CONFIG_CRYPTO_BLOWFISH=m
CONFIG_CRYPTO_BLOWFISH_COMMON=m
# CONFIG_CRYPTO_CAMELLIA is not set
CONFIG_CRYPTO_CAST5=m
CONFIG_CRYPTO_CAST6=m
CONFIG_CRYPTO_DES=y
# CONFIG_CRYPTO_FCRYPT is not set
CONFIG_CRYPTO_KHAZAD=m
# CONFIG_CRYPTO_SALSA20 is not set
# CONFIG_CRYPTO_SALSA20_586 is not set
# CONFIG_CRYPTO_SEED is not set
CONFIG_CRYPTO_SERPENT=m
CONFIG_CRYPTO_TEA=m
CONFIG_CRYPTO_TWOFISH=m
CONFIG_CRYPTO_TWOFISH_COMMON=m
# CONFIG_CRYPTO_TWOFISH_586 is not set
#
# Compression
#
CONFIG_CRYPTO_DEFLATE=y
# CONFIG_CRYPTO_ZLIB is not set
# CONFIG_CRYPTO_LZO is not set
#
# Random Number Generation
#
# CONFIG_CRYPTO_ANSI_CPRNG is not set
# CONFIG_CRYPTO_USER_API_HASH is not set
# CONFIG_CRYPTO_USER_API_SKCIPHER is not set
CONFIG_CRYPTO_HW=y
# CONFIG_CRYPTO_DEV_PADLOCK is not set
# CONFIG_CRYPTO_DEV_GEODE is not set
CONFIG_HAVE_KVM=y
# CONFIG_VIRTUALIZATION is not set
CONFIG_BINARY_PRINTF=y
#
# Library routines
#
CONFIG_BITREVERSE=y
CONFIG_GENERIC_FIND_FIRST_BIT=y
CONFIG_CRC_CCITT=m
# CONFIG_CRC16 is not set
# CONFIG_CRC_T10DIF is not set
CONFIG_CRC_ITU_T=m
CONFIG_CRC32=y
# CONFIG_CRC7 is not set
CONFIG_LIBCRC32C=m
# CONFIG_CRC8 is not set
CONFIG_AUDIT_GENERIC=y
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=y
# CONFIG_XZ_DEC is not set
# CONFIG_XZ_DEC_BCJ is not set
CONFIG_DECOMPRESS_GZIP=y
CONFIG_HAS_IOMEM=y
CONFIG_HAS_IOPORT=y
CONFIG_HAS_DMA=y
CONFIG_CHECK_SIGNATURE=y
CONFIG_CPU_RMAP=y
CONFIG_DQL=y
CONFIG_NLATTR=y
CONFIG_AVERAGE=y
# CONFIG_CORDIC is not set
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 22:23 ` Eric Dumazet
@ 2012-01-10 23:44 ` Linus Torvalds
2012-01-11 6:35 ` David Ahern
` (2 more replies)
0 siblings, 3 replies; 28+ messages in thread
From: Linus Torvalds @ 2012-01-10 23:44 UTC (permalink / raw)
To: Eric Dumazet
Cc: Ingo Molnar, Thomas Gleixner, Peter Zijlstra, Martin Schwidefsky,
linux-kernel, Frederic Weisbecker, Suresh Siddha
On Tue, Jan 10, 2012 at 2:23 PM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
>
> Maybe a recent change in NMI handling, or perf events ?
Unlikely. And it shouldn't show up in the merge commit anyway, those
things should be pretty independent.
> No idea why the bisection (I redid it carefully : same result) points to the above commit.
Ok, so the bisect is almost certainly correct. But just to be anal and
really careful, can you independently check both parents of the merge,
and then re-check the merge itself, and verify that the two parent
commits never hang, and that the merged state hangs.
Just to take any bisection issues out of the picture, and just verify
those three commits by hand.
But in the meantime, we should assume that it's the merge that is the problem.
I added Frederic to the cc, because he did the
tick_nohz_idle_enter_norcu(), so maybe he can tell if there is
something in that merge that looks suspicious (Frederic - see the
history of the thread on lkml. I thought maybe it was the lack of
irq-disable around set_cpu_sd_state_idle(), but Eric already tested
that). And Suresh because he worked on the whole nohz/nr_busy_cpus.
Maybe you guys see some obvious semantic clash..
Anybody? Any ideas? Clearly there can be a merge problem that doesn't
actually show as a real data conflict, just some semantic conflict,
but I don't see what such issues would be brouht in by the scheduler
merge anyway.
Linus
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 23:44 ` Linus Torvalds
@ 2012-01-11 6:35 ` David Ahern
2012-01-11 9:04 ` Peter Zijlstra
2012-01-11 8:22 ` [BUG] kernel freezes with latest tree Eric Dumazet
2012-01-11 14:20 ` Frederic Weisbecker
2 siblings, 1 reply; 28+ messages in thread
From: David Ahern @ 2012-01-11 6:35 UTC (permalink / raw)
To: Linus Torvalds, Eric Dumazet, Peter Zijlstra
Cc: Ingo Molnar, Thomas Gleixner, Martin Schwidefsky, linux-kernel,
Frederic Weisbecker, Suresh Siddha
On 01/10/2012 04:44 PM, Linus Torvalds wrote:
> Anybody? Any ideas? Clearly there can be a merge problem that doesn't
> actually show as a real data conflict, just some semantic conflict,
> but I don't see what such issues would be brouht in by the scheduler
> merge anyway.
This is really easy to reproduce in a KVM hosted VM.
Using the gdb stub one cpu is spinning here:
(gdb) bt
#0 try_to_wake_up (p=0xf529b200, state=<optimized out>, wake_flags=1)
at /mnt/sw/kernel-2.6.git/kernel/sched/core.c:1575
#1 0xc0470ab0 in default_wake_function (curr=<optimized out>,
mode=<optimized out>,
wake_flags=<optimized out>, key=0xc3) at
/mnt/sw/kernel-2.6.git/kernel/sched/core.c:3364
So basically:
while (p->on_cpu) {
...
cpu_relax();
}
And the other vcpu is here:
#0 tg_load_down (tg=0xf55b9c00, data=<optimized out>) at
/mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3351
#1 0xc0470049 in walk_tg_tree_from (from=0xc0ba5400, down=0xc04753c0
<tg_load_down>, up=0xc046a3b0 <tg_nop>,
data=0x0) at /mnt/sw/kernel-2.6.git/kernel/sched/core.c:664
#2 0xc04793f7 in walk_tg_tree (data=<optimized out>, up=<optimized
out>, down=0xc04753c0 <tg_load_down>)
at /mnt/sw/kernel-2.6.git/kernel/sched/sched.h:175
#3 update_h_load (cpu=<optimized out>) at
/mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3361
#4 load_balance_fair (lb_flags=<synthetic pointer>,
idle=CPU_NEWLY_IDLE, sd=0xf5c30800, max_load_move=278,
busiest=0xf6607d00, this_cpu=1, this_rq=0xf6707d00) at
/mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3374
#5 move_tasks (lb_flags=<synthetic pointer>, idle=CPU_NEWLY_IDLE,
sd=0xf5c30800, max_load_move=278,
busiest=<optimized out>, this_cpu=1, this_rq=0xf6707d00)
at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3444
#6 load_balance (this_cpu=1, this_rq=0xf6707d00, sd=0xf5c30800,
idle=CPU_NEWLY_IDLE, balance=0xf5217cb4)
at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:4496
#7 0xc0479be2 in idle_balance (this_cpu=1, this_rq=0xf6707d00)
at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:4640
Based on the file in question (sched/fair.c) I took a stab at guessing
the commit: without a195f004 I was not able to lock it up. With the
patch the VM spins after a few hackbench iterations.
I don't have time for a proper bisect tonight. I can do that in the a.m.
if I am not totally off base here. Peter: any chance this commit could
explain the spinning cpus / system freeze?
David
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 23:44 ` Linus Torvalds
2012-01-11 6:35 ` David Ahern
@ 2012-01-11 8:22 ` Eric Dumazet
2012-01-11 14:20 ` Frederic Weisbecker
2 siblings, 0 replies; 28+ messages in thread
From: Eric Dumazet @ 2012-01-11 8:22 UTC (permalink / raw)
To: Linus Torvalds
Cc: Ingo Molnar, Thomas Gleixner, Peter Zijlstra, Martin Schwidefsky,
linux-kernel, Frederic Weisbecker, Suresh Siddha
Le mardi 10 janvier 2012 à 15:44 -0800, Linus Torvalds a écrit :
> On Tue, Jan 10, 2012 at 2:23 PM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
> >
> > Maybe a recent change in NMI handling, or perf events ?
>
> Unlikely. And it shouldn't show up in the merge commit anyway, those
> things should be pretty independent.
>
> > No idea why the bisection (I redid it carefully : same result) points to the above commit.
>
> Ok, so the bisect is almost certainly correct. But just to be anal and
> really careful, can you independently check both parents of the merge,
> and then re-check the merge itself, and verify that the two parent
> commits never hang, and that the merged state hangs.
>
> Just to take any bisection issues out of the picture, and just verify
> those three commits by hand.
>
> But in the meantime, we should assume that it's the merge that is the problem.
>
> I added Frederic to the cc, because he did the
> tick_nohz_idle_enter_norcu(), so maybe he can tell if there is
> something in that merge that looks suspicious (Frederic - see the
> history of the thread on lkml. I thought maybe it was the lack of
> irq-disable around set_cpu_sd_state_idle(), but Eric already tested
> that). And Suresh because he worked on the whole nohz/nr_busy_cpus.
> Maybe you guys see some obvious semantic clash..
>
> Anybody? Any ideas? Clearly there can be a merge problem that doesn't
> actually show as a real data conflict, just some semantic conflict,
> but I don't see what such issues would be brouht in by the scheduler
> merge anyway.
>
Thanks Linus for all the input.
I'll redo extensive bisection today, waiting at least 30 minutes before
telling a point is good (or not).
Maybe bug can sometime hide a long time before triggering.
[ I'll first make sure 3.2 is rock solid ]
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 6:35 ` David Ahern
@ 2012-01-11 9:04 ` Peter Zijlstra
2012-01-11 10:28 ` Eric Dumazet
2012-01-11 12:25 ` Peter Zijlstra
0 siblings, 2 replies; 28+ messages in thread
From: Peter Zijlstra @ 2012-01-11 9:04 UTC (permalink / raw)
To: David Ahern
Cc: Linus Torvalds, Eric Dumazet, Ingo Molnar, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
On Tue, 2012-01-10 at 23:35 -0700, David Ahern wrote:
> On 01/10/2012 04:44 PM, Linus Torvalds wrote:
> > Anybody? Any ideas? Clearly there can be a merge problem that doesn't
> > actually show as a real data conflict, just some semantic conflict,
> > but I don't see what such issues would be brouht in by the scheduler
> > merge anyway.
>
> This is really easy to reproduce in a KVM hosted VM.
>
> Using the gdb stub one cpu is spinning here:
>
> (gdb) bt
> #0 try_to_wake_up (p=0xf529b200, state=<optimized out>, wake_flags=1)
> at /mnt/sw/kernel-2.6.git/kernel/sched/core.c:1575
> #1 0xc0470ab0 in default_wake_function (curr=<optimized out>,
> mode=<optimized out>,
> wake_flags=<optimized out>, key=0xc3) at
> /mnt/sw/kernel-2.6.git/kernel/sched/core.c:3364
>
> So basically:
> while (p->on_cpu) {
> ...
> cpu_relax();
> }
>
>
> And the other vcpu is here:
>
> #0 tg_load_down (tg=0xf55b9c00, data=<optimized out>) at
> /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3351
> #1 0xc0470049 in walk_tg_tree_from (from=0xc0ba5400, down=0xc04753c0
> <tg_load_down>, up=0xc046a3b0 <tg_nop>,
> data=0x0) at /mnt/sw/kernel-2.6.git/kernel/sched/core.c:664
> #2 0xc04793f7 in walk_tg_tree (data=<optimized out>, up=<optimized
> out>, down=0xc04753c0 <tg_load_down>)
> at /mnt/sw/kernel-2.6.git/kernel/sched/sched.h:175
> #3 update_h_load (cpu=<optimized out>) at
> /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3361
> #4 load_balance_fair (lb_flags=<synthetic pointer>,
> idle=CPU_NEWLY_IDLE, sd=0xf5c30800, max_load_move=278,
> busiest=0xf6607d00, this_cpu=1, this_rq=0xf6707d00) at
> /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3374
> #5 move_tasks (lb_flags=<synthetic pointer>, idle=CPU_NEWLY_IDLE,
> sd=0xf5c30800, max_load_move=278,
> busiest=<optimized out>, this_cpu=1, this_rq=0xf6707d00)
> at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3444
> #6 load_balance (this_cpu=1, this_rq=0xf6707d00, sd=0xf5c30800,
> idle=CPU_NEWLY_IDLE, balance=0xf5217cb4)
> at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:4496
> #7 0xc0479be2 in idle_balance (this_cpu=1, this_rq=0xf6707d00)
> at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:4640
>
>
> Based on the file in question (sched/fair.c) I took a stab at guessing
> the commit: without a195f004 I was not able to lock it up. With the
> patch the VM spins after a few hackbench iterations.
>
> I don't have time for a proper bisect tonight. I can do that in the a.m.
> if I am not totally off base here. Peter: any chance this commit could
> explain the spinning cpus / system freeze?
It could, I certainly ran into similar issues while developing that
patch. I ran into all sorts of weird stuff but had hoped I'd cured all
of it.
If Eric can confirm this is indeed what is causing his pain, I'm fine
with reverting it and having another go at it later. How easy is it to
reproduce using your KVM thing?
I think simply replacing the one |= LBF_NEED_BREAK with a LBF_ABORT or
removing that condition all-together should make the hang go away.
I'll try and figure out how it ends up in the infinite retry loop after
my brain wakes up a bit more. Maybe adding a few more NEED_BREAK bits
and making it a counter and overflowing it into ABORT might be good.
/me off to get breakfast and morning-juice..
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 9:04 ` Peter Zijlstra
@ 2012-01-11 10:28 ` Eric Dumazet
2012-01-11 11:29 ` Eric Dumazet
2012-01-11 12:25 ` Peter Zijlstra
1 sibling, 1 reply; 28+ messages in thread
From: Eric Dumazet @ 2012-01-11 10:28 UTC (permalink / raw)
To: Peter Zijlstra
Cc: David Ahern, Linus Torvalds, Ingo Molnar, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
Le mercredi 11 janvier 2012 à 10:04 +0100, Peter Zijlstra a écrit :
> On Tue, 2012-01-10 at 23:35 -0700, David Ahern wrote:
> > On 01/10/2012 04:44 PM, Linus Torvalds wrote:
> > > Anybody? Any ideas? Clearly there can be a merge problem that doesn't
> > > actually show as a real data conflict, just some semantic conflict,
> > > but I don't see what such issues would be brouht in by the scheduler
> > > merge anyway.
> >
> > This is really easy to reproduce in a KVM hosted VM.
> >
> > Using the gdb stub one cpu is spinning here:
> >
> > (gdb) bt
> > #0 try_to_wake_up (p=0xf529b200, state=<optimized out>, wake_flags=1)
> > at /mnt/sw/kernel-2.6.git/kernel/sched/core.c:1575
> > #1 0xc0470ab0 in default_wake_function (curr=<optimized out>,
> > mode=<optimized out>,
> > wake_flags=<optimized out>, key=0xc3) at
> > /mnt/sw/kernel-2.6.git/kernel/sched/core.c:3364
> >
> > So basically:
> > while (p->on_cpu) {
> > ...
> > cpu_relax();
> > }
> >
> >
> > And the other vcpu is here:
> >
> > #0 tg_load_down (tg=0xf55b9c00, data=<optimized out>) at
> > /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3351
> > #1 0xc0470049 in walk_tg_tree_from (from=0xc0ba5400, down=0xc04753c0
> > <tg_load_down>, up=0xc046a3b0 <tg_nop>,
> > data=0x0) at /mnt/sw/kernel-2.6.git/kernel/sched/core.c:664
> > #2 0xc04793f7 in walk_tg_tree (data=<optimized out>, up=<optimized
> > out>, down=0xc04753c0 <tg_load_down>)
> > at /mnt/sw/kernel-2.6.git/kernel/sched/sched.h:175
> > #3 update_h_load (cpu=<optimized out>) at
> > /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3361
> > #4 load_balance_fair (lb_flags=<synthetic pointer>,
> > idle=CPU_NEWLY_IDLE, sd=0xf5c30800, max_load_move=278,
> > busiest=0xf6607d00, this_cpu=1, this_rq=0xf6707d00) at
> > /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3374
> > #5 move_tasks (lb_flags=<synthetic pointer>, idle=CPU_NEWLY_IDLE,
> > sd=0xf5c30800, max_load_move=278,
> > busiest=<optimized out>, this_cpu=1, this_rq=0xf6707d00)
> > at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:3444
> > #6 load_balance (this_cpu=1, this_rq=0xf6707d00, sd=0xf5c30800,
> > idle=CPU_NEWLY_IDLE, balance=0xf5217cb4)
> > at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:4496
> > #7 0xc0479be2 in idle_balance (this_cpu=1, this_rq=0xf6707d00)
> > at /mnt/sw/kernel-2.6.git/kernel/sched/fair.c:4640
> >
> >
> > Based on the file in question (sched/fair.c) I took a stab at guessing
> > the commit: without a195f004 I was not able to lock it up. With the
> > patch the VM spins after a few hackbench iterations.
> >
> > I don't have time for a proper bisect tonight. I can do that in the a.m.
> > if I am not totally off base here. Peter: any chance this commit could
> > explain the spinning cpus / system freeze?
>
> It could, I certainly ran into similar issues while developing that
> patch. I ran into all sorts of weird stuff but had hoped I'd cured all
> of it.
>
> If Eric can confirm this is indeed what is causing his pain, I'm fine
> with reverting it and having another go at it later. How easy is it to
> reproduce using your KVM thing?
>
> I think simply replacing the one |= LBF_NEED_BREAK with a LBF_ABORT or
> removing that condition all-together should make the hang go away.
>
> I'll try and figure out how it ends up in the infinite retry loop after
> my brain wakes up a bit more. Maybe adding a few more NEED_BREAK bits
> and making it a counter and overflowing it into ABORT might be good.
>
> /me off to get breakfast and morning-juice..
>
I let my machine run 3.2 kernel for 37 minutes with no hang, so at least
we know there is no hardware glitch.
$ uptime
11:26:45 up 37 min, 2 users, load average: 201.80, 206.06, 170.68
I'll try now latest tree with a195f004 reverted.
Thanks
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 10:28 ` Eric Dumazet
@ 2012-01-11 11:29 ` Eric Dumazet
0 siblings, 0 replies; 28+ messages in thread
From: Eric Dumazet @ 2012-01-11 11:29 UTC (permalink / raw)
To: Peter Zijlstra
Cc: David Ahern, Linus Torvalds, Ingo Molnar, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
Le mercredi 11 janvier 2012 à 11:28 +0100, Eric Dumazet a écrit :
> I let my machine run 3.2 kernel for 37 minutes with no hang, so at least
> we know there is no hardware glitch.
>
> $ uptime
> 11:26:45 up 37 min, 2 users, load average: 201.80, 206.06, 170.68
>
> I'll try now latest tree with a195f004 reverted.
So the revert of a195f004 seems to solve the problem here.
$ uptime
12:19:55 up 39 min, 2 users, load average: 191.05, 200.91, 183.59
While vanilla current tree freezes in less than 15 seconds.
$ while :; do hackbench 10 thread 1000; done
Running with 10*40 (== 400) tasks.
Time: 3.035
Running with 10*40 (== 400) tasks.
Time: 3.045
Running with 10*40 (== 400) tasks.
Time: 3.089
Running with 10*40 (== 400) tasks.
Time: 2.995
Running with 10*40 (== 400) tasks.
<hang>
[ 79.182001] ------------[ cut here ]------------
[ 79.182001] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 79.182001] Hardware name: ProLiant BL460c G1
[ 79.182001] Watchdog detected hard LOCKUP on cpu 0
[ 79.182001] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 79.182001] Pid: 6948, comm: hackbench Not tainted 3.2.0-06100-ge343a89 #12
[ 79.182001] Call Trace:
[ 79.182001] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 79.182001] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.182001] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.182001] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 79.182001] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 79.182001] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 79.182001] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 79.182001] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 79.182001] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 79.182001] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 79.182001] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.182001] ------------[ cut here ]------------
[ 79.182001] WARNING: at kernel/softirq.c:159 local_bh_enable_ip+0x60/0x90()
[ 79.182001] Hardware name: ProLiant BL460c G1
[ 79.182001] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 79.182001] Pid: 6948, comm: hackbench Not tainted 3.2.0-06100-ge343a89 #12
[ 79.182001] Call Trace:
[ 79.182001] [<c05ffeba>] ? printk+0x1d/0x1f
[ 79.182001] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 79.182001] [<c022f8c0>] ? local_bh_enable_ip+0x60/0x90
[ 79.182001] [<c022f8c0>] ? local_bh_enable_ip+0x60/0x90
[ 79.182001] [<c0229c92>] warn_slowpath_null+0x22/0x30
[ 79.182001] [<c022f8c0>] local_bh_enable_ip+0x60/0x90
[ 79.182001] [<c0606683>] _raw_spin_unlock_bh+0x13/0x20
[ 79.182001] [<c046cc29>] bnx2_reg_rd_ind+0x39/0x50
[ 79.182001] [<c046cc53>] bnx2_shmem_rd+0x13/0x20
[ 79.182001] [<c0477a53>] bnx2_poll+0x103/0x1f0
[ 79.182001] [<c046ff33>] ? poll_bnx2+0x73/0x90
[ 79.182001] [<c04e9ee1>] netpoll_poll_dev.part.26+0x3d1/0x4d0
[ 79.182001] [<c02e7cdd>] ? __kmalloc_node_track_caller+0x2d/0x1f0
[ 79.182001] [<c04cbec1>] ? __alloc_skb+0x31/0x220
[ 79.182001] [<c04ea195>] netpoll_send_skb_on_dev+0x1b5/0x200
[ 79.182001] [<c04cbef9>] ? __alloc_skb+0x69/0x220
[ 79.182001] [<c04e9aad>] ? find_skb.isra.27+0x3d/0xa0
[ 79.182001] [<c04ea3a3>] netpoll_send_udp+0x1c3/0x1e0
[ 79.182001] [<f868321c>] write_msg+0x8c/0xb4 [netconsole]
[ 79.182001] [<f8683190>] ? netconsole_netdev_event+0x190/0x190 [netconsole]
[ 79.182001] [<c0229dcd>] __call_console_drivers+0x7d/0x90
[ 79.182001] [<c0229ffd>] _call_console_drivers+0x4d/0x90
[ 79.182001] [<c022a2c3>] console_unlock+0xf3/0x230
[ 79.182001] [<c022a7bb>] vprintk+0x2db/0x3f0
[ 79.182001] [<c024fb9a>] ? up+0x2a/0x40
[ 79.182001] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.182001] [<c05ffeba>] printk+0x1d/0x1f
[ 79.182001] [<c02055e2>] printk_address+0x32/0x40
[ 79.182001] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.182001] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.182001] [<c0205620>] print_trace_address+0x30/0x40
[ 79.182001] [<c020552c>] print_context_stack+0x7c/0x100
[ 79.182001] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.182001] [<c02045cf>] dump_trace+0x7f/0xf0
[ 79.182001] [<c020567c>] show_trace_log_lvl+0x4c/0x60
[ 79.182001] [<c02056af>] show_trace+0x1f/0x30
[ 79.182001] [<c05feebb>] dump_stack+0x73/0x7a
[ 79.182001] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 79.182001] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.182001] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.182001] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 79.182001] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 79.182001] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 79.182001] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 79.182001] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 79.182001] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 79.182001] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 79.182001] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.182001] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 79.182001] [<c0205bf7>] do_nmi+0xc7/0x380
[ 79.182001] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 79.182001] [<c06064a2>] ? _raw_spin_lock+0x22/0x30
[ 79.182001] [<c025dc90>] load_balance+0x1a0/0x510
[ 79.182001] [<c025e21a>] idle_balance+0xca/0x140
[ 79.182001] [<c0605ae4>] __schedule+0x4c4/0x640
[ 79.182001] [<c033b5db>] ? proc_flush_task+0xcb/0x1a0
[ 79.182001] [<c02857d2>] ? call_rcu_sched+0x12/0x20
[ 79.182001] [<c022bae0>] ? allow_signal+0x70/0x70
[ 79.182001] [<c02857d2>] ? call_rcu_sched+0x12/0x20
[ 79.182001] [<c022be31>] ? release_task+0x1e1/0x320
[ 79.182001] [<c0605d15>] schedule+0x35/0x50
[ 79.182001] [<c022d14f>] do_exit+0x4ef/0x750
[ 79.182001] [<c02ebdc7>] ? vfs_write+0xf7/0x150
[ 79.182001] [<c022d608>] sys_exit+0x18/0x20
[ 79.182001] [<c060685d>] syscall_call+0x7/0xb
[ 79.182001] ---[ end trace 3d1cedd589a9a5c3 ]---
[ 79.182001] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 79.182001] [<c0205bf7>] do_nmi+0xc7/0x380
[ 79.182001] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 79.182001] [<c06064a2>] ? _raw_spin_lock+0x22/0x30
[ 79.182001] [<c025dc90>] load_balance+0x1a0/0x510
[ 79.182001] [<c025e21a>] idle_balance+0xca/0x140
[ 79.182001] [<c0605ae4>] __schedule+0x4c4/0x640
[ 79.182001] [<c033b5db>] ? proc_flush_task+0xcb/0x1a0
[ 79.182001] [<c02857d2>] ? call_rcu_sched+0x12/0x20
[ 79.182001] [<c022bae0>] ? allow_signal+0x70/0x70
[ 79.182001] [<c02857d2>] ? call_rcu_sched+0x12/0x20
[ 79.182001] [<c022be31>] ? release_task+0x1e1/0x320
[ 79.182001] [<c0605d15>] schedule+0x35/0x50
[ 79.182001] [<c022d14f>] do_exit+0x4ef/0x750
[ 79.182001] [<c02ebdc7>] ? vfs_write+0xf7/0x150
[ 79.182001] [<c022d608>] sys_exit+0x18/0x20
[ 79.182001] [<c060685d>] syscall_call+0x7/0xb
[ 79.182001] ---[ end trace 3d1cedd589a9a5c4 ]---
[ 79.089368] ------------[ cut here ]------------
[ 79.089368] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 79.089368] Hardware name: ProLiant BL460c G1
[ 79.089368] Watchdog detected hard LOCKUP on cpu 1
[ 79.089368] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 79.089368] Pid: 4211, comm: Com Tainted: G W 3.2.0-06100-ge343a89 #12
[ 79.089368] Call Trace:
[ 79.089368] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 79.089368] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.089368] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.089368] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 79.089368] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 79.089368] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 79.089368] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 79.089368] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 79.089368] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 79.089368] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 79.089368] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.089368] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 79.089368] [<c0205bf7>] do_nmi+0xc7/0x380
[ 79.089368] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 79.089368] [<c06064a0>] ? _raw_spin_lock+0x20/0x30
[ 79.089368] [<c025dc90>] load_balance+0x1a0/0x510
[ 79.089368] [<c025e21a>] idle_balance+0xca/0x140
[ 79.089368] [<c0605ae4>] __schedule+0x4c4/0x640
[ 79.089368] [<c03ae010>] ? timerqueue_add+0x60/0xc0
[ 79.089368] [<c024e990>] ? __hrtimer_start_range_ns+0x160/0x3f0
[ 79.089368] [<c0605d15>] schedule+0x35/0x50
[ 79.089368] [<c0604f67>] schedule_hrtimeout_range_clock+0xc7/0x180
[ 79.089368] [<c024df10>] ? update_rmtp+0x80/0x80
[ 79.089368] [<c024ec76>] ? hrtimer_start_range_ns+0x26/0x30
[ 79.089368] [<c0605037>] schedule_hrtimeout_range+0x17/0x20
[ 79.089368] [<c02fbe8e>] poll_schedule_timeout+0x3e/0x60
[ 79.089368] [<c02fc796>] do_select+0x566/0x680
[ 79.089368] [<c02fbf70>] ? poll_freewait+0xc0/0xc0
[ 79.089368] [<c02fc040>] ? __pollwait+0xd0/0xd0
[ 79.089368] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.089368] [<c025c13c>] ? sched_slice.isra.47+0x5c/0xb0
[ 79.089368] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.089368] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.089368] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.089368] [<c025ada7>] ? sched_clock_cpu+0xd7/0x160
[ 79.089368] [<c0256c42>] ? activate_task+0x42/0x50
[ 79.089368] [<c022ffb2>] ? irq_exit+0x62/0x80
[ 79.089368] [<c02573cd>] ? scheduler_ipi+0x2d/0x40
[ 79.089368] [<c021ad87>] ? smp_reschedule_interrupt+0x27/0x30
[ 79.089368] [<c060699e>] ? reschedule_interrupt+0x2a/0x30
[ 79.089368] [<c02fca35>] core_sys_select+0x185/0x260
[ 79.089368] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.089368] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.089368] [<c0263332>] ? ktime_get_ts+0xe2/0x110
[ 79.089368] [<c0263332>] ? ktime_get_ts+0xe2/0x110
[ 79.089368] [<c02fcb94>] sys_select+0x84/0xb0
[ 79.089368] [<c060750c>] sysenter_do_call+0x12/0x22
[ 79.089368] ---[ end trace 3d1cedd589a9a5c5 ]---
[ 79.604813] ------------[ cut here ]------------
[ 79.604813] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 79.604813] Hardware name: ProLiant BL460c G1
[ 79.604813] Watchdog detected hard LOCKUP on cpu 5
[ 79.604813] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 79.604813] Pid: 7117, comm: hackbench Tainted: G W 3.2.0-06100-ge343a89 #12
[ 79.604813] Call Trace:
[ 79.604813] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 79.604813] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.604813] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.604813] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 79.604813] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 79.604813] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 79.604813] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 79.604813] [<c025c13c>] ? sched_slice.isra.47+0x5c/0xb0
[ 79.604813] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 79.604813] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 79.604813] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 79.604813] [<c03ae010>] ? timerqueue_add+0x60/0xc0
[ 79.604813] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.604813] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 79.604813] [<c0205bf7>] do_nmi+0xc7/0x380
[ 79.604813] [<c025ada7>] ? sched_clock_cpu+0xd7/0x160
[ 79.604813] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 79.604813] [<c02591fa>] ? try_to_wake_up+0x9a/0x210
[ 79.604813] [<c0259380>] default_wake_function+0x10/0x20
[ 79.604813] [<c024a950>] autoremove_wake_function+0x20/0x50
[ 79.604813] [<c0251df7>] __wake_up_common+0x47/0x70
[ 79.604813] [<c0252d63>] __wake_up_sync_key+0x43/0x60
[ 79.604813] [<c05589b9>] unix_write_space+0x49/0x80
[ 79.604813] [<c04c7d6a>] sock_wfree+0x4a/0x60
[ 79.604813] [<c0558eba>] unix_destruct_scm+0x7a/0x90
[ 79.604813] [<c04cc88d>] skb_release_head_state+0x4d/0xe0
[ 79.604813] [<c04cc690>] __kfree_skb+0x10/0x90
[ 79.604813] [<c04cc73b>] consume_skb+0x2b/0x90
[ 79.604813] [<c05590b9>] unix_stream_recvmsg+0x1e9/0x590
[ 79.604813] [<c04c4ffc>] sock_aio_read+0xec/0x100
[ 79.604813] [<c02eb42c>] do_sync_read+0xac/0xe0
[ 79.604813] [<c033b5db>] ? proc_flush_task+0xcb/0x1a0
[ 79.604813] [<c02857d2>] ? call_rcu_sched+0x12/0x20
[ 79.604813] [<c02ebf51>] vfs_read+0x131/0x150
[ 79.604813] [<c02ebfad>] sys_read+0x3d/0x70
[ 79.604813] [<c060750c>] sysenter_do_call+0x12/0x22
[ 79.604813] ---[ end trace 3d1cedd589a9a5c6 ]---
[ 79.101000] ------------[ cut here ]------------
[ 79.101000] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 79.101000] Hardware name: ProLiant BL460c G1
[ 79.101000] Watchdog detected hard LOCKUP on cpu 2
[ 79.101000] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 79.101000] Pid: 7152, comm: hackbench Tainted: G W 3.2.0-06100-ge343a89 #12
[ 79.101000] Call Trace:
[ 79.101000] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 79.101000] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.101000] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.101000] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 79.101000] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 79.101000] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 79.101000] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 79.101000] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 79.101000] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 79.101000] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 79.101000] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.101000] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 79.101000] [<c0205bf7>] do_nmi+0xc7/0x380
[ 79.101000] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 79.101000] [<c06064a5>] ? _raw_spin_lock+0x25/0x30
[ 79.101000] [<c025dc90>] load_balance+0x1a0/0x510
[ 79.101000] [<c025e21a>] idle_balance+0xca/0x140
[ 79.101000] [<c0605ae4>] __schedule+0x4c4/0x640
[ 79.101000] [<c025ada7>] ? sched_clock_cpu+0xd7/0x160
[ 79.101000] [<c0605d15>] schedule+0x35/0x50
[ 79.101000] [<c0604615>] schedule_timeout+0x1e5/0x260
[ 79.101000] [<c04c79a4>] ? sock_alloc_send_pskb+0x164/0x280
[ 79.101000] [<c0607c09>] ? smp_apic_timer_interrupt+0x59/0x88
[ 79.101000] [<c024a798>] ? prepare_to_wait+0x48/0x70
[ 79.101000] [<c04c795d>] sock_alloc_send_pskb+0x11d/0x280
[ 79.101000] [<c024a930>] ? abort_exclusive_wait+0x80/0x80
[ 79.101000] [<c04c7add>] sock_alloc_send_skb+0x1d/0x30
[ 79.101000] [<c0559def>] unix_stream_sendmsg+0x31f/0x420
[ 79.101000] [<c04c50ed>] sock_aio_write+0xdd/0xf0
[ 79.101000] [<c03ae010>] ? timerqueue_add+0x60/0xc0
[ 79.101000] [<c02eb34c>] do_sync_write+0xac/0xe0
[ 79.101000] [<c02ebe01>] vfs_write+0x131/0x150
[ 79.101000] [<c02ec01d>] sys_write+0x3d/0x70
[ 79.101000] [<c060750c>] sysenter_do_call+0x12/0x22
[ 79.101000] ---[ end trace 3d1cedd589a9a5c7 ]---
[ 79.185336] ------------[ cut here ]------------
[ 79.185336] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 79.185336] Hardware name: ProLiant BL460c G1
[ 79.185336] Watchdog detected hard LOCKUP on cpu 4
[ 79.185336] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 79.185336] Pid: 4915, comm: IVR Tainted: G W 3.2.0-06100-ge343a89 #12
[ 79.185336] Call Trace:
[ 79.185336] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 79.185336] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.185336] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.185336] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 79.185336] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 79.185336] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 79.185336] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 79.185336] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 79.185336] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 79.185336] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 79.185336] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.185336] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 79.185336] [<c0205bf7>] do_nmi+0xc7/0x380
[ 79.185336] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 79.185336] [<c06064a5>] ? _raw_spin_lock+0x25/0x30
[ 79.185336] [<c025dc90>] load_balance+0x1a0/0x510
[ 79.185336] [<c025e21a>] idle_balance+0xca/0x140
[ 79.185336] [<c0605ae4>] __schedule+0x4c4/0x640
[ 79.185336] [<c03ae010>] ? timerqueue_add+0x60/0xc0
[ 79.185336] [<c024e990>] ? __hrtimer_start_range_ns+0x160/0x3f0
[ 79.185336] [<c022ffb2>] ? irq_exit+0x62/0x80
[ 79.185336] [<c0605d15>] schedule+0x35/0x50
[ 79.185336] [<c0604f67>] schedule_hrtimeout_range_clock+0xc7/0x180
[ 79.185336] [<c024df10>] ? update_rmtp+0x80/0x80
[ 79.185336] [<c024ec76>] ? hrtimer_start_range_ns+0x26/0x30
[ 79.185336] [<c0605037>] schedule_hrtimeout_range+0x17/0x20
[ 79.185336] [<c02fbe8e>] poll_schedule_timeout+0x3e/0x60
[ 79.185336] [<c02fc796>] do_select+0x566/0x680
[ 79.185336] [<c02fbf70>] ? poll_freewait+0xc0/0xc0
[ 79.185336] [<c02fc040>] ? __pollwait+0xd0/0xd0
[ 79.185336] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.185336] [<c025ada7>] ? sched_clock_cpu+0xd7/0x160
[ 79.185336] [<c025c13c>] ? sched_slice.isra.47+0x5c/0xb0
[ 79.185336] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.185336] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.185336] [<c025ada7>] ? sched_clock_cpu+0xd7/0x160
[ 79.185336] [<c025bfaf>] ? check_preempt_wakeup+0xaf/0x1e0
[ 79.185336] [<c0256d82>] ? check_preempt_curr+0x72/0x90
[ 79.185336] [<c0256dc8>] ? ttwu_do_wakeup+0x28/0x130
[ 79.185336] [<c0256c42>] ? activate_task+0x42/0x50
[ 79.185336] [<c02fca35>] core_sys_select+0x185/0x260
[ 79.185336] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.185336] [<c0263332>] ? ktime_get_ts+0xe2/0x110
[ 79.185336] [<c0263332>] ? ktime_get_ts+0xe2/0x110
[ 79.185336] [<c02fcb94>] sys_select+0x84/0xb0
[ 79.185336] [<c060750c>] sysenter_do_call+0x12/0x22
[ 79.185336] [<c0600000>] ? retarget_shared_pending+0x10/0xa1
[ 79.185336] ---[ end trace 3d1cedd589a9a5c8 ]---
[ 80.035202] ------------[ cut here ]------------
[ 80.035202] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 80.035202] Hardware name: ProLiant BL460c G1
[ 80.035202] Watchdog detected hard LOCKUP on cpu 3
[ 80.035202] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 80.035202] Pid: 6858, comm: hackbench Tainted: G W 3.2.0-06100-ge343a89 #12
[ 80.035202] Call Trace:
[ 80.035202] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 80.035202] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 80.035202] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 80.035202] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 80.035202] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 80.035202] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 80.035202] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 80.035202] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 80.035202] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 80.035202] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 80.035202] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 80.035202] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 80.035202] [<c0205bf7>] do_nmi+0xc7/0x380
[ 80.035202] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 80.035202] [<c06064a5>] ? _raw_spin_lock+0x25/0x30
[ 80.035202] [<c025dc90>] load_balance+0x1a0/0x510
[ 80.035202] [<c025e21a>] idle_balance+0xca/0x140
[ 80.035202] [<c0605ae4>] __schedule+0x4c4/0x640
[ 80.035202] [<c033b5db>] ? proc_flush_task+0xcb/0x1a0
[ 80.035202] [<c02857d2>] ? call_rcu_sched+0x12/0x20
[ 80.035202] [<c022bae0>] ? allow_signal+0x70/0x70
[ 80.035202] [<c02857d2>] ? call_rcu_sched+0x12/0x20
[ 80.035202] [<c022be31>] ? release_task+0x1e1/0x320
[ 80.035202] [<c0605d15>] schedule+0x35/0x50
[ 80.035202] [<c022d14f>] do_exit+0x4ef/0x750
[ 80.035202] [<c02ebdc7>] ? vfs_write+0xf7/0x150
[ 80.035202] [<c022d608>] sys_exit+0x18/0x20
[ 80.035202] [<c060685d>] syscall_call+0x7/0xb
[ 80.035202] ---[ end trace 3d1cedd589a9a5c9 ]---
[ 80.040000] ------------[ cut here ]------------
[ 80.040000] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 80.040000] Hardware name: ProLiant BL460c G1
[ 80.040000] Watchdog detected hard LOCKUP on cpu 7
[ 80.040000] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 80.040000] Pid: 6799, comm: hackbench Tainted: G W 3.2.0-06100-ge343a89 #12
[ 80.040000] Call Trace:
[ 80.040000] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 80.040000] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 80.040000] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 80.040000] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 80.040000] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 80.040000] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 80.040000] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 80.040000] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 80.040000] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 80.040000] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 80.040000] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 80.040000] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 80.040000] [<c0205bf7>] do_nmi+0xc7/0x380
[ 80.040000] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 80.040000] [<c06064a2>] ? _raw_spin_lock+0x22/0x30
[ 80.040000] [<c025de4c>] load_balance+0x35c/0x510
[ 80.040000] [<c025e21a>] idle_balance+0xca/0x140
[ 80.040000] [<c0605ae4>] __schedule+0x4c4/0x640
[ 80.040000] [<c06023ee>] ? __slab_free+0x162/0x23a
[ 80.040000] [<c0605d15>] schedule+0x35/0x50
[ 80.040000] [<c0604615>] schedule_timeout+0x1e5/0x260
[ 80.040000] [<c02e5202>] ? kmem_cache_free+0x102/0x110
[ 80.040000] [<c04cc6bd>] ? __kfree_skb+0x3d/0x90
[ 80.040000] [<c04cc6bd>] ? __kfree_skb+0x3d/0x90
[ 80.040000] [<c04cc6bd>] ? __kfree_skb+0x3d/0x90
[ 80.040000] [<c024a798>] ? prepare_to_wait+0x48/0x70
[ 80.040000] [<c0559259>] unix_stream_recvmsg+0x389/0x590
[ 80.040000] [<c03b2535>] ? _copy_from_user+0x35/0x50
[ 80.040000] [<c024a930>] ? abort_exclusive_wait+0x80/0x80
[ 80.040000] [<c04c4ffc>] sock_aio_read+0xec/0x100
[ 80.040000] [<c025ada7>] ? sched_clock_cpu+0xd7/0x160
[ 80.040000] [<c02eb42c>] do_sync_read+0xac/0xe0
[ 80.040000] [<c06070ba>] ? apic_timer_interrupt+0x2a/0x30
[ 80.040000] [<c02ebf51>] vfs_read+0x131/0x150
[ 80.040000] [<c02ebfad>] sys_read+0x3d/0x70
[ 80.040000] [<c060750c>] sysenter_do_call+0x12/0x22
[ 80.040000] ---[ end trace 3d1cedd589a9a5ca ]---
[ 79.100002] ------------[ cut here ]------------
[ 79.100002] WARNING: at kernel/watchdog.c:241 watchdog_overflow_callback+0x9c/0xc0()
[ 79.100002] Hardware name: ProLiant BL460c G1
[ 79.100002] Watchdog detected hard LOCKUP on cpu 6
[ 79.100002] Modules linked in: netconsole xt_hashlimit af_packet tg3 bonding
[ 79.100002] Pid: 7153, comm: hackbench Tainted: G W 3.2.0-06100-ge343a89 #12
[ 79.100002] Call Trace:
[ 79.100002] [<c0229c42>] warn_slowpath_common+0x72/0xa0
[ 79.100002] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.100002] [<c027f31c>] ? watchdog_overflow_callback+0x9c/0xc0
[ 79.100002] [<c027f280>] ? touch_nmi_watchdog+0x70/0x70
[ 79.100002] [<c0229d13>] warn_slowpath_fmt+0x33/0x40
[ 79.100002] [<c027f31c>] watchdog_overflow_callback+0x9c/0xc0
[ 79.100002] [<c02a72d5>] __perf_event_overflow+0x95/0x220
[ 79.100002] [<c0210039>] ? x86_perf_event_set_period+0x119/0x210
[ 79.100002] [<c02a7b25>] perf_event_overflow+0x15/0x20
[ 79.100002] [<c0213545>] intel_pmu_handle_irq+0x125/0x260
[ 79.100002] [<c025d1a0>] ? find_busiest_group+0x150/0xaa0
[ 79.100002] [<c020f330>] perf_event_nmi_handler+0x20/0x30
[ 79.100002] [<c0205bf7>] do_nmi+0xc7/0x380
[ 79.100002] [<c0607359>] nmi_stack_correct+0x28/0x2d
[ 79.100002] [<c06064a5>] ? _raw_spin_lock+0x25/0x30
[ 79.100002] [<c025de4c>] load_balance+0x35c/0x510
[ 79.100002] [<c025e21a>] idle_balance+0xca/0x140
[ 79.100002] [<c0605ae4>] __schedule+0x4c4/0x640
[ 79.100002] [<c025ada7>] ? sched_clock_cpu+0xd7/0x160
[ 79.100002] [<c0605d15>] schedule+0x35/0x50
[ 79.100002] [<c0604615>] schedule_timeout+0x1e5/0x260
[ 79.100002] [<c04c79a4>] ? sock_alloc_send_pskb+0x164/0x280
[ 79.100002] [<c0607c09>] ? smp_apic_timer_interrupt+0x59/0x88
[ 79.100002] [<c024a798>] ? prepare_to_wait+0x48/0x70
[ 79.100002] [<c04c795d>] sock_alloc_send_pskb+0x11d/0x280
[ 79.100002] [<c024a930>] ? abort_exclusive_wait+0x80/0x80
[ 79.100002] [<c04c7add>] sock_alloc_send_skb+0x1d/0x30
[ 79.100002] [<c0559def>] unix_stream_sendmsg+0x31f/0x420
[ 79.100002] [<c04c50ed>] sock_aio_write+0xdd/0xf0
[ 79.100002] [<c025ab5b>] ? sched_clock_local+0xcb/0x1d0
[ 79.100002] [<c02eb34c>] do_sync_write+0xac/0xe0
[ 79.100002] [<c03abdcc>] ? rb_insert_color+0x7c/0x110
[ 79.100002] [<c02ebe01>] vfs_write+0x131/0x150
[ 79.100002] [<c02ec01d>] sys_write+0x3d/0x70
[ 79.100002] [<c060750c>] sysenter_do_call+0x12/0x22
[ 79.100002] ---[ end trace 3d1cedd589a9a5cb ]---
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 9:04 ` Peter Zijlstra
2012-01-11 10:28 ` Eric Dumazet
@ 2012-01-11 12:25 ` Peter Zijlstra
2012-01-11 13:24 ` Eric Dumazet
2012-01-11 15:56 ` Ingo Molnar
1 sibling, 2 replies; 28+ messages in thread
From: Peter Zijlstra @ 2012-01-11 12:25 UTC (permalink / raw)
To: David Ahern
Cc: Linus Torvalds, Eric Dumazet, Ingo Molnar, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
On Wed, 2012-01-11 at 10:04 +0100, Peter Zijlstra wrote:
> Maybe adding a few more NEED_BREAK bits
> and making it a counter and overflowing it into ABORT might be good.
>
>
I could reproduce and confirm something like the below makes the hang
go-away. I haven't managed to fully understand why we're stuck though
because we do release the runqueue locks and re-enable IRQs on this
lock-break.
My stuck machine had several CPUs stuck in a load-balance pass, so it
could be they're bouncing tasks back and forth without actually making
any progress what so ever.
I reproduced with hackbench 500, which results in 20000 tasks, spread
over 24 cpus that gives some 833 tasks per runqueue on average, easily
overflowing that lock-break scanning limit.
---
Subject: sched: Limit load-balance retries on lock-break
From: Peter Zijlstra <a.p.zijlstra@chello.nl>
Date: Wed Jan 11 13:11:12 CET 2012
Eric and David reported dead machines and traced it to commit a195f004 ("sched:
Fix load-balance lock-breaking"), it turns out there's still a
scenario where we can end up re-trying forever.
Limit the number of retries and simply abort.
Reported-by: Eric Dumazet <eric.dumazet@gmail.com>
Reported-by: David Ahern <dsahern@gmail.com>
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
---
kernel/sched/fair.c | 9 +++++++--
1 file changed, 7 insertions(+), 2 deletions(-)
--- a/kernel/sched/fair.c
+++ b/kernel/sched/fair.c
@@ -3130,8 +3130,10 @@ task_hot(struct task_struct *p, u64 now,
}
#define LBF_ALL_PINNED 0x01
-#define LBF_NEED_BREAK 0x02
-#define LBF_ABORT 0x04
+#define LBF_NEED_BREAK 0x02 /* clears into HAD_BREAK */
+#define LBF_HAD_BREAK 0x04
+#define LBF_HAD_BREAKS 0x0C /* count HAD_BREAKs overflows into ABORT */
+#define LBF_ABORT 0x10
/*
* can_migrate_task - may task p from runqueue rq be migrated to this_cpu?
@@ -4509,6 +4511,9 @@ static int load_balance(int this_cpu, st
if (lb_flags & LBF_NEED_BREAK) {
lb_flags &= ~LBF_NEED_BREAK;
+ lb_flags += LBF_HAD_BREAK;
+ if (lb_flags & LBF_ABORT)
+ goto out_balanced;
goto redo;
}
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 12:25 ` Peter Zijlstra
@ 2012-01-11 13:24 ` Eric Dumazet
2012-01-11 15:56 ` Ingo Molnar
1 sibling, 0 replies; 28+ messages in thread
From: Eric Dumazet @ 2012-01-11 13:24 UTC (permalink / raw)
To: Peter Zijlstra
Cc: David Ahern, Linus Torvalds, Ingo Molnar, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
Le mercredi 11 janvier 2012 à 13:25 +0100, Peter Zijlstra a écrit :
> On Wed, 2012-01-11 at 10:04 +0100, Peter Zijlstra wrote:
> > Maybe adding a few more NEED_BREAK bits
> > and making it a counter and overflowing it into ABORT might be good.
> >
> >
> I could reproduce and confirm something like the below makes the hang
> go-away. I haven't managed to fully understand why we're stuck though
> because we do release the runqueue locks and re-enable IRQs on this
> lock-break.
>
> My stuck machine had several CPUs stuck in a load-balance pass, so it
> could be they're bouncing tasks back and forth without actually making
> any progress what so ever.
>
> I reproduced with hackbench 500, which results in 20000 tasks, spread
> over 24 cpus that gives some 833 tasks per runqueue on average, easily
> overflowing that lock-break scanning limit.
>
> ---
> Subject: sched: Limit load-balance retries on lock-break
> From: Peter Zijlstra <a.p.zijlstra@chello.nl>
> Date: Wed Jan 11 13:11:12 CET 2012
>
> Eric and David reported dead machines and traced it to commit a195f004 ("sched:
> Fix load-balance lock-breaking"), it turns out there's still a
> scenario where we can end up re-trying forever.
>
> Limit the number of retries and simply abort.
>
> Reported-by: Eric Dumazet <eric.dumazet@gmail.com>
> Reported-by: David Ahern <dsahern@gmail.com>
> Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
> ---
> kernel/sched/fair.c | 9 +++++++--
> 1 file changed, 7 insertions(+), 2 deletions(-)
>
> --- a/kernel/sched/fair.c
> +++ b/kernel/sched/fair.c
> @@ -3130,8 +3130,10 @@ task_hot(struct task_struct *p, u64 now,
> }
>
> #define LBF_ALL_PINNED 0x01
> -#define LBF_NEED_BREAK 0x02
> -#define LBF_ABORT 0x04
> +#define LBF_NEED_BREAK 0x02 /* clears into HAD_BREAK */
> +#define LBF_HAD_BREAK 0x04
> +#define LBF_HAD_BREAKS 0x0C /* count HAD_BREAKs overflows into ABORT */
> +#define LBF_ABORT 0x10
>
> /*
> * can_migrate_task - may task p from runqueue rq be migrated to this_cpu?
> @@ -4509,6 +4511,9 @@ static int load_balance(int this_cpu, st
>
> if (lb_flags & LBF_NEED_BREAK) {
> lb_flags &= ~LBF_NEED_BREAK;
> + lb_flags += LBF_HAD_BREAK;
> + if (lb_flags & LBF_ABORT)
> + goto out_balanced;
> goto redo;
> }
>
>
The two lines :
lb_flags &= ~LBF_NEED_BREAK;
lb_flags += LBF_HAD_BREAK;
could be combined to :
lb_flags += LBF_HAD_BREAK - LBF_NEED_BREAK;
Anyway, your patch solved the problem on my machines, thanks a lot.
$ uptime
14:20:32 up 31 min, 2 users, load average: 170.18, 183.00, 156.53
Tested-by: Eric Dumazet <eric.dumazet@gmail.com>
One perf top output, on the 32bit kernel, to check scheduler functions
dont use too many cycles ;)
12.31% hackbench [kernel.kallsyms] [k] __slab_free
8.98% hackbench [kernel.kallsyms] [k] _raw_spin_lock_irqsave
6.52% hackbench [kernel.kallsyms] [k] sock_alloc_send_pskb
6.25% hackbench [kernel.kallsyms] [k] _raw_spin_lock
5.33% hackbench [kernel.kallsyms] [k] fget_light
5.04% hackbench [kernel.kallsyms] [k] unix_stream_recvmsg
4.01% hackbench [kernel.kallsyms] [k] __copy_user_intel
3.14% hackbench [kernel.kallsyms] [k] __kmalloc_node_track_caller
2.61% hackbench [kernel.kallsyms] [k] __alloc_skb
2.55% hackbench [kernel.kallsyms] [k] skb_release_head_state
2.18% hackbench [kernel.kallsyms] [k] sock_wfree
2.00% hackbench [kernel.kallsyms] [k] cred_to_ucred
1.68% hackbench [kernel.kallsyms] [k] kfree
1.65% hackbench [kernel.kallsyms] [k] unix_stream_sendmsg
1.62% hackbench [kernel.kallsyms] [k] kmem_cache_alloc_node
1.55% hackbench [kernel.kallsyms] [k] unix_destruct_scm
1.43% hackbench [kernel.kallsyms] [k] __schedule
1.39% hackbench [kernel.kallsyms] [k] sched_clock_cpu
1.37% hackbench [kernel.kallsyms] [k] kmem_cache_free
1.30% hackbench [kernel.kallsyms] [k] sock_def_readable
1.25% hackbench [kernel.kallsyms] [k] __slab_alloc
1.19% hackbench [kernel.kallsyms] [k] sched_clock_local
1.16% hackbench [kernel.kallsyms] [k] fput
1.11% hackbench [kernel.kallsyms] [k] sysenter_past_esp
0.98% hackbench [kernel.kallsyms] [k] get_partial_node.isra.43
0.93% hackbench [kernel.kallsyms] [k] select_task_rq_fair
0.81% hackbench [unknown] [.] 0xffffe424
0.80% hackbench [kernel.kallsyms] [k] update_curr
0.75% hackbench [kernel.kallsyms] [k] skb_release_data
0.60% hackbench [kernel.kallsyms] [k] try_to_wake_up
0.56% hackbench [kernel.kallsyms] [k] vfs_write
0.54% hackbench libpthread-2.3.4.so [.] __pthread_disable_asynccancel
0.52% hackbench [kernel.kallsyms] [k] update_rq_clock
0.47% hackbench [kernel.kallsyms] [k] ktime_get
0.45% hackbench libpthread-2.3.4.so [.] __pthread_enable_asynccancel
0.45% hackbench [kernel.kallsyms] [k] skb_dequeue
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-10 23:44 ` Linus Torvalds
2012-01-11 6:35 ` David Ahern
2012-01-11 8:22 ` [BUG] kernel freezes with latest tree Eric Dumazet
@ 2012-01-11 14:20 ` Frederic Weisbecker
2 siblings, 0 replies; 28+ messages in thread
From: Frederic Weisbecker @ 2012-01-11 14:20 UTC (permalink / raw)
To: Linus Torvalds
Cc: Eric Dumazet, Ingo Molnar, Thomas Gleixner, Peter Zijlstra,
Martin Schwidefsky, linux-kernel, Suresh Siddha
On Tue, Jan 10, 2012 at 03:44:38PM -0800, Linus Torvalds wrote:
> On Tue, Jan 10, 2012 at 2:23 PM, Eric Dumazet <eric.dumazet@gmail.com> wrote:
> >
> > Maybe a recent change in NMI handling, or perf events ?
>
> Unlikely. And it shouldn't show up in the merge commit anyway, those
> things should be pretty independent.
>
> > No idea why the bisection (I redid it carefully : same result) points to the above commit.
>
> Ok, so the bisect is almost certainly correct. But just to be anal and
> really careful, can you independently check both parents of the merge,
> and then re-check the merge itself, and verify that the two parent
> commits never hang, and that the merged state hangs.
>
> Just to take any bisection issues out of the picture, and just verify
> those three commits by hand.
>
> But in the meantime, we should assume that it's the merge that is the problem.
>
> I added Frederic to the cc, because he did the
> tick_nohz_idle_enter_norcu(), so maybe he can tell if there is
> something in that merge that looks suspicious (Frederic - see the
> history of the thread on lkml. I thought maybe it was the lack of
> irq-disable around set_cpu_sd_state_idle(), but Eric already tested
> that). And Suresh because he worked on the whole nohz/nr_busy_cpus.
> Maybe you guys see some obvious semantic clash..
As the thread evolved I guess we found the issue or at least we
got more clues.
But just in case, I double checked the merge but nothing looked
suspicious to me.
Thanks.
>
> Anybody? Any ideas? Clearly there can be a merge problem that doesn't
> actually show as a real data conflict, just some semantic conflict,
> but I don't see what such issues would be brouht in by the scheduler
> merge anyway.
>
> Linus
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 12:25 ` Peter Zijlstra
2012-01-11 13:24 ` Eric Dumazet
@ 2012-01-11 15:56 ` Ingo Molnar
2012-01-11 16:05 ` Peter Zijlstra
1 sibling, 1 reply; 28+ messages in thread
From: Ingo Molnar @ 2012-01-11 15:56 UTC (permalink / raw)
To: Peter Zijlstra
Cc: David Ahern, Linus Torvalds, Eric Dumazet, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
* Peter Zijlstra <peterz@infradead.org> wrote:
> On Wed, 2012-01-11 at 10:04 +0100, Peter Zijlstra wrote:
> > Maybe adding a few more NEED_BREAK bits
> > and making it a counter and overflowing it into ABORT might be good.
> >
> >
>
> I could reproduce and confirm something like the below makes
> the hang go-away. I haven't managed to fully understand why
> we're stuck though because we do release the runqueue locks
> and re-enable IRQs on this lock-break.
Well, what happens if every CPU runs load_balance() and we keep
triggering:
if (loops++ > sysctl_sched_nr_migrate) {
*lb_flags |= LBF_NEED_BREAK;
break;
}
in this case load_balance() will do the retry:
if (lb_flags & LBF_NEED_BREAK) {
lb_flags &= ~LBF_NEED_BREAK;
goto redo;
}
but the retry starts the loop again:
list_for_each_entry_safe(p, n, &busiest_cfs_rq->tasks, se.group_node) {
so nobody is able to make progress: livelock/lockup.
( This also explains why i was unable to see this in my
randomized testing: my tests never extreme enough to trigger
the sysctl_sched_nr_migrate threshold. )
Thanks,
Ingo
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 15:56 ` Ingo Molnar
@ 2012-01-11 16:05 ` Peter Zijlstra
2012-01-11 16:14 ` Ingo Molnar
` (2 more replies)
0 siblings, 3 replies; 28+ messages in thread
From: Peter Zijlstra @ 2012-01-11 16:05 UTC (permalink / raw)
To: Ingo Molnar
Cc: David Ahern, Linus Torvalds, Eric Dumazet, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
On Wed, 2012-01-11 at 16:56 +0100, Ingo Molnar wrote:
> Well, what happens if every CPU runs load_balance() and we keep
> triggering:
>
> if (loops++ > sysctl_sched_nr_migrate) {
> *lb_flags |= LBF_NEED_BREAK;
> break;
> }
>
> in this case load_balance() will do the retry:
>
> if (lb_flags & LBF_NEED_BREAK) {
> lb_flags &= ~LBF_NEED_BREAK;
> goto redo;
> }
>
> but the retry starts the loop again:
>
> list_for_each_entry_safe(p, n, &busiest_cfs_rq->tasks, se.group_node) {
>
> so nobody is able to make progress: livelock/lockup.
Ah, right! Silly me. One possibility is to rotate that list, except that
won't work for the cgroup case where we have another iteration.
OK, here's an updated patch..
---
Subject: sched: Limit load-balance retries on lock-break
From: Peter Zijlstra <a.p.zijlstra@chello.nl>
Date: Wed Jan 11 13:11:12 CET 2012
Eric and David reported dead machines and traced it to commit a195f004 ("sched:
Fix load-balance lock-breaking"), it turns out there's still a
scenario where we can end up re-trying forever.
Since there is no strict forward progress guarantee in the
load-balance iteration we can get stuck re-retrying the same task-set
over and over.
Creating a forward progress guarantee with the existing structure is
somewhat non-trivial, for now simply terminate the retry loop after a
few tries.
Reported-by: Eric Dumazet <eric.dumazet@gmail.com>
Reported-by: David Ahern <dsahern@gmail.com>
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
[eric: logic cleanup]
Tested-by: Eric Dumazet <eric.dumazet@gmail.com>
Link: http://lkml.kernel.org/n/tip-ya9m8grb9wfc26uqnviq2wjq@git.kernel.org
---
kernel/sched/fair.c | 10 +++++++---
1 file changed, 7 insertions(+), 3 deletions(-)
--- a/kernel/sched/fair.c
+++ b/kernel/sched/fair.c
@@ -3130,8 +3130,10 @@ task_hot(struct task_struct *p, u64 now,
}
#define LBF_ALL_PINNED 0x01
-#define LBF_NEED_BREAK 0x02
-#define LBF_ABORT 0x04
+#define LBF_NEED_BREAK 0x02 /* clears into HAD_BREAK */
+#define LBF_HAD_BREAK 0x04
+#define LBF_HAD_BREAKS 0x0C /* count HAD_BREAKs overflows into ABORT */
+#define LBF_ABORT 0x10
/*
* can_migrate_task - may task p from runqueue rq be migrated to this_cpu?
@@ -4508,7 +4510,9 @@ static int load_balance(int this_cpu, st
goto out_balanced;
if (lb_flags & LBF_NEED_BREAK) {
- lb_flags &= ~LBF_NEED_BREAK;
+ lb_flags += LBF_HAD_BREAK - LBF_NEED_BREAK;
+ if (lb_flags & LBF_ABORT)
+ goto out_balanced;
goto redo;
}
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 16:05 ` Peter Zijlstra
@ 2012-01-11 16:14 ` Ingo Molnar
2012-01-11 16:31 ` Linus Torvalds
2012-01-12 6:17 ` [tip:sched/urgent] sched: Fix lockup by limiting load-balance retries on lock-break tip-bot for Peter Zijlstra
2 siblings, 0 replies; 28+ messages in thread
From: Ingo Molnar @ 2012-01-11 16:14 UTC (permalink / raw)
To: Peter Zijlstra
Cc: David Ahern, Linus Torvalds, Eric Dumazet, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
* Peter Zijlstra <peterz@infradead.org> wrote:
> On Wed, 2012-01-11 at 16:56 +0100, Ingo Molnar wrote:
>
> > Well, what happens if every CPU runs load_balance() and we keep
> > triggering:
> >
> > if (loops++ > sysctl_sched_nr_migrate) {
> > *lb_flags |= LBF_NEED_BREAK;
> > break;
> > }
> >
> > in this case load_balance() will do the retry:
> >
> > if (lb_flags & LBF_NEED_BREAK) {
> > lb_flags &= ~LBF_NEED_BREAK;
> > goto redo;
> > }
> >
> > but the retry starts the loop again:
> >
> > list_for_each_entry_safe(p, n, &busiest_cfs_rq->tasks, se.group_node) {
> >
> > so nobody is able to make progress: livelock/lockup.
>
> Ah, right! Silly me. One possibility is to rotate that list, except that
> won't work for the cgroup case where we have another iteration.
>
> OK, here's an updated patch..
>
> ---
> Subject: sched: Limit load-balance retries on lock-break
> From: Peter Zijlstra <a.p.zijlstra@chello.nl>
> Date: Wed Jan 11 13:11:12 CET 2012
>
> Eric and David reported dead machines and traced it to commit a195f004 ("sched:
> Fix load-balance lock-breaking"), it turns out there's still a
> scenario where we can end up re-trying forever.
>
> Since there is no strict forward progress guarantee in the
> load-balance iteration we can get stuck re-retrying the same task-set
> over and over.
>
> Creating a forward progress guarantee with the existing structure is
> somewhat non-trivial, for now simply terminate the retry loop after a
> few tries.
>
> Reported-by: Eric Dumazet <eric.dumazet@gmail.com>
> Reported-by: David Ahern <dsahern@gmail.com>
> Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
> [eric: logic cleanup]
> Tested-by: Eric Dumazet <eric.dumazet@gmail.com>
> Link: http://lkml.kernel.org/n/tip-ya9m8grb9wfc26uqnviq2wjq@git.kernel.org
> ---
> kernel/sched/fair.c | 10 +++++++---
> 1 file changed, 7 insertions(+), 3 deletions(-)
Thanks Peter, i'll get this fix to Linus ASAP.
Thanks,
Ingo
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 16:05 ` Peter Zijlstra
2012-01-11 16:14 ` Ingo Molnar
@ 2012-01-11 16:31 ` Linus Torvalds
2012-01-11 16:58 ` Peter Zijlstra
2012-01-12 6:17 ` [tip:sched/urgent] sched: Fix lockup by limiting load-balance retries on lock-break tip-bot for Peter Zijlstra
2 siblings, 1 reply; 28+ messages in thread
From: Linus Torvalds @ 2012-01-11 16:31 UTC (permalink / raw)
To: Peter Zijlstra
Cc: Ingo Molnar, David Ahern, Eric Dumazet, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
On Wed, Jan 11, 2012 at 8:05 AM, Peter Zijlstra <peterz@infradead.org> wrote:
>
> Ah, right! Silly me. One possibility is to rotate that list, except that
> won't work for the cgroup case where we have another iteration.
I just wonder whether you *really* need that loop at all?
If something went wrong with the attempted task move - you raced with
another cpu, or whatever - is there any real reason to even bother to
try again?
It's just a heuristic, after all, and we'll come back to balancing later.
The minimal patch looks good, but I did want to ask whether people
have considered just removing the looping entirely?
Linus
^ permalink raw reply [flat|nested] 28+ messages in thread
* Re: [BUG] kernel freezes with latest tree
2012-01-11 16:31 ` Linus Torvalds
@ 2012-01-11 16:58 ` Peter Zijlstra
0 siblings, 0 replies; 28+ messages in thread
From: Peter Zijlstra @ 2012-01-11 16:58 UTC (permalink / raw)
To: Linus Torvalds
Cc: Ingo Molnar, David Ahern, Eric Dumazet, Thomas Gleixner,
Martin Schwidefsky, linux-kernel, Frederic Weisbecker,
Suresh Siddha
On Wed, 2012-01-11 at 08:31 -0800, Linus Torvalds wrote:
> On Wed, Jan 11, 2012 at 8:05 AM, Peter Zijlstra <peterz@infradead.org> wrote:
> >
> > Ah, right! Silly me. One possibility is to rotate that list, except that
> > won't work for the cgroup case where we have another iteration.
>
> I just wonder whether you *really* need that loop at all?
>
> If something went wrong with the attempted task move - you raced with
> another cpu, or whatever - is there any real reason to even bother to
> try again?
>
> It's just a heuristic, after all, and we'll come back to balancing later.
>
> The minimal patch looks good, but I did want to ask whether people
> have considered just removing the looping entirely?
Yeah, I did consider it, and given the current code it doesn't really
make a difference either way. But ideally we'll go fix the code to
provide better progress over repeated attempts.
Esp for people who put the migration count rather low (-rt crackpots)
multiple rounds (provided progress) make more sense.
Something like the below snippet improves the progress for !cgroup
kernels, but it also defeats the regular termination condition since any
list with two or more elements will endlessly rotate until we hit the
break limit.
We could fix this by adding an iteration count and limit that to
nr_running I guess, but since world and dog compiles kernels with cgroup
muck these days we need something slightly more clever to deal with the
for_each_leaf_cfs_rq() loop in load_balance_fair().
Will ponder more..
---
--- a/kernel/sched/fair.c
+++ b/kernel/sched/fair.c
@@ -3244,8 +3246,10 @@ balance_tasks(struct rq *this_rq, int th
if ((p->se.load.weight >> 1) > rem_load_move ||
!can_migrate_task(p, busiest, this_cpu, sd, idle,
- lb_flags))
+ lb_flags)) {
+ list_move_tail(&p->se.group_node, &busiest_cfs_rq->tasks);
continue;
+ }
pull_task(busiest, p, this_rq, this_cpu);
pulled++;
^ permalink raw reply [flat|nested] 28+ messages in thread
* [tip:sched/urgent] sched: Fix lockup by limiting load-balance retries on lock-break
2012-01-11 16:05 ` Peter Zijlstra
2012-01-11 16:14 ` Ingo Molnar
2012-01-11 16:31 ` Linus Torvalds
@ 2012-01-12 6:17 ` tip-bot for Peter Zijlstra
2 siblings, 0 replies; 28+ messages in thread
From: tip-bot for Peter Zijlstra @ 2012-01-12 6:17 UTC (permalink / raw)
To: linux-tip-commits
Cc: linux-kernel, hpa, mingo, eric.dumazet, torvalds, a.p.zijlstra,
schwidefsky, fweisbec, suresh.b.siddha, dsahern, tglx, mingo
Commit-ID: bced76aeaca03b45e3b4bdb868cada328e497847
Gitweb: http://git.kernel.org/tip/bced76aeaca03b45e3b4bdb868cada328e497847
Author: Peter Zijlstra <a.p.zijlstra@chello.nl>
AuthorDate: Wed, 11 Jan 2012 13:11:12 +0100
Committer: Ingo Molnar <mingo@elte.hu>
CommitDate: Wed, 11 Jan 2012 17:15:12 +0100
sched: Fix lockup by limiting load-balance retries on lock-break
Eric and David reported dead machines and traced it to commit
a195f004 ("sched: Fix load-balance lock-breaking"), it turns out
there's still a scenario where we can end up re-trying forever.
Since there is no strict forward progress guarantee in the
load-balance iteration we can get stuck re-retrying the same
task-set over and over.
Creating a forward progress guarantee with the existing
structure is somewhat non-trivial, for now simply terminate the
retry loop after a few tries.
Reported-by: Eric Dumazet <eric.dumazet@gmail.com>
Tested-by: Eric Dumazet <eric.dumazet@gmail.com>
Reported-by: David Ahern <dsahern@gmail.com>
[ logic cleanup as suggested by Eric ]
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Martin Schwidefsky <schwidefsky@de.ibm.com>
Cc: Frederic Weisbecker <fweisbec@gmail.com>
Cc: Suresh Siddha <suresh.b.siddha@intel.com>
Link: http://lkml.kernel.org/r/1326297936.2442.157.camel@twins
Signed-off-by: Ingo Molnar <mingo@elte.hu>
---
kernel/sched/fair.c | 10 +++++++---
1 files changed, 7 insertions(+), 3 deletions(-)
diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c
index 8e42de9..84adb2d 100644
--- a/kernel/sched/fair.c
+++ b/kernel/sched/fair.c
@@ -3130,8 +3130,10 @@ task_hot(struct task_struct *p, u64 now, struct sched_domain *sd)
}
#define LBF_ALL_PINNED 0x01
-#define LBF_NEED_BREAK 0x02
-#define LBF_ABORT 0x04
+#define LBF_NEED_BREAK 0x02 /* clears into HAD_BREAK */
+#define LBF_HAD_BREAK 0x04
+#define LBF_HAD_BREAKS 0x0C /* count HAD_BREAKs overflows into ABORT */
+#define LBF_ABORT 0x10
/*
* can_migrate_task - may task p from runqueue rq be migrated to this_cpu?
@@ -4508,7 +4510,9 @@ redo:
goto out_balanced;
if (lb_flags & LBF_NEED_BREAK) {
- lb_flags &= ~LBF_NEED_BREAK;
+ lb_flags += LBF_HAD_BREAK - LBF_NEED_BREAK;
+ if (lb_flags & LBF_ABORT)
+ goto out_balanced;
goto redo;
}
^ permalink raw reply related [flat|nested] 28+ messages in thread
end of thread, other threads:[~2012-01-12 6:17 UTC | newest]
Thread overview: 28+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-01-10 4:57 [BUG] kernel freezes with latest tree Eric Dumazet
2012-01-10 5:03 ` Eric Dumazet
2012-01-10 8:16 ` Eric Dumazet
2012-01-10 16:13 ` Eric Dumazet
2012-01-10 16:28 ` Linus Torvalds
2012-01-10 16:37 ` Eric Dumazet
2012-01-10 16:49 ` Linus Torvalds
2012-01-10 16:53 ` Eric Dumazet
2012-01-10 17:00 ` Linus Torvalds
2012-01-10 19:32 ` Ingo Molnar
2012-01-10 22:23 ` Eric Dumazet
2012-01-10 23:44 ` Linus Torvalds
2012-01-11 6:35 ` David Ahern
2012-01-11 9:04 ` Peter Zijlstra
2012-01-11 10:28 ` Eric Dumazet
2012-01-11 11:29 ` Eric Dumazet
2012-01-11 12:25 ` Peter Zijlstra
2012-01-11 13:24 ` Eric Dumazet
2012-01-11 15:56 ` Ingo Molnar
2012-01-11 16:05 ` Peter Zijlstra
2012-01-11 16:14 ` Ingo Molnar
2012-01-11 16:31 ` Linus Torvalds
2012-01-11 16:58 ` Peter Zijlstra
2012-01-12 6:17 ` [tip:sched/urgent] sched: Fix lockup by limiting load-balance retries on lock-break tip-bot for Peter Zijlstra
2012-01-11 8:22 ` [BUG] kernel freezes with latest tree Eric Dumazet
2012-01-11 14:20 ` Frederic Weisbecker
2012-01-10 16:16 ` Linus Torvalds
2012-01-10 16:33 ` Eric Dumazet
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).