linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* oops in kernel ( 3.4.x -> 3.5rc )
@ 2012-07-20  9:56 nicolas prochazka
  2012-07-20 13:21 ` Dave Jones
  0 siblings, 1 reply; 12+ messages in thread
From: nicolas prochazka @ 2012-07-20  9:56 UTC (permalink / raw)
  To: linux-kernel

Hello,
Since i 've updated our server from linux kernel 3.3.8 to linux kernel
3.4.6 or linux kernel 3.5rc7,
we can observe a lot of oops and big load  on system.

Example : Linux positronic836 3.5.0-rc7 #4 SMP Fri Jul 20 11:47:12 UTC
2012 x86_64 Intel(R) Xeon(R) CPU E5345 @ 2.33GHz GenuineIntel
GNU/Linux

Regards,
Nicolas Prochazka.

[ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
[ 2384.900307] IP: [<ffffffff8115a250>] dup_fd+0x160/0x2e0
[ 2384.905492] PGD 4e9bab067 PUD 0
[ 2384.910010] Oops: 0002 [#4] SMP
[ 2384.910010] CPU 6
[ 2384.910010] Modules linked in: kvm_intel kvm
[ 2384.910010]
[ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
3.5.0-rc7 #4 Dell Inc. PowerEdge M600/0MY736
[ 2384.910010] RIP: 0010:[<ffffffff8115a250>]  [<ffffffff8115a250>]
dup_fd+0x160/0x2e0
[ 2384.910010] RSP: 0018:ffff88049fef1d90  EFLAGS: 00010206
[ 2384.910010] RAX: 0000000000000038 RBX: ffff8806a0ac4580 RCX: 0000000000000007
[ 2384.910010] RDX: 00000000ffffffff RSI: 0000000000000800 RDI: ffff880658a85400
[ 2384.910010] RBP: ffff88049fef1df0 R08: 0000000000000020 R09: ffffffff81159fe4
[ 2384.910010] R10: ffffea0020495fd8 R11: 0000000000000000 R12: ffff8807f1eaa000
[ 2384.970401] R13: ffff880658a85380 R14: 0000000000000100 R15: ffff8807d8820000
[ 2384.970401] FS:  00007f169ffdb700(0000) GS:ffff88083fd80000(0000)
knlGS:0000000000000000
[ 2384.970401] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 2384.970401] CR2: 000000010000002f CR3: 000000059a96e000 CR4: 00000000000027e0
[ 2384.970401] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 2384.970401] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 2384.970401] Process queue.sh (pid: 23838, threadinfo
ffff88049fef0000, task ffff8805d707a000)
[ 2384.970401] Stack:
[ 2384.970401]  ffff88049fef1da0 000000018102db49 0000000000000020
ffff88045da607c0
[ 2384.970401]  ffff8805321a7c88 ffff8805321a7d00 00007f169ffdb9d0
ffff8804cd075000
[ 2384.970401]  0000000000000000 0000000001200011 00007f169ffdb9d0
0000000000000000
[ 2384.970401] Call Trace:
[ 2384.970401]  [<ffffffff8104056c>] copy_process+0x93c/0x13d0
[ 2384.970401]  [<ffffffff81041154>] do_fork+0x54/0x360
[ 2384.970401]  [<ffffffff81ae8eae>] ? _raw_spin_lock+0xe/0x20
[ 2384.970401]  [<ffffffff81055c67>] ? __set_task_blocked+0x37/0x80
[ 2384.970401]  [<ffffffff8100c1b8>] sys_clone+0x28/0x30
[ 2384.970401]  [<ffffffff81ae9eb3>] stub_clone+0x13/0x20
[ 2384.970401]  [<ffffffff81ae9c29>] ? system_call_fastpath+0x16/0x1b
[ 2384.970401] Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10 4c 89 c2 e8 a8
9c 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5 08 00 00 00 31
c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0 08 48 39 f0 74
24 49
[ 2384.970401] RIP  [<ffffffff8115a250>] dup_fd+0x160/0x2e0
[ 2384.970401]  RSP <ffff88049fef1d90>
[ 2384.970401] CR2: 000000010000002f
[ 2385.131572] ---[ end trace 12628ad63724505e ]---
[ 2385.550858] device vmEtap18 left promiscuous mode
[ 2385.953882] device vmEtap19 left promiscuous mode
[ 2386.318553] device vmEtap20 left promiscuous mode
[ 2386.714127] device vmEtap21 left promiscuous mode
[ 2387.131308] device vmEtap22 left promiscuous mode
[ 2387.498609] device vmEtap23 left promiscuous mode
[ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
[ 2397.885596] IP: [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 2397.885804] PGD 4ce59d067 PUD 0
[ 2397.885950] Oops: 0000 [#5] SMP
[ 2397.886097] CPU 3
[ 2397.886163] Modules linked in: kvm_intel kvm
[ 2397.886408]
[ 2397.886425] Pid: 25760, comm: netstat Tainted: G      D W
3.5.0-rc7 #4 Dell Inc. PowerEdge M600/0MY736
[ 2397.886747] RIP: 0010:[<ffffffff811a3654>]  [<ffffffff811a3654>]
tid_fd_revalidate+0x84/0x1a0
[ 2397.887019] RSP: 0018:ffff88040ca4bd78  EFLAGS: 00010206
[ 2397.887187] RAX: ffff8807f1f26ec0 RBX: ffff8807d918e928 RCX: 000000000000007d
[ 2397.887392] RDX: 00000000ffffffff RSI: 0000000000000000 RDI: ffff8807f1f26ec0
[ 2397.887596] RBP: ffff88040ca4bd98 R08: ffff88083fcd6b30 R09: ffffffff8119fef0
[ 2397.887801] R10: 0000000000000000 R11: 0000000000000202 R12: ffff8807d93cd3c0
[ 2397.891771] R13: ffff8807c1366000 R14: ffff8807cf615038 R15: ffff88040ca4be08
[ 2397.891771] FS:  00007f029b1b5700(0000) GS:ffff88083fcc0000(0000)
knlGS:0000000000000000
[ 2397.891771] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2397.891771] CR2: 000000010000003b CR3: 00000004d0fd9000 CR4: 00000000000007e0
[ 2397.891771] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 2397.891771] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 2397.891771] Process netstat (pid: 25760, threadinfo
ffff88040ca4a000, task ffff88065897f000)
[ 2397.891771] Stack:
[ 2397.891771]  ffff8807d93cd3c0 0000000000000007 ffff8807d918e928
ffff8807db8db240
[ 2397.891771]  ffff88040ca4bdc8 ffffffff811a3880 ffffffffff0a0210
0000000000000001
[ 2397.963460]  ffff88040ca4be98 ffff8807d6dcb600 ffff88040ca4be48
ffffffff811a4cd6
[ 2397.963460] Call Trace:
[ 2397.963460]  [<ffffffff811a3880>] proc_fd_instantiate+0x80/0xa0
[ 2397.963460]  [<ffffffff811a4cd6>] proc_fill_cache+0x126/0x150
[ 2397.963460]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 2397.963460]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2397.963460]  [<ffffffff811a5006>] proc_readfd_common+0xf6/0x1c0
[ 2397.963460]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 2397.963460]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2397.963460]  [<ffffffff811a5105>] proc_readfd+0x15/0x20
[ 2397.963460]  [<ffffffff811507c0>] vfs_readdir+0xa0/0xc0
[ 2397.963460]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2397.963460]  [<ffffffff8115096d>] sys_getdents+0x8d/0x100
[ 2397.963460]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[ 2397.963460] Code: b8 00 00 00 48 8b 50 08 44 3b 32 0f 83 9e 00 00
00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2 0f 84 87 00 00
00 48 89 c7 <44> 8b 62 3c e8 13 29 ea ff 4c 89 ef e8 4b df ff ff 85 c0
0f 84
[ 2397.963460] RIP  [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 2397.963460]  RSP <ffff88040ca4bd78>
[ 2397.963460] CR2: 000000010000003b
[ 2397.970166] ---[ end trace 12628ad63724505f ]---

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-20  9:56 oops in kernel ( 3.4.x -> 3.5rc ) nicolas prochazka
@ 2012-07-20 13:21 ` Dave Jones
  2012-07-20 13:32   ` nicolas prochazka
  2012-07-20 20:21   ` Thadeu Lima de Souza Cascardo
  0 siblings, 2 replies; 12+ messages in thread
From: Dave Jones @ 2012-07-20 13:21 UTC (permalink / raw)
  To: nicolas prochazka; +Cc: linux-kernel

On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
 
 > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f

That '1' looks like a random bit flip. Try running memtest86.

 > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W

This wasn't the first problem either.

 > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b

Looks like the same flipped bit.

	Dave


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-20 13:21 ` Dave Jones
@ 2012-07-20 13:32   ` nicolas prochazka
  2012-07-20 20:21   ` Thadeu Lima de Souza Cascardo
  1 sibling, 0 replies; 12+ messages in thread
From: nicolas prochazka @ 2012-07-20 13:32 UTC (permalink / raw)
  To: Dave Jones, nicolas prochazka, linux-kernel

Hello;
I can reproduce this problem on five differents servers,
I can try a memtest86.
regards,
Nicolas Prochazka.
complete dump :

 596.322369] BUG: unable to handle kernel paging request at 000000010000003b
[  596.322622] IP: [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[  596.322828] PGD 7d6c20067 PUD 0
[  596.322972] Oops: 0000 [#1] SMP
[  596.323115] CPU 3
[  596.323181] Modules linked in: kvm_intel kvm
[  596.323422]
[  596.323435] Pid: 28353, comm: netstat Not tainted 3.5.0-rc7 #4 Dell
Inc. PowerEdge M600/0MY736
[  596.323745] RIP: 0010:[<ffffffff811a3654>]  [<ffffffff811a3654>]
tid_fd_revalidate+0x84/0x1a0
[  596.329940] RSP: 0018:ffff880658ab9d78  EFLAGS: 00010206
[  596.330010] RAX: ffff8807f1195340 RBX: ffff8807d91bdd20 RCX: 000000000000007d
[  596.330010] RDX: 00000000ffffffff RSI: 0000000000000000 RDI: ffff8807f1195340
[  596.330010] RBP: ffff880658ab9d98 R08: ffff88083fcd6b30 R09: ffffffff8119fef0
[  596.330010] R10: 0000000000000000 R11: 0000000000000202 R12: ffff8805eea4d480
[  596.330010] R13: ffff8807d6f06000 R14: ffff8807f0fa1038 R15: ffff880658ab9e08
[  596.330010] FS:  00007f3414807700(0000) GS:ffff88083fcc0000(0000)
knlGS:0000000000000000
[  596.330010] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  596.330010] CR2: 000000010000003b CR3: 000000069bd85000 CR4: 00000000000007e0
[  596.330010] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[  596.330010] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[  596.330010] Process netstat (pid: 28353, threadinfo
ffff880658ab8000, task ffff88074a897000)
[  596.330010] Stack:
[  596.330010]  ffff8805eea4d480 0000000000000007 ffff8807d91bdd20
ffff8807dbbbac00
[  596.330010]  ffff880658ab9dc8 ffffffff811a3880 ffffffffff0a0210
0000000000000001
[  596.330010]  ffff880658ab9e98 ffff880593e3ac00 ffff880658ab9e48
ffffffff811a4cd6
[  596.330010] Call Trace:
[  596.330010]  [<ffffffff811a3880>] proc_fd_instantiate+0x80/0xa0
[  596.330010]  [<ffffffff811a4cd6>] proc_fill_cache+0x126/0x150
[  596.330010]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[  596.330010]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[  596.330010]  [<ffffffff811a5006>] proc_readfd_common+0xf6/0x1c0
[  596.330010]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[  596.330010]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[  596.330010]  [<ffffffff811a5105>] proc_readfd+0x15/0x20
[  596.330010]  [<ffffffff811507c0>] vfs_readdir+0xa0/0xc0
[  596.330010]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[  596.330010]  [<ffffffff8115096d>] sys_getdents+0x8d/0x100
[  596.330010]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[  596.531217] Code: b8 00 00 00 48 8b 50 08 44 3b 32 0f 83 9e 00 00
00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2 0f 84 87 00 00
00 48 89 c7 <44> 8b 62 3c e8 13 29 ea ff 4c 89 ef e8 4b df ff ff 85 c0
0f 84
[  596.531217] RIP  [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[  596.531217]  RSP <ffff880658ab9d78>
[  596.531217] CR2: 000000010000003b
[  596.533373] ---[ end trace 12628ad63724505a ]---
[  620.908188] device vmEtap5 entered promiscuous mode
[  632.625058] device vmEtap22 entered promiscuous mode
[  637.628184] device vmEtap4 entered promiscuous mode
[  647.651842] device vmEtap6 entered promiscuous mode
[  869.373622] device vmEtap7 entered promiscuous mode
[  879.418886] device vmEtap8 entered promiscuous mode
[  884.422364] device vmEtap9 entered promiscuous mode
[  889.487014] device vmEtap10 entered promiscuous mode
[  898.926970] device vmEtap11 entered promiscuous mode
[  902.600030] hrtimer: interrupt took 23049 ns
[  909.244532] device vmEtap12 entered promiscuous mode
[  919.208239] device vmEtap13 entered promiscuous mode
[  929.798012] device vmEtap14 entered promiscuous mode
[  939.575998] device vmEtap15 entered promiscuous mode
[  949.673050] device vmEtap16 entered promiscuous mode
[  959.879484] device vmEtap17 entered promiscuous mode
[  970.117849] device vmEtap18 entered promiscuous mode
[  980.157065] device vmEtap19 entered promiscuous mode
[  990.493721] device vmEtap20 entered promiscuous mode
[ 1000.683323] device vmEtap21 entered promiscuous mode
[ 1010.820146] device vmEtap23 entered promiscuous mode
[ 1179.360788] device vmEtap4 left promiscuous mode
[ 1179.801638] device vmEtap5 left promiscuous mode
[ 1180.297567] device vmEtap6 left promiscuous mode
[ 1180.774054] device vmEtap7 left promiscuous mode
[ 1181.170919] device vmEtap8 left promiscuous mode
[ 1181.631908] device vmEtap9 left promiscuous mode
[ 1182.116042] device vmEtap10 left promiscuous mode
[ 1182.511330] device vmEtap11 left promiscuous mode
[ 1182.929594] device vmEtap12 left promiscuous mode
[ 1183.329183] device vmEtap13 left promiscuous mode
[ 1183.720130] device vmEtap14 left promiscuous mode
[ 1184.288507] device vmEtap15 left promiscuous mode
[ 1184.679455] device vmEtap16 left promiscuous mode
[ 1185.045020] device vmEtap17 left promiscuous mode
[ 1185.410966] device vmEtap18 left promiscuous mode
[ 1185.685902] BUG: unable to handle kernel paging request at 000000010000003b
[ 1185.690492] IP: [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 1185.690492] PGD 4d103d067 PUD 0
[ 1185.690492] Oops: 0000 [#2] SMP
[ 1185.690492] CPU 2 Modules linked in: kvm_intel kvm
[ 1185.690492]
[ 1185.690492] Pid: 15922, comm: netstat Tainted: G      D
3.5.0-rc7 #4 Dell Inc. PowerEdge M600/0MY736
[ 1185.690492] RIP: 0010:[<ffffffff811a3654>]  [<ffffffff811a3654>]
tid_fd_revalidate+0x84/0x1a0
[ 1185.690492] RSP: 0018:ffff8806b1a0bd78  EFLAGS: 00010206
[ 1185.690492] RAX: ffff8807f1c90580 RBX: ffff8805ee859ab8 RCX: 000000000000007d
[ 1185.690492] RDX: 00000000ffffffff RSI: 0000000000000000 RDI: ffff8807f1c90580
[ 1185.690492] RBP: ffff8806b1a0bd98 R08: ffff88083fc96b30 R09: ffffffff8119fef0
[ 1185.690492] R10: 0000000000000000 R11: 0000000000000206 R12: ffff8807d91c6a80
[ 1185.690492] R13: ffff8807f2b64000 R14: ffff8807f1027038 R15: ffff8806b1a0be08
[ 1185.690492] FS:  00007f98f9f96700(0000) GS:ffff88083fc80000(0000)
knlGS:0000000000000000
[ 1185.690492] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1185.690492] CR2: 000000010000003b CR3: 00000007ca9b9000 CR4: 00000000000027e0
[ 1185.690492] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 1185.690492] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 1185.690492] Process netstat (pid: 15922, threadinfo
ffff8806b1a0a000, task ffff880593fc3000)
[ 1185.690492] Stack:
[ 1185.690492]  ffff8807d91c6a80 0000000000000007 ffff8805ee859ab8
ffff8807d902a780
[ 1185.690492]  ffff8806b1a0bdc8 ffffffff811a3880 ffffffffff0a0210
0000000000000001
[ 1185.690492]  ffff8806b1a0be98 ffff8807d6cb9f00 ffff8806b1a0be48
ffffffff811a4cd6
[ 1185.690492] Call Trace:
[ 1185.690492]  [<ffffffff811a3880>] proc_fd_instantiate+0x80/0xa0
[ 1185.690492]  [<ffffffff811a4cd6>] proc_fill_cache+0x126/0x150
[ 1185.690492]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 1185.690492]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1185.690492]  [<ffffffff811a5006>] proc_readfd_common+0xf6/0x1c0
[ 1185.690492]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 1185.690492]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1185.690492]  [<ffffffff811a5105>] proc_readfd+0x15/0x20
[ 1185.690492]  [<ffffffff811507c0>] vfs_readdir+0xa0/0xc0
[ 1185.690492]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1185.690492]  [<ffffffff8115096d>] sys_getdents+0x8d/0x100
[ 1185.690492]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[ 1185.690492] Code: b8 00 00 00 48 8b 50 08 44 3b 32 0f 83 9e 00 00
00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2 0f 84 87 00 00
00 48 89 c7 <44> 8b 62 3c e8 13 29 ea ff 4c 89 ef e8 4b df ff ff 85 c0
0f 84
[ 1185.690492] RIP  [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 1185.690492]  RSP <ffff8806b1a0bd78>
[ 1185.690492] CR2: 000000010000003b
[ 1185.690492] ------------[ cut here ]------------
[ 1185.690492] WARNING: at kernel/softirq.c:159 local_bh_enable_ip+0x7a/0xa0()
[ 1185.690492] Hardware name: PowerEdge M600
[ 1185.690492] Modules linked in: kvm_intel kvm
[ 1185.690492] Pid: 15922, comm: netstat Tainted: G      D      3.5.0-rc7 #4
[ 1185.690492] Call Trace:
[ 1185.690492]  [<ffffffff81041c1f>] warn_slowpath_common+0x7f/0xc0
[ 1185.690492]  [<ffffffff81041c7a>] warn_slowpath_null+0x1a/0x20
[ 1185.690492]  [<ffffffff8104a88a>] local_bh_enable_ip+0x7a/0xa0
[ 1185.690492]  [<ffffffff81ae9129>] _raw_spin_unlock_bh+0x19/0x20
[ 1185.690492]  [<ffffffff81441dea>] cn_netlink_send+0xaa/0x180
[ 1185.690492]  [<ffffffff813d39fb>] uvesafb_exec+0x14b/0x290
[ 1185.690492]  [<ffffffff813d3c7c>] uvesafb_blank+0x13c/0x180
[ 1185.690492]  [<ffffffff813c0332>] fb_blank+0x62/0xc0
[ 1185.690492]  [<ffffffff813d0690>] ? bit_update_start+0x60/0x60
[ 1185.690492]  [<ffffffff813cc74b>] fbcon_blank+0x22b/0x2d0
[ 1185.690492]  [<ffffffff81043917>] ? log_store+0x177/0x210
[ 1185.690492]  [<ffffffff8102db49>] ? default_spin_lock_flags+0x9/0x10
[ 1185.690492]  [<ffffffff8102db49>] ? default_spin_lock_flags+0x9/0x10
[ 1185.690492]  [<ffffffff81ae8eef>] ? _raw_spin_lock_irqsave+0x2f/0x40
[ 1185.690492]  [<ffffffff81052c3c>] ? lock_timer_base+0x3c/0x70
[ 1185.690492]  [<ffffffff8105364d>] ? mod_timer+0x15d/0x2b0
[ 1185.690492]  [<ffffffff81429d38>] do_unblank_screen+0xa8/0x1c0
[ 1185.690492]  [<ffffffff81429e60>] unblank_screen+0x10/0x20
[ 1185.690492]  [<ffffffff81395305>] bust_spinlocks+0x15/0x40
[ 1185.690492]  [<ffffffff81005c6f>] oops_end+0x3f/0xf0
[ 1185.690492]  [<ffffffff8103165d>] no_context+0x11d/0x2d0
[ 1185.690492]  [<ffffffff8103194d>] __bad_area_nosemaphore+0x13d/0x220
[ 1185.690492]  [<ffffffff81031aa6>] __bad_area+0x56/0x70
[ 1185.690492]  [<ffffffff81031ad3>] bad_area+0x13/0x20
[ 1185.690492]  [<ffffffff81032016>] do_page_fault+0x356/0x440
[ 1185.690492]  [<ffffffff81ae8eae>] ? _raw_spin_lock+0xe/0x20
[ 1185.690492]  [<ffffffff81ae8eae>] ? _raw_spin_lock+0xe/0x20
[ 1185.690492]  [<ffffffff8106db4a>] ? lg_local_unlock+0x1a/0x20
[ 1185.690492]  [<ffffffff81ae8eae>] ? _raw_spin_lock+0xe/0x20
[ 1185.690492]  [<ffffffff8106db4a>] ? lg_local_unlock+0x1a/0x20
[ 1185.690492]  [<ffffffff81ae9575>] page_fault+0x25/0x30
[ 1185.690492]  [<ffffffff8119fef0>] ? proc_alloc_inode+0x20/0xa0
[ 1185.690492]  [<ffffffff811a3654>] ? tid_fd_revalidate+0x84/0x1a0
[ 1185.690492]  [<ffffffff811a3624>] ? tid_fd_revalidate+0x54/0x1a0
[ 1185.690492]  [<ffffffff811a3880>] proc_fd_instantiate+0x80/0xa0
[ 1185.690492]  [<ffffffff811a4cd6>] proc_fill_cache+0x126/0x150
[ 1185.690492]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 1185.690492]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1185.690492]  [<ffffffff811a5006>] proc_readfd_common+0xf6/0x1c0
[ 1185.690492]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 1185.690492]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1185.690492]  [<ffffffff811a5105>] proc_readfd+0x15/0x20
[ 1185.690492]  [<ffffffff811507c0>] vfs_readdir+0xa0/0xc0
[ 1185.690492]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1185.690492]  [<ffffffff8115096d>] sys_getdents+0x8d/0x100
[ 1185.690492]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[ 1185.690492] ---[ end trace 12628ad63724505b ]---
[ 1185.709295] ---[ end trace 12628ad63724505c ]---
[ 1186.333396] device vmEtap19 left promiscuous mode
[ 1186.731191] device vmEtap20 left promiscuous mode
[ 1187.118147] device vmEtap21 left promiscuous mode
[ 1187.542182] device vmEtap22 left promiscuous mode
[ 1187.906083] device vmEtap23 left promiscuous mode
[ 1432.812573] device vmEtap4 entered promiscuous mode
[ 1443.064074] device vmEtap5 entered promiscuous mode
[ 1453.294585] device vmEtap6 entered promiscuous mode
[ 1463.401918] device vmEtap7 entered promiscuous mode
[ 1473.592298] device vmEtap8 entered promiscuous mode
[ 1483.788381] device vmEtap9 entered promiscuous mode
[ 1494.130649] device vmEtap10 entered promiscuous mode
[ 1504.226101] device vmEtap11 entered promiscuous mode
[ 1514.468192] device vmEtap12 entered promiscuous mode
[ 1524.705412] device vmEtap13 entered promiscuous mode
[ 1534.868519] device vmEtap14 entered promiscuous mode
[ 1544.998033] device vmEtap15 entered promiscuous mode
[ 1555.248343] device vmEtap16 entered promiscuous mode
[ 1565.437769] device vmEtap17 entered promiscuous mode
[ 1575.561884] device vmEtap18 entered promiscuous mode
[ 1585.725911] device vmEtap19 entered promiscuous mode
[ 1595.957660] device vmEtap20 entered promiscuous mode
[ 1606.300954] device vmEtap21 entered promiscuous mode
[ 1616.380670] device vmEtap22 entered promiscuous mode
[ 1626.501701] device vmEtap23 entered promiscuous mode
[ 1779.362687] device vmEtap4 left promiscuous mode
[ 1779.894650] device vmEtap5 left promiscuous mode
[ 1780.319940] device vmEtap6 left promiscuous mode
[ 1780.756781] device vmEtap7 left promiscuous mode
[ 1781.202178] device vmEtap8 left promiscuous mode
[ 1781.631718] device vmEtap9 left promiscuous mode
[ 1782.045837] device vmEtap10 left promiscuous mode
[ 1782.472439] device vmEtap11 left promiscuous mode
[ 1782.897959] device vmEtap12 left promiscuous mode
[ 1783.297698] device vmEtap13 left promiscuous mode
[ 1783.701312] device vmEtap14 left promiscuous mode
[ 1784.093936] device vmEtap15 left promiscuous mode
[ 1784.508188] device vmEtap16 left promiscuous mode
[ 1784.931853] device vmEtap17 left promiscuous mode
[ 1785.356987] device vmEtap18 left promiscuous mode
[ 1785.767588] device vmEtap19 left promiscuous mode
[ 1786.116405] device vmEtap20 left promiscuous mode
[ 1786.485665] device vmEtap21 left promiscuous mode
[ 1786.875160] device vmEtap22 left promiscuous mode
[ 1787.261811] device vmEtap23 left promiscuous mode
[ 1797.665705] BUG: unable to handle kernel paging request at 000000010000003b
[ 1797.665942] IP: [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 1797.666137] PGD 6a1b01067 PUD 0
[ 1797.666263] Oops: 0000 [#3] SMP
[ 1797.666389] CPU 3
[ 1797.666449] Modules linked in: kvm_intel kvm
[ 1797.666662]
[ 1797.666669] Pid: 5047, comm: netstat Tainted: G      D W
3.5.0-rc7 #4 Dell Inc. PowerEdge M600/0MY736
[ 1797.666977] RIP: 0010:[<ffffffff811a3654>]  [<ffffffff811a3654>]
tid_fd_revalidate+0x84/0x1a0
[ 1797.667239] RSP: 0018:ffff8806961cfd78  EFLAGS: 00010206
[ 1797.667402] RAX: ffff8807f3139080 RBX: ffff8805ee970778 RCX: 000000000000007d
[ 1797.667598] RDX: 00000000ffffffff RSI: 0000000000000000 RDI: ffff8807f3139080
[ 1797.667795] RBP: ffff8806961cfd98 R08: ffff8805ee970738 R09: ffffea0017ba5c10
[ 1797.667993] R10: ffffea0017ba5c18 R11: 0000000000000202 R12: ffff8805a51fc240
[ 1797.668191] R13: ffff880813ede000 R14: ffff8807f36b6838 R15: ffff8806961cfe08
[ 1797.668389] FS:  00007fda3f421700(0000) GS:ffff88083fcc0000(0000)
knlGS:0000000000000000
[ 1797.674897] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1797.674897] CR2: 000000010000003b CR3: 000000049f03b000 CR4: 00000000000007e0
[ 1797.674897] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 1797.674897] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 1797.674897] Process netstat (pid: 5047, threadinfo
ffff8806961ce000, task ffff88045f2c5000)
[ 1797.674897] Stack:
[ 1797.674897]  ffff8805a51fc240 0000000000000007 ffff8805ee970778
ffff8807d9044600
[ 1797.674897]  ffff8806961cfdc8 ffffffff811a3880 ffffffffff0a0210
0000000000000001
[ 1797.674897]  ffff8806961cfe98 ffff8806c81b7300 ffff8806961cfe48
ffffffff811a4cd6
[ 1797.674897] Call Trace:
[ 1797.674897]  [<ffffffff811a3880>] proc_fd_instantiate+0x80/0xa0
[ 1797.674897]  [<ffffffff811a4cd6>] proc_fill_cache+0x126/0x150
[ 1797.674897]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 1797.674897]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1797.674897]  [<ffffffff811a5006>] proc_readfd_common+0xf6/0x1c0
[ 1797.674897]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 1797.674897]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1797.674897]  [<ffffffff811a5105>] proc_readfd+0x15/0x20
[ 1797.674897]  [<ffffffff811507c0>] vfs_readdir+0xa0/0xc0
[ 1797.674897]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 1797.674897]  [<ffffffff8115096d>] sys_getdents+0x8d/0x100
[ 1797.674897]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[ 1797.674897] Code: b8 00 00 00 48 8b 50 08 44 3b 32 0f 83 9e 00 00
00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2 0f 84 87 00 00
00 48 89 c7 <44> 8b 62 3c e8 13 29 ea ff 4c 89 ef e8 4b df ff ff 85 c0
0f 84
[ 1797.674897] RIP  [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 1797.674897]  RSP <ffff8806961cfd78>
[ 1797.674897] CR2: 000000010000003b
[ 1797.906648] ---[ end trace 12628ad63724505d ]---
[ 2027.496367] device vmEtap4 entered promiscuous mode
[ 2042.456717] device vmEtap5 entered promiscuous mode
[ 2052.807736] device vmEtap6 entered promiscuous mode
[ 2063.097469] device vmEtap7 entered promiscuous mode
[ 2073.065037] device vmEtap8 entered promiscuous mode
[ 2083.537428] device vmEtap9 entered promiscuous mode
[ 2093.765564] device vmEtap10 entered promiscuous mode
[ 2103.806845] device vmEtap11 entered promiscuous mode
[ 2113.958981] device vmEtap12 entered promiscuous mode
[ 2124.179834] device vmEtap13 entered promiscuous mode
[ 2134.389304] device vmEtap14 entered promiscuous mode
[ 2144.688667] device vmEtap15 entered promiscuous mode
[ 2154.935890] device vmEtap16 entered promiscuous mode
[ 2165.138184] device vmEtap17 entered promiscuous mode
[ 2175.314773] device vmEtap18 entered promiscuous mode
[ 2185.479987] device vmEtap19 entered promiscuous mode
[ 2195.724304] device vmEtap20 entered promiscuous mode
[ 2206.035457] device vmEtap21 entered promiscuous mode
[ 2216.185894] device vmEtap22 entered promiscuous mode
[ 2226.345187] device vmEtap23 entered promiscuous mode
[ 2379.283954] device vmEtap4 left promiscuous mode
[ 2379.713046] device vmEtap5 left promiscuous mode
[ 2380.136627] device vmEtap6 left promiscuous mode
[ 2380.586193] device vmEtap7 left promiscuous mode
[ 2381.037738] device vmEtap8 left promiscuous mode
[ 2381.472551] device vmEtap9 left promiscuous mode
[ 2381.933456] device vmEtap10 left promiscuous mode
[ 2382.344070] device vmEtap11 left promiscuous mode
[ 2382.776366] device vmEtap12 left promiscuous mode
[ 2383.241242] device vmEtap13 left promiscuous mode
[ 2383.655400] device vmEtap14 left promiscuous mode
[ 2384.062445] device vmEtap15 left promiscuous mode
[ 2384.511881] device vmEtap16 left promiscuous mode
[ 2384.897733] device vmEtap17 left promiscuous mode
[ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
[ 2384.900307] IP: [<ffffffff8115a250>] dup_fd+0x160/0x2e0
[ 2384.905492] PGD 4e9bab067 PUD 0
[ 2384.910010] Oops: 0002 [#4] SMP
[ 2384.910010] CPU 6
[ 2384.910010] Modules linked in: kvm_intel kvm
[ 2384.910010]
[ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
3.5.0-rc7 #4 Dell Inc. PowerEdge M600/0MY736
[ 2384.910010] RIP: 0010:[<ffffffff8115a250>]  [<ffffffff8115a250>]
dup_fd+0x160/0x2e0
[ 2384.910010] RSP: 0018:ffff88049fef1d90  EFLAGS: 00010206
[ 2384.910010] RAX: 0000000000000038 RBX: ffff8806a0ac4580 RCX: 0000000000000007
[ 2384.910010] RDX: 00000000ffffffff RSI: 0000000000000800 RDI: ffff880658a85400
[ 2384.910010] RBP: ffff88049fef1df0 R08: 0000000000000020 R09: ffffffff81159fe4
[ 2384.910010] R10: ffffea0020495fd8 R11: 0000000000000000 R12: ffff8807f1eaa000
[ 2384.970401] R13: ffff880658a85380 R14: 0000000000000100 R15: ffff8807d8820000
[ 2384.970401] FS:  00007f169ffdb700(0000) GS:ffff88083fd80000(0000)
knlGS:0000000000000000
[ 2384.970401] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 2384.970401] CR2: 000000010000002f CR3: 000000059a96e000 CR4: 00000000000027e0
[ 2384.970401] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 2384.970401] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 2384.970401] Process queue.sh (pid: 23838, threadinfo
ffff88049fef0000, task ffff8805d707a000)
[ 2384.970401] Stack:
[ 2384.970401]  ffff88049fef1da0 000000018102db49 0000000000000020
ffff88045da607c0
[ 2384.970401]  ffff8805321a7c88 ffff8805321a7d00 00007f169ffdb9d0
ffff8804cd075000
[ 2384.970401]  0000000000000000 0000000001200011 00007f169ffdb9d0
0000000000000000
[ 2384.970401] Call Trace:
[ 2384.970401]  [<ffffffff8104056c>] copy_process+0x93c/0x13d0
[ 2384.970401]  [<ffffffff81041154>] do_fork+0x54/0x360
[ 2384.970401]  [<ffffffff81ae8eae>] ? _raw_spin_lock+0xe/0x20
[ 2384.970401]  [<ffffffff81055c67>] ? __set_task_blocked+0x37/0x80
[ 2384.970401]  [<ffffffff8100c1b8>] sys_clone+0x28/0x30
[ 2384.970401]  [<ffffffff81ae9eb3>] stub_clone+0x13/0x20
[ 2384.970401]  [<ffffffff81ae9c29>] ? system_call_fastpath+0x16/0x1b
[ 2384.970401] Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10 4c 89 c2 e8 a8
9c 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5 08 00 00 00 31
c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0 08 48 39 f0 74
24 49
[ 2384.970401] RIP  [<ffffffff8115a250>] dup_fd+0x160/0x2e0
[ 2384.970401]  RSP <ffff88049fef1d90>
[ 2384.970401] CR2: 000000010000002f
[ 2385.131572] ---[ end trace 12628ad63724505e ]---
[ 2385.550858] device vmEtap18 left promiscuous mode
[ 2385.953882] device vmEtap19 left promiscuous mode
[ 2386.318553] device vmEtap20 left promiscuous mode
[ 2386.714127] device vmEtap21 left promiscuous mode
[ 2387.131308] device vmEtap22 left promiscuous mode
[ 2387.498609] device vmEtap23 left promiscuous mode
[ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
[ 2397.885596] IP: [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 2397.885804] PGD 4ce59d067 PUD 0
[ 2397.885950] Oops: 0000 [#5] SMP
[ 2397.886097] CPU 3
[ 2397.886163] Modules linked in: kvm_intel kvm
[ 2397.886408]
[ 2397.886425] Pid: 25760, comm: netstat Tainted: G      D W
3.5.0-rc7 #4 Dell Inc. PowerEdge M600/0MY736
[ 2397.886747] RIP: 0010:[<ffffffff811a3654>]  [<ffffffff811a3654>]
tid_fd_revalidate+0x84/0x1a0
[ 2397.887019] RSP: 0018:ffff88040ca4bd78  EFLAGS: 00010206
[ 2397.887187] RAX: ffff8807f1f26ec0 RBX: ffff8807d918e928 RCX: 000000000000007d
[ 2397.887392] RDX: 00000000ffffffff RSI: 0000000000000000 RDI: ffff8807f1f26ec0
[ 2397.887596] RBP: ffff88040ca4bd98 R08: ffff88083fcd6b30 R09: ffffffff8119fef0
[ 2397.887801] R10: 0000000000000000 R11: 0000000000000202 R12: ffff8807d93cd3c0
[ 2397.891771] R13: ffff8807c1366000 R14: ffff8807cf615038 R15: ffff88040ca4be08
[ 2397.891771] FS:  00007f029b1b5700(0000) GS:ffff88083fcc0000(0000)
knlGS:0000000000000000
[ 2397.891771] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2397.891771] CR2: 000000010000003b CR3: 00000004d0fd9000 CR4: 00000000000007e0
[ 2397.891771] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 2397.891771] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 2397.891771] Process netstat (pid: 25760, threadinfo
ffff88040ca4a000, task ffff88065897f000)
[ 2397.891771] Stack:
[ 2397.891771]  ffff8807d93cd3c0 0000000000000007 ffff8807d918e928
ffff8807db8db240
[ 2397.891771]  ffff88040ca4bdc8 ffffffff811a3880 ffffffffff0a0210
0000000000000001
[ 2397.963460]  ffff88040ca4be98 ffff8807d6dcb600 ffff88040ca4be48
ffffffff811a4cd6
[ 2397.963460] Call Trace:
[ 2397.963460]  [<ffffffff811a3880>] proc_fd_instantiate+0x80/0xa0
[ 2397.963460]  [<ffffffff811a4cd6>] proc_fill_cache+0x126/0x150
[ 2397.963460]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 2397.963460]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2397.963460]  [<ffffffff811a5006>] proc_readfd_common+0xf6/0x1c0
[ 2397.963460]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 2397.963460]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2397.963460]  [<ffffffff811a5105>] proc_readfd+0x15/0x20
[ 2397.963460]  [<ffffffff811507c0>] vfs_readdir+0xa0/0xc0
[ 2397.963460]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2397.963460]  [<ffffffff8115096d>] sys_getdents+0x8d/0x100
[ 2397.963460]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[ 2397.963460] Code: b8 00 00 00 48 8b 50 08 44 3b 32 0f 83 9e 00 00
00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2 0f 84 87 00 00
00 48 89 c7 <44> 8b 62 3c e8 13 29 ea ff 4c 89 ef e8 4b df ff ff 85 c0
0f 84
[ 2397.963460] RIP  [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 2397.963460]  RSP <ffff88040ca4bd78>
[ 2397.963460] CR2: 000000010000003b
[ 2397.970166] ---[ end trace 12628ad63724505f ]---
[ 2627.719862] device vmEtap4 entered promiscuous mode
[ 2642.717593] device vmEtap5 entered promiscuous mode
[ 2653.003484] device vmEtap6 entered promiscuous mode
[ 2663.213482] device vmEtap7 entered promiscuous mode
[ 2673.377745] device vmEtap8 entered promiscuous mode
[ 2683.768448] device vmEtap9 entered promiscuous mode
[ 2693.928755] device vmEtap10 entered promiscuous mode
[ 2704.030115] device vmEtap11 entered promiscuous mode
[ 2714.386189] device vmEtap12 entered promiscuous mode
[ 2724.552373] device vmEtap13 entered promiscuous mode
[ 2734.578330] device vmEtap14 entered promiscuous mode
[ 2744.992878] device vmEtap15 entered promiscuous mode
[ 2755.119300] device vmEtap16 entered promiscuous mode
[ 2765.207347] device vmEtap17 entered promiscuous mode
[ 2775.500931] device vmEtap18 entered promiscuous mode
[ 2785.532119] device vmEtap19 entered promiscuous mode
[ 2795.911095] device vmEtap20 entered promiscuous mode
[ 2806.069401] device vmEtap21 entered promiscuous mode
[ 2815.282977] device vmEtap22 entered promiscuous mode
[ 2826.578202] device vmEtap23 entered promiscuous mode
[ 2979.308639] device vmEtap4 left promiscuous mode
[ 2980.137266] device vmEtap5 left promiscuous mode
[ 2980.180177] BUG: unable to handle kernel paging request at ffffff81c1962137
[ 2980.180413] IP: [<ffffffff81151b5a>] do_select+0x33a/0x6a0
[ 2980.180595] PGD 2221067 PUD 0
[ 2980.180710] Oops: 0000 [#6] SMP
[ 2980.180836] CPU 5
[ 2980.180897] Modules linked in: kvm_intel kvm
[ 2980.181109]
[ 2980.181117] Pid: 29464, comm: qemu Tainted: G      D W    3.5.0-rc7
#4 Dell Inc. PowerEdge M600/0MY736
[ 2980.181423] RIP: 0010:[<ffffffff81151b5a>]  [<ffffffff81151b5a>]
do_select+0x33a/0x6a0
[ 2980.181667] RSP: 0018:ffff88049c7439e8  EFLAGS: 00010286
[ 2980.181826] RAX: ffffff81c19620ff RBX: ffffffffda00b2c8 RCX: 0000000000000300
[ 2980.182021] RDX: 000000000000005e RSI: ffff88049c743d34 RDI: 0000000000000300
[ 2980.182219] RBP: ffff88049c743d68 R08: ffff8804ce231f2f R09: 0000000000000301
[ 2980.182417] R10: 0140000000000000 R11: 0000000000000001 R12: 0000000000000007
[ 2980.189487] R13: 0000000000000080 R14: 0000000000000040 R15: ffff8804ce231eff
[ 2980.190166] FS:  00007f387b58f8c0(0000) GS:ffff88083fd40000(0000)
knlGS:0000000000000000
[ 2980.190166] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 2980.190166] CR2: ffffff81c1962137 CR3: 000000060da68000 CR4: 00000000000027e0
[ 2980.190166] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 2980.190166] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 2980.190166] Process qemu (pid: 29464, threadinfo ffff88049c742000,
task ffff88049f223000)
[ 2980.236490] Stack:
[ 2980.236490]  ffff8807a94bdc00 0000000000000000 0000000000000001
0000000000000000
[ 2980.236490]  ffff88040000005e 01ffffff8107a928 ffff88049f223000
00000000000f423f
[ 2980.236490]  ffff88049c743f38 00000000a94bdc00 ffff88049c743d28
ffff88049c743dd8
[ 2980.236490] Call Trace:
[ 2980.236490]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.236490]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.236490]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.236490]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.236490]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.236490]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.236490]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.331274]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.331274]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2980.331274]  [<ffffffff8115204c>] core_sys_select+0x18c/0x2b0
[ 2980.331274]  [<ffffffff81ae8f15>] ? _raw_spin_lock_irq+0x15/0x20
[ 2980.331274]  [<ffffffff81183ad4>] ? eventfd_ctx_read+0xb4/0x220
[ 2980.331274]  [<ffffffff81085f5d>] ? ktime_get_ts+0xad/0xe0
[ 2980.331274]  [<ffffffff811523d7>] sys_select+0x47/0x110
[ 2980.331274]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[ 2980.331274] Code: a0 fc ff ff 48 8d 75 cc 44 89 e7 e8 51 e5 fe ff
8b 95 a0 fc ff ff 49 89 c7 48 85 c0 74 c3 48 8b 40 20 48 85 c0 0f 84
2e 02 00 00 <48> 83 78 38 00 0f 84 23 02 00 00 48 c7 85 58 fd ff ff 02
00 00
[ 2980.331274] RIP  [<ffffffff81151b5a>] do_select+0x33a/0x6a0
[ 2980.331274]  RSP <ffff88049c7439e8>
[ 2980.331274] CR2: ffffff81c1962137
[ 2980.356444] ---[ end trace 12628ad637245060 ]---
[ 2980.908580] device vmEtap6 left promiscuous mode
[ 2981.402529] device vmEtap7 left promiscuous mode
[ 2981.856117] device vmEtap8 left promiscuous mode
[ 2982.294580] device vmEtap9 left promiscuous mode
[ 2982.340822] BUG: unable to handle kernel paging request at ffffff81c1962137
[ 2982.348264] IP: [<ffffffff81151b5a>] do_select+0x33a/0x6a0
[ 2982.350763] PGD 2221067 PUD 0
[ 2982.350763] Oops: 0000 [#7] SMP
[ 2982.350763] CPU 3
[ 2982.350763] Modules linked in: kvm_intel kvm
[ 2982.350763]
[ 2982.350763] Pid: 27896, comm: qemu Tainted: G      D W    3.5.0-rc7
#4 Dell Inc. PowerEdge M600/0MY736
[ 2982.350763] RIP: 0010:[<ffffffff81151b5a>]  [<ffffffff81151b5a>]
do_select+0x33a/0x6a0
[ 2982.350763] RSP: 0018:ffff88074a87b9e8  EFLAGS: 00010286
[ 2982.350763] RAX: ffffff81c19620ff RBX: ffffffffda00b2c8 RCX: 0000000000000300
[ 2982.350763] RDX: 000000000000005e RSI: ffff88074a87bd34 RDI: 0000000000000300
[ 2982.350763] RBP: ffff88074a87bd68 R08: ffff8806990e212f R09: 0000000000000301
[ 2982.350763] R10: 00000000000028c7 R11: 0000000000000001 R12: 0000000000000007
[ 2982.350763] R13: 0000000000000080 R14: 0000000000000040 R15: ffff8806990e20ff
[ 2982.350763] FS:  00007f2b916798c0(0000) GS:ffff88083fcc0000(0000)
knlGS:0000000000000000
[ 2982.350763] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 2982.350763] CR2: ffffff81c1962137 CR3: 00000005fe9f0000 CR4: 00000000000027e0
[ 2982.350763] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 2982.350763] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 2982.478155] Process qemu (pid: 27896, threadinfo ffff88074a87a000,
task ffff8804d088e000)
[ 2982.478155] Stack:
[ 2982.491738]  ffff8804d0e67c80 0000000000000000 0000000000000001
0000000000000000
[ 2982.491738]  ffff88070000005e 01ffffff8107a928 ffff8804d088e000
00000000000f423f
[ 2982.491738]  ffff88074a87bf38 00000000d0e67c80 ffff88074a87bd28
ffff88074a87bdd8
[ 2982.491738] Call Trace:
[ 2982.491738]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff81150ec0>] ? __pollwait+0xf0/0xf0
[ 2982.535426]  [<ffffffff8115204c>] core_sys_select+0x18c/0x2b0
[ 2982.535426]  [<ffffffff81ae8f15>] ? _raw_spin_lock_irq+0x15/0x20
[ 2982.535426]  [<ffffffff81183ad4>] ? eventfd_ctx_read+0xb4/0x220
[ 2982.535426]  [<ffffffff81085f5d>] ? ktime_get_ts+0xad/0xe0
[ 2982.535426]  [<ffffffff811523d7>] sys_select+0x47/0x110
[ 2982.535426]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[ 2982.535426] Code: a0 fc ff ff 48 8d 75 cc 44 89 e7 e8 51 e5 fe ff
8b 95 a0 fc ff ff 49 89 c7 48 85 c0 74 c3 48 8b 40 20 48 85 c0 0f 84
2e 02 00 00 <48> 83 78 38 00 0f 84 23 02 00 00 48 c7 85 58 fd ff ff 02
00 00
[ 2982.535426] RIP  [<ffffffff81151b5a>] do_select+0x33a/0x6a0
[ 2982.535426]  RSP <ffff88074a87b9e8>
[ 2982.535426] CR2: ffffff81c1962137
[ 2982.535426] ---[ end trace 12628ad637245061 ]---
[ 2982.845618] device vmEtap10 left promiscuous mode
[ 2983.346394] device vmEtap11 left promiscuous mode
[ 2984.031623] device vmEtap13 left promiscuous mode
[ 2984.444363] device vmEtap14 left promiscuous mode
[ 2984.860415] device vmEtap15 left promiscuous mode
[ 2985.582443] device vmEtap17 left promiscuous mode
[ 2986.032780] device vmEtap18 left promiscuous mode
[ 2986.445006] device vmEtap19 left promiscuous mode
[ 2986.816845] device vmEtap20 left promiscuous mode
[ 2987.266644] device vmEtap21 left promiscuous mode
[ 2987.714912] device vmEtap22 left promiscuous mode
[ 2988.122833] device vmEtap23 left promiscuous mode
[ 2998.535493] BUG: unable to handle kernel paging request at 000000010000003b
[ 2998.535746] IP: [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 2998.535954] PGD 63dd1c067 PUD 0
[ 2998.536102] Oops: 0000 [#8] SMP
[ 2998.536248] CPU 0
[ 2998.536314] Modules linked in: kvm_intel kvm
[ 2998.536566]
[ 2998.536579] Pid: 14138, comm: netstat Tainted: G      D W
3.5.0-rc7 #4 Dell Inc. PowerEdge M600/0MY736
[ 2998.536901] RIP: 0010:[<ffffffff811a3654>]  [<ffffffff811a3654>]
tid_fd_revalidate+0x84/0x1a0
[ 2998.537174] RSP: 0018:ffff880599495d78  EFLAGS: 00010206
[ 2998.537340] RAX: ffff8807f1186ec0 RBX: ffff8807d915f060 RCX: 000000000000007d
[ 2998.537544] RDX: 00000000ffffffff RSI: 0000000000000000 RDI: ffff8807f1186ec0
[ 2998.537749] RBP: ffff880599495d98 R08: ffff88083fc16b30 R09: ffffffff8119fef0
[ 2998.537953] R10: 0000000000000000 R11: 0000000000000202 R12: ffff88051a98a000
[ 2998.538158] R13: ffff8804cfda1000 R14: ffff8807f206e038 R15: ffff880599495e08
[ 2998.538363] FS:  00007fb5f7f50700(0000) GS:ffff88083fc00000(0000)
knlGS:0000000000000000
[ 2998.542536] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2998.542536] CR2: 000000010000003b CR3: 00000004b4d93000 CR4: 00000000000027e0
[ 2998.542536] DR0: 0000000000000001 DR1: 0000000000000002 DR2: 0000000000000001
[ 2998.542536] DR3: 000000000000000a DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 2998.542536] Process netstat (pid: 14138, threadinfo
ffff880599494000, task ffff880687a68000)
[ 2998.542536] Stack:
[ 2998.542536]  ffff88051a98a000 0000000000000007 ffff8807d915f060
ffff8807d91e7240
[ 2998.542536]  ffff880599495dc8 ffffffff811a3880 ffffffffff0a0210
0000000000000001
[ 2998.542536]  ffff880599495e98 ffff8804cda2dc00 ffff880599495e48
ffffffff811a4cd6
[ 2998.542536] Call Trace:
[ 2998.542536]  [<ffffffff811a3880>] proc_fd_instantiate+0x80/0xa0
[ 2998.542536]  [<ffffffff811a4cd6>] proc_fill_cache+0x126/0x150
[ 2998.542536]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 2998.542536]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2998.542536]  [<ffffffff811a5006>] proc_readfd_common+0xf6/0x1c0
[ 2998.542536]  [<ffffffff811a3800>] ? proc_fdinfo_instantiate+0x90/0x90
[ 2998.542536]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2998.542536]  [<ffffffff811a5105>] proc_readfd+0x15/0x20
[ 2998.542536]  [<ffffffff811507c0>] vfs_readdir+0xa0/0xc0
[ 2998.542536]  [<ffffffff811505a0>] ? filldir64+0xe0/0xe0
[ 2998.542536]  [<ffffffff8115096d>] sys_getdents+0x8d/0x100
[ 2998.542536]  [<ffffffff81ae9c29>] system_call_fastpath+0x16/0x1b
[ 2998.542536] Code: b8 00 00 00 48 8b 50 08 44 3b 32 0f 83 9e 00 00
00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2 0f 84 87 00 00
00 48 89 c7 <44> 8b 62 3c e8 13 29 ea ff 4c 89 ef e8 4b df ff ff 85 c0
0f 84
[ 2998.542536] RIP  [<ffffffff811a3654>] tid_fd_revalidate+0x84/0x1a0
[ 2998.542536]  RSP <ffff880599495d78>
[ 2998.542536] CR2: 000000010000003b
[ 2998.761009] ---[ end trace 12628ad637245062 ]---




2012/7/20 Dave Jones <davej@redhat.com>:
> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
>
>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
>
> That '1' looks like a random bit flip. Try running memtest86.
>
>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
>
> This wasn't the first problem either.
>
>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
>
> Looks like the same flipped bit.
>
>         Dave
>

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-20 13:21 ` Dave Jones
  2012-07-20 13:32   ` nicolas prochazka
@ 2012-07-20 20:21   ` Thadeu Lima de Souza Cascardo
  2012-07-20 20:52     ` nicolas prochazka
  1 sibling, 1 reply; 12+ messages in thread
From: Thadeu Lima de Souza Cascardo @ 2012-07-20 20:21 UTC (permalink / raw)
  To: Dave Jones, nicolas prochazka, linux-kernel

On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
> 
>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
> 
> That '1' looks like a random bit flip. Try running memtest86.
> 

Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
likely a pointer to some other piece of a struct. However, taking a look
at fs/files.c code, nothing seems suspicious.

Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
has been some changes in fs/files.c on 3.4-rc1 in the piece of code
where you hit the problem.

What does your system exercise? Any chance you are using a lot of
select, which has also been changed in those same patches to fs/files.c?

Regards.
Cascardo.


>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
> 
> This wasn't the first problem either.
> 
>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
> 
> Looks like the same flipped bit.
> 
> 	Dave
> 
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
> 


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-20 20:21   ` Thadeu Lima de Souza Cascardo
@ 2012-07-20 20:52     ` nicolas prochazka
  2012-07-20 21:06       ` Thadeu Lima de Souza Cascardo
  0 siblings, 1 reply; 12+ messages in thread
From: nicolas prochazka @ 2012-07-20 20:52 UTC (permalink / raw)
  To: Thadeu Lima de Souza Cascardo; +Cc: Dave Jones, linux-kernel

Hello
the problem is occured with  :
- linux kernel 3.4.5    i do not test with 3.4.0 / 1 / 2 / 3 / 4    ,
but i can if you want
- linux kernel 3.5rc6 rc7  / do not test with other rc.

the problem is not occured with :
linux kernel 3.3.4 / 3.3.8

These servers are used for :
- starting a lot of virtual machine with qemu-kvm ( ~ 40 )   ( lot of
select i think)
- do a lot of network tests with openvswitch

I can test a kernel 3.4.x before and after a commit id (?) to find a regression.

Regards,
Nicolas.


2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
>> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
>>
>>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
>>
>> That '1' looks like a random bit flip. Try running memtest86.
>>
>
> Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
> likely a pointer to some other piece of a struct. However, taking a look
> at fs/files.c code, nothing seems suspicious.
>
> Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
> has been some changes in fs/files.c on 3.4-rc1 in the piece of code
> where you hit the problem.
>
> What does your system exercise? Any chance you are using a lot of
> select, which has also been changed in those same patches to fs/files.c?
>
> Regards.
> Cascardo.
>
>
>>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
>>
>> This wasn't the first problem either.
>>
>>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
>>
>> Looks like the same flipped bit.
>>
>>       Dave
>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> Please read the FAQ at  http://www.tux.org/lkml/
>>
>

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-20 20:52     ` nicolas prochazka
@ 2012-07-20 21:06       ` Thadeu Lima de Souza Cascardo
  2012-07-20 22:59         ` nicolas prochazka
  0 siblings, 1 reply; 12+ messages in thread
From: Thadeu Lima de Souza Cascardo @ 2012-07-20 21:06 UTC (permalink / raw)
  To: nicolas prochazka; +Cc: Dave Jones, linux-kernel

On Fri, Jul 20, 2012 at 10:52:40PM +0200, nicolas prochazka wrote:
> Hello
> the problem is occured with  :
> - linux kernel 3.4.5    i do not test with 3.4.0 / 1 / 2 / 3 / 4    ,
> but i can if you want
> - linux kernel 3.5rc6 rc7  / do not test with other rc.
> 
> the problem is not occured with :
> linux kernel 3.3.4 / 3.3.8
> 
> These servers are used for :
> - starting a lot of virtual machine with qemu-kvm ( ~ 40 )   ( lot of
> select i think)
> - do a lot of network tests with openvswitch
> 
> I can test a kernel 3.4.x before and after a commit id (?) to find a regression.
> 
> Regards,
> Nicolas.
> 

Can you try this commit 1fd36adcd98c14d2fd97f545293c488775cb2823? And
the commit before it?

> 
> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> > On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
> >> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
> >>
> >>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
> >>
> >> That '1' looks like a random bit flip. Try running memtest86.
> >>
> >
> > Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
> > likely a pointer to some other piece of a struct. However, taking a look
> > at fs/files.c code, nothing seems suspicious.
> >
> > Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
> > has been some changes in fs/files.c on 3.4-rc1 in the piece of code
> > where you hit the problem.
> >
> > What does your system exercise? Any chance you are using a lot of
> > select, which has also been changed in those same patches to fs/files.c?
> >
> > Regards.
> > Cascardo.
> >
> >
> >>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
> >>
> >> This wasn't the first problem either.
> >>
> >>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
> >>
> >> Looks like the same flipped bit.
> >>
> >>       Dave
> >>
> >> --
> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> >> the body of a message to majordomo@vger.kernel.org
> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >> Please read the FAQ at  http://www.tux.org/lkml/
> >>
> >
> 


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-20 21:06       ` Thadeu Lima de Souza Cascardo
@ 2012-07-20 22:59         ` nicolas prochazka
  2012-07-23 16:39           ` Thadeu Lima de Souza Cascardo
  0 siblings, 1 reply; 12+ messages in thread
From: nicolas prochazka @ 2012-07-20 22:59 UTC (permalink / raw)
  To: Thadeu Lima de Souza Cascardo; +Cc: Dave Jones, linux-kernel

Well done
1fd36adcd98c14d2fd97f545293c488775cb2823  :  the bug occurs   ( cf dump )
1dce27c5aa6770e9d195f2bb7db1db3d4dde5591 :  the bug not occurs

Regards,
Nicolas Prochazka.

dump  / 1fd36adcd98c14d2fd97f545293c488775cb2823
lloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
VMtap: no IPv6 routers present
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 71 not NULL!
alloc_fd: slot 121 not NULL!
alloc_fd: slot 96 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 110 not NULL!
alloc_fd: slot 121 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
brE: no IPv6 routers present
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 121 not NULL!
alloc_fd: slot 142 not NULL!
alloc_fd: slot 153 not NULL!
alloc_fd: slot 153 not NULL!
alloc_fd: slot 153 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 70 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 102 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 106 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 106 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 36 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 68 not NULL!
alloc_fd: slot 100 not NULL!
alloc_fd: slot 100 not NULL!
------------[ cut here ]------------
kernel BUG at fs/open.c:873!
invalid opcode: 0000 [#1] SMP
CPU 0
Modules linked in: kvm_intel kvm

then BUG paging request as usual


2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> On Fri, Jul 20, 2012 at 10:52:40PM +0200, nicolas prochazka wrote:
>> Hello
>> the problem is occured with  :
>> - linux kernel 3.4.5    i do not test with 3.4.0 / 1 / 2 / 3 / 4    ,
>> but i can if you want
>> - linux kernel 3.5rc6 rc7  / do not test with other rc.
>>
>> the problem is not occured with :
>> linux kernel 3.3.4 / 3.3.8
>>
>> These servers are used for :
>> - starting a lot of virtual machine with qemu-kvm ( ~ 40 )   ( lot of
>> select i think)
>> - do a lot of network tests with openvswitch
>>
>> I can test a kernel 3.4.x before and after a commit id (?) to find a regression.
>>
>> Regards,
>> Nicolas.
>>
>
> Can you try this commit 1fd36adcd98c14d2fd97f545293c488775cb2823? And
> the commit before it?
>
>>
>> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>> > On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
>> >> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
>> >>
>> >>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
>> >>
>> >> That '1' looks like a random bit flip. Try running memtest86.
>> >>
>> >
>> > Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
>> > likely a pointer to some other piece of a struct. However, taking a look
>> > at fs/files.c code, nothing seems suspicious.
>> >
>> > Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
>> > has been some changes in fs/files.c on 3.4-rc1 in the piece of code
>> > where you hit the problem.
>> >
>> > What does your system exercise? Any chance you are using a lot of
>> > select, which has also been changed in those same patches to fs/files.c?
>> >
>> > Regards.
>> > Cascardo.
>> >
>> >
>> >>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
>> >>
>> >> This wasn't the first problem either.
>> >>
>> >>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
>> >>
>> >> Looks like the same flipped bit.
>> >>
>> >>       Dave
>> >>
>> >> --
>> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>> >> the body of a message to majordomo@vger.kernel.org
>> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> >> Please read the FAQ at  http://www.tux.org/lkml/
>> >>
>> >
>>
>

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-20 22:59         ` nicolas prochazka
@ 2012-07-23 16:39           ` Thadeu Lima de Souza Cascardo
  2012-07-23 21:15             ` nicolas prochazka
  0 siblings, 1 reply; 12+ messages in thread
From: Thadeu Lima de Souza Cascardo @ 2012-07-23 16:39 UTC (permalink / raw)
  To: nicolas prochazka; +Cc: Dave Jones, linux-kernel

On Sat, Jul 21, 2012 at 12:59:12AM +0200, nicolas prochazka wrote:
> Well done
> 1fd36adcd98c14d2fd97f545293c488775cb2823  :  the bug occurs   ( cf dump )
> 1dce27c5aa6770e9d195f2bb7db1db3d4dde5591 :  the bug not occurs
> 
> Regards,
> Nicolas Prochazka.

Hi, Nicolas.

I was too hasty in sending you the commit id. There is a bug in 1fd36adc
that is fixed by commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215. Can
you test running f044db4cb4? If you find the bug in there, then we know
that this fix isn't the only one needed for 1fd36adc.

Regards.
Cascardo.

> 
> dump  / 1fd36adcd98c14d2fd97f545293c488775cb2823
> lloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> VMtap: no IPv6 routers present
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 71 not NULL!
> alloc_fd: slot 121 not NULL!
> alloc_fd: slot 96 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 110 not NULL!
> alloc_fd: slot 121 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> brE: no IPv6 routers present
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 121 not NULL!
> alloc_fd: slot 142 not NULL!
> alloc_fd: slot 153 not NULL!
> alloc_fd: slot 153 not NULL!
> alloc_fd: slot 153 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 70 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 102 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 106 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 106 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 36 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 68 not NULL!
> alloc_fd: slot 100 not NULL!
> alloc_fd: slot 100 not NULL!
> ------------[ cut here ]------------
> kernel BUG at fs/open.c:873!
> invalid opcode: 0000 [#1] SMP
> CPU 0
> Modules linked in: kvm_intel kvm
> 
> then BUG paging request as usual
> 
> 
> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> > On Fri, Jul 20, 2012 at 10:52:40PM +0200, nicolas prochazka wrote:
> >> Hello
> >> the problem is occured with  :
> >> - linux kernel 3.4.5    i do not test with 3.4.0 / 1 / 2 / 3 / 4    ,
> >> but i can if you want
> >> - linux kernel 3.5rc6 rc7  / do not test with other rc.
> >>
> >> the problem is not occured with :
> >> linux kernel 3.3.4 / 3.3.8
> >>
> >> These servers are used for :
> >> - starting a lot of virtual machine with qemu-kvm ( ~ 40 )   ( lot of
> >> select i think)
> >> - do a lot of network tests with openvswitch
> >>
> >> I can test a kernel 3.4.x before and after a commit id (?) to find a regression.
> >>
> >> Regards,
> >> Nicolas.
> >>
> >
> > Can you try this commit 1fd36adcd98c14d2fd97f545293c488775cb2823? And
> > the commit before it?
> >
> >>
> >> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> >> > On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
> >> >> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
> >> >>
> >> >>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
> >> >>
> >> >> That '1' looks like a random bit flip. Try running memtest86.
> >> >>
> >> >
> >> > Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
> >> > likely a pointer to some other piece of a struct. However, taking a look
> >> > at fs/files.c code, nothing seems suspicious.
> >> >
> >> > Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
> >> > has been some changes in fs/files.c on 3.4-rc1 in the piece of code
> >> > where you hit the problem.
> >> >
> >> > What does your system exercise? Any chance you are using a lot of
> >> > select, which has also been changed in those same patches to fs/files.c?
> >> >
> >> > Regards.
> >> > Cascardo.
> >> >
> >> >
> >> >>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
> >> >>
> >> >> This wasn't the first problem either.
> >> >>
> >> >>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
> >> >>
> >> >> Looks like the same flipped bit.
> >> >>
> >> >>       Dave
> >> >>
> >> >> --
> >> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> >> >> the body of a message to majordomo@vger.kernel.org
> >> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >> >> Please read the FAQ at  http://www.tux.org/lkml/
> >> >>
> >> >
> >>
> >
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
> 


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-23 16:39           ` Thadeu Lima de Souza Cascardo
@ 2012-07-23 21:15             ` nicolas prochazka
  2012-07-24 16:52               ` Thadeu Lima de Souza Cascardo
  0 siblings, 1 reply; 12+ messages in thread
From: nicolas prochazka @ 2012-07-23 21:15 UTC (permalink / raw)
  To: Thadeu Lima de Souza Cascardo; +Cc: Dave Jones, linux-kernel

Hello,
I 'm trying differents versions with differents results

- commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215  : bug is not reproductible
- 3.5rc7  : bug is reproductible    (cf new dump )
- master branch  : bug is reproductible



Regards,
Nicolas Prochazka


Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000002f
Jul 23 21:10:05 positronic18696 IP: [<ffffffff81156900>] dup_fd+0x160/0x2e0
Jul 23 21:10:05 positronic18696 PGD 6627ea067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0002 [#1] SMP
Jul 23 21:10:05 positronic18696 CPU 1
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 17596, comm: queue.sh Not tainted
3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff81156900>]
[<ffffffff81156900>] dup_fd+0x160/0x2e0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff880669ebdd90  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: 0000000000000038 RBX:
ffff8807ed95eec0 RCX: 0000000000000007
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000800 RDI: ffff8805a4d01d40
Jul 23 21:10:05 positronic18696 RBP: ffff880669ebddf0 R08:
0000000000000020 R09: ffffffff81156694
Jul 23 21:10:05 positronic18696 R10: 0000000000000001 R11:
0000000000000000 R12: ffff8807ecf25000
Jul 23 21:10:05 positronic18696 R13: ffff8805a4d01d80 R14:
0000000000000100 R15: ffff8807d3a61800
Jul 23 21:10:05 positronic18696 FS:  00007f1a8e719700(0000)
GS:ffff88083fc40000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
000000008005003b
Jul 23 21:10:05 positronic18696 CR2: 000000010000002f CR3:
000000066ef90000 CR4: 00000000000027e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process queue.sh (pid: 17596,
threadinfo ffff880669ebc000, task ffff8806625ab000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff880669ebdda0 000000018102db49
0000000000000020 ffff8806627ee8c0
Jul 23 21:10:05 positronic18696 ffff8807eefc1608 ffff8807eefc1680
00007f1a8e7199d0 ffff8807bf41d000
Jul 23 21:10:05 positronic18696 0000000000000000 0000000001200011
00007f1a8e7199d0 0000000000000000
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff81040441>] copy_process+0x931/0x13c0
Jul 23 21:10:05 positronic18696 [<ffffffff81041024>] do_fork+0x54/0x360
Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff810559e7>] ?
__set_task_blocked+0x37/0x80
Jul 23 21:10:05 positronic18696 [<ffffffff81055a83>] ?
__set_current_blocked+0x53/0x70
Jul 23 21:10:05 positronic18696 [<ffffffff8100c098>] sys_clone+0x28/0x30
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4bb3>] stub_clone+0x13/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>] ?
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10
4c 89 c2 e8 08 82 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5
08 00 00 00 31 c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0
08 48 39 f0 74 24 49
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff81156900>] dup_fd+0x160/0x2e0
Jul 23 21:10:05 positronic18696 RSP <ffff880669ebdd90>
Jul 23 21:10:05 positronic18696 CR2: 000000010000002f
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92756 ]---
Jul 23 21:10:05 positronic18696 device vmtap35 left promiscuous mode
Jul 23 21:10:05 positronic18696 device vmEtap35 left promiscuous mode
Jul 23 21:10:05 positronic18696 device vmtap36 left promiscuous mode
Jul 23 21:10:05 positronic18696 device vmEtap36 left promiscuous mode
Jul 23 21:10:05 positronic18696 device vmtap37 left promiscuous mode
Jul 23 21:10:05 positronic18696 device vmEtap37 left promiscuous mode
Jul 23 21:10:05 positronic18696 device vmtap38 left promiscuous mode
Jul 23 21:10:05 positronic18696 device vmEtap38 left promiscuous mode
Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000003b
Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 PGD 598c9e067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0000 [#2] SMP
Jul 23 21:10:05 positronic18696 CPU 0
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 21815, comm: netstat Tainted: G
   D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
[<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88053f965d78  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf700 RBX:
ffff8807ed1d9118 RCX: 000000000000007e
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000000 RDI: ffff8807ee3bf700
Jul 23 21:10:05 positronic18696 RBP: ffff88053f965d98 R08:
ffff88083fc16a10 R09: ffffffff8119bfe0
Jul 23 21:10:05 positronic18696 R10: 0000000000000000 R11:
0000000000000206 R12: ffff8807d8afaa80
Jul 23 21:10:05 positronic18696 R13: ffff8808139d7000 R14:
ffff8807ed98d038 R15: ffff88053f965e08
Jul 23 21:10:05 positronic18696 FS:  00007faee78b5700(0000)
GS:ffff88083fc00000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
00000007e2eb5000 CR4: 00000000000007e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process netstat (pid: 21815,
threadinfo ffff88053f964000, task ffff8807c6207000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff8807d8afaa80 0000000000000007
ffff8807ed1d9118 ffff8807ee63ab40
Jul 23 21:10:05 positronic18696 ffff88053f965dc8 ffffffff8119f8b0
ffffffffff0a0210 0000000000000001
Jul 23 21:10:05 positronic18696 ffff88053f965e98 ffff8807eca70200
ffff88053f965e48 ffffffff811a0876
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff8119f8b0>]
proc_fd_instantiate+0x80/0xa0
Jul 23 21:10:05 positronic18696 [<ffffffff811a0876>] proc_fill_cache+0x126/0x150
Jul 23 21:10:05 positronic18696 [<ffffffff8119f830>] ?
proc_fdinfo_instantiate+0x90/0x90
Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
Jul 23 21:10:05 positronic18696 [<ffffffff811a0ba6>]
proc_readfd_common+0xf6/0x1c0
Jul 23 21:10:05 positronic18696 [<ffffffff8119f830>] ?
proc_fdinfo_instantiate+0x90/0x90
Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
Jul 23 21:10:05 positronic18696 [<ffffffff811a0ca5>] proc_readfd+0x15/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff8114ce70>] vfs_readdir+0xa0/0xc0
Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
Jul 23 21:10:05 positronic18696 [<ffffffff8114d01d>] sys_getdents+0x8d/0x100
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
e0 ff ff 85 c0 0f 84
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP <ffff88053f965d78>
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92757 ]---
Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000002f
Jul 23 21:10:05 positronic18696 IP: [<ffffffff81156900>] dup_fd+0x160/0x2e0
Jul 23 21:10:05 positronic18696 PGD 7ee96c067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0002 [#3] SMP
Jul 23 21:10:05 positronic18696 CPU 3
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 7882, comm: bash Tainted: G
D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff81156900>]
[<ffffffff81156900>] dup_fd+0x160/0x2e0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807ec9e1d90  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: 0000000000000038 RBX:
ffff8807ed42de40 RCX: 0000000000000007
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000800 RDI: ffff8807ef0de080
Jul 23 21:10:05 positronic18696 RBP: ffff8807ec9e1df0 R08:
0000000000000020 R09: ffffffff81156694
Jul 23 21:10:05 positronic18696 R10: 00000000fffffffb R11:
0000000000000000 R12: ffff8807eb8ec000
Jul 23 21:10:05 positronic18696 R13: ffff8807ef0de440 R14:
0000000000000100 R15: ffff8807ed98d000
Jul 23 21:10:05 positronic18696 FS:  00007f7d50f02700(0000)
GS:ffff88083fcc0000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
000000008005003b
Jul 23 21:10:05 positronic18696 CR2: 000000010000002f CR3:
00000007ed669000 CR4: 00000000000007e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process bash (pid: 7882, threadinfo
ffff8807ec9e0000, task ffff8808139d7000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff8807ec9e1da0 000000018102db49
0000000000000020 ffff8807ef0de980
Jul 23 21:10:05 positronic18696 ffff8807ee3bf708 ffff8807ee3bf780
00007f7d50f029d0 ffff8806627e6000
Jul 23 21:10:05 positronic18696 0000000000000000 0000000001200011
00007f7d50f029d0 0000000000000000
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff81040441>] copy_process+0x931/0x13c0
Jul 23 21:10:05 positronic18696 [<ffffffff8112902f>] ?
kmem_cache_alloc+0xaf/0x110
Jul 23 21:10:05 positronic18696 [<ffffffff81041024>] do_fork+0x54/0x360
Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81139247>] ? fd_install+0x67/0x90
Jul 23 21:10:05 positronic18696 [<ffffffff81144580>] ? do_pipe_flags+0xb0/0x100
Jul 23 21:10:05 positronic18696 [<ffffffff8100c098>] sys_clone+0x28/0x30
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4bb3>] stub_clone+0x13/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>] ?
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10
4c 89 c2 e8 08 82 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5
08 00 00 00 31 c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0
08 48 39 f0 74 24 49
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff81156900>] dup_fd+0x160/0x2e0
Jul 23 21:10:05 positronic18696 RSP <ffff8807ec9e1d90>
Jul 23 21:10:05 positronic18696 CR2: 000000010000002f
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92758 ]---
Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000003b
Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 PGD 7ec990067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0000 [#4] SMP
Jul 23 21:10:05 positronic18696 CPU 3
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 22417, comm: netstat Tainted: G
   D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
[<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88066ef4fcd8  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
ffff8807ed065f88 RCX: ffff8807ed051000
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000000 RDI: ffff8807ee3bf180
Jul 23 21:10:05 positronic18696 RBP: ffff88066ef4fcf8 R08:
ffff8807ed051038 R09: ffffffffffcaffc8
Jul 23 21:10:05 positronic18696 R10: ffff88066ef4fc44 R11:
0000000000000004 R12: ffff8807ed051000
Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
ffff8807eb875038 R15: ffff880813b59c20
Jul 23 21:10:05 positronic18696 FS:  00007f7200558700(0000)
GS:ffff88083fcc0000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
00000007ec9fd000 CR4: 00000000000027e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process netstat (pid: 22417,
threadinfo ffff88066ef4e000, task ffff8807ecfa9000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff88066ef4fdb8 ffff88066ef4fe48
ffff88066ef4fdc8 0000000000000001
Jul 23 21:10:05 positronic18696 ffff88066ef4fd58 ffffffff811460dc
ffff880813b59c20 ffff8807ed051000
Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
0000000000000040 ffff88066ef4fe48
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
user_path_at_empty+0x59/0xb0
Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
mntput_no_expire+0x44/0x140
Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
e0 ff ff 85 c0 0f 84
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP <ffff88066ef4fcd8>
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92759 ]---
Jul 23 21:10:05 positronic18696 device vmtap24 entered promiscuous mode
Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000003b
Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 PGD 7ecea9067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0000 [#5] SMP
Jul 23 21:10:05 positronic18696 CPU 2
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 22487, comm: netstat Tainted: G
   D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
[<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807ecb4dcd8  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
ffff8807ed065f88 RCX: ffff8807ed051000
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000000 RDI: ffff8807ee3bf180
Jul 23 21:10:05 positronic18696 RBP: ffff8807ecb4dcf8 R08:
ffff8807ed051038 R09: ffffffffffcaffc8
Jul 23 21:10:05 positronic18696 R10: ffff8807ecb4dc44 R11:
0000000000000004 R12: ffff8807ed051000
Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
ffff8807eb875038 R15: ffff880813b59c20
Jul 23 21:10:05 positronic18696 FS:  00007f370dd20700(0000)
GS:ffff88083fc80000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
0000000623f45000 CR4: 00000000000027e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process netstat (pid: 22487,
threadinfo ffff8807ecb4c000, task ffff8807d1b99000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff8807ecb4ddb8 ffff8807ecb4de48
ffff8807ecb4ddc8 0000000000000001
Jul 23 21:10:05 positronic18696 ffff8807ecb4dd58 ffffffff811460dc
ffff880813b59c20 ffff8807ed051000
Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
0000000000000040 ffff8807ecb4de48
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
user_path_at_empty+0x59/0xb0
Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
mntput_no_expire+0x44/0x140
Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
e0 ff ff 85 c0 0f 84
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP <ffff8807ecb4dcd8>
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275a ]---
Jul 23 21:10:05 positronic18696 device vmEtap24 entered promiscuous mode
Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000003b
Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 PGD 7ec9a0067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0000 [#6] SMP
Jul 23 21:10:05 positronic18696 CPU 3
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 22570, comm: netstat Tainted: G
   D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
[<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88066edebcd8  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
ffff8807ed065f88 RCX: ffff8807ed051000
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000000 RDI: ffff8807ee3bf180
Jul 23 21:10:05 positronic18696 RBP: ffff88066edebcf8 R08:
ffff8807ed051038 R09: ffffffffffcaffc8
Jul 23 21:10:05 positronic18696 R10: ffff88066edebc44 R11:
0000000000000004 R12: ffff8807ed051000
Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
ffff8807eb875038 R15: ffff880813b59c20
Jul 23 21:10:05 positronic18696 FS:  00007f914b112700(0000)
GS:ffff88083fcc0000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
00000005a4c9b000 CR4: 00000000000027e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process netstat (pid: 22570,
threadinfo ffff88066edea000, task ffff8807eefa2000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff88066edebdb8 ffff88066edebe48
ffff88066edebdc8 0000000000000001
Jul 23 21:10:05 positronic18696 ffff88066edebd58 ffffffff811460dc
ffff880813b59c20 ffff8807ed051000
Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
0000000000000040 ffff88066edebe48
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
user_path_at_empty+0x59/0xb0
Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
mntput_no_expire+0x44/0x140
Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
e0 ff ff 85 c0 0f 84
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP <ffff88066edebcd8>
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275b ]---
Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000003b
Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 PGD 53d536067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0000 [#7] SMP
Jul 23 21:10:05 positronic18696 CPU 1
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 22727, comm: netstat Tainted: G
   D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
[<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807bf797cd8  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
ffff8807ed065f88 RCX: ffff8807ed051000
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000000 RDI: ffff8807ee3bf180
Jul 23 21:10:05 positronic18696 RBP: ffff8807bf797cf8 R08:
ffff8807ed051038 R09: ffffffffffcaffc8
Jul 23 21:10:05 positronic18696 R10: ffff8807bf797c44 R11:
0000000000000004 R12: ffff8807ed051000
Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
ffff8807eb875038 R15: ffff880813b59c20
Jul 23 21:10:05 positronic18696 FS:  00007f49e0de2700(0000)
GS:ffff88083fc40000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
000000066ed95000 CR4: 00000000000027e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process netstat (pid: 22727,
threadinfo ffff8807bf796000, task ffff8807eeeb1000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff8807bf797db8 ffff8807bf797e48
ffff8807bf797dc8 0000000000000001
Jul 23 21:10:05 positronic18696 ffff8807bf797d58 ffffffff811460dc
ffff880813b59c20 ffff8807ed051000
Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
0000000000000040 ffff8807bf797e48
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
user_path_at_empty+0x59/0xb0
Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
mntput_no_expire+0x44/0x140
Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
e0 ff ff 85 c0 0f 84
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP <ffff8807bf797cd8>
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275c ]---
Jul 23 21:10:05 positronic18696 device vmtap25 entered promiscuous mode
Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000003b
Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 PGD 7c6184067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0000 [#8] SMP
Jul 23 21:10:05 positronic18696 CPU 7
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 22808, comm: netstat Tainted: G
   D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
[<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff880771b43cd8  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
ffff8807ed065f88 RCX: ffff8807ed051000
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000000 RDI: ffff8807ee3bf180
Jul 23 21:10:05 positronic18696 RBP: ffff880771b43cf8 R08:
ffff8807ed051038 R09: ffffffffffcaffc8
Jul 23 21:10:05 positronic18696 R10: ffff880771b43c44 R11:
0000000000000004 R12: ffff8807ed051000
Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
ffff8807eb875038 R15: ffff880813b59c20
Jul 23 21:10:05 positronic18696 FS:  00007f22e3d5f700(0000)
GS:ffff88083fdc0000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
000000053d5cc000 CR4: 00000000000027e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process netstat (pid: 22808,
threadinfo ffff880771b42000, task ffff8807e2e36000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff880771b43db8 ffff880771b43e48
ffff880771b43dc8 0000000000000001
Jul 23 21:10:05 positronic18696 ffff880771b43d58 ffffffff811460dc
ffff880813b59c20 ffff8807ed051000
Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
0000000000000040 ffff880771b43e48
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
user_path_at_empty+0x59/0xb0
Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
mntput_no_expire+0x44/0x140
Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
e0 ff ff 85 c0 0f 84
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP <ffff880771b43cd8>
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275d ]---
Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
request at 000000010000003b
Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 device vmEtap25 entered promiscuous mode
Jul 23 21:10:05 positronic18696 PGD 771aad067 PUD 0
Jul 23 21:10:05 positronic18696 Oops: 0000 [#9] SMP
Jul 23 21:10:05 positronic18696 CPU 0
Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
Jul 23 21:10:05 positronic18696
Jul 23 21:10:05 positronic18696 Pid: 22820, comm: netstat Tainted: G
   D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
[<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807c628fcd8  EFLAGS: 00010206
Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
ffff8807ed065f88 RCX: ffff8807ed051000
Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
0000000000000000 RDI: ffff8807ee3bf180
Jul 23 21:10:05 positronic18696 RBP: ffff8807c628fcf8 R08:
ffff8807ed051038 R09: ffffffffffcaffc8
Jul 23 21:10:05 positronic18696 R10: ffff8807c628fc44 R11:
0000000000000004 R12: ffff8807ed051000
Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
ffff8807eb875038 R15: ffff880813b59c20
Jul 23 21:10:05 positronic18696 FS:  00007fe1972b9700(0000)
GS:ffff88083fc00000(0000) knlGS:0000000000000000
Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
00000007a745d000 CR4: 00000000000027e0
Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
0000000000000002 DR2: 0000000000000001
Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
00000000ffff0ff0 DR7: 0000000000000400
Jul 23 21:10:05 positronic18696 Process netstat (pid: 22820,
threadinfo ffff8807c628e000, task ffff8807d1a99000)
Jul 23 21:10:05 positronic18696 Stack:
Jul 23 21:10:05 positronic18696 ffff8807c628fdb8 ffff8807c628fe48
ffff8807c628fdc8 0000000000000001
Jul 23 21:10:05 positronic18696 ffff8807c628fd58 ffffffff811460dc
ffff880813b59c20 ffff8807ed051000
Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
0000000000000040 ffff8807c628fe48
Jul 23 21:10:05 positronic18696 Call Trace:
Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
user_path_at_empty+0x59/0xb0
Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
mntput_no_expire+0x44/0x140
Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
system_call_fastpath+0x16/0x1b
Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
e0 ff ff 85 c0 0f 84
Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
tid_fd_revalidate+0x84/0x1a0
Jul 23 21:10:05 positronic18696 RSP <ffff8807c628fcd8>
Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275e ]---




2012/7/23 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> On Sat, Jul 21, 2012 at 12:59:12AM +0200, nicolas prochazka wrote:
>> Well done
>> 1fd36adcd98c14d2fd97f545293c488775cb2823  :  the bug occurs   ( cf dump )
>> 1dce27c5aa6770e9d195f2bb7db1db3d4dde5591 :  the bug not occurs
>>
>> Regards,
>> Nicolas Prochazka.
>
> Hi, Nicolas.
>
> I was too hasty in sending you the commit id. There is a bug in 1fd36adc
> that is fixed by commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215. Can
> you test running f044db4cb4? If you find the bug in there, then we know
> that this fix isn't the only one needed for 1fd36adc.
>
> Regards.
> Cascardo.
>
>>
>> dump  / 1fd36adcd98c14d2fd97f545293c488775cb2823
>> lloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> VMtap: no IPv6 routers present
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 71 not NULL!
>> alloc_fd: slot 121 not NULL!
>> alloc_fd: slot 96 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 110 not NULL!
>> alloc_fd: slot 121 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> brE: no IPv6 routers present
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 121 not NULL!
>> alloc_fd: slot 142 not NULL!
>> alloc_fd: slot 153 not NULL!
>> alloc_fd: slot 153 not NULL!
>> alloc_fd: slot 153 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 70 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 102 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 106 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 106 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 36 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 68 not NULL!
>> alloc_fd: slot 100 not NULL!
>> alloc_fd: slot 100 not NULL!
>> ------------[ cut here ]------------
>> kernel BUG at fs/open.c:873!
>> invalid opcode: 0000 [#1] SMP
>> CPU 0
>> Modules linked in: kvm_intel kvm
>>
>> then BUG paging request as usual
>>
>>
>> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>> > On Fri, Jul 20, 2012 at 10:52:40PM +0200, nicolas prochazka wrote:
>> >> Hello
>> >> the problem is occured with  :
>> >> - linux kernel 3.4.5    i do not test with 3.4.0 / 1 / 2 / 3 / 4    ,
>> >> but i can if you want
>> >> - linux kernel 3.5rc6 rc7  / do not test with other rc.
>> >>
>> >> the problem is not occured with :
>> >> linux kernel 3.3.4 / 3.3.8
>> >>
>> >> These servers are used for :
>> >> - starting a lot of virtual machine with qemu-kvm ( ~ 40 )   ( lot of
>> >> select i think)
>> >> - do a lot of network tests with openvswitch
>> >>
>> >> I can test a kernel 3.4.x before and after a commit id (?) to find a regression.
>> >>
>> >> Regards,
>> >> Nicolas.
>> >>
>> >
>> > Can you try this commit 1fd36adcd98c14d2fd97f545293c488775cb2823? And
>> > the commit before it?
>> >
>> >>
>> >> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>> >> > On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
>> >> >> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
>> >> >>
>> >> >>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
>> >> >>
>> >> >> That '1' looks like a random bit flip. Try running memtest86.
>> >> >>
>> >> >
>> >> > Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
>> >> > likely a pointer to some other piece of a struct. However, taking a look
>> >> > at fs/files.c code, nothing seems suspicious.
>> >> >
>> >> > Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
>> >> > has been some changes in fs/files.c on 3.4-rc1 in the piece of code
>> >> > where you hit the problem.
>> >> >
>> >> > What does your system exercise? Any chance you are using a lot of
>> >> > select, which has also been changed in those same patches to fs/files.c?
>> >> >
>> >> > Regards.
>> >> > Cascardo.
>> >> >
>> >> >
>> >> >>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
>> >> >>
>> >> >> This wasn't the first problem either.
>> >> >>
>> >> >>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
>> >> >>
>> >> >> Looks like the same flipped bit.
>> >> >>
>> >> >>       Dave
>> >> >>
>> >> >> --
>> >> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>> >> >> the body of a message to majordomo@vger.kernel.org
>> >> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> >> >> Please read the FAQ at  http://www.tux.org/lkml/
>> >> >>
>> >> >
>> >>
>> >
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> Please read the FAQ at  http://www.tux.org/lkml/
>>
>

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-23 21:15             ` nicolas prochazka
@ 2012-07-24 16:52               ` Thadeu Lima de Souza Cascardo
  2012-07-28  7:52                 ` nicolas prochazka
  0 siblings, 1 reply; 12+ messages in thread
From: Thadeu Lima de Souza Cascardo @ 2012-07-24 16:52 UTC (permalink / raw)
  To: nicolas prochazka; +Cc: Dave Jones, linux-kernel, David Howells, Bobby Powers

On Mon, Jul 23, 2012 at 11:15:09PM +0200, nicolas prochazka wrote:
> Hello,
> I 'm trying differents versions with differents results
> 
> - commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215  : bug is not reproductible
> - 3.5rc7  : bug is reproductible    (cf new dump )
> - master branch  : bug is reproductible
> 
> 
> 
> Regards,
> Nicolas Prochazka
> 
> 

Hi, Nicolas.

Can you try a bisect? I am also copying David Howells and Bobby Powers,
even though their set of patches don't seem to be the culprit.

Regards.
Cascardo.

> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000002f
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff81156900>] dup_fd+0x160/0x2e0
> Jul 23 21:10:05 positronic18696 PGD 6627ea067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0002 [#1] SMP
> Jul 23 21:10:05 positronic18696 CPU 1
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 17596, comm: queue.sh Not tainted
> 3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff81156900>]
> [<ffffffff81156900>] dup_fd+0x160/0x2e0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff880669ebdd90  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: 0000000000000038 RBX:
> ffff8807ed95eec0 RCX: 0000000000000007
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000800 RDI: ffff8805a4d01d40
> Jul 23 21:10:05 positronic18696 RBP: ffff880669ebddf0 R08:
> 0000000000000020 R09: ffffffff81156694
> Jul 23 21:10:05 positronic18696 R10: 0000000000000001 R11:
> 0000000000000000 R12: ffff8807ecf25000
> Jul 23 21:10:05 positronic18696 R13: ffff8805a4d01d80 R14:
> 0000000000000100 R15: ffff8807d3a61800
> Jul 23 21:10:05 positronic18696 FS:  00007f1a8e719700(0000)
> GS:ffff88083fc40000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 000000008005003b
> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f CR3:
> 000000066ef90000 CR4: 00000000000027e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process queue.sh (pid: 17596,
> threadinfo ffff880669ebc000, task ffff8806625ab000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff880669ebdda0 000000018102db49
> 0000000000000020 ffff8806627ee8c0
> Jul 23 21:10:05 positronic18696 ffff8807eefc1608 ffff8807eefc1680
> 00007f1a8e7199d0 ffff8807bf41d000
> Jul 23 21:10:05 positronic18696 0000000000000000 0000000001200011
> 00007f1a8e7199d0 0000000000000000
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff81040441>] copy_process+0x931/0x13c0
> Jul 23 21:10:05 positronic18696 [<ffffffff81041024>] do_fork+0x54/0x360
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff810559e7>] ?
> __set_task_blocked+0x37/0x80
> Jul 23 21:10:05 positronic18696 [<ffffffff81055a83>] ?
> __set_current_blocked+0x53/0x70
> Jul 23 21:10:05 positronic18696 [<ffffffff8100c098>] sys_clone+0x28/0x30
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4bb3>] stub_clone+0x13/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>] ?
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10
> 4c 89 c2 e8 08 82 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5
> 08 00 00 00 31 c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0
> 08 48 39 f0 74 24 49
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff81156900>] dup_fd+0x160/0x2e0
> Jul 23 21:10:05 positronic18696 RSP <ffff880669ebdd90>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92756 ]---
> Jul 23 21:10:05 positronic18696 device vmtap35 left promiscuous mode
> Jul 23 21:10:05 positronic18696 device vmEtap35 left promiscuous mode
> Jul 23 21:10:05 positronic18696 device vmtap36 left promiscuous mode
> Jul 23 21:10:05 positronic18696 device vmEtap36 left promiscuous mode
> Jul 23 21:10:05 positronic18696 device vmtap37 left promiscuous mode
> Jul 23 21:10:05 positronic18696 device vmEtap37 left promiscuous mode
> Jul 23 21:10:05 positronic18696 device vmtap38 left promiscuous mode
> Jul 23 21:10:05 positronic18696 device vmEtap38 left promiscuous mode
> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000003b
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 PGD 598c9e067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0000 [#2] SMP
> Jul 23 21:10:05 positronic18696 CPU 0
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 21815, comm: netstat Tainted: G
>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88053f965d78  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf700 RBX:
> ffff8807ed1d9118 RCX: 000000000000007e
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000000 RDI: ffff8807ee3bf700
> Jul 23 21:10:05 positronic18696 RBP: ffff88053f965d98 R08:
> ffff88083fc16a10 R09: ffffffff8119bfe0
> Jul 23 21:10:05 positronic18696 R10: 0000000000000000 R11:
> 0000000000000206 R12: ffff8807d8afaa80
> Jul 23 21:10:05 positronic18696 R13: ffff8808139d7000 R14:
> ffff8807ed98d038 R15: ffff88053f965e08
> Jul 23 21:10:05 positronic18696 FS:  00007faee78b5700(0000)
> GS:ffff88083fc00000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
> 00000007e2eb5000 CR4: 00000000000007e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process netstat (pid: 21815,
> threadinfo ffff88053f964000, task ffff8807c6207000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff8807d8afaa80 0000000000000007
> ffff8807ed1d9118 ffff8807ee63ab40
> Jul 23 21:10:05 positronic18696 ffff88053f965dc8 ffffffff8119f8b0
> ffffffffff0a0210 0000000000000001
> Jul 23 21:10:05 positronic18696 ffff88053f965e98 ffff8807eca70200
> ffff88053f965e48 ffffffff811a0876
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff8119f8b0>]
> proc_fd_instantiate+0x80/0xa0
> Jul 23 21:10:05 positronic18696 [<ffffffff811a0876>] proc_fill_cache+0x126/0x150
> Jul 23 21:10:05 positronic18696 [<ffffffff8119f830>] ?
> proc_fdinfo_instantiate+0x90/0x90
> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
> Jul 23 21:10:05 positronic18696 [<ffffffff811a0ba6>]
> proc_readfd_common+0xf6/0x1c0
> Jul 23 21:10:05 positronic18696 [<ffffffff8119f830>] ?
> proc_fdinfo_instantiate+0x90/0x90
> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
> Jul 23 21:10:05 positronic18696 [<ffffffff811a0ca5>] proc_readfd+0x15/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff8114ce70>] vfs_readdir+0xa0/0xc0
> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
> Jul 23 21:10:05 positronic18696 [<ffffffff8114d01d>] sys_getdents+0x8d/0x100
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
> e0 ff ff 85 c0 0f 84
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP <ffff88053f965d78>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92757 ]---
> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000002f
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff81156900>] dup_fd+0x160/0x2e0
> Jul 23 21:10:05 positronic18696 PGD 7ee96c067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0002 [#3] SMP
> Jul 23 21:10:05 positronic18696 CPU 3
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 7882, comm: bash Tainted: G
> D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff81156900>]
> [<ffffffff81156900>] dup_fd+0x160/0x2e0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807ec9e1d90  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: 0000000000000038 RBX:
> ffff8807ed42de40 RCX: 0000000000000007
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000800 RDI: ffff8807ef0de080
> Jul 23 21:10:05 positronic18696 RBP: ffff8807ec9e1df0 R08:
> 0000000000000020 R09: ffffffff81156694
> Jul 23 21:10:05 positronic18696 R10: 00000000fffffffb R11:
> 0000000000000000 R12: ffff8807eb8ec000
> Jul 23 21:10:05 positronic18696 R13: ffff8807ef0de440 R14:
> 0000000000000100 R15: ffff8807ed98d000
> Jul 23 21:10:05 positronic18696 FS:  00007f7d50f02700(0000)
> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 000000008005003b
> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f CR3:
> 00000007ed669000 CR4: 00000000000007e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process bash (pid: 7882, threadinfo
> ffff8807ec9e0000, task ffff8808139d7000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff8807ec9e1da0 000000018102db49
> 0000000000000020 ffff8807ef0de980
> Jul 23 21:10:05 positronic18696 ffff8807ee3bf708 ffff8807ee3bf780
> 00007f7d50f029d0 ffff8806627e6000
> Jul 23 21:10:05 positronic18696 0000000000000000 0000000001200011
> 00007f7d50f029d0 0000000000000000
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff81040441>] copy_process+0x931/0x13c0
> Jul 23 21:10:05 positronic18696 [<ffffffff8112902f>] ?
> kmem_cache_alloc+0xaf/0x110
> Jul 23 21:10:05 positronic18696 [<ffffffff81041024>] do_fork+0x54/0x360
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81139247>] ? fd_install+0x67/0x90
> Jul 23 21:10:05 positronic18696 [<ffffffff81144580>] ? do_pipe_flags+0xb0/0x100
> Jul 23 21:10:05 positronic18696 [<ffffffff8100c098>] sys_clone+0x28/0x30
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4bb3>] stub_clone+0x13/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>] ?
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10
> 4c 89 c2 e8 08 82 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5
> 08 00 00 00 31 c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0
> 08 48 39 f0 74 24 49
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff81156900>] dup_fd+0x160/0x2e0
> Jul 23 21:10:05 positronic18696 RSP <ffff8807ec9e1d90>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92758 ]---
> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000003b
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 PGD 7ec990067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0000 [#4] SMP
> Jul 23 21:10:05 positronic18696 CPU 3
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 22417, comm: netstat Tainted: G
>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88066ef4fcd8  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
> ffff8807ed065f88 RCX: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000000 RDI: ffff8807ee3bf180
> Jul 23 21:10:05 positronic18696 RBP: ffff88066ef4fcf8 R08:
> ffff8807ed051038 R09: ffffffffffcaffc8
> Jul 23 21:10:05 positronic18696 R10: ffff88066ef4fc44 R11:
> 0000000000000004 R12: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
> ffff8807eb875038 R15: ffff880813b59c20
> Jul 23 21:10:05 positronic18696 FS:  00007f7200558700(0000)
> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
> 00000007ec9fd000 CR4: 00000000000027e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22417,
> threadinfo ffff88066ef4e000, task ffff8807ecfa9000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff88066ef4fdb8 ffff88066ef4fe48
> ffff88066ef4fdc8 0000000000000001
> Jul 23 21:10:05 positronic18696 ffff88066ef4fd58 ffffffff811460dc
> ffff880813b59c20 ffff8807ed051000
> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
> 0000000000000040 ffff88066ef4fe48
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
> user_path_at_empty+0x59/0xb0
> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
> mntput_no_expire+0x44/0x140
> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
> e0 ff ff 85 c0 0f 84
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP <ffff88066ef4fcd8>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92759 ]---
> Jul 23 21:10:05 positronic18696 device vmtap24 entered promiscuous mode
> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000003b
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 PGD 7ecea9067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0000 [#5] SMP
> Jul 23 21:10:05 positronic18696 CPU 2
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 22487, comm: netstat Tainted: G
>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807ecb4dcd8  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
> ffff8807ed065f88 RCX: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000000 RDI: ffff8807ee3bf180
> Jul 23 21:10:05 positronic18696 RBP: ffff8807ecb4dcf8 R08:
> ffff8807ed051038 R09: ffffffffffcaffc8
> Jul 23 21:10:05 positronic18696 R10: ffff8807ecb4dc44 R11:
> 0000000000000004 R12: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
> ffff8807eb875038 R15: ffff880813b59c20
> Jul 23 21:10:05 positronic18696 FS:  00007f370dd20700(0000)
> GS:ffff88083fc80000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
> 0000000623f45000 CR4: 00000000000027e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22487,
> threadinfo ffff8807ecb4c000, task ffff8807d1b99000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff8807ecb4ddb8 ffff8807ecb4de48
> ffff8807ecb4ddc8 0000000000000001
> Jul 23 21:10:05 positronic18696 ffff8807ecb4dd58 ffffffff811460dc
> ffff880813b59c20 ffff8807ed051000
> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
> 0000000000000040 ffff8807ecb4de48
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
> user_path_at_empty+0x59/0xb0
> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
> mntput_no_expire+0x44/0x140
> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
> e0 ff ff 85 c0 0f 84
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP <ffff8807ecb4dcd8>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275a ]---
> Jul 23 21:10:05 positronic18696 device vmEtap24 entered promiscuous mode
> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000003b
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 PGD 7ec9a0067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0000 [#6] SMP
> Jul 23 21:10:05 positronic18696 CPU 3
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 22570, comm: netstat Tainted: G
>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88066edebcd8  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
> ffff8807ed065f88 RCX: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000000 RDI: ffff8807ee3bf180
> Jul 23 21:10:05 positronic18696 RBP: ffff88066edebcf8 R08:
> ffff8807ed051038 R09: ffffffffffcaffc8
> Jul 23 21:10:05 positronic18696 R10: ffff88066edebc44 R11:
> 0000000000000004 R12: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
> ffff8807eb875038 R15: ffff880813b59c20
> Jul 23 21:10:05 positronic18696 FS:  00007f914b112700(0000)
> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
> 00000005a4c9b000 CR4: 00000000000027e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22570,
> threadinfo ffff88066edea000, task ffff8807eefa2000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff88066edebdb8 ffff88066edebe48
> ffff88066edebdc8 0000000000000001
> Jul 23 21:10:05 positronic18696 ffff88066edebd58 ffffffff811460dc
> ffff880813b59c20 ffff8807ed051000
> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
> 0000000000000040 ffff88066edebe48
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
> user_path_at_empty+0x59/0xb0
> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
> mntput_no_expire+0x44/0x140
> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
> e0 ff ff 85 c0 0f 84
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP <ffff88066edebcd8>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275b ]---
> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000003b
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 PGD 53d536067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0000 [#7] SMP
> Jul 23 21:10:05 positronic18696 CPU 1
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 22727, comm: netstat Tainted: G
>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807bf797cd8  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
> ffff8807ed065f88 RCX: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000000 RDI: ffff8807ee3bf180
> Jul 23 21:10:05 positronic18696 RBP: ffff8807bf797cf8 R08:
> ffff8807ed051038 R09: ffffffffffcaffc8
> Jul 23 21:10:05 positronic18696 R10: ffff8807bf797c44 R11:
> 0000000000000004 R12: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
> ffff8807eb875038 R15: ffff880813b59c20
> Jul 23 21:10:05 positronic18696 FS:  00007f49e0de2700(0000)
> GS:ffff88083fc40000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
> 000000066ed95000 CR4: 00000000000027e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22727,
> threadinfo ffff8807bf796000, task ffff8807eeeb1000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff8807bf797db8 ffff8807bf797e48
> ffff8807bf797dc8 0000000000000001
> Jul 23 21:10:05 positronic18696 ffff8807bf797d58 ffffffff811460dc
> ffff880813b59c20 ffff8807ed051000
> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
> 0000000000000040 ffff8807bf797e48
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
> user_path_at_empty+0x59/0xb0
> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
> mntput_no_expire+0x44/0x140
> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
> e0 ff ff 85 c0 0f 84
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP <ffff8807bf797cd8>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275c ]---
> Jul 23 21:10:05 positronic18696 device vmtap25 entered promiscuous mode
> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000003b
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 PGD 7c6184067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0000 [#8] SMP
> Jul 23 21:10:05 positronic18696 CPU 7
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 22808, comm: netstat Tainted: G
>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff880771b43cd8  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
> ffff8807ed065f88 RCX: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000000 RDI: ffff8807ee3bf180
> Jul 23 21:10:05 positronic18696 RBP: ffff880771b43cf8 R08:
> ffff8807ed051038 R09: ffffffffffcaffc8
> Jul 23 21:10:05 positronic18696 R10: ffff880771b43c44 R11:
> 0000000000000004 R12: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
> ffff8807eb875038 R15: ffff880813b59c20
> Jul 23 21:10:05 positronic18696 FS:  00007f22e3d5f700(0000)
> GS:ffff88083fdc0000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
> 000000053d5cc000 CR4: 00000000000027e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22808,
> threadinfo ffff880771b42000, task ffff8807e2e36000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff880771b43db8 ffff880771b43e48
> ffff880771b43dc8 0000000000000001
> Jul 23 21:10:05 positronic18696 ffff880771b43d58 ffffffff811460dc
> ffff880813b59c20 ffff8807ed051000
> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
> 0000000000000040 ffff880771b43e48
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
> user_path_at_empty+0x59/0xb0
> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
> mntput_no_expire+0x44/0x140
> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
> e0 ff ff 85 c0 0f 84
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP <ffff880771b43cd8>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275d ]---
> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
> request at 000000010000003b
> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 device vmEtap25 entered promiscuous mode
> Jul 23 21:10:05 positronic18696 PGD 771aad067 PUD 0
> Jul 23 21:10:05 positronic18696 Oops: 0000 [#9] SMP
> Jul 23 21:10:05 positronic18696 CPU 0
> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
> Jul 23 21:10:05 positronic18696
> Jul 23 21:10:05 positronic18696 Pid: 22820, comm: netstat Tainted: G
>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807c628fcd8  EFLAGS: 00010206
> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
> ffff8807ed065f88 RCX: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
> 0000000000000000 RDI: ffff8807ee3bf180
> Jul 23 21:10:05 positronic18696 RBP: ffff8807c628fcf8 R08:
> ffff8807ed051038 R09: ffffffffffcaffc8
> Jul 23 21:10:05 positronic18696 R10: ffff8807c628fc44 R11:
> 0000000000000004 R12: ffff8807ed051000
> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
> ffff8807eb875038 R15: ffff880813b59c20
> Jul 23 21:10:05 positronic18696 FS:  00007fe1972b9700(0000)
> GS:ffff88083fc00000(0000) knlGS:0000000000000000
> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
> 00000007a745d000 CR4: 00000000000027e0
> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
> 0000000000000002 DR2: 0000000000000001
> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
> 00000000ffff0ff0 DR7: 0000000000000400
> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22820,
> threadinfo ffff8807c628e000, task ffff8807d1a99000)
> Jul 23 21:10:05 positronic18696 Stack:
> Jul 23 21:10:05 positronic18696 ffff8807c628fdb8 ffff8807c628fe48
> ffff8807c628fdc8 0000000000000001
> Jul 23 21:10:05 positronic18696 ffff8807c628fd58 ffffffff811460dc
> ffff880813b59c20 ffff8807ed051000
> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
> 0000000000000040 ffff8807c628fe48
> Jul 23 21:10:05 positronic18696 Call Trace:
> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
> user_path_at_empty+0x59/0xb0
> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
> mntput_no_expire+0x44/0x140
> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
> system_call_fastpath+0x16/0x1b
> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
> e0 ff ff 85 c0 0f 84
> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
> tid_fd_revalidate+0x84/0x1a0
> Jul 23 21:10:05 positronic18696 RSP <ffff8807c628fcd8>
> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275e ]---
> 
> 
> 
> 
> 2012/7/23 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> > On Sat, Jul 21, 2012 at 12:59:12AM +0200, nicolas prochazka wrote:
> >> Well done
> >> 1fd36adcd98c14d2fd97f545293c488775cb2823  :  the bug occurs   ( cf dump )
> >> 1dce27c5aa6770e9d195f2bb7db1db3d4dde5591 :  the bug not occurs
> >>
> >> Regards,
> >> Nicolas Prochazka.
> >
> > Hi, Nicolas.
> >
> > I was too hasty in sending you the commit id. There is a bug in 1fd36adc
> > that is fixed by commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215. Can
> > you test running f044db4cb4? If you find the bug in there, then we know
> > that this fix isn't the only one needed for 1fd36adc.
> >
> > Regards.
> > Cascardo.
> >
> >>
> >> dump  / 1fd36adcd98c14d2fd97f545293c488775cb2823
> >> lloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> VMtap: no IPv6 routers present
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 71 not NULL!
> >> alloc_fd: slot 121 not NULL!
> >> alloc_fd: slot 96 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 110 not NULL!
> >> alloc_fd: slot 121 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> brE: no IPv6 routers present
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 121 not NULL!
> >> alloc_fd: slot 142 not NULL!
> >> alloc_fd: slot 153 not NULL!
> >> alloc_fd: slot 153 not NULL!
> >> alloc_fd: slot 153 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 70 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 102 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 106 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 106 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 36 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 68 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> alloc_fd: slot 100 not NULL!
> >> ------------[ cut here ]------------
> >> kernel BUG at fs/open.c:873!
> >> invalid opcode: 0000 [#1] SMP
> >> CPU 0
> >> Modules linked in: kvm_intel kvm
> >>
> >> then BUG paging request as usual
> >>
> >>
> >> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> >> > On Fri, Jul 20, 2012 at 10:52:40PM +0200, nicolas prochazka wrote:
> >> >> Hello
> >> >> the problem is occured with  :
> >> >> - linux kernel 3.4.5    i do not test with 3.4.0 / 1 / 2 / 3 / 4    ,
> >> >> but i can if you want
> >> >> - linux kernel 3.5rc6 rc7  / do not test with other rc.
> >> >>
> >> >> the problem is not occured with :
> >> >> linux kernel 3.3.4 / 3.3.8
> >> >>
> >> >> These servers are used for :
> >> >> - starting a lot of virtual machine with qemu-kvm ( ~ 40 )   ( lot of
> >> >> select i think)
> >> >> - do a lot of network tests with openvswitch
> >> >>
> >> >> I can test a kernel 3.4.x before and after a commit id (?) to find a regression.
> >> >>
> >> >> Regards,
> >> >> Nicolas.
> >> >>
> >> >
> >> > Can you try this commit 1fd36adcd98c14d2fd97f545293c488775cb2823? And
> >> > the commit before it?
> >> >
> >> >>
> >> >> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> >> >> > On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
> >> >> >> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
> >> >> >>
> >> >> >>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
> >> >> >>
> >> >> >> That '1' looks like a random bit flip. Try running memtest86.
> >> >> >>
> >> >> >
> >> >> > Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
> >> >> > likely a pointer to some other piece of a struct. However, taking a look
> >> >> > at fs/files.c code, nothing seems suspicious.
> >> >> >
> >> >> > Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
> >> >> > has been some changes in fs/files.c on 3.4-rc1 in the piece of code
> >> >> > where you hit the problem.
> >> >> >
> >> >> > What does your system exercise? Any chance you are using a lot of
> >> >> > select, which has also been changed in those same patches to fs/files.c?
> >> >> >
> >> >> > Regards.
> >> >> > Cascardo.
> >> >> >
> >> >> >
> >> >> >>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
> >> >> >>
> >> >> >> This wasn't the first problem either.
> >> >> >>
> >> >> >>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
> >> >> >>
> >> >> >> Looks like the same flipped bit.
> >> >> >>
> >> >> >>       Dave
> >> >> >>
> >> >> >> --
> >> >> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> >> >> >> the body of a message to majordomo@vger.kernel.org
> >> >> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >> >> >> Please read the FAQ at  http://www.tux.org/lkml/
> >> >> >>
> >> >> >
> >> >>
> >> >
> >> --
> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> >> the body of a message to majordomo@vger.kernel.org
> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >> Please read the FAQ at  http://www.tux.org/lkml/
> >>
> >
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
> 
> 


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-24 16:52               ` Thadeu Lima de Souza Cascardo
@ 2012-07-28  7:52                 ` nicolas prochazka
  2012-08-08 10:44                   ` nicolas prochazka
  0 siblings, 1 reply; 12+ messages in thread
From: nicolas prochazka @ 2012-07-28  7:52 UTC (permalink / raw)
  To: Thadeu Lima de Souza Cascardo
  Cc: Dave Jones, linux-kernel, David Howells, Bobby Powers

hello again,
bisect git gives ( after 13 steps) :
58bca4a8fa90fcf9069379653b396b2cec642f7f is the first bad commit

Regards,
Nicolas Prochazka

2012/7/24 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
> On Mon, Jul 23, 2012 at 11:15:09PM +0200, nicolas prochazka wrote:
>> Hello,
>> I 'm trying differents versions with differents results
>>
>> - commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215  : bug is not reproductible
>> - 3.5rc7  : bug is reproductible    (cf new dump )
>> - master branch  : bug is reproductible
>>
>>
>>
>> Regards,
>> Nicolas Prochazka
>>
>>
>
> Hi, Nicolas.
>
> Can you try a bisect? I am also copying David Howells and Bobby Powers,
> even though their set of patches don't seem to be the culprit.
>
> Regards.
> Cascardo.
>
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000002f
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff81156900>] dup_fd+0x160/0x2e0
>> Jul 23 21:10:05 positronic18696 PGD 6627ea067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0002 [#1] SMP
>> Jul 23 21:10:05 positronic18696 CPU 1
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 17596, comm: queue.sh Not tainted
>> 3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff81156900>]
>> [<ffffffff81156900>] dup_fd+0x160/0x2e0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff880669ebdd90  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: 0000000000000038 RBX:
>> ffff8807ed95eec0 RCX: 0000000000000007
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000800 RDI: ffff8805a4d01d40
>> Jul 23 21:10:05 positronic18696 RBP: ffff880669ebddf0 R08:
>> 0000000000000020 R09: ffffffff81156694
>> Jul 23 21:10:05 positronic18696 R10: 0000000000000001 R11:
>> 0000000000000000 R12: ffff8807ecf25000
>> Jul 23 21:10:05 positronic18696 R13: ffff8805a4d01d80 R14:
>> 0000000000000100 R15: ffff8807d3a61800
>> Jul 23 21:10:05 positronic18696 FS:  00007f1a8e719700(0000)
>> GS:ffff88083fc40000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 000000008005003b
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f CR3:
>> 000000066ef90000 CR4: 00000000000027e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process queue.sh (pid: 17596,
>> threadinfo ffff880669ebc000, task ffff8806625ab000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff880669ebdda0 000000018102db49
>> 0000000000000020 ffff8806627ee8c0
>> Jul 23 21:10:05 positronic18696 ffff8807eefc1608 ffff8807eefc1680
>> 00007f1a8e7199d0 ffff8807bf41d000
>> Jul 23 21:10:05 positronic18696 0000000000000000 0000000001200011
>> 00007f1a8e7199d0 0000000000000000
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff81040441>] copy_process+0x931/0x13c0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81041024>] do_fork+0x54/0x360
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff810559e7>] ?
>> __set_task_blocked+0x37/0x80
>> Jul 23 21:10:05 positronic18696 [<ffffffff81055a83>] ?
>> __set_current_blocked+0x53/0x70
>> Jul 23 21:10:05 positronic18696 [<ffffffff8100c098>] sys_clone+0x28/0x30
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4bb3>] stub_clone+0x13/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>] ?
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10
>> 4c 89 c2 e8 08 82 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5
>> 08 00 00 00 31 c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0
>> 08 48 39 f0 74 24 49
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff81156900>] dup_fd+0x160/0x2e0
>> Jul 23 21:10:05 positronic18696 RSP <ffff880669ebdd90>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92756 ]---
>> Jul 23 21:10:05 positronic18696 device vmtap35 left promiscuous mode
>> Jul 23 21:10:05 positronic18696 device vmEtap35 left promiscuous mode
>> Jul 23 21:10:05 positronic18696 device vmtap36 left promiscuous mode
>> Jul 23 21:10:05 positronic18696 device vmEtap36 left promiscuous mode
>> Jul 23 21:10:05 positronic18696 device vmtap37 left promiscuous mode
>> Jul 23 21:10:05 positronic18696 device vmEtap37 left promiscuous mode
>> Jul 23 21:10:05 positronic18696 device vmtap38 left promiscuous mode
>> Jul 23 21:10:05 positronic18696 device vmEtap38 left promiscuous mode
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000003b
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 PGD 598c9e067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#2] SMP
>> Jul 23 21:10:05 positronic18696 CPU 0
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 21815, comm: netstat Tainted: G
>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88053f965d78  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf700 RBX:
>> ffff8807ed1d9118 RCX: 000000000000007e
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000000 RDI: ffff8807ee3bf700
>> Jul 23 21:10:05 positronic18696 RBP: ffff88053f965d98 R08:
>> ffff88083fc16a10 R09: ffffffff8119bfe0
>> Jul 23 21:10:05 positronic18696 R10: 0000000000000000 R11:
>> 0000000000000206 R12: ffff8807d8afaa80
>> Jul 23 21:10:05 positronic18696 R13: ffff8808139d7000 R14:
>> ffff8807ed98d038 R15: ffff88053f965e08
>> Jul 23 21:10:05 positronic18696 FS:  00007faee78b5700(0000)
>> GS:ffff88083fc00000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 0000000080050033
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>> 00000007e2eb5000 CR4: 00000000000007e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 21815,
>> threadinfo ffff88053f964000, task ffff8807c6207000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff8807d8afaa80 0000000000000007
>> ffff8807ed1d9118 ffff8807ee63ab40
>> Jul 23 21:10:05 positronic18696 ffff88053f965dc8 ffffffff8119f8b0
>> ffffffffff0a0210 0000000000000001
>> Jul 23 21:10:05 positronic18696 ffff88053f965e98 ffff8807eca70200
>> ffff88053f965e48 ffffffff811a0876
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff8119f8b0>]
>> proc_fd_instantiate+0x80/0xa0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811a0876>] proc_fill_cache+0x126/0x150
>> Jul 23 21:10:05 positronic18696 [<ffffffff8119f830>] ?
>> proc_fdinfo_instantiate+0x90/0x90
>> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811a0ba6>]
>> proc_readfd_common+0xf6/0x1c0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8119f830>] ?
>> proc_fdinfo_instantiate+0x90/0x90
>> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811a0ca5>] proc_readfd+0x15/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff8114ce70>] vfs_readdir+0xa0/0xc0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8114d01d>] sys_getdents+0x8d/0x100
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>> e0 ff ff 85 c0 0f 84
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP <ffff88053f965d78>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92757 ]---
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000002f
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff81156900>] dup_fd+0x160/0x2e0
>> Jul 23 21:10:05 positronic18696 PGD 7ee96c067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0002 [#3] SMP
>> Jul 23 21:10:05 positronic18696 CPU 3
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 7882, comm: bash Tainted: G
>> D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff81156900>]
>> [<ffffffff81156900>] dup_fd+0x160/0x2e0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807ec9e1d90  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: 0000000000000038 RBX:
>> ffff8807ed42de40 RCX: 0000000000000007
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000800 RDI: ffff8807ef0de080
>> Jul 23 21:10:05 positronic18696 RBP: ffff8807ec9e1df0 R08:
>> 0000000000000020 R09: ffffffff81156694
>> Jul 23 21:10:05 positronic18696 R10: 00000000fffffffb R11:
>> 0000000000000000 R12: ffff8807eb8ec000
>> Jul 23 21:10:05 positronic18696 R13: ffff8807ef0de440 R14:
>> 0000000000000100 R15: ffff8807ed98d000
>> Jul 23 21:10:05 positronic18696 FS:  00007f7d50f02700(0000)
>> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 000000008005003b
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f CR3:
>> 00000007ed669000 CR4: 00000000000007e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process bash (pid: 7882, threadinfo
>> ffff8807ec9e0000, task ffff8808139d7000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff8807ec9e1da0 000000018102db49
>> 0000000000000020 ffff8807ef0de980
>> Jul 23 21:10:05 positronic18696 ffff8807ee3bf708 ffff8807ee3bf780
>> 00007f7d50f029d0 ffff8806627e6000
>> Jul 23 21:10:05 positronic18696 0000000000000000 0000000001200011
>> 00007f7d50f029d0 0000000000000000
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff81040441>] copy_process+0x931/0x13c0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8112902f>] ?
>> kmem_cache_alloc+0xaf/0x110
>> Jul 23 21:10:05 positronic18696 [<ffffffff81041024>] do_fork+0x54/0x360
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81139247>] ? fd_install+0x67/0x90
>> Jul 23 21:10:05 positronic18696 [<ffffffff81144580>] ? do_pipe_flags+0xb0/0x100
>> Jul 23 21:10:05 positronic18696 [<ffffffff8100c098>] sys_clone+0x28/0x30
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4bb3>] stub_clone+0x13/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>] ?
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10
>> 4c 89 c2 e8 08 82 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5
>> 08 00 00 00 31 c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0
>> 08 48 39 f0 74 24 49
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff81156900>] dup_fd+0x160/0x2e0
>> Jul 23 21:10:05 positronic18696 RSP <ffff8807ec9e1d90>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92758 ]---
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000003b
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 PGD 7ec990067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#4] SMP
>> Jul 23 21:10:05 positronic18696 CPU 3
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 22417, comm: netstat Tainted: G
>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88066ef4fcd8  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>> ffff8807ed065f88 RCX: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000000 RDI: ffff8807ee3bf180
>> Jul 23 21:10:05 positronic18696 RBP: ffff88066ef4fcf8 R08:
>> ffff8807ed051038 R09: ffffffffffcaffc8
>> Jul 23 21:10:05 positronic18696 R10: ffff88066ef4fc44 R11:
>> 0000000000000004 R12: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>> ffff8807eb875038 R15: ffff880813b59c20
>> Jul 23 21:10:05 positronic18696 FS:  00007f7200558700(0000)
>> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 0000000080050033
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>> 00000007ec9fd000 CR4: 00000000000027e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22417,
>> threadinfo ffff88066ef4e000, task ffff8807ecfa9000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff88066ef4fdb8 ffff88066ef4fe48
>> ffff88066ef4fdc8 0000000000000001
>> Jul 23 21:10:05 positronic18696 ffff88066ef4fd58 ffffffff811460dc
>> ffff880813b59c20 ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>> 0000000000000040 ffff88066ef4fe48
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>> user_path_at_empty+0x59/0xb0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>> mntput_no_expire+0x44/0x140
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>> e0 ff ff 85 c0 0f 84
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP <ffff88066ef4fcd8>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92759 ]---
>> Jul 23 21:10:05 positronic18696 device vmtap24 entered promiscuous mode
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000003b
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 PGD 7ecea9067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#5] SMP
>> Jul 23 21:10:05 positronic18696 CPU 2
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 22487, comm: netstat Tainted: G
>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807ecb4dcd8  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>> ffff8807ed065f88 RCX: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000000 RDI: ffff8807ee3bf180
>> Jul 23 21:10:05 positronic18696 RBP: ffff8807ecb4dcf8 R08:
>> ffff8807ed051038 R09: ffffffffffcaffc8
>> Jul 23 21:10:05 positronic18696 R10: ffff8807ecb4dc44 R11:
>> 0000000000000004 R12: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>> ffff8807eb875038 R15: ffff880813b59c20
>> Jul 23 21:10:05 positronic18696 FS:  00007f370dd20700(0000)
>> GS:ffff88083fc80000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 0000000080050033
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>> 0000000623f45000 CR4: 00000000000027e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22487,
>> threadinfo ffff8807ecb4c000, task ffff8807d1b99000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff8807ecb4ddb8 ffff8807ecb4de48
>> ffff8807ecb4ddc8 0000000000000001
>> Jul 23 21:10:05 positronic18696 ffff8807ecb4dd58 ffffffff811460dc
>> ffff880813b59c20 ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>> 0000000000000040 ffff8807ecb4de48
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>> user_path_at_empty+0x59/0xb0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>> mntput_no_expire+0x44/0x140
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>> e0 ff ff 85 c0 0f 84
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP <ffff8807ecb4dcd8>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275a ]---
>> Jul 23 21:10:05 positronic18696 device vmEtap24 entered promiscuous mode
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000003b
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 PGD 7ec9a0067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#6] SMP
>> Jul 23 21:10:05 positronic18696 CPU 3
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 22570, comm: netstat Tainted: G
>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88066edebcd8  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>> ffff8807ed065f88 RCX: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000000 RDI: ffff8807ee3bf180
>> Jul 23 21:10:05 positronic18696 RBP: ffff88066edebcf8 R08:
>> ffff8807ed051038 R09: ffffffffffcaffc8
>> Jul 23 21:10:05 positronic18696 R10: ffff88066edebc44 R11:
>> 0000000000000004 R12: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>> ffff8807eb875038 R15: ffff880813b59c20
>> Jul 23 21:10:05 positronic18696 FS:  00007f914b112700(0000)
>> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 0000000080050033
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>> 00000005a4c9b000 CR4: 00000000000027e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22570,
>> threadinfo ffff88066edea000, task ffff8807eefa2000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff88066edebdb8 ffff88066edebe48
>> ffff88066edebdc8 0000000000000001
>> Jul 23 21:10:05 positronic18696 ffff88066edebd58 ffffffff811460dc
>> ffff880813b59c20 ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>> 0000000000000040 ffff88066edebe48
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>> user_path_at_empty+0x59/0xb0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>> mntput_no_expire+0x44/0x140
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>> e0 ff ff 85 c0 0f 84
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP <ffff88066edebcd8>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275b ]---
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000003b
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 PGD 53d536067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#7] SMP
>> Jul 23 21:10:05 positronic18696 CPU 1
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 22727, comm: netstat Tainted: G
>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807bf797cd8  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>> ffff8807ed065f88 RCX: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000000 RDI: ffff8807ee3bf180
>> Jul 23 21:10:05 positronic18696 RBP: ffff8807bf797cf8 R08:
>> ffff8807ed051038 R09: ffffffffffcaffc8
>> Jul 23 21:10:05 positronic18696 R10: ffff8807bf797c44 R11:
>> 0000000000000004 R12: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>> ffff8807eb875038 R15: ffff880813b59c20
>> Jul 23 21:10:05 positronic18696 FS:  00007f49e0de2700(0000)
>> GS:ffff88083fc40000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 0000000080050033
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>> 000000066ed95000 CR4: 00000000000027e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22727,
>> threadinfo ffff8807bf796000, task ffff8807eeeb1000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff8807bf797db8 ffff8807bf797e48
>> ffff8807bf797dc8 0000000000000001
>> Jul 23 21:10:05 positronic18696 ffff8807bf797d58 ffffffff811460dc
>> ffff880813b59c20 ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>> 0000000000000040 ffff8807bf797e48
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>> user_path_at_empty+0x59/0xb0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>> mntput_no_expire+0x44/0x140
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>> e0 ff ff 85 c0 0f 84
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP <ffff8807bf797cd8>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275c ]---
>> Jul 23 21:10:05 positronic18696 device vmtap25 entered promiscuous mode
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000003b
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 PGD 7c6184067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#8] SMP
>> Jul 23 21:10:05 positronic18696 CPU 7
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 22808, comm: netstat Tainted: G
>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff880771b43cd8  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>> ffff8807ed065f88 RCX: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000000 RDI: ffff8807ee3bf180
>> Jul 23 21:10:05 positronic18696 RBP: ffff880771b43cf8 R08:
>> ffff8807ed051038 R09: ffffffffffcaffc8
>> Jul 23 21:10:05 positronic18696 R10: ffff880771b43c44 R11:
>> 0000000000000004 R12: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>> ffff8807eb875038 R15: ffff880813b59c20
>> Jul 23 21:10:05 positronic18696 FS:  00007f22e3d5f700(0000)
>> GS:ffff88083fdc0000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 0000000080050033
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>> 000000053d5cc000 CR4: 00000000000027e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22808,
>> threadinfo ffff880771b42000, task ffff8807e2e36000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff880771b43db8 ffff880771b43e48
>> ffff880771b43dc8 0000000000000001
>> Jul 23 21:10:05 positronic18696 ffff880771b43d58 ffffffff811460dc
>> ffff880813b59c20 ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>> 0000000000000040 ffff880771b43e48
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>> user_path_at_empty+0x59/0xb0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>> mntput_no_expire+0x44/0x140
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>> e0 ff ff 85 c0 0f 84
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP <ffff880771b43cd8>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275d ]---
>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>> request at 000000010000003b
>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 device vmEtap25 entered promiscuous mode
>> Jul 23 21:10:05 positronic18696 PGD 771aad067 PUD 0
>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#9] SMP
>> Jul 23 21:10:05 positronic18696 CPU 0
>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>> Jul 23 21:10:05 positronic18696
>> Jul 23 21:10:05 positronic18696 Pid: 22820, comm: netstat Tainted: G
>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807c628fcd8  EFLAGS: 00010206
>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>> ffff8807ed065f88 RCX: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>> 0000000000000000 RDI: ffff8807ee3bf180
>> Jul 23 21:10:05 positronic18696 RBP: ffff8807c628fcf8 R08:
>> ffff8807ed051038 R09: ffffffffffcaffc8
>> Jul 23 21:10:05 positronic18696 R10: ffff8807c628fc44 R11:
>> 0000000000000004 R12: ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>> ffff8807eb875038 R15: ffff880813b59c20
>> Jul 23 21:10:05 positronic18696 FS:  00007fe1972b9700(0000)
>> GS:ffff88083fc00000(0000) knlGS:0000000000000000
>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>> 0000000080050033
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>> 00000007a745d000 CR4: 00000000000027e0
>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>> 0000000000000002 DR2: 0000000000000001
>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>> 00000000ffff0ff0 DR7: 0000000000000400
>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22820,
>> threadinfo ffff8807c628e000, task ffff8807d1a99000)
>> Jul 23 21:10:05 positronic18696 Stack:
>> Jul 23 21:10:05 positronic18696 ffff8807c628fdb8 ffff8807c628fe48
>> ffff8807c628fdc8 0000000000000001
>> Jul 23 21:10:05 positronic18696 ffff8807c628fd58 ffffffff811460dc
>> ffff880813b59c20 ffff8807ed051000
>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>> 0000000000000040 ffff8807c628fe48
>> Jul 23 21:10:05 positronic18696 Call Trace:
>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>> user_path_at_empty+0x59/0xb0
>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>> mntput_no_expire+0x44/0x140
>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>> system_call_fastpath+0x16/0x1b
>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>> e0 ff ff 85 c0 0f 84
>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>> tid_fd_revalidate+0x84/0x1a0
>> Jul 23 21:10:05 positronic18696 RSP <ffff8807c628fcd8>
>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275e ]---
>>
>>
>>
>>
>> 2012/7/23 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>> > On Sat, Jul 21, 2012 at 12:59:12AM +0200, nicolas prochazka wrote:
>> >> Well done
>> >> 1fd36adcd98c14d2fd97f545293c488775cb2823  :  the bug occurs   ( cf dump )
>> >> 1dce27c5aa6770e9d195f2bb7db1db3d4dde5591 :  the bug not occurs
>> >>
>> >> Regards,
>> >> Nicolas Prochazka.
>> >
>> > Hi, Nicolas.
>> >
>> > I was too hasty in sending you the commit id. There is a bug in 1fd36adc
>> > that is fixed by commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215. Can
>> > you test running f044db4cb4? If you find the bug in there, then we know
>> > that this fix isn't the only one needed for 1fd36adc.
>> >
>> > Regards.
>> > Cascardo.
>> >
>> >>
>> >> dump  / 1fd36adcd98c14d2fd97f545293c488775cb2823
>> >> lloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> VMtap: no IPv6 routers present
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 71 not NULL!
>> >> alloc_fd: slot 121 not NULL!
>> >> alloc_fd: slot 96 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 110 not NULL!
>> >> alloc_fd: slot 121 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> brE: no IPv6 routers present
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 121 not NULL!
>> >> alloc_fd: slot 142 not NULL!
>> >> alloc_fd: slot 153 not NULL!
>> >> alloc_fd: slot 153 not NULL!
>> >> alloc_fd: slot 153 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 70 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 102 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 106 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 106 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 36 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 68 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> alloc_fd: slot 100 not NULL!
>> >> ------------[ cut here ]------------
>> >> kernel BUG at fs/open.c:873!
>> >> invalid opcode: 0000 [#1] SMP
>> >> CPU 0
>> >> Modules linked in: kvm_intel kvm
>> >>
>> >> then BUG paging request as usual
>> >>
>> >>
>> >> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>> >> > On Fri, Jul 20, 2012 at 10:52:40PM +0200, nicolas prochazka wrote:
>> >> >> Hello
>> >> >> the problem is occured with  :
>> >> >> - linux kernel 3.4.5    i do not test with 3.4.0 / 1 / 2 / 3 / 4    ,
>> >> >> but i can if you want
>> >> >> - linux kernel 3.5rc6 rc7  / do not test with other rc.
>> >> >>
>> >> >> the problem is not occured with :
>> >> >> linux kernel 3.3.4 / 3.3.8
>> >> >>
>> >> >> These servers are used for :
>> >> >> - starting a lot of virtual machine with qemu-kvm ( ~ 40 )   ( lot of
>> >> >> select i think)
>> >> >> - do a lot of network tests with openvswitch
>> >> >>
>> >> >> I can test a kernel 3.4.x before and after a commit id (?) to find a regression.
>> >> >>
>> >> >> Regards,
>> >> >> Nicolas.
>> >> >>
>> >> >
>> >> > Can you try this commit 1fd36adcd98c14d2fd97f545293c488775cb2823? And
>> >> > the commit before it?
>> >> >
>> >> >>
>> >> >> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>> >> >> > On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
>> >> >> >> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
>> >> >> >>
>> >> >> >>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
>> >> >> >>
>> >> >> >> That '1' looks like a random bit flip. Try running memtest86.
>> >> >> >>
>> >> >> >
>> >> >> > Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
>> >> >> > likely a pointer to some other piece of a struct. However, taking a look
>> >> >> > at fs/files.c code, nothing seems suspicious.
>> >> >> >
>> >> >> > Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
>> >> >> > has been some changes in fs/files.c on 3.4-rc1 in the piece of code
>> >> >> > where you hit the problem.
>> >> >> >
>> >> >> > What does your system exercise? Any chance you are using a lot of
>> >> >> > select, which has also been changed in those same patches to fs/files.c?
>> >> >> >
>> >> >> > Regards.
>> >> >> > Cascardo.
>> >> >> >
>> >> >> >
>> >> >> >>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
>> >> >> >>
>> >> >> >> This wasn't the first problem either.
>> >> >> >>
>> >> >> >>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
>> >> >> >>
>> >> >> >> Looks like the same flipped bit.
>> >> >> >>
>> >> >> >>       Dave
>> >> >> >>
>> >> >> >> --
>> >> >> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>> >> >> >> the body of a message to majordomo@vger.kernel.org
>> >> >> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> >> >> >> Please read the FAQ at  http://www.tux.org/lkml/
>> >> >> >>
>> >> >> >
>> >> >>
>> >> >
>> >> --
>> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>> >> the body of a message to majordomo@vger.kernel.org
>> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> >> Please read the FAQ at  http://www.tux.org/lkml/
>> >>
>> >
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> Please read the FAQ at  http://www.tux.org/lkml/
>>
>>
>

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: oops in kernel ( 3.4.x -> 3.5rc )
  2012-07-28  7:52                 ` nicolas prochazka
@ 2012-08-08 10:44                   ` nicolas prochazka
  0 siblings, 0 replies; 12+ messages in thread
From: nicolas prochazka @ 2012-08-08 10:44 UTC (permalink / raw)
  To: Thadeu Lima de Souza Cascardo; +Cc: linux-kernel, m.szyprowski

Hello
last git master checkout  seems  correct this problem
Thanks
Nicolas Prochazka.

2012/7/28 nicolas prochazka <prochazka.nicolas@gmail.com>:
> hello again,
> bisect git gives ( after 13 steps) :
> 58bca4a8fa90fcf9069379653b396b2cec642f7f is the first bad commit
>
> Regards,
> Nicolas Prochazka
>
> 2012/7/24 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>> On Mon, Jul 23, 2012 at 11:15:09PM +0200, nicolas prochazka wrote:
>>> Hello,
>>> I 'm trying differents versions with differents results
>>>
>>> - commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215  : bug is not reproductible
>>> - 3.5rc7  : bug is reproductible    (cf new dump )
>>> - master branch  : bug is reproductible
>>>
>>>
>>>
>>> Regards,
>>> Nicolas Prochazka
>>>
>>>
>>
>> Hi, Nicolas.
>>
>> Can you try a bisect? I am also copying David Howells and Bobby Powers,
>> even though their set of patches don't seem to be the culprit.
>>
>> Regards.
>> Cascardo.
>>
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000002f
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff81156900>] dup_fd+0x160/0x2e0
>>> Jul 23 21:10:05 positronic18696 PGD 6627ea067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0002 [#1] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 1
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 17596, comm: queue.sh Not tainted
>>> 3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff81156900>]
>>> [<ffffffff81156900>] dup_fd+0x160/0x2e0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff880669ebdd90  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: 0000000000000038 RBX:
>>> ffff8807ed95eec0 RCX: 0000000000000007
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000800 RDI: ffff8805a4d01d40
>>> Jul 23 21:10:05 positronic18696 RBP: ffff880669ebddf0 R08:
>>> 0000000000000020 R09: ffffffff81156694
>>> Jul 23 21:10:05 positronic18696 R10: 0000000000000001 R11:
>>> 0000000000000000 R12: ffff8807ecf25000
>>> Jul 23 21:10:05 positronic18696 R13: ffff8805a4d01d80 R14:
>>> 0000000000000100 R15: ffff8807d3a61800
>>> Jul 23 21:10:05 positronic18696 FS:  00007f1a8e719700(0000)
>>> GS:ffff88083fc40000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 000000008005003b
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f CR3:
>>> 000000066ef90000 CR4: 00000000000027e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process queue.sh (pid: 17596,
>>> threadinfo ffff880669ebc000, task ffff8806625ab000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff880669ebdda0 000000018102db49
>>> 0000000000000020 ffff8806627ee8c0
>>> Jul 23 21:10:05 positronic18696 ffff8807eefc1608 ffff8807eefc1680
>>> 00007f1a8e7199d0 ffff8807bf41d000
>>> Jul 23 21:10:05 positronic18696 0000000000000000 0000000001200011
>>> 00007f1a8e7199d0 0000000000000000
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81040441>] copy_process+0x931/0x13c0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81041024>] do_fork+0x54/0x360
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff810559e7>] ?
>>> __set_task_blocked+0x37/0x80
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81055a83>] ?
>>> __set_current_blocked+0x53/0x70
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8100c098>] sys_clone+0x28/0x30
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4bb3>] stub_clone+0x13/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>] ?
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10
>>> 4c 89 c2 e8 08 82 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5
>>> 08 00 00 00 31 c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0
>>> 08 48 39 f0 74 24 49
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff81156900>] dup_fd+0x160/0x2e0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff880669ebdd90>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92756 ]---
>>> Jul 23 21:10:05 positronic18696 device vmtap35 left promiscuous mode
>>> Jul 23 21:10:05 positronic18696 device vmEtap35 left promiscuous mode
>>> Jul 23 21:10:05 positronic18696 device vmtap36 left promiscuous mode
>>> Jul 23 21:10:05 positronic18696 device vmEtap36 left promiscuous mode
>>> Jul 23 21:10:05 positronic18696 device vmtap37 left promiscuous mode
>>> Jul 23 21:10:05 positronic18696 device vmEtap37 left promiscuous mode
>>> Jul 23 21:10:05 positronic18696 device vmtap38 left promiscuous mode
>>> Jul 23 21:10:05 positronic18696 device vmEtap38 left promiscuous mode
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000003b
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 PGD 598c9e067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#2] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 0
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 21815, comm: netstat Tainted: G
>>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88053f965d78  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf700 RBX:
>>> ffff8807ed1d9118 RCX: 000000000000007e
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000000 RDI: ffff8807ee3bf700
>>> Jul 23 21:10:05 positronic18696 RBP: ffff88053f965d98 R08:
>>> ffff88083fc16a10 R09: ffffffff8119bfe0
>>> Jul 23 21:10:05 positronic18696 R10: 0000000000000000 R11:
>>> 0000000000000206 R12: ffff8807d8afaa80
>>> Jul 23 21:10:05 positronic18696 R13: ffff8808139d7000 R14:
>>> ffff8807ed98d038 R15: ffff88053f965e08
>>> Jul 23 21:10:05 positronic18696 FS:  00007faee78b5700(0000)
>>> GS:ffff88083fc00000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 0000000080050033
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>>> 00000007e2eb5000 CR4: 00000000000007e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 21815,
>>> threadinfo ffff88053f964000, task ffff8807c6207000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff8807d8afaa80 0000000000000007
>>> ffff8807ed1d9118 ffff8807ee63ab40
>>> Jul 23 21:10:05 positronic18696 ffff88053f965dc8 ffffffff8119f8b0
>>> ffffffffff0a0210 0000000000000001
>>> Jul 23 21:10:05 positronic18696 ffff88053f965e98 ffff8807eca70200
>>> ffff88053f965e48 ffffffff811a0876
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8119f8b0>]
>>> proc_fd_instantiate+0x80/0xa0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811a0876>] proc_fill_cache+0x126/0x150
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8119f830>] ?
>>> proc_fdinfo_instantiate+0x90/0x90
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811a0ba6>]
>>> proc_readfd_common+0xf6/0x1c0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8119f830>] ?
>>> proc_fdinfo_instantiate+0x90/0x90
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811a0ca5>] proc_readfd+0x15/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8114ce70>] vfs_readdir+0xa0/0xc0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8114cc50>] ? filldir64+0xe0/0xe0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8114d01d>] sys_getdents+0x8d/0x100
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>>> e0 ff ff 85 c0 0f 84
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff88053f965d78>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92757 ]---
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000002f
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff81156900>] dup_fd+0x160/0x2e0
>>> Jul 23 21:10:05 positronic18696 PGD 7ee96c067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0002 [#3] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 3
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 7882, comm: bash Tainted: G
>>> D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff81156900>]
>>> [<ffffffff81156900>] dup_fd+0x160/0x2e0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807ec9e1d90  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: 0000000000000038 RBX:
>>> ffff8807ed42de40 RCX: 0000000000000007
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000800 RDI: ffff8807ef0de080
>>> Jul 23 21:10:05 positronic18696 RBP: ffff8807ec9e1df0 R08:
>>> 0000000000000020 R09: ffffffff81156694
>>> Jul 23 21:10:05 positronic18696 R10: 00000000fffffffb R11:
>>> 0000000000000000 R12: ffff8807eb8ec000
>>> Jul 23 21:10:05 positronic18696 R13: ffff8807ef0de440 R14:
>>> 0000000000000100 R15: ffff8807ed98d000
>>> Jul 23 21:10:05 positronic18696 FS:  00007f7d50f02700(0000)
>>> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 000000008005003b
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f CR3:
>>> 00000007ed669000 CR4: 00000000000007e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process bash (pid: 7882, threadinfo
>>> ffff8807ec9e0000, task ffff8808139d7000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff8807ec9e1da0 000000018102db49
>>> 0000000000000020 ffff8807ef0de980
>>> Jul 23 21:10:05 positronic18696 ffff8807ee3bf708 ffff8807ee3bf780
>>> 00007f7d50f029d0 ffff8806627e6000
>>> Jul 23 21:10:05 positronic18696 0000000000000000 0000000001200011
>>> 00007f7d50f029d0 0000000000000000
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81040441>] copy_process+0x931/0x13c0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8112902f>] ?
>>> kmem_cache_alloc+0xaf/0x110
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81041024>] do_fork+0x54/0x360
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81139247>] ? fd_install+0x67/0x90
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81144580>] ? do_pipe_flags+0xb0/0x100
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8100c098>] sys_clone+0x28/0x30
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4bb3>] stub_clone+0x13/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>] ?
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: 8b 45 b0 49 8b 7d 10 48 8b 71 10
>>> 4c 89 c2 e8 08 82 23 00 45 85 f6 74 54 41 8d 46 ff 31 c9 48 8d 34 c5
>>> 08 00 00 00 31 c0 eb 15 90 <f0> 48 ff 42 30 49 89 14 04 ff c1 48 83 c0
>>> 08 48 39 f0 74 24 49
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff81156900>] dup_fd+0x160/0x2e0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff8807ec9e1d90>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000002f
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92758 ]---
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000003b
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 PGD 7ec990067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#4] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 3
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 22417, comm: netstat Tainted: G
>>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88066ef4fcd8  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>>> ffff8807ed065f88 RCX: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000000 RDI: ffff8807ee3bf180
>>> Jul 23 21:10:05 positronic18696 RBP: ffff88066ef4fcf8 R08:
>>> ffff8807ed051038 R09: ffffffffffcaffc8
>>> Jul 23 21:10:05 positronic18696 R10: ffff88066ef4fc44 R11:
>>> 0000000000000004 R12: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>>> ffff8807eb875038 R15: ffff880813b59c20
>>> Jul 23 21:10:05 positronic18696 FS:  00007f7200558700(0000)
>>> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 0000000080050033
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>>> 00000007ec9fd000 CR4: 00000000000027e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22417,
>>> threadinfo ffff88066ef4e000, task ffff8807ecfa9000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff88066ef4fdb8 ffff88066ef4fe48
>>> ffff88066ef4fdc8 0000000000000001
>>> Jul 23 21:10:05 positronic18696 ffff88066ef4fd58 ffffffff811460dc
>>> ffff880813b59c20 ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>>> 0000000000000040 ffff88066ef4fe48
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>>> user_path_at_empty+0x59/0xb0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>>> mntput_no_expire+0x44/0x140
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>>> e0 ff ff 85 c0 0f 84
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff88066ef4fcd8>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d92759 ]---
>>> Jul 23 21:10:05 positronic18696 device vmtap24 entered promiscuous mode
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000003b
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 PGD 7ecea9067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#5] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 2
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 22487, comm: netstat Tainted: G
>>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807ecb4dcd8  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>>> ffff8807ed065f88 RCX: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000000 RDI: ffff8807ee3bf180
>>> Jul 23 21:10:05 positronic18696 RBP: ffff8807ecb4dcf8 R08:
>>> ffff8807ed051038 R09: ffffffffffcaffc8
>>> Jul 23 21:10:05 positronic18696 R10: ffff8807ecb4dc44 R11:
>>> 0000000000000004 R12: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>>> ffff8807eb875038 R15: ffff880813b59c20
>>> Jul 23 21:10:05 positronic18696 FS:  00007f370dd20700(0000)
>>> GS:ffff88083fc80000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 0000000080050033
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>>> 0000000623f45000 CR4: 00000000000027e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22487,
>>> threadinfo ffff8807ecb4c000, task ffff8807d1b99000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff8807ecb4ddb8 ffff8807ecb4de48
>>> ffff8807ecb4ddc8 0000000000000001
>>> Jul 23 21:10:05 positronic18696 ffff8807ecb4dd58 ffffffff811460dc
>>> ffff880813b59c20 ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>>> 0000000000000040 ffff8807ecb4de48
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>>> user_path_at_empty+0x59/0xb0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>>> mntput_no_expire+0x44/0x140
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>>> e0 ff ff 85 c0 0f 84
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff8807ecb4dcd8>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275a ]---
>>> Jul 23 21:10:05 positronic18696 device vmEtap24 entered promiscuous mode
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000003b
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 PGD 7ec9a0067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#6] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 3
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 22570, comm: netstat Tainted: G
>>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff88066edebcd8  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>>> ffff8807ed065f88 RCX: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000000 RDI: ffff8807ee3bf180
>>> Jul 23 21:10:05 positronic18696 RBP: ffff88066edebcf8 R08:
>>> ffff8807ed051038 R09: ffffffffffcaffc8
>>> Jul 23 21:10:05 positronic18696 R10: ffff88066edebc44 R11:
>>> 0000000000000004 R12: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>>> ffff8807eb875038 R15: ffff880813b59c20
>>> Jul 23 21:10:05 positronic18696 FS:  00007f914b112700(0000)
>>> GS:ffff88083fcc0000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 0000000080050033
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>>> 00000005a4c9b000 CR4: 00000000000027e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22570,
>>> threadinfo ffff88066edea000, task ffff8807eefa2000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff88066edebdb8 ffff88066edebe48
>>> ffff88066edebdc8 0000000000000001
>>> Jul 23 21:10:05 positronic18696 ffff88066edebd58 ffffffff811460dc
>>> ffff880813b59c20 ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>>> 0000000000000040 ffff88066edebe48
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>>> user_path_at_empty+0x59/0xb0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>>> mntput_no_expire+0x44/0x140
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>>> e0 ff ff 85 c0 0f 84
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff88066edebcd8>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275b ]---
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000003b
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 PGD 53d536067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#7] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 1
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 22727, comm: netstat Tainted: G
>>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807bf797cd8  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>>> ffff8807ed065f88 RCX: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000000 RDI: ffff8807ee3bf180
>>> Jul 23 21:10:05 positronic18696 RBP: ffff8807bf797cf8 R08:
>>> ffff8807ed051038 R09: ffffffffffcaffc8
>>> Jul 23 21:10:05 positronic18696 R10: ffff8807bf797c44 R11:
>>> 0000000000000004 R12: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>>> ffff8807eb875038 R15: ffff880813b59c20
>>> Jul 23 21:10:05 positronic18696 FS:  00007f49e0de2700(0000)
>>> GS:ffff88083fc40000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 0000000080050033
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>>> 000000066ed95000 CR4: 00000000000027e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22727,
>>> threadinfo ffff8807bf796000, task ffff8807eeeb1000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff8807bf797db8 ffff8807bf797e48
>>> ffff8807bf797dc8 0000000000000001
>>> Jul 23 21:10:05 positronic18696 ffff8807bf797d58 ffffffff811460dc
>>> ffff880813b59c20 ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>>> 0000000000000040 ffff8807bf797e48
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>>> user_path_at_empty+0x59/0xb0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>>> mntput_no_expire+0x44/0x140
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>>> e0 ff ff 85 c0 0f 84
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff8807bf797cd8>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275c ]---
>>> Jul 23 21:10:05 positronic18696 device vmtap25 entered promiscuous mode
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000003b
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 PGD 7c6184067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#8] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 7
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 22808, comm: netstat Tainted: G
>>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff880771b43cd8  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>>> ffff8807ed065f88 RCX: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000000 RDI: ffff8807ee3bf180
>>> Jul 23 21:10:05 positronic18696 RBP: ffff880771b43cf8 R08:
>>> ffff8807ed051038 R09: ffffffffffcaffc8
>>> Jul 23 21:10:05 positronic18696 R10: ffff880771b43c44 R11:
>>> 0000000000000004 R12: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>>> ffff8807eb875038 R15: ffff880813b59c20
>>> Jul 23 21:10:05 positronic18696 FS:  00007f22e3d5f700(0000)
>>> GS:ffff88083fdc0000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 0000000080050033
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>>> 000000053d5cc000 CR4: 00000000000027e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22808,
>>> threadinfo ffff880771b42000, task ffff8807e2e36000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff880771b43db8 ffff880771b43e48
>>> ffff880771b43dc8 0000000000000001
>>> Jul 23 21:10:05 positronic18696 ffff880771b43d58 ffffffff811460dc
>>> ffff880813b59c20 ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>>> 0000000000000040 ffff880771b43e48
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>>> user_path_at_empty+0x59/0xb0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>>> mntput_no_expire+0x44/0x140
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>>> e0 ff ff 85 c0 0f 84
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff880771b43cd8>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275d ]---
>>> Jul 23 21:10:05 positronic18696 BUG: unable to handle kernel paging
>>> request at 000000010000003b
>>> Jul 23 21:10:05 positronic18696 IP: [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 device vmEtap25 entered promiscuous mode
>>> Jul 23 21:10:05 positronic18696 PGD 771aad067 PUD 0
>>> Jul 23 21:10:05 positronic18696 Oops: 0000 [#9] SMP
>>> Jul 23 21:10:05 positronic18696 CPU 0
>>> Jul 23 21:10:05 positronic18696 Modules linked in: kvm_intel kvm
>>> Jul 23 21:10:05 positronic18696
>>> Jul 23 21:10:05 positronic18696 Pid: 22820, comm: netstat Tainted: G
>>>    D      3.5.0-rc7-dirty #6 Dell Inc. PowerEdge M600/0MY736
>>> Jul 23 21:10:05 positronic18696 RIP: 0010:[<ffffffff8119f684>]
>>> [<ffffffff8119f684>] tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP: 0018:ffff8807c628fcd8  EFLAGS: 00010206
>>> Jul 23 21:10:05 positronic18696 RAX: ffff8807ee3bf180 RBX:
>>> ffff8807ed065f88 RCX: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 RDX: 00000000ffffffff RSI:
>>> 0000000000000000 RDI: ffff8807ee3bf180
>>> Jul 23 21:10:05 positronic18696 RBP: ffff8807c628fcf8 R08:
>>> ffff8807ed051038 R09: ffffffffffcaffc8
>>> Jul 23 21:10:05 positronic18696 R10: ffff8807c628fc44 R11:
>>> 0000000000000004 R12: ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 R13: ffff8807ee1ab000 R14:
>>> ffff8807eb875038 R15: ffff880813b59c20
>>> Jul 23 21:10:05 positronic18696 FS:  00007fe1972b9700(0000)
>>> GS:ffff88083fc00000(0000) knlGS:0000000000000000
>>> Jul 23 21:10:05 positronic18696 CS:  0010 DS: 0000 ES: 0000 CR0:
>>> 0000000080050033
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b CR3:
>>> 00000007a745d000 CR4: 00000000000027e0
>>> Jul 23 21:10:05 positronic18696 DR0: 0000000000000001 DR1:
>>> 0000000000000002 DR2: 0000000000000001
>>> Jul 23 21:10:05 positronic18696 DR3: 000000000000000a DR6:
>>> 00000000ffff0ff0 DR7: 0000000000000400
>>> Jul 23 21:10:05 positronic18696 Process netstat (pid: 22820,
>>> threadinfo ffff8807c628e000, task ffff8807d1a99000)
>>> Jul 23 21:10:05 positronic18696 Stack:
>>> Jul 23 21:10:05 positronic18696 ffff8807c628fdb8 ffff8807c628fe48
>>> ffff8807c628fdc8 0000000000000001
>>> Jul 23 21:10:05 positronic18696 ffff8807c628fd58 ffffffff811460dc
>>> ffff880813b59c20 ffff8807ed051000
>>> Jul 23 21:10:05 positronic18696 0000000000000001 ffff8807ed0642a8
>>> 0000000000000040 ffff8807c628fe48
>>> Jul 23 21:10:05 positronic18696 Call Trace:
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811460dc>] lookup_fast+0x1fc/0x2f0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81147d2d>] path_lookupat+0x12d/0x780
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81150d94>] ? dynamic_dname+0x94/0xa0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811483b3>] do_path_lookup+0x33/0x80
>>> Jul 23 21:10:05 positronic18696 [<ffffffff811486a9>]
>>> user_path_at_empty+0x59/0xb0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81145ad2>] ? path_put+0x22/0x30
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac3b7e>] ? _raw_spin_lock+0xe/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8106d29a>] ? lg_local_unlock+0x1a/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159264>] ?
>>> mntput_no_expire+0x44/0x140
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81159381>] ? mntput+0x21/0x40
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113facd>] sys_readlinkat+0x4d/0xc0
>>> Jul 23 21:10:05 positronic18696 [<ffffffff8113fb5b>] sys_readlink+0x1b/0x20
>>> Jul 23 21:10:05 positronic18696 [<ffffffff81ac4929>]
>>> system_call_fastpath+0x16/0x1b
>>> Jul 23 21:10:05 positronic18696 Code: b8 00 00 00 48 8b 50 08 44 3b 32
>>> 0f 83 9e 00 00 00 45 89 f6 49 c1 e6 03 4c 03 72 08 49 8b 16 48 85 d2
>>> 0f 84 87 00 00 00 48 89 c7 <44> 8b 62 3c e8 b3 67 ea ff 4c 89 ef e8 0b
>>> e0 ff ff 85 c0 0f 84
>>> Jul 23 21:10:05 positronic18696 RIP  [<ffffffff8119f684>]
>>> tid_fd_revalidate+0x84/0x1a0
>>> Jul 23 21:10:05 positronic18696 RSP <ffff8807c628fcd8>
>>> Jul 23 21:10:05 positronic18696 CR2: 000000010000003b
>>> Jul 23 21:10:05 positronic18696 ---[ end trace ccf5b66c39d9275e ]---
>>>
>>>
>>>
>>>
>>> 2012/7/23 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>>> > On Sat, Jul 21, 2012 at 12:59:12AM +0200, nicolas prochazka wrote:
>>> >> Well done
>>> >> 1fd36adcd98c14d2fd97f545293c488775cb2823  :  the bug occurs   ( cf dump )
>>> >> 1dce27c5aa6770e9d195f2bb7db1db3d4dde5591 :  the bug not occurs
>>> >>
>>> >> Regards,
>>> >> Nicolas Prochazka.
>>> >
>>> > Hi, Nicolas.
>>> >
>>> > I was too hasty in sending you the commit id. There is a bug in 1fd36adc
>>> > that is fixed by commit f044db4cb4bf16893812d35b5fbeaaf3e30c9215. Can
>>> > you test running f044db4cb4? If you find the bug in there, then we know
>>> > that this fix isn't the only one needed for 1fd36adc.
>>> >
>>> > Regards.
>>> > Cascardo.
>>> >
>>> >>
>>> >> dump  / 1fd36adcd98c14d2fd97f545293c488775cb2823
>>> >> lloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> VMtap: no IPv6 routers present
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 71 not NULL!
>>> >> alloc_fd: slot 121 not NULL!
>>> >> alloc_fd: slot 96 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 110 not NULL!
>>> >> alloc_fd: slot 121 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> brE: no IPv6 routers present
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 121 not NULL!
>>> >> alloc_fd: slot 142 not NULL!
>>> >> alloc_fd: slot 153 not NULL!
>>> >> alloc_fd: slot 153 not NULL!
>>> >> alloc_fd: slot 153 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 70 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 102 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 106 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 106 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 36 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 68 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> alloc_fd: slot 100 not NULL!
>>> >> ------------[ cut here ]------------
>>> >> kernel BUG at fs/open.c:873!
>>> >> invalid opcode: 0000 [#1] SMP
>>> >> CPU 0
>>> >> Modules linked in: kvm_intel kvm
>>> >>
>>> >> then BUG paging request as usual
>>> >>
>>> >>
>>> >> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>>> >> > On Fri, Jul 20, 2012 at 10:52:40PM +0200, nicolas prochazka wrote:
>>> >> >> Hello
>>> >> >> the problem is occured with  :
>>> >> >> - linux kernel 3.4.5    i do not test with 3.4.0 / 1 / 2 / 3 / 4    ,
>>> >> >> but i can if you want
>>> >> >> - linux kernel 3.5rc6 rc7  / do not test with other rc.
>>> >> >>
>>> >> >> the problem is not occured with :
>>> >> >> linux kernel 3.3.4 / 3.3.8
>>> >> >>
>>> >> >> These servers are used for :
>>> >> >> - starting a lot of virtual machine with qemu-kvm ( ~ 40 )   ( lot of
>>> >> >> select i think)
>>> >> >> - do a lot of network tests with openvswitch
>>> >> >>
>>> >> >> I can test a kernel 3.4.x before and after a commit id (?) to find a regression.
>>> >> >>
>>> >> >> Regards,
>>> >> >> Nicolas.
>>> >> >>
>>> >> >
>>> >> > Can you try this commit 1fd36adcd98c14d2fd97f545293c488775cb2823? And
>>> >> > the commit before it?
>>> >> >
>>> >> >>
>>> >> >> 2012/7/20 Thadeu Lima de Souza Cascardo <cascardo@linux.vnet.ibm.com>:
>>> >> >> > On Fri, Jul 20, 2012 at 09:21:53AM -0400, Dave Jones wrote:
>>> >> >> >> On Fri, Jul 20, 2012 at 11:56:06AM +0200, nicolas prochazka wrote:
>>> >> >> >>
>>> >> >> >>  > [ 2384.900061] BUG: unable to handle kernel paging request at 000000010000002f
>>> >> >> >>
>>> >> >> >> That '1' looks like a random bit flip. Try running memtest86.
>>> >> >> >>
>>> >> >> >
>>> >> >> > Looks more a 32-bit value of 1 followed by a 32-bit value of 0x2f. Most
>>> >> >> > likely a pointer to some other piece of a struct. However, taking a look
>>> >> >> > at fs/files.c code, nothing seems suspicious.
>>> >> >> >
>>> >> >> > Nicolas, it wasn't clear to me if you had problems with 3.4 too. There
>>> >> >> > has been some changes in fs/files.c on 3.4-rc1 in the piece of code
>>> >> >> > where you hit the problem.
>>> >> >> >
>>> >> >> > What does your system exercise? Any chance you are using a lot of
>>> >> >> > select, which has also been changed in those same patches to fs/files.c?
>>> >> >> >
>>> >> >> > Regards.
>>> >> >> > Cascardo.
>>> >> >> >
>>> >> >> >
>>> >> >> >>  > [ 2384.910010] Pid: 23838, comm: queue.sh Tainted: G      D W
>>> >> >> >>
>>> >> >> >> This wasn't the first problem either.
>>> >> >> >>
>>> >> >> >>  > [ 2397.885344] BUG: unable to handle kernel paging request at 000000010000003b
>>> >> >> >>
>>> >> >> >> Looks like the same flipped bit.
>>> >> >> >>
>>> >> >> >>       Dave
>>> >> >> >>
>>> >> >> >> --
>>> >> >> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>>> >> >> >> the body of a message to majordomo@vger.kernel.org
>>> >> >> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>> >> >> >> Please read the FAQ at  http://www.tux.org/lkml/
>>> >> >> >>
>>> >> >> >
>>> >> >>
>>> >> >
>>> >> --
>>> >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>>> >> the body of a message to majordomo@vger.kernel.org
>>> >> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>> >> Please read the FAQ at  http://www.tux.org/lkml/
>>> >>
>>> >
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>> Please read the FAQ at  http://www.tux.org/lkml/
>>>
>>>
>>

^ permalink raw reply	[flat|nested] 12+ messages in thread

end of thread, other threads:[~2012-08-08 10:44 UTC | newest]

Thread overview: 12+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-07-20  9:56 oops in kernel ( 3.4.x -> 3.5rc ) nicolas prochazka
2012-07-20 13:21 ` Dave Jones
2012-07-20 13:32   ` nicolas prochazka
2012-07-20 20:21   ` Thadeu Lima de Souza Cascardo
2012-07-20 20:52     ` nicolas prochazka
2012-07-20 21:06       ` Thadeu Lima de Souza Cascardo
2012-07-20 22:59         ` nicolas prochazka
2012-07-23 16:39           ` Thadeu Lima de Souza Cascardo
2012-07-23 21:15             ` nicolas prochazka
2012-07-24 16:52               ` Thadeu Lima de Souza Cascardo
2012-07-28  7:52                 ` nicolas prochazka
2012-08-08 10:44                   ` nicolas prochazka

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).