All of lore.kernel.org
 help / color / mirror / Atom feed
* Guest hanging several times a day
@ 2017-03-21 14:51 Emmanuel Florac
  2017-03-23 15:02 ` Emmanuel Florac
  0 siblings, 1 reply; 2+ messages in thread
From: Emmanuel Florac @ 2017-03-21 14:51 UTC (permalink / raw)
  To: kvm

[-- Attachment #1: Type: text/plain, Size: 42774 bytes --]


Hi everyone, 
On a host running Debian 8 with a plain vanilla kernel 3.18.25 amd64,
running several VMs, one of these freezes repeatedly.


This VM is running Debian Wheezy, kernel 3.2.0 (3.2.83), standard
Debian stock. Another VM running the same release never crashes.
However this one running ElasticSearch, crashes repeatedly.

Elastic Search is running atop Oracle Java :

java version "1.7.0_60"
Java(TM) SE Runtime Environment (build 1.7.0_60-b19)
Java HotSpot(TM) 64-Bit Server VM (build 24.60-b09, mixed mode)

Symptoms are that the VM freezes, CPU at 100%, won't reply to ping, and
must be killed. Therefore I suspected a kernel panic.

I've run 'vmstat 5 > /some/nfs/log' to see if the crashes are related
to heavy load, memory pressure, but no dice. The guest isn't
particularly loaded when crashing (this is the tail of the log):


procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 1  0      0 166584 392764 5284136    0    0     5    85 2350 4999 13  3 84  0
 0  0      0 166276 392788 5284188    0    0     0   405 2518 5357 17  3 79  0
 0  0      0 165920 392816 5284308    0    0     2   210 2531 5450 22  3 73  1
 0  0      0 172740 392860 5284380    0    0     0   242 2695 5701 17  5 77  0

I have these weird logs entries on the host:

[14144268.854175] kvm [8922]: vcpu0 unimplemented perfctr wrmsr: 0xc0010004 data 0xabcd
[14419620.465102] kvm: zapping shadow pages for mmio generation wraparound
[14419628.994376] kvm [14828]: vcpu0 unimplemented perfctr wrmsr: 0xc0010004 data 0xabcd
[14449999.836128] kvm: zapping shadow pages for mmio generation wraparound
[14450007.904546] kvm [23985]: vcpu0 unimplemented perfctr wrmsr: 0xc0010004 data 0xabcd

And they may come at about the same time as the VM crashes, but not
always. So it's rather inconclusive.

The VM guest has tons of these in its logs, and I have no idea of where
it comes from:

[61355.374615] Ack 1419984953 before 1419993145:1419993145
[61355.374618] Ack 1419989049 before 1419993145:1419993145
[61417.924610] Ack 2764677737 before 2764685929:2764690025
[61509.480514] Ack 3395730315 before 3395738507:3395738507
[61599.206073] Ack 786804524 before 786841388:786841388
[61599.206101] Ack 786808620 before 786841388:786845484
[61599.206108] Ack 786812716 before 786841388:786845484
[61599.206112] Ack 786816812 before 786841388:786845484
[61599.206115] Ack 786820908 before 786841388:786845484
[61599.206119] Ack 786825004 before 786841388:786845484
[61599.206122] Ack 786829100 before 786841388:786845484
[61599.206125] Ack 786833196 before 786841388:786845484
[61599.206129] Ack 786837292 before 786841388:786845484

Lately after days pulling my hair, for some reason netconsole finally
deigned providing a kernel dump, which doesn't speak much to me except
that it's java which is crashing everything down:

[8020353013.849868] INFO: rcu_sched detected stall on CPU 0 (t=2005081748685 jiffies)
[26019.112074] INFO: rcu_sched detected stall on CPU 2 (t=2005081748685 jiffies)
[26019.112074] sending NMI to all CPUs:
[8020353013.849868] NMI backtrace for cpu 0
[8020353013.849868] CPU 0 
[8020353013.849868] Modules linked in: netconsole configfs fuse btrfs crc32c libcrc32c zlib_deflate ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs xfs reiserfs ext3 jbd ext2 efivars dm_mod xt_tcpudp iptable_filter ip_tables x_tables nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_hda_itel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc psmouse snd_timer i2c_piix4 processor snd i2c_core joydev button evdev pcspkr serio_raw virtio_balloon thermal_sys soundcore ext4 crc16 jbd2 mbcache usbhid hid sg sr_mod cdrom ata_generic virtio_net virtio_blk ata_piix floppy libata virtio_pci virtioring virtio uhci_hcd ehci_hcd scsi_mod usbcore usb_common [last unloaded: scsi_wait_scan]
[8020353013.849868] 
[8020353013.849868] Pid: 0, comm: swapper/0 Not tainted 3.2.0-4-amd64 #1 Debian 3.2.86-1 Bochs Bochs
[8020353013.849868] RIP: 0010:[<ffffffff8123ca92>]  [<ffffffff8123ca92>] vt_console_print+0x1e0/0x296
[8020353013.849868] RSP: 0018:ffff88041fc03c78  EFLAGS: 00000002
[8020353013.849868] RAX: 0000000000000001 RBX: ffff88041f019000 RCX: ffff8800000bcb02
[8020353013.849868] RDX: 0000000000000738 RSI: 0000000000000038 RDI: ffff88041f019000
[8020353013.849868] RBP: 0000000000000002 R08: 0000000000000000 R09: 0000000000000002
[8020353013.849868] R10: 0000000000000000 R11: ffffffff81600000 R12: 0000000000000038
[8020353013.849868] R13: ffff8800000bcb00 R14: 0000000000000055 R15: ffffffff81785555
[8020353013.849868] FS:  00007f6c0fe2b700(0000) GS:ffff88041fc00000(0000) knlGS:0000000000000000
[8020353013.849868] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[8020353013.849868] CR2: 00007fbd72b10000 CR3: 000000034a240000 CR4: 00000000000006f0
[8020353013.849868] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[8020353013.849868] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[8020353013.849868] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020)
[8020353013.849868] Stack:
[8020353013.849868]  0000000000000000 006ed5719118b7f7 ffffffff8102bb60 ffffffff8164cea0
[8020353013.849868]  0000000000000056 000000000001a523 ffffffff8168f260 00000000ffffffa7
[8020353013.849868]  000000000001a579 ffffffff8104705e 000000000001a579 000000000001a523
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ> 
[8020353013.849868]  [<ffffffff8102bb60>] ? pvclock_clocksource_read+0x42/0xb2
[8020353013.849868]  [<ffffffff8104705e>] ? __call_console_drivers+0x72/0x83
[8020353013.849868]  [<ffffffff81047715>] ? console_unlock+0x12d/0x206
[8020353013.849868]  [<ffffffff8135404f>] ? _raw_spin_unlock_irqrestore+0xe/0xf
[8020353013.849868]  [<ffffffff81047c6d>] ? vprintk+0x396/0x3d9
[8020353013.849868]  [<ffffffff8103b153>] ? check_preempt_curr+0x36/0x5f
[8020353013.849868]  [<ffffffff81041e0b>] ? load_balance+0x4a3/0x633
[8020353013.849868]  [<ffffffff8106ca08>] ? tick_nohz_handler+0xd0/0xd0
[8020353013.849868]  [<ffffffff8134d619>] ? printk+0x43/0x48
[8020353013.849868]  [<ffffffff81096ae7>] ? __rcu_pending+0x7d/0x358
[8020353013.849868]  [<ffffffff8106ca08>] ? tick_nohz_handler+0xd0/0xd0
[8020353013.849868]  [<ffffffff810970ef>] ? rcu_check_callbacks+0x90/0xcc
[8020353013.849868]  [<ffffffff81053098>] ? update_process_times+0x31/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI> 
[8020353013.849868]  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[8020353013.849868]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[8020353013.849868]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[8020353013.849868]  [<ffffffff816aab3b>] ? start_kernel+0x3bd/0x3c8
[8020353013.849868]  [<ffffffff816aa140>] ? early_idt_handlers+0x140/0x140
[8020353013.849868]  [<ffffffff816aa3c4>] ? x86_64_start_kernel+0x104/0x111
[8020353013.849868] Code: 8b 83 2c 01 00 00 75 50 0f b6 93 1d 01 00 00 48 8b 8b 40 01 00 00 41 0f b6 f4 48 89 df ff c5 c1 e2 08 01 f2 41 0f b6 f4 66 89 11 <89> 04 24 e8 ec d4 ff ff 8b 04 24 8b 93 d4 00 00 00 0f b7 c8 ff 
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ>  [<ffffffff8102bb60>] ? pvclock_clocksource_read+0x42/0xb2
[8020353013.849868]  [<ffffffff8104705e>] ? __call_console_drivers+0x72/0x83
[8020353013.849868]  [<ffffffff81047715>] ? console_unlock+0x12d/0x206
[8020353013.849868]  [<ffffffff8135404f>] ? _raw_spin_unlock_irqrestore+0xe/0xf
[8020353013.849868]  [<ffffffff81047c6d>] ? vprintk+0x396/0x3d9
[8020353013.849868]  [<ffffffff8103b153>] ? check_preempt_curr+0x36/0x5f
[8020353013.849868]  [<ffffffff81041e0b>] ? load_balance+0x4a3/0x633
[8020353013.849868]  [<ffffffff8106ca08>] ? tick_nohz_handler+0xd0/0xd0
[8020353013.849868]  [<ffffffff8134d619>] ? printk+0x43/0x48
[8020353013.849868]  [<ffffffff81096ae7>] ? __rcu_pending+0x7d/0x358
[8020353013.849868]  [<ffffffff8106ca08>] ? tick_nohz_handler+0xd0/0xd0
[8020353013.849868]  [<ffffffff810970ef>] ? rcu_check_callbacks+0x90/0xcc
[8020353013.849868]  [<ffffffff81053098>] ? update_process_times+0x31/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI>  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[8020353013.849868]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[8020353013.849868]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[8020353013.849868]  [<ffffffff816aab3b>] ? start_kernel+0x3bd/0x3c8
[8020353013.849868]  [<ffffffff816aa140>] ? early_idt_handlers+0x140/0x140
[8020353013.849868]  [<ffffffff816aa3c4>] ? x86_64_start_kernel+0x104/0x111
[26019.112074] NMI backtrace for cpu 2
[26019.112074] CPU 2 
[26019.112074] Modules linked in: netconsole configfs fuse btrfs crc32c libcrc32c zlib_deflate ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs xfs reiserfs ext3 jbd ext2 efivars dm_mod xt_tcpudp iptable_filter ip_tables x_tables nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_hda_intel nd_hda_codec snd_hwdep snd_pcm snd_page_alloc psmouse snd_timer i2c_piix4 processor snd i2c_core joydev button evdev pcspkr serio_raw virtio_balloon thermal_sys soundcore ext4 crc16 jbd2 mbcache usbhid hid sg sr_mod cdrom ata_generic virtio_net virtio_blk ata_piix floppy libata virtio_pci virtio_ringvirtio uhci_hcd ehci_hcd scsi_mod usbcore usb_common [last unloaded: scsi_wait_scan]
[26019.112074] 
[26019.112074] Pid: 4321, comm: java Not tainted 3.2.0-4-amd64 #1 Debian 3.2.86-1 Bochs Bochs
[26019.112074] RIP: 0010:[<ffffffff81027f6c>]  [<ffffffff81027f6c>] native_apic_mem_write+0x8/0x9
[26019.112074] RSP: 0018:ffff88041fd03df0  EFLAGS: 00000046
[26019.112074] RAX: 0000000000000000 RBX: 0000000000000046 RCX: 000000000000201c
[26019.112074] RDX: 0000000000000000 RSI: 0000000000000c00 RDI: 0000000000000300
[26019.112074] RBP: 0000000000000002 R08: 0000000000000002 R09: 0000000000000000
[26019.112074] R10: ffff88041fd0d980 R11: ffff88041fd0d980 R12: 0000000000000c00
[26019.112074] R13: 000000000000000f R14: ffff88041fd0da78 R15: ffffffff8106ca08
[26019.112074] FS:  00007fadd88da700(0000) GS:ffff88041fd00000(0000) knlGS:0000000000000000
[26019.112074] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[26019.112074] CR2: 00007facc0198000 CR3: 000000040bbdd000 CR4: 00000000000006e0
[26019.112074] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[26019.112074] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[26019.112074] Process java (pid: 4321, threadinfo ffff8802f604c000, task ffff8802f602e800)
[26019.112074] Stack:
[26019.112074]  ffffffff810281bc 0000000000000000 0000000000002710 ffffffff81622300
[26019.112074]  ffffffff81622400 ffff88041fd03f50 ffffffff810250e2 ffff88041fd0ddc0
[26019.112074]  ffffffff81096aec 0000000000000000 0000370827f1c309 ffffffff8103726e
[26019.112074] Call Trace:
[26019.112074]  <IRQ> 
[26019.112074]  [<ffffffff810281bc>] ? _flat_send_IPI_mask+0x68/0x78
[26019.112074]  [<ffffffff810250e2>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7b
[26019.112074]  [<ffffffff81096aec>] ? __rcu_pending+0x82/0x358
[26019.112074]  [<ffffffff8103726e>] ? test_tsk_need_resched+0xa/0x13
[26019.112074]  [<ffffffff8106ca08>] ? tick_nohz_handler+0xd0/0xd0
[26019.112074]  [<ffffffff810970ef>] ? rcu_check_callbacks+0x90/0xcc
[26019.112074]  [<ffffffff81053098>] ? update_process_times+0x31/0x63
[26019.112074]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[26019.112074]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[26019.112074]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[26019.112074]  [<ffffffff8135b32c>] ? call_softirq+0x1c/0x30
[26019.112074]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[26019.112074]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[26019.112074]  <EOI> 
[26019.112074]  [<ffffffff81066da5>] ? ktime_get_ts+0x32/0x82
[26019.112074]  [<ffffffff81066dcf>] ? ktime_get_ts+0x5c/0x82
[26019.112074]  [<ffffffff8105ebfa>] ? posix_ktime_get_ts+0xa/0xf
[26019.112074]  [<ffffffff8105f68b>] ? sys_clock_gettime+0x2b/0x5c
[26019.112074]  [<ffffffff813590f2>] ? system_call_fastpath+0x16/0x1b
[26019.112074] Code: 24 0c bf 1b 00 00 00 e8 ab fb ff ff f6 c4 04 0f 95 c0 0f b6 c0 48 83 c4 10 c3 90 57 9d 66 66 90 66 90 c3 89 ff 89 b7 00 b0 5f ff <c3> 89 ff 8b 87 00 b0 5f ff c3 48 8b 07 25 ff 00 00 00 c3 48 8b 
[26019.112074] Call Trace:
[26019.112074]  <IRQ>  [<ffffffff810281bc>] ? _flat_send_IPI_mask+0x68/0x78
[26019.112074]  [<ffffffff810250e2>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7b
[26019.112074]  [<ffffffff81096aec>] ? __rcu_pending+0x82/0x358
[26019.112074]  [<ffffffff8103726e>] ? test_tsk_need_resched+0xa/0x13
[26019.112074]  [<ffffffff8106ca08>] ? tick_nohz_handler+0xd0/0xd0
[26019.112074]  [<ffffffff810970ef>] ? rcu_check_callbacks+0x90/0xcc
[26019.112074]  [<ffffffff81053098>] ? update_process_times+0x31/0x63
[26019.112074]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[26019.112074]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[26019.112074]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[26019.112074]  [<ffffffff8135b32c>] ? call_softirq+0x1c/0x30
[26019.112074]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[26019.112074]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[26019.112074]  <EOI>  [<ffffffff81066da5>] ? ktime_get_ts+0x32/0x82
[26019.112074]  [<ffffffff81066dcf>] ? ktime_get_ts+0x5c/0x82
[26019.112074]  [<ffffffff8105ebfa>] ? posix_ktime_get_ts+0xa/0xf
[26019.112074]  [<ffffffff8105f68b>] ? sys_clock_gettime+0x2b/0x5c
[26019.112074]  [<ffffffff813590f2>] ? system_call_fastpath+0x16/0x1b
[27017.688992] NMI backtrace for cpu 1
[27017.688992] CPU 1 
[27017.688992] Modules linked in: netconsole configfs fuse btrfs crc32c libcrc32c zlib_deflate ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs xfs reiserfs ext3 jbd ext2 efivars dm_mod xt_tcpudp iptable_filter ip_tables x_tables nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_hda_intel nd_hda_codec snd_hwdep snd_pcm snd_page_alloc psmouse snd_timer i2c_piix4 processor snd i2c_core joydev button evdev pcspkr serio_raw virtio_balloon thermal_sys soundcore ext4 crc16 jbd2 mbcache usbhid hid sg sr_mod cdrom ata_generic virtio_net virtio_blk ata_piix floppy libata virtio_pci virtio_ringvirtio uhci_hcd ehci_hcd scsi_mod usbcore usb_common [last unloaded: scsi_wait_scan]
[27017.688992] 
[27017.688992] Pid: 0, comm: swapper/1 Not tainted 3.2.0-4-amd64 #1 Debian 3.2.86-1 Bochs Bochs
[27017.688992] RIP: 0010:[<ffffffff8135401a>]  [<ffffffff8135401a>] _raw_spin_lock_irqsave+0x12/0x25
[27017.688992] RSP: 0018:ffff88041fc83e88  EFLAGS: 00000006
[27017.688992] RAX: 0000000000000046 RBX: ffff8802b10b0de0 RCX: ffff880316d7bd68
[27017.688992] RDX: 0000000001d801d8 RSI: 0000000000000003 RDI: ffff8802b10b0de0
[27017.688992] RBP: ffff8802b10b0de0 R08: 0000000000000000 R09: 00000000000127c0
[27017.688992] R10: 00000000000127c0 R11: ffff88041fc8d980 R12: 0000000000000000
[27017.688992] R13: ffff88041fc83f50 R14: 0000000000000003 R15: 0000000000000000
[27017.688992] FS:  00007fa2b7792700(0000) GS:ffff88041fc80000(0000) knlGS:0000000000000000
[27017.688992] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[27017.688992] CR2: 00007fbd72b0a000 CR3: 0000000352608000 CR4: 00000000000006e0
[27017.688992] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[27017.688992] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[27017.688992] Process swapper/1 (pid: 0, threadinfo ffff88040f0dc000, task ffff88040f0c1180)
[27017.688992] Stack:
[27017.688992]  ffff8802b10b08c0 ffffffff8103f6ad 00000000000127c0 ffff88028cca7d68
[27017.688992]  ffff88041fc8d980 ffff88041fc8d9c0 ffff88041fc83f50 ffff88041fc8da78
[27017.688992]  ffffffff81062854 ffffffff8106286e ffff880316d7bd68 ffffffff81062bdd
[27017.688992] Call Trace:
[27017.688992]  <IRQ> 
[27017.688992]  [<ffffffff8103f6ad>] ? try_to_wake_up+0x27/0x197
[27017.688992]  [<ffffffff81062854>] ? update_rmtp+0x62/0x62
[27017.688992]  [<ffffffff8106286e>] ? hrtimer_wakeup+0x1a/0x1e
[27017.688992]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[27017.688992]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[27017.688992]  [<ffffffff81013d64>] ? sched_clock+0x5/0x8
[27017.688992]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[27017.688992]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[27017.688992]  <EOI> 
[27017.688992]  [<ffffffff810971c9>] ? rcu_needs_cpu+0x50/0x1bb
[27017.688992]  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[27017.688992]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[27017.688992]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[27017.688992]  [<ffffffff81345f66>] ? start_secondary+0x1da/0x1e0
[27017.688992] Code: ff e8 e3 d8 d1 ff 85 c0 ba 01 00 00 00 75 02 30 d2 89 d0 c3 e9 b5 d8 d1 ff 53 48 89 fb e8 7b d8 d1 ff ba 00 00 01 00 f0 0f c1 13 <89> d1 c1 e9 10 66 39 ca 74 07 f3 90 66 8b 13 eb f4 5b c3 51 48 
[27017.688992] Call Trace:
[27017.688992]  <IRQ>  [<ffffffff8103f6ad>] ? try_to_wake_up+0x27/0x197
[27017.688992]  [<ffffffff81062854>] ? update_rmtp+0x62/0x62
[27017.688992]  [<ffffffff8106286e>] ? hrtimer_wakeup+0x1a/0x1e
[27017.688992]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[27017.688992]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[27017.688992]  [<ffffffff81013d64>] ? sched_clock+0x5/0x8
[27017.688992]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[27017.688992]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[27017.688992]  <EOI>  [<ffffffff810971c9>] ? rcu_needs_cpu+0x50/0x1bb
[27017.688992]  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[27017.688992]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[27017.688992]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[27017.688992]  [<ffffffff81345f66>] ? start_secondary+0x1da/0x1e0
[27017.688992] NMI backtrace for cpu 3
[27017.688992] CPU 3 
[27017.688992] Modules linked in: netconsole configfs fuse btrfs crc32c libcrc32c zlib_deflate ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs xfs reiserfs ext3 jbd ext2 efivars dm_mod xt_tcpudp iptable_filter ip_tables x_tables nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_hda_intel nd_hda_codec snd_hwdep snd_pcm snd_page_alloc psmouse snd_timer i2c_piix4 processor snd i2c_core joydev button evdev pcspkr serio_raw virtio_balloon thermal_sys soundcore ext4 crc16 jbd2 mbcache usbhid hid sg sr_mod cdrom ata_generic virtio_net virtio_blk ata_piix floppy libata virtio_pci virtio_ringvirtio uhci_hcd ehci_hcd scsi_mod usbcore usb_common [last unloaded: scsi_wait_scan]
[27017.688992] 
[27017.688992] Pid: 0, comm: swapper/3 Not tainted 3.2.0-4-amd64 #1 Debian 3.2.86-1 Bochs Bochs
[27017.688992] RIP: 0010:[<ffffffff8135401a>]  [<ffffffff8135401a>] _raw_spin_lock_irqsave+0x12/0x25
[27017.688992] RSP: 0018:ffff88041fd83e88  EFLAGS: 00000002
[27017.688992] RAX: 0000000000000046 RBX: ffff88038cfbcce0 RCX: ffff880316d75d68
[27017.688992] RDX: 000000006fb96fb9 RSI: 0000000000000003 RDI: ffff88038cfbcce0
[27017.688992] RBP: ffff88038cfbcce0 R08: 0000000000000000 R09: 00000000000127c0
[27017.688992] R10: 00000000000127c0 R11: ffff88041fd8d980 R12: 0000000000000000
[27017.688992] INFO: rcu_sched detected stall on CPU 1 (t=2005081748685 jiffies)
[27017.688992] R13: ffff88041fd83f50 R14: 0000000000000003 R15: 0000000000000000
[27017.688992] FS:  00007fa9f66ee700(0000) GS:ffff88041fd80000(0000) knlGS:0000000000000000
[27017.688992] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[27017.688992] CR2: 00007fbd72b24000 CR3: 00000003527fe000 CR4: 00000000000006e0
[27017.688992] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[27017.688992] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[27017.688992] Process swapper/3 (pid: 0, threadinfo ffff88040f11e000, task ffff88040f0fe100)
[27017.688992] Stack:
[27017.688992]  ffff88038cfbc7c0 ffffffff8103f6ad 00000000000127c0 ffff880352417e38
[27017.688992]  ffff88041fd8d980 ffff88041fd8d9c0 ffff88041fd83f50 ffff88041fd8da78
[27017.688992]  ffffffff81062854 ffffffff8106286e ffff880316d75d68 ffffffff81062bdd
[27017.688992] Call Trace:
[27017.688992]  <IRQ> 
[27017.688992]  [<ffffffff8103f6ad>] ? try_to_wake_up+0x27/0x197
[27017.688992]  [<ffffffff81062854>] ? update_rmtp+0x62/0x62
[27017.688992]  [<ffffffff8106286e>] ? hrtimer_wakeup+0x1a/0x1e
[27017.688992]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[27017.688992]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[27017.688992]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[27017.688992]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[27017.688992]  <EOI> 
[27017.688992]  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[27017.688992]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[27017.688992]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[27017.688992]  [<ffffffff81345f66>] ? start_secondary+0x1da/0x1e0
[27017.688992] Code: ff e8 e3 d8 d1 ff 85 c0 ba 01 00 00 00 75 02 30 d2 89 d0 c3 e9 b5 d8 d1 ff 53 48 89 fb e8 7b d8 d1 ff ba 00 00 01 00 f0 0f c1 13 <89> d1 c1 e9 10 66 39 ca 74 07 f3 90 66 8b 13 eb f4 5b c3 51 48 
[27017.688992] Call Trace:
[27017.688992]  <IRQ>  [<ffffffff8103f6ad>] ? try_to_wake_up+0x27/0x197
[27017.688992]  [<ffffffff81062854>] ? update_rmtp+0x62/0x62
[27017.688992]  [<ffffffff8106286e>] ? hrtimer_wakeup+0x1a/0x1e
[27017.688992]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[27017.688992]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[27017.688992]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[27017.688992]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[27017.688992]  <EOI>  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[27017.688992]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[27017.688992]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[27017.688992]  [<ffffffff81345f66>] ? start_secondary+0x1da/0x1e0
[8020353013.849868] sending NMI to all CPUs:
[8020353013.849868] NMI backtrace for cpu 1
[8020353013.849868] CPU 1 
[8020353013.849868] Modules linked in: netconsole configfs fuse btrfs crc32c libcrc32c zlib_deflate ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs xfs reiserfs ext3 jbd ext2 efivars dm_mod xt_tcpudp iptable_filter ip_tables x_tables nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_hda_itel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc psmouse snd_timer i2c_piix4 processor snd i2c_core joydev button evdev pcspkr serio_raw virtio_balloon thermal_sys soundcore ext4 crc16 jbd2 mbcache usbhid hid sg sr_mod cdrom ata_generic virtio_net virtio_blk ata_piix floppy libata virtio_pci virtioring virtio uhci_hcd ehci_hcd scsi_mod usbcore usb_common [last unloaded: scsi_wait_scan]
[8020353013.849868] 
[8020353013.849868] Pid: 0, comm: swapper/1 Not tainted 3.2.0-4-amd64 #1 Debian 3.2.86-1 Bochs Bochs
[8020353013.849868] RIP: 0010:[<ffffffff81036291>]  [<ffffffff81036291>] __update_cpu_load+0xde/0xf2
[8020353013.849868] RSP: 0018:ffff88041fc83e68  EFLAGS: 00000006
[8020353013.849868] RAX: 000000001dcd6500 RBX: 000000000000000f RCX: 00b3517fa4df4700
[8020353013.849868] RDX: 6e9ab31304af68c0 RSI: 0000000000041800 RDI: ffff88041fc927c0
[8020353013.849868] RBP: 0000000000000001 R08: 0000000000000005 R09: 0000000000000004
[8020353013.849868] R10: 0000000000000020 R11: ffff88041fc8d900 R12: ffff88040f0c1180
[8020353013.849868] R13: ffff88041fc83f50 R14: ffff88041fc8da78 R15: ffffffff8106ca08
[8020353013.849868] FS:  00007fa2b7792700(0000) GS:ffff88041fc80000(0000) knlGS:0000000000000000
[8020353013.849868] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[8020353013.849868] CR2: 00007fbd72b0a000 CR3: 0000000352608000 CR4: 00000000000006e0
[8020353013.849868] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[8020353013.849868] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[8020353013.849868] Process swapper/1 (pid: 0, threadinfo ffff88040f0dc000, task ffff88040f0c1180)
[8020353013.849868] Stack:
[8020353013.849868]  ffff88041fc927c0 0000000000000001 ffff88040f0c1180 ffffffff81042497
[8020353013.849868]  ffff88040f0c1180 0000000000000000 0000000000000001 ffffffff810530be
[8020353013.849868]  ffff88041fc8dab0 6f4e04928bc14ac0 ffff88040f0dde48 ffffffff8106ca72
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ> 
[8020353013.849868]  [<ffffffff81042497>] ? scheduler_tick+0x56/0x231
[8020353013.849868]  [<ffffffff810530be>] ? update_process_times+0x57/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff81013d64>] ? sched_clock+0x5/0x8
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI> 
[8020353013.849868]  [<ffffffff810971c9>] ? rcu_needs_cpu+0x50/0x1bb
[8020353013.849868]  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[8020353013.849868]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[8020353013.849868]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[8020353013.849868]  [<ffffffff81345f66>] ? start_secondary+0x1da/0x1e0
[8020353013.849868] Code: 8f 65 00 48 69 c0 40 42 0f 00 48 d1 e8 eb 15 48 d1 af b0 08 00 00 48 89 8f b8 08 00 00 48 01 87 b8 08 00 00 48 8b 8f b8 08 00 00 <48> 8b 97 40 08 00 00 48 29 ca 48 39 c2 7f d5 5b 5d 41 5c c3 41 
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ>  [<ffffffff81042497>] ? scheduler_tick+0x56/0x231
[8020353013.849868]  [<ffffffff810530be>] ? update_process_times+0x57/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff81013d64>] ? sched_clock+0x5/0x8
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI>  [<ffffffff810971c9>] ? rcu_needs_cpu+0x50/0x1bb
[8020353013.849868]  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[8020353013.849868]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[8020353013.849868]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[8020353013.849868]  [<ffffffff81345f66>] ? start_secondary+0x1da/0x1e0
[8020353013.849868] NMI backtrace for cpu 0
[8020353013.849868] CPU 0 
[8020353013.849868] Modules linked in: netconsole configfs fuse btrfs crc32c libcrc32c zlib_deflate ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs xfs reiserfs ext3 jbd ext2 efivars dm_mod xt_tcpudp iptable_filter ip_tables x_tables nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_hda_itel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc psmouse snd_timer i2c_piix4 processor snd i2c_core joydev button evdev pcspkr serio_raw virtio_balloon thermal_sys soundcore ext4 crc16 jbd2 mbcache usbhid hid sg sr_mod cdrom ata_generic virtio_net virtio_blk ata_piix floppy libata virtio_pci virtioring virtio uhci_hcd ehci_hcd scsi_mod usbcore usb_common [last unloaded: scsi_wait_scan]
[8020353013.849868] 
[8020353013.849868] Pid: 0, comm: swapper/0 Not tainted 3.2.0-4-amd64 #1 Debian 3.2.86-1 Bochs Bochs
[8020353013.849868] RIP: 0010:[<ffffffff81027f6c>]  [<ffffffff81027f6c>] native_apic_mem_write+0x8/0x9
[8020353013.849868] RSP: 0018:ffff88041fc03df0  EFLAGS: 00000046
[8020353013.849868] RAX: 0000000000000000 RBX: 0000000000000046 RCX: 000000000000241c
[8020353013.849868] RDX: 0000000000000000 RSI: 0000000000000c00 RDI: 0000000000000300
[8020353013.849868] RBP: 0000000000000002 R08: 0000000000000200 R09: 0000000000000000
[8020353013.849868] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000c00
[8020353013.849868] R13: 000000000000000f R14: ffff88041fc0da78 R15: ffffffff8106ca08
[8020353013.849868] FS:  00007f6c0fe2b700(0000) GS:ffff88041fc00000(0000) knlGS:0000000000000000
[8020353013.849868] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[8020353013.849868] CR2: 00007fbd72b10000 CR3: 000000034a240000 CR4: 00000000000006f0
[8020353013.849868] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[8020353013.849868] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[8020353013.849868] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020)
[8020353013.849868] Stack:
[8020353013.849868]  ffffffff810281bc 0000000000000000 0000000000002710 ffffffff81622300
[8020353013.849868]  ffffffff81622400 ffff88041fc03f50 ffffffff810250e2 ffff88041fc0ddc0
[8020353013.849868]  ffffffff81096aec ffff88041fd12fc0 0000370827f1b5db ffff88040f106dc0
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ> 
[8020353013.849868]  [<ffffffff810281bc>] ? _flat_send_IPI_mask+0x68/0x78
[8020353013.849868]  [<ffffffff810250e2>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7b
[8020353013.849868]  [<ffffffff81096aec>] ? __rcu_pending+0x82/0x358
[8020353013.849868]  [<ffffffff8106ca08>] ? tick_nohz_handler+0xd0/0xd0
[8020353013.849868]  [<ffffffff810970ef>] ? rcu_check_callbacks+0x90/0xcc
[8020353013.849868]  [<ffffffff81053098>] ? update_process_times+0x31/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI> 
[8020353013.849868]  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[8020353013.849868]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[8020353013.849868]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[8020353013.849868]  [<ffffffff816aab3b>] ? start_kernel+0x3bd/0x3c8
[8020353013.849868]  [<ffffffff816aa140>] ? early_idt_handlers+0x140/0x140
[8020353013.849868]  [<ffffffff816aa3c4>] ? x86_64_start_kernel+0x104/0x111
[8020353013.849868] Code: 24 0c bf 1b 00 00 00 e8 ab fb ff ff f6 c4 04 0f 95 c0 0f b6 c0 48 83 c4 10 c3 90 57 9d 66 66 90 66 90 c3 89 ff 89 b7 00 b0 5f ff <c3> 89 ff 8b 87 00 b0 5f ff c3 48 8b 07 25 ff 00 00 00 c3 48 8b 
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ>  [<ffffffff810281bc>] ? _flat_send_IPI_mask+0x68/0x78
[8020353013.849868]  [<ffffffff810250e2>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7b
[8020353013.849868]  [<ffffffff81096aec>] ? __rcu_pending+0x82/0x358
[8020353013.849868]  [<ffffffff8106ca08>] ? tick_nohz_handler+0xd0/0xd0
[8020353013.849868]  [<ffffffff810970ef>] ? rcu_check_callbacks+0x90/0xcc
[8020353013.849868]  [<ffffffff81053098>] ? update_process_times+0x31/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI>  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[8020353013.849868]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[8020353013.849868]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[8020353013.849868]  [<ffffffff816aab3b>] ? start_kernel+0x3bd/0x3c8
[8020353013.849868]  [<ffffffff816aa140>] ? early_idt_handlers+0x140/0x140
[8020353013.849868]  [<ffffffff816aa3c4>] ? x86_64_start_kernel+0x104/0x111
[8020353013.849868] NMI backtrace for cpu 2
[8020353013.849868] CPU 2 
[8020353013.849868] Modules linked in: netconsole configfs fuse btrfs crc32c libcrc32c zlib_deflate ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs xfs reiserfs ext3 jbd ext2 efivars dm_mod xt_tcpudp iptable_filter ip_tables x_tables nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_hda_itel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc psmouse snd_timer i2c_piix4 processor snd i2c_core joydev button evdev pcspkr serio_raw virtio_balloon thermal_sys soundcore ext4 crc16 jbd2 mbcache usbhid hid sg sr_mod cdrom ata_generic virtio_net virtio_blk ata_piix floppy libata virtio_pci virtioring virtio uhci_hcd ehci_hcd scsi_mod usbcore usb_common [last unloaded: scsi_wait_scan]
[8020353013.849868] 
[8020353013.849868] Pid: 4321, comm: java Not tainted 3.2.0-4-amd64 #1 Debian 3.2.86-1 Bochs Bochs
[8020353013.849868] RIP: 0010:[<ffffffff8103628a>]  [<ffffffff8103628a>] __update_cpu_load+0xd7/0xf2
[8020353013.849868] RSP: 0018:ffff88041fd03e68  EFLAGS: 00000006
[8020353013.849868] RAX: 000000001dcd6500 RBX: 000000000000000f RCX: 00acd8d07f9c9c00
[8020353013.849868] RDX: 6ea12bc20c24aec0 RSI: 0000000000000c00 RDI: ffff88041fd127c0
[8020353013.849868] RBP: 0000000000000002 R08: 0000000000000005 R09: 0000000000000004
[8020353013.849868] R10: 0000000000000020 R11: ffff88041fd0d900 R12: ffff8802f602e800
[8020353013.849868] R13: ffff88041fd03f50 R14: ffff88041fd0da78 R15: ffffffff8106ca08
[8020353013.849868] FS:  00007fadd88da700(0000) GS:ffff88041fd00000(0000) knlGS:0000000000000000
[8020353013.849868] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[8020353013.849868] CR2: 00007facc0198000 CR3: 000000040bbdd000 CR4: 00000000000006e0
[8020353013.849868] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[8020353013.849868] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[8020353013.849868] Process java (pid: 4321, threadinfo ffff8802f604c000, task ffff8802f602e800)
[8020353013.849868] Stack:
[8020353013.849868]  ffff88041fd127c0 0000000000000002 ffff8802f602e800 ffffffff81042497
[8020353013.849868]  ffff8802f602e800 0000000000000000 0000000000000002 ffffffff810530be
[8020353013.849868]  ffff88041fd0dab0 6f4e04928bc14ac0 ffff8802f604de68 ffffffff8106ca72
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ> 
[8020353013.849868]  [<ffffffff81042497>] ? scheduler_tick+0x56/0x231
[8020353013.849868]  [<ffffffff810530be>] ? update_process_times+0x57/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff8135b32c>] ? call_softirq+0x1c/0x30
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI> 
[8020353013.849868]  [<ffffffff81066da5>] ? ktime_get_ts+0x32/0x82
[8020353013.849868]  [<ffffffff81066dcf>] ? ktime_get_ts+0x5c/0x82
[8020353013.849868]  [<ffffffff8105ebfa>] ? posix_ktime_get_ts+0xa/0xf
[8020353013.849868]  [<ffffffff8105f68b>] ? sys_clock_gettime+0x2b/0x5c
[8020353013.849868]  [<ffffffff813590f2>] ? system_call_fastpath+0x16/0x1b
[8020353013.849868]  ffff88041fd0dab0 6f4e04928bc14ac0 ffff8802f604de68 ffffffff8106ca72
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ>
[8020353013.849868]  [<ffffffff81042497>] ? scheduler_tick+0x56/0x231
[8020353013.849868]  [<ffffffff810530be>] ? update_process_times+0x57/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff8135b32c>] ? call_softirq+0x1c/0x30
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI>
[8020353013.849868]  [<ffffffff81066da5>] ? ktime_get_ts+0x32/0x82
[8020353013.849868]  [<ffffffff81066dcf>] ? ktime_get_ts+0x5c/0x82
[8020353013.849868]  [<ffffffff8105ebfa>] ? posix_ktime_get_ts+0xa/0xf
[8020353013.849868]  [<ffffffff8105f68b>] ? sys_clock_gettime+0x2b/0x5c
[8020353013.849868]  [<ffffffff813590f2>] ? system_call_fastpath+0x16/0x1b
[8020353013.849868] Code: 71 ff ff ff 8b 05 4b 8f 65 00 48 69 c0 40 42 0f 00 48 d1 e8 eb 15 48 d1 af b0 08 00 00 48 89 8f b8 08 00 00 48 01 87 b8 08 00 00 <48> 8b 8f b8 08 00 00 48 8b 97 40 08 00 00 48 29 ca 48 39 c2 7f
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ>  [<ffffffff81042497>] ? scheduler_tick+0x56/0x231
[8020353013.849868]  [<ffffffff810530be>] ? update_process_times+0x57/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff8135b32c>] ? call_softirq+0x1c/0x30
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI>  [<ffffffff81066da5>] ? ktime_get_ts+0x32/0x82
[8020353013.849868]  [<ffffffff81066dcf>] ? ktime_get_ts+0x5c/0x82
[8020353013.849868]  [<ffffffff8105ebfa>] ? posix_ktime_get_ts+0xa/0xf
[8020353013.849868]  [<ffffffff8105f68b>] ? sys_clock_gettime+0x2b/0x5c
[8020353013.849868]  [<ffffffff813590f2>] ? system_call_fastpath+0x16/0x1b
[8020353013.849868] NMI backtrace for cpu 3
[8020353013.849868] CPU 3
[8020353013.849868] Modules linked in: netconsole configfs fuse btrfs crc32c libcrc32c zlib_deflate ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs xfs reiserfs ext3 jbd ext2 efivars dm_mod xt_tcpudp iptable_filter ip_tables x_tables nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc psmouse snd_timer i2c_piix4 processor snd i2c_core joydev button evdev pcspkr serio_raw virtio_balloon thermal_sys soundcore ext4 crc16 jbd2 mbcache usbhid hid sg sr_mod cdrom ata_generic virtio_net virtio_blk ata_piix floppy libata virtio_pci virtio_ring virtio uhci_hcd ehci_hcd scsi_mod usbcore usb_common [last unloaded: scsi_wait_scan]
[8020353013.849868]
[8020353013.849868] Pid: 0, comm: swapper/3 Not tainted 3.2.0-4-amd64 #1 Debian 3.2.86-1 Bochs Bochs
[8020353013.849868] RIP: 0010:[<ffffffff81036291>]  [<ffffffff81036291>] __update_cpu_load+0xde/0xf2
[8020353013.849868] RSP: 0018:ffff88041fd83e68  EFLAGS: 00000006
[8020353013.849868] RAX: 000000001dcd6500 RBX: 000000000000000f RCX: 00b0d55da059f400
[8020353013.849868] RDX: 6e9d2f350934bbc0 RSI: 000000000002b400 RDI: ffff88041fd927c0
[8020353013.849868] RBP: 0000000000000003 R08: 0000000000000005 R09: 0000000000000004
[8020353013.849868] R10: 0000000000000020 R11: ffff88041fd8d900 R12: ffff88040f0fe100
[8020353013.849868] R13: ffff88041fd83f50 R14: ffff88041fd8da78 R15: ffffffff8106ca08
[8020353013.849868] FS:  00007fa9f66ee700(0000) GS:ffff88041fd80000(0000) knlGS:0000000000000000
[8020353013.849868] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[8020353013.849868] CR2: 00007fbd72b24000 CR3: 00000003527fe000 CR4: 00000000000006e0
[8020353013.849868] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[8020353013.849868] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[8020353013.849868] Process swapper/3 (pid: 0, threadinfo ffff88040f11e000, task ffff88040f0fe100)
[8020353013.849868] Stack:
[8020353013.849868]  ffff88041fd927c0 0000000000000003 ffff88040f0fe100 ffffffff81042497
[8020353013.849868]  ffff88040f0fe100 0000000000000000 0000000000000003 ffffffff810530be
[8020353013.849868]  ffff88041fd8dab0 6f4e04928bc14ac0 ffff88040f11fe48 ffffffff8106ca72
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ>
[8020353013.849868]  [<ffffffff81042497>] ? scheduler_tick+0x56/0x231
[8020353013.849868]  [<ffffffff810530be>] ? update_process_times+0x57/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI>
[8020353013.849868]  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[8020353013.849868]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[8020353013.849868]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[8020353013.849868]  [<ffffffff81345f66>] ? start_secondary+0x1da/0x1e0
[8020353013.849868] Code: 8f 65 00 48 69 c0 40 42 0f 00 48 d1 e8 eb 15 48 d1 af b0 08 00 00 48 89 8f b8 08 00 00 48 01 87 b8 08 00 00 48 8b 8f b8 08 00 00 <48> 8b 97 40 08 00 00 48 29 ca 48 39 c2 7f d5 5b 5d 41 5c c3 41
[8020353013.849868] Call Trace:
[8020353013.849868]  <IRQ>  [<ffffffff81042497>] ? scheduler_tick+0x56/0x231
[8020353013.849868]  [<ffffffff810530be>] ? update_process_times+0x57/0x63
[8020353013.849868]  [<ffffffff8106ca72>] ? tick_sched_timer+0x6a/0x90
[8020353013.849868]  [<ffffffff81062bdd>] ? __run_hrtimer+0xc4/0x162
[8020353013.849868]  [<ffffffff81063305>] ? hrtimer_interrupt+0xd7/0x1b1
[8020353013.849868]  [<ffffffff810246eb>] ? smp_apic_timer_interrupt+0x6f/0x82
[8020353013.849868]  [<ffffffff81359b9e>] ? apic_timer_interrupt+0x6e/0x80
[8020353013.849868]  <EOI>  [<ffffffff8102b370>] ? native_safe_halt+0x2/0x3
[8020353013.849868]  [<ffffffff81014880>] ? default_idle+0x47/0x7f
[8020353013.849868]  [<ffffffff8100d24c>] ? cpu_idle+0xaf/0xf2
[8020353013.849868]  [<ffffffff81345f66>] ? start_secondary+0x1da/0x1e0

-- 
------------------------------------------------------------------------
Emmanuel Florac     |   Direction technique
                    |   Intellique
                    |	<eflorac@intellique.com>
                    |   +33 1 78 94 84 02
------------------------------------------------------------------------

[-- Attachment #2: Signature digitale OpenPGP --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

^ permalink raw reply	[flat|nested] 2+ messages in thread

* Re: Guest hanging several times a day
  2017-03-21 14:51 Guest hanging several times a day Emmanuel Florac
@ 2017-03-23 15:02 ` Emmanuel Florac
  0 siblings, 0 replies; 2+ messages in thread
From: Emmanuel Florac @ 2017-03-23 15:02 UTC (permalink / raw)
  To: kvm

[-- Attachment #1: Type: text/plain, Size: 830 bytes --]

Le Tue, 21 Mar 2017 15:51:17 +0100
Emmanuel Florac <eflorac@intellique.com> écrivait:

> Hi everyone, 
> On a host running Debian 8 with a plain vanilla kernel 3.18.25 amd64,
> running several VMs, one of these freezes repeatedly.
> 

I didn't mention the version of KVM:

# kvm --version
QEMU emulator version 2.1.2 (Debian 1:2.1+dfsg-12+deb8u6), Copyright
(c) 2003-2008 Fabrice Bellard

Does anyone have any idea about what could make the VM crash? Is the
java VM a possible culprit?

-- 
------------------------------------------------------------------------
Emmanuel Florac     |   Direction technique
                    |   Intellique
                    |	<eflorac@intellique.com>
                    |   +33 1 78 94 84 02
------------------------------------------------------------------------

[-- Attachment #2: Signature digitale OpenPGP --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2017-03-23 15:02 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-03-21 14:51 Guest hanging several times a day Emmanuel Florac
2017-03-23 15:02 ` Emmanuel Florac

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.