From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:39146) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XCAcG-0004vM-Lb for qemu-devel@nongnu.org; Tue, 29 Jul 2014 12:51:15 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1XCAc8-0001Df-8D for qemu-devel@nongnu.org; Tue, 29 Jul 2014 12:51:08 -0400 Received: from indium.canonical.com ([91.189.90.7]:37501) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XCAc8-0001DV-1w for qemu-devel@nongnu.org; Tue, 29 Jul 2014 12:51:00 -0400 Received: from loganberry.canonical.com ([91.189.90.37]) by indium.canonical.com with esmtp (Exim 4.76 #1 (Debian)) id 1XCAc7-0000id-1d for ; Tue, 29 Jul 2014 16:50:59 +0000 Received: from loganberry.canonical.com (localhost [127.0.0.1]) by loganberry.canonical.com (Postfix) with ESMTP id 090682E80B0 for ; Tue, 29 Jul 2014 16:50:59 +0000 (UTC) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Date: Tue, 29 Jul 2014 16:45:14 -0000 From: Paul Boven Sender: bounces@canonical.com References: <20140325110518.5612.54837.malonedeb@chaenomeles.canonical.com> Message-Id: <20140729164515.26647.4605.launchpad@soybean.canonical.com> Errors-To: bounces@canonical.com Subject: [Qemu-devel] [Bug 1297218] Re: guest hangs after live migration due to tsc jump Reply-To: Bug 1297218 <1297218@bugs.launchpad.net> List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: qemu-devel@nongnu.org ** Also affects: qemu Importance: Undecided Status: New -- = You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1297218 Title: guest hangs after live migration due to tsc jump Status in QEMU: New Status in =E2=80=9Cglusterfs=E2=80=9D package in Ubuntu: Invalid Status in =E2=80=9Clibvirt=E2=80=9D package in Ubuntu: Triaged Bug description: We have two identical Ubuntu servers running libvirt/kvm/qemu, sharing a Gluster filesystem. Guests can be live migrated between them. However, live migration often leads to the guest being stuck at 100% for a while. In that case, the dmesg output for such a guest will show (once it recovers): Clocksource tsc unstable (delta =3D 662463064082 ns). In this particular example, a guest was migrated and only after 11 minutes (662 seconds) did it become responsive again. It seems that newly booted guests doe not suffer from this problem, these can be migrated back and forth at will. After a day or so, the problem becomes apparent. It also seems that migrating from server A to server B causes much more problems than going from B back to A. If necessary, I can do more measurements to qualify these observations. The VM servers run Ubuntu 13.04 with these packages: Kernel: 3.8.0-35-generic x86_64 Libvirt: 1.0.2 Qemu: 1.4.0 Gluster-fs: 3.4.2 (libvirt access the images via the filesystem, not usin= g libgfapi yet as the Ubuntu libvirt is not linked against libgfapi). The interconnect between both machines (both for migration and gluster) i= s 10GbE. = Both servers are synced to NTP and well within 1ms form one another. Guests are either Ubuntu 13.04 or 13.10. On the guests, the current_clocksource is kvm-clock. The XML definition of the guests only contains: = Now as far as I've read in the documentation of kvm-clock, it specificall= y supports live migrations, so I'm a bit surprised at these problems. There= isn't all that much information to find on these issue, although I have fo= und postings by others that seem to have run into the same issues, but with= out a solution. --- = ApportVersion: 2.14.1-0ubuntu3 Architecture: amd64 DistroRelease: Ubuntu 14.04 Package: libvirt (not installed) ProcCmdline: BOOT_IMAGE=3D/boot/vmlinuz-3.13.0-24-generic root=3DUUID=3D1= b0c3c6d-a9b8-4e84-b076-117ae267d178 ro console=3DttyS1,115200n8 BOOTIF=3D01= -00-25-90-75-b5-c8 ProcVersionSignature: Ubuntu 3.13.0-24.47-generic 3.13.9 Tags: trusty apparmor apparmor apparmor apparmor apparmor Uname: Linux 3.13.0-24-generic x86_64 UpgradeStatus: No upgrade log present (probably fresh install) UserGroups: = _MarkForUpload: True modified.conffile..etc.default.libvirt.bin: [modified] modified.conffile..etc.libvirt.libvirtd.conf: [modified] modified.conffile..etc.libvirt.qemu.conf: [modified] modified.conffile..etc.libvirt.qemu.networks.default.xml: [deleted] mtime.conffile..etc.default.libvirt.bin: 2014-05-12T19:07:40.020662 mtime.conffile..etc.libvirt.libvirtd.conf: 2014-05-13T14:40:25.894837 mtime.conffile..etc.libvirt.qemu.conf: 2014-05-12T18:58:27.885506 To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1297218/+subscriptions