From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.8 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4B984C433E7 for ; Thu, 15 Oct 2020 11:28:24 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 8A3462073A for ; Thu, 15 Oct 2020 11:28:23 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=kernel.org header.i=@kernel.org header.b="w7jKyu4O" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 8A3462073A Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:33564 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kT1Qk-00020U-4z for qemu-devel@archiver.kernel.org; Thu, 15 Oct 2020 07:28:22 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:47406) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kT1Ol-0001Dd-TX for qemu-devel@nongnu.org; Thu, 15 Oct 2020 07:26:20 -0400 Received: from mail.kernel.org ([198.145.29.99]:35918) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kT1Oj-00087U-34 for qemu-devel@nongnu.org; Thu, 15 Oct 2020 07:26:19 -0400 Received: from disco-boy.misterjones.org (disco-boy.misterjones.org [51.254.78.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 11D1720878; Thu, 15 Oct 2020 11:26:13 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1602761173; bh=jlvWDzncWzjj0CkQc8YBItJ3auhIS7cMPtALYoadg/U=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=w7jKyu4OD9gTPtmS0kFMmNIa1X+o7PA7ue8sVMq8tNWG3UK0+EWd1jFYsMxflmSfj Igx7UK7H8hYd9DaSNIK+A5LRvXDQz4MmXJrSvnUXPoPARkcehg6FbziOGywgGGaJ4l RqTycU353H/kbM4UdMDPf/lJ27JqKl7hIBkmKfpI= Received: from disco-boy.misterjones.org ([51.254.78.96] helo=www.loen.fr) by disco-boy.misterjones.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1kT1Od-001Mt3-0U; Thu, 15 Oct 2020 12:26:11 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Thu, 15 Oct 2020 12:26:10 +0100 From: Marc Zyngier To: xu910121@sina.com Subject: Re: Kernel patch cases qemu live migration failed. In-Reply-To: <20201015040639.70C6D414009F@webmail.sinamail.sina.com.cn> References: <20201015040639.70C6D414009F@webmail.sinamail.sina.com.cn> User-Agent: Roundcube Webmail/1.4.9 Message-ID: <7fecfc67da4caab1d677a8b4cd5386b3@kernel.org> X-Sender: maz@kernel.org X-SA-Exim-Connect-IP: 51.254.78.96 X-SA-Exim-Rcpt-To: xu910121@sina.com, dave.martin@arm.com, kvmarm@lists.cs.columbia.edu, qemu-devel@nongnu.org X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false Received-SPF: pass client-ip=198.145.29.99; envelope-from=maz@kernel.org; helo=mail.kernel.org X-detected-operating-system: by eggs.gnu.org: First seen = 2020/10/15 07:26:13 X-ACL-Warn: Detected OS = Linux 3.11 and newer X-Spam_score_int: -70 X-Spam_score: -7.1 X-Spam_bar: ------- X-Spam_report: (-7.1 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: qemu-devel , "Dave.Martin" , kvmarm Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" Hi Please don't use my arm.com address anymore, nobody reads it... On 2020-10-15 05:06, 张东旭 wrote: > I'm so sorry for disturbing you. > > When I apply this kernel patch：KVM: arm64/sve: System register > context switch and access support > https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/arch/arm64/kvm/sys_regs.c?id=73433762fcaeb9d59e84d299021c6b15466c96dd This patch was only introduced in 5.2, and wasn't supposed to be backported to anything else. > qemu live migration will failed with messages： > ​qemu-kvm: Invalid value 233 expecting positive value > <= 232 > qemu-kvm: Failed to load cpu:cpreg_vmstate_array_len > New version kernel exclude ID_AA64ZFR0_EL1 register when host not > support SVE feature, > so qemu ioctl kvm(KVM_GET_REG_LIST) will not contain ID_AA64ZFR0_EL1 > register. > > I'm using CentOS Linux kernel, old kernel version：4.18.0-80.11.el8 > (migration source) > new kernel version：4.18.0-147.5.el8 (migration destination) > > CentOS linux kernel version 4.18.0-111.el8 applied this patch. So > 4.18.0-147.5.el8 also applied this patch. > > Migration source and destination hosts have the same hardware, just > kernel version is different, > and the hardware on either side of the migration not support SVE. > > Is there some good suggestions，which can make sure old version > kernel live migration to new version kernel with qemu? I['m afraid you should take this with your distribution of choice, unless you can reproduce the problem with mainline kernels. Thanks, M. -- Jazz is not dead. It just smells funny... From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.8 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7C9D8C433E7 for ; Thu, 15 Oct 2020 11:26:20 +0000 (UTC) Received: from mm01.cs.columbia.edu (mm01.cs.columbia.edu [128.59.11.253]) by mail.kernel.org (Postfix) with ESMTP id 75D342080A for ; Thu, 15 Oct 2020 11:26:19 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=kernel.org header.i=@kernel.org header.b="w7jKyu4O" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 75D342080A Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvmarm-bounces@lists.cs.columbia.edu Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id BDA524B6E7; Thu, 15 Oct 2020 07:26:18 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Authentication-Results: mm01.cs.columbia.edu (amavisd-new); dkim=softfail (fail, message has been altered) header.i=@kernel.org Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xTRSzJXZQ--b; Thu, 15 Oct 2020 07:26:17 -0400 (EDT) Received: from mm01.cs.columbia.edu (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 9C1B44B562; Thu, 15 Oct 2020 07:26:17 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id D8BA94B6E4 for ; Thu, 15 Oct 2020 07:26:15 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id CzLDAgAFzQsE for ; Thu, 15 Oct 2020 07:26:14 -0400 (EDT) Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by mm01.cs.columbia.edu (Postfix) with ESMTPS id 8E0E14B562 for ; Thu, 15 Oct 2020 07:26:14 -0400 (EDT) Received: from disco-boy.misterjones.org (disco-boy.misterjones.org [51.254.78.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 11D1720878; Thu, 15 Oct 2020 11:26:13 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1602761173; bh=jlvWDzncWzjj0CkQc8YBItJ3auhIS7cMPtALYoadg/U=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=w7jKyu4OD9gTPtmS0kFMmNIa1X+o7PA7ue8sVMq8tNWG3UK0+EWd1jFYsMxflmSfj Igx7UK7H8hYd9DaSNIK+A5LRvXDQz4MmXJrSvnUXPoPARkcehg6FbziOGywgGGaJ4l RqTycU353H/kbM4UdMDPf/lJ27JqKl7hIBkmKfpI= Received: from disco-boy.misterjones.org ([51.254.78.96] helo=www.loen.fr) by disco-boy.misterjones.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1kT1Od-001Mt3-0U; Thu, 15 Oct 2020 12:26:11 +0100 MIME-Version: 1.0 Date: Thu, 15 Oct 2020 12:26:10 +0100 From: Marc Zyngier To: xu910121@sina.com Subject: Re: Kernel patch cases qemu live migration failed. In-Reply-To: <20201015040639.70C6D414009F@webmail.sinamail.sina.com.cn> References: <20201015040639.70C6D414009F@webmail.sinamail.sina.com.cn> User-Agent: Roundcube Webmail/1.4.9 Message-ID: <7fecfc67da4caab1d677a8b4cd5386b3@kernel.org> X-Sender: maz@kernel.org X-SA-Exim-Connect-IP: 51.254.78.96 X-SA-Exim-Rcpt-To: xu910121@sina.com, dave.martin@arm.com, kvmarm@lists.cs.columbia.edu, qemu-devel@nongnu.org X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false Cc: qemu-devel , "Dave.Martin" , kvmarm X-BeenThere: kvmarm@lists.cs.columbia.edu X-Mailman-Version: 2.1.14 Precedence: list List-Id: Where KVM/ARM decisions are made List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: kvmarm-bounces@lists.cs.columbia.edu Sender: kvmarm-bounces@lists.cs.columbia.edu SGkKClBsZWFzZSBkb24ndCB1c2UgbXkgYXJtLmNvbSBhZGRyZXNzIGFueW1vcmUsIG5vYm9keSBy ZWFkcyBpdC4uLgoKT24gMjAyMC0xMC0xNSAwNTowNiwg5byg5Lic5petIHdyb3RlOgo+IEknbSBz byBzb3JyeSBmb3IgZGlzdHVyYmluZyB5b3UuCj4gCj4gV2hlbiBJIGFwcGx5IHRoaXMga2VybmVs IHBhdGNo77yaS1ZNOiBhcm02NC9zdmU6IFN5c3RlbSByZWdpc3Rlcgo+IGNvbnRleHQgc3dpdGNo IGFuZCBhY2Nlc3Mgc3VwcG9ydAo+IGh0dHBzOi8vZ2l0Lmtlcm5lbC5vcmcvcHViL3NjbS9saW51 eC9rZXJuZWwvZ2l0L3RvcnZhbGRzL2xpbnV4LmdpdC9jb21taXQvYXJjaC9hcm02NC9rdm0vc3lz X3JlZ3MuYz9pZD03MzQzMzc2MmZjYWViOWQ1OWU4NGQyOTkwMjFjNmIxNTQ2NmM5NmRkCgpUaGlz IHBhdGNoIHdhcyBvbmx5IGludHJvZHVjZWQgaW4gNS4yLCBhbmQgd2Fzbid0IHN1cHBvc2VkIHRv IGJlCmJhY2twb3J0ZWQgdG8gYW55dGhpbmcgZWxzZS4KCj4gcWVtdSBsaXZlIG1pZ3JhdGlvbiB3 aWxsIGZhaWxlZCB3aXRoIG1lc3NhZ2Vz77yaCj4gICAgICAgICAgICAgICDigItxZW11LWt2bTog SW52YWxpZCB2YWx1ZSAyMzMgZXhwZWN0aW5nIHBvc2l0aXZlIHZhbHVlCj4gPD0gMjMyCj4gICAg ICAgICAgICAgICBxZW11LWt2bTogRmFpbGVkIHRvIGxvYWQgY3B1OmNwcmVnX3Ztc3RhdGVfYXJy YXlfbGVuCj4gTmV3IHZlcnNpb24ga2VybmVsICBleGNsdWRlIElEX0FBNjRaRlIwX0VMMSByZWdp c3RlciB3aGVuIGhvc3Qgbm90Cj4gc3VwcG9ydCBTVkUgZmVhdHVyZSwKPiBzbyBxZW11IGlvY3Rs IGt2bShLVk1fR0VUX1JFR19MSVNUKSB3aWxsIG5vdCBjb250YWluIElEX0FBNjRaRlIwX0VMMQo+ IHJlZ2lzdGVyLgo+IAo+IEknbSB1c2luZyBDZW50T1MgTGludXgga2VybmVsLCBvbGQga2VybmVs IHZlcnNpb27vvJo0LjE4LjAtODAuMTEuZWw4Cj4gKG1pZ3JhdGlvbiBzb3VyY2UpCj4gICAgICAg bmV3IGtlcm5lbCB2ZXJzaW9u77yaNC4xOC4wLTE0Ny41LmVsOCAobWlncmF0aW9uIGRlc3RpbmF0 aW9uKQo+IAo+IENlbnRPUyBsaW51eCBrZXJuZWwgdmVyc2lvbiA0LjE4LjAtMTExLmVsOCBhcHBs aWVkIHRoaXMgcGF0Y2guIFNvCj4gNC4xOC4wLTE0Ny41LmVsOCBhbHNvIGFwcGxpZWQgdGhpcyBw YXRjaC4KPiAKPiBNaWdyYXRpb24gc291cmNlIGFuZCBkZXN0aW5hdGlvbiBob3N0cyBoYXZlIHRo ZSBzYW1lIGhhcmR3YXJlLCBqdXN0Cj4ga2VybmVsIHZlcnNpb24gaXMgZGlmZmVyZW50LAo+IGFu ZCB0aGUgaGFyZHdhcmUgb24gZWl0aGVyIHNpZGUgb2YgdGhlIG1pZ3JhdGlvbiBub3Qgc3VwcG9y dCBTVkUuCj4gCj4gSXMgdGhlcmUgc29tZSBnb29kIHN1Z2dlc3Rpb25z77yMd2hpY2ggY2FuIG1h a2Ugc3VyZSBvbGQgdmVyc2lvbgo+IGtlcm5lbCBsaXZlIG1pZ3JhdGlvbiB0byBuZXcgdmVyc2lv biBrZXJuZWwgd2l0aCBxZW11PwoKSVsnbSBhZnJhaWQgeW91IHNob3VsZCB0YWtlIHRoaXMgd2l0 aCB5b3VyIGRpc3RyaWJ1dGlvbiBvZgpjaG9pY2UsIHVubGVzcyB5b3UgY2FuIHJlcHJvZHVjZSB0 aGUgcHJvYmxlbSB3aXRoIG1haW5saW5lIGtlcm5lbHMuCgpUaGFua3MsCgogICAgICAgICBNLgot LSAKSmF6eiBpcyBub3QgZGVhZC4gSXQganVzdCBzbWVsbHMgZnVubnkuLi4KX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18Ka3ZtYXJtIG1haWxpbmcgbGlzdApr dm1hcm1AbGlzdHMuY3MuY29sdW1iaWEuZWR1Cmh0dHBzOi8vbGlzdHMuY3MuY29sdW1iaWEuZWR1 L21haWxtYW4vbGlzdGluZm8va3ZtYXJtCg==