From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.3 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE, SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4A896C07E96 for ; Thu, 15 Jul 2021 10:00:55 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 316BA610F9 for ; Thu, 15 Jul 2021 10:00:55 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S240986AbhGOKDp (ORCPT ); Thu, 15 Jul 2021 06:03:45 -0400 Received: from foss.arm.com ([217.140.110.172]:50398 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233629AbhGOKDm (ORCPT ); Thu, 15 Jul 2021 06:03:42 -0400 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id CB15431B; Thu, 15 Jul 2021 03:00:48 -0700 (PDT) Received: from [10.57.36.240] (unknown [10.57.36.240]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 1FAED3F694; Thu, 15 Jul 2021 03:00:48 -0700 (PDT) Subject: Re: Any way to disable KVM VHE extension? To: Qu Wenruo , kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, Linux ARM References: <37f873cf-1b39-ea7f-a5e7-6feb0200dd4c@suse.com> <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> From: Robin Murphy Message-ID: <6331dfe5-a028-4a71-6cc1-479003a58f47@arm.com> Date: Thu, 15 Jul 2021 11:00:42 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: kvm@vger.kernel.org On 2021-07-15 10:44, Qu Wenruo wrote: > > > On 2021/7/15 下午5:28, Robin Murphy wrote: >> On 2021-07-15 09:55, Qu Wenruo wrote: >>> Hi, >>> >>> Recently I'm playing around the Nvidia Xavier AGX board, which has >>> VHE extension support. >>> >>> In theory, considering the CPU and memory, it should be pretty >>> powerful compared to boards like RPI CM4. >>> >>> But to my surprise, KVM runs pretty poor on Xavier. >>> >>> Just booting the edk2 firmware could take over 10s, and 20s to fully >>> boot the kernel. >>> Even my VM on RPI CM4 has way faster boot time, even just running on >>> PCIE2.0 x1 lane NVME, and just 4 2.1Ghz A72 core. >>> >>> This is definitely out of my expectation, I double checked to be sure >>> that it's running in KVM mode. >>> >>> But further digging shows that, since Xavier AGX CPU supports VHE, >>> kvm is running in VHE mode other than HYP mode on CM4. >>> >>> Is there anyway to manually disable VHE mode to test the more common >>> HYP mode on Xavier? >> >> According to kernel-parameters.txt, "kvm-arm.mode=nvhe" (or its >> low-level equivalent "id_aa64mmfr1.vh=0") on the command line should >> do that. > > Thanks for this one, I stupidly only searched modinfo of kvm, and didn't > even bother to search arch/arm64/kvm... > >> >> However I'd imagine the discrepancy is likely to be something more >> fundamental to the wildly different microarchitectures. There's >> certainly no harm in giving non-VHE a go for comparison, but I >> wouldn't be surprised if it turns out even slower... > > You're totally right, with nvhe mode, it's still the same slow speed. > > BTW, what did you mean by the "wildly different microarch"? > Is ARMv8.2 arch that different from ARMv8 of RPI4? I don't mean Armv8.x architectural features, I mean the actual implementation of NVIDIA's Carmel core is very, very different from Cortex-A72 or indeed our newer v8.2 Cortex-A designs. > And any extra methods I could try to explore the reason of the slowness? I guess the first check would be whether you're trapping and exiting the VM significantly more. I believe there are stats somewhere, but I don't know exactly where, sorry - I know very little about actually *using* KVM :) If it's not that, then it might just be that EDK2 is doing a lot of cache maintenance or system register modification or some other operation that happens to be slower on Carmel compared to Cortex-A72. Robin. > At least RPI CM4 is beyond my expectation and is working pretty fine. > > Thanks, > Qu > >> >> Robin. >> >>> BTW, this is the dmesg related to KVM on Xavier, running v5.13 >>> upstream kernel, with 64K page size: >>> [    0.852357] kvm [1]: IPA Size Limit: 40 bits >>> [    0.857378] kvm [1]: vgic interrupt IRQ9 >>> [    0.862122] kvm: pmu event creation failed -2 >>> [    0.866734] kvm [1]: VHE mode initialized successfully >>> >>> While on CM4, the host runs v5.12.10 upstream kernel (with downstream >>> dtb), with 4K page size: >>> [    1.276818] kvm [1]: IPA Size Limit: 44 bits >>> [    1.278425] kvm [1]: vgic interrupt IRQ9 >>> [    1.278620] kvm [1]: Hyp mode initialized successfully >>> >>> Could it be the PAGE size causing problem? >>> >>> Thanks, >>> Qu >>> >>> >>> _______________________________________________ >>> linux-arm-kernel mailing list >>> linux-arm-kernel@lists.infradead.org >>> http://lists.infradead.org/mailman/listinfo/linux-arm-kernel >> > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.3 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE, SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id F20D3C07E96 for ; Thu, 15 Jul 2021 10:00:57 +0000 (UTC) Received: from mm01.cs.columbia.edu (mm01.cs.columbia.edu [128.59.11.253]) by mail.kernel.org (Postfix) with ESMTP id 7231D610CB for ; Thu, 15 Jul 2021 10:00:57 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 7231D610CB Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=arm.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvmarm-bounces@lists.cs.columbia.edu Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id D062940CC5; Thu, 15 Jul 2021 06:00:56 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JoD4R9WQfmDQ; Thu, 15 Jul 2021 06:00:51 -0400 (EDT) Received: from mm01.cs.columbia.edu (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id BD81849FB0; Thu, 15 Jul 2021 06:00:51 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id B49A540D0A for ; Thu, 15 Jul 2021 06:00:50 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wngVhJ3+Z2H9 for ; Thu, 15 Jul 2021 06:00:49 -0400 (EDT) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 3718640CC5 for ; Thu, 15 Jul 2021 06:00:49 -0400 (EDT) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id CB15431B; Thu, 15 Jul 2021 03:00:48 -0700 (PDT) Received: from [10.57.36.240] (unknown [10.57.36.240]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 1FAED3F694; Thu, 15 Jul 2021 03:00:48 -0700 (PDT) Subject: Re: Any way to disable KVM VHE extension? To: Qu Wenruo , kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, Linux ARM References: <37f873cf-1b39-ea7f-a5e7-6feb0200dd4c@suse.com> <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> From: Robin Murphy Message-ID: <6331dfe5-a028-4a71-6cc1-479003a58f47@arm.com> Date: Thu, 15 Jul 2021 11:00:42 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> Content-Language: en-GB X-BeenThere: kvmarm@lists.cs.columbia.edu X-Mailman-Version: 2.1.14 Precedence: list List-Id: Where KVM/ARM decisions are made List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: kvmarm-bounces@lists.cs.columbia.edu Sender: kvmarm-bounces@lists.cs.columbia.edu T24gMjAyMS0wNy0xNSAxMDo0NCwgUXUgV2VucnVvIHdyb3RlOgo+IAo+IAo+IE9uIDIwMjEvNy8x NSDkuIvljYg1OjI4LCBSb2JpbiBNdXJwaHkgd3JvdGU6Cj4+IE9uIDIwMjEtMDctMTUgMDk6NTUs IFF1IFdlbnJ1byB3cm90ZToKPj4+IEhpLAo+Pj4KPj4+IFJlY2VudGx5IEknbSBwbGF5aW5nIGFy b3VuZCB0aGUgTnZpZGlhIFhhdmllciBBR1ggYm9hcmQsIHdoaWNoIGhhcyAKPj4+IFZIRSBleHRl bnNpb24gc3VwcG9ydC4KPj4+Cj4+PiBJbiB0aGVvcnksIGNvbnNpZGVyaW5nIHRoZSBDUFUgYW5k IG1lbW9yeSwgaXQgc2hvdWxkIGJlIHByZXR0eSAKPj4+IHBvd2VyZnVsIGNvbXBhcmVkIHRvIGJv YXJkcyBsaWtlIFJQSSBDTTQuCj4+Pgo+Pj4gQnV0IHRvIG15IHN1cnByaXNlLCBLVk0gcnVucyBw cmV0dHkgcG9vciBvbiBYYXZpZXIuCj4+Pgo+Pj4gSnVzdCBib290aW5nIHRoZSBlZGsyIGZpcm13 YXJlIGNvdWxkIHRha2Ugb3ZlciAxMHMsIGFuZCAyMHMgdG8gZnVsbHkgCj4+PiBib290IHRoZSBr ZXJuZWwuCj4+PiBFdmVuIG15IFZNIG9uIFJQSSBDTTQgaGFzIHdheSBmYXN0ZXIgYm9vdCB0aW1l LCBldmVuIGp1c3QgcnVubmluZyBvbiAKPj4+IFBDSUUyLjAgeDEgbGFuZSBOVk1FLCBhbmQganVz dCA0IDIuMUdoeiBBNzIgY29yZS4KPj4+Cj4+PiBUaGlzIGlzIGRlZmluaXRlbHkgb3V0IG9mIG15 IGV4cGVjdGF0aW9uLCBJIGRvdWJsZSBjaGVja2VkIHRvIGJlIHN1cmUgCj4+PiB0aGF0IGl0J3Mg cnVubmluZyBpbiBLVk0gbW9kZS4KPj4+Cj4+PiBCdXQgZnVydGhlciBkaWdnaW5nIHNob3dzIHRo YXQsIHNpbmNlIFhhdmllciBBR1ggQ1BVIHN1cHBvcnRzIFZIRSwgCj4+PiBrdm0gaXMgcnVubmlu ZyBpbiBWSEUgbW9kZSBvdGhlciB0aGFuIEhZUCBtb2RlIG9uIENNNC4KPj4+Cj4+PiBJcyB0aGVy ZSBhbnl3YXkgdG8gbWFudWFsbHkgZGlzYWJsZSBWSEUgbW9kZSB0byB0ZXN0IHRoZSBtb3JlIGNv bW1vbiAKPj4+IEhZUCBtb2RlIG9uIFhhdmllcj8KPj4KPj4gQWNjb3JkaW5nIHRvIGtlcm5lbC1w YXJhbWV0ZXJzLnR4dCwgImt2bS1hcm0ubW9kZT1udmhlIiAob3IgaXRzIAo+PiBsb3ctbGV2ZWwg ZXF1aXZhbGVudCAiaWRfYWE2NG1tZnIxLnZoPTAiKSBvbiB0aGUgY29tbWFuZCBsaW5lIHNob3Vs ZCAKPj4gZG8gdGhhdC4KPiAKPiBUaGFua3MgZm9yIHRoaXMgb25lLCBJIHN0dXBpZGx5IG9ubHkg c2VhcmNoZWQgbW9kaW5mbyBvZiBrdm0sIGFuZCBkaWRuJ3QgCj4gZXZlbiBib3RoZXIgdG8gc2Vh cmNoIGFyY2gvYXJtNjQva3ZtLi4uCj4gCj4+Cj4+IEhvd2V2ZXIgSSdkIGltYWdpbmUgdGhlIGRp c2NyZXBhbmN5IGlzIGxpa2VseSB0byBiZSBzb21ldGhpbmcgbW9yZSAKPj4gZnVuZGFtZW50YWwg dG8gdGhlIHdpbGRseSBkaWZmZXJlbnQgbWljcm9hcmNoaXRlY3R1cmVzLiBUaGVyZSdzIAo+PiBj ZXJ0YWlubHkgbm8gaGFybSBpbiBnaXZpbmcgbm9uLVZIRSBhIGdvIGZvciBjb21wYXJpc29uLCBi dXQgSSAKPj4gd291bGRuJ3QgYmUgc3VycHJpc2VkIGlmIGl0IHR1cm5zIG91dCBldmVuIHNsb3dl ci4uLgo+IAo+IFlvdSdyZSB0b3RhbGx5IHJpZ2h0LCB3aXRoIG52aGUgbW9kZSwgaXQncyBzdGls bCB0aGUgc2FtZSBzbG93IHNwZWVkLgo+IAo+IEJUVywgd2hhdCBkaWQgeW91IG1lYW4gYnkgdGhl ICJ3aWxkbHkgZGlmZmVyZW50IG1pY3JvYXJjaCI/Cj4gSXMgQVJNdjguMiBhcmNoIHRoYXQgZGlm ZmVyZW50IGZyb20gQVJNdjggb2YgUlBJND8KCkkgZG9uJ3QgbWVhbiBBcm12OC54IGFyY2hpdGVj dHVyYWwgZmVhdHVyZXMsIEkgbWVhbiB0aGUgYWN0dWFsIAppbXBsZW1lbnRhdGlvbiBvZiBOVklE SUEncyBDYXJtZWwgY29yZSBpcyB2ZXJ5LCB2ZXJ5IGRpZmZlcmVudCBmcm9tIApDb3J0ZXgtQTcy IG9yIGluZGVlZCBvdXIgbmV3ZXIgdjguMiBDb3J0ZXgtQSBkZXNpZ25zLgoKPiBBbmQgYW55IGV4 dHJhIG1ldGhvZHMgSSBjb3VsZCB0cnkgdG8gZXhwbG9yZSB0aGUgcmVhc29uIG9mIHRoZSBzbG93 bmVzcz8KCkkgZ3Vlc3MgdGhlIGZpcnN0IGNoZWNrIHdvdWxkIGJlIHdoZXRoZXIgeW91J3JlIHRy YXBwaW5nIGFuZCBleGl0aW5nIHRoZSAKVk0gc2lnbmlmaWNhbnRseSBtb3JlLiBJIGJlbGlldmUg dGhlcmUgYXJlIHN0YXRzIHNvbWV3aGVyZSwgYnV0IEkgZG9uJ3QgCmtub3cgZXhhY3RseSB3aGVy ZSwgc29ycnkgLSBJIGtub3cgdmVyeSBsaXR0bGUgYWJvdXQgYWN0dWFsbHkgKnVzaW5nKiBLVk0g OikKCklmIGl0J3Mgbm90IHRoYXQsIHRoZW4gaXQgbWlnaHQganVzdCBiZSB0aGF0IEVESzIgaXMg ZG9pbmcgYSBsb3Qgb2YgCmNhY2hlIG1haW50ZW5hbmNlIG9yIHN5c3RlbSByZWdpc3RlciBtb2Rp ZmljYXRpb24gb3Igc29tZSBvdGhlciAKb3BlcmF0aW9uIHRoYXQgaGFwcGVucyB0byBiZSBzbG93 ZXIgb24gQ2FybWVsIGNvbXBhcmVkIHRvIENvcnRleC1BNzIuCgpSb2Jpbi4KCj4gQXQgbGVhc3Qg UlBJIENNNCBpcyBiZXlvbmQgbXkgZXhwZWN0YXRpb24gYW5kIGlzIHdvcmtpbmcgcHJldHR5IGZp bmUuCj4gCj4gVGhhbmtzLAo+IFF1Cj4gCj4+Cj4+IFJvYmluLgo+Pgo+Pj4gQlRXLCB0aGlzIGlz IHRoZSBkbWVzZyByZWxhdGVkIHRvIEtWTSBvbiBYYXZpZXIsIHJ1bm5pbmcgdjUuMTMgCj4+PiB1 cHN0cmVhbSBrZXJuZWwsIHdpdGggNjRLIHBhZ2Ugc2l6ZToKPj4+IFvCoMKgwqAgMC44NTIzNTdd IGt2bSBbMV06IElQQSBTaXplIExpbWl0OiA0MCBiaXRzCj4+PiBbwqDCoMKgIDAuODU3Mzc4XSBr dm0gWzFdOiB2Z2ljIGludGVycnVwdCBJUlE5Cj4+PiBbwqDCoMKgIDAuODYyMTIyXSBrdm06IHBt dSBldmVudCBjcmVhdGlvbiBmYWlsZWQgLTIKPj4+IFvCoMKgwqAgMC44NjY3MzRdIGt2bSBbMV06 IFZIRSBtb2RlIGluaXRpYWxpemVkIHN1Y2Nlc3NmdWxseQo+Pj4KPj4+IFdoaWxlIG9uIENNNCwg dGhlIGhvc3QgcnVucyB2NS4xMi4xMCB1cHN0cmVhbSBrZXJuZWwgKHdpdGggZG93bnN0cmVhbSAK Pj4+IGR0YiksIHdpdGggNEsgcGFnZSBzaXplOgo+Pj4gW8KgwqDCoCAxLjI3NjgxOF0ga3ZtIFsx XTogSVBBIFNpemUgTGltaXQ6IDQ0IGJpdHMKPj4+IFvCoMKgwqAgMS4yNzg0MjVdIGt2bSBbMV06 IHZnaWMgaW50ZXJydXB0IElSUTkKPj4+IFvCoMKgwqAgMS4yNzg2MjBdIGt2bSBbMV06IEh5cCBt b2RlIGluaXRpYWxpemVkIHN1Y2Nlc3NmdWxseQo+Pj4KPj4+IENvdWxkIGl0IGJlIHRoZSBQQUdF IHNpemUgY2F1c2luZyBwcm9ibGVtPwo+Pj4KPj4+IFRoYW5rcywKPj4+IFF1Cj4+Pgo+Pj4KPj4+ IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4+PiBsaW51 eC1hcm0ta2VybmVsIG1haWxpbmcgbGlzdAo+Pj4gbGludXgtYXJtLWtlcm5lbEBsaXN0cy5pbmZy YWRlYWQub3JnCj4+PiBodHRwOi8vbGlzdHMuaW5mcmFkZWFkLm9yZy9tYWlsbWFuL2xpc3RpbmZv L2xpbnV4LWFybS1rZXJuZWwKPj4KPiAKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX18Ka3ZtYXJtIG1haWxpbmcgbGlzdAprdm1hcm1AbGlzdHMuY3MuY29sdW1i aWEuZWR1Cmh0dHBzOi8vbGlzdHMuY3MuY29sdW1iaWEuZWR1L21haWxtYW4vbGlzdGluZm8va3Zt YXJtCg== From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.0 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4A38AC47E48 for ; Thu, 15 Jul 2021 10:03:04 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 119DF610F9 for ; Thu, 15 Jul 2021 10:03:04 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 119DF610F9 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=arm.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:Content-Type: Content-Transfer-Encoding:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:Date:Message-ID:From: References:To:Subject:Reply-To:Cc:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=4fJlow2uWRcZ0Q2gR6RMY7kwMpEpwO5nYX0m1ka/un8=; b=oiZereWdzCQnXhW7+2QBJi1H/+ jIki262kgC+3RGL0wmkiQ7GGE/X1k8cpa8uOccqvLBzuVCn1s+iuXHDSa/I+rFK/e6/yJhPYtbnPU zFcZFJG/Du/ZJ2h6VuGKOf7lbNsItscQ+heJhR62LHO/U7ghU7X+xk8CnJHAvblJC96GXtwXphqq8 0aq8YyTk6IHCbCuEiLSJYl/uTLfNwtDNjqbKLrD7okrtD5S9mVpCUbNbfTlqrAqQAGMspojUUliP+ RGu5vNe5iJBQkwlo3MRpwxQTG8vwLAk4Bh2uQZr5QzVB8UqATqCbAOFsTNn3dHlaa0lxHBz5nszXL jKBI/N4Q==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1m3yAo-000NoM-2a; Thu, 15 Jul 2021 10:00:54 +0000 Received: from foss.arm.com ([217.140.110.172]) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1m3yAk-000Nni-Ir for linux-arm-kernel@lists.infradead.org; Thu, 15 Jul 2021 10:00:52 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id CB15431B; Thu, 15 Jul 2021 03:00:48 -0700 (PDT) Received: from [10.57.36.240] (unknown [10.57.36.240]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 1FAED3F694; Thu, 15 Jul 2021 03:00:48 -0700 (PDT) Subject: Re: Any way to disable KVM VHE extension? To: Qu Wenruo , kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, Linux ARM References: <37f873cf-1b39-ea7f-a5e7-6feb0200dd4c@suse.com> <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> From: Robin Murphy Message-ID: <6331dfe5-a028-4a71-6cc1-479003a58f47@arm.com> Date: Thu, 15 Jul 2021 11:00:42 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> Content-Language: en-GB X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210715_030050_759683_122857E4 X-CRM114-Status: GOOD ( 26.39 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org T24gMjAyMS0wNy0xNSAxMDo0NCwgUXUgV2VucnVvIHdyb3RlOgo+IAo+IAo+IE9uIDIwMjEvNy8x NSDkuIvljYg1OjI4LCBSb2JpbiBNdXJwaHkgd3JvdGU6Cj4+IE9uIDIwMjEtMDctMTUgMDk6NTUs IFF1IFdlbnJ1byB3cm90ZToKPj4+IEhpLAo+Pj4KPj4+IFJlY2VudGx5IEknbSBwbGF5aW5nIGFy b3VuZCB0aGUgTnZpZGlhIFhhdmllciBBR1ggYm9hcmQsIHdoaWNoIGhhcyAKPj4+IFZIRSBleHRl bnNpb24gc3VwcG9ydC4KPj4+Cj4+PiBJbiB0aGVvcnksIGNvbnNpZGVyaW5nIHRoZSBDUFUgYW5k IG1lbW9yeSwgaXQgc2hvdWxkIGJlIHByZXR0eSAKPj4+IHBvd2VyZnVsIGNvbXBhcmVkIHRvIGJv YXJkcyBsaWtlIFJQSSBDTTQuCj4+Pgo+Pj4gQnV0IHRvIG15IHN1cnByaXNlLCBLVk0gcnVucyBw cmV0dHkgcG9vciBvbiBYYXZpZXIuCj4+Pgo+Pj4gSnVzdCBib290aW5nIHRoZSBlZGsyIGZpcm13 YXJlIGNvdWxkIHRha2Ugb3ZlciAxMHMsIGFuZCAyMHMgdG8gZnVsbHkgCj4+PiBib290IHRoZSBr ZXJuZWwuCj4+PiBFdmVuIG15IFZNIG9uIFJQSSBDTTQgaGFzIHdheSBmYXN0ZXIgYm9vdCB0aW1l LCBldmVuIGp1c3QgcnVubmluZyBvbiAKPj4+IFBDSUUyLjAgeDEgbGFuZSBOVk1FLCBhbmQganVz dCA0IDIuMUdoeiBBNzIgY29yZS4KPj4+Cj4+PiBUaGlzIGlzIGRlZmluaXRlbHkgb3V0IG9mIG15 IGV4cGVjdGF0aW9uLCBJIGRvdWJsZSBjaGVja2VkIHRvIGJlIHN1cmUgCj4+PiB0aGF0IGl0J3Mg cnVubmluZyBpbiBLVk0gbW9kZS4KPj4+Cj4+PiBCdXQgZnVydGhlciBkaWdnaW5nIHNob3dzIHRo YXQsIHNpbmNlIFhhdmllciBBR1ggQ1BVIHN1cHBvcnRzIFZIRSwgCj4+PiBrdm0gaXMgcnVubmlu ZyBpbiBWSEUgbW9kZSBvdGhlciB0aGFuIEhZUCBtb2RlIG9uIENNNC4KPj4+Cj4+PiBJcyB0aGVy ZSBhbnl3YXkgdG8gbWFudWFsbHkgZGlzYWJsZSBWSEUgbW9kZSB0byB0ZXN0IHRoZSBtb3JlIGNv bW1vbiAKPj4+IEhZUCBtb2RlIG9uIFhhdmllcj8KPj4KPj4gQWNjb3JkaW5nIHRvIGtlcm5lbC1w YXJhbWV0ZXJzLnR4dCwgImt2bS1hcm0ubW9kZT1udmhlIiAob3IgaXRzIAo+PiBsb3ctbGV2ZWwg ZXF1aXZhbGVudCAiaWRfYWE2NG1tZnIxLnZoPTAiKSBvbiB0aGUgY29tbWFuZCBsaW5lIHNob3Vs ZCAKPj4gZG8gdGhhdC4KPiAKPiBUaGFua3MgZm9yIHRoaXMgb25lLCBJIHN0dXBpZGx5IG9ubHkg c2VhcmNoZWQgbW9kaW5mbyBvZiBrdm0sIGFuZCBkaWRuJ3QgCj4gZXZlbiBib3RoZXIgdG8gc2Vh cmNoIGFyY2gvYXJtNjQva3ZtLi4uCj4gCj4+Cj4+IEhvd2V2ZXIgSSdkIGltYWdpbmUgdGhlIGRp c2NyZXBhbmN5IGlzIGxpa2VseSB0byBiZSBzb21ldGhpbmcgbW9yZSAKPj4gZnVuZGFtZW50YWwg dG8gdGhlIHdpbGRseSBkaWZmZXJlbnQgbWljcm9hcmNoaXRlY3R1cmVzLiBUaGVyZSdzIAo+PiBj ZXJ0YWlubHkgbm8gaGFybSBpbiBnaXZpbmcgbm9uLVZIRSBhIGdvIGZvciBjb21wYXJpc29uLCBi dXQgSSAKPj4gd291bGRuJ3QgYmUgc3VycHJpc2VkIGlmIGl0IHR1cm5zIG91dCBldmVuIHNsb3dl ci4uLgo+IAo+IFlvdSdyZSB0b3RhbGx5IHJpZ2h0LCB3aXRoIG52aGUgbW9kZSwgaXQncyBzdGls bCB0aGUgc2FtZSBzbG93IHNwZWVkLgo+IAo+IEJUVywgd2hhdCBkaWQgeW91IG1lYW4gYnkgdGhl ICJ3aWxkbHkgZGlmZmVyZW50IG1pY3JvYXJjaCI/Cj4gSXMgQVJNdjguMiBhcmNoIHRoYXQgZGlm ZmVyZW50IGZyb20gQVJNdjggb2YgUlBJND8KCkkgZG9uJ3QgbWVhbiBBcm12OC54IGFyY2hpdGVj dHVyYWwgZmVhdHVyZXMsIEkgbWVhbiB0aGUgYWN0dWFsIAppbXBsZW1lbnRhdGlvbiBvZiBOVklE SUEncyBDYXJtZWwgY29yZSBpcyB2ZXJ5LCB2ZXJ5IGRpZmZlcmVudCBmcm9tIApDb3J0ZXgtQTcy IG9yIGluZGVlZCBvdXIgbmV3ZXIgdjguMiBDb3J0ZXgtQSBkZXNpZ25zLgoKPiBBbmQgYW55IGV4 dHJhIG1ldGhvZHMgSSBjb3VsZCB0cnkgdG8gZXhwbG9yZSB0aGUgcmVhc29uIG9mIHRoZSBzbG93 bmVzcz8KCkkgZ3Vlc3MgdGhlIGZpcnN0IGNoZWNrIHdvdWxkIGJlIHdoZXRoZXIgeW91J3JlIHRy YXBwaW5nIGFuZCBleGl0aW5nIHRoZSAKVk0gc2lnbmlmaWNhbnRseSBtb3JlLiBJIGJlbGlldmUg dGhlcmUgYXJlIHN0YXRzIHNvbWV3aGVyZSwgYnV0IEkgZG9uJ3QgCmtub3cgZXhhY3RseSB3aGVy ZSwgc29ycnkgLSBJIGtub3cgdmVyeSBsaXR0bGUgYWJvdXQgYWN0dWFsbHkgKnVzaW5nKiBLVk0g OikKCklmIGl0J3Mgbm90IHRoYXQsIHRoZW4gaXQgbWlnaHQganVzdCBiZSB0aGF0IEVESzIgaXMg ZG9pbmcgYSBsb3Qgb2YgCmNhY2hlIG1haW50ZW5hbmNlIG9yIHN5c3RlbSByZWdpc3RlciBtb2Rp ZmljYXRpb24gb3Igc29tZSBvdGhlciAKb3BlcmF0aW9uIHRoYXQgaGFwcGVucyB0byBiZSBzbG93 ZXIgb24gQ2FybWVsIGNvbXBhcmVkIHRvIENvcnRleC1BNzIuCgpSb2Jpbi4KCj4gQXQgbGVhc3Qg UlBJIENNNCBpcyBiZXlvbmQgbXkgZXhwZWN0YXRpb24gYW5kIGlzIHdvcmtpbmcgcHJldHR5IGZp bmUuCj4gCj4gVGhhbmtzLAo+IFF1Cj4gCj4+Cj4+IFJvYmluLgo+Pgo+Pj4gQlRXLCB0aGlzIGlz IHRoZSBkbWVzZyByZWxhdGVkIHRvIEtWTSBvbiBYYXZpZXIsIHJ1bm5pbmcgdjUuMTMgCj4+PiB1 cHN0cmVhbSBrZXJuZWwsIHdpdGggNjRLIHBhZ2Ugc2l6ZToKPj4+IFvCoMKgwqAgMC44NTIzNTdd IGt2bSBbMV06IElQQSBTaXplIExpbWl0OiA0MCBiaXRzCj4+PiBbwqDCoMKgIDAuODU3Mzc4XSBr dm0gWzFdOiB2Z2ljIGludGVycnVwdCBJUlE5Cj4+PiBbwqDCoMKgIDAuODYyMTIyXSBrdm06IHBt dSBldmVudCBjcmVhdGlvbiBmYWlsZWQgLTIKPj4+IFvCoMKgwqAgMC44NjY3MzRdIGt2bSBbMV06 IFZIRSBtb2RlIGluaXRpYWxpemVkIHN1Y2Nlc3NmdWxseQo+Pj4KPj4+IFdoaWxlIG9uIENNNCwg dGhlIGhvc3QgcnVucyB2NS4xMi4xMCB1cHN0cmVhbSBrZXJuZWwgKHdpdGggZG93bnN0cmVhbSAK Pj4+IGR0YiksIHdpdGggNEsgcGFnZSBzaXplOgo+Pj4gW8KgwqDCoCAxLjI3NjgxOF0ga3ZtIFsx XTogSVBBIFNpemUgTGltaXQ6IDQ0IGJpdHMKPj4+IFvCoMKgwqAgMS4yNzg0MjVdIGt2bSBbMV06 IHZnaWMgaW50ZXJydXB0IElSUTkKPj4+IFvCoMKgwqAgMS4yNzg2MjBdIGt2bSBbMV06IEh5cCBt b2RlIGluaXRpYWxpemVkIHN1Y2Nlc3NmdWxseQo+Pj4KPj4+IENvdWxkIGl0IGJlIHRoZSBQQUdF IHNpemUgY2F1c2luZyBwcm9ibGVtPwo+Pj4KPj4+IFRoYW5rcywKPj4+IFF1Cj4+Pgo+Pj4KPj4+ IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4+PiBsaW51 eC1hcm0ta2VybmVsIG1haWxpbmcgbGlzdAo+Pj4gbGludXgtYXJtLWtlcm5lbEBsaXN0cy5pbmZy YWRlYWQub3JnCj4+PiBodHRwOi8vbGlzdHMuaW5mcmFkZWFkLm9yZy9tYWlsbWFuL2xpc3RpbmZv L2xpbnV4LWFybS1rZXJuZWwKPj4KPiAKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fCmxpbnV4LWFybS1rZXJuZWwgbWFpbGluZyBsaXN0CmxpbnV4LWFybS1r ZXJuZWxAbGlzdHMuaW5mcmFkZWFkLm9yZwpodHRwOi8vbGlzdHMuaW5mcmFkZWFkLm9yZy9tYWls bWFuL2xpc3RpbmZvL2xpbnV4LWFybS1rZXJuZWwK