From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-14.0 required=3.0 tests=BAYES_00,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 48A60C4338F for ; Sun, 1 Aug 2021 11:21:02 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 2E1DA60200 for ; Sun, 1 Aug 2021 11:21:02 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231776AbhHALU7 (ORCPT ); Sun, 1 Aug 2021 07:20:59 -0400 Received: from mail.kernel.org ([198.145.29.99]:50342 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231461AbhHALU6 (ORCPT ); Sun, 1 Aug 2021 07:20:58 -0400 Received: from disco-boy.misterjones.org (disco-boy.misterjones.org [51.254.78.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 58E40610A6; Sun, 1 Aug 2021 11:20:50 +0000 (UTC) Received: from sofa.misterjones.org ([185.219.108.64] helo=why.misterjones.org) by disco-boy.misterjones.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1mA9WS-002HQ9-A1; Sun, 01 Aug 2021 12:20:48 +0100 Date: Sun, 01 Aug 2021 12:20:47 +0100 Message-ID: <87v94p1kds.wl-maz@kernel.org> From: Marc Zyngier To: Will Deacon Cc: linux-arm-kernel@lists.infradead.org, kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, qperret@google.com, dbrazdil@google.com, Srivatsa Vaddagiri , Shanker R Donthineni , James Morse , Suzuki K Poulose , Alexandru Elisei , kernel-team@android.com Subject: Re: [PATCH 07/16] KVM: arm64: Wire MMIO guard hypercalls In-Reply-To: <20210730131103.GD23756@willie-the-truck> References: <20210715163159.1480168-1-maz@kernel.org> <20210715163159.1480168-8-maz@kernel.org> <20210727181145.GF19173@willie-the-truck> <87v94ud8av.wl-maz@kernel.org> <20210730131103.GD23756@willie-the-truck> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM-LB/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL-LB/10.8 EasyPG/1.0.0 Emacs/27.1 (x86_64-pc-linux-gnu) MULE/6.0 (HANACHIRUSATO) MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: text/plain; charset=US-ASCII X-SA-Exim-Connect-IP: 185.219.108.64 X-SA-Exim-Rcpt-To: will@kernel.org, linux-arm-kernel@lists.infradead.org, kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, qperret@google.com, dbrazdil@google.com, vatsa@codeaurora.org, sdonthineni@nvidia.com, james.morse@arm.com, suzuki.poulose@arm.com, alexandru.elisei@arm.com, kernel-team@android.com X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, 30 Jul 2021 14:11:03 +0100, Will Deacon wrote: > > On Wed, Jul 28, 2021 at 11:47:20AM +0100, Marc Zyngier wrote: > > On Tue, 27 Jul 2021 19:11:46 +0100, > > Will Deacon wrote: > > > > > > On Thu, Jul 15, 2021 at 05:31:50PM +0100, Marc Zyngier wrote: > > > > Plumb in the hypercall interface to allow a guest to discover, > > > > enroll, map and unmap MMIO regions. > > > > > > > > Signed-off-by: Marc Zyngier > > > > --- > > > > arch/arm64/kvm/hypercalls.c | 20 ++++++++++++++++++++ > > > > include/linux/arm-smccc.h | 28 ++++++++++++++++++++++++++++ > > > > 2 files changed, 48 insertions(+) > > > > > > > > diff --git a/arch/arm64/kvm/hypercalls.c b/arch/arm64/kvm/hypercalls.c > > > > index 30da78f72b3b..a3deeb907fdd 100644 > > > > --- a/arch/arm64/kvm/hypercalls.c > > > > +++ b/arch/arm64/kvm/hypercalls.c > > > > @@ -5,6 +5,7 @@ > > > > #include > > > > > > > > #include > > > > +#include > > > > > > > > #include > > > > #include > > > > @@ -129,10 +130,29 @@ int kvm_hvc_call_handler(struct kvm_vcpu *vcpu) > > > > case ARM_SMCCC_VENDOR_HYP_KVM_FEATURES_FUNC_ID: > > > > val[0] = BIT(ARM_SMCCC_KVM_FUNC_FEATURES); > > > > val[0] |= BIT(ARM_SMCCC_KVM_FUNC_PTP); > > > > + val[0] |= BIT(ARM_SMCCC_KVM_FUNC_MMIO_GUARD_INFO); > > > > + val[0] |= BIT(ARM_SMCCC_KVM_FUNC_MMIO_GUARD_ENROLL); > > > > + val[0] |= BIT(ARM_SMCCC_KVM_FUNC_MMIO_GUARD_MAP); > > > > + val[0] |= BIT(ARM_SMCCC_KVM_FUNC_MMIO_GUARD_UNMAP); > > > > break; > > > > case ARM_SMCCC_VENDOR_HYP_KVM_PTP_FUNC_ID: > > > > kvm_ptp_get_time(vcpu, val); > > > > break; > > > > + case ARM_SMCCC_VENDOR_HYP_KVM_MMIO_GUARD_INFO_FUNC_ID: > > > > + val[0] = PAGE_SIZE; > > > > + break; > > > > > > I get the nagging feeling that querying the stage-2 page-size outside of > > > MMIO guard is going to be useful once we start looking at memory sharing, > > > so perhaps rename this to something more generic? > > > > At this stage, why not follow the architecture and simply expose it as > > ID_AA64MMFR0_EL1.TGran{4,64,16}_2? That's exactly what it is for, and > > we already check for this in KVM itself. > > Nice, I hadn't thought of that. On reflection, though, I don't agree that > it's "exactly what it is for" -- the ID register talks about the supported > stage-2 page-sizes, whereas we want to advertise the one page size that > we're currently using. In other words, it's important that we only ever > populate one of the fields and I wonder if that could bite us in future > somehow? Either that, or we expose all the page sizes >= to that of the host (using the fact that larger page sizes are multiples of the base one), and use the guest's page size to work out the granularity. Which is what NV does already. > Up to you, you've definitely got a better feel for this than me. I'll have a look. The "one size" version is dead easy. > > > > > + case ARM_SMCCC_VENDOR_HYP_KVM_MMIO_GUARD_ENROLL_FUNC_ID: > > > > + set_bit(KVM_ARCH_FLAG_MMIO_GUARD, &vcpu->kvm->arch.flags); > > > > + val[0] = SMCCC_RET_SUCCESS; > > > > + break; > > > > + case ARM_SMCCC_VENDOR_HYP_KVM_MMIO_GUARD_MAP_FUNC_ID: > > > > + if (kvm_install_ioguard_page(vcpu, vcpu_get_reg(vcpu, 1))) > > > > + val[0] = SMCCC_RET_SUCCESS; > > > > + break; > > > > + case ARM_SMCCC_VENDOR_HYP_KVM_MMIO_GUARD_UNMAP_FUNC_ID: > > > > + if (kvm_remove_ioguard_page(vcpu, vcpu_get_reg(vcpu, 1))) > > > > + val[0] = SMCCC_RET_SUCCESS; > > > > + break; > > > > > > I think there's a slight discrepancy between MAP and UNMAP here in that > > > calling UNMAP on something that hasn't been mapped will fail, whereas > > > calling MAP on something that's already been mapped will succeed. I think > > > that might mean you can't reason about the final state of the page if two > > > vCPUs race to call these functions in some cases (and both succeed). > > > > I'm not sure that's the expected behaviour for ioremap(), for example > > (you can ioremap two portions of the same page successfully). > > Hmm, good point. Does that mean we should be refcounting the stage-2? > Otherwise if we do something like: > > foo = ioremap(page, 0x100); > bar = ioremap(page+0x100, 0x100); > iounmap(foo); > > then bar will break. Or did I miss something in the series? No, I don't think you have. But I don't think we should implement this refcounting in the hypervisor side. We really should do it guest side. I'll have a look. Thanks, M. -- Without deviation from the norm, progress is not possible.