From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.3 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, NICE_REPLY_A,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0D957C433E7 for ; Mon, 19 Oct 2020 09:09:19 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 923F82225F for ; Mon, 19 Oct 2020 09:09:18 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=suse.com header.i=@suse.com header.b="fe6eBpj6" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 923F82225F Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=suse.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.8677.23239 (Exim 4.92) (envelope-from ) id 1kURA9-0007q1-H8; Mon, 19 Oct 2020 09:09:05 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 8677.23239; Mon, 19 Oct 2020 09:09:05 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kURA9-0007pu-Ds; Mon, 19 Oct 2020 09:09:05 +0000 Received: by outflank-mailman (input) for mailman id 8677; Mon, 19 Oct 2020 09:09:04 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kURA8-0007pe-IU for xen-devel@lists.xenproject.org; Mon, 19 Oct 2020 09:09:04 +0000 Received: from mx2.suse.de (unknown [195.135.220.15]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 8e6ba33b-a0b9-4a3a-b173-5386f6458568; Mon, 19 Oct 2020 09:09:02 +0000 (UTC) Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 7E45EB290; Mon, 19 Oct 2020 09:09:01 +0000 (UTC) Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kURA8-0007pe-IU for xen-devel@lists.xenproject.org; Mon, 19 Oct 2020 09:09:04 +0000 X-Inumbo-ID: 8e6ba33b-a0b9-4a3a-b173-5386f6458568 Received: from mx2.suse.de (unknown [195.135.220.15]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 8e6ba33b-a0b9-4a3a-b173-5386f6458568; Mon, 19 Oct 2020 09:09:02 +0000 (UTC) X-Virus-Scanned: by amavisd-new at test-mx.suse.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1603098541; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ldr9vP5enLyLasdYmjZrwcRMN/AHiax7zlq6K/z5+0k=; b=fe6eBpj6EXE+FDHeLRlspMLdjYW4QogZGp1qr4s/XX8MhgO41iDwu+M139Wvy2bnZ9VvuW TNOGEafp9VCiYZW5tmVXV9SAc3j4Uc2PS9HJyxn18smJfkE3kG6MqI9Pvf1lSI8zY/Asu7 48PqwT+Pm8Lvc5KoyQ8onJVGVcgdshg= Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 7E45EB290; Mon, 19 Oct 2020 09:09:01 +0000 (UTC) Subject: Re: [PATCH] x86/vmx: Revert "x86/VMX: sanitize rIP before re-entering guest" To: Andrew Cooper Cc: Xen-devel , =?UTF-8?Q?Roger_Pau_Monn=c3=a9?= , Wei Liu , Jun Nakajima , Kevin Tian References: <20201009150948.31063-1-andrew.cooper3@citrix.com> <01bb2f27-4e0b-3637-e456-09eb7b9b233e@citrix.com> <1786f728-15c2-3877-c01a-035b11bd8504@suse.com> <82e64d10-50be-68ab-127b-99d205a0a768@citrix.com> From: Jan Beulich Message-ID: <6430fef8-23f1-f4ef-8741-5e089eaa0df9@suse.com> Date: Mon, 19 Oct 2020 11:09:00 +0200 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.12.1 MIME-Version: 1.0 In-Reply-To: <82e64d10-50be-68ab-127b-99d205a0a768@citrix.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit On 16.10.2020 17:38, Andrew Cooper wrote: > On 15/10/2020 09:01, Jan Beulich wrote: >> On 14.10.2020 15:57, Andrew Cooper wrote: >>> On 13/10/2020 16:58, Jan Beulich wrote: >>>> On 09.10.2020 17:09, Andrew Cooper wrote: >>>>> At the time of XSA-170, the x86 instruction emulator really was broken, and >>>>> would allow arbitrary non-canonical values to be loaded into %rip. This was >>>>> fixed after the embargo by c/s 81d3a0b26c1 "x86emul: limit-check branch >>>>> targets". >>>>> >>>>> However, in a demonstration that off-by-one errors really are one of the >>>>> hardest programming issues we face, everyone involved with XSA-170, myself >>>>> included, mistook the statement in the SDM which says: >>>>> >>>>> If the processor supports N < 64 linear-address bits, bits 63:N must be identical >>>>> >>>>> to mean "must be canonical". A real canonical check is bits 63:N-1. >>>>> >>>>> VMEntries really do tolerate a not-quite-canonical %rip, specifically to cater >>>>> to the boundary condition at 0x0000800000000000. >>>>> >>>>> Now that the emulator has been fixed, revert the XSA-170 change to fix >>>>> architectural behaviour at the boundary case. The XTF test case for XSA-170 >>>>> exercises this corner case, and still passes. >>>>> >>>>> Fixes: ffbbfda377 ("x86/VMX: sanitize rIP before re-entering guest") >>>>> Signed-off-by: Andrew Cooper >>>> But why revert the change rather than fix ... >>>> >>>>> @@ -4280,38 +4280,6 @@ void vmx_vmexit_handler(struct cpu_user_regs *regs) >>>>> out: >>>>> if ( nestedhvm_vcpu_in_guestmode(v) ) >>>>> nvmx_idtv_handling(); >>>>> - >>>>> - /* >>>>> - * VM entry will fail (causing the guest to get crashed) if rIP (and >>>>> - * rFLAGS, but we don't have an issue there) doesn't meet certain >>>>> - * criteria. As we must not allow less than fully privileged mode to have >>>>> - * such an effect on the domain, we correct rIP in that case (accepting >>>>> - * this not being architecturally correct behavior, as the injected #GP >>>>> - * fault will then not see the correct [invalid] return address). >>>>> - * And since we know the guest will crash, we crash it right away if it >>>>> - * already is in most privileged mode. >>>>> - */ >>>>> - mode = vmx_guest_x86_mode(v); >>>>> - if ( mode == 8 ? !is_canonical_address(regs->rip) >>>> ... the wrong use of is_canonical_address() here? By reverting >>>> you open up avenues for XSAs in case we get things wrong elsewhere, >>>> including ... >>>> >>>>> - : regs->rip != regs->eip ) >>>> ... for 32-bit guests. >>> Because the only appropriate alternative would be ASSERT_UNREACHABLE() >>> and domain crash. >>> >>> This logic corrupts guest state. >>> >>> Running with corrupt state is every bit an XSA as hitting a VMEntry >>> failure if it can be triggered by userspace, but the latter safer and >>> much more obvious. >> I disagree. For CPL > 0 we don't "corrupt" guest state any more >> than reporting a #GP fault when one is going to be reported >> anyway (as long as the VM entry doesn't fail, and hence the >> guest won't get crashed). IOW this raising of #GP actually is a >> precautionary measure to _avoid_ XSAs. > > It does not remove any XSAs.  It merely hides them. How that? If we convert the ability of guest user mode to crash the guest into deliver of #GP(0), how is there a hidden XSA then? > There are legal states where RIP is 0x0000800000000000 and #GP is the > wrong thing to do.  Any async VMExit (Processor Trace Prefetch in > particular), or with debug traps pending. You realize we're in agreement about this pseudo-canonical check needing fixing? >> Nor do I agree with the "much more obvious" aspect: > > A domain crash is far more likely to be reported to xen-devel/security > than something which bodges state in an almost-silent way. > >> A VM entry >> failure requires quite a bit of analysis to recognize what has >> caused it; whether a non-pseudo-canonical RIP is what catches your >> eye right away is simply unknown. The gprintk() that you delete, >> otoh, says very clearly what we have found to be wrong. > > Non-canonical values are easier to spot than most of the other rules, IMO. Which will get less obvious with 5-level paging capable hardware in mind. >>> It was the appropriate security fix (give or take the functional bug in >>> it) at the time, given the complexity of retrofitting zero length >>> instruction fetches to the emulator. >>> >>> However, it is one of a very long list of guest-state-induced VMEntry >>> failures, with non-trivial logic which we assert will pass, on a >>> fastpath, where hardware also performs the same checks and we already >>> have a runtime safe way of dealing with errors.  (Hence not actually >>> using ASSERT_UNREACHABLE() here.) >> "Runtime safe" as far as Xen is concerned, I take it. This isn't safe >> for the guest at all, as vmx_failed_vmentry() results in an >> unconditional domain_crash(). > > Any VMEntry failure is a bug in Xen.  If userspace can trigger it, it is > an XSA, *irrespective* of whether we crash the domain then and there, or > whether we let it try and limp on with corrupted state. Allowing the guest to continue with corrupted state is not a useful thing to do, I agree. However, what falls under "corrupted" seems to be different for you and me. I'd not call delivery of #GP "corruption" in any way. The primary goal ought to be that we don't corrupt the guest kernel view of the world. It may then have the opportunity to kill the offending user mode process. Jan