From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_PASS,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 198EAECDE44 for ; Mon, 29 Oct 2018 21:04:10 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id C4A0120824 for ; Mon, 29 Oct 2018 21:04:09 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="Tvav4Day" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C4A0120824 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726752AbeJ3Fyb (ORCPT ); Tue, 30 Oct 2018 01:54:31 -0400 Received: from mail-lf1-f65.google.com ([209.85.167.65]:33359 "EHLO mail-lf1-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725932AbeJ3Fyb (ORCPT ); Tue, 30 Oct 2018 01:54:31 -0400 Received: by mail-lf1-f65.google.com with SMTP id i26so2874036lfc.0; Mon, 29 Oct 2018 14:04:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=pJS00Wz78YE4h3jPUSK9vYr329tTOTXAXEgeKZDRc4w=; b=Tvav4DayJoq2yBMiyGQr/vuYcypqQ0XTLNRlJvCJ9IKe6cVEaZRYakBzUFfEG7rV4g Rm4wmkrC4PjvVQ/wWCpHm5IH59fVBTV+Rb5Rx/U1dk/g6IluZLpjjlbcSyd/CrzwlP5o 2tNyiNlwWM9mEBkJc0dIpjc+BuXgr8IoK8h+H3ImD54+8rg/nyfB8JdBfMH0NqOFmKdR KvhYBMKu81R81mVlGm/RSmVFzUsYJjyFJWSEinhWtAzX07yYvY/e24S7hjqbEqrJFJN8 G2kTGX+vlps5onRAlgnLIMglDRZPL/Z0ylsN4BWFOddu3X5fOwBjLPSeUgWK7LKo9Dcm cdHA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=pJS00Wz78YE4h3jPUSK9vYr329tTOTXAXEgeKZDRc4w=; b=smPNihFFgnAf7jVYZBPe80D5C/SWb83aqRXHKzRK5LJWvz5lJ0BDkYhTlGKkqTCp1/ IIFGa8hFMP4oN391oTNbSbrd3Ap8+wmNXhbLbE92cgN/7jgrS7iUcitaSN5xLrFFrdd+ 1/j28MpHYijRZUpOqlNTtg9Zvl19FyfhjmiOJZ/UWNR53b1j+bkDRxzbQRV2bOp68tCZ DIGHKwMQBrNArIyGOG043DybyiYoZBOfqZjQObUAZUwres2cnAdVU0ZUqyuDl6W5UR49 w0FSwQYhRwbnbRXBLPT62hxIybta0POGSXFyLD9QbOdmSn8kTEXEVtHbjXHHkR5MyK4Y xkPw== X-Gm-Message-State: AGRZ1gIyR3kW9H5eGb7RsxFfW4W5R0VOWZIsvI262oyPr0QnGoaBK5Uj k6nPactcXJCmO77op781e6xNEUApvlA= X-Google-Smtp-Source: AJdET5fHyAabfz/bgJTH3xcNVUpIHwWffygQd3s0jS1bdLFDaeuHlkd/30zfk4L0EkToZiI1LayWxA== X-Received: by 2002:a19:6e0b:: with SMTP id j11-v6mr191152lfc.118.1540847044118; Mon, 29 Oct 2018 14:04:04 -0700 (PDT) Received: from ?IPv6:2001:14bb:52:7be:f0bf:dd2d:f008:5213? (dmkd798g-7z2-yccwcp-4.rev.dnainternet.fi. [2001:14bb:52:7be:f0bf:dd2d:f008:5213]) by smtp.gmail.com with ESMTPSA id x16sm534970lff.26.2018.10.29.14.04.02 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 29 Oct 2018 14:04:03 -0700 (PDT) Subject: Re: [PATCH 10/17] prmem: documentation To: Peter Zijlstra , Kees Cook Cc: Mimi Zohar , Matthew Wilcox , Dave Chinner , James Morris , Michal Hocko , Kernel Hardening , linux-integrity , linux-security-module , Igor Stoppa , Dave Hansen , Jonathan Corbet , Laura Abbott , Randy Dunlap , Mike Rapoport , "open list:DOCUMENTATION" , LKML References: <20181023213504.28905-1-igor.stoppa@huawei.com> <20181023213504.28905-11-igor.stoppa@huawei.com> <20181026092609.GB3159@worktop.c.hoisthospitality.com> <20181028183126.GB744@hirez.programming.kicks-ass.net> From: Igor Stoppa Message-ID: <40cd77ce-f234-3213-f3cb-0c3137c5e201@gmail.com> Date: Mon, 29 Oct 2018 23:04:01 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 In-Reply-To: <20181028183126.GB744@hirez.programming.kicks-ass.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 28/10/2018 18:31, Peter Zijlstra wrote: > On Fri, Oct 26, 2018 at 11:46:28AM +0100, Kees Cook wrote: >> On Fri, Oct 26, 2018 at 10:26 AM, Peter Zijlstra wrote: >>> I still don't really understand the whole write-rare thing; how does it >>> really help? If we can write in kernel memory, we can write to >>> page-tables too. > >> One aspect of hardening the kernel against attack is reducing the >> internal attack surface. Not all flaws are created equal, so there is >> variation in what limitations an attacker may have when exploiting >> flaws (not many flaws end up being a fully controlled "write anything, >> anywhere, at any time"). By making the more sensitive data structures >> of the kernel read-only, we reduce the risk of an attacker finding a >> path to manipulating the kernel's behavior in a significant way. >> >> Examples of typical sensitive targets are function pointers, security >> policy, and page tables. Having these "read only at rest" makes them >> much harder to control by an attacker using memory integrity flaws. > > Because 'write-anywhere' exploits are easier than (and the typical first > step to) arbitrary code execution thingies? > >> The "write rarely" name itself may not sufficiently describe what is >> wanted either (I'll take the blame for the inaccurate name), so I'm >> open to new ideas there. The implementation requirements for the >> "sensitive data read-only at rest" feature are rather tricky: >> >> - allow writes only from specific places in the kernel >> - keep those locations inline to avoid making them trivial ROP targets >> - keep the writeability window open only to a single uninterruptable CPU > > The current patch set does not achieve that because it uses a global > address space for the alias mapping (vmap) which is equally accessible > from all CPUs. I never claimed to achieve 100% resilience to attacks. While it's true that the address space is accessible to all the CPUs, it is also true that the access has a limited duration in time, and the location where the access can be performed is not fixed. Iow, assuming that the CPUs not involved in the write-rare operations are compromised and that they are trying to perform a concurrent access to the data in the writable page, they have a limited window of opportunity. Said this, this I have posted is just a tentative implementation. My primary intent was to at least give an idea of what I'd like to do: alter some data in a way that is not easily exploitable. >> - fast enough to deal with page table updates > > The proposed implementation needs page-tables for the alias; I don't see > how you could ever do R/O page-tables when you need page-tables to > modify your page-tables. It's not all-or-nothing. I hope we agree at least on the reasoning that having only a limited amount of address space directly attackable, instead of the whole set of pages containing exploitable data, is reducing the attack surface. Furthermore, if we think about possible limitations that the attack might have (maximum reach), the level of protection might be even higher. I have to use "might" because I cannot foresee the vulnerability. Furthermore, taking a different angle: your average attacker is not necessarily very social and inclined to share the vulnerability found. It is safe to assume that in most cases each attacker has to identify the attack strategy autonomously. Reducing the amount of individual who can perform an attack, by increasing the expertise required is also a way of doing damage control. > And this is entirely irrespective of performance. I have not completely given up on performance, but, being write-rare, I see improved performance as just a way of widening the range of possible recipients for the hardening. >> The proposal I made a while back only covered .data things (and used >> x86-specific features). > > Oh, right, that CR0.WP stuff. > >> Igor's proposal builds on this by including a >> way to do this with dynamic allocation too, which greatly expands the >> scope of structures that can be protected. Given that the x86-only >> method of write-window creation was firmly rejected, this is a new >> proposal for how to do it (vmap window). Using switch_mm() has also >> been suggested, etc. > > Right... /me goes find the patches we did for text_poke. Hmm, those > never seem to have made it: > > https://lkml.kernel.org/r/20180902173224.30606-1-namit@vmware.com > > like that. That approach will in fact work and not be a completely > broken mess like this thing. That approach is x86 specific. I preferred to start with something that would work on a broader set of architectures, even if with less resilience. It can be done so that individual architectures can implement their own specific way and obtain better results. >> We need to find a good way to do the write-windowing that works well >> for static and dynamic structures _and_ for the page tables... this >> continues to be tricky. >> >> Making it resilient against ROP-style targets makes it difficult to >> deal with certain data structures (like list manipulation). In my >> earlier RFC, I tried to provide enough examples of where this could >> get used to let people see some of the complexity[1]. Igor's series >> expands this to even more examples using dynamic allocation. > > Doing 2 CR3 writes for 'every' WR write doesn't seem like it would be > fast enough for much of anything. Part of the reason for the duplication is that, even if the wr_API I came up with, can be collapsed with the regular API, the implementation needs to be different, to be faster. Ex: * force the list_head structure to be aligned so that it will always be fully contained by a single page * create alternate mapping for all the pages involved (max 1 page for each list_head) * do the lsit operation on the remapped list_heads * destroy all the mappings I can try to introduce some wrapper similar to kmap_atomic(), as suggested by Dave Hansen, which can improve the coding, but it will not change the actual set of operations performed. > And I don't suppose we can take the WP fault and then fix up from there, > because if we're doing R/O page-tables, that'll incrase the fault depth > and we'll double fault all the time, and tripple fault where we > currently double fault. And we all know how _awesome_ tripple faults > are. > > But duplicating (and wrapping in gunk) whole APIs is just not going to > work. Would something like kmap_atomic() be acceptable? Do you have some better proposal, now that (I hope) it should be more clear what I'm trying to do and why? -- igor