From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.2 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E387EC433ED for ; Thu, 29 Apr 2021 00:05:32 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 5215661448 for ; Thu, 29 Apr 2021 00:05:32 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5215661448 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id D2A4B6B006C; Wed, 28 Apr 2021 20:05:31 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id CC7996B006E; Wed, 28 Apr 2021 20:05:31 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B68A46B0070; Wed, 28 Apr 2021 20:05:31 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0244.hostedemail.com [216.40.44.244]) by kanga.kvack.org (Postfix) with ESMTP id 9E1AB6B006C for ; Wed, 28 Apr 2021 20:05:31 -0400 (EDT) Received: from smtpin14.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with ESMTP id 503CF181AEF3F for ; Thu, 29 Apr 2021 00:05:31 +0000 (UTC) X-FDA: 78083460462.14.7242ABD Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by imf21.hostedemail.com (Postfix) with ESMTP id 4B1B4E000122 for ; Thu, 29 Apr 2021 00:05:27 +0000 (UTC) Received: by mail.kernel.org (Postfix) with ESMTPSA id CD77760FEF for ; Thu, 29 Apr 2021 00:05:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1619654729; bh=ZC+xd/7ZmNYK1PhNfcZ+lZ3Q54ZiPxXwCjpfba43YdE=; h=References:In-Reply-To:From:Date:Subject:To:Cc:From; b=BPGUaW9NjOjSklWrJV4EudWx4GiPPpCbrp1sn7n3BcBIzTe3PSt69QWSgqqSHLlFM ZEKeMifrvmPnX4NLPy51VnBjLcC8wEMVEbbQVgGCbfelAKCfzKvbmNAJEh3g8pRWlH 8RetqPpS712RdtUTQ2Nyp/SYVwpEbj+h37ENyJoc4yLPwVlSRTwIG01GQNT7KQYnBN Gwu1BcHjwHOZDxnIDDyinm55tq9b5fdubTd7buB0M9kJvS5Zh7hdyfFr02iLTTT8qV UONB0nGtcVf0qbGNMKzHDeSAj3981TfhYt+m0nw8mNazBSOn1n5T16vthpnHvbRQZU DoqgYmzhokzxQ== Received: by mail-ed1-f52.google.com with SMTP id i24so16811168edy.8 for ; Wed, 28 Apr 2021 17:05:29 -0700 (PDT) X-Gm-Message-State: AOAM531LghsZ4I4u5HHNVsKIrwDrrclzOxhctgAHQAbWKPomC219eQ6T E3hF7IaZFDrelSVqL09Ljpe/1ZX/ddF9zFLPLT+jaw== X-Google-Smtp-Source: ABdhPJxp//vlm9G8en7jFepxpsQZsjbMVNlpknDqIon2nNUjFJgRW5sOhZiVskEANO9YQ4YcgDXg2lRfC5Tpn5A7IIk= X-Received: by 2002:a50:fc91:: with SMTP id f17mr14647157edq.23.1619654728429; Wed, 28 Apr 2021 17:05:28 -0700 (PDT) MIME-Version: 1.0 References: <20210407014502.24091-1-michel@lespinasse.org> <20210407014502.24091-14-michel@lespinasse.org> <20210428145823.GA856@lespinasse.org> <20210428161108.GP975577@paulmck-ThinkPad-P17-Gen-1> <20210429000225.GC10973@lespinasse.org> In-Reply-To: <20210429000225.GC10973@lespinasse.org> From: Andy Lutomirski Date: Wed, 28 Apr 2021 17:05:17 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: [RFC PATCH 13/37] mm: implement speculative handling in __handle_mm_fault(). To: Michel Lespinasse Cc: "Paul E. McKenney" , Andy Lutomirski , Linux-MM , Laurent Dufour , Peter Zijlstra , Michal Hocko , Matthew Wilcox , Rik van Riel , Andrew Morton , Suren Baghdasaryan , Joel Fernandes , Rom Lemarchand , Linux-Kernel Content-Type: text/plain; charset="UTF-8" X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 4B1B4E000122 X-Stat-Signature: mhdhpg1x4cteutygtwxgjzmz4tyeibik Received-SPF: none (kernel.org>: No applicable sender policy available) receiver=imf21; identity=mailfrom; envelope-from=""; helo=mail.kernel.org; client-ip=198.145.29.99 X-HE-DKIM-Result: pass/pass X-HE-Tag: 1619654727-788900 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed, Apr 28, 2021 at 5:02 PM Michel Lespinasse wrote: > > On Wed, Apr 28, 2021 at 09:11:08AM -0700, Paul E. McKenney wrote: > > On Wed, Apr 28, 2021 at 08:13:53AM -0700, Andy Lutomirski wrote: > > > On Wed, Apr 28, 2021 at 8:05 AM Michel Lespinasse wrote: > > > > > > > > On Wed, Apr 07, 2021 at 08:36:01AM -0700, Andy Lutomirski wrote: > > > > > On 4/6/21 6:44 PM, Michel Lespinasse wrote: > > > > > > The page table tree is walked with local irqs disabled, which prevents > > > > > > page table reclamation (similarly to what fast GUP does). The logic is > > > > > > otherwise similar to the non-speculative path, but with additional > > > > > > restrictions: in the speculative path, we do not handle huge pages or > > > > > > wiring new pages tables. > > > > > > > > > > Not on most architectures. Quoting the actual comment in mm/gup.c: > > > > > > > > > > > * Before activating this code, please be aware that the following assumptions > > > > > > * are currently made: > > > > > > * > > > > > > * *) Either MMU_GATHER_RCU_TABLE_FREE is enabled, and tlb_remove_table() is used to > > > > > > * free pages containing page tables or TLB flushing requires IPI broadcast. > > > > > > > > > > On MMU_GATHER_RCU_TABLE_FREE architectures, you cannot make the > > > > > assumption that it is safe to dereference a pointer in a page table just > > > > > because irqs are off. You need RCU protection, too. > > > > > > > > > > You have the same error in the cover letter. > > > > > > > > Hi Andy, > > > > > > > > Thanks for your comment. At first I thought did not matter, because we > > > > only enable ARCH_SUPPORTS_SPECULATIVE_PAGE_FAULT on selected > > > > architectures, and I thought MMU_GATHER_RCU_TABLE_FREE is not set on > > > > these. But I was wrong - MMU_GATHER_RCU_TABLE_FREE is enabled on X86 > > > > with paravirt. So I took another look at fast GUP to make sure I > > > > actually understand it. > > > > > > > > This brings a question about lockless_pages_from_mm() - I see it > > > > disabling interrupts, which it explains is necessary for disabling THP > > > > splitting IPIs, but I do not see it taking an RCU read lock as would > > > > be necessary for preventing paga table freeing on > > > > MMU_GATHER_RCU_TABLE_FREE configs. I figure local_irq_save() > > > > indirectly takes an rcu read lock somehow ? I think this is something > > > > I should also mention in my explanation, and I have not seen a good > > > > description of this on the fast GUP side... > > > > > > Sounds like a bug! That being said, based on my extremely limited > > > understanding of how the common RCU modes work, local_irq_save() > > > probably implies an RCU lock in at least some cases. Hi Paul! > > > > In modern kernels, local_irq_save() does have RCU reader semantics, > > meaning that synchronize_rcu() will wait for pre-exiting irq-disabled > > regions. It will also wait for pre-existing bh-disable, preempt-disable, > > and of course rcu_read_lock() sections of code. > > Thanks Paul for confirming / clarifying this. BTW, it would be good to > add this to the rcu header files, just so people have something to > reference to when they depend on such behavior (like fast GUP > currently does). Or, even better, fast GUP could add an explicit RCU read lock. > > Going back to my patch. I don't need to protect against THP splitting > here, as I'm only handling the small page case. So when > MMU_GATHER_RCU_TABLE_FREE is enabled, I *think* I could get away with > using only an rcu read lock, instead of disabling interrupts which > implicitly creates the rcu read lock. I'm not sure which way to go - > fast GUP always disables interrupts regardless of the > MMU_GATHER_RCU_TABLE_FREE setting, and I think there is a case to be > made for following the fast GUP stes rather than trying to be smarter. How about adding some little helpers: lockless_page_walk_begin(); lockless_page_walk_end(); these turn into RCU read locks if MMU_GATHER_RCU_TABLE_FREE and into irqsave otherwise. And they're somewhat self-documenting. --Andy