From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.0 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4D12EC3A5A2 for ; Fri, 23 Aug 2019 08:48:32 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 1E35A22CEC for ; Fri, 23 Aug 2019 08:48:32 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="P6eKagAL" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2393053AbfHWIsa (ORCPT ); Fri, 23 Aug 2019 04:48:30 -0400 Received: from bombadil.infradead.org ([198.137.202.133]:55256 "EHLO bombadil.infradead.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1732418AbfHWIsa (ORCPT ); Fri, 23 Aug 2019 04:48:30 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20170209; h=In-Reply-To:Content-Transfer-Encoding :Content-Type:MIME-Version:References:Message-ID:Subject:To:From:Date:Sender: Reply-To:Cc:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=7s9/nci+zKyvrE92H9Lp/Liq0lrM5HNKhcwL7sRJw+4=; b=P6eKagALn8nMspRlT5ktoTdyRi EJMa61U6Y0iSY8RaLjdPRr77ly3h6vUScMsTZrWkUBrBqE3vXFEvaoagy2NMYcOpOJHcslrk5VKn2 2nroaMZss/Rv2u5Qaqh9AWTDRg0zOg4sqb3QW4/JUaO1luNcGy8Yt345WcvQIpkHW5/NBWKLbpfwW nsdaqhbiKoEyLRU4OzJeYFwB8Udi0RSzefldCm1Fhc/tVL9iYpB2NCqtJjhHL3Pi939WHS/qV1XN9 2lCLbOBIjA9+feGg4R8SM6OQa6s8WpBgzTEydowrpjEApaqiiLp6b/5ELAhy9r3SIMP+RjfnF9XaV UbGf8VRQ==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=noisy.programming.kicks-ass.net) by bombadil.infradead.org with esmtpsa (Exim 4.92 #3 (Red Hat Linux)) id 1i15Et-0002rs-2t; Fri, 23 Aug 2019 08:48:07 +0000 Received: from hirez.programming.kicks-ass.net (hirez.programming.kicks-ass.net [192.168.1.225]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by noisy.programming.kicks-ass.net (Postfix) with ESMTPS id B3CE3307764; Fri, 23 Aug 2019 10:47:31 +0200 (CEST) Received: by hirez.programming.kicks-ass.net (Postfix, from userid 1000) id DD53F20A21FCF; Fri, 23 Aug 2019 10:48:03 +0200 (CEST) Date: Fri, 23 Aug 2019 10:48:03 +0200 From: Peter Zijlstra To: LKML , Linux MM , DRI Development , Intel Graphics Development , Jason Gunthorpe , Ingo Molnar , Andrew Morton , Michal Hocko , David Rientjes , Christian =?iso-8859-1?Q?K=F6nig?= , =?iso-8859-1?B?Suly9G1l?= Glisse , Masahiro Yamada , Wei Wang , Andy Shevchenko , Thomas Gleixner , Jann Horn , Feng Tang , Kees Cook , Randy Dunlap , Daniel Vetter Subject: Re: [PATCH 3/4] kernel.h: Add non_block_start/end() Message-ID: <20190823084803.GD2369@hirez.programming.kicks-ass.net> References: <20190820081902.24815-1-daniel.vetter@ffwll.ch> <20190820081902.24815-4-daniel.vetter@ffwll.ch> <20190820202440.GH11147@phenom.ffwll.local> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20190820202440.GH11147@phenom.ffwll.local> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Aug 20, 2019 at 10:24:40PM +0200, Daniel Vetter wrote: > On Tue, Aug 20, 2019 at 10:19:01AM +0200, Daniel Vetter wrote: > > In some special cases we must not block, but there's not a > > spinlock, preempt-off, irqs-off or similar critical section already > > that arms the might_sleep() debug checks. Add a non_block_start/end() > > pair to annotate these. > > > > This will be used in the oom paths of mmu-notifiers, where blocking is > > not allowed to make sure there's forward progress. Quoting Michal: > > > > "The notifier is called from quite a restricted context - oom_reaper - > > which shouldn't depend on any locks or sleepable conditionals. The code > > should be swift as well but we mostly do care about it to make a forward > > progress. Checking for sleepable context is the best thing we could come > > up with that would describe these demands at least partially." > > > > Peter also asked whether we want to catch spinlocks on top, but Michal > > said those are less of a problem because spinlocks can't have an > > indirect dependency upon the page allocator and hence close the loop > > with the oom reaper. > > > > Suggested by Michal Hocko. > > > > v2: > > - Improve commit message (Michal) > > - Also check in schedule, not just might_sleep (Peter) > > > > v3: It works better when I actually squash in the fixup I had lying > > around :-/ > > > > v4: Pick the suggestion from Andrew Morton to give non_block_start/end > > some good kerneldoc comments. I added that other blocking calls like > > wait_event pose similar issues, since that's the other example we > > discussed. > > > > Cc: Jason Gunthorpe > > Cc: Peter Zijlstra > > Cc: Ingo Molnar > > Cc: Andrew Morton > > Cc: Michal Hocko > > Cc: David Rientjes > > Cc: "Christian König" > > Cc: Daniel Vetter > > Cc: "Jérôme Glisse" > > Cc: linux-mm@kvack.org > > Cc: Masahiro Yamada > > Cc: Wei Wang > > Cc: Andy Shevchenko > > Cc: Thomas Gleixner > > Cc: Jann Horn > > Cc: Feng Tang > > Cc: Kees Cook > > Cc: Randy Dunlap > > Cc: linux-kernel@vger.kernel.org > > Acked-by: Christian König (v1) > > Signed-off-by: Daniel Vetter > > Hi Peter, > > Iirc you've been involved at least somewhat in discussing this. -mm folks > are a bit undecided whether these new non_block semantics are a good idea. > Michal Hocko still is in support, but Andrew Morton and Jason Gunthorpe > are less enthusiastic. Jason said he's ok with merging the hmm side of > this if scheduler folks ack. If not, then I'll respin with the > preempt_disable/enable instead like in v1. > > So ack/nack for this from the scheduler side? Right, I had memories of seeing this before, and I just found a fairly long discussion on this elsewhere in the vacation inbox (*groan*). Yeah, this is something I can live with, Acked-by: Peter Zijlstra (Intel) From mboxrd@z Thu Jan 1 00:00:00 1970 From: Peter Zijlstra Subject: Re: [PATCH 3/4] kernel.h: Add non_block_start/end() Date: Fri, 23 Aug 2019 10:48:03 +0200 Message-ID: <20190823084803.GD2369@hirez.programming.kicks-ass.net> References: <20190820081902.24815-1-daniel.vetter@ffwll.ch> <20190820081902.24815-4-daniel.vetter@ffwll.ch> <20190820202440.GH11147@phenom.ffwll.local> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: Content-Disposition: inline In-Reply-To: <20190820202440.GH11147@phenom.ffwll.local> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: intel-gfx-bounces@lists.freedesktop.org Sender: "Intel-gfx" To: LKML , Linux MM , DRI Development , Intel Graphics Development , Jason Gunthorpe , Ingo Molnar , Andrew Morton , Michal Hocko , David Rientjes , Christian =?iso-8859-1?Q?K=F6nig?= , =?iso-8859-1?B?Suly9G1l?= Glisse , Masahiro Yamada , Wei Wang , Andy Shevchenko , Thomas Gleixner , Jann Horn , Feng Tang , Kees Cook , Randy Dunlap , Daniel Vetter List-Id: dri-devel@lists.freedesktop.org T24gVHVlLCBBdWcgMjAsIDIwMTkgYXQgMTA6MjQ6NDBQTSArMDIwMCwgRGFuaWVsIFZldHRlciB3 cm90ZToKPiBPbiBUdWUsIEF1ZyAyMCwgMjAxOSBhdCAxMDoxOTowMUFNICswMjAwLCBEYW5pZWwg VmV0dGVyIHdyb3RlOgo+ID4gSW4gc29tZSBzcGVjaWFsIGNhc2VzIHdlIG11c3Qgbm90IGJsb2Nr LCBidXQgdGhlcmUncyBub3QgYQo+ID4gc3BpbmxvY2ssIHByZWVtcHQtb2ZmLCBpcnFzLW9mZiBv ciBzaW1pbGFyIGNyaXRpY2FsIHNlY3Rpb24gYWxyZWFkeQo+ID4gdGhhdCBhcm1zIHRoZSBtaWdo dF9zbGVlcCgpIGRlYnVnIGNoZWNrcy4gQWRkIGEgbm9uX2Jsb2NrX3N0YXJ0L2VuZCgpCj4gPiBw YWlyIHRvIGFubm90YXRlIHRoZXNlLgo+ID4gCj4gPiBUaGlzIHdpbGwgYmUgdXNlZCBpbiB0aGUg b29tIHBhdGhzIG9mIG1tdS1ub3RpZmllcnMsIHdoZXJlIGJsb2NraW5nIGlzCj4gPiBub3QgYWxs b3dlZCB0byBtYWtlIHN1cmUgdGhlcmUncyBmb3J3YXJkIHByb2dyZXNzLiBRdW90aW5nIE1pY2hh bDoKPiA+IAo+ID4gIlRoZSBub3RpZmllciBpcyBjYWxsZWQgZnJvbSBxdWl0ZSBhIHJlc3RyaWN0 ZWQgY29udGV4dCAtIG9vbV9yZWFwZXIgLQo+ID4gd2hpY2ggc2hvdWxkbid0IGRlcGVuZCBvbiBh bnkgbG9ja3Mgb3Igc2xlZXBhYmxlIGNvbmRpdGlvbmFscy4gVGhlIGNvZGUKPiA+IHNob3VsZCBi ZSBzd2lmdCBhcyB3ZWxsIGJ1dCB3ZSBtb3N0bHkgZG8gY2FyZSBhYm91dCBpdCB0byBtYWtlIGEg Zm9yd2FyZAo+ID4gcHJvZ3Jlc3MuIENoZWNraW5nIGZvciBzbGVlcGFibGUgY29udGV4dCBpcyB0 aGUgYmVzdCB0aGluZyB3ZSBjb3VsZCBjb21lCj4gPiB1cCB3aXRoIHRoYXQgd291bGQgZGVzY3Jp YmUgdGhlc2UgZGVtYW5kcyBhdCBsZWFzdCBwYXJ0aWFsbHkuIgo+ID4gCj4gPiBQZXRlciBhbHNv IGFza2VkIHdoZXRoZXIgd2Ugd2FudCB0byBjYXRjaCBzcGlubG9ja3Mgb24gdG9wLCBidXQgTWlj aGFsCj4gPiBzYWlkIHRob3NlIGFyZSBsZXNzIG9mIGEgcHJvYmxlbSBiZWNhdXNlIHNwaW5sb2Nr cyBjYW4ndCBoYXZlIGFuCj4gPiBpbmRpcmVjdCBkZXBlbmRlbmN5IHVwb24gdGhlIHBhZ2UgYWxs b2NhdG9yIGFuZCBoZW5jZSBjbG9zZSB0aGUgbG9vcAo+ID4gd2l0aCB0aGUgb29tIHJlYXBlci4K PiA+IAo+ID4gU3VnZ2VzdGVkIGJ5IE1pY2hhbCBIb2Nrby4KPiA+IAo+ID4gdjI6Cj4gPiAtIElt cHJvdmUgY29tbWl0IG1lc3NhZ2UgKE1pY2hhbCkKPiA+IC0gQWxzbyBjaGVjayBpbiBzY2hlZHVs ZSwgbm90IGp1c3QgbWlnaHRfc2xlZXAgKFBldGVyKQo+ID4gCj4gPiB2MzogSXQgd29ya3MgYmV0 dGVyIHdoZW4gSSBhY3R1YWxseSBzcXVhc2ggaW4gdGhlIGZpeHVwIEkgaGFkIGx5aW5nCj4gPiBh cm91bmQgOi0vCj4gPiAKPiA+IHY0OiBQaWNrIHRoZSBzdWdnZXN0aW9uIGZyb20gQW5kcmV3IE1v cnRvbiB0byBnaXZlIG5vbl9ibG9ja19zdGFydC9lbmQKPiA+IHNvbWUgZ29vZCBrZXJuZWxkb2Mg Y29tbWVudHMuIEkgYWRkZWQgdGhhdCBvdGhlciBibG9ja2luZyBjYWxscyBsaWtlCj4gPiB3YWl0 X2V2ZW50IHBvc2Ugc2ltaWxhciBpc3N1ZXMsIHNpbmNlIHRoYXQncyB0aGUgb3RoZXIgZXhhbXBs ZSB3ZQo+ID4gZGlzY3Vzc2VkLgo+ID4gCj4gPiBDYzogSmFzb24gR3VudGhvcnBlIDxqZ2dAemll cGUuY2E+Cj4gPiBDYzogUGV0ZXIgWmlqbHN0cmEgPHBldGVyekBpbmZyYWRlYWQub3JnPgo+ID4g Q2M6IEluZ28gTW9sbmFyIDxtaW5nb0ByZWRoYXQuY29tPgo+ID4gQ2M6IEFuZHJldyBNb3J0b24g PGFrcG1AbGludXgtZm91bmRhdGlvbi5vcmc+Cj4gPiBDYzogTWljaGFsIEhvY2tvIDxtaG9ja29A c3VzZS5jb20+Cj4gPiBDYzogRGF2aWQgUmllbnRqZXMgPHJpZW50amVzQGdvb2dsZS5jb20+Cj4g PiBDYzogIkNocmlzdGlhbiBLw7ZuaWciIDxjaHJpc3RpYW4ua29lbmlnQGFtZC5jb20+Cj4gPiBD YzogRGFuaWVsIFZldHRlciA8ZGFuaWVsLnZldHRlckBmZndsbC5jaD4KPiA+IENjOiAiSsOpcsO0 bWUgR2xpc3NlIiA8amdsaXNzZUByZWRoYXQuY29tPgo+ID4gQ2M6IGxpbnV4LW1tQGt2YWNrLm9y Zwo+ID4gQ2M6IE1hc2FoaXJvIFlhbWFkYSA8eWFtYWRhLm1hc2FoaXJvQHNvY2lvbmV4dC5jb20+ Cj4gPiBDYzogV2VpIFdhbmcgPHd2d0Bnb29nbGUuY29tPgo+ID4gQ2M6IEFuZHkgU2hldmNoZW5r byA8YW5kcml5LnNoZXZjaGVua29AbGludXguaW50ZWwuY29tPgo+ID4gQ2M6IFRob21hcyBHbGVp eG5lciA8dGdseEBsaW51dHJvbml4LmRlPgo+ID4gQ2M6IEphbm4gSG9ybiA8amFubmhAZ29vZ2xl LmNvbT4KPiA+IENjOiBGZW5nIFRhbmcgPGZlbmcudGFuZ0BpbnRlbC5jb20+Cj4gPiBDYzogS2Vl cyBDb29rIDxrZWVzY29va0BjaHJvbWl1bS5vcmc+Cj4gPiBDYzogUmFuZHkgRHVubGFwIDxyZHVu bGFwQGluZnJhZGVhZC5vcmc+Cj4gPiBDYzogbGludXgta2VybmVsQHZnZXIua2VybmVsLm9yZwo+ ID4gQWNrZWQtYnk6IENocmlzdGlhbiBLw7ZuaWcgPGNocmlzdGlhbi5rb2VuaWdAYW1kLmNvbT4g KHYxKQo+ID4gU2lnbmVkLW9mZi1ieTogRGFuaWVsIFZldHRlciA8ZGFuaWVsLnZldHRlckBpbnRl bC5jb20+Cj4gCj4gSGkgUGV0ZXIsCj4gCj4gSWlyYyB5b3UndmUgYmVlbiBpbnZvbHZlZCBhdCBs ZWFzdCBzb21ld2hhdCBpbiBkaXNjdXNzaW5nIHRoaXMuIC1tbSBmb2xrcwo+IGFyZSBhIGJpdCB1 bmRlY2lkZWQgd2hldGhlciB0aGVzZSBuZXcgbm9uX2Jsb2NrIHNlbWFudGljcyBhcmUgYSBnb29k IGlkZWEuCj4gTWljaGFsIEhvY2tvIHN0aWxsIGlzIGluIHN1cHBvcnQsIGJ1dCBBbmRyZXcgTW9y dG9uIGFuZCBKYXNvbiBHdW50aG9ycGUKPiBhcmUgbGVzcyBlbnRodXNpYXN0aWMuIEphc29uIHNh aWQgaGUncyBvayB3aXRoIG1lcmdpbmcgdGhlIGhtbSBzaWRlIG9mCj4gdGhpcyBpZiBzY2hlZHVs ZXIgZm9sa3MgYWNrLiBJZiBub3QsIHRoZW4gSSdsbCByZXNwaW4gd2l0aCB0aGUKPiBwcmVlbXB0 X2Rpc2FibGUvZW5hYmxlIGluc3RlYWQgbGlrZSBpbiB2MS4KPiAKPiBTbyBhY2svbmFjayBmb3Ig dGhpcyBmcm9tIHRoZSBzY2hlZHVsZXIgc2lkZT8KClJpZ2h0LCBJIGhhZCBtZW1vcmllcyBvZiBz ZWVpbmcgdGhpcyBiZWZvcmUsIGFuZCBJIGp1c3QgZm91bmQgYSBmYWlybHkKbG9uZyBkaXNjdXNz aW9uIG9uIHRoaXMgZWxzZXdoZXJlIGluIHRoZSB2YWNhdGlvbiBpbmJveCAoKmdyb2FuKikuCgpZ ZWFoLCB0aGlzIGlzIHNvbWV0aGluZyBJIGNhbiBsaXZlIHdpdGgsCgpBY2tlZC1ieTogUGV0ZXIg WmlqbHN0cmEgKEludGVsKSA8cGV0ZXJ6QGluZnJhZGVhZC5vcmc+Cl9fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCkludGVsLWdmeCBtYWlsaW5nIGxpc3QKSW50 ZWwtZ2Z4QGxpc3RzLmZyZWVkZXNrdG9wLm9yZwpodHRwczovL2xpc3RzLmZyZWVkZXNrdG9wLm9y Zy9tYWlsbWFuL2xpc3RpbmZvL2ludGVsLWdmeA==