From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753354AbbCZPXz (ORCPT ); Thu, 26 Mar 2015 11:23:55 -0400 Received: from gum.cmpxchg.org ([85.214.110.215]:51161 "EHLO gum.cmpxchg.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753044AbbCZPXu (ORCPT ); Thu, 26 Mar 2015 11:23:50 -0400 Date: Thu, 26 Mar 2015 11:23:43 -0400 From: Johannes Weiner To: Michal Hocko Cc: Tetsuo Handa , linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, torvalds@linux-foundation.org, akpm@linux-foundation.org, ying.huang@intel.com, aarcange@redhat.com, david@fromorbit.com, tytso@mit.edu Subject: Re: [patch 08/12] mm: page_alloc: wait for OOM killer progress before retrying Message-ID: <20150326152343.GE23973@cmpxchg.org> References: <1427264236-17249-1-git-send-email-hannes@cmpxchg.org> <1427264236-17249-9-git-send-email-hannes@cmpxchg.org> <201503252315.FBJ09847.FSOtOJQFOMLFVH@I-love.SAKURA.ne.jp> <20150326112445.GC18560@cmpxchg.org> <20150326143223.GM15257@dhcp22.suse.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20150326143223.GM15257@dhcp22.suse.cz> Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Mar 26, 2015 at 03:32:23PM +0100, Michal Hocko wrote: > On Thu 26-03-15 07:24:45, Johannes Weiner wrote: > > On Wed, Mar 25, 2015 at 11:15:48PM +0900, Tetsuo Handa wrote: > > > Johannes Weiner wrote: > [...] > > > > /* > > > > - * Acquire the oom lock. If that fails, somebody else is > > > > - * making progress for us. > > > > + * This allocating task can become the OOM victim itself at > > > > + * any point before acquiring the lock. In that case, exit > > > > + * quickly and don't block on the lock held by another task > > > > + * waiting for us to exit. > > > > */ > > > > - if (!mutex_trylock(&oom_lock)) { > > > > - *did_some_progress = 1; > > > > - schedule_timeout_uninterruptible(1); > > > > - return NULL; > > > > + if (test_thread_flag(TIF_MEMDIE) || mutex_lock_killable(&oom_lock)) { > > > > + alloc_flags |= ALLOC_NO_WATERMARKS; > > > > + goto alloc; > > > > } > > > > > > When a thread group has 1000 threads and most of them are doing memory allocation > > > request, all of them will get fatal_signal_pending() == true when one of them are > > > chosen by OOM killer. > > > This code will allow most of them to access memory reserves, won't it? > > > > Ah, good point! Only TIF_MEMDIE should get reserve access, not just > > any dying thread. Thanks, I'll fix it in v2. > > Do you plan to post this v2 here for review? Yeah, I was going to wait for feedback to settle before updating the code. But I was thinking something like this? diff --git a/mm/page_alloc.c b/mm/page_alloc.c index 9ce9c4c083a0..106793a75461 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -2344,7 +2344,8 @@ __alloc_pages_may_oom(gfp_t gfp_mask, unsigned int order, int alloc_flags, * waiting for us to exit. */ if (test_thread_flag(TIF_MEMDIE) || mutex_lock_killable(&oom_lock)) { - alloc_flags |= ALLOC_NO_WATERMARKS; + if (test_thread_flag(TIF_MEMDIE)) + alloc_flags |= ALLOC_NO_WATERMARKS; goto alloc; } From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wg0-f49.google.com (mail-wg0-f49.google.com [74.125.82.49]) by kanga.kvack.org (Postfix) with ESMTP id AB3626B0071 for ; Thu, 26 Mar 2015 11:23:49 -0400 (EDT) Received: by wgdm6 with SMTP id m6so68342809wgd.2 for ; Thu, 26 Mar 2015 08:23:49 -0700 (PDT) Received: from gum.cmpxchg.org (gum.cmpxchg.org. [85.214.110.215]) by mx.google.com with ESMTPS id m4si3461474wia.75.2015.03.26.08.23.47 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 26 Mar 2015 08:23:48 -0700 (PDT) Date: Thu, 26 Mar 2015 11:23:43 -0400 From: Johannes Weiner Subject: Re: [patch 08/12] mm: page_alloc: wait for OOM killer progress before retrying Message-ID: <20150326152343.GE23973@cmpxchg.org> References: <1427264236-17249-1-git-send-email-hannes@cmpxchg.org> <1427264236-17249-9-git-send-email-hannes@cmpxchg.org> <201503252315.FBJ09847.FSOtOJQFOMLFVH@I-love.SAKURA.ne.jp> <20150326112445.GC18560@cmpxchg.org> <20150326143223.GM15257@dhcp22.suse.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20150326143223.GM15257@dhcp22.suse.cz> Sender: owner-linux-mm@kvack.org List-ID: To: Michal Hocko Cc: Tetsuo Handa , linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, torvalds@linux-foundation.org, akpm@linux-foundation.org, ying.huang@intel.com, aarcange@redhat.com, david@fromorbit.com, tytso@mit.edu On Thu, Mar 26, 2015 at 03:32:23PM +0100, Michal Hocko wrote: > On Thu 26-03-15 07:24:45, Johannes Weiner wrote: > > On Wed, Mar 25, 2015 at 11:15:48PM +0900, Tetsuo Handa wrote: > > > Johannes Weiner wrote: > [...] > > > > /* > > > > - * Acquire the oom lock. If that fails, somebody else is > > > > - * making progress for us. > > > > + * This allocating task can become the OOM victim itself at > > > > + * any point before acquiring the lock. In that case, exit > > > > + * quickly and don't block on the lock held by another task > > > > + * waiting for us to exit. > > > > */ > > > > - if (!mutex_trylock(&oom_lock)) { > > > > - *did_some_progress = 1; > > > > - schedule_timeout_uninterruptible(1); > > > > - return NULL; > > > > + if (test_thread_flag(TIF_MEMDIE) || mutex_lock_killable(&oom_lock)) { > > > > + alloc_flags |= ALLOC_NO_WATERMARKS; > > > > + goto alloc; > > > > } > > > > > > When a thread group has 1000 threads and most of them are doing memory allocation > > > request, all of them will get fatal_signal_pending() == true when one of them are > > > chosen by OOM killer. > > > This code will allow most of them to access memory reserves, won't it? > > > > Ah, good point! Only TIF_MEMDIE should get reserve access, not just > > any dying thread. Thanks, I'll fix it in v2. > > Do you plan to post this v2 here for review? Yeah, I was going to wait for feedback to settle before updating the code. But I was thinking something like this? diff --git a/mm/page_alloc.c b/mm/page_alloc.c index 9ce9c4c083a0..106793a75461 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -2344,7 +2344,8 @@ __alloc_pages_may_oom(gfp_t gfp_mask, unsigned int order, int alloc_flags, * waiting for us to exit. */ if (test_thread_flag(TIF_MEMDIE) || mutex_lock_killable(&oom_lock)) { - alloc_flags |= ALLOC_NO_WATERMARKS; + if (test_thread_flag(TIF_MEMDIE)) + alloc_flags |= ALLOC_NO_WATERMARKS; goto alloc; } -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org