All of lore.kernel.org
 help / color / mirror / Atom feed
From: Vlastimil Babka <vbabka@suse.cz>
To: Christoph Lameter <cl@linux.com>, Michal Hocko <mhocko@kernel.org>
Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	cgroups@vger.kernel.org, Li Zefan <lizefan@huawei.com>,
	Mel Gorman <mgorman@techsingularity.net>,
	David Rientjes <rientjes@google.com>,
	Hugh Dickins <hughd@google.com>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Anshuman Khandual <khandual@linux.vnet.ibm.com>,
	"Kirill A. Shutemov" <kirill.shutemov@linux.intel.com>,
	linux-api@vger.kernel.org
Subject: Re: [RFC 1/6] mm, page_alloc: fix more premature OOM due to race with cpuset update
Date: Thu, 18 May 2017 12:03:50 +0200	[thread overview]
Message-ID: <8889d67a-adab-91e1-c320-d8bd88d7e1e0@suse.cz> (raw)
In-Reply-To: <alpine.DEB.2.20.1705170943090.8714@east.gentwo.org>

On 05/17/2017 04:48 PM, Christoph Lameter wrote:
> On Wed, 17 May 2017, Michal Hocko wrote:
> 
>>>> So how are you going to distinguish VM_FAULT_OOM from an empty mempolicy
>>>> case in a raceless way?
>>>
>>> You dont have to do that if you do not create an empty mempolicy in the
>>> first place. The current kernel code avoids that by first allowing access
>>> to the new set of nodes and removing the old ones from the set when done.
>>
>> which is racy and as Vlastimil pointed out. If we simply fail such an
>> allocation the failure will go up the call chain until we hit the OOM
>> killer due to VM_FAULT_OOM. How would you want to handle that?
> 
> The race is where? If you expand the node set during the move of the
> application then you are safe in terms of the legacy apps that did not
> include static bindings.

No, that expand/shrink by itself doesn't work against parallel
get_page_from_freelist going through a zonelist. Moving from node 0 to
1, with zonelist containing nodes 1 and 0 in that order:

- mempolicy mask is 0
- zonelist iteration checks node 1, it's not allowed, skip
- mempolicy mask is 0,1 (expand)
- mempolicy mask is 1 (shrink)
- zonelist iteration checks node 0, it's not allowed, skip
- OOM

WARNING: multiple messages have this Message-ID (diff)
From: Vlastimil Babka <vbabka@suse.cz>
To: Christoph Lameter <cl@linux.com>, Michal Hocko <mhocko@kernel.org>
Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	cgroups@vger.kernel.org, Li Zefan <lizefan@huawei.com>,
	Mel Gorman <mgorman@techsingularity.net>,
	David Rientjes <rientjes@google.com>,
	Hugh Dickins <hughd@google.com>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Anshuman Khandual <khandual@linux.vnet.ibm.com>,
	"Kirill A. Shutemov" <kirill.shutemov@linux.intel.com>,
	linux-api@vger.kernel.org
Subject: Re: [RFC 1/6] mm, page_alloc: fix more premature OOM due to race with cpuset update
Date: Thu, 18 May 2017 12:03:50 +0200	[thread overview]
Message-ID: <8889d67a-adab-91e1-c320-d8bd88d7e1e0@suse.cz> (raw)
In-Reply-To: <alpine.DEB.2.20.1705170943090.8714@east.gentwo.org>

On 05/17/2017 04:48 PM, Christoph Lameter wrote:
> On Wed, 17 May 2017, Michal Hocko wrote:
> 
>>>> So how are you going to distinguish VM_FAULT_OOM from an empty mempolicy
>>>> case in a raceless way?
>>>
>>> You dont have to do that if you do not create an empty mempolicy in the
>>> first place. The current kernel code avoids that by first allowing access
>>> to the new set of nodes and removing the old ones from the set when done.
>>
>> which is racy and as Vlastimil pointed out. If we simply fail such an
>> allocation the failure will go up the call chain until we hit the OOM
>> killer due to VM_FAULT_OOM. How would you want to handle that?
> 
> The race is where? If you expand the node set during the move of the
> application then you are safe in terms of the legacy apps that did not
> include static bindings.

No, that expand/shrink by itself doesn't work against parallel
get_page_from_freelist going through a zonelist. Moving from node 0 to
1, with zonelist containing nodes 1 and 0 in that order:

- mempolicy mask is 0
- zonelist iteration checks node 1, it's not allowed, skip
- mempolicy mask is 0,1 (expand)
- mempolicy mask is 1 (shrink)
- zonelist iteration checks node 0, it's not allowed, skip
- OOM

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  parent reply	other threads:[~2017-05-18 10:04 UTC|newest]

Thread overview: 91+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-04-11 14:06 [RFC 0/6] cpuset/mempolicies related fixes and cleanups Vlastimil Babka
2017-04-11 14:06 ` Vlastimil Babka
2017-04-11 14:06 ` [RFC 1/6] mm, page_alloc: fix more premature OOM due to race with cpuset update Vlastimil Babka
2017-04-11 14:06   ` Vlastimil Babka
2017-04-11 17:24   ` Christoph Lameter
2017-04-11 17:24     ` Christoph Lameter
2017-04-11 19:00     ` Vlastimil Babka
2017-04-11 19:00       ` Vlastimil Babka
2017-04-11 19:00       ` Vlastimil Babka
2017-04-12 21:25       ` Christoph Lameter
2017-04-12 21:25         ` Christoph Lameter
2017-04-13  6:24         ` Vlastimil Babka
2017-04-13  6:24           ` Vlastimil Babka
2017-04-13  6:24           ` Vlastimil Babka
2017-04-14 20:37           ` Christoph Lameter
2017-04-14 20:37             ` Christoph Lameter
2017-04-26  8:07             ` Vlastimil Babka
2017-04-26  8:07               ` Vlastimil Babka
2017-04-30 21:33               ` Christoph Lameter
2017-04-30 21:33                 ` Christoph Lameter
2017-05-17  9:20                 ` Michal Hocko
2017-05-17  9:20                   ` Michal Hocko
2017-05-17  9:20                   ` Michal Hocko
2017-05-17 13:56                   ` Christoph Lameter
2017-05-17 13:56                     ` Christoph Lameter
2017-05-17 13:56                     ` Christoph Lameter
2017-05-17 14:05                     ` Michal Hocko
2017-05-17 14:05                       ` Michal Hocko
2017-05-17 14:05                       ` Michal Hocko
2017-05-17 14:48                       ` Christoph Lameter
2017-05-17 14:48                         ` Christoph Lameter
2017-05-17 14:56                         ` Michal Hocko
2017-05-17 14:56                           ` Michal Hocko
2017-05-17 14:56                           ` Michal Hocko
2017-05-17 15:25                           ` Christoph Lameter
2017-05-17 15:25                             ` Christoph Lameter
2017-05-18  9:08                             ` Michal Hocko
2017-05-18  9:08                               ` Michal Hocko
2017-05-18  9:08                               ` Michal Hocko
2017-05-18 16:57                               ` Christoph Lameter
2017-05-18 16:57                                 ` Christoph Lameter
2017-05-18 16:57                                 ` Christoph Lameter
2017-05-18 17:24                                 ` Michal Hocko
2017-05-18 17:24                                   ` Michal Hocko
2017-05-18 17:24                                   ` Michal Hocko
2017-05-18 19:07                                   ` Christoph Lameter
2017-05-18 19:07                                     ` Christoph Lameter
2017-05-18 19:07                                     ` Christoph Lameter
2017-05-19  7:37                                     ` Michal Hocko
2017-05-19  7:37                                       ` Michal Hocko
2017-05-17 15:27                           ` Christoph Lameter
2017-05-17 15:27                             ` Christoph Lameter
2017-05-18 10:03                         ` Vlastimil Babka [this message]
2017-05-18 10:03                           ` Vlastimil Babka
2017-05-18 17:07                           ` Christoph Lameter
2017-05-18 17:07                             ` Christoph Lameter
2017-05-19 11:27                             ` Vlastimil Babka
2017-05-19 11:27                               ` Vlastimil Babka
2017-04-13  5:42   ` Anshuman Khandual
2017-04-13  5:42     ` Anshuman Khandual
2017-04-13  6:06     ` Vlastimil Babka
2017-04-13  6:06       ` Vlastimil Babka
2017-04-13  6:07       ` Vlastimil Babka
2017-04-13  6:07         ` Vlastimil Babka
2017-04-11 14:06 ` [RFC 2/6] mm, mempolicy: stop adjusting current->il_next in mpol_rebind_nodemask() Vlastimil Babka
2017-04-11 14:06   ` Vlastimil Babka
2017-04-11 17:32   ` Christoph Lameter
2017-04-11 17:32     ` Christoph Lameter
2017-04-11 19:03     ` Vlastimil Babka
2017-04-11 19:03       ` Vlastimil Babka
2017-04-11 19:03       ` Vlastimil Babka
2017-04-12  8:49       ` Vlastimil Babka
2017-04-12  8:49         ` Vlastimil Babka
2017-04-12 21:16         ` Christoph Lameter
2017-04-12 21:16           ` Christoph Lameter
2017-04-12 21:16           ` Christoph Lameter
2017-04-12 21:18           ` Vlastimil Babka
2017-04-12 21:18             ` Vlastimil Babka
2017-04-11 14:06 ` [RFC 3/6] mm, page_alloc: pass preferred nid instead of zonelist to allocator Vlastimil Babka
2017-04-11 14:06   ` Vlastimil Babka
2017-04-11 14:06 ` [RFC 4/6] mm, mempolicy: simplify rebinding mempolicies when updating cpusets Vlastimil Babka
2017-04-11 14:06   ` Vlastimil Babka
2017-04-11 14:06 ` [RFC 5/6] mm, cpuset: always use seqlock when changing task's nodemask Vlastimil Babka
2017-04-11 14:06   ` Vlastimil Babka
2017-04-12  8:10   ` Hillf Danton
2017-04-12  8:10     ` Hillf Danton
2017-04-12  8:18     ` Vlastimil Babka
2017-04-12  8:18       ` Vlastimil Babka
2017-04-12  8:18       ` Vlastimil Babka
2017-04-11 14:06 ` [RFC 6/6] mm, mempolicy: don't check cpuset seqlock where it doesn't matter Vlastimil Babka
2017-04-11 14:06   ` Vlastimil Babka

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=8889d67a-adab-91e1-c320-d8bd88d7e1e0@suse.cz \
    --to=vbabka@suse.cz \
    --cc=aarcange@redhat.com \
    --cc=cgroups@vger.kernel.org \
    --cc=cl@linux.com \
    --cc=hughd@google.com \
    --cc=khandual@linux.vnet.ibm.com \
    --cc=kirill.shutemov@linux.intel.com \
    --cc=linux-api@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=lizefan@huawei.com \
    --cc=mgorman@techsingularity.net \
    --cc=mhocko@kernel.org \
    --cc=rientjes@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.