From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-9.7 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 20830C433E3 for ; Fri, 19 Jun 2020 16:24:24 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id DA47321707 for ; Fri, 19 Jun 2020 16:24:23 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org DA47321707 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 6F7F08D00AD; Fri, 19 Jun 2020 12:24:22 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 6CB728D00CE; Fri, 19 Jun 2020 12:24:22 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5BBDE8D00AD; Fri, 19 Jun 2020 12:24:22 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0087.hostedemail.com [216.40.44.87]) by kanga.kvack.org (Postfix) with ESMTP id 3E3928D00CE for ; Fri, 19 Jun 2020 12:24:22 -0400 (EDT) Received: from smtpin17.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id EE9E36CFD3 for ; Fri, 19 Jun 2020 16:24:21 +0000 (UTC) X-FDA: 76946483922.17.word40_1c1763226e1a Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin17.hostedemail.com (Postfix) with ESMTP id C8514180D018B for ; Fri, 19 Jun 2020 16:24:21 +0000 (UTC) X-HE-Tag: word40_1c1763226e1a X-Filterd-Recvd-Size: 3865 Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by imf32.hostedemail.com (Postfix) with ESMTP for ; Fri, 19 Jun 2020 16:24:20 +0000 (UTC) IronPort-SDR: 7nxDxP10t5HHTvfM/lmAMSpNV5AF2447fas2eUpxIi8lsvNZbStmrbnabhv7wUBLZ8qc4FwO/c lzotKfpXdCAg== X-IronPort-AV: E=McAfee;i="6000,8403,9657"; a="208241113" X-IronPort-AV: E=Sophos;i="5.75,255,1589266800"; d="scan'208";a="208241113" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga007.jf.intel.com ([10.7.209.58]) by orsmga105.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 19 Jun 2020 09:24:17 -0700 IronPort-SDR: JNWg0LBNX4ykFFvtoUFSymlw9R/U9+t3bcuc5c75MGwBysLzJSxwCePzcwZBLyvhS7XmJkyxMs YSo8la/M6djw== X-IronPort-AV: E=Sophos;i="5.75,255,1589266800"; d="scan'208";a="264366406" Received: from sjiang-mobl2.ccr.corp.intel.com (HELO bwidawsk-mobl5.local) ([10.252.131.131]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 19 Jun 2020 09:24:17 -0700 From: Ben Widawsky To: linux-mm Subject: [PATCH 10/18] mm: clean up alloc_pages_vma (thp) Date: Fri, 19 Jun 2020 09:24:06 -0700 Message-Id: <20200619162414.1052234-11-ben.widawsky@intel.com> X-Mailer: git-send-email 2.27.0 In-Reply-To: <20200619162414.1052234-1-ben.widawsky@intel.com> References: <20200619162414.1052234-1-ben.widawsky@intel.com> MIME-Version: 1.0 X-Rspamd-Queue-Id: C8514180D018B X-Spamd-Result: default: False [0.00 / 100.00] X-Rspamd-Server: rspam02 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: __alloc_pages_nodemask() already does the right thing for a preferred node and bind nodemask. Calling it directly allows us to simplify much of this. The handling occurs in prepare_alloc_pages() A VM assertion is added to prove correctness. Cc: Andrew Morton Cc: David Rientjes Cc: Dave Hansen Signed-off-by: Ben Widawsky --- mm/mempolicy.c | 40 +++++++++++++++++++++------------------- 1 file changed, 21 insertions(+), 19 deletions(-) diff --git a/mm/mempolicy.c b/mm/mempolicy.c index 90bc9c93b1b9..408ba78c8424 100644 --- a/mm/mempolicy.c +++ b/mm/mempolicy.c @@ -2293,27 +2293,29 @@ alloc_pages_vma(gfp_t gfp, int order, struct vm_a= rea_struct *vma, hpage_node =3D first_node(pol->v.preferred_nodes); =20 nmask =3D policy_nodemask(gfp, pol); - if (!nmask || node_isset(hpage_node, *nmask)) { - mpol_cond_put(pol); - /* - * First, try to allocate THP only on local node, but - * don't reclaim unnecessarily, just compact. - */ - page =3D __alloc_pages_node(hpage_node, - gfp | __GFP_THISNODE | __GFP_NORETRY, order); + mpol_cond_put(pol); =20 - /* - * If hugepage allocations are configured to always - * synchronous compact or the vma has been madvised - * to prefer hugepage backing, retry allowing remote - * memory with both reclaim and compact as well. - */ - if (!page && (gfp & __GFP_DIRECT_RECLAIM)) - page =3D __alloc_pages_node(hpage_node, - gfp, order); + /* + * First, try to allocate THP only on local node, but + * don't reclaim unnecessarily, just compact. + */ + page =3D __alloc_pages_nodemask(gfp | __GFP_THISNODE | + __GFP_NORETRY, + order, hpage_node, nmask); =20 - goto out; - } + /* + * If hugepage allocations are configured to always synchronous + * compact or the vma has been madvised to prefer hugepage + * backing, retry allowing remote memory with both reclaim and + * compact as well. + */ + if (!page && (gfp & __GFP_DIRECT_RECLAIM)) + page =3D __alloc_pages_nodemask(gfp, order, hpage_node, + nmask); + + VM_BUG_ON(page && nmask && + !node_isset(page_to_nid(page), *nmask)); + goto out; } =20 nmask =3D policy_nodemask(gfp, pol); --=20 2.27.0