From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 75444C4829A for ; Tue, 13 Feb 2024 21:55:50 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 04B068D0017; Tue, 13 Feb 2024 16:55:50 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id F3D658D0012; Tue, 13 Feb 2024 16:55:49 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id DB71B8D0017; Tue, 13 Feb 2024 16:55:49 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id CB08E8D0012 for ; Tue, 13 Feb 2024 16:55:49 -0500 (EST) Received: from smtpin23.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 9EAAB40D72 for ; Tue, 13 Feb 2024 21:55:49 +0000 (UTC) X-FDA: 81788138418.23.72C75FC Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) by imf21.hostedemail.com (Postfix) with ESMTP id 6D9BE1C0011 for ; Tue, 13 Feb 2024 21:55:47 +0000 (UTC) Authentication-Results: imf21.hostedemail.com; dkim=pass header.d=sent.com header.s=fm3 header.b="m r1rlho"; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=Fd2Djm86; dmarc=pass (policy=none) header.from=sent.com; spf=pass (imf21.hostedemail.com: domain of zi.yan@sent.com designates 66.111.4.29 as permitted sender) smtp.mailfrom=zi.yan@sent.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1707861347; h=from:from:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=rKsJORufnnGtyC9mo4arxw/2f9LvMA7u/22qfgccp3c=; b=juv6UCwskr9kwOkYsH4mBzTGrV9GM/xAyvNhtVfk20uyTzszhZiye5tL+xbcHlaaS0e2BY NMWOjGJ7Jj3APNjcZAvDAEaPW3aHUseayqXHkoFWip660IE5KLe+ts7VOKU/YJZ5TVKMHK W12MkrDI8nM871rCGZrbasFkgPgrXOs= ARC-Authentication-Results: i=1; imf21.hostedemail.com; dkim=pass header.d=sent.com header.s=fm3 header.b="m r1rlho"; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=Fd2Djm86; dmarc=pass (policy=none) header.from=sent.com; spf=pass (imf21.hostedemail.com: domain of zi.yan@sent.com designates 66.111.4.29 as permitted sender) smtp.mailfrom=zi.yan@sent.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1707861347; a=rsa-sha256; cv=none; b=HMbeJqc+0BAcGlPVCu6ZQcglUOINWyFnmYgPODG8LhqZj88tC6HWiTuzotLwFPVWmPW8ND YAwl5XJO3S7oZIgLixfJwv0cBEUsOBgeb/n8LUVt8rcz53GbRD8QhZkNy3cQOZB5BVZpkE 1G95Xe6cY9dZCNqdde6gRqgxwaYiSR4= Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id 94E005C00B9; Tue, 13 Feb 2024 16:55:46 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Tue, 13 Feb 2024 16:55:46 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sent.com; h=cc :cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:message-id:mime-version:reply-to :reply-to:subject:subject:to:to; s=fm3; t=1707861346; x= 1707947746; bh=rKsJORufnnGtyC9mo4arxw/2f9LvMA7u/22qfgccp3c=; b=m r1rlhoLr2CPDTqsvidZUK1X1seSyDWNlCrtq5VdswnoSB7r4Dslk2NS5/Ex2154j u4r0ppFXXbbylSIwiVpj1pRT9PExZzo9rIaoFf3G241fWxGuJZ3IY1uKfBpvgWpm eY6O3NgMy0niZoaPwyB2lAFa/OCK0o3hEUGxF5IFQfbBRZXsFmgUeAUDN23/FHRt 2XKa6BuqUlXiZXJRJMw9MeQLVQ9rWoIParVMyzU1YjOXeNY18Q45l+Hh8bJUnqa5 3VUq3BuZ1YkX+H0dwDuJ+vQ+CONJlprI6FfXNXZKoux5Z6evZQU+Pp4Mkgvez/vZ A/rxo3iq07cjOJzf8lsbQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:message-id:mime-version:reply-to:reply-to :subject:subject:to:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; t=1707861346; x=1707947746; bh=r KsJORufnnGtyC9mo4arxw/2f9LvMA7u/22qfgccp3c=; b=Fd2Djm86eNZq4Z3Lw MptTHyTJB/A++7ca2z3/dZltN6Su0fua9dJHFOXn5UTGA0s5zv6Dx8P9bDl5DuSZ enKaCtT43/48VRr9lMbrKXiqDitLlytuhvBltIBLLankuEt/pWb9XFjkxiR3/GM8 KgL4O+LuJ+OPToSsVJctYyrFySFW0UeQwUkZOBbKXlMJqFBtM+psqcA7JkZtg2A8 Iafj/K0R+HeelFUsD6lOWLbC6B0EfVphE9aIBi0J/p33joIg1rFa0bYHEjMmHWFl ZatMuVRFtsDz0UQnXB2HUvRsAyOSqbfKYo1mhC34Grf/YGgzwT8KhA57a5D7b9fS Rzx/A== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrudehgdduheegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufffkofhrgggtgfesthekredtredtjeenucfhrhhomhepkghiucgj rghnuceoiihirdihrghnsehsvghnthdrtghomheqnecuggftrfgrthhtvghrnhepteduve ehteehheeiteeihfejveejledtgfdvieeuiedutefftdevtdfhteevtdffnecuffhomhgr ihhnpehkvghrnhgvlhdrohhrghenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmh epmhgrihhlfhhrohhmpeiiihdrhigrnhesshgvnhhtrdgtohhm X-ME-Proxy: Feedback-ID: iccd040f4:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 13 Feb 2024 16:55:45 -0500 (EST) From: Zi Yan To: "Pankaj Raghav (Samsung)" , linux-mm@kvack.org Cc: Zi Yan , "Matthew Wilcox (Oracle)" , David Hildenbrand , Yang Shi , Yu Zhao , "Kirill A . Shutemov" , Ryan Roberts , =?UTF-8?q?Michal=20Koutn=C3=BD?= , Roman Gushchin , "Zach O'Keefe" , Hugh Dickins , Mcgrof Chamberlain , Andrew Morton , linux-kernel@vger.kernel.org, cgroups@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-kselftest@vger.kernel.org Subject: [PATCH v4 0/7] Split a folio to any lower order folios Date: Tue, 13 Feb 2024 16:55:13 -0500 Message-ID: <20240213215520.1048625-1-zi.yan@sent.com> X-Mailer: git-send-email 2.43.0 Reply-To: Zi Yan MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: 6D9BE1C0011 X-Stat-Signature: 4bc3foi5o47w1464m974qeouxya6e699 X-Rspam-User: X-HE-Tag: 1707861347-990385 X-HE-Meta: U2FsdGVkX183jfCrZEVI7bFQSG/iwZ3nQZah+Ccgu10c0dH9tQ8dJUYLxpJW5V/qO6DtU33EqlfTffOUYdQIHFVPBOg2lrRZ7qOVyNtCmzhxmmAL7fHU3wSmtI9m0Xhmbmtp048gbKA8w0rME38SCiBSCuxign37T4biR8ovt0VHcPMy5P9Xvys98SOJNwb4vpDkkmI00S/knZSe1TFhVvnEAJkVZCAsYoMiQ8CJN2NvGP0pMCOJ4RYIR7yaQFYP1vDviKTsSF3+Niq1nJIoC4rmAucs8p7ZNpMG22eu8cEkb7KlnKtGEKjwyl5Bmf+S1zxpH0Vd/UTwYPZMVHNMYcZXVaCBDtkXVx5P4cxbxjOVtKPsemcKGhwZGOHKB/c6QIksqh3Y1C4dLBOWBJz6ZFv9FJ3LJhDro0cwv/sqigioPp+0r9HyTSNcdwhIpaETyRZJS5NhkjVx7CaoHxcwoyGrhRxC/zWbpuCxNIF8tVkcXP9a8LCjoSrkSe/lL3sZ1Zm9vlzaDzR/YXME/fN0dgtPy4wlrYBbe2PkoiU2uOtVdXD6KJpAewSMV2h2MwHM7FZqdoA0yAs6alXE5HWHgsxMDelu+OqHeGqNql/zEmR6QygIEO3s1IEvdK0eotFL1OxBYBxyv/Z++GDSWLATfq1FXRZT+hEmRVPOe6lm7vMfPfTzjCZKHeYODRVdRY2CsVay2PpO1yyndNqLyVz0chXR8Nbin6U6t2z6m3B02gz3LFMVoyLf5UOR1JhW5tbX3e+kqw79f6gBbg8w5/t5oZ+2jiH9He+5evY6mUrP7Slxz3sxjbkRH2D4BWSgL7dz0wDv/6SkRsUQu2MDXuGHq3zXNaSvpqYId+S9X2u3uZWYaLQkB0uEvD/lLLE5xjALJxSRmhLgAqL/Iw0ud+zCvGgwGTRHP2KXXXEdTTczMbiLPfBPCwLw2HLParKvaGVATjmOl/ge6lZ1pMxVSO/ vkr9UtZp IIINWnozutsqFo9Lp4Xi1bymqgLkMe5Bi01/hN24E7U41TecUIhSahQJmnyrGX18IYnGJ5weptM4hlCw0CbMd7jnmhHOMUtRvrgxmoEPTg46kFU+jFaASSb2L7ElZO8nnLaj8kPnGOpqH2JGzgPJC5JjbCP6SQZ4rIKbcb9ZsGSsPH9SwTg/nwN1UCy4n+mxmH+wwNRRyHTz3FmT/DpYdKs1wy9JpBKvV6cD1r31OxpNV8pDx+TP5KcgwfOzVnm15mXyxD17eGXSUyJfjBkyWlUJ0hsJw7VAh5Ecb8A7PD8hp17gpxrPtmlYdKHS7jqZ6iW8XLctfuS6YGhEL8ilEEymgj2l6UUnncQP4NlF+fL0deU+QroD3wV/QqLSa2zk7sc9bIgHxGc5wiirMGnVKUQJwUrWU3sfYusTvqXmtjhgvQazJfp44wodz/oSeI8ZeFn/0Z9sEdZwlxci6g3KjYMvjPFCsoea9Dkdinwa8RoA5lsjqFMKZ2cVn36FnHLWclsAQ0tD6BuNr01wHSdxR37L3EAZe/RslR/OqW2wM952zprTcM3xbIl49yP+qp/SuQQixRfMzmRRvNo2H2MsG2l8Ggg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Zi Yan Hi all, File folio supports any order and multi-size THP is upstreamed[1], so both file and anonymous folios can be >0 order. Currently, split_huge_page() only splits a huge page to order-0 pages, but splitting to orders higher than 0 is going to better utilize large folios. In addition, Large Block Sizes in XFS support would benefit from it[2]. This patchset adds support for splitting a large folio to any lower order folios and uses it during file folio truncate operations. For Patch 6, Hugh did not like my approach to minimize the number of folios for truncate[3]. I would like to get more feedback, especially from FS people, on it to decide whether to keep it or not. The patchset is on top of mm-everything-2024-02-13-01-26. Changelog === Since v3 --- 1. Excluded shmem folios and pagecache folios without FS support from splitting to any order (per Hugh Dickins). 2. Allowed splitting anonymous large folio to any lower order since multi-size THP is upstreamed. 3. Adapted selftests code to new framework. Since v2 --- 1. Fixed an issue in __split_page_owner() introduced during my rebase Since v1 --- 1. Changed split_page_memcg() and split_page_owner() parameter to use order 2. Used folio_test_pmd_mappable() in place of the equivalent code Details === * Patch 1 changes split_page_memcg() to use order instead of nr_pages * Patch 2 changes split_page_owner() to use order instead of nr_pages * Patch 3 and 4 add new_order parameter split_page_memcg() and split_page_owner() and prepare for upcoming changes. * Patch 5 adds split_huge_page_to_list_to_order() to split a huge page to any lower order. The original split_huge_page_to_list() calls split_huge_page_to_list_to_order() with new_order = 0. * Patch 6 uses split_huge_page_to_list_to_order() in large pagecache folio truncation instead of split the large folio all the way down to order-0. * Patch 7 adds a test API to debugfs and test cases in split_huge_page_test selftests. Comments and/or suggestions are welcome. [1] https://lore.kernel.org/all/20231207161211.2374093-1-ryan.roberts@arm.com/ [2] https://lore.kernel.org/linux-mm/qzbcjn4gcyxla4gwuj6smlnwknz2wvo5wrjctin6eengjfqjei@lzkxv3iy6bol/ [3] https://lore.kernel.org/linux-mm/9dd96da-efa2-5123-20d4-4992136ef3ad@google.com/ Zi Yan (7): mm/memcg: use order instead of nr in split_page_memcg() mm/page_owner: use order instead of nr in split_page_owner() mm: memcg: make memcg huge page split support any order split. mm: page_owner: add support for splitting to any order in split page_owner. mm: thp: split huge page to any lower order pages (except order-1). mm: truncate: split huge page cache page to a non-zero order if possible. mm: huge_memory: enable debugfs to split huge pages to any order. include/linux/huge_mm.h | 21 +- include/linux/memcontrol.h | 4 +- include/linux/page_owner.h | 10 +- mm/huge_memory.c | 149 +++++++++--- mm/memcontrol.c | 10 +- mm/page_alloc.c | 8 +- mm/page_owner.c | 8 +- mm/truncate.c | 21 +- .../selftests/mm/split_huge_page_test.c | 223 +++++++++++++++++- 9 files changed, 382 insertions(+), 72 deletions(-) -- 2.43.0