From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B1F8FC7EE23 for ; Fri, 26 May 2023 07:56:16 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 7E733900002; Fri, 26 May 2023 03:56:09 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 45D61280001; Fri, 26 May 2023 03:56:09 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 01B0D900002; Fri, 26 May 2023 03:56:08 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id BA616900004 for ; Fri, 26 May 2023 03:56:08 -0400 (EDT) Received: from smtpin04.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 8A1CF1A0DF1 for ; Fri, 26 May 2023 07:56:08 +0000 (UTC) X-FDA: 80831648016.04.0A159C9 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) by imf26.hostedemail.com (Postfix) with ESMTP id 0D7F7140008 for ; Fri, 26 May 2023 07:56:06 +0000 (UTC) Authentication-Results: imf26.hostedemail.com; dkim=pass header.d=infradead.org header.s=bombadil.20210309 header.b=aNld4o2V; spf=none (imf26.hostedemail.com: domain of mcgrof@infradead.org has no SPF policy when checking 198.137.202.133) smtp.mailfrom=mcgrof@infradead.org; dmarc=fail reason="No valid SPF, DKIM not aligned (relaxed)" header.from=kernel.org (policy=none) ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1685087767; a=rsa-sha256; cv=none; b=KOdMPzBeMOfQXAOCZGWoZa0T1aXDrevsfTeyJZAAZw8rY9pboIjd9qX8kZSuIPX7WZC6Zs 4nVQD7OM4rCW6zbD9VZnRe+9FwUwWG7C+V4EKFj4+Vh5txDm7wZV9lfM4lpkpglwyVrOCy cif//QocvrV01yRzx5F72oCAOZXsAIA= ARC-Authentication-Results: i=1; imf26.hostedemail.com; dkim=pass header.d=infradead.org header.s=bombadil.20210309 header.b=aNld4o2V; spf=none (imf26.hostedemail.com: domain of mcgrof@infradead.org has no SPF policy when checking 198.137.202.133) smtp.mailfrom=mcgrof@infradead.org; dmarc=fail reason="No valid SPF, DKIM not aligned (relaxed)" header.from=kernel.org (policy=none) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1685087767; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:references:dkim-signature; bh=5sDzoLLiNk6KHdYH8uCoV/dBsj9Jyf+/G1i59BLdhsE=; b=aThHD+nFLsCj9BOYQr2+a+Z6mqnv5T3fb1Etrk7KWc1SktnwwLg3jZPfWDq95jUqI3RRLq Fl30Tm23cEVZBD5eysBC0NC5yRMlC63OwFFFCCK4jahBWIEiIs4Y2cI0IfYMediZHDZAxI Hj+mRRUsVnOnOJs/u1C4nOotD1qz2KA= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Sender:Content-Transfer-Encoding: MIME-Version:Message-Id:Date:Subject:Cc:To:From:Reply-To:Content-Type: Content-ID:Content-Description:In-Reply-To:References; bh=5sDzoLLiNk6KHdYH8uCoV/dBsj9Jyf+/G1i59BLdhsE=; b=aNld4o2VvRGiQ7vUI5arJSgX/L 6HnGHoys0fJ0NyQtFF23FYlkQQzjBbOG2VhMIvldNEf22GLVMNLTPM709hyKOlQD0gLZxwuctNBgy 5xB+UXzv2lZoitwyBzx9gtzjlhfkbRrUBPE63O6bJwBIPoLlAiT5sqXh83wJrFBVWWsyd0+6vzmLw Zg+CCpzYhsYjajho25CSz1p1EJHOT1tTxSqrc5eVEUGlE72Ih/0P9mhN8JBy4HyPPn6fJ2fJsrvnB 8F5DFRPYRHJ48DzQkK2rZN5deuJkdDWpeanaIbyclKM98/ZFBFaHcLpjk6EO/3caforvAU1V5EiBJ 7SdjKf2Q==; Received: from mcgrof by bombadil.infradead.org with local (Exim 4.96 #2 (Red Hat Linux)) id 1q2SIj-001WZa-2E; Fri, 26 May 2023 07:55:53 +0000 From: Luis Chamberlain To: hughd@google.com, akpm@linux-foundation.org, willy@infradead.org, brauner@kernel.org, djwong@kernel.org Cc: p.raghav@samsung.com, da.gomez@samsung.com, rohan.puri@samsung.com, rpuri.linux@gmail.com, a.manzanares@samsung.com, dave@stgolabs.net, yosryahmed@google.com, keescook@chromium.org, hare@suse.de, kbusch@kernel.org, mcgrof@kernel.org, patches@lists.linux.dev, linux-block@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [RFC v2 0/8] add support for blocksize > PAGE_SIZE Date: Fri, 26 May 2023 00:55:44 -0700 Message-Id: <20230526075552.363524-1-mcgrof@kernel.org> X-Mailer: git-send-email 2.38.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 0D7F7140008 X-Stat-Signature: nhxahij3hs584b5wpnskizk851qs459e X-Rspam-User: X-HE-Tag: 1685087766-886137 X-HE-Meta: U2FsdGVkX1/wCXI2BtDkNJ111sj0d68ODX0Pf3Pc56m+9Vb8G3f6miDfRBCXrhYVj35gIZlKNA4VDXm0w0S/wOmIOnlUB3C+djI4av8SYBtRJ0JemHxFdbKYyffEeSL+hgQ29quMt5v/n4gehwGVfmMhcDOuiqwHSHPO/ZWwBqgz1vRLrSSAWD5U3A+kW9har++X0DqfYfVhtbQWCBCD3fp9UXZCChVOfBYYW4Fk64U85yALDXQ24ZrBKD5jvUqQvMDV+WFECw9BahLNyulqhiWHzXWJax7kCUOPd5R0/OMMmo0kM4eSBkxWqqRB7YMeIgR6cLjBxw+1CtBOt6LO1fDEdIGwZl0Bi9/SvH14xG2aiBkDd1/o6Pa7PS9paM4gGCkzt34X/0OGuFdL0Ov/C2aflxWpGFyCUiYKMEi86PCu0vwHp1sKeSE/vpdPnjfDDvYvdfHb2kxKJUAKk0q+pWuf9GgvlJfMNB9Ywukhcy4py6Znk6sj1ijpP4dam2gmuwXue5TaAdKrolVCIOcqea0Y807zUF/lh9k3C73tY5OJLb2piZ80tqbw5/b7ZFATm/4gjiSoRaBLnv9dw5tU9Oyyp2vBRq8sNeGuOFsqfDt0dHR8Xb8F3McEcQ2F1yJ86s030UUsaGn06IPzdJERUEihriE813WaWDMHsyrMqtuhqE1D/KnN4gpGVndt0YbuABw6rgf5JgrCVwedqg5ml2UsAM4NTmYY4Bpd0V2bWSHtfQp5lxPNsin2F160H8oVfk+2Txy5ITxkpTt8BeOgDeGrWGNU0hYpIMvd0kuSBVIPIOjLbi+E1f4/5oS7d5dcSgh2NCKCn1HKUVUJVl/JLVFO3seCovJuEEhpqv+XxVW6oXMucyO8l2K5v55htQqpe84cy37KPBTUog7umRN7ApllyeMRFKgKpLLPppOkMbvOTohuVjcIzePvC9R3cOnix6K4HdpgzSM1kKUD+pT M7gvcCRa 3AQGOWL9xX3SgO1Fg0CxGG6aTZn0vvkjAyizKke5wgruOl1qiW36sYKULCcCM4el8cY+RMD0ZODoBuB5cOb0s4Mu4PzxW9XF0pbnooRA5W0Po+LrA60w6luR3GgGdxDdZ69JlYAZk+Ocm2CE6l5SzDSiNbMfdfWROhZpf/diTXHttGyooaM997dLBRleuIS7/lei9cRUa0+s6khF091EQUryDeJsYwVAFW+MWa9COVzGM0x2WNEzrkO8+93C3Rm0VYDhdCSAFH751oxD+X3KKLPOsdUQHLPGPOcGjnz5willy+OkZQC2gU2utASVi89+2zBPO1l9gPcc5aaRUtDSGgIZpN1KWDv8fABs8B24SQ8jRnefkTRjT3HrpMmNAnt61A53uFUj5MgalL59WdN4fN6xhZsEU3sM5whd8wPHPEfxyBb4z81j2N3xlKOx0phYsP/Qt3R9geWfM7glSzsgeOM0HeHys8L1JcjwInLjHyPIoOqnnclILPZ9/lgeJb4MGZTB5LJ+cBPwhApxJlXoeCk2eWmELuPvuOGAV X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: This is an initial attempt to add support for block size > PAGE_SIZE for tmpfs. Why would you want this? It helps us experiment with higher order folio uses with fs APIS and helps us test out corner cases which would likely need to be accounted for sooner or later if and when filesystems enable support for this. Better review early and burn early than continue on in the wrong direction so looking for early feedback. I have other patches to convert shmem_file_read_iter() to folios too but that is not yet working. In the swap world the next thing to look at would be to convert swap_cluster_readahead() to folios. As mentioned at LSFMM, if folks want to experiment with anything related to Large Block Sizes (LBS) I've been trying to stash related patches in a tree which tries to carry as many nuggets we have and can collect into a dedicated lage-block tree. Many of this is obviously work in progress so don't try it unless you want to your systems to blow up. But in case you do, you can use my large-block-20230525 branch [0]. Similarly you can also use kdevops with CONFIG_QEMU_ENABLE_EXTRA_DRIVE_LARGEIO support to get everything with just as that branch is used for that: make make bringup make linux Changes on this v2: o the block size has been modified to block order after Matthew Wilcox's suggestion. This truly makes a huge difference in making this code much more easier to read and maintain. o At Pankaj Raghav's suggestion I've put together a helper for poison flags and so this now introduces that as is_folio_hwpoison(). o cleaned up the nits / debug code as pointed out by Matthew Wilcox o clarified the max block size we support is computed by the MAX_ORDER, and for x86_64 this is 8 MiB. o Tested up to 4 MiB block size with a basic test nothing blew up Future work: o shmem_file_read_iter() o extend struct address_space with order and use that instead of our own block order. We may still need to have our own block order, we'll need to see. o swap_cluster_readahead() and friends coverted over to folios o test this well [0] https://git.kernel.org/pub/scm/linux/kernel/git/mcgrof/linux-next.git/log/?h=large-block-20230525 [1] https://github.com/linux-kdevops/kdevops Luis Chamberlain (8): page_flags: add is_folio_hwpoison() shmem: convert to use is_folio_hwpoison() shmem: account for high order folios shmem: add helpers to get block size shmem: account for larger blocks sizes for shmem_default_max_blocks() shmem: consider block size in shmem_default_max_inodes() shmem: add high order page support shmem: add support to customize block size order include/linux/page-flags.h | 7 ++ include/linux/shmem_fs.h | 3 + mm/shmem.c | 139 +++++++++++++++++++++++++++++-------- 3 files changed, 119 insertions(+), 30 deletions(-) -- 2.39.2