From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D8480C54E41 for ; Fri, 8 Mar 2024 03:11:52 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 6F9E76B031F; Thu, 7 Mar 2024 22:11:52 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 683196B0321; Thu, 7 Mar 2024 22:11:52 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4D65E6B0322; Thu, 7 Mar 2024 22:11:52 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 3D6416B031F for ; Thu, 7 Mar 2024 22:11:52 -0500 (EST) Received: from smtpin15.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id DAC14A1A9F for ; Fri, 8 Mar 2024 03:11:51 +0000 (UTC) X-FDA: 81872397222.15.BCF5571 Received: from APC01-TYZ-obe.outbound.protection.outlook.com (mail-tyzapc01on2099.outbound.protection.outlook.com [40.107.117.99]) by imf20.hostedemail.com (Postfix) with ESMTP id 4FD3D1C0009 for ; Fri, 8 Mar 2024 03:11:47 +0000 (UTC) Authentication-Results: imf20.hostedemail.com; dkim=pass header.d=oppo.com header.s=selector1 header.b=NdNBfIoG; spf=pass (imf20.hostedemail.com: domain of lipeifeng@oppo.com designates 40.107.117.99 as permitted sender) smtp.mailfrom=lipeifeng@oppo.com; dmarc=pass (policy=quarantine) header.from=oppo.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1709867509; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=V294uW1/6G7dfsCoyKZHi6U5asc8iRhQw7sDVAtY8xc=; b=UGfmNmvXwNavyAXsA+MD7aV9NT/qebU2zMr6APxDxp8P2yUMOdnkh+VTSdEkAXqnNtyuGp hFdWFttGSSZ4pPHyuSFNdHKlwcOel6gp173+8loIRNBakB0clr2Ys1aJ7SmQ5d07GPH5b3 VcITLJ8NYyk2J3O0hj990o3rA2j8zF4= ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1709867509; a=rsa-sha256; cv=pass; b=vLeDaz9a4UgpEM3sEIIjD5pZF+O94DWDgtAsQhu+qFzzNtC7dykIQP0cXf1HREruhs/9C9 Ld7M1Dc8pRcU6rnZGALr9iHvJK8LCyGLZeOnDNryZhIgeayGml6zJf/DXZeblCAba2lCaA h26crro3ZRrM0ULImlTLJ0GJ4hLsZmc= ARC-Authentication-Results: i=2; imf20.hostedemail.com; dkim=pass header.d=oppo.com header.s=selector1 header.b=NdNBfIoG; spf=pass (imf20.hostedemail.com: domain of lipeifeng@oppo.com designates 40.107.117.99 as permitted sender) smtp.mailfrom=lipeifeng@oppo.com; dmarc=pass (policy=quarantine) header.from=oppo.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Mmiqh9g9hMC/zinjsjVvjmg3oMLpaUKHtiAi5M8ctQO+nH81d0VVNVaM8tofnTyblP7Kx5NwsmAwiq8lnMWAdPbXD2xVZAI85KI4tOUXsV13rEJWFbnAMSGFllHqQNZs3Gu5lFl+97yxh+m2bpon8aHT+u3vDi/2lU3PtqfF+xO+CR/WqfZBPUZN3mJuOBzs/IV3AFfM09gLngEM1ZCFr2utdn3b1Vuz+Wyji3n06a8f1EJ2eTU+XwGybwoUvMQeOjxF5lrRc2ogZfrC5ikyL1JTmYaIFOScRijAPHCrftzbrZgft/25Jk7NeENWfZemN9b3rIuiCKK4S1xmRfjsSw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=V294uW1/6G7dfsCoyKZHi6U5asc8iRhQw7sDVAtY8xc=; b=i5GdVCOrmFVuA4uY7We1J1gtpZya9/xumB7NdVFt8gA46Yj8jTrHwK24agACucngXA+tbzGE7ax5t/j4AtNhhOCJnGPheFf0W38uXQbsWLiQA11hMkz+dWdNH+nHu87O0A8J4C53YPCnqodheAetA8TPpH4UuXGRm8E/RaTr/bMu30M/FvJamT687rN2IH5rafqd9MbPp4HsNZ797LsW63podKRjLa/6QlUNlgHovS0XQoA39H/3yCHccRG1RzT4ZdSlG791uF2J8vqN+1V4sYcGq34dUDeoBMcAtnAmRnPUJenv+IvOmpbj4hXFriO5GpUjOSe2nO9/C37kQV5pVA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oppo.com; dmarc=pass action=none header.from=oppo.com; dkim=pass header.d=oppo.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oppo.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=V294uW1/6G7dfsCoyKZHi6U5asc8iRhQw7sDVAtY8xc=; b=NdNBfIoGtEAgLmIznxCOWWPR9/UloD7z3vKTQNQIIVOmT9Vd/igflLLD9Q11lGpoJMP3sGKitZJxr1eojJu2sY027HuC5nW1ENuoPj8PjjZm+7ptJTe40FnaCULqGRj/yWngvnkmzetnqIzX0jS3t60FQICPNe/+NQUW3F585yE= Received: from TYZPR02MB5595.apcprd02.prod.outlook.com (2603:1096:400:1c5::12) by SI2PR02MB5539.apcprd02.prod.outlook.com (2603:1096:4:1a6::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7362.27; Fri, 8 Mar 2024 03:11:40 +0000 Received: from TYZPR02MB5595.apcprd02.prod.outlook.com ([fe80::60d1:4349:510c:8133]) by TYZPR02MB5595.apcprd02.prod.outlook.com ([fe80::60d1:4349:510c:8133%4]) with mapi id 15.20.7339.031; Fri, 8 Mar 2024 03:11:39 +0000 From: lipeifeng@oppo.com To: lipeifeng@oppo.com, 21cnbao@gmail.com, akpm@linux-foundation.org, david@redhat.com, osalvador@suse.de, willy@infradead.org Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH v2 0/2] reclaim contended folios asynchronously instead of promoting them Date: Fri, 8 Mar 2024 11:11:24 +0800 Message-Id: <20240308031126.750-1-lipeifeng@oppo.com> X-Mailer: git-send-email 2.34.1 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-ClientProxiedBy: SG2PR02CA0033.apcprd02.prod.outlook.com (2603:1096:3:18::21) To TYZPR02MB5595.apcprd02.prod.outlook.com (2603:1096:400:1c5::12) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: TYZPR02MB5595:EE_|SI2PR02MB5539:EE_ X-MS-Office365-Filtering-Correlation-Id: 30585782-5ccd-4ae1-fe1e-08dc3f1d78c6 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 3UjvtHsT8S+GYRzPS11G9kiaCT9nj5comT1MkyscogsGM7N7mcXFCZygvIgpQjakbsH7lwjAy8jNwVi6U/ls4IC7d/zn1YosXAhEQRLnvHM6gYYvOBYsnua8zb1qbkbreUWTzfUBtTCmWh9W2vwzmG7NYQ0x9D53WZZaJLOJtObjVuBij1G4BrYhaCwm9KlPs5/wwZy6MO79hr2WotcA63HiQthe0p6uqq+9MKpStfuRPF7Pt6bXy7jWOVqTaCzwb6rvbP++8swDKNIM9k3isfdAfNtio7aIkNt2bSipGm+AxBgW24p8Ks4WZ/0MxMrtMLm5FnZWRNJGhLdolUB0qmGyU+GE7EELg8czl7XKFyEHQBzLMVTrsIa1ZxtaQrGx4ON3LFb6BmADjBJQeoG4Zl5sBmzGZQeGPbFI6daszQLjAlNw2WOwR9VigrD9AlRU+/hqpzrJPQGnqtldpClt1WHaq/Igsq6vrtpYO+Mh/KEF9O96ogNWAmop4XctPe/qjMmiZo27t6fYnvovcBmrxuYC7OvlVo198MUGGiNXrWWlIaEUfmywg/Ts38xaUKnW0GJPkxgkaYh0NaUexB8x/raJQFjCTHGQwh6JuN24GvpVRgjTF4suuPbVyogj/l6H/3ok16dn7uKvuxUsd9MSzhgOGSbqmaJiFFmUe9H0N8I= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:TYZPR02MB5595.apcprd02.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(52116005)(1800799015)(376005)(38350700005);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?AH6xDrpjglh28BZWi+6maovjJ/rcVefmjpyhip0f848At64wczbZh1mk+JyO?= =?us-ascii?Q?z61cm81APJHAX55cbbSfUq2+f43Iy+kEYOTeF8fSqsxZ4R5bDiSryJzwjEO8?= =?us-ascii?Q?GbJpbNDj/8gVLm5LCgo1tPcaHphTayXdzvOv4IfN8OCUQ2DKhVPVKErxOT23?= =?us-ascii?Q?nXR/Tqk+Dxe+y9OawDC1q2KwnB2hrC8sfO7q9TNKB1m2n94s4RoakHYtcxju?= =?us-ascii?Q?2Lph7+Y9HKyYm5Wmh9tYb0aSlzWnM4LKfjyh53WV/aIZ9VJ5L4JVlwClrT24?= =?us-ascii?Q?4Ix7S2WdUd4+znWPSxhc8ohDr9XTuruG+sl/6Wg5JSK5L1+lq/jj9cU1mtdn?= =?us-ascii?Q?yjj0yyRT/Kfx55D9P4fHv65/9NM50WkSJdHWeNZpCZV6sfrJEXFSMiOZsiYy?= =?us-ascii?Q?POL2psDO0oy1io94gyHmEnB9PXlze2XCz05gX357yjIkQdUIn1Y19HlzCcUM?= =?us-ascii?Q?GjgEJhM0OUeL82toOaTsr2juI300xsdZkfoGiJlablQiJHADgIt8JEiKrKGH?= =?us-ascii?Q?DTkHk6yKkYGkLaQFyltt+mADEvT3d3N4GZG8fcAONHKVZdbBdmImhn3HUVc+?= =?us-ascii?Q?G5ZaNhItABqKVYtbN4Gj4AoFpbBmh6mFCAr4n054luTxPAeISbNoNc13RxLY?= =?us-ascii?Q?bwKdUzmlb1eVC3L+BWRLhGkPsC55i2Lm8YuUdeYhmrrzMnQaylCoQwSV/HRb?= =?us-ascii?Q?SF4fxT3jfb8wdxNx/QZ2cdg15LN3i5i4RY78fVRpMKeId9Gr/6lBv9nl2oZ4?= =?us-ascii?Q?04p8uEG4KeLnhAJp3lyXYbkSH2ViwJQz7IsGknC0CwINDanR3S0nFFTmYIzB?= =?us-ascii?Q?mlI4RzIXNjNKQzQrNiXbSm+yLcg1SPaYR6tePabpemggXY3wJXpUZwFX9Hjv?= =?us-ascii?Q?cvP0aw14rvXaovRQJTCMFyTRMIylLvbkOc43J72kg+kF0WmFXvqq2KfPwt67?= =?us-ascii?Q?0oju/wrWb61uPDa0LuzvfvPjRWWlpNF8/IQixhR7Nu3HZKdGTN0uZ7pPQR6W?= =?us-ascii?Q?LUd1oY0TIwHl5yPPpk0Nzis5Qtd7CVi/KdmXZmBuJLIzy19Acc71yvRxxwH2?= =?us-ascii?Q?kPnOhzWHgEMZnbmA3ICv3pXC2PP3cUHDmhPLLEqRiozsZ2Ppb4PmQ+BDUdgk?= =?us-ascii?Q?VvELoTP3Diu2u/L1qc3nGDqCeAXQb2VVSducfb7oZ00D8LPYBn2/y1e10/K5?= =?us-ascii?Q?/nY0FyoRJ6PYNr5WGC3j7mfGUGORs6PF7m+GkiRo75auJgeXk/GU2yAkHI7o?= =?us-ascii?Q?tDH/PxCUGLVh7CToxcbwcF8X7/rJjdImxG144GZMV3YtWM8FVKWypfTUWlY1?= =?us-ascii?Q?gk+at+gHfPQURIc4fTqw6JjBwpiYN2j1KhSxJqYffUoyX/WVuWBIQI1Fvs8g?= =?us-ascii?Q?/4rNIZTVMcIlWA7vl9A1v3VrwWbsWSLcitLMhgO5b1TRTCvYGHEDFo8qJzCA?= =?us-ascii?Q?fJRIa3qb5hEJPk0H4vBPkhax0ny2mf6doKBRhsABU3MpGea162h9shEtHPYs?= =?us-ascii?Q?RKq/id1ZUuO9FbtxLncfccfnzjiKjCPv3TrTrCAn5k5FxsVGQn7SGx2+tTsh?= =?us-ascii?Q?xaCrQoCIIS4ZsoNN3VC6bDeNYFTxqgsWEY1rodaR?= X-OriginatorOrg: oppo.com X-MS-Exchange-CrossTenant-Network-Message-Id: 30585782-5ccd-4ae1-fe1e-08dc3f1d78c6 X-MS-Exchange-CrossTenant-AuthSource: TYZPR02MB5595.apcprd02.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Mar 2024 03:11:39.4010 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: f1905eb1-c353-41c5-9516-62b4a54b5ee6 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 1cxq0PQHA03oViqAFajp4Wmw6fAk/pVf+Pn6OqaVHpLFo2A3YJjHunke/Dzli54F77I35Wbr1FBGl8B7Ym1yDw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SI2PR02MB5539 X-Rspamd-Queue-Id: 4FD3D1C0009 X-Rspam-User: X-Rspamd-Server: rspam11 X-Stat-Signature: 5x6ux9nif1rtsibeqgtsrrp9kob76yoh X-HE-Tag: 1709867507-509597 X-HE-Meta: U2FsdGVkX19+fhymPcW6fYrv91UyH99kXSUqYVEmDI6d+XKV9JHNQyZauR40x6SnNI22eL/jP9vhk+Owum0rvNiW8PycYn+6GYTH2rn9m1yMBnO4959QI4G5X00HUJv+TYRL7UDJivRK4bxyOOKWEZJu/fLbDKHO2GZA93tU+bYNf9KBHVq6xsIQoEsXPd9JC3HsA13VoD/QwbLFW1iXoQNnnLRoXBOzBzOJhlcARyE7qmECSGE+jSup7+ayyez3kr6GIctjCt0+ti6g8fCxk0AMipjm6yma0I8eYc0V2MMEa1NxOOI5PXRCOi7seT9UeT4I7ULrfBhFM4pzVxVvPrmnaX8kI6/2LF8+Hb01WcgG63cNlmID3srXcRRqCJ2FRbrEoRYNDc08TWrIOKhPTA+0zcLe+yOleiHnQDzVObXkv/NwPaIDrLcKByi1zB7knk/VdIoFa9Lp/OUiziXS1oR07pUt3JwNcGvBIoUv/ghZAnAYPNW82O3FdcHFlpZ3JY2wpD56cfqnnDIBOfSircIcSU7WfENlo17uid7H06gOKFarrcMhtdcJqcWypWJgtbgtqy2oa8pFEJXnpcO3ZcPN7hi0fcLIVOqCcYolsZgUHM0LGYnNREGU/N9NRj1ltTA8hP70dpgyaJYCjqpd2f62r0XkN0aABqTTmqIVvJY0RIsk/1NPTzZN/3GkkfakZxiFnJOtjdVhqMyoTEprd69FBPWwtiETVN2Cl9Yto+hJX5xttG0QAWDwEKOV9f/W4EmPxroYZMmplhTm8vI65z1tJvt55H4Ga4YBVH6jyJFDDZQQXT6ZIBZbHSdGaOizpj89dW2iwQY1igYwp8uBpne7UjstTEfn0Q2NRRrD8Ui5YKcLgaBRFCNuR6OvdqfEg45z4oHRWMmNRlctGjNn6jbDIANd/JkNRUy62zeObRjXoXzy2TK1gA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Peifeng Li Commit 6d4675e60135 ("mm: don't be stuck to rmap lock on reclaim path") prevents the reclaim path from becoming stuck on the rmap lock. However, it reinserts those folios at the head of the LRU during shrink_folio_list, even if those folios are very cold. This can have a detrimental effect on performance by increasing refaults and the likelihood of OOM (Out of Memory) killing. This patchset introduces a new kthread:kshrinkd thread to asynchronously reclaim contended folios rather than promoting them, thereby preventing excessive violations of LRU rules. We observed a noticeable decrease in refaults and OOM killing as a result. -v2: * rewrite the commit messages; * rebase on top of mm-unstable -v1: https://lore.kernel.org/linux-mm/20240219141703.3851-1-lipeifeng@oppo.com/ Peifeng Li (2): mm/rmap: provide folio_referenced with the options to try_lock or lock mm: vmscan: reclaim contended folios asynchronously instead of promoting them include/linux/mmzone.h | 6 + include/linux/rmap.h | 5 +- include/linux/swap.h | 3 + include/linux/vm_event_item.h | 2 + mm/memory_hotplug.c | 2 + mm/rmap.c | 5 +- mm/vmscan.c | 205 +++++++++++++++++++++++++++++++++- mm/vmstat.c | 2 + 8 files changed, 221 insertions(+), 9 deletions(-) -- 2.34.1