From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 58C91C433EF for ; Mon, 4 Apr 2022 14:46:35 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4C7A48D0016; Mon, 4 Apr 2022 10:36:05 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 451608D000A; Mon, 4 Apr 2022 10:36:05 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 22E928D0016; Mon, 4 Apr 2022 10:36:05 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0214.hostedemail.com [216.40.44.214]) by kanga.kvack.org (Postfix) with ESMTP id 0C2388D000A for ; Mon, 4 Apr 2022 10:36:05 -0400 (EDT) Received: from smtpin17.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with ESMTP id 9F23C824C428 for ; Mon, 4 Apr 2022 14:35:54 +0000 (UTC) X-FDA: 79319445828.17.CF0E6E9 Received: from mx0a-00069f02.pphosted.com (mx0a-00069f02.pphosted.com [205.220.165.32]) by imf19.hostedemail.com (Postfix) with ESMTP id C30E41A0028 for ; Mon, 4 Apr 2022 14:35:53 +0000 (UTC) Received: from pps.filterd (m0246617.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.16.1.2/8.16.1.2) with SMTP id 234DpPEC024458; Mon, 4 Apr 2022 14:35:52 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=from : to : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=corp-2021-07-09; bh=yH8C8jxjGP9TxMA9rnfZXkKoAONWUkCSigcYZilSREo=; b=psMdXkub6Cr9RFbDROybyV3UQ+x2YxXTzoGiACjkwRKotC5692cWscQMaqLYMPy0UUL8 uhC5EhOP+LVJB4pfrLa2ANe4HkYJ+LQBc+Z2zFEqwwn5TSTKJhgI5FZ82WspXSVgJope e7KNrbtj3GC67b2afsCkR/YuNd7Fl9R1N0vU2QGDNQ9pC5pM7t2nDNNZ27uxIRBEz0fb 3h+WJ02HqdZGtEMZ1lNy5+2WBQrQykVMFwBbloazv6MQCAv9xNx5Kdq9OknCVe3cgbaJ jXL0LYz3URaxgwguINqPZwUPllOd6avyfyxeAFmhWLMK0KjdyRq7Spb/HjICyoDj3pnp Pg== Received: from iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta01.appoci.oracle.com [130.35.100.223]) by mx0b-00069f02.pphosted.com with ESMTP id 3f6f1t3csj-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 04 Apr 2022 14:35:52 +0000 Received: from pps.filterd (iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com (8.16.1.2/8.16.1.2) with SMTP id 234EGkPi033647; Mon, 4 Apr 2022 14:35:50 GMT Received: from nam11-co1-obe.outbound.protection.outlook.com (mail-co1nam11lp2177.outbound.protection.outlook.com [104.47.56.177]) by iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com with ESMTP id 3f6cx2guqq-3 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 04 Apr 2022 14:35:50 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=a3ez9BzDY9E0tSWFPnJMjrDkZorXF/HIj/bWlycIO22vzU/KKDag3Pe9R08x8grhc4gNafx8k00hMtx8zy9Dq/EtWQ/tzsUE7+d1bOSx2vxJ7ZyoSAVtYm+e8L5XBO1k2Jx2bKyFxK2EpqvEiVFL/CVoVpm6BUmneQ9hVigj1M2yW8fEBQxWfpBkshCN7N8V89KqwUGI/a8jYPMH4WFdW3c+9nafaefTh6/LcsYpErN762siVDprW52oNVERGExdf3TjM+UmOoZfhfVVRS/rbXyKk2iqBPnBDzc64epcQH4GNmmtYMSMX9sUVGcIH9rU2SvAirGS5YoWmIaxmi+doQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=yH8C8jxjGP9TxMA9rnfZXkKoAONWUkCSigcYZilSREo=; b=AvY57qbCXdXWIK8xyUNkdhVVE5SJQYLHWotZHXWklos5vVNiaXOEyyK6/o+oQtIErlVwn80YQyYN4r8zXgLIuEjd1cePYKMybyFLoRdx5J/G4cl1b0JD73WZW2qSSVL/pb1GKWZaVle9OADaaJOAZ5cDeKq0q7w4pQ3znRKZ7P4HzI9GeqSJJMGTdGD+IVvijlZ3oJonql71rCSCOQ7oDbbN8ENK2fz+gFOlw2+OUvFF80OJQSCisrLuIGnLesCFz7iWP+CzfxALX+CzLviPws0Ma4Vjm2DsfPwfZzJNyh7aDfUnN/RdZqZI7EX9Nwq14t+QSRxrWN1fIcAdIf+4jQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yH8C8jxjGP9TxMA9rnfZXkKoAONWUkCSigcYZilSREo=; b=w9hvdH4/yF70bkAN1q3A/Kg2nf4dLQRL73W6AQwFPJHQEWUUqK3N5WK8kcIdvXE4iwOu6w6Yg+PpoZG4U+3nP8pQ8APmLT7iSDa8HRZeoewUPuK4p3+z2DELafxOxyp9COeHRESsIAika6YDM6rVwrqQGY7uajAX3X+N4bHDlkg= Received: from SN6PR10MB3022.namprd10.prod.outlook.com (2603:10b6:805:d8::25) by CY4PR10MB1381.namprd10.prod.outlook.com (2603:10b6:903:29::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5123.31; Mon, 4 Apr 2022 14:35:47 +0000 Received: from SN6PR10MB3022.namprd10.prod.outlook.com ([fe80::74fd:df41:4c93:24a5]) by SN6PR10MB3022.namprd10.prod.outlook.com ([fe80::74fd:df41:4c93:24a5%6]) with mapi id 15.20.5123.031; Mon, 4 Apr 2022 14:35:47 +0000 From: Liam Howlett To: "maple-tree@lists.infradead.org" , "linux-mm@kvack.org" , "linux-kernel@vger.kernel.org" , Andrew Morton Subject: [PATCH v7 27/70] mm: Remove vmacache Thread-Topic: [PATCH v7 27/70] mm: Remove vmacache Thread-Index: AQHYSDFE8kw1OziDckSjsGrFRZiKTw== Date: Mon, 4 Apr 2022 14:35:43 +0000 Message-ID: <20220404143501.2016403-28-Liam.Howlett@oracle.com> References: <20220404143501.2016403-1-Liam.Howlett@oracle.com> In-Reply-To: <20220404143501.2016403-1-Liam.Howlett@oracle.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-mailer: git-send-email 2.34.1 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: e6ca9546-7faf-4d8b-0d24-08da164868b4 x-ms-traffictypediagnostic: CY4PR10MB1381:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: o0CAgPUn/BwMQoRiwiX9Y/+M1cau3pb3k+HuN/tDwX53n6v7d5g8f6tJ/idR+zqPzWAmo5ihk/wXfYKExpaVb5AqjLEB7ykSgAwaVx1QFDn9BOGC0/tFlE8bk3MpjUhJABzEJfDq/kBUCCvOty3v2KgkBdp/8KFCVxUh9hk3Jja5bsmW8d3fN+r40MaUWoYd/WEUd/a+UVooMWuPYwyfxbTRaP9ukVkq1U5HtyQPEsaLtIzOXtMaO00K/48pVyqS/ti+7fvah0RMQD6WYYx85kAcrgqfzd6dtonpMxujy9kjj6LGPjz9Oww3oMYH2B/Apfs+Rik5jMavZq6idkNLnpHe2VTMtsRbuvlSvdGzSzuLSiNABFWoMSKbXBBhueGaTutWr3Ja7CsM0RksH4Q4YhOPCHlbmId9gSm7JP1//rFTrsKfgxtHFOq8RAk5ioY/biOm0Rp7ZyZ3Mkxdz0VJgzXmqTswv7P1ER+06uepf59gtxMi0om2x3+bPrZVOEM+cwrZBkSs9g3G/WMl8uIJPbhL73VqYYzIxAnocyHLruq110eFa+QJuPzSre9K20x61Xn6BpR+PVYlRBSYQTPbV0Y3S+1ZhX4ADvYcNE6sTLbOf78VXKfmhOWbqvoU/doIq9SixvSCNUwgw96cABkBOn5TtrdWVmK2aV4XvtXGVZWn8QFaGeDckbV0CedX+XIOMi/uKF6oUwc7rq7+xNj27g== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SN6PR10MB3022.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230001)(366004)(122000001)(6506007)(6666004)(2906002)(66446008)(66946007)(110136005)(66556008)(66476007)(36756003)(8676002)(76116006)(91956017)(64756008)(6512007)(316002)(71200400001)(5660300002)(2616005)(38070700005)(38100700002)(30864003)(1076003)(83380400001)(186003)(508600001)(26005)(8936002)(86362001)(6486002)(44832011)(579004);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?pzBLd+i6BhqU6l8s+65IImi1fJtFOCjO8wBuKj3N5HzDALM0FVjXJfUG7Z?= =?iso-8859-1?Q?M0OwVMyJgO7XM6KejUJveP/YS5EEhyPz3txWPtqnxCh3kS1h8ryL9t9z2Z?= =?iso-8859-1?Q?/kRbBTLtKJ5siNEFwuPIYfk/AU9EGMx4DA8JGl539Hv/6uKWUDp+SY29W/?= =?iso-8859-1?Q?e8vIDb5u8Q1Oqvyb9XBPZNdKq30j9QnoBu7KR6f8cdGdkOk4/NOOPjfpvW?= =?iso-8859-1?Q?HxEwJjAiGmMmzCaFMCUlauCKRC9sjZ6i0NyXjm24yJX6zIzKc0U0BuZ7Vx?= =?iso-8859-1?Q?qznxUkn55Ug+ZC5dJMbT/YXjPxndeTWEw+KxNiu6D1hjN8ctZPkQhTKpdU?= =?iso-8859-1?Q?p8BNKG4rKKK/E45iXbTYE3H8SX6xmeCh1VKH2j5ulN71khGqbc6IEgY1xr?= =?iso-8859-1?Q?1jN72+ASflM3rM0wKEEvRHVzE26r4VIqRyNqycBCuN8N9oPJ/6Ed2zYUNT?= =?iso-8859-1?Q?RMdZiKFJxucsRdVMw20do+ggCbd03/5A6PhN1fqg8mx4LoyRh5vwzddVH9?= =?iso-8859-1?Q?pkWCsrnheTPwevyTb6tSKoINnrhv8uE75RlJkjnacjJkSHH648rb8XpqZi?= =?iso-8859-1?Q?oAakalkfBz6084p5ylUhVVd4XFscs4Ts41o5Ut2M0dXCcJWHJlWP2guBkY?= =?iso-8859-1?Q?nO9khQg1E8bSphWxfcNtRRkW3JMM9a9jkE43mg4eAc9iouNAxLY649GKjT?= =?iso-8859-1?Q?EpdpX95g8B1UI0b/JX9DBY7i75UutCL3WNw1sz2IHETYMn1fHKXdELDFzS?= =?iso-8859-1?Q?Wx3+/ua3u/0E5kvTyR9BNbUhpPACR8crymPq+XtaFmSnhpOzcAe55S6M5e?= =?iso-8859-1?Q?+kTgiLcoR7xW1x2o5IdTl3g9bdSYlVHnUWT8yQQ61UeBLqX+3vq6vdiIdP?= =?iso-8859-1?Q?yGO9SCTOhiZIdX32KZWDrHwEucV/sXk77FjWUFGn+mu1h0ekm/o6+GGaSi?= =?iso-8859-1?Q?6msTDx8m/0kcXNs6P+MGIHBZRnaxCCtJFX7AhElYMsk8pTZmJWve4YEbnm?= =?iso-8859-1?Q?+vBggCkrJL/PJ+S6Wed3qhgh7yxE4O9o5IQ1rheI9vyDfmyuTwRNt15nus?= =?iso-8859-1?Q?Mzs2aG42tQKJUcRf1/1c/Ig3SJmZ4xquQsSd+utBzxYFVwGSQWMjeP50ho?= =?iso-8859-1?Q?24Gdd3N5yCS8y50jukJWhMtbON2w1TkzAP6R4qc14BiRdC21Nr5cUlghI3?= =?iso-8859-1?Q?wqfXk3Q6tBoMkZRgJ5t699C+dUfE+vf9c/oryLG3qkxsLm+h8gna+P4yJr?= =?iso-8859-1?Q?ztSYnrWiOfDeCxJbcZOKV31kwPfzsd8TxGYI1R518aArR2xP6tdAwUEI2M?= =?iso-8859-1?Q?bGrqJBaHPMDsj3QHzKxrUxHzlWy+AyTbtOzYluSaaioOMfyytx6QYHa5mQ?= =?iso-8859-1?Q?4WwWOArtXqS3XOyBwTKPEEbvVlb1JGZBSydvXPKKPH1cn84UunDyXUXw/M?= =?iso-8859-1?Q?fvqChmrG6rSGh5TVlWx0sg7Og5l0IRxEWQ3fdh5ETF2PhajvNoeZXr0DGA?= =?iso-8859-1?Q?ea3QXWucCrJfvHVE8l+sXH/AufDAQpqvp0eOIo3KZ9uB38xo1pEndsc2wD?= =?iso-8859-1?Q?HwwBboEeCaFHprizjuvcmnQ+rN/sn+SCiTgTuyX41ffDAbiXu0ocyzaAAJ?= =?iso-8859-1?Q?wE4o4kNjLVoWTOF7BcfOfbDcfmnd4nVEhTQMWhZa/celFtjEgr7R5e/E/F?= =?iso-8859-1?Q?3wTwZJI+/EFHaKucfXNMdXOCazzx+iSRK6nGVZj2GDPhoYsptRF2y5Xxdr?= =?iso-8859-1?Q?/2tgLnPobYC008ijDwgS5xbFsKAsHRvF+qKujwxERK7nTFrtuJpCxcdXMZ?= =?iso-8859-1?Q?O6NCt9Ks/joZEyW/eoujz2kV+bBvZdU=3D?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN6PR10MB3022.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: e6ca9546-7faf-4d8b-0d24-08da164868b4 X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Apr 2022 14:35:43.9248 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: MxWidW+oJG1sY2quuVZZIjOro0pi85aVLXfGRMGGGMHpwB1nqHs4bGxClj1AWU7/KuFCLk11X+d1m2Ejs3hARg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR10MB1381 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.425,18.0.850 definitions=2022-04-04_05:2022-03-30,2022-04-04 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 malwarescore=0 spamscore=0 phishscore=0 mlxscore=0 mlxlogscore=999 bulkscore=0 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2202240000 definitions=main-2204040082 X-Proofpoint-ORIG-GUID: hL5_mqTcGbxAVmoMcLGEPNFa-mTUDBaO X-Proofpoint-GUID: hL5_mqTcGbxAVmoMcLGEPNFa-mTUDBaO X-Stat-Signature: hbrhp7nfsdjsd95t1w8gt3quef4js47m Authentication-Results: imf19.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2021-07-09 header.b=psMdXkub; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b="w9hvdH4/"; spf=none (imf19.hostedemail.com: domain of liam.howlett@oracle.com has no SPF policy when checking 205.220.165.32) smtp.mailfrom=liam.howlett@oracle.com; dmarc=pass (policy=none) header.from=oracle.com X-Rspam-User: X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: C30E41A0028 X-HE-Tag: 1649082953-845031 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: "Liam R. Howlett" By using the maple tree and the maple tree state, the vmacache is no longer beneficial and is complicating the VMA code. Remove the vmacache to reduce the work in keeping it up to date and code complexity. Signed-off-by: Liam R. Howlett Acked-by: Vlastimil Babka --- fs/exec.c | 3 - fs/proc/task_mmu.c | 1 - include/linux/mm_types.h | 1 - include/linux/mm_types_task.h | 12 ---- include/linux/sched.h | 1 - include/linux/vm_event_item.h | 4 -- include/linux/vmacache.h | 28 -------- include/linux/vmstat.h | 6 -- kernel/debug/debug_core.c | 12 ---- kernel/fork.c | 5 -- lib/Kconfig.debug | 8 --- mm/Makefile | 2 +- mm/debug.c | 4 +- mm/mmap.c | 32 +--------- mm/nommu.c | 37 ++--------- mm/vmacache.c | 117 ---------------------------------- mm/vmstat.c | 4 -- 17 files changed, 9 insertions(+), 268 deletions(-) delete mode 100644 include/linux/vmacache.h delete mode 100644 mm/vmacache.c diff --git a/fs/exec.c b/fs/exec.c index e3e55d5e0be1..14e7278a1ab8 100644 --- a/fs/exec.c +++ b/fs/exec.c @@ -28,7 +28,6 @@ #include #include #include -#include #include #include #include @@ -1023,8 +1022,6 @@ static int exec_mmap(struct mm_struct *mm) activate_mm(active_mm, mm); if (IS_ENABLED(CONFIG_ARCH_WANT_IRQS_OFF_ACTIVATE_MM)) local_irq_enable(); - tsk->mm->vmacache_seqnum =3D 0; - vmacache_flush(tsk); task_unlock(tsk); if (old_mm) { mmap_read_unlock(old_mm); diff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c index f46060eb91b5..f025c8496cb7 100644 --- a/fs/proc/task_mmu.c +++ b/fs/proc/task_mmu.c @@ -1,6 +1,5 @@ // SPDX-License-Identifier: GPL-2.0 #include -#include #include #include #include diff --git a/include/linux/mm_types.h b/include/linux/mm_types.h index 123c8b07be08..43bc3d6ac074 100644 --- a/include/linux/mm_types.h +++ b/include/linux/mm_types.h @@ -465,7 +465,6 @@ struct mm_struct { struct { struct vm_area_struct *mmap; /* list of VMAs */ struct maple_tree mm_mt; - u64 vmacache_seqnum; /* per-thread vmacache */ #ifdef CONFIG_MMU unsigned long (*get_unmapped_area) (struct file *filp, unsigned long addr, unsigned long len, diff --git a/include/linux/mm_types_task.h b/include/linux/mm_types_task.h index c1bc6731125c..0bb4b6da9993 100644 --- a/include/linux/mm_types_task.h +++ b/include/linux/mm_types_task.h @@ -24,18 +24,6 @@ IS_ENABLED(CONFIG_ARCH_ENABLE_SPLIT_PMD_PTLOCK)) #define ALLOC_SPLIT_PTLOCKS (SPINLOCK_SIZE > BITS_PER_LONG/8) =20 -/* - * The per task VMA cache array: - */ -#define VMACACHE_BITS 2 -#define VMACACHE_SIZE (1U << VMACACHE_BITS) -#define VMACACHE_MASK (VMACACHE_SIZE - 1) - -struct vmacache { - u64 seqnum; - struct vm_area_struct *vmas[VMACACHE_SIZE]; -}; - /* * When updating this, please also update struct resident_page_types[] in * kernel/fork.c diff --git a/include/linux/sched.h b/include/linux/sched.h index d5e3c00b74e1..e7f984a7311e 100644 --- a/include/linux/sched.h +++ b/include/linux/sched.h @@ -861,7 +861,6 @@ struct task_struct { struct mm_struct *active_mm; =20 /* Per-thread vma caching: */ - struct vmacache vmacache; =20 #ifdef SPLIT_RSS_COUNTING struct task_rss_stat rss_stat; diff --git a/include/linux/vm_event_item.h b/include/linux/vm_event_item.h index 16a0a4fd000b..aef0369e9c08 100644 --- a/include/linux/vm_event_item.h +++ b/include/linux/vm_event_item.h @@ -122,10 +122,6 @@ enum vm_event_item { PGPGIN, PGPGOUT, PSWPIN, PSWPOUT, NR_TLB_LOCAL_FLUSH_ALL, NR_TLB_LOCAL_FLUSH_ONE, #endif /* CONFIG_DEBUG_TLBFLUSH */ -#ifdef CONFIG_DEBUG_VM_VMACACHE - VMACACHE_FIND_CALLS, - VMACACHE_FIND_HITS, -#endif #ifdef CONFIG_SWAP SWAP_RA, SWAP_RA_HIT, diff --git a/include/linux/vmacache.h b/include/linux/vmacache.h deleted file mode 100644 index 6fce268a4588..000000000000 --- a/include/linux/vmacache.h +++ /dev/null @@ -1,28 +0,0 @@ -/* SPDX-License-Identifier: GPL-2.0 */ -#ifndef __LINUX_VMACACHE_H -#define __LINUX_VMACACHE_H - -#include -#include - -static inline void vmacache_flush(struct task_struct *tsk) -{ - memset(tsk->vmacache.vmas, 0, sizeof(tsk->vmacache.vmas)); -} - -extern void vmacache_update(unsigned long addr, struct vm_area_struct *new= vma); -extern struct vm_area_struct *vmacache_find(struct mm_struct *mm, - unsigned long addr); - -#ifndef CONFIG_MMU -extern struct vm_area_struct *vmacache_find_exact(struct mm_struct *mm, - unsigned long start, - unsigned long end); -#endif - -static inline void vmacache_invalidate(struct mm_struct *mm) -{ - mm->vmacache_seqnum++; -} - -#endif /* __LINUX_VMACACHE_H */ diff --git a/include/linux/vmstat.h b/include/linux/vmstat.h index bfe38869498d..19cf5b6892ce 100644 --- a/include/linux/vmstat.h +++ b/include/linux/vmstat.h @@ -125,12 +125,6 @@ static inline void vm_events_fold_cpu(int cpu) #define count_vm_tlb_events(x, y) do { (void)(y); } while (0) #endif =20 -#ifdef CONFIG_DEBUG_VM_VMACACHE -#define count_vm_vmacache_event(x) count_vm_event(x) -#else -#define count_vm_vmacache_event(x) do {} while (0) -#endif - #define __count_zid_vm_events(item, zid, delta) \ __count_vm_events(item##_NORMAL - ZONE_NORMAL + zid, delta) =20 diff --git a/kernel/debug/debug_core.c b/kernel/debug/debug_core.c index da06a5553835..c4e6f5159bed 100644 --- a/kernel/debug/debug_core.c +++ b/kernel/debug/debug_core.c @@ -50,7 +50,6 @@ #include #include #include -#include #include #include =20 @@ -282,17 +281,6 @@ static void kgdb_flush_swbreak_addr(unsigned long addr= ) if (!CACHE_FLUSH_IS_SAFE) return; =20 - if (current->mm) { - int i; - - for (i =3D 0; i < VMACACHE_SIZE; i++) { - if (!current->vmacache.vmas[i]) - continue; - flush_cache_range(current->vmacache.vmas[i], - addr, addr + BREAK_INSTR_SIZE); - } - } - /* Force flush instruction cache if it was outside the mm */ flush_icache_range(addr, addr + BREAK_INSTR_SIZE); } diff --git a/kernel/fork.c b/kernel/fork.c index cb5a1423ea27..20890be1371b 100644 --- a/kernel/fork.c +++ b/kernel/fork.c @@ -43,7 +43,6 @@ #include #include #include -#include #include #include #include @@ -1116,7 +1115,6 @@ static struct mm_struct *mm_init(struct mm_struct *mm= , struct task_struct *p, mm->mmap =3D NULL; mt_init_flags(&mm->mm_mt, MM_MT_FLAGS); mt_set_external_lock(&mm->mm_mt, &mm->mmap_lock); - mm->vmacache_seqnum =3D 0; atomic_set(&mm->mm_users, 1); atomic_set(&mm->mm_count, 1); seqcount_init(&mm->write_protect_seq); @@ -1572,9 +1570,6 @@ static int copy_mm(unsigned long clone_flags, struct = task_struct *tsk) if (!oldmm) return 0; =20 - /* initialize the new vmacache entries */ - vmacache_flush(tsk); - if (clone_flags & CLONE_VM) { mmget(oldmm); mm =3D oldmm; diff --git a/lib/Kconfig.debug b/lib/Kconfig.debug index 3d9366075153..8a0567046e9e 100644 --- a/lib/Kconfig.debug +++ b/lib/Kconfig.debug @@ -837,14 +837,6 @@ config DEBUG_VM =20 If unsure, say N. =20 -config DEBUG_VM_VMACACHE - bool "Debug VMA caching" - depends on DEBUG_VM - help - Enable this to turn on VMA caching debug information. Doing so - can cause significant overhead, so only enable it in non-production - environments. - config DEBUG_VM_MAPLE_TREE bool "Debug VM maple trees" depends on DEBUG_VM diff --git a/mm/Makefile b/mm/Makefile index 4cc13f3179a5..f716e8a57007 100644 --- a/mm/Makefile +++ b/mm/Makefile @@ -52,7 +52,7 @@ obj-y :=3D filemap.o mempool.o oom_kill.o fadvise.o \ readahead.o swap.o truncate.o vmscan.o shmem.o \ util.o mmzone.o vmstat.o backing-dev.o \ mm_init.o percpu.o slab_common.o \ - compaction.o vmacache.o \ + compaction.o \ interval_tree.o list_lru.o workingset.o \ debug.o gup.o mmap_lock.o $(mmu-y) =20 diff --git a/mm/debug.c b/mm/debug.c index bef329bf28f0..2d625ca0e326 100644 --- a/mm/debug.c +++ b/mm/debug.c @@ -155,7 +155,7 @@ EXPORT_SYMBOL(dump_vma); =20 void dump_mm(const struct mm_struct *mm) { - pr_emerg("mm %px mmap %px seqnum %llu task_size %lu\n" + pr_emerg("mm %px mmap %px task_size %lu\n" #ifdef CONFIG_MMU "get_unmapped_area %px\n" #endif @@ -183,7 +183,7 @@ void dump_mm(const struct mm_struct *mm) "tlb_flush_pending %d\n" "def_flags: %#lx(%pGv)\n", =20 - mm, mm->mmap, (long long) mm->vmacache_seqnum, mm->task_size, + mm, mm->mmap, mm->task_size, #ifdef CONFIG_MMU mm->get_unmapped_area, #endif diff --git a/mm/mmap.c b/mm/mmap.c index be5ecb515d1e..0466e4512e2d 100644 --- a/mm/mmap.c +++ b/mm/mmap.c @@ -14,7 +14,6 @@ #include #include #include -#include #include #include #include @@ -687,9 +686,6 @@ inline int vma_expand(struct ma_state *mas, struct vm_a= rea_struct *vma, /* Remove from mm linked list - also updates highest_vm_end */ __vma_unlink_list(mm, next); =20 - /* Kill the cache */ - vmacache_invalidate(mm); - if (file) __remove_shared_vm_struct(next, file, mapping); =20 @@ -915,8 +911,6 @@ int __vma_adjust(struct vm_area_struct *vma, unsigned l= ong start, =20 if (remove_next) { __vma_unlink_list(mm, next); - /* Kill the cache */ - vmacache_invalidate(mm); if (file) __remove_shared_vm_struct(next, file, mapping); } else if (insert) { @@ -2185,19 +2179,10 @@ struct vm_area_struct *find_vma_intersection(struct= mm_struct *mm, unsigned long start_addr, unsigned long end_addr) { - struct vm_area_struct *vma; unsigned long index =3D start_addr; =20 mmap_assert_locked(mm); - /* Check the cache first. */ - vma =3D vmacache_find(mm, start_addr); - if (likely(vma)) - return vma; - - vma =3D mt_find(&mm->mm_mt, &index, end_addr - 1); - if (vma) - vmacache_update(start_addr, vma); - return vma; + return mt_find(&mm->mm_mt, &index, end_addr - 1); } EXPORT_SYMBOL(find_vma_intersection); =20 @@ -2211,19 +2196,10 @@ EXPORT_SYMBOL(find_vma_intersection); */ struct vm_area_struct *find_vma(struct mm_struct *mm, unsigned long addr) { - struct vm_area_struct *vma; unsigned long index =3D addr; =20 mmap_assert_locked(mm); - /* Check the cache first. */ - vma =3D vmacache_find(mm, addr); - if (likely(vma)) - return vma; - - vma =3D mt_find(&mm->mm_mt, &index, ULONG_MAX); - if (vma) - vmacache_update(addr, vma); - return vma; + return mt_find(&mm->mm_mt, &index, ULONG_MAX); } EXPORT_SYMBOL(find_vma); =20 @@ -2605,9 +2581,6 @@ detach_vmas_to_be_unmapped(struct mm_struct *mm, stru= ct vm_area_struct *vma, mm->highest_vm_end =3D prev ? vm_end_gap(prev) : 0; tail_vma->vm_next =3D NULL; =20 - /* Kill the cache */ - vmacache_invalidate(mm); - /* * Do not downgrade mmap_lock if we are next to VM_GROWSDOWN or * VM_GROWSUP VMA. Such VMAs can change their size under @@ -2966,7 +2939,6 @@ static int do_brk_munmap(struct ma_state *mas, struct= vm_area_struct *vma, if (vma_mas_remove(&unmap, mas)) goto mas_store_fail; =20 - vmacache_invalidate(vma->vm_mm); if (vma->anon_vma) { anon_vma_interval_tree_post_update_vma(vma); anon_vma_unlock_write(vma->anon_vma); diff --git a/mm/nommu.c b/mm/nommu.c index 7d8f756f13f3..26a9056e508f 100644 --- a/mm/nommu.c +++ b/mm/nommu.c @@ -19,7 +19,6 @@ #include #include #include -#include #include #include #include @@ -583,23 +582,12 @@ static void add_vma_to_mm(struct mm_struct *mm, struc= t vm_area_struct *vma) */ static void delete_vma_from_mm(struct vm_area_struct *vma) { - int i; - struct address_space *mapping; - struct mm_struct *mm =3D vma->vm_mm; - struct task_struct *curr =3D current; MA_STATE(mas, &vma->vm_mm->mm_mt, 0, 0); =20 - mm->map_count--; - for (i =3D 0; i < VMACACHE_SIZE; i++) { - /* if the vma is cached, invalidate the entire cache */ - if (curr->vmacache.vmas[i] =3D=3D vma) { - vmacache_invalidate(mm); - break; - } - } - + vma->vm_mm->map_count--; /* remove the VMA from the mapping */ if (vma->vm_file) { + struct address_space *mapping; mapping =3D vma->vm_file->f_mapping; =20 i_mmap_lock_write(mapping); @@ -611,7 +599,7 @@ static void delete_vma_from_mm(struct vm_area_struct *v= ma) =20 /* remove from the MM's tree and list */ vma_mas_remove(vma, &mas); - __vma_unlink_list(mm, vma); + __vma_unlink_list(vma->vm_mm, vma); } =20 /* @@ -644,20 +632,9 @@ EXPORT_SYMBOL(find_vma_intersection); */ struct vm_area_struct *find_vma(struct mm_struct *mm, unsigned long addr) { - struct vm_area_struct *vma; MA_STATE(mas, &mm->mm_mt, addr, addr); =20 - /* check the cache first */ - vma =3D vmacache_find(mm, addr); - if (likely(vma)) - return vma; - - vma =3D mas_walk(&mas); - - if (vma) - vmacache_update(addr, vma); - - return vma; + return mas_walk(&mas); } EXPORT_SYMBOL(find_vma); =20 @@ -691,11 +668,6 @@ static struct vm_area_struct *find_vma_exact(struct mm= _struct *mm, unsigned long end =3D addr + len; MA_STATE(mas, &mm->mm_mt, addr, addr); =20 - /* check the cache first */ - vma =3D vmacache_find_exact(mm, addr, end); - if (vma) - return vma; - vma =3D mas_walk(&mas); if (!vma) return NULL; @@ -704,7 +676,6 @@ static struct vm_area_struct *find_vma_exact(struct mm_= struct *mm, if (vma->vm_end !=3D end) return NULL; =20 - vmacache_update(addr, vma); return vma; } =20 diff --git a/mm/vmacache.c b/mm/vmacache.c deleted file mode 100644 index 01a6e6688ec1..000000000000 --- a/mm/vmacache.c +++ /dev/null @@ -1,117 +0,0 @@ -// SPDX-License-Identifier: GPL-2.0 -/* - * Copyright (C) 2014 Davidlohr Bueso. - */ -#include -#include -#include -#include - -/* - * Hash based on the pmd of addr if configured with MMU, which provides a = good - * hit rate for workloads with spatial locality. Otherwise, use pages. - */ -#ifdef CONFIG_MMU -#define VMACACHE_SHIFT PMD_SHIFT -#else -#define VMACACHE_SHIFT PAGE_SHIFT -#endif -#define VMACACHE_HASH(addr) ((addr >> VMACACHE_SHIFT) & VMACACHE_MASK) - -/* - * This task may be accessing a foreign mm via (for example) - * get_user_pages()->find_vma(). The vmacache is task-local and this - * task's vmacache pertains to a different mm (ie, its own). There is - * nothing we can do here. - * - * Also handle the case where a kernel thread has adopted this mm via - * kthread_use_mm(). That kernel thread's vmacache is not applicable to th= is mm. - */ -static inline bool vmacache_valid_mm(struct mm_struct *mm) -{ - return current->mm =3D=3D mm && !(current->flags & PF_KTHREAD); -} - -void vmacache_update(unsigned long addr, struct vm_area_struct *newvma) -{ - if (vmacache_valid_mm(newvma->vm_mm)) - current->vmacache.vmas[VMACACHE_HASH(addr)] =3D newvma; -} - -static bool vmacache_valid(struct mm_struct *mm) -{ - struct task_struct *curr; - - if (!vmacache_valid_mm(mm)) - return false; - - curr =3D current; - if (mm->vmacache_seqnum !=3D curr->vmacache.seqnum) { - /* - * First attempt will always be invalid, initialize - * the new cache for this task here. - */ - curr->vmacache.seqnum =3D mm->vmacache_seqnum; - vmacache_flush(curr); - return false; - } - return true; -} - -struct vm_area_struct *vmacache_find(struct mm_struct *mm, unsigned long a= ddr) -{ - int idx =3D VMACACHE_HASH(addr); - int i; - - count_vm_vmacache_event(VMACACHE_FIND_CALLS); - - if (!vmacache_valid(mm)) - return NULL; - - for (i =3D 0; i < VMACACHE_SIZE; i++) { - struct vm_area_struct *vma =3D current->vmacache.vmas[idx]; - - if (vma) { -#ifdef CONFIG_DEBUG_VM_VMACACHE - if (WARN_ON_ONCE(vma->vm_mm !=3D mm)) - break; -#endif - if (vma->vm_start <=3D addr && vma->vm_end > addr) { - count_vm_vmacache_event(VMACACHE_FIND_HITS); - return vma; - } - } - if (++idx =3D=3D VMACACHE_SIZE) - idx =3D 0; - } - - return NULL; -} - -#ifndef CONFIG_MMU -struct vm_area_struct *vmacache_find_exact(struct mm_struct *mm, - unsigned long start, - unsigned long end) -{ - int idx =3D VMACACHE_HASH(start); - int i; - - count_vm_vmacache_event(VMACACHE_FIND_CALLS); - - if (!vmacache_valid(mm)) - return NULL; - - for (i =3D 0; i < VMACACHE_SIZE; i++) { - struct vm_area_struct *vma =3D current->vmacache.vmas[idx]; - - if (vma && vma->vm_start =3D=3D start && vma->vm_end =3D=3D end) { - count_vm_vmacache_event(VMACACHE_FIND_HITS); - return vma; - } - if (++idx =3D=3D VMACACHE_SIZE) - idx =3D 0; - } - - return NULL; -} -#endif diff --git a/mm/vmstat.c b/mm/vmstat.c index b75b1a64b54c..1fd82a0c6b51 100644 --- a/mm/vmstat.c +++ b/mm/vmstat.c @@ -1382,10 +1382,6 @@ const char * const vmstat_text[] =3D { "nr_tlb_local_flush_one", #endif /* CONFIG_DEBUG_TLBFLUSH */ =20 -#ifdef CONFIG_DEBUG_VM_VMACACHE - "vmacache_find_calls", - "vmacache_find_hits", -#endif #ifdef CONFIG_SWAP "swap_ra", "swap_ra_hit", --=20 2.34.1