From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 2B989C433EF for ; Mon, 21 Mar 2022 19:20:54 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:Content-Type: Content-Transfer-Encoding:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:From:References:Cc:To:Subject: MIME-Version:Date:Message-ID:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=WuChYlGegN6Hy4FS0AYuLK5/4979+obMjc2G3zwbN74=; b=SQkrpMTKlD3Cyo dx2iZJUBjr6JQ3K3FkMfEOM0qoKTQdl1OngaWqPj3qrAtM27PONefmX6Fuk0Ov488YdRjeeqdMv95 vlLShfyRaziwnZWa0BofiIjIXX5HnFq++ctGcBuHbJp8ZfeKm7yzwqUpA+ua+FdOf+qfb2AmnFfi8 6kdwK7n9pGU4JYVP8AHgur6/vHGsUdqBGum/kLHiju032eYENrFKGbnT0e45sOgGNcEkoUnFoRm38 5gNLECZMJ3Pc320Odpv0sfibXBPx6Yuxu7cCF2JSpLJu5zS+FpvhjnRHzWsfY/+xzi+gB2Yf8jFpE XkaYoPllX4I8Spa8x0SA==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1nWNZ6-008prW-JX; Mon, 21 Mar 2022 19:19:40 +0000 Received: from us-smtp-delivery-124.mimecast.com ([170.10.129.124]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1nWNZ1-008ppT-TB for linux-arm-kernel@lists.infradead.org; Mon, 21 Mar 2022 19:19:37 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1647890373; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uvhBps1UXtsrc+nGVheIq+OQ/K59QvLDMVnB+No/i7I=; b=GWhVJt/It64UmKKZ8XhT0KZB6Lo6jFCqiWpa89OREsVF2apYxcikXenn/kYjs69Dry8sjI OuMlj13ympuQ6dPKbnBgGksX5edBccj2uTzd/E7srGE8HZJL+YDBV+0ao95hecoS2EW4jh bBLMP+pmL2l9vsBtp/WVVoZKtlVNeUg= Received: from mail-qt1-f199.google.com (mail-qt1-f199.google.com [209.85.160.199]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-42-pKo_1GVdN_WaYIZhgPNZsA-1; Mon, 21 Mar 2022 15:17:59 -0400 X-MC-Unique: pKo_1GVdN_WaYIZhgPNZsA-1 Received: by mail-qt1-f199.google.com with SMTP id u8-20020ac858c8000000b002e1b3ceb167so9987519qta.10 for ; Mon, 21 Mar 2022 12:17:59 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent:subject :content-language:to:cc:references:from:in-reply-to :content-transfer-encoding; bh=uvhBps1UXtsrc+nGVheIq+OQ/K59QvLDMVnB+No/i7I=; b=ORu3DpRUqM0FcZHEBuwsw3JZsp9Gb7SN251iw2ZAbt4fCxQi+/PzSbMInGsRiyuKwZ aNeLchcE0lYrZ36KgA9xwFgZE7cKfyghfKBG8/Rm9Lyegfddh65QHjbrae631GUGwaap zMQ3wvAv8aJhUSnL7uuVYe8tz3Z+6sENe65N1Jt2P+M2p0evPVycbtikaxShnKjZD7Gg CZoapOWNYjYEezW/9ZBFnwvPn1hHnSzJAN26QVKDOgEIc+exLwKblEDE4mHjvGj12GJC G3hJTwBfJBCfTs9QDk/ec4gyr/VX/teipm5hNd5CCUCLG7xuHXsLi869YBpMvhMwJ7qU 2ZQQ== X-Gm-Message-State: AOAM531NsKdVlI0EC2k24Q+4/yaaa6iwcEFsM1TulUaSYGQn+uRE6lF/ w4TjYqj+uMX8nV2CrD/BK30Fy0j1hwxKRXQWed7gixfFticdWKzj0QrLJhxgS4obWq/HmY3hluc /sUYwbgm6riRNxZjgviChfIfxyv9AeQazHac= X-Received: by 2002:a05:622a:50d:b0:2e2:1006:35b6 with SMTP id l13-20020a05622a050d00b002e2100635b6mr6045864qtx.536.1647890278952; Mon, 21 Mar 2022 12:17:58 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxT6OD/Y0C23YFhyuuCC1pdsNk4eMbxjtnCENsX9okSWpzu6X4wl532+Yylnnt9cpM9agH2sw== X-Received: by 2002:a05:622a:50d:b0:2e2:1006:35b6 with SMTP id l13-20020a05622a050d00b002e2100635b6mr6045807qtx.536.1647890278574; Mon, 21 Mar 2022 12:17:58 -0700 (PDT) Received: from [10.16.222.26] (nat-pool-bos-t.redhat.com. [66.187.233.206]) by smtp.gmail.com with ESMTPSA id t1-20020a05620a0b0100b0067d3ac00982sm7944596qkg.57.2022.03.21.12.17.55 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 21 Mar 2022 12:17:57 -0700 (PDT) Message-ID: Date: Mon, 21 Mar 2022 15:17:54 -0400 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Subject: Re: [PATCH v9 05/14] mm: multi-gen LRU: groundwork To: Justin Forbes , Yu Zhao Cc: Andi Kleen , kernel-team@lists.ubuntu.com, Vaibhav Jain , Rik van Riel , Mel Gorman , Catalin Marinas , Johannes Weiner , Aneesh Kumar , Brian Geffon , "open list:DOCUMENTATION" , Jesse Barnes , Sofia Trinh , "Huang, Ying" , linux-kernel , Steven Barrett , Shuang Zhai , Donald Carr , Oleksandr Natalenko , =?UTF-8?Q?Holger_Hoffst=c3=a4tte?= , Will Deacon , Dave Hansen , Jonathan Corbet , Mike Rapoport , Andrew Morton , Jens Axboe , Hillf Danton , Michal Hocko , kernel , Suleiman Souhlal , Daniel Byrne , the arch/x86 maintainers , Konstantin Kharlamov , Matthew Wilcox , Linus Torvalds , Michael Larabel , Linux-MM , Kernel Page Reclaim v2 , Jan Alexander Steffens , Linux ARM References: <20220309021230.721028-1-yuzhao@google.com> <20220309021230.721028-6-yuzhao@google.com> <875yoh552i.fsf@yhuang6-desk2.ccr.corp.intel.com> From: Prarit Bhargava In-Reply-To: Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=prarit@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20220321_121936_027384_105A8D5D X-CRM114-Status: GOOD ( 27.32 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On 3/21/22 14:58, Justin Forbes wrote: > On Mon, Mar 14, 2022 at 4:30 AM Yu Zhao wrote: >> >> On Mon, Mar 14, 2022 at 2:09 AM Huang, Ying wrote: >>> >>> Hi, Yu, >>> >>> Yu Zhao writes: >>>> diff --git a/mm/Kconfig b/mm/Kconfig >>>> index 3326ee3903f3..747ab1690bcf 100644 >>>> --- a/mm/Kconfig >>>> +++ b/mm/Kconfig >>>> @@ -892,6 +892,16 @@ config ANON_VMA_NAME >>>> area from being merged with adjacent virtual memory areas due to the >>>> difference in their name. >>>> >>>> +# the multi-gen LRU { >>>> +config LRU_GEN >>>> + bool "Multi-Gen LRU" >>>> + depends on MMU >>>> + # the following options can use up the spare bits in page flags >>>> + depends on !MAXSMP && (64BIT || !SPARSEMEM || SPARSEMEM_VMEMMAP) >>> >>> LRU_GEN depends on !MAXSMP. So, What is the maximum NR_CPUS supported >>> by LRU_GEN? >> >> LRU_GEN doesn't really care about NR_CPUS. IOW, it doesn't impose a >> max number. The dependency is with NODES_SHIFT selected by MAXSMP: >> default "10" if MAXSMP >> This combined with LAST_CPUPID_SHIFT can exhaust the spare bits in page flags. >> >> MAXSMP is meant for kernel developers to test their code, and it >> should not be used in production [1]. But some distros unfortunately >> ship kernels built with this option, e.g., Fedora and Ubuntu. And >> their users reported build errors to me after they applied MGLRU on >> those kernels ("Not enough bits in page flags"). Let me add Fedora and >> Ubuntu to this thread. >> >> Fedora and Ubuntu, >> >> Could you please clarify if there is a reason to ship kernels built >> with MAXSMP? Otherwise, please consider disabling this option. Thanks. >> >> As per above, MAXSMP enables ridiculously large numbers of CPUs and >> NUMA nodes for testing purposes. It is detrimental to performance, >> e.g., CPUMASK_OFFSTACK. > > It was enabled for Fedora, and RHEL because we did need more than 512 > CPUs, originally only in RHEL until SGI (years ago) complained that > they were testing very large machines with Fedora. The testing done > on RHEL showed that the performance impact was minimal. For a very > long time we had MAXSMP off and carried a patch which allowed us to > turn on CPUMASK_OFFSTACK without debugging because there was supposed > to be "something else" coming. In 2019 we gave up, dropped that patch > and just turned on MAXSMP. > > I do not have any metrics for how often someone runs Fedora on a > ridiculously large machine these days, but I would guess that number > is not 0. It is not 0. I've seen data from large systems (1000+ logical threads) that are running Fedora albeit with a modified Fedora kernel. Additionally the max limit for CPUS in RHEL is 1792, however, we have recently had a request to *double* that to 3584. You should just assume that number will continue to increase. P. > > Justin > >> [1] https://lore.kernel.org/lkml/20131106055634.GA24044@gmail.com/ >> > _______________________________________________ > kernel mailing list -- kernel@lists.fedoraproject.org > To unsubscribe send an email to kernel-leave@lists.fedoraproject.org > Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: https://lists.fedoraproject.org/archives/list/kernel@lists.fedoraproject.org > Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel