From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0202FC4338F for ; Mon, 26 Jul 2021 14:19:34 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 8CB5A60F44 for ; Mon, 26 Jul 2021 14:19:34 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 8CB5A60F44 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=mit.edu Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvack.org Received: by kanga.kvack.org (Postfix) id 302D28E000A; Mon, 26 Jul 2021 10:19:34 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 2B2B38E0001; Mon, 26 Jul 2021 10:19:34 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1C87D8E000A; Mon, 26 Jul 2021 10:19:34 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0246.hostedemail.com [216.40.44.246]) by kanga.kvack.org (Postfix) with ESMTP id 009B38E0001 for ; Mon, 26 Jul 2021 10:19:33 -0400 (EDT) Received: from smtpin21.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id A2ED918079 for ; Mon, 26 Jul 2021 14:19:33 +0000 (UTC) X-FDA: 78404947026.21.C10F8D9 Received: from outgoing.mit.edu (outgoing-auth-1.mit.edu [18.9.28.11]) by imf11.hostedemail.com (Postfix) with ESMTP id 2C9C0F000201 for ; Mon, 26 Jul 2021 14:19:33 +0000 (UTC) Received: from cwcc.thunk.org (pool-72-74-133-215.bstnma.fios.verizon.net [72.74.133.215]) (authenticated bits=0) (User authenticated as tytso@ATHENA.MIT.EDU) by outgoing.mit.edu (8.14.7/8.12.4) with ESMTP id 16QEJBnQ002055 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 26 Jul 2021 10:19:12 -0400 Received: by cwcc.thunk.org (Postfix, from userid 15806) id 8E64C15C37CE; Mon, 26 Jul 2021 10:19:11 -0400 (EDT) Date: Mon, 26 Jul 2021 10:19:11 -0400 From: "Theodore Ts'o" To: Andres Freund Cc: Matthew Wilcox , James Bottomley , linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, Linus Torvalds , Andrew Morton , "Darrick J. Wong" , Christoph Hellwig , Michael Larabel Subject: Re: Folios give an 80% performance win Message-ID: References: <20210715033704.692967-1-willy@infradead.org> <1e48f7edcb6d9a67e8b78823660939007e14bae1.camel@HansenPartnership.com> <17a9d8bf-cd52-4e6c-9b3e-2fbc1e4592d9@www.fastmail.com> <4c634d08-c658-44cf-ac92-92097eeb8532@www.fastmail.com> <20210724214413.fqsbjxhhodfzchs6@alap3.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210724214413.fqsbjxhhodfzchs6@alap3.anarazel.de> Authentication-Results: imf11.hostedemail.com; dkim=none; spf=none (imf11.hostedemail.com: domain of tytso@mit.edu has no SPF policy when checking 18.9.28.11) smtp.mailfrom=tytso@mit.edu; dmarc=none X-Rspamd-Server: rspam02 X-Stat-Signature: nzckbyxh7q5t1h8tbcaq1eirf5wq8ris X-Rspamd-Queue-Id: 2C9C0F000201 X-HE-Tag: 1627309173-365876 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Sat, Jul 24, 2021 at 02:44:13PM -0700, Andres Freund wrote: > The phoronix test uses postgres with only one relevant setting adjusted > (increasing the max connection count). That will end up using a buffer pool of > 128MB, no huge pages, and importantly is configured to aim for not more than > 1GB for postgres' journal, which will lead to constant checkpointing. The test > also only runs for 15 seconds, which likely isn't even enough to "warm up" > (the creation of the data set here will take longer than the run). > > Given that the dataset phoronix is using is about ~16GB of data (excluding > WAL), and uses 256 concurrent clients running full tilt, using that limited > postgres settings doesn't end up measuring something particularly interesting > in my opinion. Hi Andreas, I tend to use the phoronix test suite for my performance runs when testing ext4 changes simply because it's convenient. Can you suggest a better set configuration settings that I should perhaps use that might give more "real world" numbers that you would find more significant? Thanks, - Ted