From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0BEF9C4320E for ; Fri, 27 Aug 2021 21:41:29 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id ED177600CD for ; Fri, 27 Aug 2021 21:41:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232009AbhH0VmQ (ORCPT ); Fri, 27 Aug 2021 17:42:16 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35566 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231696AbhH0VmM (ORCPT ); Fri, 27 Aug 2021 17:42:12 -0400 Received: from mail-io1-xd2a.google.com (mail-io1-xd2a.google.com [IPv6:2607:f8b0:4864:20::d2a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 31F77C0613D9; Fri, 27 Aug 2021 14:41:23 -0700 (PDT) Received: by mail-io1-xd2a.google.com with SMTP id a15so10474230iot.2; Fri, 27 Aug 2021 14:41:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=hZLiKEdmxy2XymDIV79zNDsfKqVBV5SHf0jshhrTnSg=; b=UY+h+XuCx+JsjRmG9x4MbhZKnih3FW6xx7c8U2nqe0reS52OXYNkd30F3rgFF2gc8h ++hzosS6lZ3I4aJgTlFWy5hgy+agZLOYYo3NR22f0e2XrsGpEeogYxFe0OVz/1k9QrKk kq4UHdbCpsSJ7qQgrP4blPM9Ix3BTTn2EleLpPkWcgB5/6io9O3fOAiVR+IVkYGJHOGW TDVEy8IqoGyw8+2OAD+MWpJtHPHpHIow7MuQsh3DsM5+FJr5Ue5iim0E0Y8Dn42aw5D7 Rk1GDVnH9IjUAsB2RJlWlZz/KODQn/fjI46vMkCwRqkAg5G4TMW2rfkR7R0Xw7D54SBz smQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=hZLiKEdmxy2XymDIV79zNDsfKqVBV5SHf0jshhrTnSg=; b=T3bK/DLYB3S14PSlY6WuGBLaNsmO2LeHGbX7jgHA3p74h1sObP1+qJiUI7iQXIcLdz EqfKeKWOfmrpsQZNYm4Uxva1fYOFBha7LaejDvYQ8mAbIv6BQbHy/tRgE9kPZf0/hIom dAV4tbBqNOTUk4Uck70u9H9oK63QO39R0rLaMzTZLwOcDAiIPpH+ECAYo3RLdM/GXDjq /7iv2FCgsMDv7SI38IiO7KZwtFgQuqVtQsjj/iMlAXihmXh/Kcj8svR5sN9kRujmpm9+ RZ5kdGVuSA94qasFRhTk4YWuG8ZcrBNdBFI93pK6yC31LspYq53Ur1c6PTBbi3LAKSQ2 JxUA== X-Gm-Message-State: AOAM530fDuSZ7ud+32bzATxxzURw4o/CALUG5TkkdZUNfhk5F/jmzYgk X9/IQz2QJHGxhd7eNso+RpQHyrAuTD6By/9sAoI= X-Google-Smtp-Source: ABdhPJyp4H1blX3LEu8j1s0mTA9EKMgRd2uYuAVN5JE6aTJmk/SpUOZAOkACDtaTD5IPGlE78hMZyI4/e2tq3PKbHQE= X-Received: by 2002:a6b:6319:: with SMTP id p25mr9282044iog.100.1630100482648; Fri, 27 Aug 2021 14:41:22 -0700 (PDT) MIME-Version: 1.0 References: <20210826004555.GF12597@magnolia> In-Reply-To: From: Dan Williams Date: Fri, 27 Aug 2021 14:41:11 -0700 Message-ID: Subject: Re: [GIT PULL] Memory folios for v5.15 To: Matthew Wilcox Cc: Johannes Weiner , "Darrick J. Wong" , Linus Torvalds , linux-mm , linux-fsdevel , Linux Kernel Mailing List , Andrew Morton Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Aug 27, 2021 at 11:47 AM Matthew Wilcox wrote: > > On Fri, Aug 27, 2021 at 10:07:16AM -0400, Johannes Weiner wrote: > > We have the same thoughts in MM and growing memory sizes. The DAX > > stuff said from the start it won't be built on linear struct page > > mappings anymore because we expect the memory modules to be too big to > > manage them with such fine-grained granularity. > > Well, I did. Then I left Intel, and Dan took over. Now we have a struct > page for each 4kB of PMEM. I'm not particularly happy about this change > of direction. Page-less DAX left more problems than it solved. Meanwhile, ZONE_DEVICE has spawned other useful things like peer-to-peer DMA. I am more encouraged by efforts to make the 'struct page' overhead disappear, first from Muchun Song for hugetlbfs and recently Joao Martins for device-dax. If anything, I think 'struct page' for PMEM / DAX *strengthens* the case for folios / better mechanisms to reduce the overhead of tracking 4K pages. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 20C42C432BE for ; Fri, 27 Aug 2021 21:41:25 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id B1655604D7 for ; Fri, 27 Aug 2021 21:41:24 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org B1655604D7 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvack.org Received: by kanga.kvack.org (Postfix) id 1D1D0900004; Fri, 27 Aug 2021 17:41:24 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 18240900002; Fri, 27 Aug 2021 17:41:24 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 07060900004; Fri, 27 Aug 2021 17:41:24 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0080.hostedemail.com [216.40.44.80]) by kanga.kvack.org (Postfix) with ESMTP id E0ECF900002 for ; Fri, 27 Aug 2021 17:41:23 -0400 (EDT) Received: from smtpin34.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with ESMTP id 80A6B8249980 for ; Fri, 27 Aug 2021 21:41:23 +0000 (UTC) X-FDA: 78522182046.34.FB021EA Received: from mail-io1-f41.google.com (mail-io1-f41.google.com [209.85.166.41]) by imf14.hostedemail.com (Postfix) with ESMTP id 3D4D46001984 for ; Fri, 27 Aug 2021 21:41:23 +0000 (UTC) Received: by mail-io1-f41.google.com with SMTP id q3so10468724iot.3 for ; Fri, 27 Aug 2021 14:41:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=hZLiKEdmxy2XymDIV79zNDsfKqVBV5SHf0jshhrTnSg=; b=UY+h+XuCx+JsjRmG9x4MbhZKnih3FW6xx7c8U2nqe0reS52OXYNkd30F3rgFF2gc8h ++hzosS6lZ3I4aJgTlFWy5hgy+agZLOYYo3NR22f0e2XrsGpEeogYxFe0OVz/1k9QrKk kq4UHdbCpsSJ7qQgrP4blPM9Ix3BTTn2EleLpPkWcgB5/6io9O3fOAiVR+IVkYGJHOGW TDVEy8IqoGyw8+2OAD+MWpJtHPHpHIow7MuQsh3DsM5+FJr5Ue5iim0E0Y8Dn42aw5D7 Rk1GDVnH9IjUAsB2RJlWlZz/KODQn/fjI46vMkCwRqkAg5G4TMW2rfkR7R0Xw7D54SBz smQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=hZLiKEdmxy2XymDIV79zNDsfKqVBV5SHf0jshhrTnSg=; b=P/yLqJFABildS4iSnf8tGphOZa5fmuvhpB7LZC8SbiL9TrxqlxJfJVE2+s/ddg+XJE 0JfAHsioUeNqBvb/Z61iDgoYx8u3zZM6DyWSMP3f1rH+C+JS35dqDPJtuVFZfZ9DXlcy 9N4Eu2C7j+CBjxwKtVNPVBsTQCMI3vlWH+ck1CfqnHMyKcJfDdVzHjLBJ/LNPUgyGXv8 RqQgzS+t8dNCsV2LqvJr28qkAPGbZvQCDd2zq6EYEqVMSqIa1G9iivtNLhPN5pUAjkLz nxtYvtR3vxtAikFMZwgdFUDMZRz5L5upq78GD0wjMf62VJRjw1jda88jehrlFbryIGtq +2gA== X-Gm-Message-State: AOAM5306m5XSYLQqG5nDeRycVFO6nPWmPFDpYsn9zt5sDT6hZqeSE3zB 5+7ImoNi4X7NA1zsOa/P0IF6Tb7mmYjOuP3iCqk5C6Q3pTM= X-Google-Smtp-Source: ABdhPJyp4H1blX3LEu8j1s0mTA9EKMgRd2uYuAVN5JE6aTJmk/SpUOZAOkACDtaTD5IPGlE78hMZyI4/e2tq3PKbHQE= X-Received: by 2002:a6b:6319:: with SMTP id p25mr9282044iog.100.1630100482648; Fri, 27 Aug 2021 14:41:22 -0700 (PDT) MIME-Version: 1.0 References: <20210826004555.GF12597@magnolia> In-Reply-To: From: Dan Williams Date: Fri, 27 Aug 2021 14:41:11 -0700 Message-ID: Subject: Re: [GIT PULL] Memory folios for v5.15 To: Matthew Wilcox Cc: Johannes Weiner , "Darrick J. Wong" , Linus Torvalds , linux-mm , linux-fsdevel , Linux Kernel Mailing List , Andrew Morton Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 3D4D46001984 Authentication-Results: imf14.hostedemail.com; dkim=pass header.d=intel-com.20150623.gappssmtp.com header.s=20150623 header.b=UY+h+XuC; dmarc=fail reason="SPF not aligned (relaxed), DKIM not aligned (relaxed)" header.from=intel.com (policy=none); spf=pass (imf14.hostedemail.com: domain of danjwilliams@gmail.com designates 209.85.166.41 as permitted sender) smtp.mailfrom=danjwilliams@gmail.com X-Rspamd-Server: rspam01 X-Stat-Signature: hzkfh38sghsdfdsafhyh4ihaip78eb49 X-HE-Tag: 1630100483-212177 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, Aug 27, 2021 at 11:47 AM Matthew Wilcox wrote: > > On Fri, Aug 27, 2021 at 10:07:16AM -0400, Johannes Weiner wrote: > > We have the same thoughts in MM and growing memory sizes. The DAX > > stuff said from the start it won't be built on linear struct page > > mappings anymore because we expect the memory modules to be too big to > > manage them with such fine-grained granularity. > > Well, I did. Then I left Intel, and Dan took over. Now we have a struct > page for each 4kB of PMEM. I'm not particularly happy about this change > of direction. Page-less DAX left more problems than it solved. Meanwhile, ZONE_DEVICE has spawned other useful things like peer-to-peer DMA. I am more encouraged by efforts to make the 'struct page' overhead disappear, first from Muchun Song for hugetlbfs and recently Joao Martins for device-dax. If anything, I think 'struct page' for PMEM / DAX *strengthens* the case for folios / better mechanisms to reduce the overhead of tracking 4K pages.