From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 23B83C5519F for ; Mon, 23 Nov 2020 00:41:29 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 8C6072078B for ; Mon, 23 Nov 2020 00:41:28 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 8C6072078B Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=cn.fujitsu.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id BAEBC6B005D; Sun, 22 Nov 2020 19:41:27 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id B602F6B0070; Sun, 22 Nov 2020 19:41:27 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A4E126B0071; Sun, 22 Nov 2020 19:41:27 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0221.hostedemail.com [216.40.44.221]) by kanga.kvack.org (Postfix) with ESMTP id 78FC26B005D for ; Sun, 22 Nov 2020 19:41:27 -0500 (EST) Received: from smtpin26.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with ESMTP id 18B58181AEF15 for ; Mon, 23 Nov 2020 00:41:27 +0000 (UTC) X-FDA: 77513829414.26.pig64_0c0db7527361 Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin26.hostedemail.com (Postfix) with ESMTP id EF7A418006FB9 for ; Mon, 23 Nov 2020 00:41:26 +0000 (UTC) X-HE-Tag: pig64_0c0db7527361 X-Filterd-Recvd-Size: 4640 Received: from heian.cn.fujitsu.com (mail.cn.fujitsu.com [183.91.158.132]) by imf03.hostedemail.com (Postfix) with ESMTP for ; Mon, 23 Nov 2020 00:41:25 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.78,361,1599494400"; d="scan'208";a="101635228" Received: from unknown (HELO cn.fujitsu.com) ([10.167.33.5]) by heian.cn.fujitsu.com with ESMTP; 23 Nov 2020 08:41:23 +0800 Received: from G08CNEXMBPEKD06.g08.fujitsu.local (unknown [10.167.33.206]) by cn.fujitsu.com (Postfix) with ESMTP id 03B5C48990F9; Mon, 23 Nov 2020 08:41:18 +0800 (CST) Received: from G08CNEXCHPEKD05.g08.fujitsu.local (10.167.33.203) by G08CNEXMBPEKD06.g08.fujitsu.local (10.167.33.206) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 23 Nov 2020 08:41:16 +0800 Received: from localhost.localdomain (10.167.225.141) by G08CNEXCHPEKD05.g08.fujitsu.local (10.167.33.209) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Mon, 23 Nov 2020 08:41:18 +0800 From: Shiyang Ruan To: , , , CC: , , , , , , , , , Subject: [RFC PATCH v2 0/6] fsdax: introduce fs query to support reflink Date: Mon, 23 Nov 2020 08:41:10 +0800 Message-ID: <20201123004116.2453-1-ruansy.fnst@cn.fujitsu.com> X-Mailer: git-send-email 2.29.2 MIME-Version: 1.0 Content-Type: text/plain X-yoursite-MailScanner-ID: 03B5C48990F9.AE527 X-yoursite-MailScanner: Found to be clean X-yoursite-MailScanner-From: ruansy.fnst@cn.fujitsu.com Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: This patchset is a try to resolve the problem of tracking shared page for fsdax. Change from v1: - Intorduce ->block_lost() for block device - Support mapped device - Add 'not available' warning for realtime device in XFS - Rebased to v5.10-rc1 This patchset moves owner tracking from dax_assocaite_entry() to pmem device, by introducing an interface ->memory_failure() of struct pagemap. The interface is called by memory_failure() in mm, and implemented by pmem device. Then pmem device calls its ->block_lost() to find the filesystem which the damaged page located in, and call ->storage_lost() to track files or metadata assocaited with this page. Finally we are able to try to fix the damaged data in filesystem and do other necessary processing, such as killing processes who are using the files affected. The call trace is like this: memory_failure() pgmap->ops->memory_failure() =3D> pmem_pgmap_memory_failure() gendisk->fops->block_lost() =3D> pmem_block_lost() or md_blk_block_lost() sb->s_ops->storage_lost() =3D> xfs_fs_storage_lost() xfs_rmap_query_range() xfs_storage_lost_helper() mf_recover_controller->recover_fn =3D> \=20 memory_failure_dev_pagemap_kill_procs() The collect_procs() and kill_procs() are moved into a callback which is passed from memory_failure() to xfs_storage_lost_helper(). So we can call it when a file assocaited is found, instead of creating a file list and iterate it. The fsdax & reflink support for XFS is not contained in this patchset. (Rebased on v5.10-rc1) Shiyang Ruan (6): fs: introduce ->storage_lost() for memory-failure blk: introduce ->block_lost() to handle memory-failure md: implement ->block_lost() for memory-failure pagemap: introduce ->memory_failure() mm, fsdax: refactor dax handler in memory-failure fsdax: remove useless (dis)associate functions block/genhd.c | 12 ++++ drivers/md/dm-linear.c | 8 +++ drivers/md/dm.c | 64 +++++++++++++++++ drivers/nvdimm/pmem.c | 50 +++++++++++++ fs/block_dev.c | 23 ++++++ fs/dax.c | 64 ++--------------- fs/xfs/xfs_super.c | 87 +++++++++++++++++++++++ include/linux/blkdev.h | 2 + include/linux/dax.h | 5 +- include/linux/device-mapper.h | 2 + include/linux/fs.h | 2 + include/linux/genhd.h | 9 +++ include/linux/memremap.h | 3 + include/linux/mm.h | 14 ++++ mm/memory-failure.c | 127 +++++++++++++++++++++------------- 15 files changed, 362 insertions(+), 110 deletions(-) --=20 2.29.2