All of lore.kernel.org
 help / color / mirror / Atom feed
From: fdmanana@kernel.org
To: linux-btrfs@vger.kernel.org
Subject: [PATCH] Btrfs: fix race between shrinking truncate and fiemap
Date: Fri,  7 Feb 2020 12:23:09 +0000	[thread overview]
Message-ID: <20200207122309.17209-1-fdmanana@kernel.org> (raw)

From: Filipe Manana <fdmanana@suse.com>

When there is a fiemap executing in parallel with a shrinking truncate we
can end up in a situation where we have extent maps for which we no longer
have corresponding file extent items. This is generally harmless and at
the moment the only consequences are missing file extent items representing
holes after we expand the file size again after the truncate operation
removed the prealloc extent items, and stale information for future fiemap
calls (reporting extents that no longer exist or may have been reallocated
to other files for example).

Consider the following example:

1) Our inode has a size of 128Kb, one 128Kb extent at file offset 0 and
   a 1Mb prealloc extent at file offset 128Kb;

2) Task A starts doing a shrinking truncate of our inode to reduce it to
   a size of 64Kb. Before it searches the subvolume tree for file extent
   items to delete, it drops all the extent maps in the range from 64Kb
   to (u64)-1 by calling btrfs_drop_extent_cache();

3) Task B starts doing a fiemap against our inode. When looking up for the
   inode's extent maps in the range from 128Kb to (u64)-1, it doesn't find
   any in the inode's extent map tree, since they were removed by task A.
   Because it didn't find any in the extent map tree, it scans the inode's
   subvolume tree for file extent items, and it finds the 1Mb prealloc
   extent at file offset 128Kb, then it creates an extent map based on
   that file extent item and adds it to inode's extent map tree (this ends
   up being done by btrfs_get_extent() <- btrfs_get_extent_fiemap() <-
   get_extent_skip_holes());

4) Task A then drops the prealloc extent at file offset 128Kb and shrinks
   the 128Kb extent file offset 0 to a length of 64Kb. The truncation
   operation finishes and we end up with an extent map representing a 1Mb
   prealloc extent at file offset 128Kb, despite we don't have any more
   that extent;

After this the two types of problems we have are:

1) Future calls to fiemap always report that a 1Mb prealloc extent exists
   at file offset 128Kb. This is stale information, no longer correct;

2) If the size of the file is increased, by a truncate operation that
   increases the file size or by a write into a file offset > 64Kb for
   example, we end up not inserting file extent items to represent
   holes for any range between 128Kb and 128Kb + 1Mb, since the hole
   expansion function, btrfs_cont_expand() will skip hole insertion
   for any range for which an extent map exists that represents a
   prealloc extent. This causes fsck to complain about missing file
   extent items when not using the NO_HOLES feature.

The second issue could be often triggered by test case generic/561 from
fstests, which runs fsstress and duperemove in parallel, and duperemove
does frequent fiemap calls.

Essentially the problems happens because fiemap does not acquire the
inode's lock while truncate does, and fiemap locks the file range in the
inode's iotree while truncate does not. So fix the issue by making
btrfs_truncate_inode_items() lock the file range from the new file size
to (u64)-1, so that it serializes with fiemap.

Signed-off-by: Filipe Manana <fdmanana@suse.com>
---
 fs/btrfs/inode.c | 8 ++++++++
 1 file changed, 8 insertions(+)

diff --git a/fs/btrfs/inode.c b/fs/btrfs/inode.c
index ac22ba472c68..90c404ae242a 100644
--- a/fs/btrfs/inode.c
+++ b/fs/btrfs/inode.c
@@ -4684,6 +4684,8 @@ int btrfs_truncate_inode_items(struct btrfs_trans_handle *trans,
 	u64 bytes_deleted = 0;
 	bool be_nice = false;
 	bool should_throttle = false;
+	const u64 lock_start = ALIGN_DOWN(new_size, fs_info->sectorsize);
+	struct extent_state *cached_state = NULL;
 
 	BUG_ON(new_size > 0 && min_type != BTRFS_EXTENT_DATA_KEY);
 
@@ -4700,6 +4702,9 @@ int btrfs_truncate_inode_items(struct btrfs_trans_handle *trans,
 		return -ENOMEM;
 	path->reada = READA_BACK;
 
+	lock_extent_bits(&BTRFS_I(inode)->io_tree, lock_start, (u64)-1,
+			 &cached_state);
+
 	/*
 	 * We want to drop from the next block forward in case this new size is
 	 * not block aligned since we will be keeping the last block of the
@@ -4993,6 +4998,9 @@ int btrfs_truncate_inode_items(struct btrfs_trans_handle *trans,
 		btrfs_inode_safe_disk_i_size_write(inode, last_size);
 	}
 
+	unlock_extent_cached(&BTRFS_I(inode)->io_tree, lock_start, (u64)-1,
+			     &cached_state);
+
 	btrfs_free_path(path);
 	return ret;
 }
-- 
2.11.0


             reply	other threads:[~2020-02-07 12:23 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-02-07 12:23 fdmanana [this message]
2020-02-07 16:19 ` [PATCH] Btrfs: fix race between shrinking truncate and fiemap Josef Bacik
2020-02-11 19:45 ` David Sterba

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20200207122309.17209-1-fdmanana@kernel.org \
    --to=fdmanana@kernel.org \
    --cc=linux-btrfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.