From: Allison Henderson <allison.henderson@oracle.com>
To: linux-block@vger.kernel.org, linux-xfs@vger.kernel.org,
linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org
Cc: martin.petersen@oracle.com, shirley.ma@oracle.com,
bob.liu@oracle.com, allison.henderson@oracle.com
Subject: [RFC PATCH v1 0/7] Block/XFS: Support alternative mirror device retry
Date: Tue, 27 Nov 2018 20:49:44 -0700 [thread overview]
Message-ID: <1543376991-5764-1-git-send-email-allison.henderson@oracle.com> (raw)
Motivation:
When fs data/metadata checksum mismatch, lower block devices may have other
correct copies. e.g. If XFS successfully reads a metadata buffer off a raid1 but
decides that the metadata is garbage, today it will shut down the entire
filesystem without trying any of the other mirrors. This is a severe
loss of service, and we propose these patches to have XFS try harder to
avoid failure.
This patch prototype this mirror retry idea by:
* Adding @nr_mirrors to struct request_queue which is similar as
blk_queue_nonrot(), filesystem can grab device request queue and check max
mirrors this block device has.
Helper functions were also added to get/set the nr_mirrors.
* Expanding bi_write_hint to bi_rw_hint, now @bi_rw_hint has three meanings.
1.Original write_hint.
2.end_io() will update @bi_rw_hint to reflect which mirror this i/o really happened.
3.Fs set @bi_rw_hint to force driver e.g raid1 read from a specific mirror.
* Modify md/raid1 to support this retry feature.
* Add b_rw_hint to xfs_buf
This patch adds a new field b_rw_hint to xfs_buf. We will use this to set the
new bio->bi_rw_hint when submitting the read request, and also to store the
returned mirror when the read compleates
* Add device retry
This patch add some logic to xfs_buf_read_map. If the read verify
fails, we loop over the available mirrors and retry the read
* Rewrite retried read
When the read verification fails, but the retry succeedes
write the buffer back to correct the bad mirror
* Add tracepoints and logging to alternate device retry.
This patch adds new log entries and trace points to the alternate device retry
error path.
We're not planning to take over all 16 bits of the read hint field; just looking for
feedback about the sanity of the overall approach.
Allison Henderson (4):
xfs: Add b_rw_hint to xfs_buf
xfs: Add device retry
xfs: Rewrite retried read
xfs: Add tracepoints and logging to alternate device retry
Bob Liu (3):
block: add nr_mirrors to request_queue
block: expand write_hint of bio/request to rw_hint
md: raid1: handle bi_rw_hint accordingly
Documentation/block/biodoc.txt | 7 ++++++
block/bio.c | 2 +-
block/blk-core.c | 13 ++++++++++-
block/blk-merge.c | 8 +++----
block/blk-settings.c | 18 ++++++++++++++
block/bounce.c | 2 +-
drivers/md/raid1.c | 33 ++++++++++++++++++++++----
drivers/md/raid5.c | 10 ++++----
drivers/md/raid5.h | 2 +-
drivers/nvme/host/core.c | 2 +-
fs/block_dev.c | 6 +++--
fs/btrfs/extent_io.c | 3 ++-
fs/buffer.c | 3 ++-
fs/direct-io.c | 3 ++-
fs/ext4/page-io.c | 7 ++++--
fs/f2fs/data.c | 2 +-
fs/iomap.c | 3 ++-
fs/mpage.c | 2 +-
fs/xfs/xfs_aops.c | 4 ++--
fs/xfs/xfs_buf.c | 53 ++++++++++++++++++++++++++++++++++++++++--
fs/xfs/xfs_buf.h | 8 +++++++
fs/xfs/xfs_trace.h | 6 ++++-
include/linux/blk_types.h | 2 +-
include/linux/blkdev.h | 5 +++-
24 files changed, 169 insertions(+), 35 deletions(-)
--
2.7.4
next reply other threads:[~2018-11-28 3:52 UTC|newest]
Thread overview: 29+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-11-28 3:49 Allison Henderson [this message]
2018-11-28 3:49 ` [PATCH v1 1/7] block: add nr_mirrors to request_queue Allison Henderson
2018-11-28 3:49 ` [PATCH v1 2/7] block: expand write_hint of bio/request to rw_hint Allison Henderson
2018-11-28 3:49 ` [PATCH v1 3/7] md: raid1: handle bi_rw_hint accordingly Allison Henderson
2018-11-28 3:49 ` [PATCH v1 4/7] xfs: Add b_rw_hint to xfs_buf Allison Henderson
2018-11-28 5:03 ` Dave Chinner
2018-11-28 3:49 ` [PATCH v1 5/7] xfs: Add device retry Allison Henderson
2018-11-28 5:08 ` Dave Chinner
2018-11-28 5:22 ` Darrick J. Wong
2018-11-28 5:38 ` Dave Chinner
2018-11-28 7:35 ` Christoph Hellwig
2018-11-28 12:41 ` Bob Liu
2018-11-28 16:47 ` Allison Henderson
2018-11-28 3:49 ` [PATCH v1 6/7] xfs: Rewrite retried read Allison Henderson
2018-11-28 5:17 ` Dave Chinner
2018-11-28 5:26 ` Darrick J. Wong
2018-11-28 5:40 ` Dave Chinner
2018-11-28 3:49 ` [PATCH v1 7/7] xfs: Add tracepoints and logging to alternate device retry Allison Henderson
2018-11-28 5:33 ` [RFC PATCH v1 0/7] Block/XFS: Support alternative mirror " Dave Chinner
2018-11-28 5:49 ` Darrick J. Wong
2018-11-28 6:30 ` Dave Chinner
2018-11-28 7:15 ` Darrick J. Wong
2018-11-28 19:38 ` Andreas Dilger
2018-11-28 7:37 ` Christoph Hellwig
2018-11-28 7:46 ` Dave Chinner
2018-11-28 7:51 ` Christoph Hellwig
2018-11-28 7:45 ` Christoph Hellwig
2018-12-08 14:49 ` Bob Liu
2018-12-10 4:30 ` Darrick J. Wong
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1543376991-5764-1-git-send-email-allison.henderson@oracle.com \
--to=allison.henderson@oracle.com \
--cc=bob.liu@oracle.com \
--cc=linux-block@vger.kernel.org \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-xfs@vger.kernel.org \
--cc=martin.petersen@oracle.com \
--cc=shirley.ma@oracle.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).