From: Matthew Wilcox <willy@infradead.org>
To: "Martin K. Petersen" <martin.petersen@oracle.com>
Cc: Linus Torvalds <torvalds@linux-foundation.org>,
Omar Sandoval <osandov@osandov.com>,
Al Viro <viro@zeniv.linux.org.uk>,
Dave Chinner <david@fromorbit.com>,
linux-fsdevel <linux-fsdevel@vger.kernel.org>,
linux-btrfs <linux-btrfs@vger.kernel.org>,
Linux API <linux-api@vger.kernel.org>,
Kernel Team <kernel-team@fb.com>,
Dave Chinner <dchinner@redhat.com>
Subject: Re: [PATCH RESEND x3 v9 1/9] iov_iter: add copy_struct_from_iter()
Date: Fri, 25 Jun 2021 04:38:15 +0100 [thread overview]
Message-ID: <YNVPp/Pgqshami3U@casper.infradead.org> (raw)
In-Reply-To: <yq1tulmoqxf.fsf@ca-mkp.ca.oracle.com>
On Thu, Jun 24, 2021 at 06:41:52PM -0400, Martin K. Petersen wrote:
>
> Linus,
>
> > I also worry that this "raw compressed data" thing isn't the only
> > thing people will want to do. I could easily see some kind of
> > "end-to-end CRC read/write" where the user passes in not just the
> > data, but also checksums for it to validate it (maybe because you're
> > doing a file copy and had the original checksums, but also maybe
> > because user space simply has a known good copy and doesn't want
> > errors re-introduced due to memory corruption).
>
> We already support passing CRCs down to be validated by the hardware for
> both NVMe and SCSI. This currently only works from the block layer
> down. When enabled, the checksums are generated by the block layer for
> writes and the data is validated against the checksums sent by the
> storage on reads.
>
> Over the years various attempts at adding support for passing the
> checksum buffers in from userland have failed for exactly the reasons
> outlined in this thread (Joel, Darrick, Bob). Would love to have a
> generic way of passing this kind of information...
Does it make any kind of sense to talk about doing this for buffered I/O,
given that we can't generate them for (eg) mmaped files? Or does this
only make sense to pass in for O_DIRECT accesses?
next prev parent reply other threads:[~2021-06-25 3:38 UTC|newest]
Thread overview: 50+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-06-17 23:51 [PATCH RESEND x3 v9 0/9] fs: interface for directly reading/writing compressed data Omar Sandoval
2021-06-17 23:51 ` [PATCH RESEND x3 v9 1/9] iov_iter: add copy_struct_from_iter() Omar Sandoval
2021-06-18 18:50 ` Linus Torvalds
2021-06-18 19:42 ` Al Viro
2021-06-18 19:49 ` Al Viro
2021-06-18 20:33 ` Omar Sandoval
2021-06-18 20:32 ` Omar Sandoval
2021-06-18 20:58 ` Al Viro
2021-06-18 21:10 ` Linus Torvalds
2021-06-18 21:32 ` Al Viro
2021-06-18 21:40 ` Linus Torvalds
2021-06-18 22:10 ` Omar Sandoval
2021-06-18 22:32 ` Al Viro
2021-06-19 0:43 ` Omar Sandoval
2021-06-21 18:46 ` Omar Sandoval
2021-06-21 19:33 ` Linus Torvalds
2021-06-21 20:46 ` Omar Sandoval
2021-06-21 20:53 ` Omar Sandoval
2021-06-21 20:55 ` Omar Sandoval
2021-06-22 22:06 ` Dave Chinner
2021-06-23 17:49 ` Omar Sandoval
2021-06-23 18:28 ` Linus Torvalds
2021-06-23 19:33 ` Omar Sandoval
2021-06-23 19:45 ` Al Viro
2021-06-23 20:46 ` Omar Sandoval
2021-06-23 21:39 ` Al Viro
2021-06-23 21:58 ` Omar Sandoval
2021-06-23 22:26 ` Al Viro
2021-06-24 2:00 ` Matthew Wilcox
2021-06-24 6:14 ` Omar Sandoval
2021-06-24 17:52 ` Linus Torvalds
2021-06-24 18:28 ` Omar Sandoval
2021-06-24 21:07 ` Linus Torvalds
2021-06-24 22:41 ` Martin K. Petersen
2021-06-25 3:38 ` Matthew Wilcox [this message]
2021-06-25 16:16 ` Linus Torvalds
2021-06-25 21:07 ` Omar Sandoval
2021-07-07 17:59 ` Omar Sandoval
2021-07-19 15:44 ` Josef Bacik
2021-06-24 6:41 ` Christoph Hellwig
2021-06-24 7:50 ` Omar Sandoval
2021-06-18 22:14 ` Al Viro
2021-06-17 23:51 ` [PATCH RESEND x3 v9 2/9] fs: add O_ALLOW_ENCODED open flag Omar Sandoval
2021-06-17 23:51 ` [PATCH RESEND x3 v9 3/9] fs: add RWF_ENCODED for reading/writing compressed data Omar Sandoval
2021-06-17 23:51 ` [PATCH RESEND x3 v9 4/9] btrfs: don't advance offset for compressed bios in btrfs_csum_one_bio() Omar Sandoval
2021-06-17 23:51 ` [PATCH RESEND x3 v9 5/9] btrfs: add ram_bytes and offset to btrfs_ordered_extent Omar Sandoval
2021-06-17 23:51 ` [PATCH RESEND x3 v9 6/9] btrfs: support different disk extent size for delalloc Omar Sandoval
2021-06-17 23:51 ` [PATCH RESEND x3 v9 7/9] btrfs: optionally extend i_size in cow_file_range_inline() Omar Sandoval
2021-06-17 23:51 ` [PATCH RESEND x3 v9 8/9] btrfs: implement RWF_ENCODED reads Omar Sandoval
2021-06-17 23:51 ` [PATCH RESEND x3 v9 9/9] btrfs: implement RWF_ENCODED writes Omar Sandoval
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=YNVPp/Pgqshami3U@casper.infradead.org \
--to=willy@infradead.org \
--cc=david@fromorbit.com \
--cc=dchinner@redhat.com \
--cc=kernel-team@fb.com \
--cc=linux-api@vger.kernel.org \
--cc=linux-btrfs@vger.kernel.org \
--cc=linux-fsdevel@vger.kernel.org \
--cc=martin.petersen@oracle.com \
--cc=osandov@osandov.com \
--cc=torvalds@linux-foundation.org \
--cc=viro@zeniv.linux.org.uk \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).