archive mirror
 help / color / mirror / Atom feed
From: Eric Biggers <>
To: Omar Sandoval <>
Cc: Linus Torvalds <>,
	"Theodore Y. Ts'o" <>,
	Jaegeuk Kim <>,
	linux-fsdevel <>,
	linux-btrfs <>,
	Al Viro <>,
	Christoph Hellwig <>,
	Dave Chinner <>, Jann Horn <>,
	Amir Goldstein <>,
	Aleksa Sarai <>,
	Linux API <>,
	Kernel Team <>
Subject: Re: [PATCH RERESEND v9 0/9] fs: interface for directly reading/writing compressed data
Date: Mon, 17 May 2021 15:48:30 -0700	[thread overview]
Message-ID: <> (raw)
In-Reply-To: <YKLt5GyznttizBjd@relinquished.localdomain>

On Mon, May 17, 2021 at 03:27:48PM -0700, Omar Sandoval wrote:
> On Mon, May 17, 2021 at 02:32:47PM -0700, Linus Torvalds wrote:
> > On Mon, May 17, 2021 at 11:35 AM Omar Sandoval <> wrote:
> > >
> > > Patches 1-3 add the VFS support, UAPI, and documentation. Patches 4-7
> > > are Btrfs prep patches. Patch 8 adds Btrfs encoded read support and
> > > patch 9 adds Btrfs encoded write support.
> > 
> > I don't love the RWF_ENCODED flag, but if that's the way people think
> > this should be done, as a model this looks reasonable to me.
> > 
> > I'm not sure what the deal with the encryption metadata is. I realize
> > there is currently only one encryption type ("none") in this series,
> > but it's not clear how any other encryption type would actually ever
> > be described. It's not like you can pass in the key (well, I guess
> > passing in the key would be fine, but passing it back out certainly
> > would not be).  A key ID from a keyring?
> > 
> > So there's presumably some future plan for it, but it would be good to
> > verify that that plan makes sense..
> What I'm imagining for fscrypt is:
> 1. Add ENCODED_IOV_ENCRYPTION_* types for fscrypt. Consumers at least
>    need to be able to distinguish between encryption policy versions,
>    DIRECT_KEY policies, and IV_INO_LBLK_{64,32} policies, and maybe
>    other details.
> 2. Use RWF_ENCODED only for the data itself.
> 3. Add new fscrypt ioctls to get and set the encryption key.
> The interesting part is (3). If I'm reading the fscrypt documentation
> correctly, in the default mode, each file is encrypted with a per-file
> key that is a function of the master key for the directory tree and a
> per-file nonce.
> Userspace manages the master key, we have a FS_IOC_GET_ENCRYPTION_NONCE
> ioctl, and the key derivation function is documented. So, userspace
> already has all of the pieces it needs to get the encryption key, and
> all of the information it needs to decrypt the data it gets from
> RWF_ENCODED if it so desires.
> On the set/write side, the user can set the same master key and policy
> with FS_IOC_SET_ENCRYPTION_POLICY, and we'd need something like an
> FS_IOC_SET_ENCRYPTION_NONCE ioctl (possibly with a requirement that it
> be set when the file is empty). I think that's it.
> The details will vary for the other fscrypt policies, but that's the
> gist of it. I added the fscrypt maintainers to correct me if I missed
> something.

Well, assuming we're talking about regular files only (so file contents
encryption, not filenames encryption), with fscrypt the information needed to
understand a file's encrypted data is the following:

1. The encryption key

2. The filesystem's block size

3. The encryption context:

    struct fscrypt_context_v2 {                                                      
         u8 version; /* FSCRYPT_CONTEXT_V2 */                                     
         u8 contents_encryption_mode;                                             
         u8 filenames_encryption_mode;                                            
         u8 flags;                                                                
         u8 __reserved[4];                                                        
         u8 master_key_identifier[FSCRYPT_KEY_IDENTIFIER_SIZE];                   
         u8 nonce[FSCRYPT_FILE_NONCE_SIZE];                                       

   (Or alternatively struct fscrypt_policy_v2 + the nonce field separately;
    that results in the same fields as struct fscrypt_context_v2.)

This is definitely more complex than the compression cases like "the data is a
zlib stream".  So the question is, how much of this metadata (if any) should
actually be passed around during RWF_ENCODED pread/pwrite operations, and how
much should be out-of-band.

I feel like this should be mostly out-of-band (e.g. via the existing ioctls
FS_IOC_{GET,SET}_ENCRYPTION_POLICY), especially given that compression and
encryption could be combined which would make describing the on-disk data even
more difficult.

But I'm not sure what you intended.

- Eric

  reply	other threads:[~2021-05-17 22:48 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-05-17 18:35 [PATCH RERESEND v9 0/9] fs: interface for directly reading/writing compressed data Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 1/9] iov_iter: add copy_struct_from_iter() Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 2/9] fs: add O_ALLOW_ENCODED open flag Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 3/9] fs: add RWF_ENCODED for reading/writing compressed data Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 4/9] btrfs: don't advance offset for compressed bios in btrfs_csum_one_bio() Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 5/9] btrfs: add ram_bytes and offset to btrfs_ordered_extent Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 6/9] btrfs: support different disk extent size for delalloc Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 7/9] btrfs: optionally extend i_size in cow_file_range_inline() Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 8/9] btrfs: implement RWF_ENCODED reads Omar Sandoval
2021-05-17 18:35 ` [PATCH RERESEND v9 9/9] btrfs: implement RWF_ENCODED writes Omar Sandoval
2021-05-17 21:32 ` [PATCH RERESEND v9 0/9] fs: interface for directly reading/writing compressed data Linus Torvalds
2021-05-17 22:27   ` Omar Sandoval
2021-05-17 22:48     ` Eric Biggers [this message]
2021-05-17 23:25       ` Omar Sandoval
2021-05-18  0:07         ` Eric Biggers
2021-05-18  2:53         ` Theodore Y. Ts'o
2021-05-18  8:38           ` Omar Sandoval
2021-05-18 16:21             ` Theodore Y. Ts'o
2021-06-07 19:27   ` Omar Sandoval

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).