CEPH-Devel Archive on lore.kernel.org
 help / color / Atom feed
From: Jeff Layton <jlayton@kernel.org>
To: ceph-devel@vger.kernel.org
Cc: linux-fscrypt@vger.kernel.org, linux-fsdevel@vger.kernel.org
Subject: Re: [RFC PATCH v5 00/19] ceph+fscrypt: context, filename and symlink support
Date: Fri, 26 Mar 2021 14:38:10 -0400
Message-ID: <f7e34bd93f8e774cf11ff059d040a7ec19ef0b19.camel@kernel.org> (raw)
In-Reply-To: <20210326173227.96363-1-jlayton@kernel.org>

On Fri, 2021-03-26 at 13:32 -0400, Jeff Layton wrote:
> I haven't posted this in a while and there were some bugs shaken out of
> the last posting. This adds (partial) support for fscrypt to kcephfs,
> including crypto contexts, filenames and encrypted symlink targets. At
> this point, the xfstests quick tests that generally pass without fscrypt
> also pass with test_dummy_encryption enabled.
> 
> There is one lingering bug that I'm having trouble tracking down: xfstest
> generic/477 (an open_by_handle_at test) sometimes throws a "Busy inodes
> after umount" warning. I'm narrowed down the issue a bit, but there is
> some raciness involved so I haven't quite nailed it down yet.
> 
> This set is quite invasive. There is probably some further work to be
> done to add common code helpers and the like, but the final diffstat
> probably won't look too different.
> 
> This set does not include encryption of file contents. That is turning
> out to be a bit trickier than first expected owing to the fact that the
> MDS is usually what handles truncation, and the i_size no longer
> represents the amount of data stored in the backing store. That will
> probably require an MDS change to fix, and we're still sorting out the
> details.
> 
> Jeff Layton (19):
>   vfs: export new_inode_pseudo
>   fscrypt: export fscrypt_base64_encode and fscrypt_base64_decode
>   fscrypt: export fscrypt_fname_encrypt and fscrypt_fname_encrypted_size
>   fscrypt: add fscrypt_context_for_new_inode
>   ceph: crypto context handling for ceph
>   ceph: implement -o test_dummy_encryption mount option
>   ceph: preallocate inode for ops that may create one
>   ceph: add routine to create fscrypt context prior to RPC
>   ceph: make ceph_msdc_build_path use ref-walk
>   ceph: add encrypted fname handling to ceph_mdsc_build_path
>   ceph: decode alternate_name in lease info
>   ceph: send altname in MClientRequest
>   ceph: properly set DCACHE_NOKEY_NAME flag in lookup
>   ceph: make d_revalidate call fscrypt revalidator for encrypted
>     dentries
>   ceph: add helpers for converting names for userland presentation
>   ceph: add fscrypt support to ceph_fill_trace
>   ceph: add support to readdir for encrypted filenames
>   ceph: create symlinks with encrypted and base64-encoded targets
>   ceph: add fscrypt ioctls
> 
>  fs/ceph/Makefile            |   1 +
>  fs/ceph/crypto.c            | 185 +++++++++++++++++++++++
>  fs/ceph/crypto.h            | 101 +++++++++++++
>  fs/ceph/dir.c               | 178 ++++++++++++++++++-----
>  fs/ceph/file.c              |  56 ++++---
>  fs/ceph/inode.c             | 255 +++++++++++++++++++++++++++++---
>  fs/ceph/ioctl.c             |  94 ++++++++++++
>  fs/ceph/mds_client.c        | 283 ++++++++++++++++++++++++++++++------
>  fs/ceph/mds_client.h        |  14 +-
>  fs/ceph/super.c             |  80 +++++++++-
>  fs/ceph/super.h             |  16 +-
>  fs/ceph/xattr.c             |  32 ++++
>  fs/crypto/fname.c           |  53 +++++--
>  fs/crypto/fscrypt_private.h |   9 +-
>  fs/crypto/hooks.c           |   6 +-
>  fs/crypto/policy.c          |  34 ++++-
>  fs/inode.c                  |   1 +
>  include/linux/fscrypt.h     |  10 ++
>  18 files changed, 1246 insertions(+), 162 deletions(-)
>  create mode 100644 fs/ceph/crypto.c
>  create mode 100644 fs/ceph/crypto.h
> 

Oh, I should mention that this is all in my ceph-fscrypt-fnames branch:

    https://git.kernel.org/pub/scm/linux/kernel/git/jlayton/linux.git/

This all still under heavy development, so I'm open to suggestions and
review. If you're daring and want to test with it, please do.

I do think this has the potential to be a "killer feature" for ceph (and
maybe other network filesystems). Being able to store data securely on
an otherwise "public" cluster seems like a very nice thing to have.

Cheers,
-- 
Jeff Layton <jlayton@kernel.org>


  parent reply index

Thread overview: 39+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-03-26 17:32 Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 01/19] vfs: export new_inode_pseudo Jeff Layton
2021-04-08  1:08   ` Eric Biggers
2021-04-08 16:18     ` Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 02/19] fscrypt: export fscrypt_base64_encode and fscrypt_base64_decode Jeff Layton
2021-04-08  1:06   ` Eric Biggers
2021-04-08 16:22     ` Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 03/19] fscrypt: export fscrypt_fname_encrypt and fscrypt_fname_encrypted_size Jeff Layton
2021-04-08  1:19   ` Eric Biggers
2021-03-26 17:32 ` [RFC PATCH v5 04/19] fscrypt: add fscrypt_context_for_new_inode Jeff Layton
2021-04-08  1:21   ` Eric Biggers
2021-04-08 16:27     ` Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 05/19] ceph: crypto context handling for ceph Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 06/19] ceph: implement -o test_dummy_encryption mount option Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 07/19] ceph: preallocate inode for ops that may create one Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 08/19] ceph: add routine to create fscrypt context prior to RPC Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 09/19] ceph: make ceph_msdc_build_path use ref-walk Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 10/19] ceph: add encrypted fname handling to ceph_mdsc_build_path Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 11/19] ceph: decode alternate_name in lease info Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 12/19] ceph: send altname in MClientRequest Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 13/19] ceph: properly set DCACHE_NOKEY_NAME flag in lookup Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 14/19] ceph: make d_revalidate call fscrypt revalidator for encrypted dentries Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 15/19] ceph: add helpers for converting names for userland presentation Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 16/19] ceph: add fscrypt support to ceph_fill_trace Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 17/19] ceph: add support to readdir for encrypted filenames Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 18/19] ceph: create symlinks with encrypted and base64-encoded targets Jeff Layton
2021-03-26 17:32 ` [RFC PATCH v5 19/19] ceph: add fscrypt ioctls Jeff Layton
2021-04-06 15:38   ` Luis Henriques
2021-04-06 16:03     ` Jeff Layton
2021-04-06 16:24       ` Luis Henriques
2021-04-06 17:27         ` Jeff Layton
2021-04-06 18:04           ` Luis Henriques
2021-04-07 12:47             ` Jeff Layton
2021-03-26 18:38 ` Jeff Layton [this message]
2021-03-31 20:35 ` [RFC PATCH v5 20/19] ceph: make ceph_get_name decrypt filenames Jeff Layton
2021-04-01 11:14   ` Luis Henriques
2021-04-01 12:15     ` Jeff Layton
2021-04-01 13:05       ` Luis Henriques
2021-04-01 13:12         ` Jeff Layton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=f7e34bd93f8e774cf11ff059d040a7ec19ef0b19.camel@kernel.org \
    --to=jlayton@kernel.org \
    --cc=ceph-devel@vger.kernel.org \
    --cc=linux-fscrypt@vger.kernel.org \
    --cc=linux-fsdevel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

CEPH-Devel Archive on lore.kernel.org

Archives are clonable:
	git clone --mirror https://lore.kernel.org/ceph-devel/0 ceph-devel/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 ceph-devel ceph-devel/ https://lore.kernel.org/ceph-devel \
		ceph-devel@vger.kernel.org
	public-inbox-index ceph-devel

Example config snippet for mirrors

Newsgroup available over NNTP:
	nntp://nntp.lore.kernel.org/org.kernel.vger.ceph-devel


AGPL code for this site: git clone https://public-inbox.org/public-inbox.git