From: "Theodore Y. Ts'o" <tytso@mit.edu>
To: Andreas Dilger <adilger@dilger.ca>
Cc: Daniel Phillips <daniel@phunq.net>,
linux-ext4@vger.kernel.org, linux-kernel@vger.kernel.org,
linux-fsdevel@vger.kernel.org,
OGAWA Hirofumi <hirofumi@mail.parknet.co.jp>
Subject: Re: [RFC] Thing 1: Shardmap fox Ext4
Date: Wed, 4 Dec 2019 18:41:06 -0500 [thread overview]
Message-ID: <20191204234106.GC5641@mit.edu> (raw)
In-Reply-To: <23F33101-065E-445A-AE5C-D05E35E2B78B@dilger.ca>
On Wed, Dec 04, 2019 at 11:31:50AM -0700, Andreas Dilger wrote:
> One important use case that we have for Lustre that is not yet in the
> upstream ext4[*] is the ability to do parallel directory operations.
> This means we can create, lookup, and/or unlink entries in the same
> directory concurrently, to increase parallelism for large directories.
>
>
> [*] we've tried to submit the pdirops patch a couple of times, but the
> main blocker is that the VFS has a single directory mutex and couldn't
> use the added functionality without significant VFS changes.
> Patch at https://git.whamcloud.com/?p=fs/lustre-release.git;f=ldiskfs/kernel_patches/patches/rhel8/ext4-pdirop.patch;hb=HEAD
>
The XFS folks recently added support for parallel directory operations
into the VFS, for the benefit of XFS has this feature. So it should
be possible adjust the patch so it will work with the upstream kernel
now.
Cheers,
- Ted
next prev parent reply other threads:[~2019-12-04 23:41 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-11-27 1:47 [RFC] Thing 1: Shardmap fox Ext4 Daniel Phillips
2019-11-27 7:40 ` Vyacheslav Dubeyko
2019-11-27 8:28 ` Daniel Phillips
2019-11-27 19:35 ` Viacheslav Dubeyko
2019-11-28 2:54 ` Daniel Phillips
2019-11-28 9:15 ` Andreas Dilger
2019-11-28 10:03 ` Daniel Phillips
2019-11-27 14:25 ` Theodore Y. Ts'o
2019-11-27 22:27 ` Daniel Phillips
2019-11-28 2:28 ` Theodore Y. Ts'o
2019-11-28 4:27 ` Daniel Phillips
2019-11-30 17:50 ` Theodore Y. Ts'o
2019-12-01 8:21 ` Daniel Phillips
2019-12-04 18:31 ` Andreas Dilger
2019-12-04 21:44 ` Daniel Phillips
2019-12-05 0:36 ` Andreas Dilger
2019-12-05 2:27 ` [RFC] Thing 1: Shardmap for Ext4 Daniel Phillips
2019-12-04 23:41 ` Theodore Y. Ts'o [this message]
2019-12-06 1:16 ` [RFC] Thing 1: Shardmap fox Ext4 Dave Chinner
2019-12-06 5:09 ` [RFC] Thing 1: Shardmap for Ext4 Daniel Phillips
2019-12-08 22:42 ` Dave Chinner
2019-11-28 21:17 ` [RFC] Thing 1: Shardmap fox Ext4 Daniel Phillips
2019-12-08 10:25 ` Daniel Phillips
2019-12-02 1:45 ` Daniel Phillips
2019-12-04 15:55 ` Vyacheslav Dubeyko
2019-12-05 9:46 ` Daniel Phillips
2019-12-06 11:47 ` Vyacheslav Dubeyko
2019-12-07 0:46 ` [RFC] Thing 1: Shardmap for Ext4 Daniel Phillips
2019-12-04 18:03 ` [RFC] Thing 1: Shardmap fox Ext4 Andreas Dilger
2019-12-04 20:47 ` Daniel Phillips
2019-12-04 20:53 ` Daniel Phillips
2019-12-05 5:59 ` Daniel Phillips
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20191204234106.GC5641@mit.edu \
--to=tytso@mit.edu \
--cc=adilger@dilger.ca \
--cc=daniel@phunq.net \
--cc=hirofumi@mail.parknet.co.jp \
--cc=linux-ext4@vger.kernel.org \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).