From: Vyacheslav Dubeyko <slava@dubeyko.com> To: Daniel Phillips <daniel@phunq.net>, "Theodore Y. Ts'o" <tytso@mit.edu> Cc: linux-ext4@vger.kernel.org, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org, OGAWA Hirofumi <hirofumi@mail.parknet.co.jp> Subject: Re: [RFC] Thing 1: Shardmap fox Ext4 Date: Fri, 06 Dec 2019 14:47:57 +0300 Message-ID: <37c9494c40998d23d0d68afaa5a7f942a23e8986.camel@dubeyko.com> (raw) In-Reply-To: <c61706fb-3534-72b9-c4ae-0f0972bc566b@phunq.net> On Thu, 2019-12-05 at 01:46 -0800, Daniel Phillips wrote: > On 2019-12-04 7:55 a.m., Vyacheslav Dubeyko wrote: > > > <snipped and reoredered> > And here is a diagram of the Shardmap three level hashing scheme, > which ties everything together: > > https://github.com/danielbot/Shardmap/wiki/Shardmap-hashing-scheme > > This needs explanation. It is something new that you won't find in > any > textbook, this is the big reveal right here. > This diagram is pretty good and provides the high-level view of the whole scheme. But, maybe, it makes sense to show the granularity of hash code. It looks like the low hash is the hash of a name. Am I correct? But how the mid- and high- parts of the hash code are defined? It looks like that cached shard stores LBAs of record entry blocks are associated with the low hash values. But what does it mean that shard is cached? Here is a diagram of the cache structures, very simple: > > https://github.com/danielbot/Shardmap/wiki/Shardmap-cache-format > This diagram is not easy to relate with the previous one. So, shard table and shard array are the same entities or not? Or do you mean that shard table is storeed on the volume but shard array is constructed in memory? >There is a diagram here: > > > https://github.com/danielbot/Shardmap/wiki/Shardmap-record-block-format I am slightly confused here. Does header be located at the bottom of the record block? My understanding is that records grow from top of the block down to the header direction. Am I correct? Why header is not located at the top of the block with entry dictionary? Any special purpose here? Thanks, Viacheslav Dubeyko.
next prev parent reply index Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top 2019-11-27 1:47 Daniel Phillips 2019-11-27 7:40 ` Vyacheslav Dubeyko 2019-11-27 8:28 ` Daniel Phillips 2019-11-27 19:35 ` Viacheslav Dubeyko 2019-11-28 2:54 ` Daniel Phillips 2019-11-28 9:15 ` Andreas Dilger 2019-11-28 10:03 ` Daniel Phillips 2019-11-27 14:25 ` Theodore Y. Ts'o 2019-11-27 22:27 ` Daniel Phillips 2019-11-28 2:28 ` Theodore Y. Ts'o 2019-11-28 4:27 ` Daniel Phillips 2019-11-30 17:50 ` Theodore Y. Ts'o 2019-12-01 8:21 ` Daniel Phillips 2019-12-04 18:31 ` Andreas Dilger 2019-12-04 21:44 ` Daniel Phillips 2019-12-05 0:36 ` Andreas Dilger 2019-12-05 2:27 ` [RFC] Thing 1: Shardmap for Ext4 Daniel Phillips 2019-12-04 23:41 ` [RFC] Thing 1: Shardmap fox Ext4 Theodore Y. Ts'o 2019-12-06 1:16 ` Dave Chinner 2019-12-06 5:09 ` [RFC] Thing 1: Shardmap for Ext4 Daniel Phillips 2019-12-08 22:42 ` Dave Chinner 2019-11-28 21:17 ` [RFC] Thing 1: Shardmap fox Ext4 Daniel Phillips 2019-12-08 10:25 ` Daniel Phillips 2019-12-02 1:45 ` Daniel Phillips 2019-12-04 15:55 ` Vyacheslav Dubeyko 2019-12-05 9:46 ` Daniel Phillips 2019-12-06 11:47 ` Vyacheslav Dubeyko [this message] 2019-12-07 0:46 ` [RFC] Thing 1: Shardmap for Ext4 Daniel Phillips 2019-12-04 18:03 ` [RFC] Thing 1: Shardmap fox Ext4 Andreas Dilger 2019-12-04 20:47 ` Daniel Phillips 2019-12-04 20:53 ` Daniel Phillips 2019-12-05 5:59 ` Daniel Phillips
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=37c9494c40998d23d0d68afaa5a7f942a23e8986.camel@dubeyko.com \ --to=slava@dubeyko.com \ --cc=daniel@phunq.net \ --cc=hirofumi@mail.parknet.co.jp \ --cc=linux-ext4@vger.kernel.org \ --cc=linux-fsdevel@vger.kernel.org \ --cc=linux-kernel@vger.kernel.org \ --cc=tytso@mit.edu \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
Linux-ext4 Archive on lore.kernel.org Archives are clonable: git clone --mirror https://lore.kernel.org/linux-ext4/0 linux-ext4/git/0.git # If you have public-inbox 1.1+ installed, you may # initialize and index your mirror using the following commands: public-inbox-init -V2 linux-ext4 linux-ext4/ https://lore.kernel.org/linux-ext4 \ linux-ext4@vger.kernel.org public-inbox-index linux-ext4 Example config snippet for mirrors Newsgroup available over NNTP: nntp://nntp.lore.kernel.org/org.kernel.vger.linux-ext4 AGPL code for this site: git clone https://public-inbox.org/public-inbox.git