linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Gao Xiang <xiang@kernel.org>
To: linux-erofs@lists.ozlabs.org, Chao Yu <chao@kernel.org>
Cc: LKML <linux-kernel@vger.kernel.org>, Gao Xiang <xiang@kernel.org>
Subject: [PATCH 0/3] erofs: some decompression improvements
Date: Fri,  8 Oct 2021 01:06:02 +0800	[thread overview]
Message-ID: <20211007170605.7062-1-xiang@kernel.org> (raw)

Hi folks,

This patchset is mainly intended for the upcoming LZMA preparation,
but they still have some benefits to the exist LZ4 decompression.

The first patch looks up compression algorithms on mapping instead
of in the decompression frontend, which is used for the rest patches.

The second patch introduces another compression HEAD (HEAD2) so that
each file can be compressed with two different algorithms at most,
which can be used for the upcoming LZMA compression and LZ4 range
dictionary compression for various data patterns.

The third patch introduces a new readmore decompression strategy to
avoid partial decompression for large big pcluster. It resolves the
randread issue mentioned in the original big pcluster patchset [1]:

randread
Kernel: 5.15.0-rc2+
pclustersize		Vanilla		Patched
 4096			 54.6 MiB/s	 54.0 MiB/s
16384			117.4 MiB/s	143.8 MiB/s
32768			113.6 MiB/s	199.6 MiB/s
65536			 72.8 MiB/s	236.4 MiB/s

The latest version can also be fetched from
git://git.kernel.org/pub/scm/linux/kernel/git/xiang/linux.git -b erofs/readmore

[1] https://lore.kernel.org/r/20210407043927.10623-1-xiang@kernel.org

Thanks,
Gao Xiang

Gao Xiang (3):
  erofs: get compression algorithms directly on mapping
  erofs: introduce the secondary compression head
  erofs: introduce readmore decompression strategy

 fs/erofs/compress.h          |   5 --
 fs/erofs/erofs_fs.h          |   8 ++-
 fs/erofs/internal.h          |  28 ++++++++-
 fs/erofs/zdata.c             | 106 ++++++++++++++++++++++++++---------
 fs/erofs/zmap.c              |  57 ++++++++++++-------
 include/trace/events/erofs.h |   2 +-
 6 files changed, 150 insertions(+), 56 deletions(-)

-- 
2.20.1


             reply	other threads:[~2021-10-07 17:06 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-10-07 17:06 Gao Xiang [this message]
2021-10-07 17:06 ` [PATCH 1/3] erofs: get compression algorithms directly on mapping Gao Xiang
2021-10-08  3:00   ` Yue Hu
2021-10-08  3:28     ` Gao Xiang
2021-10-07 17:06 ` [PATCH 2/3] erofs: introduce the secondary compression head Gao Xiang
2021-10-07 17:06 ` [PATCH 3/3] erofs: introduce readmore decompression strategy Gao Xiang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20211007170605.7062-1-xiang@kernel.org \
    --to=xiang@kernel.org \
    --cc=chao@kernel.org \
    --cc=linux-erofs@lists.ozlabs.org \
    --cc=linux-kernel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).