linux-erofs.lists.ozlabs.org archive mirror
 help / color / mirror / Atom feed
From: Gao Xiang via Linux-erofs <linux-erofs@lists.ozlabs.org>
To: linux-erofs@lists.ozlabs.org
Cc: Lasse Collin <lasse.collin@tukaani.org>
Subject: [RFC PATCH v0 0/4] erofs-utils: add LZMA fixed-sized output compression support
Date: Mon, 18 Jan 2021 01:45:59 +0800	[thread overview]
Message-ID: <20210117174603.17943-1-hsiangkao@aol.com> (raw)
In-Reply-To: 20210117174603.17943-1-hsiangkao.ref@aol.com

From: Gao Xiang <hsiangkao@aol.com>

Hi folks,

Thanks to Lasse, liblzma finally has a preliminary usable fixed-sized
output compression support. I've made a quick integration and it seems
work. The preliminary C/R result of this is:
 459382784  enwik9_4k.squashfs.xz.img
 401649664  enwik9_8k.squashfs.xz.img
 371617792  enwik9_4k.lzma.erofs.img
 360972288  enwik9_16k.squashfs.xz.img

* Also -zlzma,1,
 389115904  enwik9_4k.lzma.erofs.img

So it's worthwhile to take the further step and get an entire solution.

TODOs:
 - make a formal configure.ac / Makefile.am rather than such hack;
 - save DICT_SIZE to super block rather than using a fixed value;
 - support threaded compression to boost up build time (including
   segment compression);
 - look on sorting out kernel side support.

Thanks,
Gao Xiang

Cc: Lasse Collin <lasse.collin@tukaani.org>

Gao Xiang (4):
  erofs-utils: clevel set up as an individual function
  erofs-utils: add liblzma dependency
  erofs-utils: mkfs: add LZMA algorithm support
  erofs-utils: fuse: add LZMA algorithm support

 fuse/Makefile.am         |  2 +-
 include/erofs_fs.h       |  3 +-
 lib/Makefile.am          |  2 +
 lib/compress.c           | 16 ++++---
 lib/compressor.c         | 23 +++++++---
 lib/compressor.h         |  7 ++-
 lib/compressor_liblzma.c | 93 ++++++++++++++++++++++++++++++++++++++++
 lib/compressor_lz4.c     |  1 -
 lib/compressor_lz4hc.c   | 21 ++++++---
 lib/data.c               |  7 +--
 lib/decompress.c         | 62 +++++++++++++++++++++++++++
 mkfs/Makefile.am         |  2 +-
 12 files changed, 211 insertions(+), 28 deletions(-)
 create mode 100644 lib/compressor_liblzma.c

-- 
2.24.0


       reply	other threads:[~2021-01-17 17:46 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <20210117174603.17943-1-hsiangkao.ref@aol.com>
2021-01-17 17:45 ` Gao Xiang via Linux-erofs [this message]
2021-01-17 17:46   ` [RFC PATCH v0 1/4] erofs-utils: clevel set up as an individual function Gao Xiang via Linux-erofs
2021-01-17 17:46   ` [RFC PATCH v0 2/4] erofs-utils: add liblzma dependency Gao Xiang via Linux-erofs
2021-01-17 17:46   ` [RFC PATCH v0 3/4] erofs-utils: mkfs: add LZMA algorithm support Gao Xiang via Linux-erofs
2021-01-17 17:46   ` [RFC PATCH v0 4/4] erofs-utils: fuse: " Gao Xiang via Linux-erofs

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20210117174603.17943-1-hsiangkao@aol.com \
    --to=linux-erofs@lists.ozlabs.org \
    --cc=hsiangkao@aol.com \
    --cc=lasse.collin@tukaani.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).