From: Saul Wold <sgw@linux.intel.com>
To: Patches and discussions about the oe-core layer
<openembedded-core@lists.openembedded.org>
Cc: Koen Kooi <koen@dominion.thruhere.net>
Subject: Re: [PATCH 0/3] Fix xz compression command and optimize compression time
Date: Tue, 17 Jul 2012 09:27:42 -0700 [thread overview]
Message-ID: <5005927E.6000509@linux.intel.com> (raw)
In-Reply-To: <cover.1342116650.git.andrei@gherzan.ro>
On 07/12/2012 11:13 AM, Andrei Gherzan wrote:
> Koen suggested to add -T to xz commands. We have this option implemented in our current version .1alpha.
>
> -T threads, --threads=threads
> Specify the number of worker threads to use. Setting threads to
> a special value 0 makes xz use as many threads as there are CPU
> cores on the system. The actual number of threads can be less
> than threads if the input file is not big enough for threading
> with the given settings or if using more threads would exceed
> the memory usage limit.
>
> -------------------
>
> Memory: 7.8 GiB
> Processor:: Intel® Core™ i5-2540M CPU @ 2.60GHz × 4
>
> File to compress: 1.9G
>
> xz -f -k -e -9 --check=crc32 (current configuration)
> Memory: 673Mb
> real 6m37.170s
> user 6m35.389s
> sys 0m0.884s
> Compressed file size: 3.4Mb
>
> xz -f -k -e -9 -T 4 --check=crc32
> Memory: Cannot allocate memory
>
> xz -f -k -e -8 -T 4 --check=crc32
> Memory: 1.8G
> real 3m24.462s
> user 12m8.502s
> sys 0m2.180s
> Compressed file size: 3.4Mb
>
> xz -f -k -T 4 --check=crc32 (-e defaults to -6)
> Memory: 471Mb
> real 1m9.265s
> user 4m8.972s
> sys 0m0.944s
> Compressed file size: 3.4Mb
>
> So my conclusion would be to use the default -e -6 with -T 0.
>
> The following changes since commit 90ad663909c0c8a405b22a510c9f957007d02669:
>
> upstream_tracking: update boost (2012-07-09 17:21:38 +0100)
>
> are available in the git repository at:
>
> git://git.yoctoproject.org/poky-contrib ag/xz
> http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=ag/xz
>
> Andrei Gherzan (3):
> image_types.bbclass: Fix COMPRESS_CMD for xz to redirect compressed
> data to file
> image_types.bbclass: Add XZ variable to set number of threads to be
> used while compressing
> image_types.bbclass: Default XZ_COMPRESSION_LEVEL to -e -6
>
> meta/classes/image_types.bbclass | 5 +++--
> 1 file changed, 3 insertions(+), 2 deletions(-)
>
Merged into OE-Core
Thanks
Sau!
prev parent reply other threads:[~2012-07-17 16:39 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-07-12 18:13 [PATCH 0/3] Fix xz compression command and optimize compression time Andrei Gherzan
2012-07-12 18:13 ` [PATCH 1/3] image_types.bbclass: Fix COMPRESS_CMD for xz to redirect compressed data to file Andrei Gherzan
2012-07-12 18:13 ` [PATCH 2/3] image_types.bbclass: Add XZ variable to set number of threads to be used while compressing Andrei Gherzan
2012-07-12 18:13 ` [PATCH 3/3] image_types.bbclass: Default XZ_COMPRESSION_LEVEL to -e -6 Andrei Gherzan
2012-07-12 18:58 ` [PATCH 0/3] Fix xz compression command and optimize compression time Koen Kooi
2012-07-12 19:20 ` McClintock Matthew-B29882
2012-07-12 19:22 ` Saul Wold
2012-07-12 19:59 ` Andrei Gherzan
2012-07-12 20:14 ` Khem Raj
2012-07-13 6:45 ` Koen Kooi
2012-07-13 8:19 ` Andrea Adami
2012-07-13 9:44 ` Andrei Gherzan
2012-07-13 9:54 ` Andrea Adami
2012-07-13 9:59 ` Andrei Gherzan
2012-07-17 16:27 ` Saul Wold [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=5005927E.6000509@linux.intel.com \
--to=sgw@linux.intel.com \
--cc=koen@dominion.thruhere.net \
--cc=openembedded-core@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.