From: Andrea Adami <andrea.adami@gmail.com>
To: Patches and discussions about the oe-core layer
<openembedded-core@lists.openembedded.org>
Subject: Re: [PATCH 0/3] Fix xz compression command and optimize compression time
Date: Fri, 13 Jul 2012 11:54:51 +0200 [thread overview]
Message-ID: <CAAQYJAsNv_R_GXrXY2OjU8Y-ft52V9Wzp6Y24sZX=d-hn=Zcig@mail.gmail.com> (raw)
In-Reply-To: <CAK18fxErPLi5685HPfL8HtvF7fziHHBc0cc+=MKWnec4Lurgug@mail.gmail.com>
On Fri, Jul 13, 2012 at 11:44 AM, Andrei Gherzan <andrei@gherzan.ro> wrote:
> On Fri, Jul 13, 2012 at 11:19 AM, Andrea Adami <andrea.adami@gmail.com>
> wrote:
>>
>> On Fri, Jul 13, 2012 at 8:45 AM, Koen Kooi <koen@dominion.thruhere.net>
>> wrote:
>> >
>> > Op 12 jul. 2012, om 21:22 heeft Saul Wold het volgende geschreven:
>> >
>> >> On 07/12/2012 11:58 AM, Koen Kooi wrote:
>> >>> Any volunteers to test this on a system with >4 real cores?
>> >>>
>> >>
>> >> Koen,
>> >>
>> >> Does OE-Core or Poky have an image setup for using .xz by default?
>> >
>> > No, and as you can see from Andrei's patches, it would have never worked
>> > :)
>> >
>> > regards,
>> >
>> > Koen
>> >
>>
>> This leads to a similar remark for lzma:
>>
>> The xz/lzma have been added with commit 38334ac and at that time both
>> where using XZ_COMPRESSION_LEVEL.
>>
>> The code has been refactored afterwards and what happened is that lzma
>> now defaults to compression 7 (the default) while xz is way too high
>> (default is 6).
>>
>
> Nope. It's default value is -9.
>
Well, in oe-core maybe.
Upstream they are more conservative, see that man.
"The default preset level in LZMA Utils is -7 while in XZ Utils it is
-6, so both use 8 MiB dictionary by default."
Cheers
Andrea
>>
>> There is a well hidden pitfall with that, being that any image,
>> including the initramfs, will use that compression factor.
>>
>> As you can notice in that (old) man xz [2] the memory requirements
>
>
> What old version?
>
>>
>> are very high and what did happen to me was that the cpio.lzma could
>> not be decompressed thus kernel could not boot (we override now the
>> value setting "-e2" in our BSP).
>>
>
> Without threads, memory demand was around 700mb. So it should be ok for most
> of machines.
>
>> Adding more threads will multiply that figures.
>>
>
> Indeed. With 8GB memory at my disposal i couldn't compress an image with -e
> -9 and -T 0 (-T 4)/
>
> @g
>
> _______________________________________________
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/openembedded-core
>
next prev parent reply other threads:[~2012-07-13 10:06 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-07-12 18:13 [PATCH 0/3] Fix xz compression command and optimize compression time Andrei Gherzan
2012-07-12 18:13 ` [PATCH 1/3] image_types.bbclass: Fix COMPRESS_CMD for xz to redirect compressed data to file Andrei Gherzan
2012-07-12 18:13 ` [PATCH 2/3] image_types.bbclass: Add XZ variable to set number of threads to be used while compressing Andrei Gherzan
2012-07-12 18:13 ` [PATCH 3/3] image_types.bbclass: Default XZ_COMPRESSION_LEVEL to -e -6 Andrei Gherzan
2012-07-12 18:58 ` [PATCH 0/3] Fix xz compression command and optimize compression time Koen Kooi
2012-07-12 19:20 ` McClintock Matthew-B29882
2012-07-12 19:22 ` Saul Wold
2012-07-12 19:59 ` Andrei Gherzan
2012-07-12 20:14 ` Khem Raj
2012-07-13 6:45 ` Koen Kooi
2012-07-13 8:19 ` Andrea Adami
2012-07-13 9:44 ` Andrei Gherzan
2012-07-13 9:54 ` Andrea Adami [this message]
2012-07-13 9:59 ` Andrei Gherzan
2012-07-17 16:27 ` Saul Wold
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CAAQYJAsNv_R_GXrXY2OjU8Y-ft52V9Wzp6Y24sZX=d-hn=Zcig@mail.gmail.com' \
--to=andrea.adami@gmail.com \
--cc=openembedded-core@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.