All of lore.kernel.org
 help / color / mirror / Atom feed
From: Pavel Machek <pavel@ucw.cz>
To: Jean Delvare <khali@linux-fr.org>
Cc: mirrors@kernel.org, lasse.collin@tukaani.org,
	linux-kernel <linux-kernel@vger.kernel.org>,
	users@kernel.org, "FTPAdmin Kernel.org" <ftpadmin@kernel.org>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Willy Tarreau <w@1wt.eu>
Subject: Re: [kernel.org users] XZ Migration discussion
Date: Tue, 16 Feb 2010 15:00:04 +0100	[thread overview]
Message-ID: <20100216140004.GB4821@elf.ucw.cz> (raw)
In-Reply-To: <20100214200803.4b2348ce@hyperion.delvare>


> > > I have an old, slow machine here which I am going to use to perform
> > > some real world testing, and I'll post the results when I'm done. But I
> > > suspect that building a kernel on this machine, even a small one with
> > > just the drivers it needs, will take much longer than unpacking the
> > > sources. So anyone worrying about performance would rather rely on
> > > cross-compilation, and in turn can afford whatever decompression tool
> > > is needed.
> > 
> > On zaurus, kernel compilation takes 4 hours. (I.e. "one night"). So
> > that one is ... well ... done overnight.
> 
> Out of curiosity, if it takes that long, why don't you use a
> cross-compiler?

Because I hack it on the go. First build is long and ugly, but
subsequent builds only take 5 minutes or so, so development is
possible.

(If I crosscompiled it, I'd have to crosscompile even the subsequent
builds, which is impossible -- no powerful machine nearby).

> > Untar is something I normally wait for, since you need to run
> > (interactive) oldconfig after that.
> 
> You'll have to wait, no matter what compression format you use (and
> even if you don't compress the tarball). Judging by the duration of the
> build on your machine, I'd estimate the decompression time to 7 minutes
> for gz vs. 15 minutes for bz2 maybe? I doubt you sit in front of the
> machine for 7 minutes waiting for tar.gz to decompress, right? So I
> fail to see what difference it makes. You'll just do something else for
> 15 minutes instead of doing something else for 7 minutes.

Actually I do sit in front of the machine, reading mails while it
decompresses.

[I'll get some numbers.]

sh-3.2$ time bzip2 -d < ~/.ketchup/l^Ginux-2.6.31.tar.bz2 > delme.tar
485.73user 137.35system 683.32 (11m23.320s) elapsed 91.18%CPU
sh-3.2$ df -h^H^H^H^H^Htime cat delme.tar > /usr/src/delme.tar
0.57user 109.03system 381.13 (6m21.133s) elapsed 28.75%CPU
sh-3.2$ time zca^G^Gt delme.tar > /u ^H^H ^H^H ^H^H ^H^Hdelme.tar.gz
^H^H ^H^H ^H^H
+^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H.gz > delme.tar
43.97user 106.22system 223.26 (3m43.261s) elapsed 67.27%CPU

So... gzip is actually _faster_ than uncompressed data, while bzip is
twice slower. Don't know about xzip.

Anyway, gzip just makes sense. It is both smaller and faster than
alternatives, and nearly as portable.

> Anyway, as I have been saying several times already, nothing prevents
> you from repacking tarballs to gz before uploading it to your slow
> system if such is your desire. I can understand the portability
> argument, but the decompression time, no way.

Ok, so lets go by the portability argument.
									Pavel
-- 
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

  parent reply	other threads:[~2010-02-16 14:00 UTC|newest]

Thread overview: 106+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-02-11 18:36 XZ Migration discussion J.H.
2010-02-11 19:44 ` david
2010-02-11 19:48 ` H. Peter Anvin
2010-02-12  0:14   ` [kernel.org mirrors] " Carlos Carvalho
2010-02-11 20:22 ` [kernel.org users] " Willy Tarreau
2010-02-11 20:51 ` Pavel Machek
2010-02-11 22:22   ` H. Peter Anvin
2010-02-12 14:35     ` Jean Delvare
2010-02-13 17:10   ` Jean Delvare
2010-02-13 18:49     ` Geert Uytterhoeven
2010-02-13 19:30       ` Randy Dunlap
2010-02-16 14:55       ` Steven Rostedt
2010-02-13 23:28     ` Stefan Richter
2010-02-14  9:07       ` Jean Delvare
2010-02-13 23:52     ` Phillip Lougher
2010-02-14  9:23       ` Jean Delvare
2010-02-14  9:33         ` Justin P. Mattock
2010-02-14  9:49         ` Willy Tarreau
2010-02-14 12:43           ` Jean Delvare
2010-02-15 21:31           ` James Cloos
2010-02-17  5:40             ` Willy Tarreau
2010-02-17  5:54               ` H. Peter Anvin
2010-02-17 10:22               ` Petri Kaukasoina
2010-02-17 10:25               ` Petri Kaukasoina
2010-02-14  9:56       ` Andi Kleen
2010-02-18 23:59         ` Jan Engelhardt
2010-02-14 10:16       ` Lasse Collin
2010-02-12 14:01 ` Jean Delvare
2010-02-12 15:21   ` Linus Torvalds
2010-02-12 19:02     ` J.H.
2010-02-12 19:23       ` Jean Delvare
2010-02-12 23:07         ` Willy Tarreau
2010-02-13  6:20           ` Pavel Machek
2010-02-13 10:06             ` Stefan Richter
2010-02-13 10:21               ` Stefan Richter
2010-02-14  9:56                 ` Lasse Collin
2010-02-13  8:17           ` Jean Delvare
2010-02-13  9:59             ` Stefan Richter
2010-02-13 10:18               ` Avi Kivity
2010-02-13 21:37                 ` [kernel] " Mr. James W. Laferriere
2010-02-13 22:39                   ` Bernd Petrovitsch
2010-02-15 19:33                     ` [kernel.org users] [kernel] " Steve French
2010-02-16  9:16                       ` Bernd Petrovitsch
2010-02-16 15:13                         ` J.H.
2010-02-14 17:13               ` [kernel.org users] " Pavel Machek
2010-02-14 17:33                 ` Stefan Richter
2010-02-14 20:51                   ` Pavel Machek
2010-02-15  8:48                     ` Stefan Richter
2010-02-15 23:32                       ` Tom Rini
2010-02-16  8:21                         ` Stefan Richter
2010-02-14 17:07             ` Pavel Machek
2010-02-14 18:39               ` Stefan Richter
2010-02-14 21:04                 ` david
2010-02-14 21:32                   ` Jean Delvare
2010-02-14 18:59               ` H. Peter Anvin
2010-02-14 19:08               ` Jean Delvare
2010-02-15 15:15                 ` tytso
2010-02-16 15:29                   ` J.H.
2010-02-16 16:03                     ` Jean Delvare
2010-02-17  1:36                     ` David Rees
2010-02-16 14:00                 ` Pavel Machek [this message]
2010-02-19  0:08     ` Jan Engelhardt
2010-02-19  4:38       ` J.H.
2010-02-12 15:25   ` Steven Rostedt
2010-02-12 16:11     ` Jean Delvare
2010-02-12 16:30       ` Steven Rostedt
2010-02-12 16:44         ` Jean Delvare
2010-02-12 20:34         ` Junio C Hamano
2010-02-12 21:16           ` Steven Rostedt
2010-02-16 15:39     ` ketchup was " Pavel Machek
2010-02-16 16:17       ` Steven Rostedt
2010-02-16 16:27         ` Pavel Machek
2010-02-21 13:53           ` Pavel Machek
2010-02-21 14:26             ` Jean Delvare
2010-02-21 19:28               ` Pavel Machek
2010-02-22 18:59             ` Pavel Machek
2010-02-23 13:14               ` Steven Rostedt
2010-02-23 20:32                 ` Pavel Machek
2010-02-12 19:02   ` Phillip Lougher
2010-02-12 19:32     ` Jean Delvare
2010-02-12 19:57       ` Phillip Lougher
2010-02-12 21:59         ` Jean Delvare
2010-02-12 23:30           ` Phillip Lougher
2010-02-12 23:39           ` Phillip Lougher
2010-02-13  7:31             ` Jean Delvare
2010-02-13 22:37               ` Phillip Lougher
2010-02-14  9:32                 ` Jean Delvare
2010-02-14  9:53                   ` Justin P. Mattock
     [not found]           ` <20100212223547.GN5186@tux>
2010-02-13  7:20             ` Jean Delvare
2010-02-12 19:03   ` H. Peter Anvin
2010-02-12 20:25     ` Matthew Wilcox
2010-02-12 21:54       ` Greg KH
2010-02-12 21:58       ` Steven Rostedt
2010-02-14 14:49       ` Harald Arnesen
2010-02-14 18:34         ` H. Peter Anvin
2010-02-12 20:31     ` [kernel.org mirrors] " Sleddens, J.P.G.
2010-02-12 22:11       ` H. Peter Anvin
2010-02-12 23:14         ` [kernel.org users] [kernel.org mirrors] " Willy Tarreau
2010-02-13  7:42     ` [kernel.org users] " Tony Luck
2010-02-13  8:14       ` H. Peter Anvin
2010-02-13  8:53         ` Jean Delvare
2010-02-14  5:43           ` H. Peter Anvin
     [not found]             ` <987664A83D2D224EAE907B061CE93D53123E0ED5@orsmsx505.amr.corp.intel.com>
2010-02-17  0:11               ` H. Peter Anvin
2010-02-14 18:03 ` Eric W. Biederman
2010-02-14 22:27   ` Stephen Hemminger
2010-02-15 16:15     ` Jean Delvare

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20100216140004.GB4821@elf.ucw.cz \
    --to=pavel@ucw.cz \
    --cc=ftpadmin@kernel.org \
    --cc=khali@linux-fr.org \
    --cc=lasse.collin@tukaani.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mirrors@kernel.org \
    --cc=torvalds@linux-foundation.org \
    --cc=users@kernel.org \
    --cc=w@1wt.eu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.