Re: Performance issue: initial git clone causes massive repack

["Robin H. Johnson" <robbat2@gentoo.org>]

[-- Attachment #1: Type: text/plain, Size: 1355 bytes --]

On Wed, Apr 08, 2009 at 12:52:54AM -0400, Nicolas Pitre wrote:
> > http://git.overlays.gentoo.org/gitweb/?p=exp/gentoo-x86.git;a=summary
> > At least that's what I cloned ;-) I hope it's the right one, but it fits
> > the description...
> OK.  FWIW, I repacked it with --window=250 --depth=250 and obtained a 
> 725MB pack file.  So that's about half the originally reported size.
The one problem with having the single large packfile is that Git
doesn't have a trivial way to resume downloading it when the git://
protocol is used.

For our developers cursed with bad internet connections (a fair number
of firewalls that don't seem to respect keepalive properly), I suppose
I can probably just maintain a separate repo for their initial clones,
which leaves a large overall download, but more chances to resume.

PS #1: B.Steinbrink's memory improvement patch seems to work nicely too,
but more memory improvements in that realm are still needed.

PS #2: We finally got some newer hardware to run the large repo, I'm
working on the install now, but until the memory issue is better
resolved, I'm still worried we might run short if there are too many
concurrent clones.

-- 
Robin Hugh Johnson
Gentoo Linux Developer & Infra Guy
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85

[-- Attachment #2: Type: application/pgp-signature, Size: 330 bytes --]