When I clone the kernel source, I encounter a fatal error.

When I clone the kernel source, I encounter a fatal error.

[Hao Lee]

Hi,

I used to run 'git clone --depth=1' to get kernel source, because this
way is very lightweight. But today, I want to clone the whole git
repository with 'git clone
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git'

Then, I encounter a problem.

The output is :

Cloning into 'linux-stable'...
remote: Counting objects: 5531619, done.
remote: Compressing objects: 100% (492978/492978), done.
error: index-pack died of signal 9531619), 777.26 MiB | 19.22 MiB/s
fatal: index-pack failed

I do this on my VPS which has 768M memory. Is it because the memory is
not enough? If so, is it possible to limit the memory usage of Git?

Thanks!
Hao Lee

When I clone the kernel source, I encounter a fatal error.

[Craig Inches]

On Tue, Nov 08, 2016 at 11:52:44PM +0800, Hao Lee wrote:
> Hi,
> 
> I used to run 'git clone --depth=1' to get kernel source, because this
> way is very lightweight. But today, I want to clone the whole git
> repository with 'git clone
> git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git'
> 
> Then, I encounter a problem.
> 
> The output is :
> 
> Cloning into 'linux-stable'...
> remote: Counting objects: 5531619, done.
> remote: Compressing objects: 100% (492978/492978), done.
> error: index-pack died of signal 9531619), 777.26 MiB | 19.22 MiB/s
> fatal: index-pack failed
> 
> I do this on my VPS which has 768M memory. Is it because the memory is
> not enough? If so, is it possible to limit the memory usage of Git?

Hi Hao,

Definatly looks like memory limit, I have the same issue when cloning on
android devices. You can use git config file to limit the memory used by
git for various operations: 
https://support.google.com/mail/accounts/answer/78754

Cheers,
Craig
> 
> Thanks!
> Hao Lee
> 
> _______________________________________________
> Kernelnewbies mailing list
> Kernelnewbies at kernelnewbies.org
> https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies

When I clone the kernel source, I encounter a fatal error.

[Greg KH]

On Tue, Nov 08, 2016 at 11:52:44PM +0800, Hao Lee wrote:
> Hi,
> 
> I used to run 'git clone --depth=1' to get kernel source, because this
> way is very lightweight. But today, I want to clone the whole git
> repository with 'git clone
> git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git'
> 
> Then, I encounter a problem.
> 
> The output is :
> 
> Cloning into 'linux-stable'...
> remote: Counting objects: 5531619, done.
> remote: Compressing objects: 100% (492978/492978), done.
> error: index-pack died of signal 9531619), 777.26 MiB | 19.22 MiB/s
> fatal: index-pack failed
> 
> I do this on my VPS which has 768M memory. Is it because the memory is
> not enough?

Yes.

> If so, is it possible to limit the memory usage of Git?

Not really, try giving your VM more memory, the kernel tree is bigger
than 768M.

good luck!

greg k-h

When I clone the kernel source, I encounter a fatal error.

[Hao Lee]

I have tried packedGitWindowSize, packedGitLimit, windowMemory,
packSizeLimit and other options, but it seems that cloning the whole
history still need a lot of memory and Git will be killed by OOM.

Finally, I find that I can clone the latest commit of all branches
with 'git clone --depth=1 --no-single-branch'. Although my local
repository doesn't have any history commits, I can still track remote
updates.

I hope my approach can help someone who want to have a lightweight repository.
Thanks for everyone's help !

Thanks,
Hao Lee.