All of lore.kernel.org
 help / color / mirror / Atom feed
* Yocto git server via http and mirror tarballs
@ 2016-06-15 10:51 Pascal Bach
  2016-06-15 11:22 ` Woronicz, Bartosz (Nokia - PL/Wroclaw)
  0 siblings, 1 reply; 4+ messages in thread
From: Pascal Bach @ 2016-06-15 10:51 UTC (permalink / raw)
  To: yocto

Hi

Because of firewall restrictions I'm not always not able to access the git.yoctoproject.org via the git protocol but I'm required to use http.

By default most of the recipes in Poky recipes use the git protocol not the http protocol. For example yocto-kernel-tools points to repositories "git://git.yoctoproject.org/yocto-kernel-tools" instead of "http://git.yoctoproject.org/git/yocto-kernel-tools".

To work around this issue I added a mirror rules for rewriting the protocol like this:

MIRRORS += "\
    git://git.yoctoproject.org/.*                               git://git.yoctoproject.org/git/PATH;protocol=http \n \
    "

This seems to work and I'm able to fetch the sources even when git access is not possible.

But when I then enable BB_GENERATE_MIRROR_TARBALLS = "1" I'm starting to get different tarball names depending on what protocol was used.
For example "git2_git.yoctoproject.org.yocto-kernel-tools.git.tar.gz" vs "git2_git.yoctoproject.org.git.yocto-kernel-tools.git.tar.gz".

I assume this happens because the first tarball was create while git access was possible, while the second one was created when only http was possible:
git.yoctoproject.org/git => git.yoctoproject.org.git
git.yoctoproject.org     => git.yoctoproject.org

Is there any way to prevent the tarballs from having different names? For example derive the name always from the original URL not the mirror one?

Or is there a better way to achieve what we are doing with MIRROR?

Thanks for your help.

Pascal


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Yocto git server via http and mirror tarballs
  2016-06-15 10:51 Yocto git server via http and mirror tarballs Pascal Bach
@ 2016-06-15 11:22 ` Woronicz, Bartosz (Nokia - PL/Wroclaw)
  2016-06-15 11:33   ` Pascal Bach
  0 siblings, 1 reply; 4+ messages in thread
From: Woronicz, Bartosz (Nokia - PL/Wroclaw) @ 2016-06-15 11:22 UTC (permalink / raw)
  To: Pascal Bach, yocto

I set in .gitconfig to always use https:// (don't forget 'git' at the end of path) instead git:// for yoctoproject url

[url "https://git.yoctoproject.org/git/"]
        insteadOf = git://git.yoctoproject.org/

Kind regards,
Bartosz Woronicz
Engineer, Software Configuration (SCM)
Nokia Networks - PL/Wroclaw

-----Original Message-----
From: yocto-bounces@yoctoproject.org [mailto:yocto-bounces@yoctoproject.org] On Behalf Of Pascal Bach
Sent: Wednesday, June 15, 2016 12:51 PM
To: yocto@yoctoproject.org
Subject: [yocto] Yocto git server via http and mirror tarballs

Hi

Because of firewall restrictions I'm not always not able to access the git.yoctoproject.org via the git protocol but I'm required to use http.

By default most of the recipes in Poky recipes use the git protocol not the http protocol. For example yocto-kernel-tools points to repositories "git://git.yoctoproject.org/yocto-kernel-tools" instead of "http://git.yoctoproject.org/git/yocto-kernel-tools".

To work around this issue I added a mirror rules for rewriting the protocol like this:

MIRRORS += "\
    git://git.yoctoproject.org/.*                               git://git.yoctoproject.org/git/PATH;protocol=http \n \
    "

This seems to work and I'm able to fetch the sources even when git access is not possible.

But when I then enable BB_GENERATE_MIRROR_TARBALLS = "1" I'm starting to get different tarball names depending on what protocol was used.
For example "git2_git.yoctoproject.org.yocto-kernel-tools.git.tar.gz" vs "git2_git.yoctoproject.org.git.yocto-kernel-tools.git.tar.gz".

I assume this happens because the first tarball was create while git access was possible, while the second one was created when only http was possible:
git.yoctoproject.org/git => git.yoctoproject.org.git
git.yoctoproject.org     => git.yoctoproject.org

Is there any way to prevent the tarballs from having different names? For example derive the name always from the original URL not the mirror one?

Or is there a better way to achieve what we are doing with MIRROR?

Thanks for your help.

Pascal
-- 
_______________________________________________
yocto mailing list
yocto@yoctoproject.org
https://lists.yoctoproject.org/listinfo/yocto


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Yocto git server via http and mirror tarballs
  2016-06-15 11:22 ` Woronicz, Bartosz (Nokia - PL/Wroclaw)
@ 2016-06-15 11:33   ` Pascal Bach
  2016-06-15 15:09     ` Woronicz, Bartosz ( NSN - PL/Wroclaw)
  0 siblings, 1 reply; 4+ messages in thread
From: Pascal Bach @ 2016-06-15 11:33 UTC (permalink / raw)
  To: Woronicz, Bartosz (Nokia - PL/Wroclaw), yocto


> I set in .gitconfig to always use https:// (don't forget 'git' at the end of path) instead git:// for yoctoproject url
>
> [url "https://git.yoctoproject.org/git/"]
>         insteadOf = git://git.yoctoproject.org/

I would pefer a solution that can be handled at the distro/site.conf level so that not very developer has to change their .gitconfig.
However this is a good work around, thanks.

>
> Kind regards,
> Bartosz Woronicz
> Engineer, Software Configuration (SCM)
> Nokia Networks - PL/Wroclaw
>
> -----Original Message-----
> From: yocto-bounces@yoctoproject.org [mailto:yocto-bounces@yoctoproject.org] On Behalf Of Pascal Bach
> Sent: Wednesday, June 15, 2016 12:51 PM
> To: yocto@yoctoproject.org
> Subject: [yocto] Yocto git server via http and mirror tarballs
>
> Hi
>
> Because of firewall restrictions I'm not always not able to access the git.yoctoproject.org via the git protocol but I'm required to use http.
>
> By default most of the recipes in Poky recipes use the git protocol not the http protocol. For example yocto-kernel-tools points to repositories "git://git.yoctoproject.org/yocto-kernel-tools" instead of "http://git.yoctoproject.org/git/yocto-kernel-tools".
>
> To work around this issue I added a mirror rules for rewriting the protocol like this:
>
> MIRRORS += "\
>     git://git.yoctoproject.org/.*                               git://git.yoctoproject.org/git/PATH;protocol=http \n \
>     "
>
> This seems to work and I'm able to fetch the sources even when git access is not possible.
>
> But when I then enable BB_GENERATE_MIRROR_TARBALLS = "1" I'm starting to get different tarball names depending on what protocol was used.
> For example "git2_git.yoctoproject.org.yocto-kernel-tools.git.tar.gz" vs "git2_git.yoctoproject.org.git.yocto-kernel-tools.git.tar.gz".
>
> I assume this happens because the first tarball was create while git access was possible, while the second one was created when only http was possible:
> git.yoctoproject.org/git => git.yoctoproject.org.git
> git.yoctoproject.org     => git.yoctoproject.org
>
> Is there any way to prevent the tarballs from having different names? For example derive the name always from the original URL not the mirror one?
>
> Or is there a better way to achieve what we are doing with MIRROR?
>
> Thanks for your help.
>
> Pascal



^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Yocto git server via http and mirror tarballs
  2016-06-15 11:33   ` Pascal Bach
@ 2016-06-15 15:09     ` Woronicz, Bartosz ( NSN - PL/Wroclaw)
  0 siblings, 0 replies; 4+ messages in thread
From: Woronicz, Bartosz ( NSN - PL/Wroclaw) @ 2016-06-15 15:09 UTC (permalink / raw)
  To: Pascal Bach, yocto

Maybe try to prepend PREMIRRORS , then possibly everytime it will use 
HTTP/HTTPS protocol instead git (because it will be the very first match).

http://www.yoctoproject.org/docs/current/mega-manual/mega-manual.html#var-PREMIRRORS

Kind regards,
Bartosz Woronicz
Engineer, Software Configuration (SCM)
Nokia Networks - PL/Wroclaw

On 15.06.2016 13:33, Pascal Bach wrote:
>> I set in .gitconfig to always use https:// (don't forget 'git' at the end of path) instead git:// for yoctoproject url
>>
>> [url "https://git.yoctoproject.org/git/"]
>>          insteadOf = git://git.yoctoproject.org/
> I would pefer a solution that can be handled at the distro/site.conf level so that not very developer has to change their .gitconfig.
> However this is a good work around, thanks.
>
>> Kind regards,
>> Bartosz Woronicz
>> Engineer, Software Configuration (SCM)
>> Nokia Networks - PL/Wroclaw
>>
>> -----Original Message-----
>> From: yocto-bounces@yoctoproject.org [mailto:yocto-bounces@yoctoproject.org] On Behalf Of Pascal Bach
>> Sent: Wednesday, June 15, 2016 12:51 PM
>> To: yocto@yoctoproject.org
>> Subject: [yocto] Yocto git server via http and mirror tarballs
>>
>> Hi
>>
>> Because of firewall restrictions I'm not always not able to access the git.yoctoproject.org via the git protocol but I'm required to use http.
>>
>> By default most of the recipes in Poky recipes use the git protocol not the http protocol. For example yocto-kernel-tools points to repositories "git://git.yoctoproject.org/yocto-kernel-tools" instead of "http://git.yoctoproject.org/git/yocto-kernel-tools".
>>
>> To work around this issue I added a mirror rules for rewriting the protocol like this:
>>
>> MIRRORS += "\
>>      git://git.yoctoproject.org/.*                               git://git.yoctoproject.org/git/PATH;protocol=http \n \
>>      "
>>
>> This seems to work and I'm able to fetch the sources even when git access is not possible.
>>
>> But when I then enable BB_GENERATE_MIRROR_TARBALLS = "1" I'm starting to get different tarball names depending on what protocol was used.
>> For example "git2_git.yoctoproject.org.yocto-kernel-tools.git.tar.gz" vs "git2_git.yoctoproject.org.git.yocto-kernel-tools.git.tar.gz".
>>
>> I assume this happens because the first tarball was create while git access was possible, while the second one was created when only http was possible:
>> git.yoctoproject.org/git => git.yoctoproject.org.git
>> git.yoctoproject.org     => git.yoctoproject.org
>>
>> Is there any way to prevent the tarballs from having different names? For example derive the name always from the original URL not the mirror one?
>>
>> Or is there a better way to achieve what we are doing with MIRROR?
>>
>> Thanks for your help.
>>
>> Pascal



^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2016-06-15 15:10 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-06-15 10:51 Yocto git server via http and mirror tarballs Pascal Bach
2016-06-15 11:22 ` Woronicz, Bartosz (Nokia - PL/Wroclaw)
2016-06-15 11:33   ` Pascal Bach
2016-06-15 15:09     ` Woronicz, Bartosz ( NSN - PL/Wroclaw)

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.