* Undeterministic expat fetching failure
@ 2021-09-16 9:31 Konrad Weihmann
2021-09-16 9:53 ` [OE-core] " Richard Purdie
0 siblings, 1 reply; 4+ messages in thread
From: Konrad Weihmann @ 2021-09-16 9:31 UTC (permalink / raw)
To: OE-core
Hi all,
ERROR: expat-2.2.10-r0 do_fetch: Fetcher failure: Fetch command export
PSEUDO_DISABLED=1; export
PATH="/opt/build/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/opt/build/sources/poky/scripts:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/bin/x86_64-scatest-linux:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot/usr/bin/crossscripts:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/sbin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/bin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/sbin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/bin:/opt/build/sources/poky/bitbake/bin:/opt/build/build/tmp/hosttools";
export HOME="/github/home"; /usr/bin/env wget -t 2 -T 30 --passive-ftp
--no-check-certificate -P
/opt/build/build/tmp/work/core2-64-scatest-linux/expat/downloads
'https://downloads.sourceforge.net/expat/expat-2.2.10.tar.bz2'
--progress=dot -v failed with exit code 8, output:
--2021-09-16 09:13:26--
https://downloads.sourceforge.net/expat/expat-2.2.10.tar.bz2
Resolving downloads.sourceforge.net (downloads.sourceforge.net)...
204.68.111.105
Connecting to downloads.sourceforge.net
(downloads.sourceforge.net)|204.68.111.105|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2021-09-16 09:13:26 ERROR 404: Not Found.
that one happens like every 100th attempt - and this seems to be an
issue of sourceforge. (I got a hunch that actually not all mirrors of SF
do still have the yanked version 2.2.10).
Also the projects moved to github a while ago - are there any reasons
why the recipe still pulls it from sourceforge?
If not I could spin up a patch to fetch form GH with git
Regards
Konrad
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [OE-core] Undeterministic expat fetching failure
2021-09-16 9:31 Undeterministic expat fetching failure Konrad Weihmann
@ 2021-09-16 9:53 ` Richard Purdie
2021-09-16 10:00 ` Konrad Weihmann
0 siblings, 1 reply; 4+ messages in thread
From: Richard Purdie @ 2021-09-16 9:53 UTC (permalink / raw)
To: Konrad Weihmann, OE-core
On Thu, 2021-09-16 at 11:31 +0200, Konrad Weihmann wrote:
> Hi all,
>
> ERROR: expat-2.2.10-r0 do_fetch: Fetcher failure: Fetch command export
> PSEUDO_DISABLED=1; export
> PATH="/opt/build/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/opt/build/sources/poky/scripts:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/bin/x86_64-scatest-linux:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot/usr/bin/crossscripts:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/sbin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/bin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/sbin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/bin:/opt/build/sources/poky/bitbake/bin:/opt/build/build/tmp/hosttools";
> export HOME="/github/home"; /usr/bin/env wget -t 2 -T 30 --passive-ftp
> --no-check-certificate -P
> /opt/build/build/tmp/work/core2-64-scatest-linux/expat/downloads
> 'https://downloads.sourceforge.net/expat/expat-2.2.10.tar.bz2'
> --progress=dot -v failed with exit code 8, output:
> --2021-09-16 09:13:26--
> https://downloads.sourceforge.net/expat/expat-2.2.10.tar.bz2
> Resolving downloads.sourceforge.net (downloads.sourceforge.net)...
> 204.68.111.105
> Connecting to downloads.sourceforge.net
> (downloads.sourceforge.net)|204.68.111.105|:443... connected.
> HTTP request sent, awaiting response... 404 Not Found
> 2021-09-16 09:13:26 ERROR 404: Not Found.
>
> that one happens like every 100th attempt - and this seems to be an
> issue of sourceforge. (I got a hunch that actually not all mirrors of SF
> do still have the yanked version 2.2.10).
I suspect you're right and this is something to do with some mirrors deleting
removed files and some not.
> Also the projects moved to github a while ago - are there any reasons
> why the recipe still pulls it from sourceforge?
>
> If not I could spin up a patch to fetch form GH with git
Tarball releases are a lot more efficient for the system. Git based recipes make
the versioning less obvious and easier to break, are harder to mirror and thrown
more data around causing more build IO. There are therefore pros and cons to
tarballs vs. git urls.
Sourceforge does appear to continue to store tarball releases.
Cheers,
Richard
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [OE-core] Undeterministic expat fetching failure
2021-09-16 9:53 ` [OE-core] " Richard Purdie
@ 2021-09-16 10:00 ` Konrad Weihmann
2021-09-16 10:02 ` Richard Purdie
0 siblings, 1 reply; 4+ messages in thread
From: Konrad Weihmann @ 2021-09-16 10:00 UTC (permalink / raw)
To: Richard Purdie, OE-core
On 16.09.21 11:53, Richard Purdie wrote:
> On Thu, 2021-09-16 at 11:31 +0200, Konrad Weihmann wrote:
>> Hi all,
>>
>> ERROR: expat-2.2.10-r0 do_fetch: Fetcher failure: Fetch command export
>> PSEUDO_DISABLED=1; export
>> PATH="/opt/build/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/opt/build/sources/poky/scripts:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/bin/x86_64-scatest-linux:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot/usr/bin/crossscripts:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/sbin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/bin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/sbin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/bin:/opt/build/sources/poky/bitbake/bin:/opt/build/build/tmp/hosttools";
>> export HOME="/github/home"; /usr/bin/env wget -t 2 -T 30 --passive-ftp
>> --no-check-certificate -P
>> /opt/build/build/tmp/work/core2-64-scatest-linux/expat/downloads
>> 'https://downloads.sourceforge.net/expat/expat-2.2.10.tar.bz2'
>> --progress=dot -v failed with exit code 8, output:
>> --2021-09-16 09:13:26--
>> https://downloads.sourceforge.net/expat/expat-2.2.10.tar.bz2
>> Resolving downloads.sourceforge.net (downloads.sourceforge.net)...
>> 204.68.111.105
>> Connecting to downloads.sourceforge.net
>> (downloads.sourceforge.net)|204.68.111.105|:443... connected.
>> HTTP request sent, awaiting response... 404 Not Found
>> 2021-09-16 09:13:26 ERROR 404: Not Found.
>>
>> that one happens like every 100th attempt - and this seems to be an
>> issue of sourceforge. (I got a hunch that actually not all mirrors of SF
>> do still have the yanked version 2.2.10).
>
> I suspect you're right and this is something to do with some mirrors deleting
> removed files and some not.
>
>> Also the projects moved to github a while ago - are there any reasons
>> why the recipe still pulls it from sourceforge?
>>
>> If not I could spin up a patch to fetch form GH with git
>
> Tarball releases are a lot more efficient for the system. Git based recipes make
> the versioning less obvious and easier to break, are harder to mirror and thrown
> more data around causing more build IO. There are therefore pros and cons to
> tarballs vs. git urls.
>
> Sourceforge does appear to continue to store tarball releases.
How about pulling the release tarball from github instead?
https://github.com/libexpat/libexpat/releases/download/R_2_2_10/expat-2.2.10.tar.bz2
should be fine IINM
>
> Cheers,
>
> Richard
>
>
>
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [OE-core] Undeterministic expat fetching failure
2021-09-16 10:00 ` Konrad Weihmann
@ 2021-09-16 10:02 ` Richard Purdie
0 siblings, 0 replies; 4+ messages in thread
From: Richard Purdie @ 2021-09-16 10:02 UTC (permalink / raw)
To: Konrad Weihmann, OE-core
On Thu, 2021-09-16 at 12:00 +0200, Konrad Weihmann wrote:
>
> On 16.09.21 11:53, Richard Purdie wrote:
> > On Thu, 2021-09-16 at 11:31 +0200, Konrad Weihmann wrote:
> > > Hi all,
> > >
> > > ERROR: expat-2.2.10-r0 do_fetch: Fetcher failure: Fetch command export
> > > PSEUDO_DISABLED=1; export
> > > PATH="/opt/build/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/opt/build/sources/poky/scripts:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/bin/x86_64-scatest-linux:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot/usr/bin/crossscripts:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/sbin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/usr/bin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/sbin:/opt/build/build/tmp/work/core2-64-scatest-linux/expat/2.2.10-r0/recipe-sysroot-native/bin:/opt/build/sources/poky/bitbake/bin:/opt/build/build/tmp/hosttools";
> > > export HOME="/github/home"; /usr/bin/env wget -t 2 -T 30 --passive-ftp
> > > --no-check-certificate -P
> > > /opt/build/build/tmp/work/core2-64-scatest-linux/expat/downloads
> > > 'https://downloads.sourceforge.net/expat/expat-2.2.10.tar.bz2'
> > > --progress=dot -v failed with exit code 8, output:
> > > --2021-09-16 09:13:26--
> > > https://downloads.sourceforge.net/expat/expat-2.2.10.tar.bz2
> > > Resolving downloads.sourceforge.net (downloads.sourceforge.net)...
> > > 204.68.111.105
> > > Connecting to downloads.sourceforge.net
> > > (downloads.sourceforge.net)|204.68.111.105|:443... connected.
> > > HTTP request sent, awaiting response... 404 Not Found
> > > 2021-09-16 09:13:26 ERROR 404: Not Found.
> > >
> > > that one happens like every 100th attempt - and this seems to be an
> > > issue of sourceforge. (I got a hunch that actually not all mirrors of SF
> > > do still have the yanked version 2.2.10).
> >
> > I suspect you're right and this is something to do with some mirrors deleting
> > removed files and some not.
> >
> > > Also the projects moved to github a while ago - are there any reasons
> > > why the recipe still pulls it from sourceforge?
> > >
> > > If not I could spin up a patch to fetch form GH with git
> >
> > Tarball releases are a lot more efficient for the system. Git based recipes make
> > the versioning less obvious and easier to break, are harder to mirror and thrown
> > more data around causing more build IO. There are therefore pros and cons to
> > tarballs vs. git urls.
> >
> > Sourceforge does appear to continue to store tarball releases.
>
> How about pulling the release tarball from github instead?
> https://github.com/libexpat/libexpat/releases/download/R_2_2_10/expat-2.2.10.tar.bz2
> should be fine IINM
>
As long as those aren't dynamically built and vary their checksum, that should
be ok. We may need to test/check the upstream version check urls/regex.
Cheers,
Richard
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2021-09-16 10:02 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-09-16 9:31 Undeterministic expat fetching failure Konrad Weihmann
2021-09-16 9:53 ` [OE-core] " Richard Purdie
2021-09-16 10:00 ` Konrad Weihmann
2021-09-16 10:02 ` Richard Purdie
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.