From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-lj1-f180.google.com (mail-lj1-f180.google.com [209.85.208.180]) by mx.groups.io with SMTP id smtpd.web08.193.1619801437238534338 for ; Fri, 30 Apr 2021 09:50:37 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=FX0pUofo; spf=pass (domain: linuxfoundation.org, ip: 209.85.208.180, mailfrom: mhalstead@linuxfoundation.org) Received: by mail-lj1-f180.google.com with SMTP id o16so81584915ljp.3 for ; Fri, 30 Apr 2021 09:50:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=PactuW8gErgEdPHXK6ceOhDh33gqxb/VXlvvIeqk/RQ=; b=FX0pUofoAwar+1lWaMJ/dcYvz9Z7f7CxZGWeKY0htq44bzVSPErDZykumdQrYbl+Gz YVkZZbjZYoPLLTnh44Cj/9ihLWHD0034rXNdkSSa2hKrmxEdxsu2DpLyvZJKC6h6tK2j GziMjYO0rsvk1rlGnF3kGUC8k40d/tfOeCatE= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=PactuW8gErgEdPHXK6ceOhDh33gqxb/VXlvvIeqk/RQ=; b=ESAssAFQkbn2bKVT67wOiZf5MoH7A6ytFkufAobDWyTMgUrJgt4F4IyDTt2CK0LQ5j kRukaz3CZou4/luDZfDtwIdLm3mDRHibc3/KFTg1XUqH8U+dVgMQtPgINyxVzeMBzHaN aD5xzalcrs0bLGv57fFsJ+x5AEJTlIWLQgviWSv7WH/V0+2zZdyC8OK+xfuJ9mMD78lG pul/BgyjhDxx6o7KCUiWyMbaN5yU8EOTiX6M6U+H4njetiiNBsFQb9x3WL9V8KKBpm8O vKbdQWetghXjCrN3ESsJQAOe9v3doKXE82RYOnCgKqVGCHi394Nly1UZFoxNcGJu3hQx o+8Q== X-Gm-Message-State: AOAM532yNW9tN9ObFaNxJGFz2B7o3O5+E81HRi2IZtrqEJf9yVUXDaWT AuDGMYesK5ryNPvVOL8nVl0TPH7W+oa1wUkWnbIIbA== X-Google-Smtp-Source: ABdhPJzCqahw9Tv8zhx378m//B6kp8K1NQCjbQVEd3WoX10W1YvXydtaA6X5OZqduHGJ3xRyXxMu3HQI8b1HB2l5lJo= X-Received: by 2002:a2e:9149:: with SMTP id q9mr4524616ljg.28.1619801435305; Fri, 30 Apr 2021 09:50:35 -0700 (PDT) MIME-Version: 1.0 References: <20210420182838.958151-1-raj.khem@gmail.com> <20210420182838.958151-2-raj.khem@gmail.com> In-Reply-To: From: "Michael Halstead" Date: Fri, 30 Apr 2021 09:50:24 -0700 Message-ID: Subject: Re: [OE-core] [PATCH 2/2] go: Use dl.google.com for SRC_URI To: Khem Raj Cc: Alexandre Belloni , Patches and discussions about the oe-core layer Content-Type: multipart/alternative; boundary="000000000000288b5005c13369e0" --000000000000288b5005c13369e0 Content-Type: text/plain; charset="UTF-8" I've removed the following: go1.16.3.src.tar.gz ( 0 bytes) go1.16.3.src.tar.gz_bad-checksum_b298d29de9236ca47a023e382313bcc2d2eed31dfa706b60a04103ce83a71a25 ( 20912861 bytes) I can add a job to check for 0 byte tarballs. Do you think that would be helpful? On Thu, Apr 29, 2021 at 4:26 PM Khem Raj wrote: > you also want to get rid of *.lock files as well. > > On Thu, Apr 29, 2021 at 4:24 PM Khem Raj wrote: > > > > Adding Miachel as well. > > > > this seems to be running > > buildoptions.SourceMirroring.test_yocto_source_mirror selftest, which > > AFAICT should force downloads from yp mirror only > > when I check the YP mirror then this tarball exists there > > > > http://downloads.yoctoproject.org/mirror/sources/go1.16.3.src.tar.gz > > > > but problem is that its 0 sized. > > > > Secondly I also see a bad checksum file there > > > > > http://downloads.yoctoproject.org/mirror/sources/go1.16.3.src.tar.gz_bad-checksum_b298d29de9236ca47a023e382313bcc2d2eed31dfa706b60a04103ce83a71a25 > > > > I am seeing that there are lot of *_bad-checksum_* files in YP src > > mirror http://downloads.yoctoproject.org/mirror/sources/ > > > > Michael, > > > > Can we delete these *_bad-checksum_* files as well as zero-sized > > tarballs please? > > > > On Thu, Apr 29, 2021 at 3:57 PM Alexandre Belloni > > wrote: > > > > > > Hello, > > > > > > On 20/04/2021 11:28:38-0700, Khem Raj wrote: > > > > golang.org/dl is resolving to this anyway > > > > > > > > > > Unfortunately, this is still an issue on the autobuilders: > > > > > > ERROR: go-cross-core2-32-1.16.3-r0 do_fetch: The URL: ' > https://dl.google.com/go/go1.16.3.src.tar.gz;name=main' is not trusted > and cannot be used > > > ERROR: go-cross-core2-32-1.16.3-r0 do_fetch: Fetcher failure for URL: ' > https://dl.google.com/go/go1.16.3.src.tar.gz;name=main'. Unable to fetch > URL from any source. > > > ERROR: Logfile of failure stored in: > /home/pokybuild/yocto-worker/a-quick/build/build-st/tmp/work/x86_64-linux/go-cross-core2-32/1.16.3-r0/temp/log.do_fetch.525 > > > ERROR: go-runtime-1.16.3-r0 do_fetch: The URL: ' > https://dl.google.com/go/go1.16.3.src.tar.gz;name=main' is not trusted > and cannot be used > > > ERROR: go-runtime-1.16.3-r0 do_fetch: Fetcher failure for URL: ' > https://dl.google.com/go/go1.16.3.src.tar.gz;name=main'. Unable to fetch > URL from any source. > > > ERROR: Logfile of failure stored in: > /home/pokybuild/yocto-worker/a-quick/build/build-st/tmp/work/core2-32-poky-linux/go-runtime/1.16.3-r0/temp/log.do_fetch.544 > > > > > > This is fairly reproducible: > > > > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1404/steps/23/logs/stdio > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1403/steps/23/logs/stdio > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1402/steps/23/logs/stdio > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1401/steps/23/logs/stdio > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/2076/steps/23/logs/stdio > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/2074/steps/23/logs/stdio > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/2070/steps/23/logs/stdio > > > > > > > > > > Signed-off-by: Khem Raj > > > > --- > > > > meta/recipes-devtools/go/go-common.inc | 2 +- > > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > > > diff --git a/meta/recipes-devtools/go/go-common.inc > b/meta/recipes-devtools/go/go-common.inc > > > > index 39a681a712..c368b95b69 100644 > > > > --- a/meta/recipes-devtools/go/go-common.inc > > > > +++ b/meta/recipes-devtools/go/go-common.inc > > > > @@ -14,7 +14,7 @@ LICENSE = "BSD-3-Clause" > > > > > > > > inherit goarch > > > > > > > > -SRC_URI = "https://golang.org/dl/go${PV}.src.tar.gz;name=main" > > > > +SRC_URI = "https://dl.google.com/go/go${PV}.src.tar.gz;name=main" > > > > S = "${WORKDIR}/go" > > > > B = "${S}" > > > > UPSTREAM_CHECK_REGEX = "(?P\d+(\.\d+)+)\.src\.tar" > > > > -- > > > > 2.31.1 > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > Alexandre Belloni, co-owner and COO, Bootlin > > > Embedded Linux and Kernel engineering > > > https://bootlin.com > -- Michael Halstead Linux Foundation / Yocto Project Systems Operations Engineer --000000000000288b5005c13369e0 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I've removed the following:
go1.16.3.src.tar= .gz ( 0 bytes)
go1.16.3.src.tar.gz_bad-checksum_b298d29de9236ca47a023e38= 2313bcc2d2eed31dfa706b60a04103ce83a71a25 (=C2=A020912861 bytes)

I can add a job to check for 0 byte tarballs. Do you think that wou= ld be helpful?


On Thu, Apr 29, 2021 at 4:26 PM Khem= Raj <raj.khem@gmail.com> w= rote:
you also w= ant to get rid of *.lock files as well.

On Thu, Apr 29, 2021 at 4:24 PM Khem Raj <raj.khem@gmail.com> wrote:
>
> Adding Miachel as well.
>
> this seems to be running
> buildoptions.SourceMirroring.test_yocto_source_mirror selftest, which=
> AFAICT should force downloads from yp mirror only
> when I check the YP mirror then this tarball exists there
>
> http://downloads.yoctoproj= ect.org/mirror/sources/go1.16.3.src.tar.gz
>
> but problem is that its 0 sized.
>
> Secondly I also see a bad checksum file there
>
> http://downloads.yoctop= roject.org/mirror/sources/go1.16.3.src.tar.gz_bad-checksum_b298d29de9236ca4= 7a023e382313bcc2d2eed31dfa706b60a04103ce83a71a25
>
> I am seeing that there are lot of *_bad-checksum_* files in YP src > mirror http://downloads.yoctoproject.org/mirr= or/sources/
>
> Michael,
>
> Can we delete these *_bad-checksum_* files as well as zero-sized
> tarballs please?
>
> On Thu, Apr 29, 2021 at 3:57 PM Alexandre Belloni
> <alexandre.belloni@bootlin.com> wrote:
> >
> > Hello,
> >
> > On 20/04/2021 11:28:38-0700, Khem Raj wrote:
> > > golang.org/dl is resolving to this anyway
> > >
> >
> > Unfortunately, this is still an issue on the autobuilders:
> >
> > ERROR: go-cross-core2-32-1.16.3-r0 do_fetch: The URL: 'https://dl.google.com/go/go1.16.3.src.tar.gz;name= = =3Dmain' is not trusted and cannot be used
> > ERROR: go-cross-core2-32-1.16.3-r0 do_fetch: Fetcher failure for= URL: 'https://dl.google.com/go/go1.16.3= .src.tar.gz;name=3Dmain'. Unable to fetch URL from any source.
> > ERROR: Logfile of failure stored in: /home/pokybuild/yocto-worke= r/a-quick/build/build-st/tmp/work/x86_64-linux/go-cross-core2-32/1.16.3-r0/= temp/log.do_fetch.525
> > ERROR: go-runtime-1.16.3-r0 do_fetch: The URL: 'https://dl.google.com/go/go1.16.3.src.tar.gz;name=3Dmain= ' is not trusted and cannot be used
> > ERROR: go-runtime-1.16.3-r0 do_fetch: Fetcher failure for URL: &= #39;https://dl.google.com/go/go1.16.3.src.ta= r.gz;name=3Dmain'. Unable to fetch URL from any source.
> > ERROR: Logfile of failure stored in: /home/pokybuild/yocto-worke= r/a-quick/build/build-st/tmp/work/core2-32-poky-linux/go-runtime/1.16.3-r0/= temp/log.do_fetch.544
> >
> > This is fairly reproducible:
> >
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1404/ste= ps/23/logs/stdio
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1403/ste= ps/23/logs/stdio
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1402/ste= ps/23/logs/stdio
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/85/builds/1401/ste= ps/23/logs/stdio
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/2076/ste= ps/23/logs/stdio
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/2074/ste= ps/23/logs/stdio
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/2070/ste= ps/23/logs/stdio
> >
> >
> > > Signed-off-by: Khem Raj <raj.khem@gmail.com>
> > > ---
> > >=C2=A0 meta/recipes-devtools/go/go-common.inc | 2 +-
> > >=C2=A0 1 file changed, 1 insertion(+), 1 deletion(-)
> > >
> > > diff --git a/meta/recipes-devtools/go/go-common.inc b/meta/= recipes-devtools/go/go-common.inc
> > > index 39a681a712..c368b95b69 100644
> > > --- a/meta/recipes-devtools/go/go-common.inc
> > > +++ b/meta/recipes-devtools/go/go-common.inc
> > > @@ -14,7 +14,7 @@ LICENSE =3D "BSD-3-Clause"
> > >
> > >=C2=A0 inherit goarch
> > >
> > > -SRC_URI =3D "https://g= olang.org/dl/go${PV}.src.tar.gz;name=3Dmain"
> > > +SRC_URI =3D "https:= //dl.google.com/go/go${PV}.src.tar.gz;name=3Dmain"
> > >=C2=A0 S =3D "${WORKDIR}/go"
> > >=C2=A0 B =3D "${S}"
> > >=C2=A0 UPSTREAM_CHECK_REGEX =3D "(?P<pver>\d+(\.\= d+)+)\.src\.tar"
> > > --
> > > 2.31.1
> > >
> >
> > >
> > >
> > >
> >
> >
> > --
> > Alexandre Belloni, co-owner and COO, Bootlin
> > Embedded Linux and Kernel engineering
> > https://bootlin.com


--
Michael Halstead
Linux Fou= ndation / Yocto Project
Systems Operations Engineer
--000000000000288b5005c13369e0--