All of lore.kernel.org
 help / color / mirror / Atom feed
* [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
@ 2018-11-13 22:40 Armin Kuster
  2018-11-13 22:55 ` Martin Jansa
  0 siblings, 1 reply; 10+ messages in thread
From: Armin Kuster @ 2018-11-13 22:40 UTC (permalink / raw)
  To: openembedded-devel

Signed-off-by: Armin Kuster <akuster808@gmail.com>
---
 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30 ++++++++++++++++++++++
 1 file changed, 30 insertions(+)
 create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py

diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
new file mode 100644
index 0000000..79bebf5
--- /dev/null
+++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
@@ -0,0 +1,30 @@
+import os
+import re
+import glob as g
+import shutil
+import tempfile
+from oeqa.selftest.case import OESelftestTestCase
+from oeqa.utils.commands import runCmd, bitbake, get_bb_var, get_bb_vars
+
+class MetaOESourceMirroring(OESelftestTestCase):
+    # Can we download everything from the OpenEmbedded Sources Mirror over http only
+    def test_oe_source_mirror(self):
+        self.write_config("""
+BB_ALLOWED_NETWORKS = " sources.openembedded.org"
+MIRRORS = ""
+DL_DIR = "${TMPDIR}/test_oe_downloads"
+PREMIRRORS = "\\
+    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    git://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/ \\n \\
+    hg://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n \\
+    osc://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    p4://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n \\
+    svn://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    ftp://.*/.*      http://sources.openembedded.org/mirror/sources/ \\n \\
+    http://.*/.*     http://sources.openembedded.org/mirror/sources/ \\n \\
+    https://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n"
+    """)
+
+        bitbake("world --runall fetch")
-- 
2.7.4



^ permalink raw reply related	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-13 22:40 [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org Armin Kuster
@ 2018-11-13 22:55 ` Martin Jansa
  2018-11-13 23:27   ` akuster808
  0 siblings, 1 reply; 10+ messages in thread
From: Martin Jansa @ 2018-11-13 22:55 UTC (permalink / raw)
  To: akuster808; +Cc: openembedded-devel

Is this the right URL? http://sources.openembedded.org/mirror/sources/
returns 404

meta/classes/mirrors.bbclass also uses:
cvs://.*/.*     http://sources.openembedded.org/ \n \
svn://.*/.*     http://sources.openembedded.org/ \n \
git://.*/.*     http://sources.openembedded.org/ \n \
hg://.*/.*      http://sources.openembedded.org/ \n \
bzr://.*/.*     http://sources.openembedded.org/ \n \
p4://.*/.*      http://sources.openembedded.org/ \n \
osc://.*/.*     http://sources.openembedded.org/ \n \
https?$://.*/.* http://sources.openembedded.org/ \n \
ftp://.*/.*     http://sources.openembedded.org/ \n \
npm://.*/?.*    http://sources.openembedded.org/ \n \

without the /mirror/sources suffix, maybe it's copy & paste issue from
downloads.yoctoproject.org which uses /mirror/sources?
git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \

But if the test works for you, then something even worse is going on :).

On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com> wrote:

> Signed-off-by: Armin Kuster <akuster808@gmail.com>
> ---
>  meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
> ++++++++++++++++++++++
>  1 file changed, 30 insertions(+)
>  create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>
> diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> new file mode 100644
> index 0000000..79bebf5
> --- /dev/null
> +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> @@ -0,0 +1,30 @@
> +import os
> +import re
> +import glob as g
> +import shutil
> +import tempfile
> +from oeqa.selftest.case import OESelftestTestCase
> +from oeqa.utils.commands import runCmd, bitbake, get_bb_var, get_bb_vars
> +
> +class MetaOESourceMirroring(OESelftestTestCase):
> +    # Can we download everything from the OpenEmbedded Sources Mirror
> over http only
> +    def test_oe_source_mirror(self):
> +        self.write_config("""
> +BB_ALLOWED_NETWORKS = " sources.openembedded.org"
> +MIRRORS = ""
> +DL_DIR = "${TMPDIR}/test_oe_downloads"
> +PREMIRRORS = "\\
> +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    git://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/ \\n \\
> +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n \\
> +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n \\
> +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    ftp://.*/.*      http://sources.openembedded.org/mirror/sources/ \\n
> \\
> +    http://.*/.*     http://sources.openembedded.org/mirror/sources/ \\n
> \\
> +    https://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n"
> +    """)
> +
> +        bitbake("world --runall fetch")
> --
> 2.7.4
>
> --
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-13 22:55 ` Martin Jansa
@ 2018-11-13 23:27   ` akuster808
  2018-11-14 15:17     ` Martin Jansa
  0 siblings, 1 reply; 10+ messages in thread
From: akuster808 @ 2018-11-13 23:27 UTC (permalink / raw)
  To: Martin Jansa; +Cc: openembedded-devel


On 11/13/18 2:55 PM, Martin Jansa wrote:
> Is this the right URL? http://sources.openembedded.org/mirror/sources/
> returns 404

I thought it was.

I get 404 with http://sources.openembedded.org/
<http://sources.openembedded.org/mirror/sources/>

>
> meta/classes/mirrors.bbclass also uses:
> cvs://.*/.*     http://sources.openembedded.org/ \n \
> svn://.*/.*     http://sources.openembedded.org/ \n \
> git://.*/.*     http://sources.openembedded.org/ \n \
> hg://.*/.*      http://sources.openembedded.org/ \n \
> bzr://.*/.*     http://sources.openembedded.org/ \n \
> p4://.*/.*      http://sources.openembedded.org/ \n \
> osc://.*/.*     http://sources.openembedded.org/ \n \
> https?$://.*/.* http://sources.openembedded.org/ \n \
> ftp://.*/.*     http://sources.openembedded.org/ \n \
> npm://.*/?.*    http://sources.openembedded.org/ \n \
>
I will change the URL's. thanks.
> without the /mirror/sources suffix, maybe it's copy & paste issue from
> downloads.yoctoproject.org <http://downloads.yoctoproject.org> which
> uses /mirror/sources?
> git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \
>
> But if the test works for you, then something even worse is going on :).


it found:

Summary: 5 tasks failed:
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch

with url changes i see:

virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/elfutils/elfutils_0.174.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-extended/libarchive/libarchive_3.3.3.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-support/mpfr/mpfr_4.0.1.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch

maybe the OE system needs to be checked out.


- armin

>
> On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com
> <mailto:akuster808@gmail.com>> wrote:
>
>     Signed-off-by: Armin Kuster <akuster808@gmail.com
>     <mailto:akuster808@gmail.com>>
>     ---
>      meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
>     ++++++++++++++++++++++
>      1 file changed, 30 insertions(+)
>      create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>
>     diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>     b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>     new file mode 100644
>     index 0000000..79bebf5
>     --- /dev/null
>     +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>     @@ -0,0 +1,30 @@
>     +import os
>     +import re
>     +import glob as g
>     +import shutil
>     +import tempfile
>     +from oeqa.selftest.case import OESelftestTestCase
>     +from oeqa.utils.commands import runCmd, bitbake, get_bb_var,
>     get_bb_vars
>     +
>     +class MetaOESourceMirroring(OESelftestTestCase):
>     +    # Can we download everything from the OpenEmbedded Sources
>     Mirror over http only
>     +    def test_oe_source_mirror(self):
>     +        self.write_config("""
>     +BB_ALLOWED_NETWORKS = " sources.openembedded.org
>     <http://sources.openembedded.org>"
>     +MIRRORS = ""
>     +DL_DIR = "${TMPDIR}/test_oe_downloads"
>     +PREMIRRORS = "\\
>     +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    git://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    ftp://.*/.*     
>     http://sources.openembedded.org/mirror/sources/ \\n \\
>     +    http://.*/.*   
>      http://sources.openembedded.org/mirror/sources/ \\n \\
>     +    https://.*/.*   
>     http://sources.openembedded.org/mirror/sources/ \\n"
>     +    """)
>     +
>     +        bitbake("world --runall fetch")
>     -- 
>     2.7.4
>
>     -- 
>     _______________________________________________
>     Openembedded-devel mailing list
>     Openembedded-devel@lists.openembedded.org
>     <mailto:Openembedded-devel@lists.openembedded.org>
>     http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-13 23:27   ` akuster808
@ 2018-11-14 15:17     ` Martin Jansa
  2018-11-14 16:18       ` akuster808
  0 siblings, 1 reply; 10+ messages in thread
From: Martin Jansa @ 2018-11-14 15:17 UTC (permalink / raw)
  To: akuster808; +Cc: openembedded-devel

[-- Attachment #1: Type: text/plain, Size: 6622 bytes --]

On Tue, Nov 13, 2018 at 03:27:39PM -0800, akuster808 wrote:
> 
> On 11/13/18 2:55 PM, Martin Jansa wrote:
> > Is this the right URL? http://sources.openembedded.org/mirror/sources/
> > returns 404
> 
> I thought it was.
> 
> I get 404 with http://sources.openembedded.org/
> <http://sources.openembedded.org/mirror/sources/>

This link is http://sources.openembedded.org/mirror/sources/, that's why
it's 404, with http://sources.openembedded.org/ you get 403, which is
fine.
> 
> >
> > meta/classes/mirrors.bbclass also uses:
> > cvs://.*/.*     http://sources.openembedded.org/ \n \
> > svn://.*/.*     http://sources.openembedded.org/ \n \
> > git://.*/.*     http://sources.openembedded.org/ \n \
> > hg://.*/.*      http://sources.openembedded.org/ \n \
> > bzr://.*/.*     http://sources.openembedded.org/ \n \
> > p4://.*/.*      http://sources.openembedded.org/ \n \
> > osc://.*/.*     http://sources.openembedded.org/ \n \
> > https?$://.*/.* http://sources.openembedded.org/ \n \
> > ftp://.*/.*     http://sources.openembedded.org/ \n \
> > npm://.*/?.*    http://sources.openembedded.org/ \n \
> >
> I will change the URL's. thanks.
> > without the /mirror/sources suffix, maybe it's copy & paste issue from
> > downloads.yoctoproject.org <http://downloads.yoctoproject.org> which
> > uses /mirror/sources?
> > git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \
> >
> > But if the test works for you, then something even worse is going on :).
> 
> 
> it found:
> 
> Summary: 5 tasks failed:
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
> 
> with url changes i see:
> 
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/elfutils/elfutils_0.174.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-extended/libarchive/libarchive_3.3.3.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-support/mpfr/mpfr_4.0.1.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
> 
> maybe the OE system needs to be checked out.

I've checked it yesterday and it's broken since Aug 6.

See IRC log from earlier today:
00:14 < armpit> sources.openembedded.org needs updating ; )
00:17 < JaMa> armpit: khem: the builder lost access to the fileserver as shown in
http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/475/console
00:18 < JaMa> something changed between Aug 6th and 9th

> 
> 
> - armin
> 
> >
> > On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com
> > <mailto:akuster808@gmail.com>> wrote:
> >
> >     Signed-off-by: Armin Kuster <akuster808@gmail.com
> >     <mailto:akuster808@gmail.com>>
> >     ---
> >      meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
> >     ++++++++++++++++++++++
> >      1 file changed, 30 insertions(+)
> >      create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >
> >     diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     new file mode 100644
> >     index 0000000..79bebf5
> >     --- /dev/null
> >     +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     @@ -0,0 +1,30 @@
> >     +import os
> >     +import re
> >     +import glob as g
> >     +import shutil
> >     +import tempfile
> >     +from oeqa.selftest.case import OESelftestTestCase
> >     +from oeqa.utils.commands import runCmd, bitbake, get_bb_var,
> >     get_bb_vars
> >     +
> >     +class MetaOESourceMirroring(OESelftestTestCase):
> >     +    # Can we download everything from the OpenEmbedded Sources
> >     Mirror over http only
> >     +    def test_oe_source_mirror(self):
> >     +        self.write_config("""
> >     +BB_ALLOWED_NETWORKS = " sources.openembedded.org
> >     <http://sources.openembedded.org>"
> >     +MIRRORS = ""
> >     +DL_DIR = "${TMPDIR}/test_oe_downloads"
> >     +PREMIRRORS = "\\
> >     +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    git://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    ftp://.*/.*     
> >     http://sources.openembedded.org/mirror/sources/ \\n \\
> >     +    http://.*/.*   
> >      http://sources.openembedded.org/mirror/sources/ \\n \\
> >     +    https://.*/.*   
> >     http://sources.openembedded.org/mirror/sources/ \\n"
> >     +    """)
> >     +
> >     +        bitbake("world --runall fetch")
> >     -- 
> >     2.7.4
> >
> >     -- 
> >     _______________________________________________
> >     Openembedded-devel mailing list
> >     Openembedded-devel@lists.openembedded.org
> >     <mailto:Openembedded-devel@lists.openembedded.org>
> >     http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> >

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 201 bytes --]

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-14 15:17     ` Martin Jansa
@ 2018-11-14 16:18       ` akuster808
  2018-11-19 20:01         ` Michael Halstead
  0 siblings, 1 reply; 10+ messages in thread
From: akuster808 @ 2018-11-14 16:18 UTC (permalink / raw)
  To: Martin Jansa; +Cc: openembedded-devel


[-- Attachment #1.1.1: Type: text/plain, Size: 6719 bytes --]


On 11/14/18 7:17 AM, Martin Jansa wrote:
> On Tue, Nov 13, 2018 at 03:27:39PM -0800, akuster808 wrote:
>> On 11/13/18 2:55 PM, Martin Jansa wrote:
>>> Is this the right URL? http://sources.openembedded.org/mirror/sources/
>>> returns 404
>> I thought it was.
>>
>> I get 404 with http://sources.openembedded.org/
>> <http://sources.openembedded.org/mirror/sources/>
> This link is http://sources.openembedded.org/mirror/sources/, that's why
> it's 404, with http://sources.openembedded.org/ you get 403, which is
> fine.
>>> meta/classes/mirrors.bbclass also uses:
>>> cvs://.*/.*     http://sources.openembedded.org/ \n \
>>> svn://.*/.*     http://sources.openembedded.org/ \n \
>>> git://.*/.*     http://sources.openembedded.org/ \n \
>>> hg://.*/.*      http://sources.openembedded.org/ \n \
>>> bzr://.*/.*     http://sources.openembedded.org/ \n \
>>> p4://.*/.*      http://sources.openembedded.org/ \n \
>>> osc://.*/.*     http://sources.openembedded.org/ \n \
>>> https?$://.*/.* http://sources.openembedded.org/ \n \
>>> ftp://.*/.*     http://sources.openembedded.org/ \n \
>>> npm://.*/?.*    http://sources.openembedded.org/ \n \
>>>
>> I will change the URL's. thanks.
>>> without the /mirror/sources suffix, maybe it's copy & paste issue from
>>> downloads.yoctoproject.org <http://downloads.yoctoproject.org> which
>>> uses /mirror/sources?
>>> git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \
>>>
>>> But if the test works for you, then something even worse is going on :).
>>
>> it found:
>>
>> Summary: 5 tasks failed:
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
>>
>> with url changes i see:
>>
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/elfutils/elfutils_0.174.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-extended/libarchive/libarchive_3.3.3.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-support/mpfr/mpfr_4.0.1.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
>>
>> maybe the OE system needs to be checked out.
> I've checked it yesterday and it's broken since Aug 6.
>
> See IRC log from earlier today:
> 00:14 < armpit> sources.openembedded.org needs updating ; )
> 00:17 < JaMa> armpit: khem: the builder lost access to the fileserver as shown in
> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/475/console
> 00:18 < JaMa> something changed between Aug 6th and 9th
>

/I think Khem is looking into it./

/Looks like the selftest has a use./

/- armin/

>>
>> - armin
>>
>>> On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com
>>> <mailto:akuster808@gmail.com>> wrote:
>>>
>>>     Signed-off-by: Armin Kuster <akuster808@gmail.com
>>>     <mailto:akuster808@gmail.com>>
>>>     ---
>>>      meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
>>>     ++++++++++++++++++++++
>>>      1 file changed, 30 insertions(+)
>>>      create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>
>>>     diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     new file mode 100644
>>>     index 0000000..79bebf5
>>>     --- /dev/null
>>>     +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     @@ -0,0 +1,30 @@
>>>     +import os
>>>     +import re
>>>     +import glob as g
>>>     +import shutil
>>>     +import tempfile
>>>     +from oeqa.selftest.case import OESelftestTestCase
>>>     +from oeqa.utils.commands import runCmd, bitbake, get_bb_var,
>>>     get_bb_vars
>>>     +
>>>     +class MetaOESourceMirroring(OESelftestTestCase):
>>>     +    # Can we download everything from the OpenEmbedded Sources
>>>     Mirror over http only
>>>     +    def test_oe_source_mirror(self):
>>>     +        self.write_config("""
>>>     +BB_ALLOWED_NETWORKS = " sources.openembedded.org
>>>     <http://sources.openembedded.org>"
>>>     +MIRRORS = ""
>>>     +DL_DIR = "${TMPDIR}/test_oe_downloads"
>>>     +PREMIRRORS = "\\
>>>     +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    git://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    ftp://.*/.*     
>>>     http://sources.openembedded.org/mirror/sources/ \\n \\
>>>     +    http://.*/.*   
>>>      http://sources.openembedded.org/mirror/sources/ \\n \\
>>>     +    https://.*/.*   
>>>     http://sources.openembedded.org/mirror/sources/ \\n"
>>>     +    """)
>>>     +
>>>     +        bitbake("world --runall fetch")
>>>     -- 
>>>     2.7.4
>>>
>>>     -- 
>>>     _______________________________________________
>>>     Openembedded-devel mailing list
>>>     Openembedded-devel@lists.openembedded.org
>>>     <mailto:Openembedded-devel@lists.openembedded.org>
>>>     http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-14 16:18       ` akuster808
@ 2018-11-19 20:01         ` Michael Halstead
  2018-11-19 20:18           ` Khem Raj
  0 siblings, 1 reply; 10+ messages in thread
From: Michael Halstead @ 2018-11-19 20:01 UTC (permalink / raw)
  To: Armin Kuster (akuster808@gmail.com); +Cc: openembeded-devel

The rsync target on on the world build machine was offline following a
reboot causing the sync to sources.oe.org to fail. The rsync target is now
configured to be available following reboots and the sync has run. Please
let me know if this test still fails.

On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com> wrote:

> --
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-19 20:01         ` Michael Halstead
@ 2018-11-19 20:18           ` Khem Raj
  2018-11-20  8:07             ` Martin Jansa
  0 siblings, 1 reply; 10+ messages in thread
From: Khem Raj @ 2018-11-19 20:18 UTC (permalink / raw)
  To: Michael Halstead; +Cc: openembeded-devel

Thanks Michael for taking care of it

On Mon, Nov 19, 2018 at 12:02 PM Michael Halstead <
mhalstead@linuxfoundation.org> wrote:

> The rsync target on on the world build machine was offline following a
> reboot causing the sync to sources.oe.org to fail. The rsync target is now
> configured to be available following reboots and the sync has run. Please
> let me know if this test still fails.
>
> On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com> wrote:
>
> > --
> > _______________________________________________
> > Openembedded-devel mailing list
> > Openembedded-devel@lists.openembedded.org
> > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> >
> --
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-19 20:18           ` Khem Raj
@ 2018-11-20  8:07             ` Martin Jansa
  2018-11-21 14:18               ` Martin Jansa
  0 siblings, 1 reply; 10+ messages in thread
From: Martin Jansa @ 2018-11-20  8:07 UTC (permalink / raw)
  To: Khem Raj; +Cc: openembedded-devel

The jenkins job which does the rsync (or at least how I was doing it), is
still failing as reported before:
http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/480/console

Either you're using something else now, or it still won't work.

Regards,

On Mon, Nov 19, 2018 at 9:18 PM Khem Raj <raj.khem@gmail.com> wrote:

> Thanks Michael for taking care of it
>
> On Mon, Nov 19, 2018 at 12:02 PM Michael Halstead <
> mhalstead@linuxfoundation.org> wrote:
>
> > The rsync target on on the world build machine was offline following a
> > reboot causing the sync to sources.oe.org to fail. The rsync target is
> now
> > configured to be available following reboots and the sync has run. Please
> > let me know if this test still fails.
> >
> > On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com> wrote:
> >
> > > --
> > > _______________________________________________
> > > Openembedded-devel mailing list
> > > Openembedded-devel@lists.openembedded.org
> > > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> > >
> > --
> > _______________________________________________
> > Openembedded-devel mailing list
> > Openembedded-devel@lists.openembedded.org
> > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> >
> --
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-20  8:07             ` Martin Jansa
@ 2018-11-21 14:18               ` Martin Jansa
  2018-11-21 14:38                 ` akuster808
  0 siblings, 1 reply; 10+ messages in thread
From: Martin Jansa @ 2018-11-21 14:18 UTC (permalink / raw)
  To: Khem Raj; +Cc: openembedded-devel

I've fixed known_hosts on abaco and some archives were finally rsynced:
http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/481/console

but it doesn't seem to cover all found issues, please re-run the test to
see what's left.


On Tue, Nov 20, 2018 at 9:07 AM Martin Jansa <martin.jansa@gmail.com> wrote:

> The jenkins job which does the rsync (or at least how I was doing it), is
> still failing as reported before:
>
> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/480/console
>
> Either you're using something else now, or it still won't work.
>
> Regards,
>
> On Mon, Nov 19, 2018 at 9:18 PM Khem Raj <raj.khem@gmail.com> wrote:
>
>> Thanks Michael for taking care of it
>>
>> On Mon, Nov 19, 2018 at 12:02 PM Michael Halstead <
>> mhalstead@linuxfoundation.org> wrote:
>>
>> > The rsync target on on the world build machine was offline following a
>> > reboot causing the sync to sources.oe.org to fail. The rsync target is
>> now
>> > configured to be available following reboots and the sync has run.
>> Please
>> > let me know if this test still fails.
>> >
>> > On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com>
>> wrote:
>> >
>> > > --
>> > > _______________________________________________
>> > > Openembedded-devel mailing list
>> > > Openembedded-devel@lists.openembedded.org
>> > > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>> > >
>> > --
>> > _______________________________________________
>> > Openembedded-devel mailing list
>> > Openembedded-devel@lists.openembedded.org
>> > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>> >
>> --
>> _______________________________________________
>> Openembedded-devel mailing list
>> Openembedded-devel@lists.openembedded.org
>> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>
>


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org
  2018-11-21 14:18               ` Martin Jansa
@ 2018-11-21 14:38                 ` akuster808
  0 siblings, 0 replies; 10+ messages in thread
From: akuster808 @ 2018-11-21 14:38 UTC (permalink / raw)
  To: Martin Jansa, Khem Raj; +Cc: openembedded-devel

Thanks Martin,

Looks like this is the only failure left.

Summary: 1 task failed:
 
virtual:native:/home/build/releases/master/openembedded-core/meta/recipes-support/lz4/lz4_1.8.2.bb:do_fetch

- Armin



On 11/21/18 7:18 AM, Martin Jansa wrote:
> I've fixed known_hosts on abaco and some archives were finally rsynced:
> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/481/console
>
> but it doesn't seem to cover all found issues, please re-run the test to
> see what's left.
>
>
> On Tue, Nov 20, 2018 at 9:07 AM Martin Jansa <martin.jansa@gmail.com> wrote:
>
>> The jenkins job which does the rsync (or at least how I was doing it), is
>> still failing as reported before:
>>
>> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/480/console
>>
>> Either you're using something else now, or it still won't work.
>>
>> Regards,
>>
>> On Mon, Nov 19, 2018 at 9:18 PM Khem Raj <raj.khem@gmail.com> wrote:
>>
>>> Thanks Michael for taking care of it
>>>
>>> On Mon, Nov 19, 2018 at 12:02 PM Michael Halstead <
>>> mhalstead@linuxfoundation.org> wrote:
>>>
>>>> The rsync target on on the world build machine was offline following a
>>>> reboot causing the sync to sources.oe.org to fail. The rsync target is
>>> now
>>>> configured to be available following reboots and the sync has run.
>>> Please
>>>> let me know if this test still fails.
>>>>
>>>> On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com>
>>> wrote:
>>>>> --
>>>>> _______________________________________________
>>>>> Openembedded-devel mailing list
>>>>> Openembedded-devel@lists.openembedded.org
>>>>> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>>>
>>>> --
>>>> _______________________________________________
>>>> Openembedded-devel mailing list
>>>> Openembedded-devel@lists.openembedded.org
>>>> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>>
>>> --
>>> _______________________________________________
>>> Openembedded-devel mailing list
>>> Openembedded-devel@lists.openembedded.org
>>> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>



^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2018-11-21 14:38 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-11-13 22:40 [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org Armin Kuster
2018-11-13 22:55 ` Martin Jansa
2018-11-13 23:27   ` akuster808
2018-11-14 15:17     ` Martin Jansa
2018-11-14 16:18       ` akuster808
2018-11-19 20:01         ` Michael Halstead
2018-11-19 20:18           ` Khem Raj
2018-11-20  8:07             ` Martin Jansa
2018-11-21 14:18               ` Martin Jansa
2018-11-21 14:38                 ` akuster808

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.