* [PATCH 1/7] ncurses: Don't put terminfo into the sysroot
@ 2021-01-27 17:27 Richard Purdie
2021-01-27 17:27 ` [PATCH 2/7] python3: Avoid installing test data into recipe-sysroot Richard Purdie
` (6 more replies)
0 siblings, 7 replies; 23+ messages in thread
From: Richard Purdie @ 2021-01-27 17:27 UTC (permalink / raw)
To: openembedded-core
This recudes the file count from ~2850 to ~100 which is a huge win
for reducing build directory clutter, its unlikely anything uses the
terminfo data or man pages in the sysroot. This is especially helpful
as we usually end up with two copies of these sets of files.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
meta/recipes-core/ncurses/ncurses.inc | 5 +++++
1 file changed, 5 insertions(+)
diff --git a/meta/recipes-core/ncurses/ncurses.inc b/meta/recipes-core/ncurses/ncurses.inc
index fe4e8a5d6e1..ef59bc3b0a0 100644
--- a/meta/recipes-core/ncurses/ncurses.inc
+++ b/meta/recipes-core/ncurses/ncurses.inc
@@ -324,3 +324,8 @@ FILES_${PN}-terminfo-base = "\
RSUGGESTS_${PN}-libtinfo = "${PN}-terminfo"
RRECOMMENDS_${PN}-libtinfo = "${PN}-terminfo-base"
+
+# Putting terminfo into the sysroot adds around 2800 files to
+# each recipe specific sysroot. We can live without this, particularly
+# as many recipes may have native and target copies.
+SYSROOT_DIRS_remove = "${datadir}"
--
2.27.0
^ permalink raw reply related [flat|nested] 23+ messages in thread
* [PATCH 2/7] python3: Avoid installing test data into recipe-sysroot
2021-01-27 17:27 [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Richard Purdie
@ 2021-01-27 17:27 ` Richard Purdie
2021-01-27 17:27 ` [PATCH 3/7] staging: Clean up files installed into the sysroot Richard Purdie
` (5 subsequent siblings)
6 siblings, 0 replies; 23+ messages in thread
From: Richard Purdie @ 2021-01-27 17:27 UTC (permalink / raw)
To: openembedded-core
There are several thousand files in the test directory which we don't need.
Adding these for the native and target sysroots is a crazy amount of files
to be throwing around needlessly. Delete the files from the sysroot side
of things to tidy up the sysroots and improve performance.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
meta/recipes-devtools/python/python3_3.9.1.bb | 6 ++++++
1 file changed, 6 insertions(+)
diff --git a/meta/recipes-devtools/python/python3_3.9.1.bb b/meta/recipes-devtools/python/python3_3.9.1.bb
index 17d0c032f73..a89122f9494 100644
--- a/meta/recipes-devtools/python/python3_3.9.1.bb
+++ b/meta/recipes-devtools/python/python3_3.9.1.bb
@@ -372,3 +372,9 @@ RDEPENDS_${PN}-dev = ""
RDEPENDS_${PN}-tests_append_class-target = " ${MLPREFIX}bash"
RDEPENDS_${PN}-tests_append_class-nativesdk = " ${MLPREFIX}bash"
+
+# Python's tests contain large numbers of files we don't need in the recipe sysroots
+SYSROOT_PREPROCESS_FUNCS += " py3_sysroot_cleanup"
+py3_sysroot_cleanup () {
+ rm -rf ${SYSROOT_DESTDIR}${libdir}/python${PYTHON_MAJMIN}/test
+}
--
2.27.0
^ permalink raw reply related [flat|nested] 23+ messages in thread
* [PATCH 3/7] staging: Clean up files installed into the sysroot
2021-01-27 17:27 [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Richard Purdie
2021-01-27 17:27 ` [PATCH 2/7] python3: Avoid installing test data into recipe-sysroot Richard Purdie
@ 2021-01-27 17:27 ` Richard Purdie
2021-01-27 17:27 ` [PATCH 4/7] gobject-introspection: Fix variable override order Richard Purdie
` (4 subsequent siblings)
6 siblings, 0 replies; 23+ messages in thread
From: Richard Purdie @ 2021-01-27 17:27 UTC (permalink / raw)
To: openembedded-core
There are a variety of files being installed into $datadir which we
don't need. Pick the top "offenders" which amount of thousands of files
and simply don't install them. These include things like test data,
terminfo data, locale data for native tools and so on. This saves
copying these files into native and target sysroots and should improve
performance (smaller sstate, fewer files to copy around).
With this and the python recipe change, alsa-tools went from:
recipe-sysroot: 18357
recipe-sysroot-native: 14129
to
recipe-sysroot: 10809
recipe-sysroot-native: 8079
which is a decent improvement.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
meta/classes/staging.bbclass | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/meta/classes/staging.bbclass b/meta/classes/staging.bbclass
index 12e0eab4f0f..bbe8cff9b1a 100644
--- a/meta/classes/staging.bbclass
+++ b/meta/classes/staging.bbclass
@@ -28,11 +28,15 @@ SYSROOT_DIRS_BLACKLIST = " \
${mandir} \
${docdir} \
${infodir} \
+ ${datadir}/X11/locale \
${datadir}/applications \
+ ${datadir}/bash-completion \
${datadir}/fonts \
${datadir}/gtk-doc/html \
+ ${datadir}/installed-tests \
${datadir}/locale \
${datadir}/pixmaps \
+ ${datadir}/terminfo \
${libdir}/${BPN}/ptest \
"
--
2.27.0
^ permalink raw reply related [flat|nested] 23+ messages in thread
* [PATCH 4/7] gobject-introspection: Fix variable override order
2021-01-27 17:27 [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Richard Purdie
2021-01-27 17:27 ` [PATCH 2/7] python3: Avoid installing test data into recipe-sysroot Richard Purdie
2021-01-27 17:27 ` [PATCH 3/7] staging: Clean up files installed into the sysroot Richard Purdie
@ 2021-01-27 17:27 ` Richard Purdie
2021-01-27 17:27 ` [PATCH 5/7] bitbake.conf/python: Drop setting RDEPENDS/RPROVIDES default Richard Purdie
` (3 subsequent siblings)
6 siblings, 0 replies; 23+ messages in thread
From: Richard Purdie @ 2021-01-27 17:27 UTC (permalink / raw)
To: openembedded-core
The DEPENDS variable override ordering here was almostly certainly
incorrect and led to weird behaviour when making changes elsewhere.
Correct it.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
.../gobject-introspection/gobject-introspection_1.66.1.bb | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/meta/recipes-gnome/gobject-introspection/gobject-introspection_1.66.1.bb b/meta/recipes-gnome/gobject-introspection/gobject-introspection_1.66.1.bb
index ee0ab2866b8..ebac8d3a432 100644
--- a/meta/recipes-gnome/gobject-introspection/gobject-introspection_1.66.1.bb
+++ b/meta/recipes-gnome/gobject-introspection/gobject-introspection_1.66.1.bb
@@ -28,14 +28,14 @@ GTKDOC_MESON_OPTION = "gtk_doc"
MULTILIB_SCRIPTS = "${PN}:${bindir}/g-ir-annotation-tool ${PN}:${bindir}/g-ir-scanner"
-DEPENDS_append = " libffi zlib glib-2.0 python3 flex-native bison-native autoconf-archive"
+DEPENDS += " libffi zlib glib-2.0 python3 flex-native bison-native autoconf-archive"
# target build needs qemu to run temporary introspection binaries created
# on the fly by g-ir-scanner and a native version of itself to run
# native versions of its own tools during build.
# Also prelink-rtld is used to find out library dependencies of introspection binaries
# (standard ldd doesn't work when cross-compiling).
-DEPENDS_class-target_append = " gobject-introspection-native qemu-native prelink-native"
+DEPENDS_append_class-target = " gobject-introspection-native qemu-native prelink-native"
# needed for writing out the qemu wrapper script
export STAGING_DIR_HOST
--
2.27.0
^ permalink raw reply related [flat|nested] 23+ messages in thread
* [PATCH 5/7] bitbake.conf/python: Drop setting RDEPENDS/RPROVIDES default
2021-01-27 17:27 [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Richard Purdie
` (2 preceding siblings ...)
2021-01-27 17:27 ` [PATCH 4/7] gobject-introspection: Fix variable override order Richard Purdie
@ 2021-01-27 17:27 ` Richard Purdie
2021-01-27 17:27 ` [PATCH 6/7] native: Stop clearing PACKAGES Richard Purdie
` (2 subsequent siblings)
6 siblings, 0 replies; 23+ messages in thread
From: Richard Purdie @ 2021-01-27 17:27 UTC (permalink / raw)
To: openembedded-core
We never recommend setting RDEPENDS or RPROVIDES without a package name
against them. The default in bitbake.conf is legacy only, drop it.
The python recipe was trying to add to the empty variable in the native case
fix that too.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
meta/conf/bitbake.conf | 2 --
meta/recipes-devtools/python/python3_3.9.1.bb | 2 +-
2 files changed, 1 insertion(+), 3 deletions(-)
diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index af1b3b8c3e2..790859e8ae1 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -272,10 +272,8 @@ DEPCHAIN_PRE = ""
DEPCHAIN_POST = "-dev -dbg"
DEPENDS = ""
-RDEPENDS = ""
PROVIDES = ""
PROVIDES_prepend = "${PN} "
-RPROVIDES = ""
MULTI_PROVIDER_WHITELIST = "virtual/libintl virtual/libintl-native virtual/nativesdk-libintl virtual/xserver virtual/update-alternatives-native virtual/update-alternatives"
diff --git a/meta/recipes-devtools/python/python3_3.9.1.bb b/meta/recipes-devtools/python/python3_3.9.1.bb
index a89122f9494..a2dc572672c 100644
--- a/meta/recipes-devtools/python/python3_3.9.1.bb
+++ b/meta/recipes-devtools/python/python3_3.9.1.bb
@@ -240,7 +240,7 @@ python(){
# First set RPROVIDES for -native case
# Hardcoded since it cant be python3-native-foo, should be python3-foo-native
pn = 'python3'
- rprovides = d.getVar('RPROVIDES').split()
+ rprovides = (d.getVar('RPROVIDES') or "").split()
# ${PN}-misc-native is not in the manifest
rprovides.append(pn + '-misc-native')
--
2.27.0
^ permalink raw reply related [flat|nested] 23+ messages in thread
* [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-27 17:27 [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Richard Purdie
` (3 preceding siblings ...)
2021-01-27 17:27 ` [PATCH 5/7] bitbake.conf/python: Drop setting RDEPENDS/RPROVIDES default Richard Purdie
@ 2021-01-27 17:27 ` Richard Purdie
2021-01-30 16:15 ` [OE-core] " Martin Jansa
2021-02-04 19:43 ` Peter Kjellerstedt
2021-01-27 17:27 ` [PATCH 7/7] meta: Clean up various class-native* RDEPENDS overrides Richard Purdie
2021-01-28 8:45 ` [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Mikko Rapeli
6 siblings, 2 replies; 23+ messages in thread
From: Richard Purdie @ 2021-01-27 17:27 UTC (permalink / raw)
To: openembedded-core
Native recipes have been special and they don't have packages generated
from them. The RDEPENDS/RPROVIDES and other runtime package specific
variables can contain important data about dependencies recipes need
though and currently it is required to write this information explicitly
in the native case.
We now delete the packaging tasks for native recipes which removes the
need to clear PACKAGES. The next step to improve the metadata is to
stop clearing it and ensure any entries in these variables are remapped
appropriately. The R* variables were already being processed by the class
extension code but the implementation was suboptimal.
This patch stops clearing PACKAGES and PACKAGES_DYNAMIC and fixes the places
where that caused issues in OE-Core, for example PACKAGES additions in anonymous
python without the "-native" suffix and a case where the included classes
caused a self reference in DEPENDS which would once have been removed by
the previous code.
The implementation uses datastore/parser parameters to ensure that the
variable overrides are not overwritten when calling setVar which is appropriate
for a function as close to the core as this one is.
Some now unneeded code in python3-setuptools is dropped, there are further
changes like this which can follow.
This change was verified with OE-Core by comparing task-depends.dot generated
by "bitbake world -g" before and after the change, the files were identical.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
meta/classes/native.bbclass | 23 ++++++++-----------
.../python/python3-setuptools_51.0.0.bb | 5 ----
.../gdk-pixbuf/gdk-pixbuf_2.40.0.bb | 1 +
meta/recipes-support/boost/boost.inc | 3 +++
4 files changed, 13 insertions(+), 19 deletions(-)
diff --git a/meta/classes/native.bbclass b/meta/classes/native.bbclass
index 08106e345ca..a0838e41b97 100644
--- a/meta/classes/native.bbclass
+++ b/meta/classes/native.bbclass
@@ -5,20 +5,12 @@ inherit relocatable
# no need for them to be a direct target of 'world'
EXCLUDE_FROM_WORLD = "1"
-PACKAGES = ""
-PACKAGES_class-native = ""
-PACKAGES_DYNAMIC = ""
-PACKAGES_DYNAMIC_class-native = ""
PACKAGE_ARCH = "${BUILD_ARCH}"
# used by cmake class
OECMAKE_RPATH = "${libdir}"
OECMAKE_RPATH_class-native = "${libdir}"
-# When this class has packaging enabled, setting
-# RPROVIDES becomes unnecessary.
-RPROVIDES = "${PN}"
-
TARGET_ARCH = "${BUILD_ARCH}"
TARGET_OS = "${BUILD_OS}"
TARGET_VENDOR = "${BUILD_VENDOR}"
@@ -138,7 +130,7 @@ python native_virtclass_handler () {
if "native" not in classextend:
return
- def map_dependencies(varname, d, suffix = ""):
+ def map_dependencies(varname, d, suffix = "", selfref=True):
if suffix:
varname = varname + "_" + suffix
deps = d.getVar(varname)
@@ -148,22 +140,25 @@ python native_virtclass_handler () {
newdeps = []
for dep in deps:
if dep == pn:
- continue
+ if not selfref:
+ continue
+ newdeps.append(dep)
elif "-cross-" in dep:
newdeps.append(dep.replace("-cross", "-native"))
elif not dep.endswith("-native"):
- newdeps.append(dep + "-native")
+ newdeps.append(dep.replace("-native", "") + "-native")
else:
newdeps.append(dep)
- d.setVar(varname, " ".join(newdeps))
+ d.setVar(varname, " ".join(newdeps), parsing=True)
- map_dependencies("DEPENDS", e.data)
- for pkg in [e.data.getVar("PN"), "", "${PN}"]:
+ map_dependencies("DEPENDS", e.data, selfref=False)
+ for pkg in e.data.getVar("PACKAGES", False).split():
map_dependencies("RDEPENDS", e.data, pkg)
map_dependencies("RRECOMMENDS", e.data, pkg)
map_dependencies("RSUGGESTS", e.data, pkg)
map_dependencies("RPROVIDES", e.data, pkg)
map_dependencies("RREPLACES", e.data, pkg)
+ map_dependencies("PACKAGES", e.data)
provides = e.data.getVar("PROVIDES")
nprovides = []
diff --git a/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb b/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
index 6ee935f8f79..db336bfa13b 100644
--- a/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
+++ b/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
@@ -58,8 +58,3 @@ RDEPENDS_${PYTHON_PN}-pkg-resources = "\
${PYTHON_PN}-plistlib \
${PYTHON_PN}-pprint \
"
-# Due to the way OE-Core implemented native recipes, the native class cannot
-# have a dependency on something that is not a recipe name. Work around that by
-# manually setting RPROVIDES.
-RDEPENDS_${PN}_append = " ${PYTHON_PN}-pkg-resources"
-RPROVIDES_append_class-native = " ${PYTHON_PN}-pkg-resources-native"
diff --git a/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb b/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
index 16708fd581d..226e1c7b89f 100644
--- a/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
+++ b/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
@@ -13,6 +13,7 @@ LIC_FILES_CHKSUM = "file://COPYING;md5=4fbd65380cdd255951079008b364516c \
SECTION = "libs"
DEPENDS = "glib-2.0 gdk-pixbuf-native shared-mime-info"
+DEPENDS_remove_class-native = "gdk-pixbuf-native"
MAJ_VER = "${@oe.utils.trim_version("${PV}", 2)}"
diff --git a/meta/recipes-support/boost/boost.inc b/meta/recipes-support/boost/boost.inc
index cbf9cad7071..c9bb1785419 100644
--- a/meta/recipes-support/boost/boost.inc
+++ b/meta/recipes-support/boost/boost.inc
@@ -59,10 +59,13 @@ PACKAGES = "${PN}-dbg ${BOOST_PACKAGES}"
python __anonymous () {
packages = []
extras = []
+ pn = d.getVar("PN")
mlprefix = d.getVar("MLPREFIX")
for lib in d.getVar('BOOST_LIBS').split():
extras.append("--with-%s" % lib)
pkg = "boost-%s" % (lib.replace("_", "-"))
+ if "-native" in pn:
+ pkg = pkg + "-native"
packages.append(mlprefix + pkg)
if not d.getVar("FILES_%s" % pkg):
d.setVar("FILES_%s%s" % (mlprefix, pkg), "${libdir}/libboost_%s*.so.*" % lib)
--
2.27.0
^ permalink raw reply related [flat|nested] 23+ messages in thread
* [PATCH 7/7] meta: Clean up various class-native* RDEPENDS overrides
2021-01-27 17:27 [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Richard Purdie
` (4 preceding siblings ...)
2021-01-27 17:27 ` [PATCH 6/7] native: Stop clearing PACKAGES Richard Purdie
@ 2021-01-27 17:27 ` Richard Purdie
2021-01-28 8:45 ` [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Mikko Rapeli
6 siblings, 0 replies; 23+ messages in thread
From: Richard Purdie @ 2021-01-27 17:27 UTC (permalink / raw)
To: openembedded-core
With PACKAGES functioning more correctly for native recipes combined
with classextend improvements over the years, there are various overrides
of RDEPENDS which look unecessary now, clean them up.
There some some minor changes in dependencies, specifically:
"python3-numpy-native.do_populate_sysroot" -> "python3-native.do_populate_sysroot"
"python3-mako-native.do_populate_sysroot" -> "python3-native.do_populate_sysroot"
"itstool-native.do_populate_sysroot" -> "libxml2-native.do_populate_sysroot"
however there are already:
XXX-native.do_prepare_recipe_ssysroot -> YYY-native.do_populate_sysroot
mappings from DEPENDS so this is effectively a null op.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
meta/recipes-core/dbus/dbus_1.12.20.bb | 2 --
meta/recipes-devtools/autoconf/autoconf.inc | 29 +------------------
.../automake/automake_1.16.2.bb | 1 -
.../python-numpy/python3-numpy_1.19.5.bb | 2 --
.../python/python3-mako_1.1.4.bb | 2 --
meta/recipes-devtools/tcltk/tcl_8.6.11.bb | 1 -
.../perl/libtimedate-perl_2.30.bb | 1 -
meta/recipes-support/itstool/itstool_2.0.6.bb | 1 -
8 files changed, 1 insertion(+), 38 deletions(-)
diff --git a/meta/recipes-core/dbus/dbus_1.12.20.bb b/meta/recipes-core/dbus/dbus_1.12.20.bb
index 09049301cc7..32e7d9cfa38 100644
--- a/meta/recipes-core/dbus/dbus_1.12.20.bb
+++ b/meta/recipes-core/dbus/dbus_1.12.20.bb
@@ -6,8 +6,6 @@ SECTION = "base"
require dbus.inc
DEPENDS = "expat virtual/libintl autoconf-archive"
-RDEPENDS_dbus_class-native = ""
-RDEPENDS_dbus_class-nativesdk = ""
PACKAGES += "${@bb.utils.contains('DISTRO_FEATURES', 'ptest', '${PN}-ptest', '', d)}"
ALLOW_EMPTY_dbus-ptest = "1"
RDEPENDS_dbus-ptest_class-target = "dbus-test-ptest"
diff --git a/meta/recipes-devtools/autoconf/autoconf.inc b/meta/recipes-devtools/autoconf/autoconf.inc
index 787f30a0975..a4db7ca38f3 100644
--- a/meta/recipes-devtools/autoconf/autoconf.inc
+++ b/meta/recipes-devtools/autoconf/autoconf.inc
@@ -32,34 +32,7 @@ RDEPENDS_${PN} = "m4 gnu-config \
perl-module-thread-queue \
perl-module-threads \
"
-RDEPENDS_${PN}_class-native = "m4-native gnu-config-native"
-RDEPENDS_${PN}_class-nativesdk = "\
- nativesdk-gnu-config \
- nativesdk-m4 \
- nativesdk-perl \
- nativesdk-perl-module-bytes \
- nativesdk-perl-module-carp \
- nativesdk-perl-module-constant \
- nativesdk-perl-module-data-dumper \
- nativesdk-perl-module-errno \
- nativesdk-perl-module-exporter \
- nativesdk-perl-module-file-basename \
- nativesdk-perl-module-file-compare \
- nativesdk-perl-module-file-copy \
- nativesdk-perl-module-file-find \
- nativesdk-perl-module-file-glob \
- nativesdk-perl-module-file-path \
- nativesdk-perl-module-file-spec \
- nativesdk-perl-module-file-spec-unix \
- nativesdk-perl-module-file-stat \
- nativesdk-perl-module-getopt-long \
- nativesdk-perl-module-io-file \
- nativesdk-perl-module-overloading \
- nativesdk-perl-module-posix \
- nativesdk-perl-module-symbol \
- nativesdk-perl-module-thread-queue \
- nativesdk-perl-module-threads \
- "
+RDEPENDS_${PN}_class-native = "m4-native gnu-config-native hostperl-runtime-native"
inherit autotools texinfo
diff --git a/meta/recipes-devtools/automake/automake_1.16.2.bb b/meta/recipes-devtools/automake/automake_1.16.2.bb
index fd8ed0ed3b8..08ec0346263 100644
--- a/meta/recipes-devtools/automake/automake_1.16.2.bb
+++ b/meta/recipes-devtools/automake/automake_1.16.2.bb
@@ -17,7 +17,6 @@ RDEPENDS_${PN} += "\
perl-module-vars "
RDEPENDS_${PN}_class-native = "autoconf-native hostperl-runtime-native"
-RDEPENDS_${PN}_class-nativesdk = "nativesdk-autoconf"
SRC_URI += "file://python-libdir.patch \
file://buildtest.patch \
diff --git a/meta/recipes-devtools/python-numpy/python3-numpy_1.19.5.bb b/meta/recipes-devtools/python-numpy/python3-numpy_1.19.5.bb
index 5037d2a4221..b619bf6f32a 100644
--- a/meta/recipes-devtools/python-numpy/python3-numpy_1.19.5.bb
+++ b/meta/recipes-devtools/python-numpy/python3-numpy_1.19.5.bb
@@ -53,6 +53,4 @@ RDEPENDS_${PN}-ptest += "${PYTHON_PN}-pytest \
ldd \
"
-RDEPENDS_${PN}_class-native = ""
-
BBCLASSEXTEND = "native nativesdk"
diff --git a/meta/recipes-devtools/python/python3-mako_1.1.4.bb b/meta/recipes-devtools/python/python3-mako_1.1.4.bb
index 531fc6a3c0e..1645f37da44 100644
--- a/meta/recipes-devtools/python/python3-mako_1.1.4.bb
+++ b/meta/recipes-devtools/python/python3-mako_1.1.4.bb
@@ -15,6 +15,4 @@ RDEPENDS_${PN} = "${PYTHON_PN}-html \
${PYTHON_PN}-threading \
"
-RDEPENDS_${PN}_class-native = ""
-
BBCLASSEXTEND = "native nativesdk"
diff --git a/meta/recipes-devtools/tcltk/tcl_8.6.11.bb b/meta/recipes-devtools/tcltk/tcl_8.6.11.bb
index 74bdb098c6f..d0112020813 100644
--- a/meta/recipes-devtools/tcltk/tcl_8.6.11.bb
+++ b/meta/recipes-devtools/tcltk/tcl_8.6.11.bb
@@ -69,7 +69,6 @@ ALTERNATIVE_LINK_NAME[Thread.3] = "${mandir}/man3/Thread.3"
# isn't getting picked up by shlibs code
RDEPENDS_${PN} += "tcl-lib"
-RDEPENDS_${PN}_class-native = ""
RDEPENDS_${PN}-ptest += "libgcc"
BBCLASSEXTEND = "native nativesdk"
diff --git a/meta/recipes-extended/perl/libtimedate-perl_2.30.bb b/meta/recipes-extended/perl/libtimedate-perl_2.30.bb
index 7219c7d11eb..d42eadb586e 100644
--- a/meta/recipes-extended/perl/libtimedate-perl_2.30.bb
+++ b/meta/recipes-extended/perl/libtimedate-perl_2.30.bb
@@ -13,7 +13,6 @@ inherit cpan ptest-perl
BBCLASSEXTEND = "native"
-RDEPENDS_${PN}_class-native = ""
RDEPENDS_${PN} += "perl-module-carp perl-module-exporter perl-module-strict perl-module-time-local"
RDEPENDS_${PN}-ptest += "perl-module-test-more perl-module-utf8"
diff --git a/meta/recipes-support/itstool/itstool_2.0.6.bb b/meta/recipes-support/itstool/itstool_2.0.6.bb
index 5f358f463d0..c52aa7941a3 100644
--- a/meta/recipes-support/itstool/itstool_2.0.6.bb
+++ b/meta/recipes-support/itstool/itstool_2.0.6.bb
@@ -18,4 +18,3 @@ SRC_URI[sha256sum] = "6233cc22726a9a5a83664bf67d1af79549a298c23185d926c3677afa91
BBCLASSEXTEND = "native nativesdk"
RDEPENDS_${PN} += "libxml2-python"
-RDEPENDS_${PN}_class-native = ""
--
2.27.0
^ permalink raw reply related [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot
2021-01-27 17:27 [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Richard Purdie
` (5 preceding siblings ...)
2021-01-27 17:27 ` [PATCH 7/7] meta: Clean up various class-native* RDEPENDS overrides Richard Purdie
@ 2021-01-28 8:45 ` Mikko Rapeli
2021-01-28 9:02 ` Richard Purdie
2021-01-28 16:38 ` Richard Purdie
6 siblings, 2 replies; 23+ messages in thread
From: Mikko Rapeli @ 2021-01-28 8:45 UTC (permalink / raw)
To: richard.purdie; +Cc: openembedded-core
Hi Richard,
Interesting series! Do you already have some numbers how this affects
bitbake builds?
Cheers,
-Mikko
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot
2021-01-28 8:45 ` [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Mikko Rapeli
@ 2021-01-28 9:02 ` Richard Purdie
2021-01-28 10:35 ` Mikko Rapeli
2021-01-28 16:38 ` Richard Purdie
1 sibling, 1 reply; 23+ messages in thread
From: Richard Purdie @ 2021-01-28 9:02 UTC (permalink / raw)
To: Mikko.Rapeli; +Cc: openembedded-core
On Thu, 2021-01-28 at 08:45 +0000, Mikko.Rapeli@bmw.de wrote:
> Interesting series! Do you already have some numbers how this affects
> bitbake builds?
Not yet. I should really have split the series into two, the files
reduction and the native PACKAGES pieces as the latter is proving quite
unstable on the autobuilder and holding the other up. Once it does
build cleanly and merges, we will get build time measurements which I'm
curious about too.
Cheers,
Richard
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot
2021-01-28 9:02 ` Richard Purdie
@ 2021-01-28 10:35 ` Mikko Rapeli
2021-01-28 10:52 ` Richard Purdie
0 siblings, 1 reply; 23+ messages in thread
From: Mikko Rapeli @ 2021-01-28 10:35 UTC (permalink / raw)
To: richard.purdie; +Cc: openembedded-core
On Thu, Jan 28, 2021 at 09:02:39AM +0000, Richard Purdie wrote:
> On Thu, 2021-01-28 at 08:45 +0000, Mikko.Rapeli@bmw.de wrote:
> > Interesting series! Do you already have some numbers how this affects
> > bitbake builds?
>
> Not yet. I should really have split the series into two, the files
> reduction and the native PACKAGES pieces as the latter is proving quite
> unstable on the autobuilder and holding the other up. Once it does
> build cleanly and merges, we will get build time measurements which I'm
> curious about too.
Yes, split would have been nice. I'm seeing issues after porting over
to dunfell :)
-Mikko
> Cheers,
>
> Richard
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot
2021-01-28 10:35 ` Mikko Rapeli
@ 2021-01-28 10:52 ` Richard Purdie
0 siblings, 0 replies; 23+ messages in thread
From: Richard Purdie @ 2021-01-28 10:52 UTC (permalink / raw)
To: Mikko.Rapeli; +Cc: openembedded-core
On Thu, 2021-01-28 at 10:35 +0000, Mikko.Rapeli@bmw.de wrote:
> On Thu, Jan 28, 2021 at 09:02:39AM +0000, Richard Purdie wrote:
> > On Thu, 2021-01-28 at 08:45 +0000, Mikko.Rapeli@bmw.de wrote:
> > > Interesting series! Do you already have some numbers how this affects
> > > bitbake builds?
> >
> > Not yet. I should really have split the series into two, the files
> > reduction and the native PACKAGES pieces as the latter is proving quite
> > unstable on the autobuilder and holding the other up. Once it does
> > build cleanly and merges, we will get build time measurements which I'm
> > curious about too.
>
> Yes, split would have been nice. I'm seeing issues after porting over
> to dunfell :)
They don't depend on each other so you can just pick the sysroot
cleaning ones. master-next has some updated patches which are doing
better too.
Cheers,
Richard
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot
2021-01-28 8:45 ` [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Mikko Rapeli
2021-01-28 9:02 ` Richard Purdie
@ 2021-01-28 16:38 ` Richard Purdie
2021-01-29 8:28 ` Mikko Rapeli
1 sibling, 1 reply; 23+ messages in thread
From: Richard Purdie @ 2021-01-28 16:38 UTC (permalink / raw)
To: Mikko.Rapeli; +Cc: openembedded-core
On Thu, 2021-01-28 at 08:45 +0000, Mikko.Rapeli@bmw.de wrote:
> Interesting series! Do you already have some numbers how this affects
> bitbake builds?
We do now have measurements:
https://autobuilder.yocto.io/pub/non-release/20210128-10/testresults/buildperf-centos7/perf-centos7.yoctoproject.org_master-next_20210128130350_0ec9fb3f98.html
https://autobuilder.yocto.io/pub/non-release/20210128-9/testresults/buildperf-ubuntu1604/perf-ubuntu1604_master-next_20210128130346_0ec9fb3f98.html
so a 5-7% build time speedup with and without rm_work and a 7%
reduction in disk usage without rm_work.
Cheers,
Richard
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot
2021-01-28 16:38 ` Richard Purdie
@ 2021-01-29 8:28 ` Mikko Rapeli
0 siblings, 0 replies; 23+ messages in thread
From: Mikko Rapeli @ 2021-01-29 8:28 UTC (permalink / raw)
To: richard.purdie; +Cc: openembedded-core
On Thu, Jan 28, 2021 at 04:38:08PM +0000, Richard Purdie wrote:
> On Thu, 2021-01-28 at 08:45 +0000, Mikko.Rapeli@bmw.de wrote:
> > Interesting series! Do you already have some numbers how this affects
> > bitbake builds?
>
> We do now have measurements:
>
> https://autobuilder.yocto.io/pub/non-release/20210128-10/testresults/buildperf-centos7/perf-centos7.yoctoproject.org_master-next_20210128130350_0ec9fb3f98.html
>
> https://autobuilder.yocto.io/pub/non-release/20210128-9/testresults/buildperf-ubuntu1604/perf-ubuntu1604_master-next_20210128130346_0ec9fb3f98.html
>
> so a 5-7% build time speedup with and without rm_work and a 7%
> reduction in disk usage without rm_work.
Awesome! Thanks, Richard!
-Mikko
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-27 17:27 ` [PATCH 6/7] native: Stop clearing PACKAGES Richard Purdie
@ 2021-01-30 16:15 ` Martin Jansa
2021-01-31 9:07 ` Richard Purdie
2021-02-04 19:43 ` Peter Kjellerstedt
1 sibling, 1 reply; 23+ messages in thread
From: Martin Jansa @ 2021-01-30 16:15 UTC (permalink / raw)
To: Richard Purdie; +Cc: Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 2187 bytes --]
On Wed, Jan 27, 2021 at 6:28 PM Richard Purdie <
richard.purdie@linuxfoundation.org> wrote:
> Some now unneeded code in python3-setuptools is dropped, there are further
> changes like this which can follow.
>
> This change was verified with OE-Core by comparing task-depends.dot
> generated
> by "bitbake world -g" before and after the change, the files were
> identical.
>
> diff --git a/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
> b/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
> index 6ee935f8f79..db336bfa13b 100644
> --- a/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
> +++ b/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
> @@ -58,8 +58,3 @@ RDEPENDS_${PYTHON_PN}-pkg-resources = "\
> ${PYTHON_PN}-plistlib \
> ${PYTHON_PN}-pprint \
> "
> -# Due to the way OE-Core implemented native recipes, the native class
> cannot
> -# have a dependency on something that is not a recipe name. Work around
> that by
> -# manually setting RPROVIDES.
> -RDEPENDS_${PN}_append = " ${PYTHON_PN}-pkg-resources"
> -RPROVIDES_append_class-native = " ${PYTHON_PN}-pkg-resources-native"
>
The runtime dependency on ${PYTHON_PN}-pkg-resources isn't needed anymore?
I don't see how it would get still included as you said that bitbake -g
files were the same.
I'm asking because meta-python2 has the same issue in:
https://git.openembedded.org/meta-python2/tree/recipes-devtools/python/python-setuptools.inc#n49
and my fix I was planing to send was to replace it with:
RDEPENDS_${PN}_append_class-target = " ${PYTHON_PN}-pkg-resources"
and drop the RPROVIDES, because it unfortunately causes bitbake to get
stuck after reporting parsing error as:
ERROR: meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA
Issue: meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb:
Variable RPROVIDES is set as not being package specific, please fix this.
[pkgvarcheck]
ERROR: meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb:
Fatal QA errors found, failing task.
ERROR: Failed to parse recipe: meta-python2/recipes-devtools/python/
python-setuptools_42.0.2.bb
[-- Attachment #2: Type: text/html, Size: 3349 bytes --]
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-30 16:15 ` [OE-core] " Martin Jansa
@ 2021-01-31 9:07 ` Richard Purdie
2021-01-31 9:55 ` Martin Jansa
0 siblings, 1 reply; 23+ messages in thread
From: Richard Purdie @ 2021-01-31 9:07 UTC (permalink / raw)
To: Martin Jansa; +Cc: Patches and discussions about the oe-core layer
On Sat, 2021-01-30 at 17:15 +0100, Martin Jansa wrote:
>
>
> On Wed, Jan 27, 2021 at 6:28 PM Richard Purdie <
> richard.purdie@linuxfoundation.org> wrote:
> > Some now unneeded code in python3-setuptools is dropped, there are
> > further
> > changes like this which can follow.
> >
> > This change was verified with OE-Core by comparing task-depends.dot
> > generated
> > by "bitbake world -g" before and after the change, the files were
> > identical.
> >
> > diff --git a/meta/recipes-
> > devtools/python/python3-setuptools_51.0.0.bb b/meta/recipes-
> > devtools/python/python3-setuptools_51.0.0.bb
> > index 6ee935f8f79..db336bfa13b 100644
> > --- a/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
> > +++ b/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
> > @@ -58,8 +58,3 @@ RDEPENDS_${PYTHON_PN}-pkg-resources = "\
> > ${PYTHON_PN}-plistlib \
> > ${PYTHON_PN}-pprint \
> > "
> > -# Due to the way OE-Core implemented native recipes, the native
> > class cannot
> > -# have a dependency on something that is not a recipe name. Work
> > around that by
> > -# manually setting RPROVIDES.
> > -RDEPENDS_${PN}_append = " ${PYTHON_PN}-pkg-resources"
> > -RPROVIDES_append_class-native = " ${PYTHON_PN}-pkg-resources-
> > native"
> >
>
> The runtime dependency on ${PYTHON_PN}-pkg-resources isn't needed
> anymore? I don't see how it would get still included as you said that
> bitbake -g files were the same.
I think you're right and I shouldn't have removed the RDEPENDS, only
the RPROVIDES. bitbake -g are task dependencies and the task
dependencies still showed up so this didn't highlight any issue.
I'll test a patch to fix that and add it back, probably in the main
RDEPENDS list.
> I'm asking because meta-python2 has the same issue in:
> https://git.openembedded.org/meta-python2/tree/recipes-devtools/python/python-setuptools.inc#n49
>
> and my fix I was planing to send was to replace it with:
> RDEPENDS_${PN}_append_class-target = " ${PYTHON_PN}-pkg-resources"
> and drop the RPROVIDES, because it unfortunately causes bitbake to
> get stuck after reporting parsing error as:
>
> ERROR: meta-python2/recipes-devtools/python/python-
> setuptools_42.0.2.bb: QA Issue: meta-python2/recipes-
> devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is
> set as not being package specific, please fix this. [pkgvarcheck]
> ERROR: meta-python2/recipes-devtools/python/python-
> setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe: meta-python2/recipes-
> devtools/python/python-setuptools_42.0.2.bb
Are you saying that it does that with the RPROVIDES removed? That seems
odd :/
Cheers,
Richard
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-31 9:07 ` Richard Purdie
@ 2021-01-31 9:55 ` Martin Jansa
2021-01-31 10:34 ` Richard Purdie
0 siblings, 1 reply; 23+ messages in thread
From: Martin Jansa @ 2021-01-31 9:55 UTC (permalink / raw)
To: Richard Purdie; +Cc: Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 3511 bytes --]
On Sun, Jan 31, 2021 at 09:07:50AM +0000, Richard Purdie wrote:
> On Sat, 2021-01-30 at 17:15 +0100, Martin Jansa wrote:
> >
> >
> > On Wed, Jan 27, 2021 at 6:28 PM Richard Purdie <
> > richard.purdie@linuxfoundation.org> wrote:
> > > Some now unneeded code in python3-setuptools is dropped, there are
> > > further
> > > changes like this which can follow.
> > >
> > > This change was verified with OE-Core by comparing task-depends.dot
> > > generated
> > > by "bitbake world -g" before and after the change, the files were
> > > identical.
> > >
> > > diff --git a/meta/recipes-
> > > devtools/python/python3-setuptools_51.0.0.bb b/meta/recipes-
> > > devtools/python/python3-setuptools_51.0.0.bb
> > > index 6ee935f8f79..db336bfa13b 100644
> > > --- a/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
> > > +++ b/meta/recipes-devtools/python/python3-setuptools_51.0.0.bb
> > > @@ -58,8 +58,3 @@ RDEPENDS_${PYTHON_PN}-pkg-resources = "\
> > > ${PYTHON_PN}-plistlib \
> > > ${PYTHON_PN}-pprint \
> > > "
> > > -# Due to the way OE-Core implemented native recipes, the native
> > > class cannot
> > > -# have a dependency on something that is not a recipe name. Work
> > > around that by
> > > -# manually setting RPROVIDES.
> > > -RDEPENDS_${PN}_append = " ${PYTHON_PN}-pkg-resources"
> > > -RPROVIDES_append_class-native = " ${PYTHON_PN}-pkg-resources-
> > > native"
> > >
> >
> > The runtime dependency on ${PYTHON_PN}-pkg-resources isn't needed
> > anymore? I don't see how it would get still included as you said that
> > bitbake -g files were the same.
>
> I think you're right and I shouldn't have removed the RDEPENDS, only
> the RPROVIDES. bitbake -g are task dependencies and the task
> dependencies still showed up so this didn't highlight any issue.
>
> I'll test a patch to fix that and add it back, probably in the main
> RDEPENDS list.
OK, I've sent similar fix for meta-python2:
https://lists.openembedded.org/g/openembedded-devel/message/89200
> > I'm asking because meta-python2 has the same issue in:
> > https://git.openembedded.org/meta-python2/tree/recipes-devtools/python/python-setuptools.inc#n49
> >
> > and my fix I was planing to send was to replace it with:
> > RDEPENDS_${PN}_append_class-target = " ${PYTHON_PN}-pkg-resources"
> > and drop the RPROVIDES, because it unfortunately causes bitbake to
> > get stuck after reporting parsing error as:
> >
> > ERROR: meta-python2/recipes-devtools/python/python-
> > setuptools_42.0.2.bb: QA Issue: meta-python2/recipes-
> > devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is
> > set as not being package specific, please fix this. [pkgvarcheck]
> > ERROR: meta-python2/recipes-devtools/python/python-
> > setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> > ERROR: Failed to parse recipe: meta-python2/recipes-
> > devtools/python/python-setuptools_42.0.2.bb
>
> Are you saying that it does that with the RPROVIDES removed? That seems
> odd :/
No, this was before removing RPROVIDES in meta-python2, I was just
surprised that bitbake got stuck after reporting parsing failure, I'm
seeing bitbake getting stuck in dunfell builds quite often, but don't
remember seeing it with gatesgarth and newer (and was believing that you
have already fixed most if not all cases there). But it's also true that
our jenkins runs 1000x more builds based on dunfell, so it's much more
likely to happen there.
Cheers,
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 201 bytes --]
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-31 9:55 ` Martin Jansa
@ 2021-01-31 10:34 ` Richard Purdie
2021-01-31 13:10 ` Martin Jansa
0 siblings, 1 reply; 23+ messages in thread
From: Richard Purdie @ 2021-01-31 10:34 UTC (permalink / raw)
To: Martin Jansa; +Cc: Patches and discussions about the oe-core layer
On Sun, 2021-01-31 at 10:55 +0100, Martin Jansa wrote:
> On Sun, Jan 31, 2021 at 09:07:50AM +0000, Richard Purdie wrote:
> > On Sat, 2021-01-30 at 17:15 +0100, Martin Jansa wrote:
> > > I'm asking because meta-python2 has the same issue in:
> > > https://git.openembedded.org/meta-python2/tree/recipes-devtools/python/python-setuptools.inc#n49
> > >
> > > and my fix I was planing to send was to replace it with:
> > > RDEPENDS_${PN}_append_class-target = " ${PYTHON_PN}-pkg-resources"
> > > and drop the RPROVIDES, because it unfortunately causes bitbake to
> > > get stuck after reporting parsing error as:
> > >
> > > ERROR: meta-python2/recipes-devtools/python/python-
> > > setuptools_42.0.2.bb: QA Issue: meta-python2/recipes-
> > > devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is
> > > set as not being package specific, please fix this. [pkgvarcheck]
> > > ERROR: meta-python2/recipes-devtools/python/python-
> > > setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> > > ERROR: Failed to parse recipe: meta-python2/recipes-
> > > devtools/python/python-setuptools_42.0.2.bb
> >
> > Are you saying that it does that with the RPROVIDES removed? That seems
> > odd :/
>
> No, this was before removing RPROVIDES in meta-python2, I was just
> surprised that bitbake got stuck after reporting parsing failure, I'm
> seeing bitbake getting stuck in dunfell builds quite often, but don't
> remember seeing it with gatesgarth and newer (and was believing that you
> have already fixed most if not all cases there). But it's also true that
> our jenkins runs 1000x more builds based on dunfell, so it's much more
> likely to happen there.
Its the first time I've heard a report of that and it sounds a little
worrying. What you say stuck, bitbake hangs? Is it using cpu? A process
tree of what it looks like when stuck would be interesting if it is
hanging and maybe the last things in any running or just finished task
logs. It could be some issue with the way a failing task is handled?
We've seen a lot of weird issues on the autobuilder but not that. Could
you have something enabled in your setup for logging/reporting whch
wouldn't be in ours and could be causing it?
Cheers,
Richard
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-31 10:34 ` Richard Purdie
@ 2021-01-31 13:10 ` Martin Jansa
2021-02-01 14:26 ` Anibal Limon
2021-02-01 20:21 ` Richard Purdie
0 siblings, 2 replies; 23+ messages in thread
From: Martin Jansa @ 2021-01-31 13:10 UTC (permalink / raw)
To: Richard Purdie; +Cc: Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 54091 bytes --]
On Sun, Jan 31, 2021 at 10:34:48AM +0000, Richard Purdie wrote:
> On Sun, 2021-01-31 at 10:55 +0100, Martin Jansa wrote:
> > On Sun, Jan 31, 2021 at 09:07:50AM +0000, Richard Purdie wrote:
> > > On Sat, 2021-01-30 at 17:15 +0100, Martin Jansa wrote:
> > > > I'm asking because meta-python2 has the same issue in:
> > > > https://git.openembedded.org/meta-python2/tree/recipes-devtools/python/python-setuptools.inc#n49
> > > >
> > > > and my fix I was planing to send was to replace it with:
> > > > RDEPENDS_${PN}_append_class-target = " ${PYTHON_PN}-pkg-resources"
> > > > and drop the RPROVIDES, because it unfortunately causes bitbake to
> > > > get stuck after reporting parsing error as:
> > > >
> > > > ERROR: meta-python2/recipes-devtools/python/python-
> > > > setuptools_42.0.2.bb: QA Issue: meta-python2/recipes-
> > > > devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is
> > > > set as not being package specific, please fix this. [pkgvarcheck]
> > > > ERROR: meta-python2/recipes-devtools/python/python-
> > > > setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> > > > ERROR: Failed to parse recipe: meta-python2/recipes-
> > > > devtools/python/python-setuptools_42.0.2.bb
> > >
> > > Are you saying that it does that with the RPROVIDES removed? That seems
> > > odd :/
> >
> > No, this was before removing RPROVIDES in meta-python2, I was just
> > surprised that bitbake got stuck after reporting parsing failure, I'm
> > seeing bitbake getting stuck in dunfell builds quite often, but don't
> > remember seeing it with gatesgarth and newer (and was believing that you
> > have already fixed most if not all cases there). But it's also true that
> > our jenkins runs 1000x more builds based on dunfell, so it's much more
> > likely to happen there.
>
> Its the first time I've heard a report of that and it sounds a little
> worrying. What you say stuck, bitbake hangs? Is it using cpu? A process
> tree of what it looks like when stuck would be interesting if it is
> hanging and maybe the last things in any running or just finished task
> logs. It could be some issue with the way a failing task is handled?
>
> We've seen a lot of weird issues on the autobuilder but not that. Could
> you have something enabled in your setup for logging/reporting whch
> wouldn't be in ours and could be causing it?
It doesn't seem to happen very often and I guess autobuilder doesn't
include meta-python2 (which is currently the only reproducer in my list
of layers).
I've tried to reproduce it with just 3 layers included:
BBLAYERS = " \
/OE/build/oe-core/meta-python2 \
/OE/build/oe-core/meta-openembedded/meta-oe \
/OE/build/oe-core/openembedded-core/meta \
"
and it happened on 3rd try (cache, tmpdir, sstate-cache were removed
only before 1st try)
martin@jama:/OE/build/oe-core$ bitbake -k python-native
Loading cache: 100% | | ETA: --:--:--
Loaded 0 entries from dependency cache.
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA Issue: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being package specific, please fix this. [pkgvarcheck]
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
ERROR: Failed to parse recipe: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb | ETA: 0:00:14
Summary: There were 3 ERROR messages shown, returning a non-zero exit code.
martin@jama:/OE/build/oe-core$ bitbake -k python-native
NOTE: Reconnecting to bitbake server...
Loading cache: 100% |###################################################################################################################################################################################################################################| Time: 0:00:00
Loaded 845 entries from dependency cache.
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb: Error executing a python function in <code>: | ETA: 0:01:10
The stack trace of python calls that resulted in this exception/failure was:
File: '<code>', lineno: 14, function: <module>
0010:__anon_35__OE_build_oe_core_openembedded_core_meta_classes_devshell_bbclass(d)
0011:__anon_151__OE_build_oe_core_openembedded_core_meta_classes_sstate_bbclass(d)
0012:__anon_20__OE_build_oe_core_openembedded_core_meta_classes_blacklist_bbclass(d)
0013:__anon_177__OE_build_oe_core_openembedded_core_meta_classes_siteinfo_bbclass(d)
*** 0014:__anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb(d)
File: '/OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb', lineno: 76, function: __anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb
0072: manifest_file.seek(json_start)
0073: manifest_str = manifest_file.read()
0074: python_manifest = json.loads(manifest_str)
0075:
*** 0076: rprovides = d.getVar('RPROVIDES').split()
0077:
0078: # Hardcoded since it cant be python-native-foo, should be python-foo-native
0079: pn = 'python'
0080:
Exception: AttributeError: 'NoneType' object has no attribute 'split'
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA Issue: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being package specific, please fix this. [pkgvarcheck]
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
ERROR: Failed to parse recipe: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb | ETA: 0:00:30
Summary: There were 4 ERROR messages shown, returning a non-zero exit code.
martin@jama:/OE/build/oe-core$ bitbake -k python-native
NOTE: Reconnecting to bitbake server...
Loading cache: 100% |###################################################################################################################################################################################################################################| Time: 0:00:00
Loaded 1289 entries from dependency cache.
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA Issue: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being package specific, please fix this. [pkgvarcheck]
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
ERROR: Failed to parse recipe: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb
and here it's stuck for around 1 hour, bitbake using very little cpu.
martin@jama:~$ ps aux | grep bitbake
martin 372784 0.0 0.0 11552 884 pts/1 S+ 13:43 0:00 grep --color=auto bitbake
martin 928962 0.1 0.1 219204 133704 ? Sl 12:42 0:04 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 943698 0.0 0.0 119900 29928 pts/8 Sl+ 12:43 0:01 python3 /OE/build/oe-core/bitbake/bin/bitbake -k python-native
martin 945507 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945528 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945532 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945563 0.0 0.0 214364 124732 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945577 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945621 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945632 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945643 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945653 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945669 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945685 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945703 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945736 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945753 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945774 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945778 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945819 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945839 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945860 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945878 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945894 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945909 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945915 0.0 0.0 214364 124804 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945929 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945950 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945953 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945964 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945966 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 945989 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946005 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946016 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946037 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946038 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946064 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946068 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946080 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946103 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946109 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946122 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946135 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946137 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946152 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946167 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946168 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946185 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946197 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946214 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946228 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946243 0.0 0.0 214364 124728 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946249 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946265 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946298 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946345 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946364 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946386 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946389 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946405 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946410 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946442 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946458 0.0 0.0 214364 124612 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946463 0.0 0.0 214364 124652 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946481 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946501 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin 946518 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin@jama:~$ sudo strace -p 928962
strace: Process 928962 attached
wait4(945507,
martin@jama:~$ kill 928962
adds an warning to the stuck build:
martin@jama:/OE/build/oe-core$ bitbake -k python-native
NOTE: Reconnecting to bitbake server...
Loading cache: 100% |###################################################################################################################################################################################################################################| Time: 0:00:00
Loaded 1289 entries from dependency cache.
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA Issue: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being package specific, please fix this. [pkgvarcheck]
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
ERROR: Failed to parse recipe: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb | ETA: 0:00:50
WARNING: Cooker received SIGTERM, shutting down...
killing the main process:
martin@jama:~$ kill 943698
terminates the stuck build, but all bitbake-server processes are left behind.
If I try to kill all remaining bitbake-server processes, then only one is left behind:
martin 928962 0.1 0.1 285004 137688 ? S 12:42 0:05 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
martin@jama:/OE/build/oe-core$ sudo strace -p 928962
strace: Process 928962 attached
select(7, [6], [], [], {tv_sec=0, tv_usec=40768}) = 0 (Timeout)
poll([{fd=7, events=POLLIN}], 1, 0) = 0 (Timeout)
poll([{fd=8, events=POLLIN}], 1, 0) = 0 (Timeout)
select(7, [6], [], [], {tv_sec=0, tv_usec=100000}) = 0 (Timeout)
poll([{fd=7, events=POLLIN}], 1, 0) = 0 (Timeout)
poll([{fd=8, events=POLLIN}], 1, 0) = 0 (Timeout)
and then it dies as well after a while.
Here is bitbake-cookerdaemon.log, but doesn't look very interesting to me:
928962 12:42:56.099747 --- Starting bitbake server pid 928962 at 2021-01-31 12:42:56.099713 ---
928962 12:42:56.110782 Started bitbake server pid 928962
928962 12:42:56.111010 Entering server connection loop
928962 12:42:56.111833 Accepting [<socket.socket fd=6, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, laddr=bitbake.sock>] ([])
928962 12:42:56.112382 Processing Client
928962 12:42:56.112428 Connecting Client
928962 12:42:56.112733 Running command ['setFeatures', [2]]
928962 12:42:56.113448 Command Completed
928962 12:42:56.113566 Running command ['updateConfig', {'abort': False, 'force': False, 'invalidate_stamp': None, 'dry_run': False, 'dump_signatures': [], 'extra_assume_provided': [], 'profile': False, 'prefile': [], 'postfile': [], 'server_timeout': None, 'nosetscene': False, 'setsceneonly': False, 'skipsetscene': False, 'runall': None, 'runonly': None, 'writeeventlog': None, 'build_verbose_shell': False, 'build_verbose_stdout': False, 'default_loglevel': 20, 'debug_domains': {}}, {'SHELL': '/bin/bash', 'SSH_AUTH_SOCK': '/run/user/1000/keyring/ssh', 'SSH_AGENT_PID': '3080', 'PWD': '/OE/build/oe-core', 'LOGNAME': 'martin', 'HOME': '/home/martin', 'MACHINE': 'qemux86-64', 'BB_ENV_EXTRAWHITE': 'MACHINE DISTRO http_proxy ftp_proxy https_proxy all_proxy ALL_PROXY no_proxy SSH_AGENT_PID SSH_AUTH_SOCK BB_SRCREV_POLICY SDKMACHINE BB_NUMBER_THREADS GIT_PROXY_COMMAND PSEUDO_DISABLED PSEUDO_BUILD', 'USER': 'martin', 'LC_ALL': 'en_US.UTF-8', 'PATH': '/OE/build/oe-core/openembedded-core/scripts:/OE/build/oe-core/bitbake/bin:/home/martin/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'SESSION_MANAGER': 'local/jama:@/tmp/.ICE-unix/2943,unix/jama:/tmp/.ICE-unix/2943', 'WINDOWID': '79691779', 'QT_ACCESSIBILITY': '1', 'COLORTERM': 'truecolor', 'XDG_CONFIG_DIRS': '/etc/xdg/xdg-xubuntu:/etc/xdg:/etc/xdg', 'XDG_SESSION_PATH': '/org/freedesktop/DisplayManager/Session0', 'XDG_MENU_PREFIX': 'xfce-', 'CLUTTER_BACKEND': 'x11', 'LANGUAGE': 'en_US', 'TERMCAP': 'SC|screen.xterm-256color|VT 100/ANSI X3.64 virtual terminal:DO=\\E[%dB:LE=\\E[%dD:RI=\\E[%dC:UP=\\E[%dA:bs:bt=\\E[Z:cd=\\E[J:ce=\\E[K:cl=\\E[H\\E[J:cm=\\E[%i%d;%dH:ct=\\E[3g:do=^J:nd=\\E[C:pt:rc=\\E8:rs=\\Ec:sc=\\E7:st=\\EH:up=\\EM:le=^H:bl=^G:cr=^M:it#8:ho=\\E[H:nw=\\EE:ta=^I:is=\\E)0:li#51:co#263:am:xn:xv:LP:sr=\\EM:al=\\E[L:AL=\\E[%dL:cs=\\E[%i%d;%dr:dl=\\E[M:DL=\\E[%dM:dc=\\E[P:DC=\\E[%dP:im=\\E[4h:ei=\\E[4l:mi:IC=\\E[%d@:ks=\\E[?1h\\E=:ke=\\E[?1l\\E>:vi=\\E[?25l:ve=\\E[34h\\E[?25h:vs=\\E[34l:ti=\\E[?1049h:te=\\E[?1049l:us=\\E[4m:ue=\\E[24m:so=\\E[3m:se=\\E[23m:mb=\\E[5m:md=\\E[1m:mh=\\E[2m:mr=\\E[7m:me=\\E[m:ms:Co#8:pa#64:AF=\\E[3%dm:AB=\\E[4%dm:op=\\E[39;49m:AX:vb=\\Eg:G0:as=\\E(0:ae=\\E(B:ac=\\140\\140aaffggjjkkllmmnnooppqqrrssttuuvvwwxxyyzz{{||}}~~..--++,,hhII00:po=\\E[5i:pf=\\E[4i:Km=\\E[<:k0=\\E[10~:k1=\\EOP:k2=\\EOQ:k3=\\EOR:k4=\\EOS:k5=\\E[15~:k6=\\E[17~:k7=\\E[18~:k8=\\E[19~:k9=\\E[20~:k;=\\E[21~:F1=\\E[23~:F2=\\E[24~:kB=\\E[Z:kh=\\E[1~:@1=\\E[1~:kH=\\E[4~:@7=\\E[4~:kN=\\E[6~:kP=\\E[5~:kI=\\E[2~:kD=\\E[3~:ku=\\EOA:kd=\\EOB:kr=\\EOC:kl=\\EOD:km:', 'LC_ADDRESS': 'cs_CZ.UTF-8', 'LC_NAME': 'cs_CZ.UTF-8', 'WINDOW': '6', 'DESKTOP_SESSION': 'xubuntu', 'LC_MONETARY': 'cs_CZ.UTF-8', 'EDITOR': 'vim', 'XDG_SEAT': 'seat0', 'XDG_SESSION_DESKTOP': 'xubuntu', 'QT_QPA_PLATFORMTHEME': 'gtk2', 'XDG_SESSION_TYPE': 'x11', 'PANEL_GDK_CORE_DEVICE_EVENTS': '0', 'GPG_AGENT_INFO': '/run/user/1000/gnupg/S.gpg-agent:0:1', 'XAUTHORITY': '/home/martin/.Xauthority', 'XDG_GREETER_DATA_DIR': '/var/lib/lightdm-data/martin', 'GDM_LANG': 'en_US', 'LANG': 'C', 'LC_PAPER': 'cs_CZ.UTF-8', 'LS_COLORS': 'rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:', 'XDG_CURRENT_DESKTOP': 'XFCE', 'VTE_VERSION': '6200', 'XDG_SEAT_PATH': '/org/freedesktop/DisplayManager/Seat0', 'LESSCLOSE': '/usr/bin/lesspipe %s %s', 'XDG_SESSION_CLASS': 'user', 'LC_IDENTIFICATION': 'cs_CZ.UTF-8', 'TERM': 'screen.xterm-256color', 'GTK_OVERLAY_SCROLLING': '0', 'LESSOPEN': '| /usr/bin/lesspipe %s', 'DISPLAY': ':0.0', 'SHLVL': '2', 'LC_TELEPHONE': 'cs_CZ.UTF-8', 'LC_MEASUREMENT': 'cs_CZ.UTF-8', 'XDG_VTNR': '7', 'XDG_SESSION_ID': 'c2', 'LD_LIBRARY_PATH': '', 'XDG_RUNTIME_DIR': '/run/user/1000', 'LC_TIME': 'cs_CZ.UTF-8', 'XDG_DATA_DIRS': '/usr/share/xubuntu:/usr/share/xfce4:/usr/local/share:/usr/share:/var/lib/snapd/desktop:/usr/share', 'STY': '5368.x', 'GDMSESSION': 'xubuntu', 'DBUS_SESSION_BUS_ADDRESS': 'unix:path=/run/user/1000/bus', 'BUILDDIR': '/OE/build/oe-core', 'LC_NUMERIC': 'cs_CZ.UTF-8', 'OLDPWD': '/OE/build/oe-core/meta-python2', '_': '/OE/build/oe-core/bitbake/bin/bitbake'}, ['/OE/build/oe-core/bitbake/bin/bitbake', '-k', 'python-native']]
928962 12:42:56.450688 Command Completed
928962 12:42:56.450996 Running command ['getVariable', 'BBINCLUDELOGS']
928962 12:42:56.451159 Command Completed
928962 12:42:56.451239 Running command ['getVariable', 'BBINCLUDELOGS_LINES']
928962 12:42:56.451360 Command Completed
928962 12:42:56.451436 Running command ['getSetVariable', 'BB_CONSOLELOG']
928962 12:42:56.451656 Command Completed
928962 12:42:56.451740 Running command ['getSetVariable', 'BB_LOGCONFIG']
928962 12:42:56.453927 Command Completed
928962 12:42:56.454122 Running command ['getUIHandlerNum']
928962 12:42:56.454289 Command Completed
928962 12:42:56.454392 Running command ['setEventMask', 1, 20, {'BitBake.RunQueue.HashEquiv': 19, 'BitBake.SigGen.HashEquiv': 19}, ['bb.runqueue.runQueueExitWait', 'bb.event.LogExecTTY', 'logging.LogRecord', 'bb.build.TaskFailed', 'bb.build.TaskBase', 'bb.event.ParseStarted', 'bb.event.ParseProgress', 'bb.event.ParseCompleted', 'bb.event.CacheLoadStarted', 'bb.event.CacheLoadProgress', 'bb.event.CacheLoadCompleted', 'bb.command.CommandFailed', 'bb.command.CommandExit', 'bb.command.CommandCompleted', 'bb.cooker.CookerExit', 'bb.event.MultipleProviders', 'bb.event.NoProvider', 'bb.runqueue.sceneQueueTaskStarted', 'bb.runqueue.runQueueTaskStarted', 'bb.runqueue.runQueueTaskFailed', 'bb.runqueue.sceneQueueTaskFailed', 'bb.event.BuildBase', 'bb.build.TaskStarted', 'bb.build.TaskSucceeded', 'bb.build.TaskFailedSilent', 'bb.build.TaskProgress', 'bb.event.ProcessStarted', 'bb.event.ProcessProgress', 'bb.event.ProcessFinished']]
928962 12:42:56.454523 Command Completed
928962 12:42:56.454599 Running command ['getVariable', 'BB_DEFAULT_TASK']
928962 12:42:56.454741 Command Completed
928962 12:42:56.454816 Running command ['setConfig', 'cmd', 'build']
928962 12:42:56.454947 Command Completed
928962 12:42:56.455022 Running command ['buildTargets', ['python-native'], 'build']
928962 12:42:56.457778 Command Completed
928962 12:43:04.560968 Processing Client
928962 12:43:04.561063 Disconnecting Client
928962 12:43:08.544918 Accepting [<socket.socket fd=6, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, laddr=bitbake.sock>] ([])
928962 12:43:08.557050 Processing Client
928962 12:43:08.557154 Connecting Client
928962 12:43:08.557787 Running command ['setFeatures', [2]]
928962 12:43:08.558183 Command Completed
928962 12:43:08.558952 Running command ['updateConfig', {'abort': False, 'force': False, 'invalidate_stamp': None, 'dry_run': False, 'dump_signatures': [], 'extra_assume_provided': [], 'profile': False, 'prefile': [], 'postfile': [], 'server_timeout': None, 'nosetscene': False, 'setsceneonly': False, 'skipsetscene': False, 'runall': None, 'runonly': None, 'writeeventlog': None, 'build_verbose_shell': False, 'build_verbose_stdout': False, 'default_loglevel': 20, 'debug_domains': {}}, {'SHELL': '/bin/bash', 'SSH_AUTH_SOCK': '/run/user/1000/keyring/ssh', 'SSH_AGENT_PID': '3080', 'PWD': '/OE/build/oe-core', 'LOGNAME': 'martin', 'HOME': '/home/martin', 'MACHINE': 'qemux86-64', 'BB_ENV_EXTRAWHITE': 'MACHINE DISTRO http_proxy ftp_proxy https_proxy all_proxy ALL_PROXY no_proxy SSH_AGENT_PID SSH_AUTH_SOCK BB_SRCREV_POLICY SDKMACHINE BB_NUMBER_THREADS GIT_PROXY_COMMAND PSEUDO_DISABLED PSEUDO_BUILD', 'USER': 'martin', 'LC_ALL': 'en_US.UTF-8', 'PATH': '/OE/build/oe-core/openembedded-core/scripts:/OE/build/oe-core/bitbake/bin:/home/martin/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'SESSION_MANAGER': 'local/jama:@/tmp/.ICE-unix/2943,unix/jama:/tmp/.ICE-unix/2943', 'WINDOWID': '79691779', 'QT_ACCESSIBILITY': '1', 'COLORTERM': 'truecolor', 'XDG_CONFIG_DIRS': '/etc/xdg/xdg-xubuntu:/etc/xdg:/etc/xdg', 'XDG_SESSION_PATH': '/org/freedesktop/DisplayManager/Session0', 'XDG_MENU_PREFIX': 'xfce-', 'CLUTTER_BACKEND': 'x11', 'LANGUAGE': 'en_US', 'TERMCAP': 'SC|screen.xterm-256color|VT 100/ANSI X3.64 virtual terminal:DO=\\E[%dB:LE=\\E[%dD:RI=\\E[%dC:UP=\\E[%dA:bs:bt=\\E[Z:cd=\\E[J:ce=\\E[K:cl=\\E[H\\E[J:cm=\\E[%i%d;%dH:ct=\\E[3g:do=^J:nd=\\E[C:pt:rc=\\E8:rs=\\Ec:sc=\\E7:st=\\EH:up=\\EM:le=^H:bl=^G:cr=^M:it#8:ho=\\E[H:nw=\\EE:ta=^I:is=\\E)0:li#51:co#263:am:xn:xv:LP:sr=\\EM:al=\\E[L:AL=\\E[%dL:cs=\\E[%i%d;%dr:dl=\\E[M:DL=\\E[%dM:dc=\\E[P:DC=\\E[%dP:im=\\E[4h:ei=\\E[4l:mi:IC=\\E[%d@:ks=\\E[?1h\\E=:ke=\\E[?1l\\E>:vi=\\E[?25l:ve=\\E[34h\\E[?25h:vs=\\E[34l:ti=\\E[?1049h:te=\\E[?1049l:us=\\E[4m:ue=\\E[24m:so=\\E[3m:se=\\E[23m:mb=\\E[5m:md=\\E[1m:mh=\\E[2m:mr=\\E[7m:me=\\E[m:ms:Co#8:pa#64:AF=\\E[3%dm:AB=\\E[4%dm:op=\\E[39;49m:AX:vb=\\Eg:G0:as=\\E(0:ae=\\E(B:ac=\\140\\140aaffggjjkkllmmnnooppqqrrssttuuvvwwxxyyzz{{||}}~~..--++,,hhII00:po=\\E[5i:pf=\\E[4i:Km=\\E[<:k0=\\E[10~:k1=\\EOP:k2=\\EOQ:k3=\\EOR:k4=\\EOS:k5=\\E[15~:k6=\\E[17~:k7=\\E[18~:k8=\\E[19~:k9=\\E[20~:k;=\\E[21~:F1=\\E[23~:F2=\\E[24~:kB=\\E[Z:kh=\\E[1~:@1=\\E[1~:kH=\\E[4~:@7=\\E[4~:kN=\\E[6~:kP=\\E[5~:kI=\\E[2~:kD=\\E[3~:ku=\\EOA:kd=\\EOB:kr=\\EOC:kl=\\EOD:km:', 'LC_ADDRESS': 'cs_CZ.UTF-8', 'LC_NAME': 'cs_CZ.UTF-8', 'WINDOW': '6', 'DESKTOP_SESSION': 'xubuntu', 'LC_MONETARY': 'cs_CZ.UTF-8', 'EDITOR': 'vim', 'XDG_SEAT': 'seat0', 'XDG_SESSION_DESKTOP': 'xubuntu', 'QT_QPA_PLATFORMTHEME': 'gtk2', 'XDG_SESSION_TYPE': 'x11', 'PANEL_GDK_CORE_DEVICE_EVENTS': '0', 'GPG_AGENT_INFO': '/run/user/1000/gnupg/S.gpg-agent:0:1', 'XAUTHORITY': '/home/martin/.Xauthority', 'XDG_GREETER_DATA_DIR': '/var/lib/lightdm-data/martin', 'GDM_LANG': 'en_US', 'LANG': 'C', 'LC_PAPER': 'cs_CZ.UTF-8', 'LS_COLORS': 'rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:', 'XDG_CURRENT_DESKTOP': 'XFCE', 'VTE_VERSION': '6200', 'XDG_SEAT_PATH': '/org/freedesktop/DisplayManager/Seat0', 'LESSCLOSE': '/usr/bin/lesspipe %s %s', 'XDG_SESSION_CLASS': 'user', 'LC_IDENTIFICATION': 'cs_CZ.UTF-8', 'TERM': 'screen.xterm-256color', 'GTK_OVERLAY_SCROLLING': '0', 'LESSOPEN': '| /usr/bin/lesspipe %s', 'DISPLAY': ':0.0', 'SHLVL': '2', 'LC_TELEPHONE': 'cs_CZ.UTF-8', 'LC_MEASUREMENT': 'cs_CZ.UTF-8', 'XDG_VTNR': '7', 'XDG_SESSION_ID': 'c2', 'LD_LIBRARY_PATH': '', 'XDG_RUNTIME_DIR': '/run/user/1000', 'LC_TIME': 'cs_CZ.UTF-8', 'XDG_DATA_DIRS': '/usr/share/xubuntu:/usr/share/xfce4:/usr/local/share:/usr/share:/var/lib/snapd/desktop:/usr/share', 'STY': '5368.x', 'GDMSESSION': 'xubuntu', 'DBUS_SESSION_BUS_ADDRESS': 'unix:path=/run/user/1000/bus', 'BUILDDIR': '/OE/build/oe-core', 'LC_NUMERIC': 'cs_CZ.UTF-8', 'OLDPWD': '/OE/build/oe-core/meta-python2', '_': '/OE/build/oe-core/bitbake/bin/bitbake'}, ['/OE/build/oe-core/bitbake/bin/bitbake', '-k', 'python-native']]
928962 12:43:08.559567 Command Completed
928962 12:43:08.559798 Running command ['getVariable', 'BBINCLUDELOGS']
928962 12:43:08.812911 Command Completed
928962 12:43:08.813560 Running command ['getVariable', 'BBINCLUDELOGS_LINES']
928962 12:43:08.813765 Command Completed
928962 12:43:08.813879 Running command ['getSetVariable', 'BB_CONSOLELOG']
928962 12:43:08.814115 Command Completed
928962 12:43:08.814236 Running command ['getSetVariable', 'BB_LOGCONFIG']
928962 12:43:08.816210 Command Completed
928962 12:43:08.816451 Running command ['getUIHandlerNum']
928962 12:43:08.816661 Command Completed
928962 12:43:08.816799 Running command ['setEventMask', 2, 20, {'BitBake.RunQueue.HashEquiv': 19, 'BitBake.SigGen.HashEquiv': 19}, ['bb.runqueue.runQueueExitWait', 'bb.event.LogExecTTY', 'logging.LogRecord', 'bb.build.TaskFailed', 'bb.build.TaskBase', 'bb.event.ParseStarted', 'bb.event.ParseProgress', 'bb.event.ParseCompleted', 'bb.event.CacheLoadStarted', 'bb.event.CacheLoadProgress', 'bb.event.CacheLoadCompleted', 'bb.command.CommandFailed', 'bb.command.CommandExit', 'bb.command.CommandCompleted', 'bb.cooker.CookerExit', 'bb.event.MultipleProviders', 'bb.event.NoProvider', 'bb.runqueue.sceneQueueTaskStarted', 'bb.runqueue.runQueueTaskStarted', 'bb.runqueue.runQueueTaskFailed', 'bb.runqueue.sceneQueueTaskFailed', 'bb.event.BuildBase', 'bb.build.TaskStarted', 'bb.build.TaskSucceeded', 'bb.build.TaskFailedSilent', 'bb.build.TaskProgress', 'bb.event.ProcessStarted', 'bb.event.ProcessProgress', 'bb.event.ProcessFinished']]
928962 12:43:08.816980 Command Completed
928962 12:43:08.817101 Running command ['getVariable', 'BB_DEFAULT_TASK']
928962 12:43:08.817293 Command Completed
928962 12:43:08.817418 Running command ['setConfig', 'cmd', 'build']
928962 12:43:08.817604 Command Completed
928962 12:43:08.817732 Running command ['buildTargets', ['python-native'], 'build']
928962 12:43:08.820432 Command Completed
928962 12:43:18.569947 Processing Client
928962 12:43:18.570026 Disconnecting Client
928962 12:43:21.796010 Accepting [<socket.socket fd=6, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0, laddr=bitbake.sock>] ([])
928962 12:43:21.812637 Processing Client
928962 12:43:21.812758 Connecting Client
928962 12:43:21.816670 Running command ['setFeatures', [2]]
928962 12:43:21.817252 Command Completed
928962 12:43:21.817987 Running command ['updateConfig', {'abort': False, 'force': False, 'invalidate_stamp': None, 'dry_run': False, 'dump_signatures': [], 'extra_assume_provided': [], 'profile': False, 'prefile': [], 'postfile': [], 'server_timeout': None, 'nosetscene': False, 'setsceneonly': False, 'skipsetscene': False, 'runall': None, 'runonly': None, 'writeeventlog': None, 'build_verbose_shell': False, 'build_verbose_stdout': False, 'default_loglevel': 20, 'debug_domains': {}}, {'SHELL': '/bin/bash', 'SSH_AUTH_SOCK': '/run/user/1000/keyring/ssh', 'SSH_AGENT_PID': '3080', 'PWD': '/OE/build/oe-core', 'LOGNAME': 'martin', 'HOME': '/home/martin', 'MACHINE': 'qemux86-64', 'BB_ENV_EXTRAWHITE': 'MACHINE DISTRO http_proxy ftp_proxy https_proxy all_proxy ALL_PROXY no_proxy SSH_AGENT_PID SSH_AUTH_SOCK BB_SRCREV_POLICY SDKMACHINE BB_NUMBER_THREADS GIT_PROXY_COMMAND PSEUDO_DISABLED PSEUDO_BUILD', 'USER': 'martin', 'LC_ALL': 'en_US.UTF-8', 'PATH': '/OE/build/oe-core/openembedded-core/scripts:/OE/build/oe-core/bitbake/bin:/home/martin/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'SESSION_MANAGER': 'local/jama:@/tmp/.ICE-unix/2943,unix/jama:/tmp/.ICE-unix/2943', 'WINDOWID': '79691779', 'QT_ACCESSIBILITY': '1', 'COLORTERM': 'truecolor', 'XDG_CONFIG_DIRS': '/etc/xdg/xdg-xubuntu:/etc/xdg:/etc/xdg', 'XDG_SESSION_PATH': '/org/freedesktop/DisplayManager/Session0', 'XDG_MENU_PREFIX': 'xfce-', 'CLUTTER_BACKEND': 'x11', 'LANGUAGE': 'en_US', 'TERMCAP': 'SC|screen.xterm-256color|VT 100/ANSI X3.64 virtual terminal:DO=\\E[%dB:LE=\\E[%dD:RI=\\E[%dC:UP=\\E[%dA:bs:bt=\\E[Z:cd=\\E[J:ce=\\E[K:cl=\\E[H\\E[J:cm=\\E[%i%d;%dH:ct=\\E[3g:do=^J:nd=\\E[C:pt:rc=\\E8:rs=\\Ec:sc=\\E7:st=\\EH:up=\\EM:le=^H:bl=^G:cr=^M:it#8:ho=\\E[H:nw=\\EE:ta=^I:is=\\E)0:li#51:co#263:am:xn:xv:LP:sr=\\EM:al=\\E[L:AL=\\E[%dL:cs=\\E[%i%d;%dr:dl=\\E[M:DL=\\E[%dM:dc=\\E[P:DC=\\E[%dP:im=\\E[4h:ei=\\E[4l:mi:IC=\\E[%d@:ks=\\E[?1h\\E=:ke=\\E[?1l\\E>:vi=\\E[?25l:ve=\\E[34h\\E[?25h:vs=\\E[34l:ti=\\E[?1049h:te=\\E[?1049l:us=\\E[4m:ue=\\E[24m:so=\\E[3m:se=\\E[23m:mb=\\E[5m:md=\\E[1m:mh=\\E[2m:mr=\\E[7m:me=\\E[m:ms:Co#8:pa#64:AF=\\E[3%dm:AB=\\E[4%dm:op=\\E[39;49m:AX:vb=\\Eg:G0:as=\\E(0:ae=\\E(B:ac=\\140\\140aaffggjjkkllmmnnooppqqrrssttuuvvwwxxyyzz{{||}}~~..--++,,hhII00:po=\\E[5i:pf=\\E[4i:Km=\\E[<:k0=\\E[10~:k1=\\EOP:k2=\\EOQ:k3=\\EOR:k4=\\EOS:k5=\\E[15~:k6=\\E[17~:k7=\\E[18~:k8=\\E[19~:k9=\\E[20~:k;=\\E[21~:F1=\\E[23~:F2=\\E[24~:kB=\\E[Z:kh=\\E[1~:@1=\\E[1~:kH=\\E[4~:@7=\\E[4~:kN=\\E[6~:kP=\\E[5~:kI=\\E[2~:kD=\\E[3~:ku=\\EOA:kd=\\EOB:kr=\\EOC:kl=\\EOD:km:', 'LC_ADDRESS': 'cs_CZ.UTF-8', 'LC_NAME': 'cs_CZ.UTF-8', 'WINDOW': '6', 'DESKTOP_SESSION': 'xubuntu', 'LC_MONETARY': 'cs_CZ.UTF-8', 'EDITOR': 'vim', 'XDG_SEAT': 'seat0', 'XDG_SESSION_DESKTOP': 'xubuntu', 'QT_QPA_PLATFORMTHEME': 'gtk2', 'XDG_SESSION_TYPE': 'x11', 'PANEL_GDK_CORE_DEVICE_EVENTS': '0', 'GPG_AGENT_INFO': '/run/user/1000/gnupg/S.gpg-agent:0:1', 'XAUTHORITY': '/home/martin/.Xauthority', 'XDG_GREETER_DATA_DIR': '/var/lib/lightdm-data/martin', 'GDM_LANG': 'en_US', 'LANG': 'C', 'LC_PAPER': 'cs_CZ.UTF-8', 'LS_COLORS': 'rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:', 'XDG_CURRENT_DESKTOP': 'XFCE', 'VTE_VERSION': '6200', 'XDG_SEAT_PATH': '/org/freedesktop/DisplayManager/Seat0', 'LESSCLOSE': '/usr/bin/lesspipe %s %s', 'XDG_SESSION_CLASS': 'user', 'LC_IDENTIFICATION': 'cs_CZ.UTF-8', 'TERM': 'screen.xterm-256color', 'GTK_OVERLAY_SCROLLING': '0', 'LESSOPEN': '| /usr/bin/lesspipe %s', 'DISPLAY': ':0.0', 'SHLVL': '2', 'LC_TELEPHONE': 'cs_CZ.UTF-8', 'LC_MEASUREMENT': 'cs_CZ.UTF-8', 'XDG_VTNR': '7', 'XDG_SESSION_ID': 'c2', 'LD_LIBRARY_PATH': '', 'XDG_RUNTIME_DIR': '/run/user/1000', 'LC_TIME': 'cs_CZ.UTF-8', 'XDG_DATA_DIRS': '/usr/share/xubuntu:/usr/share/xfce4:/usr/local/share:/usr/share:/var/lib/snapd/desktop:/usr/share', 'STY': '5368.x', 'GDMSESSION': 'xubuntu', 'DBUS_SESSION_BUS_ADDRESS': 'unix:path=/run/user/1000/bus', 'BUILDDIR': '/OE/build/oe-core', 'LC_NUMERIC': 'cs_CZ.UTF-8', 'OLDPWD': '/OE/build/oe-core/meta-python2', '_': '/OE/build/oe-core/bitbake/bin/bitbake'}, ['/OE/build/oe-core/bitbake/bin/bitbake', '-k', 'python-native']]
928962 12:43:21.818533 Command Completed
928962 12:43:21.818721 Running command ['getVariable', 'BBINCLUDELOGS']
928962 12:43:22.255470 Command Completed
928962 12:43:22.255835 Running command ['getVariable', 'BBINCLUDELOGS_LINES']
928962 12:43:22.256018 Command Completed
928962 12:43:22.256172 Running command ['getSetVariable', 'BB_CONSOLELOG']
928962 12:43:22.256346 Command Completed
928962 12:43:22.256468 Running command ['getSetVariable', 'BB_LOGCONFIG']
928962 12:43:22.256618 Command Completed
928962 12:43:22.264356 Running command ['getUIHandlerNum']
928962 12:43:22.264922 Command Completed
928962 12:43:22.265103 Running command ['setEventMask', 3, 20, {'BitBake.SigGen.HashEquiv': 19, 'BitBake.RunQueue.HashEquiv': 19}, ['bb.runqueue.runQueueExitWait', 'bb.event.LogExecTTY', 'logging.LogRecord', 'bb.build.TaskFailed', 'bb.build.TaskBase', 'bb.event.ParseStarted', 'bb.event.ParseProgress', 'bb.event.ParseCompleted', 'bb.event.CacheLoadStarted', 'bb.event.CacheLoadProgress', 'bb.event.CacheLoadCompleted', 'bb.command.CommandFailed', 'bb.command.CommandExit', 'bb.command.CommandCompleted', 'bb.cooker.CookerExit', 'bb.event.MultipleProviders', 'bb.event.NoProvider', 'bb.runqueue.sceneQueueTaskStarted', 'bb.runqueue.runQueueTaskStarted', 'bb.runqueue.runQueueTaskFailed', 'bb.runqueue.sceneQueueTaskFailed', 'bb.event.BuildBase', 'bb.build.TaskStarted', 'bb.build.TaskSucceeded', 'bb.build.TaskFailedSilent', 'bb.build.TaskProgress', 'bb.event.ProcessStarted', 'bb.event.ProcessProgress', 'bb.event.ProcessFinished']]
928962 12:43:22.265324 Command Completed
928962 12:43:22.265466 Running command ['getVariable', 'BB_DEFAULT_TASK']
928962 12:43:22.272249 Command Completed
928962 12:43:22.272677 Running command ['setConfig', 'cmd', 'build']
928962 12:43:22.273073 Command Completed
928962 12:43:22.273220 Running command ['buildTargets', ['python-native'], 'build']
928962 12:43:22.275823 Command Completed
It was reproduced on builder with 64 cores.
After changing BB_NUMBER_PARSE_THREADS from default 64 to 10, I wasn't able to get bitbake stuck again (in the same setup after cleaning cache, tmpdir, sstate again) by calling "bitbake python-native" 20+ times.
But after changing BB_NUMBER_PARSE_THREADS to 100 I wasn't able to reproduce it again (so maybe 3rd try with the default value was just me being lucky to reproduce it).
Then I've tried to change it to 1000, just to see what happens and it got stuck (but probably from different reasons):
martin@jama:/OE/build/oe-core$ bitbake -k python-native
Loading cache: 100% | | ETA: --:--:--
Loaded 0 entries from dependency cache.
ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb: Error executing a python function in <code>: | ETA: --:--:--
The stack trace of python calls that resulted in this exception/failure was:
File: '<code>', lineno: 14, function: <module>
0010:__anon_35__OE_build_oe_core_openembedded_core_meta_classes_devshell_bbclass(d)
0011:__anon_151__OE_build_oe_core_openembedded_core_meta_classes_sstate_bbclass(d)
0012:__anon_20__OE_build_oe_core_openembedded_core_meta_classes_blacklist_bbclass(d)
0013:__anon_177__OE_build_oe_core_openembedded_core_meta_classes_siteinfo_bbclass(d)
*** 0014:__anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb(d)
File: '/OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb', lineno: 76, function: __anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb
0072: manifest_file.seek(json_start)
0073: manifest_str = manifest_file.read()
0074: python_manifest = json.loads(manifest_str)
0075:
*** 0076: rprovides = d.getVar('RPROVIDES').split()
0077:
0078: # Hardcoded since it cant be python-native-foo, should be python-foo-native
0079: pn = 'python'
0080:
Exception: AttributeError: 'NoneType' object has no attribute 'split'
ERROR: Command execution failed: Traceback (most recent call last):
File "/OE/bitbake/lib/bb/command.py", line 114, in runAsyncCommand
File "/OE/bitbake/lib/bb/cooker.py", line 1605, in updateCache
File "/OE/bitbake/lib/bb/cooker.py", line 2087, in __init__
File "/OE/bitbake/lib/bb/cooker.py", line 2113, in start
File "/usr/lib/python3.8/multiprocessing/process.py", line 121, in start
File "/usr/lib/python3.8/multiprocessing/context.py", line 224, in _Popen
File "/usr/lib/python3.8/multiprocessing/context.py", line 277, in _Popen
File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 69, in _launch
OSError: [Errno 24] Too many open files
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.
martin@jama:/OE/build/oe-core$ bitbake -k python-native
NOTE: Reconnecting to bitbake server...
NOTE: No reply from server in 30s
NOTE: Retrying server connection (#1)...
On this builder I was using:
BB_SERVER_TIMEOUT = "60"
but that doesn't seem to be required to reproduce as the other builds I've seen stuck on jenkins weren't setting BB_SERVER_TIMEOUT at all.
Let me know if there is something else I should try next time it gets stuck, but right now
I'm not able to reliably reproduce it again (even after switching back to default BB_NUMBER_PARSE_THREADS)
Cheers,
>
> Cheers,
>
> Richard
>
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 201 bytes --]
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-31 13:10 ` Martin Jansa
@ 2021-02-01 14:26 ` Anibal Limon
2021-02-01 20:21 ` Richard Purdie
1 sibling, 0 replies; 23+ messages in thread
From: Anibal Limon @ 2021-02-01 14:26 UTC (permalink / raw)
To: Martin Jansa
Cc: Richard Purdie, Patches and discussions about the oe-core layer,
Nicolas Dechesne, Dmitry Baryshkov
[-- Attachment #1: Type: text/plain, Size: 55536 bytes --]
On Sun, 31 Jan 2021 at 07:10, Martin Jansa <Martin.Jansa@gmail.com> wrote:
> On Sun, Jan 31, 2021 at 10:34:48AM +0000, Richard Purdie wrote:
> > On Sun, 2021-01-31 at 10:55 +0100, Martin Jansa wrote:
> > > On Sun, Jan 31, 2021 at 09:07:50AM +0000, Richard Purdie wrote:
> > > > On Sat, 2021-01-30 at 17:15 +0100, Martin Jansa wrote:
> > > > > I'm asking because meta-python2 has the same issue in:
> > > > >
> https://git.openembedded.org/meta-python2/tree/recipes-devtools/python/python-setuptools.inc#n49
> > > > >
> > > > > and my fix I was planing to send was to replace it with:
> > > > > RDEPENDS_${PN}_append_class-target = " ${PYTHON_PN}-pkg-resources"
> > > > > and drop the RPROVIDES, because it unfortunately causes bitbake to
> > > > > get stuck after reporting parsing error as:
> > > > >
> > > > > ERROR: meta-python2/recipes-devtools/python/python-
> > > > > setuptools_42.0.2.bb: QA Issue: meta-python2/recipes-
> > > > > devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is
> > > > > set as not being package specific, please fix this. [pkgvarcheck]
> > > > > ERROR: meta-python2/recipes-devtools/python/python-
> > > > > setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> > > > > ERROR: Failed to parse recipe: meta-python2/recipes-
> > > > > devtools/python/python-setuptools_42.0.2.bb
> > > >
> > > > Are you saying that it does that with the RPROVIDES removed? That
> seems
> > > > odd :/
> > >
> > > No, this was before removing RPROVIDES in meta-python2, I was just
> > > surprised that bitbake got stuck after reporting parsing failure, I'm
> > > seeing bitbake getting stuck in dunfell builds quite often, but don't
> > > remember seeing it with gatesgarth and newer (and was believing that
> you
> > > have already fixed most if not all cases there). But it's also true
> that
> > > our jenkins runs 1000x more builds based on dunfell, so it's much more
> > > likely to happen there.
> >
> > Its the first time I've heard a report of that and it sounds a little
> > worrying. What you say stuck, bitbake hangs? Is it using cpu? A process
> > tree of what it looks like when stuck would be interesting if it is
> > hanging and maybe the last things in any running or just finished task
> > logs. It could be some issue with the way a failing task is handled?
> >
> > We've seen a lot of weird issues on the autobuilder but not that. Could
> > you have something enabled in your setup for logging/reporting whch
> > wouldn't be in ours and could be causing it?
>
> It doesn't seem to happen very often and I guess autobuilder doesn't
> include meta-python2 (which is currently the only reproducer in my list
> of layers).
>
Hi,
We have similar failure in the Linaro CI using meta-python2,
https://ci.linaro.org/job/lt-qcom-openembedded-rpb-master/437/DISTRO=rpb,MACHINE=dragonboard-820c,label=docker-buster-amd64/console
Regards,
Anibal
>
> I've tried to reproduce it with just 3 layers included:
> BBLAYERS = " \
> /OE/build/oe-core/meta-python2 \
> /OE/build/oe-core/meta-openembedded/meta-oe \
> /OE/build/oe-core/openembedded-core/meta \
> "
>
> and it happened on 3rd try (cache, tmpdir, sstate-cache were removed
> only before 1st try)
>
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> Loading cache: 100% |
>
>
> | ETA: --:--:--
> Loaded 0 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: QA Issue:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being
> package specific, please fix this. [pkgvarcheck]
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb
>
> | ETA: 0:00:14
>
> Summary: There were 3 ERROR messages shown, returning a non-zero exit code.
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> NOTE: Reconnecting to bitbake server...
> Loading cache: 100%
> |###################################################################################################################################################################################################################################|
> Time: 0:00:00
> Loaded 845 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-native_2.7.18.bb: Error executing a python function in <code>:
>
> | ETA: 0:01:10
>
> The stack trace of python calls that resulted in this exception/failure
> was:
> File: '<code>', lineno: 14, function: <module>
>
> 0010:__anon_35__OE_build_oe_core_openembedded_core_meta_classes_devshell_bbclass(d)
>
> 0011:__anon_151__OE_build_oe_core_openembedded_core_meta_classes_sstate_bbclass(d)
>
> 0012:__anon_20__OE_build_oe_core_openembedded_core_meta_classes_blacklist_bbclass(d)
>
> 0013:__anon_177__OE_build_oe_core_openembedded_core_meta_classes_siteinfo_bbclass(d)
> ***
> 0014:__anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb(d)
> File: '/OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-native_2.7.18.bb', lineno: 76, function:
> __anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb
> 0072: manifest_file.seek(json_start)
> 0073: manifest_str = manifest_file.read()
> 0074: python_manifest = json.loads(manifest_str)
> 0075:
> *** 0076: rprovides = d.getVar('RPROVIDES').split()
> 0077:
> 0078: # Hardcoded since it cant be python-native-foo, should be
> python-foo-native
> 0079: pn = 'python'
> 0080:
> Exception: AttributeError: 'NoneType' object has no attribute 'split'
>
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: QA Issue:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being
> package specific, please fix this. [pkgvarcheck]
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-native_2.7.18.bb
>
> | ETA: 0:00:30
>
> Summary: There were 4 ERROR messages shown, returning a non-zero exit code.
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> NOTE: Reconnecting to bitbake server...
> Loading cache: 100%
> |###################################################################################################################################################################################################################################|
> Time: 0:00:00
> Loaded 1289 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: QA Issue:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being
> package specific, please fix this. [pkgvarcheck]
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb
>
> and here it's stuck for around 1 hour, bitbake using very little cpu.
>
> martin@jama:~$ ps aux | grep bitbake
> martin 372784 0.0 0.0 11552 884 pts/1 S+ 13:43 0:00 grep
> --color=auto bitbake
> martin 928962 0.1 0.1 219204 133704 ? Sl 12:42 0:04
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 943698 0.0 0.0 119900 29928 pts/8 Sl+ 12:43 0:01 python3
> /OE/build/oe-core/bitbake/bin/bitbake -k python-native
> martin 945507 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945528 0.0 0.0 214364 124740 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945532 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945563 0.0 0.0 214364 124732 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945577 0.0 0.0 214364 124740 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945621 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945632 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945643 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945653 0.0 0.0 214364 124740 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945669 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945685 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945703 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945736 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945753 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945774 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945778 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945819 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945839 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945860 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945878 0.0 0.0 214364 124740 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945894 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945909 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945915 0.0 0.0 214364 124804 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945929 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945950 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945953 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945964 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945966 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 945989 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946005 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946016 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946037 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946038 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946064 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946068 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946080 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946103 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946109 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946122 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946135 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946137 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946152 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946167 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946168 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946185 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946197 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946214 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946228 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946243 0.0 0.0 214364 124728 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946249 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946265 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946298 0.0 0.0 214364 124740 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946345 0.0 0.0 214364 124736 ? Sl 12:43 0:01
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946364 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946386 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946389 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946405 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946410 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946442 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946458 0.0 0.0 214364 124612 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946463 0.0 0.0 214364 124652 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946481 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946501 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin 946518 0.0 0.0 214364 124736 ? Sl 12:43 0:00
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
>
> martin@jama:~$ sudo strace -p 928962
> strace: Process 928962 attached
> wait4(945507,
>
> martin@jama:~$ kill 928962
>
> adds an warning to the stuck build:
>
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> NOTE: Reconnecting to bitbake server...
> Loading cache: 100%
> |###################################################################################################################################################################################################################################|
> Time: 0:00:00
> Loaded 1289 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: QA Issue:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being
> package specific, please fix this. [pkgvarcheck]
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb
>
> | ETA: 0:00:50
> WARNING: Cooker received SIGTERM, shutting down...
>
> killing the main process:
> martin@jama:~$ kill 943698
>
> terminates the stuck build, but all bitbake-server processes are left
> behind.
>
> If I try to kill all remaining bitbake-server processes, then only one is
> left behind:
> martin 928962 0.1 0.1 285004 137688 ? S 12:42 0:05
> bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5
> /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock
> /OE/build/oe-core/bitbake.sock None None 0
> martin@jama:/OE/build/oe-core$ sudo strace -p 928962
> strace: Process 928962 attached
> select(7, [6], [], [], {tv_sec=0, tv_usec=40768}) = 0 (Timeout)
> poll([{fd=7, events=POLLIN}], 1, 0) = 0 (Timeout)
> poll([{fd=8, events=POLLIN}], 1, 0) = 0 (Timeout)
> select(7, [6], [], [], {tv_sec=0, tv_usec=100000}) = 0 (Timeout)
> poll([{fd=7, events=POLLIN}], 1, 0) = 0 (Timeout)
> poll([{fd=8, events=POLLIN}], 1, 0) = 0 (Timeout)
>
> and then it dies as well after a while.
>
> Here is bitbake-cookerdaemon.log, but doesn't look very interesting to me:
>
> 928962 12:42:56.099747 --- Starting bitbake server pid 928962 at
> 2021-01-31 12:42:56.099713 ---
> 928962 12:42:56.110782 Started bitbake server pid 928962
> 928962 12:42:56.111010 Entering server connection loop
> 928962 12:42:56.111833 Accepting [<socket.socket fd=6,
> family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0,
> laddr=bitbake.sock>] ([])
> 928962 12:42:56.112382 Processing Client
> 928962 12:42:56.112428 Connecting Client
> 928962 12:42:56.112733 Running command ['setFeatures', [2]]
> 928962 12:42:56.113448 Command Completed
> 928962 12:42:56.113566 Running command ['updateConfig', {'abort': False,
> 'force': False, 'invalidate_stamp': None, 'dry_run': False,
> 'dump_signatures': [], 'extra_assume_provided': [], 'profile': False,
> 'prefile': [], 'postfile': [], 'server_timeout': None, 'nosetscene': False,
> 'setsceneonly': False, 'skipsetscene': False, 'runall': None, 'runonly':
> None, 'writeeventlog': None, 'build_verbose_shell': False,
> 'build_verbose_stdout': False, 'default_loglevel': 20, 'debug_domains':
> {}}, {'SHELL': '/bin/bash', 'SSH_AUTH_SOCK': '/run/user/1000/keyring/ssh',
> 'SSH_AGENT_PID': '3080', 'PWD': '/OE/build/oe-core', 'LOGNAME': 'martin',
> 'HOME': '/home/martin', 'MACHINE': 'qemux86-64', 'BB_ENV_EXTRAWHITE':
> 'MACHINE DISTRO http_proxy ftp_proxy https_proxy all_proxy ALL_PROXY
> no_proxy SSH_AGENT_PID SSH_AUTH_SOCK BB_SRCREV_POLICY SDKMACHINE
> BB_NUMBER_THREADS GIT_PROXY_COMMAND PSEUDO_DISABLED PSEUDO_BUILD', 'USER':
> 'martin', 'LC_ALL': 'en_US.UTF-8', 'PATH':
> '/OE/build/oe-core/openembedded-core/scripts:/OE/build/oe-core/bitbake/bin:/home/martin/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin',
> 'SESSION_MANAGER': 'local/jama:@/tmp/.ICE-unix/2943,unix/jama:/tmp/.ICE-unix/2943',
> 'WINDOWID': '79691779', 'QT_ACCESSIBILITY': '1', 'COLORTERM': 'truecolor',
> 'XDG_CONFIG_DIRS': '/etc/xdg/xdg-xubuntu:/etc/xdg:/etc/xdg',
> 'XDG_SESSION_PATH': '/org/freedesktop/DisplayManager/Session0',
> 'XDG_MENU_PREFIX': 'xfce-', 'CLUTTER_BACKEND': 'x11', 'LANGUAGE': 'en_US',
> 'TERMCAP': 'SC|screen.xterm-256color|VT 100/ANSI X3.64 virtual
> terminal:DO=\\E[%dB:LE=\\E[%dD:RI=\\E[%dC:UP=\\E[%dA:bs:bt=\\E[Z:cd=\\E[J:ce=\\E[K:cl=\\E[H\\E[J:cm=\\E[%i%d;%dH:ct=\\E[3g:do=^J:nd=\\E[C:pt:rc=\\E8:rs=\\Ec:sc=\\E7:st=\\EH:up=\\EM:le=^H:bl=^G:cr=^M:it#8:ho=\\E[H:nw=\\EE:ta=^I:is=\\E)0:li#51:co#263:am:xn:xv:LP:sr=\\EM:al=\\E[L:AL=\\E[%dL:cs=\\E[%i%d;%dr:dl=\\E[M:DL=\\E[%dM:dc=\\E[P:DC=\\E[%dP:im=\\E[4h:ei=\\E[4l:mi:IC=\\E[%d@:ks=\\E[?1h\\E=:ke=\\E[?1l\\E>:vi=\\E[?25l:ve=\\E[34h\\E[?25h:vs=\\E[34l:ti=\\E[?1049h:te=\\E[?1049l:us=\\E[4m:ue=\\E[24m:so=\\E[3m:se=\\E[23m:mb=\\E[5m:md=\\E[1m:mh=\\E[2m:mr=\\E[7m:me=\\E[m:ms:Co#8:pa#64:AF=\\E[3%dm:AB=\\E[4%dm:op=\\E[39;49m:AX:vb=\\Eg:G0:as=\\E(0:ae=\\E(B:ac=\\140\\140aaffggjjkkllmmnnooppqqrrssttuuvvwwxxyyzz{{||}}~~..--++,,hhII00:po=\\E[5i:pf=\\E[4i:Km=\\E[<:k0=\\E[10~:k1=\\EOP:k2=\\EOQ:k3=\\EOR:k4=\\EOS:k5=\\E[15~:k6=\\E[17~:k7=\\E[18~:k8=\\E[19~:k9=\\E[20~:k;=\\E[21~:F1=\\E[23~:F2=\\E[24~:kB=\\E[Z:kh=\\E[1~:@1=\\E[1~:kH=\\E[4~:@7=\\E[4~:kN=\\E[6~:kP=\\E[5~:kI=\\E[2~:kD=\\E[3~:ku=\\EOA:kd=\\EOB:kr=\\EOC:kl=\\EOD:km:',
> 'LC_ADDRESS': 'cs_CZ.UTF-8', 'LC_NAME': 'cs_CZ.UTF-8', 'WINDOW': '6',
> 'DESKTOP_SESSION': 'xubuntu', 'LC_MONETARY': 'cs_CZ.UTF-8', 'EDITOR':
> 'vim', 'XDG_SEAT': 'seat0', 'XDG_SESSION_DESKTOP': 'xubuntu',
> 'QT_QPA_PLATFORMTHEME': 'gtk2', 'XDG_SESSION_TYPE': 'x11',
> 'PANEL_GDK_CORE_DEVICE_EVENTS': '0', 'GPG_AGENT_INFO':
> '/run/user/1000/gnupg/S.gpg-agent:0:1', 'XAUTHORITY':
> '/home/martin/.Xauthority', 'XDG_GREETER_DATA_DIR':
> '/var/lib/lightdm-data/martin', 'GDM_LANG': 'en_US', 'LANG': 'C',
> 'LC_PAPER': 'cs_CZ.UTF-8', 'LS_COLORS':
> 'rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:',
> 'XDG_CURRENT_DESKTOP': 'XFCE', 'VTE_VERSION': '6200', 'XDG_SEAT_PATH':
> '/org/freedesktop/DisplayManager/Seat0', 'LESSCLOSE': '/usr/bin/lesspipe %s
> %s', 'XDG_SESSION_CLASS': 'user', 'LC_IDENTIFICATION': 'cs_CZ.UTF-8',
> 'TERM': 'screen.xterm-256color', 'GTK_OVERLAY_SCROLLING': '0', 'LESSOPEN':
> '| /usr/bin/lesspipe %s', 'DISPLAY': ':0.0', 'SHLVL': '2', 'LC_TELEPHONE':
> 'cs_CZ.UTF-8', 'LC_MEASUREMENT': 'cs_CZ.UTF-8', 'XDG_VTNR': '7',
> 'XDG_SESSION_ID': 'c2', 'LD_LIBRARY_PATH': '', 'XDG_RUNTIME_DIR':
> '/run/user/1000', 'LC_TIME': 'cs_CZ.UTF-8', 'XDG_DATA_DIRS':
> '/usr/share/xubuntu:/usr/share/xfce4:/usr/local/share:/usr/share:/var/lib/snapd/desktop:/usr/share',
> 'STY': '5368.x', 'GDMSESSION': 'xubuntu', 'DBUS_SESSION_BUS_ADDRESS':
> 'unix:path=/run/user/1000/bus', 'BUILDDIR': '/OE/build/oe-core',
> 'LC_NUMERIC': 'cs_CZ.UTF-8', 'OLDPWD': '/OE/build/oe-core/meta-python2',
> '_': '/OE/build/oe-core/bitbake/bin/bitbake'},
> ['/OE/build/oe-core/bitbake/bin/bitbake', '-k', 'python-native']]
> 928962 12:42:56.450688 Command Completed
> 928962 12:42:56.450996 Running command ['getVariable', 'BBINCLUDELOGS']
> 928962 12:42:56.451159 Command Completed
> 928962 12:42:56.451239 Running command ['getVariable',
> 'BBINCLUDELOGS_LINES']
> 928962 12:42:56.451360 Command Completed
> 928962 12:42:56.451436 Running command ['getSetVariable', 'BB_CONSOLELOG']
> 928962 12:42:56.451656 Command Completed
> 928962 12:42:56.451740 Running command ['getSetVariable', 'BB_LOGCONFIG']
> 928962 12:42:56.453927 Command Completed
> 928962 12:42:56.454122 Running command ['getUIHandlerNum']
> 928962 12:42:56.454289 Command Completed
> 928962 12:42:56.454392 Running command ['setEventMask', 1, 20,
> {'BitBake.RunQueue.HashEquiv': 19, 'BitBake.SigGen.HashEquiv': 19},
> ['bb.runqueue.runQueueExitWait', 'bb.event.LogExecTTY',
> 'logging.LogRecord', 'bb.build.TaskFailed', 'bb.build.TaskBase',
> 'bb.event.ParseStarted', 'bb.event.ParseProgress',
> 'bb.event.ParseCompleted', 'bb.event.CacheLoadStarted',
> 'bb.event.CacheLoadProgress', 'bb.event.CacheLoadCompleted',
> 'bb.command.CommandFailed', 'bb.command.CommandExit',
> 'bb.command.CommandCompleted', 'bb.cooker.CookerExit',
> 'bb.event.MultipleProviders', 'bb.event.NoProvider',
> 'bb.runqueue.sceneQueueTaskStarted', 'bb.runqueue.runQueueTaskStarted',
> 'bb.runqueue.runQueueTaskFailed', 'bb.runqueue.sceneQueueTaskFailed',
> 'bb.event.BuildBase', 'bb.build.TaskStarted', 'bb.build.TaskSucceeded',
> 'bb.build.TaskFailedSilent', 'bb.build.TaskProgress',
> 'bb.event.ProcessStarted', 'bb.event.ProcessProgress',
> 'bb.event.ProcessFinished']]
> 928962 12:42:56.454523 Command Completed
> 928962 12:42:56.454599 Running command ['getVariable', 'BB_DEFAULT_TASK']
> 928962 12:42:56.454741 Command Completed
> 928962 12:42:56.454816 Running command ['setConfig', 'cmd', 'build']
> 928962 12:42:56.454947 Command Completed
> 928962 12:42:56.455022 Running command ['buildTargets', ['python-native'],
> 'build']
> 928962 12:42:56.457778 Command Completed
> 928962 12:43:04.560968 Processing Client
> 928962 12:43:04.561063 Disconnecting Client
> 928962 12:43:08.544918 Accepting [<socket.socket fd=6,
> family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0,
> laddr=bitbake.sock>] ([])
> 928962 12:43:08.557050 Processing Client
> 928962 12:43:08.557154 Connecting Client
> 928962 12:43:08.557787 Running command ['setFeatures', [2]]
> 928962 12:43:08.558183 Command Completed
> 928962 12:43:08.558952 Running command ['updateConfig', {'abort': False,
> 'force': False, 'invalidate_stamp': None, 'dry_run': False,
> 'dump_signatures': [], 'extra_assume_provided': [], 'profile': False,
> 'prefile': [], 'postfile': [], 'server_timeout': None, 'nosetscene': False,
> 'setsceneonly': False, 'skipsetscene': False, 'runall': None, 'runonly':
> None, 'writeeventlog': None, 'build_verbose_shell': False,
> 'build_verbose_stdout': False, 'default_loglevel': 20, 'debug_domains':
> {}}, {'SHELL': '/bin/bash', 'SSH_AUTH_SOCK': '/run/user/1000/keyring/ssh',
> 'SSH_AGENT_PID': '3080', 'PWD': '/OE/build/oe-core', 'LOGNAME': 'martin',
> 'HOME': '/home/martin', 'MACHINE': 'qemux86-64', 'BB_ENV_EXTRAWHITE':
> 'MACHINE DISTRO http_proxy ftp_proxy https_proxy all_proxy ALL_PROXY
> no_proxy SSH_AGENT_PID SSH_AUTH_SOCK BB_SRCREV_POLICY SDKMACHINE
> BB_NUMBER_THREADS GIT_PROXY_COMMAND PSEUDO_DISABLED PSEUDO_BUILD', 'USER':
> 'martin', 'LC_ALL': 'en_US.UTF-8', 'PATH':
> '/OE/build/oe-core/openembedded-core/scripts:/OE/build/oe-core/bitbake/bin:/home/martin/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin',
> 'SESSION_MANAGER': 'local/jama:@/tmp/.ICE-unix/2943,unix/jama:/tmp/.ICE-unix/2943',
> 'WINDOWID': '79691779', 'QT_ACCESSIBILITY': '1', 'COLORTERM': 'truecolor',
> 'XDG_CONFIG_DIRS': '/etc/xdg/xdg-xubuntu:/etc/xdg:/etc/xdg',
> 'XDG_SESSION_PATH': '/org/freedesktop/DisplayManager/Session0',
> 'XDG_MENU_PREFIX': 'xfce-', 'CLUTTER_BACKEND': 'x11', 'LANGUAGE': 'en_US',
> 'TERMCAP': 'SC|screen.xterm-256color|VT 100/ANSI X3.64 virtual
> terminal:DO=\\E[%dB:LE=\\E[%dD:RI=\\E[%dC:UP=\\E[%dA:bs:bt=\\E[Z:cd=\\E[J:ce=\\E[K:cl=\\E[H\\E[J:cm=\\E[%i%d;%dH:ct=\\E[3g:do=^J:nd=\\E[C:pt:rc=\\E8:rs=\\Ec:sc=\\E7:st=\\EH:up=\\EM:le=^H:bl=^G:cr=^M:it#8:ho=\\E[H:nw=\\EE:ta=^I:is=\\E)0:li#51:co#263:am:xn:xv:LP:sr=\\EM:al=\\E[L:AL=\\E[%dL:cs=\\E[%i%d;%dr:dl=\\E[M:DL=\\E[%dM:dc=\\E[P:DC=\\E[%dP:im=\\E[4h:ei=\\E[4l:mi:IC=\\E[%d@:ks=\\E[?1h\\E=:ke=\\E[?1l\\E>:vi=\\E[?25l:ve=\\E[34h\\E[?25h:vs=\\E[34l:ti=\\E[?1049h:te=\\E[?1049l:us=\\E[4m:ue=\\E[24m:so=\\E[3m:se=\\E[23m:mb=\\E[5m:md=\\E[1m:mh=\\E[2m:mr=\\E[7m:me=\\E[m:ms:Co#8:pa#64:AF=\\E[3%dm:AB=\\E[4%dm:op=\\E[39;49m:AX:vb=\\Eg:G0:as=\\E(0:ae=\\E(B:ac=\\140\\140aaffggjjkkllmmnnooppqqrrssttuuvvwwxxyyzz{{||}}~~..--++,,hhII00:po=\\E[5i:pf=\\E[4i:Km=\\E[<:k0=\\E[10~:k1=\\EOP:k2=\\EOQ:k3=\\EOR:k4=\\EOS:k5=\\E[15~:k6=\\E[17~:k7=\\E[18~:k8=\\E[19~:k9=\\E[20~:k;=\\E[21~:F1=\\E[23~:F2=\\E[24~:kB=\\E[Z:kh=\\E[1~:@1=\\E[1~:kH=\\E[4~:@7=\\E[4~:kN=\\E[6~:kP=\\E[5~:kI=\\E[2~:kD=\\E[3~:ku=\\EOA:kd=\\EOB:kr=\\EOC:kl=\\EOD:km:',
> 'LC_ADDRESS': 'cs_CZ.UTF-8', 'LC_NAME': 'cs_CZ.UTF-8', 'WINDOW': '6',
> 'DESKTOP_SESSION': 'xubuntu', 'LC_MONETARY': 'cs_CZ.UTF-8', 'EDITOR':
> 'vim', 'XDG_SEAT': 'seat0', 'XDG_SESSION_DESKTOP': 'xubuntu',
> 'QT_QPA_PLATFORMTHEME': 'gtk2', 'XDG_SESSION_TYPE': 'x11',
> 'PANEL_GDK_CORE_DEVICE_EVENTS': '0', 'GPG_AGENT_INFO':
> '/run/user/1000/gnupg/S.gpg-agent:0:1', 'XAUTHORITY':
> '/home/martin/.Xauthority', 'XDG_GREETER_DATA_DIR':
> '/var/lib/lightdm-data/martin', 'GDM_LANG': 'en_US', 'LANG': 'C',
> 'LC_PAPER': 'cs_CZ.UTF-8', 'LS_COLORS':
> 'rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:',
> 'XDG_CURRENT_DESKTOP': 'XFCE', 'VTE_VERSION': '6200', 'XDG_SEAT_PATH':
> '/org/freedesktop/DisplayManager/Seat0', 'LESSCLOSE': '/usr/bin/lesspipe %s
> %s', 'XDG_SESSION_CLASS': 'user', 'LC_IDENTIFICATION': 'cs_CZ.UTF-8',
> 'TERM': 'screen.xterm-256color', 'GTK_OVERLAY_SCROLLING': '0', 'LESSOPEN':
> '| /usr/bin/lesspipe %s', 'DISPLAY': ':0.0', 'SHLVL': '2', 'LC_TELEPHONE':
> 'cs_CZ.UTF-8', 'LC_MEASUREMENT': 'cs_CZ.UTF-8', 'XDG_VTNR': '7',
> 'XDG_SESSION_ID': 'c2', 'LD_LIBRARY_PATH': '', 'XDG_RUNTIME_DIR':
> '/run/user/1000', 'LC_TIME': 'cs_CZ.UTF-8', 'XDG_DATA_DIRS':
> '/usr/share/xubuntu:/usr/share/xfce4:/usr/local/share:/usr/share:/var/lib/snapd/desktop:/usr/share',
> 'STY': '5368.x', 'GDMSESSION': 'xubuntu', 'DBUS_SESSION_BUS_ADDRESS':
> 'unix:path=/run/user/1000/bus', 'BUILDDIR': '/OE/build/oe-core',
> 'LC_NUMERIC': 'cs_CZ.UTF-8', 'OLDPWD': '/OE/build/oe-core/meta-python2',
> '_': '/OE/build/oe-core/bitbake/bin/bitbake'},
> ['/OE/build/oe-core/bitbake/bin/bitbake', '-k', 'python-native']]
> 928962 12:43:08.559567 Command Completed
> 928962 12:43:08.559798 Running command ['getVariable', 'BBINCLUDELOGS']
> 928962 12:43:08.812911 Command Completed
> 928962 12:43:08.813560 Running command ['getVariable',
> 'BBINCLUDELOGS_LINES']
> 928962 12:43:08.813765 Command Completed
> 928962 12:43:08.813879 Running command ['getSetVariable', 'BB_CONSOLELOG']
> 928962 12:43:08.814115 Command Completed
> 928962 12:43:08.814236 Running command ['getSetVariable', 'BB_LOGCONFIG']
> 928962 12:43:08.816210 Command Completed
> 928962 12:43:08.816451 Running command ['getUIHandlerNum']
> 928962 12:43:08.816661 Command Completed
> 928962 12:43:08.816799 Running command ['setEventMask', 2, 20,
> {'BitBake.RunQueue.HashEquiv': 19, 'BitBake.SigGen.HashEquiv': 19},
> ['bb.runqueue.runQueueExitWait', 'bb.event.LogExecTTY',
> 'logging.LogRecord', 'bb.build.TaskFailed', 'bb.build.TaskBase',
> 'bb.event.ParseStarted', 'bb.event.ParseProgress',
> 'bb.event.ParseCompleted', 'bb.event.CacheLoadStarted',
> 'bb.event.CacheLoadProgress', 'bb.event.CacheLoadCompleted',
> 'bb.command.CommandFailed', 'bb.command.CommandExit',
> 'bb.command.CommandCompleted', 'bb.cooker.CookerExit',
> 'bb.event.MultipleProviders', 'bb.event.NoProvider',
> 'bb.runqueue.sceneQueueTaskStarted', 'bb.runqueue.runQueueTaskStarted',
> 'bb.runqueue.runQueueTaskFailed', 'bb.runqueue.sceneQueueTaskFailed',
> 'bb.event.BuildBase', 'bb.build.TaskStarted', 'bb.build.TaskSucceeded',
> 'bb.build.TaskFailedSilent', 'bb.build.TaskProgress',
> 'bb.event.ProcessStarted', 'bb.event.ProcessProgress',
> 'bb.event.ProcessFinished']]
> 928962 12:43:08.816980 Command Completed
> 928962 12:43:08.817101 Running command ['getVariable', 'BB_DEFAULT_TASK']
> 928962 12:43:08.817293 Command Completed
> 928962 12:43:08.817418 Running command ['setConfig', 'cmd', 'build']
> 928962 12:43:08.817604 Command Completed
> 928962 12:43:08.817732 Running command ['buildTargets', ['python-native'],
> 'build']
> 928962 12:43:08.820432 Command Completed
> 928962 12:43:18.569947 Processing Client
> 928962 12:43:18.570026 Disconnecting Client
> 928962 12:43:21.796010 Accepting [<socket.socket fd=6,
> family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0,
> laddr=bitbake.sock>] ([])
> 928962 12:43:21.812637 Processing Client
> 928962 12:43:21.812758 Connecting Client
> 928962 12:43:21.816670 Running command ['setFeatures', [2]]
> 928962 12:43:21.817252 Command Completed
> 928962 12:43:21.817987 Running command ['updateConfig', {'abort': False,
> 'force': False, 'invalidate_stamp': None, 'dry_run': False,
> 'dump_signatures': [], 'extra_assume_provided': [], 'profile': False,
> 'prefile': [], 'postfile': [], 'server_timeout': None, 'nosetscene': False,
> 'setsceneonly': False, 'skipsetscene': False, 'runall': None, 'runonly':
> None, 'writeeventlog': None, 'build_verbose_shell': False,
> 'build_verbose_stdout': False, 'default_loglevel': 20, 'debug_domains':
> {}}, {'SHELL': '/bin/bash', 'SSH_AUTH_SOCK': '/run/user/1000/keyring/ssh',
> 'SSH_AGENT_PID': '3080', 'PWD': '/OE/build/oe-core', 'LOGNAME': 'martin',
> 'HOME': '/home/martin', 'MACHINE': 'qemux86-64', 'BB_ENV_EXTRAWHITE':
> 'MACHINE DISTRO http_proxy ftp_proxy https_proxy all_proxy ALL_PROXY
> no_proxy SSH_AGENT_PID SSH_AUTH_SOCK BB_SRCREV_POLICY SDKMACHINE
> BB_NUMBER_THREADS GIT_PROXY_COMMAND PSEUDO_DISABLED PSEUDO_BUILD', 'USER':
> 'martin', 'LC_ALL': 'en_US.UTF-8', 'PATH':
> '/OE/build/oe-core/openembedded-core/scripts:/OE/build/oe-core/bitbake/bin:/home/martin/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin',
> 'SESSION_MANAGER': 'local/jama:@/tmp/.ICE-unix/2943,unix/jama:/tmp/.ICE-unix/2943',
> 'WINDOWID': '79691779', 'QT_ACCESSIBILITY': '1', 'COLORTERM': 'truecolor',
> 'XDG_CONFIG_DIRS': '/etc/xdg/xdg-xubuntu:/etc/xdg:/etc/xdg',
> 'XDG_SESSION_PATH': '/org/freedesktop/DisplayManager/Session0',
> 'XDG_MENU_PREFIX': 'xfce-', 'CLUTTER_BACKEND': 'x11', 'LANGUAGE': 'en_US',
> 'TERMCAP': 'SC|screen.xterm-256color|VT 100/ANSI X3.64 virtual
> terminal:DO=\\E[%dB:LE=\\E[%dD:RI=\\E[%dC:UP=\\E[%dA:bs:bt=\\E[Z:cd=\\E[J:ce=\\E[K:cl=\\E[H\\E[J:cm=\\E[%i%d;%dH:ct=\\E[3g:do=^J:nd=\\E[C:pt:rc=\\E8:rs=\\Ec:sc=\\E7:st=\\EH:up=\\EM:le=^H:bl=^G:cr=^M:it#8:ho=\\E[H:nw=\\EE:ta=^I:is=\\E)0:li#51:co#263:am:xn:xv:LP:sr=\\EM:al=\\E[L:AL=\\E[%dL:cs=\\E[%i%d;%dr:dl=\\E[M:DL=\\E[%dM:dc=\\E[P:DC=\\E[%dP:im=\\E[4h:ei=\\E[4l:mi:IC=\\E[%d@:ks=\\E[?1h\\E=:ke=\\E[?1l\\E>:vi=\\E[?25l:ve=\\E[34h\\E[?25h:vs=\\E[34l:ti=\\E[?1049h:te=\\E[?1049l:us=\\E[4m:ue=\\E[24m:so=\\E[3m:se=\\E[23m:mb=\\E[5m:md=\\E[1m:mh=\\E[2m:mr=\\E[7m:me=\\E[m:ms:Co#8:pa#64:AF=\\E[3%dm:AB=\\E[4%dm:op=\\E[39;49m:AX:vb=\\Eg:G0:as=\\E(0:ae=\\E(B:ac=\\140\\140aaffggjjkkllmmnnooppqqrrssttuuvvwwxxyyzz{{||}}~~..--++,,hhII00:po=\\E[5i:pf=\\E[4i:Km=\\E[<:k0=\\E[10~:k1=\\EOP:k2=\\EOQ:k3=\\EOR:k4=\\EOS:k5=\\E[15~:k6=\\E[17~:k7=\\E[18~:k8=\\E[19~:k9=\\E[20~:k;=\\E[21~:F1=\\E[23~:F2=\\E[24~:kB=\\E[Z:kh=\\E[1~:@1=\\E[1~:kH=\\E[4~:@7=\\E[4~:kN=\\E[6~:kP=\\E[5~:kI=\\E[2~:kD=\\E[3~:ku=\\EOA:kd=\\EOB:kr=\\EOC:kl=\\EOD:km:',
> 'LC_ADDRESS': 'cs_CZ.UTF-8', 'LC_NAME': 'cs_CZ.UTF-8', 'WINDOW': '6',
> 'DESKTOP_SESSION': 'xubuntu', 'LC_MONETARY': 'cs_CZ.UTF-8', 'EDITOR':
> 'vim', 'XDG_SEAT': 'seat0', 'XDG_SESSION_DESKTOP': 'xubuntu',
> 'QT_QPA_PLATFORMTHEME': 'gtk2', 'XDG_SESSION_TYPE': 'x11',
> 'PANEL_GDK_CORE_DEVICE_EVENTS': '0', 'GPG_AGENT_INFO':
> '/run/user/1000/gnupg/S.gpg-agent:0:1', 'XAUTHORITY':
> '/home/martin/.Xauthority', 'XDG_GREETER_DATA_DIR':
> '/var/lib/lightdm-data/martin', 'GDM_LANG': 'en_US', 'LANG': 'C',
> 'LC_PAPER': 'cs_CZ.UTF-8', 'LS_COLORS':
> 'rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:',
> 'XDG_CURRENT_DESKTOP': 'XFCE', 'VTE_VERSION': '6200', 'XDG_SEAT_PATH':
> '/org/freedesktop/DisplayManager/Seat0', 'LESSCLOSE': '/usr/bin/lesspipe %s
> %s', 'XDG_SESSION_CLASS': 'user', 'LC_IDENTIFICATION': 'cs_CZ.UTF-8',
> 'TERM': 'screen.xterm-256color', 'GTK_OVERLAY_SCROLLING': '0', 'LESSOPEN':
> '| /usr/bin/lesspipe %s', 'DISPLAY': ':0.0', 'SHLVL': '2', 'LC_TELEPHONE':
> 'cs_CZ.UTF-8', 'LC_MEASUREMENT': 'cs_CZ.UTF-8', 'XDG_VTNR': '7',
> 'XDG_SESSION_ID': 'c2', 'LD_LIBRARY_PATH': '', 'XDG_RUNTIME_DIR':
> '/run/user/1000', 'LC_TIME': 'cs_CZ.UTF-8', 'XDG_DATA_DIRS':
> '/usr/share/xubuntu:/usr/share/xfce4:/usr/local/share:/usr/share:/var/lib/snapd/desktop:/usr/share',
> 'STY': '5368.x', 'GDMSESSION': 'xubuntu', 'DBUS_SESSION_BUS_ADDRESS':
> 'unix:path=/run/user/1000/bus', 'BUILDDIR': '/OE/build/oe-core',
> 'LC_NUMERIC': 'cs_CZ.UTF-8', 'OLDPWD': '/OE/build/oe-core/meta-python2',
> '_': '/OE/build/oe-core/bitbake/bin/bitbake'},
> ['/OE/build/oe-core/bitbake/bin/bitbake', '-k', 'python-native']]
> 928962 12:43:21.818533 Command Completed
> 928962 12:43:21.818721 Running command ['getVariable', 'BBINCLUDELOGS']
> 928962 12:43:22.255470 Command Completed
> 928962 12:43:22.255835 Running command ['getVariable',
> 'BBINCLUDELOGS_LINES']
> 928962 12:43:22.256018 Command Completed
> 928962 12:43:22.256172 Running command ['getSetVariable', 'BB_CONSOLELOG']
> 928962 12:43:22.256346 Command Completed
> 928962 12:43:22.256468 Running command ['getSetVariable', 'BB_LOGCONFIG']
> 928962 12:43:22.256618 Command Completed
> 928962 12:43:22.264356 Running command ['getUIHandlerNum']
> 928962 12:43:22.264922 Command Completed
> 928962 12:43:22.265103 Running command ['setEventMask', 3, 20,
> {'BitBake.SigGen.HashEquiv': 19, 'BitBake.RunQueue.HashEquiv': 19},
> ['bb.runqueue.runQueueExitWait', 'bb.event.LogExecTTY',
> 'logging.LogRecord', 'bb.build.TaskFailed', 'bb.build.TaskBase',
> 'bb.event.ParseStarted', 'bb.event.ParseProgress',
> 'bb.event.ParseCompleted', 'bb.event.CacheLoadStarted',
> 'bb.event.CacheLoadProgress', 'bb.event.CacheLoadCompleted',
> 'bb.command.CommandFailed', 'bb.command.CommandExit',
> 'bb.command.CommandCompleted', 'bb.cooker.CookerExit',
> 'bb.event.MultipleProviders', 'bb.event.NoProvider',
> 'bb.runqueue.sceneQueueTaskStarted', 'bb.runqueue.runQueueTaskStarted',
> 'bb.runqueue.runQueueTaskFailed', 'bb.runqueue.sceneQueueTaskFailed',
> 'bb.event.BuildBase', 'bb.build.TaskStarted', 'bb.build.TaskSucceeded',
> 'bb.build.TaskFailedSilent', 'bb.build.TaskProgress',
> 'bb.event.ProcessStarted', 'bb.event.ProcessProgress',
> 'bb.event.ProcessFinished']]
> 928962 12:43:22.265324 Command Completed
> 928962 12:43:22.265466 Running command ['getVariable', 'BB_DEFAULT_TASK']
> 928962 12:43:22.272249 Command Completed
> 928962 12:43:22.272677 Running command ['setConfig', 'cmd', 'build']
> 928962 12:43:22.273073 Command Completed
> 928962 12:43:22.273220 Running command ['buildTargets', ['python-native'],
> 'build']
> 928962 12:43:22.275823 Command Completed
>
> It was reproduced on builder with 64 cores.
>
> After changing BB_NUMBER_PARSE_THREADS from default 64 to 10, I wasn't
> able to get bitbake stuck again (in the same setup after cleaning cache,
> tmpdir, sstate again) by calling "bitbake python-native" 20+ times.
>
> But after changing BB_NUMBER_PARSE_THREADS to 100 I wasn't able to
> reproduce it again (so maybe 3rd try with the default value was just me
> being lucky to reproduce it).
>
> Then I've tried to change it to 1000, just to see what happens and it got
> stuck (but probably from different reasons):
>
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> Loading cache: 100% |
>
>
> | ETA: --:--:--
> Loaded 0 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-native_2.7.18.bb: Error executing a python function in <code>:
>
> | ETA: --:--:--
>
> The stack trace of python calls that resulted in this exception/failure
> was:
> File: '<code>', lineno: 14, function: <module>
>
> 0010:__anon_35__OE_build_oe_core_openembedded_core_meta_classes_devshell_bbclass(d)
>
> 0011:__anon_151__OE_build_oe_core_openembedded_core_meta_classes_sstate_bbclass(d)
>
> 0012:__anon_20__OE_build_oe_core_openembedded_core_meta_classes_blacklist_bbclass(d)
>
> 0013:__anon_177__OE_build_oe_core_openembedded_core_meta_classes_siteinfo_bbclass(d)
> ***
> 0014:__anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb(d)
> File: '/OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-native_2.7.18.bb', lineno: 76, function:
> __anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb
> 0072: manifest_file.seek(json_start)
> 0073: manifest_str = manifest_file.read()
> 0074: python_manifest = json.loads(manifest_str)
> 0075:
> *** 0076: rprovides = d.getVar('RPROVIDES').split()
> 0077:
> 0078: # Hardcoded since it cant be python-native-foo, should be
> python-foo-native
> 0079: pn = 'python'
> 0080:
> Exception: AttributeError: 'NoneType' object has no attribute 'split'
>
> ERROR: Command execution failed: Traceback (most recent call last):
> File "/OE/bitbake/lib/bb/command.py", line 114, in runAsyncCommand
> File "/OE/bitbake/lib/bb/cooker.py", line 1605, in updateCache
> File "/OE/bitbake/lib/bb/cooker.py", line 2087, in __init__
> File "/OE/bitbake/lib/bb/cooker.py", line 2113, in start
> File "/usr/lib/python3.8/multiprocessing/process.py", line 121, in start
> File "/usr/lib/python3.8/multiprocessing/context.py", line 224, in _Popen
> File "/usr/lib/python3.8/multiprocessing/context.py", line 277, in _Popen
> File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 19, in
> __init__
> File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 69, in
> _launch
> OSError: [Errno 24] Too many open files
>
>
> Summary: There were 2 ERROR messages shown, returning a non-zero exit code.
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> NOTE: Reconnecting to bitbake server...
> NOTE: No reply from server in 30s
> NOTE: Retrying server connection (#1)...
>
> On this builder I was using:
> BB_SERVER_TIMEOUT = "60"
> but that doesn't seem to be required to reproduce as the other builds I've
> seen stuck on jenkins weren't setting BB_SERVER_TIMEOUT at all.
>
> Let me know if there is something else I should try next time it gets
> stuck, but right now
> I'm not able to reliably reproduce it again (even after switching back to
> default BB_NUMBER_PARSE_THREADS)
>
> Cheers,
> >
> > Cheers,
> >
> > Richard
> >
>
>
>
>
[-- Attachment #2: Type: text/html, Size: 65751 bytes --]
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-31 13:10 ` Martin Jansa
2021-02-01 14:26 ` Anibal Limon
@ 2021-02-01 20:21 ` Richard Purdie
2021-02-01 20:44 ` Martin Jansa
1 sibling, 1 reply; 23+ messages in thread
From: Richard Purdie @ 2021-02-01 20:21 UTC (permalink / raw)
To: Martin Jansa, Joshua Watt; +Cc: Patches and discussions about the oe-core layer
On Sun, 2021-01-31 at 14:10 +0100, Martin Jansa wrote:
> On Sun, Jan 31, 2021 at 10:34:48AM +0000, Richard Purdie wrote:
> > Its the first time I've heard a report of that and it sounds a little
> > worrying. What you say stuck, bitbake hangs? Is it using cpu? A process
> > tree of what it looks like when stuck would be interesting if it is
> > hanging and maybe the last things in any running or just finished task
> > logs. It could be some issue with the way a failing task is handled?
> >
> > We've seen a lot of weird issues on the autobuilder but not that. Could
> > you have something enabled in your setup for logging/reporting whch
> > wouldn't be in ours and could be causing it?
>
> It doesn't seem to happen very often and I guess autobuilder doesn't
> include meta-python2 (which is currently the only reproducer in my list
> of layers).
We don't use meta-python2 on the autobuilder so that could explain why
we've not seen this.
> I've tried to reproduce it with just 3 layers included:
> BBLAYERS = " \
> /OE/build/oe-core/meta-python2 \
> /OE/build/oe-core/meta-openembedded/meta-oe \
> /OE/build/oe-core/openembedded-core/meta \
> "
>
> and it happened on 3rd try (cache, tmpdir, sstate-cache were removed
> only before 1st try)
>
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> Loading cache: 100% | | ETA: --:--:--
> Loaded 0 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA Issue: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being package specific, please fix this. [pkgvarcheck]
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb | ETA: 0:00:14
>
> Summary: There were 3 ERROR messages shown, returning a non-zero exit code.
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> NOTE: Reconnecting to bitbake server...
> Loading cache: 100% |###################################################################################################################################################################################################################################| Time: 0:00:00
> Loaded 845 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb: Error executing a python function in <code>: | ETA: 0:01:10
>
> The stack trace of python calls that resulted in this exception/failure was:
> File: '<code>', lineno: 14, function: <module>
> 0010:__anon_35__OE_build_oe_core_openembedded_core_meta_classes_devshell_bbclass(d)
> 0011:__anon_151__OE_build_oe_core_openembedded_core_meta_classes_sstate_bbclass(d)
> 0012:__anon_20__OE_build_oe_core_openembedded_core_meta_classes_blacklist_bbclass(d)
> 0013:__anon_177__OE_build_oe_core_openembedded_core_meta_classes_siteinfo_bbclass(d)
> *** 0014:__anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb(d)
> File: '/OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb', lineno: 76, function: __anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb
> 0072: manifest_file.seek(json_start)
> 0073: manifest_str = manifest_file.read()
> 0074: python_manifest = json.loads(manifest_str)
> 0075:
> *** 0076: rprovides = d.getVar('RPROVIDES').split()
> 0077:
> 0078: # Hardcoded since it cant be python-native-foo, should be python-foo-native
> 0079: pn = 'python'
> 0080:
> Exception: AttributeError: 'NoneType' object has no attribute 'split'
This sounds like a similar issue to the one I fixed in the python3
recipe:
http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=cff7db890cdfab41cc8f74e3dc378660d9b6219e
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA Issue: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being package specific, please fix this. [pkgvarcheck]
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb | ETA: 0:00:30
Which makes me wonder whether the real issue is a bug in bitbake when
parsing fails. We did have an issue like that a while back but I
thought it was fixed by changes both Joshua and I made.
> Summary: There were 4 ERROR messages shown, returning a non-zero exit code.
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> NOTE: Reconnecting to bitbake server...
> Loading cache: 100% |###################################################################################################################################################################################################################################| Time: 0:00:00
> Loaded 1289 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA Issue: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being package specific, please fix this. [pkgvarcheck]
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb
>
> and here it's stuck for around 1 hour, bitbake using very little cpu.
>
> martin@jama:~$ ps aux | grep bitbake
> martin 372784 0.0 0.0 11552 884 pts/1 S+ 13:43 0:00 grep --color=auto bitbake
> martin 928962 0.1 0.1 219204 133704 ? Sl 12:42 0:04 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 943698 0.0 0.0 119900 29928 pts/8 Sl+ 12:43 0:01 python3 /OE/build/oe-core/bitbake/bin/bitbake -k python-native
> martin 945507 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945528 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945532 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945563 0.0 0.0 214364 124732 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945577 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945621 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945632 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945643 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945653 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945669 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945685 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945703 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945736 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945753 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945774 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945778 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945819 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945839 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945860 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945878 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945894 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945909 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945915 0.0 0.0 214364 124804 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945929 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945950 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945953 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945964 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945966 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 945989 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946005 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946016 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946037 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946038 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946064 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946068 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946080 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946103 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946109 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946122 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946135 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946137 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946152 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946167 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946168 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946185 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946197 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946214 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946228 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946243 0.0 0.0 214364 124728 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946249 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946265 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946298 0.0 0.0 214364 124740 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946345 0.0 0.0 214364 124736 ? Sl 12:43 0:01 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946364 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946386 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946389 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946405 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946410 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946442 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946458 0.0 0.0 214364 124612 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946463 0.0 0.0 214364 124652 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946481 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946501 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin 946518 0.0 0.0 214364 124736 ? Sl 12:43 0:00 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
Something is wrong here as bitbake shouldn't have this number of
processes like this :(
> martin@jama:~$ sudo strace -p 928962
> strace: Process 928962 attached
> wait4(945507,
>
> martin@jama:~$ kill 928962
>
> adds an warning to the stuck build:
>
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> NOTE: Reconnecting to bitbake server...
> Loading cache: 100% |###################################################################################################################################################################################################################################| Time: 0:00:00
> Loaded 1289 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: QA Issue: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being package specific, please fix this. [pkgvarcheck]
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> ERROR: Failed to parse recipe: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-setuptools_42.0.2.bb | ETA: 0:00:50
> WARNING: Cooker received SIGTERM, shutting down...
>
> killing the main process:
> martin@jama:~$ kill 943698
>
> terminates the stuck build, but all bitbake-server processes are left behind.
>
> If I try to kill all remaining bitbake-server processes, then only one is left behind:
> martin 928962 0.1 0.1 285004 137688 ? S 12:42 0:05 bitbake-server /OE/bitbake/bin/bitbake-server decafbad 3 5 /OE/build/oe-core/bitbake-cookerdaemon.log /OE/build/oe-core/bitbake.lock /OE/build/oe-core/bitbake.sock None None 0
> martin@jama:/OE/build/oe-core$ sudo strace -p 928962
> strace: Process 928962 attached
> select(7, [6], [], [], {tv_sec=0, tv_usec=40768}) = 0 (Timeout)
> poll([{fd=7, events=POLLIN}], 1, 0) = 0 (Timeout)
> poll([{fd=8, events=POLLIN}], 1, 0) = 0 (Timeout)
> select(7, [6], [], [], {tv_sec=0, tv_usec=100000}) = 0 (Timeout)
> poll([{fd=7, events=POLLIN}], 1, 0) = 0 (Timeout)
> poll([{fd=8, events=POLLIN}], 1, 0) = 0 (Timeout)
>
> and then it dies as well after a while.
It sounds like the failed parsing is causing the parsing pool to fail
to clean up properly and its hanging at exit. I don't know why :(
> Here is bitbake-cookerdaemon.log, but doesn't look very interesting to me:
You're right, nothing looked untoward there to me either.
>
> It was reproduced on builder with 64 cores.
>
> After changing BB_NUMBER_PARSE_THREADS from default 64 to 10, I
> wasn't able to get bitbake stuck again (in the same setup after
> cleaning cache, tmpdir, sstate again) by calling "bitbake python-
> native" 20+ times.
>
> But after changing BB_NUMBER_PARSE_THREADS to 100 I wasn't able to
> reproduce it again (so maybe 3rd try with the default value was just
> me being lucky to reproduce it).
I think after a certain number of tries, its not hitting the magic
combination where the parse failure breaks the parsing pool.
>
> Then I've tried to change it to 1000, just to see what happens and it got stuck (but probably from different reasons):
>
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> Loading cache: 100% | | ETA: --:--:--
> Loaded 0 entries from dependency cache.
> ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb: Error executing a python function in <code>: | ETA: --:--:--
>
> The stack trace of python calls that resulted in this exception/failure was:
> File: '<code>', lineno: 14, function: <module>
> 0010:__anon_35__OE_build_oe_core_openembedded_core_meta_classes_devshell_bbclass(d)
> 0011:__anon_151__OE_build_oe_core_openembedded_core_meta_classes_sstate_bbclass(d)
> 0012:__anon_20__OE_build_oe_core_openembedded_core_meta_classes_blacklist_bbclass(d)
> 0013:__anon_177__OE_build_oe_core_openembedded_core_meta_classes_siteinfo_bbclass(d)
> *** 0014:__anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb(d)
> File: '/OE/build/oe-core/meta-python2/recipes-devtools/python/python-native_2.7.18.bb', lineno: 76, function: __anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb
> 0072: manifest_file.seek(json_start)
> 0073: manifest_str = manifest_file.read()
> 0074: python_manifest = json.loads(manifest_str)
> 0075:
> *** 0076: rprovides = d.getVar('RPROVIDES').split()
> 0077:
> 0078: # Hardcoded since it cant be python-native-foo, should be python-foo-native
> 0079: pn = 'python'
> 0080:
> Exception: AttributeError: 'NoneType' object has no attribute 'split'
This one is one of the original errors above and can be fixed with a
patch.
> ERROR: Command execution failed: Traceback (most recent call last):
> File "/OE/bitbake/lib/bb/command.py", line 114, in runAsyncCommand
> File "/OE/bitbake/lib/bb/cooker.py", line 1605, in updateCache
> File "/OE/bitbake/lib/bb/cooker.py", line 2087, in __init__
> File "/OE/bitbake/lib/bb/cooker.py", line 2113, in start
> File "/usr/lib/python3.8/multiprocessing/process.py", line 121, in start
> File "/usr/lib/python3.8/multiprocessing/context.py", line 224, in _Popen
> File "/usr/lib/python3.8/multiprocessing/context.py", line 277, in _Popen
> File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
> File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 69, in _launch
> OSError: [Errno 24] Too many open files
This one is as it says, you exceeded the resource limits, so yes, it is
unrelated.
> Summary: There were 2 ERROR messages shown, returning a non-zero exit code.
> martin@jama:/OE/build/oe-core$ bitbake -k python-native
> NOTE: Reconnecting to bitbake server...
> NOTE: No reply from server in 30s
> NOTE: Retrying server connection (#1)...
>
> On this builder I was using:
> BB_SERVER_TIMEOUT = "60"
> but that doesn't seem to be required to reproduce as the other builds I've seen
> stuck on jenkins weren't setting BB_SERVER_TIMEOUT at all.
That did at least explain some of the logs as I was wondering!
BB_SERVER_TIMEOUT being set is known to cause problems on the
autobuilders too, we've not been able to adopt it yet. I believe we
opened bugs for the issues although I'm blanking on what they were
right now.
> Let me know if there is something else I should try next time it gets
> stuck, but right now
> I'm not able to reliably reproduce it again (even after switching
> back to default BB_NUMBER_PARSE_THREADS)
I think the reproducer will be some combination of parsing failures and
a need to parse a larger number of recipes. I will give debug some
further thought, I'm not entirely sure how to proceed on this one at
the moment :/.
I suspect if you're not hitting parse failures, things will calm down
though.
Cheers,
Richard
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-02-01 20:21 ` Richard Purdie
@ 2021-02-01 20:44 ` Martin Jansa
0 siblings, 0 replies; 23+ messages in thread
From: Martin Jansa @ 2021-02-01 20:44 UTC (permalink / raw)
To: Richard Purdie
Cc: Joshua Watt, Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 7077 bytes --]
On Mon, Feb 1, 2021 at 9:21 PM Richard Purdie <
richard.purdie@linuxfoundation.org> wrote:
> On Sun, 2021-01-31 at 14:10 +0100, Martin Jansa wrote:
> > On Sun, Jan 31, 2021 at 10:34:48AM +0000, Richard Purdie wrote:
> > > Its the first time I've heard a report of that and it sounds a little
> > > worrying. What you say stuck, bitbake hangs? Is it using cpu? A process
> > > tree of what it looks like when stuck would be interesting if it is
> > > hanging and maybe the last things in any running or just finished task
> > > logs. It could be some issue with the way a failing task is handled?
> > >
> > > We've seen a lot of weird issues on the autobuilder but not that. Could
> > > you have something enabled in your setup for logging/reporting whch
> > > wouldn't be in ours and could be causing it?
> >
> > It doesn't seem to happen very often and I guess autobuilder doesn't
> > include meta-python2 (which is currently the only reproducer in my list
> > of layers).
>
> We don't use meta-python2 on the autobuilder so that could explain why
> we've not seen this.
>
> > I've tried to reproduce it with just 3 layers included:
> > BBLAYERS = " \
> > /OE/build/oe-core/meta-python2 \
> > /OE/build/oe-core/meta-openembedded/meta-oe \
> > /OE/build/oe-core/openembedded-core/meta \
> > "
> >
> > and it happened on 3rd try (cache, tmpdir, sstate-cache were removed
> > only before 1st try)
> >
> > martin@jama:/OE/build/oe-core$ bitbake -k python-native
> > Loading cache: 100% |
>
>
> | ETA: --:--:--
> > Loaded 0 entries from dependency cache.
> > ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: QA Issue:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being
> package specific, please fix this. [pkgvarcheck]
> > ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> > ERROR: Failed to parse recipe:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb
>
> | ETA: 0:00:14
> >
> > Summary: There were 3 ERROR messages shown, returning a non-zero exit
> code.
> > martin@jama:/OE/build/oe-core$ bitbake -k python-native
> > NOTE: Reconnecting to bitbake server...
> > Loading cache: 100%
> |###################################################################################################################################################################################################################################|
> Time: 0:00:00
> > Loaded 845 entries from dependency cache.
> > ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-native_2.7.18.bb: Error executing a python function in <code>:
>
> | ETA: 0:01:10
> >
> > The stack trace of python calls that resulted in this exception/failure
> was:
> > File: '<code>', lineno: 14, function: <module>
> >
> 0010:__anon_35__OE_build_oe_core_openembedded_core_meta_classes_devshell_bbclass(d)
> >
> 0011:__anon_151__OE_build_oe_core_openembedded_core_meta_classes_sstate_bbclass(d)
> >
> 0012:__anon_20__OE_build_oe_core_openembedded_core_meta_classes_blacklist_bbclass(d)
> >
> 0013:__anon_177__OE_build_oe_core_openembedded_core_meta_classes_siteinfo_bbclass(d)
> > ***
> 0014:__anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb(d)
> > File: '/OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-native_2.7.18.bb', lineno: 76, function:
> __anon_90__OE_build_oe_core_meta_python2_recipes_devtools_python_python_native_2_7_18_bb
> > 0072: manifest_file.seek(json_start)
> > 0073: manifest_str = manifest_file.read()
> > 0074: python_manifest = json.loads(manifest_str)
> > 0075:
> > *** 0076: rprovides = d.getVar('RPROVIDES').split()
> > 0077:
> > 0078: # Hardcoded since it cant be python-native-foo, should be
> python-foo-native
> > 0079: pn = 'python'
> > 0080:
> > Exception: AttributeError: 'NoneType' object has no attribute 'split'
>
> This sounds like a similar issue to the one I fixed in the python3
> recipe:
>
>
> http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=cff7db890cdfab41cc8f74e3dc378660d9b6219e
Yes, I've already sent similar patch for meta-python2 yesterday (and today
asked for write access again as last e-mail from Tim clearly said he
doesn't want to maintain it anymore)
> > ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: QA Issue:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Variable RPROVIDES is set as not being
> package specific, please fix this. [pkgvarcheck]
> > ERROR: /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-setuptools_42.0.2.bb: Fatal QA errors found, failing task.
> > ERROR: Failed to parse recipe:
> /OE/build/oe-core/meta-python2/recipes-devtools/python/
> python-native_2.7.18.bb
>
> | ETA: 0:00:30
>
> Which makes me wonder whether the real issue is a bug in bitbake when
> parsing fails. We did have an issue like that a while back but I
> thought it was fixed by changes both Joshua and I made.
>
> It sounds like the failed parsing is causing the parsing pool to fail
> to clean up properly and its hanging at exit. I don't know why :(
>
> I think after a certain number of tries, its not hitting the magic
> combination where the parse failure breaks the parsing pool.
>
>
> I think the reproducer will be some combination of parsing failures and
> a need to parse a larger number of recipes. I will give debug some
> further thought, I'm not entirely sure how to proceed on this one at
> the moment :/.
>
> I suspect if you're not hitting parse failures, things will calm down
> though.
>
Yes, I'm sorry if I wasn't clear, all these meta-python2 issues I've
mentioned are easy to fix and I already did (based on your changes in
oe-core), they were shown just as a case which sometimes leads to bitbake
to gettting stuck, with both fixes applied in meta-python2 I haven't
noticed bitbake getting stuck (with latest oe-core + bitbake).
In dunfell based builds I quite often see builds getting stuck on jenkins,
usually after parsing error caused by bad SRCREV (developers use reference
to gerrit review like SRCREV_pn-foo = "refs/changes/59/295159/96" but then
trigger many verification builds with it which include some builds where
foo's SRC_URI points to different repository
where refs/changes/59/295159/96 doesn't exit and git ls-remote fails during
"foo" parsing. But again this might be just the huge number of dunfell
builds we do with similar overrides and the root cause for getting stuck
might be the same as what we're seeing now with this meta-python2 in master.
Cheers,
[-- Attachment #2: Type: text/html, Size: 10167 bytes --]
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-01-27 17:27 ` [PATCH 6/7] native: Stop clearing PACKAGES Richard Purdie
2021-01-30 16:15 ` [OE-core] " Martin Jansa
@ 2021-02-04 19:43 ` Peter Kjellerstedt
2021-02-04 20:34 ` Richard Purdie
1 sibling, 1 reply; 23+ messages in thread
From: Peter Kjellerstedt @ 2021-02-04 19:43 UTC (permalink / raw)
To: Richard Purdie, openembedded-core
> -----Original Message-----
> From: openembedded-core@lists.openembedded.org <openembedded-
> core@lists.openembedded.org> On Behalf Of Richard Purdie
> Sent: den 27 januari 2021 18:28
> To: openembedded-core@lists.openembedded.org
> Subject: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
>
> Native recipes have been special and they don't have packages generated
> from them. The RDEPENDS/RPROVIDES and other runtime package specific
> variables can contain important data about dependencies recipes need
> though and currently it is required to write this information explicitly
> in the native case.
>
> We now delete the packaging tasks for native recipes which removes the
> need to clear PACKAGES. The next step to improve the metadata is to
> stop clearing it and ensure any entries in these variables are remapped
> appropriately. The R* variables were already being processed by the class
> extension code but the implementation was suboptimal.
>
> This patch stops clearing PACKAGES and PACKAGES_DYNAMIC and fixes the
> places
> where that caused issues in OE-Core, for example PACKAGES additions in
> anonymous
> python without the "-native" suffix and a case where the included classes
> caused a self reference in DEPENDS which would once have been removed by
> the previous code.
>
> The implementation uses datastore/parser parameters to ensure that the
> variable overrides are not overwritten when calling setVar which is
> appropriate
> for a function as close to the core as this one is.
>
> Some now unneeded code in python3-setuptools is dropped, there are
> further
> changes like this which can follow.
>
> This change was verified with OE-Core by comparing task-depends.dot
> generated
> by "bitbake world -g" before and after the change, the files were
> identical.
>
> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> ---
> meta/classes/native.bbclass | 23 ++++++++-----------
> .../python/python3-setuptools_51.0.0.bb | 5 ----
> .../gdk-pixbuf/gdk-pixbuf_2.40.0.bb | 1 +
> meta/recipes-support/boost/boost.inc | 3 +++
> 4 files changed, 13 insertions(+), 19 deletions(-)
>
[cut]
> diff --git a/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb b/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
> index 16708fd581d..226e1c7b89f 100644
> --- a/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
> +++ b/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
> @@ -13,6 +13,7 @@ LIC_FILES_CHKSUM = "file://COPYING;md5=4fbd65380cdd255951079008b364516c \
> SECTION = "libs"
>
> DEPENDS = "glib-2.0 gdk-pixbuf-native shared-mime-info"
> +DEPENDS_remove_class-native = "gdk-pixbuf-native"
Given that I know you want to avoid using _remove in OE-Core, is there
any reason to not write this as:
DEPENDS = "glib-2.0 shared-mime-info"
DEPENDS_append_class-target = " gdk-pixbuf-native"
DEPENDS_append_class-nativesdk = " gdk-pixbuf-native"
(I'm not sure the append for nativesdk should be there, but I added it
to match the original code.)
>
> MAJ_VER = "${@oe.utils.trim_version("${PV}", 2)}"
>
//Peter
^ permalink raw reply [flat|nested] 23+ messages in thread
* Re: [OE-core] [PATCH 6/7] native: Stop clearing PACKAGES
2021-02-04 19:43 ` Peter Kjellerstedt
@ 2021-02-04 20:34 ` Richard Purdie
0 siblings, 0 replies; 23+ messages in thread
From: Richard Purdie @ 2021-02-04 20:34 UTC (permalink / raw)
To: Peter Kjellerstedt, openembedded-core
On Thu, 2021-02-04 at 19:43 +0000, Peter Kjellerstedt wrote:
>
>
> > diff --git a/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
> > b/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
> > index 16708fd581d..226e1c7b89f 100644
> > --- a/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
> > +++ b/meta/recipes-gnome/gdk-pixbuf/gdk-pixbuf_2.40.0.bb
> > @@ -13,6 +13,7 @@ LIC_FILES_CHKSUM = "
> > file://COPYING;md5=4fbd65380cdd255951079008b364516c \
> > SECTION = "libs"
> >
> > DEPENDS = "glib-2.0 gdk-pixbuf-native shared-mime-info"
> > +DEPENDS_remove_class-native = "gdk-pixbuf-native"
>
> Given that I know you want to avoid using _remove in OE-Core, is
> there
> any reason to not write this as:
>
> DEPENDS = "glib-2.0 shared-mime-info"
> DEPENDS_append_class-target = " gdk-pixbuf-native"
> DEPENDS_append_class-nativesdk = " gdk-pixbuf-native"
That would be better, yes. I'll admit with this series I was dealing
with a lot of weird issues so the end result still could use some
improvement. There are probably a few places in the metadata we could
improve now.
> (I'm not sure the append for nativesdk should be there, but I added
> it to match the original code.)
I'd suspect the nativesdk is needed.
Cheers,
Richard
^ permalink raw reply [flat|nested] 23+ messages in thread
end of thread, other threads:[~2021-02-04 20:34 UTC | newest]
Thread overview: 23+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-01-27 17:27 [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Richard Purdie
2021-01-27 17:27 ` [PATCH 2/7] python3: Avoid installing test data into recipe-sysroot Richard Purdie
2021-01-27 17:27 ` [PATCH 3/7] staging: Clean up files installed into the sysroot Richard Purdie
2021-01-27 17:27 ` [PATCH 4/7] gobject-introspection: Fix variable override order Richard Purdie
2021-01-27 17:27 ` [PATCH 5/7] bitbake.conf/python: Drop setting RDEPENDS/RPROVIDES default Richard Purdie
2021-01-27 17:27 ` [PATCH 6/7] native: Stop clearing PACKAGES Richard Purdie
2021-01-30 16:15 ` [OE-core] " Martin Jansa
2021-01-31 9:07 ` Richard Purdie
2021-01-31 9:55 ` Martin Jansa
2021-01-31 10:34 ` Richard Purdie
2021-01-31 13:10 ` Martin Jansa
2021-02-01 14:26 ` Anibal Limon
2021-02-01 20:21 ` Richard Purdie
2021-02-01 20:44 ` Martin Jansa
2021-02-04 19:43 ` Peter Kjellerstedt
2021-02-04 20:34 ` Richard Purdie
2021-01-27 17:27 ` [PATCH 7/7] meta: Clean up various class-native* RDEPENDS overrides Richard Purdie
2021-01-28 8:45 ` [OE-core] [PATCH 1/7] ncurses: Don't put terminfo into the sysroot Mikko Rapeli
2021-01-28 9:02 ` Richard Purdie
2021-01-28 10:35 ` Mikko Rapeli
2021-01-28 10:52 ` Richard Purdie
2021-01-28 16:38 ` Richard Purdie
2021-01-29 8:28 ` Mikko Rapeli
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.