* glibc-testsuite-2.33-r0 do_populate_sysroot: Error executing a python function in exec_python_func() autogenerated:
@ 2021-07-04 11:20 Vinay Kumar
2021-07-04 11:21 ` [PATCH] glibc-package.inc: To fix build issue with glibc-testsuite Vinay Kumar
0 siblings, 1 reply; 5+ messages in thread
From: Vinay Kumar @ 2021-07-04 11:20 UTC (permalink / raw)
To: Richard Purdie, Patches and discussions about the oe-core layer
Cc: Randy MacLeod, umesh kalappa0, shivahms
[-- Attachment #1: Type: text/plain, Size: 283 bytes --]
Hi Richard,
Getting error with "MACHINE=qemuarm bitbake glibc-testsuite" on poky
master branch with below commit id.
http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=e14c2a4986242d2a2c0eb070d4be550c56a3dded
Attached error log for your reference.
Regards,
Vinay
[-- Attachment #2: log.do_populate_sysroot.129678 --]
[-- Type: application/octet-stream, Size: 5718 bytes --]
DEBUG: Executing python function sstate_task_prefunc
DEBUG: Python function sstate_task_prefunc finished
DEBUG: Executing python function extend_recipe_sysroot
NOTE: Direct dependencies are ['/ala-lpggp31/vinay/tcwrlgcc-399/poky/meta/recipes-devtools/binutils/binutils-cross_2.36.bb:do_populate_sysroot']
NOTE: Installed into sysroot: ['binutils-cross-arm', 'quilt-native', 'gnu-config-native', 'zlib-native', 'flex-native', 'autoconf-native', 'texinfo-dummy-native', 'xz-native', 'gettext-minimal-native', 'libtool-native', 'automake-native', 'm4-native']
NOTE: Skipping as already exists in sysroot: []
DEBUG: sed -e 's:^[^/]*/:/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/recipe-sysroot-native/:g' /ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/sysroots-components/x86_64/quilt-native/fixmepath /ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/sysroots-components/x86_64/gnu-config-native/fixmepath /ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/sysroots-components/x86_64/autoconf-native/fixmepath /ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/sysroots-components/x86_64/libtool-native/fixmepath /ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/sysroots-components/x86_64/automake-native/fixmepath | xargs sed -i -e 's:FIXMESTAGINGDIRTARGET:/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/recipe-sysroot:g; s:FIXMESTAGINGDIRHOST:/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/recipe-sysroot-native:g' -e 's:FIXME_PSEUDO_SYSROOT:/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/sysroots-components/x86_64/pseudo-native:g' -e 's:FIXME_HOSTTOOLS_DIR:/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/hosttools:g' -e 's:FIXME_PKGDATA_DIR:/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/pkgdata/qemuarm:g' -e 's:FIXME_PSEUDO_LOCALSTATEDIR:/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/pseudo/:g' -e 's:FIXME_LOGFIFO:/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/temp/fifo.129678:g'
DEBUG: Python function extend_recipe_sysroot finished
DEBUG: Executing python function do_populate_sysroot
DEBUG: Executing shell function sysroot_stage_all
DEBUG: Shell function sysroot_stage_all finished
DEBUG: Executing python function sysroot_strip
DEBUG: Python function sysroot_strip finished
DEBUG: Executing shell function stash_locale_sysroot_cleanup
rmdir: failed to remove '/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/sysroot-destdir/usr/share': No such file or directory
WARNING: exit code 1 from a shell command.
ERROR: Error executing a python function in exec_python_func() autogenerated:
The stack trace of python calls that resulted in this exception/failure was:
File: 'exec_python_func() autogenerated', lineno: 2, function: <module>
0001:
*** 0002:do_populate_sysroot(d)
0003:
File: '/ala-lpggp31/vinay/tcwrlgcc-399/poky/meta/classes/staging.bbclass', lineno: 104, function: do_populate_sysroot
0100: # SYSROOT 'version' 2
0101: bb.build.exec_func("sysroot_stage_all", d)
0102: bb.build.exec_func("sysroot_strip", d)
0103: for f in (d.getVar('SYSROOT_PREPROCESS_FUNCS') or '').split():
*** 0104: bb.build.exec_func(f, d)
0105: pn = d.getVar("PN")
0106: multiprov = d.getVar("MULTI_PROVIDER_WHITELIST").split()
0107: provdir = d.expand("${SYSROOT_DESTDIR}${base_prefix}/sysroot-providers/")
0108: bb.utils.mkdirhier(provdir)
File: '/ala-lpggp31/vinay/tcwrlgcc-399/poky/bitbake/lib/bb/build.py', lineno: 256, function: exec_func
0252: with bb.utils.fileslocked(lockfiles):
0253: if ispython:
0254: exec_func_python(func, d, runfile, cwd=adir)
0255: else:
*** 0256: exec_func_shell(func, d, runfile, cwd=adir)
0257:
0258: try:
0259: curcwd = os.getcwd()
0260: except:
File: '/ala-lpggp31/vinay/tcwrlgcc-399/poky/bitbake/lib/bb/build.py', lineno: 503, function: exec_func_shell
0499: with open(fifopath, 'r+b', buffering=0) as fifo:
0500: try:
0501: bb.debug(2, "Executing shell function %s" % func)
0502: with open(os.devnull, 'r+') as stdin, logfile:
*** 0503: bb.process.run(cmd, shell=False, stdin=stdin, log=logfile, extrafiles=[(fifo,readfifo)])
0504: except bb.process.ExecutionError as exe:
0505: # Find the backtrace that the shell trap generated
0506: backtrace_marker_regex = re.compile(r"WARNING: Backtrace \(BB generated script\)")
0507: stdout_lines = (exe.stdout or "").split("\n")
File: '/ala-lpggp31/vinay/tcwrlgcc-399/poky/bitbake/lib/bb/process.py', lineno: 184, function: run
0180: if not stderr is None:
0181: stderr = stderr.decode("utf-8")
0182:
0183: if pipe.returncode != 0:
*** 0184: raise ExecutionError(cmd, pipe.returncode, stdout, stderr)
0185: return stdout, stderr
Exception: bb.process.ExecutionError: Execution of '/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/temp/run.stash_locale_sysroot_cleanup.129678' failed with exit code 1:
rmdir: failed to remove '/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/sysroot-destdir/usr/share': No such file or directory
WARNING: exit code 1 from a shell command.
DEBUG: Python function do_populate_sysroot finished
^ permalink raw reply [flat|nested] 5+ messages in thread
* [PATCH] glibc-package.inc: To fix build issue with glibc-testsuite.
2021-07-04 11:20 glibc-testsuite-2.33-r0 do_populate_sysroot: Error executing a python function in exec_python_func() autogenerated: Vinay Kumar
@ 2021-07-04 11:21 ` Vinay Kumar
2021-07-04 17:03 ` [OE-core] " Alexander Kanavin
2021-07-07 10:23 ` Richard Purdie
0 siblings, 2 replies; 5+ messages in thread
From: Vinay Kumar @ 2021-07-04 11:21 UTC (permalink / raw)
To: richard.purdie, openembedded-core
Cc: rwmacleod, umesh.kalappa0, vinay.kumar, Vinay Kumar
Added condition to check "$cleanupdir${datadir}" exists.
Signed-off-by: Vinay Kumar <vinay.m.engg@gmail.com>
---
meta/recipes-core/glibc/glibc-package.inc | 2 ++
1 file changed, 2 insertions(+)
diff --git a/meta/recipes-core/glibc/glibc-package.inc b/meta/recipes-core/glibc/glibc-package.inc
index 92e5dbac61..df3f612192 100644
--- a/meta/recipes-core/glibc/glibc-package.inc
+++ b/meta/recipes-core/glibc/glibc-package.inc
@@ -230,7 +230,9 @@ stash_locale_cleanup () {
rm -rf $cleanupdir${libdir}/gconv
rm -rf $cleanupdir${localedir}
rm -rf $cleanupdir${datadir}/locale
+ if [ -d $cleanupdir${datadir} ]; then
rmdir --ignore-fail-on-non-empty $cleanupdir${datadir}
+ fi;
if [ "${libdir}" != "${exec_prefix}/lib" ] && [ "${root_prefix}/lib" != "${exec_prefix}/lib" ]; then
if [ -d "$cleanupdir${exec_prefix}/lib" ]; then
--
2.31.1
^ permalink raw reply related [flat|nested] 5+ messages in thread
* Re: [OE-core] [PATCH] glibc-package.inc: To fix build issue with glibc-testsuite.
2021-07-04 11:21 ` [PATCH] glibc-package.inc: To fix build issue with glibc-testsuite Vinay Kumar
@ 2021-07-04 17:03 ` Alexander Kanavin
2021-07-05 8:47 ` Vinay Kumar
2021-07-07 10:23 ` Richard Purdie
1 sibling, 1 reply; 5+ messages in thread
From: Alexander Kanavin @ 2021-07-04 17:03 UTC (permalink / raw)
To: Vinay Kumar
Cc: Richard Purdie, OE-core, Randy MacLeod, umesh kalappa0, vinay.kumar
[-- Attachment #1: Type: text/plain, Size: 1264 bytes --]
This looks like a workaround that does not fix the actual issue. Can you
please look into what is causing the failure, if it is reproducible
reliably, and at which point it regressed?
Alex
Alex
On Sun, 4 Jul 2021 at 13:22, Vinay Kumar <vinay.m.engg@gmail.com> wrote:
> Added condition to check "$cleanupdir${datadir}" exists.
>
> Signed-off-by: Vinay Kumar <vinay.m.engg@gmail.com>
> ---
> meta/recipes-core/glibc/glibc-package.inc | 2 ++
> 1 file changed, 2 insertions(+)
>
> diff --git a/meta/recipes-core/glibc/glibc-package.inc
> b/meta/recipes-core/glibc/glibc-package.inc
> index 92e5dbac61..df3f612192 100644
> --- a/meta/recipes-core/glibc/glibc-package.inc
> +++ b/meta/recipes-core/glibc/glibc-package.inc
> @@ -230,7 +230,9 @@ stash_locale_cleanup () {
> rm -rf $cleanupdir${libdir}/gconv
> rm -rf $cleanupdir${localedir}
> rm -rf $cleanupdir${datadir}/locale
> + if [ -d $cleanupdir${datadir} ]; then
> rmdir --ignore-fail-on-non-empty $cleanupdir${datadir}
> + fi;
>
> if [ "${libdir}" != "${exec_prefix}/lib" ] && [
> "${root_prefix}/lib" != "${exec_prefix}/lib" ]; then
> if [ -d "$cleanupdir${exec_prefix}/lib" ]; then
> --
> 2.31.1
>
>
>
>
>
[-- Attachment #2: Type: text/html, Size: 1821 bytes --]
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [OE-core] [PATCH] glibc-package.inc: To fix build issue with glibc-testsuite.
2021-07-04 17:03 ` [OE-core] " Alexander Kanavin
@ 2021-07-05 8:47 ` Vinay Kumar
0 siblings, 0 replies; 5+ messages in thread
From: Vinay Kumar @ 2021-07-05 8:47 UTC (permalink / raw)
To: Alexander Kanavin
Cc: Richard Purdie, OE-core, Randy MacLeod, umesh kalappa0, vinay.kumar
Hi Alex,
Here is my analysis,
$bitbake -e glibc-testsuite
==============================
2 # line: 222, file:
/ala-lpggp31/vinay/tcwrlgcc-399/poky/meta/recipes-core/glibc/glibc-package.inc
3 stash_locale_cleanup() {
4 cleanupdir=$1
5 # Remove all files which do_stash_locale() copies
6 for i in mtrace sotruss xtrace; do
7 rm -f $cleanupdir/usr/bin/$i
8 done
9 rm -f $cleanupdir/usr/bin/localedef
10 rm -rf $cleanupdir/usr/share/i18n
11 rm -rf $cleanupdir/usr/lib/gconv
12 rm -rf $cleanupdir/usr/lib/locale
13 rm -rf $cleanupdir/usr/share/locale
14 rmdir --ignore-fail-on-non-empty $cleanupdir/usr/share
15
16 if [ "/usr/lib" != "/usr/lib" ] && [ "/lib" != "/usr/lib" ]; then
17 if [ -d "$cleanupdir/usr/lib" ]; then
18 if [ -z "" -o \
19 ! -e "$cleanupdir/usr/lib/" ]; then
20 # error out if directory isn't empty
21 # this dir should only contain locale dir
22 # which has been deleted in the previous step
23 rmdir $cleanupdir/usr/lib
24 fi
25 fi
26 fi
27 }
28
29 # line: 251, file:
/ala-lpggp31/vinay/tcwrlgcc-399/poky/meta/recipes-core/glibc/glibc-package.inc
30 stash_locale_package_cleanup() {
31 stash_locale_cleanup
/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/package
32 }
33
34 # line: 248, file:
/ala-lpggp31/vinay/tcwrlgcc-399/poky/meta/recipes-core/glibc/glibc-package.inc
35 stash_locale_sysroot_cleanup() {
36 stash_locale_cleanup
/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/sysroot-destdir
37 }
==============================
Its trying to remove "usr/share" at
"bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/sysroot-destdir"
which does not exists in glibc-testsuite case.
Contents of "bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc-testsuite/2.33-r0/sysroot-destdir"
are
"sysroot-providers/glibc-testsuite"
$bitbake -e glibc
==============================
19167 # line: 222, file:
/ala-lpggp31/vinay/tcwrlgcc-399/poky/meta/recipes-core/glibc/glibc-package.inc
1 stash_locale_cleanup() {
2 cleanupdir=$1
3 # Remove all files which do_stash_locale() copies
4 for i in mtrace sotruss xtrace; do
5 rm -f $cleanupdir/usr/bin/$i
6 done
7 rm -f $cleanupdir/usr/bin/localedef
8 rm -rf $cleanupdir/usr/share/i18n
9 rm -rf $cleanupdir/usr/lib/gconv
10 rm -rf $cleanupdir/usr/lib/locale
11 rm -rf $cleanupdir/usr/share/locale
12 rmdir --ignore-fail-on-non-empty $cleanupdir/usr/share
13
14 if [ "/usr/lib" != "/usr/lib" ] && [ "/lib" != "/usr/lib" ]; then
15 if [ -d "$cleanupdir/usr/lib" ]; then
16 if [ -z "" -o \
17 ! -e "$cleanupdir/usr/lib/" ]; then
18 # error out if directory isn't empty
19 # this dir should only contain locale dir
20 # which has been deleted in the previous step
21 rmdir $cleanupdir/usr/lib
22 fi
23 fi
24 fi
25 }
26
27 # line: 251, file:
/ala-lpggp31/vinay/tcwrlgcc-399/poky/meta/recipes-core/glibc/glibc-package.inc
28 stash_locale_package_cleanup() {
29 stash_locale_cleanup
/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc/2.33-r0/package
30 }
31
32 # line: 248, file:
/ala-lpggp31/vinay/tcwrlgcc-399/poky/meta/recipes-core/glibc/glibc-package.inc
33 stash_locale_sysroot_cleanup() {
34 stash_locale_cleanup
/ala-lpggp31/vinay/tcwrlgcc-399/bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc/2.33-r0/sysroot-destdir
35 }
==============================
In case of "bitbake glibc" the same "usr/share" directory exists at
"bld-arm/tmp/work/armv7vet2hf-neon-poky-linux-gnueabi/glibc/2.33-r0/sysroot-destdir/"
so
no error occurs.
Regards,
Vinay
On Sun, Jul 4, 2021 at 10:33 PM Alexander Kanavin
<alex.kanavin@gmail.com> wrote:
>
> This looks like a workaround that does not fix the actual issue. Can you please look into what is causing the failure, if it is reproducible reliably, and at which point it regressed?
>
> Alex
>
> Alex
>
> On Sun, 4 Jul 2021 at 13:22, Vinay Kumar <vinay.m.engg@gmail.com> wrote:
>>
>> Added condition to check "$cleanupdir${datadir}" exists.
>>
>> Signed-off-by: Vinay Kumar <vinay.m.engg@gmail.com>
>> ---
>> meta/recipes-core/glibc/glibc-package.inc | 2 ++
>> 1 file changed, 2 insertions(+)
>>
>> diff --git a/meta/recipes-core/glibc/glibc-package.inc b/meta/recipes-core/glibc/glibc-package.inc
>> index 92e5dbac61..df3f612192 100644
>> --- a/meta/recipes-core/glibc/glibc-package.inc
>> +++ b/meta/recipes-core/glibc/glibc-package.inc
>> @@ -230,7 +230,9 @@ stash_locale_cleanup () {
>> rm -rf $cleanupdir${libdir}/gconv
>> rm -rf $cleanupdir${localedir}
>> rm -rf $cleanupdir${datadir}/locale
>> + if [ -d $cleanupdir${datadir} ]; then
>> rmdir --ignore-fail-on-non-empty $cleanupdir${datadir}
>> + fi;
>>
>> if [ "${libdir}" != "${exec_prefix}/lib" ] && [ "${root_prefix}/lib" != "${exec_prefix}/lib" ]; then
>> if [ -d "$cleanupdir${exec_prefix}/lib" ]; then
>> --
>> 2.31.1
>>
>>
>>
>>
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH] glibc-package.inc: To fix build issue with glibc-testsuite.
2021-07-04 11:21 ` [PATCH] glibc-package.inc: To fix build issue with glibc-testsuite Vinay Kumar
2021-07-04 17:03 ` [OE-core] " Alexander Kanavin
@ 2021-07-07 10:23 ` Richard Purdie
1 sibling, 0 replies; 5+ messages in thread
From: Richard Purdie @ 2021-07-07 10:23 UTC (permalink / raw)
To: Vinay Kumar, openembedded-core, Alexander Kanavin
Cc: rwmacleod, umesh.kalappa0, vinay.kumar
On Sun, 2021-07-04 at 04:21 -0700, Vinay Kumar wrote:
> Added condition to check "$cleanupdir${datadir}" exists.
>
> Signed-off-by: Vinay Kumar <vinay.m.engg@gmail.com>
> ---
> meta/recipes-core/glibc/glibc-package.inc | 2 ++
> 1 file changed, 2 insertions(+)
>
> diff --git a/meta/recipes-core/glibc/glibc-package.inc b/meta/recipes-core/glibc/glibc-package.inc
> index 92e5dbac61..df3f612192 100644
> --- a/meta/recipes-core/glibc/glibc-package.inc
> +++ b/meta/recipes-core/glibc/glibc-package.inc
> @@ -230,7 +230,9 @@ stash_locale_cleanup () {
> rm -rf $cleanupdir${libdir}/gconv
> rm -rf $cleanupdir${localedir}
> rm -rf $cleanupdir${datadir}/locale
> + if [ -d $cleanupdir${datadir} ]; then
> rmdir --ignore-fail-on-non-empty $cleanupdir${datadir}
> + fi;
>
>
>
>
> if [ "${libdir}" != "${exec_prefix}/lib" ] && [ "${root_prefix}/lib" != "${exec_prefix}/lib" ]; then
> if [ -d "$cleanupdir${exec_prefix}/lib" ]; then
I had a look into this issue in more detail and you're right, if you
bitbake the recipe it does indeed fail. The reason it doesn't fail
everywhere in testing is that it is excluded from world builds.
Since there is no do_install task, the do_populate_sysroot task
is also pointless. I've sent a patch just to delete the task.
Cheers,
Richard
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2021-07-07 10:23 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-07-04 11:20 glibc-testsuite-2.33-r0 do_populate_sysroot: Error executing a python function in exec_python_func() autogenerated: Vinay Kumar
2021-07-04 11:21 ` [PATCH] glibc-package.inc: To fix build issue with glibc-testsuite Vinay Kumar
2021-07-04 17:03 ` [OE-core] " Alexander Kanavin
2021-07-05 8:47 ` Vinay Kumar
2021-07-07 10:23 ` Richard Purdie
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.