Re: [OE-core] [PATCH] meson.bblcass: Remove empty egg-info directories before running meson

[Alexandre Belloni <alexandre.belloni@bootlin.com>]

Hello Peter,

This causes issues with qemux86-world-alt builds:

https://autobuilder.yoctoproject.org/typhoon/#/builders/108/builds/2232/steps/11/logs/stdio

ERROR: Logfile of failure stored in: /home/pokybuild/yocto-worker/qemux86-world-alt/build/build/tmp/work/core2-64-poky-linux/pango/1.48.10-r0/temp/log.do_configure.24847
Log data follows:
| DEBUG: Executing python function extend_recipe_sysroot
| NOTE: Direct dependencies are ['virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-gnome/gobject-introspection/gobject-introspection_1.70.0.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-gnome/gobject-introspection/gobject-introspection_1.70.0.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/meson/meson_0.59.2.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/python/python3_3.10.0.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/glib-2.0/glib-2.0_2.70.0.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/ninja/ninja_1.10.2.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-graphics/xorg-lib/libxft_2.3.4.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-gnome/gi-docgen/gi-docgen_git.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/gcc/gcc-runtime_11.2.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/gcc/gcc-cross_11.2.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-graphics/freetype/freetype_2.11.0.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/pseudo/pseudo_git.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/quilt/quilt-native_0.66.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/qemu/qemu-native_6.1.0.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/prelink/prelink_git.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-support/fribidi/fribidi_1.0.11.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/patch/patch_2.7.6.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-graphics/xorg-lib/libx11_1.7.2.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-devtools/pkgconfig/pkgconfig_git.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-graphics/fontconfig/fontconfig_2.13.1.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/glib-2.0/glib-2.0_2.70.0.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-graphics/cairo/cairo_1.16.0.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-graphics/harfbuzz/harfbuzz_3.0.0.bb:do_populate_sysroot', '/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/glibc/glibc_2.34.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-gnome/gi-docgen/gi-docgen_git.bb:do_populate_sysroot', 'virtual:native:/home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-extended/xz/xz_5.2.5.bb:do_populate_sysroot']
| NOTE: Installed into sysroot: []
| NOTE: Skipping as already exists in sysroot: ['gobject-introspection-native', 'gobject-introspection', 'meson-native', 'python3-native', 'glib-2.0-native', 'ninja-native', 'libxft', 'gi-docgen', 'gcc-runtime', 'gcc-cross-x86_64', 'freetype', 'pseudo-native', 'quilt-native', 'qemu-native', 'prelink-native', 'fribidi', 'patch-native', 'libx11', 'pkgconfig-native', 'fontconfig', 'glib-2.0', 'cairo', 'harfbuzz', 'glibc', 'gi-docgen-native', 'xz-native', 'zlib-native', 'libffi-native', 'flex-native', 'gtk-doc-native', 'libffi', 'zlib', 'python3', 'autoconf-archive', 'opkg-utils', 'python3-setuptools-native', 'libnsl2-native', 'libtirpc-native', 'gdbm-native', 'openssl-native', 'readline-native', 'sqlite3-native', 'bzip2-native', 'util-linux-native', 'libtool-native', 'gettext-minimal-native', 'libpcre-native', 'gettext-native', 're2c-native', 'util-macros', 'libxrender', 'libgcc', 'linux-libc-headers', 'libmpc-native', 'mpfr-native', 'binutils-cross-x86_64', 'gnu-config-native', 'texinfo-dummy-native', 'gmp-native', 'libpng', 'binutils-native', 'elfutils-native', 'libsm', 'mesa', 'libxext', 'pixman', 'libxcb', 'attr-native', 'xorgproto', 'xtrans', 'expat', 'util-linux', 'gtk-doc', 'dbus', 'libpcre', 'bash-completion', 'icu', 'python3-toml-native', 'python3-typogrify-native', 'python3-markupsafe-native', 'python3-markdown-native', 'python3-jinja2-native', 'python3-pygments-native', 'm4-native', 'xmlto-native', 'libxslt-native', 'python3-six-native', 'xz', 'openssl', 'sqlite3', 'readline', 'libtirpc', 'libxcrypt', 'gdbm', 'libnsl2', 'bzip2', 'perl-native', 'ncurses-native', 'libpcre2-native', 'libcap-ng-native', 'util-linux-libuuid-native', 'libmicrohttpd-native', 'curl-native', 'libarchive-native', 'libice', 'libdrm', 'wayland-protocols', 'libxxf86vm', 'libxdamage', 'libxshmfence', 'libxfixes', 'xrandr', 'wayland', 'libpthread-stubs', 'libxdmcp', 'xcb-proto', 'libxau', 'ncurses', 'libpam', 'libcap-ng', 'util-linux-libuuid', 'python3-six', 'python3-pygments', 'shadow', 'base-passwd', 'shadow-native', 'base-files', 'systemd', 'shadow-sysroot', 'python3-smartypants-native', 'docbook-xsl-stylesheets-native', 'libxml2-native', 'docbook-xml-dtd4-native', 'perlcross-native', 'libgcrypt-native', 'gnutls-native', 'e2fsprogs-native', 'zstd-native', 'lzo-native', 'libpciaccess', 'libxrandr', 'libxml2', 'cracklib', 'flex', 'attr', 'acl', 'libseccomp', 'zstd', 'kmod', 'libxkbcommon', 'libcap', 'libgpg-error-native', 'libcap-native', 'libunistring-native', 'libidn2-native', 'nettle-native', 'xkeyboard-config', 'gperf-native']
| DEBUG: Python function extend_recipe_sysroot finished
| DEBUG: Executing shell function do_configure
| rmdir: failed to remove '/home/pokybuild/yocto-worker/qemux86-world-alt/build/build/tmp/work/core2-64-poky-linux/pango/1.48.10-r0/recipe-sysroot-native/usr/lib/python3.10/site-packages/smartypants-2.0.0-py3.10.egg-info': Not a directory
| WARNING: /home/pokybuild/yocto-worker/qemux86-world-alt/build/build/tmp/work/core2-64-poky-linux/pango/1.48.10-r0/temp/run.do_configure.24847:172 exit 1 from 'rmdir --ignore-fail-on-non-empty /home/pokybuild/yocto-worker/qemux86-world-alt/build/build/tmp/work/core2-64-poky-linux/pango/1.48.10-r0/recipe-sysroot-native/usr/lib/python3.10/site-packages/*.egg-info'
| WARNING: Backtrace (BB generated script):
| 	#1: meson_do_configure, /home/pokybuild/yocto-worker/qemux86-world-alt/build/build/tmp/work/core2-64-poky-linux/pango/1.48.10-r0/temp/run.do_configure.24847, line 172
| 	#2: do_configure, /home/pokybuild/yocto-worker/qemux86-world-alt/build/build/tmp/work/core2-64-poky-linux/pango/1.48.10-r0/temp/run.do_configure.24847, line 157
| 	#3: main, /home/pokybuild/yocto-worker/qemux86-world-alt/build/build/tmp/work/core2-64-poky-linux/pango/1.48.10-r0/temp/run.do_configure.24847, line 203

On 20/10/2021 16:11:04+0200, Peter Kjellerstedt wrote:
> sstate.bbclass no longer removes empty directories to avoid a race (see
> commit 4f94d929 "sstate/staging: Handle directory creation race issue").
> Unfortunately Python apparently treats an empty egg-info directory as if
> the version it previously contained still exists and fails if a newer
> version is required, which Meson does. To avoid this, make sure there
> are no empty egg-info directories from previous versions left behind.
> 
> Signed-off-by: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
> ---
> 
> RP: This is the solution I came up with regarding our discussion at the
> meeting yesterday. With this in place the upgrade to meson 0.59.1 now
> went without a hitch.
> 
>  meta/classes/meson.bbclass | 8 ++++++++
>  1 file changed, 8 insertions(+)
> 
> diff --git a/meta/classes/meson.bbclass b/meta/classes/meson.bbclass
> index e124d18144..d07b34fc5e 100644
> --- a/meta/classes/meson.bbclass
> +++ b/meta/classes/meson.bbclass
> @@ -103,6 +103,14 @@ meson_do_configure() {
>      # https://github.com/mesonbuild/meson/commit/ef9aeb188ea2bc7353e59916c18901cde90fa2b3
>      unset LD
>  
> +    # sstate.bbclass no longer removes empty directories to avoid a race (see
> +    # commit 4f94d929 "sstate/staging: Handle directory creation race issue").
> +    # Unfortunately Python apparently treats an empty egg-info directory as if
> +    # the version it previously contained still exists and fails if a newer
> +    # version is required, which Meson does. To avoid this, make sure there are
> +    # no empty egg-info directories from previous versions left behind.
> +    rmdir --ignore-fail-on-non-empty ${STAGING_LIBDIR_NATIVE}/${PYTHON_DIR}/site-packages/*.egg-info
> +
>      # Work around "Meson fails if /tmp is mounted with noexec #2972"
>      mkdir -p "${B}/meson-private/tmp"
>      export TMPDIR="${B}/meson-private/tmp"

> 
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#157262): https://lists.openembedded.org/g/openembedded-core/message/157262
> Mute This Topic: https://lists.openembedded.org/mt/86465686/3617179
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [alexandre.belloni@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
> 


-- 
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com