Unable to build core-image-full-cmdline on openSUSE Leap 15.1: dnf can't find _curses module in do_rootfs task

Unable to build core-image-full-cmdline on openSUSE Leap 15.1: dnf can't find _curses module in do_rootfs task

[Rebecca Cran]

[-- Attachment #1: Type: text/plain, Size: 3544 bytes --]

I recently switched from Ubuntu 19.10 to openSUSE Leap 15.1, but I'm having problems building core-image-full-cmdline on it. I've installed all the host packages I can think of, including python-curses and python3-curses, with no success.

I'm on the zeus branch, and running "bitbake core-image-full-cmdline" results in the following error when running the do_rootfs task:

ERROR: core-image-full-cmdline-1.0-r0 do_rootfs: Could not invoke dnf. Command '/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/bin/dnf -v --rpmverbosity=info -y -c /home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/rootfs/etc/dnf/dnf.conf --setopt=reposdir=/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/rootfs/etc/yum.repos.d --installroot=/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/rootfs --setopt=logdir=/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/temp --repofrompath=oe-repo,/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/oe-rootfs-repo makecache --refresh' returned 1:
Traceback (most recent call last):
File "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/bin/dnf.real", line 57, in <module>
from dnf.cli import main
File "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/__init__.py", line 30, in <module>
from dnf.cli.cli import Cli  # :api
File "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/cli.py", line 44, in <module>
from . import output
File "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/output.py", line 34, in <module>
import dnf.cli.progress
File "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/progress.py", line 19, in <module>
from dnf.cli.term import _term_width
File "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/term.py", line 21, in <module>
import curses
File "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/curses/__init__.py", line 13, in <module>
from _curses import *
ModuleNotFoundError: No module named '_curses'

ERROR: Logfile of failure stored in: /home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/temp/log.do_rootfs.40254
ERROR: Task (/home/bcran/src/fsl-community-bsp/sources/poky/meta/recipes-extended/images/core-image-full-cmdline.bb:do_rootfs) failed with exit code '1'

--
Rebecca Cran

[-- Attachment #2: Type: text/html, Size: 3877 bytes --]

Re: [yocto] Unable to build core-image-full-cmdline on openSUSE Leap 15.1: dnf can't find _curses module in do_rootfs task

[Alexander Kanavin]

[-- Attachment #1: Type: text/plain, Size: 4542 bytes --]

This error means native python3 was somehow built without curses, or isn't
able to use the curses module that was built, so installing host packages
isn't going to help. You need to look into how python3 was built and
installed into recipe-sysroot-native. I can't offer more specific guidance
than that unfortunately.

Alex

On Sun, 8 Dec 2019 at 22:33, Rebecca Cran <rebecca@bsdio.com> wrote:

> I recently switched from Ubuntu 19.10 to openSUSE Leap 15.1, but I'm
> having problems building core-image-full-cmdline on it. I've installed all
> the host packages I can think of, including python-curses and
> python3-curses, with no success.
>
> I'm on the zeus branch, and running "bitbake core-image-full-cmdline"
> results in the following error when running the do_rootfs task:
>
> ERROR: core-image-full-cmdline-1.0-r0 do_rootfs: Could not invoke dnf.
> Command
> '/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/bin/dnf
> -v --rpmverbosity=info -y -c
> /home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/rootfs/etc/dnf/dnf.conf
> --setopt=reposdir=/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/rootfs/etc/yum.repos.d
> --installroot=/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/rootfs
> --setopt=logdir=/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/temp
> --repofrompath=oe-repo,/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/oe-rootfs-repo
> makecache --refresh' returned 1:
> Traceback (most recent call last):
>   File
> "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/bin/dnf.real",
> line 57, in <module>
>     from dnf.cli import main
>   File
> "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/__init__.py",
> line 30, in <module>
>     from dnf.cli.cli import Cli  # :api
>   File
> "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/cli.py",
> line 44, in <module>
>     from . import output
>   File
> "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/output.py",
> line 34, in <module>
>     import dnf.cli.progress
>   File
> "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/progress.py",
> line 19, in <module>
>     from dnf.cli.term import _term_width
>   File
> "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/site-packages/dnf/cli/term.py",
> line 21, in <module>
>     import curses
>   File
> "/home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/recipe-sysroot-native/usr/lib/python3.7/curses/__init__.py",
> line 13, in <module>
>     from _curses import *
> ModuleNotFoundError: No module named '_curses'
>
> ERROR: Logfile of failure stored in:
> /home/bcran/src/fsl-community-bsp/build-imx6slevk/tmp/work/imx6slevk-fslc-linux-gnueabi/core-image-full-cmdline/1.0-r0/temp/log.do_rootfs.40254
> ERROR: Task
> (/home/bcran/src/fsl-community-bsp/sources/poky/meta/recipes-extended/images/core-image-full-cmdline.bb:do_rootfs)
> failed with exit code '1'
>
> --
> Rebecca Cran -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
>
> View/Reply Online (#47593):
> https://lists.yoctoproject.org/g/yocto/message/47593
> Mute This Topic: https://lists.yoctoproject.org/mt/67777408/1686489
> Group Owner: yocto+owner@lists.yoctoproject.org
> Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub  [
> alex.kanavin@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

[-- Attachment #2: Type: text/html, Size: 5395 bytes --]

Re: Unable to build core-image-full-cmdline on openSUSE Leap 15.1: dnf can't find _curses module in do_rootfs task

[bpeter]

[-- Attachment #1: Type: text/plain, Size: 1202 bytes --]

I'm experiencing the same problem with yocto zeus on both OpenSuse Leap 15.0 and 15.1. Were you able to find a resolution for this issue?

I've been investigating and found problems with some of the libraries built for python3-native. They're missing some dependencies:

/home/brendan/workspaces/imx-linux-zeus/build_fsl-imx-xwayland/tmp/sysroots-components/x86_64/python3-native/usr/lib/python3.7/lib-dynload/_curses.cpython-37m-x86_64-linux-gnu_failed.so
/home/brendan/workspaces/imx-linux-zeus/build_fsl-imx-xwayland/tmp/sysroots-components/x86_64/python3-native/usr/lib/python3.7/lib-dynload/_curses_panel.cpython-37m-x86_64-linux-gnu_failed.so

readelf -d | grep NEEDED
0x0000000000000001 (NEEDED)             Shared library: [libpanelw.so.5]
0x0000000000000001 (NEEDED)             Shared library: [libncursesw.so.5]
0x0000000000000001 (NEEDED)             Shared library: [libtinfo.so.5]
0x0000000000000001 (NEEDED)             Shared library: [libpython3.7m.so.1.0]
0x0000000000000001 (NEEDED)             Shared library: [libpthread.so.0]
0x0000000000000001 (NEEDED)             Shared library: [libc.so.6]

[-- Attachment #2: Type: text/html, Size: 1578 bytes --]

Re: [yocto] Unable to build core-image-full-cmdline on openSUSE Leap 15.1: dnf can't find _curses module in do_rootfs task

[Alexander Kanavin]

[-- Attachment #1: Type: text/plain, Size: 1417 bytes --]

I think the issue is solved by this:

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?h=master-next&id=39970f583dddf04139a039cbe04e62b7236f0481

Alex



On Mon, 27 Apr 2020 at 19:51, <bpeter@lytx.com> wrote:

> I'm experiencing the same problem with yocto zeus on both OpenSuse Leap
> 15.0 and 15.1. Were you able to find a resolution for this issue?
>
> I've been investigating and found problems with some of the libraries
> built for python3-native. They're missing some dependencies:
>
>
> /home/brendan/workspaces/imx-linux-zeus/build_fsl-imx-xwayland/tmp/sysroots-components/x86_64/python3-native/usr/lib/python3.7/lib-dynload/_
> curses.cpython-37m-x86_64-linux-gnu_failed.so
>
> /home/brendan/workspaces/imx-linux-zeus/build_fsl-imx-xwayland/tmp/sysroots-components/x86_64/python3-native/usr/lib/python3.7/lib-dynload/_
> curses_panel.cpython-37m-x86_64-linux-gnu_failed.so
>
> readelf -d | grep NEEDED
>  0x0000000000000001 (NEEDED)             Shared library: [libpanelw.so.5]
>  0x0000000000000001 (NEEDED)             Shared library: [libncursesw.so.5]
>  0x0000000000000001 (NEEDED)             Shared library: [libtinfo.so.5]
>  0x0000000000000001 (NEEDED)             Shared library:
> [libpython3.7m.so.1.0]
>  0x0000000000000001 (NEEDED)             Shared library: [libpthread.so.0]
>  0x0000000000000001 (NEEDED)             Shared library: [libc.so.6]
> 
>

[-- Attachment #2: Type: text/html, Size: 2147 bytes --]

Re: Unable to build core-image-full-cmdline on openSUSE Leap 15.1: dnf can't find _curses module in do_rootfs task

[bpeter]

[-- Attachment #1: Type: text/plain, Size: 60 bytes --]

Thanks for your help! Applying the patch solved the issue.

[-- Attachment #2: Type: text/html, Size: 60 bytes --]