[meta-python][Question] python3-dlib recipe?

[meta-python][Question] python3-dlib recipe?

[open.prac]

[-- Attachment #1: Type: text/plain, Size: 5708 bytes --]

Hi everyone, first time in the mailing list...

I was wondering if anybody is already working in a recipe for the package dlib pyhon3 module,
so far this is the recipe I've been working on
```bitbake
# python3-dlib_19.21.1.bb
SUMMARY = "A toolkit for making real world machine learning and data analysis applications"
HOMEPAGE = "https://pypi.python.org/pypi/dlib"
PYPI_PACKAGE = "dlib"
LICENSE = "Boost-Software"
SRC_URI[md5sum] = "1e7e357d7d54e86267ef60f606cb40e1"
LIC_FILES_CHKSUM = "file://dlib/LICENSE.txt;md5=2c7a3fa82e66676005cd4ee2608fd7d2 \
                    file://dlib/external/libpng/LICENSE;md5=243135ddedf702158f9170807cbcfb66 \
                    file://dlib/external/pybind11/LICENSE;md5=beb87117af69fd10fbf9fb14c22a2e62 \
                    file://python_examples/LICENSE_FOR_EXAMPLE_PROGRAMS.txt;md5=064f53ab40ea2b6a4bba1324149e4fde \
"
DEPENDS = "cmake-native"

inherit  pypi setuptools3
BBCLASSEXTEND = "native nativesdk"

```


I'm not a bitbake or cmake expert, during do_compile() task i get the following error message
```
| [ 95%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/shape_predictor.cpp.o
| [ 96%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/correlation_tracker.cpp.o
| [ 96%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/face_recognition.cpp.o
| [ 97%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/cnn_face_detector.cpp.o
| [ 98%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/global_optimization.cpp.o
| [ 98%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/image_dataset_metadata.cpp.o
| [ 99%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/numpy_returns.cpp.o
| [100%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/line.cpp.o
| [100%] Linking CXX shared module build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/build/lib.linux-x86_64-3.8/_dlib_pybind11.cpython-38-aarch64-linux-gnu.so
| build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/bin/aarch64-poky-linux/../../libexec/aarch64-poky-linux/gcc/aarch64-poky-linux/8.3.0/ld: build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/libsqlite3.so: error adding symbols: file in wrong format
| collect2: error: ld returned 1 exit status
| CMakeFiles/_dlib_pybind11.dir/build.make:445: recipe for target 'build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/build/lib.linux-x86_64-3.8/_dlib_pybind11.cpython-38-aarch64-linux-gnu.so' failed
| make[2]: *** [build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/build/lib.linux-x86_64-3.8/_dlib_pybind11.cpython-38-aarch64-linux-gnu.so] Error 1
| CMakeFiles/Makefile2:116: recipe for target 'CMakeFiles/_dlib_pybind11.dir/all' failed
| make[1]: *** [CMakeFiles/_dlib_pybind11.dir/all] Error 2
| Makefile:83: recipe for target 'all' failed
| make: *** [all] Error 2
| Traceback (most recent call last):
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/dlib-19.21.1/setup.py", line 223, in <module>
|     setup(
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/site-packages/setuptools/__init__.py", line 144, in setup
|     return distutils.core.setup(**attrs)
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/core.py", line 148, in setup
|     dist.run_commands()
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/dist.py", line 966, in run_commands
|     self.run_command(cmd)
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
|     cmd_obj.run()
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/command/build.py", line 135, in run
|     self.run_command(cmd_name)
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
|     self.distribution.run_command(command)
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
|     cmd_obj.run()
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/dlib-19.21.1/setup.py", line 135, in run
|     self.build_extension(ext)
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/dlib-19.21.1/setup.py", line 175, in build_extension
|     subprocess.check_call(cmake_build, cwd=build_folder)
|   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/subprocess.py", line 364, in check_call
|     raise CalledProcessError(retcode, cmd)
| subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--config', 'Release', '--', '-j8']' returned non-zero exit status 2.
| WARNING: exit code 1 from a shell command.
| 

```

Not sure why the linker **gcc/aarch64-poky-linux/8.3.0/ld** is showing the error
```
 error adding symbols: file in wrong format
```
Perhaps i'm messing things up with cmake-native environment but not sure how i can enable cmake to be used by setup.py if it is not with DEPENDS=cmake-native.

Any clue to solve this issue will be highly appreciated, or if you know who is already working on this it will be great to have its contact :)

Also i use dunfell branch for meta-oe

BR,

[-- Attachment #2: Type: text/html, Size: 6193 bytes --]

Re: [oe] [meta-python][Question] python3-dlib recipe?

[Khem Raj]

This is the error of interest.


| build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/bin/aarch64-poky-linux/../../libexec/aarch64-poky-linux/gcc/aarch64-poky-linux/8.3.0/ld:
build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/libsqlite3.so:
error adding symbols: file in wrong format

you might want to add sqlite3 dependency or look at the component's
build files to see if it can be stopped from looking into native
sysroot or native files on build system

On Wed, Jan 20, 2021 at 1:12 PM <open.prac@gmail.com> wrote:
>
> Hi everyone, first time in the mailing list...
>
> I was wondering if anybody is already working in a recipe for the package dlib pyhon3 module, so far this is the recipe I've been working on
>
> # python3-dlib_19.21.1.bb
> SUMMARY = "A toolkit for making real world machine learning and data analysis applications"
> HOMEPAGE = "https://pypi.python.org/pypi/dlib"
> PYPI_PACKAGE = "dlib"
> LICENSE = "Boost-Software"
> SRC_URI[md5sum] = "1e7e357d7d54e86267ef60f606cb40e1"
> LIC_FILES_CHKSUM = "file://dlib/LICENSE.txt;md5=2c7a3fa82e66676005cd4ee2608fd7d2 \
>                     file://dlib/external/libpng/LICENSE;md5=243135ddedf702158f9170807cbcfb66 \
>                     file://dlib/external/pybind11/LICENSE;md5=beb87117af69fd10fbf9fb14c22a2e62 \
>                     file://python_examples/LICENSE_FOR_EXAMPLE_PROGRAMS.txt;md5=064f53ab40ea2b6a4bba1324149e4fde \
> "
> DEPENDS = "cmake-native"
>
> inherit  pypi setuptools3
> BBCLASSEXTEND = "native nativesdk"
>
> I'm not a bitbake or cmake expert, during do_compile() task i get the following error message
>
> | [ 95%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/shape_predictor.cpp.o
> | [ 96%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/correlation_tracker.cpp.o
> | [ 96%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/face_recognition.cpp.o
> | [ 97%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/cnn_face_detector.cpp.o
> | [ 98%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/global_optimization.cpp.o
> | [ 98%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/image_dataset_metadata.cpp.o
> | [ 99%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/numpy_returns.cpp.o
> | [100%] Building CXX object CMakeFiles/_dlib_pybind11.dir/src/line.cpp.o
> | [100%] Linking CXX shared module build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/build/lib.linux-x86_64-3.8/_dlib_pybind11.cpython-38-aarch64-linux-gnu.so
> | build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/bin/aarch64-poky-linux/../../libexec/aarch64-poky-linux/gcc/aarch64-poky-linux/8.3.0/ld: build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/libsqlite3.so: error adding symbols: file in wrong format
> | collect2: error: ld returned 1 exit status
> | CMakeFiles/_dlib_pybind11.dir/build.make:445: recipe for target 'build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/build/lib.linux-x86_64-3.8/_dlib_pybind11.cpython-38-aarch64-linux-gnu.so' failed
> | make[2]: *** [build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/build/lib.linux-x86_64-3.8/_dlib_pybind11.cpython-38-aarch64-linux-gnu.so] Error 1
> | CMakeFiles/Makefile2:116: recipe for target 'CMakeFiles/_dlib_pybind11.dir/all' failed
> | make[1]: *** [CMakeFiles/_dlib_pybind11.dir/all] Error 2
> | Makefile:83: recipe for target 'all' failed
> | make: *** [all] Error 2
> | Traceback (most recent call last):
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/dlib-19.21.1/setup.py", line 223, in <module>
> |     setup(
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/site-packages/setuptools/__init__.py", line 144, in setup
> |     return distutils.core.setup(**attrs)
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/core.py", line 148, in setup
> |     dist.run_commands()
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/dist.py", line 966, in run_commands
> |     self.run_command(cmd)
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
> |     cmd_obj.run()
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/command/build.py", line 135, in run
> |     self.run_command(cmd_name)
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
> |     self.distribution.run_command(command)
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
> |     cmd_obj.run()
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/dlib-19.21.1/setup.py", line 135, in run
> |     self.build_extension(ext)
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/dlib-19.21.1/setup.py", line 175, in build_extension
> |     subprocess.check_call(cmake_build, cwd=build_folder)
> |   File "build_dunfell/tmp/work/aarch64-poky-linux/python3-dlib/19.21.1-r0/recipe-sysroot-native/usr/lib/python3.8/subprocess.py", line 364, in check_call
> |     raise CalledProcessError(retcode, cmd)
> | subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--config', 'Release', '--', '-j8']' returned non-zero exit status 2.
> | WARNING: exit code 1 from a shell command.
> |
>
> Not sure why the linker gcc/aarch64-poky-linux/8.3.0/ld is showing the error
>
>  error adding symbols: file in wrong format
>
> Perhaps i'm messing things up with cmake-native environment but not sure how i can enable cmake to be used by setup.py if it is not with DEPENDS=cmake-native.
>
> Any clue to solve this issue will be highly appreciated, or if you know who is already working on this it will be great to have its contact :)
>
> Also i use dunfell branch for meta-oe
>
> BR,
>
>
> 
>

Re: [meta-python][Question] python3-dlib recipe?

[open.prac]

[-- Attachment #1: Type: text/plain, Size: 1129 bytes --]

Hi @Khem, based on [this](https://stackoverflow.com/q/65822507/8033671) discussion i tried the following recipe and it worked just fine

```bitbake
SUMMARY = "A toolkit for making real world machine learning and data analysis applications"
HOMEPAGE = "https://pypi.python.org/pypi/dlib"
PYPI_PACKAGE = "dlib"
LICENSE = "Boost-Software"
SRC_URI[md5sum] = "1e7e357d7d54e86267ef60f606cb40e1"
LIC_FILES_CHKSUM = "file://dlib/LICENSE.txt;md5=2c7a3fa82e66676005cd4ee2608fd7d2 \
                    file://dlib/external/libpng/LICENSE;md5=243135ddedf702158f9170807cbcfb66 \
                    file://dlib/external/pybind11/LICENSE;md5=beb87117af69fd10fbf9fb14c22a2e62 \
                    file://python_examples/LICENSE_FOR_EXAMPLE_PROGRAMS.txt;md5=064f53ab40ea2b6a4bba1324149e4fde \
"
DEPENDS = "sqlite3 "

inherit pypi cmake setuptools3
INSANE_SKIP_${PN} = "already-stripped"                                  

DISTUTILS_BUILD_ARGS_append = " \
      --set CMAKE_TOOLCHAIN_FILE=${WORKDIR}/toolchain.cmake \
"


```
I'm not sure if there is a better way to do this and make a PATCH from it

-- 
- el prac

[-- Attachment #2: Type: text/html, Size: 1292 bytes --]