[prelink-cross] error while loading shared libraries: ld-linux.so.3

[prelink-cross] error while loading shared libraries: ld-linux.so.3

[Florian Boehmak]

[-- Attachment #1: Type: text/plain, Size: 1881 bytes --]

Hi,

I am having difficulties to cross-prelink a simple hello world program.
Prelinking for my x86 machine works fine (host system) but when using the
arm cross-compile toolchain I get the error:

prelink: bin_arm/hello: Could not parse `/usr/local/sbin//prelink-rtld:
error while loading shared libraries: ld-linux.so.3'

If I understand it correctly then prelink-rtld emulates ld-linux.so but why
is it parsed by rtld?

Here are my files:

# main.cpp

#include <stdio.h>
#include "world.h"
int main (int argc, char *argv[])
{
fprintf(stdout, "hello\n");
World w;
w.Str();
return 0;
}


# world.cpp

#include "world.h"
void World::Str()
{
fprintf(stdout, "world\n");
}


# prelink_arm.conf

-l arm-2012.03/arm-none-linux-gnueabi/libc/lib
-h arm-2012.03/arm-none-linux-gnueabi/libc/lib
-l arm-2012.03/arm-none-linux-gnueabi/libc/usr/lib
-h arm-2012.03/arm-none-linux-gnueabi/libc/usr/lib


# compiling

../arm-2012.03/bin/arm-none-linux-gnueabi-gcc -Wall -fPIC -shared -Iinclude
-o lib_arm/libworld.so src/world.cpp
arm-2012.03/bin/arm-none-linux-gnueabi-gcc -Wall -Iworld/include
-Lworld/lib_arm/ -lworld -o bin_arm/hello src/main.cpp


# prelink-cross

PATH=/usr/local/sbin prelink --verbose --cache-file=cache/prelink_arm.cache
--config-file=prelink_arm.conf
--ld-library-path="world/lib_arm;arm-2012.03/arm-none-linux-gnueabi/libc/lib;arm-2012.03/arm-none-linux-gnueabi/libc/usr/lib;"
-h bin_arm/hello


I am sort of stuck. Could you point me in the right direction. What am I
missing or doing wrong?
Thank you.

Cheers
Florian

Ps. I have put together the code on github this would be the
"shared-library" branch.
https://github.com/fnbk/prelink-cross-example

Ps. I posted a similar question on stackoverflow, cross-prelinking but
without shared libraries.
http://stackoverflow.com/q/30849060/5011904

[-- Attachment #2: Type: text/html, Size: 3125 bytes --]

Re: [prelink-cross] error while loading shared libraries: ld-linux.so.3

[Mark Hatle]

On 6/16/15 2:01 AM, Florian Boehmak wrote:
> Hi,
> 
> I am having difficulties to cross-prelink a simple hello world program.
> Prelinking for my x86 machine works fine (host system) but when using the arm
> cross-compile toolchain I get the error: 
> 
> prelink: bin_arm/hello: Could not parse `/usr/local/sbin//prelink-rtld: error
> while loading shared libraries: ld-linux.so.3'

The error indicates that it found a library required called 'ld-linux.so.3', but
could not find that in the "path".  (The path generally being the sysroot path
passed to the rtld.)

What command did you use to run the prelinker?  And does your sysroot contain
the /lib/ld-linux.so.3?

--Mark

> If I understand it correctly then prelink-rtld emulates ld-linux.so but why is
> it parsed by rtld?
> 
> Here are my files:
> 
> # main.cpp
> 
> #include <stdio.h>
> #include "world.h"
> int main (int argc, char *argv[])
> {
> fprintf(stdout, "hello\n");
> World w;
> w.Str();
> return 0;
> }
> 
> 
> # world.cpp
> 
> #include "world.h"
> void World::Str()
> {
> fprintf(stdout, "world\n");
> }
> 
> 
> # prelink_arm.conf
> 
> -l arm-2012.03/arm-none-linux-gnueabi/libc/lib 
> -h arm-2012.03/arm-none-linux-gnueabi/libc/lib 
> -l arm-2012.03/arm-none-linux-gnueabi/libc/usr/lib
> -h arm-2012.03/arm-none-linux-gnueabi/libc/usr/lib
> 
> 
> # compiling
> 
> ../arm-2012.03/bin/arm-none-linux-gnueabi-gcc -Wall -fPIC -shared -Iinclude -o
> lib_arm/libworld.so src/world.cpp 
> arm-2012.03/bin/arm-none-linux-gnueabi-gcc -Wall -Iworld/include
> -Lworld/lib_arm/ -lworld -o bin_arm/hello src/main.cpp
> 
> 
> # prelink-cross
> 
> PATH=/usr/local/sbin prelink --verbose --cache-file=cache/prelink_arm.cache
> --config-file=prelink_arm.conf
> --ld-library-path="world/lib_arm;arm-2012.03/arm-none-linux-gnueabi/libc/lib;arm-2012.03/arm-none-linux-gnueabi/libc/usr/lib;"
> -h bin_arm/hello
> 
> 
> I am sort of stuck. Could you point me in the right direction. What am I missing
> or doing wrong?
> Thank you.
> 
> Cheers
> Florian
> 
> Ps. I have put together the code on github this would be the "shared-library"
> branch.
> https://github.com/fnbk/prelink-cross-example 
> 
> Ps. I posted a similar question on stackoverflow, cross-prelinking but without
> shared libraries.
> http://stackoverflow.com/q/30849060/5011904
> 
>  
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 

Re: [prelink-cross] error while loading shared libraries: ld-linux.so.3

[Florian Boehmak]

[-- Attachment #1: Type: text/plain, Size: 5380 bytes --]

> The error indicates that it found a library required called
'ld-linux.so.3', but
> could not find that in the "path".  (The path generally being the sysroot
path
> passed to the rtld.)

I tried to move the files to their location in sysroot:

arm-2012.03/arm-none-linux-gnueabi/libc/usr/local/include/world.h
arm-2012.03/arm-none-linux-gnueabi/libc/usr/local/lib/libworld.so
arm-2012.03/arm-none-linux-gnueabi/libc/usr/local/bin/hello
arm-2012.03/arm-none-linux-gnueabi/libc/etc/prelink.conf


> What command did you use to run the prelinker?  And does your sysroot
contain
> the /lib/ld-linux.so.3?

prelink command:

PATH=/usr/local/sbin prelink --verbose
--root=arm-2012.03/arm-none-linux-gnueabi/libc
--cache-file=/etc/cache/prelink.cache --config-file=/etc/prelink.conf
--ld-library-path="/usr/local/lib;/lib;/usr/lib;" -h /usr/local/bin/hello


error message:

prelink: /lib/libdl-2.15.so is not present in any config file directories,
nor was specified on command line
prelink: /lib/libc-2.15.so is not present in any config file directories,
nor was specified on command line
prelink: /lib/libgcc_s.so.1 is not present in any config file directories,
nor was specified on command line
prelink: /lib/ld-2.15.so is not present in any config file directories, nor
was specified on command line
Laying out 1 libraries in virtual address space 41000000-50000000
Assigned virtual address space slots for libraries:
/usr/local/lib/libworld.so
41000000-410086d0
prelink: Could not prelink /usr/lib/bin/localedef because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/POSIX_V6_ILP32_OFFBIG because its
dependency /lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/zdump because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/POSIX_V7_ILP32_OFF32 because its
dependency /lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/local/lib/libworld.so because its
dependency /lib/libgcc_s.so.1 could not be prelinked
prelink: Could not prelink /usr/local/bin/hello because its dependency
/usr/local/lib/libworld.so could not be prelinked
prelink: Could not prelink /usr/lib/bin/pldd because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/zic because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/sprof because its dependency
/lib/libdl.so.2 could not be prelinked
prelink: Could not prelink /usr/lib/bin/POSIX_V6_ILP32_OFF32 because its
dependency /lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/gdbserver because its dependency
/lib/libdl.so.2 could not be prelinked
prelink: Could not prelink /usr/lib/bin/XBS5_ILP32_OFFBIG because its
dependency /lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/XBS5_ILP32_OFF32 because its
dependency /lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/makedb because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/pcprofiledump because its
dependency /lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/iconv because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/locale because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/gencat because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/POSIX_V7_ILP32_OFFBIG because its
dependency /lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/rpcgen because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/getent because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/getconf because its dependency
/lib/libc.so.6 could not be prelinked
prelink: Could not prelink /usr/lib/bin/iconvconfig because its dependency
/lib/libc.so.6 could not be prelinked


prelink.conf

-l /lib
-h /lib
-l /usr/lib
-h /usr/lib
-l /usr/local/lib
-h /usr/local/lib


Now there is no error message from rtld and libworld.so seems to be found.
But what's the problem with the folling libraries?

libdl-2.15.so
libc-2.15.so
libgcc_s.so.1
ld-2.15.so


I can see them in this folder arm-2012.03/arm-none-linux-gnueabi/libc/lib:

-rwxr-xr-x 1 developer users  177212 10. Jun 18:43 ld-2.15.so
lrwxrwxrwx 1 developer users      10 10. Jun 18:43 ld-linux.so.3 ->
ld-2.15.so
-rwxr-xr-x 1 developer users 1777390 10. Jun 18:43 libc-2.15.so
lrwxrwxrwx 1 developer users      12 10. Jun 18:43 libc.so.6 -> libc-2.15.so
-rwxr-xr-x 1 developer users   26841 10. Jun 18:43 libdl-2.15.so
lrwxrwxrwx 1 developer users      13 10. Jun 18:43 libdl.so.2 ->
libdl-2.15.so
-rw-r--r-- 1 developer users     135 10. Jun 18:43 libgcc_s.so
-rw-r--r-- 1 developer users 3190583 10. Jun 18:43 libgcc_s.so.1
lrwxrwxrwx 1 developer users      13 10. Jun 18:43 libld-linux.so.3 ->
ld-linux.so.3



I have also put the code on github for reference. Where is the mistake? - I
think we are almost there :-)
https://github.com/fnbk/prelink-cross-example/tree/shared-library


Greetings
Florian

[-- Attachment #2: Type: text/html, Size: 7121 bytes --]

Re: [prelink-cross] error while loading shared libraries: ld-linux.so.3

[Florian Boehmak]

> The error indicates that it found a library required called 'ld-linux.so.3', but
> could not find that in the "path".  (The path generally being the sysroot path
> passed to the rtld.)
>
> What command did you use to run the prelinker?  And does your sysroot contain
> the /lib/ld-linux.so.3?

Hey, now I understand it :-) Thank you!

I need to specify the sysroot and explicitly tell prelink which
libraries to prelink:

PATH=/usr/local/sbin prelink --verbose
--root=/home/developer/workspace/eclipse/prelink-cross-example/arm-2012.03/arm-none-linux-gnueabi/libc
--cache-file=/etc/cache/prelink.cache --config-file=/etc/prelink.conf
--ld-library-path="/usr/local/lib;/lib;" -h /usr/local/bin/hello
/lib/libc.so.6 /lib/libgcc_s.so.1 /lib/ld-2.15.so


This will produce the following output:

Assigned virtual address space slots for libraries:
/lib/ld-linux.so.3                                           41000000-4102a968
/lib/libc.so.6                                               41030000-41181968
/lib/libgcc_s.so.1                                           41188000-411af748
/usr/local/lib/libworld.so                                   411b8000-411c06d0
Prelinking /lib/ld-2.15.so
Prelinking /lib/libc-2.15.so
Prelinking /lib/libgcc_s.so.1
Prelinking /usr/local/lib/libworld.so
Prelinking /usr/local/bin/hello


I put all the code on github, in case somebody has the same issues
(make sure to checkout both branches 'master' and 'shared-library'):
https://github.com/fnbk/prelink-cross-example

Thank you for the great help.

Cheers
Florian

Re: [prelink-cross] error while loading shared libraries: ld-linux.so.3

[Mark Hatle]

On 6/16/15 5:56 PM, Florian Boehmak wrote:
>> The error indicates that it found a library required called 'ld-linux.so.3', but
>> could not find that in the "path".  (The path generally being the sysroot path
>> passed to the rtld.)
> 
> I tried to move the files to their location in sysroot:
> 
> arm-2012.03/arm-none-linux-gnueabi/libc/usr/local/include/world.h
> arm-2012.03/arm-none-linux-gnueabi/libc/usr/local/lib/libworld.so
> arm-2012.03/arm-none-linux-gnueabi/libc/usr/local/bin/hello
> arm-2012.03/arm-none-linux-gnueabi/libc/etc/prelink.conf
> 
> 
>> What command did you use to run the prelinker?  And does your sysroot contain
>> the /lib/ld-linux.so.3?
> 
> prelink command:
> 
> PATH=/usr/local/sbin prelink --verbose
> --root=arm-2012.03/arm-none-linux-gnueabi/libc
> --cache-file=/etc/cache/prelink.cache --config-file=/etc/prelink.conf
> --ld-library-path="/usr/local/lib;/lib;/usr/lib;" -h /usr/local/bin/hello
> 

/usr/local/bin/hello is going to look at the absolute location, not that patch
within that specific sysroot.  Any files passed in should have the on-host path
names specified.  This allows for you to prelink an app based on rootfs where
the app is not present.

The normal mechanism used by the Yocto Project is:

[path]/prelink --root ${IMAGE_ROOTFS} -amR -N -c /etc/prelink.conf

This will process the entire contents of the IMAGE_ROOTFS.

--Mark

> error message:
> 
> prelink: /lib/libdl-2.15.so <http://libdl-2.15.so> is not present in any config
> file directories, nor was specified on command line
> prelink: /lib/libc-2.15.so <http://libc-2.15.so> is not present in any config
> file directories, nor was specified on command line
> prelink: /lib/libgcc_s.so.1 is not present in any config file directories, nor
> was specified on command line
> prelink: /lib/ld-2.15.so <http://ld-2.15.so> is not present in any config file
> directories, nor was specified on command line
> Laying out 1 libraries in virtual address space 41000000-50000000
> Assigned virtual address space slots for libraries:
> /usr/local/lib/libworld.so                                   41000000-410086d0
> prelink: Could not prelink /usr/lib/bin/localedef because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/POSIX_V6_ILP32_OFFBIG because its
> dependency /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/zdump because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/POSIX_V7_ILP32_OFF32 because its
> dependency /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/local/lib/libworld.so because its dependency
> /lib/libgcc_s.so.1 could not be prelinked
> prelink: Could not prelink /usr/local/bin/hello because its dependency
> /usr/local/lib/libworld.so could not be prelinked
> prelink: Could not prelink /usr/lib/bin/pldd because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/zic because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/sprof because its dependency
> /lib/libdl.so.2 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/POSIX_V6_ILP32_OFF32 because its
> dependency /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/gdbserver because its dependency
> /lib/libdl.so.2 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/XBS5_ILP32_OFFBIG because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/XBS5_ILP32_OFF32 because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/makedb because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/pcprofiledump because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/iconv because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/locale because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/gencat because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/POSIX_V7_ILP32_OFFBIG because its
> dependency /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/rpcgen because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/getent because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/getconf because its dependency
> /lib/libc.so.6 could not be prelinked
> prelink: Could not prelink /usr/lib/bin/iconvconfig because its dependency
> /lib/libc.so.6 could not be prelinked
> 
> 
> prelink.conf
> 
> -l /lib 
> -h /lib 
> -l /usr/lib
> -h /usr/lib
> -l /usr/local/lib
> -h /usr/local/lib
> 
> 
> Now there is no error message from rtld and libworld.so seems to be found. But
> what's the problem with the folling libraries?
> 
> libdl-2.15.so <http://libdl-2.15.so>
> libc-2.15.so <http://libc-2.15.so>
> libgcc_s.so.1
> ld-2.15.so <http://ld-2.15.so>
> 
> 
> I can see them in this folder arm-2012.03/arm-none-linux-gnueabi/libc/lib:
> 
> -rwxr-xr-x 1 developer users  177212 10. Jun 18:43 ld-2.15.so <http://ld-2.15.so>
> lrwxrwxrwx 1 developer users      10 10. Jun 18:43 ld-linux.so.3 -> ld-2.15.so
> <http://ld-2.15.so>
> -rwxr-xr-x 1 developer users 1777390 10. Jun 18:43 libc-2.15.so
> <http://libc-2.15.so>
> lrwxrwxrwx 1 developer users      12 10. Jun 18:43 libc.so.6 -> libc-2.15.so
> <http://libc-2.15.so>
> -rwxr-xr-x 1 developer users   26841 10. Jun 18:43 libdl-2.15.so
> <http://libdl-2.15.so>
> lrwxrwxrwx 1 developer users      13 10. Jun 18:43 libdl.so.2 -> libdl-2.15.so
> <http://libdl-2.15.so>
> -rw-r--r-- 1 developer users     135 10. Jun 18:43 libgcc_s.so
> -rw-r--r-- 1 developer users 3190583 10. Jun 18:43 libgcc_s.so.1
> lrwxrwxrwx 1 developer users      13 10. Jun 18:43 libld-linux.so.3 -> ld-linux.so.3
> 
> 
> 
> I have also put the code on github for reference. Where is the mistake? - I
> think we are almost there :-)
> https://github.com/fnbk/prelink-cross-example/tree/shared-library
> 
> 
> Greetings
> Florian
> 
> 
> 

[prelink-cross] error while loading shared libraries: ld-linux.so.3

[Florian Boehmak]

[-- Attachment #1: Type: text/plain, Size: 2126 bytes --]

Hi, I tried to track down the error message which comes from rtld. This is
the call stack:

rtld.c:main()
    rtld.c:process_one_dso()
        dl-version.c:_dl_check_map_versions()



This is the code that produces the error message:

Elf64_Vernaux *aux;
struct link_map *needed = find_needed (strtab + ent->vn_file, map);

/* If NEEDED is NULL this means a dependency was not found
 and no stub entry was created.  This should never happen.  */
if (needed == NULL)
{
  _dl_signal_error (errval, NULL, NULL, strtab + ent->vn_file);
  printf("error while loading shared libraries: %s", strtab + ent->vn_file);
  exit (1);
}



This code loops through the needed versions of the link_map (Elf64_Verneed
*ent) and calls find_needed for each entry. find_needed calls
_dl_name_match_p and compares the library name. I have captured the
individual calls in debug statements and this is the result:

_dl_name_match_p name:libc.so.6
_dl_name_match_p name:libc.so.6
_dl_name_match_p name:libc.so.6
_dl_check_map_versions needed:1, file:libc.so.6

_dl_name_match_p name:libgcc_s.so.1
_dl_name_match_p name:libgcc_s.so.1
_dl_check_map_versions needed:1, file:libgcc_s.so.1

_dl_name_match_p name:libc.so.6
_dl_name_match_p name:libc.so.6
_dl_check_map_versions needed:1, file:libc.so.6

_dl_name_match_p name:ld-linux.so.3
_dl_name_match_p name:ld-linux.so.3
_dl_check_map_versions needed:NULL, file:ld-linux.so.3



As I can see the dependencies libc.so.6 and libgcc_s.so.1 are met. Only
ld-linux.so.3 is not. libc.so.6, libgcc_s.so.1 and ld-linux.so.3 are all in
the same location, so I don't understand what this error means.

arm-2012.03/arm-none-linux-gnueabi/libc/lib:
-rwxr-xr-x 1 developer users  177212 10. Jun 18:43 ld-2.15.so
lrwxrwxrwx 1 developer users      10 10. Jun 18:43 ld-linux.so.3 ->
ld-2.15.so
lrwxrwxrwx 1 developer users      12 10. Jun 18:43 libc.so.6 -> libc-2.15.so
-rw-r--r-- 1 developer users     135 10. Jun 18:43 libgcc_s.so
-rw-r--r-- 1 developer users 3190583 10. Jun 18:43 libgcc_s.so.1
...


Any hints? :-)
Thank you.

Cheers
Florian

[-- Attachment #2: Type: text/html, Size: 2923 bytes --]