Is there a simple way to install rdma-core other than making a package?

Is there a simple way to install rdma-core other than making a package?

[Bob Pearson]

There doesn't seem to be a documented way to make install rdma-core, at least in the README file. However trying the obvious

$ bash build.sh
$ cd build
$ sudo make install

seems to work, almost. After a few 100 lines of promising output I get

CMake Error at librdmacm/cmake_install.cmake:76 (file):
  file INSTALL cannot find
  "/home/rpearson/src/rdma-core-git/build/lib/librdmacm.so.1.3.31.0": No such
  file or directory.

Looking I see

# ls -l build/lib

....

-rwxrwxr-x 1 rpearson rpearson  263384 Aug 10 12:31 libqedr-rdmav25.so
lrwxrwxrwx 1 rpearson rpearson      14 Aug 10 12:31 librdmacm.so -> librdmacm.so.1
lrwxrwxrwx 1 rpearson rpearson      21 Aug 10 12:31 librdmacm.so.1 -> librdmacm.so.1.3.31.0
-rwxrwxr-x 1 rpearson rpearson  138536 Aug 10 12:31 librspreload.so
-rwxrwxr-x 1 rpearson rpearson  112488 Aug 10 12:32 librxe-rdmav25.so

....

with no librdmacm.so.1.3.31.0 as advertised. On the other hand if you stop after bash build.sh and before make install you get:

-rwxrwxr-x 1 rpearson rpearson  263384 Aug 10 12:31 libqedr-rdmav25.so
lrwxrwxrwx 1 rpearson rpearson      14 Aug 10 12:31 librdmacm.so -> librdmacm.so.1
lrwxrwxrwx 1 rpearson rpearson      21 Aug 10 12:31 librdmacm.so.1 -> librdmacm.so.1.3.31.0
-rwxrwxr-x 1 rpearson rpearson  608632 Aug 10 12:31 librdmacm.so.1.3.31.0
-rwxrwxr-x 1 rpearson rpearson  138536 Aug 10 12:31 librspreload.so

So the make install seems to be deleting the .so file. Nothing like this is happening to the other libraries. 

Any help would be appreciated. I would like to be able to install this version of rdma-core on the system.

Bob Pearson

Re: Is there a simple way to install rdma-core other than making a package?

[Leon Romanovsky]

On Tue, Aug 11, 2020 at 10:41:02PM -0500, Bob Pearson wrote:
> There doesn't seem to be a documented way to make install rdma-core, at least in the README file. However trying the obvious
>
> $ bash build.sh
> $ cd build
> $ sudo make install

The build.sh script that comes with rdma-core builds libraries in-place
and is not suitable for "make install".

Thanks

Re: Is there a simple way to install rdma-core other than making a package?

[Bart Van Assche]

On 2020-08-11 20:41, Bob Pearson wrote:
> There doesn't seem to be a documented way to make install rdma-core, at least in the README file. However trying the obvious
> 
> $ bash build.sh
> $ cd build
> $ sudo make install
> 
> seems to work, almost. After a few 100 lines of promising output I get
> 
> CMake Error at librdmacm/cmake_install.cmake:76 (file):
>   file INSTALL cannot find
>   "/home/rpearson/src/rdma-core-git/build/lib/librdmacm.so.1.3.31.0": No such
>   file or directory.

This is how I do this myself:

export EXTRA_CMAKE_FLAGS="-DCMAKE_BUILD_TYPE=Debug -DENABLE_WERROR=1" &&
    mkdir -p build &&
    cd build &&
    cmake -G Ninja CFLAGS="-O0 -g" -DCMAKE_INSTALL_PREFIX=/usr .. &&
    ninja &&
    ninja install

Bart.

Re: Is there a simple way to install rdma-core other than making a package?

[Bob Pearson]

On 8/12/20 12:57 AM, Leon Romanovsky wrote:
> On Tue, Aug 11, 2020 at 10:41:02PM -0500, Bob Pearson wrote:
>> There doesn't seem to be a documented way to make install rdma-core, at least in the README file. However trying the obvious
>>
>> $ bash build.sh
>> $ cd build
>> $ sudo make install
> 
> The build.sh script that comes with rdma-core builds libraries in-place
> and is not suitable for "make install".
> 
> Thanks
> 
Agreed, but the Makefile in the build directory does respond to make install but a little incorrectly. Maybe it's just a tease to drive old farts like me crazy.

Re: Is there a simple way to install rdma-core other than making a package?

[Bob Pearson]

On 8/12/20 12:14 PM, Bart Van Assche wrote:
> On 2020-08-11 20:41, Bob Pearson wrote:
>> There doesn't seem to be a documented way to make install rdma-core, at least in the README file. However trying the obvious
>>
>> $ bash build.sh
>> $ cd build
>> $ sudo make install
>>
>> seems to work, almost. After a few 100 lines of promising output I get
>>
>> CMake Error at librdmacm/cmake_install.cmake:76 (file):
>>   file INSTALL cannot find
>>   "/home/rpearson/src/rdma-core-git/build/lib/librdmacm.so.1.3.31.0": No such
>>   file or directory.
> 
> This is how I do this myself:
> 
> export EXTRA_CMAKE_FLAGS="-DCMAKE_BUILD_TYPE=Debug -DENABLE_WERROR=1" &&
>     mkdir -p build &&
>     cd build &&
>     cmake -G Ninja CFLAGS="-O0 -g" -DCMAKE_INSTALL_PREFIX=/usr .. &&
>     ninja &&
>     ninja install
> 
> Bart.
> 
Thanks, I'll try it.

Re: Is there a simple way to install rdma-core other than making a package?

[Jason Gunthorpe]

On Wed, Aug 12, 2020 at 10:14:17AM -0700, Bart Van Assche wrote:
> On 2020-08-11 20:41, Bob Pearson wrote:
> > There doesn't seem to be a documented way to make install rdma-core, at least in the README file. However trying the obvious
> > 
> > $ bash build.sh
> > $ cd build
> > $ sudo make install
> > 
> > seems to work, almost. After a few 100 lines of promising output I get
> > 
> > CMake Error at librdmacm/cmake_install.cmake:76 (file):
> >   file INSTALL cannot find
> >   "/home/rpearson/src/rdma-core-git/build/lib/librdmacm.so.1.3.31.0": No such
> >   file or directory.
> 
> This is how I do this myself:
> 
> export EXTRA_CMAKE_FLAGS="-DCMAKE_BUILD_TYPE=Debug -DENABLE_WERROR=1" &&
>     mkdir -p build &&
>     cd build &&
>     cmake -G Ninja CFLAGS="-O0 -g" -DCMAKE_INSTALL_PREFIX=/usr .. &&
>     ninja &&
>     ninja install

I really discourage using 'make install' - rdma-core is complicated
and adds a lot of files to the system. It is very hard to undo 'make
install'.

For most things just set LD_LIBRARY_PATH=build/lib and just forget
about installing

If you do have to install use the cbuild package builders and install
the RPMs. At least that can be undone.

Jason