Tutorials/howto to modify exiting tcp/ip app for rdma

Tutorials/howto to modify exiting tcp/ip app for rdma

[Vasiliy Tolstov]

Hello.
I want to study ibverbs,rdma. I have application that use tcp/ip for
transfer data.
I want to add rdma support,avoiding usage IPoIB. So I want to write
app that can find and connect to other nodes via guides.
Does somebody share for me some links or how can I find it?
Thanks


-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Tutorials/howto to modify exiting tcp/ip app for rdma

[Vasiliy Tolstov]

2014-11-23 23:41 GMT+03:00 Vasiliy Tolstov <v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org>:
> Hello.
> I want to study ibverbs,rdma. I have application that use tcp/ip for
> transfer data.
> I want to add rdma support,avoiding usage IPoIB. So I want to write
> app that can find and connect to other nodes via guides.
> Does somebody share for me some links or how can I find it?
> Thanks


Anybody can't help?

-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

RE: Tutorials/howto to modify exiting tcp/ip app for rdma

[Rupert Dance]

Vasiliy,

Please review the OpenFabrics Alliance site and consider posting this question to the OFA User group.

OFA: https://www.openfabrics.org/index.php 
User Group: http://lists.openfabrics.org/mailman/listinfo/users 
OFS User Portal: https://www.openfabrics.org/index.php/ofs-users.html 

Thanks

Rupert

-----Original Message-----
From: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org [mailto:linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org] On Behalf Of Vasiliy Tolstov
Sent: Thursday, November 27, 2014 6:53 AM
To: Vasiliy Tolstov
Cc: linux-rdma
Subject: Re: Tutorials/howto to modify exiting tcp/ip app for rdma

2014-11-23 23:41 GMT+03:00 Vasiliy Tolstov <v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org>:
> Hello.
> I want to study ibverbs,rdma. I have application that use tcp/ip for 
> transfer data.
> I want to add rdma support,avoiding usage IPoIB. So I want to write 
> app that can find and connect to other nodes via guides.
> Does somebody share for me some links or how can I find it?
> Thanks


Anybody can't help?

--
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at  http://vger.kernel.org/majordomo-info.html


--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Tutorials/howto to modify exiting tcp/ip app for rdma

[Sagi Grimberg]

On 11/23/2014 10:41 PM, Vasiliy Tolstov wrote:
> Hello.
> I want to study ibverbs,rdma. I have application that use tcp/ip for
> transfer data.
> I want to add rdma support,avoiding usage IPoIB. So I want to write
> app that can find and connect to other nodes via guides.
> Does somebody share for me some links or how can I find it?
> Thanks
>
>

You can keep doing IP address resolution using rdma_cm.

You can see perftest examples in 
git://flatbed.openfabrics.org/~grockah/perftest.git
Or,
librdmacm's rping in git://flatbed.openfabrics.org/~shefty/librdmacm.git

Cheers,
Sagi.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Tutorials/howto to modify exiting tcp/ip app for rdma

[Vasiliy Tolstov]

2014-11-27 16:39 GMT+03:00 Sagi Grimberg <sagig-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>:
> You can keep doing IP address resolution using rdma_cm.
>
> You can see perftest examples in
> git://flatbed.openfabrics.org/~grockah/perftest.git
> Or,
> librdmacm's rping in git://flatbed.openfabrics.org/~shefty/librdmacm.git


Thanks! But if don't have ipoib connection why i need ip address ?=)

-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Tutorials/howto to modify exiting tcp/ip app for rdma

[Vasiliy Tolstov]

2014-11-27 15:28 GMT+03:00 Rupert Dance <rsdance-rzwDkyJvnYokmLvzuZlaBw@public.gmane.org>:
> Vasiliy,
>
> Please review the OpenFabrics Alliance site and consider posting this question to the OFA User group.
>
> OFA: https://www.openfabrics.org/index.php
> User Group: http://lists.openfabrics.org/mailman/listinfo/users
> OFS User Portal: https://www.openfabrics.org/index.php/ofs-users.html
>
> Thanks


Thanks, i'm try.

-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Tutorials/howto to modify exiting tcp/ip app for rdma

[Sagi Grimberg]

On 11/27/2014 4:39 PM, Vasiliy Tolstov wrote:
> 2014-11-27 16:39 GMT+03:00 Sagi Grimberg <sagig-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>:
>> You can keep doing IP address resolution using rdma_cm.
>>
>> You can see perftest examples in
>> git://flatbed.openfabrics.org/~grockah/perftest.git
>> Or,
>> librdmacm's rping in git://flatbed.openfabrics.org/~shefty/librdmacm.git
>
>
> Thanks! But if don't have ipoib connection why i need ip address ?=)
>

My understanding was that you want to _add_ support for RDMA to a
working tcp/ip application, the natural thing is using rdma_cm.

If you want to replace IP address resolution you need to start
communicating with the SM.

srptools is a nice example for that:
git://flatbed.openfabrics.org/~bvanassche/srptools.git/.git

Sagi.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Tutorials/howto to modify exiting tcp/ip app for rdma

[Hal Rosenstock]

On 11/27/2014 10:20 AM, Sagi Grimberg wrote:
> On 11/27/2014 4:39 PM, Vasiliy Tolstov wrote:
>> 2014-11-27 16:39 GMT+03:00 Sagi Grimberg <sagig-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>:
>>> You can keep doing IP address resolution using rdma_cm.
>>>
>>> You can see perftest examples in
>>> git://flatbed.openfabrics.org/~grockah/perftest.git
>>> Or,
>>> librdmacm's rping in git://flatbed.openfabrics.org/~shefty/librdmacm.git
>>
>>
>> Thanks! But if don't have ipoib connection why i need ip address ?=)
>>
> 
> My understanding was that you want to _add_ support for RDMA to a
> working tcp/ip application, the natural thing is using rdma_cm.
> 
> If you want to replace IP address resolution you need to start
> communicating with the SM.

rsockets now supports AF_IB address family (assuming kernel does too -
3.11 or beyond) but you need the path record to the destination IB
address (GID) to make the connection so that involves an SA query or the
equivalent...

-- Hal

> 
> srptools is a nice example for that:
> git://flatbed.openfabrics.org/~bvanassche/srptools.git/.git
> 
> Sagi.
> -- 
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Tutorials/howto to modify exiting tcp/ip app for rdma

[Hal Rosenstock]

On 11/27/2014 11:58 AM, Hal Rosenstock wrote:
> On 11/27/2014 10:20 AM, Sagi Grimberg wrote:
>> On 11/27/2014 4:39 PM, Vasiliy Tolstov wrote:
>>> 2014-11-27 16:39 GMT+03:00 Sagi Grimberg <sagig-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>:
>>>> You can keep doing IP address resolution using rdma_cm.
>>>>
>>>> You can see perftest examples in
>>>> git://flatbed.openfabrics.org/~grockah/perftest.git
>>>> Or,
>>>> librdmacm's rping in git://flatbed.openfabrics.org/~shefty/librdmacm.git
>>>
>>>
>>> Thanks! But if don't have ipoib connection why i need ip address ?=)
>>>
>>
>> My understanding was that you want to _add_ support for RDMA to a
>> working tcp/ip application, the natural thing is using rdma_cm.
>>
>> If you want to replace IP address resolution you need to start
>> communicating with the SM.
> 
> rsockets now supports AF_IB address family (assuming kernel does too -
> 3.11 or beyond) but you need the path record to the destination IB
> address (GID) to make the connection so that involves an SA query or the
> equivalent...

Also, you need librdmacm 1.0.19-1 or later for this.

rstream is the best example of how to use AF_IB.

-- Hal

> 
> -- Hal
> 
>>
>> srptools is a nice example for that:
>> git://flatbed.openfabrics.org/~bvanassche/srptools.git/.git
>>
>> Sagi.
>> -- 
>> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
>> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>
> 

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Tutorials/howto to modify exiting tcp/ip app for rdma

[Vasiliy Tolstov]

2014-11-28 19:08 GMT+03:00 Hal Rosenstock <hal-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>:
> Also, you need librdmacm 1.0.19-1 or later for this.
>
> rstream is the best example of how to use AF_IB.


THanks! As i understand i need kernel for example 3.14... =) and
librdmacm 1.0.19 or later and use rsockets to replace tcp/ip.
How about resolving? Sorry i'm try to take all pieces =).
For example i see that rdma_getaddrinfo can resolve address, but as i
see http://manpages.ubuntu.com/manpages/raring/man3/rdma_resolve_addr.3.html
i need ipoib.
In case of pure RDMA network without IP as i understand i need to
check opensm sources?
whether there is somewhere the minimum example how to work with guid
of ports without use ipoib ?
-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html