From mboxrd@z Thu Jan 1 00:00:00 1970 From: Majd Dibbiny Subject: Re: [nvme-fabrics]Fabrics over ROCEv2 Date: Fri, 24 Jun 2016 14:38:00 +0000 Message-ID: References: <1755342088.51635051.1466689109109.JavaMail.zimbra@kalray.eu> <20160624071312.GD4252@infradead.org> <394543770.53385548.1466766141681.JavaMail.zimbra@kalray.eu> <8AB89CFA-063B-4C85-9B68-3BAE2E9F0B1D@mellanox.com>,<1187980791.54028200.1466778741463.JavaMail.zimbra@kalray.eu> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: In-Reply-To: <1187980791.54028200.1466778741463.JavaMail.zimbra-FNhOzJFKnXGHXe+LvDLADg@public.gmane.org> Content-Language: en-US Sender: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org To: Marta Rybczynska Cc: Christoph Hellwig , "linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org" , "linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org" , Yishai Hadas , Moni Shoua List-Id: linux-rdma@vger.kernel.org > On Jun 24, 2016, at 5:32 PM, Marta Rybczynska wr= ote: >=20 >=20 >=20 > ----- Le 24 Juin 16, =E0 15:40, Majd Dibbiny majd-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org a =E9c= rit : >=20 >>> On Jun 24, 2016, at 2:02 PM, Marta Rybczynska = wrote: >>>=20 >>> Hello Christoph, >>> Thanks for the answer. I do indeed have more general problems with >>> ROCEv2: ib_send_bw works fine for ROCEv1 but not with ROCEv2. I'm >>> going to follow with the Mellanox persons as it seems to be mlx4 or >>> configuration-related. >> Hi Marta, >>=20 >> Do you run with RDMA-CM? >> Can you please provide the command lines you use and the GIDs table? >=20 > Hello Majd, > Yes, it's using RDMA-CM. I have re-connected the network and the This might be related to the fact that you need to configure the RDMA C= M mode using configfs. (By default it's V1)=20 > machines have=20 > rebooted (unrelated panic) and now it's working fine. If I'm able to = reproduce=20 > the problem, I will keep you updated. >=20 > Thanks for the help all, > Marta -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" i= n the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at http://vger.kernel.org/majordomo-info.html From mboxrd@z Thu Jan 1 00:00:00 1970 From: majd@mellanox.com (Majd Dibbiny) Date: Fri, 24 Jun 2016 14:38:00 +0000 Subject: [nvme-fabrics]Fabrics over ROCEv2 In-Reply-To: <1187980791.54028200.1466778741463.JavaMail.zimbra@kalray.eu> References: <1755342088.51635051.1466689109109.JavaMail.zimbra@kalray.eu> <20160624071312.GD4252@infradead.org> <394543770.53385548.1466766141681.JavaMail.zimbra@kalray.eu> <8AB89CFA-063B-4C85-9B68-3BAE2E9F0B1D@mellanox.com>, <1187980791.54028200.1466778741463.JavaMail.zimbra@kalray.eu> Message-ID: > On Jun 24, 2016,@5:32 PM, Marta Rybczynska wrote: > > > > ----- Le 24 Juin 16, ? 15:40, Majd Dibbiny majd at mellanox.com a ?crit : > >>> On Jun 24, 2016,@2:02 PM, Marta Rybczynska wrote: >>> >>> Hello Christoph, >>> Thanks for the answer. I do indeed have more general problems with >>> ROCEv2: ib_send_bw works fine for ROCEv1 but not with ROCEv2. I'm >>> going to follow with the Mellanox persons as it seems to be mlx4 or >>> configuration-related. >> Hi Marta, >> >> Do you run with RDMA-CM? >> Can you please provide the command lines you use and the GIDs table? > > Hello Majd, > Yes, it's using RDMA-CM. I have re-connected the network and the This might be related to the fact that you need to configure the RDMA CM mode using configfs. (By default it's V1) > machines have > rebooted (unrelated panic) and now it's working fine. If I'm able to reproduce > the problem, I will keep you updated. > > Thanks for the help all, > Marta