* [PATCH infiniband-diags] ibportstate: Fixed peer port probing when using DR routing
@ 2016-09-23 6:42 Knut Omang
[not found] ` <430aa17fd12cdcfd735b4215938dc4279e33572d.1474612678.git-series.knut.omang-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
0 siblings, 1 reply; 4+ messages in thread
From: Knut Omang @ 2016-09-23 6:42 UTC (permalink / raw)
To: Ira Weiny
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA, Line Holen, Knut Omang, Dag Moxnes
From: Dag Moxnes <dag.moxnes-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
When querying a remote port using ibportportstate, queries to the peer port
would result in timeouts. The reason for this is that the DR path (or partial
DR path was not correctly constructed.
Signed-off-by: Dag Moxnes <dag.moxnes-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
Reviewed-by: Line Holen <line.holen-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
Signed-off-by: Knut Omang <knut.omang-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
---
src/ibportstate.c | 36 +++++++++++++++++++++++++++---------
1 file changed, 27 insertions(+), 9 deletions(-)
diff --git a/src/ibportstate.c b/src/ibportstate.c
index cb47aa9..cd0f680 100644
--- a/src/ibportstate.c
+++ b/src/ibportstate.c
@@ -1,6 +1,8 @@
/*
* Copyright (c) 2004-2009 Voltaire Inc. All rights reserved.
* Copyright (c) 2010,2011 Mellanox Technologies LTD. All rights reserved.
+ * Copyright (c) 2011, 2015, Oracle and/or its affiliates. All rights reserved.
+ *
*
* This software is available to you under a choice of one of two
* licenses. You may choose to be licensed under the terms of the GNU
@@ -655,15 +657,31 @@ int main(int argc, char **argv)
/* Setup portid for peer port */
memcpy(&peerportid, &portid, sizeof(peerportid));
- peerportid.drpath.cnt = 1;
- peerportid.drpath.p[1] = (uint8_t) portnum;
-
- /* Set DrSLID to local lid */
- if (resolve_self(ibd_ca, ibd_ca_port, &selfportid,
- &selfport, 0) < 0)
- IBEXIT("could not resolve self");
- peerportid.drpath.drslid = (uint16_t) selfportid.lid;
- peerportid.drpath.drdlid = 0xffff;
+ if (portid.lid == 0) {
+ peerportid.drpath.cnt = portid.drpath.cnt + 1;
+ if (peerportid.drpath.cnt == IB_SUBNET_PATH_HOPS_MAX) {
+ exit(0);
+ }
+ peerportid.drpath.p[peerportid.drpath.cnt] = (uint8_t) portnum;
+ } else {
+ /* Set DrSLID to local lid */
+ if (resolve_portid_str(ibd_ca, ibd_ca_port, &portid, argv[0],
+ ibd_dest_type, ibd_sm_id, srcport) < 0)
+ IBEXIT("could not resolve self");
+
+ peerportid.drpath.cnt = 1;
+ peerportid.drpath.p[1] = (uint8_t) portnum;
+
+
+ /* Use partial LID routing if remote switch */
+ if ((portid.lid == selfportid.lid)) {
+ peerportid.drpath.drslid = 0xffff;
+ peerportid.drpath.drdlid = 0xffff;
+ } else {
+ peerportid.drpath.drslid = selfportid.lid;
+ peerportid.drpath.drdlid = 0xffff;
+ }
+ }
/* Get peer port NodeInfo to obtain peer port number */
is_peer_switch = get_node_info(&peerportid, data);
base-commit: 2937cf99350a2e423b705e8b8dd10499796a7b41
--
git-series 0.8.10
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply related [flat|nested] 4+ messages in thread
* Re: [PATCH infiniband-diags] ibportstate: Fixed peer port probing when using DR routing
[not found] ` <430aa17fd12cdcfd735b4215938dc4279e33572d.1474612678.git-series.knut.omang-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
@ 2016-09-23 13:06 ` Hal Rosenstock
[not found] ` <01da2b4d-270a-f8c9-3d5f-ec7a4c0b7d22-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
0 siblings, 1 reply; 4+ messages in thread
From: Hal Rosenstock @ 2016-09-23 13:06 UTC (permalink / raw)
To: Knut Omang, Ira Weiny
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA, Line Holen, Dag Moxnes
On 9/23/2016 2:42 AM, Knut Omang wrote:
> From: Dag Moxnes <dag.moxnes-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
Title might be better as:
ibportstate: Fixed switch peer port probing when using DR routing
>
> When querying a remote port
on a switch
> using ibportportstate,
Typo: ibportstate
> queries to the peer port
> would result in timeouts. The reason for this is that the DR path (or partial
> DR path was not correctly constructed.
It looks like there are 2 cases fixed below and it's best to describe
them. My take on it is:
1. local LID (for switch port 0) is not yet configured
2. SMI requester port (I think this is what you term remote port above)
is on local rather than remote switch
Is that accurate ?
> Signed-off-by: Dag Moxnes <dag.moxnes-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> Reviewed-by: Line Holen <line.holen-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> Signed-off-by: Knut Omang <knut.omang-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> ---
> src/ibportstate.c | 36 +++++++++++++++++++++++++++---------
> 1 file changed, 27 insertions(+), 9 deletions(-)
>
> diff --git a/src/ibportstate.c b/src/ibportstate.c
> index cb47aa9..cd0f680 100644
> --- a/src/ibportstate.c
> +++ b/src/ibportstate.c
> @@ -1,6 +1,8 @@
> /*
> * Copyright (c) 2004-2009 Voltaire Inc. All rights reserved.
> * Copyright (c) 2010,2011 Mellanox Technologies LTD. All rights reserved.
> + * Copyright (c) 2011, 2015, Oracle and/or its affiliates. All rights reserved.
> + *
> *
> * This software is available to you under a choice of one of two
> * licenses. You may choose to be licensed under the terms of the GNU
> @@ -655,15 +657,31 @@ int main(int argc, char **argv)
>
> /* Setup portid for peer port */
> memcpy(&peerportid, &portid, sizeof(peerportid));
> - peerportid.drpath.cnt = 1;
> - peerportid.drpath.p[1] = (uint8_t) portnum;
> -
> - /* Set DrSLID to local lid */
> - if (resolve_self(ibd_ca, ibd_ca_port, &selfportid,
> - &selfport, 0) < 0)
> - IBEXIT("could not resolve self");
> - peerportid.drpath.drslid = (uint16_t) selfportid.lid;
> - peerportid.drpath.drdlid = 0xffff;
> + if (portid.lid == 0) {
> + peerportid.drpath.cnt = portid.drpath.cnt + 1;
> + if (peerportid.drpath.cnt == IB_SUBNET_PATH_HOPS_MAX) {
> + exit(0);
Nit: IBEXIT("Too many hops") rather than exit(0)
> + }
> + peerportid.drpath.p[peerportid.drpath.cnt] = (uint8_t) portnum;
> + } else {
> + /* Set DrSLID to local lid */
> + if (resolve_portid_str(ibd_ca, ibd_ca_port, &portid, argv[0],
> + ibd_dest_type, ibd_sm_id, srcport) < 0)
> + IBEXIT("could not resolve self");
> +
> + peerportid.drpath.cnt = 1;
> + peerportid.drpath.p[1] = (uint8_t) portnum;
> +
> +
Nit: Eliminate extra blank line
> + /* Use partial LID routing if remote switch */
> + if ((portid.lid == selfportid.lid)) {
> + peerportid.drpath.drslid = 0xffff;
> + peerportid.drpath.drdlid = 0xffff;
> + } else {
> + peerportid.drpath.drslid = selfportid.lid;
> + peerportid.drpath.drdlid = 0xffff;
> + }
The following can be factored out of the above if/else:
peerportid.drpath.drdlid = 0xffff;
> + }
>
> /* Get peer port NodeInfo to obtain peer port number */
> is_peer_switch = get_node_info(&peerportid, data);
>
> base-commit: 2937cf99350a2e423b705e8b8dd10499796a7b41
>
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PATCH infiniband-diags] ibportstate: Fixed peer port probing when using DR routing
[not found] ` <01da2b4d-270a-f8c9-3d5f-ec7a4c0b7d22-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
@ 2016-09-26 5:34 ` ira.weiny
[not found] ` <20160926053442.GE29780-W4f6Xiosr+yv7QzWx2u06xL4W9x8LtSr@public.gmane.org>
0 siblings, 1 reply; 4+ messages in thread
From: ira.weiny @ 2016-09-26 5:34 UTC (permalink / raw)
To: Hal Rosenstock
Cc: Knut Omang, linux-rdma-u79uwXL29TY76Z2rM5mHXA, Line Holen, Dag Moxnes
On Fri, Sep 23, 2016 at 09:06:45AM -0400, Hal Rosenstock wrote:
> On 9/23/2016 2:42 AM, Knut Omang wrote:
> > From: Dag Moxnes <dag.moxnes-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
>
> Title might be better as:
> ibportstate: Fixed switch peer port probing when using DR routing
Agreed.
>
> >
> > When querying a remote port
>
> on a switch
>
> > using ibportportstate,
>
> Typo: ibportstate
>
> > queries to the peer port
> > would result in timeouts. The reason for this is that the DR path (or partial
> > DR path was not correctly constructed.
>
> It looks like there are 2 cases fixed below and it's best to describe
> them. My take on it is:
> 1. local LID (for switch port 0) is not yet configured
> 2. SMI requester port (I think this is what you term remote port above)
> is on local rather than remote switch
> Is that accurate ?
>
> > Signed-off-by: Dag Moxnes <dag.moxnes-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> > Reviewed-by: Line Holen <line.holen-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> > Signed-off-by: Knut Omang <knut.omang-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> > ---
> > src/ibportstate.c | 36 +++++++++++++++++++++++++++---------
> > 1 file changed, 27 insertions(+), 9 deletions(-)
> >
> > diff --git a/src/ibportstate.c b/src/ibportstate.c
> > index cb47aa9..cd0f680 100644
> > --- a/src/ibportstate.c
> > +++ b/src/ibportstate.c
> > @@ -1,6 +1,8 @@
> > /*
> > * Copyright (c) 2004-2009 Voltaire Inc. All rights reserved.
> > * Copyright (c) 2010,2011 Mellanox Technologies LTD. All rights reserved.
> > + * Copyright (c) 2011, 2015, Oracle and/or its affiliates. All rights reserved.
> > + *
> > *
> > * This software is available to you under a choice of one of two
> > * licenses. You may choose to be licensed under the terms of the GNU
> > @@ -655,15 +657,31 @@ int main(int argc, char **argv)
> >
> > /* Setup portid for peer port */
> > memcpy(&peerportid, &portid, sizeof(peerportid));
> > - peerportid.drpath.cnt = 1;
> > - peerportid.drpath.p[1] = (uint8_t) portnum;
> > -
> > - /* Set DrSLID to local lid */
> > - if (resolve_self(ibd_ca, ibd_ca_port, &selfportid,
> > - &selfport, 0) < 0)
> > - IBEXIT("could not resolve self");
> > - peerportid.drpath.drslid = (uint16_t) selfportid.lid;
> > - peerportid.drpath.drdlid = 0xffff;
> > + if (portid.lid == 0) {
> > + peerportid.drpath.cnt = portid.drpath.cnt + 1;
Nit: peerportid.drpath.cnt++;
Ira
> > + if (peerportid.drpath.cnt == IB_SUBNET_PATH_HOPS_MAX) {
> > + exit(0);
>
> Nit: IBEXIT("Too many hops") rather than exit(0)
>
> > + }
> > + peerportid.drpath.p[peerportid.drpath.cnt] = (uint8_t) portnum;
> > + } else {
> > + /* Set DrSLID to local lid */
> > + if (resolve_portid_str(ibd_ca, ibd_ca_port, &portid, argv[0],
> > + ibd_dest_type, ibd_sm_id, srcport) < 0)
> > + IBEXIT("could not resolve self");
> > +
> > + peerportid.drpath.cnt = 1;
> > + peerportid.drpath.p[1] = (uint8_t) portnum;
> > +
> > +
>
> Nit: Eliminate extra blank line
>
> > + /* Use partial LID routing if remote switch */
> > + if ((portid.lid == selfportid.lid)) {
> > + peerportid.drpath.drslid = 0xffff;
> > + peerportid.drpath.drdlid = 0xffff;
> > + } else {
> > + peerportid.drpath.drslid = selfportid.lid;
> > + peerportid.drpath.drdlid = 0xffff;
> > + }
>
> The following can be factored out of the above if/else:
> peerportid.drpath.drdlid = 0xffff;
>
> > + }
> >
> > /* Get peer port NodeInfo to obtain peer port number */
> > is_peer_switch = get_node_info(&peerportid, data);
> >
> > base-commit: 2937cf99350a2e423b705e8b8dd10499796a7b41
> >
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PATCH infiniband-diags] ibportstate: Fixed peer port probing when using DR routing
[not found] ` <20160926053442.GE29780-W4f6Xiosr+yv7QzWx2u06xL4W9x8LtSr@public.gmane.org>
@ 2016-09-26 8:12 ` Dag Moxnes
0 siblings, 0 replies; 4+ messages in thread
From: Dag Moxnes @ 2016-09-26 8:12 UTC (permalink / raw)
To: ira.weiny, Hal Rosenstock
Cc: Knut Omang, linux-rdma-u79uwXL29TY76Z2rM5mHXA, Line Holen
On 09/26/2016 07:34 AM, ira.weiny wrote:
> On Fri, Sep 23, 2016 at 09:06:45AM -0400, Hal Rosenstock wrote:
>> On 9/23/2016 2:42 AM, Knut Omang wrote:
>>> From: Dag Moxnes <dag.moxnes-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
>> Title might be better as:
>> ibportstate: Fixed switch peer port probing when using DR routing
> Agreed.
Thanks for the suggestion. I will change this.
>
>
>>> When querying a remote port
>> on a switch
I will change this.
>>
>>> using ibportportstate,
>> Typo: ibportstate
I will change this.
>>
>>> queries to the peer port
>>> would result in timeouts. The reason for this is that the DR path (or partial
>>> DR path was not correctly constructed.
>> It looks like there are 2 cases fixed below and it's best to describe
>> them. My take on it is:
>> 1. local LID (for switch port 0) is not yet configured
>> 2. SMI requester port (I think this is what you term remote port above)
>> is on local rather than remote switch
>> Is that accurate ?
It is correct that this patch does cover 2 cases.
The two cases are:
1. The user has run ibportstate with a direct route, e.g.
"ibportstate -D 0,1,15 6"
In this case, the current implementation will use a direct route of
"0,6" when probing the peer node. Instead, the portnumber it should
be using the
direct route "0,1,15,6".
2. The other case is actually a workaround for a problem with partial DR
routing on
some of our switches. As this is a workaround for a problem
elsewhere, I release
that it should not be part of the ibportstate utility. I will
remove this part of the
commit.
>>
>>> Signed-off-by: Dag Moxnes <dag.moxnes-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
>>> Reviewed-by: Line Holen <line.holen-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
>>> Signed-off-by: Knut Omang <knut.omang-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
>>> ---
>>> src/ibportstate.c | 36 +++++++++++++++++++++++++++---------
>>> 1 file changed, 27 insertions(+), 9 deletions(-)
>>>
>>> diff --git a/src/ibportstate.c b/src/ibportstate.c
>>> index cb47aa9..cd0f680 100644
>>> --- a/src/ibportstate.c
>>> +++ b/src/ibportstate.c
>>> @@ -1,6 +1,8 @@
>>> /*
>>> * Copyright (c) 2004-2009 Voltaire Inc. All rights reserved.
>>> * Copyright (c) 2010,2011 Mellanox Technologies LTD. All rights reserved.
>>> + * Copyright (c) 2011, 2015, Oracle and/or its affiliates. All rights reserved.
>>> + *
>>> *
>>> * This software is available to you under a choice of one of two
>>> * licenses. You may choose to be licensed under the terms of the GNU
>>> @@ -655,15 +657,31 @@ int main(int argc, char **argv)
>>>
>>> /* Setup portid for peer port */
>>> memcpy(&peerportid, &portid, sizeof(peerportid));
>>> - peerportid.drpath.cnt = 1;
>>> - peerportid.drpath.p[1] = (uint8_t) portnum;
>>> -
>>> - /* Set DrSLID to local lid */
>>> - if (resolve_self(ibd_ca, ibd_ca_port, &selfportid,
>>> - &selfport, 0) < 0)
>>> - IBEXIT("could not resolve self");
>>> - peerportid.drpath.drslid = (uint16_t) selfportid.lid;
>>> - peerportid.drpath.drdlid = 0xffff;
>>> + if (portid.lid == 0) {
>>> + peerportid.drpath.cnt = portid.drpath.cnt + 1;
> Nit: peerportid.drpath.cnt++;
Thanks I will change that.
>
> Ira
>
>>> + if (peerportid.drpath.cnt == IB_SUBNET_PATH_HOPS_MAX) {
>>> + exit(0);
>> Nit: IBEXIT("Too many hops") rather than exit(0)
Thanks, I will correct that.
>>
>>> + }
>>> + peerportid.drpath.p[peerportid.drpath.cnt] = (uint8_t) portnum;
>>> + } else {
>>> + /* Set DrSLID to local lid */
>>> + if (resolve_portid_str(ibd_ca, ibd_ca_port, &portid, argv[0],
>>> + ibd_dest_type, ibd_sm_id, srcport) < 0)
>>> + IBEXIT("could not resolve self");
>>> +
>>> + peerportid.drpath.cnt = 1;
>>> + peerportid.drpath.p[1] = (uint8_t) portnum;
>>> +
>>> +
>> Nit: Eliminate extra blank line
Thanks, I will correct that.
>>
>>> + /* Use partial LID routing if remote switch */
>>> + if ((portid.lid == selfportid.lid)) {
>>> + peerportid.drpath.drslid = 0xffff;
>>> + peerportid.drpath.drdlid = 0xffff;
>>> + } else {
>>> + peerportid.drpath.drslid = selfportid.lid;
>>> + peerportid.drpath.drdlid = 0xffff;
>>> + }
>> The following can be factored out of the above if/else:
>> peerportid.drpath.drdlid = 0xffff;
Thanks, I will do that (I believe this will removed from the commit as
explained above).
>>
>>> + }
>>>
>>> /* Get peer port NodeInfo to obtain peer port number */
>>> is_peer_switch = get_node_info(&peerportid, data);
>>>
>>> base-commit: 2937cf99350a2e423b705e8b8dd10499796a7b41
>>>
Thanks for the review,
Dag
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2016-09-26 8:12 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-09-23 6:42 [PATCH infiniband-diags] ibportstate: Fixed peer port probing when using DR routing Knut Omang
[not found] ` <430aa17fd12cdcfd735b4215938dc4279e33572d.1474612678.git-series.knut.omang-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2016-09-23 13:06 ` Hal Rosenstock
[not found] ` <01da2b4d-270a-f8c9-3d5f-ec7a4c0b7d22-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2016-09-26 5:34 ` ira.weiny
[not found] ` <20160926053442.GE29780-W4f6Xiosr+yv7QzWx2u06xL4W9x8LtSr@public.gmane.org>
2016-09-26 8:12 ` Dag Moxnes
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.