All of lore.kernel.org
 help / color / mirror / Atom feed
From: Or Gerlitz <ogerlitz-smomgflXvOZWk0Htik3J/w@public.gmane.org>
To: Sean Hefty <sean.hefty-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>,
	Roland Dreier <rolandd-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
Cc: linux-rdma <linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Jason Gunthorpe
	<jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
Subject: Re: QoS in local SA entity
Date: Thu, 05 Nov 2009 14:07:38 +0200	[thread overview]
Message-ID: <4AF2C00A.4040808@voltaire.com> (raw)

>
> I think this really needs to be discussed wrt the implementation of the entity providing the path records.
fair-enough, lets do it then...

> I think what's needed is a way for the SA to distribute QoS information to the end nodes, so that the decisions can be made locally.  If someone wants some sort of dynamic QoS management and is happy using a small cluster, then they can disable any local SA entities and contact the SA directly.

I believe we can go also on a middle way, where the SA isn't contacted 
directly using path query for each resolution, but rather "indirectly" 
e.g using a dedicated multicast based protocol.

> In the case of ACM, the pkey is embedded in the MGID.  'Something' could tell the SA to create ACM multicast groups using a specific SL for a given MGID or pkey in the join request.  That SL would be distributed to the end nodes when they joined their groups.

So assuming ACM supports AF_INET, using network stack route lookup on 
the destination address / rdma_bind on the source address, etc as we 
discussed, ACM can use the rdma-cm to resolve the pkey, then use this 
pkey the MGID and a management software could tell the SA to use a 
specific SL for MGIDs on this partition. Next, ACM can use this SL in 
the path it generates for the IB connection, makes sense?

> The entity that provides the path records cannot depend on calling into the librdmacm.  The dependency needs to go the other way.
I understand that you want to be dependent less as much as possible, but 
I believe that my suggestion doesn't contradict your design but rather 
enhance it.

Or.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

             reply	other threads:[~2009-11-05 12:07 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-11-05 12:07 Or Gerlitz [this message]
     [not found] ` <4AF2C00A.4040808-smomgflXvOZWk0Htik3J/w@public.gmane.org>
2009-11-05 16:40   ` QoS in local SA entity Sean Hefty
     [not found]     ` <9BF1CEFA7F6F44F5B5641065C4914EB5-Zpru7NauK7drdx17CPfAsdBPR1lH4CV8@public.gmane.org>
2009-11-08  6:25       ` Or Gerlitz
     [not found]         ` <4AF66473.2050303-smomgflXvOZWk0Htik3J/w@public.gmane.org>
2009-11-09  0:56           ` Jason Gunthorpe
     [not found]             ` <20091109005607.GV1966-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2009-11-09  7:44               ` Or Gerlitz
     [not found]                 ` <4AF7C85F.5000604-smomgflXvOZWk0Htik3J/w@public.gmane.org>
2009-11-09  8:08                   ` Jason Gunthorpe
     [not found]                     ` <20091109080812.GX1966-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2009-11-10  5:51                       ` Or Gerlitz
2009-11-09 18:38           ` Sean Hefty
     [not found]             ` <5C9CD47F123648F0A926E151BF775484-Zpru7NauK7drdx17CPfAsdBPR1lH4CV8@public.gmane.org>
2009-11-10  5:29               ` Or Gerlitz

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4AF2C00A.4040808@voltaire.com \
    --to=ogerlitz-smomgflxvozwk0htik3j/w@public.gmane.org \
    --cc=jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=rolandd-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org \
    --cc=sean.hefty-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.