All of lore.kernel.org
 help / color / mirror / Atom feed
From: Chuck Lever <chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
To: anna.schumaker-HgOvQuBEEgTQT0dZR+AlfA@public.gmane.org
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: [PATCH v3 08/22] xprtrdma: Use smaller buffers for RPC-over-RDMA headers
Date: Thu, 15 Sep 2016 10:56:02 -0400	[thread overview]
Message-ID: <20160915145601.11080.32594.stgit@manet.1015granger.net> (raw)
In-Reply-To: <20160915143440.11080.89241.stgit-FYjufvaPoItvLzlybtyyYzGyq/o6K9yX@public.gmane.org>

Commit 949317464bc2 ("xprtrdma: Limit number of RDMA segments in
RPC-over-RDMA headers") capped the number of chunks that may appear
in RPC-over-RDMA headers. The maximum header size can be estimated
and fixed to avoid allocating buffer space that is never used.

Signed-off-by: Chuck Lever <chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
---
 net/sunrpc/xprtrdma/backchannel.c |    5 ++---
 net/sunrpc/xprtrdma/transport.c   |    2 +-
 net/sunrpc/xprtrdma/xprt_rdma.h   |    5 ++++-
 3 files changed, 7 insertions(+), 5 deletions(-)

diff --git a/net/sunrpc/xprtrdma/backchannel.c b/net/sunrpc/xprtrdma/backchannel.c
index c4904f8..60fc991 100644
--- a/net/sunrpc/xprtrdma/backchannel.c
+++ b/net/sunrpc/xprtrdma/backchannel.c
@@ -45,13 +45,12 @@ static int rpcrdma_bc_setup_rqst(struct rpcrdma_xprt *r_xprt,
 		return PTR_ERR(req);
 	req->rl_backchannel = true;
 
-	size = r_xprt->rx_data.inline_wsize;
-	rb = rpcrdma_alloc_regbuf(ia, size, GFP_KERNEL);
+	rb = rpcrdma_alloc_regbuf(ia, RPCRDMA_HDRBUF_SIZE, GFP_KERNEL);
 	if (IS_ERR(rb))
 		goto out_fail;
 	req->rl_rdmabuf = rb;
 
-	size += r_xprt->rx_data.inline_rsize;
+	size = r_xprt->rx_data.inline_rsize;
 	rb = rpcrdma_alloc_regbuf(ia, size, GFP_KERNEL);
 	if (IS_ERR(rb))
 		goto out_fail;
diff --git a/net/sunrpc/xprtrdma/transport.c b/net/sunrpc/xprtrdma/transport.c
index ecdc3ad..94dbfd3 100644
--- a/net/sunrpc/xprtrdma/transport.c
+++ b/net/sunrpc/xprtrdma/transport.c
@@ -484,7 +484,7 @@ static bool
 rpcrdma_get_rdmabuf(struct rpcrdma_xprt *r_xprt, struct rpcrdma_req *req,
 		    gfp_t flags)
 {
-	size_t size = r_xprt->rx_data.inline_wsize;
+	size_t size = RPCRDMA_HDRBUF_SIZE;
 	struct rpcrdma_regbuf *rb;
 
 	if (req->rl_rdmabuf)
diff --git a/net/sunrpc/xprtrdma/xprt_rdma.h b/net/sunrpc/xprtrdma/xprt_rdma.h
index 444f637..cc426b1 100644
--- a/net/sunrpc/xprtrdma/xprt_rdma.h
+++ b/net/sunrpc/xprtrdma/xprt_rdma.h
@@ -160,7 +160,10 @@ rdmab_to_msg(struct rpcrdma_regbuf *rb)
  * The smallest inline threshold is 1024 bytes, ensuring that
  * at least 750 bytes are available for RPC messages.
  */
-#define RPCRDMA_MAX_HDR_SEGS	(8)
+enum {
+	RPCRDMA_MAX_HDR_SEGS = 8,
+	RPCRDMA_HDRBUF_SIZE = 256,
+};
 
 /*
  * struct rpcrdma_rep -- this structure encapsulates state required to recv

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

WARNING: multiple messages have this Message-ID (diff)
From: Chuck Lever <chuck.lever@oracle.com>
To: anna.schumaker@netapp.com
Cc: linux-rdma@vger.kernel.org, linux-nfs@vger.kernel.org
Subject: [PATCH v3 08/22] xprtrdma: Use smaller buffers for RPC-over-RDMA headers
Date: Thu, 15 Sep 2016 10:56:02 -0400	[thread overview]
Message-ID: <20160915145601.11080.32594.stgit@manet.1015granger.net> (raw)
In-Reply-To: <20160915143440.11080.89241.stgit@manet.1015granger.net>

Commit 949317464bc2 ("xprtrdma: Limit number of RDMA segments in
RPC-over-RDMA headers") capped the number of chunks that may appear
in RPC-over-RDMA headers. The maximum header size can be estimated
and fixed to avoid allocating buffer space that is never used.

Signed-off-by: Chuck Lever <chuck.lever@oracle.com>
---
 net/sunrpc/xprtrdma/backchannel.c |    5 ++---
 net/sunrpc/xprtrdma/transport.c   |    2 +-
 net/sunrpc/xprtrdma/xprt_rdma.h   |    5 ++++-
 3 files changed, 7 insertions(+), 5 deletions(-)

diff --git a/net/sunrpc/xprtrdma/backchannel.c b/net/sunrpc/xprtrdma/backchannel.c
index c4904f8..60fc991 100644
--- a/net/sunrpc/xprtrdma/backchannel.c
+++ b/net/sunrpc/xprtrdma/backchannel.c
@@ -45,13 +45,12 @@ static int rpcrdma_bc_setup_rqst(struct rpcrdma_xprt *r_xprt,
 		return PTR_ERR(req);
 	req->rl_backchannel = true;
 
-	size = r_xprt->rx_data.inline_wsize;
-	rb = rpcrdma_alloc_regbuf(ia, size, GFP_KERNEL);
+	rb = rpcrdma_alloc_regbuf(ia, RPCRDMA_HDRBUF_SIZE, GFP_KERNEL);
 	if (IS_ERR(rb))
 		goto out_fail;
 	req->rl_rdmabuf = rb;
 
-	size += r_xprt->rx_data.inline_rsize;
+	size = r_xprt->rx_data.inline_rsize;
 	rb = rpcrdma_alloc_regbuf(ia, size, GFP_KERNEL);
 	if (IS_ERR(rb))
 		goto out_fail;
diff --git a/net/sunrpc/xprtrdma/transport.c b/net/sunrpc/xprtrdma/transport.c
index ecdc3ad..94dbfd3 100644
--- a/net/sunrpc/xprtrdma/transport.c
+++ b/net/sunrpc/xprtrdma/transport.c
@@ -484,7 +484,7 @@ static bool
 rpcrdma_get_rdmabuf(struct rpcrdma_xprt *r_xprt, struct rpcrdma_req *req,
 		    gfp_t flags)
 {
-	size_t size = r_xprt->rx_data.inline_wsize;
+	size_t size = RPCRDMA_HDRBUF_SIZE;
 	struct rpcrdma_regbuf *rb;
 
 	if (req->rl_rdmabuf)
diff --git a/net/sunrpc/xprtrdma/xprt_rdma.h b/net/sunrpc/xprtrdma/xprt_rdma.h
index 444f637..cc426b1 100644
--- a/net/sunrpc/xprtrdma/xprt_rdma.h
+++ b/net/sunrpc/xprtrdma/xprt_rdma.h
@@ -160,7 +160,10 @@ rdmab_to_msg(struct rpcrdma_regbuf *rb)
  * The smallest inline threshold is 1024 bytes, ensuring that
  * at least 750 bytes are available for RPC messages.
  */
-#define RPCRDMA_MAX_HDR_SEGS	(8)
+enum {
+	RPCRDMA_MAX_HDR_SEGS = 8,
+	RPCRDMA_HDRBUF_SIZE = 256,
+};
 
 /*
  * struct rpcrdma_rep -- this structure encapsulates state required to recv


  parent reply	other threads:[~2016-09-15 14:56 UTC|newest]

Thread overview: 46+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-09-15 14:54 [PATCH v3 00/22] client-side NFS/RDMA patches ready for v4.9 Chuck Lever
2016-09-15 14:54 ` Chuck Lever
     [not found] ` <20160915143440.11080.89241.stgit-FYjufvaPoItvLzlybtyyYzGyq/o6K9yX@public.gmane.org>
2016-09-15 14:55   ` [PATCH v3 01/22] xprtrdma: Eliminate INLINE_THRESHOLD macros Chuck Lever
2016-09-15 14:55     ` Chuck Lever
2016-09-15 14:55   ` [PATCH v3 02/22] SUNRPC: Refactor rpc_xdr_buf_init() Chuck Lever
2016-09-15 14:55     ` Chuck Lever
2016-09-15 14:55   ` [PATCH v3 03/22] SUNRPC: Generalize the RPC buffer allocation API Chuck Lever
2016-09-15 14:55     ` Chuck Lever
2016-09-15 14:55   ` [PATCH v3 04/22] SUNRPC: Generalize the RPC buffer release API Chuck Lever
2016-09-15 14:55     ` Chuck Lever
2016-09-15 14:55   ` [PATCH v3 05/22] SUNRPC: Separate buffer pointers for RPC Call and Reply messages Chuck Lever
2016-09-15 14:55     ` Chuck Lever
2016-09-15 14:55   ` [PATCH v3 06/22] SUNRPC: Add a transport-specific private field in rpc_rqst Chuck Lever
2016-09-15 14:55     ` Chuck Lever
2016-09-15 14:55   ` [PATCH v3 07/22] xprtrdma: Initialize separate RPC call and reply buffers Chuck Lever
2016-09-15 14:55     ` Chuck Lever
2016-09-15 14:56   ` Chuck Lever [this message]
2016-09-15 14:56     ` [PATCH v3 08/22] xprtrdma: Use smaller buffers for RPC-over-RDMA headers Chuck Lever
2016-09-15 14:56   ` [PATCH v3 09/22] xprtrdma: Replace DMA_BIDIRECTIONAL Chuck Lever
2016-09-15 14:56     ` Chuck Lever
2016-09-15 14:56   ` [PATCH v3 10/22] xprtrdma: Delay DMA mapping Send and Receive buffers Chuck Lever
2016-09-15 14:56     ` Chuck Lever
2016-09-15 14:56   ` [PATCH v3 11/22] xprtrdma: Eliminate "ia" argument in rpcrdma_{alloc, free}_regbuf Chuck Lever
2016-09-15 14:56     ` Chuck Lever
2016-09-15 14:56   ` [PATCH v3 12/22] xprtrdma: Simplify rpcrdma_ep_post_recv() Chuck Lever
2016-09-15 14:56     ` Chuck Lever
2016-09-15 14:56   ` [PATCH v3 13/22] xprtrdma: Move send_wr to struct rpcrdma_req Chuck Lever
2016-09-15 14:56     ` Chuck Lever
2016-09-15 14:56   ` [PATCH v3 14/22] xprtrdma: Move recv_wr to struct rpcrdma_rep Chuck Lever
2016-09-15 14:56     ` Chuck Lever
2016-09-15 14:56   ` [PATCH v3 15/22] rpcrdma: RDMA/CM private message data structure Chuck Lever
2016-09-15 14:56     ` Chuck Lever
2016-09-15 14:57   ` [PATCH v3 16/22] xprtrdma: Client-side support for rpcrdma_connect_private Chuck Lever
2016-09-15 14:57     ` Chuck Lever
2016-09-15 14:57   ` [PATCH v3 17/22] xprtrdma: Basic support for Remote Invalidation Chuck Lever
2016-09-15 14:57     ` Chuck Lever
2016-09-15 14:57   ` [PATCH v3 18/22] xprtrdma: Use gathered Send for large inline messages Chuck Lever
2016-09-15 14:57     ` Chuck Lever
2016-09-15 14:57   ` [PATCH v3 19/22] xprtrdma: Support larger inline thresholds Chuck Lever
2016-09-15 14:57     ` Chuck Lever
2016-09-15 14:57   ` [PATCH v3 20/22] xprtrmda: Report address of frmr, not mw Chuck Lever
2016-09-15 14:57     ` Chuck Lever
2016-09-15 14:57   ` [PATCH v3 21/22] xprtrdma: Rename rpcrdma_receive_wc() Chuck Lever
2016-09-15 14:57     ` Chuck Lever
2016-09-15 14:57   ` [PATCH v3 22/22] xprtrdma: Eliminate rpcrdma_receive_worker() Chuck Lever
2016-09-15 14:57     ` Chuck Lever

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20160915145601.11080.32594.stgit@manet.1015granger.net \
    --to=chuck.lever-qhclzuegtsvqt0dzr+alfa@public.gmane.org \
    --cc=anna.schumaker-HgOvQuBEEgTQT0dZR+AlfA@public.gmane.org \
    --cc=linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.