From mboxrd@z Thu Jan 1 00:00:00 1970 From: Chuck Lever Subject: Re: [PATCH v2 0/7] Server-side NFS/RDMA changes for v4.11 Date: Mon, 6 Feb 2017 17:48:09 -0500 Message-ID: <23A0875C-CD9D-48C1-B1FB-CE17E85EBC55@oracle.com> References: <20170131184623.14185.35480.stgit@klimt.1015granger.net> <20170206223918.GE19704@fieldses.org> Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8BIT Return-path: In-Reply-To: <20170206223918.GE19704-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org> Sender: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org To: "J. Bruce Fields" Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org, Linux NFS Mailing List List-Id: linux-rdma@vger.kernel.org > On Feb 6, 2017, at 5:39 PM, J. Bruce Fields wrote: > > On Tue, Jan 31, 2017 at 01:52:42PM -0500, Chuck Lever wrote: >> These are largely clean-ups, except for the last patch. Switching >> completion polling from soft IRQ to a worker thread has a few >> benefits: >> >> - svcrdma's completion handlers invoke svc_xprt_put(). We discovered >> recently svc_xprt_put() is supposed to be called only in a process >> context. This will become more important when NFS/RDMA supports >> multi-path. >> >> - eventually we'd like to allocate pages for RDMA Read in the >> completion handler, and not defer RDMA Read to svc_rdma_recvfrom. >> Using GFP_KERNEL can sleep, which is not allowed in soft IRQ >> context. >> >> - several places where BH's are disabled can be converted to simple >> spin_locks. >> >> Bruce, would you consider these for v4.11? > > Sure, looks fine to me. > > Looks like you had a minor edit or two from Christoph's review, so I'm > assuming you'll resend. Yes, just waiting for the 0-day robot to report any issues. Expect to see these tomorrow. > --b. > >> >> >> Available in the "nfsd-rdma-for-4.11" topic branch of this git repo: >> >> git://git.linux-nfs.org/projects/cel/cel-2.6.git >> >> >> Or for browsing: >> >> http://git.linux-nfs.org/?p=cel/cel-2.6.git;a=log;h=refs/heads/nfsd-rdma-for-4.11 >> >> >> Changes since v1: >> - Rebased on v4.10-rc6 >> >> --- >> >> Chuck Lever (7): >> svcrdma: Another sendto chunk list parsing update >> svcrdma: Clean up RPC-over-RDMA Reply header encoder >> svcrdma: Clean up RPC-over-RDMA Call header decoder >> svcrdma: Clean up backchannel send header encoding >> svcrdma: Remove unused sc_dto_q field >> svcrdma: Combine list fields in struct svc_rdma_op_ctxt >> svcrdma: Poll CQs in "workqueue" mode >> >> >> include/linux/sunrpc/rpc_rdma.h | 9 + >> include/linux/sunrpc/svc_rdma.h | 17 + >> net/sunrpc/xprtrdma/svc_rdma_backchannel.c | 17 + >> net/sunrpc/xprtrdma/svc_rdma_marshal.c | 320 +++++++++++----------------- >> net/sunrpc/xprtrdma/svc_rdma_recvfrom.c | 20 +- >> net/sunrpc/xprtrdma/svc_rdma_sendto.c | 13 - >> net/sunrpc/xprtrdma/svc_rdma_transport.c | 61 +++-- >> 7 files changed, 199 insertions(+), 258 deletions(-) >> >> -- >> Chuck Lever > -- > To unsubscribe from this list: send the line "unsubscribe linux-nfs" in > the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org > More majordomo info at http://vger.kernel.org/majordomo-info.html -- Chuck Lever -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at http://vger.kernel.org/majordomo-info.html From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from userp1040.oracle.com ([156.151.31.81]:49561 "EHLO userp1040.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751418AbdBFWsN (ORCPT ); Mon, 6 Feb 2017 17:48:13 -0500 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: [PATCH v2 0/7] Server-side NFS/RDMA changes for v4.11 From: Chuck Lever In-Reply-To: <20170206223918.GE19704@fieldses.org> Date: Mon, 6 Feb 2017 17:48:09 -0500 Cc: linux-rdma@vger.kernel.org, Linux NFS Mailing List Message-Id: <23A0875C-CD9D-48C1-B1FB-CE17E85EBC55@oracle.com> References: <20170131184623.14185.35480.stgit@klimt.1015granger.net> <20170206223918.GE19704@fieldses.org> To: "J. Bruce Fields" Sender: linux-nfs-owner@vger.kernel.org List-ID: > On Feb 6, 2017, at 5:39 PM, J. Bruce Fields wrote: > > On Tue, Jan 31, 2017 at 01:52:42PM -0500, Chuck Lever wrote: >> These are largely clean-ups, except for the last patch. Switching >> completion polling from soft IRQ to a worker thread has a few >> benefits: >> >> - svcrdma's completion handlers invoke svc_xprt_put(). We discovered >> recently svc_xprt_put() is supposed to be called only in a process >> context. This will become more important when NFS/RDMA supports >> multi-path. >> >> - eventually we'd like to allocate pages for RDMA Read in the >> completion handler, and not defer RDMA Read to svc_rdma_recvfrom. >> Using GFP_KERNEL can sleep, which is not allowed in soft IRQ >> context. >> >> - several places where BH's are disabled can be converted to simple >> spin_locks. >> >> Bruce, would you consider these for v4.11? > > Sure, looks fine to me. > > Looks like you had a minor edit or two from Christoph's review, so I'm > assuming you'll resend. Yes, just waiting for the 0-day robot to report any issues. Expect to see these tomorrow. > --b. > >> >> >> Available in the "nfsd-rdma-for-4.11" topic branch of this git repo: >> >> git://git.linux-nfs.org/projects/cel/cel-2.6.git >> >> >> Or for browsing: >> >> http://git.linux-nfs.org/?p=cel/cel-2.6.git;a=log;h=refs/heads/nfsd-rdma-for-4.11 >> >> >> Changes since v1: >> - Rebased on v4.10-rc6 >> >> --- >> >> Chuck Lever (7): >> svcrdma: Another sendto chunk list parsing update >> svcrdma: Clean up RPC-over-RDMA Reply header encoder >> svcrdma: Clean up RPC-over-RDMA Call header decoder >> svcrdma: Clean up backchannel send header encoding >> svcrdma: Remove unused sc_dto_q field >> svcrdma: Combine list fields in struct svc_rdma_op_ctxt >> svcrdma: Poll CQs in "workqueue" mode >> >> >> include/linux/sunrpc/rpc_rdma.h | 9 + >> include/linux/sunrpc/svc_rdma.h | 17 + >> net/sunrpc/xprtrdma/svc_rdma_backchannel.c | 17 + >> net/sunrpc/xprtrdma/svc_rdma_marshal.c | 320 +++++++++++----------------- >> net/sunrpc/xprtrdma/svc_rdma_recvfrom.c | 20 +- >> net/sunrpc/xprtrdma/svc_rdma_sendto.c | 13 - >> net/sunrpc/xprtrdma/svc_rdma_transport.c | 61 +++-- >> 7 files changed, 199 insertions(+), 258 deletions(-) >> >> -- >> Chuck Lever > -- > To unsubscribe from this list: send the line "unsubscribe linux-nfs" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html -- Chuck Lever