From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jeff Layton Subject: Re: [PATCH 09/18] nfsd: implement pNFS operations Date: Thu, 8 Jan 2015 16:48:51 -0800 Message-ID: <20150108164851.03b64e16@synchrony.poochiereds.net> References: <1420561721-9150-1-git-send-email-hch@lst.de> <1420561721-9150-10-git-send-email-hch@lst.de> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: "J. Bruce Fields" , linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org, linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org, xfs-VZNHf3L845pBDgjK7y7TUQ@public.gmane.org To: Christoph Hellwig Return-path: In-Reply-To: <1420561721-9150-10-git-send-email-hch-jcswGhMUV9g@public.gmane.org> Sender: linux-nfs-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org List-Id: linux-fsdevel.vger.kernel.org On Tue, 6 Jan 2015 17:28:32 +0100 Christoph Hellwig wrote: > Add support for the GETDEVICEINFO, LAYOUTGET, LAYOUTCOMMIT and > LAYOUTRETURN NFSv4.1 operations, as well as backing code to manage > outstanding layouts and devices. > > Layout management is very straight forward, with a nfs4_layout_stateid > structure that extents nfs4_stid to manage layout stateids as the > top-level structure. It is linked into the nfs4_file and nfs4_client > structures like the other stateids, and contains a linked list of > layouts that hang of the stateid. The actual layout operations are > implemented in layout drivers that are not part of this commit, but > will be added later. > > The worst part of this commit is the management of the pNFS device IDs, > which suffers from a specification that is not sanely implementable due > to the fact that the device-IDs are global and not bound to an export, > and have a small enough size so that we can't store the fsid portion of > a file handle, and must never be reused. As we still do need perform all > export authentication and validation checks on a device ID passed to > GETDEVICEINFO we are caught between a rock and a hard place. To work > around this issue we add a new hash that maps from a 64-bit integer to a > fsid so that we can look up the export to authenticate against it, > a 32-bit integer as a generation that we can bump when changing the device, > and a currently unused 32-bit integer that could be used in the future > to handle more than a single device per export. Entries in this hash > table are never deleted as we can't reuse the ids anyway, and would have > a severe lifetime problem anyway as Linux export structures are temporary > structures that can go away under load. > > Parts of the XDR data, structures and marshaling/unmarshaling code, as > well as many concepts are derived from the old pNFS server implementation > from Andy Adamson, Benny Halevy, Dean Hildebrand, Marc Eshel, Fred Isaman, > Mike Sager, Ricardo Labiaga and many others. > > Signed-off-by: Christoph Hellwig > --- > fs/nfsd/Kconfig | 10 + > fs/nfsd/Makefile | 1 + > fs/nfsd/export.c | 8 + > fs/nfsd/export.h | 2 + > fs/nfsd/nfs4layouts.c | 486 ++++++++++++++++++++++++++++++++++++++++ > fs/nfsd/nfs4proc.c | 266 ++++++++++++++++++++++ > fs/nfsd/nfs4state.c | 16 +- > fs/nfsd/nfs4xdr.c | 306 +++++++++++++++++++++++++ > fs/nfsd/nfsctl.c | 9 +- > fs/nfsd/nfsd.h | 16 +- > fs/nfsd/pnfs.h | 80 +++++++ > fs/nfsd/state.h | 21 ++ > fs/nfsd/xdr4.h | 60 +++++ > include/linux/nfs4.h | 1 + > include/uapi/linux/nfsd/debug.h | 1 + > 15 files changed, 1279 insertions(+), 4 deletions(-) > create mode 100644 fs/nfsd/nfs4layouts.c > create mode 100644 fs/nfsd/pnfs.h > [...] > @@ -4845,6 +4856,9 @@ nfsd4_close(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate, > update_stateid(&stp->st_stid.sc_stateid); > memcpy(&close->cl_stateid, &stp->st_stid.sc_stateid, sizeof(stateid_t)); > > + nfsd4_return_all_file_layouts(stp->st_stateowner->so_client, > + stp->st_stid.sc_file); > + Shouldn't the above be conditional on whether the lg_roc was true? > nfsd4_close_open_stateid(stp); > > /* put reference from nfs4_preprocess_seqid_op */ -- Jeff Layton -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at http://vger.kernel.org/majordomo-info.html From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id ABD047F3F for ; Thu, 8 Jan 2015 18:49:01 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 8C50C304048 for ; Thu, 8 Jan 2015 16:48:58 -0800 (PST) Received: from mail-qc0-f179.google.com (mail-qc0-f179.google.com [209.85.216.179]) by cuda.sgi.com with ESMTP id CKTn90UwFKVx7At8 (version=TLSv1 cipher=RC4-SHA bits=128 verify=NO) for ; Thu, 08 Jan 2015 16:48:57 -0800 (PST) Received: by mail-qc0-f179.google.com with SMTP id c9so5588983qcz.10 for ; Thu, 08 Jan 2015 16:48:56 -0800 (PST) From: Jeff Layton Date: Thu, 8 Jan 2015 16:48:51 -0800 Subject: Re: [PATCH 09/18] nfsd: implement pNFS operations Message-ID: <20150108164851.03b64e16@synchrony.poochiereds.net> In-Reply-To: <1420561721-9150-10-git-send-email-hch@lst.de> References: <1420561721-9150-1-git-send-email-hch@lst.de> <1420561721-9150-10-git-send-email-hch@lst.de> MIME-Version: 1.0 List-Id: XFS Filesystem from SGI List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: xfs-bounces@oss.sgi.com Sender: xfs-bounces@oss.sgi.com To: Christoph Hellwig Cc: "J. Bruce Fields" , linux-fsdevel@vger.kernel.org, linux-nfs@vger.kernel.org, xfs@oss.sgi.com On Tue, 6 Jan 2015 17:28:32 +0100 Christoph Hellwig wrote: > Add support for the GETDEVICEINFO, LAYOUTGET, LAYOUTCOMMIT and > LAYOUTRETURN NFSv4.1 operations, as well as backing code to manage > outstanding layouts and devices. > > Layout management is very straight forward, with a nfs4_layout_stateid > structure that extents nfs4_stid to manage layout stateids as the > top-level structure. It is linked into the nfs4_file and nfs4_client > structures like the other stateids, and contains a linked list of > layouts that hang of the stateid. The actual layout operations are > implemented in layout drivers that are not part of this commit, but > will be added later. > > The worst part of this commit is the management of the pNFS device IDs, > which suffers from a specification that is not sanely implementable due > to the fact that the device-IDs are global and not bound to an export, > and have a small enough size so that we can't store the fsid portion of > a file handle, and must never be reused. As we still do need perform all > export authentication and validation checks on a device ID passed to > GETDEVICEINFO we are caught between a rock and a hard place. To work > around this issue we add a new hash that maps from a 64-bit integer to a > fsid so that we can look up the export to authenticate against it, > a 32-bit integer as a generation that we can bump when changing the device, > and a currently unused 32-bit integer that could be used in the future > to handle more than a single device per export. Entries in this hash > table are never deleted as we can't reuse the ids anyway, and would have > a severe lifetime problem anyway as Linux export structures are temporary > structures that can go away under load. > > Parts of the XDR data, structures and marshaling/unmarshaling code, as > well as many concepts are derived from the old pNFS server implementation > from Andy Adamson, Benny Halevy, Dean Hildebrand, Marc Eshel, Fred Isaman, > Mike Sager, Ricardo Labiaga and many others. > > Signed-off-by: Christoph Hellwig > --- > fs/nfsd/Kconfig | 10 + > fs/nfsd/Makefile | 1 + > fs/nfsd/export.c | 8 + > fs/nfsd/export.h | 2 + > fs/nfsd/nfs4layouts.c | 486 ++++++++++++++++++++++++++++++++++++++++ > fs/nfsd/nfs4proc.c | 266 ++++++++++++++++++++++ > fs/nfsd/nfs4state.c | 16 +- > fs/nfsd/nfs4xdr.c | 306 +++++++++++++++++++++++++ > fs/nfsd/nfsctl.c | 9 +- > fs/nfsd/nfsd.h | 16 +- > fs/nfsd/pnfs.h | 80 +++++++ > fs/nfsd/state.h | 21 ++ > fs/nfsd/xdr4.h | 60 +++++ > include/linux/nfs4.h | 1 + > include/uapi/linux/nfsd/debug.h | 1 + > 15 files changed, 1279 insertions(+), 4 deletions(-) > create mode 100644 fs/nfsd/nfs4layouts.c > create mode 100644 fs/nfsd/pnfs.h > [...] > @@ -4845,6 +4856,9 @@ nfsd4_close(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate, > update_stateid(&stp->st_stid.sc_stateid); > memcpy(&close->cl_stateid, &stp->st_stid.sc_stateid, sizeof(stateid_t)); > > + nfsd4_return_all_file_layouts(stp->st_stateowner->so_client, > + stp->st_stid.sc_file); > + Shouldn't the above be conditional on whether the lg_roc was true? > nfsd4_close_open_stateid(stp); > > /* put reference from nfs4_preprocess_seqid_op */ -- Jeff Layton _______________________________________________ xfs mailing list xfs@oss.sgi.com http://oss.sgi.com/mailman/listinfo/xfs From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: linux-nfs-owner@vger.kernel.org Received: from mail-qc0-f180.google.com ([209.85.216.180]:61713 "EHLO mail-qc0-f180.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751087AbbAIAs5 (ORCPT ); Thu, 8 Jan 2015 19:48:57 -0500 Received: by mail-qc0-f180.google.com with SMTP id i8so5750619qcq.11 for ; Thu, 08 Jan 2015 16:48:56 -0800 (PST) From: Jeff Layton Date: Thu, 8 Jan 2015 16:48:51 -0800 To: Christoph Hellwig Cc: "J. Bruce Fields" , linux-nfs@vger.kernel.org, linux-fsdevel@vger.kernel.org, xfs@oss.sgi.com Subject: Re: [PATCH 09/18] nfsd: implement pNFS operations Message-ID: <20150108164851.03b64e16@synchrony.poochiereds.net> In-Reply-To: <1420561721-9150-10-git-send-email-hch@lst.de> References: <1420561721-9150-1-git-send-email-hch@lst.de> <1420561721-9150-10-git-send-email-hch@lst.de> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Sender: linux-nfs-owner@vger.kernel.org List-ID: On Tue, 6 Jan 2015 17:28:32 +0100 Christoph Hellwig wrote: > Add support for the GETDEVICEINFO, LAYOUTGET, LAYOUTCOMMIT and > LAYOUTRETURN NFSv4.1 operations, as well as backing code to manage > outstanding layouts and devices. > > Layout management is very straight forward, with a nfs4_layout_stateid > structure that extents nfs4_stid to manage layout stateids as the > top-level structure. It is linked into the nfs4_file and nfs4_client > structures like the other stateids, and contains a linked list of > layouts that hang of the stateid. The actual layout operations are > implemented in layout drivers that are not part of this commit, but > will be added later. > > The worst part of this commit is the management of the pNFS device IDs, > which suffers from a specification that is not sanely implementable due > to the fact that the device-IDs are global and not bound to an export, > and have a small enough size so that we can't store the fsid portion of > a file handle, and must never be reused. As we still do need perform all > export authentication and validation checks on a device ID passed to > GETDEVICEINFO we are caught between a rock and a hard place. To work > around this issue we add a new hash that maps from a 64-bit integer to a > fsid so that we can look up the export to authenticate against it, > a 32-bit integer as a generation that we can bump when changing the device, > and a currently unused 32-bit integer that could be used in the future > to handle more than a single device per export. Entries in this hash > table are never deleted as we can't reuse the ids anyway, and would have > a severe lifetime problem anyway as Linux export structures are temporary > structures that can go away under load. > > Parts of the XDR data, structures and marshaling/unmarshaling code, as > well as many concepts are derived from the old pNFS server implementation > from Andy Adamson, Benny Halevy, Dean Hildebrand, Marc Eshel, Fred Isaman, > Mike Sager, Ricardo Labiaga and many others. > > Signed-off-by: Christoph Hellwig > --- > fs/nfsd/Kconfig | 10 + > fs/nfsd/Makefile | 1 + > fs/nfsd/export.c | 8 + > fs/nfsd/export.h | 2 + > fs/nfsd/nfs4layouts.c | 486 ++++++++++++++++++++++++++++++++++++++++ > fs/nfsd/nfs4proc.c | 266 ++++++++++++++++++++++ > fs/nfsd/nfs4state.c | 16 +- > fs/nfsd/nfs4xdr.c | 306 +++++++++++++++++++++++++ > fs/nfsd/nfsctl.c | 9 +- > fs/nfsd/nfsd.h | 16 +- > fs/nfsd/pnfs.h | 80 +++++++ > fs/nfsd/state.h | 21 ++ > fs/nfsd/xdr4.h | 60 +++++ > include/linux/nfs4.h | 1 + > include/uapi/linux/nfsd/debug.h | 1 + > 15 files changed, 1279 insertions(+), 4 deletions(-) > create mode 100644 fs/nfsd/nfs4layouts.c > create mode 100644 fs/nfsd/pnfs.h > [...] > @@ -4845,6 +4856,9 @@ nfsd4_close(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate, > update_stateid(&stp->st_stid.sc_stateid); > memcpy(&close->cl_stateid, &stp->st_stid.sc_stateid, sizeof(stateid_t)); > > + nfsd4_return_all_file_layouts(stp->st_stateowner->so_client, > + stp->st_stid.sc_file); > + Shouldn't the above be conditional on whether the lg_roc was true? > nfsd4_close_open_stateid(stp); > > /* put reference from nfs4_preprocess_seqid_op */ -- Jeff Layton