From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-io0-f174.google.com ([209.85.223.174]:57178 "EHLO mail-io0-f174.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751836AbdI2QBq (ORCPT ); Fri, 29 Sep 2017 12:01:46 -0400 Received: by mail-io0-f174.google.com with SMTP id m103so187965iod.13 for ; Fri, 29 Sep 2017 09:01:46 -0700 (PDT) MIME-Version: 1.0 In-Reply-To: <6ff26d9f-6f94-7a35-dfd1-c228dd0086e7@gmail.com> References: <20170928172819.50703-1-kolga@netapp.com> <20170928172819.50703-13-kolga@netapp.com> <81151f31-a9d1-6f75-30b3-1608bdc1d432@gmail.com> <6ff26d9f-6f94-7a35-dfd1-c228dd0086e7@gmail.com> From: Olga Kornievskaia Date: Fri, 29 Sep 2017 12:01:44 -0400 Message-ID: Subject: Re: [PATCH v4 12/12] NFS add a simple sync nfs4_proc_commit after async COPY To: Anna Schumaker Cc: Olga Kornievskaia , Trond Myklebust , Anna Schumaker , linux-nfs Content-Type: text/plain; charset="UTF-8" Sender: linux-nfs-owner@vger.kernel.org List-ID: On Thu, Sep 28, 2017 at 4:40 PM, Anna Schumaker wrote: > > > On 09/28/2017 04:34 PM, Olga Kornievskaia wrote: >> On Thu, Sep 28, 2017 at 4:13 PM, Anna Schumaker >> wrote: >>> >>> >>> On 09/28/2017 01:28 PM, Olga Kornievskaia wrote: >>>> A COPY with unstable write data needs a simple commit that doesn't >>>> deal with inodes >>>> >>>> Signed-off-by: Olga Kornievskaia >>>> --- >>>> fs/nfs/nfs42proc.c | 22 ++++++++++++++++++++++ >>>> fs/nfs/nfs4_fs.h | 2 +- >>>> fs/nfs/nfs4proc.c | 33 +++++++++++++++++++++++++++++++++ >>>> 3 files changed, 56 insertions(+), 1 deletion(-) >>>> >>>> diff --git a/fs/nfs/nfs42proc.c b/fs/nfs/nfs42proc.c >>>> index b9e47a2..2064d11 100644 >>>> --- a/fs/nfs/nfs42proc.c >>>> +++ b/fs/nfs/nfs42proc.c >>>> @@ -252,6 +252,28 @@ static ssize_t _nfs42_proc_copy(struct file *src, >>>> return status; >>>> } >>>> >>>> + if ((!res->synchronous || !args->sync) && >>>> + res->write_res.verifier.committed != NFS_FILE_SYNC) { >>>> + struct nfs_commitres cres; >>>> + >>>> + cres.verf = kzalloc(sizeof(struct nfs_writeverf), GFP_NOFS); >>>> + if (!cres.verf) >>>> + return -ENOMEM; >>>> + >>>> + status = nfs4_proc_commit(dst, pos_dst, res->write_res.count, >>>> + &cres); >>>> + if (status) { >>>> + kfree(cres.verf); >>>> + return status; >>>> + } >>>> + if (!nfs_write_verifier_cmp(&res->write_res.verifier.verifier, >>>> + &cres.verf->verifier)) { >>>> + /* what are we suppose to do here ? */ >>>> + dprintk("commit verf differs from copy verf\n"); >>> >>> I assume you should retry the commit, but we're retrying the whole operation in the synchronous case so I'm not sure. >> >> Urgh. I forgot about this. I guess I should retry the whole copy here.. >> >>> >>>> + } >>>> + kfree(cres.verf); >>>> + } >>>> + >>> >>> _nfs42_proc_copy() does a lot of stuff right now. Can you do the whole commit process into a separate function to make it easier to follow? >> >> got it. >> >>> >>>> truncate_pagecache_range(dst_inode, pos_dst, >>>> pos_dst + res->write_res.count); >>>> >>>> diff --git a/fs/nfs/nfs4_fs.h b/fs/nfs/nfs4_fs.h >>>> index c7225bb..5edb161 100644 >>>> --- a/fs/nfs/nfs4_fs.h >>>> +++ b/fs/nfs/nfs4_fs.h >>>> @@ -475,7 +475,7 @@ extern int nfs4_sequence_done(struct rpc_task *task, >>>> struct nfs4_sequence_res *res); >>>> >>>> extern void nfs4_free_lock_state(struct nfs_server *server, struct nfs4_lock_state *lsp); >>>> - >>>> +extern int nfs4_proc_commit(struct file *dst, __u64 offset, __u32 count, struct nfs_commitres *res); >>>> extern const nfs4_stateid zero_stateid; >>>> >>>> /* nfs4super.c */ >>>> diff --git a/fs/nfs/nfs4proc.c b/fs/nfs/nfs4proc.c >>>> index f1bf19e..30829ce 100644 >>>> --- a/fs/nfs/nfs4proc.c >>>> +++ b/fs/nfs/nfs4proc.c >>>> @@ -4829,6 +4829,39 @@ static void nfs4_proc_commit_setup(struct nfs_commit_data *data, struct rpc_mess >>>> nfs4_init_sequence(&data->args.seq_args, &data->res.seq_res, 1); >>>> } >>>> >>>> +static int _nfs4_proc_commit(struct file *dst, struct nfs_commitargs *args, >>>> + struct nfs_commitres *res) >>>> +{ >>>> + struct inode *dst_inode = file_inode(dst); >>>> + struct nfs_server *server = NFS_SERVER(dst_inode); >>>> + struct rpc_message msg = { >>>> + .rpc_proc = &nfs4_procedures[NFSPROC4_CLNT_COMMIT], >>>> + .rpc_argp = args, >>>> + .rpc_resp = res, >>>> + }; >>>> + return nfs4_call_sync(server->client, server, &msg, >>>> + &args->seq_args, &res->seq_res, 1); >>>> +} >>>> + >>>> +int nfs4_proc_commit(struct file *dst, __u64 offset, __u32 count, struct nfs_commitres *res) >>>> +{ >>>> + struct nfs_commitargs args = { >>>> + .fh = NFS_FH(file_inode(dst)), >>> >>> How worried do we need to be about filehandles changing if we need to enter recovery during this operation? >> >> This is the same thing we do in the copy and other operations (llseek, clone)? > > Yeah, it's to match what we do in the other operations. Otherwise we could end up with a different filehandle if we need to do open recovery. Ok so I'd like some clarification to what is suppose to be here. I think the correct behavior is to get the value of the "fh" from the struct file inside the inner loop of the operation (I can change commit to be that way). Prior to commit 9d8cacbf563 "NFSv4: fix reboot recovery in copy offload" copy used to assign "fh" inside the inner loop but then it was moved into the main nfs42_proc_copy(). Was that not a correct change then? > >> >>> >>> Thanks, >>> Anna >>> >>>> + .offset = offset, >>>> + .count = count, >>>> + }; >>>> + struct nfs_server *dst_server = NFS_SERVER(file_inode(dst)); >>>> + struct nfs4_exception exception = { }; >>>> + int status; >>>> + >>>> + do { >>>> + status = _nfs4_proc_commit(dst, &args, res);> + status = nfs4_handle_exception(dst_server, status, &exception); >>>> + } while (exception.retry); >>>> + >>>> + return status; >>>> +} >>>> + >>>> struct nfs4_renewdata { >>>> struct nfs_client *client; >>>> unsigned long timestamp; >>>> >>> -- >>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in >>> the body of a message to majordomo@vger.kernel.org >>> More majordomo info at http://vger.kernel.org/majordomo-info.html