All of lore.kernel.org
 help / color / mirror / Atom feed
From: Brian Foster <bfoster@redhat.com>
To: "Darrick J. Wong" <darrick.wong@oracle.com>
Cc: linux-fsdevel@vger.kernel.org, vishal.l.verma@intel.com, xfs@oss.sgi.com
Subject: Re: [PATCH 044/119] xfs: propagate bmap updates to rmapbt
Date: Mon, 18 Jul 2016 08:55:29 -0400	[thread overview]
Message-ID: <20160718125529.GB27380@bfoster.bfoster> (raw)
In-Reply-To: <20160716072621.GC21529@birch.djwong.org>

On Sat, Jul 16, 2016 at 12:26:21AM -0700, Darrick J. Wong wrote:
> On Fri, Jul 15, 2016 at 02:33:56PM -0400, Brian Foster wrote:
> > On Thu, Jun 16, 2016 at 06:22:34PM -0700, Darrick J. Wong wrote:
> > > When we map, unmap, or convert an extent in a file's data or attr
> > > fork, schedule a respective update in the rmapbt.  Previous versions
> > > of this patch required a 1:1 correspondence between bmap and rmap,
> > > but this is no longer true.
> > > 
> > > v2: Remove the 1:1 correspondence requirement now that we have the
> > > ability to make interval queries against the rmapbt.  Update the
> > > commit message to reflect the broad restructuring of this patch.
> > > Fix the bmap shift code to adjust the rmaps correctly.
> > > 
> > > v3: Use the deferred operations code to handle redo operations
> > > atomically and deadlock free.  Plumb in all five rmap actions
> > > (map, unmap, convert extent, alloc, free); we'll use the first
> > > three now for file data, and reflink will want the last two.
> > > Add an error injection site to test log recovery.
> > > 
> > > Signed-off-by: Darrick J. Wong <darrick.wong@oracle.com>
> > > ---
> > >  fs/xfs/libxfs/xfs_bmap.c       |   56 ++++++++-
> > >  fs/xfs/libxfs/xfs_rmap.c       |  252 ++++++++++++++++++++++++++++++++++++++++
> > >  fs/xfs/libxfs/xfs_rmap_btree.h |   24 ++++
> > >  fs/xfs/xfs_bmap_util.c         |    1 
> > >  fs/xfs/xfs_defer_item.c        |    6 +
> > >  fs/xfs/xfs_error.h             |    4 -
> > >  fs/xfs/xfs_log_recover.c       |   56 +++++++++
> > >  fs/xfs/xfs_trans.h             |    3 
> > >  fs/xfs/xfs_trans_rmap.c        |    7 +
> > >  9 files changed, 393 insertions(+), 16 deletions(-)
> > > 
> > > 
...
> > > diff --git a/fs/xfs/libxfs/xfs_rmap.c b/fs/xfs/libxfs/xfs_rmap.c
> > > index 76fc5c2..f179ea4 100644
> > > --- a/fs/xfs/libxfs/xfs_rmap.c
> > > +++ b/fs/xfs/libxfs/xfs_rmap.c
> > > @@ -36,6 +36,8 @@
> > >  #include "xfs_trace.h"
> > >  #include "xfs_error.h"
> > >  #include "xfs_extent_busy.h"
> > > +#include "xfs_bmap.h"
> > > +#include "xfs_inode.h"
> > >  
> > >  /*
> > >   * Lookup the first record less than or equal to [bno, len, owner, offset]
> > > @@ -1212,3 +1214,253 @@ xfs_rmapbt_query_range(
> > >  	return xfs_btree_query_range(cur, &low_brec, &high_brec,
> > >  			xfs_rmapbt_query_range_helper, &query);
> > >  }
> > > +
> > > +/* Clean up after calling xfs_rmap_finish_one. */
> > > +void
> > > +xfs_rmap_finish_one_cleanup(
> > > +	struct xfs_trans	*tp,
> > > +	struct xfs_btree_cur	*rcur,
> > > +	int			error)
> > > +{
> > > +	struct xfs_buf		*agbp;
> > > +
> > > +	if (rcur == NULL)
> > > +		return;
> > > +	agbp = rcur->bc_private.a.agbp;
> > > +	xfs_btree_del_cursor(rcur, error ? XFS_BTREE_ERROR : XFS_BTREE_NOERROR);
> > > +	xfs_trans_brelse(tp, agbp);
> > 
> > Why unconditionally release the agbp (and not just on error)?
> 
> We grabbed the agbp (er, AGF buffer) to construct the rmapbt cursor, so we have
> to free it after the cursor is deleted regardless of whether or not there's an
> error.
> 

It looks like it's attached to the transaction via xfs_trans_read_*(),
which means it will be released properly on transaction commit. I don't
think it's necessarily a bug because xfs_trans_brelse() bails out when
the item is dirty, but it looks like a departure from how this is used
elsewhere throughout XFS (when no modifications are made or otherwise as
an error condition cleanup). E.g., see the similar pattern in
xfs_free_extent().

Maybe I'm missing something.. was there a known issue that required this
call, or had it always been there?

> > > +}
> > > +
> > > +/*
> > > + * Process one of the deferred rmap operations.  We pass back the
> > > + * btree cursor to maintain our lock on the rmapbt between calls.
> > > + * This saves time and eliminates a buffer deadlock between the
> > > + * superblock and the AGF because we'll always grab them in the same
> > > + * order.
> > > + */
> > > +int
> > > +xfs_rmap_finish_one(
> > > +	struct xfs_trans		*tp,
> > > +	enum xfs_rmap_intent_type	type,
> > > +	__uint64_t			owner,
> > > +	int				whichfork,
> > > +	xfs_fileoff_t			startoff,
> > > +	xfs_fsblock_t			startblock,
> > > +	xfs_filblks_t			blockcount,
> > > +	xfs_exntst_t			state,
> > > +	struct xfs_btree_cur		**pcur)
> > > +{
> > > +	struct xfs_mount		*mp = tp->t_mountp;
> > > +	struct xfs_btree_cur		*rcur;
> > > +	struct xfs_buf			*agbp = NULL;
> > > +	int				error = 0;
> > > +	xfs_agnumber_t			agno;
> > > +	struct xfs_owner_info		oinfo;
> > > +	xfs_agblock_t			bno;
> > > +	bool				unwritten;
> > > +
> > > +	agno = XFS_FSB_TO_AGNO(mp, startblock);
> > > +	ASSERT(agno != NULLAGNUMBER);
> > > +	bno = XFS_FSB_TO_AGBNO(mp, startblock);
> > > +
> > > +	trace_xfs_rmap_deferred(mp, agno, type, bno, owner, whichfork,
> > > +			startoff, blockcount, state);
> > > +
> > > +	if (XFS_TEST_ERROR(false, mp,
> > > +			XFS_ERRTAG_RMAP_FINISH_ONE,
> > > +			XFS_RANDOM_RMAP_FINISH_ONE))
> > > +		return -EIO;
> > > +
> > > +	/*
> > > +	 * If we haven't gotten a cursor or the cursor AG doesn't match
> > > +	 * the startblock, get one now.
> > > +	 */
> > > +	rcur = *pcur;
> > > +	if (rcur != NULL && rcur->bc_private.a.agno != agno) {
> > > +		xfs_rmap_finish_one_cleanup(tp, rcur, 0);
> > > +		rcur = NULL;
> > > +		*pcur = NULL;
> > > +	}
> > > +	if (rcur == NULL) {
> > > +		error = xfs_free_extent_fix_freelist(tp, agno, &agbp);
> > 
> > Comment? Why is this here? (Maybe we should rename that function while
> > we're at it..)
> 
> /*
>  * Ensure the freelist is of a sufficient length to provide for any btree
>  * splits that could happen when we make changes to the rmapbt.
>  */
> 
> (I don't know why the function has that name; Dave supplied it.)
> 
> > > +		if (error)
> > > +			return error;
> > > +		if (!agbp)
> > > +			return -EFSCORRUPTED;
> > > +
> > > +		rcur = xfs_rmapbt_init_cursor(mp, tp, agbp, agno);
> > > +		if (!rcur) {
> > > +			error = -ENOMEM;
> > > +			goto out_cur;
> > > +		}
> > > +	}
> > > +	*pcur = rcur;
> > > +
> > > +	xfs_rmap_ino_owner(&oinfo, owner, whichfork, startoff);
> > > +	unwritten = state == XFS_EXT_UNWRITTEN;
> > > +	bno = XFS_FSB_TO_AGBNO(rcur->bc_mp, startblock);
> > > +
> > > +	switch (type) {
> > > +	case XFS_RMAP_MAP:
> > > +		error = xfs_rmap_map(rcur, bno, blockcount, unwritten, &oinfo);
> > > +		break;
> > > +	case XFS_RMAP_UNMAP:
> > > +		error = xfs_rmap_unmap(rcur, bno, blockcount, unwritten,
> > > +				&oinfo);
> > > +		break;
> > > +	case XFS_RMAP_CONVERT:
> > > +		error = xfs_rmap_convert(rcur, bno, blockcount, !unwritten,
> > > +				&oinfo);
> > > +		break;
> > > +	case XFS_RMAP_ALLOC:
> > > +		error = __xfs_rmap_alloc(rcur, bno, blockcount, unwritten,
> > > +				&oinfo);
> > > +		break;
> > > +	case XFS_RMAP_FREE:
> > > +		error = __xfs_rmap_free(rcur, bno, blockcount, unwritten,
> > > +				&oinfo);
> > > +		break;
> > > +	default:
> > > +		ASSERT(0);
> > > +		error = -EFSCORRUPTED;
> > > +	}
> > > +	return error;
> > > +
> > > +out_cur:
> > > +	xfs_trans_brelse(tp, agbp);
> > > +
> > > +	return error;
> > > +}
> > > +
> > > +/*
> > > + * Record a rmap intent; the list is kept sorted first by AG and then by
> > > + * increasing age.
> > > + */
> > > +static int
> > > +__xfs_rmap_add(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	struct xfs_rmap_intent	*ri)
> > > +{
> > > +	struct xfs_rmap_intent	*new;
> > > +
> > > +	if (!xfs_sb_version_hasrmapbt(&mp->m_sb))
> > > +		return 0;
> > > +
> > > +	trace_xfs_rmap_defer(mp, XFS_FSB_TO_AGNO(mp, ri->ri_bmap.br_startblock),
> > > +			ri->ri_type,
> > > +			XFS_FSB_TO_AGBNO(mp, ri->ri_bmap.br_startblock),
> > > +			ri->ri_owner, ri->ri_whichfork,
> > > +			ri->ri_bmap.br_startoff,
> > > +			ri->ri_bmap.br_blockcount,
> > > +			ri->ri_bmap.br_state);
> > > +
> > > +	new = kmem_zalloc(sizeof(struct xfs_rmap_intent), KM_SLEEP | KM_NOFS);
> > > +	*new = *ri;
> > > +
> > > +	xfs_defer_add(dfops, XFS_DEFER_OPS_TYPE_RMAP, &new->ri_list);
> > > +	return 0;
> > > +}
> > > +
> > > +/* Map an extent into a file. */
> > > +int
> > > +xfs_rmap_map_extent(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	struct xfs_inode	*ip,
> > > +	int			whichfork,
> > > +	struct xfs_bmbt_irec	*PREV)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_MAP;
> > > +	ri.ri_owner = ip->i_ino;
> > > +	ri.ri_whichfork = whichfork;
> > > +	ri.ri_bmap = *PREV;
> > > +
> > 
> > I think we should probably initialize ri_list as well (maybe turn this
> > into an xfs_rmap_init helper).
> 
> __xfs_rmap_add calls xfs_defer_add, which calls list_add_tail, which
> initializes ri_list.  Could probably just make an _rmap_init helper that
> allocates the structure, then have _rmap_*_extent fill out the new intent, and
> make the _rmap_add function pass it to _defer_add, which I think is what you're
> getting at.
> 

I didn't mean to suggest it was a bug. It's more of a defensive thing
than anything.

Brian

> > Also, for some reason it feels to me like the _hasrmapbt() feature check
> > should be up at this level (or higher), rather than buried in
> > __xfs_rmap_add(). I don't feel too strongly about that if others think
> > differently, however.
> 
> <shrug> It probably ought to be in the higher level function.
> 
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > +
> > > +/* Unmap an extent out of a file. */
> > > +int
> > > +xfs_rmap_unmap_extent(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	struct xfs_inode	*ip,
> > > +	int			whichfork,
> > > +	struct xfs_bmbt_irec	*PREV)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_UNMAP;
> > > +	ri.ri_owner = ip->i_ino;
> > > +	ri.ri_whichfork = whichfork;
> > > +	ri.ri_bmap = *PREV;
> > > +
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > +
> > > +/* Convert a data fork extent from unwritten to real or vice versa. */
> > > +int
> > > +xfs_rmap_convert_extent(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	struct xfs_inode	*ip,
> > > +	int			whichfork,
> > > +	struct xfs_bmbt_irec	*PREV)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_CONVERT;
> > > +	ri.ri_owner = ip->i_ino;
> > > +	ri.ri_whichfork = whichfork;
> > > +	ri.ri_bmap = *PREV;
> > > +
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > +
> > > +/* Schedule the creation of an rmap for non-file data. */
> > > +int
> > > +xfs_rmap_alloc_defer(
> > 
> > xfs_rmap_[alloc|free]_extent() like the others..?
> 
> Yeah.  The naming has shifted a bit over the past few revisions.
> 
> --D
> 
> > 
> > Brian 
> > 
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	xfs_agnumber_t		agno,
> > > +	xfs_agblock_t		bno,
> > > +	xfs_extlen_t		len,
> > > +	__uint64_t		owner)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_ALLOC;
> > > +	ri.ri_owner = owner;
> > > +	ri.ri_whichfork = XFS_DATA_FORK;
> > > +	ri.ri_bmap.br_startblock = XFS_AGB_TO_FSB(mp, agno, bno);
> > > +	ri.ri_bmap.br_blockcount = len;
> > > +	ri.ri_bmap.br_startoff = 0;
> > > +	ri.ri_bmap.br_state = XFS_EXT_NORM;
> > > +
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > +
> > > +/* Schedule the deletion of an rmap for non-file data. */
> > > +int
> > > +xfs_rmap_free_defer(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	xfs_agnumber_t		agno,
> > > +	xfs_agblock_t		bno,
> > > +	xfs_extlen_t		len,
> > > +	__uint64_t		owner)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_FREE;
> > > +	ri.ri_owner = owner;
> > > +	ri.ri_whichfork = XFS_DATA_FORK;
> > > +	ri.ri_bmap.br_startblock = XFS_AGB_TO_FSB(mp, agno, bno);
> > > +	ri.ri_bmap.br_blockcount = len;
> > > +	ri.ri_bmap.br_startoff = 0;
> > > +	ri.ri_bmap.br_state = XFS_EXT_NORM;
> > > +
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > diff --git a/fs/xfs/libxfs/xfs_rmap_btree.h b/fs/xfs/libxfs/xfs_rmap_btree.h
> > > index aff60dc..5df406e 100644
> > > --- a/fs/xfs/libxfs/xfs_rmap_btree.h
> > > +++ b/fs/xfs/libxfs/xfs_rmap_btree.h
> > > @@ -106,4 +106,28 @@ struct xfs_rmap_intent {
> > >  	struct xfs_bmbt_irec			ri_bmap;
> > >  };
> > >  
> > > +/* functions for updating the rmapbt based on bmbt map/unmap operations */
> > > +int xfs_rmap_map_extent(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		struct xfs_inode *ip, int whichfork,
> > > +		struct xfs_bmbt_irec *imap);
> > > +int xfs_rmap_unmap_extent(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		struct xfs_inode *ip, int whichfork,
> > > +		struct xfs_bmbt_irec *imap);
> > > +int xfs_rmap_convert_extent(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		struct xfs_inode *ip, int whichfork,
> > > +		struct xfs_bmbt_irec *imap);
> > > +int xfs_rmap_alloc_defer(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		xfs_agnumber_t agno, xfs_agblock_t bno, xfs_extlen_t len,
> > > +		__uint64_t owner);
> > > +int xfs_rmap_free_defer(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		xfs_agnumber_t agno, xfs_agblock_t bno, xfs_extlen_t len,
> > > +		__uint64_t owner);
> > > +
> > > +void xfs_rmap_finish_one_cleanup(struct xfs_trans *tp,
> > > +		struct xfs_btree_cur *rcur, int error);
> > > +int xfs_rmap_finish_one(struct xfs_trans *tp, enum xfs_rmap_intent_type type,
> > > +		__uint64_t owner, int whichfork, xfs_fileoff_t startoff,
> > > +		xfs_fsblock_t startblock, xfs_filblks_t blockcount,
> > > +		xfs_exntst_t state, struct xfs_btree_cur **pcur);
> > > +
> > >  #endif	/* __XFS_RMAP_BTREE_H__ */
> > > diff --git a/fs/xfs/xfs_bmap_util.c b/fs/xfs/xfs_bmap_util.c
> > > index 62d194e..450fd49 100644
> > > --- a/fs/xfs/xfs_bmap_util.c
> > > +++ b/fs/xfs/xfs_bmap_util.c
> > > @@ -41,6 +41,7 @@
> > >  #include "xfs_trace.h"
> > >  #include "xfs_icache.h"
> > >  #include "xfs_log.h"
> > > +#include "xfs_rmap_btree.h"
> > >  
> > >  /* Kernel only BMAP related definitions and functions */
> > >  
> > > diff --git a/fs/xfs/xfs_defer_item.c b/fs/xfs/xfs_defer_item.c
> > > index dbd10fc..9ed060d 100644
> > > --- a/fs/xfs/xfs_defer_item.c
> > > +++ b/fs/xfs/xfs_defer_item.c
> > > @@ -213,7 +213,8 @@ xfs_rmap_update_finish_item(
> > >  			rmap->ri_bmap.br_startoff,
> > >  			rmap->ri_bmap.br_startblock,
> > >  			rmap->ri_bmap.br_blockcount,
> > > -			rmap->ri_bmap.br_state);
> > > +			rmap->ri_bmap.br_state,
> > > +			(struct xfs_btree_cur **)state);
> > >  	kmem_free(rmap);
> > >  	return error;
> > >  }
> > > @@ -225,6 +226,9 @@ xfs_rmap_update_finish_cleanup(
> > >  	void			*state,
> > >  	int			error)
> > >  {
> > > +	struct xfs_btree_cur	*rcur = state;
> > > +
> > > +	xfs_rmap_finish_one_cleanup(tp, rcur, error);
> > >  }
> > >  
> > >  /* Abort all pending RUIs. */
> > > diff --git a/fs/xfs/xfs_error.h b/fs/xfs/xfs_error.h
> > > index ee4680e..6bc614c 100644
> > > --- a/fs/xfs/xfs_error.h
> > > +++ b/fs/xfs/xfs_error.h
> > > @@ -91,7 +91,8 @@ extern void xfs_verifier_error(struct xfs_buf *bp);
> > >  #define XFS_ERRTAG_DIOWRITE_IOERR			20
> > >  #define XFS_ERRTAG_BMAPIFORMAT				21
> > >  #define XFS_ERRTAG_FREE_EXTENT				22
> > > -#define XFS_ERRTAG_MAX					23
> > > +#define XFS_ERRTAG_RMAP_FINISH_ONE			23
> > > +#define XFS_ERRTAG_MAX					24
> > >  
> > >  /*
> > >   * Random factors for above tags, 1 means always, 2 means 1/2 time, etc.
> > > @@ -119,6 +120,7 @@ extern void xfs_verifier_error(struct xfs_buf *bp);
> > >  #define XFS_RANDOM_DIOWRITE_IOERR			(XFS_RANDOM_DEFAULT/10)
> > >  #define	XFS_RANDOM_BMAPIFORMAT				XFS_RANDOM_DEFAULT
> > >  #define XFS_RANDOM_FREE_EXTENT				1
> > > +#define XFS_RANDOM_RMAP_FINISH_ONE			1
> > >  
> > >  #ifdef DEBUG
> > >  extern int xfs_error_test_active;
> > > diff --git a/fs/xfs/xfs_log_recover.c b/fs/xfs/xfs_log_recover.c
> > > index c9fe0c4..f7f9635 100644
> > > --- a/fs/xfs/xfs_log_recover.c
> > > +++ b/fs/xfs/xfs_log_recover.c
> > > @@ -45,6 +45,7 @@
> > >  #include "xfs_error.h"
> > >  #include "xfs_dir2.h"
> > >  #include "xfs_rmap_item.h"
> > > +#include "xfs_rmap_btree.h"
> > >  
> > >  #define BLK_AVG(blk1, blk2)	((blk1+blk2) >> 1)
> > >  
> > > @@ -4486,6 +4487,12 @@ xlog_recover_process_rui(
> > >  	struct xfs_map_extent		*rmap;
> > >  	xfs_fsblock_t			startblock_fsb;
> > >  	bool				op_ok;
> > > +	struct xfs_rud_log_item		*rudp;
> > > +	enum xfs_rmap_intent_type	type;
> > > +	int				whichfork;
> > > +	xfs_exntst_t			state;
> > > +	struct xfs_trans		*tp;
> > > +	struct xfs_btree_cur		*rcur = NULL;
> > >  
> > >  	ASSERT(!test_bit(XFS_RUI_RECOVERED, &ruip->rui_flags));
> > >  
> > > @@ -4528,9 +4535,54 @@ xlog_recover_process_rui(
> > >  		}
> > >  	}
> > >  
> > > -	/* XXX: do nothing for now */
> > > +	error = xfs_trans_alloc(mp, &M_RES(mp)->tr_itruncate, 0, 0, 0, &tp);
> > > +	if (error)
> > > +		return error;
> > > +	rudp = xfs_trans_get_rud(tp, ruip, ruip->rui_format.rui_nextents);
> > > +
> > > +	for (i = 0; i < ruip->rui_format.rui_nextents; i++) {
> > > +		rmap = &(ruip->rui_format.rui_extents[i]);
> > > +		state = (rmap->me_flags & XFS_RMAP_EXTENT_UNWRITTEN) ?
> > > +				XFS_EXT_UNWRITTEN : XFS_EXT_NORM;
> > > +		whichfork = (rmap->me_flags & XFS_RMAP_EXTENT_ATTR_FORK) ?
> > > +				XFS_ATTR_FORK : XFS_DATA_FORK;
> > > +		switch (rmap->me_flags & XFS_RMAP_EXTENT_TYPE_MASK) {
> > > +		case XFS_RMAP_EXTENT_MAP:
> > > +			type = XFS_RMAP_MAP;
> > > +			break;
> > > +		case XFS_RMAP_EXTENT_UNMAP:
> > > +			type = XFS_RMAP_UNMAP;
> > > +			break;
> > > +		case XFS_RMAP_EXTENT_CONVERT:
> > > +			type = XFS_RMAP_CONVERT;
> > > +			break;
> > > +		case XFS_RMAP_EXTENT_ALLOC:
> > > +			type = XFS_RMAP_ALLOC;
> > > +			break;
> > > +		case XFS_RMAP_EXTENT_FREE:
> > > +			type = XFS_RMAP_FREE;
> > > +			break;
> > > +		default:
> > > +			error = -EFSCORRUPTED;
> > > +			goto abort_error;
> > > +		}
> > > +		error = xfs_trans_log_finish_rmap_update(tp, rudp, type,
> > > +				rmap->me_owner, whichfork,
> > > +				rmap->me_startoff, rmap->me_startblock,
> > > +				rmap->me_len, state, &rcur);
> > > +		if (error)
> > > +			goto abort_error;
> > > +
> > > +	}
> > > +
> > > +	xfs_rmap_finish_one_cleanup(tp, rcur, error);
> > >  	set_bit(XFS_RUI_RECOVERED, &ruip->rui_flags);
> > > -	xfs_rui_release(ruip);
> > > +	error = xfs_trans_commit(tp);
> > > +	return error;
> > > +
> > > +abort_error:
> > > +	xfs_rmap_finish_one_cleanup(tp, rcur, error);
> > > +	xfs_trans_cancel(tp);
> > >  	return error;
> > >  }
> > >  
> > > diff --git a/fs/xfs/xfs_trans.h b/fs/xfs/xfs_trans.h
> > > index c48be63..f59d934 100644
> > > --- a/fs/xfs/xfs_trans.h
> > > +++ b/fs/xfs/xfs_trans.h
> > > @@ -244,12 +244,13 @@ void xfs_trans_log_start_rmap_update(struct xfs_trans *tp,
> > >  		xfs_fsblock_t startblock, xfs_filblks_t blockcount,
> > >  		xfs_exntst_t state);
> > >  
> > > +struct xfs_btree_cur;
> > >  struct xfs_rud_log_item *xfs_trans_get_rud(struct xfs_trans *tp,
> > >  		struct xfs_rui_log_item *ruip, uint nextents);
> > >  int xfs_trans_log_finish_rmap_update(struct xfs_trans *tp,
> > >  		struct xfs_rud_log_item *rudp, enum xfs_rmap_intent_type type,
> > >  		__uint64_t owner, int whichfork, xfs_fileoff_t startoff,
> > >  		xfs_fsblock_t startblock, xfs_filblks_t blockcount,
> > > -		xfs_exntst_t state);
> > > +		xfs_exntst_t state, struct xfs_btree_cur **pcur);
> > >  
> > >  #endif	/* __XFS_TRANS_H__ */
> > > diff --git a/fs/xfs/xfs_trans_rmap.c b/fs/xfs/xfs_trans_rmap.c
> > > index b55a725..0c0df18 100644
> > > --- a/fs/xfs/xfs_trans_rmap.c
> > > +++ b/fs/xfs/xfs_trans_rmap.c
> > > @@ -170,14 +170,15 @@ xfs_trans_log_finish_rmap_update(
> > >  	xfs_fileoff_t			startoff,
> > >  	xfs_fsblock_t			startblock,
> > >  	xfs_filblks_t			blockcount,
> > > -	xfs_exntst_t			state)
> > > +	xfs_exntst_t			state,
> > > +	struct xfs_btree_cur		**pcur)
> > >  {
> > >  	uint				next_extent;
> > >  	struct xfs_map_extent		*rmap;
> > >  	int				error;
> > >  
> > > -	/* XXX: actually finish the rmap update here */
> > > -	error = -EFSCORRUPTED;
> > > +	error = xfs_rmap_finish_one(tp, type, owner, whichfork, startoff,
> > > +			startblock, blockcount, state, pcur);
> > >  
> > >  	/*
> > >  	 * Mark the transaction dirty, even on error. This ensures the
> > > 
> > > _______________________________________________
> > > xfs mailing list
> > > xfs@oss.sgi.com
> > > http://oss.sgi.com/mailman/listinfo/xfs
> 
> _______________________________________________
> xfs mailing list
> xfs@oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs

WARNING: multiple messages have this Message-ID (diff)
From: Brian Foster <bfoster@redhat.com>
To: "Darrick J. Wong" <darrick.wong@oracle.com>
Cc: linux-fsdevel@vger.kernel.org, vishal.l.verma@intel.com, xfs@oss.sgi.com
Subject: Re: [PATCH 044/119] xfs: propagate bmap updates to rmapbt
Date: Mon, 18 Jul 2016 08:55:29 -0400	[thread overview]
Message-ID: <20160718125529.GB27380@bfoster.bfoster> (raw)
In-Reply-To: <20160716072621.GC21529@birch.djwong.org>

On Sat, Jul 16, 2016 at 12:26:21AM -0700, Darrick J. Wong wrote:
> On Fri, Jul 15, 2016 at 02:33:56PM -0400, Brian Foster wrote:
> > On Thu, Jun 16, 2016 at 06:22:34PM -0700, Darrick J. Wong wrote:
> > > When we map, unmap, or convert an extent in a file's data or attr
> > > fork, schedule a respective update in the rmapbt.  Previous versions
> > > of this patch required a 1:1 correspondence between bmap and rmap,
> > > but this is no longer true.
> > > 
> > > v2: Remove the 1:1 correspondence requirement now that we have the
> > > ability to make interval queries against the rmapbt.  Update the
> > > commit message to reflect the broad restructuring of this patch.
> > > Fix the bmap shift code to adjust the rmaps correctly.
> > > 
> > > v3: Use the deferred operations code to handle redo operations
> > > atomically and deadlock free.  Plumb in all five rmap actions
> > > (map, unmap, convert extent, alloc, free); we'll use the first
> > > three now for file data, and reflink will want the last two.
> > > Add an error injection site to test log recovery.
> > > 
> > > Signed-off-by: Darrick J. Wong <darrick.wong@oracle.com>
> > > ---
> > >  fs/xfs/libxfs/xfs_bmap.c       |   56 ++++++++-
> > >  fs/xfs/libxfs/xfs_rmap.c       |  252 ++++++++++++++++++++++++++++++++++++++++
> > >  fs/xfs/libxfs/xfs_rmap_btree.h |   24 ++++
> > >  fs/xfs/xfs_bmap_util.c         |    1 
> > >  fs/xfs/xfs_defer_item.c        |    6 +
> > >  fs/xfs/xfs_error.h             |    4 -
> > >  fs/xfs/xfs_log_recover.c       |   56 +++++++++
> > >  fs/xfs/xfs_trans.h             |    3 
> > >  fs/xfs/xfs_trans_rmap.c        |    7 +
> > >  9 files changed, 393 insertions(+), 16 deletions(-)
> > > 
> > > 
...
> > > diff --git a/fs/xfs/libxfs/xfs_rmap.c b/fs/xfs/libxfs/xfs_rmap.c
> > > index 76fc5c2..f179ea4 100644
> > > --- a/fs/xfs/libxfs/xfs_rmap.c
> > > +++ b/fs/xfs/libxfs/xfs_rmap.c
> > > @@ -36,6 +36,8 @@
> > >  #include "xfs_trace.h"
> > >  #include "xfs_error.h"
> > >  #include "xfs_extent_busy.h"
> > > +#include "xfs_bmap.h"
> > > +#include "xfs_inode.h"
> > >  
> > >  /*
> > >   * Lookup the first record less than or equal to [bno, len, owner, offset]
> > > @@ -1212,3 +1214,253 @@ xfs_rmapbt_query_range(
> > >  	return xfs_btree_query_range(cur, &low_brec, &high_brec,
> > >  			xfs_rmapbt_query_range_helper, &query);
> > >  }
> > > +
> > > +/* Clean up after calling xfs_rmap_finish_one. */
> > > +void
> > > +xfs_rmap_finish_one_cleanup(
> > > +	struct xfs_trans	*tp,
> > > +	struct xfs_btree_cur	*rcur,
> > > +	int			error)
> > > +{
> > > +	struct xfs_buf		*agbp;
> > > +
> > > +	if (rcur == NULL)
> > > +		return;
> > > +	agbp = rcur->bc_private.a.agbp;
> > > +	xfs_btree_del_cursor(rcur, error ? XFS_BTREE_ERROR : XFS_BTREE_NOERROR);
> > > +	xfs_trans_brelse(tp, agbp);
> > 
> > Why unconditionally release the agbp (and not just on error)?
> 
> We grabbed the agbp (er, AGF buffer) to construct the rmapbt cursor, so we have
> to free it after the cursor is deleted regardless of whether or not there's an
> error.
> 

It looks like it's attached to the transaction via xfs_trans_read_*(),
which means it will be released properly on transaction commit. I don't
think it's necessarily a bug because xfs_trans_brelse() bails out when
the item is dirty, but it looks like a departure from how this is used
elsewhere throughout XFS (when no modifications are made or otherwise as
an error condition cleanup). E.g., see the similar pattern in
xfs_free_extent().

Maybe I'm missing something.. was there a known issue that required this
call, or had it always been there?

> > > +}
> > > +
> > > +/*
> > > + * Process one of the deferred rmap operations.  We pass back the
> > > + * btree cursor to maintain our lock on the rmapbt between calls.
> > > + * This saves time and eliminates a buffer deadlock between the
> > > + * superblock and the AGF because we'll always grab them in the same
> > > + * order.
> > > + */
> > > +int
> > > +xfs_rmap_finish_one(
> > > +	struct xfs_trans		*tp,
> > > +	enum xfs_rmap_intent_type	type,
> > > +	__uint64_t			owner,
> > > +	int				whichfork,
> > > +	xfs_fileoff_t			startoff,
> > > +	xfs_fsblock_t			startblock,
> > > +	xfs_filblks_t			blockcount,
> > > +	xfs_exntst_t			state,
> > > +	struct xfs_btree_cur		**pcur)
> > > +{
> > > +	struct xfs_mount		*mp = tp->t_mountp;
> > > +	struct xfs_btree_cur		*rcur;
> > > +	struct xfs_buf			*agbp = NULL;
> > > +	int				error = 0;
> > > +	xfs_agnumber_t			agno;
> > > +	struct xfs_owner_info		oinfo;
> > > +	xfs_agblock_t			bno;
> > > +	bool				unwritten;
> > > +
> > > +	agno = XFS_FSB_TO_AGNO(mp, startblock);
> > > +	ASSERT(agno != NULLAGNUMBER);
> > > +	bno = XFS_FSB_TO_AGBNO(mp, startblock);
> > > +
> > > +	trace_xfs_rmap_deferred(mp, agno, type, bno, owner, whichfork,
> > > +			startoff, blockcount, state);
> > > +
> > > +	if (XFS_TEST_ERROR(false, mp,
> > > +			XFS_ERRTAG_RMAP_FINISH_ONE,
> > > +			XFS_RANDOM_RMAP_FINISH_ONE))
> > > +		return -EIO;
> > > +
> > > +	/*
> > > +	 * If we haven't gotten a cursor or the cursor AG doesn't match
> > > +	 * the startblock, get one now.
> > > +	 */
> > > +	rcur = *pcur;
> > > +	if (rcur != NULL && rcur->bc_private.a.agno != agno) {
> > > +		xfs_rmap_finish_one_cleanup(tp, rcur, 0);
> > > +		rcur = NULL;
> > > +		*pcur = NULL;
> > > +	}
> > > +	if (rcur == NULL) {
> > > +		error = xfs_free_extent_fix_freelist(tp, agno, &agbp);
> > 
> > Comment? Why is this here? (Maybe we should rename that function while
> > we're at it..)
> 
> /*
>  * Ensure the freelist is of a sufficient length to provide for any btree
>  * splits that could happen when we make changes to the rmapbt.
>  */
> 
> (I don't know why the function has that name; Dave supplied it.)
> 
> > > +		if (error)
> > > +			return error;
> > > +		if (!agbp)
> > > +			return -EFSCORRUPTED;
> > > +
> > > +		rcur = xfs_rmapbt_init_cursor(mp, tp, agbp, agno);
> > > +		if (!rcur) {
> > > +			error = -ENOMEM;
> > > +			goto out_cur;
> > > +		}
> > > +	}
> > > +	*pcur = rcur;
> > > +
> > > +	xfs_rmap_ino_owner(&oinfo, owner, whichfork, startoff);
> > > +	unwritten = state == XFS_EXT_UNWRITTEN;
> > > +	bno = XFS_FSB_TO_AGBNO(rcur->bc_mp, startblock);
> > > +
> > > +	switch (type) {
> > > +	case XFS_RMAP_MAP:
> > > +		error = xfs_rmap_map(rcur, bno, blockcount, unwritten, &oinfo);
> > > +		break;
> > > +	case XFS_RMAP_UNMAP:
> > > +		error = xfs_rmap_unmap(rcur, bno, blockcount, unwritten,
> > > +				&oinfo);
> > > +		break;
> > > +	case XFS_RMAP_CONVERT:
> > > +		error = xfs_rmap_convert(rcur, bno, blockcount, !unwritten,
> > > +				&oinfo);
> > > +		break;
> > > +	case XFS_RMAP_ALLOC:
> > > +		error = __xfs_rmap_alloc(rcur, bno, blockcount, unwritten,
> > > +				&oinfo);
> > > +		break;
> > > +	case XFS_RMAP_FREE:
> > > +		error = __xfs_rmap_free(rcur, bno, blockcount, unwritten,
> > > +				&oinfo);
> > > +		break;
> > > +	default:
> > > +		ASSERT(0);
> > > +		error = -EFSCORRUPTED;
> > > +	}
> > > +	return error;
> > > +
> > > +out_cur:
> > > +	xfs_trans_brelse(tp, agbp);
> > > +
> > > +	return error;
> > > +}
> > > +
> > > +/*
> > > + * Record a rmap intent; the list is kept sorted first by AG and then by
> > > + * increasing age.
> > > + */
> > > +static int
> > > +__xfs_rmap_add(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	struct xfs_rmap_intent	*ri)
> > > +{
> > > +	struct xfs_rmap_intent	*new;
> > > +
> > > +	if (!xfs_sb_version_hasrmapbt(&mp->m_sb))
> > > +		return 0;
> > > +
> > > +	trace_xfs_rmap_defer(mp, XFS_FSB_TO_AGNO(mp, ri->ri_bmap.br_startblock),
> > > +			ri->ri_type,
> > > +			XFS_FSB_TO_AGBNO(mp, ri->ri_bmap.br_startblock),
> > > +			ri->ri_owner, ri->ri_whichfork,
> > > +			ri->ri_bmap.br_startoff,
> > > +			ri->ri_bmap.br_blockcount,
> > > +			ri->ri_bmap.br_state);
> > > +
> > > +	new = kmem_zalloc(sizeof(struct xfs_rmap_intent), KM_SLEEP | KM_NOFS);
> > > +	*new = *ri;
> > > +
> > > +	xfs_defer_add(dfops, XFS_DEFER_OPS_TYPE_RMAP, &new->ri_list);
> > > +	return 0;
> > > +}
> > > +
> > > +/* Map an extent into a file. */
> > > +int
> > > +xfs_rmap_map_extent(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	struct xfs_inode	*ip,
> > > +	int			whichfork,
> > > +	struct xfs_bmbt_irec	*PREV)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_MAP;
> > > +	ri.ri_owner = ip->i_ino;
> > > +	ri.ri_whichfork = whichfork;
> > > +	ri.ri_bmap = *PREV;
> > > +
> > 
> > I think we should probably initialize ri_list as well (maybe turn this
> > into an xfs_rmap_init helper).
> 
> __xfs_rmap_add calls xfs_defer_add, which calls list_add_tail, which
> initializes ri_list.  Could probably just make an _rmap_init helper that
> allocates the structure, then have _rmap_*_extent fill out the new intent, and
> make the _rmap_add function pass it to _defer_add, which I think is what you're
> getting at.
> 

I didn't mean to suggest it was a bug. It's more of a defensive thing
than anything.

Brian

> > Also, for some reason it feels to me like the _hasrmapbt() feature check
> > should be up at this level (or higher), rather than buried in
> > __xfs_rmap_add(). I don't feel too strongly about that if others think
> > differently, however.
> 
> <shrug> It probably ought to be in the higher level function.
> 
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > +
> > > +/* Unmap an extent out of a file. */
> > > +int
> > > +xfs_rmap_unmap_extent(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	struct xfs_inode	*ip,
> > > +	int			whichfork,
> > > +	struct xfs_bmbt_irec	*PREV)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_UNMAP;
> > > +	ri.ri_owner = ip->i_ino;
> > > +	ri.ri_whichfork = whichfork;
> > > +	ri.ri_bmap = *PREV;
> > > +
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > +
> > > +/* Convert a data fork extent from unwritten to real or vice versa. */
> > > +int
> > > +xfs_rmap_convert_extent(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	struct xfs_inode	*ip,
> > > +	int			whichfork,
> > > +	struct xfs_bmbt_irec	*PREV)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_CONVERT;
> > > +	ri.ri_owner = ip->i_ino;
> > > +	ri.ri_whichfork = whichfork;
> > > +	ri.ri_bmap = *PREV;
> > > +
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > +
> > > +/* Schedule the creation of an rmap for non-file data. */
> > > +int
> > > +xfs_rmap_alloc_defer(
> > 
> > xfs_rmap_[alloc|free]_extent() like the others..?
> 
> Yeah.  The naming has shifted a bit over the past few revisions.
> 
> --D
> 
> > 
> > Brian 
> > 
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	xfs_agnumber_t		agno,
> > > +	xfs_agblock_t		bno,
> > > +	xfs_extlen_t		len,
> > > +	__uint64_t		owner)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_ALLOC;
> > > +	ri.ri_owner = owner;
> > > +	ri.ri_whichfork = XFS_DATA_FORK;
> > > +	ri.ri_bmap.br_startblock = XFS_AGB_TO_FSB(mp, agno, bno);
> > > +	ri.ri_bmap.br_blockcount = len;
> > > +	ri.ri_bmap.br_startoff = 0;
> > > +	ri.ri_bmap.br_state = XFS_EXT_NORM;
> > > +
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > +
> > > +/* Schedule the deletion of an rmap for non-file data. */
> > > +int
> > > +xfs_rmap_free_defer(
> > > +	struct xfs_mount	*mp,
> > > +	struct xfs_defer_ops	*dfops,
> > > +	xfs_agnumber_t		agno,
> > > +	xfs_agblock_t		bno,
> > > +	xfs_extlen_t		len,
> > > +	__uint64_t		owner)
> > > +{
> > > +	struct xfs_rmap_intent	ri;
> > > +
> > > +	ri.ri_type = XFS_RMAP_FREE;
> > > +	ri.ri_owner = owner;
> > > +	ri.ri_whichfork = XFS_DATA_FORK;
> > > +	ri.ri_bmap.br_startblock = XFS_AGB_TO_FSB(mp, agno, bno);
> > > +	ri.ri_bmap.br_blockcount = len;
> > > +	ri.ri_bmap.br_startoff = 0;
> > > +	ri.ri_bmap.br_state = XFS_EXT_NORM;
> > > +
> > > +	return __xfs_rmap_add(mp, dfops, &ri);
> > > +}
> > > diff --git a/fs/xfs/libxfs/xfs_rmap_btree.h b/fs/xfs/libxfs/xfs_rmap_btree.h
> > > index aff60dc..5df406e 100644
> > > --- a/fs/xfs/libxfs/xfs_rmap_btree.h
> > > +++ b/fs/xfs/libxfs/xfs_rmap_btree.h
> > > @@ -106,4 +106,28 @@ struct xfs_rmap_intent {
> > >  	struct xfs_bmbt_irec			ri_bmap;
> > >  };
> > >  
> > > +/* functions for updating the rmapbt based on bmbt map/unmap operations */
> > > +int xfs_rmap_map_extent(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		struct xfs_inode *ip, int whichfork,
> > > +		struct xfs_bmbt_irec *imap);
> > > +int xfs_rmap_unmap_extent(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		struct xfs_inode *ip, int whichfork,
> > > +		struct xfs_bmbt_irec *imap);
> > > +int xfs_rmap_convert_extent(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		struct xfs_inode *ip, int whichfork,
> > > +		struct xfs_bmbt_irec *imap);
> > > +int xfs_rmap_alloc_defer(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		xfs_agnumber_t agno, xfs_agblock_t bno, xfs_extlen_t len,
> > > +		__uint64_t owner);
> > > +int xfs_rmap_free_defer(struct xfs_mount *mp, struct xfs_defer_ops *dfops,
> > > +		xfs_agnumber_t agno, xfs_agblock_t bno, xfs_extlen_t len,
> > > +		__uint64_t owner);
> > > +
> > > +void xfs_rmap_finish_one_cleanup(struct xfs_trans *tp,
> > > +		struct xfs_btree_cur *rcur, int error);
> > > +int xfs_rmap_finish_one(struct xfs_trans *tp, enum xfs_rmap_intent_type type,
> > > +		__uint64_t owner, int whichfork, xfs_fileoff_t startoff,
> > > +		xfs_fsblock_t startblock, xfs_filblks_t blockcount,
> > > +		xfs_exntst_t state, struct xfs_btree_cur **pcur);
> > > +
> > >  #endif	/* __XFS_RMAP_BTREE_H__ */
> > > diff --git a/fs/xfs/xfs_bmap_util.c b/fs/xfs/xfs_bmap_util.c
> > > index 62d194e..450fd49 100644
> > > --- a/fs/xfs/xfs_bmap_util.c
> > > +++ b/fs/xfs/xfs_bmap_util.c
> > > @@ -41,6 +41,7 @@
> > >  #include "xfs_trace.h"
> > >  #include "xfs_icache.h"
> > >  #include "xfs_log.h"
> > > +#include "xfs_rmap_btree.h"
> > >  
> > >  /* Kernel only BMAP related definitions and functions */
> > >  
> > > diff --git a/fs/xfs/xfs_defer_item.c b/fs/xfs/xfs_defer_item.c
> > > index dbd10fc..9ed060d 100644
> > > --- a/fs/xfs/xfs_defer_item.c
> > > +++ b/fs/xfs/xfs_defer_item.c
> > > @@ -213,7 +213,8 @@ xfs_rmap_update_finish_item(
> > >  			rmap->ri_bmap.br_startoff,
> > >  			rmap->ri_bmap.br_startblock,
> > >  			rmap->ri_bmap.br_blockcount,
> > > -			rmap->ri_bmap.br_state);
> > > +			rmap->ri_bmap.br_state,
> > > +			(struct xfs_btree_cur **)state);
> > >  	kmem_free(rmap);
> > >  	return error;
> > >  }
> > > @@ -225,6 +226,9 @@ xfs_rmap_update_finish_cleanup(
> > >  	void			*state,
> > >  	int			error)
> > >  {
> > > +	struct xfs_btree_cur	*rcur = state;
> > > +
> > > +	xfs_rmap_finish_one_cleanup(tp, rcur, error);
> > >  }
> > >  
> > >  /* Abort all pending RUIs. */
> > > diff --git a/fs/xfs/xfs_error.h b/fs/xfs/xfs_error.h
> > > index ee4680e..6bc614c 100644
> > > --- a/fs/xfs/xfs_error.h
> > > +++ b/fs/xfs/xfs_error.h
> > > @@ -91,7 +91,8 @@ extern void xfs_verifier_error(struct xfs_buf *bp);
> > >  #define XFS_ERRTAG_DIOWRITE_IOERR			20
> > >  #define XFS_ERRTAG_BMAPIFORMAT				21
> > >  #define XFS_ERRTAG_FREE_EXTENT				22
> > > -#define XFS_ERRTAG_MAX					23
> > > +#define XFS_ERRTAG_RMAP_FINISH_ONE			23
> > > +#define XFS_ERRTAG_MAX					24
> > >  
> > >  /*
> > >   * Random factors for above tags, 1 means always, 2 means 1/2 time, etc.
> > > @@ -119,6 +120,7 @@ extern void xfs_verifier_error(struct xfs_buf *bp);
> > >  #define XFS_RANDOM_DIOWRITE_IOERR			(XFS_RANDOM_DEFAULT/10)
> > >  #define	XFS_RANDOM_BMAPIFORMAT				XFS_RANDOM_DEFAULT
> > >  #define XFS_RANDOM_FREE_EXTENT				1
> > > +#define XFS_RANDOM_RMAP_FINISH_ONE			1
> > >  
> > >  #ifdef DEBUG
> > >  extern int xfs_error_test_active;
> > > diff --git a/fs/xfs/xfs_log_recover.c b/fs/xfs/xfs_log_recover.c
> > > index c9fe0c4..f7f9635 100644
> > > --- a/fs/xfs/xfs_log_recover.c
> > > +++ b/fs/xfs/xfs_log_recover.c
> > > @@ -45,6 +45,7 @@
> > >  #include "xfs_error.h"
> > >  #include "xfs_dir2.h"
> > >  #include "xfs_rmap_item.h"
> > > +#include "xfs_rmap_btree.h"
> > >  
> > >  #define BLK_AVG(blk1, blk2)	((blk1+blk2) >> 1)
> > >  
> > > @@ -4486,6 +4487,12 @@ xlog_recover_process_rui(
> > >  	struct xfs_map_extent		*rmap;
> > >  	xfs_fsblock_t			startblock_fsb;
> > >  	bool				op_ok;
> > > +	struct xfs_rud_log_item		*rudp;
> > > +	enum xfs_rmap_intent_type	type;
> > > +	int				whichfork;
> > > +	xfs_exntst_t			state;
> > > +	struct xfs_trans		*tp;
> > > +	struct xfs_btree_cur		*rcur = NULL;
> > >  
> > >  	ASSERT(!test_bit(XFS_RUI_RECOVERED, &ruip->rui_flags));
> > >  
> > > @@ -4528,9 +4535,54 @@ xlog_recover_process_rui(
> > >  		}
> > >  	}
> > >  
> > > -	/* XXX: do nothing for now */
> > > +	error = xfs_trans_alloc(mp, &M_RES(mp)->tr_itruncate, 0, 0, 0, &tp);
> > > +	if (error)
> > > +		return error;
> > > +	rudp = xfs_trans_get_rud(tp, ruip, ruip->rui_format.rui_nextents);
> > > +
> > > +	for (i = 0; i < ruip->rui_format.rui_nextents; i++) {
> > > +		rmap = &(ruip->rui_format.rui_extents[i]);
> > > +		state = (rmap->me_flags & XFS_RMAP_EXTENT_UNWRITTEN) ?
> > > +				XFS_EXT_UNWRITTEN : XFS_EXT_NORM;
> > > +		whichfork = (rmap->me_flags & XFS_RMAP_EXTENT_ATTR_FORK) ?
> > > +				XFS_ATTR_FORK : XFS_DATA_FORK;
> > > +		switch (rmap->me_flags & XFS_RMAP_EXTENT_TYPE_MASK) {
> > > +		case XFS_RMAP_EXTENT_MAP:
> > > +			type = XFS_RMAP_MAP;
> > > +			break;
> > > +		case XFS_RMAP_EXTENT_UNMAP:
> > > +			type = XFS_RMAP_UNMAP;
> > > +			break;
> > > +		case XFS_RMAP_EXTENT_CONVERT:
> > > +			type = XFS_RMAP_CONVERT;
> > > +			break;
> > > +		case XFS_RMAP_EXTENT_ALLOC:
> > > +			type = XFS_RMAP_ALLOC;
> > > +			break;
> > > +		case XFS_RMAP_EXTENT_FREE:
> > > +			type = XFS_RMAP_FREE;
> > > +			break;
> > > +		default:
> > > +			error = -EFSCORRUPTED;
> > > +			goto abort_error;
> > > +		}
> > > +		error = xfs_trans_log_finish_rmap_update(tp, rudp, type,
> > > +				rmap->me_owner, whichfork,
> > > +				rmap->me_startoff, rmap->me_startblock,
> > > +				rmap->me_len, state, &rcur);
> > > +		if (error)
> > > +			goto abort_error;
> > > +
> > > +	}
> > > +
> > > +	xfs_rmap_finish_one_cleanup(tp, rcur, error);
> > >  	set_bit(XFS_RUI_RECOVERED, &ruip->rui_flags);
> > > -	xfs_rui_release(ruip);
> > > +	error = xfs_trans_commit(tp);
> > > +	return error;
> > > +
> > > +abort_error:
> > > +	xfs_rmap_finish_one_cleanup(tp, rcur, error);
> > > +	xfs_trans_cancel(tp);
> > >  	return error;
> > >  }
> > >  
> > > diff --git a/fs/xfs/xfs_trans.h b/fs/xfs/xfs_trans.h
> > > index c48be63..f59d934 100644
> > > --- a/fs/xfs/xfs_trans.h
> > > +++ b/fs/xfs/xfs_trans.h
> > > @@ -244,12 +244,13 @@ void xfs_trans_log_start_rmap_update(struct xfs_trans *tp,
> > >  		xfs_fsblock_t startblock, xfs_filblks_t blockcount,
> > >  		xfs_exntst_t state);
> > >  
> > > +struct xfs_btree_cur;
> > >  struct xfs_rud_log_item *xfs_trans_get_rud(struct xfs_trans *tp,
> > >  		struct xfs_rui_log_item *ruip, uint nextents);
> > >  int xfs_trans_log_finish_rmap_update(struct xfs_trans *tp,
> > >  		struct xfs_rud_log_item *rudp, enum xfs_rmap_intent_type type,
> > >  		__uint64_t owner, int whichfork, xfs_fileoff_t startoff,
> > >  		xfs_fsblock_t startblock, xfs_filblks_t blockcount,
> > > -		xfs_exntst_t state);
> > > +		xfs_exntst_t state, struct xfs_btree_cur **pcur);
> > >  
> > >  #endif	/* __XFS_TRANS_H__ */
> > > diff --git a/fs/xfs/xfs_trans_rmap.c b/fs/xfs/xfs_trans_rmap.c
> > > index b55a725..0c0df18 100644
> > > --- a/fs/xfs/xfs_trans_rmap.c
> > > +++ b/fs/xfs/xfs_trans_rmap.c
> > > @@ -170,14 +170,15 @@ xfs_trans_log_finish_rmap_update(
> > >  	xfs_fileoff_t			startoff,
> > >  	xfs_fsblock_t			startblock,
> > >  	xfs_filblks_t			blockcount,
> > > -	xfs_exntst_t			state)
> > > +	xfs_exntst_t			state,
> > > +	struct xfs_btree_cur		**pcur)
> > >  {
> > >  	uint				next_extent;
> > >  	struct xfs_map_extent		*rmap;
> > >  	int				error;
> > >  
> > > -	/* XXX: actually finish the rmap update here */
> > > -	error = -EFSCORRUPTED;
> > > +	error = xfs_rmap_finish_one(tp, type, owner, whichfork, startoff,
> > > +			startblock, blockcount, state, pcur);
> > >  
> > >  	/*
> > >  	 * Mark the transaction dirty, even on error. This ensures the
> > > 
> > > _______________________________________________
> > > xfs mailing list
> > > xfs@oss.sgi.com
> > > http://oss.sgi.com/mailman/listinfo/xfs
> 
> _______________________________________________
> xfs mailing list
> xfs@oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

  parent reply	other threads:[~2016-07-18 12:55 UTC|newest]

Thread overview: 472+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-06-17  1:17 [PATCH v6 000/119] xfs: add reverse mapping, reflink, dedupe, and online scrub support Darrick J. Wong
2016-06-17  1:17 ` Darrick J. Wong
2016-06-17  1:17 ` [PATCH 001/119] vfs: fix return type of ioctl_file_dedupe_range Darrick J. Wong
2016-06-17  1:17   ` Darrick J. Wong
2016-06-17 11:32   ` Christoph Hellwig
2016-06-17 11:32     ` Christoph Hellwig
2016-06-28 19:19     ` Darrick J. Wong
2016-06-28 19:19       ` Darrick J. Wong
2016-06-17  1:18 ` [PATCH 002/119] vfs: support FS_XFLAG_REFLINK and FS_XFLAG_COWEXTSIZE Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-17 11:41   ` Christoph Hellwig
2016-06-17 11:41     ` Christoph Hellwig
2016-06-17 12:16     ` Brian Foster
2016-06-17 12:16       ` Brian Foster
2016-06-17 15:06       ` Christoph Hellwig
2016-06-17 15:06         ` Christoph Hellwig
2016-06-17 16:54       ` Darrick J. Wong
2016-06-17 16:54         ` Darrick J. Wong
2016-06-17 17:38         ` Brian Foster
2016-06-17 17:38           ` Brian Foster
2016-06-17  1:18 ` [PATCH 003/119] xfs: check offsets of variable length structures Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-17 11:33   ` Christoph Hellwig
2016-06-17 11:33     ` Christoph Hellwig
2016-06-17 17:34   ` Brian Foster
2016-06-17 17:34     ` Brian Foster
2016-06-18 18:01     ` Darrick J. Wong
2016-06-18 18:01       ` Darrick J. Wong
2016-06-20 12:38       ` Brian Foster
2016-06-20 12:38         ` Brian Foster
2016-06-17  1:18 ` [PATCH 004/119] xfs: enable buffer deadlock postmortem diagnosis via ftrace Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-17 11:34   ` Christoph Hellwig
2016-06-17 11:34     ` Christoph Hellwig
2016-06-21  0:47     ` Dave Chinner
2016-06-21  0:47       ` Dave Chinner
2016-06-17  1:18 ` [PATCH 005/119] xfs: check for a valid error_tag in errortag_add Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-17 11:34   ` Christoph Hellwig
2016-06-17 11:34     ` Christoph Hellwig
2016-06-17  1:18 ` [PATCH 006/119] xfs: port differences from xfsprogs libxfs Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-17 15:06   ` Christoph Hellwig
2016-06-20  0:21   ` Dave Chinner
2016-06-20  0:21     ` Dave Chinner
2016-07-13 23:39     ` Darrick J. Wong
2016-07-13 23:39       ` Darrick J. Wong
2016-06-17  1:18 ` [PATCH 007/119] xfs: rearrange xfs_bmap_add_free parameters Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-17 11:39   ` Christoph Hellwig
2016-06-17 11:39     ` Christoph Hellwig
2016-06-17  1:18 ` [PATCH 008/119] xfs: separate freelist fixing into a separate helper Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-17 11:52   ` Christoph Hellwig
2016-06-17 11:52     ` Christoph Hellwig
2016-06-21  0:48     ` Dave Chinner
2016-06-21  0:48       ` Dave Chinner
2016-06-21  1:40   ` Dave Chinner
2016-06-21  1:40     ` Dave Chinner
2016-06-17  1:18 ` [PATCH 009/119] xfs: convert list of extents to free into a regular list Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-17 11:59   ` Christoph Hellwig
2016-06-17 11:59     ` Christoph Hellwig
2016-06-18 20:15     ` Darrick J. Wong
2016-06-18 20:15       ` Darrick J. Wong
2016-06-21  0:57       ` Dave Chinner
2016-06-21  0:57         ` Dave Chinner
2016-07-18  3:30         ` Eric Sandeen
2016-06-17  1:18 ` [PATCH 010/119] xfs: create a standard btree size calculator code Darrick J. Wong
2016-06-17  1:18   ` Darrick J. Wong
2016-06-20 14:31   ` Brian Foster
2016-06-20 14:31     ` Brian Foster
2016-06-20 19:34     ` Darrick J. Wong
2016-06-20 19:34       ` Darrick J. Wong
2016-06-17  1:19 ` [PATCH 011/119] xfs: refactor btree maxlevels computation Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-20 14:31   ` Brian Foster
2016-06-20 14:31     ` Brian Foster
2016-06-20 18:23     ` Darrick J. Wong
2016-06-20 18:23       ` Darrick J. Wong
2016-06-17  1:19 ` [PATCH 012/119] xfs: during btree split, save new block key & ptr for future insertion Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-21 13:00   ` Brian Foster
2016-06-21 13:00     ` Brian Foster
2016-06-27 22:30     ` Darrick J. Wong
2016-06-27 22:30       ` Darrick J. Wong
2016-06-28 12:31       ` Brian Foster
2016-06-28 12:31         ` Brian Foster
2016-06-17  1:19 ` [PATCH 013/119] xfs: support btrees with overlapping intervals for keys Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-22 15:17   ` Brian Foster
2016-06-22 15:17     ` Brian Foster
2016-06-28  3:26     ` Darrick J. Wong
2016-06-28  3:26       ` Darrick J. Wong
2016-06-28 12:32       ` Brian Foster
2016-06-28 12:32         ` Brian Foster
2016-06-28 17:36         ` Darrick J. Wong
2016-06-28 17:36           ` Darrick J. Wong
2016-07-06  4:59   ` Dave Chinner
2016-07-06  4:59     ` Dave Chinner
2016-07-06  8:09     ` Darrick J. Wong
2016-07-06  8:09       ` Darrick J. Wong
2016-06-17  1:19 ` [PATCH 014/119] xfs: introduce interval queries on btrees Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-22 15:18   ` Brian Foster
2016-06-22 15:18     ` Brian Foster
2016-06-27 21:07     ` Darrick J. Wong
2016-06-27 21:07       ` Darrick J. Wong
2016-06-28 12:32       ` Brian Foster
2016-06-28 12:32         ` Brian Foster
2016-06-28 16:29         ` Darrick J. Wong
2016-06-28 16:29           ` Darrick J. Wong
2016-06-17  1:19 ` [PATCH 015/119] xfs: refactor btree owner change into a separate visit-blocks function Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-23 17:19   ` Brian Foster
2016-06-23 17:19     ` Brian Foster
2016-06-17  1:19 ` [PATCH 016/119] xfs: move deferred operations into a separate file Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-27 13:14   ` Brian Foster
2016-06-27 13:14     ` Brian Foster
2016-06-27 19:14     ` Darrick J. Wong
2016-06-27 19:14       ` Darrick J. Wong
2016-06-28 12:32       ` Brian Foster
2016-06-28 12:32         ` Brian Foster
2016-06-28 18:51         ` Darrick J. Wong
2016-06-28 18:51           ` Darrick J. Wong
2016-06-17  1:19 ` [PATCH 017/119] xfs: add tracepoints for the deferred ops mechanism Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-27 13:15   ` Brian Foster
2016-06-27 13:15     ` Brian Foster
2016-06-17  1:19 ` [PATCH 018/119] xfs: enable the xfs_defer mechanism to process extents to free Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-27 13:15   ` Brian Foster
2016-06-27 13:15     ` Brian Foster
2016-06-27 21:41     ` Darrick J. Wong
2016-06-27 21:41       ` Darrick J. Wong
2016-06-27 22:00       ` Darrick J. Wong
2016-06-27 22:00         ` Darrick J. Wong
2016-06-28 12:32         ` Brian Foster
2016-06-28 12:32           ` Brian Foster
2016-06-28 16:33           ` Darrick J. Wong
2016-06-28 16:33             ` Darrick J. Wong
2016-06-17  1:19 ` [PATCH 019/119] xfs: rework xfs_bmap_free callers to use xfs_defer_ops Darrick J. Wong
2016-06-17  1:19   ` Darrick J. Wong
2016-06-17  1:20 ` [PATCH 020/119] xfs: change xfs_bmap_{finish, cancel, init, free} -> xfs_defer_* Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-06-30  0:11   ` Darrick J. Wong
2016-06-30  0:11     ` Darrick J. Wong
2016-06-17  1:20 ` [PATCH 021/119] xfs: rename flist/free_list to dfops Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-06-17  1:20 ` [PATCH 022/119] xfs: add tracepoints and error injection for deferred extent freeing Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-06-17  1:20 ` [PATCH 023/119] xfs: introduce rmap btree definitions Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-06-30 17:32   ` Brian Foster
2016-06-30 17:32     ` Brian Foster
2016-06-17  1:20 ` [PATCH 024/119] xfs: add rmap btree stats infrastructure Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-06-30 17:32   ` Brian Foster
2016-06-30 17:32     ` Brian Foster
2016-06-17  1:20 ` [PATCH 025/119] xfs: rmap btree add more reserved blocks Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-06-30 17:32   ` Brian Foster
2016-06-30 17:32     ` Brian Foster
2016-06-17  1:20 ` [PATCH 026/119] xfs: add owner field to extent allocation and freeing Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-07-06  4:01   ` Dave Chinner
2016-07-06  4:01     ` Dave Chinner
2016-07-06  6:44     ` Darrick J. Wong
2016-07-06  6:44       ` Darrick J. Wong
2016-07-07 15:12   ` Brian Foster
2016-07-07 15:12     ` Brian Foster
2016-07-07 19:09     ` Darrick J. Wong
2016-07-07 19:09       ` Darrick J. Wong
2016-07-07 22:55       ` Dave Chinner
2016-07-07 22:55         ` Dave Chinner
2016-07-08 11:37       ` Brian Foster
2016-07-08 11:37         ` Brian Foster
2016-06-17  1:20 ` [PATCH 027/119] xfs: introduce rmap extent operation stubs Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-06-17  1:20 ` [PATCH 028/119] xfs: define the on-disk rmap btree format Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-07-06  4:05   ` Dave Chinner
2016-07-06  4:05     ` Dave Chinner
2016-07-06  6:44     ` Darrick J. Wong
2016-07-06  6:44       ` Darrick J. Wong
2016-07-07 18:41   ` Brian Foster
2016-07-07 18:41     ` Brian Foster
2016-07-07 19:18     ` Darrick J. Wong
2016-07-07 19:18       ` Darrick J. Wong
2016-07-07 23:14       ` Dave Chinner
2016-07-07 23:14         ` Dave Chinner
2016-07-07 23:58         ` Darrick J. Wong
2016-07-07 23:58           ` Darrick J. Wong
2016-06-17  1:20 ` [PATCH 029/119] xfs: add rmap btree growfs support Darrick J. Wong
2016-06-17  1:20   ` Darrick J. Wong
2016-06-17  1:21 ` [PATCH 030/119] xfs: rmap btree transaction reservations Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-07-08 13:21   ` Brian Foster
2016-07-08 13:21     ` Brian Foster
2016-06-17  1:21 ` [PATCH 031/119] xfs: rmap btree requires more reserved free space Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-07-08 13:21   ` Brian Foster
2016-07-08 13:21     ` Brian Foster
2016-07-13 16:50     ` Darrick J. Wong
2016-07-13 16:50       ` Darrick J. Wong
2016-07-13 18:32       ` Brian Foster
2016-07-13 18:32         ` Brian Foster
2016-07-13 23:50         ` Dave Chinner
2016-07-13 23:50           ` Dave Chinner
2016-06-17  1:21 ` [PATCH 032/119] xfs: add rmap btree operations Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-07-08 18:33   ` Brian Foster
2016-07-08 18:33     ` Brian Foster
2016-07-08 23:53     ` Darrick J. Wong
2016-07-08 23:53       ` Darrick J. Wong
2016-06-17  1:21 ` [PATCH 033/119] xfs: support overlapping intervals in the rmap btree Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-07-08 18:33   ` Brian Foster
2016-07-08 18:33     ` Brian Foster
2016-07-09  0:14     ` Darrick J. Wong
2016-07-09  0:14       ` Darrick J. Wong
2016-07-09 13:25       ` Brian Foster
2016-07-09 13:25         ` Brian Foster
2016-06-17  1:21 ` [PATCH 034/119] xfs: teach rmapbt to support interval queries Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-07-08 18:34   ` Brian Foster
2016-07-08 18:34     ` Brian Foster
2016-07-09  0:16     ` Darrick J. Wong
2016-07-09  0:16       ` Darrick J. Wong
2016-07-09 13:25       ` Brian Foster
2016-07-09 13:25         ` Brian Foster
2016-06-17  1:21 ` [PATCH 035/119] xfs: add tracepoints for the rmap functions Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-07-08 18:34   ` Brian Foster
2016-07-08 18:34     ` Brian Foster
2016-06-17  1:21 ` [PATCH 036/119] xfs: add an extent to the rmap btree Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-07-11 18:49   ` Brian Foster
2016-07-11 18:49     ` Brian Foster
2016-07-11 23:01     ` Darrick J. Wong
2016-07-11 23:01       ` Darrick J. Wong
2016-06-17  1:21 ` [PATCH 037/119] xfs: remove an extent from " Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-07-11 18:49   ` Brian Foster
2016-07-11 18:49     ` Brian Foster
2016-06-17  1:21 ` [PATCH 038/119] xfs: convert unwritten status of reverse mappings Darrick J. Wong
2016-06-17  1:21   ` Darrick J. Wong
2016-06-30  0:15   ` Darrick J. Wong
2016-06-30  0:15     ` Darrick J. Wong
2016-07-13 18:27   ` Brian Foster
2016-07-13 18:27     ` Brian Foster
2016-07-13 20:43     ` Darrick J. Wong
2016-07-13 20:43       ` Darrick J. Wong
2016-06-17  1:22 ` [PATCH 039/119] xfs: add rmap btree insert and delete helpers Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-13 18:28   ` Brian Foster
2016-07-13 18:28     ` Brian Foster
2016-07-13 18:37     ` Darrick J. Wong
2016-07-13 18:37       ` Darrick J. Wong
2016-07-13 18:42       ` Brian Foster
2016-07-13 18:42         ` Brian Foster
2016-06-17  1:22 ` [PATCH 040/119] xfs: create helpers for mapping, unmapping, and converting file fork extents Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-13 18:28   ` Brian Foster
2016-07-13 18:28     ` Brian Foster
2016-07-13 18:47     ` Darrick J. Wong
2016-07-13 18:47       ` Darrick J. Wong
2016-07-13 23:54       ` Dave Chinner
2016-07-13 23:54         ` Dave Chinner
2016-07-13 23:55         ` Darrick J. Wong
2016-07-13 23:55           ` Darrick J. Wong
2016-06-17  1:22 ` [PATCH 041/119] xfs: create rmap update intent log items Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-15 18:33   ` Brian Foster
2016-07-15 18:33     ` Brian Foster
2016-07-16  7:10     ` Darrick J. Wong
2016-07-16  7:10       ` Darrick J. Wong
2016-06-17  1:22 ` [PATCH 042/119] xfs: log rmap intent items Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-15 18:33   ` Brian Foster
2016-07-15 18:33     ` Brian Foster
2016-07-16  7:34     ` Darrick J. Wong
2016-07-16  7:34       ` Darrick J. Wong
2016-07-18 12:55       ` Brian Foster
2016-07-18 12:55         ` Brian Foster
2016-07-19 17:10         ` Darrick J. Wong
2016-07-19 17:10           ` Darrick J. Wong
2016-06-17  1:22 ` [PATCH 043/119] xfs: enable the xfs_defer mechanism to process rmaps to update Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-15 18:33   ` Brian Foster
2016-07-15 18:33     ` Brian Foster
2016-06-17  1:22 ` [PATCH 044/119] xfs: propagate bmap updates to rmapbt Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-15 18:33   ` Brian Foster
2016-07-15 18:33     ` Brian Foster
2016-07-16  7:26     ` Darrick J. Wong
2016-07-16  7:26       ` Darrick J. Wong
2016-07-18  1:21       ` Dave Chinner
2016-07-18  1:21         ` Dave Chinner
2016-07-18 12:56         ` Brian Foster
2016-07-18 12:56           ` Brian Foster
2016-07-18 12:55       ` Brian Foster [this message]
2016-07-18 12:55         ` Brian Foster
2016-07-19  1:53         ` Darrick J. Wong
2016-07-19  1:53           ` Darrick J. Wong
2016-07-19 11:37           ` Brian Foster
2016-07-19 11:37             ` Brian Foster
2016-06-17  1:22 ` [PATCH 045/119] xfs: add rmap btree geometry feature flag Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-18 13:34   ` Brian Foster
2016-07-18 13:34     ` Brian Foster
2016-06-17  1:22 ` [PATCH 046/119] xfs: add rmap btree block detection to log recovery Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-18 13:34   ` Brian Foster
2016-07-18 13:34     ` Brian Foster
2016-06-17  1:22 ` [PATCH 047/119] xfs: disable XFS_IOC_SWAPEXT when rmap btree is enabled Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-18 13:34   ` Brian Foster
2016-07-18 13:34     ` Brian Foster
2016-07-18 16:18     ` Darrick J. Wong
2016-07-18 16:18       ` Darrick J. Wong
2016-06-17  1:22 ` [PATCH 048/119] xfs: don't update rmapbt when fixing agfl Darrick J. Wong
2016-06-17  1:22   ` Darrick J. Wong
2016-07-18 13:34   ` Brian Foster
2016-07-18 13:34     ` Brian Foster
2016-07-18 15:53     ` Darrick J. Wong
2016-07-18 15:53       ` Darrick J. Wong
2016-06-17  1:23 ` [PATCH 049/119] xfs: enable the rmap btree functionality Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-07-18 13:34   ` Brian Foster
2016-07-18 13:34     ` Brian Foster
2016-06-17  1:23 ` [PATCH 050/119] xfs: count the blocks in a btree Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-06-17  1:23 ` [PATCH 051/119] xfs: introduce tracepoints for AG reservation code Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-06-17  1:23 ` [PATCH 052/119] xfs: set up per-AG free space reservations Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-06-17  1:23 ` [PATCH 053/119] xfs: define tracepoints for refcount btree activities Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-06-17  1:23 ` [PATCH 054/119] xfs: introduce refcount btree definitions Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-06-17  1:23 ` [PATCH 055/119] xfs: add refcount btree stats infrastructure Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-06-17  1:23 ` [PATCH 056/119] xfs: refcount btree add more reserved blocks Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-06-17  1:23 ` [PATCH 057/119] xfs: define the on-disk refcount btree format Darrick J. Wong
2016-06-17  1:23   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 058/119] xfs: add refcount btree support to growfs Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 059/119] xfs: account for the refcount btree in the alloc/free log reservation Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 060/119] xfs: add refcount btree operations Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 061/119] xfs: create refcount update intent log items Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 062/119] xfs: log refcount intent items Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 063/119] xfs: adjust refcount of an extent of blocks in refcount btree Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 064/119] xfs: connect refcount adjust functions to upper layers Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 065/119] xfs: adjust refcount when unmapping file blocks Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:24 ` [PATCH 066/119] xfs: add refcount btree block detection to log recovery Darrick J. Wong
2016-06-17  1:24   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 067/119] xfs: refcount btree requires more reserved space Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 068/119] xfs: introduce reflink utility functions Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 069/119] xfs: create bmbt update intent log items Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 070/119] xfs: log bmap intent items Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 071/119] xfs: map an inode's offset to an exact physical block Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 072/119] xfs: implement deferred bmbt map/unmap operations Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 073/119] xfs: return work remaining at the end of a bunmapi operation Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 074/119] xfs: define tracepoints for reflink activities Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 075/119] xfs: add reflink feature flag to geometry Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:25 ` [PATCH 076/119] xfs: don't allow reflinked dir/dev/fifo/socket/pipe files Darrick J. Wong
2016-06-17  1:25   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 077/119] xfs: introduce the CoW fork Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 078/119] xfs: support bmapping delalloc extents in " Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 079/119] xfs: create delalloc extents in " Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 080/119] xfs: support allocating delayed " Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 081/119] xfs: allocate " Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 082/119] xfs: support removing extents from " Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 083/119] xfs: move mappings from cow fork to data fork after copy-write Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 084/119] xfs: implement CoW for directio writes Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:26 ` [PATCH 085/119] xfs: copy-on-write reflinked blocks when zeroing ranges of blocks Darrick J. Wong
2016-06-17  1:26   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 086/119] xfs: cancel CoW reservations and clear inode reflink flag when freeing blocks Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 087/119] xfs: cancel pending CoW reservations when destroying inodes Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 088/119] xfs: store in-progress CoW allocations in the refcount btree Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 089/119] xfs: reflink extents from one file to another Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 090/119] xfs: add clone file and clone range vfs functions Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 091/119] xfs: add dedupe range vfs function Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 092/119] xfs: teach get_bmapx and fiemap about shared extents and the CoW fork Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 093/119] xfs: swap inode reflink flags when swapping inode extents Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:27 ` [PATCH 094/119] xfs: unshare a range of blocks via fallocate Darrick J. Wong
2016-06-17  1:27   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 095/119] xfs: CoW shared EOF block when truncating file Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 096/119] xfs: support FS_XFLAG_REFLINK on reflink filesystems Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 097/119] xfs: create a separate cow extent size hint for the allocator Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 098/119] xfs: preallocate blocks for worst-case btree expansion Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 099/119] xfs: don't allow reflink when the AG is low on space Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 100/119] xfs: try other AGs to allocate a BMBT block Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 101/119] xfs: promote buffered writes to CoW when cowextsz is set Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 102/119] xfs: garbage collect old cowextsz reservations Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:28 ` [PATCH 103/119] xfs: provide switch to force filesystem to copy-on-write all the time Darrick J. Wong
2016-06-17  1:28   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 104/119] xfs: increase log reservations for reflink Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 105/119] xfs: use interval query for rmap alloc operations on shared files Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 106/119] xfs: convert unwritten status of reverse mappings for " Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 107/119] xfs: set a default CoW extent size of 32 blocks Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 108/119] xfs: don't allow realtime and reflinked files to mix Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 109/119] xfs: don't mix reflink and DAX mode for now Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 110/119] xfs: fail ->bmap for reflink inodes Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 111/119] xfs: recognize the reflink feature bit Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:29 ` [PATCH 112/119] xfs: introduce the XFS_IOC_GETFSMAPX ioctl Darrick J. Wong
2016-06-17  1:29   ` Darrick J. Wong
2016-06-17  1:30 ` [PATCH 113/119] xfs: scrub btree records and pointers while querying Darrick J. Wong
2016-06-17  1:30   ` Darrick J. Wong
2016-06-17  1:30 ` [PATCH 114/119] xfs: create sysfs hooks to scrub various files Darrick J. Wong
2016-06-17  1:30   ` Darrick J. Wong
2016-06-17  1:30 ` [PATCH 115/119] xfs: support scrubbing free space btrees Darrick J. Wong
2016-06-17  1:30   ` Darrick J. Wong
2016-06-17  1:30 ` [PATCH 116/119] xfs: support scrubbing inode btrees Darrick J. Wong
2016-06-17  1:30   ` Darrick J. Wong
2016-06-17  1:30 ` [PATCH 117/119] xfs: support scrubbing rmap btree Darrick J. Wong
2016-06-17  1:30   ` Darrick J. Wong
2016-06-17  1:30 ` [PATCH 118/119] xfs: support scrubbing refcount btree Darrick J. Wong
2016-06-17  1:30   ` Darrick J. Wong
2016-06-17  1:30 ` [PATCH 119/119] xfs: add btree scrub tracepoints Darrick J. Wong
2016-06-17  1:30   ` Darrick J. Wong

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20160718125529.GB27380@bfoster.bfoster \
    --to=bfoster@redhat.com \
    --cc=darrick.wong@oracle.com \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=vishal.l.verma@intel.com \
    --cc=xfs@oss.sgi.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.