All of lore.kernel.org
 help / color / mirror / Atom feed
From: Ming Lei <ming.lei@redhat.com>
To: Christoph Hellwig <hch@lst.de>
Cc: Jens Axboe <axboe@kernel.dk>,
	linux-block@vger.kernel.org, linux-kernel@vger.kernel.org,
	linux-mm@kvack.org, Theodore Ts'o <tytso@mit.edu>,
	Omar Sandoval <osandov@fb.com>, Sagi Grimberg <sagi@grimberg.me>,
	Dave Chinner <dchinner@redhat.com>,
	Kent Overstreet <kent.overstreet@gmail.com>,
	Mike Snitzer <snitzer@redhat.com>,
	dm-devel@redhat.com, Alexander Viro <viro@zeniv.linux.org.uk>,
	linux-fsdevel@vger.kernel.org, Shaohua Li <shli@kernel.org>,
	linux-raid@vger.kernel.org, David Sterba <dsterba@suse.com>,
	linux-btrfs@vger.kernel.org,
	"Darrick J . Wong" <darrick.wong@oracle.com>,
	linux-xfs@vger.kernel.org, Gao Xiang <gaoxiang25@huawei.com>,
	linux-ext4@vger.kernel.org, Coly Li <colyli@suse.de>,
	linux-bcache@vger.kernel.org, Boaz Harrosh <ooo@electrozaur.com>,
	Bob
Subject: Re: [PATCH V11 03/19] block: introduce bio_for_each_bvec()
Date: Thu, 22 Nov 2018 09:17:06 +0800	[thread overview]
Message-ID: <20181122011705.GC20814@ming.t460p> (raw)
In-Reply-To: <20181121161025.GB4977@lst.de>

On Wed, Nov 21, 2018 at 05:10:25PM +0100, Christoph Hellwig wrote:
> On Wed, Nov 21, 2018 at 11:31:36PM +0800, Ming Lei wrote:
> > > But while looking over this I wonder why we even need the max_seg_len
> > > here.  The only thing __bvec_iter_advance does it to move bi_bvec_done
> > > and bi_idx forward, with corresponding decrements of bi_size.  As far
> > > as I can tell the only thing that max_seg_len does is that we need
> > > to more iterations of the while loop to archive the same thing.
> > > 
> > > And actual bvec used by the caller will be obtained using
> > > bvec_iter_bvec or segment_iter_bvec depending on if they want multi-page
> > > or single-page variants.
> > 
> > Right, we let __bvec_iter_advance() serve for both multi-page and single-page
> > case, then we have to tell it via one way or another, now we use the constant
> > of 'max_seg_len'.
> > 
> > Or you suggest to implement two versions of __bvec_iter_advance()?
> 
> No - I think we can always use the code without any segment in
> bvec_iter_advance.  Because bvec_iter_advance only operates on the
> iteractor, the generation of an actual single-page or multi-page
> bvec is left to the caller using the bvec_iter_bvec or segment_iter_bvec
> helpers.  The only difference is how many bytes you can move the
> iterator forward in a single loop iteration - so if you pass in
> PAGE_SIZE as the max_seg_len you just will have to loop more often
> for a large enough bytes, but not actually do anything different.

Yeah, I see that.

The difference is made by bio_iter_iovec()/bio_iter_mp_iovec() in
__bio_for_each_segment()/__bio_for_each_bvec().


Thanks,
Ming

WARNING: multiple messages have this Message-ID (diff)
From: Ming Lei <ming.lei@redhat.com>
To: Christoph Hellwig <hch@lst.de>
Cc: Jens Axboe <axboe@kernel.dk>,
	linux-block@vger.kernel.org, linux-kernel@vger.kernel.org,
	linux-mm@kvack.org, Theodore Ts'o <tytso@mit.edu>,
	Omar Sandoval <osandov@fb.com>, Sagi Grimberg <sagi@grimberg.me>,
	Dave Chinner <dchinner@redhat.com>,
	Kent Overstreet <kent.overstreet@gmail.com>,
	Mike Snitzer <snitzer@redhat.com>,
	dm-devel@redhat.com, Alexander Viro <viro@zeniv.linux.org.uk>,
	linux-fsdevel@vger.kernel.org, Shaohua Li <shli@kernel.org>,
	linux-raid@vger.kernel.org, David Sterba <dsterba@suse.com>,
	linux-btrfs@vger.kernel.org,
	"Darrick J . Wong" <darrick.wong@oracle.com>,
	linux-xfs@vger.kernel.org, Gao Xiang <gaoxiang25@huawei.com>,
	linux-ext4@vger.kernel.org, Coly Li <colyli@suse.de>,
	linux-bcache@vger.kernel.org, Boaz Harrosh <ooo@electrozaur.com>,
	Bob Peterson <rpeterso@redhat.com>,
	cluster-devel@redhat.com
Subject: Re: [PATCH V11 03/19] block: introduce bio_for_each_bvec()
Date: Thu, 22 Nov 2018 09:17:06 +0800	[thread overview]
Message-ID: <20181122011705.GC20814@ming.t460p> (raw)
In-Reply-To: <20181121161025.GB4977@lst.de>

On Wed, Nov 21, 2018 at 05:10:25PM +0100, Christoph Hellwig wrote:
> On Wed, Nov 21, 2018 at 11:31:36PM +0800, Ming Lei wrote:
> > > But while looking over this I wonder why we even need the max_seg_len
> > > here.  The only thing __bvec_iter_advance does it to move bi_bvec_done
> > > and bi_idx forward, with corresponding decrements of bi_size.  As far
> > > as I can tell the only thing that max_seg_len does is that we need
> > > to more iterations of the while loop to archive the same thing.
> > > 
> > > And actual bvec used by the caller will be obtained using
> > > bvec_iter_bvec or segment_iter_bvec depending on if they want multi-page
> > > or single-page variants.
> > 
> > Right, we let __bvec_iter_advance() serve for both multi-page and single-page
> > case, then we have to tell it via one way or another, now we use the constant
> > of 'max_seg_len'.
> > 
> > Or you suggest to implement two versions of __bvec_iter_advance()?
> 
> No - I think we can always use the code without any segment in
> bvec_iter_advance.  Because bvec_iter_advance only operates on the
> iteractor, the generation of an actual single-page or multi-page
> bvec is left to the caller using the bvec_iter_bvec or segment_iter_bvec
> helpers.  The only difference is how many bytes you can move the
> iterator forward in a single loop iteration - so if you pass in
> PAGE_SIZE as the max_seg_len you just will have to loop more often
> for a large enough bytes, but not actually do anything different.

Yeah, I see that.

The difference is made by bio_iter_iovec()/bio_iter_mp_iovec() in
__bio_for_each_segment()/__bio_for_each_bvec().


Thanks,
Ming

WARNING: multiple messages have this Message-ID (diff)
From: Ming Lei <ming.lei@redhat.com>
To: cluster-devel.redhat.com
Subject: [Cluster-devel] [PATCH V11 03/19] block: introduce bio_for_each_bvec()
Date: Thu, 22 Nov 2018 09:17:06 +0800	[thread overview]
Message-ID: <20181122011705.GC20814@ming.t460p> (raw)
In-Reply-To: <20181121161025.GB4977@lst.de>

On Wed, Nov 21, 2018 at 05:10:25PM +0100, Christoph Hellwig wrote:
> On Wed, Nov 21, 2018 at 11:31:36PM +0800, Ming Lei wrote:
> > > But while looking over this I wonder why we even need the max_seg_len
> > > here.  The only thing __bvec_iter_advance does it to move bi_bvec_done
> > > and bi_idx forward, with corresponding decrements of bi_size.  As far
> > > as I can tell the only thing that max_seg_len does is that we need
> > > to more iterations of the while loop to archive the same thing.
> > > 
> > > And actual bvec used by the caller will be obtained using
> > > bvec_iter_bvec or segment_iter_bvec depending on if they want multi-page
> > > or single-page variants.
> > 
> > Right, we let __bvec_iter_advance() serve for both multi-page and single-page
> > case, then we have to tell it via one way or another, now we use the constant
> > of 'max_seg_len'.
> > 
> > Or you suggest to implement two versions of __bvec_iter_advance()?
> 
> No - I think we can always use the code without any segment in
> bvec_iter_advance.  Because bvec_iter_advance only operates on the
> iteractor, the generation of an actual single-page or multi-page
> bvec is left to the caller using the bvec_iter_bvec or segment_iter_bvec
> helpers.  The only difference is how many bytes you can move the
> iterator forward in a single loop iteration - so if you pass in
> PAGE_SIZE as the max_seg_len you just will have to loop more often
> for a large enough bytes, but not actually do anything different.

Yeah, I see that.

The difference is made by bio_iter_iovec()/bio_iter_mp_iovec() in
__bio_for_each_segment()/__bio_for_each_bvec().


Thanks,
Ming



  parent reply	other threads:[~2018-11-22  1:17 UTC|newest]

Thread overview: 177+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-11-21  3:23 [PATCH V11 00/19] block: support multi-page bvec Ming Lei
2018-11-21  3:23 ` [Cluster-devel] " Ming Lei
2018-11-21  3:23 ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 01/19] block: don't use bio->bi_vcnt to figure out segment number Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 02/19] block: introduce multi-page bvec helpers Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21 13:19   ` Christoph Hellwig
2018-11-21 13:19     ` [Cluster-devel] " Christoph Hellwig
2018-11-21 13:19     ` Christoph Hellwig
2018-11-21 15:06     ` Ming Lei
2018-11-21 15:06       ` [Cluster-devel] " Ming Lei
2018-11-21 15:06       ` Ming Lei
2018-11-21 16:08       ` Christoph Hellwig
2018-11-21 16:08         ` [Cluster-devel] " Christoph Hellwig
2018-11-21 16:08         ` Christoph Hellwig
2018-11-22  1:09         ` Ming Lei
2018-11-22  1:09           ` [Cluster-devel] " Ming Lei
2018-11-22  1:09           ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 03/19] block: introduce bio_for_each_bvec() Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21 13:32   ` Christoph Hellwig
2018-11-21 13:32     ` [Cluster-devel] " Christoph Hellwig
2018-11-21 13:32     ` Christoph Hellwig
2018-11-21 15:31     ` Ming Lei
2018-11-21 15:31       ` [Cluster-devel] " Ming Lei
2018-11-21 15:31       ` Ming Lei
2018-11-21 16:10       ` Christoph Hellwig
2018-11-21 16:10         ` [Cluster-devel] " Christoph Hellwig
2018-11-21 16:10         ` Christoph Hellwig
2018-11-21 17:12         ` Christoph Hellwig
2018-11-21 17:12           ` [Cluster-devel] " Christoph Hellwig
2018-11-21 17:12           ` Christoph Hellwig
2018-11-22 10:15           ` Ming Lei
2018-11-22 10:15             ` [Cluster-devel] " Ming Lei
2018-11-22 10:15             ` Ming Lei
2018-11-22 10:23             ` Christoph Hellwig
2018-11-22 10:23               ` [Cluster-devel] " Christoph Hellwig
2018-11-22 10:23               ` Christoph Hellwig
2018-11-22 10:30               ` Christoph Hellwig
2018-11-22 10:30                 ` [Cluster-devel] " Christoph Hellwig
2018-11-22 10:30                 ` Christoph Hellwig
2018-11-22 14:57                 ` Ming Lei
2018-11-22 14:57                   ` [Cluster-devel] " Ming Lei
2018-11-22 14:57                   ` Ming Lei
2018-11-22  1:17         ` Ming Lei [this message]
2018-11-22  1:17           ` [Cluster-devel] " Ming Lei
2018-11-22  1:17           ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 04/19] block: use bio_for_each_bvec() to compute multi-page bvec count Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 05/19] block: use bio_for_each_bvec() to map sg Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 06/19] block: introduce bvec_last_segment() Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 07/19] fs/buffer.c: use bvec iterator to truncate the bio Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-22 10:58   ` Christoph Hellwig
2018-11-22 10:58     ` [Cluster-devel] " Christoph Hellwig
2018-11-22 10:58     ` Christoph Hellwig
2018-11-23  1:48     ` Ming Lei
2018-11-23  1:48       ` [Cluster-devel] " Ming Lei
2018-11-23  1:48       ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 08/19] btrfs: use bvec_last_segment to get bio's last page Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 09/19] btrfs: move bio_pages_all() to btrfs Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 10/19] block: loop: pass multi-page bvec to iov_iter Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21 14:00   ` Christoph Hellwig
2018-11-21 14:00     ` [Cluster-devel] " Christoph Hellwig
2018-11-21 14:00     ` Christoph Hellwig
2018-11-21  3:23 ` [PATCH V11 11/19] bcache: avoid to use bio_for_each_segment_all() in bch_bio_alloc_pages() Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21 14:01   ` Christoph Hellwig
2018-11-21 14:01     ` [Cluster-devel] " Christoph Hellwig
2018-11-21 14:01     ` Christoph Hellwig
2018-11-21  3:23 ` [PATCH V11 12/19] block: allow bio_for_each_segment_all() to iterate over multi-page bvec Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21 14:02   ` Christoph Hellwig
2018-11-21 14:02     ` [Cluster-devel] " Christoph Hellwig
2018-11-21 14:02     ` Christoph Hellwig
2018-11-22 11:03   ` Christoph Hellwig
2018-11-22 11:03     ` [Cluster-devel] " Christoph Hellwig
2018-11-22 11:03     ` Christoph Hellwig
2018-11-23  2:19     ` Ming Lei
2018-11-23  2:19       ` [Cluster-devel] " Ming Lei
2018-11-23  2:19       ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 13/19] block: move bounce_clone_bio into bio.c Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 14/19] block: handle non-cluster bio out of blk_bio_segment_split Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21 14:33   ` Christoph Hellwig
2018-11-21 14:33     ` [Cluster-devel] " Christoph Hellwig
2018-11-21 14:33     ` Christoph Hellwig
2018-11-21 15:37     ` Ming Lei
2018-11-21 15:37       ` [Cluster-devel] " Ming Lei
2018-11-21 15:37       ` Ming Lei
2018-11-21 16:11       ` Christoph Hellwig
2018-11-21 16:11         ` [Cluster-devel] " Christoph Hellwig
2018-11-21 16:11         ` Christoph Hellwig
2018-11-21 17:46       ` Christoph Hellwig
2018-11-21 17:46         ` [Cluster-devel] " Christoph Hellwig
2018-11-21 17:46         ` Christoph Hellwig
2018-11-21 17:46         ` Christoph Hellwig
2018-11-21 17:46         ` Christoph Hellwig
2018-11-22  9:33         ` Ming Lei
2018-11-22  9:33           ` [Cluster-devel] " Ming Lei
2018-11-22  9:33           ` Ming Lei
2018-11-22 10:04           ` Christoph Hellwig
2018-11-22 10:04             ` [Cluster-devel] " Christoph Hellwig
2018-11-22 10:04             ` Christoph Hellwig
2018-11-22 10:26             ` Ming Lei
2018-11-22 10:26               ` [Cluster-devel] " Ming Lei
2018-11-22 10:26               ` Ming Lei
2018-11-22 10:40               ` Christoph Hellwig
2018-11-22 10:40                 ` [Cluster-devel] " Christoph Hellwig
2018-11-22 10:40                 ` Christoph Hellwig
2018-11-22 10:32             ` Ming Lei
2018-11-22 10:32               ` [Cluster-devel] " Ming Lei
2018-11-22 10:32               ` Ming Lei
2018-11-22 10:41               ` Christoph Hellwig
2018-11-22 10:41                 ` [Cluster-devel] " Christoph Hellwig
2018-11-22 10:41                 ` Christoph Hellwig
2018-11-22 10:46                 ` Ming Lei
2018-11-22 10:46                   ` [Cluster-devel] " Ming Lei
2018-11-22 10:46                   ` Ming Lei
2018-11-22 10:47                   ` Christoph Hellwig
2018-11-22 10:47                     ` [Cluster-devel] " Christoph Hellwig
2018-11-22 10:47                     ` Christoph Hellwig
2018-11-21  3:23 ` [PATCH V11 15/19] block: enable multipage bvecs Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21 14:55   ` Christoph Hellwig
2018-11-21 14:55     ` [Cluster-devel] " Christoph Hellwig
2018-11-21 14:55     ` Christoph Hellwig
2018-11-21 15:48     ` Ming Lei
2018-11-21 15:48       ` [Cluster-devel] " Ming Lei
2018-11-21 15:48       ` Ming Lei
2018-11-21 16:12       ` Christoph Hellwig
2018-11-21 16:12         ` [Cluster-devel] " Christoph Hellwig
2018-11-21 16:12         ` Christoph Hellwig
2018-11-23 10:50         ` Ming Lei
2018-11-23 10:50           ` [Cluster-devel] " Ming Lei
2018-11-23 10:50           ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 16/19] block: always define BIO_MAX_PAGES as 256 Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 17/19] block: document usage of bio iterator helpers Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  7:45   ` Nikolay Borisov
2018-11-21  7:45     ` [Cluster-devel] " Nikolay Borisov
2018-11-21  7:45     ` Nikolay Borisov
2018-11-21  7:45     ` Nikolay Borisov
2018-11-21 14:34     ` Christoph Hellwig
2018-11-21 14:34       ` [Cluster-devel] " Christoph Hellwig
2018-11-21 14:34       ` Christoph Hellwig
2018-11-21  3:23 ` [PATCH V11 18/19] block: kill QUEUE_FLAG_NO_SG_MERGE Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei
2018-11-21  3:23 ` [PATCH V11 19/19] block: kill BLK_MQ_F_SG_MERGE Ming Lei
2018-11-21  3:23   ` [Cluster-devel] " Ming Lei
2018-11-21  3:23   ` Ming Lei

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20181122011705.GC20814@ming.t460p \
    --to=ming.lei@redhat.com \
    --cc=axboe@kernel.dk \
    --cc=colyli@suse.de \
    --cc=darrick.wong@oracle.com \
    --cc=dchinner@redhat.com \
    --cc=dm-devel@redhat.com \
    --cc=dsterba@suse.com \
    --cc=gaoxiang25@huawei.com \
    --cc=hch@lst.de \
    --cc=kent.overstreet@gmail.com \
    --cc=linux-bcache@vger.kernel.org \
    --cc=linux-block@vger.kernel.org \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=linux-ext4@vger.kernel.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linux-raid@vger.kernel.org \
    --cc=linux-xfs@vger.kernel.org \
    --cc=ooo@electrozaur.com \
    --cc=osandov@fb.com \
    --cc=sagi@grimberg.me \
    --cc=shli@kernel.org \
    --cc=snitzer@redhat.com \
    --cc=tytso@mit.edu \
    --cc=viro@zeniv.linux.org.uk \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.