linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Sagi Grimberg <sagi@grimberg.me>
To: Christoph Hellwig <hch@lst.de>
Cc: Ming Lei <ming.lei@redhat.com>, Jens Axboe <axboe@kernel.dk>,
	linux-block@vger.kernel.org, linux-kernel@vger.kernel.org,
	linux-mm@kvack.org, Dave Chinner <dchinner@redhat.com>,
	Kent Overstreet <kent.overstreet@gmail.com>,
	Mike Snitzer <snitzer@redhat.com>,
	dm-devel@redhat.com, Alexander Viro <viro@zeniv.linux.org.uk>,
	linux-fsdevel@vger.kernel.org, Shaohua Li <shli@kernel.org>,
	linux-raid@vger.kernel.org, linux-erofs@lists.ozlabs.org,
	David Sterba <dsterba@suse.com>,
	linux-btrfs@vger.kernel.org,
	"Darrick J . Wong" <darrick.wong@oracle.com>,
	linux-xfs@vger.kernel.org, Gao Xiang <gaoxiang25@huawei.com>,
	Theodore Ts'o <tytso@mit.edu>,
	linux-ext4@vger.kernel.org, Coly Li <colyli@suse.de>,
	linux-bcache@vger.kernel.org, Boaz Harrosh <ooo@electrozaur.com>,
	Bob Peterson <rpeterso@redhat.com>,
	cluster-devel@redhat.com
Subject: Re: [PATCH V10 09/19] block: introduce bio_bvecs()
Date: Tue, 20 Nov 2018 12:11:35 -0800	[thread overview]
Message-ID: <53526aae-fb9b-ee38-0a01-e5899e2d4e4d@grimberg.me> (raw)
In-Reply-To: <20181120161651.GB2629@lst.de>


>>> The only user in your final tree seems to be the loop driver, and
>>> even that one only uses the helper for read/write bios.
>>>
>>> I think something like this would be much simpler in the end:
>>
>> The recently submitted nvme-tcp host driver should also be a user
>> of this. Does it make sense to keep it as a helper then?
> 
> I did take a brief look at the code, and I really don't understand
> why the heck it even deals with bios to start with.  Like all the
> other nvme transports it is a blk-mq driver and should iterate
> over segments in a request and more or less ignore bios.  Something
> is horribly wrong in the design.

Can you explain a little more? I'm more than happy to change that but
I'm not completely clear how...

Before we begin a data transfer, we need to set our own iterator that
will advance with the progression of the data transfer. We also need to
keep in mind that all the data transfer (both send and recv) are
completely non blocking (and zero-copy when we send).

That means that every data movement needs to be able to suspend
and resume asynchronously. i.e. we cannot use the following pattern:
rq_for_each_segment(bvec, rq, rq_iter) {
	iov_iter_bvec(&iov_iter, WRITE, &bvec, 1, bvec.bv_len);
	send(sock, iov_iter);
}

Given that a request can hold more than a single bio, I'm not clear on
how we can achieve that without iterating over the bios in the request
ourselves.

Any useful insight?

  reply	other threads:[~2018-11-20 20:12 UTC|newest]

Thread overview: 103+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-11-15  8:52 [PATCH V10 00/19] block: support multi-page bvec Ming Lei
2018-11-15  8:52 ` [PATCH V10 01/19] block: introduce multi-page page bvec helpers Ming Lei
2018-11-15 18:25   ` Omar Sandoval
2018-11-19  2:25     ` Ming Lei
2018-11-16 13:13   ` Christoph Hellwig
2018-11-19  2:23     ` Ming Lei
2018-11-19  3:10       ` Jens Axboe
2018-11-19  3:35         ` Ming Lei
2018-11-15  8:52 ` [PATCH V10 02/19] block: introduce bio_for_each_bvec() Ming Lei
2018-11-15 18:28   ` Omar Sandoval
2018-11-16 13:30   ` Christoph Hellwig
2018-11-19  3:31     ` Ming Lei
2018-11-15  8:52 ` [PATCH V10 03/19] block: use bio_for_each_bvec() to compute multi-page bvec count Ming Lei
2018-11-15 20:20   ` Omar Sandoval
2018-11-15 21:05     ` Mike Snitzer
2018-11-15 22:18       ` Omar Sandoval
2018-11-16  9:19         ` Christoph Hellwig
2018-11-16  9:41           ` Gao Xiang
2018-11-16 16:04           ` Omar Sandoval
2018-11-19  7:50     ` Ming Lei
2018-11-15  8:52 ` [PATCH V10 04/19] block: use bio_for_each_bvec() to map sg Ming Lei
2018-11-15 22:33   ` Omar Sandoval
2018-11-16 13:33   ` Christoph Hellwig
2018-11-19  7:51     ` Ming Lei
2018-11-15  8:52 ` [PATCH V10 05/19] block: introduce bvec_last_segment() Ming Lei
2018-11-15 23:23   ` Omar Sandoval
2018-11-19  7:57     ` Ming Lei
2018-11-16 13:34   ` Christoph Hellwig
2018-11-15  8:52 ` [PATCH V10 06/19] fs/buffer.c: use bvec iterator to truncate the bio Ming Lei
2018-11-16  0:20   ` Omar Sandoval
2018-11-16 13:36   ` Christoph Hellwig
2018-11-15  8:52 ` [PATCH V10 07/19] btrfs: use bvec_last_segment to get bio's last page Ming Lei
2018-11-16  0:21   ` Omar Sandoval
2018-11-16 13:37   ` Christoph Hellwig
2018-11-19  8:09     ` Ming Lei
2018-11-15  8:52 ` [PATCH V10 08/19] btrfs: move bio_pages_all() to btrfs Ming Lei
2018-11-16  0:23   ` Omar Sandoval
2018-11-19  8:15     ` Ming Lei
2018-11-16 13:38   ` Christoph Hellwig
2018-11-19  8:19     ` Ming Lei
2018-11-19  8:24       ` Christoph Hellwig
2018-11-15  8:52 ` [PATCH V10 09/19] block: introduce bio_bvecs() Ming Lei
2018-11-16  0:26   ` Omar Sandoval
2018-11-16 13:45   ` Christoph Hellwig
2018-11-19  8:21     ` Ming Lei
2018-11-20  0:49     ` Sagi Grimberg
2018-11-20 16:16       ` Christoph Hellwig
2018-11-20 20:11         ` Sagi Grimberg [this message]
2018-11-21  0:59           ` Ming Lei
2018-11-21  3:20             ` Sagi Grimberg
2018-11-21  3:44               ` Ming Lei
2018-11-21  4:25                 ` Sagi Grimberg
2018-11-21  4:42                   ` Sagi Grimberg
2018-11-21  5:04                     ` Ming Lei
2018-11-21  5:35                       ` Sagi Grimberg
2018-11-21  8:46                         ` Christoph Hellwig
2018-11-21 10:19                         ` Ming Lei
2018-11-15  8:52 ` [PATCH V10 10/19] block: loop: pass multi-page bvec to iov_iter Ming Lei
2018-11-16  0:40   ` Omar Sandoval
2018-11-19  8:25     ` Ming Lei
2018-11-15  8:52 ` [PATCH V10 11/19] bcache: avoid to use bio_for_each_segment_all() in bch_bio_alloc_pages() Ming Lei
2018-11-16  0:44   ` Omar Sandoval
2018-11-19  8:27     ` Ming Lei
2018-11-16 13:46   ` Christoph Hellwig
2018-11-19  8:28     ` Ming Lei
2018-11-15  8:52 ` [PATCH V10 12/19] block: allow bio_for_each_segment_all() to iterate over multi-page bvec Ming Lei
2018-11-15 12:42   ` David Sterba
2018-11-19  8:29     ` Ming Lei
2018-11-16  1:22   ` Omar Sandoval
2018-11-19  8:32     ` Ming Lei
2018-11-15  8:53 ` [PATCH V10 13/19] iomap & xfs: only account for new added page Ming Lei
2018-11-16  1:46   ` Omar Sandoval
2018-11-19  8:35     ` Ming Lei
2018-11-16 13:49   ` Christoph Hellwig
2018-11-19  8:39     ` Ming Lei
2018-11-15  8:53 ` [PATCH V10 14/19] block: enable multipage bvecs Ming Lei
2018-11-16  1:56   ` Omar Sandoval
2018-11-19  8:45     ` Ming Lei
2018-11-16 13:53   ` Christoph Hellwig
2018-11-19  9:00     ` Ming Lei
2018-11-15  8:53 ` [PATCH V10 15/19] block: always define BIO_MAX_PAGES as 256 Ming Lei
2018-11-16  1:59   ` Omar Sandoval
2018-11-19  9:04     ` Ming Lei
2018-11-20  2:45       ` Huang, Ying
2018-11-16 13:53   ` Christoph Hellwig
2018-11-15  8:53 ` [PATCH V10 16/19] block: document usage of bio iterator helpers Ming Lei
2018-11-16  2:05   ` Omar Sandoval
2018-11-15  8:53 ` [PATCH V10 17/19] block: don't use bio->bi_vcnt to figure out segment number Ming Lei
2018-11-16  2:11   ` Omar Sandoval
2018-11-19  9:06     ` Ming Lei
2018-11-16 13:55   ` Christoph Hellwig
2018-11-15  8:53 ` [PATCH V10 18/19] block: kill QUEUE_FLAG_NO_SG_MERGE Ming Lei
2018-11-16  2:18   ` Omar Sandoval
2018-11-16 13:59     ` Christoph Hellwig
2018-11-16 16:40       ` Omar Sandoval
2018-11-19  9:17     ` Ming Lei
2018-11-16 13:58   ` Christoph Hellwig
2018-11-19  9:20     ` Ming Lei
2018-11-15  8:53 ` [PATCH V10 19/19] block: kill BLK_MQ_F_SG_MERGE Ming Lei
2018-11-16 13:59   ` Christoph Hellwig
2018-11-16 16:40   ` Omar Sandoval
2018-11-16 14:03 ` [PATCH V10 00/19] block: support multi-page bvec Christoph Hellwig
2018-11-17  2:42   ` Ming Lei

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=53526aae-fb9b-ee38-0a01-e5899e2d4e4d@grimberg.me \
    --to=sagi@grimberg.me \
    --cc=axboe@kernel.dk \
    --cc=cluster-devel@redhat.com \
    --cc=colyli@suse.de \
    --cc=darrick.wong@oracle.com \
    --cc=dchinner@redhat.com \
    --cc=dm-devel@redhat.com \
    --cc=dsterba@suse.com \
    --cc=gaoxiang25@huawei.com \
    --cc=hch@lst.de \
    --cc=kent.overstreet@gmail.com \
    --cc=linux-bcache@vger.kernel.org \
    --cc=linux-block@vger.kernel.org \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=linux-erofs@lists.ozlabs.org \
    --cc=linux-ext4@vger.kernel.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linux-raid@vger.kernel.org \
    --cc=linux-xfs@vger.kernel.org \
    --cc=ming.lei@redhat.com \
    --cc=ooo@electrozaur.com \
    --cc=rpeterso@redhat.com \
    --cc=shli@kernel.org \
    --cc=snitzer@redhat.com \
    --cc=tytso@mit.edu \
    --cc=viro@zeniv.linux.org.uk \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).