From: Hannes Reinecke <hare@suse.de>
To: Ming Lei <ming.lei@redhat.com>, Jens Axboe <axboe@kernel.dk>
Cc: linux-block@vger.kernel.org,
Jeffle Xu <jefflexu@linux.alibaba.com>,
Mike Snitzer <snitzer@redhat.com>,
dm-devel@redhat.com
Subject: Re: [PATCH V6 10/12] block: limit hw queues to be polled in each blk_poll()
Date: Mon, 26 Apr 2021 09:19:20 +0200 [thread overview]
Message-ID: <b6a1f1fa-bad2-e072-6292-363510fc7017@suse.de> (raw)
In-Reply-To: <20210422122038.2192933-11-ming.lei@redhat.com>
On 4/22/21 2:20 PM, Ming Lei wrote:
> Limit at most 8 queues are polled in each blk_pull(), avoid to
> add extra latency when queue depth is high.
>
> Reviewed-by: Jeffle Xu <jefflexu@linux.alibaba.com>
> Signed-off-by: Ming Lei <ming.lei@redhat.com>
> ---
> block/blk-poll.c | 78 ++++++++++++++++++++++++++++++++++--------------
> 1 file changed, 55 insertions(+), 23 deletions(-)
>
> diff --git a/block/blk-poll.c b/block/blk-poll.c
> index 249d73ff6f81..20e7c47cc984 100644
> --- a/block/blk-poll.c
> +++ b/block/blk-poll.c
> @@ -288,36 +288,32 @@ static void bio_grp_list_move(struct bio_grp_list *dst,
> src->nr_grps -= cnt;
> }
>
> -static int blk_mq_poll_io(struct bio *bio)
> +#define POLL_HCTX_MAX_CNT 8
> +
> +static bool blk_add_unique_hctx(struct blk_mq_hw_ctx **data, int *cnt,
> + struct blk_mq_hw_ctx *hctx)
> {
> - struct request_queue *q = bio->bi_bdev->bd_disk->queue;
> - blk_qc_t cookie = bio_get_poll_data(bio);
> - int ret = 0;
> + int i;
>
> - /* wait until the bio is submitted really */
> - if (!blk_qc_t_ready(cookie))
> - return 0;
>
> - if (!bio_flagged(bio, BIO_DONE) && blk_qc_t_valid(cookie)) {
> - struct blk_mq_hw_ctx *hctx =
> - q->queue_hw_ctx[blk_qc_t_to_queue_num(cookie)];
> + for (i = 0; i < *cnt; i++) {
> + if (data[i] == hctx)
> + goto exit;
> + }
>
> - ret += blk_mq_poll_hctx(q, hctx);
> + if (i < POLL_HCTX_MAX_CNT) {
> + data[i] = hctx;
> + (*cnt)++;
> }
> - return ret;
> + exit:
> + return *cnt == POLL_HCTX_MAX_CNT;
> }
>
> -static int blk_bio_poll_and_end_io(struct bio_grp_list *grps)
> +static void blk_build_poll_queues(struct bio_grp_list *grps,
> + struct blk_mq_hw_ctx **data, int *cnt)
> {
> - int ret = 0;
> int i;
>
> - /*
> - * Poll hw queue first.
> - *
> - * TODO: limit max poll times and make sure to not poll same
> - * hw queue one more time.
> - */
> for (i = 0; i < grps->nr_grps; i++) {
> struct bio_grp_list_data *grp = &grps->head[i];
> struct bio *bio;
> @@ -325,11 +321,31 @@ static int blk_bio_poll_and_end_io(struct bio_grp_list *grps)
> if (bio_grp_list_grp_empty(grp))
> continue;
>
> - for (bio = grp->list.head; bio; bio = bio->bi_poll)
> - ret += blk_mq_poll_io(bio);
> + for (bio = grp->list.head; bio; bio = bio->bi_poll) {
> + blk_qc_t cookie;
> + struct blk_mq_hw_ctx *hctx;
> + struct request_queue *q;
> +
> + if (bio_flagged(bio, BIO_DONE))
> + continue;
> +
> + /* wait until the bio is submitted really */
> + cookie = bio_get_poll_data(bio);
> + if (!blk_qc_t_ready(cookie) || !blk_qc_t_valid(cookie))
> + continue;
> +
> + q = bio->bi_bdev->bd_disk->queue;
> + hctx = q->queue_hw_ctx[blk_qc_t_to_queue_num(cookie)];
> + if (blk_add_unique_hctx(data, cnt, hctx))
> + return;
> + }
> }
> +}
> +
> +static void blk_bio_poll_reap_ios(struct bio_grp_list *grps)
> +{
> + int i;
>
> - /* reap bios */
> for (i = 0; i < grps->nr_grps; i++) {
> struct bio_grp_list_data *grp = &grps->head[i];
> struct bio *bio;
> @@ -354,6 +370,22 @@ static int blk_bio_poll_and_end_io(struct bio_grp_list *grps)
> }
> __bio_grp_list_merge(&grp->list, &bl);
> }
> +}
> +
> +static int blk_bio_poll_and_end_io(struct bio_grp_list *grps)
> +{
> + int ret = 0;
> + int i;
> + struct blk_mq_hw_ctx *hctx[POLL_HCTX_MAX_CNT];
> + int cnt = 0;
> +
> + blk_build_poll_queues(grps, hctx, &cnt);
> +
> + for (i = 0; i < cnt; i++)
> + ret += blk_mq_poll_hctx(hctx[i]->queue, hctx[i]);
> +
> + blk_bio_poll_reap_ios(grps);
> +
> return ret;
> }
>
>
Can't we make it a sysfs attribute instead of hard-coding it?
'8' seems a bit arbitrary to me, I'd rather have the ability to modify it...
Cheers,
Hannes
--
Dr. Hannes Reinecke Kernel Storage Architect
hare@suse.de +49 911 74053 688
SUSE Software Solutions Germany GmbH, 90409 Nürnberg
GF: F. Imendörffer, HRB 36809 (AG Nürnberg)
next prev parent reply other threads:[~2021-04-26 7:19 UTC|newest]
Thread overview: 26+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-04-22 12:20 [PATCH V6 00/12] block: support bio based io polling Ming Lei
2021-04-22 12:20 ` [PATCH V6 01/12] block: add helper of blk_queue_poll Ming Lei
2021-04-22 12:20 ` [PATCH V6 02/12] block: define 'struct bvec_iter' as packed Ming Lei
2021-04-22 13:18 ` Hannes Reinecke
2021-04-22 12:20 ` [PATCH V6 03/12] block: add one helper to free io_context Ming Lei
2021-04-22 12:20 ` [PATCH V6 04/12] block: move block polling code into one dedicated source file Ming Lei
2021-04-22 13:19 ` Hannes Reinecke
2021-04-26 7:12 ` Hannes Reinecke
2021-04-22 12:20 ` [PATCH V6 05/12] block: extract one helper function polling hw queue Ming Lei
2021-04-22 12:20 ` [PATCH V6 06/12] block: prepare for supporting bio_list via other link Ming Lei
2021-04-22 12:20 ` [PATCH V6 07/12] block: create io poll context for submission and poll task Ming Lei
2021-04-22 12:20 ` [PATCH V6 08/12] block: add req flag of REQ_POLL_CTX Ming Lei
2021-04-22 12:20 ` [PATCH V6 09/12] block: use per-task poll context to implement bio based io polling Ming Lei
2021-04-26 7:17 ` Hannes Reinecke
2021-04-22 12:20 ` [PATCH V6 10/12] block: limit hw queues to be polled in each blk_poll() Ming Lei
2021-04-26 7:19 ` Hannes Reinecke [this message]
2021-04-26 8:00 ` Ming Lei
2021-04-26 9:05 ` Hannes Reinecke
2021-04-22 12:20 ` [PATCH V6 11/12] block: allow to control FLAG_POLL via sysfs for bio poll capable queue Ming Lei
2021-04-26 7:20 ` Hannes Reinecke
2021-04-22 12:20 ` [PATCH V6 12/12] dm: support IO polling for bio-based dm device Ming Lei
2021-04-23 1:32 ` JeffleXu
2021-04-23 2:39 ` Ming Lei
2021-04-23 2:38 ` [PATCH V7 " Ming Lei
2021-05-17 6:16 ` [PATCH V6 00/12] block: support bio based io polling JeffleXu
2021-05-17 7:13 ` Ming Lei
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=b6a1f1fa-bad2-e072-6292-363510fc7017@suse.de \
--to=hare@suse.de \
--cc=axboe@kernel.dk \
--cc=dm-devel@redhat.com \
--cc=jefflexu@linux.alibaba.com \
--cc=linux-block@vger.kernel.org \
--cc=ming.lei@redhat.com \
--cc=snitzer@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).