I reviewed the changes. They looked good.

On Fri, Oct 12, 2018 = at 12:26 PM Ed Cashin <ed.cashin@ac= m.org> wrote:

On Fri, Oct 12= , 2018 at 12:23 PM Jens Axboe <axboe@kernel.dk> wrote:
>
> On 10/12/18 10:17 AM, Ed Cashin wrote:
> > On Fri, Oct 12, 2018 at 10:20 AM Jens Axboe <axboe@kernel.dk> wrote:
> >>
> >> On 10/12/18 5:28 AM, Ed Cashin wrote:
> >>> OK.=C2=A0 We always tried to avoid putting includes in th= e .h file, so
> >>> if you wouldn't mind moving the include to the C file= s, that would
> >>> be nice.=C2=A0 I wouldn't insist, though.
> >>
> >> There's really no way around it, since I'm embedding = the tag_set
> >> in the device.
> >>
> >> Is that OK with you?
> >
> > Yes, it's fine.=C2=A0 Thank you.
>
> Can I add a reviewed-by?

Acked-by is already fine, but I can give it more attention tomorrow, and af= ter
that a reviewed-by would be appropriate.

--
=C2=A0 Ed

=C2=A0 Ed Cashin <ecashin@noserose.ne= t>

--0000000000000e2e52057825b027-- From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: MIME-Version: 1.0 References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-15-axboe@kernel.dk>

<2fb82c13-66c0-30bb-a408-10e01abc648f@kernel.dk> In-Reply-To: <2fb82c13-66c0-30bb-a408-10e01abc648f@kernel.dk> From: Ed Cashin Date: Fri, 12 Oct 2018 12:26:13 -0400 Message-ID: Subject: Re: [PATCH 14/17] aoe: convert aoeblk to blk-mq To: axboe@kernel.dk Cc: "Ed L. Cashin" , linux-block@vger.kernel.org Content-Type: text/plain; charset="UTF-8" List-ID: On Fri, Oct 12, 2018 at 12:23 PM Jens Axboe wrote: > > On 10/12/18 10:17 AM, Ed Cashin wrote: > > On Fri, Oct 12, 2018 at 10:20 AM Jens Axboe wrote: > >> > >> On 10/12/18 5:28 AM, Ed Cashin wrote: > >>> OK. We always tried to avoid putting includes in the .h file, so > >>> if you wouldn't mind moving the include to the C files, that would > >>> be nice. I wouldn't insist, though. > >> > >> There's really no way around it, since I'm embedding the tag_set > >> in the device. > >> > >> Is that OK with you? > > > > Yes, it's fine. Thank you. > > Can I add a reviewed-by? Acked-by is already fine, but I can give it more attention tomorrow, and after that a reviewed-by would be appropriate. -- Ed From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 14/17] aoe: convert aoeblk to blk-mq To: Ed Cashin Cc: linux-block@vger.kernel.org References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-15-axboe@kernel.dk>

From: Jens Axboe Message-ID: <2fb82c13-66c0-30bb-a408-10e01abc648f@kernel.dk> Date: Fri, 12 Oct 2018 10:23:08 -0600 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 List-ID: On 10/12/18 10:17 AM, Ed Cashin wrote: > On Fri, Oct 12, 2018 at 10:20 AM Jens Axboe wrote: >> >> On 10/12/18 5:28 AM, Ed Cashin wrote: >>> OK. We always tried to avoid putting includes in the .h file, so >>> if you wouldn't mind moving the include to the C files, that would >>> be nice. I wouldn't insist, though. >> >> There's really no way around it, since I'm embedding the tag_set >> in the device. >> >> Is that OK with you? > > Yes, it's fine. Thank you. Can I add a reviewed-by? -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: MIME-Version: 1.0 References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-15-axboe@kernel.dk>

In-Reply-To: From: Ed Cashin Date: Fri, 12 Oct 2018 12:17:08 -0400 Message-ID: Subject: Re: [PATCH 14/17] aoe: convert aoeblk to blk-mq To: axboe@kernel.dk Cc: linux-block@vger.kernel.org, "Ed L. Cashin" Content-Type: text/plain; charset="UTF-8" List-ID: On Fri, Oct 12, 2018 at 10:20 AM Jens Axboe wrote: > > On 10/12/18 5:28 AM, Ed Cashin wrote: > > OK. We always tried to avoid putting includes in the .h file, so > > if you wouldn't mind moving the include to the C files, that would > > be nice. I wouldn't insist, though. > > There's really no way around it, since I'm embedding the tag_set > in the device. > > Is that OK with you? Yes, it's fine. Thank you. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 14/17] aoe: convert aoeblk to blk-mq To: Ed Cashin Cc: linux-block@vger.kernel.org, "Ed L. Cashin" References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-15-axboe@kernel.dk> From: Jens Axboe Message-ID: Date: Fri, 12 Oct 2018 08:20:00 -0600 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 List-ID: On 10/12/18 5:28 AM, Ed Cashin wrote: > OK. We always tried to avoid putting includes in the .h file, so > if you wouldn't mind moving the include to the C files, that would > be nice. I wouldn't insist, though. There's really no way around it, since I'm embedding the tag_set in the device. Is that OK with you? -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: MIME-Version: 1.0 References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-15-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-15-axboe@kernel.dk> From: Ed Cashin Date: Fri, 12 Oct 2018 07:28:29 -0400 Message-ID: Subject: Re: [PATCH 14/17] aoe: convert aoeblk to blk-mq To: axboe@kernel.dk Cc: linux-block@vger.kernel.org, "Ed L. Cashin" Content-Type: text/plain; charset="UTF-8" List-ID: OK. We always tried to avoid putting includes in the .h file, so if you wouldn't mind moving the include to the C files, that would be nice. I wouldn't insist, though. On Thu, Oct 11, 2018 at 12:59 PM Jens Axboe wrote: > > Straight forward conversion - instead of rewriting the internal buffer > retrieval logic, just replace the previous elevator peeking with an > internal list of requests. > > Cc: "Ed L. Cashin" > Signed-off-by: Jens Axboe > --- > drivers/block/aoe/aoe.h | 4 ++++ > drivers/block/aoe/aoeblk.c | 49 ++++++++++++++++++++++++++++---------- > drivers/block/aoe/aoecmd.c | 17 +++++++++---- > drivers/block/aoe/aoedev.c | 14 ++++++----- > 4 files changed, 60 insertions(+), 24 deletions(-) > > diff --git a/drivers/block/aoe/aoe.h b/drivers/block/aoe/aoe.h > index c0ebda1283cc..9b9db29fe712 100644 > --- a/drivers/block/aoe/aoe.h > +++ b/drivers/block/aoe/aoe.h > @@ -1,4 +1,6 @@ > /* Copyright (c) 2013 Coraid, Inc. See COPYING for GPL terms. */ > +#include > + > #define VERSION "85" > #define AOE_MAJOR 152 > #define DEVICE_NAME "aoe" > @@ -164,6 +166,8 @@ struct aoedev { > struct gendisk *gd; > struct dentry *debugfs; > struct request_queue *blkq; > + struct list_head rq_list; > + struct blk_mq_tag_set tag_set; > struct hd_geometry geo; > sector_t ssize; > struct timer_list timer; > diff --git a/drivers/block/aoe/aoeblk.c b/drivers/block/aoe/aoeblk.c > index 429ebb84b592..ba4afa0ce1c7 100644 > --- a/drivers/block/aoe/aoeblk.c > +++ b/drivers/block/aoe/aoeblk.c > @@ -6,7 +6,7 @@ > > #include > #include > -#include > +#include > #include > #include > #include > @@ -274,23 +274,25 @@ aoeblk_release(struct gendisk *disk, fmode_t mode) > spin_unlock_irqrestore(&d->lock, flags); > } > > -static void > -aoeblk_request(struct request_queue *q) > +static blk_status_t aoeblk_queue_rq(struct blk_mq_hw_ctx *hctx, > + const struct blk_mq_queue_data *bd) > { > - struct aoedev *d; > - struct request *rq; > + struct aoedev *d = hctx->queue->queuedata; > + > + spin_lock_irq(&d->lock); > > - d = q->queuedata; > if ((d->flags & DEVFL_UP) == 0) { > pr_info_ratelimited("aoe: device %ld.%d is not up\n", > d->aoemajor, d->aoeminor); > - while ((rq = blk_peek_request(q))) { > - blk_start_request(rq); > - aoe_end_request(d, rq, 1); > - } > - return; > + spin_unlock_irq(&d->lock); > + blk_mq_start_request(bd->rq); > + return BLK_STS_IOERR; > } > + > + list_add_tail(&bd->rq->queuelist, &d->rq_list); > aoecmd_work(d); > + spin_unlock_irq(&d->lock); > + return BLK_STS_OK; > } > > static int > @@ -345,6 +347,10 @@ static const struct block_device_operations aoe_bdops = { > .owner = THIS_MODULE, > }; > > +static const struct blk_mq_ops aoeblk_mq_ops = { > + .queue_rq = aoeblk_queue_rq, > +}; > + > /* alloc_disk and add_disk can sleep */ > void > aoeblk_gdalloc(void *vp) > @@ -353,9 +359,11 @@ aoeblk_gdalloc(void *vp) > struct gendisk *gd; > mempool_t *mp; > struct request_queue *q; > + struct blk_mq_tag_set *set; > enum { KB = 1024, MB = KB * KB, READ_AHEAD = 2 * MB, }; > ulong flags; > int late = 0; > + int err; > > spin_lock_irqsave(&d->lock, flags); > if (d->flags & DEVFL_GDALLOC > @@ -382,10 +390,25 @@ aoeblk_gdalloc(void *vp) > d->aoemajor, d->aoeminor); > goto err_disk; > } > - q = blk_init_queue(aoeblk_request, &d->lock); > - if (q == NULL) { > + > + set = &d->tag_set; > + set->ops = &aoeblk_mq_ops; > + set->nr_hw_queues = 1; > + set->queue_depth = 128; > + set->numa_node = NUMA_NO_NODE; > + set->flags = BLK_MQ_F_SHOULD_MERGE; > + err = blk_mq_alloc_tag_set(set); > + if (err) { > + pr_err("aoe: cannot allocate tag set for %ld.%d\n", > + d->aoemajor, d->aoeminor); > + goto err_mempool; > + } > + > + q = blk_mq_init_queue(set); > + if (IS_ERR(q)) { > pr_err("aoe: cannot allocate block queue for %ld.%d\n", > d->aoemajor, d->aoeminor); > + blk_mq_free_tag_set(set); > goto err_mempool; > } > > diff --git a/drivers/block/aoe/aoecmd.c b/drivers/block/aoe/aoecmd.c > index 136dc507d020..fce0fc1fa7bf 100644 > --- a/drivers/block/aoe/aoecmd.c > +++ b/drivers/block/aoe/aoecmd.c > @@ -7,7 +7,7 @@ > #include > #include > #include > -#include > +#include > #include > #include > #include > @@ -857,10 +857,12 @@ nextbuf(struct aoedev *d) > return d->ip.buf; > rq = d->ip.rq; > if (rq == NULL) { > - rq = blk_peek_request(q); > + rq = list_first_entry_or_null(&d->rq_list, struct request, > + queuelist); > if (rq == NULL) > return NULL; > - blk_start_request(rq); > + list_del_init(&rq->queuelist); > + blk_mq_start_request(rq); > d->ip.rq = rq; > d->ip.nxbio = rq->bio; > rq->special = (void *) rqbiocnt(rq); > @@ -1045,6 +1047,7 @@ aoe_end_request(struct aoedev *d, struct request *rq, int fastfail) > struct bio *bio; > int bok; > struct request_queue *q; > + blk_status_t err = BLK_STS_OK; > > q = d->blkq; > if (rq == d->ip.rq) > @@ -1052,11 +1055,15 @@ aoe_end_request(struct aoedev *d, struct request *rq, int fastfail) > do { > bio = rq->bio; > bok = !fastfail && !bio->bi_status; > - } while (__blk_end_request(rq, bok ? BLK_STS_OK : BLK_STS_IOERR, bio->bi_iter.bi_size)); > + if (!bok) > + err = BLK_STS_IOERR; > + } while (blk_update_request(rq, bok ? BLK_STS_OK : BLK_STS_IOERR, bio->bi_iter.bi_size)); > + > + __blk_mq_end_request(rq, err); > > /* cf. http://lkml.org/lkml/2006/10/31/28 */ > if (!fastfail) > - __blk_run_queue(q); > + blk_mq_run_hw_queues(q, true); > } > > static void > diff --git a/drivers/block/aoe/aoedev.c b/drivers/block/aoe/aoedev.c > index 41060e9cedf2..96b420ddff3f 100644 > --- a/drivers/block/aoe/aoedev.c > +++ b/drivers/block/aoe/aoedev.c > @@ -5,7 +5,7 @@ > */ > > #include > -#include > +#include > #include > #include > #include > @@ -197,7 +197,6 @@ aoedev_downdev(struct aoedev *d) > { > struct aoetgt *t, **tt, **te; > struct list_head *head, *pos, *nx; > - struct request *rq; > int i; > > d->flags &= ~DEVFL_UP; > @@ -225,10 +224,11 @@ aoedev_downdev(struct aoedev *d) > > /* fast fail all pending I/O */ > if (d->blkq) { > - while ((rq = blk_peek_request(d->blkq))) { > - blk_start_request(rq); > - aoe_end_request(d, rq, 1); > - } > + /* UP is cleared, freeze+quiesce to insure all are errored */ > + blk_mq_freeze_queue(d->blkq); > + blk_mq_quiesce_queue(d->blkq); > + blk_mq_unquiesce_queue(d->blkq); > + blk_mq_unfreeze_queue(d->blkq); > } > > if (d->gd) > @@ -278,6 +278,7 @@ freedev(struct aoedev *d) > aoedisk_rm_sysfs(d); > del_gendisk(d->gd); > put_disk(d->gd); > + blk_mq_free_tag_set(&d->tag_set); > blk_cleanup_queue(d->blkq); > } > t = d->targets; > @@ -464,6 +465,7 @@ aoedev_by_aoeaddr(ulong maj, int min, int do_alloc) > d->ntargets = NTARGETS; > INIT_WORK(&d->work, aoecmd_sleepwork); > spin_lock_init(&d->lock); > + INIT_LIST_HEAD(&d->rq_list); > skb_queue_head_init(&d->skbpool); > timer_setup(&d->timer, dummy_timer, 0); > d->timer.expires = jiffies + HZ; > -- > 2.17.1 > -- Ed Cashin From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe , "Ed L. Cashin" Subject: [PATCH 14/17] aoe: convert aoeblk to blk-mq Date: Thu, 11 Oct 2018 10:59:06 -0600 Message-Id: <20181011165909.32615-15-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Straight forward conversion - instead of rewriting the internal buffer retrieval logic, just replace the previous elevator peeking with an internal list of requests. Cc: "Ed L. Cashin" Signed-off-by: Jens Axboe --- drivers/block/aoe/aoe.h | 4 ++++ drivers/block/aoe/aoeblk.c | 49 ++++++++++++++++++++++++++++---------- drivers/block/aoe/aoecmd.c | 17 +++++++++---- drivers/block/aoe/aoedev.c | 14 ++++++----- 4 files changed, 60 insertions(+), 24 deletions(-) diff --git a/drivers/block/aoe/aoe.h b/drivers/block/aoe/aoe.h index c0ebda1283cc..9b9db29fe712 100644 --- a/drivers/block/aoe/aoe.h +++ b/drivers/block/aoe/aoe.h @@ -1,4 +1,6 @@ /* Copyright (c) 2013 Coraid, Inc. See COPYING for GPL terms. */ +#include + #define VERSION "85" #define AOE_MAJOR 152 #define DEVICE_NAME "aoe" @@ -164,6 +166,8 @@ struct aoedev { struct gendisk *gd; struct dentry *debugfs; struct request_queue *blkq; + struct list_head rq_list; + struct blk_mq_tag_set tag_set; struct hd_geometry geo; sector_t ssize; struct timer_list timer; diff --git a/drivers/block/aoe/aoeblk.c b/drivers/block/aoe/aoeblk.c index 429ebb84b592..ba4afa0ce1c7 100644 --- a/drivers/block/aoe/aoeblk.c +++ b/drivers/block/aoe/aoeblk.c @@ -6,7 +6,7 @@ #include #include -#include +#include #include #include #include @@ -274,23 +274,25 @@ aoeblk_release(struct gendisk *disk, fmode_t mode) spin_unlock_irqrestore(&d->lock, flags); } -static void -aoeblk_request(struct request_queue *q) +static blk_status_t aoeblk_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { - struct aoedev *d; - struct request *rq; + struct aoedev *d = hctx->queue->queuedata; + + spin_lock_irq(&d->lock); - d = q->queuedata; if ((d->flags & DEVFL_UP) == 0) { pr_info_ratelimited("aoe: device %ld.%d is not up\n", d->aoemajor, d->aoeminor); - while ((rq = blk_peek_request(q))) { - blk_start_request(rq); - aoe_end_request(d, rq, 1); - } - return; + spin_unlock_irq(&d->lock); + blk_mq_start_request(bd->rq); + return BLK_STS_IOERR; } + + list_add_tail(&bd->rq->queuelist, &d->rq_list); aoecmd_work(d); + spin_unlock_irq(&d->lock); + return BLK_STS_OK; } static int @@ -345,6 +347,10 @@ static const struct block_device_operations aoe_bdops = { .owner = THIS_MODULE, }; +static const struct blk_mq_ops aoeblk_mq_ops = { + .queue_rq = aoeblk_queue_rq, +}; + /* alloc_disk and add_disk can sleep */ void aoeblk_gdalloc(void *vp) @@ -353,9 +359,11 @@ aoeblk_gdalloc(void *vp) struct gendisk *gd; mempool_t *mp; struct request_queue *q; + struct blk_mq_tag_set *set; enum { KB = 1024, MB = KB * KB, READ_AHEAD = 2 * MB, }; ulong flags; int late = 0; + int err; spin_lock_irqsave(&d->lock, flags); if (d->flags & DEVFL_GDALLOC @@ -382,10 +390,25 @@ aoeblk_gdalloc(void *vp) d->aoemajor, d->aoeminor); goto err_disk; } - q = blk_init_queue(aoeblk_request, &d->lock); - if (q == NULL) { + + set = &d->tag_set; + set->ops = &aoeblk_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = 128; + set->numa_node = NUMA_NO_NODE; + set->flags = BLK_MQ_F_SHOULD_MERGE; + err = blk_mq_alloc_tag_set(set); + if (err) { + pr_err("aoe: cannot allocate tag set for %ld.%d\n", + d->aoemajor, d->aoeminor); + goto err_mempool; + } + + q = blk_mq_init_queue(set); + if (IS_ERR(q)) { pr_err("aoe: cannot allocate block queue for %ld.%d\n", d->aoemajor, d->aoeminor); + blk_mq_free_tag_set(set); goto err_mempool; } diff --git a/drivers/block/aoe/aoecmd.c b/drivers/block/aoe/aoecmd.c index 136dc507d020..fce0fc1fa7bf 100644 --- a/drivers/block/aoe/aoecmd.c +++ b/drivers/block/aoe/aoecmd.c @@ -7,7 +7,7 @@ #include #include #include -#include +#include #include #include #include @@ -857,10 +857,12 @@ nextbuf(struct aoedev *d) return d->ip.buf; rq = d->ip.rq; if (rq == NULL) { - rq = blk_peek_request(q); + rq = list_first_entry_or_null(&d->rq_list, struct request, + queuelist); if (rq == NULL) return NULL; - blk_start_request(rq); + list_del_init(&rq->queuelist); + blk_mq_start_request(rq); d->ip.rq = rq; d->ip.nxbio = rq->bio; rq->special = (void *) rqbiocnt(rq); @@ -1045,6 +1047,7 @@ aoe_end_request(struct aoedev *d, struct request *rq, int fastfail) struct bio *bio; int bok; struct request_queue *q; + blk_status_t err = BLK_STS_OK; q = d->blkq; if (rq == d->ip.rq) @@ -1052,11 +1055,15 @@ aoe_end_request(struct aoedev *d, struct request *rq, int fastfail) do { bio = rq->bio; bok = !fastfail && !bio->bi_status; - } while (__blk_end_request(rq, bok ? BLK_STS_OK : BLK_STS_IOERR, bio->bi_iter.bi_size)); + if (!bok) + err = BLK_STS_IOERR; + } while (blk_update_request(rq, bok ? BLK_STS_OK : BLK_STS_IOERR, bio->bi_iter.bi_size)); + + __blk_mq_end_request(rq, err); /* cf. http://lkml.org/lkml/2006/10/31/28 */ if (!fastfail) - __blk_run_queue(q); + blk_mq_run_hw_queues(q, true); } static void diff --git a/drivers/block/aoe/aoedev.c b/drivers/block/aoe/aoedev.c index 41060e9cedf2..96b420ddff3f 100644 --- a/drivers/block/aoe/aoedev.c +++ b/drivers/block/aoe/aoedev.c @@ -5,7 +5,7 @@ */ #include -#include +#include #include #include #include @@ -197,7 +197,6 @@ aoedev_downdev(struct aoedev *d) { struct aoetgt *t, **tt, **te; struct list_head *head, *pos, *nx; - struct request *rq; int i; d->flags &= ~DEVFL_UP; @@ -225,10 +224,11 @@ aoedev_downdev(struct aoedev *d) /* fast fail all pending I/O */ if (d->blkq) { - while ((rq = blk_peek_request(d->blkq))) { - blk_start_request(rq); - aoe_end_request(d, rq, 1); - } + /* UP is cleared, freeze+quiesce to insure all are errored */ + blk_mq_freeze_queue(d->blkq); + blk_mq_quiesce_queue(d->blkq); + blk_mq_unquiesce_queue(d->blkq); + blk_mq_unfreeze_queue(d->blkq); } if (d->gd) @@ -278,6 +278,7 @@ freedev(struct aoedev *d) aoedisk_rm_sysfs(d); del_gendisk(d->gd); put_disk(d->gd); + blk_mq_free_tag_set(&d->tag_set); blk_cleanup_queue(d->blkq); } t = d->targets; @@ -464,6 +465,7 @@ aoedev_by_aoeaddr(ulong maj, int min, int do_alloc) d->ntargets = NTARGETS; INIT_WORK(&d->work, aoecmd_sleepwork); spin_lock_init(&d->lock); + INIT_LIST_HEAD(&d->rq_list); skb_queue_head_init(&d->skbpool); timer_setup(&d->timer, dummy_timer, 0); d->timer.expires = jiffies + HZ; -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe Subject: [PATCH 11/17] z2ram: convert to blk-mq Date: Thu, 11 Oct 2018 10:59:03 -0600 Message-Id: <20181011165909.32615-12-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Straight forward conversion to blk-mq, nothing special about this driver. Signed-off-by: Jens Axboe --- drivers/block/z2ram.c | 96 ++++++++++++++++++++++++++----------------- 1 file changed, 58 insertions(+), 38 deletions(-) diff --git a/drivers/block/z2ram.c b/drivers/block/z2ram.c index d0c5bc4e0703..82a022a5297e 100644 --- a/drivers/block/z2ram.c +++ b/drivers/block/z2ram.c @@ -31,7 +31,7 @@ #include #include #include -#include +#include #include #include #include @@ -66,43 +66,44 @@ static DEFINE_SPINLOCK(z2ram_lock); static struct gendisk *z2ram_gendisk; -static void do_z2_request(struct request_queue *q) +static blk_status_t z2_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { - struct request *req; - - req = blk_fetch_request(q); - while (req) { - unsigned long start = blk_rq_pos(req) << 9; - unsigned long len = blk_rq_cur_bytes(req); - blk_status_t err = BLK_STS_OK; - - if (start + len > z2ram_size) { - pr_err(DEVICE_NAME ": bad access: block=%llu, " - "count=%u\n", - (unsigned long long)blk_rq_pos(req), - blk_rq_cur_sectors(req)); - err = BLK_STS_IOERR; - goto done; - } - while (len) { - unsigned long addr = start & Z2RAM_CHUNKMASK; - unsigned long size = Z2RAM_CHUNKSIZE - addr; - void *buffer = bio_data(req->bio); - - if (len < size) - size = len; - addr += z2ram_map[ start >> Z2RAM_CHUNKSHIFT ]; - if (rq_data_dir(req) == READ) - memcpy(buffer, (char *)addr, size); - else - memcpy((char *)addr, buffer, size); - start += size; - len -= size; - } - done: - if (!__blk_end_request_cur(req, err)) - req = blk_fetch_request(q); + struct request *req = bd->rq; + unsigned long start = blk_rq_pos(req) << 9; + unsigned long len = blk_rq_cur_bytes(req); + + blk_mq_start_request(req); + + if (start + len > z2ram_size) { + pr_err(DEVICE_NAME ": bad access: block=%llu, " + "count=%u\n", + (unsigned long long)blk_rq_pos(req), + blk_rq_cur_sectors(req)); + return BLK_STS_IOERR; } + + spin_lock_irq(&z2ram_lock); + + while (len) { + unsigned long addr = start & Z2RAM_CHUNKMASK; + unsigned long size = Z2RAM_CHUNKSIZE - addr; + void *buffer = bio_data(req->bio); + + if (len < size) + size = len; + addr += z2ram_map[ start >> Z2RAM_CHUNKSHIFT ]; + if (rq_data_dir(req) == READ) + memcpy(buffer, (char *)addr, size); + else + memcpy((char *)addr, buffer, size); + start += size; + len -= size; + } + + spin_unlock_irq(&z2ram_lock); + blk_mq_end_request(req, BLK_STS_OK); + return BLK_STS_OK; } static void @@ -337,6 +338,11 @@ static struct kobject *z2_find(dev_t dev, int *part, void *data) } static struct request_queue *z2_queue; +static struct blk_mq_tag_set tag_set; + +static const struct blk_mq_ops z2_mq_ops = { + .queue_rq = z2_queue_rq, +}; static int __init z2_init(void) @@ -355,10 +361,23 @@ z2_init(void) if (!z2ram_gendisk) goto out_disk; - z2_queue = blk_init_queue(do_z2_request, &z2ram_lock); - if (!z2_queue) + tag_set.ops = &z2_mq_ops; + tag_set.nr_hw_queues = 1; + tag_set.queue_depth = 16; /* no hard limit */ + tag_set.numa_node = NUMA_NO_NODE; + tag_set.flags = BLK_MQ_F_SHOULD_MERGE; + ret = blk_mq_alloc_tag_set(&tag_set); + if (ret) goto out_queue; + z2_queue = blk_mq_init_queue(&tag_set); + if (IS_ERR(z2_queue)) { + ret = PTR_ERR(z2_queue); + z2_queue = NULL; + blk_mq_free_tag_set(&tag_set); + goto out_queue; + } + z2ram_gendisk->major = Z2RAM_MAJOR; z2ram_gendisk->first_minor = 0; z2ram_gendisk->fops = &z2_fops; @@ -386,6 +405,7 @@ static void __exit z2_exit(void) unregister_blkdev(Z2RAM_MAJOR, DEVICE_NAME); del_gendisk(z2ram_gendisk); put_disk(z2ram_gendisk); + blk_mq_free_tag_set(&tag_set); blk_cleanup_queue(z2_queue); if ( current_device != -1 ) -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe Subject: [PATCH 02/17] sx8: convert to blk-mq Date: Thu, 11 Oct 2018 10:58:54 -0600 Message-Id: <20181011165909.32615-3-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Convert from the old request_fn style driver to blk-mq. Signed-off-by: Jens Axboe --- drivers/block/sx8.c | 133 +++++++++++++++++++++++++++++--------------- 1 file changed, 88 insertions(+), 45 deletions(-) diff --git a/drivers/block/sx8.c b/drivers/block/sx8.c index 4d90e5eba2f5..5402dfdf331b 100644 --- a/drivers/block/sx8.c +++ b/drivers/block/sx8.c @@ -16,7 +16,7 @@ #include #include #include -#include +#include #include #include #include @@ -244,6 +244,7 @@ struct carm_port { unsigned int port_no; struct gendisk *disk; struct carm_host *host; + struct blk_mq_tag_set tag_set; /* attached device characteristics */ u64 capacity; @@ -279,6 +280,7 @@ struct carm_host { unsigned int state; u32 fw_ver; + struct blk_mq_tag_set tag_set; struct request_queue *oob_q; unsigned int n_oob; @@ -750,7 +752,7 @@ static inline void carm_end_request_queued(struct carm_host *host, struct request *req = crq->rq; int rc; - __blk_end_request_all(req, error); + blk_mq_end_request(req, error); rc = carm_put_request(host, crq); assert(rc == 0); @@ -760,7 +762,7 @@ static inline void carm_push_q (struct carm_host *host, struct request_queue *q) { unsigned int idx = host->wait_q_prod % CARM_MAX_WAIT_Q; - blk_stop_queue(q); + blk_mq_stop_hw_queues(q); VPRINTK("STOPPED QUEUE %p\n", q); host->wait_q[idx] = q; @@ -785,7 +787,7 @@ static inline void carm_round_robin(struct carm_host *host) { struct request_queue *q = carm_pop_q(host); if (q) { - blk_start_queue(q); + blk_mq_start_hw_queues(q); VPRINTK("STARTED QUEUE %p\n", q); } } @@ -802,62 +804,62 @@ static inline void carm_end_rq(struct carm_host *host, struct carm_request *crq, } } -static void carm_oob_rq_fn(struct request_queue *q) +static blk_status_t carm_oob_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { + struct request_queue *q = hctx->queue; struct carm_host *host = q->queuedata; struct carm_request *crq; - struct request *rq; int rc; - while (1) { - DPRINTK("get req\n"); - rq = blk_fetch_request(q); - if (!rq) - break; + blk_mq_start_request(bd->rq); + + spin_lock_irq(&host->lock); - crq = rq->special; - assert(crq != NULL); - assert(crq->rq == rq); + crq = bd->rq->special; + assert(crq != NULL); + assert(crq->rq == bd->rq); - crq->n_elem = 0; + crq->n_elem = 0; - DPRINTK("send req\n"); - rc = carm_send_msg(host, crq); - if (rc) { - blk_requeue_request(q, rq); - carm_push_q(host, q); - return; /* call us again later, eventually */ - } + DPRINTK("send req\n"); + rc = carm_send_msg(host, crq); + if (rc) { + carm_push_q(host, q); + spin_unlock_irq(&host->lock); + return BLK_STS_DEV_RESOURCE; } + + spin_unlock_irq(&host->lock); + return BLK_STS_OK; } -static void carm_rq_fn(struct request_queue *q) +static blk_status_t carm_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { + struct request_queue *q = hctx->queue; struct carm_port *port = q->queuedata; struct carm_host *host = port->host; struct carm_msg_rw *msg; struct carm_request *crq; - struct request *rq; + struct request *rq = bd->rq; struct scatterlist *sg; int writing = 0, pci_dir, i, n_elem, rc; u32 tmp; unsigned int msg_size; -queue_one_request: - VPRINTK("get req\n"); - rq = blk_peek_request(q); - if (!rq) - return; + blk_mq_start_request(rq); + + spin_lock_irq(&host->lock); crq = carm_get_request(host); if (!crq) { carm_push_q(host, q); - return; /* call us again later, eventually */ + spin_unlock_irq(&host->lock); + return BLK_STS_DEV_RESOURCE; } crq->rq = rq; - blk_start_request(rq); - if (rq_data_dir(rq) == WRITE) { writing = 1; pci_dir = PCI_DMA_TODEVICE; @@ -869,15 +871,19 @@ static void carm_rq_fn(struct request_queue *q) sg = &crq->sg[0]; n_elem = blk_rq_map_sg(q, rq, sg); if (n_elem <= 0) { + /* request with no s/g entries? */ carm_end_rq(host, crq, BLK_STS_IOERR); - return; /* request with no s/g entries? */ + spin_unlock_irq(&host->lock); + return BLK_STS_IOERR; } /* map scatterlist to PCI bus addresses */ n_elem = pci_map_sg(host->pdev, sg, n_elem, pci_dir); if (n_elem <= 0) { + /* request with no s/g entries? */ carm_end_rq(host, crq, BLK_STS_IOERR); - return; /* request with no s/g entries? */ + spin_unlock_irq(&host->lock); + return BLK_STS_IOERR; } crq->n_elem = n_elem; crq->port = port; @@ -927,12 +933,13 @@ static void carm_rq_fn(struct request_queue *q) rc = carm_send_msg(host, crq); if (rc) { carm_put_request(host, crq); - blk_requeue_request(q, rq); carm_push_q(host, q); - return; /* call us again later, eventually */ + spin_unlock_irq(&host->lock); + return BLK_STS_DEV_RESOURCE; } - goto queue_one_request; + spin_unlock_irq(&host->lock); + return BLK_STS_OK; } static void carm_handle_array_info(struct carm_host *host, @@ -1485,6 +1492,14 @@ static int carm_init_host(struct carm_host *host) return 0; } +static const struct blk_mq_ops carm_oob_mq_ops = { + .queue_rq = carm_oob_queue_rq, +}; + +static const struct blk_mq_ops carm_mq_ops = { + .queue_rq = carm_queue_rq, +}; + static int carm_init_disks(struct carm_host *host) { unsigned int i; @@ -1494,6 +1509,7 @@ static int carm_init_disks(struct carm_host *host) struct gendisk *disk; struct request_queue *q; struct carm_port *port; + struct blk_mq_tag_set *set; port = &host->port[i]; port->host = host; @@ -1513,9 +1529,19 @@ static int carm_init_disks(struct carm_host *host) disk->fops = &carm_bd_ops; disk->private_data = port; - q = blk_init_queue(carm_rq_fn, &host->lock); - if (!q) { - rc = -ENOMEM; + set = &port->tag_set; + set->ops = &carm_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = max_queue; + set->numa_node = NUMA_NO_NODE; + set->flags = BLK_MQ_F_SHOULD_MERGE; + rc = blk_mq_alloc_tag_set(set); + if (rc) + break; + + q = blk_mq_init_queue(set); + if (IS_ERR(q)) { + rc = PTR_ERR(q); break; } disk->queue = q; @@ -1533,14 +1559,18 @@ static void carm_free_disks(struct carm_host *host) unsigned int i; for (i = 0; i < CARM_MAX_PORTS; i++) { - struct gendisk *disk = host->port[i].disk; + struct carm_port *port = &host->port[i]; + struct gendisk *disk = port->disk; + if (disk) { struct request_queue *q = disk->queue; if (disk->flags & GENHD_FL_UP) del_gendisk(disk); - if (q) + if (q) { + blk_mq_free_tag_set(&port->tag_set); blk_cleanup_queue(q); + } put_disk(disk); } } @@ -1568,6 +1598,7 @@ static int carm_init_one (struct pci_dev *pdev, const struct pci_device_id *ent) unsigned int pci_dac; int rc; struct request_queue *q; + struct blk_mq_tag_set *set; unsigned int i; printk_once(KERN_DEBUG DRV_NAME " version " DRV_VERSION "\n"); @@ -1636,11 +1667,21 @@ static int carm_init_one (struct pci_dev *pdev, const struct pci_device_id *ent) goto err_out_iounmap; } - q = blk_init_queue(carm_oob_rq_fn, &host->lock); - if (!q) { + set = &host->tag_set; + set->ops = &carm_oob_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = 1; + set->numa_node = NUMA_NO_NODE; + set->flags = BLK_MQ_F_NO_SCHED; + rc = blk_mq_alloc_tag_set(set); + if (rc) + goto err_out_pci_free; + + q = blk_mq_init_queue(set); + if (IS_ERR(q)) { printk(KERN_ERR DRV_NAME "(%s): OOB queue alloc failure\n", pci_name(pdev)); - rc = -ENOMEM; + rc = PTR_ERR(q); goto err_out_pci_free; } host->oob_q = q; @@ -1704,6 +1745,7 @@ static int carm_init_one (struct pci_dev *pdev, const struct pci_device_id *ent) clear_bit(0, &carm_major_alloc); else if (host->major == 161) clear_bit(1, &carm_major_alloc); + blk_mq_free_tag_set(&host->tag_set); blk_cleanup_queue(host->oob_q); err_out_pci_free: pci_free_consistent(pdev, CARM_SHM_SIZE, host->shm, host->shm_dma); @@ -1735,6 +1777,7 @@ static void carm_remove_one (struct pci_dev *pdev) clear_bit(0, &carm_major_alloc); else if (host->major == 161) clear_bit(1, &carm_major_alloc); + blk_mq_free_tag_set(&host->tag_set); blk_cleanup_queue(host->oob_q); pci_free_consistent(pdev, CARM_SHM_SIZE, host->shm, host->shm_dma); iounmap(host->mmio); -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq To: Geoff Levand , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt , Geert Uytterhoeven References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> <3403ae47-1aaa-9d01-817c-cd52a7daa272@infradead.org> <6d7ccd4c-0d41-e2d3-6ecd-b9efbd7358b5@infradead.org> From: Jens Axboe Message-ID: <870de740-005f-ff82-ef33-7c8aac1a2c86@kernel.dk> Date: Mon, 15 Oct 2018 13:30:48 -0600 MIME-Version: 1.0 In-Reply-To: <6d7ccd4c-0d41-e2d3-6ecd-b9efbd7358b5@infradead.org> Content-Type: text/plain; charset=utf-8 List-ID: On 10/15/18 1:24 PM, Geoff Levand wrote: > Hi Jens, > > On 10/15/2018 11:38 AM, Jens Axboe wrote: >> Weird, it looks like we're waiting for something to complete, and then >> we have a few others waiting for queue new IO. >> >> Can you try and move the blk_mq_end_request() inside the priv->lock >> section and see if that helps? > > With the change below to your V2 I can't get it to have an > error. I did mkfs.ext4, some big file downloads, and ran > 'fsck.ext3 -c' for a while. OK good, that's better than having to make the bigger change I just sent out. > Thanks for working late on it. Thanks for testing! I'll add your tested-by. -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq To: Jens Axboe , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt , Geert Uytterhoeven References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> <3403ae47-1aaa-9d01-817c-cd52a7daa272@infradead.org> From: Geoff Levand Message-ID: <6d7ccd4c-0d41-e2d3-6ecd-b9efbd7358b5@infradead.org> Date: Mon, 15 Oct 2018 12:24:28 -0700 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 List-ID: Hi Jens, On 10/15/2018 11:38 AM, Jens Axboe wrote: > Weird, it looks like we're waiting for something to complete, and then > we have a few others waiting for queue new IO. > > Can you try and move the blk_mq_end_request() inside the priv->lock > section and see if that helps? With the change below to your V2 I can't get it to have an error. I did mkfs.ext4, some big file downloads, and ran 'fsck.ext3 -c' for a while. Thanks for working late on it. -Geoff --- a/drivers/block/ps3disk.c +++ b/drivers/block/ps3disk.c @@ -274,10 +274,9 @@ static irqreturn_t ps3disk_interrupt(int irq, void *data) ps3disk_scatter_gather(dev, req, 0); } - blk_mq_end_request(req, error); - spin_lock(&priv->lock); priv->req = NULL; + blk_mq_end_request(req, error); spin_unlock(&priv->lock); blk_mq_run_hw_queues(priv->queue, true); @@ -458,7 +457,7 @@ static int ps3disk_probe(struct ps3_system_bus_device *_dev) set = &priv->tag_set; set->ops = &ps3disk_mq_ops; set->nr_hw_queues = 1; - set->queue_depth = 2; + set->queue_depth = 1; set->numa_node = NUMA_NO_NODE; set->flags = BLK_MQ_F_SHOULD_MERGE; error = blk_mq_alloc_tag_set(set); From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq From: Jens Axboe To: Geoff Levand , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt , Geert Uytterhoeven References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> <3403ae47-1aaa-9d01-817c-cd52a7daa272@infradead.org> Message-ID: <6c9f8842-6043-60c2-ed68-39cae1fc2cc8@kernel.dk> Date: Mon, 15 Oct 2018 13:09:11 -0600 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 List-ID: On 10/15/18 12:38 PM, Jens Axboe wrote: > On 10/15/18 12:23 PM, Geoff Levand wrote: >> Hi Jens, >> >> On 10/15/2018 09:27 AM, Jens Axboe wrote:> Can you try and change the queue depth to 1 instead of 2? It's set in> the tag_set, as ->queue_depth. >> >> With this change: >> >> - set->queue_depth = 2; >> + set->queue_depth = 1; >> >> Something is still wrong. It can sometimes boot, sometimes udevd hangs >> up on /sbin/blkid. If it boots I can sometimes mount a ps3disk >> partition, but then cat or echo to a file will hang. Other times the >> mount command will hang. I saw this error appear in the system log: > > Weird, it looks like we're waiting for something to complete, and then > we have a few others waiting for queue new IO. > > Can you try and move the blk_mq_end_request() inside the priv->lock > section and see if that helps? If that still fails, replace with this version. It's closer to the original logic. Thanks for testing!! diff --git a/block/blk-mq.c b/block/blk-mq.c index c2ecd64a2403..dcf10e39995a 100644 --- a/block/blk-mq.c +++ b/block/blk-mq.c @@ -2507,6 +2507,39 @@ struct request_queue *blk_mq_init_queue(struct blk_mq_tag_set *set) } EXPORT_SYMBOL(blk_mq_init_queue); +/* + * Helper for setting up a queue with mq ops, given queue depth, and + * the passed in mq ops flags. + */ +struct request_queue *blk_mq_init_sq_queue(struct blk_mq_tag_set *set, + const struct blk_mq_ops *ops, + unsigned int queue_depth, + unsigned int set_flags) +{ + struct request_queue *q; + int ret; + + memset(set, 0, sizeof(*set)); + set->ops = ops; + set->nr_hw_queues = 1; + set->queue_depth = queue_depth; + set->numa_node = NUMA_NO_NODE; + set->flags = set_flags; + + ret = blk_mq_alloc_tag_set(set); + if (ret) + return ERR_PTR(ret); + + q = blk_mq_init_queue(set); + if (IS_ERR(q)) { + blk_mq_free_tag_set(set); + return q; + } + + return q; +} +EXPORT_SYMBOL(blk_mq_init_sq_queue); + static int blk_mq_hw_ctx_size(struct blk_mq_tag_set *tag_set) { int hw_ctx_size = sizeof(struct blk_mq_hw_ctx); diff --git a/include/linux/blk-mq.h b/include/linux/blk-mq.h index 1da59c16f637..2286dc12c6bc 100644 --- a/include/linux/blk-mq.h +++ b/include/linux/blk-mq.h @@ -203,6 +203,10 @@ enum { struct request_queue *blk_mq_init_queue(struct blk_mq_tag_set *); struct request_queue *blk_mq_init_allocated_queue(struct blk_mq_tag_set *set, struct request_queue *q); +struct request_queue *blk_mq_init_sq_queue(struct blk_mq_tag_set *set, + const struct blk_mq_ops *ops, + unsigned int queue_depth, + unsigned int set_flags); int blk_mq_register_dev(struct device *, struct request_queue *); void blk_mq_unregister_dev(struct device *, struct request_queue *); diff --git a/drivers/block/ps3disk.c b/drivers/block/ps3disk.c index 29a4419e8ba3..affc25a431e2 100644 --- a/drivers/block/ps3disk.c +++ b/drivers/block/ps3disk.c @@ -19,7 +19,7 @@ */ #include -#include +#include #include #include @@ -42,6 +42,8 @@ struct ps3disk_private { spinlock_t lock; /* Request queue spinlock */ struct request_queue *queue; + struct blk_mq_tag_set tag_set; + struct list_head rq_list; struct gendisk *gendisk; unsigned int blocking_factor; struct request *req; @@ -118,8 +120,8 @@ static void ps3disk_scatter_gather(struct ps3_storage_device *dev, } } -static int ps3disk_submit_request_sg(struct ps3_storage_device *dev, - struct request *req) +static blk_status_t ps3disk_submit_request_sg(struct ps3_storage_device *dev, + struct request *req) { struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); int write = rq_data_dir(req), res; @@ -158,16 +160,15 @@ static int ps3disk_submit_request_sg(struct ps3_storage_device *dev, if (res) { dev_err(&dev->sbd.core, "%s:%u: %s failed %d\n", __func__, __LINE__, op, res); - __blk_end_request_all(req, BLK_STS_IOERR); - return 0; + return BLK_STS_IOERR; } priv->req = req; - return 1; + return BLK_STS_OK; } -static int ps3disk_submit_flush_request(struct ps3_storage_device *dev, - struct request *req) +static blk_status_t ps3disk_submit_flush_request(struct ps3_storage_device *dev, + struct request *req) { struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); u64 res; @@ -180,50 +181,63 @@ static int ps3disk_submit_flush_request(struct ps3_storage_device *dev, if (res) { dev_err(&dev->sbd.core, "%s:%u: sync cache failed 0x%llx\n", __func__, __LINE__, res); - __blk_end_request_all(req, BLK_STS_IOERR); - return 0; + return BLK_STS_IOERR; } priv->req = req; - return 1; + return BLK_STS_OK; } -static void ps3disk_do_request(struct ps3_storage_device *dev, - struct request_queue *q) +static blk_status_t __ps3disk_do_request(struct ps3_storage_device *dev, + struct request *req) { + dev_dbg(&dev->sbd.core, "%s:%u\n", __func__, __LINE__); + + switch (req_op(req)) { + case REQ_OP_FLUSH: + return ps3disk_submit_flush_request(dev, req); + case REQ_OP_READ: + case REQ_OP_WRITE: + return ps3disk_submit_request_sg(dev, req); + default: + blk_dump_rq_flags(req, DEVICE_NAME " bad request"); + return BLK_STS_IOERR; + } +} + +static void ps3disk_do_request(struct ps3_storage_device *dev) +{ + struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); struct request *req; + blk_status_t ret; - dev_dbg(&dev->sbd.core, "%s:%u\n", __func__, __LINE__); + while (!list_empty(&priv->rq_list)) { + req = list_first_entry(&priv->rq_list, struct request, queuelist); + list_del_init(&req->queuelist); + blk_mq_start_request(req); - while ((req = blk_fetch_request(q))) { - switch (req_op(req)) { - case REQ_OP_FLUSH: - if (ps3disk_submit_flush_request(dev, req)) - return; - break; - case REQ_OP_READ: - case REQ_OP_WRITE: - if (ps3disk_submit_request_sg(dev, req)) - return; - break; - default: - blk_dump_rq_flags(req, DEVICE_NAME " bad request"); - __blk_end_request_all(req, BLK_STS_IOERR); + ret = __ps3disk_do_request(dev, req); + if (ret == BLK_STS_IOERR) { + blk_mq_end_request(req, BLK_STS_IOERR); + continue; } + break; } } -static void ps3disk_request(struct request_queue *q) +static blk_status_t ps3disk_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { - struct ps3_storage_device *dev = q->queuedata; + struct ps3_storage_device *dev = hctx->queue->queuedata; struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); - if (priv->req) { - dev_dbg(&dev->sbd.core, "%s:%u busy\n", __func__, __LINE__); - return; - } + spin_lock_irq(&priv->lock); + list_add_tail(&bd->rq->queuelist, &priv->rq_list); + if (!priv->req) + ps3disk_do_request(dev); + spin_unlock_irq(&priv->lock); - ps3disk_do_request(dev, q); + return BLK_STS_OK; } static irqreturn_t ps3disk_interrupt(int irq, void *data) @@ -280,9 +294,9 @@ static irqreturn_t ps3disk_interrupt(int irq, void *data) } spin_lock(&priv->lock); - __blk_end_request_all(req, error); + blk_mq_end_request(req, error); priv->req = NULL; - ps3disk_do_request(dev, priv->queue); + ps3disk_do_request(dev); spin_unlock(&priv->lock); return IRQ_HANDLED; @@ -404,6 +418,10 @@ static unsigned long ps3disk_mask; static DEFINE_MUTEX(ps3disk_mask_mutex); +static const struct blk_mq_ops ps3disk_mq_ops = { + .queue_rq = ps3disk_queue_rq, +}; + static int ps3disk_probe(struct ps3_system_bus_device *_dev) { struct ps3_storage_device *dev = to_ps3_storage_device(&_dev->core); @@ -440,6 +458,7 @@ static int ps3disk_probe(struct ps3_system_bus_device *_dev) ps3_system_bus_set_drvdata(_dev, priv); spin_lock_init(&priv->lock); + INIT_LIST_HEAD(&priv->rq_list); dev->bounce_size = BOUNCE_SIZE; dev->bounce_buf = kmalloc(BOUNCE_SIZE, GFP_DMA); @@ -454,11 +473,12 @@ static int ps3disk_probe(struct ps3_system_bus_device *_dev) ps3disk_identify(dev); - queue = blk_init_queue(ps3disk_request, &priv->lock); - if (!queue) { - dev_err(&dev->sbd.core, "%s:%u: blk_init_queue failed\n", + queue = blk_mq_init_sq_queue(&priv->tag_set, &ps3disk_mq_ops, 16, + BLK_MQ_F_SHOULD_MERGE); + if (IS_ERR(queue)) { + dev_err(&dev->sbd.core, "%s:%u: blk_mq_init_queue failed\n", __func__, __LINE__); - error = -ENOMEM; + error = PTR_ERR(queue); goto fail_teardown; } @@ -505,6 +525,7 @@ static int ps3disk_probe(struct ps3_system_bus_device *_dev) fail_cleanup_queue: blk_cleanup_queue(queue); + blk_mq_free_tag_set(&priv->tag_set); fail_teardown: ps3stor_teardown(dev); fail_free_bounce: @@ -530,6 +551,7 @@ static int ps3disk_remove(struct ps3_system_bus_device *_dev) mutex_unlock(&ps3disk_mask_mutex); del_gendisk(priv->gendisk); blk_cleanup_queue(priv->queue); + blk_mq_free_tag_set(&priv->tag_set); put_disk(priv->gendisk); dev_notice(&dev->sbd.core, "Synchronizing disk cache\n"); ps3disk_sync_cache(dev); -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq To: Geoff Levand , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt , Geert Uytterhoeven References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> <3403ae47-1aaa-9d01-817c-cd52a7daa272@infradead.org> From: Jens Axboe Message-ID: Date: Mon, 15 Oct 2018 12:38:21 -0600 MIME-Version: 1.0 In-Reply-To: <3403ae47-1aaa-9d01-817c-cd52a7daa272@infradead.org> Content-Type: text/plain; charset=utf-8 List-ID: On 10/15/18 12:23 PM, Geoff Levand wrote: > Hi Jens, > > On 10/15/2018 09:27 AM, Jens Axboe wrote:> Can you try and change the queue depth to 1 instead of 2? It's set in> the tag_set, as ->queue_depth. > > With this change: > > - set->queue_depth = 2; > + set->queue_depth = 1; > > Something is still wrong. It can sometimes boot, sometimes udevd hangs > up on /sbin/blkid. If it boots I can sometimes mount a ps3disk > partition, but then cat or echo to a file will hang. Other times the > mount command will hang. I saw this error appear in the system log: Weird, it looks like we're waiting for something to complete, and then we have a few others waiting for queue new IO. Can you try and move the blk_mq_end_request() inside the priv->lock section and see if that helps? -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq To: Jens Axboe , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt , Geert Uytterhoeven References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> From: Geoff Levand Message-ID: <3403ae47-1aaa-9d01-817c-cd52a7daa272@infradead.org> Date: Mon, 15 Oct 2018 11:23:18 -0700 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 List-ID: Hi Jens, On 10/15/2018 09:27 AM, Jens Axboe wrote:> Can you try and change the queue depth to 1 instead of 2? It's set in> the tag_set, as ->queue_depth. With this change: - set->queue_depth = 2; + set->queue_depth = 1; Something is still wrong. It can sometimes boot, sometimes udevd hangs up on /sbin/blkid. If it boots I can sometimes mount a ps3disk partition, but then cat or echo to a file will hang. Other times the mount command will hang. I saw this error appear in the system log: Oct 15 10:51:47 ps3 kernel: jbd2/ps3da2-8 D 0 2463 2 0x00000800 Oct 15 10:51:47 ps3 kernel: Call Trace: Oct 15 10:51:47 ps3 kernel: [c00000000d3c36b0] [c00000000d3c3750] 0xc00000000d3c3750 (unreliable) Oct 15 10:51:47 ps3 kernel: [c00000000d3c3880] [c0000000000152d0] .__switch_to+0x290/0x300 Oct 15 10:51:47 ps3 kernel: [c00000000d3c3930] [c000000000571d3c] .__schedule+0x904/0x958 Oct 15 10:51:47 ps3 kernel: [c00000000d3c3a10] [c000000000571e0c] .schedule+0x7c/0x90 Oct 15 10:51:47 ps3 kernel: [c00000000d3c3a90] [c0000000002553c4] .jbd2_journal_commit_transaction+0xb84/0x1f68 Oct 15 10:51:47 ps3 kernel: [c00000000d3c3ca0] [c00000000025ad94] .kjournald2+0xc8/0x230 Oct 15 10:51:47 ps3 kernel: [c00000000d3c3d70] [c0000000000713c4] .kthread+0x14c/0x154 Oct 15 10:51:47 ps3 kernel: [c00000000d3c3e30] [c00000000000a83c] .ret_from_kernel_thread+0x58/0x7c Oct 15 10:51:47 ps3 kernel: ext4lazyinit D 0 2465 2 0x00000800 Oct 15 10:51:47 ps3 kernel: Call Trace: Oct 15 10:51:47 ps3 kernel: [c00000000a12f130] [c00000000a12f1b0] 0xc00000000a12f1b0 (unreliable) Oct 15 10:51:47 ps3 kernel: [c00000000a12f300] [c0000000000152d0] .__switch_to+0x290/0x300 Oct 15 10:51:47 ps3 kernel: [c00000000a12f3b0] [c000000000571d3c] .__schedule+0x904/0x958 Oct 15 10:51:47 ps3 kernel: [c00000000a12f490] [c000000000571e0c] .schedule+0x7c/0x90 Oct 15 10:51:47 ps3 kernel: [c00000000a12f510] [c00000000007e1b0] .io_schedule+0x1c/0x34 Oct 15 10:51:47 ps3 kernel: [c00000000a12f590] [c0000000002fbc60] .blk_mq_get_tag+0x180/0x2a0 Oct 15 10:51:47 ps3 kernel: [c00000000a12f660] [c0000000002f59c0] .blk_mq_get_request+0x230/0x4c4 Oct 15 10:51:47 ps3 kernel: [c00000000a12f700] [c0000000002f88b8] .blk_mq_make_request+0x1c0/0x6ec Oct 15 10:51:47 ps3 kernel: [c00000000a12f7f0] [c0000000002e9b10] .generic_make_request+0x3a0/0x450 Oct 15 10:51:47 ps3 kernel: [c00000000a12f8b0] [c0000000002e9c08] .submit_bio+0x48/0x148 Oct 15 10:51:47 ps3 kernel: [c00000000a12f970] [c0000000002f49e0] .next_bio+0x50/0x60 Oct 15 10:51:47 ps3 kernel: [c00000000a12f9f0] [c0000000002f5074] .__blkdev_issue_zero_pages+0xa4/0x168 Oct 15 10:51:47 ps3 kernel: [c00000000a12fac0] [c0000000002f5360] .blkdev_issue_zeroout+0x168/0x16c Oct 15 10:51:47 ps3 kernel: [c00000000a12fbb0] [c00000000020edb8] .ext4_init_inode_table+0x230/0x34c Oct 15 10:51:47 ps3 kernel: [c00000000a12fc90] [c000000000242c30] .ext4_lazyinit_thread+0x21c/0x2f8 Oct 15 10:51:47 ps3 kernel: [c00000000a12fd70] [c0000000000713c4] .kthread+0x14c/0x154 Oct 15 10:51:47 ps3 kernel: [c00000000a12fe30] [c00000000000a83c] .ret_from_kernel_thread+0x58/0x7c Oct 15 10:51:47 ps3 kernel: kworker/u4:11 D 0 2478 2 0x00000800 Oct 15 10:51:47 ps3 kernel: Workqueue: writeback .wb_workfn (flush-254:0) Oct 15 10:51:47 ps3 kernel: Call Trace: Oct 15 10:51:47 ps3 kernel: [c00000000d5928f0] [c00000000d592990] 0xc00000000d592990 (unreliable) Oct 15 10:51:47 ps3 kernel: [c00000000d592ac0] [c0000000000152d0] .__switch_to+0x290/0x300 Oct 15 10:51:47 ps3 kernel: [c00000000d592b70] [c000000000571d3c] .__schedule+0x904/0x958 Oct 15 10:51:47 ps3 kernel: [c00000000d592c50] [c000000000571e0c] .schedule+0x7c/0x90 Oct 15 10:51:47 ps3 kernel: [c00000000d592cd0] [c00000000007e1b0] .io_schedule+0x1c/0x34 Oct 15 10:51:47 ps3 kernel: [c00000000d592d50] [c0000000002fbc60] .blk_mq_get_tag+0x180/0x2a0 Oct 15 10:51:47 ps3 kernel: [c00000000d592e20] [c0000000002f59c0] .blk_mq_get_request+0x230/0x4c4 Oct 15 10:51:47 ps3 kernel: [c00000000d592ec0] [c0000000002f88b8] .blk_mq_make_request+0x1c0/0x6ec Oct 15 10:51:47 ps3 kernel: [c00000000d592fb0] [c0000000002e9b10] .generic_make_request+0x3a0/0x450 Oct 15 10:51:47 ps3 kernel: [c00000000d593070] [c0000000002e9c08] .submit_bio+0x48/0x148 Oct 15 10:51:47 ps3 kernel: [c00000000d593130] [c0000000001aa2f8] .submit_bh_wbc.isra.9+0x198/0x1a8 Oct 15 10:51:47 ps3 kernel: [c00000000d5931d0] [c0000000001aa594] .__block_write_full_page+0x28c/0x430 Oct 15 10:51:47 ps3 kernel: [c00000000d5932c0] [c0000000001adc1c] .blkdev_writepage+0x1c/0x30 Oct 15 10:51:47 ps3 kernel: [c00000000d593330] [c000000000118fbc] .__writepage+0x34/0x80 Oct 15 10:51:47 ps3 kernel: [c00000000d5933b0] [c000000000118920] .write_cache_pages+0x39c/0x47c Oct 15 10:51:47 ps3 kernel: [c00000000d593550] [c000000000118a54] .generic_writepages+0x54/0x70 Oct 15 10:51:47 ps3 kernel: [c00000000d593600] [c0000000001adbbc] .blkdev_writepages+0x10/0x24 Oct 15 10:51:47 ps3 kernel: [c00000000d593670] [c00000000011ab80] .do_writepages+0x54/0xa0 Oct 15 10:51:47 ps3 kernel: [c00000000d5936f0] [c00000000019d84c] .__writeback_single_inode+0x104/0x698 Oct 15 10:51:47 ps3 kernel: [c00000000d5937b0] [c00000000019e0b8] .writeback_sb_inodes+0x2d8/0x480 Oct 15 10:51:47 ps3 kernel: [c00000000d5938e0] [c00000000019e2d4] .__writeback_inodes_wb+0x74/0xb0 Oct 15 10:51:47 ps3 kernel: [c00000000d593990] [c00000000019e7b8] .wb_writeback+0x3f8/0x464 Oct 15 10:51:47 ps3 kernel: [c00000000d593ab0] [c00000000019f388] .wb_workfn+0x43c/0x5ac Oct 15 10:51:47 ps3 kernel: [c00000000d593be0] [c00000000006aae0] .process_one_work+0x30c/0x588 Oct 15 10:51:47 ps3 kernel: [c00000000d593cb0] [c00000000006b2b4] .worker_thread+0x294/0x33c Oct 15 10:51:47 ps3 kernel: [c00000000d593d70] [c0000000000713c4] .kthread+0x14c/0x154 Oct 15 10:51:47 ps3 kernel: [c00000000d593e30] [c00000000000a83c] .ret_from_kernel_thread+0x58/0x7c Oct 15 10:51:47 ps3 kernel: cat D 0 2481 1 0x00000012 Oct 15 10:51:47 ps3 kernel: Call Trace: Oct 15 10:51:47 ps3 kernel: [c00000000b6a3130] [c00000000b6a31d0] 0xc00000000b6a31d0 (unreliable) Oct 15 10:51:47 ps3 kernel: [c00000000b6a3300] [c0000000000152d0] .__switch_to+0x290/0x300 Oct 15 10:51:47 ps3 kernel: [c00000000b6a33b0] [c000000000571d3c] .__schedule+0x904/0x958 Oct 15 10:51:47 ps3 kernel: [c00000000b6a3490] [c000000000571e0c] .schedule+0x7c/0x90 Oct 15 10:51:47 ps3 kernel: [c00000000b6a3510] [c000000000250dac] .wait_transaction_locked+0xd8/0xf4 Oct 15 10:51:47 ps3 kernel: [c00000000b6a35d0] [c000000000250e3c] .add_transaction_credits+0x2c/0x370 Oct 15 10:51:47 ps3 kernel: [c00000000b6a36a0] [c0000000002519a0] .start_this_handle+0x2f0/0x3bc Oct 15 10:51:47 ps3 kernel: [c00000000b6a37d0] [c000000000251b5c] .jbd2__journal_start+0xf0/0x27c Oct 15 10:51:47 ps3 kernel: [c00000000b6a3890] [c0000000001fd828] .__ext4_journal_start_sb+0x1b4/0x1ec Oct 15 10:51:47 ps3 kernel: [c00000000b6a3950] [c000000000209b90] .ext4_file_open+0xc8/0x1c8 Oct 15 10:51:47 ps3 kernel: [c00000000b6a3a50] [c000000000167b18] .do_dentry_open+0x2a0/0x380 Oct 15 10:51:47 ps3 kernel: [c00000000b6a3af0] [c00000000017c7b0] .path_openat+0x4a4/0x904 Oct 15 10:51:47 ps3 kernel: [c00000000b6a3bf0] [c00000000017cc50] .do_filp_open+0x40/0x88 Oct 15 10:51:47 ps3 kernel: [c00000000b6a3d60] [c000000000169074] .do_sys_open+0x13c/0x228 Oct 15 10:51:47 ps3 kernel: [c00000000b6a3e30] [c00000000000a4a4] system_call+0x5c/0x70 Oct 15 10:51:47 ps3 kernel: Oct 15 10:51:47 ps3 kernel: Showing all locks held in the system: Oct 15 10:51:47 ps3 kernel: 1 lock held by khungtaskd/148: Oct 15 10:51:47 ps3 kernel: #0: 000000003bcb2a3a (rcu_read_lock){....}, at: .debug_show_all_locks+0x38/0x1ac Oct 15 10:51:47 ps3 kernel: 2 locks held by ps3fb/301: Oct 15 10:51:47 ps3 kernel: 1 lock held by in:imklog/1779: Oct 15 10:51:47 ps3 kernel: #0: 00000000713da15f (&f->f_pos_lock){+.+.}, at: .__fdget_pos+0x48/0x58 Oct 15 10:51:47 ps3 kernel: 2 locks held by getty/2404: Oct 15 10:51:47 ps3 kernel: #0: 00000000ced8d07b (&tty->ldisc_sem){++++}, at: .tty_ldisc_ref_wait+0x2c/0x54 Oct 15 10:51:47 ps3 kernel: #1: 00000000fd462e7d (&ldata->atomic_read_lock){+.+.}, at: .n_tty_read+0x1bc/0x724 Oct 15 10:51:47 ps3 kernel: 2 locks held by getty/2405: Oct 15 10:51:47 ps3 kernel: #0: 000000009e9dff48 (&tty->ldisc_sem){++++}, at: .tty_ldisc_ref_wait+0x2c/0x54 Oct 15 10:51:47 ps3 kernel: #1: 0000000098475abc (&ldata->atomic_read_lock){+.+.}, at: .n_tty_read+0x1bc/0x724 Oct 15 10:51:47 ps3 kernel: 2 locks held by getty/2406: Oct 15 10:51:47 ps3 kernel: #0: 00000000f060a6f0 (&tty->ldisc_sem){++++}, at: .tty_ldisc_ref_wait+0x2c/0x54 Oct 15 10:51:47 ps3 kernel: #1: 00000000efce01c3 (&ldata->atomic_read_lock){+.+.}, at: .n_tty_read+0x1bc/0x724 Oct 15 10:51:47 ps3 kernel: 2 locks held by getty/2407: Oct 15 10:51:47 ps3 kernel: #0: 00000000935f3792 (&tty->ldisc_sem){++++}, at: .tty_ldisc_ref_wait+0x2c/0x54 Oct 15 10:51:47 ps3 kernel: #1: 00000000efa3bee7 (&ldata->atomic_read_lock){+.+.}, at: .n_tty_read+0x1bc/0x724 Oct 15 10:51:47 ps3 kernel: 2 locks held by getty/2408: Oct 15 10:51:47 ps3 kernel: #0: 00000000111a56ee (&tty->ldisc_sem){++++}, at: .tty_ldisc_ref_wait+0x2c/0x54 Oct 15 10:51:47 ps3 kernel: #1: 00000000f219e2ab (&ldata->atomic_read_lock){+.+.}, at: .n_tty_read+0x1bc/0x724 Oct 15 10:51:47 ps3 kernel: 2 locks held by getty/2409: Oct 15 10:51:47 ps3 kernel: #0: 0000000045df3048 (&tty->ldisc_sem){++++}, at: .tty_ldisc_ref_wait+0x2c/0x54 Oct 15 10:51:47 ps3 kernel: #1: 00000000deede503 (&ldata->atomic_read_lock){+.+.}, at: .n_tty_read+0x1bc/0x724 Oct 15 10:51:47 ps3 kernel: 4 locks held by ext4lazyinit/2465: Oct 15 10:51:47 ps3 kernel: #0: 000000001603d342 (&type->s_umount_key#26){.+.+}, at: .ext4_lazyinit_thread+0x12c/0x2f8 Oct 15 10:51:47 ps3 kernel: #1: 00000000c857701f (sb_writers#10){.+.+}, at: .ext4_lazyinit_thread+0x14c/0x2f8 Oct 15 10:51:47 ps3 kernel: #2: 000000004c766729 (jbd2_handle){++++}, at: .start_this_handle+0x2f8/0x3bc Oct 15 10:51:47 ps3 kernel: #3: 000000001c56823b (&meta_group_info[i]->alloc_sem){+.+.}, at: .ext4_init_inode_table+0xcc/0x34c Oct 15 10:51:47 ps3 kernel: 3 locks held by kworker/u4:11/2478: Oct 15 10:51:47 ps3 kernel: #0: 0000000030f3b24b ((wq_completion)"writeback"){+.+.}, at: .process_one_work+0x1bc/0x588 Oct 15 10:51:47 ps3 kernel: #1: 00000000a1fc5fc0 ((work_completion)(&(&wb->dwork)->work)){+.+.}, at: .process_one_work+0x1bc/0x588 Oct 15 10:51:47 ps3 kernel: #2: 000000007f2fe323 (&type->s_umount_key#27){.+.+}, at: .trylock_super+0x24/0x70 Oct 15 10:51:47 ps3 kernel: 1 lock held by cat/2481: Oct 15 10:51:47 ps3 kernel: #0: 00000000aa6085f9 (sb_internal){.+.+}, at: .ext4_file_open+0x54/0x1c8 Oct 15 10:51:47 ps3 kernel: 2 locks held by bash/2490: Oct 15 10:51:47 ps3 kernel: #0: 0000000077655c1f (&tty->ldisc_sem){++++}, at: .tty_ldisc_ref_wait+0x2c/0x54 Oct 15 10:51:47 ps3 kernel: #1: 000000006f4f8843 (&ldata->atomic_read_lock){+.+.}, at: .n_tty_read+0x1bc/0x724 Oct 15 10:51:47 ps3 kernel: 2 locks held by touch/2518: Oct 15 10:51:47 ps3 kernel: #0: 00000000c857701f (sb_writers#10){.+.+}, at: .mnt_want_write+0x28/0x58 Oct 15 10:51:47 ps3 kernel: #1: 00000000957b6825 (&type->i_mutex_dir_key#4){++++}, at: .path_openat+0x308/0x904 Oct 15 10:51:47 ps3 kernel: Oct 15 10:51:47 ps3 kernel: ============================================= From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq From: Jens Axboe To: Geoff Levand , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt , Geert Uytterhoeven References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> Message-ID: <898e01a5-0000-d5db-d1b6-f58cd4366ce3@kernel.dk> Date: Mon, 15 Oct 2018 10:47:39 -0600 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 List-ID: On 10/15/18 10:27 AM, Jens Axboe wrote: > On 10/15/18 10:22 AM, Geoff Levand wrote: >> Hi Jens, >> >> On 10/12/2018 05:58 PM, Jens Axboe wrote: >>> On 10/12/18 4:47 PM, Geoff Levand wrote: >>>> On 10/11/2018 09:58 AM, Jens Axboe wrote: >>>>> Convert from the old request_fn style driver to blk-mq. >>>> >>>> I tested this on PS3 applied to v4.19-rc7, and on boot it either >>>> gets a deadlock message or becomes unstable with various other >>>> block related error messages. >>>> >>>> For what its worth, I put an image of the deadlock message here: >>>> >>>> https://storage.googleapis.com/public-tmp-files/blk-deadlock.jpg >>> >>> Thanks for testing! Can you try this incremental? It's mostly just >>> a cleanup on top, but the last hunk should be the thing that >>> hopefully makes this tick again. If you prefer just using a new >>> patch, this one is updated: >>> >>> http://git.kernel.dk/cgit/linux-block/commit/?h=mq-conversions&id=5c86f76f45e7c8d5a47a1f20b3e7b93fc945168a >> >> I tested your V2 applied to v4.19-rc8 and it works a little >> better, in that the system will now boot up, but the ps3disk >> still gets hung up. >> >> I added a '#define DEBUG' to ps3disk.c and saved the dmesg >> output with and without the patch here: >> >> https://storage.googleapis.com/public-tmp-files/dmesg-ok.txt >> https://storage.googleapis.com/public-tmp-files/dmesg-ng.txt >> >> Looking at dmesg-ng.txt, it seems things are going OK, but then >> go wrong with a 'tag mismatch': >> >> [ 6.068298] ps3disk sb_03: ps3disk_do_request:193 >> [ 6.068318] ps3disk sb_03: ps3disk_submit_request_sg:140: read req has 2 bvecs for 16 sectors >> [ 6.068339] ps3disk sb_03: ps3disk_submit_request_sg:146: read 16 sectors starting at 256 >> [ 6.074231] ps3disk sb_03: ps3disk_interrupt:239: tag mismatch, got 0, expected 1 >> [ 6.084125] ps3disk sb_03: ps3disk_interrupt:271: read completed >> [ 6.084147] ps3disk sb_03: ps3disk_scatter_gather:107: bio 0: 16 sectors from 256 >> [ 6.084174] ps3disk sb_03: ps3disk_scatter_gather:107: bio 1: 16 sectors from 256 >> [ 6.084405] ps3disk sb_03: ps3disk_interrupt:252 non-block layer request completed >> ... >> [ 242.657694] INFO: task blkid:563 blocked for more than 120 seconds. >> >> Geert is the original author of the PS3 disk support. Geert, >> can you see anything wrong in the patch? > > Can you try and change the queue depth to 1 instead of 2? It's set in > the tag_set, as ->queue_depth. I took a closer look at it, and I think that's it. The driver doesn't support any queueing, so we must limit the depth to 1. Either artificially like it did before, or just by setting the depth to 1. The latter is cleaner imho. If you make the above mentioned edit, changing the 2 to a 1, it should work. -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq To: Geoff Levand , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt , Geert Uytterhoeven References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> From: Jens Axboe Message-ID: Date: Mon, 15 Oct 2018 10:27:12 -0600 MIME-Version: 1.0 In-Reply-To: <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> Content-Type: text/plain; charset=utf-8 List-ID: On 10/15/18 10:22 AM, Geoff Levand wrote: > Hi Jens, > > On 10/12/2018 05:58 PM, Jens Axboe wrote: >> On 10/12/18 4:47 PM, Geoff Levand wrote: >>> On 10/11/2018 09:58 AM, Jens Axboe wrote: >>>> Convert from the old request_fn style driver to blk-mq. >>> >>> I tested this on PS3 applied to v4.19-rc7, and on boot it either >>> gets a deadlock message or becomes unstable with various other >>> block related error messages. >>> >>> For what its worth, I put an image of the deadlock message here: >>> >>> https://storage.googleapis.com/public-tmp-files/blk-deadlock.jpg >> >> Thanks for testing! Can you try this incremental? It's mostly just >> a cleanup on top, but the last hunk should be the thing that >> hopefully makes this tick again. If you prefer just using a new >> patch, this one is updated: >> >> http://git.kernel.dk/cgit/linux-block/commit/?h=mq-conversions&id=5c86f76f45e7c8d5a47a1f20b3e7b93fc945168a > > I tested your V2 applied to v4.19-rc8 and it works a little > better, in that the system will now boot up, but the ps3disk > still gets hung up. > > I added a '#define DEBUG' to ps3disk.c and saved the dmesg > output with and without the patch here: > > https://storage.googleapis.com/public-tmp-files/dmesg-ok.txt > https://storage.googleapis.com/public-tmp-files/dmesg-ng.txt > > Looking at dmesg-ng.txt, it seems things are going OK, but then > go wrong with a 'tag mismatch': > > [ 6.068298] ps3disk sb_03: ps3disk_do_request:193 > [ 6.068318] ps3disk sb_03: ps3disk_submit_request_sg:140: read req has 2 bvecs for 16 sectors > [ 6.068339] ps3disk sb_03: ps3disk_submit_request_sg:146: read 16 sectors starting at 256 > [ 6.074231] ps3disk sb_03: ps3disk_interrupt:239: tag mismatch, got 0, expected 1 > [ 6.084125] ps3disk sb_03: ps3disk_interrupt:271: read completed > [ 6.084147] ps3disk sb_03: ps3disk_scatter_gather:107: bio 0: 16 sectors from 256 > [ 6.084174] ps3disk sb_03: ps3disk_scatter_gather:107: bio 1: 16 sectors from 256 > [ 6.084405] ps3disk sb_03: ps3disk_interrupt:252 non-block layer request completed > ... > [ 242.657694] INFO: task blkid:563 blocked for more than 120 seconds. > > Geert is the original author of the PS3 disk support. Geert, > can you see anything wrong in the patch? Can you try and change the queue depth to 1 instead of 2? It's set in the tag_set, as ->queue_depth. -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from bombadil.infradead.org ([198.137.202.133]:50614 "EHLO bombadil.infradead.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726528AbeJPAIc (ORCPT ); Mon, 15 Oct 2018 20:08:32 -0400 Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq To: Jens Axboe , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt , Geert Uytterhoeven References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> From: Geoff Levand Message-ID: <7f27a68f-9cbe-c4c2-5c35-70763a5b1484@infradead.org> Date: Mon, 15 Oct 2018 09:22:29 -0700 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Sender: linux-block-owner@vger.kernel.org List-Id: linux-block@vger.kernel.org Hi Jens, On 10/12/2018 05:58 PM, Jens Axboe wrote: > On 10/12/18 4:47 PM, Geoff Levand wrote: >> On 10/11/2018 09:58 AM, Jens Axboe wrote: >>> Convert from the old request_fn style driver to blk-mq. >> >> I tested this on PS3 applied to v4.19-rc7, and on boot it either >> gets a deadlock message or becomes unstable with various other >> block related error messages. >> >> For what its worth, I put an image of the deadlock message here: >> >> https://storage.googleapis.com/public-tmp-files/blk-deadlock.jpg > > Thanks for testing! Can you try this incremental? It's mostly just > a cleanup on top, but the last hunk should be the thing that > hopefully makes this tick again. If you prefer just using a new > patch, this one is updated: > > http://git.kernel.dk/cgit/linux-block/commit/?h=mq-conversions&id=5c86f76f45e7c8d5a47a1f20b3e7b93fc945168a I tested your V2 applied to v4.19-rc8 and it works a little better, in that the system will now boot up, but the ps3disk still gets hung up. I added a '#define DEBUG' to ps3disk.c and saved the dmesg output with and without the patch here: https://storage.googleapis.com/public-tmp-files/dmesg-ok.txt https://storage.googleapis.com/public-tmp-files/dmesg-ng.txt Looking at dmesg-ng.txt, it seems things are going OK, but then go wrong with a 'tag mismatch': [ 6.068298] ps3disk sb_03: ps3disk_do_request:193 [ 6.068318] ps3disk sb_03: ps3disk_submit_request_sg:140: read req has 2 bvecs for 16 sectors [ 6.068339] ps3disk sb_03: ps3disk_submit_request_sg:146: read 16 sectors starting at 256 [ 6.074231] ps3disk sb_03: ps3disk_interrupt:239: tag mismatch, got 0, expected 1 [ 6.084125] ps3disk sb_03: ps3disk_interrupt:271: read completed [ 6.084147] ps3disk sb_03: ps3disk_scatter_gather:107: bio 0: 16 sectors from 256 [ 6.084174] ps3disk sb_03: ps3disk_scatter_gather:107: bio 1: 16 sectors from 256 [ 6.084405] ps3disk sb_03: ps3disk_interrupt:252 non-block layer request completed ... [ 242.657694] INFO: task blkid:563 blocked for more than 120 seconds. Geert is the original author of the PS3 disk support. Geert, can you see anything wrong in the patch? -Geoff From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq To: Geoff Levand , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> <17539e5f-742b-796e-8e36-31327120f883@infradead.org> From: Jens Axboe Message-ID: Date: Fri, 12 Oct 2018 18:58:50 -0600 MIME-Version: 1.0 In-Reply-To: <17539e5f-742b-796e-8e36-31327120f883@infradead.org> Content-Type: text/plain; charset=utf-8 List-ID: On 10/12/18 4:47 PM, Geoff Levand wrote: > Hi Jens, > > On 10/11/2018 09:58 AM, Jens Axboe wrote: >> Convert from the old request_fn style driver to blk-mq. > > I tested this on PS3 applied to v4.19-rc7, and on boot it either > gets a deadlock message or becomes unstable with various other > block related error messages. > > For what its worth, I put an image of the deadlock message here: > > https://storage.googleapis.com/public-tmp-files/blk-deadlock.jpg Thanks for testing! Can you try this incremental? It's mostly just a cleanup on top, but the last hunk should be the thing that hopefully makes this tick again. If you prefer just using a new patch, this one is updated: http://git.kernel.dk/cgit/linux-block/commit/?h=mq-conversions&id=5c86f76f45e7c8d5a47a1f20b3e7b93fc945168a diff --git a/drivers/block/ps3disk.c b/drivers/block/ps3disk.c index 5f777b694f3c..338ea9dc3393 100644 --- a/drivers/block/ps3disk.c +++ b/drivers/block/ps3disk.c @@ -119,8 +119,8 @@ static void ps3disk_scatter_gather(struct ps3_storage_device *dev, } } -static void ps3disk_submit_request_sg(struct ps3_storage_device *dev, - struct request *req) +static blk_status_t ps3disk_submit_request_sg(struct ps3_storage_device *dev, + struct request *req) { struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); int write = rq_data_dir(req), res; @@ -159,15 +159,15 @@ static void ps3disk_submit_request_sg(struct ps3_storage_device *dev, if (res) { dev_err(&dev->sbd.core, "%s:%u: %s failed %d\n", __func__, __LINE__, op, res); - blk_mq_end_request(req, BLK_STS_IOERR); - return; + return BLK_STS_IOERR; } priv->req = req; + return BLK_STS_OK; } -static void ps3disk_submit_flush_request(struct ps3_storage_device *dev, - struct request *req) +static blk_status_t ps3disk_submit_flush_request(struct ps3_storage_device *dev, + struct request *req) { struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); u64 res; @@ -180,29 +180,27 @@ static void ps3disk_submit_flush_request(struct ps3_storage_device *dev, if (res) { dev_err(&dev->sbd.core, "%s:%u: sync cache failed 0x%llx\n", __func__, __LINE__, res); - blk_mq_end_request(req, BLK_STS_IOERR); - return; + return BLK_STS_IOERR; } priv->req = req; + return BLK_STS_OK; } -static void ps3disk_do_request(struct ps3_storage_device *dev, - struct request *req) +static blk_status_t ps3disk_do_request(struct ps3_storage_device *dev, + struct request *req) { dev_dbg(&dev->sbd.core, "%s:%u\n", __func__, __LINE__); switch (req_op(req)) { case REQ_OP_FLUSH: - ps3disk_submit_flush_request(dev, req); - break; + return ps3disk_submit_flush_request(dev, req); case REQ_OP_READ: case REQ_OP_WRITE: - ps3disk_submit_request_sg(dev, req); - break; + return ps3disk_submit_request_sg(dev, req); default: blk_dump_rq_flags(req, DEVICE_NAME " bad request"); - blk_mq_end_request(req, BLK_STS_IOERR); + return BLK_STS_IOERR; } } @@ -212,14 +210,15 @@ static blk_status_t ps3disk_queue_rq(struct blk_mq_hw_ctx *hctx, struct request_queue *q = hctx->queue; struct ps3_storage_device *dev = q->queuedata; struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); + blk_status_t ret; blk_mq_start_request(bd->rq); spin_lock_irq(&priv->lock); - ps3disk_do_request(dev, bd->rq); + ret = ps3disk_do_request(dev, bd->rq); spin_unlock_irq(&priv->lock); - return BLK_STS_OK; + return ret; } static irqreturn_t ps3disk_interrupt(int irq, void *data) @@ -281,7 +280,7 @@ static irqreturn_t ps3disk_interrupt(int irq, void *data) priv->req = NULL; spin_unlock(&priv->lock); - blk_mq_start_hw_queues(priv->queue); + blk_mq_run_hw_queues(priv->queue, true); return IRQ_HANDLED; } -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from bombadil.infradead.org ([198.137.202.133]:60876 "EHLO bombadil.infradead.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725894AbeJMGWQ (ORCPT ); Sat, 13 Oct 2018 02:22:16 -0400 Subject: Re: [PATCH 03/17] ps3disk: convert to blk-mq To: Jens Axboe , linux-block@vger.kernel.org Cc: Benjamin Herrenschmidt References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-4-axboe@kernel.dk> From: Geoff Levand Message-ID: <17539e5f-742b-796e-8e36-31327120f883@infradead.org> Date: Fri, 12 Oct 2018 15:47:37 -0700 MIME-Version: 1.0 In-Reply-To: <20181011165909.32615-4-axboe@kernel.dk> Content-Type: text/plain; charset=utf-8 Sender: linux-block-owner@vger.kernel.org List-Id: linux-block@vger.kernel.org Hi Jens, On 10/11/2018 09:58 AM, Jens Axboe wrote: > Convert from the old request_fn style driver to blk-mq. I tested this on PS3 applied to v4.19-rc7, and on boot it either gets a deadlock message or becomes unstable with various other block related error messages. For what its worth, I put an image of the deadlock message here: https://storage.googleapis.com/public-tmp-files/blk-deadlock.jpg -Geoff From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe , Geoff Levand , Benjamin Herrenschmidt Subject: [PATCH 03/17] ps3disk: convert to blk-mq Date: Thu, 11 Oct 2018 10:58:55 -0600 Message-Id: <20181011165909.32615-4-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Convert from the old request_fn style driver to blk-mq. Cc: Geoff Levand Cc: Benjamin Herrenschmidt Signed-off-by: Jens Axboe --- drivers/block/ps3disk.c | 95 +++++++++++++++++++++++------------------ 1 file changed, 54 insertions(+), 41 deletions(-) diff --git a/drivers/block/ps3disk.c b/drivers/block/ps3disk.c index afe1508d82c6..e8b41e95a679 100644 --- a/drivers/block/ps3disk.c +++ b/drivers/block/ps3disk.c @@ -19,7 +19,7 @@ */ #include -#include +#include #include #include @@ -42,6 +42,7 @@ struct ps3disk_private { spinlock_t lock; /* Request queue spinlock */ struct request_queue *queue; + struct blk_mq_tag_set tag_set; struct gendisk *gendisk; unsigned int blocking_factor; struct request *req; @@ -118,8 +119,8 @@ static void ps3disk_scatter_gather(struct ps3_storage_device *dev, } } -static int ps3disk_submit_request_sg(struct ps3_storage_device *dev, - struct request *req) +static void ps3disk_submit_request_sg(struct ps3_storage_device *dev, + struct request *req) { struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); int write = rq_data_dir(req), res; @@ -158,16 +159,15 @@ static int ps3disk_submit_request_sg(struct ps3_storage_device *dev, if (res) { dev_err(&dev->sbd.core, "%s:%u: %s failed %d\n", __func__, __LINE__, op, res); - __blk_end_request_all(req, BLK_STS_IOERR); - return 0; + blk_mq_end_request(req, BLK_STS_IOERR); + return; } priv->req = req; - return 1; } -static int ps3disk_submit_flush_request(struct ps3_storage_device *dev, - struct request *req) +static void ps3disk_submit_flush_request(struct ps3_storage_device *dev, + struct request *req) { struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); u64 res; @@ -180,50 +180,46 @@ static int ps3disk_submit_flush_request(struct ps3_storage_device *dev, if (res) { dev_err(&dev->sbd.core, "%s:%u: sync cache failed 0x%llx\n", __func__, __LINE__, res); - __blk_end_request_all(req, BLK_STS_IOERR); - return 0; + blk_mq_end_request(req, BLK_STS_IOERR); + return; } priv->req = req; - return 1; } static void ps3disk_do_request(struct ps3_storage_device *dev, - struct request_queue *q) + struct request *req) { - struct request *req; - dev_dbg(&dev->sbd.core, "%s:%u\n", __func__, __LINE__); - while ((req = blk_fetch_request(q))) { - switch (req_op(req)) { - case REQ_OP_FLUSH: - if (ps3disk_submit_flush_request(dev, req)) - return; - break; - case REQ_OP_READ: - case REQ_OP_WRITE: - if (ps3disk_submit_request_sg(dev, req)) - return; - break; - default: - blk_dump_rq_flags(req, DEVICE_NAME " bad request"); - __blk_end_request_all(req, BLK_STS_IOERR); - } + switch (req_op(req)) { + case REQ_OP_FLUSH: + ps3disk_submit_flush_request(dev, req); + break; + case REQ_OP_READ: + case REQ_OP_WRITE: + ps3disk_submit_request_sg(dev, req); + break; + default: + blk_dump_rq_flags(req, DEVICE_NAME " bad request"); + blk_mq_end_request(req, BLK_STS_IOERR); } } -static void ps3disk_request(struct request_queue *q) +static blk_status_t ps3disk_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { + struct request_queue *q = hctx->queue; struct ps3_storage_device *dev = q->queuedata; struct ps3disk_private *priv = ps3_system_bus_get_drvdata(&dev->sbd); - if (priv->req) { - dev_dbg(&dev->sbd.core, "%s:%u busy\n", __func__, __LINE__); - return; - } + blk_mq_start_request(bd->rq); + + spin_lock_irq(&priv->lock); + ps3disk_do_request(dev, bd->rq); + spin_unlock_irq(&priv->lock); - ps3disk_do_request(dev, q); + return BLK_STS_OK; } static irqreturn_t ps3disk_interrupt(int irq, void *data) @@ -279,12 +275,13 @@ static irqreturn_t ps3disk_interrupt(int irq, void *data) ps3disk_scatter_gather(dev, req, 0); } + blk_mq_end_request(req, error); + spin_lock(&priv->lock); - __blk_end_request_all(req, error); priv->req = NULL; - ps3disk_do_request(dev, priv->queue); spin_unlock(&priv->lock); + blk_mq_start_hw_queues(priv->queue); return IRQ_HANDLED; } @@ -404,6 +401,10 @@ static unsigned long ps3disk_mask; static DEFINE_MUTEX(ps3disk_mask_mutex); +static const struct blk_mq_ops ps3disk_mq_ops = { + .queue_rq = ps3disk_queue_rq, +}; + static int ps3disk_probe(struct ps3_system_bus_device *_dev) { struct ps3_storage_device *dev = to_ps3_storage_device(&_dev->core); @@ -411,6 +412,7 @@ static int ps3disk_probe(struct ps3_system_bus_device *_dev) int error; unsigned int devidx; struct request_queue *queue; + struct blk_mq_tag_set *set; struct gendisk *gendisk; if (dev->blk_size < 512) { @@ -454,11 +456,21 @@ static int ps3disk_probe(struct ps3_system_bus_device *_dev) ps3disk_identify(dev); - queue = blk_init_queue(ps3disk_request, &priv->lock); - if (!queue) { - dev_err(&dev->sbd.core, "%s:%u: blk_init_queue failed\n", + set = &priv->tag_set; + set->ops = &ps3disk_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = 2; + set->numa_node = NUMA_NO_NODE; + set->flags = BLK_MQ_F_SHOULD_MERGE; + error = blk_mq_alloc_tag_set(set); + if (error) + goto fail_teardown; + + queue = blk_mq_init_queue(set); + if (IS_ERR(queue)) { + dev_err(&dev->sbd.core, "%s:%u: blk_mq_init_queue failed\n", __func__, __LINE__); - error = -ENOMEM; + error = PTR_ERR(queue); goto fail_teardown; } @@ -504,6 +516,7 @@ static int ps3disk_probe(struct ps3_system_bus_device *_dev) return 0; fail_cleanup_queue: + blk_mq_free_tag_set(&priv->tag_set); blk_cleanup_queue(queue); fail_teardown: ps3stor_teardown(dev); -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 07/17] uml: convert ubd to blk-mq To: Ming Lei Cc: linux-block@vger.kernel.org, Jeff Dike References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-8-axboe@kernel.dk> <20181015102717.GB31722@ming.t460p> From: Jens Axboe Message-ID: Date: Mon, 15 Oct 2018 08:16:32 -0600 MIME-Version: 1.0 In-Reply-To: <20181015102717.GB31722@ming.t460p> Content-Type: text/plain; charset=utf-8 List-ID: On 10/15/18 4:27 AM, Ming Lei wrote: > On Thu, Oct 11, 2018 at 10:58:59AM -0600, Jens Axboe wrote: >> @@ -947,9 +970,12 @@ static int ubd_add(int n, char **error_out) >> >> err = 0; >> out: >> + blk_mq_free_tag_set(&ubd_dev->tag_set); >> +out1: >> return err; >> >> out_cleanup: >> + blk_mq_free_tag_set(&ubd_dev->tag_set); >> blk_cleanup_queue(ubd_dev->queue); > > blk_mq_free_tag_set() should have been put after blk_cleanup_queue(). Doesn't matter for this error path, but I do agree in general that should be the case. I'll fix those up. -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Date: Mon, 15 Oct 2018 18:27:18 +0800 From: Ming Lei To: Jens Axboe Cc: linux-block@vger.kernel.org, Jeff Dike Subject: Re: [PATCH 07/17] uml: convert ubd to blk-mq Message-ID: <20181015102717.GB31722@ming.t460p> References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-8-axboe@kernel.dk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii In-Reply-To: <20181011165909.32615-8-axboe@kernel.dk> List-ID: On Thu, Oct 11, 2018 at 10:58:59AM -0600, Jens Axboe wrote: > Just a straight forward conversion. The retry handling could > potentially be done by blk-mq as well, but that's for another > day. > > Cc: Jeff Dike > Signed-off-by: Jens Axboe > --- > arch/um/drivers/ubd_kern.c | 154 ++++++++++++++++++++++--------------- > 1 file changed, 94 insertions(+), 60 deletions(-) > > diff --git a/arch/um/drivers/ubd_kern.c b/arch/um/drivers/ubd_kern.c > index 83c470364dfb..a302962a441d 100644 > --- a/arch/um/drivers/ubd_kern.c > +++ b/arch/um/drivers/ubd_kern.c > @@ -22,7 +22,7 @@ > > #include > #include > -#include > +#include > #include > #include > #include > @@ -156,6 +156,7 @@ struct ubd { > struct cow cow; > struct platform_device pdev; > struct request_queue *queue; > + struct blk_mq_tag_set tag_set; > spinlock_t lock; > struct scatterlist sg[MAX_SG]; > struct request *request; > @@ -436,7 +437,9 @@ __uml_help(udb_setup, > " in the boot output.\n\n" > ); > > -static void do_ubd_request(struct request_queue * q); > +static void ubd_handle_request(struct ubd *dev); > +static blk_status_t ubd_queue_rq(struct blk_mq_hw_ctx *hctx, > + const struct blk_mq_queue_data *bd); > > /* Only changed by ubd_init, which is an initcall. */ > static int thread_fd = -1; > @@ -520,12 +523,12 @@ static void ubd_handler(void) > return; > } > for (count = 0; count < n/sizeof(struct io_thread_req *); count++) { > - blk_end_request( > - (*irq_req_buffer)[count]->req, > - BLK_STS_OK, > - (*irq_req_buffer)[count]->length > - ); > - kfree((*irq_req_buffer)[count]); > + struct io_thread_req *io_req = (*irq_req_buffer)[count]; > + > + if (!blk_update_request(io_req->req, BLK_STS_OK, io_req->length)) > + __blk_mq_end_request(io_req->req, BLK_STS_OK); > + > + kfree(io_req); > } > } > reactivate_fd(thread_fd, UBD_IRQ); > @@ -534,7 +537,7 @@ static void ubd_handler(void) > ubd = container_of(list, struct ubd, restart); > list_del_init(&ubd->restart); > spin_lock_irqsave(&ubd->lock, flags); > - do_ubd_request(ubd->queue); > + ubd_handle_request(ubd); > spin_unlock_irqrestore(&ubd->lock, flags); > } > } > @@ -856,6 +859,7 @@ static void ubd_device_release(struct device *dev) > { > struct ubd *ubd_dev = dev_get_drvdata(dev); > > + blk_mq_free_tag_set(&ubd_dev->tag_set); > blk_cleanup_queue(ubd_dev->queue); > *ubd_dev = ((struct ubd) DEFAULT_UBD); > } > @@ -897,20 +901,25 @@ static int ubd_disk_register(int major, u64 size, int unit, > return 0; > } > > +static const struct blk_mq_ops ubd_mq_ops = { > + .queue_rq = ubd_queue_rq, > +}; > + > #define ROUND_BLOCK(n) ((n + ((1 << 9) - 1)) & (-1 << 9)) > > static int ubd_add(int n, char **error_out) > { > struct ubd *ubd_dev = &ubd_devs[n]; > + struct blk_mq_tag_set *set; > int err = 0; > > if(ubd_dev->file == NULL) > - goto out; > + goto out1; > > err = ubd_file_size(ubd_dev, &ubd_dev->size); > if(err < 0){ > *error_out = "Couldn't determine size of device's file"; > - goto out; > + goto out1; > } > > ubd_dev->size = ROUND_BLOCK(ubd_dev->size); > @@ -918,12 +927,26 @@ static int ubd_add(int n, char **error_out) > INIT_LIST_HEAD(&ubd_dev->restart); > sg_init_table(ubd_dev->sg, MAX_SG); > > - err = -ENOMEM; > - ubd_dev->queue = blk_init_queue(do_ubd_request, &ubd_dev->lock); > - if (ubd_dev->queue == NULL) { > + set = &ubd_dev->tag_set; > + set->ops = &ubd_mq_ops; > + set->nr_hw_queues = 1; > + set->queue_depth = 2; > + set->numa_node = NUMA_NO_NODE; > + set->flags = BLK_MQ_F_SHOULD_MERGE; > + err = blk_mq_alloc_tag_set(set); > + if (err) { > + *error_out = "Failed to initialize device tag set"; > + goto out1; > + } > + > + ubd_dev->queue = blk_mq_init_queue(set); > + if (IS_ERR(ubd_dev->queue)) { > + err = PTR_ERR(ubd_dev->queue); > + ubd_dev->queue = NULL; > *error_out = "Failed to initialize device queue"; > goto out; > } > + > ubd_dev->queue->queuedata = ubd_dev; > blk_queue_write_cache(ubd_dev->queue, true, false); > > @@ -947,9 +970,12 @@ static int ubd_add(int n, char **error_out) > > err = 0; > out: > + blk_mq_free_tag_set(&ubd_dev->tag_set); > +out1: > return err; > > out_cleanup: > + blk_mq_free_tag_set(&ubd_dev->tag_set); > blk_cleanup_queue(ubd_dev->queue); blk_mq_free_tag_set() should have been put after blk_cleanup_queue(). -- Ming From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe , Jeff Dike Subject: [PATCH 07/17] uml: convert ubd to blk-mq Date: Thu, 11 Oct 2018 10:58:59 -0600 Message-Id: <20181011165909.32615-8-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Just a straight forward conversion. The retry handling could potentially be done by blk-mq as well, but that's for another day. Cc: Jeff Dike Signed-off-by: Jens Axboe --- arch/um/drivers/ubd_kern.c | 154 ++++++++++++++++++++++--------------- 1 file changed, 94 insertions(+), 60 deletions(-) diff --git a/arch/um/drivers/ubd_kern.c b/arch/um/drivers/ubd_kern.c index 83c470364dfb..a302962a441d 100644 --- a/arch/um/drivers/ubd_kern.c +++ b/arch/um/drivers/ubd_kern.c @@ -22,7 +22,7 @@ #include #include -#include +#include #include #include #include @@ -156,6 +156,7 @@ struct ubd { struct cow cow; struct platform_device pdev; struct request_queue *queue; + struct blk_mq_tag_set tag_set; spinlock_t lock; struct scatterlist sg[MAX_SG]; struct request *request; @@ -436,7 +437,9 @@ __uml_help(udb_setup, " in the boot output.\n\n" ); -static void do_ubd_request(struct request_queue * q); +static void ubd_handle_request(struct ubd *dev); +static blk_status_t ubd_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd); /* Only changed by ubd_init, which is an initcall. */ static int thread_fd = -1; @@ -520,12 +523,12 @@ static void ubd_handler(void) return; } for (count = 0; count < n/sizeof(struct io_thread_req *); count++) { - blk_end_request( - (*irq_req_buffer)[count]->req, - BLK_STS_OK, - (*irq_req_buffer)[count]->length - ); - kfree((*irq_req_buffer)[count]); + struct io_thread_req *io_req = (*irq_req_buffer)[count]; + + if (!blk_update_request(io_req->req, BLK_STS_OK, io_req->length)) + __blk_mq_end_request(io_req->req, BLK_STS_OK); + + kfree(io_req); } } reactivate_fd(thread_fd, UBD_IRQ); @@ -534,7 +537,7 @@ static void ubd_handler(void) ubd = container_of(list, struct ubd, restart); list_del_init(&ubd->restart); spin_lock_irqsave(&ubd->lock, flags); - do_ubd_request(ubd->queue); + ubd_handle_request(ubd); spin_unlock_irqrestore(&ubd->lock, flags); } } @@ -856,6 +859,7 @@ static void ubd_device_release(struct device *dev) { struct ubd *ubd_dev = dev_get_drvdata(dev); + blk_mq_free_tag_set(&ubd_dev->tag_set); blk_cleanup_queue(ubd_dev->queue); *ubd_dev = ((struct ubd) DEFAULT_UBD); } @@ -897,20 +901,25 @@ static int ubd_disk_register(int major, u64 size, int unit, return 0; } +static const struct blk_mq_ops ubd_mq_ops = { + .queue_rq = ubd_queue_rq, +}; + #define ROUND_BLOCK(n) ((n + ((1 << 9) - 1)) & (-1 << 9)) static int ubd_add(int n, char **error_out) { struct ubd *ubd_dev = &ubd_devs[n]; + struct blk_mq_tag_set *set; int err = 0; if(ubd_dev->file == NULL) - goto out; + goto out1; err = ubd_file_size(ubd_dev, &ubd_dev->size); if(err < 0){ *error_out = "Couldn't determine size of device's file"; - goto out; + goto out1; } ubd_dev->size = ROUND_BLOCK(ubd_dev->size); @@ -918,12 +927,26 @@ static int ubd_add(int n, char **error_out) INIT_LIST_HEAD(&ubd_dev->restart); sg_init_table(ubd_dev->sg, MAX_SG); - err = -ENOMEM; - ubd_dev->queue = blk_init_queue(do_ubd_request, &ubd_dev->lock); - if (ubd_dev->queue == NULL) { + set = &ubd_dev->tag_set; + set->ops = &ubd_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = 2; + set->numa_node = NUMA_NO_NODE; + set->flags = BLK_MQ_F_SHOULD_MERGE; + err = blk_mq_alloc_tag_set(set); + if (err) { + *error_out = "Failed to initialize device tag set"; + goto out1; + } + + ubd_dev->queue = blk_mq_init_queue(set); + if (IS_ERR(ubd_dev->queue)) { + err = PTR_ERR(ubd_dev->queue); + ubd_dev->queue = NULL; *error_out = "Failed to initialize device queue"; goto out; } + ubd_dev->queue->queuedata = ubd_dev; blk_queue_write_cache(ubd_dev->queue, true, false); @@ -947,9 +970,12 @@ static int ubd_add(int n, char **error_out) err = 0; out: + blk_mq_free_tag_set(&ubd_dev->tag_set); +out1: return err; out_cleanup: + blk_mq_free_tag_set(&ubd_dev->tag_set); blk_cleanup_queue(ubd_dev->queue); goto out; } @@ -1338,10 +1364,11 @@ static bool submit_request(struct io_thread_req *io_req, struct ubd *dev) int n = os_write_file(thread_fd, &io_req, sizeof(io_req)); if (n != sizeof(io_req)) { - if (n != -EAGAIN) + if (n != -EAGAIN) { printk("write to io thread failed, " "errno = %d\n", -n); - else if (list_empty(&dev->restart)) + blk_mq_end_request(io_req->req, BLK_STS_IOERR); + } else if (list_empty(&dev->restart)) list_add(&dev->restart, &restart); kfree(io_req); @@ -1351,62 +1378,69 @@ static bool submit_request(struct io_thread_req *io_req, struct ubd *dev) } /* Called with dev->lock held */ -static void do_ubd_request(struct request_queue *q) +static void ubd_handle_request(struct ubd *dev) { + struct request *req = dev->request; struct io_thread_req *io_req; - struct request *req; - - while(1){ - struct ubd *dev = q->queuedata; - if(dev->request == NULL){ - struct request *req = blk_fetch_request(q); - if(req == NULL) - return; - dev->request = req; - dev->rq_pos = blk_rq_pos(req); - dev->start_sg = 0; - dev->end_sg = blk_rq_map_sg(q, req, dev->sg); + if (req_op(req) == REQ_OP_FLUSH) { + io_req = kmalloc(sizeof(struct io_thread_req), GFP_ATOMIC); + if (io_req == NULL) { + if (list_empty(&dev->restart)) + list_add(&dev->restart, &restart); + return; } + prepare_flush_request(req, io_req); + if (submit_request(io_req, dev) == false) + return; + } - req = dev->request; + while (dev->start_sg < dev->end_sg){ + struct scatterlist *sg = &dev->sg[dev->start_sg]; - if (req_op(req) == REQ_OP_FLUSH) { - io_req = kmalloc(sizeof(struct io_thread_req), - GFP_ATOMIC); - if (io_req == NULL) { - if (list_empty(&dev->restart)) - list_add(&dev->restart, &restart); - return; - } - prepare_flush_request(req, io_req); - if (submit_request(io_req, dev) == false) - return; + io_req = kmalloc(sizeof(struct io_thread_req), GFP_ATOMIC); + if (io_req == NULL){ + if (list_empty(&dev->restart)) + list_add(&dev->restart, &restart); + return; } + prepare_request(req, io_req, + (unsigned long long)dev->rq_pos << 9, + sg->offset, sg->length, sg_page(sg)); - while(dev->start_sg < dev->end_sg){ - struct scatterlist *sg = &dev->sg[dev->start_sg]; + if (submit_request(io_req, dev) == false) + return; - io_req = kmalloc(sizeof(struct io_thread_req), - GFP_ATOMIC); - if(io_req == NULL){ - if(list_empty(&dev->restart)) - list_add(&dev->restart, &restart); - return; - } - prepare_request(req, io_req, - (unsigned long long)dev->rq_pos << 9, - sg->offset, sg->length, sg_page(sg)); + dev->rq_pos += sg->length >> 9; + dev->start_sg++; + } - if (submit_request(io_req, dev) == false) - return; + dev->end_sg = 0; + dev->request = NULL; +} - dev->rq_pos += sg->length >> 9; - dev->start_sg++; - } - dev->end_sg = 0; - dev->request = NULL; +static blk_status_t ubd_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) +{ + struct ubd *dev = hctx->queue->queuedata; + struct request *req; + + spin_lock_irq(&dev->lock); + if (dev->request != NULL) { + spin_unlock_irq(&dev->lock); + return BLK_STS_DEV_RESOURCE; } + + req = bd->rq; + blk_mq_start_request(req); + dev->request = req; + dev->rq_pos = blk_rq_pos(req); + dev->start_sg = 0; + dev->end_sg = blk_rq_map_sg(req->q, req, dev->sg); + + ubd_handle_request(dev); + spin_unlock_irq(&dev->lock); + return BLK_STS_OK; } static int ubd_getgeo(struct block_device *bdev, struct hd_geometry *geo) -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe Subject: [PATCH 05/17] paride: convert pd to blk-mq Date: Thu, 11 Oct 2018 10:58:57 -0600 Message-Id: <20181011165909.32615-6-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Signed-off-by: Jens Axboe --- drivers/block/paride/pd.c | 109 ++++++++++++++++++++++---------------- 1 file changed, 62 insertions(+), 47 deletions(-) diff --git a/drivers/block/paride/pd.c b/drivers/block/paride/pd.c index 7cf947586fe4..87636d6ce191 100644 --- a/drivers/block/paride/pd.c +++ b/drivers/block/paride/pd.c @@ -151,7 +151,7 @@ enum {D_PRT, D_PRO, D_UNI, D_MOD, D_GEO, D_SBY, D_DLY, D_SLV}; #include #include #include /* for the eject ioctl */ -#include +#include #include #include #include @@ -236,6 +236,7 @@ struct pd_unit { int alt_geom; char name[PD_NAMELEN]; /* pda, pdb, etc ... */ struct gendisk *gd; + struct blk_mq_tag_set tag_set; }; static struct pd_unit pd[PD_UNITS]; @@ -355,25 +356,6 @@ enum action {Fail = 0, Ok = 1, Hold, Wait}; static struct request *pd_req; /* current request */ static enum action (*phase)(void); -static void run_fsm(void); - -static void ps_tq_int(struct work_struct *work); - -static DECLARE_DELAYED_WORK(fsm_tq, ps_tq_int); - -static void schedule_fsm(void) -{ - if (!nice) - schedule_delayed_work(&fsm_tq, 0); - else - schedule_delayed_work(&fsm_tq, nice-1); -} - -static void ps_tq_int(struct work_struct *work) -{ - run_fsm(); -} - static enum action do_pd_io_start(void); static enum action pd_special(void); static enum action do_pd_read_start(void); @@ -387,7 +369,7 @@ static int pd_claimed; static struct pd_unit *pd_current; /* current request's drive */ static PIA *pi_current; /* current request's PIA */ -static int set_next_request(void) +static int run_next_queue(void) { struct gendisk *disk; struct request_queue *q; @@ -398,11 +380,8 @@ static int set_next_request(void) q = disk ? disk->queue : NULL; if (++pd_queue == PD_UNITS) pd_queue = 0; - if (q) { - pd_req = blk_fetch_request(q); - if (pd_req) - break; - } + if (q) + blk_mq_run_hw_queues(q, true); } while (pd_queue != old_pos); return pd_req != NULL; @@ -438,17 +417,20 @@ static void run_fsm(void) pd_claimed = 0; phase = NULL; spin_lock_irqsave(&pd_lock, saved_flags); - if (!__blk_end_request_cur(pd_req, - res == Ok ? 0 : BLK_STS_IOERR)) { - if (!set_next_request()) - stop = 1; + if (!blk_update_request(pd_req, + res == Ok ? 0 : BLK_STS_IOERR, + blk_rq_cur_bytes(pd_req))) { + __blk_mq_end_request(pd_req, + res == Ok ? 0 : BLK_STS_IOERR); + run_next_queue(); + stop = 1; } spin_unlock_irqrestore(&pd_lock, saved_flags); if (stop) return; /* fall through */ case Hold: - schedule_fsm(); + blk_mq_run_hw_queues(pd_req->q, true); return; case Wait: pi_disconnect(pi_current); @@ -505,11 +487,17 @@ static int pd_next_buf(void) if (pd_count) return 0; spin_lock_irqsave(&pd_lock, saved_flags); - __blk_end_request_cur(pd_req, 0); - pd_count = blk_rq_cur_sectors(pd_req); - pd_buf = bio_data(pd_req->bio); + if (!blk_update_request(pd_req, 0, blk_rq_cur_bytes(pd_req))) { + __blk_mq_end_request(pd_req, 0); + pd_req = NULL; + pd_count = 0; + pd_buf = NULL; + } else { + pd_count = blk_rq_cur_sectors(pd_req); + pd_buf = bio_data(pd_req->bio); + } spin_unlock_irqrestore(&pd_lock, saved_flags); - return 0; + return !pd_count; } static unsigned long pd_timeout; @@ -726,15 +714,22 @@ static enum action pd_identify(struct pd_unit *disk) /* end of io request engine */ -static void do_pd_request(struct request_queue * q) +static blk_status_t pd_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { - if (pd_req) - return; - pd_req = blk_fetch_request(q); - if (!pd_req) - return; + spin_lock_irq(&pd_lock); - schedule_fsm(); + /* this should not be possible */ + if (pd_req) { + spin_unlock_irq(&pd_lock); + return BLK_STS_DEV_RESOURCE; + } + + pd_req = bd->rq; + spin_unlock_irq(&pd_lock); + blk_mq_start_request(bd->rq); + run_fsm(); + return BLK_STS_OK; } static int pd_special_command(struct pd_unit *disk, @@ -847,23 +842,42 @@ static const struct block_device_operations pd_fops = { /* probing */ +static const struct blk_mq_ops pd_mq_ops = { + .queue_rq = pd_queue_rq, +}; + static void pd_probe_drive(struct pd_unit *disk) { - struct gendisk *p = alloc_disk(1 << PD_BITS); + struct blk_mq_tag_set *set; + struct gendisk *p; + + p = alloc_disk(1 << PD_BITS); if (!p) return; + strcpy(p->disk_name, disk->name); p->fops = &pd_fops; p->major = major; p->first_minor = (disk - pd) << PD_BITS; disk->gd = p; p->private_data = disk; - p->queue = blk_init_queue(do_pd_request, &pd_lock); - if (!p->queue) { - disk->gd = NULL; - put_disk(p); + + set = &disk->tag_set; + set->ops = &pd_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = 1; + set->numa_node = NUMA_NO_NODE; + set->flags = BLK_MQ_F_SHOULD_MERGE | BLK_MQ_F_BLOCKING; + if (blk_mq_alloc_tag_set(set)) + return; + + p->queue = blk_mq_init_queue(set); + if (IS_ERR(p->queue)) { + blk_mq_free_tag_set(set); + p->queue = NULL; return; } + blk_queue_max_hw_sectors(p->queue, cluster); blk_queue_bounce_limit(p->queue, BLK_BOUNCE_HIGH); @@ -971,6 +985,7 @@ static void __exit pd_exit(void) if (p) { disk->gd = NULL; del_gendisk(p); + blk_mq_free_tag_set(&disk->tag_set); blk_cleanup_queue(p->queue); put_disk(p); pi_release(disk->pi); -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 12/17] blk-mq-sched: export way for drivers to insert request To: Christoph Hellwig Cc: linux-block@vger.kernel.org References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-13-axboe@kernel.dk> <20181014184935.GA1944@infradead.org> From: Jens Axboe Message-ID: <8fcbef11-84a4-80a8-2fc0-e11b5db55721@kernel.dk> Date: Sun, 14 Oct 2018 12:56:17 -0600 MIME-Version: 1.0 In-Reply-To: <20181014184935.GA1944@infradead.org> Content-Type: text/plain; charset=utf-8 List-ID: On 10/14/18 12:49 PM, Christoph Hellwig wrote: > On Thu, Oct 11, 2018 at 10:59:04AM -0600, Jens Axboe wrote: >> We'll need this for the IDE conversion, which queues sense requests. > > Why can't the ide code use blk_execute_rq_nowait? Yeah it can, I made that change and dropped this patch. -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Date: Sun, 14 Oct 2018 11:49:35 -0700 From: Christoph Hellwig To: Jens Axboe Cc: linux-block@vger.kernel.org Subject: Re: [PATCH 12/17] blk-mq-sched: export way for drivers to insert request Message-ID: <20181014184935.GA1944@infradead.org> References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-13-axboe@kernel.dk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii In-Reply-To: <20181011165909.32615-13-axboe@kernel.dk> List-ID: On Thu, Oct 11, 2018 at 10:59:04AM -0600, Jens Axboe wrote: > We'll need this for the IDE conversion, which queues sense requests. Why can't the ide code use blk_execute_rq_nowait? From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe Subject: [PATCH 12/17] blk-mq-sched: export way for drivers to insert request Date: Thu, 11 Oct 2018 10:59:04 -0600 Message-Id: <20181011165909.32615-13-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: We'll need this for the IDE conversion, which queues sense requests. Signed-off-by: Jens Axboe --- block/blk-mq-sched.c | 1 + block/blk-mq-sched.h | 2 -- include/linux/blk-mq.h | 2 ++ 3 files changed, 3 insertions(+), 2 deletions(-) diff --git a/block/blk-mq-sched.c b/block/blk-mq-sched.c index 29bfe8017a2d..f307af1a42bc 100644 --- a/block/blk-mq-sched.c +++ b/block/blk-mq-sched.c @@ -395,6 +395,7 @@ void blk_mq_sched_insert_request(struct request *rq, bool at_head, if (run_queue) blk_mq_run_hw_queue(hctx, async); } +EXPORT_SYMBOL_GPL(blk_mq_sched_insert_request); void blk_mq_sched_insert_requests(struct request_queue *q, struct blk_mq_ctx *ctx, diff --git a/block/blk-mq-sched.h b/block/blk-mq-sched.h index 4e028ee42430..6b3e8255f3af 100644 --- a/block/blk-mq-sched.h +++ b/block/blk-mq-sched.h @@ -17,8 +17,6 @@ bool __blk_mq_sched_bio_merge(struct request_queue *q, struct bio *bio); bool blk_mq_sched_try_insert_merge(struct request_queue *q, struct request *rq); void blk_mq_sched_restart(struct blk_mq_hw_ctx *hctx); -void blk_mq_sched_insert_request(struct request *rq, bool at_head, - bool run_queue, bool async); void blk_mq_sched_insert_requests(struct request_queue *q, struct blk_mq_ctx *ctx, struct list_head *list, bool run_queue_async); diff --git a/include/linux/blk-mq.h b/include/linux/blk-mq.h index 1da59c16f637..1d4f8588701d 100644 --- a/include/linux/blk-mq.h +++ b/include/linux/blk-mq.h @@ -260,6 +260,8 @@ void blk_mq_add_to_requeue_list(struct request *rq, bool at_head, bool kick_requeue_list); void blk_mq_kick_requeue_list(struct request_queue *q); void blk_mq_delay_kick_requeue_list(struct request_queue *q, unsigned long msecs); +void blk_mq_sched_insert_request(struct request *rq, bool at_head, + bool run_queue, bool async); void blk_mq_complete_request(struct request *rq); bool blk_mq_bio_list_merge(struct request_queue *q, struct list_head *list, struct bio *bio); -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe Subject: [PATCH 10/17] gdrom: convert to blk-mq Date: Thu, 11 Oct 2018 10:59:02 -0600 Message-Id: <20181011165909.32615-11-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Ditch the deffered list, lock, and workqueue handling. Just mark the set as being blocking, so we are invoked from a workqueue already. Signed-off-by: Jens Axboe --- drivers/cdrom/gdrom.c | 182 ++++++++++++++++++++---------------------- 1 file changed, 87 insertions(+), 95 deletions(-) diff --git a/drivers/cdrom/gdrom.c b/drivers/cdrom/gdrom.c index ae3a7537cf0f..41b57d9c4424 100644 --- a/drivers/cdrom/gdrom.c +++ b/drivers/cdrom/gdrom.c @@ -31,12 +31,11 @@ #include #include #include -#include +#include #include #include #include #include -#include #include #include #include @@ -102,11 +101,6 @@ static int gdrom_major; static DECLARE_WAIT_QUEUE_HEAD(command_queue); static DECLARE_WAIT_QUEUE_HEAD(request_queue); -static DEFINE_SPINLOCK(gdrom_lock); -static void gdrom_readdisk_dma(struct work_struct *work); -static DECLARE_WORK(work, gdrom_readdisk_dma); -static LIST_HEAD(gdrom_deferred); - struct gdromtoc { unsigned int entry[99]; unsigned int first, last; @@ -122,6 +116,7 @@ static struct gdrom_unit { char disk_type; struct gdromtoc *toc; struct request_queue *gdrom_rq; + struct blk_mq_tag_set tag_set; } gd; struct gdrom_id { @@ -584,103 +579,83 @@ static int gdrom_set_interrupt_handlers(void) * 9 -> sectors >> 8 * 10 -> sectors */ -static void gdrom_readdisk_dma(struct work_struct *work) +static blk_status_t gdrom_readdisk_dma(struct request *req) { int block, block_cnt; blk_status_t err; struct packet_command *read_command; - struct list_head *elem, *next; - struct request *req; unsigned long timeout; - if (list_empty(&gdrom_deferred)) - return; read_command = kzalloc(sizeof(struct packet_command), GFP_KERNEL); if (!read_command) - return; /* get more memory later? */ + return BLK_STS_RESOURCE; + read_command->cmd[0] = 0x30; read_command->cmd[1] = 0x20; - spin_lock(&gdrom_lock); - list_for_each_safe(elem, next, &gdrom_deferred) { - req = list_entry(elem, struct request, queuelist); - spin_unlock(&gdrom_lock); - block = blk_rq_pos(req)/GD_TO_BLK + GD_SESSION_OFFSET; - block_cnt = blk_rq_sectors(req)/GD_TO_BLK; - __raw_writel(virt_to_phys(bio_data(req->bio)), GDROM_DMA_STARTADDR_REG); - __raw_writel(block_cnt * GDROM_HARD_SECTOR, GDROM_DMA_LENGTH_REG); - __raw_writel(1, GDROM_DMA_DIRECTION_REG); - __raw_writel(1, GDROM_DMA_ENABLE_REG); - read_command->cmd[2] = (block >> 16) & 0xFF; - read_command->cmd[3] = (block >> 8) & 0xFF; - read_command->cmd[4] = block & 0xFF; - read_command->cmd[8] = (block_cnt >> 16) & 0xFF; - read_command->cmd[9] = (block_cnt >> 8) & 0xFF; - read_command->cmd[10] = block_cnt & 0xFF; - /* set for DMA */ - __raw_writeb(1, GDROM_ERROR_REG); - /* other registers */ - __raw_writeb(0, GDROM_SECNUM_REG); - __raw_writeb(0, GDROM_BCL_REG); - __raw_writeb(0, GDROM_BCH_REG); - __raw_writeb(0, GDROM_DSEL_REG); - __raw_writeb(0, GDROM_INTSEC_REG); - /* Wait for registers to reset after any previous activity */ - timeout = jiffies + HZ / 2; - while (gdrom_is_busy() && time_before(jiffies, timeout)) - cpu_relax(); - __raw_writeb(GDROM_COM_PACKET, GDROM_STATUSCOMMAND_REG); - timeout = jiffies + HZ / 2; - /* Wait for packet command to finish */ - while (gdrom_is_busy() && time_before(jiffies, timeout)) - cpu_relax(); - gd.pending = 1; - gd.transfer = 1; - outsw(GDROM_DATA_REG, &read_command->cmd, 6); - timeout = jiffies + HZ / 2; - /* Wait for any pending DMA to finish */ - while (__raw_readb(GDROM_DMA_STATUS_REG) && - time_before(jiffies, timeout)) - cpu_relax(); - /* start transfer */ - __raw_writeb(1, GDROM_DMA_STATUS_REG); - wait_event_interruptible_timeout(request_queue, - gd.transfer == 0, GDROM_DEFAULT_TIMEOUT); - err = gd.transfer ? BLK_STS_IOERR : BLK_STS_OK; - gd.transfer = 0; - gd.pending = 0; - /* now seek to take the request spinlock - * before handling ending the request */ - spin_lock(&gdrom_lock); - list_del_init(&req->queuelist); - __blk_end_request_all(req, err); - } - spin_unlock(&gdrom_lock); + block = blk_rq_pos(req)/GD_TO_BLK + GD_SESSION_OFFSET; + block_cnt = blk_rq_sectors(req)/GD_TO_BLK; + __raw_writel(virt_to_phys(bio_data(req->bio)), GDROM_DMA_STARTADDR_REG); + __raw_writel(block_cnt * GDROM_HARD_SECTOR, GDROM_DMA_LENGTH_REG); + __raw_writel(1, GDROM_DMA_DIRECTION_REG); + __raw_writel(1, GDROM_DMA_ENABLE_REG); + read_command->cmd[2] = (block >> 16) & 0xFF; + read_command->cmd[3] = (block >> 8) & 0xFF; + read_command->cmd[4] = block & 0xFF; + read_command->cmd[8] = (block_cnt >> 16) & 0xFF; + read_command->cmd[9] = (block_cnt >> 8) & 0xFF; + read_command->cmd[10] = block_cnt & 0xFF; + /* set for DMA */ + __raw_writeb(1, GDROM_ERROR_REG); + /* other registers */ + __raw_writeb(0, GDROM_SECNUM_REG); + __raw_writeb(0, GDROM_BCL_REG); + __raw_writeb(0, GDROM_BCH_REG); + __raw_writeb(0, GDROM_DSEL_REG); + __raw_writeb(0, GDROM_INTSEC_REG); + /* Wait for registers to reset after any previous activity */ + timeout = jiffies + HZ / 2; + while (gdrom_is_busy() && time_before(jiffies, timeout)) + cpu_relax(); + __raw_writeb(GDROM_COM_PACKET, GDROM_STATUSCOMMAND_REG); + timeout = jiffies + HZ / 2; + /* Wait for packet command to finish */ + while (gdrom_is_busy() && time_before(jiffies, timeout)) + cpu_relax(); + gd.pending = 1; + gd.transfer = 1; + outsw(GDROM_DATA_REG, &read_command->cmd, 6); + timeout = jiffies + HZ / 2; + /* Wait for any pending DMA to finish */ + while (__raw_readb(GDROM_DMA_STATUS_REG) && + time_before(jiffies, timeout)) + cpu_relax(); + /* start transfer */ + __raw_writeb(1, GDROM_DMA_STATUS_REG); + wait_event_interruptible_timeout(request_queue, + gd.transfer == 0, GDROM_DEFAULT_TIMEOUT); + err = gd.transfer ? BLK_STS_IOERR : BLK_STS_OK; + gd.transfer = 0; + gd.pending = 0; + + blk_mq_end_request(req, err); kfree(read_command); + return BLK_STS_OK; } -static void gdrom_request(struct request_queue *rq) -{ - struct request *req; - - while ((req = blk_fetch_request(rq)) != NULL) { - switch (req_op(req)) { - case REQ_OP_READ: - /* - * Add to list of deferred work and then schedule - * workqueue. - */ - list_add_tail(&req->queuelist, &gdrom_deferred); - schedule_work(&work); - break; - case REQ_OP_WRITE: - pr_notice("Read only device - write request ignored\n"); - __blk_end_request_all(req, BLK_STS_IOERR); - break; - default: - printk(KERN_DEBUG "gdrom: Non-fs request ignored\n"); - __blk_end_request_all(req, BLK_STS_IOERR); - break; - } +static blk_status_t gdrom_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) +{ + blk_mq_start_request(bd->rq); + + switch (req_op(bd->rq)) { + case REQ_OP_READ: + return gdrom_readdisk_dma(bd->rq); + case REQ_OP_WRITE: + pr_notice("Read only device - write request ignored\n"); + return BLK_STS_IOERR; + default: + printk(KERN_DEBUG "gdrom: Non-fs request ignored\n"); + return BLK_STS_IOERR; } } @@ -768,6 +743,10 @@ static int probe_gdrom_setupqueue(void) return gdrom_init_dma_mode(); } +static const struct blk_mq_ops gdrom_mq_ops = { + .queue_rq = gdrom_queue_rq, +}; + /* * register this as a block device and as compliant with the * universal CD Rom driver interface @@ -811,11 +790,23 @@ static int probe_gdrom(struct platform_device *devptr) err = gdrom_set_interrupt_handlers(); if (err) goto probe_fail_cmdirq_register; - gd.gdrom_rq = blk_init_queue(gdrom_request, &gdrom_lock); - if (!gd.gdrom_rq) { - err = -ENOMEM; + + gd.tag_set.ops = &gdrom_mq_ops; + gd.tag_set.nr_hw_queues = 1; + gd.tag_set.queue_depth = 1; + gd.tag_set.numa_node = NUMA_NO_NODE; + gd.tag_set.flags = BLK_MQ_F_SHOULD_MERGE | BLK_MQ_F_BLOCKING; + err = blk_mq_alloc_tag_set(&td.tag_set); + if (err) + goto probe_fail_requestq; + + gd.gdrom_rq = blk_mq_init_queue(set); + if (IS_ERR(gd.gdrom_rq)) { + rc = PTR_ERR(gd.gdrom_rq); + gd.gdrom_rq = NULL; goto probe_fail_requestq; } + blk_queue_bounce_limit(gd.gdrom_rq, BLK_BOUNCE_HIGH); err = probe_gdrom_setupqueue(); @@ -831,6 +822,7 @@ static int probe_gdrom(struct platform_device *devptr) return 0; probe_fail_toc: + blk_mq_free_tag_set(&gd.tag_set); blk_cleanup_queue(gd.gdrom_rq); probe_fail_requestq: free_irq(HW_EVENT_GDROM_DMA, &gd); @@ -849,7 +841,7 @@ static int probe_gdrom(struct platform_device *devptr) static int remove_gdrom(struct platform_device *devptr) { - flush_work(&work); + blk_mq_free_tag_set(&gd.tag_set); blk_cleanup_queue(gd.gdrom_rq); free_irq(HW_EVENT_GDROM_CMD, &gd); free_irq(HW_EVENT_GDROM_DMA, &gd); -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 01/17] sunvdc: convert to blk-mq From: Jens Axboe To: Ming Lei Cc: linux-block@vger.kernel.org, David Miller References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-2-axboe@kernel.dk> <20181015103728.GC31722@ming.t460p> Message-ID: <2e9b9df4-944f-aa59-2c68-9cb7b1250cd7@kernel.dk> Date: Mon, 15 Oct 2018 08:50:51 -0600 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 List-ID: On 10/15/18 8:19 AM, Jens Axboe wrote: > On 10/15/18 4:38 AM, Ming Lei wrote: >>> @@ -320,7 +320,7 @@ static void vdc_end_one(struct vdc_port *port, struct vio_dring_state *dr, >>> >>> rqe->req = NULL; >>> >>> - __blk_end_request(req, (desc->status ? BLK_STS_IOERR : 0), desc->size); >>> + blk_mq_end_request(req, desc->status ? BLK_STS_IOERR : 0); >> >> blk_mq_end_request() may trigger BUG in case of partial completion, >> however looks it is fine for __blk_end_request(). > > True, I'll change this to the blk_update_request() + > __blk_mq_end_request() combo instead. I take that back, it's correct as is. This isn't a partial completion, it's completing the request. The BUG() inside blk_mq_end_request() would indicate a bug in the internal code, we don't expect a not-done return when we ask to complete the whole thing. -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 01/17] sunvdc: convert to blk-mq To: Ming Lei Cc: linux-block@vger.kernel.org, David Miller References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-2-axboe@kernel.dk> <20181015103728.GC31722@ming.t460p> From: Jens Axboe Message-ID: Date: Mon, 15 Oct 2018 08:19:02 -0600 MIME-Version: 1.0 In-Reply-To: <20181015103728.GC31722@ming.t460p> Content-Type: text/plain; charset=utf-8 List-ID: On 10/15/18 4:38 AM, Ming Lei wrote: >> @@ -320,7 +320,7 @@ static void vdc_end_one(struct vdc_port *port, struct vio_dring_state *dr, >> >> rqe->req = NULL; >> >> - __blk_end_request(req, (desc->status ? BLK_STS_IOERR : 0), desc->size); >> + blk_mq_end_request(req, desc->status ? BLK_STS_IOERR : 0); > > blk_mq_end_request() may trigger BUG in case of partial completion, > however looks it is fine for __blk_end_request(). True, I'll change this to the blk_update_request() + __blk_mq_end_request() combo instead. > Most of conversions have the above pattern, maybe it is easier to > introduce the following block API: > > struct reuqest_queue *blk_mq_alloc_and_init_sq(set, ops, queue_depth) Yeah I did consider that, I'll make that addition. -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Date: Mon, 15 Oct 2018 18:38:12 +0800 From: Ming Lei To: Jens Axboe Cc: linux-block@vger.kernel.org, David Miller Subject: Re: [PATCH 01/17] sunvdc: convert to blk-mq Message-ID: <20181015103728.GC31722@ming.t460p> References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-2-axboe@kernel.dk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii In-Reply-To: <20181011165909.32615-2-axboe@kernel.dk> List-ID: On Thu, Oct 11, 2018 at 10:58:53AM -0600, Jens Axboe wrote: > Convert from the old request_fn style driver to blk-mq. > > Cc: David Miller > Signed-off-by: Jens Axboe > --- > drivers/block/sunvdc.c | 161 ++++++++++++++++++++++++++++------------- > 1 file changed, 110 insertions(+), 51 deletions(-) > > diff --git a/drivers/block/sunvdc.c b/drivers/block/sunvdc.c > index f68e9baffad7..bf51a2307ce1 100644 > --- a/drivers/block/sunvdc.c > +++ b/drivers/block/sunvdc.c > @@ -6,7 +6,7 @@ > #include > #include > #include > -#include > +#include > #include > #include > #include > @@ -66,9 +66,10 @@ struct vdc_port { > > u64 max_xfer_size; > u32 vdisk_block_size; > + u32 drain; > > u64 ldc_timeout; > - struct timer_list ldc_reset_timer; > + struct delayed_work ldc_reset_timer_work; > struct work_struct ldc_reset_work; > > /* The server fills these in for us in the disk attribute > @@ -80,12 +81,14 @@ struct vdc_port { > u8 vdisk_mtype; > u32 vdisk_phys_blksz; > > + struct blk_mq_tag_set tag_set; > + > char disk_name[32]; > }; > > static void vdc_ldc_reset(struct vdc_port *port); > static void vdc_ldc_reset_work(struct work_struct *work); > -static void vdc_ldc_reset_timer(struct timer_list *t); > +static void vdc_ldc_reset_timer_work(struct work_struct *work); > > static inline struct vdc_port *to_vdc_port(struct vio_driver_state *vio) > { > @@ -175,11 +178,8 @@ static void vdc_blk_queue_start(struct vdc_port *port) > * handshake completes, so check for initial handshake before we've > * allocated a disk. > */ > - if (port->disk && blk_queue_stopped(port->disk->queue) && > - vdc_tx_dring_avail(dr) * 100 / VDC_TX_RING_SIZE >= 50) { > - blk_start_queue(port->disk->queue); > - } > - > + if (port->disk && vdc_tx_dring_avail(dr) * 100 / VDC_TX_RING_SIZE >= 50) > + blk_mq_start_hw_queues(port->disk->queue); > } > > static void vdc_finish(struct vio_driver_state *vio, int err, int waiting_for) > @@ -197,7 +197,7 @@ static void vdc_handshake_complete(struct vio_driver_state *vio) > { > struct vdc_port *port = to_vdc_port(vio); > > - del_timer(&port->ldc_reset_timer); > + cancel_delayed_work(&port->ldc_reset_timer_work); > vdc_finish(vio, 0, WAITING_FOR_LINK_UP); > vdc_blk_queue_start(port); > } > @@ -320,7 +320,7 @@ static void vdc_end_one(struct vdc_port *port, struct vio_dring_state *dr, > > rqe->req = NULL; > > - __blk_end_request(req, (desc->status ? BLK_STS_IOERR : 0), desc->size); > + blk_mq_end_request(req, desc->status ? BLK_STS_IOERR : 0); blk_mq_end_request() may trigger BUG in case of partial completion, however looks it is fine for __blk_end_request(). > > vdc_blk_queue_start(port); > } > @@ -525,29 +525,40 @@ static int __send_request(struct request *req) > return err; > } > > -static void do_vdc_request(struct request_queue *rq) > +static blk_status_t vdc_queue_rq(struct blk_mq_hw_ctx *hctx, > + const struct blk_mq_queue_data *bd) > { > - struct request *req; > + struct vdc_port *port = hctx->queue->queuedata; > + struct vio_dring_state *dr; > + unsigned long flags; > > - while ((req = blk_peek_request(rq)) != NULL) { > - struct vdc_port *port; > - struct vio_dring_state *dr; > + dr = &port->vio.drings[VIO_DRIVER_TX_RING]; > > - port = req->rq_disk->private_data; > - dr = &port->vio.drings[VIO_DRIVER_TX_RING]; > - if (unlikely(vdc_tx_dring_avail(dr) < 1)) > - goto wait; > + blk_mq_start_request(bd->rq); > > - blk_start_request(req); > + spin_lock_irqsave(&port->vio.lock, flags); > > - if (__send_request(req) < 0) { > - blk_requeue_request(rq, req); > -wait: > - /* Avoid pointless unplugs. */ > - blk_stop_queue(rq); > - break; > - } > + /* > + * Doing drain, just end the request in error > + */ > + if (unlikely(port->drain)) { > + spin_unlock_irqrestore(&port->vio.lock, flags); > + return BLK_STS_IOERR; > } > + > + if (unlikely(vdc_tx_dring_avail(dr) < 1)) { > + spin_unlock_irqrestore(&port->vio.lock, flags); > + blk_mq_stop_hw_queue(hctx); > + return BLK_STS_DEV_RESOURCE; > + } > + > + if (__send_request(bd->rq) < 0) { > + spin_unlock_irqrestore(&port->vio.lock, flags); > + return BLK_STS_IOERR; > + } > + > + spin_unlock_irqrestore(&port->vio.lock, flags); > + return BLK_STS_OK; > } > > static int generic_request(struct vdc_port *port, u8 op, void *buf, int len) > @@ -759,6 +770,44 @@ static void vdc_port_down(struct vdc_port *port) > vio_ldc_free(&port->vio); > } > > +static const struct blk_mq_ops vdc_mq_ops = { > + .queue_rq = vdc_queue_rq, > +}; > + > +static void cleanup_queue(struct request_queue *q) > +{ > + struct vdc_port *port = q->queuedata; > + > + blk_mq_free_tag_set(&port->tag_set); > + blk_cleanup_queue(q); blk_mq_free_tag_set() need to be put after blk_cleanup_queue(). > +} > + > +static struct request_queue *init_queue(struct vdc_port *port) > +{ > + struct blk_mq_tag_set *set = &port->tag_set; > + struct request_queue *q; > + int ret; > + > + set->ops = &vdc_mq_ops; > + set->nr_hw_queues = 1; > + set->queue_depth = VDC_TX_RING_SIZE; > + set->numa_node = NUMA_NO_NODE; > + set->flags = BLK_MQ_F_SHOULD_MERGE; > + > + ret = blk_mq_alloc_tag_set(set); > + if (ret) > + return ERR_PTR(ret); > + > + q = blk_mq_init_queue(set); > + if (IS_ERR(q)) { > + blk_mq_free_tag_set(set); > + return q; > + } Most of conversions have the above pattern, maybe it is easier to introduce the following block API: struct reuqest_queue *blk_mq_alloc_and_init_sq(set, ops, queue_depth) -- Ming From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe , David Miller Subject: [PATCH 01/17] sunvdc: convert to blk-mq Date: Thu, 11 Oct 2018 10:58:53 -0600 Message-Id: <20181011165909.32615-2-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Convert from the old request_fn style driver to blk-mq. Cc: David Miller Signed-off-by: Jens Axboe --- drivers/block/sunvdc.c | 161 ++++++++++++++++++++++++++++------------- 1 file changed, 110 insertions(+), 51 deletions(-) diff --git a/drivers/block/sunvdc.c b/drivers/block/sunvdc.c index f68e9baffad7..bf51a2307ce1 100644 --- a/drivers/block/sunvdc.c +++ b/drivers/block/sunvdc.c @@ -6,7 +6,7 @@ #include #include #include -#include +#include #include #include #include @@ -66,9 +66,10 @@ struct vdc_port { u64 max_xfer_size; u32 vdisk_block_size; + u32 drain; u64 ldc_timeout; - struct timer_list ldc_reset_timer; + struct delayed_work ldc_reset_timer_work; struct work_struct ldc_reset_work; /* The server fills these in for us in the disk attribute @@ -80,12 +81,14 @@ struct vdc_port { u8 vdisk_mtype; u32 vdisk_phys_blksz; + struct blk_mq_tag_set tag_set; + char disk_name[32]; }; static void vdc_ldc_reset(struct vdc_port *port); static void vdc_ldc_reset_work(struct work_struct *work); -static void vdc_ldc_reset_timer(struct timer_list *t); +static void vdc_ldc_reset_timer_work(struct work_struct *work); static inline struct vdc_port *to_vdc_port(struct vio_driver_state *vio) { @@ -175,11 +178,8 @@ static void vdc_blk_queue_start(struct vdc_port *port) * handshake completes, so check for initial handshake before we've * allocated a disk. */ - if (port->disk && blk_queue_stopped(port->disk->queue) && - vdc_tx_dring_avail(dr) * 100 / VDC_TX_RING_SIZE >= 50) { - blk_start_queue(port->disk->queue); - } - + if (port->disk && vdc_tx_dring_avail(dr) * 100 / VDC_TX_RING_SIZE >= 50) + blk_mq_start_hw_queues(port->disk->queue); } static void vdc_finish(struct vio_driver_state *vio, int err, int waiting_for) @@ -197,7 +197,7 @@ static void vdc_handshake_complete(struct vio_driver_state *vio) { struct vdc_port *port = to_vdc_port(vio); - del_timer(&port->ldc_reset_timer); + cancel_delayed_work(&port->ldc_reset_timer_work); vdc_finish(vio, 0, WAITING_FOR_LINK_UP); vdc_blk_queue_start(port); } @@ -320,7 +320,7 @@ static void vdc_end_one(struct vdc_port *port, struct vio_dring_state *dr, rqe->req = NULL; - __blk_end_request(req, (desc->status ? BLK_STS_IOERR : 0), desc->size); + blk_mq_end_request(req, desc->status ? BLK_STS_IOERR : 0); vdc_blk_queue_start(port); } @@ -525,29 +525,40 @@ static int __send_request(struct request *req) return err; } -static void do_vdc_request(struct request_queue *rq) +static blk_status_t vdc_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { - struct request *req; + struct vdc_port *port = hctx->queue->queuedata; + struct vio_dring_state *dr; + unsigned long flags; - while ((req = blk_peek_request(rq)) != NULL) { - struct vdc_port *port; - struct vio_dring_state *dr; + dr = &port->vio.drings[VIO_DRIVER_TX_RING]; - port = req->rq_disk->private_data; - dr = &port->vio.drings[VIO_DRIVER_TX_RING]; - if (unlikely(vdc_tx_dring_avail(dr) < 1)) - goto wait; + blk_mq_start_request(bd->rq); - blk_start_request(req); + spin_lock_irqsave(&port->vio.lock, flags); - if (__send_request(req) < 0) { - blk_requeue_request(rq, req); -wait: - /* Avoid pointless unplugs. */ - blk_stop_queue(rq); - break; - } + /* + * Doing drain, just end the request in error + */ + if (unlikely(port->drain)) { + spin_unlock_irqrestore(&port->vio.lock, flags); + return BLK_STS_IOERR; } + + if (unlikely(vdc_tx_dring_avail(dr) < 1)) { + spin_unlock_irqrestore(&port->vio.lock, flags); + blk_mq_stop_hw_queue(hctx); + return BLK_STS_DEV_RESOURCE; + } + + if (__send_request(bd->rq) < 0) { + spin_unlock_irqrestore(&port->vio.lock, flags); + return BLK_STS_IOERR; + } + + spin_unlock_irqrestore(&port->vio.lock, flags); + return BLK_STS_OK; } static int generic_request(struct vdc_port *port, u8 op, void *buf, int len) @@ -759,6 +770,44 @@ static void vdc_port_down(struct vdc_port *port) vio_ldc_free(&port->vio); } +static const struct blk_mq_ops vdc_mq_ops = { + .queue_rq = vdc_queue_rq, +}; + +static void cleanup_queue(struct request_queue *q) +{ + struct vdc_port *port = q->queuedata; + + blk_mq_free_tag_set(&port->tag_set); + blk_cleanup_queue(q); +} + +static struct request_queue *init_queue(struct vdc_port *port) +{ + struct blk_mq_tag_set *set = &port->tag_set; + struct request_queue *q; + int ret; + + set->ops = &vdc_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = VDC_TX_RING_SIZE; + set->numa_node = NUMA_NO_NODE; + set->flags = BLK_MQ_F_SHOULD_MERGE; + + ret = blk_mq_alloc_tag_set(set); + if (ret) + return ERR_PTR(ret); + + q = blk_mq_init_queue(set); + if (IS_ERR(q)) { + blk_mq_free_tag_set(set); + return q; + } + + q->queuedata = port; + return q; +} + static int probe_disk(struct vdc_port *port) { struct request_queue *q; @@ -796,17 +845,17 @@ static int probe_disk(struct vdc_port *port) (u64)geom.num_sec); } - q = blk_init_queue(do_vdc_request, &port->vio.lock); - if (!q) { + q = init_queue(port); + if (IS_ERR(q)) { printk(KERN_ERR PFX "%s: Could not allocate queue.\n", port->vio.name); - return -ENOMEM; + return PTR_ERR(q); } g = alloc_disk(1 << PARTITION_SHIFT); if (!g) { printk(KERN_ERR PFX "%s: Could not allocate gendisk.\n", port->vio.name); - blk_cleanup_queue(q); + cleanup_queue(q); return -ENOMEM; } @@ -981,7 +1030,7 @@ static int vdc_port_probe(struct vio_dev *vdev, const struct vio_device_id *id) */ ldc_timeout = mdesc_get_property(hp, vdev->mp, "vdc-timeout", NULL); port->ldc_timeout = ldc_timeout ? *ldc_timeout : 0; - timer_setup(&port->ldc_reset_timer, vdc_ldc_reset_timer, 0); + INIT_DELAYED_WORK(&port->ldc_reset_timer_work, vdc_ldc_reset_timer_work); INIT_WORK(&port->ldc_reset_work, vdc_ldc_reset_work); err = vio_driver_init(&port->vio, vdev, VDEV_DISK, @@ -1034,18 +1083,14 @@ static int vdc_port_remove(struct vio_dev *vdev) struct vdc_port *port = dev_get_drvdata(&vdev->dev); if (port) { - unsigned long flags; - - spin_lock_irqsave(&port->vio.lock, flags); - blk_stop_queue(port->disk->queue); - spin_unlock_irqrestore(&port->vio.lock, flags); + blk_mq_stop_hw_queues(port->disk->queue); flush_work(&port->ldc_reset_work); - del_timer_sync(&port->ldc_reset_timer); + cancel_delayed_work_sync(&port->ldc_reset_timer_work); del_timer_sync(&port->vio.timer); del_gendisk(port->disk); - blk_cleanup_queue(port->disk->queue); + cleanup_queue(port->disk->queue); put_disk(port->disk); port->disk = NULL; @@ -1080,32 +1125,46 @@ static void vdc_requeue_inflight(struct vdc_port *port) } rqe->req = NULL; - blk_requeue_request(port->disk->queue, req); + blk_mq_requeue_request(req, false); } } static void vdc_queue_drain(struct vdc_port *port) { - struct request *req; + struct request_queue *q = port->disk->queue; - while ((req = blk_fetch_request(port->disk->queue)) != NULL) - __blk_end_request_all(req, BLK_STS_IOERR); + /* + * Mark the queue as draining, then freeze/quiesce to ensure + * that all existing requests are seen in ->queue_rq() and killed + */ + port->drain = 1; + spin_unlock_irq(&port->vio.lock); + + blk_mq_freeze_queue(q); + blk_mq_quiesce_queue(q); + + spin_lock_irq(&port->vio.lock); + port->drain = 0; + blk_mq_unquiesce_queue(q); + blk_mq_unfreeze_queue(q); } -static void vdc_ldc_reset_timer(struct timer_list *t) +static void vdc_ldc_reset_timer_work(struct work_struct *work) { - struct vdc_port *port = from_timer(port, t, ldc_reset_timer); - struct vio_driver_state *vio = &port->vio; - unsigned long flags; + struct vdc_port *port; + struct vio_driver_state *vio; - spin_lock_irqsave(&vio->lock, flags); + port = container_of(work, struct vdc_port, ldc_reset_timer_work.work); + vio = &port->vio; + + spin_lock_irq(&vio->lock); if (!(port->vio.hs_state & VIO_HS_COMPLETE)) { pr_warn(PFX "%s ldc down %llu seconds, draining queue\n", port->disk_name, port->ldc_timeout); vdc_queue_drain(port); vdc_blk_queue_start(port); } - spin_unlock_irqrestore(&vio->lock, flags); + spin_unlock_irq(&vio->lock); } static void vdc_ldc_reset_work(struct work_struct *work) @@ -1129,7 +1188,7 @@ static void vdc_ldc_reset(struct vdc_port *port) assert_spin_locked(&port->vio.lock); pr_warn(PFX "%s ldc link reset\n", port->disk_name); - blk_stop_queue(port->disk->queue); + blk_mq_stop_hw_queues(port->disk->queue); vdc_requeue_inflight(port); vdc_port_down(port); @@ -1146,7 +1205,7 @@ static void vdc_ldc_reset(struct vdc_port *port) } if (port->ldc_timeout) - mod_timer(&port->ldc_reset_timer, + mod_delayed_work(system_wq, &port->ldc_reset_timer_work, round_jiffies(jiffies + HZ * port->ldc_timeout)); mod_timer(&port->vio.timer, round_jiffies(jiffies + HZ)); return; -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe , David Miller Subject: [PATCH 13/17] ide: convert to blk-mq Date: Thu, 11 Oct 2018 10:59:05 -0600 Message-Id: <20181011165909.32615-14-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: ide-disk and ide-cd tested as working just fine, ide-tape and ide-floppy haven't. But the latter don't require changes, so they should work without issue. Cc: David Miller Signed-off-by: Jens Axboe --- drivers/ide/ide-atapi.c | 25 ++++-- drivers/ide/ide-cd.c | 175 +++++++++++++++++++++------------------- drivers/ide/ide-disk.c | 8 +- drivers/ide/ide-io.c | 84 ++++++++++--------- drivers/ide/ide-park.c | 2 +- drivers/ide/ide-pm.c | 26 ++---- drivers/ide/ide-probe.c | 43 +++++----- include/linux/ide.h | 8 +- 8 files changed, 194 insertions(+), 177 deletions(-) diff --git a/drivers/ide/ide-atapi.c b/drivers/ide/ide-atapi.c index 8b2b72b93885..d65c3b2ab2b3 100644 --- a/drivers/ide/ide-atapi.c +++ b/drivers/ide/ide-atapi.c @@ -172,8 +172,8 @@ EXPORT_SYMBOL_GPL(ide_create_request_sense_cmd); void ide_prep_sense(ide_drive_t *drive, struct request *rq) { struct request_sense *sense = &drive->sense_data; - struct request *sense_rq = drive->sense_rq; - struct scsi_request *req = scsi_req(sense_rq); + struct request *sense_rq; + struct scsi_request *req; unsigned int cmd_len, sense_len; int err; @@ -196,9 +196,16 @@ void ide_prep_sense(ide_drive_t *drive, struct request *rq) if (ata_sense_request(rq) || drive->sense_rq_armed) return; + sense_rq = drive->sense_rq; + if (!sense_rq) { + sense_rq = blk_mq_alloc_request(drive->queue, REQ_OP_DRV_IN, + BLK_MQ_REQ_RESERVED | BLK_MQ_REQ_NOWAIT); + drive->sense_rq = sense_rq; + } + req = scsi_req(sense_rq); + memset(sense, 0, sizeof(*sense)); - blk_rq_init(rq->q, sense_rq); scsi_req_init(req); err = blk_rq_map_kern(drive->queue, sense_rq, sense, sense_len, @@ -207,6 +214,8 @@ void ide_prep_sense(ide_drive_t *drive, struct request *rq) if (printk_ratelimit()) printk(KERN_WARNING PFX "%s: failed to map sense " "buffer\n", drive->name); + blk_mq_free_request(sense_rq); + drive->sense_rq = NULL; return; } @@ -226,6 +235,8 @@ EXPORT_SYMBOL_GPL(ide_prep_sense); int ide_queue_sense_rq(ide_drive_t *drive, void *special) { + struct request *sense_rq = drive->sense_rq; + /* deferred failure from ide_prep_sense() */ if (!drive->sense_rq_armed) { printk(KERN_WARNING PFX "%s: error queuing a sense request\n", @@ -233,12 +244,12 @@ int ide_queue_sense_rq(ide_drive_t *drive, void *special) return -ENOMEM; } - drive->sense_rq->special = special; + sense_rq->special = special; drive->sense_rq_armed = false; drive->hwif->rq = NULL; - elv_add_request(drive->queue, drive->sense_rq, ELEVATOR_INSERT_FRONT); + blk_mq_sched_insert_request(sense_rq, true, true, true); return 0; } EXPORT_SYMBOL_GPL(ide_queue_sense_rq); @@ -270,10 +281,8 @@ void ide_retry_pc(ide_drive_t *drive) */ drive->hwif->rq = NULL; ide_requeue_and_plug(drive, failed_rq); - if (ide_queue_sense_rq(drive, pc)) { - blk_start_request(failed_rq); + if (ide_queue_sense_rq(drive, pc)) ide_complete_rq(drive, BLK_STS_IOERR, blk_rq_bytes(failed_rq)); - } } EXPORT_SYMBOL_GPL(ide_retry_pc); diff --git a/drivers/ide/ide-cd.c b/drivers/ide/ide-cd.c index 44a7a255ef74..188bcfb07aac 100644 --- a/drivers/ide/ide-cd.c +++ b/drivers/ide/ide-cd.c @@ -258,11 +258,22 @@ static int ide_cd_breathe(ide_drive_t *drive, struct request *rq) /* * take a breather */ - blk_delay_queue(drive->queue, 1); + blk_mq_requeue_request(rq, false); + blk_mq_delay_kick_requeue_list(drive->queue, 1); return 1; } } +static void ide_cd_free_sense(ide_drive_t *drive) +{ + if (!drive->sense_rq) + return; + + blk_mq_free_request(drive->sense_rq); + drive->sense_rq = NULL; + drive->sense_rq_armed = false; +} + /** * Returns: * 0: if the request should be continued. @@ -516,6 +527,82 @@ static bool ide_cd_error_cmd(ide_drive_t *drive, struct ide_cmd *cmd) return false; } +/* standard prep_rq_fn that builds 10 byte cmds */ +static int ide_cdrom_prep_fs(struct request_queue *q, struct request *rq) +{ + int hard_sect = queue_logical_block_size(q); + long block = (long)blk_rq_pos(rq) / (hard_sect >> 9); + unsigned long blocks = blk_rq_sectors(rq) / (hard_sect >> 9); + struct scsi_request *req = scsi_req(rq); + + if (rq_data_dir(rq) == READ) + req->cmd[0] = GPCMD_READ_10; + else + req->cmd[0] = GPCMD_WRITE_10; + + /* + * fill in lba + */ + req->cmd[2] = (block >> 24) & 0xff; + req->cmd[3] = (block >> 16) & 0xff; + req->cmd[4] = (block >> 8) & 0xff; + req->cmd[5] = block & 0xff; + + /* + * and transfer length + */ + req->cmd[7] = (blocks >> 8) & 0xff; + req->cmd[8] = blocks & 0xff; + req->cmd_len = 10; + return BLKPREP_OK; +} + +/* + * Most of the SCSI commands are supported directly by ATAPI devices. + * This transform handles the few exceptions. + */ +static int ide_cdrom_prep_pc(struct request *rq) +{ + u8 *c = scsi_req(rq)->cmd; + + /* transform 6-byte read/write commands to the 10-byte version */ + if (c[0] == READ_6 || c[0] == WRITE_6) { + c[8] = c[4]; + c[5] = c[3]; + c[4] = c[2]; + c[3] = c[1] & 0x1f; + c[2] = 0; + c[1] &= 0xe0; + c[0] += (READ_10 - READ_6); + scsi_req(rq)->cmd_len = 10; + return BLKPREP_OK; + } + + /* + * it's silly to pretend we understand 6-byte sense commands, just + * reject with ILLEGAL_REQUEST and the caller should take the + * appropriate action + */ + if (c[0] == MODE_SENSE || c[0] == MODE_SELECT) { + scsi_req(rq)->result = ILLEGAL_REQUEST; + return BLKPREP_KILL; + } + + return BLKPREP_OK; +} + +static int ide_cdrom_prep_fn(ide_drive_t *drive, struct request *rq) +{ + if (!blk_rq_is_passthrough(rq)) { + scsi_req_init(scsi_req(rq)); + + return ide_cdrom_prep_fs(drive->queue, rq); + } else if (blk_rq_is_scsi(rq)) + return ide_cdrom_prep_pc(rq); + + return 0; +} + static ide_startstop_t cdrom_newpc_intr(ide_drive_t *drive) { ide_hwif_t *hwif = drive->hwif; @@ -675,7 +762,7 @@ static ide_startstop_t cdrom_newpc_intr(ide_drive_t *drive) out_end: if (blk_rq_is_scsi(rq) && rc == 0) { scsi_req(rq)->resid_len = 0; - blk_end_request_all(rq, BLK_STS_OK); + blk_mq_end_request(rq, BLK_STS_OK); hwif->rq = NULL; } else { if (sense && uptodate) @@ -705,6 +792,8 @@ static ide_startstop_t cdrom_newpc_intr(ide_drive_t *drive) if (sense && rc == 2) ide_error(drive, "request sense failure", stat); } + + ide_cd_free_sense(drive); return ide_stopped; } @@ -729,7 +818,7 @@ static ide_startstop_t cdrom_start_rw(ide_drive_t *drive, struct request *rq) * We may be retrying this request after an error. Fix up any * weirdness which might be present in the request packet. */ - q->prep_rq_fn(q, rq); + ide_cdrom_prep_fn(drive, rq); } /* fs requests *must* be hardware frame aligned */ @@ -1323,82 +1412,6 @@ static int ide_cdrom_probe_capabilities(ide_drive_t *drive) return nslots; } -/* standard prep_rq_fn that builds 10 byte cmds */ -static int ide_cdrom_prep_fs(struct request_queue *q, struct request *rq) -{ - int hard_sect = queue_logical_block_size(q); - long block = (long)blk_rq_pos(rq) / (hard_sect >> 9); - unsigned long blocks = blk_rq_sectors(rq) / (hard_sect >> 9); - struct scsi_request *req = scsi_req(rq); - - q->initialize_rq_fn(rq); - - if (rq_data_dir(rq) == READ) - req->cmd[0] = GPCMD_READ_10; - else - req->cmd[0] = GPCMD_WRITE_10; - - /* - * fill in lba - */ - req->cmd[2] = (block >> 24) & 0xff; - req->cmd[3] = (block >> 16) & 0xff; - req->cmd[4] = (block >> 8) & 0xff; - req->cmd[5] = block & 0xff; - - /* - * and transfer length - */ - req->cmd[7] = (blocks >> 8) & 0xff; - req->cmd[8] = blocks & 0xff; - req->cmd_len = 10; - return BLKPREP_OK; -} - -/* - * Most of the SCSI commands are supported directly by ATAPI devices. - * This transform handles the few exceptions. - */ -static int ide_cdrom_prep_pc(struct request *rq) -{ - u8 *c = scsi_req(rq)->cmd; - - /* transform 6-byte read/write commands to the 10-byte version */ - if (c[0] == READ_6 || c[0] == WRITE_6) { - c[8] = c[4]; - c[5] = c[3]; - c[4] = c[2]; - c[3] = c[1] & 0x1f; - c[2] = 0; - c[1] &= 0xe0; - c[0] += (READ_10 - READ_6); - scsi_req(rq)->cmd_len = 10; - return BLKPREP_OK; - } - - /* - * it's silly to pretend we understand 6-byte sense commands, just - * reject with ILLEGAL_REQUEST and the caller should take the - * appropriate action - */ - if (c[0] == MODE_SENSE || c[0] == MODE_SELECT) { - scsi_req(rq)->result = ILLEGAL_REQUEST; - return BLKPREP_KILL; - } - - return BLKPREP_OK; -} - -static int ide_cdrom_prep_fn(struct request_queue *q, struct request *rq) -{ - if (!blk_rq_is_passthrough(rq)) - return ide_cdrom_prep_fs(q, rq); - else if (blk_rq_is_scsi(rq)) - return ide_cdrom_prep_pc(rq); - - return 0; -} - struct cd_list_entry { const char *id_model; const char *id_firmware; @@ -1508,7 +1521,7 @@ static int ide_cdrom_setup(ide_drive_t *drive) ide_debug_log(IDE_DBG_PROBE, "enter"); - blk_queue_prep_rq(q, ide_cdrom_prep_fn); + drive->prep_rq = ide_cdrom_prep_fn; blk_queue_dma_alignment(q, 31); blk_queue_update_dma_pad(q, 15); @@ -1569,7 +1582,7 @@ static void ide_cd_release(struct device *dev) if (devinfo->handle == drive) unregister_cdrom(devinfo); drive->driver_data = NULL; - blk_queue_prep_rq(drive->queue, NULL); + drive->prep_rq = NULL; g->private_data = NULL; put_disk(g); kfree(info); diff --git a/drivers/ide/ide-disk.c b/drivers/ide/ide-disk.c index e3b4e659082d..b14a1446586d 100644 --- a/drivers/ide/ide-disk.c +++ b/drivers/ide/ide-disk.c @@ -187,6 +187,9 @@ static ide_startstop_t ide_do_rw_disk(ide_drive_t *drive, struct request *rq, BUG_ON(drive->dev_flags & IDE_DFLAG_BLOCKED); BUG_ON(blk_rq_is_passthrough(rq)); + if (drive->queue->prep_rq_fn && drive->queue->prep_rq_fn(drive->queue, rq)) + return ide_stopped; + ledtrig_disk_activity(rq_data_dir(rq) == WRITE); pr_debug("%s: %sing: block=%llu, sectors=%u\n", @@ -427,9 +430,8 @@ static void ide_disk_unlock_native_capacity(ide_drive_t *drive) drive->dev_flags |= IDE_DFLAG_NOHPA; /* disable HPA on resume */ } -static int idedisk_prep_fn(struct request_queue *q, struct request *rq) +static int idedisk_prep_fn(ide_drive_t *drive, struct request *rq) { - ide_drive_t *drive = q->queuedata; struct ide_cmd *cmd; if (req_op(rq) != REQ_OP_FLUSH) @@ -548,7 +550,7 @@ static void update_flush(ide_drive_t *drive) if (barrier) { wc = true; - blk_queue_prep_rq(drive->queue, idedisk_prep_fn); + drive->prep_rq = idedisk_prep_fn; } } diff --git a/drivers/ide/ide-io.c b/drivers/ide/ide-io.c index 0d93e0cfbeaf..b583eeac7864 100644 --- a/drivers/ide/ide-io.c +++ b/drivers/ide/ide-io.c @@ -67,7 +67,15 @@ int ide_end_rq(ide_drive_t *drive, struct request *rq, blk_status_t error, ide_dma_on(drive); } - return blk_end_request(rq, error, nr_bytes); + if (!blk_update_request(rq, error, nr_bytes)) { + if (rq == drive->sense_rq) + drive->sense_rq = NULL; + + __blk_mq_end_request(rq, error); + return 0; + } + + return 1; } EXPORT_SYMBOL_GPL(ide_end_rq); @@ -307,8 +315,6 @@ static ide_startstop_t start_request (ide_drive_t *drive, struct request *rq) { ide_startstop_t startstop; - BUG_ON(!(rq->rq_flags & RQF_STARTED)); - #ifdef DEBUG printk("%s: start_request: current=0x%08lx\n", drive->hwif->name, (unsigned long) rq); @@ -320,6 +326,9 @@ static ide_startstop_t start_request (ide_drive_t *drive, struct request *rq) goto kill_rq; } + if (drive->prep_rq && drive->prep_rq(drive, rq)) + return ide_stopped; + if (ata_pm_request(rq)) ide_check_pm_state(drive, rq); @@ -430,44 +439,38 @@ static inline void ide_unlock_host(struct ide_host *host) } } -static void __ide_requeue_and_plug(struct request_queue *q, struct request *rq) -{ - if (rq) - blk_requeue_request(q, rq); - if (rq || blk_peek_request(q)) { - /* Use 3ms as that was the old plug delay */ - blk_delay_queue(q, 3); - } -} - void ide_requeue_and_plug(ide_drive_t *drive, struct request *rq) { struct request_queue *q = drive->queue; - unsigned long flags; - spin_lock_irqsave(q->queue_lock, flags); - __ide_requeue_and_plug(q, rq); - spin_unlock_irqrestore(q->queue_lock, flags); + /* Use 3ms as that was the old plug delay */ + if (rq) { + blk_mq_requeue_request(rq, false); + blk_mq_delay_kick_requeue_list(q, 3); + } else + blk_mq_delay_run_hw_queue(q->queue_hw_ctx[0], 3); } /* * Issue a new request to a device. */ -void do_ide_request(struct request_queue *q) +blk_status_t ide_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { - ide_drive_t *drive = q->queuedata; + ide_drive_t *drive = hctx->queue->queuedata; ide_hwif_t *hwif = drive->hwif; struct ide_host *host = hwif->host; struct request *rq = NULL; ide_startstop_t startstop; - spin_unlock_irq(q->queue_lock); - /* HLD do_request() callback might sleep, make sure it's okay */ might_sleep(); if (ide_lock_host(host, hwif)) - goto plug_device_2; + return BLK_STS_DEV_RESOURCE; + + rq = bd->rq; + blk_mq_start_request(rq); spin_lock_irq(&hwif->lock); @@ -503,21 +506,16 @@ void do_ide_request(struct request_queue *q) hwif->cur_dev = drive; drive->dev_flags &= ~(IDE_DFLAG_SLEEPING | IDE_DFLAG_PARKED); - spin_unlock_irq(&hwif->lock); - spin_lock_irq(q->queue_lock); /* * we know that the queue isn't empty, but this can happen * if the q->prep_rq_fn() decides to kill a request */ - if (!rq) - rq = blk_fetch_request(drive->queue); - - spin_unlock_irq(q->queue_lock); - spin_lock_irq(&hwif->lock); - if (!rq) { - ide_unlock_port(hwif); - goto out; + rq = bd->rq; + if (!rq) { + ide_unlock_port(hwif); + goto out; + } } /* @@ -553,21 +551,19 @@ void do_ide_request(struct request_queue *q) hwif->rq = NULL; goto repeat; } - } else - goto plug_device; + } else { +plug_device: + spin_unlock_irq(&hwif->lock); + ide_unlock_host(host); + ide_requeue_and_plug(drive, rq); + return BLK_STS_OK; + } + out: spin_unlock_irq(&hwif->lock); if (rq == NULL) ide_unlock_host(host); - spin_lock_irq(q->queue_lock); - return; - -plug_device: - spin_unlock_irq(&hwif->lock); - ide_unlock_host(host); -plug_device_2: - spin_lock_irq(q->queue_lock); - __ide_requeue_and_plug(q, rq); + return BLK_STS_OK; } static int drive_is_ready(ide_drive_t *drive) @@ -617,6 +613,8 @@ void ide_timer_expiry (struct timer_list *t) int plug_device = 0; struct request *uninitialized_var(rq_in_flight); + return; + spin_lock_irqsave(&hwif->lock, flags); handler = hwif->handler; diff --git a/drivers/ide/ide-park.c b/drivers/ide/ide-park.c index 622f0edb3945..45f989792633 100644 --- a/drivers/ide/ide-park.c +++ b/drivers/ide/ide-park.c @@ -54,7 +54,7 @@ static void issue_park_cmd(ide_drive_t *drive, unsigned long timeout) scsi_req(rq)->cmd[0] = REQ_UNPARK_HEADS; scsi_req(rq)->cmd_len = 1; ide_req(rq)->type = ATA_PRIV_MISC; - elv_add_request(q, rq, ELEVATOR_INSERT_FRONT); + blk_mq_sched_insert_request(rq, true, true, true); out: return; diff --git a/drivers/ide/ide-pm.c b/drivers/ide/ide-pm.c index 59217aa1d1fb..cca47adda527 100644 --- a/drivers/ide/ide-pm.c +++ b/drivers/ide/ide-pm.c @@ -40,32 +40,20 @@ int generic_ide_suspend(struct device *dev, pm_message_t mesg) return ret; } -static void ide_end_sync_rq(struct request *rq, blk_status_t error) -{ - complete(rq->end_io_data); -} - static int ide_pm_execute_rq(struct request *rq) { struct request_queue *q = rq->q; - DECLARE_COMPLETION_ONSTACK(wait); - - rq->end_io_data = &wait; - rq->end_io = ide_end_sync_rq; spin_lock_irq(q->queue_lock); if (unlikely(blk_queue_dying(q))) { rq->rq_flags |= RQF_QUIET; scsi_req(rq)->result = -ENXIO; - __blk_end_request_all(rq, BLK_STS_OK); spin_unlock_irq(q->queue_lock); + blk_mq_end_request(rq, BLK_STS_OK); return -ENXIO; } - __elv_add_request(q, rq, ELEVATOR_INSERT_FRONT); - __blk_run_queue_uncond(q); spin_unlock_irq(q->queue_lock); - - wait_for_completion_io(&wait); + blk_execute_rq(q, NULL, rq, true); return scsi_req(rq)->result ? -EIO : 0; } @@ -226,15 +214,14 @@ void ide_complete_pm_rq(ide_drive_t *drive, struct request *rq) #endif spin_lock_irqsave(q->queue_lock, flags); if (ide_req(rq)->type == ATA_PRIV_PM_SUSPEND) - blk_stop_queue(q); + blk_mq_stop_hw_queues(q); else drive->dev_flags &= ~IDE_DFLAG_BLOCKED; spin_unlock_irqrestore(q->queue_lock, flags); drive->hwif->rq = NULL; - if (blk_end_request(rq, BLK_STS_OK, 0)) - BUG(); + blk_mq_end_request(rq, BLK_STS_OK); } void ide_check_pm_state(ide_drive_t *drive, struct request *rq) @@ -260,7 +247,6 @@ void ide_check_pm_state(ide_drive_t *drive, struct request *rq) ide_hwif_t *hwif = drive->hwif; const struct ide_tp_ops *tp_ops = hwif->tp_ops; struct request_queue *q = drive->queue; - unsigned long flags; int rc; #ifdef DEBUG_PM printk("%s: Wakeup request inited, waiting for !BSY...\n", drive->name); @@ -274,8 +260,6 @@ void ide_check_pm_state(ide_drive_t *drive, struct request *rq) if (rc) printk(KERN_WARNING "%s: drive not ready on wakeup\n", drive->name); - spin_lock_irqsave(q->queue_lock, flags); - blk_start_queue(q); - spin_unlock_irqrestore(q->queue_lock, flags); + blk_mq_start_hw_queues(q); } } diff --git a/drivers/ide/ide-probe.c b/drivers/ide/ide-probe.c index 3b75a7b7a284..31ed4ab90fff 100644 --- a/drivers/ide/ide-probe.c +++ b/drivers/ide/ide-probe.c @@ -750,6 +750,11 @@ static void ide_initialize_rq(struct request *rq) req->sreq.sense = req->sense; } +static const struct blk_mq_ops ide_mq_ops = { + .queue_rq = ide_queue_rq, + .initialize_rq_fn = ide_initialize_rq, +}; + /* * init request queue */ @@ -759,6 +764,7 @@ static int ide_init_queue(ide_drive_t *drive) ide_hwif_t *hwif = drive->hwif; int max_sectors = 256; int max_sg_entries = PRD_ENTRIES; + struct blk_mq_tag_set *set; /* * Our default set up assumes the normal IDE case, @@ -767,19 +773,26 @@ static int ide_init_queue(ide_drive_t *drive) * limits and LBA48 we could raise it but as yet * do not. */ - q = blk_alloc_queue_node(GFP_KERNEL, hwif_to_node(hwif), NULL); - if (!q) + + set = &drive->tag_set; + set->ops = &ide_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = 32; + set->reserved_tags = 1; + set->cmd_size = sizeof(struct ide_request); + set->numa_node = hwif_to_node(hwif); + set->flags = BLK_MQ_F_SHOULD_MERGE | BLK_MQ_F_BLOCKING; + if (blk_mq_alloc_tag_set(set)) return 1; - q->request_fn = do_ide_request; - q->initialize_rq_fn = ide_initialize_rq; - q->cmd_size = sizeof(struct ide_request); - blk_queue_flag_set(QUEUE_FLAG_SCSI_PASSTHROUGH, q); - if (blk_init_allocated_queue(q) < 0) { - blk_cleanup_queue(q); + q = blk_mq_init_queue(set); + if (IS_ERR(q)) { + blk_mq_free_tag_set(set); return 1; } + blk_queue_flag_set(QUEUE_FLAG_SCSI_PASSTHROUGH, q); + q->queuedata = drive; blk_queue_segment_boundary(q, 0xffff); @@ -965,6 +978,10 @@ static void drive_release_dev (struct device *dev) ide_proc_unregister_device(drive); + if (drive->sense_rq) + blk_mq_free_request(drive->sense_rq); + + blk_mq_free_tag_set(&drive->tag_set); blk_cleanup_queue(drive->queue); drive->queue = NULL; @@ -1145,12 +1162,10 @@ static void ide_port_init_devices_data(ide_hwif_t *hwif) ide_port_for_each_dev(i, drive, hwif) { u8 j = (hwif->index * MAX_DRIVES) + i; u16 *saved_id = drive->id; - struct request *saved_sense_rq = drive->sense_rq; memset(drive, 0, sizeof(*drive)); memset(saved_id, 0, SECTOR_SIZE); drive->id = saved_id; - drive->sense_rq = saved_sense_rq; drive->media = ide_disk; drive->select = (i << 4) | ATA_DEVICE_OBS; @@ -1255,7 +1270,6 @@ static void ide_port_free_devices(ide_hwif_t *hwif) int i; ide_port_for_each_dev(i, drive, hwif) { - kfree(drive->sense_rq); kfree(drive->id); kfree(drive); } @@ -1283,17 +1297,10 @@ static int ide_port_alloc_devices(ide_hwif_t *hwif, int node) if (drive->id == NULL) goto out_free_drive; - drive->sense_rq = kmalloc(sizeof(struct request) + - sizeof(struct ide_request), GFP_KERNEL); - if (!drive->sense_rq) - goto out_free_id; - hwif->devices[i] = drive; } return 0; -out_free_id: - kfree(drive->id); out_free_drive: kfree(drive); out_nomem: diff --git a/include/linux/ide.h b/include/linux/ide.h index c74b0321922a..3e55c362ab7e 100644 --- a/include/linux/ide.h +++ b/include/linux/ide.h @@ -10,7 +10,7 @@ #include #include #include -#include +#include #include #include #include @@ -529,6 +529,10 @@ struct ide_drive_s { struct request_queue *queue; /* request queue */ + int (*prep_rq)(struct ide_drive_s *, struct request *); + + struct blk_mq_tag_set tag_set; + struct request *rq; /* current request */ void *driver_data; /* extra driver data */ u16 *id; /* identification info */ @@ -1208,7 +1212,7 @@ extern void ide_stall_queue(ide_drive_t *drive, unsigned long timeout); extern void ide_timer_expiry(struct timer_list *t); extern irqreturn_t ide_intr(int irq, void *dev_id); -extern void do_ide_request(struct request_queue *); +extern blk_status_t ide_queue_rq(struct blk_mq_hw_ctx *, const struct blk_mq_queue_data *); extern void ide_requeue_and_plug(ide_drive_t *drive, struct request *rq); void ide_init_disk(struct gendisk *, ide_drive_t *); -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Return-Path: michal.simek@xilinx.com Subject: Re: [PATCH 15/17] xsysace: convert to blk-mq To: Jens Axboe , CC: Michal Simek References: <20181011165909.32615-1-axboe@kernel.dk> <20181011165909.32615-16-axboe@kernel.dk> From: Michal Simek Message-ID: <0f7caa33-46d4-c727-7bbf-59d27cd7d373@xilinx.com> Date: Fri, 12 Oct 2018 07:46:16 +0200 MIME-Version: 1.0 In-Reply-To: <20181011165909.32615-16-axboe@kernel.dk> Content-Type: text/plain; charset="utf-8" List-ID: On 11.10.2018 18:59, Jens Axboe wrote: > Straight forward conversion, using an internal list to enable the > driver to pull requests at will. > > Cc: Michal Simek > Signed-off-by: Jens Axboe > --- > drivers/block/xsysace.c | 91 ++++++++++++++++++++++++++++++----------- > 1 file changed, 66 insertions(+), 25 deletions(-) > > diff --git a/drivers/block/xsysace.c b/drivers/block/xsysace.c > index c24589414c75..ddaa362ffe82 100644 > --- a/drivers/block/xsysace.c > +++ b/drivers/block/xsysace.c > @@ -88,7 +88,7 @@ > #include > #include > #include > -#include > +#include > #include > #include > #include > @@ -209,6 +209,8 @@ struct ace_device { > struct device *dev; > struct request_queue *queue; > struct gendisk *gd; > + struct blk_mq_tag_set tag_set; > + struct list_head rq_list; > > /* Inserted CF card parameters */ > u16 cf_id[ATA_ID_WORDS]; > @@ -462,18 +464,26 @@ static inline void ace_fsm_yieldirq(struct ace_device *ace) > ace->fsm_continue_flag = 0; > } > > +static bool ace_has_next_request(struct request_queue *q) > +{ > + struct ace_device *ace = q->queuedata; > + > + return !list_empty(&ace->rq_list); > +} > + > /* Get the next read/write request; ending requests that we don't handle */ > static struct request *ace_get_next_request(struct request_queue *q) > { > - struct request *req; > + struct ace_device *ace = q->queuedata; > + struct request *rq; > > - while ((req = blk_peek_request(q)) != NULL) { > - if (!blk_rq_is_passthrough(req)) > - break; > - blk_start_request(req); > - __blk_end_request_all(req, BLK_STS_IOERR); > + rq = list_first_entry_or_null(&ace->rq_list, struct request, queuelist); > + if (rq) { > + list_del_init(&rq->queuelist); > + blk_mq_start_request(rq); > } > - return req; > + > + return NULL; > } > > static void ace_fsm_dostate(struct ace_device *ace) > @@ -499,11 +509,11 @@ static void ace_fsm_dostate(struct ace_device *ace) > > /* Drop all in-flight and pending requests */ > if (ace->req) { > - __blk_end_request_all(ace->req, BLK_STS_IOERR); > + blk_mq_end_request(ace->req, BLK_STS_IOERR); > ace->req = NULL; > } > - while ((req = blk_fetch_request(ace->queue)) != NULL) > - __blk_end_request_all(req, BLK_STS_IOERR); > + while ((req = ace_get_next_request(ace->queue)) != NULL) > + blk_mq_end_request(req, BLK_STS_IOERR); > > /* Drop back to IDLE state and notify waiters */ > ace->fsm_state = ACE_FSM_STATE_IDLE; > @@ -517,7 +527,7 @@ static void ace_fsm_dostate(struct ace_device *ace) > switch (ace->fsm_state) { > case ACE_FSM_STATE_IDLE: > /* See if there is anything to do */ > - if (ace->id_req_count || ace_get_next_request(ace->queue)) { > + if (ace->id_req_count || ace_has_next_request(ace->queue)) { > ace->fsm_iter_num++; > ace->fsm_state = ACE_FSM_STATE_REQ_LOCK; > mod_timer(&ace->stall_timer, jiffies + HZ); > @@ -651,7 +661,6 @@ static void ace_fsm_dostate(struct ace_device *ace) > ace->fsm_state = ACE_FSM_STATE_IDLE; > break; > } > - blk_start_request(req); > > /* Okay, it's a data request, set it up for transfer */ > dev_dbg(ace->dev, > @@ -728,7 +737,8 @@ static void ace_fsm_dostate(struct ace_device *ace) > } > > /* bio finished; is there another one? */ > - if (__blk_end_request_cur(ace->req, BLK_STS_OK)) { > + if (blk_update_request(ace->req, BLK_STS_OK, > + blk_rq_cur_bytes(ace->req))) { > /* dev_dbg(ace->dev, "next block; h=%u c=%u\n", > * blk_rq_sectors(ace->req), > * blk_rq_cur_sectors(ace->req)); > @@ -854,17 +864,23 @@ static irqreturn_t ace_interrupt(int irq, void *dev_id) > /* --------------------------------------------------------------------- > * Block ops > */ > -static void ace_request(struct request_queue * q) > +static blk_status_t ace_queue_rq(struct blk_mq_hw_ctx *hctx, > + const struct blk_mq_queue_data *bd) > { > - struct request *req; > - struct ace_device *ace; > + struct ace_device *ace = hctx->queue->queuedata; > + struct request *req = bd->rq; > > - req = ace_get_next_request(q); > - > - if (req) { > - ace = req->rq_disk->private_data; > - tasklet_schedule(&ace->fsm_tasklet); > + if (blk_rq_is_passthrough(req)) { > + blk_mq_start_request(req); > + return BLK_STS_IOERR; > } > + > + spin_lock_irq(&ace->lock); > + list_add_tail(&req->queuelist, &ace->rq_list); > + spin_unlock_irq(&ace->lock); > + > + tasklet_schedule(&ace->fsm_tasklet); > + return BLK_STS_OK; > } > > static unsigned int ace_check_events(struct gendisk *gd, unsigned int clearing) > @@ -957,11 +973,16 @@ static const struct block_device_operations ace_fops = { > .getgeo = ace_getgeo, > }; > > +static const struct blk_mq_ops ace_mq_ops = { > + .queue_rq = ace_queue_rq, > +}; > + > /* -------------------------------------------------------------------- > * SystemACE device setup/teardown code > */ > static int ace_setup(struct ace_device *ace) > { > + struct blk_mq_tag_set *set; > u16 version; > u16 val; > int rc; > @@ -972,6 +993,7 @@ static int ace_setup(struct ace_device *ace) > > spin_lock_init(&ace->lock); > init_completion(&ace->id_completion); > + INIT_LIST_HEAD(&ace->rq_list); > > /* > * Map the device > @@ -989,9 +1011,25 @@ static int ace_setup(struct ace_device *ace) > /* > * Initialize the request queue > */ > - ace->queue = blk_init_queue(ace_request, &ace->lock); > - if (ace->queue == NULL) > + set = &ace->tag_set; > + set->ops = &ace_mq_ops; > + set->nr_hw_queues = 1; > + set->queue_depth = 2; > + set->numa_node = NUMA_NO_NODE; > + set->flags = BLK_MQ_F_SHOULD_MERGE; > + rc = blk_mq_alloc_tag_set(set); > + if (rc) > goto err_blk_initq; > + > + ace->queue = blk_mq_init_queue(set); > + if (IS_ERR(ace->queue)) { > + rc = PTR_ERR(ace->queue); > + ace->queue = NULL; > + blk_mq_free_tag_set(&ace->tag_set); > + goto err_blk_initq; > + } > + ace->queue->queuedata = ace; > + > blk_queue_logical_block_size(ace->queue, 512); > blk_queue_bounce_limit(ace->queue, BLK_BOUNCE_HIGH); > > @@ -1065,6 +1103,7 @@ static int ace_setup(struct ace_device *ace) > err_read: > put_disk(ace->gd); > err_alloc_disk: > + blk_mq_free_tag_set(&ace->tag_set); > blk_cleanup_queue(ace->queue); > err_blk_initq: > iounmap(ace->baseaddr); > @@ -1081,8 +1120,10 @@ static void ace_teardown(struct ace_device *ace) > put_disk(ace->gd); > } > > - if (ace->queue) > + if (ace->queue) { > + blk_mq_free_tag_set(&ace->tag_set); > blk_cleanup_queue(ace->queue); > + } > > tasklet_kill(&ace->fsm_tasklet); > > None is testing this driver anymore that's why feel free to do this change and if there is any issue this patch can be reverted back. That's why Acked-by: Michal Simek Thanks, Michal From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe , Michal Simek Subject: [PATCH 15/17] xsysace: convert to blk-mq Date: Thu, 11 Oct 2018 10:59:07 -0600 Message-Id: <20181011165909.32615-16-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Straight forward conversion, using an internal list to enable the driver to pull requests at will. Cc: Michal Simek Signed-off-by: Jens Axboe --- drivers/block/xsysace.c | 91 ++++++++++++++++++++++++++++++----------- 1 file changed, 66 insertions(+), 25 deletions(-) diff --git a/drivers/block/xsysace.c b/drivers/block/xsysace.c index c24589414c75..ddaa362ffe82 100644 --- a/drivers/block/xsysace.c +++ b/drivers/block/xsysace.c @@ -88,7 +88,7 @@ #include #include #include -#include +#include #include #include #include @@ -209,6 +209,8 @@ struct ace_device { struct device *dev; struct request_queue *queue; struct gendisk *gd; + struct blk_mq_tag_set tag_set; + struct list_head rq_list; /* Inserted CF card parameters */ u16 cf_id[ATA_ID_WORDS]; @@ -462,18 +464,26 @@ static inline void ace_fsm_yieldirq(struct ace_device *ace) ace->fsm_continue_flag = 0; } +static bool ace_has_next_request(struct request_queue *q) +{ + struct ace_device *ace = q->queuedata; + + return !list_empty(&ace->rq_list); +} + /* Get the next read/write request; ending requests that we don't handle */ static struct request *ace_get_next_request(struct request_queue *q) { - struct request *req; + struct ace_device *ace = q->queuedata; + struct request *rq; - while ((req = blk_peek_request(q)) != NULL) { - if (!blk_rq_is_passthrough(req)) - break; - blk_start_request(req); - __blk_end_request_all(req, BLK_STS_IOERR); + rq = list_first_entry_or_null(&ace->rq_list, struct request, queuelist); + if (rq) { + list_del_init(&rq->queuelist); + blk_mq_start_request(rq); } - return req; + + return NULL; } static void ace_fsm_dostate(struct ace_device *ace) @@ -499,11 +509,11 @@ static void ace_fsm_dostate(struct ace_device *ace) /* Drop all in-flight and pending requests */ if (ace->req) { - __blk_end_request_all(ace->req, BLK_STS_IOERR); + blk_mq_end_request(ace->req, BLK_STS_IOERR); ace->req = NULL; } - while ((req = blk_fetch_request(ace->queue)) != NULL) - __blk_end_request_all(req, BLK_STS_IOERR); + while ((req = ace_get_next_request(ace->queue)) != NULL) + blk_mq_end_request(req, BLK_STS_IOERR); /* Drop back to IDLE state and notify waiters */ ace->fsm_state = ACE_FSM_STATE_IDLE; @@ -517,7 +527,7 @@ static void ace_fsm_dostate(struct ace_device *ace) switch (ace->fsm_state) { case ACE_FSM_STATE_IDLE: /* See if there is anything to do */ - if (ace->id_req_count || ace_get_next_request(ace->queue)) { + if (ace->id_req_count || ace_has_next_request(ace->queue)) { ace->fsm_iter_num++; ace->fsm_state = ACE_FSM_STATE_REQ_LOCK; mod_timer(&ace->stall_timer, jiffies + HZ); @@ -651,7 +661,6 @@ static void ace_fsm_dostate(struct ace_device *ace) ace->fsm_state = ACE_FSM_STATE_IDLE; break; } - blk_start_request(req); /* Okay, it's a data request, set it up for transfer */ dev_dbg(ace->dev, @@ -728,7 +737,8 @@ static void ace_fsm_dostate(struct ace_device *ace) } /* bio finished; is there another one? */ - if (__blk_end_request_cur(ace->req, BLK_STS_OK)) { + if (blk_update_request(ace->req, BLK_STS_OK, + blk_rq_cur_bytes(ace->req))) { /* dev_dbg(ace->dev, "next block; h=%u c=%u\n", * blk_rq_sectors(ace->req), * blk_rq_cur_sectors(ace->req)); @@ -854,17 +864,23 @@ static irqreturn_t ace_interrupt(int irq, void *dev_id) /* --------------------------------------------------------------------- * Block ops */ -static void ace_request(struct request_queue * q) +static blk_status_t ace_queue_rq(struct blk_mq_hw_ctx *hctx, + const struct blk_mq_queue_data *bd) { - struct request *req; - struct ace_device *ace; + struct ace_device *ace = hctx->queue->queuedata; + struct request *req = bd->rq; - req = ace_get_next_request(q); - - if (req) { - ace = req->rq_disk->private_data; - tasklet_schedule(&ace->fsm_tasklet); + if (blk_rq_is_passthrough(req)) { + blk_mq_start_request(req); + return BLK_STS_IOERR; } + + spin_lock_irq(&ace->lock); + list_add_tail(&req->queuelist, &ace->rq_list); + spin_unlock_irq(&ace->lock); + + tasklet_schedule(&ace->fsm_tasklet); + return BLK_STS_OK; } static unsigned int ace_check_events(struct gendisk *gd, unsigned int clearing) @@ -957,11 +973,16 @@ static const struct block_device_operations ace_fops = { .getgeo = ace_getgeo, }; +static const struct blk_mq_ops ace_mq_ops = { + .queue_rq = ace_queue_rq, +}; + /* -------------------------------------------------------------------- * SystemACE device setup/teardown code */ static int ace_setup(struct ace_device *ace) { + struct blk_mq_tag_set *set; u16 version; u16 val; int rc; @@ -972,6 +993,7 @@ static int ace_setup(struct ace_device *ace) spin_lock_init(&ace->lock); init_completion(&ace->id_completion); + INIT_LIST_HEAD(&ace->rq_list); /* * Map the device @@ -989,9 +1011,25 @@ static int ace_setup(struct ace_device *ace) /* * Initialize the request queue */ - ace->queue = blk_init_queue(ace_request, &ace->lock); - if (ace->queue == NULL) + set = &ace->tag_set; + set->ops = &ace_mq_ops; + set->nr_hw_queues = 1; + set->queue_depth = 2; + set->numa_node = NUMA_NO_NODE; + set->flags = BLK_MQ_F_SHOULD_MERGE; + rc = blk_mq_alloc_tag_set(set); + if (rc) goto err_blk_initq; + + ace->queue = blk_mq_init_queue(set); + if (IS_ERR(ace->queue)) { + rc = PTR_ERR(ace->queue); + ace->queue = NULL; + blk_mq_free_tag_set(&ace->tag_set); + goto err_blk_initq; + } + ace->queue->queuedata = ace; + blk_queue_logical_block_size(ace->queue, 512); blk_queue_bounce_limit(ace->queue, BLK_BOUNCE_HIGH); @@ -1065,6 +1103,7 @@ static int ace_setup(struct ace_device *ace) err_read: put_disk(ace->gd); err_alloc_disk: + blk_mq_free_tag_set(&ace->tag_set); blk_cleanup_queue(ace->queue); err_blk_initq: iounmap(ace->baseaddr); @@ -1081,8 +1120,10 @@ static void ace_teardown(struct ace_device *ace) put_disk(ace->gd); } - if (ace->queue) + if (ace->queue) { + blk_mq_free_tag_set(&ace->tag_set); blk_cleanup_queue(ace->queue); + } tasklet_kill(&ace->fsm_tasklet); -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: From: Jens Axboe To: linux-block@vger.kernel.org Cc: Jens Axboe Subject: [PATCH 04/17] paride: convert pcd to blk-mq Date: Thu, 11 Oct 2018 10:58:56 -0600 Message-Id: <20181011165909.32615-5-axboe@kernel.dk> In-Reply-To: <20181011165909.32615-1-axboe@kernel.dk> References: <20181011165909.32615-1-axboe@kernel.dk> List-ID: Signed-off-by: Jens Axboe --- drivers/block/paride/pcd.c | 98 +++++++++++++++++++++++++------------- 1 file changed, 66 insertions(+), 32 deletions(-) diff --git a/drivers/block/paride/pcd.c b/drivers/block/paride/pcd.c index a026211afb51..f2b82e3510d8 100644 --- a/drivers/block/paride/pcd.c +++ b/drivers/block/paride/pcd.c @@ -137,7 +137,7 @@ enum {D_PRT, D_PRO, D_UNI, D_MOD, D_SLV, D_DLY}; #include #include #include -#include