All of lore.kernel.org
 help / color / mirror / Atom feed
From: Yaroslav Isakov <yaroslav.isakov@gmail.com>
To: Keith Busch <kbusch@kernel.org>
Cc: linux-nvme@lists.infradead.org
Subject: Re: NVME is not using CPU0
Date: Mon, 9 Mar 2020 10:49:43 +0100	[thread overview]
Message-ID: <CADS+iDXQ4HtyXSTETPqQdJS=1tKdd93vCBtAbqwXEfWt3w7GBA@mail.gmail.com> (raw)
In-Reply-To: <20200309015524.GA4567@redsun51.ssa.fujisawa.hgst.com>

Hello, Keith! I've tried to pin fio process's threads, but with no
luck. On my system, your command gave this:
0, 1
2
3
4
5
6
7
So, it looks like first queue should use two CPUs, but using only
CPU1. Oh, and if I'm run fio with 2 threads, without pinning, I can
see increasing numbers in /proc/interrupts for all CPUs besides CPU0

пн, 9 мар. 2020 г. в 02:55, Keith Busch <kbusch@kernel.org>:
>
> On Mon, Mar 09, 2020 at 12:46:24AM +0100, Yaroslav Isakov wrote:
> > Hello! I found that my nvme disk is not assigning any queue on CPU0. I
> > think, that maybe it could be a bug, related to admin queue. Function
> > queue_irq_offset return 1 with note that this is for admin queue. But
> > on my system, admin queue is on the same CPU as q2. Here is part of
> > /proc/interrupts
>
> All CPUs are assigned an nvme IO queue. Pin your IO process to CPU 0, it
> will function just fine. Another way to confirm is run:
>
>   # cat /sys/block/nvme0n1/mq/*/cpu_list
>
> Every CPU should be accounted for in the output.
>
> What you've observed is that your controller doesn't support enough IO
> queues or MSI vectors (or both) to assign to each CPU. It just means that
> a command you submit on the queue assigned to CPU 0 will get completed on
> a different CPU.

_______________________________________________
linux-nvme mailing list
linux-nvme@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-nvme

  reply	other threads:[~2020-03-09  9:50 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-03-08 23:46 NVME is not using CPU0 Yaroslav Isakov
2020-03-09  1:55 ` Keith Busch
2020-03-09  9:49   ` Yaroslav Isakov [this message]
2020-03-09 14:16     ` Keith Busch
2020-03-09 23:29       ` Yaroslav Isakov
2020-03-10  3:11         ` Keith Busch

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='CADS+iDXQ4HtyXSTETPqQdJS=1tKdd93vCBtAbqwXEfWt3w7GBA@mail.gmail.com' \
    --to=yaroslav.isakov@gmail.com \
    --cc=kbusch@kernel.org \
    --cc=linux-nvme@lists.infradead.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.