From: "Rafael J. Wysocki" <rafael@kernel.org> To: Mario Limonciello <Mario.Limonciello@dell.com> Cc: "Rafael J. Wysocki" <rafael@kernel.org>, Kai-Heng Feng <kai.heng.feng@canonical.com>, "Rafael J. Wysocki" <rjw@rjwysocki.net>, Keith Busch <kbusch@kernel.org>, Keith Busch <keith.busch@intel.com>, Christoph Hellwig <hch@lst.de>, Sagi Grimberg <sagi@grimberg.me>, linux-nvme <linux-nvme@lists.infradead.org>, Linux PM <linux-pm@vger.kernel.org>, Linux Kernel Mailing List <linux-kernel@vger.kernel.org> Subject: Re: [Regression] Commit "nvme/pci: Use host managed power state for suspend" has problems Date: Tue, 30 Jul 2019 00:05:43 +0200 [thread overview] Message-ID: <CAJZ5v0gibD_oboFt7x7VjUTe4mw+mZxHcOiFEEcWdw8dUZ5RXw@mail.gmail.com> (raw) In-Reply-To: <868a042a9422463fa1166653982bb985@AUSX13MPC105.AMER.DELL.COM> On Mon, Jul 29, 2019 at 5:53 PM <Mario.Limonciello@dell.com> wrote: > > > -----Original Message----- > > From: Rafael J. Wysocki <rafael@kernel.org> > > Sent: Saturday, July 27, 2019 7:55 AM > > To: Kai-Heng Feng > > Cc: Rafael J. Wysocki; Keith Busch; Busch, Keith; Christoph Hellwig; Sagi Grimberg; > > linux-nvme@lists.infradead.org; Limonciello, Mario; Linux PM; LKML > > Subject: Re: [Regression] Commit "nvme/pci: Use host managed power state for > > suspend" has problems > > > > > > [EXTERNAL EMAIL] > > > > On Fri, Jul 26, 2019 at 4:03 PM Kai-Heng Feng > > <kai.heng.feng@canonical.com> wrote: > > > > > > at 04:02, Rafael J. Wysocki <rjw@rjwysocki.net> wrote: > > > > > > > On Thursday, July 25, 2019 9:52:59 PM CEST Keith Busch wrote: > > > >> On Thu, Jul 25, 2019 at 09:48:57PM +0200, Rafael J. Wysocki wrote: > > > >>> NVME Identify Controller: > > > >>> vid : 0x1c5c > > > >>> ssvid : 0x1c5c > > > >>> sn : MS92N171312902J0N > > > >>> mn : PC401 NVMe SK hynix 256GB > > > >>> fr : 80007E00 > > > >>> rab : 2 > > > >>> ieee : ace42e > > > >>> cmic : 0 > > > >>> mdts : 5 > > > >>> cntlid : 1 > > > >>> ver : 10200 > > > >>> rtd3r : 7a120 > > > >>> rtd3e : 1e8480 > > > >>> oaes : 0x200 > > > >>> ctratt : 0 > > > >>> oacs : 0x17 > > > >>> acl : 7 > > > >>> aerl : 3 > > > >>> frmw : 0x14 > > > >>> lpa : 0x2 > > > >>> elpe : 255 > > > >>> npss : 4 > > > >>> avscc : 0x1 > > > >>> apsta : 0x1 > > > >>> wctemp : 352 > > > >>> cctemp : 354 > > > >>> mtfa : 0 > > > >>> hmpre : 0 > > > >>> hmmin : 0 > > > >>> tnvmcap : 0 > > > >>> unvmcap : 0 > > > >>> rpmbs : 0 > > > >>> edstt : 10 > > > >>> dsto : 0 > > > >>> fwug : 0 > > > >>> kas : 0 > > > >>> hctma : 0 > > > >>> mntmt : 0 > > > >>> mxtmt : 0 > > > >>> sanicap : 0 > > > >>> hmminds : 0 > > > >>> hmmaxd : 0 > > > >>> nsetidmax : 0 > > > >>> anatt : 0 > > > >>> anacap : 0 > > > >>> anagrpmax : 0 > > > >>> nanagrpid : 0 > > > >>> sqes : 0x66 > > > >>> cqes : 0x44 > > > >>> maxcmd : 0 > > > >>> nn : 1 > > > >>> oncs : 0x1f > > > >>> fuses : 0x1 > > > >>> fna : 0 > > > >>> vwc : 0x1 > > > >>> awun : 7 > > > >>> awupf : 7 > > > >>> nvscc : 1 > > > >>> acwu : 7 > > > >>> sgls : 0 > > > >>> mnan : 0 > > > >>> subnqn : > > > >>> ioccsz : 0 > > > >>> iorcsz : 0 > > > >>> icdoff : 0 > > > >>> ctrattr : 0 > > > >>> msdbd : 0 > > > >>> ps 0 : mp:6.00W operational enlat:5 exlat:5 rrt:0 rrl:0 > > > >>> rwt:0 rwl:0 idle_power:- active_power:- > > > >>> ps 1 : mp:3.80W operational enlat:30 exlat:30 rrt:1 rrl:1 > > > >>> rwt:1 rwl:1 idle_power:- active_power:- > > > >>> ps 2 : mp:2.40W operational enlat:100 exlat:100 rrt:2 rrl:2 > > > >>> rwt:2 rwl:2 idle_power:- active_power:- > > > >>> ps 3 : mp:0.0700W non-operational enlat:1000 exlat:1000 rrt:3 rrl:3 > > > >>> rwt:3 rwl:3 idle_power:- active_power:- > > > >>> ps 4 : mp:0.0070W non-operational enlat:1000 exlat:5000 rrt:3 rrl:3 > > > >>> rwt:3 rwl:3 idle_power:- active_power:- > > > >> > > > >> Hm, nothing stands out as something we can use to determine if we should > > > >> skip the nvme specific settings or allow D3. I've no other ideas at the > > > >> moment for what we may check. > > > > > > > > Well, do ASPM settings matter here? > > > > > > Seems like it's a regression in the firmware. > > > > > > The issue happens in version 80007E00 but not version 80006E00. > > > > So you mean the NVMe firmware, to be entirely precise. > > Yes. > > > > > > I am not sure how to downgrade it under Linux though. > > > > Me neither. > > I'll ask the storage team to ask Hynix to make both these FW available on LVFS. > Fwupd can upgrade and downgrade firmware when the binaries are made available. > > They could potentially be pulled directly out of the Windows executables too, but I don't > know how to identify them myself. Well, thanks, but I'm not quite convinced that the NVMe is the reason why my 9380 cannot reach SLP_S0 and this is my production system, so I'd rather not do NVMe firmware downgrade experiments on it. :-) > > > > > > The firmware changelog [1] is very interesting: > > > - Improves the performance of the solid-state drive (SSD) by distributing > > > power into the SSD efficiently according to the power state of the system. > > > > > > [1] > > > > > https://www.dell.com/support/home/us/en/04/drivers/driversdetails?driverid=m > > cxm8 > > > > Huh. > > > > It looks like something else prevents the PCH on my 9380 from reaching > > the right state for S0ix, though. I still need to find out what it > > is.
WARNING: multiple messages have this Message-ID (diff)
From: rafael@kernel.org (Rafael J. Wysocki) Subject: [Regression] Commit "nvme/pci: Use host managed power state for suspend" has problems Date: Tue, 30 Jul 2019 00:05:43 +0200 [thread overview] Message-ID: <CAJZ5v0gibD_oboFt7x7VjUTe4mw+mZxHcOiFEEcWdw8dUZ5RXw@mail.gmail.com> (raw) In-Reply-To: <868a042a9422463fa1166653982bb985@AUSX13MPC105.AMER.DELL.COM> On Mon, Jul 29, 2019@5:53 PM <Mario.Limonciello@dell.com> wrote: > > > -----Original Message----- > > From: Rafael J. Wysocki <rafael at kernel.org> > > Sent: Saturday, July 27, 2019 7:55 AM > > To: Kai-Heng Feng > > Cc: Rafael J. Wysocki; Keith Busch; Busch, Keith; Christoph Hellwig; Sagi Grimberg; > > linux-nvme at lists.infradead.org; Limonciello, Mario; Linux PM; LKML > > Subject: Re: [Regression] Commit "nvme/pci: Use host managed power state for > > suspend" has problems > > > > > > [EXTERNAL EMAIL] > > > > On Fri, Jul 26, 2019 at 4:03 PM Kai-Heng Feng > > <kai.heng.feng@canonical.com> wrote: > > > > > >@04:02, Rafael J. Wysocki <rjw@rjwysocki.net> wrote: > > > > > > > On Thursday, July 25, 2019 9:52:59 PM CEST Keith Busch wrote: > > > >> On Thu, Jul 25, 2019@09:48:57PM +0200, Rafael J. Wysocki wrote: > > > >>> NVME Identify Controller: > > > >>> vid : 0x1c5c > > > >>> ssvid : 0x1c5c > > > >>> sn : MS92N171312902J0N > > > >>> mn : PC401 NVMe SK hynix 256GB > > > >>> fr : 80007E00 > > > >>> rab : 2 > > > >>> ieee : ace42e > > > >>> cmic : 0 > > > >>> mdts : 5 > > > >>> cntlid : 1 > > > >>> ver : 10200 > > > >>> rtd3r : 7a120 > > > >>> rtd3e : 1e8480 > > > >>> oaes : 0x200 > > > >>> ctratt : 0 > > > >>> oacs : 0x17 > > > >>> acl : 7 > > > >>> aerl : 3 > > > >>> frmw : 0x14 > > > >>> lpa : 0x2 > > > >>> elpe : 255 > > > >>> npss : 4 > > > >>> avscc : 0x1 > > > >>> apsta : 0x1 > > > >>> wctemp : 352 > > > >>> cctemp : 354 > > > >>> mtfa : 0 > > > >>> hmpre : 0 > > > >>> hmmin : 0 > > > >>> tnvmcap : 0 > > > >>> unvmcap : 0 > > > >>> rpmbs : 0 > > > >>> edstt : 10 > > > >>> dsto : 0 > > > >>> fwug : 0 > > > >>> kas : 0 > > > >>> hctma : 0 > > > >>> mntmt : 0 > > > >>> mxtmt : 0 > > > >>> sanicap : 0 > > > >>> hmminds : 0 > > > >>> hmmaxd : 0 > > > >>> nsetidmax : 0 > > > >>> anatt : 0 > > > >>> anacap : 0 > > > >>> anagrpmax : 0 > > > >>> nanagrpid : 0 > > > >>> sqes : 0x66 > > > >>> cqes : 0x44 > > > >>> maxcmd : 0 > > > >>> nn : 1 > > > >>> oncs : 0x1f > > > >>> fuses : 0x1 > > > >>> fna : 0 > > > >>> vwc : 0x1 > > > >>> awun : 7 > > > >>> awupf : 7 > > > >>> nvscc : 1 > > > >>> acwu : 7 > > > >>> sgls : 0 > > > >>> mnan : 0 > > > >>> subnqn : > > > >>> ioccsz : 0 > > > >>> iorcsz : 0 > > > >>> icdoff : 0 > > > >>> ctrattr : 0 > > > >>> msdbd : 0 > > > >>> ps 0 : mp:6.00W operational enlat:5 exlat:5 rrt:0 rrl:0 > > > >>> rwt:0 rwl:0 idle_power:- active_power:- > > > >>> ps 1 : mp:3.80W operational enlat:30 exlat:30 rrt:1 rrl:1 > > > >>> rwt:1 rwl:1 idle_power:- active_power:- > > > >>> ps 2 : mp:2.40W operational enlat:100 exlat:100 rrt:2 rrl:2 > > > >>> rwt:2 rwl:2 idle_power:- active_power:- > > > >>> ps 3 : mp:0.0700W non-operational enlat:1000 exlat:1000 rrt:3 rrl:3 > > > >>> rwt:3 rwl:3 idle_power:- active_power:- > > > >>> ps 4 : mp:0.0070W non-operational enlat:1000 exlat:5000 rrt:3 rrl:3 > > > >>> rwt:3 rwl:3 idle_power:- active_power:- > > > >> > > > >> Hm, nothing stands out as something we can use to determine if we should > > > >> skip the nvme specific settings or allow D3. I've no other ideas at the > > > >> moment for what we may check. > > > > > > > > Well, do ASPM settings matter here? > > > > > > Seems like it's a regression in the firmware. > > > > > > The issue happens in version 80007E00 but not version 80006E00. > > > > So you mean the NVMe firmware, to be entirely precise. > > Yes. > > > > > > I am not sure how to downgrade it under Linux though. > > > > Me neither. > > I'll ask the storage team to ask Hynix to make both these FW available on LVFS. > Fwupd can upgrade and downgrade firmware when the binaries are made available. > > They could potentially be pulled directly out of the Windows executables too, but I don't > know how to identify them myself. Well, thanks, but I'm not quite convinced that the NVMe is the reason why my 9380 cannot reach SLP_S0 and this is my production system, so I'd rather not do NVMe firmware downgrade experiments on it. :-) > > > > > > The firmware changelog [1] is very interesting: > > > - Improves the performance of the solid-state drive (SSD) by distributing > > > power into the SSD efficiently according to the power state of the system. > > > > > > [1] > > > > > https://www.dell.com/support/home/us/en/04/drivers/driversdetails?driverid=m > > cxm8 > > > > Huh. > > > > It looks like something else prevents the PCH on my 9380 from reaching > > the right state for S0ix, though. I still need to find out what it > > is.
next prev parent reply other threads:[~2019-07-29 22:05 UTC|newest] Thread overview: 150+ messages / expand[flat|nested] mbox.gz Atom feed top 2019-07-25 9:51 [Regression] Commit "nvme/pci: Use host managed power state for suspend" has problems Rafael J. Wysocki 2019-07-25 9:51 ` Rafael J. Wysocki 2019-07-25 14:02 ` Kai-Heng Feng 2019-07-25 14:02 ` Kai-Heng Feng 2019-07-25 16:23 ` Mario.Limonciello 2019-07-25 16:23 ` Mario.Limonciello 2019-07-25 17:03 ` Rafael J. Wysocki 2019-07-25 17:03 ` Rafael J. Wysocki 2019-07-25 17:23 ` Mario.Limonciello 2019-07-25 17:23 ` Mario.Limonciello 2019-07-25 18:20 ` Kai-Heng Feng 2019-07-25 18:20 ` Kai-Heng Feng 2019-07-25 19:09 ` Mario.Limonciello 2019-07-25 19:09 ` Mario.Limonciello 2019-07-30 10:45 ` Rafael J. Wysocki 2019-07-30 10:45 ` Rafael J. Wysocki 2019-07-30 14:41 ` Keith Busch 2019-07-30 14:41 ` Keith Busch 2019-07-30 17:14 ` Mario.Limonciello 2019-07-30 17:14 ` Mario.Limonciello 2019-07-30 18:50 ` Kai-Heng Feng 2019-07-30 18:50 ` Kai-Heng Feng 2019-07-30 19:19 ` Keith Busch 2019-07-30 19:19 ` Keith Busch 2019-07-30 21:05 ` Mario.Limonciello 2019-07-30 21:05 ` Mario.Limonciello 2019-07-30 21:31 ` Keith Busch 2019-07-30 21:31 ` Keith Busch 2019-07-31 21:25 ` Rafael J. Wysocki 2019-07-31 21:25 ` Rafael J. Wysocki 2019-07-31 22:19 ` Keith Busch 2019-07-31 22:19 ` Keith Busch 2019-07-31 22:33 ` Rafael J. Wysocki 2019-07-31 22:33 ` Rafael J. Wysocki 2019-08-01 9:05 ` Kai-Heng Feng 2019-08-01 9:05 ` Kai-Heng Feng 2019-08-01 17:29 ` Rafael J. Wysocki 2019-08-01 17:29 ` Rafael J. Wysocki 2019-08-01 19:05 ` Mario.Limonciello 2019-08-01 19:05 ` Mario.Limonciello 2019-08-01 22:26 ` Rafael J. Wysocki 2019-08-01 22:26 ` Rafael J. Wysocki 2019-08-02 10:55 ` Kai-Heng Feng 2019-08-02 10:55 ` Kai-Heng Feng 2019-08-02 11:04 ` Rafael J. Wysocki 2019-08-02 11:04 ` Rafael J. Wysocki 2019-08-05 19:13 ` Kai-Heng Feng 2019-08-05 19:13 ` Kai-Heng Feng 2019-08-05 21:28 ` Rafael J. Wysocki 2019-08-05 21:28 ` Rafael J. Wysocki 2019-08-06 14:02 ` Mario.Limonciello 2019-08-06 14:02 ` Mario.Limonciello 2019-08-06 15:00 ` Rafael J. Wysocki 2019-08-06 15:00 ` Rafael J. Wysocki 2019-08-07 10:29 ` Rafael J. Wysocki 2019-08-07 10:29 ` Rafael J. Wysocki 2019-08-01 20:22 ` Keith Busch 2019-08-01 20:22 ` Keith Busch 2019-08-07 9:48 ` Rafael J. Wysocki 2019-08-07 9:48 ` Rafael J. Wysocki 2019-08-07 10:45 ` Christoph Hellwig 2019-08-07 10:45 ` Christoph Hellwig 2019-08-07 10:54 ` Rafael J. Wysocki 2019-08-07 10:54 ` Rafael J. Wysocki 2019-08-07 9:53 ` [PATCH] nvme-pci: Do not prevent PCI bus-level PM from being used Rafael J. Wysocki 2019-08-07 9:53 ` Rafael J. Wysocki 2019-08-07 10:14 ` Rafael J. Wysocki 2019-08-07 10:14 ` Rafael J. Wysocki 2019-08-07 10:43 ` Christoph Hellwig 2019-08-07 10:43 ` Christoph Hellwig 2019-08-07 14:37 ` Keith Busch 2019-08-07 14:37 ` Keith Busch 2019-08-08 8:36 ` [PATCH] nvme-pci: Allow PCI bus-level PM to be used if ASPM is disabled Rafael J. Wysocki 2019-08-08 8:36 ` Rafael J. Wysocki 2019-08-08 8:48 ` Christoph Hellwig 2019-08-08 8:48 ` Christoph Hellwig 2019-08-08 9:06 ` Rafael J. Wysocki 2019-08-08 9:06 ` Rafael J. Wysocki 2019-08-08 10:03 ` [PATCH v2 0/2] " Rafael J. Wysocki 2019-08-08 10:03 ` Rafael J. Wysocki 2019-08-08 10:06 ` [PATCH v2 1/2] PCI: PCIe: ASPM: Introduce pcie_aspm_enabled_mask() Rafael J. Wysocki 2019-08-08 10:06 ` Rafael J. Wysocki 2019-08-08 13:15 ` Bjorn Helgaas 2019-08-08 13:15 ` Bjorn Helgaas 2019-08-08 14:48 ` Rafael J. Wysocki 2019-08-08 14:48 ` Rafael J. Wysocki 2019-08-08 10:10 ` [PATCH v2 2/2] nvme-pci: Allow PCI bus-level PM to be used if ASPM is disabled Rafael J. Wysocki 2019-08-08 10:10 ` Rafael J. Wysocki 2019-08-08 13:43 ` Bjorn Helgaas 2019-08-08 13:43 ` Bjorn Helgaas 2019-08-08 14:47 ` Rafael J. Wysocki 2019-08-08 14:47 ` Rafael J. Wysocki 2019-08-08 17:06 ` Rafael J. Wysocki 2019-08-08 17:06 ` Rafael J. Wysocki 2019-08-08 18:39 ` Bjorn Helgaas 2019-08-08 18:39 ` Bjorn Helgaas 2019-08-08 20:01 ` Keith Busch 2019-08-08 20:01 ` Keith Busch 2019-08-08 20:05 ` Mario.Limonciello 2019-08-08 20:05 ` Mario.Limonciello 2019-08-08 20:41 ` Rafael J. Wysocki 2019-08-08 20:41 ` Rafael J. Wysocki 2019-08-09 4:47 ` Bjorn Helgaas 2019-08-09 4:47 ` Bjorn Helgaas 2019-08-09 8:04 ` Rafael J. Wysocki 2019-08-09 8:04 ` Rafael J. Wysocki 2019-08-08 21:51 ` [PATCH v3 0/2] " Rafael J. Wysocki 2019-08-08 21:51 ` Rafael J. Wysocki 2019-08-08 21:55 ` [PATCH v3 1/2] PCI: PCIe: ASPM: Introduce pcie_aspm_enabled() Rafael J. Wysocki 2019-08-08 21:55 ` Rafael J. Wysocki 2019-08-09 4:50 ` Bjorn Helgaas 2019-08-09 4:50 ` Bjorn Helgaas 2019-08-09 8:00 ` Rafael J. Wysocki 2019-08-09 8:00 ` Rafael J. Wysocki 2019-10-07 22:34 ` Bjorn Helgaas 2019-10-07 22:34 ` Bjorn Helgaas 2019-10-08 9:27 ` Rafael J. Wysocki 2019-10-08 9:27 ` Rafael J. Wysocki 2019-10-08 21:16 ` Bjorn Helgaas 2019-10-08 21:16 ` Bjorn Helgaas 2019-10-08 22:54 ` Rafael J. Wysocki 2019-10-08 22:54 ` Rafael J. Wysocki 2019-10-09 12:49 ` Bjorn Helgaas 2019-10-09 12:49 ` Bjorn Helgaas 2019-08-08 21:58 ` [PATCH v3 2/2] nvme-pci: Allow PCI bus-level PM to be used if ASPM is disabled Rafael J. Wysocki 2019-08-08 21:58 ` Rafael J. Wysocki 2019-08-08 22:13 ` [PATCH v3 0/2] " Keith Busch 2019-08-08 22:13 ` Keith Busch 2019-08-09 8:05 ` Rafael J. Wysocki 2019-08-09 8:05 ` Rafael J. Wysocki 2019-08-09 14:52 ` Keith Busch 2019-08-09 14:52 ` Keith Busch 2019-07-25 16:59 ` [Regression] Commit "nvme/pci: Use host managed power state for suspend" has problems Rafael J. Wysocki 2019-07-25 16:59 ` Rafael J. Wysocki 2019-07-25 14:52 ` Keith Busch 2019-07-25 14:52 ` Keith Busch 2019-07-25 19:48 ` Rafael J. Wysocki 2019-07-25 19:48 ` Rafael J. Wysocki 2019-07-25 19:52 ` Keith Busch 2019-07-25 19:52 ` Keith Busch 2019-07-25 20:02 ` Rafael J. Wysocki 2019-07-25 20:02 ` Rafael J. Wysocki 2019-07-26 14:02 ` Kai-Heng Feng 2019-07-26 14:02 ` Kai-Heng Feng 2019-07-27 12:55 ` Rafael J. Wysocki 2019-07-27 12:55 ` Rafael J. Wysocki 2019-07-29 15:51 ` Mario.Limonciello 2019-07-29 15:51 ` Mario.Limonciello 2019-07-29 22:05 ` Rafael J. Wysocki [this message] 2019-07-29 22:05 ` Rafael J. Wysocki
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=CAJZ5v0gibD_oboFt7x7VjUTe4mw+mZxHcOiFEEcWdw8dUZ5RXw@mail.gmail.com \ --to=rafael@kernel.org \ --cc=Mario.Limonciello@dell.com \ --cc=hch@lst.de \ --cc=kai.heng.feng@canonical.com \ --cc=kbusch@kernel.org \ --cc=keith.busch@intel.com \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-nvme@lists.infradead.org \ --cc=linux-pm@vger.kernel.org \ --cc=rjw@rjwysocki.net \ --cc=sagi@grimberg.me \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.