[PATCH 0/5] iommu/amd: fixes for suspend/resume

[PATCH 0/5] iommu/amd: fixes for suspend/resume

[Maxim Levitsky]

As I sadly found out, a s3 cycle makes the AMD's iommu stop sending interrupts
until the system is rebooted.

I only noticed it now because otherwise the IOMMU works, and these interrupts
are only used for errors and for GA log which I tend not to use by
making my VMs do mwait/pause/etc in guest (cpu-pm=on).

There are two issues here that prevent interrupts from being generated after
s3 cycle:

1. GA log base address was not restored after resume, and was all zeroed
after resume (by BIOS or such).

In theory if BIOS writes some junk to it, that can even cause a memory corruption.
Patch 2 fixes that.

2. INTX (aka x2apic mode) settings were not restored after resume.
That mode is used regardless if the host uses/supports x2apic, but rather when
the IOMMU supports it, and mine does.
Patches 3-4 fix that.

Note that there is still one slight (userspace) bug remaining:
During suspend all but the boot CPU are offlined and then after resume
are onlined again.

The offlining moves all non-affinity managed interrupts to CPU0, and
later when all other CPUs are onlined, there is nothing in the kernel
to spread back the interrupts over the cores.

The userspace 'irqbalance' daemon does fix this but it seems to ignore
the IOMMU interrupts in INTX mode since they are not attached to any
PCI device, and thus they remain on CPU0 after a s3 cycle,
which is suboptimal when the system has multiple IOMMUs
(mine has 4 of them).

Setting the IRQ affinity manually via /proc/irq/ does work.

This was tested on my 3970X with both INTX and regular MSI mode (later was enabled
by patching out INTX detection), by running a guest with AVIC enabled and with
a PCI assigned device (network card), and observing interrupts from
IOMMU while guest is mostly idle.

This was also tested on my AMD laptop with 4650U (which has the same issue)
(I tested only INTX mode)

Patch 1 is a small refactoring to remove an unused struct field.

Best regards,
   Maxim Levitsky

Maxim Levitsky (5):
  iommu/amd: restore GA log/tail pointer on host resume
  iommu/amd: x2apic mode: re-enable after resume
  iommu/amd: x2apic mode: setup the INTX registers on mask/unmask
  iommu/amd: x2apic mode: mask/unmask interrupts on suspend/resume
  iommu/amd: remove useless irq affinity notifier

 drivers/iommu/amd/amd_iommu_types.h |   2 -
 drivers/iommu/amd/init.c            | 107 +++++++++++++++-------------
 2 files changed, 58 insertions(+), 51 deletions(-)

-- 
2.26.3

[PATCH 1/5] iommu/amd: restore GA log/tail pointer on host resume

[Maxim Levitsky]

This will give IOMMU GA log a chance to work after resume
from s3/s4.

Fixes: 8bda0cfbdc1a6 ("iommu/amd: Detect and initialize guest vAPIC log")

Signed-off-by: Maxim Levitsky <mlevitsk@redhat.com>
---
 drivers/iommu/amd/init.c | 31 +++++++++++++++----------------
 1 file changed, 15 insertions(+), 16 deletions(-)

diff --git a/drivers/iommu/amd/init.c b/drivers/iommu/amd/init.c
index 1eacd43cb4368..8dae85fcfc2eb 100644
--- a/drivers/iommu/amd/init.c
+++ b/drivers/iommu/amd/init.c
@@ -806,16 +806,27 @@ static int iommu_ga_log_enable(struct amd_iommu *iommu)
 {
 #ifdef CONFIG_IRQ_REMAP
 	u32 status, i;
+	u64 entry;
 
 	if (!iommu->ga_log)
 		return -EINVAL;
 
-	status = readl(iommu->mmio_base + MMIO_STATUS_OFFSET);
-
 	/* Check if already running */
-	if (status & (MMIO_STATUS_GALOG_RUN_MASK))
+	status = readl(iommu->mmio_base + MMIO_STATUS_OFFSET);
+	if (WARN_ON(status & (MMIO_STATUS_GALOG_RUN_MASK)))
 		return 0;
 
+	entry = iommu_virt_to_phys(iommu->ga_log) | GA_LOG_SIZE_512;
+	memcpy_toio(iommu->mmio_base + MMIO_GA_LOG_BASE_OFFSET,
+		    &entry, sizeof(entry));
+	entry = (iommu_virt_to_phys(iommu->ga_log_tail) &
+		 (BIT_ULL(52)-1)) & ~7ULL;
+	memcpy_toio(iommu->mmio_base + MMIO_GA_LOG_TAIL_OFFSET,
+		    &entry, sizeof(entry));
+	writel(0x00, iommu->mmio_base + MMIO_GA_HEAD_OFFSET);
+	writel(0x00, iommu->mmio_base + MMIO_GA_TAIL_OFFSET);
+
+
 	iommu_feature_enable(iommu, CONTROL_GAINT_EN);
 	iommu_feature_enable(iommu, CONTROL_GALOG_EN);
 
@@ -825,7 +836,7 @@ static int iommu_ga_log_enable(struct amd_iommu *iommu)
 			break;
 	}
 
-	if (i >= LOOP_TIMEOUT)
+	if (WARN_ON(i >= LOOP_TIMEOUT))
 		return -EINVAL;
 #endif /* CONFIG_IRQ_REMAP */
 	return 0;
@@ -834,8 +845,6 @@ static int iommu_ga_log_enable(struct amd_iommu *iommu)
 static int iommu_init_ga_log(struct amd_iommu *iommu)
 {
 #ifdef CONFIG_IRQ_REMAP
-	u64 entry;
-
 	if (!AMD_IOMMU_GUEST_IR_VAPIC(amd_iommu_guest_ir))
 		return 0;
 
@@ -849,16 +858,6 @@ static int iommu_init_ga_log(struct amd_iommu *iommu)
 	if (!iommu->ga_log_tail)
 		goto err_out;
 
-	entry = iommu_virt_to_phys(iommu->ga_log) | GA_LOG_SIZE_512;
-	memcpy_toio(iommu->mmio_base + MMIO_GA_LOG_BASE_OFFSET,
-		    &entry, sizeof(entry));
-	entry = (iommu_virt_to_phys(iommu->ga_log_tail) &
-		 (BIT_ULL(52)-1)) & ~7ULL;
-	memcpy_toio(iommu->mmio_base + MMIO_GA_LOG_TAIL_OFFSET,
-		    &entry, sizeof(entry));
-	writel(0x00, iommu->mmio_base + MMIO_GA_HEAD_OFFSET);
-	writel(0x00, iommu->mmio_base + MMIO_GA_TAIL_OFFSET);
-
 	return 0;
 err_out:
 	free_ga_log(iommu);
-- 
2.26.3

[PATCH 2/5] iommu/amd: x2apic mode: re-enable after resume

[Maxim Levitsky]

Otherwise it is guaranteed to not work after the resume...

Fixes: 66929812955bb ("iommu/amd: Add support for X2APIC IOMMU interrupts")

Signed-off-by: Maxim Levitsky <mlevitsk@redhat.com>
---
 drivers/iommu/amd/init.c | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/drivers/iommu/amd/init.c b/drivers/iommu/amd/init.c
index 8dae85fcfc2eb..b905604f434e1 100644
--- a/drivers/iommu/amd/init.c
+++ b/drivers/iommu/amd/init.c
@@ -2172,7 +2172,6 @@ static int iommu_setup_intcapxt(struct amd_iommu *iommu)
 		return ret;
 	}
 
-	iommu_feature_enable(iommu, CONTROL_INTCAPXT_EN);
 	return 0;
 }
 
@@ -2195,6 +2194,10 @@ static int iommu_init_irq(struct amd_iommu *iommu)
 
 	iommu->int_enabled = true;
 enable_faults:
+
+	if (amd_iommu_xt_mode == IRQ_REMAP_X2APIC_MODE)
+		iommu_feature_enable(iommu, CONTROL_INTCAPXT_EN);
+
 	iommu_feature_enable(iommu, CONTROL_EVT_INT_EN);
 
 	if (iommu->ppr_log != NULL)
-- 
2.26.3

[PATCH 3/5] iommu/amd: x2apic mode: setup the INTX registers on mask/unmask

[Maxim Levitsky]

This is more logically correct and will also allow us to
to use mask/unmask logic to restore INTX setttings after
the resume from s3/s4.

Fixes: 66929812955bb ("iommu/amd: Add support for X2APIC IOMMU interrupts")

Signed-off-by: Maxim Levitsky <mlevitsk@redhat.com>
---
 drivers/iommu/amd/init.c | 65 ++++++++++++++++++++--------------------
 1 file changed, 33 insertions(+), 32 deletions(-)

diff --git a/drivers/iommu/amd/init.c b/drivers/iommu/amd/init.c
index b905604f434e1..9e895bb8086a6 100644
--- a/drivers/iommu/amd/init.c
+++ b/drivers/iommu/amd/init.c
@@ -2015,48 +2015,18 @@ union intcapxt {
 	};
 } __attribute__ ((packed));
 
-/*
- * There isn't really any need to mask/unmask at the irqchip level because
- * the 64-bit INTCAPXT registers can be updated atomically without tearing
- * when the affinity is being updated.
- */
-static void intcapxt_unmask_irq(struct irq_data *data)
-{
-}
-
-static void intcapxt_mask_irq(struct irq_data *data)
-{
-}
 
 static struct irq_chip intcapxt_controller;
 
 static int intcapxt_irqdomain_activate(struct irq_domain *domain,
 				       struct irq_data *irqd, bool reserve)
 {
-	struct amd_iommu *iommu = irqd->chip_data;
-	struct irq_cfg *cfg = irqd_cfg(irqd);
-	union intcapxt xt;
-
-	xt.capxt = 0ULL;
-	xt.dest_mode_logical = apic->dest_mode_logical;
-	xt.vector = cfg->vector;
-	xt.destid_0_23 = cfg->dest_apicid & GENMASK(23, 0);
-	xt.destid_24_31 = cfg->dest_apicid >> 24;
-
-	/**
-	 * Current IOMMU implemtation uses the same IRQ for all
-	 * 3 IOMMU interrupts.
-	 */
-	writeq(xt.capxt, iommu->mmio_base + MMIO_INTCAPXT_EVT_OFFSET);
-	writeq(xt.capxt, iommu->mmio_base + MMIO_INTCAPXT_PPR_OFFSET);
-	writeq(xt.capxt, iommu->mmio_base + MMIO_INTCAPXT_GALOG_OFFSET);
 	return 0;
 }
 
 static void intcapxt_irqdomain_deactivate(struct irq_domain *domain,
 					  struct irq_data *irqd)
 {
-	intcapxt_mask_irq(irqd);
 }
 
 
@@ -2090,6 +2060,38 @@ static void intcapxt_irqdomain_free(struct irq_domain *domain, unsigned int virq
 	irq_domain_free_irqs_top(domain, virq, nr_irqs);
 }
 
+
+static void intcapxt_unmask_irq(struct irq_data *irqd)
+{
+	struct amd_iommu *iommu = irqd->chip_data;
+	struct irq_cfg *cfg = irqd_cfg(irqd);
+	union intcapxt xt;
+
+	xt.capxt = 0ULL;
+	xt.dest_mode_logical = apic->dest_mode_logical;
+	xt.vector = cfg->vector;
+	xt.destid_0_23 = cfg->dest_apicid & GENMASK(23, 0);
+	xt.destid_24_31 = cfg->dest_apicid >> 24;
+
+	/**
+	 * Current IOMMU implementation uses the same IRQ for all
+	 * 3 IOMMU interrupts.
+	 */
+	writeq(xt.capxt, iommu->mmio_base + MMIO_INTCAPXT_EVT_OFFSET);
+	writeq(xt.capxt, iommu->mmio_base + MMIO_INTCAPXT_PPR_OFFSET);
+	writeq(xt.capxt, iommu->mmio_base + MMIO_INTCAPXT_GALOG_OFFSET);
+}
+
+static void intcapxt_mask_irq(struct irq_data *irqd)
+{
+	struct amd_iommu *iommu = irqd->chip_data;
+
+	writeq(0, iommu->mmio_base + MMIO_INTCAPXT_EVT_OFFSET);
+	writeq(0, iommu->mmio_base + MMIO_INTCAPXT_PPR_OFFSET);
+	writeq(0, iommu->mmio_base + MMIO_INTCAPXT_GALOG_OFFSET);
+}
+
+
 static int intcapxt_set_affinity(struct irq_data *irqd,
 				 const struct cpumask *mask, bool force)
 {
@@ -2099,8 +2101,7 @@ static int intcapxt_set_affinity(struct irq_data *irqd,
 	ret = parent->chip->irq_set_affinity(parent, mask, force);
 	if (ret < 0 || ret == IRQ_SET_MASK_OK_DONE)
 		return ret;
-
-	return intcapxt_irqdomain_activate(irqd->domain, irqd, false);
+	return 0;
 }
 
 static struct irq_chip intcapxt_controller = {
-- 
2.26.3

[PATCH 4/5] iommu/amd: x2apic mode: mask/unmask interrupts on suspend/resume

[Maxim Levitsky]

Use IRQCHIP_MASK_ON_SUSPEND to make the core irq code to
mask the iommu interrupt on suspend and unmask it on the resume.

Since now the unmask function updates the INTX settings,
that will restore them on resume from s3/s4.

Since IRQCHIP_MASK_ON_SUSPEND is only effective for interrupts
which are not wakeup sources, remove IRQCHIP_SKIP_SET_WAKE flag
and instead implement a dummy .irq_set_wake which doesn't allow
the interrupt to become a wakeup source.

Fixes: 66929812955bb ("iommu/amd: Add support for X2APIC IOMMU interrupts")

Signed-off-by: Maxim Levitsky <mlevitsk@redhat.com>
---
 drivers/iommu/amd/init.c | 8 +++++++-
 1 file changed, 7 insertions(+), 1 deletion(-)

diff --git a/drivers/iommu/amd/init.c b/drivers/iommu/amd/init.c
index 9e895bb8086a6..b94822fc2c9f7 100644
--- a/drivers/iommu/amd/init.c
+++ b/drivers/iommu/amd/init.c
@@ -2104,6 +2104,11 @@ static int intcapxt_set_affinity(struct irq_data *irqd,
 	return 0;
 }
 
+static int intcapxt_set_wake(struct irq_data *irqd, unsigned int on)
+{
+	return on ? -EOPNOTSUPP : 0;
+}
+
 static struct irq_chip intcapxt_controller = {
 	.name			= "IOMMU-MSI",
 	.irq_unmask		= intcapxt_unmask_irq,
@@ -2111,7 +2116,8 @@ static struct irq_chip intcapxt_controller = {
 	.irq_ack		= irq_chip_ack_parent,
 	.irq_retrigger		= irq_chip_retrigger_hierarchy,
 	.irq_set_affinity       = intcapxt_set_affinity,
-	.flags			= IRQCHIP_SKIP_SET_WAKE,
+	.irq_set_wake		= intcapxt_set_wake,
+	.flags			= IRQCHIP_MASK_ON_SUSPEND,
 };
 
 static const struct irq_domain_ops intcapxt_domain_ops = {
-- 
2.26.3

[PATCH 5/5] iommu/amd: remove useless irq affinity notifier

[Maxim Levitsky]

iommu->intcapxt_notify field is no longer used
after a switch to a separate domain was done

Fixes: d1adcfbb520c ("iommu/amd: Fix IOMMU interrupt generation in X2APIC mode")
Signed-off-by: Maxim Levitsky <mlevitsk@redhat.com>
---
 drivers/iommu/amd/amd_iommu_types.h | 2 --
 1 file changed, 2 deletions(-)

diff --git a/drivers/iommu/amd/amd_iommu_types.h b/drivers/iommu/amd/amd_iommu_types.h
index 867535eb0ce97..ffc89c4fb1205 100644
--- a/drivers/iommu/amd/amd_iommu_types.h
+++ b/drivers/iommu/amd/amd_iommu_types.h
@@ -645,8 +645,6 @@ struct amd_iommu {
 	/* DebugFS Info */
 	struct dentry *debugfs;
 #endif
-	/* IRQ notifier for IntCapXT interrupt */
-	struct irq_affinity_notify intcapxt_notify;
 };
 
 static inline struct amd_iommu *dev_to_amd_iommu(struct device *dev)
-- 
2.26.3

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Maxim Levitsky]

On Tue, 2021-11-23 at 18:10 +0200, Maxim Levitsky wrote:
> As I sadly found out, a s3 cycle makes the AMD's iommu stop sending interrupts
> until the system is rebooted.
> 
> I only noticed it now because otherwise the IOMMU works, and these interrupts
> are only used for errors and for GA log which I tend not to use by
> making my VMs do mwait/pause/etc in guest (cpu-pm=on).
> 
> There are two issues here that prevent interrupts from being generated after
> s3 cycle:
> 
> 1. GA log base address was not restored after resume, and was all zeroed
> after resume (by BIOS or such).
> 
> In theory if BIOS writes some junk to it, that can even cause a memory corruption.
> Patch 2 fixes that.
> 
> 2. INTX (aka x2apic mode) settings were not restored after resume.
> That mode is used regardless if the host uses/supports x2apic, but rather when
> the IOMMU supports it, and mine does.
> Patches 3-4 fix that.
> 
> Note that there is still one slight (userspace) bug remaining:
> During suspend all but the boot CPU are offlined and then after resume
> are onlined again.
> 
> The offlining moves all non-affinity managed interrupts to CPU0, and
> later when all other CPUs are onlined, there is nothing in the kernel
> to spread back the interrupts over the cores.
> 
> The userspace 'irqbalance' daemon does fix this but it seems to ignore
> the IOMMU interrupts in INTX mode since they are not attached to any
> PCI device, and thus they remain on CPU0 after a s3 cycle,
> which is suboptimal when the system has multiple IOMMUs
> (mine has 4 of them).
> 
> Setting the IRQ affinity manually via /proc/irq/ does work.
> 
> This was tested on my 3970X with both INTX and regular MSI mode (later was enabled
> by patching out INTX detection), by running a guest with AVIC enabled and with
> a PCI assigned device (network card), and observing interrupts from
> IOMMU while guest is mostly idle.
> 
> This was also tested on my AMD laptop with 4650U (which has the same issue)
> (I tested only INTX mode)
> 
> Patch 1 is a small refactoring to remove an unused struct field.
> 
> Best regards,
>    Maxim Levitsky
> 
> Maxim Levitsky (5):
>   iommu/amd: restore GA log/tail pointer on host resume
>   iommu/amd: x2apic mode: re-enable after resume
>   iommu/amd: x2apic mode: setup the INTX registers on mask/unmask
>   iommu/amd: x2apic mode: mask/unmask interrupts on suspend/resume
>   iommu/amd: remove useless irq affinity notifier
> 
>  drivers/iommu/amd/amd_iommu_types.h |   2 -
>  drivers/iommu/amd/init.c            | 107 +++++++++++++++-------------
>  2 files changed, 58 insertions(+), 51 deletions(-)
> 
> -- 
> 2.26.3
> 
> 

Polite ping on these patches.
Best regards,
	Maxim Levitsky

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Maxim Levitsky]

On Thu, 2021-12-02 at 01:08 +0200, Maxim Levitsky wrote:
> On Tue, 2021-11-23 at 18:10 +0200, Maxim Levitsky wrote:
> > As I sadly found out, a s3 cycle makes the AMD's iommu stop sending interrupts
> > until the system is rebooted.
> > 
> > I only noticed it now because otherwise the IOMMU works, and these interrupts
> > are only used for errors and for GA log which I tend not to use by
> > making my VMs do mwait/pause/etc in guest (cpu-pm=on).
> > 
> > There are two issues here that prevent interrupts from being generated after
> > s3 cycle:
> > 
> > 1. GA log base address was not restored after resume, and was all zeroed
> > after resume (by BIOS or such).
> > 
> > In theory if BIOS writes some junk to it, that can even cause a memory corruption.
> > Patch 2 fixes that.
> > 
> > 2. INTX (aka x2apic mode) settings were not restored after resume.
> > That mode is used regardless if the host uses/supports x2apic, but rather when
> > the IOMMU supports it, and mine does.
> > Patches 3-4 fix that.
> > 
> > Note that there is still one slight (userspace) bug remaining:
> > During suspend all but the boot CPU are offlined and then after resume
> > are onlined again.
> > 
> > The offlining moves all non-affinity managed interrupts to CPU0, and
> > later when all other CPUs are onlined, there is nothing in the kernel
> > to spread back the interrupts over the cores.
> > 
> > The userspace 'irqbalance' daemon does fix this but it seems to ignore
> > the IOMMU interrupts in INTX mode since they are not attached to any
> > PCI device, and thus they remain on CPU0 after a s3 cycle,
> > which is suboptimal when the system has multiple IOMMUs
> > (mine has 4 of them).
> > 
> > Setting the IRQ affinity manually via /proc/irq/ does work.
> > 
> > This was tested on my 3970X with both INTX and regular MSI mode (later was enabled
> > by patching out INTX detection), by running a guest with AVIC enabled and with
> > a PCI assigned device (network card), and observing interrupts from
> > IOMMU while guest is mostly idle.
> > 
> > This was also tested on my AMD laptop with 4650U (which has the same issue)
> > (I tested only INTX mode)
> > 
> > Patch 1 is a small refactoring to remove an unused struct field.
> > 
> > Best regards,
> >    Maxim Levitsky
> > 
> > Maxim Levitsky (5):
> >   iommu/amd: restore GA log/tail pointer on host resume
> >   iommu/amd: x2apic mode: re-enable after resume
> >   iommu/amd: x2apic mode: setup the INTX registers on mask/unmask
> >   iommu/amd: x2apic mode: mask/unmask interrupts on suspend/resume
> >   iommu/amd: remove useless irq affinity notifier
> > 
> >  drivers/iommu/amd/amd_iommu_types.h |   2 -
> >  drivers/iommu/amd/init.c            | 107 +++++++++++++++-------------
> >  2 files changed, 58 insertions(+), 51 deletions(-)
> > 
> > -- 
> > 2.26.3
> > 
> > 
> 
> Polite ping on these patches.

Another very polite ping on these patches :)

Best regards,
	Maxim Levitsky

> Best regards,
> 	Maxim Levitsky

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Joerg Roedel]

On Tue, Nov 23, 2021 at 06:10:33PM +0200, Maxim Levitsky wrote:
> Best regards,
>    Maxim Levitsky
> 
> Maxim Levitsky (5):
>   iommu/amd: restore GA log/tail pointer on host resume
>   iommu/amd: x2apic mode: re-enable after resume
>   iommu/amd: x2apic mode: setup the INTX registers on mask/unmask
>   iommu/amd: x2apic mode: mask/unmask interrupts on suspend/resume
>   iommu/amd: remove useless irq affinity notifier
> 
>  drivers/iommu/amd/amd_iommu_types.h |   2 -
>  drivers/iommu/amd/init.c            | 107 +++++++++++++++-------------
>  2 files changed, 58 insertions(+), 51 deletions(-)

Suravee, can you please have a look? These look like v5.16 material.

Thanks,

	Joerg

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Joerg Roedel]

On Tue, Nov 23, 2021 at 06:10:33PM +0200, Maxim Levitsky wrote:
> Maxim Levitsky (5):
>   iommu/amd: restore GA log/tail pointer on host resume
>   iommu/amd: x2apic mode: re-enable after resume
>   iommu/amd: x2apic mode: setup the INTX registers on mask/unmask
>   iommu/amd: x2apic mode: mask/unmask interrupts on suspend/resume
>   iommu/amd: remove useless irq affinity notifier
> 
>  drivers/iommu/amd/amd_iommu_types.h |   2 -
>  drivers/iommu/amd/init.c            | 107 +++++++++++++++-------------
>  2 files changed, 58 insertions(+), 51 deletions(-)

Applied for v5.17, thanks.

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Mike Lothian]

Hi

I'm seeing a WARNING that I think might be related to these patches, unfortunately another issue is making bisecting difficult

[    0.359362] AMD-Vi: X2APIC enabled
[    0.395140] ------------[ cut here ]------------
[    0.395142] WARNING: CPU: 0 PID: 1 at amd_iommu_enable_interrupts+0x1da/0x440
[    0.395146] Modules linked in:
[    0.395148] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.17.0-rc1-tip+ #2995
[    0.395150] Hardware name: ASUSTeK COMPUTER INC. ROG Strix G513QY_G513QY/G513QY, BIOS G513QY.316 11/29/2021
[    0.395152] RIP: 0010:amd_iommu_enable_interrupts+0x1da/0x440
[    0.395154] Code: 4b 38 48 89 41 18 b8 a0 86 01 00 0f 1f 44 00 00 48 8b 4b 38 8b 89 20 20 00 00 f7 c1 00 01 00 00 0f 85 7a fe ff ff ff c8 75 e6 <0f> 0b e9 6f fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00
[    0.395157] RSP: 0018:ffff88810022fc68 EFLAGS: 00010246
[    0.395158] RAX: 0000000000000000 RBX: ffff88810004b000 RCX: 0000000000000018
[    0.395160] RDX: 0000000000000008 RSI: ffff88810022fc70 RDI: ffffc900000800f0
[    0.395161] RBP: ffff88810022fc68 R08: ffff888100fce088 R09: 0000000000000000
[    0.395162] R10: 0000000000000000 R11: ffffffffffffffff R12: ffffffff7fffffff
[    0.395163] R13: 0000777f80000000 R14: 0000000000000000 R15: ffffffff8357c9e8
[    0.395165] FS:  0000000000000000(0000) GS:ffff888fde400000(0000) knlGS:0000000000000000
[    0.395166] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.395167] CR2: ffff88901e1ff000 CR3: 00000000b440c000 CR4: 0000000000150ef0
[    0.395169] Call Trace:
[    0.395170]  <TASK>
[    0.395171]  ? iommu_setup+0x29a/0x29a
[    0.395174]  ? state_next+0x6e/0x1c9
[    0.395177]  ? iommu_setup+0x29a/0x29a
[    0.395178]  ? iommu_go_to_state+0x1f/0x33
[    0.395180]  ? amd_iommu_init+0xa/0x23
[    0.395182]  ? pci_iommu_init+0xf/0x45
[    0.395183]  ? iommu_setup+0x29a/0x29a
[    0.395184]  ? __initstub__kmod_pci_dma__250_136_pci_iommu_initrootfs+0x5/0x8
[    0.395186]  ? do_one_initcall+0x100/0x290
[    0.395190]  ? do_initcall_level+0x8b/0xe5
[    0.395192]  ? do_initcalls+0x44/0x6d
[    0.395194]  ? kernel_init_freeable+0xc7/0x10d
[    0.395196]  ? rest_init+0xc0/0xc0
[    0.395198]  ? kernel_init+0x11/0x150
[    0.395200]  ? ret_from_fork+0x22/0x30
[    0.395201]  </TASK>
[    0.395202] ---[ end trace 0000000000000000 ]---
[    0.395204] PCI-DMA: Using software bounce buffer

Let me know if you need any more info

Cheers

Mike

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Maxim Levitsky]

On Tue, 2022-01-25 at 15:08 +0000, Mike Lothian wrote:
> Hi
> 
> I'm seeing a WARNING that I think might be related to these patches, unfortunately another issue is making bisecting difficult
> 
> [    0.359362] AMD-Vi: X2APIC enabled
> [    0.395140] ------------[ cut here ]------------
> [    0.395142] WARNING: CPU: 0 PID: 1 at amd_iommu_enable_interrupts+0x1da/0x440
> [    0.395146] Modules linked in:
> [    0.395148] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.17.0-rc1-tip+ #2995
> [    0.395150] Hardware name: ASUSTeK COMPUTER INC. ROG Strix G513QY_G513QY/G513QY, BIOS G513QY.316 11/29/2021
> [    0.395152] RIP: 0010:amd_iommu_enable_interrupts+0x1da/0x440
> [    0.395154] Code: 4b 38 48 89 41 18 b8 a0 86 01 00 0f 1f 44 00 00 48 8b 4b 38 8b 89 20 20 00 00 f7 c1 00 01 00 00 0f 85 7a fe ff ff ff c8 75 e6 <0f> 0b e9 6f fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00
> [    0.395157] RSP: 0018:ffff88810022fc68 EFLAGS: 00010246
> [    0.395158] RAX: 0000000000000000 RBX: ffff88810004b000 RCX: 0000000000000018
> [    0.395160] RDX: 0000000000000008 RSI: ffff88810022fc70 RDI: ffffc900000800f0
> [    0.395161] RBP: ffff88810022fc68 R08: ffff888100fce088 R09: 0000000000000000
> [    0.395162] R10: 0000000000000000 R11: ffffffffffffffff R12: ffffffff7fffffff
> [    0.395163] R13: 0000777f80000000 R14: 0000000000000000 R15: ffffffff8357c9e8
> [    0.395165] FS:  0000000000000000(0000) GS:ffff888fde400000(0000) knlGS:0000000000000000
> [    0.395166] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [    0.395167] CR2: ffff88901e1ff000 CR3: 00000000b440c000 CR4: 0000000000150ef0
> [    0.395169] Call Trace:
> [    0.395170]  <TASK>
> [    0.395171]  ? iommu_setup+0x29a/0x29a
> [    0.395174]  ? state_next+0x6e/0x1c9
> [    0.395177]  ? iommu_setup+0x29a/0x29a
> [    0.395178]  ? iommu_go_to_state+0x1f/0x33
> [    0.395180]  ? amd_iommu_init+0xa/0x23
> [    0.395182]  ? pci_iommu_init+0xf/0x45
> [    0.395183]  ? iommu_setup+0x29a/0x29a
> [    0.395184]  ? __initstub__kmod_pci_dma__250_136_pci_iommu_initrootfs+0x5/0x8
> [    0.395186]  ? do_one_initcall+0x100/0x290
> [    0.395190]  ? do_initcall_level+0x8b/0xe5
> [    0.395192]  ? do_initcalls+0x44/0x6d
> [    0.395194]  ? kernel_init_freeable+0xc7/0x10d
> [    0.395196]  ? rest_init+0xc0/0xc0
> [    0.395198]  ? kernel_init+0x11/0x150
> [    0.395200]  ? ret_from_fork+0x22/0x30
> [    0.395201]  </TASK>
> [    0.395202] ---[ end trace 0000000000000000 ]---
> [    0.395204] PCI-DMA: Using software bounce buffer
> 
> Let me know if you need any more info
> 
> Cheers
> 
> Mike


Could you just apply these patches on top of 5.15 kernel and see if you get the warning?

If something could case it is I think patch 1, it does move the GA log enabled
to be a bit later.
I also added few warnings there. I wonder why your dmesg quote doesn't contain the C line
where the warning happens.

In partucular I added:

if (WARN_ON(status & (MMIO_STATUS_GALOG_RUN_MASK)))

That will fire if GA log is already running (maybe BIOS enabled it? - it really shouldn't do that)


And that:

if (WARN_ON(i >= LOOP_TIMEOUT))

also should not happen and worth to be logged IMHO.

Best regards,
	Maxim Levitsky

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Mike Lothian]

On Tue, 25 Jan 2022 at 19:26, Maxim Levitsky <mlevitsk@redhat.com> wrote:
>
> Could you just apply these patches on top of 5.15 kernel and see if you get the warning?
>
> If something could case it is I think patch 1, it does move the GA log enabled
> to be a bit later.
> I also added few warnings there. I wonder why your dmesg quote doesn't contain the C line
> where the warning happens.
>
> In partucular I added:
>
> if (WARN_ON(status & (MMIO_STATUS_GALOG_RUN_MASK)))
>
> That will fire if GA log is already running (maybe BIOS enabled it? - it really shouldn't do that)
>
>
> And that:
>
> if (WARN_ON(i >= LOOP_TIMEOUT))
>
> also should not happen and worth to be logged IMHO.
>
> Best regards,
>         Maxim Levitsky
>

Hi

I applied on top of another kernel as you asked, I also enabled some debugging

[    0.398833] ------------[ cut here ]------------
[    0.398835] WARNING: CPU: 0 PID: 1 at drivers/iommu/amd/init.c:839
amd_iommu_enable_interrupts+0x1da/0x440
[    0.398840] Modules linked in:
[    0.398841] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.16.0-rc5-agd5f+ #1388
[    0.398843] Hardware name: ASUSTeK COMPUTER INC. ROG Strix
G513QY_G513QY/G513QY, BIOS G513QY.316 11/29/2021
[    0.398845] RIP: 0010:amd_iommu_enable_interrupts+0x1da/0x440
[    0.398847] Code: 4b 38 48 89 41 18 b8 a0 86 01 00 0f 1f 44 00 00
48 8b 4b 38 8b 89 20 20 00 00 f7 c1 00 01 00 00 0f 85 7a fe ff ff ff
c8 75 e6 <0f> 0b e9 6f fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44
0
0 00
[    0.398850] RSP: 0018:ffff888100927c68 EFLAGS: 00010246
[    0.398851] RAX: 0000000000000000 RBX: ffff88810004b000 RCX: 0000000000000018
[    0.398853] RDX: 0000000000000008 RSI: ffff888100927c70 RDI: ffffc900000800f0
[    0.398854] RBP: ffff888100927c68 R08: ffff8881015b8f88 R09: 0000000000000000
[    0.398855] R10: 0000000000000000 R11: ffffffffffffffff R12: ffffffff7fffffff
[    0.398856] R13: 0000777f80000000 R14: 0000000000000000 R15: ffffffff8357a758
[    0.398858] FS:  0000000000000000(0000) GS:ffff888fde400000(0000)
knlGS:0000000000000000
[    0.398859] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.398860] CR2: 0000000000000000 CR3: 00000000ac40c000 CR4: 0000000000150ef0
[    0.398862] Call Trace:
[    0.398864]  <TASK>
[    0.398864]  ? iommu_setup+0x29a/0x29a
[    0.398867]  ? state_next+0x6e/0x1c9
[    0.398870]  ? iommu_setup+0x29a/0x29a
[    0.398872]  ? iommu_go_to_state+0x1f/0x33
[    0.398873]  ? amd_iommu_init+0xa/0x23
[    0.398875]  ? pci_iommu_init+0xf/0x45
[    0.398876]  ? iommu_setup+0x29a/0x29a
[    0.398878]  ? __initstub__kmod_pci_dma__244_136_pci_iommu_initrootfs+0x5/0x8
[    0.398880]  ? do_one_initcall+0x100/0x290
[    0.398882]  ? do_initcall_level+0x8b/0xe5
[    0.398884]  ? do_initcalls+0x44/0x6d
[    0.398885]  ? kernel_init_freeable+0xc7/0x10d
[    0.398886]  ? rest_init+0xc0/0xc0
[    0.398888]  ? kernel_init+0x11/0x150
[    0.398889]  ? ret_from_fork+0x22/0x30
[    0.398891]  </TASK>
[    0.398892] ---[ end trace f048a4ec907dc976 ]---

Which points to patch one and "if (WARN_ON(i >= LOOP_TIMEOUT))"

Hope that helps

Mike

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Maxim Levitsky]

On Tue, 2022-01-25 at 23:25 +0000, Mike Lothian wrote:
> On Tue, 25 Jan 2022 at 19:26, Maxim Levitsky <mlevitsk@redhat.com> wrote:
> > Could you just apply these patches on top of 5.15 kernel and see if you get the warning?
> > 
> > If something could case it is I think patch 1, it does move the GA log enabled
> > to be a bit later.
> > I also added few warnings there. I wonder why your dmesg quote doesn't contain the C line
> > where the warning happens.
> > 
> > In partucular I added:
> > 
> > if (WARN_ON(status & (MMIO_STATUS_GALOG_RUN_MASK)))
> > 
> > That will fire if GA log is already running (maybe BIOS enabled it? - it really shouldn't do that)
> > 
> > 
> > And that:
> > 
> > if (WARN_ON(i >= LOOP_TIMEOUT))
> > 
> > also should not happen and worth to be logged IMHO.
> > 
> > Best regards,
> >         Maxim Levitsky
> > 
> 
> Hi
> 
> I applied on top of another kernel as you asked, I also enabled some debugging
> 
> [    0.398833] ------------[ cut here ]------------
> [    0.398835] WARNING: CPU: 0 PID: 1 at drivers/iommu/amd/init.c:839
> amd_iommu_enable_interrupts+0x1da/0x440
> [    0.398840] Modules linked in:
> [    0.398841] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.16.0-rc5-agd5f+ #1388
> [    0.398843] Hardware name: ASUSTeK COMPUTER INC. ROG Strix
> G513QY_G513QY/G513QY, BIOS G513QY.316 11/29/2021
> [    0.398845] RIP: 0010:amd_iommu_enable_interrupts+0x1da/0x440
> [    0.398847] Code: 4b 38 48 89 41 18 b8 a0 86 01 00 0f 1f 44 00 00
> 48 8b 4b 38 8b 89 20 20 00 00 f7 c1 00 01 00 00 0f 85 7a fe ff ff ff
> c8 75 e6 <0f> 0b e9 6f fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44
> 0
> 0 00
> [    0.398850] RSP: 0018:ffff888100927c68 EFLAGS: 00010246
> [    0.398851] RAX: 0000000000000000 RBX: ffff88810004b000 RCX: 0000000000000018
> [    0.398853] RDX: 0000000000000008 RSI: ffff888100927c70 RDI: ffffc900000800f0
> [    0.398854] RBP: ffff888100927c68 R08: ffff8881015b8f88 R09: 0000000000000000
> [    0.398855] R10: 0000000000000000 R11: ffffffffffffffff R12: ffffffff7fffffff
> [    0.398856] R13: 0000777f80000000 R14: 0000000000000000 R15: ffffffff8357a758
> [    0.398858] FS:  0000000000000000(0000) GS:ffff888fde400000(0000)
> knlGS:0000000000000000
> [    0.398859] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [    0.398860] CR2: 0000000000000000 CR3: 00000000ac40c000 CR4: 0000000000150ef0
> [    0.398862] Call Trace:
> [    0.398864]  <TASK>
> [    0.398864]  ? iommu_setup+0x29a/0x29a
> [    0.398867]  ? state_next+0x6e/0x1c9
> [    0.398870]  ? iommu_setup+0x29a/0x29a
> [    0.398872]  ? iommu_go_to_state+0x1f/0x33
> [    0.398873]  ? amd_iommu_init+0xa/0x23
> [    0.398875]  ? pci_iommu_init+0xf/0x45
> [    0.398876]  ? iommu_setup+0x29a/0x29a
> [    0.398878]  ? __initstub__kmod_pci_dma__244_136_pci_iommu_initrootfs+0x5/0x8
> [    0.398880]  ? do_one_initcall+0x100/0x290
> [    0.398882]  ? do_initcall_level+0x8b/0xe5
> [    0.398884]  ? do_initcalls+0x44/0x6d
> [    0.398885]  ? kernel_init_freeable+0xc7/0x10d
> [    0.398886]  ? rest_init+0xc0/0xc0
> [    0.398888]  ? kernel_init+0x11/0x150
> [    0.398889]  ? ret_from_fork+0x22/0x30
> [    0.398891]  </TASK>
> [    0.398892] ---[ end trace f048a4ec907dc976 ]---
> 
> Which points to patch one and "if (WARN_ON(i >= LOOP_TIMEOUT))"


Could you post the whole dmesg, or at least:

dmesg | grep AMD-Vi


What CPU does your system have?

I suspect that your system doesn't GA log feature enabled in the IOMMU, and the code never checks
for that, and here it fails enabling it, which  before my patches was just
ignoring it silently.


Best regards,
	Maxim Levitsky
> 
> Hope that helps
> 
> Mike
> 

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Mike Lothian]

[-- Attachment #1: Type: text/plain, Size: 1311 bytes --]

On Wed, 26 Jan 2022 at 07:34, Maxim Levitsky <mlevitsk@redhat.com> wrote:
>
> Could you post the whole dmesg, or at least:
>
> dmesg | grep AMD-Vi
>
>
> What CPU does your system have?
>
> I suspect that your system doesn't GA log feature enabled in the IOMMU, and the code never checks
> for that, and here it fails enabling it, which  before my patches was just
> ignoring it silently.
>
>
> Best regards,
>         Maxim Levitsky
> >
> > Hope that helps
> >
> > Mike
> >

Hi

It's an AMD Ryzen 9 5900HX

[    0.186350] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR0, rdevid:160
[    0.186353] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR1, rdevid:160
[    0.186354] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR2, rdevid:160
[    0.186355] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR3, rdevid:160
[    0.355628] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    0.356134] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    0.356136] AMD-Vi: Extended features (0x206d73ef22254ade): PPR
X2APIC NX GT IA GA PC GA_vAPIC
[    0.356140] AMD-Vi: Interrupt remapping enabled
[    0.356141] AMD-Vi: Virtual APIC enabled
[    0.356142] AMD-Vi: X2APIC enabled
[    0.431377] AMD-Vi: AMD IOMMUv2 loaded and initialized

I've attached the dmesg, I notice that some boots it doesn't happen

Cheers

Mike

[-- Attachment #2: x2apic.dmesg --]
[-- Type: application/octet-stream, Size: 85282 bytes --]

[    0.000000] Linux version 5.17.0-rc1-tip+ (root@axion.fireburn.co.uk) (clang version 13.0.0, LLD 13.0.0) #2997 SMP PREEMPT Tue Jan 25 23:36:16 GMT 2022
[    0.000000] Command line: 
[    0.000000] KERNEL supported cpus:
[    0.000000]   AMD AuthenticAMD
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: xstate_offset[9]:  832, xstate_sizes[9]:    8
[    0.000000] x86/fpu: Enabled xstate features 0x207, context size is 840 bytes, using 'compacted' format.
[    0.000000] signal: max sigframe size: 3376
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000009d1efff] usable
[    0.000000] BIOS-e820: [mem 0x0000000009d1f000-0x000000000a000fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000000a001000-0x000000000a1fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000000a200000-0x000000000a20efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000000a20f000-0x00000000baa4afff] usable
[    0.000000] BIOS-e820: [mem 0x00000000baa4b000-0x00000000bbf62fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bbf63000-0x00000000bbfc7fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bbfc8000-0x00000000bc17cfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bc17d000-0x00000000bc9fefff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bc9ff000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f0000000-0x00000000f7ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fd000000-0x00000000fdffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe700000-0x00000000fe70ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feb80000-0x00000000fec01fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec10000-0x00000000fec10fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed40000-0x00000000fed44fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed80000-0x00000000fed80fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fedc4000-0x00000000fedc9fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fedcc000-0x00000000fedcefff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fedd5000-0x00000000fedd5fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000101e2fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000101e300000-0x000000103fffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] e820: update [mem 0xb6fd1018-0xb6fd7657] usable ==> usable
[    0.000000] e820: update [mem 0xb6fd1018-0xb6fd7657] usable ==> usable
[    0.000000] e820: update [mem 0xb6fc2018-0xb6fd0057] usable ==> usable
[    0.000000] e820: update [mem 0xb6fc2018-0xb6fd0057] usable ==> usable
[    0.000000] e820: update [mem 0xb6fb4018-0xb6fc1857] usable ==> usable
[    0.000000] e820: update [mem 0xb6fb4018-0xb6fc1857] usable ==> usable
[    0.000000] extended physical RAM map:
[    0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] reserve setup_data: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000000100000-0x0000000009d1efff] usable
[    0.000000] reserve setup_data: [mem 0x0000000009d1f000-0x000000000a000fff] reserved
[    0.000000] reserve setup_data: [mem 0x000000000a001000-0x000000000a1fffff] usable
[    0.000000] reserve setup_data: [mem 0x000000000a200000-0x000000000a20efff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x000000000a20f000-0x00000000b6fb4017] usable
[    0.000000] reserve setup_data: [mem 0x00000000b6fb4018-0x00000000b6fc1857] usable
[    0.000000] reserve setup_data: [mem 0x00000000b6fc1858-0x00000000b6fc2017] usable
[    0.000000] reserve setup_data: [mem 0x00000000b6fc2018-0x00000000b6fd0057] usable
[    0.000000] reserve setup_data: [mem 0x00000000b6fd0058-0x00000000b6fd1017] usable
[    0.000000] reserve setup_data: [mem 0x00000000b6fd1018-0x00000000b6fd7657] usable
[    0.000000] reserve setup_data: [mem 0x00000000b6fd7658-0x00000000baa4afff] usable
[    0.000000] reserve setup_data: [mem 0x00000000baa4b000-0x00000000bbf62fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000bbf63000-0x00000000bbfc7fff] ACPI data
[    0.000000] reserve setup_data: [mem 0x00000000bbfc8000-0x00000000bc17cfff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x00000000bc17d000-0x00000000bc9fefff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000bc9ff000-0x00000000bdffffff] usable
[    0.000000] reserve setup_data: [mem 0x00000000be000000-0x00000000bfffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000f0000000-0x00000000f7ffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fd000000-0x00000000fdffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fe700000-0x00000000fe70ffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000feb80000-0x00000000fec01fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fec10000-0x00000000fec10fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fed00000-0x00000000fed00fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fed40000-0x00000000fed44fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fed80000-0x00000000fed80fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fedc4000-0x00000000fedc9fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fedcc000-0x00000000fedcefff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fedd5000-0x00000000fedd5fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000101e2fffff] usable
[    0.000000] reserve setup_data: [mem 0x000000101e300000-0x000000103fffffff] reserved
[    0.000000] efi: EFI v2.70 by American Megatrends
[    0.000000] efi: ACPI=0xbbfc7000 ACPI 2.0=0xbbfc7014 TPMFinalLog=0xbc134000 SMBIOS=0xbc819000 SMBIOS 3.0=0xbc818000 MEMATTR=0xb7834198 ESRT=0xb9413698 RNG=0xbc867a98 TPMEventLog=0xb6fd8018 
[    0.000000] efi: seeding entropy pool
[    0.000000] random: fast init done
[    0.000000] SMBIOS 3.3.0 present.
[    0.000000] DMI: ASUSTeK COMPUTER INC. ROG Strix G513QY_G513QY/G513QY, BIOS G513QY.316 11/29/2021
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 3293.644 MHz processor
[    0.000130] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000131] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000136] last_pfn = 0x101e300 max_arch_pfn = 0x400000000
[    0.000641] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000924] e820: update [mem 0xc0000000-0xffffffff] usable ==> reserved
[    0.000930] last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000936] esrt: Reserving ESRT space from 0x00000000b9413698 to 0x00000000b94136d0.
[    0.000940] e820: update [mem 0xb9413000-0xb9413fff] usable ==> reserved
[    0.000951] Using GB pages for direct mapping
[    0.001389] Secure boot disabled
[    0.001392] ACPI: Early table checksum verification disabled
[    0.001394] ACPI: RSDP 0x00000000BBFC7014 000024 (v02 _ASUS_)
[    0.001397] ACPI: XSDT 0x00000000BBFC6728 00011C (v01 _ASUS_ Notebook 01072009 AMI  01000013)
[    0.001400] ACPI: FACP 0x00000000BBFB7000 000114 (v06 _ASUS_ Notebook 01072009 AMI  00010013)
[    0.001403] ACPI: DSDT 0x00000000BBFAA000 00C0E5 (v02 _ASUS_ Notebook 01072009 INTL 20190509)
[    0.001404] ACPI: FACS 0x00000000BC132000 000040
[    0.001406] ACPI: MSDM 0x00000000BBFC5000 000055 (v03 _ASUS_ Notebook 01072009 ASUS 00000001)
[    0.001407] ACPI: SSDT 0x00000000BBFBD000 007229 (v02 AMD    AmdTable 00000002 MSFT 04000000)
[    0.001408] ACPI: IVRS 0x00000000BBFBC000 0001A4 (v02 AMD    AmdTable 00000001 AMD  00000000)
[    0.001410] ACPI: SSDT 0x00000000BBFB8000 003A21 (v01 AMD    AMD AOD  00000001 INTL 20190509)
[    0.001411] ACPI: FIDT 0x00000000BBFA9000 00009C (v01 _ASUS_ Notebook 01072009 AMI  00010013)
[    0.001412] ACPI: MCFG 0x00000000BBFA8000 00003C (v01 _ASUS_ Notebook 01072009 MSFT 00010013)
[    0.001414] ACPI: HPET 0x00000000BBFA7000 000038 (v01 _ASUS_ Notebook 01072009 AMI  00000005)
[    0.001415] ACPI: VFCT 0x00000000BBF99000 00D884 (v01 _ASUS_ Notebook 00000001 AMD  31504F47)
[    0.001416] ACPI: TPM2 0x00000000BBF97000 00004C (v04 _ASUS_ Notebook 00000001 AMI  00000000)
[    0.001417] ACPI: SSDT 0x00000000BBF91000 005354 (v02 AMD    AmdTable 00000001 AMD  00000001)
[    0.001418] ACPI: CRAT 0x00000000BBF90000 000EE8 (v01 AMD    AmdTable 00000001 AMD  00000001)
[    0.001420] ACPI: CDIT 0x00000000BBF8F000 000029 (v01 AMD    AmdTable 00000001 AMD  00000001)
[    0.001421] ACPI: SSDT 0x00000000BBF8E000 000149 (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001422] ACPI: SSDT 0x00000000BBF8D000 0005B7 (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001423] ACPI: SSDT 0x00000000BBF8B000 00148E (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001425] ACPI: SSDT 0x00000000BBF89000 00151D (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001426] ACPI: SSDT 0x00000000BBF88000 0006A9 (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001427] ACPI: SSDT 0x00000000BBF86000 0019E6 (v01 AMD    CPMD3CLD 00000001 INTL 20190509)
[    0.001428] ACPI: SSDT 0x00000000BBF85000 0005DE (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001429] ACPI: SSDT 0x00000000BBF81000 0036E9 (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001431] ACPI: BGRT 0x00000000BBF98000 000038 (v01 _ASUS_ Notebook 01072009 AMI  00010013)
[    0.001432] ACPI: WSMT 0x00000000BBF80000 000028 (v01 _ASUS_ Notebook 01072009 AMI  00010013)
[    0.001433] ACPI: APIC 0x00000000BBF7F000 0000DE (v03 _ASUS_ Notebook 01072009 AMI  00010013)
[    0.001434] ACPI: SSDT 0x00000000BBF7E000 00008D (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001435] ACPI: SSDT 0x00000000BBF7D000 00091F (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001437] ACPI: SSDT 0x00000000BBF7B000 00112E (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001438] ACPI: SSDT 0x00000000BBF7A000 000241 (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001439] ACPI: SSDT 0x00000000BBF79000 000808 (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001440] ACPI: SSDT 0x00000000BBF78000 00078F (v01 AMD    AmdTable 00000001 INTL 20190509)
[    0.001441] ACPI: FPDT 0x00000000BBF77000 000044 (v01 _ASUS_ A M I    01072009 AMI  01000013)
[    0.001442] ACPI: Reserving FACP table memory at [mem 0xbbfb7000-0xbbfb7113]
[    0.001443] ACPI: Reserving DSDT table memory at [mem 0xbbfaa000-0xbbfb60e4]
[    0.001444] ACPI: Reserving FACS table memory at [mem 0xbc132000-0xbc13203f]
[    0.001444] ACPI: Reserving MSDM table memory at [mem 0xbbfc5000-0xbbfc5054]
[    0.001445] ACPI: Reserving SSDT table memory at [mem 0xbbfbd000-0xbbfc4228]
[    0.001445] ACPI: Reserving IVRS table memory at [mem 0xbbfbc000-0xbbfbc1a3]
[    0.001446] ACPI: Reserving SSDT table memory at [mem 0xbbfb8000-0xbbfbba20]
[    0.001446] ACPI: Reserving FIDT table memory at [mem 0xbbfa9000-0xbbfa909b]
[    0.001447] ACPI: Reserving MCFG table memory at [mem 0xbbfa8000-0xbbfa803b]
[    0.001447] ACPI: Reserving HPET table memory at [mem 0xbbfa7000-0xbbfa7037]
[    0.001448] ACPI: Reserving VFCT table memory at [mem 0xbbf99000-0xbbfa6883]
[    0.001448] ACPI: Reserving TPM2 table memory at [mem 0xbbf97000-0xbbf9704b]
[    0.001449] ACPI: Reserving SSDT table memory at [mem 0xbbf91000-0xbbf96353]
[    0.001449] ACPI: Reserving CRAT table memory at [mem 0xbbf90000-0xbbf90ee7]
[    0.001450] ACPI: Reserving CDIT table memory at [mem 0xbbf8f000-0xbbf8f028]
[    0.001450] ACPI: Reserving SSDT table memory at [mem 0xbbf8e000-0xbbf8e148]
[    0.001451] ACPI: Reserving SSDT table memory at [mem 0xbbf8d000-0xbbf8d5b6]
[    0.001451] ACPI: Reserving SSDT table memory at [mem 0xbbf8b000-0xbbf8c48d]
[    0.001452] ACPI: Reserving SSDT table memory at [mem 0xbbf89000-0xbbf8a51c]
[    0.001452] ACPI: Reserving SSDT table memory at [mem 0xbbf88000-0xbbf886a8]
[    0.001453] ACPI: Reserving SSDT table memory at [mem 0xbbf86000-0xbbf879e5]
[    0.001453] ACPI: Reserving SSDT table memory at [mem 0xbbf85000-0xbbf855dd]
[    0.001454] ACPI: Reserving SSDT table memory at [mem 0xbbf81000-0xbbf846e8]
[    0.001454] ACPI: Reserving BGRT table memory at [mem 0xbbf98000-0xbbf98037]
[    0.001455] ACPI: Reserving WSMT table memory at [mem 0xbbf80000-0xbbf80027]
[    0.001455] ACPI: Reserving APIC table memory at [mem 0xbbf7f000-0xbbf7f0dd]
[    0.001456] ACPI: Reserving SSDT table memory at [mem 0xbbf7e000-0xbbf7e08c]
[    0.001456] ACPI: Reserving SSDT table memory at [mem 0xbbf7d000-0xbbf7d91e]
[    0.001457] ACPI: Reserving SSDT table memory at [mem 0xbbf7b000-0xbbf7c12d]
[    0.001457] ACPI: Reserving SSDT table memory at [mem 0xbbf7a000-0xbbf7a240]
[    0.001458] ACPI: Reserving SSDT table memory at [mem 0xbbf79000-0xbbf79807]
[    0.001458] ACPI: Reserving SSDT table memory at [mem 0xbbf78000-0xbbf7878e]
[    0.001459] ACPI: Reserving FPDT table memory at [mem 0xbbf77000-0xbbf77043]
[    0.001490] Zone ranges:
[    0.001491]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.001492]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.001493]   Normal   [mem 0x0000000100000000-0x000000101e2fffff]
[    0.001494]   Device   empty
[    0.001495] Movable zone start for each node
[    0.001495] Early memory node ranges
[    0.001495]   node   0: [mem 0x0000000000001000-0x000000000009ffff]
[    0.001497]   node   0: [mem 0x0000000000100000-0x0000000009d1efff]
[    0.001497]   node   0: [mem 0x000000000a001000-0x000000000a1fffff]
[    0.001498]   node   0: [mem 0x000000000a20f000-0x00000000baa4afff]
[    0.001498]   node   0: [mem 0x00000000bc9ff000-0x00000000bdffffff]
[    0.001499]   node   0: [mem 0x0000000100000000-0x000000101e2fffff]
[    0.001501] Initmem setup node 0 [mem 0x0000000000001000-0x000000101e2fffff]
[    0.001504] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.001515] On node 0, zone DMA: 96 pages in unavailable ranges
[    0.001611] On node 0, zone DMA32: 738 pages in unavailable ranges
[    0.004639] On node 0, zone DMA32: 15 pages in unavailable ranges
[    0.004708] On node 0, zone DMA32: 8116 pages in unavailable ranges
[    0.079755] On node 0, zone Normal: 8192 pages in unavailable ranges
[    0.079795] On node 0, zone Normal: 7424 pages in unavailable ranges
[    0.080235] ACPI: PM-Timer IO Port: 0x808
[    0.080240] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.080250] IOAPIC[0]: apic_id 33, version 33, address 0xfec00000, GSI 0-23
[    0.080256] IOAPIC[1]: apic_id 34, version 33, address 0xfec01000, GSI 24-55
[    0.080257] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.080259] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
[    0.080260] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.080261] ACPI: HPET id: 0x10228201 base: 0xfed00000
[    0.080267] e820: update [mem 0xb4701000-0xb47a9fff] usable ==> reserved
[    0.080275] smpboot: Allowing 16 CPUs, 0 hotplug CPUs
[    0.080288] [mem 0xc0000000-0xefffffff] available for PCI devices
[    0.080290] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.080294] setup_percpu: NR_CPUS:16 nr_cpumask_bits:16 nr_cpu_ids:16 nr_node_ids:1
[    0.080670] percpu: Embedded 49 pages/cpu s161048 r8192 d31464 u262144
[    0.080674] pcpu-alloc: s161048 r8192 d31464 u262144 alloc=1*2097152
[    0.080675] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
[    0.080687] Built 1 zonelists, mobility grouping on.  Total pages: 16361689
[    0.080688] Kernel command line: root=/dev/nvme0n1p2 rootfstype=ext4 libahci.ignore_sss=1 init=/usr/lib/systemd/systemd systemd.unified_cgroup_hierarchy=1 cgroup_no_v1=all printk.devkmsg=on amd_pstate.shared_mem=1 
[    0.080710] printk: log_buf_len individual max cpu contribution: 131072 bytes
[    0.080711] printk: log_buf_len total cpu_extra contributions: 1966080 bytes
[    0.080711] printk: log_buf_len min size: 262144 bytes
[    0.082699] printk: log_buf_len: 4194304 bytes
[    0.082702] printk: early log buf free: 246488(94%)
[    0.087412] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear)
[    0.089692] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear)
[    0.089722] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[    0.184689] Memory: 65172788K/66486248K available (22539K kernel code, 2374K rwdata, 12028K rodata, 1120K init, 2500K bss, 1313204K reserved, 0K cma-reserved)
[    0.184717] random: get_random_u64 called from cache_random_seq_create+0x59/0x1b0 with crng_init=1
[    0.184749] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=16, Nodes=1
[    0.184808] rcu: Preemptible hierarchical RCU implementation.
[    0.184809] rcu: 	RCU event tracing is enabled.
[    0.184810] 	Trampoline variant of Tasks RCU enabled.
[    0.184811] 	Tracing variant of Tasks RCU enabled.
[    0.184811] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.185336] NR_IRQS: 4352, nr_irqs: 1096, preallocated irqs: 16
[    0.185592] random: crng init done (trusting CPU's manufacturer)
[    0.185610] Console: colour dummy device 80x25
[    0.185760] printk: console [tty0] enabled
[    0.185767] ACPI: Core revision 20211217
[    0.185895] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns
[    0.185912] APIC: Switch to symmetric I/O mode setup
[    0.186350] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR0, rdevid:160
[    0.186353] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR1, rdevid:160
[    0.186354] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR2, rdevid:160
[    0.186355] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR3, rdevid:160
[    0.186588] Switched APIC routing to physical flat.
[    0.187169] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.191918] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2f79d827764, max_idle_ns: 440795335271 ns
[    0.191925] Calibrating delay loop (skipped), value calculated using timer frequency.. 6587.28 BogoMIPS (lpj=3293644)
[    0.191927] pid_max: default: 32768 minimum: 301
[    0.193081] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.193220] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.193347] Disabling cpuset control group subsystem in v1 mounts
[    0.193353] Disabling cpu control group subsystem in v1 mounts
[    0.193356] Disabling cpuacct control group subsystem in v1 mounts
[    0.193360] Disabling io control group subsystem in v1 mounts
[    0.193380] Disabling memory control group subsystem in v1 mounts
[    0.193385] Disabling devices control group subsystem in v1 mounts
[    0.193386] Disabling freezer control group subsystem in v1 mounts
[    0.193388] Disabling net_cls control group subsystem in v1 mounts
[    0.193390] Disabling net_prio control group subsystem in v1 mounts
[    0.193393] Disabling hugetlb control group subsystem in v1 mounts
[    0.193395] Disabling pids control group subsystem in v1 mounts
[    0.193397] Disabling rdma control group subsystem in v1 mounts
[    0.193399] Disabling misc control group subsystem in v1 mounts
[    0.193436] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    0.193443] LVT offset 1 assigned for vector 0xf9
[    0.193451] LVT offset 2 assigned for vector 0xf4
[    0.193454] Last level iTLB entries: 4KB 512, 2MB 512, 4MB 256
[    0.193455] Last level dTLB entries: 4KB 2048, 2MB 2048, 4MB 1024, 1GB 0
[    0.193458] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.193461] Spectre V2 : Mitigation: Full AMD retpoline
[    0.193463] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.193464] Spectre V2 : Enabling Restricted Speculation for firmware calls
[    0.193466] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.193467] Spectre V2 : User space: Mitigation: STIBP always-on protection
[    0.193469] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[    0.195106] Freeing SMP alternatives memory: 52K
[    0.297794] smpboot: CPU0: AMD Ryzen 9 5900HX with Radeon Graphics (family: 0x19, model: 0x50, stepping: 0x0)
[    0.297851] cblist_init_generic: Setting adjustable number of callback queues.
[    0.297855] cblist_init_generic: Setting shift to 4 and lim to 1.
[    0.297866] cblist_init_generic: Setting shift to 4 and lim to 1.
[    0.297875] Performance Events: Fam17h+ core perfctr, AMD PMU driver.
[    0.297880] ... version:                0
[    0.297881] ... bit width:              48
[    0.297882] ... generic registers:      6
[    0.297883] ... value mask:             0000ffffffffffff
[    0.297884] ... max period:             00007fffffffffff
[    0.297885] ... fixed-purpose events:   0
[    0.297885] ... event mask:             000000000000003f
[    0.297921] rcu: Hierarchical SRCU implementation.
[    0.297921] smp: Bringing up secondary CPUs ...
[    0.297921] x86: Booting SMP configuration:
[    0.297921] .... node  #0, CPUs:        #1
[    0.298981] Spectre V2 : Update user space SMT mitigation: STIBP always-on
[    0.298992]   #2  #3  #4  #5  #6  #7  #8  #9 #10 #11 #12 #13 #14 #15
[    0.314947] smp: Brought up 1 node, 16 CPUs
[    0.314952] smpboot: Max logical packages: 1
[    0.314953] smpboot: Total of 16 processors activated (105396.60 BogoMIPS)
[    0.316976] devtmpfs: initialized
[    0.316976] x86/mm: Memory block size: 2048MB
[    0.317093] ACPI: PM: Registering ACPI NVS region [mem 0x0a200000-0x0a20efff] (61440 bytes)
[    0.317093] ACPI: PM: Registering ACPI NVS region [mem 0xbbfc8000-0xbc17cfff] (1789952 bytes)
[    0.317093] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.317093] futex hash table entries: 4096 (order: 6, 262144 bytes, linear)
[    0.317093] pinctrl core: initialized pinctrl subsystem
[    0.317093] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.317115] thermal_sys: Registered thermal governor 'step_wise'
[    0.317116] thermal_sys: Registered thermal governor 'user_space'
[    0.317124] cpuidle: using governor ladder
[    0.317128] cpuidle: using governor menu
[    0.317152] HugeTLB: can free 4094 vmemmap pages for hugepages-1048576kB
[    0.317152] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.317152] PCI: MMCONFIG for domain 0000 [bus 00-7f] at [mem 0xf0000000-0xf7ffffff] (base 0xf0000000)
[    0.317152] PCI: MMCONFIG at [mem 0xf0000000-0xf7ffffff] reserved in E820
[    0.317152] PCI: Using configuration type 1 for base access
[    0.319076] HugeTLB: can free 6 vmemmap pages for hugepages-2048kB
[    0.319076] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.319076] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.319076] cryptd: max_cpu_qlen set to 1000
[    0.319076] fbcon: Taking over console
[    0.319076] ACPI: Added _OSI(Module Device)
[    0.319076] ACPI: Added _OSI(Processor Device)
[    0.319076] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.319076] ACPI: Added _OSI(Processor Aggregator Device)
[    0.319076] ACPI: Added _OSI(Linux-Dell-Video)
[    0.319076] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    0.319076] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    0.325079] ACPI: 18 ACPI AML tables successfully acquired and loaded
[    0.325828] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    0.326691] ACPI: Interpreter enabled
[    0.326699] ACPI: PM: (supports S0 S5)
[    0.326700] ACPI: Using IOAPIC for interrupt routing
[    0.326819] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.326979] ACPI: Enabled 3 GPEs in block 00 to 1F
[    0.327218] ACPI: PM: Power Resource [M237]
[    0.327283] ACPI: PM: Power Resource [M237]
[    0.327317] ACPI: PM: Power Resource [M237]
[    0.327604] ACPI: PM: Power Resource [P0U0]
[    0.327636] ACPI: PM: Power Resource [P3U0]
[    0.327826] ACPI: PM: Power Resource [P0U1]
[    0.327856] ACPI: PM: Power Resource [P3U1]
[    0.328404] ACPI: PM: Power Resource [P1NV]
[    0.328484] ACPI: PM: Power Resource [P0NV]
[    0.329917] ACPI: PM: Power Resource [PRWL]
[    0.330427] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.330431] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    0.330469] acpi PNP0A08:00: _OSC: platform does not support [LTR]
[    0.330532] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    0.330534] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-7f] only partially covers this bridge
[    0.330676] PCI host bridge to bus 0000:00
[    0.330677] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    0.330679] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    0.330680] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    0.330681] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.330683] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000dffff window]
[    0.330684] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfcffffff window]
[    0.330685] pci_bus 0000:00: root bus resource [mem 0x1040000000-0xffffffffff window]
[    0.330687] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.330696] pci 0000:00:00.0: [1022:1630] type 00 class 0x060000
[    0.330757] pci 0000:00:00.2: [1022:1631] type 00 class 0x080600
[    0.330822] pci 0000:00:01.0: [1022:1632] type 00 class 0x060000
[    0.330865] pci 0000:00:01.1: [1022:1633] type 01 class 0x060400
[    0.330912] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    0.330972] pci 0000:00:02.0: [1022:1632] type 00 class 0x060000
[    0.331015] pci 0000:00:02.1: [1022:1634] type 01 class 0x060400
[    0.331036] pci 0000:00:02.1: enabling Extended Tags
[    0.331063] pci 0000:00:02.1: PME# supported from D0 D3hot D3cold
[    0.331103] pci 0000:00:02.2: [1022:1634] type 01 class 0x060400
[    0.331149] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    0.331188] pci 0000:00:02.3: [1022:1634] type 01 class 0x060400
[    0.331208] pci 0000:00:02.3: enabling Extended Tags
[    0.331235] pci 0000:00:02.3: PME# supported from D0 D3hot D3cold
[    0.331273] pci 0000:00:02.4: [1022:1634] type 01 class 0x060400
[    0.331294] pci 0000:00:02.4: enabling Extended Tags
[    0.331320] pci 0000:00:02.4: PME# supported from D0 D3hot D3cold
[    0.331371] pci 0000:00:08.0: [1022:1632] type 00 class 0x060000
[    0.331413] pci 0000:00:08.1: [1022:1635] type 01 class 0x060400
[    0.331432] pci 0000:00:08.1: enabling Extended Tags
[    0.331458] pci 0000:00:08.1: PME# supported from D0 D3hot D3cold
[    0.331527] pci 0000:00:14.0: [1022:790b] type 00 class 0x0c0500
[    0.331619] pci 0000:00:14.3: [1022:790e] type 00 class 0x060100
[    0.331720] pci 0000:00:18.0: [1022:166a] type 00 class 0x060000
[    0.331744] pci 0000:00:18.1: [1022:166b] type 00 class 0x060000
[    0.331767] pci 0000:00:18.2: [1022:166c] type 00 class 0x060000
[    0.331791] pci 0000:00:18.3: [1022:166d] type 00 class 0x060000
[    0.331815] pci 0000:00:18.4: [1022:166e] type 00 class 0x060000
[    0.331839] pci 0000:00:18.5: [1022:166f] type 00 class 0x060000
[    0.331864] pci 0000:00:18.6: [1022:1670] type 00 class 0x060000
[    0.331889] pci 0000:00:18.7: [1022:1671] type 00 class 0x060000
[    0.331961] pci 0000:01:00.0: [1002:1478] type 01 class 0x060400
[    0.331974] pci 0000:01:00.0: reg 0x10: [mem 0xfcc00000-0xfcc03fff]
[    0.332064] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    0.332129] pci 0000:01:00.0: 63.008 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x8 link at 0000:00:01.1 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)
[    0.332164] pci 0000:00:01.1: PCI bridge to [bus 01-03]
[    0.332168] pci 0000:00:01.1:   bridge window [mem 0xfca00000-0xfccfffff]
[    0.332171] pci 0000:00:01.1:   bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.332213] pci 0000:02:00.0: [1002:1479] type 01 class 0x060400
[    0.332312] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    0.332484] pci 0000:01:00.0: PCI bridge to [bus 02-03]
[    0.332491] pci 0000:01:00.0:   bridge window [mem 0xfca00000-0xfcbfffff]
[    0.332496] pci 0000:01:00.0:   bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.332540] pci 0000:03:00.0: [1002:73df] type 00 class 0x038000
[    0.332554] pci 0000:03:00.0: reg 0x10: [mem 0xf800000000-0xfbffffffff 64bit pref]
[    0.332563] pci 0000:03:00.0: reg 0x18: [mem 0xfc00000000-0xfc0fffffff 64bit pref]
[    0.332573] pci 0000:03:00.0: reg 0x24: [mem 0xfca00000-0xfcafffff]
[    0.332579] pci 0000:03:00.0: reg 0x30: [mem 0xfcb00000-0xfcb1ffff pref]
[    0.332657] pci 0000:03:00.0: PME# supported from D1 D2 D3hot D3cold
[    0.332719] pci 0000:03:00.0: 63.008 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x8 link at 0000:00:01.1 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)
[    0.332756] pci 0000:03:00.1: [1002:ab28] type 00 class 0x040300
[    0.332766] pci 0000:03:00.1: reg 0x10: [mem 0xfcb20000-0xfcb23fff]
[    0.332844] pci 0000:03:00.1: PME# supported from D1 D2 D3hot D3cold
[    0.332931] pci 0000:02:00.0: PCI bridge to [bus 03]
[    0.332937] pci 0000:02:00.0:   bridge window [mem 0xfca00000-0xfcbfffff]
[    0.332942] pci 0000:02:00.0:   bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.332993] pci 0000:04:00.0: [10ec:8168] type 00 class 0x020000
[    0.333009] pci 0000:04:00.0: reg 0x10: [io  0xf000-0xf0ff]
[    0.333031] pci 0000:04:00.0: reg 0x18: [mem 0xfcf04000-0xfcf04fff 64bit]
[    0.333044] pci 0000:04:00.0: reg 0x20: [mem 0xfcf00000-0xfcf03fff 64bit]
[    0.333128] pci 0000:04:00.0: supports D1 D2
[    0.333129] pci 0000:04:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.333225] pci 0000:00:02.1: PCI bridge to [bus 04]
[    0.333228] pci 0000:00:02.1:   bridge window [io  0xf000-0xffff]
[    0.333230] pci 0000:00:02.1:   bridge window [mem 0xfcf00000-0xfcffffff]
[    0.333323] pci 0000:05:00.0: [14c3:7961] type 00 class 0x028000
[    0.333399] pci 0000:05:00.0: reg 0x10: [mem 0xfc30300000-0xfc303fffff 64bit pref]
[    0.333442] pci 0000:05:00.0: reg 0x18: [mem 0xfc30400000-0xfc30403fff 64bit pref]
[    0.333485] pci 0000:05:00.0: reg 0x20: [mem 0xfc30404000-0xfc30404fff 64bit pref]
[    0.333642] pci 0000:05:00.0: supports D1 D2
[    0.333643] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.334012] pci 0000:00:02.2: PCI bridge to [bus 05]
[    0.334018] pci 0000:00:02.2:   bridge window [mem 0xfc30300000-0xfc304fffff 64bit pref]
[    0.334070] pci 0000:06:00.0: [144d:a809] type 00 class 0x010802
[    0.334086] pci 0000:06:00.0: reg 0x10: [mem 0xfce00000-0xfce03fff 64bit]
[    0.334251] pci 0000:00:02.3: PCI bridge to [bus 06]
[    0.334255] pci 0000:00:02.3:   bridge window [mem 0xfce00000-0xfcefffff]
[    0.334331] pci 0000:07:00.0: [144d:a802] type 00 class 0x010802
[    0.334346] pci 0000:07:00.0: reg 0x10: [mem 0xfcd00000-0xfcd03fff 64bit]
[    0.334353] pci 0000:07:00.0: reg 0x18: [io  0xe000-0xe0ff]
[    0.334504] pci 0000:00:02.4: PCI bridge to [bus 07]
[    0.334507] pci 0000:00:02.4:   bridge window [io  0xe000-0xefff]
[    0.334509] pci 0000:00:02.4:   bridge window [mem 0xfcd00000-0xfcdfffff]
[    0.334552] pci 0000:08:00.0: [1002:1638] type 00 class 0x030000
[    0.334562] pci 0000:08:00.0: reg 0x10: [mem 0xfc20000000-0xfc2fffffff 64bit pref]
[    0.334569] pci 0000:08:00.0: reg 0x18: [mem 0xfc30000000-0xfc301fffff 64bit pref]
[    0.334574] pci 0000:08:00.0: reg 0x20: [io  0xd000-0xd0ff]
[    0.334579] pci 0000:08:00.0: reg 0x24: [mem 0xfc900000-0xfc97ffff]
[    0.334587] pci 0000:08:00.0: enabling Extended Tags
[    0.334596] pci 0000:08:00.0: BAR 0: assigned to efifb
[    0.334630] pci 0000:08:00.0: PME# supported from D1 D2 D3hot D3cold
[    0.334658] pci 0000:08:00.0: 126.016 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x16 link at 0000:00:08.1 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)
[    0.334688] pci 0000:08:00.1: [1002:1637] type 00 class 0x040300
[    0.334696] pci 0000:08:00.1: reg 0x10: [mem 0xfc9c8000-0xfc9cbfff]
[    0.334715] pci 0000:08:00.1: enabling Extended Tags
[    0.334739] pci 0000:08:00.1: PME# supported from D1 D2 D3hot D3cold
[    0.334774] pci 0000:08:00.2: [1022:15df] type 00 class 0x108000
[    0.334786] pci 0000:08:00.2: reg 0x18: [mem 0xfc800000-0xfc8fffff]
[    0.334795] pci 0000:08:00.2: reg 0x24: [mem 0xfc9cc000-0xfc9cdfff]
[    0.334801] pci 0000:08:00.2: enabling Extended Tags
[    0.334859] pci 0000:08:00.3: [1022:1639] type 00 class 0x0c0330
[    0.334869] pci 0000:08:00.3: reg 0x10: [mem 0xfc700000-0xfc7fffff 64bit]
[    0.334891] pci 0000:08:00.3: enabling Extended Tags
[    0.334937] pci 0000:08:00.3: PME# supported from D0 D3hot D3cold
[    0.334973] pci 0000:08:00.4: [1022:1639] type 00 class 0x0c0330
[    0.334983] pci 0000:08:00.4: reg 0x10: [mem 0xfc600000-0xfc6fffff 64bit]
[    0.335005] pci 0000:08:00.4: enabling Extended Tags
[    0.335031] pci 0000:08:00.4: PME# supported from D0 D3hot D3cold
[    0.335066] pci 0000:08:00.5: [1022:15e2] type 00 class 0x048000
[    0.335073] pci 0000:08:00.5: reg 0x10: [mem 0xfc980000-0xfc9bffff]
[    0.335092] pci 0000:08:00.5: enabling Extended Tags
[    0.335117] pci 0000:08:00.5: PME# supported from D0 D3hot D3cold
[    0.335150] pci 0000:08:00.6: [1022:15e3] type 00 class 0x040300
[    0.335158] pci 0000:08:00.6: reg 0x10: [mem 0xfc9c0000-0xfc9c7fff]
[    0.335184] pci 0000:08:00.6: enabling Extended Tags
[    0.335208] pci 0000:08:00.6: PME# supported from D0 D3hot D3cold
[    0.335259] pci 0000:00:08.1: PCI bridge to [bus 08]
[    0.335262] pci 0000:00:08.1:   bridge window [io  0xd000-0xdfff]
[    0.335264] pci 0000:00:08.1:   bridge window [mem 0xfc600000-0xfc9fffff]
[    0.335266] pci 0000:00:08.1:   bridge window [mem 0xfc20000000-0xfc301fffff 64bit pref]
[    0.335287] pci_bus 0000:00: on NUMA node 0
[    0.335290] pci 0000:00:01.1: Max Payload Size set to  128/ 512 (was  256), Max Read Rq  512
[    0.335297] pci 0000:01:00.0: Max Payload Size set to  128/ 512 (was  256), Max Read Rq  512
[    0.335302] pci 0000:02:00.0: Max Payload Size set to  128/ 512 (was  256), Max Read Rq  512
[    0.335308] pci 0000:03:00.0: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335313] pci 0000:03:00.1: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335317] pci 0000:00:02.1: Max Payload Size set to  128/ 512 (was  128), Max Read Rq  512
[    0.335324] pci 0000:04:00.0: Max Payload Size set to  128/ 128 (was  128), Max Read Rq  512
[    0.335327] pci 0000:00:02.2: Max Payload Size set to  128/ 512 (was  128), Max Read Rq  512
[    0.335389] pci 0000:05:00.0: Max Payload Size set to  128/ 128 (was  128), Max Read Rq  512
[    0.335393] pci 0000:00:02.3: Max Payload Size set to  128/ 512 (was  256), Max Read Rq  512
[    0.335418] pci 0000:06:00.0: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335422] pci 0000:00:02.4: Max Payload Size set to  128/ 512 (was  128), Max Read Rq  512
[    0.335469] pci 0000:07:00.0: Max Payload Size set to  128/ 128 (was  128), Max Read Rq  512
[    0.335472] pci 0000:00:08.1: Max Payload Size set to  128/ 512 (was  256), Max Read Rq  512
[    0.335476] pci 0000:08:00.0: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335480] pci 0000:08:00.1: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335484] pci 0000:08:00.2: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335487] pci 0000:08:00.3: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335491] pci 0000:08:00.4: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335495] pci 0000:08:00.5: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335499] pci 0000:08:00.6: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    0.335880] ACPI: PCI: Interrupt link LNKA configured for IRQ 0
[    0.335904] ACPI: PCI: Interrupt link LNKB configured for IRQ 0
[    0.335926] ACPI: PCI: Interrupt link LNKC configured for IRQ 0
[    0.335952] ACPI: PCI: Interrupt link LNKD configured for IRQ 0
[    0.335974] ACPI: PCI: Interrupt link LNKE configured for IRQ 0
[    0.335993] ACPI: PCI: Interrupt link LNKF configured for IRQ 0
[    0.336012] ACPI: PCI: Interrupt link LNKG configured for IRQ 0
[    0.336030] ACPI: PCI: Interrupt link LNKH configured for IRQ 0
[    0.336501] iommu: Default domain type: Passthrough 
[    0.336510] pci 0000:08:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    0.336510] pci 0000:08:00.0: vgaarb: bridge control possible
[    0.336510] pci 0000:08:00.0: vgaarb: setting as boot device
[    0.336510] vgaarb: loaded
[    0.336510] SCSI subsystem initialized
[    0.336510] libata version 3.00 loaded.
[    0.336510] ACPI: bus type USB registered
[    0.336510] usbcore: registered new interface driver usbfs
[    0.336510] usbcore: registered new interface driver hub
[    0.336510] usbcore: registered new device driver usb
[    0.338454] videodev: Linux video capture interface: v2.00
[    0.338474] Registered efivars operations
[    0.338489] Advanced Linux Sound Architecture Driver Initialized.
[    0.338537] Bluetooth: Core ver 2.22
[    0.338541] NET: Registered PF_BLUETOOTH protocol family
[    0.338543] Bluetooth: HCI device and connection manager initialized
[    0.338545] Bluetooth: HCI socket layer initialized
[    0.338546] Bluetooth: L2CAP socket layer initialized
[    0.338548] Bluetooth: SCO socket layer initialized
[    0.338559] PCI: Using ACPI for IRQ routing
[    0.342594] PCI: pci_cache_line_size set to 64 bytes
[    0.342777] e820: reserve RAM buffer [mem 0x09d1f000-0x0bffffff]
[    0.342778] e820: reserve RAM buffer [mem 0x0a200000-0x0bffffff]
[    0.342779] e820: reserve RAM buffer [mem 0xb4701000-0xb7ffffff]
[    0.342780] e820: reserve RAM buffer [mem 0xb6fb4018-0xb7ffffff]
[    0.342780] e820: reserve RAM buffer [mem 0xb6fc2018-0xb7ffffff]
[    0.342781] e820: reserve RAM buffer [mem 0xb6fd1018-0xb7ffffff]
[    0.342781] e820: reserve RAM buffer [mem 0xb9413000-0xbbffffff]
[    0.342782] e820: reserve RAM buffer [mem 0xbaa4b000-0xbbffffff]
[    0.342782] e820: reserve RAM buffer [mem 0xbe000000-0xbfffffff]
[    0.342782] e820: reserve RAM buffer [mem 0x101e300000-0x101fffffff]
[    0.342785] acpi PNP0C14:01: duplicate WMI GUID 05901221-D566-11D1-B2F0-00A0C9062910 (first instance was on PNP0C14:00)
[    0.342785] acpi PNP0C14:02: duplicate WMI GUID 05901221-D566-11D1-B2F0-00A0C9062910 (first instance was on PNP0C14:00)
[    0.342785] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.342785] hpet0: 3 comparators, 32-bit 14.318180 MHz counter
[    0.343945] clocksource: Switched to clocksource tsc-early
[    0.347297] FS-Cache: Loaded
[    0.347317] CacheFiles: Loaded
[    0.347322] pnp: PnP ACPI init
[    0.347362] system 00:00: [mem 0xf0000000-0xf7ffffff] has been reserved
[    0.347534] system 00:03: [io  0x04d0-0x04d1] has been reserved
[    0.347536] system 00:03: [io  0x040b] has been reserved
[    0.347537] system 00:03: [io  0x04d6] has been reserved
[    0.347538] system 00:03: [io  0x0c00-0x0c01] has been reserved
[    0.347540] system 00:03: [io  0x0c14] has been reserved
[    0.347542] system 00:03: [io  0x0c50-0x0c51] has been reserved
[    0.347543] system 00:03: [io  0x0c52] has been reserved
[    0.347544] system 00:03: [io  0x0c6c] has been reserved
[    0.347545] system 00:03: [io  0x0c6f] has been reserved
[    0.347546] system 00:03: [io  0x0cd8-0x0cdf] has been reserved
[    0.347547] system 00:03: [io  0x0800-0x089f] has been reserved
[    0.347548] system 00:03: [io  0x0b00-0x0b0f] has been reserved
[    0.347549] system 00:03: [io  0x0b20-0x0b3f] has been reserved
[    0.347550] system 00:03: [io  0x0900-0x090f] has been reserved
[    0.347551] system 00:03: [io  0x0910-0x091f] has been reserved
[    0.347553] system 00:03: [mem 0xfec00000-0xfec00fff] could not be reserved
[    0.347554] system 00:03: [mem 0xfec01000-0xfec01fff] could not be reserved
[    0.347555] system 00:03: [mem 0xfedc0000-0xfedc0fff] has been reserved
[    0.347557] system 00:03: [mem 0xfee00000-0xfee00fff] has been reserved
[    0.347558] system 00:03: [mem 0xfed80000-0xfed8ffff] could not be reserved
[    0.347560] system 00:03: [mem 0xfec10000-0xfec10fff] has been reserved
[    0.347561] system 00:03: [mem 0xff000000-0xffffffff] has been reserved
[    0.347562] system 00:03: [mem 0xfe700000-0xfe70ffff] has been reserved
[    0.347897] pnp: PnP ACPI: found 4 devices
[    0.353066] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.353098] NET: Registered PF_INET protocol family
[    0.353255] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.354446] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes, linear)
[    0.354488] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.354816] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[    0.354913] TCP: Hash tables configured (established 524288 bind 65536)
[    0.354935] UDP hash table entries: 32768 (order: 8, 1048576 bytes, linear)
[    0.355023] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes, linear)
[    0.355134] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.355179] pci 0000:00:01.1: bridge window [io  0x1000-0x0fff] to [bus 01-03] add_size 1000
[    0.355185] pci 0000:00:01.1: BAR 13: assigned [io  0x1000-0x1fff]
[    0.355187] pci 0000:02:00.0: PCI bridge to [bus 03]
[    0.355191] pci 0000:02:00.0:   bridge window [mem 0xfca00000-0xfcbfffff]
[    0.355194] pci 0000:02:00.0:   bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.355199] pci 0000:01:00.0: PCI bridge to [bus 02-03]
[    0.355203] pci 0000:01:00.0:   bridge window [mem 0xfca00000-0xfcbfffff]
[    0.355206] pci 0000:01:00.0:   bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.355211] pci 0000:00:01.1: PCI bridge to [bus 01-03]
[    0.355212] pci 0000:00:01.1:   bridge window [io  0x1000-0x1fff]
[    0.355215] pci 0000:00:01.1:   bridge window [mem 0xfca00000-0xfccfffff]
[    0.355217] pci 0000:00:01.1:   bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.355220] pci 0000:00:02.1: PCI bridge to [bus 04]
[    0.355221] pci 0000:00:02.1:   bridge window [io  0xf000-0xffff]
[    0.355224] pci 0000:00:02.1:   bridge window [mem 0xfcf00000-0xfcffffff]
[    0.355227] pci 0000:00:02.2: PCI bridge to [bus 05]
[    0.355231] pci 0000:00:02.2:   bridge window [mem 0xfc30300000-0xfc304fffff 64bit pref]
[    0.355234] pci 0000:00:02.3: PCI bridge to [bus 06]
[    0.355236] pci 0000:00:02.3:   bridge window [mem 0xfce00000-0xfcefffff]
[    0.355240] pci 0000:00:02.4: PCI bridge to [bus 07]
[    0.355241] pci 0000:00:02.4:   bridge window [io  0xe000-0xefff]
[    0.355244] pci 0000:00:02.4:   bridge window [mem 0xfcd00000-0xfcdfffff]
[    0.355248] pci 0000:00:08.1: PCI bridge to [bus 08]
[    0.355249] pci 0000:00:08.1:   bridge window [io  0xd000-0xdfff]
[    0.355252] pci 0000:00:08.1:   bridge window [mem 0xfc600000-0xfc9fffff]
[    0.355254] pci 0000:00:08.1:   bridge window [mem 0xfc20000000-0xfc301fffff 64bit pref]
[    0.355257] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    0.355259] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    0.355260] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    0.355261] pci_bus 0000:00: resource 7 [io  0x0d00-0xffff window]
[    0.355262] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000dffff window]
[    0.355263] pci_bus 0000:00: resource 9 [mem 0xc0000000-0xfcffffff window]
[    0.355264] pci_bus 0000:00: resource 10 [mem 0x1040000000-0xffffffffff window]
[    0.355266] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    0.355267] pci_bus 0000:01: resource 1 [mem 0xfca00000-0xfccfffff]
[    0.355268] pci_bus 0000:01: resource 2 [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.355269] pci_bus 0000:02: resource 1 [mem 0xfca00000-0xfcbfffff]
[    0.355270] pci_bus 0000:02: resource 2 [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.355272] pci_bus 0000:03: resource 1 [mem 0xfca00000-0xfcbfffff]
[    0.355273] pci_bus 0000:03: resource 2 [mem 0xf800000000-0xfc0fffffff 64bit pref]
[    0.355274] pci_bus 0000:04: resource 0 [io  0xf000-0xffff]
[    0.355275] pci_bus 0000:04: resource 1 [mem 0xfcf00000-0xfcffffff]
[    0.355276] pci_bus 0000:05: resource 2 [mem 0xfc30300000-0xfc304fffff 64bit pref]
[    0.355278] pci_bus 0000:06: resource 1 [mem 0xfce00000-0xfcefffff]
[    0.355279] pci_bus 0000:07: resource 0 [io  0xe000-0xefff]
[    0.355280] pci_bus 0000:07: resource 1 [mem 0xfcd00000-0xfcdfffff]
[    0.355281] pci_bus 0000:08: resource 0 [io  0xd000-0xdfff]
[    0.355282] pci_bus 0000:08: resource 1 [mem 0xfc600000-0xfc9fffff]
[    0.355283] pci_bus 0000:08: resource 2 [mem 0xfc20000000-0xfc301fffff 64bit pref]
[    0.355333] pci 0000:03:00.1: D0 power state depends on 0000:03:00.0
[    0.355478] pci 0000:08:00.1: D0 power state depends on 0000:08:00.0
[    0.355497] pci 0000:08:00.3: extending delay after power-on from D3hot to 20 msec
[    0.355580] pci 0000:08:00.4: extending delay after power-on from D3hot to 20 msec
[    0.355621] PCI: CLS 64 bytes, default 64
[    0.355628] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    0.355650] pci 0000:00:00.2: can't derive routing for PCI INT A
[    0.355651] pci 0000:00:00.2: PCI INT A: not connected
[    0.355664] pci 0000:00:01.0: Adding to iommu group 0
[    0.355670] pci 0000:00:01.1: Adding to iommu group 1
[    0.355680] pci 0000:00:02.0: Adding to iommu group 2
[    0.355686] pci 0000:00:02.1: Adding to iommu group 3
[    0.355691] pci 0000:00:02.2: Adding to iommu group 4
[    0.355697] pci 0000:00:02.3: Adding to iommu group 5
[    0.355702] pci 0000:00:02.4: Adding to iommu group 6
[    0.355710] pci 0000:00:08.0: Adding to iommu group 7
[    0.355715] pci 0000:00:08.1: Adding to iommu group 7
[    0.355723] pci 0000:00:14.0: Adding to iommu group 8
[    0.355728] pci 0000:00:14.3: Adding to iommu group 8
[    0.355745] pci 0000:00:18.0: Adding to iommu group 9
[    0.355749] pci 0000:00:18.1: Adding to iommu group 9
[    0.355755] pci 0000:00:18.2: Adding to iommu group 9
[    0.355760] pci 0000:00:18.3: Adding to iommu group 9
[    0.355765] pci 0000:00:18.4: Adding to iommu group 9
[    0.355770] pci 0000:00:18.5: Adding to iommu group 9
[    0.355775] pci 0000:00:18.6: Adding to iommu group 9
[    0.355780] pci 0000:00:18.7: Adding to iommu group 9
[    0.355787] pci 0000:01:00.0: Adding to iommu group 10
[    0.355793] pci 0000:02:00.0: Adding to iommu group 11
[    0.355802] pci 0000:03:00.0: Adding to iommu group 12
[    0.355810] pci 0000:03:00.1: Adding to iommu group 13
[    0.355816] pci 0000:04:00.0: Adding to iommu group 14
[    0.355823] pci 0000:05:00.0: Adding to iommu group 15
[    0.355828] pci 0000:06:00.0: Adding to iommu group 16
[    0.355834] pci 0000:07:00.0: Adding to iommu group 17
[    0.355846] pci 0000:08:00.0: Adding to iommu group 7
[    0.355848] pci 0000:08:00.1: Adding to iommu group 7
[    0.355851] pci 0000:08:00.2: Adding to iommu group 7
[    0.355854] pci 0000:08:00.3: Adding to iommu group 7
[    0.355856] pci 0000:08:00.4: Adding to iommu group 7
[    0.355859] pci 0000:08:00.5: Adding to iommu group 7
[    0.355861] pci 0000:08:00.6: Adding to iommu group 7
[    0.356134] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    0.356136] AMD-Vi: Extended features (0x206d73ef22254ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    0.356140] AMD-Vi: Interrupt remapping enabled
[    0.356141] AMD-Vi: Virtual APIC enabled
[    0.356142] AMD-Vi: X2APIC enabled
[    0.391926] ------------[ cut here ]------------
[    0.391928] WARNING: CPU: 0 PID: 1 at amd_iommu_enable_interrupts+0x1da/0x440
[    0.391932] Modules linked in:
[    0.391934] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.17.0-rc1-tip+ #2997
[    0.391936] Hardware name: ASUSTeK COMPUTER INC. ROG Strix G513QY_G513QY/G513QY, BIOS G513QY.316 11/29/2021
[    0.391937] RIP: 0010:amd_iommu_enable_interrupts+0x1da/0x440
[    0.391940] Code: 4b 38 48 89 41 18 b8 a0 86 01 00 0f 1f 44 00 00 48 8b 4b 38 8b 89 20 20 00 00 f7 c1 00 01 00 00 0f 85 7a fe ff ff ff c8 75 e6 <0f> 0b e9 6f fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00
[    0.391943] RSP: 0018:ffff88810022fc68 EFLAGS: 00010246
[    0.391944] RAX: 0000000000000000 RBX: ffff88810004b000 RCX: 0000000000000018
[    0.391946] RDX: 0000000000000008 RSI: ffff88810022fc70 RDI: ffffc900000800f0
[    0.391947] RBP: ffff88810022fc68 R08: ffff888100fce808 R09: 0000000000000000
[    0.391949] R10: 0000000000000000 R11: ffffffffffffffff R12: ffffffff7fffffff
[    0.391950] R13: 0000777f80000000 R14: 0000000000000000 R15: ffffffff8357c9e8
[    0.391951] FS:  0000000000000000(0000) GS:ffff888fde400000(0000) knlGS:0000000000000000
[    0.391953] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.391954] CR2: ffff88901e1ff000 CR3: 00000000b340c000 CR4: 0000000000150ef0
[    0.391955] Call Trace:
[    0.391957]  <TASK>
[    0.391958]  ? iommu_setup+0x29a/0x29a
[    0.391961]  ? state_next+0x6e/0x1c9
[    0.391963]  ? iommu_setup+0x29a/0x29a
[    0.391965]  ? iommu_go_to_state+0x1f/0x33
[    0.391966]  ? amd_iommu_init+0xa/0x23
[    0.391968]  ? pci_iommu_init+0xf/0x45
[    0.391969]  ? iommu_setup+0x29a/0x29a
[    0.391971]  ? __initstub__kmod_pci_dma__250_136_pci_iommu_initrootfs+0x5/0x8
[    0.391973]  ? do_one_initcall+0x100/0x290
[    0.391976]  ? do_initcall_level+0x8b/0xe5
[    0.391978]  ? do_initcalls+0x44/0x6d
[    0.391980]  ? kernel_init_freeable+0xc7/0x10d
[    0.391982]  ? rest_init+0xc0/0xc0
[    0.391984]  ? kernel_init+0x11/0x150
[    0.391985]  ? ret_from_fork+0x22/0x30
[    0.391987]  </TASK>
[    0.391988] ---[ end trace 0000000000000000 ]---
[    0.391989] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.391990] software IO TLB: mapped [mem 0x00000000ad000000-0x00000000b1000000] (64MB)
[    0.392067] RAPL PMU: API unit is 2^-32 Joules, 1 fixed counters, 163840 ms ovfl timer
[    0.392069] RAPL PMU: hw unit of domain package 2^-16 Joules
[    0.392071] LVT offset 0 assigned for vector 0x400
[    0.392177] perf: AMD IBS detected (0x000003ff)
[    0.392181] amd_uncore: 4  amd_df counters detected
[    0.392184] amd_uncore: 6  amd_l3 counters detected
[    0.392297] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
[    0.393078] Initialise system trusted keyrings
[    0.393099] workingset: timestamp_bits=46 max_order=24 bucket_order=0
[    0.393436] zbud: loaded
[    0.393653] Key type cifs.idmap registered
[    0.393685] ntfs3: Max link count 4000
[    0.393685] ntfs3: Enabled Linux POSIX ACLs support
[    0.393687] ntfs3: Read-only LZX/Xpress compression included
[    0.393703] fuse: init (API version 7.36)
[    0.399533] NET: Registered PF_ALG protocol family
[    0.399536] Key type asymmetric registered
[    0.399537] Asymmetric key parser 'x509' registered
[    0.399698] alg: self-tests for CTR-KDF (hmac(sha256)) passed
[    0.399709] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[    0.400703] pcieport 0000:00:01.1: PME: Signaling with IRQ 36
[    0.400715] pcieport 0000:00:01.1: pciehp: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ IbPresDis- LLActRep+
[    0.400812] pcieport 0000:00:02.1: PME: Signaling with IRQ 37
[    0.400883] pcieport 0000:00:02.2: PME: Signaling with IRQ 38
[    0.400957] pcieport 0000:00:02.3: PME: Signaling with IRQ 39
[    0.401032] pcieport 0000:00:02.4: PME: Signaling with IRQ 40
[    0.401104] pcieport 0000:00:08.1: PME: Signaling with IRQ 41
[    0.429522] ACPI: AC: AC Adapter [ADP0] (on-line)
[    0.429552] input: Lid Switch as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:2a/PNP0C0D:00/input/input0
[    0.429562] ACPI: button: Lid Switch [LID0]
[    0.429575] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input1
[    0.429583] ACPI: button: Power Button [PWRB]
[    0.429596] input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input2
[    0.429603] ACPI: button: Sleep Button [SLPB]
[    0.429627] ACPI: video: Video Device [VGA] (multi-head: yes  rom: no  post: no)
[    0.429709] acpi device:0d: registered as cooling_device0
[    0.429722] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:0c/LNXVIDEO:00/input/input3
[    0.429768] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1270
[    0.429776] Monitor-Mwait will be used to enter C-1 state
[    0.429778] ACPI: \_SB_.PLTF.P000: Found 3 idle states
[    0.429848] ACPI: \_SB_.PLTF.P001: Found 3 idle states
[    0.429907] ACPI: \_SB_.PLTF.P002: Found 3 idle states
[    0.429974] ACPI: \_SB_.PLTF.P003: Found 3 idle states
[    0.430029] ACPI: \_SB_.PLTF.P004: Found 3 idle states
[    0.430082] ACPI: \_SB_.PLTF.P005: Found 3 idle states
[    0.430136] ACPI: \_SB_.PLTF.P006: Found 3 idle states
[    0.430192] ACPI: \_SB_.PLTF.P007: Found 3 idle states
[    0.430245] ACPI: \_SB_.PLTF.P008: Found 3 idle states
[    0.430298] ACPI: \_SB_.PLTF.P009: Found 3 idle states
[    0.430354] ACPI: \_SB_.PLTF.P00A: Found 3 idle states
[    0.430397] ACPI: \_SB_.PLTF.P00B: Found 3 idle states
[    0.430453] ACPI: \_SB_.PLTF.P00C: Found 3 idle states
[    0.430505] ACPI: \_SB_.PLTF.P00D: Found 3 idle states
[    0.430556] ACPI: \_SB_.PLTF.P00E: Found 3 idle states
[    0.430608] ACPI: \_SB_.PLTF.P00F: Found 3 idle states
[    0.430711] thermal LNXTHERM:00: registered as thermal_zone0
[    0.430713] ACPI: thermal: Thermal Zone [TZ01] (63 C)
[    0.431027] Non-volatile memory driver v1.3
[    0.431042] Linux agpgart interface v0.103
[    0.431119] ACPI: battery: Slot [BAT0] (battery present)
[    0.431377] AMD-Vi: AMD IOMMUv2 loaded and initialized
[    0.431444] ACPI: bus type drm_connector registered
[    0.431449] [drm] amdgpu kernel modesetting enabled.
[    0.431454] amdgpu: vga_switcheroo: detected switching method \_SB_.PCI0.GP17.VGA_.ATPX handle
[    0.431587] ATPX version 1, functions 0x00000001
[    0.431604] ATPX Hybrid Graphics
[    0.434282] amdgpu: Virtual CRAT table created for CPU
[    0.434289] amdgpu: Topology: Add CPU node
[    0.434327] amdgpu 0000:03:00.0: enabling device (0000 -> 0002)
[    0.434347] [drm] initializing kernel modesetting (NAVY_FLOUNDER 0x1002:0x73DF 0x1043:0x16C2 0xC3).
[    0.434350] amdgpu 0000:03:00.0: amdgpu: Trusted Memory Zone (TMZ) feature not supported
[    0.434408] [drm] register mmio base: 0xFCA00000
[    0.434409] [drm] register mmio size: 1048576
[    0.435837] [drm] add ip block number 0 <nv_common>
[    0.435838] [drm] add ip block number 1 <gmc_v10_0>
[    0.435840] [drm] add ip block number 2 <navi10_ih>
[    0.435841] [drm] add ip block number 3 <psp>
[    0.435842] [drm] add ip block number 4 <smu>
[    0.435843] [drm] add ip block number 5 <dm>
[    0.435844] [drm] add ip block number 6 <gfx_v10_0>
[    0.435845] [drm] add ip block number 7 <sdma_v5_2>
[    0.435846] [drm] add ip block number 8 <vcn_v3_0>
[    0.435847] [drm] add ip block number 9 <jpeg_v3_0>
[    0.436831] amdgpu 0000:03:00.0: amdgpu: Fetched VBIOS from ATRM
[    0.436833] amdgpu: ATOM BIOS: SWBRT77321.001
[    0.436839] [drm] VCN(0) decode is enabled in VM mode
[    0.436840] [drm] VCN(0) encode is enabled in VM mode
[    0.436842] [drm] JPEG decode is enabled in VM mode
[    0.436854] [drm] GPU posting now...
[    0.436872] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[    0.436877] amdgpu 0000:03:00.0: amdgpu: VRAM: 12272M 0x0000008000000000 - 0x00000082FEFFFFFF (12272M used)
[    0.436879] amdgpu 0000:03:00.0: amdgpu: GART: 512M 0x0000000000000000 - 0x000000001FFFFFFF
[    0.436881] amdgpu 0000:03:00.0: amdgpu: AGP: 267894784M 0x0000008400000000 - 0x0000FFFFFFFFFFFF
[    0.436897] [drm] Detected VRAM RAM=12272M, BAR=16384M
[    0.436898] [drm] RAM width 192bits GDDR6
[    0.436922] [drm] amdgpu: 12272M of VRAM memory ready
[    0.436923] [drm] amdgpu: 12272M of GTT memory ready.
[    0.436926] [drm] GART: num cpu pages 131072, num gpu pages 131072
[    0.437050] [drm] PCIE GART of 512M enabled (table at 0x0000008000000000).
[    0.437107] amdgpu 0000:03:00.0: amdgpu: PSP runtime database doesn't exist
[    1.433931] tsc: Refined TSC clocksource calibration: 3293.797 MHz
[    1.433939] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2f7a68e2c17, max_idle_ns: 440795323013 ns
[    1.434656] clocksource: Switched to clocksource tsc
[    2.438256] amdgpu 0000:03:00.0: amdgpu: STB initialized to 2048 entries
[    2.438283] [drm] Loading DMUB firmware via PSP: version=0x02020007
[    2.438704] [drm] use_doorbell being set to: [true]
[    2.438722] [drm] use_doorbell being set to: [true]
[    2.438738] [drm] Found VCN firmware Version ENC: 1.16 DEC: 2 VEP: 0 Revision: 1
[    2.438742] amdgpu 0000:03:00.0: amdgpu: Will use PSP to load VCN firmware
[    2.600807] [drm] reserve 0xa00000 from 0x82fe000000 for PSP TMR
[    2.680371] amdgpu 0000:03:00.0: amdgpu: RAS: optional ras ta ucode is not available
[    2.690821] amdgpu 0000:03:00.0: amdgpu: SECUREDISPLAY: securedisplay ta ucode is not available
[    2.690843] amdgpu 0000:03:00.0: amdgpu: smu driver if version = 0x0000000e, smu fw if version = 0x00000012, smu fw version = 0x00412e00 (65.46.0)
[    2.690848] amdgpu 0000:03:00.0: amdgpu: SMU driver if version not matched
[    2.690854] amdgpu 0000:03:00.0: amdgpu: use vbios provided pptable
[    2.746280] amdgpu 0000:03:00.0: amdgpu: SMU is initialized successfully!
[    2.746414] [drm] Display Core initialized with v3.2.167!
[    2.747620] [drm] DMUB hardware initialized: version=0x02020007
[    2.767561] [drm] kiq ring mec 2 pipe 1 q 0
[    2.771222] [drm] VCN decode and encode initialized successfully(under DPG Mode).
[    2.771490] [drm] JPEG decode initialized successfully.
[    2.772682] kfd kfd: amdgpu: Allocated 3969056 bytes on gart
[    2.788796] memmap_init_zone_device initialised 3145728 pages in 15ms
[    2.788804] amdgpu: HMM registered 12272MB device memory
[    2.788855] amdgpu: Virtual CRAT table created for GPU
[    2.788944] amdgpu: Topology: Add dGPU node [0x73df:0x1002]
[    2.788948] kfd kfd: amdgpu: added device 1002:73df
[    2.788969] amdgpu 0000:03:00.0: amdgpu: SE 2, SH per SE 2, CU per SH 10, active_cu_number 40
[    2.789017] amdgpu 0000:03:00.0: amdgpu: ring gfx_0.0.0 uses VM inv eng 0 on hub 0
[    2.789019] amdgpu 0000:03:00.0: amdgpu: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[    2.789020] amdgpu 0000:03:00.0: amdgpu: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[    2.789022] amdgpu 0000:03:00.0: amdgpu: ring comp_1.2.0 uses VM inv eng 5 on hub 0
[    2.789023] amdgpu 0000:03:00.0: amdgpu: ring comp_1.3.0 uses VM inv eng 6 on hub 0
[    2.789024] amdgpu 0000:03:00.0: amdgpu: ring comp_1.0.1 uses VM inv eng 7 on hub 0
[    2.789026] amdgpu 0000:03:00.0: amdgpu: ring comp_1.1.1 uses VM inv eng 8 on hub 0
[    2.789027] amdgpu 0000:03:00.0: amdgpu: ring comp_1.2.1 uses VM inv eng 9 on hub 0
[    2.789028] amdgpu 0000:03:00.0: amdgpu: ring comp_1.3.1 uses VM inv eng 10 on hub 0
[    2.789029] amdgpu 0000:03:00.0: amdgpu: ring kiq_2.1.0 uses VM inv eng 11 on hub 0
[    2.789031] amdgpu 0000:03:00.0: amdgpu: ring sdma0 uses VM inv eng 12 on hub 0
[    2.789032] amdgpu 0000:03:00.0: amdgpu: ring sdma1 uses VM inv eng 13 on hub 0
[    2.789033] amdgpu 0000:03:00.0: amdgpu: ring vcn_dec_0 uses VM inv eng 0 on hub 1
[    2.789035] amdgpu 0000:03:00.0: amdgpu: ring vcn_enc_0.0 uses VM inv eng 1 on hub 1
[    2.789036] amdgpu 0000:03:00.0: amdgpu: ring vcn_enc_0.1 uses VM inv eng 4 on hub 1
[    2.789038] amdgpu 0000:03:00.0: amdgpu: ring jpeg_dec uses VM inv eng 5 on hub 1
[    2.789477] amdgpu 0000:03:00.0: amdgpu: Using BOCO for runtime pm
[    2.793501] [drm] Initialized amdgpu 3.44.0 20150101 for 0000:03:00.0 on minor 0
[    2.797529] amdgpu 0000:03:00.0: [drm] Cannot find any crtc or sizes
[    2.797691] amdgpu 0000:08:00.0: vgaarb: deactivate vga console
[    2.797708] amdgpu 0000:08:00.0: enabling device (0006 -> 0007)
[    2.797765] [drm] initializing kernel modesetting (RENOIR 0x1002:0x1638 0x1043:0x16C2 0xC4).
[    2.797770] amdgpu 0000:08:00.0: amdgpu: Trusted Memory Zone (TMZ) feature enabled
[    2.797887] [drm] register mmio base: 0xFC900000
[    2.797889] [drm] register mmio size: 524288
[    2.798996] [drm] add ip block number 0 <soc15_common>
[    2.798998] [drm] add ip block number 1 <gmc_v9_0>
[    2.798999] [drm] add ip block number 2 <vega10_ih>
[    2.799000] [drm] add ip block number 3 <psp>
[    2.799001] [drm] add ip block number 4 <smu>
[    2.799002] [drm] add ip block number 5 <dm>
[    2.799003] [drm] add ip block number 6 <gfx_v9_0>
[    2.799004] [drm] add ip block number 7 <sdma_v4_0>
[    2.799005] [drm] add ip block number 8 <vcn_v2_0>
[    2.799006] [drm] add ip block number 9 <jpeg_v2_0>
[    2.799015] amdgpu 0000:08:00.0: amdgpu: Fetched VBIOS from VFCT
[    2.799017] amdgpu: ATOM BIOS: 113-CEZANNE-018
[    2.799025] [drm] VCN decode is enabled in VM mode
[    2.799026] [drm] VCN encode is enabled in VM mode
[    2.799026] [drm] JPEG decode is enabled in VM mode
[    2.799028] amdgpu 0000:08:00.0: amdgpu: PCIE atomic ops is not supported
[    2.799046] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[    2.799051] amdgpu 0000:08:00.0: amdgpu: VRAM: 512M 0x000000F400000000 - 0x000000F41FFFFFFF (512M used)
[    2.799053] amdgpu 0000:08:00.0: amdgpu: GART: 1024M 0x0000000000000000 - 0x000000003FFFFFFF
[    2.799054] amdgpu 0000:08:00.0: amdgpu: AGP: 267419648M 0x000000F800000000 - 0x0000FFFFFFFFFFFF
[    2.799059] [drm] Detected VRAM RAM=512M, BAR=512M
[    2.799060] [drm] RAM width 128bits DDR4
[    2.799074] [drm] amdgpu: 512M of VRAM memory ready
[    2.799075] [drm] amdgpu: 3072M of GTT memory ready.
[    2.799078] [drm] GART: num cpu pages 262144, num gpu pages 262144
[    2.799194] [drm] PCIE GART of 1024M enabled.
[    2.799196] [drm] PTB located at 0x000000F400E10000
[    2.799272] amdgpu 0000:08:00.0: amdgpu: PSP runtime database doesn't exist
[    2.799277] [drm] Loading DMUB firmware via PSP: version=0x0101001C
[    2.799781] [drm] Found VCN firmware Version ENC: 1.16 DEC: 5 VEP: 0 Revision: 3
[    2.799784] amdgpu 0000:08:00.0: amdgpu: Will use PSP to load VCN firmware
[    3.503912] [drm] reserve 0x400000 from 0xf41f800000 for PSP TMR
[    3.585927] amdgpu 0000:08:00.0: amdgpu: RAS: optional ras ta ucode is not available
[    3.594552] amdgpu 0000:08:00.0: amdgpu: RAP: optional rap ta ucode is not available
[    3.594555] amdgpu 0000:08:00.0: amdgpu: SECUREDISPLAY: securedisplay ta ucode is not available
[    3.596447] amdgpu 0000:08:00.0: amdgpu: SMU is initialized successfully!
[    3.596620] [drm] Display Core initialized with v3.2.167!
[    3.597168] [drm] DMUB hardware initialized: version=0x0101001C
[    3.699855] clocksource: timekeeping watchdog on CPU6: Marking clocksource 'tsc' as unstable because the skew is too large:
[    3.699872] clocksource:                       'hpet' wd_nsec: 504211219 wd_now: 3033e92 wd_last: 29515d7 mask: ffffffff
[    3.699881] clocksource:                       'tsc' cs_nsec: 505917227 cs_now: 7cad43b2d cs_last: 767812839 mask: ffffffffffffffff
[    3.699888] clocksource:                       'tsc' is current clocksource.
[    3.699893] tsc: Marking TSC unstable due to clocksource watchdog
[    3.700128] clocksource: Checking clocksource tsc synchronization from CPU 9 to CPUs 0,3,5-6,13-15.
[    3.700422] clocksource: Switched to clocksource hpet
[    3.766515] [drm] kiq ring mec 2 pipe 1 q 0
[    3.772388] [drm] VCN decode and encode initialized successfully(under DPG Mode).
[    3.772407] [drm] JPEG decode initialized successfully.
[    3.773932] kfd kfd: amdgpu: Allocated 3969056 bytes on gart
[    3.774373] memmap_init_zone_device initialised 131072 pages in 0ms
[    3.774377] amdgpu: HMM registered 512MB device memory
[    3.774393] amdgpu: Virtual CRAT table created for GPU
[    3.775581] amdgpu: Topology: Add dGPU node [0x1638:0x1002]
[    3.775583] kfd kfd: amdgpu: added device 1002:1638
[    3.775660] amdgpu 0000:08:00.0: amdgpu: SE 1, SH per SE 1, CU per SH 8, active_cu_number 8
[    3.776440] amdgpu 0000:08:00.0: amdgpu: ring gfx uses VM inv eng 0 on hub 0
[    3.776442] amdgpu 0000:08:00.0: amdgpu: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[    3.776443] amdgpu 0000:08:00.0: amdgpu: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[    3.776444] amdgpu 0000:08:00.0: amdgpu: ring comp_1.2.0 uses VM inv eng 5 on hub 0
[    3.776446] amdgpu 0000:08:00.0: amdgpu: ring comp_1.3.0 uses VM inv eng 6 on hub 0
[    3.776447] amdgpu 0000:08:00.0: amdgpu: ring comp_1.0.1 uses VM inv eng 7 on hub 0
[    3.776448] amdgpu 0000:08:00.0: amdgpu: ring comp_1.1.1 uses VM inv eng 8 on hub 0
[    3.776449] amdgpu 0000:08:00.0: amdgpu: ring comp_1.2.1 uses VM inv eng 9 on hub 0
[    3.776451] amdgpu 0000:08:00.0: amdgpu: ring comp_1.3.1 uses VM inv eng 10 on hub 0
[    3.776452] amdgpu 0000:08:00.0: amdgpu: ring kiq_2.1.0 uses VM inv eng 11 on hub 0
[    3.776453] amdgpu 0000:08:00.0: amdgpu: ring sdma0 uses VM inv eng 0 on hub 1
[    3.776454] amdgpu 0000:08:00.0: amdgpu: ring vcn_dec uses VM inv eng 1 on hub 1
[    3.776456] amdgpu 0000:08:00.0: amdgpu: ring vcn_enc0 uses VM inv eng 4 on hub 1
[    3.776457] amdgpu 0000:08:00.0: amdgpu: ring vcn_enc1 uses VM inv eng 5 on hub 1
[    3.776458] amdgpu 0000:08:00.0: amdgpu: ring jpeg_dec uses VM inv eng 6 on hub 1
[    3.777973] [drm] Initialized amdgpu 3.44.0 20150101 for 0000:08:00.0 on minor 1
[    3.782995] fbcon: amdgpudrmfb (fb0) is primary device
[    4.455442] Console: switching to colour frame buffer device 160x45
[    4.469851] amdgpu 0000:08:00.0: [drm] fb0: amdgpudrmfb frame buffer device
[    4.471466] loop: module loaded
[    4.471710] nvme 0000:06:00.0: platform quirk: setting simple suspend
[    4.471830] nvme nvme0: pci function 0000:06:00.0
[    4.471913] nvme 0000:07:00.0: platform quirk: setting simple suspend
[    4.472052] nvme nvme1: pci function 0000:07:00.0
[    4.479771] r8169 0000:04:00.0 eth0: RTL8168h/8111h, 7c:10:c9:27:22:9a, XID 541, IRQ 52
[    4.479906] r8169 0000:04:00.0 eth0: jumbo features [frames: 9194 bytes, tx checksumming: ko]
[    4.480085] mt7921e 0000:05:00.0: enabling device (0000 -> 0002)
[    4.485753] nvme nvme0: Shutdown timeout set to 8 seconds
[    4.497141] nvme nvme1: 8/0/0 default/read/poll queues
[    4.499639]  nvme1n1: p1 p2 p3
[    4.500446] mt7921e 0000:05:00.0: ASIC revision: 79610010
[    4.500809] nvme nvme0: allocated 64 MiB host memory buffer.
[    4.548769] nvme nvme0: 12/0/0 default/read/poll queues
[    4.555357]  nvme0n1: p1 p2 p3
[    4.575020] mt7921e 0000:05:00.0: HW/SW Version: 0x8a108a10, Build Time: 20220110230855a

[    4.585961] mt7921e 0000:05:00.0: WM Firmware Version: ____010000, Build Time: 20220110230951
[    5.424387] xhci_hcd 0000:08:00.3: xHCI Host Controller
[    5.427661] xhci_hcd 0000:08:00.3: new USB bus registered, assigned bus number 1
[    5.431175] xhci_hcd 0000:08:00.3: hcc params 0x0268ffe5 hci version 0x110 quirks 0x0000020000000410
[    5.434910] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.17
[    5.437865] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.440957] usb usb1: Product: xHCI Host Controller
[    5.443940] usb usb1: Manufacturer: Linux 5.17.0-rc1-tip+ xhci-hcd
[    5.446893] usb usb1: SerialNumber: 0000:08:00.3
[    5.450119] hub 1-0:1.0: USB hub found
[    5.453417] hub 1-0:1.0: 4 ports detected
[    5.456447] xhci_hcd 0000:08:00.3: xHCI Host Controller
[    5.459270] xhci_hcd 0000:08:00.3: new USB bus registered, assigned bus number 2
[    5.462129] xhci_hcd 0000:08:00.3: Host supports USB 3.1 Enhanced SuperSpeed
[    5.465707] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    5.468507] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.17
[    5.471350] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.474149] usb usb2: Product: xHCI Host Controller
[    5.477193] usb usb2: Manufacturer: Linux 5.17.0-rc1-tip+ xhci-hcd
[    5.479912] usb usb2: SerialNumber: 0000:08:00.3
[    5.482850] hub 2-0:1.0: USB hub found
[    5.485600] hub 2-0:1.0: 2 ports detected
[    5.488516] xhci_hcd 0000:08:00.4: xHCI Host Controller
[    5.491139] xhci_hcd 0000:08:00.4: new USB bus registered, assigned bus number 3
[    5.493856] xhci_hcd 0000:08:00.4: hcc params 0x0268ffe5 hci version 0x110 quirks 0x0000020000000410
[    5.496850] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.17
[    5.499472] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.502145] usb usb3: Product: xHCI Host Controller
[    5.504769] usb usb3: Manufacturer: Linux 5.17.0-rc1-tip+ xhci-hcd
[    5.507405] usb usb3: SerialNumber: 0000:08:00.4
[    5.510146] hub 3-0:1.0: USB hub found
[    5.512764] hub 3-0:1.0: 4 ports detected
[    5.515575] xhci_hcd 0000:08:00.4: xHCI Host Controller
[    5.518150] xhci_hcd 0000:08:00.4: new USB bus registered, assigned bus number 4
[    5.520707] xhci_hcd 0000:08:00.4: Host supports USB 3.1 Enhanced SuperSpeed
[    5.523239] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[    5.525814] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.17
[    5.528400] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.530986] usb usb4: Product: xHCI Host Controller
[    5.533565] usb usb4: Manufacturer: Linux 5.17.0-rc1-tip+ xhci-hcd
[    5.536131] usb usb4: SerialNumber: 0000:08:00.4
[    5.539103] hub 4-0:1.0: USB hub found
[    5.542100] hub 4-0:1.0: 2 ports detected
[    5.545654] usbcore: registered new interface driver cdc_acm
[    5.548313] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
[    5.551601] usbcore: registered new interface driver uas
[    5.554062] usbcore: registered new interface driver usb-storage
[    5.557476] i8042: PNP: PS/2 Controller [PNP030b:PS2K] at 0x60,0x64 irq 1
[    5.559859] i8042: PNP: PS/2 appears to have AUX port disabled, if this is incorrect please boot with i8042.nopnp
[    5.562946] serio: i8042 KBD port at 0x60,0x64 irq 1
[    5.566037] mousedev: PS/2 mouse device common for all mice
[    5.568682] rtc_cmos 00:01: RTC can wake from S4
[    5.571333] rtc_cmos 00:01: registered as rtc0
[    5.574072] rtc_cmos 00:01: setting system clock to 2022-01-26T09:50:32 UTC (1643190632)
[    5.576740] rtc_cmos 00:01: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    5.579560] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xff00, revision 15
[    5.582555] piix4_smbus 0000:00:14.0: Using register 0x02 for SMBus port selection
[    5.585164] piix4_smbus 0000:00:14.0: Auxiliary SMBus Host Controller at 0xff20
[    5.587857] usbcore: registered new interface driver uvcvideo
[    5.590510] sp5100_tco: SP5100/SB800 TCO WatchDog Timer Driver
[    5.593416] sp5100-tco sp5100-tco: Using 0xfeb00000 for watchdog MMIO address
[    5.595943] sp5100-tco sp5100-tco: Watchdog hardware is disabled
[    5.598745] usbcore: registered new interface driver btusb
[    5.604629] simple-framebuffer simple-framebuffer.0: simplefb: a framebuffer is already registered
[    5.607221] simple-framebuffer: probe of simple-framebuffer.0 failed with error -22
[    5.610183] EFI Variables Facility v0.08 2004-May-17
[    5.619195] pstore: Registered efi as persistent store backend
[    5.621865] ccp 0000:08:00.2: enabling device (0000 -> 0002)
[    5.635384] ccp 0000:08:00.2: tee enabled
[    5.638210] ccp 0000:08:00.2: psp enabled
[    5.641302] hid: raw HID events driver (C) Jiri Kosina
[    5.643941] usbcore: registered new interface driver usbhid
[    5.646459] usbhid: USB HID core driver
[    5.691963] usb 1-3: new full-speed USB device number 2 using xhci_hcd
[    5.736192] input: ASUE120A:00 04F3:319B Mouse as /devices/platform/AMDI0010:00/i2c-0/i2c-ASUE120A:00/0018:04F3:319B.0001/input/input5
[    5.741447] input: ASUE120A:00 04F3:319B Touchpad as /devices/platform/AMDI0010:00/i2c-0/i2c-ASUE120A:00/0018:04F3:319B.0001/input/input6
[    5.746063] hid-multitouch 0018:04F3:319B.0001: input,hidraw0: I2C HID v1.00 Mouse [ASUE120A:00 04F3:319B] on i2c-ASUE120A:00
[    5.756227] usb 3-4: new high-speed USB device number 2 using xhci_hcd
[    5.774734] input: Asus Wireless Radio Control as /devices/LNXSYSTM:00/LNXSYBUS:00/ATK4002:00/input/input7
[    5.781075] asus_wmi: ASUS WMI generic driver loaded
[    5.786512] asus_wmi: Initialization: 0x1
[    5.791091] asus_wmi: SFUN value: 0x1821
[    5.795215] asus-nb-wmi asus-nb-wmi: Detected ATK, not ASUSWMI, use DSTS
[    5.798967] asus-nb-wmi asus-nb-wmi: Detected ATK, enable event queue
[    5.804683] asus-nb-wmi asus-nb-wmi: Using throttle_thermal_policy for platform_profile support
[    5.809568] input: Asus WMI hotkeys as /devices/platform/asus-nb-wmi/input/input8
[    5.817533] ACPI: battery: new extension: ASUS Battery Extension
[    5.822141] amd-tee driver initialization successful
[    5.826409] snd_hda_intel 0000:03:00.1: enabling device (0000 -> 0002)
[    5.830084] snd_hda_intel 0000:03:00.1: Handle vga_switcheroo audio client
[    5.833913] snd_hda_intel 0000:03:00.1: Force to non-snoop mode
[    5.837987] snd_hda_intel 0000:08:00.1: enabling device (0000 -> 0002)
[    5.841654] snd_hda_intel 0000:08:00.1: Handle vga_switcheroo audio client
[    5.845213] usbcore: registered new interface driver snd-usb-audio
[    5.846450] snd_hda_intel 0000:03:00.1: bound 0000:03:00.0 (ops amdgpu_dm_audio_component_bind_ops)
[    5.848438] snd_rn_pci_acp3x 0000:08:00.5: enabling device (0000 -> 0002)
[    5.851619] input: HDA ATI HDMI HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:01.1/0000:01:00.0/0000:02:00.0/0000:03:00.1/sound/card0/input9
[    5.854340] usb 1-3: New USB device found, idVendor=0b05, idProduct=1866, bcdDevice=40.23
[    5.855144] xt_time: kernel timezone is -0000
[    5.855172] snd_hda_intel 0000:08:00.1: bound 0000:08:00.0 (ops amdgpu_dm_audio_component_bind_ops)
[    5.855197] ipt_CLUSTERIP: ClusterIP Version 0.8 loaded successfully
[    5.855204] Initializing XFRM netlink socket
[    5.855247] NET: Registered PF_INET6 protocol family
[    5.855356] input: HD-Audio Generic HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:08.1/0000:08:00.1/sound/card1/input10
[    5.855462] Segment Routing with IPv6
[    5.855466] In-situ OAM (IOAM) with IPv6
[    5.855499] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[    5.855596] NET: Registered PF_PACKET protocol family
[    5.855600] NET: Registered PF_KEY protocol family
[    5.855656] Bluetooth: RFCOMM TTY layer initialized
[    5.855659] Bluetooth: RFCOMM socket layer initialized
[    5.855663] Bluetooth: RFCOMM ver 1.11
[    5.855665] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[    5.855666] Bluetooth: BNEP filters: protocol multicast
[    5.855667] Bluetooth: BNEP socket layer initialized
[    5.855668] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[    5.855670] Bluetooth: HIDP socket layer initialized
[    5.856031] Key type dns_resolver registered
[    5.864053] snd_hda_codec_realtek hdaudioC2D0: autoconfig for ALC294: line_outs=1 (0x17/0x0/0x0/0x0/0x0) type:speaker
[    5.865305] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    5.865409] microcode: CPU0: patch_level=0x0a50000c
[    5.865417] microcode: CPU1: patch_level=0x0a50000c
[    5.865424] microcode: CPU2: patch_level=0x0a50000c
[    5.866278] microcode: CPU3: patch_level=0x0a50000c
[    5.868390] snd_hda_codec_realtek hdaudioC2D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    5.868399] microcode: CPU4: patch_level=0x0a50000c
[    5.868409] microcode: CPU5: patch_level=0x0a50000c
[    5.868426] microcode: CPU6: patch_level=0x0a50000c
[    5.868435] microcode: CPU7: patch_level=0x0a50000c
[    5.868444] microcode: CPU8: patch_level=0x0a50000c
[    5.868454] microcode: CPU9: patch_level=0x0a50000c
[    5.868472] microcode: CPU10: patch_level=0x0a50000c
[    5.868480] microcode: CPU11: patch_level=0x0a50000c
[    5.868481] microcode: CPU12: patch_level=0x0a50000c
[    5.868490] microcode: CPU13: patch_level=0x0a50000c
[    5.869388] microcode: CPU14: patch_level=0x0a50000c
[    5.872274] microcode: CPU15: patch_level=0x0a50000c
[    5.872274] usb 1-3: Product: N-KEY Device
[    5.872275] usb 1-3: Manufacturer: ASUSTek Computer Inc.
[    5.875521] snd_hda_codec_realtek hdaudioC2D0:    hp_outs=1 (0x21/0x0/0x0/0x0/0x0)
[    5.879366] microcode: Microcode Update Driver: v2.2.
[    5.879369] IPI shorthand broadcast: enabled
[    5.879372] AVX2 version of gcm_enc/dec engaged.
[    5.890634] usb 3-4: New USB device found, idVendor=13d3, idProduct=3563, bcdDevice= 1.00
[    5.892221] snd_hda_codec_realtek hdaudioC2D0:    mono: mono_out=0x0
[    5.896155] usb 3-4: New USB device strings: Mfr=5, Product=6, SerialNumber=7
[    5.896157] usb 3-4: Product: Wireless_Device
[    5.896158] usb 3-4: Manufacturer: MediaTek Inc.
[    5.896159] usb 3-4: SerialNumber: 000000000
[    5.896169] AES CTR mode by8 optimization enabled
[    5.896437] asus 0003:0B05:1866.0002: Asus initialise N-KEY Device
[    5.899260] snd_hda_codec_realtek hdaudioC2D0:    inputs:
[    5.902705] registered taskstats version 1
[    5.905386] snd_hda_codec_realtek hdaudioC2D0:      Headset Mic=0x19
[    5.908389] Loading compiled-in X.509 certificates
[    5.917492] input: ASUSTek Computer Inc. N-KEY Device as /devices/pci0000:00/0000:00:08.1/0000:08:00.3/usb1/1-3/1-3:1.0/0003:0B05:1866.0002/input/input11
[    5.920442] snd_hda_codec_realtek hdaudioC2D0:      Internal Mic=0x12
[    5.978062] asus 0003:0B05:1866.0002: input,hiddev0,hidraw1: USB HID v1.10 Keyboard [ASUSTek Computer Inc. N-KEY Device] on usb-0000:08:00.3-3/input0
[    6.025764] Bluetooth: hci0: Device setup in 121325 usecs
[    6.028424] Key type ._fscrypt registered
[    6.031478] Key type .fscrypt registered
[    6.035396] Key type fscrypt-provisioning registered
[    6.042084] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    6.047174] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    6.051594] Unstable clock detected, switching default tracing clock to "global"
               If you want to keep using the local clock, then add:
                 "trace_clock=local"
               on the kernel command line
[    6.068008] ALSA device list:
[    6.071943]   #0: HDA ATI HDMI at 0xfcb20000 irq 97
[    6.075074]   #1: HD-Audio Generic at 0xfc9c8000 irq 99
[    6.098405] Bluetooth: hci0: AOSP extensions version v1.00
[    6.101090] Bluetooth: hci0: AOSP quality report is supported
[    6.441241] input: HD-Audio Generic Headset Mic as /devices/pci0000:00/0000:00:08.1/0000:08:00.6/sound/card2/input13
[    6.446328] input: HD-Audio Generic Headphone as /devices/pci0000:00/0000:00:08.1/0000:08:00.6/sound/card2/input14
[    6.450666] EXT4-fs (nvme0n1p2): mounted filesystem with ordered data mode. Quota mode: disabled.
[    6.453551] VFS: Mounted root (ext4 filesystem) readonly on device 259:6.
[    6.456999] devtmpfs: mounted
[    6.461914] Freeing unused kernel image (initmem) memory: 1120K
[    6.466919] Write protecting the kernel read-only data: 36864k
[    6.472750] Freeing unused kernel image (text/rodata gap) memory: 2036K
[    6.477938] Freeing unused kernel image (rodata/data gap) memory: 260K
[    6.483054] Run /usr/lib/systemd/systemd as init process
[    6.488209]   with arguments:
[    6.488211]     /usr/lib/systemd/systemd
[    6.488213]   with environment:
[    6.488214]     HOME=/
[    6.488215]     TERM=linux
[    6.553240] systemd[1]: systemd 249 running in system mode (+PAM -AUDIT -SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT +GNUTLS +OPENSSL +ACL +BLKID -CURL -ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD -LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE -BZIP2 +LZ4 +XZ -ZLIB +ZSTD +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    6.581000] systemd[1]: Detected architecture x86-64.
[    6.653986] systemd[1]: /lib/systemd/system/gpm.service:7: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[    6.674517] systemd[1]: Queued start job for default target Graphical Interface.
[    6.678797] systemd[1]: Created slice Slice /system/getty.
[    6.687522] systemd[1]: Created slice Slice /system/modprobe.
[    6.696141] systemd[1]: Created slice Slice /system/systemd-fsck.
[    6.703792] systemd[1]: Created slice User and Session Slice.
[    6.711126] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    6.718731] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    6.725978] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[    6.733468] systemd[1]: Reached target Login Prompts.
[    6.742196] systemd[1]: Reached target Remote File Systems.
[    6.751155] systemd[1]: Reached target Slice Units.
[    6.758880] systemd[1]: Reached target Swaps.
[    6.767131] systemd[1]: Listening on Process Core Dump Socket.
[    6.774446] systemd[1]: Listening on initctl Compatibility Named Pipe.
[    6.782635] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
[    6.786927] systemd[1]: Listening on Journal Socket (/dev/log).
[    6.794562] systemd[1]: Listening on Journal Socket.
[    6.802126] systemd[1]: Listening on Network Service Netlink Socket.
[    6.810129] systemd[1]: Listening on udev Control Socket.
[    6.817833] systemd[1]: Listening on udev Kernel Socket.
[    6.825330] systemd[1]: Mounting Huge Pages File System...
[    6.833768] systemd[1]: Mounting POSIX Message Queue File System...
[    6.842298] systemd[1]: Mounting Kernel Debug File System...
[    6.850543] systemd[1]: Mounting Kernel Trace File System...
[    6.858410] systemd[1]: tmp.mount: Directory /tmp to mount over is not empty, mounting anyway.
[    6.862499] systemd[1]: Mounting Temporary Directory /tmp...
[    6.870153] systemd[1]: Condition check resulted in Create List of Static Device Nodes being skipped.
[    6.874335] systemd[1]: Starting Load Kernel Module configfs...
[    6.882392] systemd[1]: Starting Load Kernel Module drm...
[    6.889750] systemd[1]: Starting Load Kernel Module fuse...
[    6.896809] systemd[1]: Starting File System Check on Root Device...
[    6.904508] systemd[1]: Starting Journal Service...
[    6.911885] systemd[1]: Condition check resulted in Load Kernel Modules being skipped.
[    6.915477] systemd[1]: Starting Apply Kernel Variables...
[    6.923801] systemd[1]: Starting Coldplug All udev Devices...
[    6.932465] systemd[1]: Mounted Huge Pages File System.
[    6.939186] systemd[1]: Mounted POSIX Message Queue File System.
[    6.946979] systemd[1]: Mounted Kernel Debug File System.
[    6.953658] systemd[1]: Started Journal Service.
[    6.995677] EXT4-fs (nvme0n1p2): re-mounted. Quota mode: disabled.
[    7.010916] systemd-journald[351]: Received client request to flush runtime journal.
[    7.211895] EXT4-fs (nvme0n1p3): mounted filesystem with ordered data mode. Quota mode: disabled.
[    7.598946] Generic FE-GE Realtek PHY r8169-0-400:00: attached PHY driver (mii_bus:phy_addr=r8169-0-400:00, irq=MAC)
[    7.772105] r8169 0000:04:00.0 eth0: Link is Down
[   14.463946] wlan0: authenticate with a0:63:91:a7:3c:9f
[   14.650184] wlan0: send auth to a0:63:91:a7:3c:9f (try 1/3)
[   14.749625] wlan0: authenticate with a0:63:91:a7:3c:9f
[   14.749630] wlan0: send auth to a0:63:91:a7:3c:9f (try 1/3)
[   14.783005] wlan0: authenticated
[   14.784953] wlan0: associate with a0:63:91:a7:3c:9f (try 1/3)
[   14.788207] wlan0: RX AssocResp from a0:63:91:a7:3c:9f (capab=0x11 status=0 aid=4)
[   14.814261] wlan0: associated
[   14.892392] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   48.908055] [drm] free PSP TMR buffer

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Maxim Levitsky]

On Wed, 2022-01-26 at 09:54 +0000, Mike Lothian wrote:
> On Wed, 26 Jan 2022 at 07:34, Maxim Levitsky <mlevitsk@redhat.com> wrote:
> > Could you post the whole dmesg, or at least:
> > 
> > dmesg | grep AMD-Vi
> > 
> > 
> > What CPU does your system have?
> > 
> > I suspect that your system doesn't GA log feature enabled in the IOMMU, and the code never checks
> > for that, and here it fails enabling it, which  before my patches was just
> > ignoring it silently.
> > 
> > 
> > Best regards,
> >         Maxim Levitsky
> > > Hope that helps
> > > 
> > > Mike
> > > 
> 
> Hi
> 
> It's an AMD Ryzen 9 5900HX
> 
> [    0.186350] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR0, rdevid:160
> [    0.186353] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR1, rdevid:160
> [    0.186354] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR2, rdevid:160
> [    0.186355] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR3, rdevid:160
> [    0.355628] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
> [    0.356134] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
> [    0.356136] AMD-Vi: Extended features (0x206d73ef22254ade): PPR
> X2APIC NX GT IA GA PC GA_vAPIC
> [    0.356140] AMD-Vi: Interrupt remapping enabled
> [    0.356141] AMD-Vi: Virtual APIC enabled
> [    0.356142] AMD-Vi: X2APIC enabled
> [    0.431377] AMD-Vi: AMD IOMMUv2 loaded and initialized
> 
> I've attached the dmesg, I notice that some boots it doesn't happen
> 
> Cheers
> 
> Mike

Great, your system does seem to support GA log 
(but a patch to check if, other that assume blindly that it is supported is 
something that should be done).

So could you bump the LOOP_TIMEOUT like by 10x or so and see if the problem goes away?

(that code should be rewritten to time based wait and not just blindly loop like that,
I also can prepare a patch for that as well).

Best regards,
	Maxim Levitsky

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Mike Lothian]

On Wed, 26 Jan 2022 at 10:12, Maxim Levitsky <mlevitsk@redhat.com> wrote:
>
> Great, your system does seem to support GA log
> (but a patch to check if, other that assume blindly that it is supported is
> something that should be done).
>
> So could you bump the LOOP_TIMEOUT like by 10x or so and see if the problem goes away?
>
> (that code should be rewritten to time based wait and not just blindly loop like that,
> I also can prepare a patch for that as well).
>
> Best regards,
>         Maxim Levitsky
>

Hi

I've done quite a few restarts with the LOOP_TIMEOUT increased and
I've not seen the issue since

Cheers

Mike

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Maxim Levitsky]

On Thu, 2022-01-27 at 00:39 +0000, Mike Lothian wrote:
> On Wed, 26 Jan 2022 at 10:12, Maxim Levitsky <mlevitsk@redhat.com> wrote:
> > Great, your system does seem to support GA log
> > (but a patch to check if, other that assume blindly that it is supported is
> > something that should be done).
> > 
> > So could you bump the LOOP_TIMEOUT like by 10x or so and see if the problem goes away?
> > 
> > (that code should be rewritten to time based wait and not just blindly loop like that,
> > I also can prepare a patch for that as well).
> > 
> > Best regards,
> >         Maxim Levitsky
> > 
> 
> Hi
> 
> I've done quite a few restarts with the LOOP_TIMEOUT increased and
> I've not seen the issue since

Great, so the problem is solved I guess. 
Thanks for the help!


I'll send a patch for this in few days to replace this and other similiar timeouts
with a proper udelay() wait.

Best regards,
	Maxim Levitsky

> 
> Cheers
> 
> Mike
> 

Re: [PATCH 0/5] iommu/amd: fixes for suspend/resume

[Mike Lothian]

On Thu, 27 Jan 2022 at 10:22, Maxim Levitsky <mlevitsk@redhat.com> wrote:
>
> On Thu, 2022-01-27 at 00:39 +0000, Mike Lothian wrote:
> > On Wed, 26 Jan 2022 at 10:12, Maxim Levitsky <mlevitsk@redhat.com> wrote:
> > > Great, your system does seem to support GA log
> > > (but a patch to check if, other that assume blindly that it is supported is
> > > something that should be done).
> > >
> > > So could you bump the LOOP_TIMEOUT like by 10x or so and see if the problem goes away?
> > >
> > > (that code should be rewritten to time based wait and not just blindly loop like that,
> > > I also can prepare a patch for that as well).
> > >
> > > Best regards,
> > >         Maxim Levitsky
> > >
> >
> > Hi
> >
> > I've done quite a few restarts with the LOOP_TIMEOUT increased and
> > I've not seen the issue since
>
> Great, so the problem is solved I guess.
> Thanks for the help!
>
>
> I'll send a patch for this in few days to replace this and other similiar timeouts
> with a proper udelay() wait.
>

Thanks for your help