[PATCH 0/2] Fix boot hang issue on Ampere Emag server

[PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Jia He]

I met a hung task warning and then kernel was hung forever with latest
kernel on an Ampere Emag server.

The root cause is kernel was hung  when invoking an efi rts call to set
the RandomSeed variable during the booting stage. The arch_efi_call_virt
call (set_variable) was never returned and then caused the hung task error.

On the Emag server, efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE)
is returned with "true"

Fix it by introducing the efi_get_supported_rt_services() and then determine
to set or clear the runtime services bit of efi.flags.

Jia He (2):
  efi: libstub: Fix the retriving of supported rutime services
  efi: Introduce efi_get_supported_rt_services() to get the runtime
    services mask

 drivers/firmware/efi/arm-runtime.c      |  5 ++++-
 drivers/firmware/efi/efi.c              | 28 +++++++++++++++++--------
 drivers/firmware/efi/libstub/efi-stub.c |  2 ++
 include/linux/efi.h                     |  1 +
 4 files changed, 26 insertions(+), 10 deletions(-)

-- 
2.25.1

[PATCH 1/2] efi: libstub: Fix the retriving of supported rutime services

[Jia He]

If retrieving UEFI configuration table is failed, the supported runtime
services mask should be regarded as 0 instead of EFI_RT_SUPPORTED_ALL.
Otherwise efi_novamap might be incorrectly assigned to "false" on the
Ampere Emag server.

Signed-off-by: Jia He <justin.he@arm.com>
---
 drivers/firmware/efi/libstub/efi-stub.c | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/drivers/firmware/efi/libstub/efi-stub.c b/drivers/firmware/efi/libstub/efi-stub.c
index 2955c1ac6a36..f24b5436729c 100644
--- a/drivers/firmware/efi/libstub/efi-stub.c
+++ b/drivers/firmware/efi/libstub/efi-stub.c
@@ -111,6 +111,8 @@ static u32 get_supported_rt_services(void)
 	rt_prop_table = get_efi_config_table(EFI_RT_PROPERTIES_TABLE_GUID);
 	if (rt_prop_table)
 		supported &= rt_prop_table->runtime_services_supported;
+	else
+		supported = 0;
 
 	return supported;
 }
-- 
2.25.1

Re: [PATCH 1/2] efi: libstub: Fix the retriving of supported rutime services

[Ard Biesheuvel]

On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
>
> If retrieving UEFI configuration table is failed, the supported runtime
> services mask should be regarded as 0 instead of EFI_RT_SUPPORTED_ALL.
> Otherwise efi_novamap might be incorrectly assigned to "false" on the
> Ampere Emag server.
>
> Signed-off-by: Jia He <justin.he@arm.com>
> ---
>  drivers/firmware/efi/libstub/efi-stub.c | 2 ++
>  1 file changed, 2 insertions(+)
>
> diff --git a/drivers/firmware/efi/libstub/efi-stub.c b/drivers/firmware/efi/libstub/efi-stub.c
> index 2955c1ac6a36..f24b5436729c 100644
> --- a/drivers/firmware/efi/libstub/efi-stub.c
> +++ b/drivers/firmware/efi/libstub/efi-stub.c
> @@ -111,6 +111,8 @@ static u32 get_supported_rt_services(void)
>         rt_prop_table = get_efi_config_table(EFI_RT_PROPERTIES_TABLE_GUID);
>         if (rt_prop_table)
>                 supported &= rt_prop_table->runtime_services_supported;
> +       else
> +               supported = 0;
>
>         return supported;
>  }

Hello Justin,

This is not how things are supposed to work. On systems that do not
implement the RT properties table, all runtime services are assumed to
be implemented.

Note that this table is informational only - the runtime services
themselves must be callable and return EFI_UNSUPPORTED if they are
marked as unavailable in the RT properties table.

[PATCH 2/2] efi: Introduce efi_get_supported_rt_services() to get the runtime services mask

[Jia He]

Previously, efi.runtime_supported_mask will always be the initial value
EFI_RT_SUPPORTED_ALL and can't be retrieved in efi_config_parse_tables()
if rt_prop is EFI_INVALID_TABLE_ADDR. Thus this can cause the wrong
return value of efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE)
on the Ampere Emag server.

Besides, abstract the runtime services retrieving into a new exported
helper efi_get_supported_rt_services() to set or clear the runtime service
bit of efi.flags.

Signed-off-by: Jia He <justin.he@arm.com>
---
 drivers/firmware/efi/arm-runtime.c |  5 ++++-
 drivers/firmware/efi/efi.c         | 28 +++++++++++++++++++---------
 include/linux/efi.h                |  1 +
 3 files changed, 24 insertions(+), 10 deletions(-)

diff --git a/drivers/firmware/efi/arm-runtime.c b/drivers/firmware/efi/arm-runtime.c
index 83f5bb57fa4c..ce93133f9abc 100644
--- a/drivers/firmware/efi/arm-runtime.c
+++ b/drivers/firmware/efi/arm-runtime.c
@@ -146,7 +146,10 @@ static int __init arm_enable_runtime_services(void)
 
 	/* Set up runtime services function pointers */
 	efi_native_runtime_setup();
-	set_bit(EFI_RUNTIME_SERVICES, &efi.flags);
+	if (efi_get_supported_rt_services())
+		set_bit(EFI_RUNTIME_SERVICES, &efi.flags);
+	else
+		clear_bit(EFI_RUNTIME_SERVICES, &efi.flags);
 
 	return 0;
 }
diff --git a/drivers/firmware/efi/efi.c b/drivers/firmware/efi/efi.c
index a2b0cbc8741c..96475cb8088e 100644
--- a/drivers/firmware/efi/efi.c
+++ b/drivers/firmware/efi/efi.c
@@ -595,6 +595,24 @@ static __init int match_config_table(const efi_guid_t *guid,
 	return 0;
 }
 
+unsigned int __init efi_get_supported_rt_services(void)
+{
+	unsigned int runtime_supported_mask = EFI_RT_SUPPORTED_ALL;
+
+	if (rt_prop != EFI_INVALID_TABLE_ADDR) {
+		efi_rt_properties_table_t *tbl;
+
+		tbl = early_memremap(rt_prop, sizeof(*tbl));
+		if (tbl) {
+			runtime_supported_mask &= tbl->runtime_services_supported;
+			early_memunmap(tbl, sizeof(*tbl));
+		}
+	} else
+		runtime_supported_mask = 0;
+
+	return runtime_supported_mask;
+}
+
 int __init efi_config_parse_tables(const efi_config_table_t *config_tables,
 				   int count,
 				   const efi_config_table_type_t *arch_tables)
@@ -695,15 +713,7 @@ int __init efi_config_parse_tables(const efi_config_table_t *config_tables,
 		}
 	}
 
-	if (rt_prop != EFI_INVALID_TABLE_ADDR) {
-		efi_rt_properties_table_t *tbl;
-
-		tbl = early_memremap(rt_prop, sizeof(*tbl));
-		if (tbl) {
-			efi.runtime_supported_mask &= tbl->runtime_services_supported;
-			early_memunmap(tbl, sizeof(*tbl));
-		}
-	}
+	efi.runtime_supported_mask &= efi_get_supported_rt_services();
 
 	if (IS_ENABLED(CONFIG_BLK_DEV_INITRD) &&
 	    initrd != EFI_INVALID_TABLE_ADDR && phys_initrd_size == 0) {
diff --git a/include/linux/efi.h b/include/linux/efi.h
index 4b27519143f5..fcaf0d7fc07e 100644
--- a/include/linux/efi.h
+++ b/include/linux/efi.h
@@ -717,6 +717,7 @@ extern void __init efi_esrt_init(void);
 #else
 static inline void efi_esrt_init(void) { }
 #endif
+extern unsigned int efi_get_supported_rt_services(void);
 extern int efi_config_parse_tables(const efi_config_table_t *config_tables,
 				   int count,
 				   const efi_config_table_type_t *arch_tables);
-- 
2.25.1

Re: [PATCH 2/2] efi: Introduce efi_get_supported_rt_services() to get the runtime services mask

[Ard Biesheuvel]

On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
>
> Previously, efi.runtime_supported_mask will always be the initial value
> EFI_RT_SUPPORTED_ALL and can't be retrieved in efi_config_parse_tables()
> if rt_prop is EFI_INVALID_TABLE_ADDR. Thus this can cause the wrong
> return value of efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE)
> on the Ampere Emag server.
>
> Besides, abstract the runtime services retrieving into a new exported
> helper efi_get_supported_rt_services() to set or clear the runtime service
> bit of efi.flags.
>
> Signed-off-by: Jia He <justin.he@arm.com>
> ---
>  drivers/firmware/efi/arm-runtime.c |  5 ++++-
>  drivers/firmware/efi/efi.c         | 28 +++++++++++++++++++---------
>  include/linux/efi.h                |  1 +
>  3 files changed, 24 insertions(+), 10 deletions(-)
>
> diff --git a/drivers/firmware/efi/arm-runtime.c b/drivers/firmware/efi/arm-runtime.c
> index 83f5bb57fa4c..ce93133f9abc 100644
> --- a/drivers/firmware/efi/arm-runtime.c
> +++ b/drivers/firmware/efi/arm-runtime.c
> @@ -146,7 +146,10 @@ static int __init arm_enable_runtime_services(void)
>
>         /* Set up runtime services function pointers */
>         efi_native_runtime_setup();
> -       set_bit(EFI_RUNTIME_SERVICES, &efi.flags);
> +       if (efi_get_supported_rt_services())
> +               set_bit(EFI_RUNTIME_SERVICES, &efi.flags);
> +       else
> +               clear_bit(EFI_RUNTIME_SERVICES, &efi.flags);
>

This is not right. There are now other users of the EFI runtime
service infrastructure (ACPI PRM), so even if all EFI runtime services
are marked as unsupported, we should still set the
EFI_RUNTIME_SERVICES bit if the EFI runtime memory map is provided.


>         return 0;
>  }
> diff --git a/drivers/firmware/efi/efi.c b/drivers/firmware/efi/efi.c
> index a2b0cbc8741c..96475cb8088e 100644
> --- a/drivers/firmware/efi/efi.c
> +++ b/drivers/firmware/efi/efi.c
> @@ -595,6 +595,24 @@ static __init int match_config_table(const efi_guid_t *guid,
>         return 0;
>  }
>
> +unsigned int __init efi_get_supported_rt_services(void)
> +{
> +       unsigned int runtime_supported_mask = EFI_RT_SUPPORTED_ALL;
> +
> +       if (rt_prop != EFI_INVALID_TABLE_ADDR) {
> +               efi_rt_properties_table_t *tbl;
> +
> +               tbl = early_memremap(rt_prop, sizeof(*tbl));
> +               if (tbl) {
> +                       runtime_supported_mask &= tbl->runtime_services_supported;
> +                       early_memunmap(tbl, sizeof(*tbl));
> +               }
> +       } else
> +               runtime_supported_mask = 0;
> +
> +       return runtime_supported_mask;
> +}
> +
>  int __init efi_config_parse_tables(const efi_config_table_t *config_tables,
>                                    int count,
>                                    const efi_config_table_type_t *arch_tables)
> @@ -695,15 +713,7 @@ int __init efi_config_parse_tables(const efi_config_table_t *config_tables,
>                 }
>         }
>
> -       if (rt_prop != EFI_INVALID_TABLE_ADDR) {
> -               efi_rt_properties_table_t *tbl;
> -
> -               tbl = early_memremap(rt_prop, sizeof(*tbl));
> -               if (tbl) {
> -                       efi.runtime_supported_mask &= tbl->runtime_services_supported;
> -                       early_memunmap(tbl, sizeof(*tbl));
> -               }
> -       }
> +       efi.runtime_supported_mask &= efi_get_supported_rt_services();
>
>         if (IS_ENABLED(CONFIG_BLK_DEV_INITRD) &&
>             initrd != EFI_INVALID_TABLE_ADDR && phys_initrd_size == 0) {
> diff --git a/include/linux/efi.h b/include/linux/efi.h
> index 4b27519143f5..fcaf0d7fc07e 100644
> --- a/include/linux/efi.h
> +++ b/include/linux/efi.h
> @@ -717,6 +717,7 @@ extern void __init efi_esrt_init(void);
>  #else
>  static inline void efi_esrt_init(void) { }
>  #endif
> +extern unsigned int efi_get_supported_rt_services(void);
>  extern int efi_config_parse_tables(const efi_config_table_t *config_tables,
>                                    int count,
>                                    const efi_config_table_type_t *arch_tables);
> --
> 2.25.1
>

Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Ard Biesheuvel]

(cc Jason for awareness)

On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
>
> I met a hung task warning and then kernel was hung forever with latest
> kernel on an Ampere Emag server.
>
> The root cause is kernel was hung  when invoking an efi rts call to set
> the RandomSeed variable during the booting stage. The arch_efi_call_virt
> call (set_variable) was never returned and then caused the hung task error.
>

Given that EFI variables work on this platform (as far as I know), the
problem may be that we are calling SetVariable() too early.

Could you double check whether setting variables works as expected?
You can use efibootmgr -t 10 as root (for example) to set the boot
timeout, and check whether the new value is retained after a reboot
(efibootmgr will print the current value for you)

Could you also please share the kernel log up until the point where it hangs?


> On the Emag server, efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE)
> is returned with "true"
>

This is as expected: if the firmware does not expose the RT properties
table, all runtime services are assumed to be available.

> Fix it by introducing the efi_get_supported_rt_services() and then determine
> to set or clear the runtime services bit of efi.flags.
>
> Jia He (2):
>   efi: libstub: Fix the retriving of supported rutime services
>   efi: Introduce efi_get_supported_rt_services() to get the runtime
>     services mask
>
>  drivers/firmware/efi/arm-runtime.c      |  5 ++++-
>  drivers/firmware/efi/efi.c              | 28 +++++++++++++++++--------
>  drivers/firmware/efi/libstub/efi-stub.c |  2 ++
>  include/linux/efi.h                     |  1 +
>  4 files changed, 26 insertions(+), 10 deletions(-)
>
> --
> 2.25.1
>

RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Justin He]

Hi Ard,

> -----Original Message-----
> From: Ard Biesheuvel <ardb@kernel.org>
> Sent: Tuesday, January 31, 2023 3:19 PM
> To: Justin He <Justin.He@arm.com>; Jason A. Donenfeld <Jason@zx2c4.com>
> Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>
> Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
>
> (cc Jason for awareness)
>
> On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
> >
> > I met a hung task warning and then kernel was hung forever with latest
> > kernel on an Ampere Emag server.
> >
> > The root cause is kernel was hung  when invoking an efi rts call to
> > set the RandomSeed variable during the booting stage. The
> > arch_efi_call_virt call (set_variable) was never returned and then caused the
> hung task error.
> >
>
> Given that EFI variables work on this platform (as far as I know), the problem
> may be that we are calling SetVariable() too early.
>
> Could you double check whether setting variables works as expected?
> You can use efibootmgr -t 10 as root (for example) to set the boot timeout, and
> check whether the new value is retained after a reboot (efibootmgr will print
> the current value for you)
>
> Could you also please share the kernel log up until the point where it hangs?
>
The set_variable seems to be ok in 5.19+:
root@:~# efibootmgr -t 10
BootCurrent: 0000
Timeout: 10 seconds
BootOrder: 0000,0004,0003,0002,0001
Boot0000* ubuntu
Boot0001* grub
Boot0002* UEFI: Built-in EFI Shell
Boot0003* UEFI: PXE boot on MAC: 4C:38:D5:08:F6:02
Boot0004* ubuntu
root@:~# efibootmgr -t 9
BootCurrent: 0000
Timeout: 9 seconds
BootOrder: 0000,0004,0003,0002,0001
Boot0000* ubuntu
Boot0001* grub
Boot0002* UEFI: Built-in EFI Shell
Boot0003* UEFI: PXE boot on MAC: 4C:38:D5:08:F6:02
Boot0004* ubuntu
root@:~# uname -a
Linux $machine_name 5.19.0+ #228 SMP Wed Aug 17 13:22:29 UTC 2022 aarch64 aarch64 aarch64 GNU/Linux

The dmesg log until the hung(some information was removed, eg, hostname):

[    0.000000][    T0] Booting Linux on physical CPU 0x0000000000 [0x503f0002]
[    0.000000][    T0] Linux version 6.2.0-rc4+ (root@machine_name) (gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #379 SMP Tue Jan 31 14:50:57 UTC 2023
[    0.000000][    T0] efi: EFI v2.60 by American Megatrends
[    0.000000][    T0] efi: ACPI 2.0=0xbfffcb0000 SMBIOS 3.0=0xbffcbe6598 ESRT=0xbffe402018 MEMRESERVE=0xbff31bad98
[    0.000000][    T0] esrt: Reserving ESRT space from 0x000000bffe402018 to 0x000000bffe402050.
[    0.000000][    T0] ACPI: Early table checksum verification disabled
[    0.000000][    T0] ACPI: RSDP 0x000000BFFFCB0000 000024 (v02 ALASKA)
[    0.000000][    T0] ACPI: XSDT 0x000000BFFFCB0028 000094 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000][    T0] ACPI: FACP 0x000000BFFFCB00C0 000114 (v06 Ampere eMAG     00000003 INTL 20171215)
[    0.000000][    T0] ACPI: DSDT 0x000000BFFFCB01D8 007648 (v05 ALASKA A M I    00000001 INTL 20171215)
[    0.000000][    T0] ACPI: FIDT 0x000000BFFFCB7820 00009C (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000][    T0] ACPI: DBG2 0x000000BFFFCB78C0 000061 (v00 Ampere eMAG     00000000 INTL 20171215)
[    0.000000][    T0] ACPI: GTDT 0x000000BFFFCB7928 000108 (v02 Ampere eMAG     00000001 INTL 20171215)
[    0.000000][    T0] ACPI: IORT 0x000000BFFFCB7A30 000ABC (v00 Ampere eMAG     00000000 INTL 20171215)
[    0.000000][    T0] ACPI: MCFG 0x000000BFFFCB84F0 0000AC (v01 Ampere eMAG     00000001 INTL 20171215)
[    0.000000][    T0] ACPI: SSDT 0x000000BFFFCB85A0 00002D (v02 Ampere eMAG     00000001 INTL 20171215)
[    0.000000][    T0] ACPI: SPMI 0x000000BFFFCB85D0 000041 (v05 ALASKA A M I    00000000 AMI. 00000000)
[    0.000000][    T0] ACPI: APIC 0x000000BFFFCB8618 000A68 (v04 Ampere eMAG     00000004      01000013)
[    0.000000][    T0] ACPI: PCCT 0x000000BFFFCB9080 0005D0 (v01 Ampere eMAG     00000003      01000013)
[    0.000000][    T0] ACPI: BERT 0x000000BFFFCB9650 000030 (v01 Ampere eMAG     00000003 INTL 20171215)
[    0.000000][    T0] ACPI: HEST 0x000000BFFFCB9680 000328 (v01 Ampere eMAG     00000003 INTL 20171215)
[    0.000000][    T0] ACPI: SPCR 0x000000BFFFCB99A8 000050 (v02 A M I  APTIO V  01072009 AMI. 0005000D)
[    0.000000][    T0] ACPI: PPTT 0x000000BFFFCB99F8 000CB8 (v01 Ampere eMAG     00000003      01000013)
[    0.000000][    T0] ACPI: SPCR: console: pl011,mmio,0x12600000,115200
[    0.000000][    T0] earlycon: pl11 at MMIO 0x0000000012600000 (options '115200')
[    0.000000][    T0] printk: bootconsole [pl11] enabled
[    0.000000][    T0] NUMA: Failed to initialise from firmware
[    0.000000][    T0] NUMA: Faking a node at [mem 0x0000000090000000-0x000000bfffffffff]
[    0.000000][    T0] NUMA: NODE_DATA [mem 0xbfde112100-0xbfde115fff]
[    0.000000][    T0] Zone ranges:
[    0.000000][    T0]   DMA      [mem 0x0000000090000000-0x00000000ffffffff]
[    0.000000][    T0]   DMA32    empty
[    0.000000][    T0]   Normal   [mem 0x0000000100000000-0x000000bfffffffff]
[    0.000000][    T0] Movable zone start for each node
[    0.000000][    T0] Early memory node ranges
[    0.000000][    T0]   node   0: [mem 0x0000000090000000-0x0000000091ffffff]
[    0.000000][    T0]   node   0: [mem 0x0000000092000000-0x00000000928fffff]
[    0.000000][    T0]   node   0: [mem 0x0000000092900000-0x00000000fffbffff]
[    0.000000][    T0]   node   0: [mem 0x00000000fffc0000-0x00000000ffffffff]
[    0.000000][    T0]   node   0: [mem 0x0000000880000000-0x0000000fffffffff]
[    0.000000][    T0]   node   0: [mem 0x0000008800000000-0x000000bff30fffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff3100000-0x000000bff312ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff3130000-0x000000bff36cffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff36d0000-0x000000bff372ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff3730000-0x000000bff3bcffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff3bd0000-0x000000bff3c2ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff3c30000-0x000000bff3dbffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff3dc0000-0x000000bff3dcffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff3dd0000-0x000000bff82dffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff82e0000-0x000000bff876ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff8770000-0x000000bff9f1ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff9f20000-0x000000bff9f6ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bff9f70000-0x000000bffa1fffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffa200000-0x000000bffa20ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffa210000-0x000000bffc634fff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc635000-0x000000bffc657fff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc658000-0x000000bffc6affff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc6b0000-0x000000bffc6bffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc6c0000-0x000000bffc86ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc870000-0x000000bffc87ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc880000-0x000000bffc92ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc930000-0x000000bffc96ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc970000-0x000000bffc9affff]
[    0.000000][    T0]   node   0: [mem 0x000000bffc9b0000-0x000000bffca2ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffca30000-0x000000bffcabffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffcac0000-0x000000bffcadffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffcae0000-0x000000bffcb0ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffcb10000-0x000000bffcb2ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffcb30000-0x000000bffcb3ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffcb40000-0x000000bffe17ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bffe180000-0x000000bfffc7ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bfffc80000-0x000000bfffcaffff]
[    0.000000][    T0]   node   0: [mem 0x000000bfffcb0000-0x000000bfffcbffff]
[    0.000000][    T0]   node   0: [mem 0x000000bfffcc0000-0x000000bfffd6ffff]
[    0.000000][    T0]   node   0: [mem 0x000000bfffd70000-0x000000bfffffffff]
[    0.000000][    T0] Initmem setup node 0 [mem 0x0000000090000000-0x000000bfffffffff]
[    0.000000][    T0] cma: Reserved 32 MiB at 0x00000000af000000
[    0.000000][    T0] psci: probing for conduit method from ACPI.
[    0.000000][    T0] psci: PSCIv1.0 detected in firmware.
[    0.000000][    T0] psci: Using standard PSCI v0.2 function IDs
[    0.000000][    T0] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000][    T0] psci: SMC Calling Convention v1.0
[    0.000000][    T0] percpu: Embedded 30 pages/cpu s83496 r8192 d31192 u122880
[    0.000000][    T0] Detected PIPT I-cache on CPU0
[    0.000000][    T0] CPU features: detected: GIC system register CPU interface
[    0.000000][    T0] CPU features: detected: Spectre-v2
[    0.000000][    T0] CPU features: detected: Spectre-v4
[    0.000000][    T0] CPU features: kernel page table isolation forced ON by KASLR
[    0.000000][    T0] CPU features: detected: Kernel page table isolation (KPTI)
[    0.000000][    T0] alternatives: applying boot alternatives
[    0.000000][    T0] Fallback order for Node 0: 0
[    0.000000][    T0] Built 1 zonelists, mobility groupil command line: console_suspend
[    0.000000][    T0] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-6.2.0-rc4+", will be passed to user space.
[    0.000000][    T0] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, linear)
[    0.000000][    T0] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear)
[    0.000000][    T0] mem auto-init: stack:off, heap alloc:on, heap free:off
[    0.000000][    T0] software IO TLB: area num 32.
[    0.000000][    T0] software IO TLB: mapped [mem 0x00000000ab000000-0x00000000af000000] (64MB)
[    0.000000][    T0] Memory: 261790012K/268173312K available (14528K kernel code, 3556K rwdata, 7076K rodata, 8128K init, 818K bss, 6350532K reserved, 32768K cma-reserved)
[    0.000000][    T0] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=1
[    0.000000][    T0] ftrace: allocating 48485 entries in 190 pages
[    0.000000][    T0] ftrace: allocated 190 pages with 6 groups
[    0.000000][    T0] trace event string verifier disabled
[    0.000000][    T0] rcu: Hierarchical RCU implementation.
[    0.000000][    T0] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=32.
[    0.000000][    T0]  Rude variant of Tasks RCU enabled.
[    0.000000][    T0]  Tracing variant of Tasks RCU enabled.
[    0.000000][    T0] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000][    T0] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.000000][    T0] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000][    T0] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000][    T0] GICv3: 512 SPIs implemented
[    0.000000][    T0] GICv3: 0 Extended SPIs implemented
[    0.000000][    T0] Root IRQ handler: gic_handle_irq
[    0.000000][    T0] GICv3: GICv3 features: 16 PPIs
[    0.000000][    T0] GICv3: CPU0: found redistributor 0 region 0:0x0000000078400000
[    0.000000][    T0] ITS [mem 0x78020000-0x7803ffff]
[    0.000000][    T0] ITS@0x0000000078020000: Devices Table too large, reduce ids 20->19
[    0.000000][    T0] ITS@0x0000000078020000: allocated 524288 Devices @880800000 (flat, esz 8, psz 64K, shr 0)
[    0.000000][    T0] ITS: using cache flushing for cmd queue
[    0.000000][    T0] GICv3: using LPI property table @0x0000000880230000
[    0.000000][    T0] GIC: using cache flushing for LPI property table
[    0.000000][    T0] GICv3: CPU0: using allocated LPI pending table @0x0000000880240000
[    0.000000][    T0] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.000000][    T0] arch_timer: Broken CNTx_CVAL_EL1, using 31 bit TVAL instead.
[    0.000000][    T0] ACPI GTDT: found 1 memory-mapped timer block(s).
[    0.000000][    T0] arch_timer: cp15 and mmio timer(s) running at 40.00MHz (phys/phys).
[    0.000000][    T0] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x939a85c40, max_idle_ns: 440795202120 ns
[    0.000000][    T0] sched_clock: 56 bits at 40MHz, resolution 25ns, wraps every 4398046511100ns
[    0.008896][    T0] Console: colour dummy device 80x25
[    0.014129][    T0] ACPI: Core revision 20221020
[    0.018912][    T0] Calibrating delay loop (skipped), value calculated using timer frequency.. 80.00 BogoMIPS (lpj=160000)
[    0.030085][    T0] pid_max: default: 32768 minimum: 301
[    0.035656][    T0] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.044235][    T0] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.053973][    T1] cblist_init_generic: Setting adjustable number of callback queues.
[    0.061998][    T1] cblist_init_generic: Setting shift to 5 and lim to 1.
[    0.068904][    T1] cblist_init_generic: Setting shift to 5 and lim to 1.
[    0.075837][    T1] rcu: Hierarchical SRCU implementation.
[    0.081382][    T1] rcu:     Max phase no-delay instances is 1000.
[    0.087806][    T1] Platform MSI: ITS@0x78020000 domain created
[    0.093804][    T1] PCI/MSI: ITS@0x78020000 domain created
[    0.099357][    T1] Remapping and enabling EFI services.
[    0.105683][    T1] smp: Bringing up secondary CPUs ...
[    0.111260][    T0] Detected PIPT I-cache on CPU1
[    0.111291][    T0] GICv3: CPU1: found redistributor 1 region 0:0x0000000078420000
[    0.111298][    T0] GICv3: CPU1: using allocated LPI pending table @0x0000000880250000
[    0.111314][    T0] CPU1: Booted secondary processor 0x0000000001 [0x503f0002]
[    0.111661][    T0] Detected PIPT I-cache on CPU2
[    0.111689][    T0] GICv3: CPU2: found redistributor 100 region 0:0x0000000078440000
[    0.111695][    T0] GICv3: CPU2: using allocated LPI pending table @0x0000000880260000
[    0.111710][    T0] CPU2: Booted secondary processor 0x0000000100 [0x503f0002]
[    0.112042][    T0] Detected PIPT I-cache on CPU3
[    0.112066][    T0] GICv3: CPU3: found redistributor 101 region 0:0x0000000078460000
[    0.112072][    T0] GICv3: CPU3: using allocated LPI pending table @0x0000000880270000
[    0.112086][    T0] CPU3: Booted secondary processor 0x0000000101 [0x503f0002]
[    0.112406][    T0] Detected PIPT I-cache on CPU4
[    0.112433][    T0] GICv3: CPU4: found redistributor 200 region 0:0x0000000078480000
[    0.112440][    T0] GICv3: CPU4: using allocated LPI pending table @0x0000000880280000
[    0.112454][    T0] CPU4: Booted secondary processor 0x0000000200 [0x503f0002]
[    0.112773][    T0] Detected PIPT I-cache on CPU5
[    0.112798][    T0] GICv3: CPU5: found redistributor 201 region 0:0x00000000784a0000
[    0.112805][    T0] GICv3: CPU5: using allocated LPI pending table @0x0000000880290000
[    0.112819][    T0] CPU5: Booted secondary processor 0x0000000201 [0x503f0002]
[    0.113144][    T0] Detected PIPT I-cache on CPU6
[    0.113173][    T0] GICv3: CPU6: found redistributor 300 region 0:0x00000000784c0000
[    0.113179][    T0] GICv3: CPU6: using allocated LPI pending table @0x00000008802a0000
[    0.113194][    T0] CPU6: Booted secondary processor 0x0000000300 [0x503f0002]
[    0.113529][    T0] Detected PIPT I-cache on CPU7
[    0.113555][    T0] GICv3: CPU7: found redistributor 301 region 0:0x00000000784e0000
[    0.113562][    T0] GICv3: CPU7: using allocated LPI pending table @0x00000008802b0000
[    0.113576][    T0] CPU7: Booted secondary processor 0x0000000301 [0x503f0002]
[    0.113904][    T0] Detected PIPT I-cache on CPU8
[    0.113934][    T0] GICv3: CPU8: found redistributor 400 region 0:0x0000000078500000
[    0.113940][    T0] GICv3: CPU8: using allocated LPI pending table @0x00000008802c0000
[    0.113955][    T0] CPU8: Booted secondary processor 0x0000000400 [0x503f0002]
[    0.114277][    T0] Detected PIPT I-cache on CPU9
[    0.114304][    T0] GICv3: CPU9: found redistributor 401 region 0:0x0000000078520000
[    0.114311][    T0] GICv3: CPU9: using allocated LPI pending table @0x00000008802d0000
[    0.114325][    T0] CPU9: Booted secondary processor 0x0000000401 [0x503f0002]
[    0.114703][    T0] Detected PIPT I-cache on CPU10
[    0.114734][    T0] GICv3: CPU10: found redistributor 500 region 0:0x0000000078540000
[    0.114741][    T0] GICv3: CPU10: using allocated LPI pending table @0x00000008802e0000
[    0.114756][    T0] CPU10: Booted secondary processor 0x0000000500 [0x503f0002]
[    0.115107][    T0] Detected PIPT I-cache on CPU11
[    0.115135][    T0] GICv3: CPU11: found redistributor 501 region 0:0x0000000078560000
[    0.115142][    T0] GICv3: CPU11: using allocated LPI pending table @0x00000008802f0000
[    0.115156][    T0] CPU11: Booted secondary processor 0x0000000501 [0x503f0002]
[    0.115496][    T0] Detected PIPT I-cache on CPU12
[    0.115528][    T0] GICv3: CPU12: found redistributor 600 region 0:0x0000000078580000
[    0.115535][    T0] GICv3: CPU12: using allocated LPI pending table @0x0000000880300000
[    0.115549][    T0] CPU12: Booted secondary processor 0x0000000600 [0x503f0002]
[    0.115871][    T0] Detected PIPT I-cache on CPU13
[    0.115900][    T0] GICv3: CPU13: found redistributor 601 region 0:0x00000000785a0000
[    0.115907][    T0] GICv3: CPU13: using allocated LPI pending table @0x0000000880310000
[    0.115921][    T0] CPU13: Booted secondary processor 0x0000000601 [0x503f0002]
[    0.116252][    T0] Detected PIPT I-cache on CPU14
[    0.116286][    T0] GICv3: CPU14: found redistributor 700 region 0:0x00000000785c0000
[    0.116293][    T0] GICv3: CPU14: using allocated LPI pending table @0x0000000880320000
[    0.116307][    T0] CPU14: Booted secondary processor 0x0000000700 [0x503f0002]
[    0.116633][    T0] Detected PIPT I-cache on CPU15
[    0.116665][    T0] GICv3: CPU15: found redistributor 701 region 0:0x00000000785e0000
[    0.116672][    T0] GICv3: CPU15: using allocated LPI pending table @0x0000000880330000
[    0.116687][    T0] CPU15: Booted secondary processor 0x0000000701 [0x503f0002]
[    0.117022][    T0] Detected PIPT I-cache on CPU16
[    0.117058][    T0] GICv3: CPU16: found redistributor 800 region 0:0x0000000078600000
[    0.117066][    T0] GICv3: CPU16: using allocated LPI pending table @0x0000000880340000
[    0.117081][    T0] CPU16: Booted secondary processor 0x0000000800 [0x503f0002]
[    0.117413][    T0] Detected PIPT I-cache on CPU17
[    0.117447][    T0] GICv3: CPU17: found redistributor 801 region 0:0x0000000078620000
[    0.117454][    T0] GICv3: CPU17: using allocated LPI pending table @0x0000000880350000
[    0.117469][    T0] CPU17: Booted secondary processor 0x0000000801 [0x503f0002]
[    0.117805][    T0] Detected PIPT I-cache on CPU18
[    0.117843][    T0] GICv3: CPU18: found redistributor 900 region 0:0x0000000078640000
[    0.117850][    T0] GICv3: CPU18: using allocated LPI pending table @0x0000000880360000
[    0.117866][    T0] CPU18: Booted secondary processor 0x0000000900 [0x503f0002]
[    0.118198][    T0] Detected PIPT I-cache on CPU19
[    0.118233][    T0] GICv3: CPU19: found redistributor 901 region 0:0x0000000078660000
[    0.118240][    T0] GICv3: CPU19: using allocated LPI pending table @0x0000000880370000
[    0.118255][    T0] CPU19: Booted secondary processor 0x0000000901 [0x503f0002]
[    0.118600][    T0] Detected PIPT I-cache on CPU20
[    0.118638][    T0] GICv3: CPU20: found redistributor a00 region 0:0x0000000078680000
[    0.118646][    T0] GICv3: CPU20: using allocated LPI pending table @0x0000000880380000
[    0.118661][    T0] CPU20: Booted secondary processor 0x0000000a00 [0x503f0002]
[    0.118990][    T0] Detected PIPT I-cache on CPU21
[    0.119027][    T0] GICv3: CPU21: found redistributor a01 region 0:0x00000000786a0000
[    0.119035][    T0] GICv3: CPU21: using allocated LPI pending table @0x0000000880390000
[    0.119049][    T0] CPU21: Booted secondary processor 0x0000000a01 [0x503f0002]
[    0.119385][    T0] Detected PIPT I-cache on CPU22
[    0.119425][    T0] GICv3: CPU22: found redistributor b00 region 0:0x00000000786c0000
[    0.119432][    T0] GICv3: CPU22: using allocated LPI pending table @0x00000008803a0000
[    0.119448][    T0] CPU22: Booted secondary processor 0x0000000b00 [0x503f0002]
[    0.119784][    T0] Detected PIPT I-cache on CPU23
[    0.119822][    T0] GICv3: CPU23: found redistributor b01 region 0:0x00000000786e0000
[    0.119829][    T0] GICv3: CPU23: using allocated LPI pending table @0x00000008803b0000
[    0.119844][    T0] CPU23: Booted secondary processor 0x0000000b01 [0x503f0002]
[    0.120178][    T0] Detected PIPT I-cache on CPU24
[    0.120219][    T0] GICv3: CPU24: found redistributor c00 region 0:0x0000000078700000
[    0.120226][    T0] GICv3: CPU24: using allocated LPI pending table @0x00000008803c0000
[    0.120241][    T0] CPU24: Booted secondary processor 0x0000000c00 [0x503f0002]
[    0.120577][    T0] Detected PIPT I-cache on CPU25
[    0.120614][    T0] GICv3: CPU25: found redistributor c01 region 0:0x0000000078720000
[    0.120622][    T0] GICv3: CPU25: using allocated LPI pending table @0x00000008803d0000
[    0.120636][    T0] CPU25: Booted secondary processor 0x0000000c01 [0x503f0002]
[    0.120961][    T0] Detected PIPT I-cache on CPU26
[    0.121003][    T0] GICv3: CPU26: found redistributor d00 region 0:0x0000000078740000
[    0.121010][    T0] GICv3: CPU26: using allocated LPI pending table @0x00000008803e0000
[    0.121025][    T0] CPU26: Booted secondary processor 0x0000000d00 [0x503f0002]
[    0.121363][    T0] Detected PIPT I-cache on CPU27
[    0.121404][    T0] GICv3: CPU27: found redistributor d01 region 0:0x0000000078760000
[    0.121412][    T0] GICv3: CPU27: using allocated LPI pending table @0x00000008803f0000
[    0.121426][    T0] CPU27: Booted secondary processor 0x0000000d01 [0x503f0002]
[    0.121764][    T0] Detected PIPT I-cache on CPU28
[    0.121808][    T0] GICv3: CPU28: found redistributor e00 region 0:0x0000000078780000
[    0.121815][    T0] GICv3: CPU28: using allocated LPI pending table @0x0000000880c00000
[    0.121831][    T0] CPU28: Booted secondary processor 0x0000000e00 [0x503f0002]
[    0.122154][    T0] Detected PIPT I-cache on CPU29
[    0.122194][    T0] GICv3: CPU29: found redistributor e01 region 0:0x00000000787a0000
[    0.122202][    T0] GICv3: CPU29: using allocated LPI pending table @0x0000000880c10000
[    0.122217][    T0] CPU29: Booted secondary processor 0x0000000e01 [0x503f0002]
[    0.122564][    T0] Detected PIPT I-cache on CPU30
[    0.122609][    T0] GICv3: CPU30: found redistributor f00 region 0:0x00000000787c0000
[    0.122616][    T0] GICv3: CPU30: using allocated LPI pending table @0x0000000880c20000
[    0.122631][    T0] CPU30: Booted secondary processor 0x0000000f00 [0x503f0002]
[    0.122977][    T0] Detected PIPT I-cache on CPU31
[    0.123020][    T0] GICv3: CPU31: found redistributor f01 region 0:0x00000000787e0000
[    0.123028][    T0] GICv3: CPU31: using allocated LPI pending table @0x0000000880c30000
[    0.123043][    T0] CPU31: Booted secondary processor 0x0000000f01 [0x503f0002]
[    0.123107][    T1] smp: Brought up 1 node, 32 CPUs
[    0.999520][    T1] SMP: Total of 32 processors activated.
[    1.005062][    T1] CPU features: detected: 32-bit EL0 Support
[    1.010955][    T1] CPU features: detected: 32-bit EL1 Support
[    1.016848][    T1] CPU features: detected: CRC32 instructions
[    1.022854][    T1] CPU features: emulated: Privileged Access Never (PAN) using TTBR0_EL1 switching
[    1.032005][    T1] CPU: All CPU(s) started at EL2
[    1.036852][    T1] alternatives: applying system-wide alternatives
[    1.044775][    T1] devtmpfs: initialized
[    1.089521][    T1] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    1.100093][    T1] futex hash table entries: 8192 (order: 7, 524288 bytes, linear)
[    1.108067][    T1] pinctrl core: initialized pinctrl subsystem
[    1.114298][    T1] SMBIOS 3.1.1 present.
[    1.118356][    T1] DMI: MiTAC RAPTOR EV-883832-X3-0001/RAPTOR, BIOS 0.14 02/22/2019
[    1.126472][    T1] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    1.133861][    T1] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[    1.142125][    T1] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    1.150993][    T1] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    1.159819][    T1] audit: initializing netlink subsys (disabled)
[    1.166051][  T211] audit: type=2000 audit(0.692:1): state=initialized audit_enabled=0 res=1
[    1.166248][    T1] thermal_sys: Registered thermal governor 'fair_share'
[    1.174589][    T1] thermal_sys: Registered thermal governor 'bang_bang'
[    1.181450][    T1] thermal_sys: Registered thermal governor 'step_wise'
[    1.188223][    T1] thermal_sys: Registered thermal governor 'user_space'
[    1.195021][    T1] cpuidle: using governor ladder
[    1.206732][    T1] cpuidle: using governor menu
[    1.211619][    T1] Detected 16 PCC Subspaces
[    1.216023][    T1] Registering PCC driver as Mailbox controller
[    1.222171][    T1] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    1.229982][    T1] ASID allocator initialised with 32768 entries
[    1.236260][    T1] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.243590][    T1] Serial: AMBA PL011 UART driver
[    1.249234][    T1] KASLR enabled
[    1.252933][    T1] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[    1.260504][    T1] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[    1.267896][    T1] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages
[    1.275459][    T1] HugeTLB: 508 KiB vmemmap can be freed for a 32.0 MiB page
[    1.282670][    T1] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    1.290231][    T1] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[    1.297354][    T1] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages
[    1.304915][    T1] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page
[    1.312780][    T1] ACPI: Added _OSI(Module Device)
[    1.317712][    T1] ACPI: Added _OSI(Processor Device)
[    1.322902][    T1] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.328355][    T1] ACPI: Added _OSI(Processor Aggregator Device)
[    1.338051][    T1] ACPI: 2 ACPI AML tables successfully acquired and loaded
[    1.346574][    T1] ACPI: Interpreter enabled
[    1.350978][    T1] ACPI: Using GIC for interrupt routing
[    1.356445][    T1] ACPI: MCFG table detected, 8 entries
[    1.364344][    T1] HEST: Table parsing has been initialized.
[    1.370363][    T1] GHES: APEI firmware first mode is enabled by APEI bit.
[    1.385239][    T1] ARMH0011:00: ttyAMA0 at MMIO 0x12600000 (irq = 299, base_baud = 0) is a SBSA
[    1.394131][    T1] printk: console [ttyAMA0] enabled
[    1.394131][    T1] printk: console [ttyAMA0] enabled
[    1.404272][    T1] printk: bootconsole [pl11] disabled
[    1.404272][    T1] printk: bootconsole [pl11] disabled
[    1.415499][    T1] ARMH0011:01: ttyAMA1 at MMIO 0x12610000 (irq = 300, base_baud = 0) is a SBSA
[    1.426410][    T1] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    1.433295][    T1] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.443096][    T1] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug LTR]
[    1.451116][    T1] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    1.460340][    T1] acpi PNP0A08:00: ECAM area [mem 0x10000000000-0x1000fffffff] reserved by PNP0C02:00
[    1.469735][    T1] acpi PNP0A08:00: ECAM at [mem 0x10000000000-0x1000fffffff] for [bus 00-ff]
[    1.478363][    T1] ACPI: Remapped I/O 0x0000010010000000 to [io  0x0000-0xffff window]
[    1.486462][    T1] PCI host bridge to bus 0000:00
[    1.491246][    T1] pci_bus 0000:00: root bus resource [io  0x0000-0xffff window]
[    1.498722][    T1] pci_bus 0000:00: root bus resource [mem 0x10030000000-0x100efffffff window] (bus address [0x30000000-0xefffffff])
[    1.510708][    T1] pci_bus 0000:00: root bus resource [mem 0x10100000000-0x17fffffffff window]
[    1.519394][    T1] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.525609][    T1] pci 0000:00:00.0: [1def:e005] type 01 class 0x060400
[    1.532323][    T1] pci 0000:00:00.0: enabling Extended Tags
[    1.538002][    T1] pci 0000:00:00.0: supports D1 D2
[    1.543143][    T1] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.548801][    T1] pci_bus 0000:00: resource 4 [io  0x0000-0xffff window]
[    1.555665][    T1] pci_bus 0000:00: resource 5 [mem 0x10030000000-0x100efffffff window]
[    1.563746][    T1] pci_bus 0000:00: resource 6 [mem 0x10100000000-0x17fffffffff window]
[    1.571905][    T1] ACPI: PCI Root Bridge [PCI1] (domain 0001 [bus 00-ff])
[    1.578783][    T1] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.588589][    T1] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug LTR]
[    1.596611][    T1] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    1.605832][    T1] acpi PNP0A08:01: ECAM area [mem 0x7800000000-0x780fffffff] reserved by PNP0C02:00
[    1.615052][    T1] acpi PNP0A08:01: ECAM at [mem 0x7800000000-0x780fffffff] for [bus 00-ff]
[    1.623506][    T1] ACPI: Remapped I/O 0x0000007810000000 to [io  0x10000-0x1ffff window]
[    1.631772][    T1] PCI host bridge to bus 0001:00
[    1.636557][    T1] pci_bus 0001:00: root bus resource [io  0x10000-0x1ffff window] (bus address [0x0000-0xffff])
[    1.646807][    T1] pci_bus 0001:00: root bus resource [mem 0x7830000000-0x78efffffff window] (bus address [0x30000000-0xefffffff])
[    1.658619][    T1] pci_bus 0001:00: root bus resource [mem 0x7900000000-0x7fffffffff window]
[    1.667132][    T1] pci_bus 0001:00: root bus resource [bus 00-ff]
[    1.673343][    T1] pci 0001:00:00.0: [1def:e006] type 01 class 0x060400
[    1.680059][    T1] pci 0001:00:00.0: enabling Extended Tags
[    1.685742][    T1] pci 0001:00:00.0: supports D1 D2
[    1.690885][    T1] pci 0001:00:00.0: PCI bridge to [bus 01]
[    1.696543][    T1] pci_bus 0001:00: resource 4 [io  0x10000-0x1ffff window]
[    1.703582][    T1] pci_bus 0001:00: resource 5 [mem 0x7830000000-0x78efffffff window]
[    1.711486][    T1] pci_bus 0001:00: resource 6 [mem 0x7900000000-0x7fffffffff window]
[    1.719455][    T1] ACPI: PCI Root Bridge [PCI2] (domain 0002 [bus 00-ff])
[    1.726332][    T1] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.736137][    T1] acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug LTR]
[    1.744159][    T1] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    1.753384][    T1] acpi PNP0A08:02: ECAM area [mem 0x1000000000-0x100fffffff] reserved by PNP0C02:00
[    1.762606][    T1] acpi PNP0A08:02: ECAM at [mem 0x1000000000-0x100fffffff] for [bus 00-ff]
[    1.771057][    T1] ACPI: Remapped I/O 0x0000001010000000 to [io  0x20000-0x2ffff window]
[    1.779325][    T1] PCI host bridge to bus 0002:00
[    1.784110][    T1] pci_bus 0002:00: root bus resource [io  0x20000-0x2ffff window] (bus address [0x0000-0xffff])
[    1.794361][    T1] pci_bus 0002:00: root bus resource [mem 0x1030000000-0x10efffffff window] (bus address [0x30000000-0xefffffff])
[    1.806172][    T1] pci_bus 0002:00: root bus resource [mem 0x1100000000-0x57ffffffff window]
[    1.814687][    T1] pci_bus 0002:00: root bus resource [bus 00-ff]
[    1.820899][    T1] pci 0002:00:00.0: [1def:e007] type 01 class 0x060400
[    1.827611][    T1] pci 0002:00:00.0: enabling Extended Tags
[    1.833287][    T1] pci 0002:00:00.0: supports D1 D2
[    1.838415][    T1] pci 0002:00:00.0: PCI bridge to [bus 01]
[    1.844072][    T1] pci_bus 0002:00: resource 4 [io  0x20000-0x2ffff window]
[    1.851111][    T1] pci_bus 0002:00: resource 5 [mem 0x1030000000-0x10efffffff window]
[    1.859016][    T1] pci_bus 0002:00: resource 6 [mem 0x1100000000-0x57ffffffff window]
[    1.866990][    T1] ACPI: PCI Root Bridge [PCI3] (domain 0003 [bus 00-ff])
[    1.873876][    T1] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.883676][    T1] acpi PNP0A08:03: _OSC: platform does not support [SHPCHotplug LTR]
[    1.891697][    T1] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    1.900921][    T1] acpi PNP0A08:03: ECAM area [mem 0x5800000000-0x580fffffff] reserved by PNP0C02:00
[    1.910142][    T1] acpi PNP0A08:03: ECAM at [mem 0x5800000000-0x580fffffff] for [bus 00-ff]
[    1.918593][    T1] ACPI: Remapped I/O 0x0000005810000000 to [io  0x30000-0x3ffff window]
[    1.926856][    T1] PCI host bridge to bus 0003:00
[    1.931641][    T1] pci_bus 0003:00: root bus resource [io  0x30000-0x3ffff window] (bus address [0x0000-0xffff])
[    1.941893][    T1] pci_bus 0003:00: root bus resource [mem 0x5830000000-0x58efffffff window] (bus address [0x30000000-0xefffffff])
[    1.953705][    T1] pci_bus 0003:00: root bus resource [mem 0x5900000000-0x5fffffffff window]
[    1.962218][    T1] pci_bus 0003:00: root bus resource [bus 00-ff]
[    1.968430][    T1] pci 0003:00:00.0: [1def:e008] type 01 class 0x060400
[    1.975141][    T1] pci 0003:00:00.0: enabling Extended Tags
[    1.980817][    T1] pci 0003:00:00.0: supports D1 D2
[    1.985949][    T1] pci 0003:01:00.0: [144d:a808] type 00 class 0x010802
[    1.992659][    T1] pci 0003:01:00.0: reg 0x10: [mem 0x5830010000-0x5830013fff 64bit]
[    2.000511][    T1] pci 0003:01:00.0: reg 0x30: [mem 0x5830000000-0x583000ffff pref]
[    2.008495][    T1] pci 0003:00:00.0: BAR 14: assigned [mem 0x5830000000-0x58300fffff]
[    2.016405][    T1] pci 0003:01:00.0: BAR 6: assigned [mem 0x5830000000-0x583000ffff pref]
[    2.024659][    T1] pci 0003:01:00.0: BAR 0: assigned [mem 0x5830010000-0x5830013fff 64bit]
[    2.033006][    T1] pci 0003:00:00.0: PCI bridge to [bus 01]
[    2.038656][    T1] pci 0003:00:00.0:   bridge window [mem 0x5830000000-0x58300fffff]
[    2.046477][    T1] pci_bus 0003:00: resource 4 [io  0x30000-0x3ffff window]
[    2.053513][    T1] pci_bus 0003:00: resource 5 [mem 0x5830000000-0x58efffffff window]
[    2.061418][    T1] pci_bus 0003:00: resource 6 [mem 0x5900000000-0x5fffffffff window]
[    2.069325][    T1] pci_bus 0003:01: resource 1 [mem 0x5830000000-0x58300fffff]
[    2.076688][    T1] ACPI: PCI Root Bridge [PCI4] (domain 0004 [bus 00-ff])
[    2.083566][    T1] acpi PNP0A08:04: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    2.093365][    T1] acpi PNP0A08:04: _OSC: platform does not support [SHPCHotplug LTR]
[    2.101389][    T1] acpi PNP0A08:04: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    2.110620][    T1] acpi PNP0A08:04: ECAM area [mem 0x6000000000-0x600fffffff] reserved by PNP0C02:00
[    2.119842][    T1] acpi PNP0A08:04: ECAM at [mem 0x6000000000-0x600fffffff] for [bus 00-ff]
[    2.128294][    T1] ACPI: Remapped I/O 0x0000006010000000 to [io  0x40000-0x4ffff window]
[    2.136564][    T1] PCI host bridge to bus 0004:00
[    2.141349][    T1] pci_bus 0004:00: root bus resource [io  0x40000-0x4ffff window] (bus address [0x0000-0xffff])
[    2.151600][    T1] pci_bus 0004:00: root bus resource [mem 0x6030000000-0x60efffffff window] (bus address [0x30000000-0xefffffff])
[    2.163411][    T1] pci_bus 0004:00: root bus resource [mem 0x6100000000-0x6fffffffff window]
[    2.171924][    T1] pci_bus 0004:00: root bus resource [bus 00-ff]
[    2.178134][    T1] pci 0004:00:00.0: [1def:e009] type 01 class 0x060400
[    2.18484D2
[    2.1956601:00.0: reg 0x10: [mem 0x6030010000-0x6030013fff 64bit]
[    2.210219][    T1] pci 0004:01:00.0: reg 0x30: [mem 0x6030000000-0x603000ffff pref]
[    2.217955][    T1] pci 0004:01:00.0: enabling Extended Tags
[    2.223854][    T1] pci 0004:00:00.0: BAR 14: assigned [mem 0x6030000000-0x60300fffff]
[    2.231765][    T1] pci 0004:01:00.0: BAR 6: assigned [mem 0x6030000000-0x603000ffff pref]
[    2.240019][    T1] pci 0004:01:00.0: BAR 0: assigned [mem 0x6030010000-0x6030013fff 64bit]
[    2.248365][    T1] pci 0004:00:00.0: PCI bridge to [bus 01]
[    2.254015][    T1] pci 0004:00:00.0:   bridge window [mem 0x6030000000-0x60300fffff]
[    2.261836][    T1] pci_bus 0004:00: resource 4 [io  0x40000-0x4ffff window]
[    2.268873][    T1] pci_bus 0004:00: resource 5 [mem 0x6030000000-0x60efffffff window]
[    2.276778][    T1] pci_bus 0004:00: resource 6 [mem 0x6100000000-0x6fffffffff window]
[    2.284683][    T1] pci_bus 0004:01: resource 1 [mem 0x6030000000-0x60300fffff]
[    2.292046][    T1] ACPI: PCI Root Bridge [PCI5] (domain 0005 [bus 00-ff])
[    2.298924][    T1] acpi PNP0A08:05: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    2.308721][    T1] acpi PNP0A08:05: _OSC: platform does not support [SHPCHotplug LTR]
[    2.316745][    T1] acpi PNP0A08:05: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    2.325969][    T1] acpi PNP0A08:05: ECAM area [mem 0x7000000000-0x700fffffff] reserved by PNP0C02:00
[    2.335193][    T1] acpi PNP0A08:05: ECAM at [mem 0x7000000000-0x700fffffff] for [bus 00-ff]
[    2.343650][    T1] ACPI: Remapped I/O 0x0000007010000000 to [io  0x50000-0x5ffff window]
[    2.351918][    T1] PCI host bridge to bus 0005:00
[    2.356704][    T1] pci_bus 0005:00: root bus resource [io  0x50000-0x5ffff window] (bus address [0x0000-0xffff])
[    2.366954][    T1] pci_bus 0005:00: root bus resource [mem 0x7030000000-0x70efffffff window] (bus address [0x30000000-0xefffffff])
[    2.378767][    T1] pci_bus 0005:00: root bus resource [mem 0x7100000000-0x77ffffffff window]
[    2.387281][    T1] pci_bus 0005:00: root bus resource [bus 00-ff]
[    2.393494][    T1] pci 0005:00:00.0: [1def:e00a] type 01 class 0x060400
[    2.400211][    T1] pci 0005:00:00.0: enabling Extended Tags
[    2.405894][    T1] pci 0005:00:00.0: supports D1 D2
[    2.411040][    T1] pci 0005:00:00.0: PCI bridge to [bus 01]
[    2.416698][    T1] pci_bus 0005:00: resource 4 [io  0x50000-0x5ffff window]
[    2.423737][    T1] pci_bus 0005:00: resource 5 [mem 0x7030000000-0x70efffffff window]
[    2.431642][    T1] pci_bus 0005:00: resource 6 [mem 0x7100000000-0x77ffffffff window]
[    2.439621][    T1] ACPI: PCI Root Bridge [PCI6] (domain 0006 [bus 00-ff])
[    2.446498][    T1] acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    2.456295][    T1] acpi PNP0A08:06: _OSC: platform does not support [SHPCHotplug LTR]
[    2.464317][    T1] acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    2.473538][    T1] acpi PNP0A08:06: ECAM area [mem 0x600000000-0x60fffffff] reserved by PNP0C02:00
[    2.482587][    T1] acpi PNP0A08:06: ECAM at [mem 0x600000000-0x60fffffff] for [bus 00-ff]
[    2.490866][    T1] ACPI: Remapped I/O 0x0000000610000000 to [io  0x60000-0x6ffff window]
[    2.499137][    T1] PCI host bridge to bus 0006:00
[    2.503922][    T1] pci_bus 0006:00: root bus resource [io  0x60000-0x6ffff window] (bus address [0x0000-0xffff])
[    2.514173][    T1] pci_bus 0006:00: root bus resource [mem 0x630000000-0x6efffffff window] (bus address [0x30000000-0xefffffff])
[    2.525810][    T1] pci_bus 0006:00: root bus resource [mem 0x700000000-0x7ffffffff window]
[    2.534150][    T1] pci_bus 0006:00: root bus resource [bus 00-ff]
[    2.540363][    T1] pci 0006:00:00.0: [1def:e00b] type 01 class 0x060400
[    2.547082][    T1] pci 0006:00:00.0: enabling Extended Tags
[    2.552766][    T1] pci 0006:00:00.0: supports D1 D2
[    2.557949][    T1] pci 0006:01:00.0: working around ROM BAR overlap defect
[    2.564904][    T1] pci 0006:01:00.0: [8086:1533] type 00 class 0x020000
[    2.571623][    T1] pci 0006:01:00.0: reg 0x10: [mem 0x630100000-0x6301fffff]
[    2.578792][    T1] pci 0006:01:00.0: reg 0x1c: [mem 0x630200000-0x630203fff]
[    2.585961][    T1] pci 0006:01:00.0: reg 0x30: [mem 0x00000000-0x000fffff pref]
[    2.593479][    T1] pci 0006:01:00.0: PME# supported from D0 D3hot D3cold
[    2.600499][    T1] pci 0006:00:00.0: BAR 14: assigned [mem 0x630000000-0x6302fffff]
[    2.608236][    T1] pci 0006:01:00.0: BAR 0: assigned [mem 0x630000000-0x6300fffff]
[    2.615886][    T1] pci 0006:01:00.0: BAR 6: assigned [mem 0x630100000-0x6301fffff pref]
[    2.623972][    T1] pci 0006:01:00.0: BAR 3: assigned [mem 0x630200000-0x630203fff]
[    2.631622][    T1] pci 0006:00:00.0: PCI bridge to [bus 01]
[    2.637272][    T1] pci 0006:00:00.0:   bridge window [mem 0x630000000-0x6302fffff]
[    2.644920][    T1] pci_bus 0006:00: resource 4 [io  0x60000-0x6ffff window]
[    2.651957][    T1] pci_bus 0006:00: resource 5 [mem 0x630000000-0x6efffffff window]
[    2.659688][    T1] pci_bus 0006:00: resource 6 [mem 0x700000000-0x7ffffffff window]
[    2.667419][    T1] pci_bus 0006:01: resource 1 [mem 0x630000000-0x6302fffff]
[    2.674616][    T1] ACPI: PCI Root Bridge [PCI7] (domain 0007 [bus 00-ff])
[    2.681497][    T1] acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    2.691303][    T1] acpi PNP0A08:07: _OSC: platform does not support [SHPCHotplug LTR]
[    2.699325][    T1] acpi PNP0A08:07: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    2.708546][    T1] acpi PNP0A08:07: ECAM area [mem 0x400000000-0x40fffffff] reserved by PNP0C02:00
[    2.717593][    T1] acpi PNP0A08:07: ECAM at [mem 0x400000000-0x40fffffff] for [bus 00-ff]
[    2.725872][    T1] ACPI: Remapped I/O 0x0000000410000000 to [io  0x70000-0x7ffff window]
[    2.734136][    T1] PCI host bridge to bus 0007:00
[    2.738921][    T1] pci_bus 0007:00: root bus resource [io  0x70000-0x7ffff window] (bus address [0x0000-0xffff])
[    2.749174][    T1] pci_bus 0007:00: root bus resource [mem 0x430000000-0x4efffffff window] (bus address [0x30000000-0xefffffff])
[    2.760813][    T1] pci_bus 0007:00: root bus resource [mem 0x500000000-0x5ffffffff window]
[    2.769153][    T1] pci_bus 0007:00: root bus resource [bus 00-ff]
[    2.775366][    T1] pci 0007:00:00.0: [1def:e00c] type 01 class 0x060400
[    2.782080][    T1] pci 0007:00:00.0: enabling Extended Tags
[    2.787759][    T1] pci 0007:00:00.0: supports D1 D2
[    2.792908][    T1] pci 0007:01:00.0: [1a03:1150] type 01 class 0x060400
[    2.799655][    T1] pci 0007:01:00.0: enabling Extended Tags
[    2.805377][    T1] pci 0007:01:00.0: supports D1 D2
[    2.810331][    T1] pci 0007:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    2.817803][    T1] pci_bus 0007:02: extended config space not accessible
[    2.824613][    T1] pci 0007:02:00.0: [1a03:2000] type 00 class 0x030000
[    2.831323][    T1] pci 0007:02:00.0: reg 0x10: [mem 0x430000000-0x430ffffff]
[    2.838459][    T1] pci 0007:02:00.0: reg 0x14: [mem 0x431000000-0x43101ffff]
[    2.845593][    T1] pci 0007:02:00.0: reg 0x18: [io  0x10000000-0x1000007f]
[    2.852594][    T1] pci 0007:02:00.0: BAR 0: assigned to efifb
[    2.858455][    T1] pci 0007:02:00.0: supports D1 D2
[    2.863409][    T1] pci 0007:02:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    2.870849][    T1] pci 0007:00:00.0: BAR 14: assigned [mem 0x430000000-0x4317fffff]
[    2.878585][    T1] pci 0007:00:00.0: BAR 13: assigned [io  0x70000-0x70fff]
[    2.885624][    T1] pci 0007:01:00.0: BAR 14: assigned [mem 0x430000000-0x4317fffff]
[    2.893356][    T1] pci 0007:01:00.0: BAR 13: assigned [io  0x70000-0x70fff]
[    2.900394][    T1] pci 0007:02:00.0: BAR 0: assigned [mem 0x430000000-0x430ffffff]
[    2.908042][    T1] pci 0007:02:00.0: BAR 1: assigned [mem 0x431000000-0x43101ffff]
[    2.915689][    T1] pci 0007:02:00.0: BAR 2: assigned [io  0x70000-0x7007f]
[    2.922643][    T1] pci 0007:01:00.0: PCI bridge to [bus 02]
[    2.928293][    T1] pci 0007:01:00.0:   bridge window [io  0x70000-0x70fff]
[    2.935248][    T1] pci 0007:01:00.0:   bridge window [mem 0x430000000-0x4317fffff]
[    2.942900][    T1] pci 0007:00:00.0: PCI bridge to [bus 01-02]
[    2.948809][    T1] pci 0007:00:00.0:   bridge window [io  0x70000-0x70fff]
[    2.955760][    T1] pci 0007:00:00.0:   bridge window [mem 0x430000000-0x4317fffff]
[    2.963408][    T1] pci_bus 0007:00: resource 4 [io  0x70000-0x7ffff window]
[    2.970445][    T1] pci_bus 0007:00: resource 5 [mem 0x430000000-0x4efffffff window]
[    2.978176][    T1] pci_bus 0007:00: resource 6 [mem 0x500000000-0x5ffffffff window]
[    2.985907][    T1] pci_bus 0007:01: resource 0 [io  0x70000-0x70fff]
[    2.992336][    T1] pci_bus 0007:01: resource 1 [mem 0x430000000-0x4317fffff]
[    2.999461][    T1] pci_bus 0007:02: resource 0 [io  0x70000-0x70fff]
[    3.005891][    T1] pci_bus 0007:02: resource 1 [mem 0x430000000-0x4317fffff]
[    3.013292][    T1] iommu: Default domain type: Translated
[    3.018858][    T1] iommu: DMA domain TLB invalidation policy: strict mode
[    3.026133][    T1] SCSI subsystem initialized
[    3.030666][    T1] ACPI: bus type USB registered
[    3.035382][    T1] usbcore: registered new interface driver usbfs
[    3.041563][    T1] usbcore: registered new interface driver hub
[    3.047577][    T1] usbcore: registered new device driver usb
[    3.054241][    T1] pps_core: LinuxPPS API ver. 1 registered
[    3.059896][    T1] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    3.069722][    T1] PTP clock support registered
[    3.074415][    T1] EDAC MC: Ver: 3.0.0
[    3.078482][    T1] Registered efivars operations
[    3.083697][    T1] pci 0007:02:00.0: vgaarb: setting as boot VGA device
[    3.090388][    T1] pci 0007:02:00.0: vgaarb: bridge control possible
[    3.096815][    T1] pci 0007:02:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    3.105852][    T1] vgaarb: loaded
[    3.109400][    T1] clocksource: Switched to clocksource arch_sys_counter
[    3.116328][    T1] VFS: Disk quotas dquot_6.6.0
[    3.120971][    T1] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.128686][    T1] pnp: PnP ACPI init
[    3.132837][    T1] system 00:00: [mem 0x10000000000-0x1000fffffff window] could not be reserved
[    3.141621][    T1] system 00:00: [mem 0x7800000000-0x780fffffff window] could not be reserved
[    3.150225][    T1] system 00:00: [mem 0x7000000000-0x700fffffff window] could not be reserved
[    3.158827][    T1] system 00:00: [mem 0x6000000000-0x600fffffff window] could not be reserved
[    3.167428][    T1] system 00:00: [mem 0x5800000000-0x580fffffff window] could not be reserved
[    3.176031][    T1] system 00:00: [mem 0x1000000000-0x100fffffff window] could not be reserved
[    3.184632][    T1] system 00:00: [mem 0x600000000-0x60fffffff window] could not be reserved
[    3.193060][    T1] system 00:00: [mem 0x400000000-0x40fffffff window] could not be reserved
[    3.201500][    T1] pnp: PnP ACPI: found 1 devices
[    3.208901][    T1] NET: Registered PF_INET protocol family
[    3.214560][    T1] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    3.226331][    T1] tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[    3.235910][    T1] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    3.244440][    T1] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    3.253771][    T1] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    3.261986][    T1] TCP: Hash tables configured (established 524288 bind 65536)
[    3.269411][    T1] UDP hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    3.277291][    T1] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    3.285664][    T1] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    3.292033][    T1] NET: Registered PF_XDP protocol family
[    3.297547][    T1] PCI: CLS 64 bytes, default 64
[    3.302328][    T9] Trying to unpack rootfs image as initramfs...
[    3.308767][    T1] hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 7 counters available
[    3.317416][    T1] kvm [1]: IPA Size Limit: 42 bits
[    3.322856][    T1] kvm [1]: GICv3: no GICV resource entry
[    3.328345][    T1] kvm [1]: disabling GICv2 emulation
[    3.333490][    T1] kvm [1]: GIC system register CPU interface enabled
[    3.340328][    T1] kvm [1]: vgic interrupt IRQ9
[    3.347443][    T1] kvm [1]: Hyp mode initialized successfully
[    3.354371][    T1] Initialise system trusted keyrings
[    3.359525][    T1] Key type blacklist registered
[    3.364275][    T1] workingset: timestamp_bits=40 max_order=26 bucket_order=0
[    3.371437][    T1] zbud: loaded
[    3.375024][    T1] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    3.381693][    T1] fuse: init (API version 7.38)
[    3.396388][    T1] Key type asymmetric registered
[    3.401173][    T1] Asymmetric key parser 'x509' registered
[    3.406768][    T1] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    3.414936][    T1] io scheduler mq-deadline registered
[    3.422299][    T1] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    3.430362][    T1] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    3.439448][    T1] ACPI: button: Power Button [PWRB]
[    3.455068][    T1] ACPI GTDT: found 1 SBSA generic Watchdog(s).
[    3.472056][    T1] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    3.490512][    T1] msm_serial: driver initialized
[    3.495792][    T1] arm-smmu arm-smmu.0.auto: probing hardware configuration...
[    3.503100][    T1] arm-smmu arm-smmu.0.auto: SMMUv2 with:
[    3.508579][    T1] arm-smmu arm-smmu.0.auto:        stage 2 translation
[    3.514753][    T1] arm-smmu arm-smmu.0.auto:        coherent table walk
[    3.520925][    T1] arm-smmu arm-smmu.0.auto:        stream matching with 128 register groups
[    3.528921][    T1] arm-smmu arm-smmu.0.auto:        128 context banks (128 stage-2 only)
[    3.536578][    T1] arm-smmu arm-smmu.0.auto:        Supported page sizes: 0x60211000
[    3.543879][    T1] arm-smmu arm-smmu.0.auto:        Stage-2: 48-bit IPA -> 48-bit PA
[    3.551281][    T1] arm-smmu arm-smmu.0.auto:        preserved 0 boot mappings
[    3.558215][    T1] arm-smmu arm-smmu.1.auto: probing hardware configuration...
[    3.565518][    T1] arm-smmu arm-smmu.1.auto: SMMUv2 with:
[    3.570998][    T1] arm-smmu arm-smmu.1.auto:        stage 2 translation
[    3.577169][    T1] arm-smmu arm-smmu.1.auto:        coherent table walk
[    3.583341][    T1] arm-smmu arm-smmu.1.auto:        stream matching with 128 register groups
[    3.591337][    T1] arm-smmu arm-smmu.1.auto:        128 context banks (128 stage-2 only)
[    3.598987][    T1] arm-smmu arm-smmu.1.auto:        Supported page sizes: 0x60211000
[    3.606286][    T1] arm-smmu arm-smmu.1.auto:        Stage-2: 48-bit IPA -> 48-bit PA
[    3.613692][    T1] arm-smmu arm-smmu.1.auto:        preserved 0 boot mappings
[    3.634151][    T1] loop: module loaded
[    3.638708][    T1] tun: Universal TUN/TAP device driver, 1.6
[    3.644593][    T1] PPP generic driver version 2.4.2
[    3.649854][    T1] mousedev: PS/2 mouse device common for all mice
[    3.667271][    T1] rtc-efi rtc-efi.0: registered as rtc0
[    3.677877][    T1] rtc-efi rtc-efi.0: setting system clock to 2023-01-31T15:13:54 UTC (1675178034)
[    3.687076][    T1] i2c_dev: i2c /dev entries driver
[    3.692453][    T1] device-mapper: uevent: version 1.0.3
[    3.697840][    T1] device-mapper: ioctl: 4.47.0-ioctl (2022-07-28) initialised: dm-devel@redhat.com
[    3.717205][    T1] ledtrig-cpu: registered to indicate activity on CPUs
[    3.724001][    T1] efifb: probing for efifb
[    3.728298][    T1] efifb: No BGRT, not showing boot graphics
[    3.734036][    T1] efifb: framebuffer at 0x430000000, using 1876k, total 1875k
[    3.741333][    T1] efifb: mode is 800x600x32, linelength=3200, pages=1
[    3.747936][    T1] efifb: scrolling: redraw
[    3.752196][    T1] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    3.758545][    T1] fbcon: Deferring console take-over
[    3.763681][    T1] fb0: EFI VGA frame buffer device
[    3.769436][    T1] xgene-pmu APMC0D83:00: X-Gene PMU version 3
[    3.786522][    T1] xgene-pmu APMC0D83:00: l3c0 PMU registered
[    3.792420][    T1] xgene-pmu APMC0D83:00: l3c1 PMU registered
[    3.798315][    T1] xgene-pmu APMC0D83:00: l3c2 PMU registered
[    3.804212][    T1] xgene-pmu APMC0D83:00: l3c3 PMU registered
[    3.810110][    T1] xgene-pmu APMC0D83:00: l3c4 PMU registered
[    3.815997][    T1] xgene-pmu APMC0D83:00: l3c5 PMU registered
[    3.821899][    T1] xgene-pmu APMC0D83:00: l3c6 PMU registered
[    3.827801][    T1] xgene-pmu APMC0D83:00: l3c7 PMU registered
[    3.833700][    T1] xgene-pmu APMC0D83:00: mcb0 PMU registered
[    3.839597][    T1] xgene-pmu APMC0D83:00: mcb1 PMU registered
[    3.845501][    T1] xgene-pmu APMC0D83:00: mc0 PMU registered
[    3.851312][    T1] xgene-pmu APMC0D83:00: mc1 PMU registered
[    3.857133][    T1] xgene-pmu APMC0D83:00: mc2 PMU registered
[    3.862947][    T1] xgene-pmu APMC0D83:00: mc3 PMU registered
[    3.868751][    T1] xgene-pmu APMC0D83:00: mc4 PMU registered
[    3.874562][    T1] xgene-pmu APMC0D83:00: mc5 PMU registered
[    3.880385][    T1] xgene-pmu APMC0D83:00: mc6 PMU registered
[    3.886203][    T1] xgene-pmu APMC0D83:00: mc7 PMU registered
[    3.892051][    T1] xgene-pmu APMC0D83:00: iob0 PMU registered
[    3.897942][    T1] xgene-pmu APMC0D83:00: iob_slow0 PMU registered
[    3.904428][    T1] drop_monitor: Initializing network drop monitor service
[    3.911532][    T1] NET: Registered PF_INET6 protocol family
[    7.275190][    T9] Freeing initrd memory: 1293708K
[    7.291296][    T1] Segment Routing with IPv6
[    7.295680][    T1] In-situ OAM (IOAM) with IPv6
[    7.300333][    T1] NET: Registered PF_PACKET protocol family
[    7.306552][    T1] Key type dns_resolver registered
[    7.314848][    T1] registered taskstats version 1
[    7.325351][    T1] Loading compiled-in X.509 certificates
[    7.331420][    T1] zswap: loaded using pool lzo/zbud
[    7.339841][    T1] Key type .fscrypt registered
[    7.344459][    T1] Key type fscrypt-provisioning registered
[    7.354906][    T1] Key type encrypted registered
[    7.360059][  T214] pcieport 0000:00:00.0: Adding to iommu group 0
[    7.366464][  T214] pcieport 0000:00:00.0: PME: Signaling with IRQ 309
[    7.377508][  T214] pcieport 0000:00:00.0: AER: enabled with IRQ 309
[    7.384000][  T214] pcieport 0001:00:00.0: Adding to iommu group 1
[    7.390360][  T214] pcieport 0001:00:00.0: PME: Signaling with IRQ 310
[    7.397139][  T214] pcieport 0001:00:00.0: AER: enabled with IRQ 310
[    7.403633][  T214] pcieport 0002:00:00.0: Adding to iommu group 2
[    7.410046][  T214] pcieport 0002:00:00.0: PME: Signaling with IRQ 311
[    7.417500][  T214] pcieport 0002:00:00.0: AER: enabled with IRQ 311
[    7.424008][  T214] pcieport 0003:00:00.0: Adding to iommu group 3
[    7.430382][  T214] pcieport 0003:00:00.0: PME: Signaling with IRQ 312
[    7.437315][  T214] pcieport 0003:00:00.0: AER: enabled with IRQ 312
[    7.443813][  T214] pcieport 0004:00:00.0: Adding to iommu group 4
[    7.450175][  T214] pcieport 0004:00:00.0: PME: Signaling with IRQ 313
[    7.457097][  T214] pcieport 0004:00:00.0: AER: enabled with IRQ 313
[    7.463609][  T214] pcieport 0005:00:00.0: Adding to iommu group 5
[    7.470019][  T214] pcieport 0005:00:00.0: PME: Signaling with IRQ 314
[    7.476946][  T214] pcieport 0005:00:00.0: AER: enabled with IRQ 314
[    7.483430][  T214] pcieport 0006:00:00.0: Adding to iommu group 6
[    7.489804][  T214] pcieport 0006:00:00.0: PME: Signaling with IRQ 315
[    7.496598][  T214] pcieport 0006:00:00.0: AER: enabled with IRQ 315
[    7.503109][  T214] pcieport 0007:00:00.0: Adding to iommu group 7
[    7.509495][  T214] pcieport 0007:00:00.0: PME: Signaling with IRQ 316
[    7.516274][  T214] pcieport 0007:00:00.0: AER: enabled with IRQ 316
[    7.522781][  T214] pcieport 0007:01:00.0: Adding to iommu group 8
[    7.532317][    T1] Freeing unused kernel memory: 8128K
[    8.307894][    T1] Checked W+X mappings: passed, no W+X pages found
[    8.314266][    T1] Run /init as init process
Loading, please wait...
Starting version 245.4-4ubuntu3.18
[    8.734576][  T319] xhci-hcd 808622B7:00: xHCI Host Controller
[    8.740427][  T319] xhci-hcd 808622B7:00: new USB bus registered, assigned bus number 1
[    8.742795][  T350] xgene-slimpro-i2c APMC0D40:00: Mailbox I2C Adapter registered
[    8.748501][  T319] xhci-hcd 808622B7:00: USB3 root hub has no ports
[    8.756537][  T350] xgene-slimpro-i2c APMC0D40:01: Mailbox I2C Adapter registered
[    8.762274][  T319] xhci-hcd 808622B7:00: hcc params 0x0220fe6d hci version 0x110 quirks 0x0000000020010010
[    8.762926][  T320] ahci APMC0D33:00: supply ahci not found, using dummy regulator
[    8.763029][  T214] nvme 0003:01:00.0: Adding to iommu group 9
[    8.763077][  T320] ahci APMC0D33:00: supply phy not found, using dummy regulator
[    8.763148][  T320] ahci APMC0D33:00: supply target not found, using dummy regulator
[    8.763161][    T9] nvme 0004:01:00.0: Adding to iommu group 10
[    8.763193][  T320] ahci APMC0D33:00: AHCI 0001.0301 32 slots 2 ports 6 Gbps 0x3 impl platform mode
[    8.763198][  T320] ahci APMC0D33:00: flags: 64bit ncq sntf pm clo only fbs pio slum part ccc sadm sds apst
[    8.763410][  T214] nvme nvme0: pci function 0003:01:00.0
[    8.763483][    T9] nvme nvme1: pci function 0004:01:00.0
[    8.770124][  T214] nvme nvme0: Shutdown timeout set to 8 seconds
[    8.770971][    T9] nvme nvme1: 32/0/0 default/read/poll queues
[    8.772498][  T361] igb: Intel(R) Gigabit Ethernet Network Driver
[    8.772501][  T361] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.772643][  T361] igb 0006:01:00.0: Adding to iommu group 11
[    8.773344][  T368] ACPI: bus type drm_connector registered
[    8.776928][    T9]  nvme1n1: p1 p2
[    8.779497][  T319] xhci-hcd 808622B7:00: irq 303, io mem 0x13800000
[    8.802124][  T361] pps pps0: new PPS source ptp0
[    8.808257][  T319] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.02
[    8.811581][  T214] nvme nvme0: 32/0/0 default/read/poll queues
[    8.814113][  T361] igb 0006:01:00.0: added PHC on eth0
[    8.818483][    T9]  nvme0n1: p1
[    8.823038][  T319] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    8.832846][  T361] igb 0006:01:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.838236][  T319] usb usb1: Product: xHCI Host Controller
[    8.843623][  T361] igb 0006:01:00.0: eth0: (PCIe:2.5Gb/s:Width x1) 4c:38:d5:08:f6:02
[    8.849705][  T319] usb usb1: Manufacturer: Linux 6.2.0-rc4+ xhci-hcd
[    8.855838][  T361] igb 0006:01:00.0: eth0: PBA No: G69016-004
[    8.861696][  T319] usb usb1: SerialNumber: 808622B7:00
[    8.862335][  T319] hub 1-0:1.0: USB hub found
[    8.862537][  T320] scsi host0: ahci
[    8.862906][  T320] scsi host1: ahci
[    8.863013][  T320] ata1: SATA max UDMA/133 mmio [mem 0x1c000000-0x1c000fff] port 0x100 irq 301
[    8.863016][  T320] ata2: SATA max UDMA/133 mmio [mem 0x1c000000-0x1c000fff] port 0x180 irq 301
[    8.863133][  T320] ahci APMC0D33:01: supply ahci not found, using dummy regulator
[    8.863215][  T320] ahci APMC0D33:01: supply phy not found, using dummy regulator
[    8.863243][  T320] ahci APMC0D33:01: supply target not found, using dummy regulator
[    8.863295][  T320] ahci APMC0D33:01: AHCI 0001.0301 32 slots 2 ports 6 Gbps 0x3 impl platform mode
[    8.863299][  T320] ahci APMC0D33:01: flags: 64bit ncq sntf pm clo only fbs pio slum part ccc sadm sds apst
[    8.867965][  T361] igb 0006:01:00.0: Using MSI-X interrupts. 4 rx queue(s), 4 tx queue(s)
[    8.873812][  T319] hub 1-0:1.0: 1 port detected
[    9.047162][  T319] xhci-hcd 808622B7:01: xHCI Host Controller
[    9.047331][  T320] scsi host2: ahci
[    9.052999][  T319] xhci-hcd 808622B7:01: new USB bus registered, assigned bus number 2
[    9.056799][  T320] scsi host3: ahci
[    9.064607][  T319] xhci-hcd 808622B7:01: USB3 root hub has no ports
[    9.068201][  T320] ata3: SATA max UDMA/133 mmio [mem 0x1c100000-0x1c100fff] port 0x100 irq 302
[    9.074469][  T319] xhci-hcd 808622B7:01: hcc params 0x0220fe6d hci version 0x110 quirks 0x0000000020010010
[    9.083152][  T320] ata4: SATA max UDMA/133 mmio [mem 0x1c100000-0x1c100fff] port 0x180 irq 302
[    9.092894][  T319] xhci-hcd 808622B7:01: irq 304, io mem 0x13900000
[    9.108198][  T319] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.02
[    9.117155][  T319] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.125064][  T319] usb usb2: Product: xHCI Host Controller
[    9.130628][  T319] usb usb2: Manufacturer: Linux 6.2.0-rc4+ xhci-hcd
[    9.137059][  T319] usb usb2: SerialNumber: 808622B7:01
[    9.142521][  T319] hub 2-0:1.0: USB hub found
[    9.146987][  T319] hub 2-0:1.0: 1 port detected
[    9.175494][  T387] ata1: SATA link down (SStatus 0 SControl 330)
[    9.181607][  T389] ata2: SATA link down (SStatus 0 SControl 330)
[    9.309385][  T113] usb 1-1: new high-speed USB device number 2 using xhci-hcd
[    9.415552][  T417] ata4: SATA link down (SStatus 0 SControl 330)
[    9.421653][  T415] ata3: SATA link down (SStatus 0 SControl 330)
[    9.429797][  T352] igb 0006:01:00.0 enP6p1s0: renamed from eth0
[    9.436736][  T368] ast 0007:02:00.0: Adding to iommu group 8
[    9.442686][  T368] ast 0007:02:00.0: enabling device (0002 -> 0003)
[    9.449107][  T368] ast 0007:02:00.0: [drm] Using P2A bridge for configuration
[    9.456332][  T368] ast 0007:02:00.0: [drm] AST 2500 detected
[    9.461517][  T113] usb 1-1: New USB device found, idVendor=0424, idProduct=2514, bcdDevice= b.b3
[    9.462080][  T368] ast 0007:02:00.0: [drm] Using analog VGA
[    9.470931][  T113] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    9.476580][  T368] ast 0007:02:00.0: [drm] dram MCLK=800 Mhz type=7 bus_width=16
[    9.492206][  T368] [drm] Initialized ast 0.1.0 20120228 for 0007:02:00.0 on minor 0
[    9.544251][  T113] hub 1-1:1.0: USB hub found
[    9.548759][  T113] hub 1-1:1.0: 4 ports detected
[    9.611042][  T368] fbcon: Deferring console take-over
[    9.616178][  T368] ast 0007:02:00.0: [drm] fb0: astdrmfb frame buffer device
Begin: Loading essential drivers ... [    9.829376][  T442] raid6: neonx8   gen()  3925 MB/s
[    9.901379][  T442] raid6: neonx4   gen()  4142 MB/s
[    9.901383][  T208] usb 1-1.1: new high-speed USB device number 3 using xhci-hcd
[    9.973380][  T442] raid6: neonx2   gen()  4335 MB/s
[   10.017739][  T208] usb 1-1.1: New USB device found, idVendor=046b, idProduct=ff01, bcdDevice= 1.00
[   10.026779][  T208] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[   10.034774][  T208] usb 1-1.1: Product: Virtual Hub
[   10.039641][  T208] usb 1-1.1: Manufacturer: American Me
[   10.044943][  T208] usb 1-1.1: SerialNumber: serial
[   10.045380][  T442] raid6: neonx1   gen()  4350 MB/s
[   10.088388][  T208] hub 1-1.1:1.0: USB hub found
[   10.093085][  T208] hub 1-1.1:1.0: 5 ports detected
[   10.121377][  T442] raid6: int64x8  gen()  4245 MB/s
[   10.193376][  T442] raid6: int64x4  gen()  4349 MB/s
[   10.265379][  T442] raid6: int64x2  gen()  3947 MB/s
[   10.329384][  T208] usb 1-1.2: new full-speed USB device number 4 using xhci-hcd
[   10.337382][  T442] raid6: int64x1  gen()  2906 MB/s
[   10.342337][  T442] raid6: using algorithm neonx1 gen() 4350 MB/s
[   10.413378][  T442] raid6: .... xor() 3569 MB/s, rmw enabled
[   10.419027][  T442] raid6: using neon recovery algorithm
[   10.426942][  T442] xor: measuring software checksum speed
[   10.433341][ endor=0416, idProduct=8249, bcdDevice= 0.00
[   10.439296][  T442]    32regs          : 10783 MB/sec
[   10.447431][  T208] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[   10.453655][  T442]    arm64_neon      :  8241 MB/sec
[   10.460453][  T208] usb 1-1.2: Product: Dongle
[   10.465491][  T442] xor: using function: 8regs (10793 MB/sec)
[   10.475660][  T208] usb 1-1.2: Manufacturer: Raritan
[   10.475801][  T442] async_tx: api initialized (async)
[   10.480616][  T208] usb 1-1.2: SerialNumber: 2.3
done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Begin: Running /scripts/local-premount ... [   10.557395][   T17] usb 1-1.1.1: new high-speed USB device number 5 using xhci-hcd
[   10.574163][ c32c-generic, zoned=yes, fsverity=yes
Scanning for Btrfs filesystems
done.
[   10.605610][  T376] hid: raw HID events driver (C) Jiri Kosina
[   10.615064][  T368] usbcore: registered new interface driver usbhid
Begin: Will now check root file s[   10.621333][  T368] usbhid: USB HID core driver
ystem ... fsck from util-linux 2.34
[   10.631950][  T376] input: Raritan Dongle as /devices/platform/808622B7:00/usb1/1-1/1-1.2/1-1.2:1.0/0003:0416:8249.0001/input/input1
[/usr/sbin/fsck.ext4 (1) -- /dev/nvme1n1p2] fsck.ext4 -a -C0 /dev/nvme1n1p2
/dev/nvme1n1p2: clean, 2813995/61022208 files, 146229059/244058880 blocks
done.
[   10.662326][  T486] EXT4-fs (nvme1n1p2): mounted filesystem afadc952-1b0b-411f-9891-064d9acd96ac with ordered data mode. Quota mode: none.
done.
Begin: Running /scripts/local-bot[   10.677850][   T17] usb 1-1.1.1: New USB device found, idVendor=046b, idProduct=ff20, bcdDevice= 1.00
tom ... done.
[   10.689307][   T17] usb 1-1.1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
Begin: Running /scripts/init-bott[   10.698762][   T17] usb 1-1.1.1: Product: Virtual Cdrom Device
om ... [   10.701516sb-808622B7:00-1.2/input0
[   10.707448][   T17] usb 1-1.1.1: Manufacturer: American Megatrends Inc.
[   10.707450][   T17] usb 1-1.1.1: SerialNumber: AAAABBBBCCCC1
[   10.732884][  T376] input: Raritan Dongle Mouse as /devices/platform/808622B7:00/usb1/1-1/1-1.2/1-1.2:1.1/0003:0416:8249.0002/input/input2
[   10.745500][  T376] input: Raritan Dongle System Control as /devices/platform/808622B7:00/usb1/1-1/1-1.2/1-1.2:1.1/0003:0416:8249.0002/input/input3
[   10.797393][   T17] usb 1-1.1.3: new low-speed USB device number 6 using xhci-hcd
[   10.817590][  T376] input: Raritan Dongle Consumer Control as /devices/platform/808622B7:00/usb1/1-1/1-1.2/1-1.2:1.1/0003:0416:8249.0002/input/input4
[   10.831096][  T376] hid-generic 0003:0416:8249.0002: input,hidraw1: USB HID v1.10 Mouse [Raritan Dongle] on usb-808622B7:00-1.2/input1
[   10.843311][  T376] input: Raritan Dongle as /devices/platform/808622B7:00/usb1/1-1/1-1.2/1-1.2:1.2/0003:0416:8249.0003/input/input5
[   10.855397][  T376] hid-generic 0003:0416:8249.0003: input,hidraw2: USB HID v1.10 Mouse [Raritan Dongle] on usb-808622B7:00-1.2/input2
[   10.914436][   T17] usb 1-1.1.3: New USB device found, idVendor=046b, idProduct=ff10, bcdDevice= 1.00
[   10.923651][   T17] usb 1-1.1.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[   10.931818][   T17] usb 1-1.1.3: Product: Virtual Keyboard and Mouse
[   10.938164][   T17] usb 1-1.1.3: Manufacturer: American Megatrends Inc.
[   11.017167][   T17] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/platform/808622B7:00/usb1/1-1/1-1.1/1-1.1.3/1-1.1.3:1.0/0003:046B:FF10.0004/input/input6
[   11.033893][   T17] hid-generic 0003:046B:FF10.0004: input,hidraw3: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-808622B7:00-1.1.3/input0
[   11.050427][   T17] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/platform/808622B7:00/usb1/1-1/1-1.1/1-1.1.3/1-1.1.3:1.1/0003:046B:FF10.0005/input/input7
[   11.066711][   T17] hid-generic 0003:046B:FF10.0005: input,hidraw4: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-808622B7:00-1.1.3/input1
[   11.086817][  T376] usb-storage 1-1.1.1:1.0: USB Mass Storage device detected
[   11.095164][  T376] scsi host4: usb-storage 1-1.1.1:1.0
[   11.100555][  T376] usbcore: registered new interface driver usb-storage
[   11.109837][  T376] usbcore: registered new interface driver uas
done.
[   11.695293][    T1] systemd[1]: Inserted module 'autofs4'
[   11.727591][    T1] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[   11.751454][    T1] systemd[1]: Detected architecture arm64.

Welcome to Ubuntu 20.04.4 LTS!

[   11.821779][    T1] systemd[1]: Set hostname to <...>.
[   12.115327][  T214] scsi 4:0:0:0: CD-ROM            AMI      Virtual CDROM0   1.00 PQ: 0 ANSI: 0 CCS
[   12.130569][  T214] sr 4:0:0:0: [sr0] scsi-1 drive
[   12.135358][  T214] cdrom: Uniform CD-ROM driver Revision: 3.20
[   12.143378][  T214] sr 4:0:0:0: Attached scsi generic sg0 type 5
[   14.209389][    C2] random: crng init done
[   40.601374][   C29] watchdog: BUG: soft lockup - CPU#29 stuck for 26s! [systemd:1]
[   40.608936][   C29] Modules linked in: ip_tables x_tables autofs4 uas usb_storage hid_generic usbhid hid btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor xor_neon raid6_pq libcrc32c raid1 raid0 multipath linear dwc3 ast ulpi udc_core drm_shmem_helper drm_kms_helper syscopyarea sysfillrect sysimgblt igb nvme ahci_platform drm i2c_algo_bit nvme_core libahci_platform libahci gpio_dwapb i2c_xgene_slimpro xhci_plat_hcd
[   40.651263][   C29] CPU: 29 PID: 1 Comm: systemd Not tainted 6.2.0-rc4+ #379
[   40.658299][   C29] Hardware name: MiTAC RAPTOR EV-883832-X3-0001/RAPTOR, BIOS 0.14 02/22/2019
[   40.666897][   C29] pstate: 20400005 (nzCv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   40.674541][   C29] pc : smp_call_function_many_cond+0x1a4/0x3c0
[   40.680540][   C29] lr : smp_call_function_many_cond+0x160/0x3c0
[   40.686534][   C29] sp : ffff80000811ba70
[   40.690530][   C29] x29: ffff80000811ba70 x28: 000000000000001f x27: ffff00bf5e0971c8
[   40.698350][   C29] x26: ffff800009e78d10 x25: 000000000000001d x24: 0000000000000020
[   40.706168][   C29] x23: ffff800009e7d548 x22: 0000000000000000 x21: ffff00bf5e0971c8
[   40.713986][   C29] x20: ffff00bf5e0971c0 x19: ffff800009e7d548 x18: 0000000000000014
[   40.721804][   C29] x17: 000000003f545a8a x16: 000000000efdb9fd x15: 0000000078485854
[   40.729622][   C29] x14: 0000000000000091 x13: 0000000000000007 x12: 0000000000000007
[   40.737440][   C29] x11: 00000000dfb57e9f x10: 0000000000000000 x9 : ffff8000087bcf1c
[   40.745259][   C29] x8 : ffff00bf5e0971f0 x7 : 0000000000000000 x6 : 00000000ffffffff
[   40.753077][   C29] x5 : 0000000000000000 x4 : 0000000000000000 x3 : 0000000000000000
[   40.760896][   C29] x2 : ffff00bf5dd35f28 x1 : 0000000000000011 x0 : 0000000000000000
[   40.768714][   C29] Call trace:
[   40.771843][   C29]  smp_call_function_many_cond+0x1a4/0x3c0
[   40.777490][   C29]  kick_all_cpus_sync+0x38/0x48
[   40.782182][   C29]  bpf_int_jit_compile+0x1ec/0x628
[   40.787136][   C29]  bpf_prog_select_runtime+0xd8/0x120
[   40.792350][   C29]  bpf_prepare_filter+0x3cc/0x470
[   40.797217][   C29]  __get_filter+0xb8/0x138
[   40.801476][   C29]  sk_attach_filter+0x20/0x88
[   40.805995][   C29]  sk_setsockopt+0x5d8/0xf30
[   40.810427][   C29]  sock_setsockopt+0x1c/0x28
[   40.814859][   C29]  __sys_setsockopt+0x130/0x1a8
[   40.819552][   C29]  __arm64_sys_setsockopt+0x30/0x40
[   40.824591][   C29]  invoke_syscall+0x4c/0x110
[   40.829025][   C29]  el0_svc_common.constprop.0+0x58/0x190
[   40.834499][   C29]  do_el0_svc+0x40/0xb8
[   40.838497][   C29]  el0_svc+0x2c/0xb8
[   40.842235][   C29]  el0t_64_sync_handler+0xb8/0xc0
[   40.847100][   C29]  el0t_64_sync+0x1a4/0x1a8
[   64.601374][   C29] watchdog: BUG: soft lockup - CPU#29 stuck for 49s! [systemd:1]
[   64.608933][   C29] Modules linked in: ip_tables x_tables autofs4 uas usb_storage hid_generic usbhid hid btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor xor_neon raid6_pq libcrc32c raid1 raid0 multipath linear dwc3 ast ulpi udc_core drm_shmem_helper drm_kms_helper syscopyarea sysfillrect sysimgblt igb nvme ahci_platform drm i2c_algo_bit nvme_core libahci_platform libahci gpio_dwapb i2c_xgene_slimpro xhci_plat_hcd
[   64.651257][   C29] CPU: 29 PID: 1 Comm: systemd Tainted: G             L     6.2.0-rc4+ #379
[   64.659768][   C29] Hardware name: MiTAC RAPTOR EV-883832-X3-0001/RAPTOR, BIOS 0.14 02/22/2019
[   64.668365][   C29] pstate: 20400005 (nzCv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   64.676008][   C29] pc : smp_call_function_many_cond+0x1a4/0x3c0
[   64.682004][   C29] lr : smp_call_function_many_cond+0x160/0x3c0
[   64.687997][   C29] sp : ffff80000811ba70
[   64.691993][   C29] x29: ffff80000811ba70 x28: 000000000000001f x27: ffff00bf5e0971c8
[   64.699811][   C29] x26: ffff800009e78d10 x25: 000000000000001d x24: 0000000000000020
[   64.707629][   C29] x23: ffff800009e7d548 x22: 0000000000000000 x21: ffff00bf5e0971c8
[   64.715448][   C29] x20: ffff00bf5e0971c0 x19: ffff800009e7d548 x18: 0000000000000014
[   64.723266][   C29] x17: 000000003f545a8a x16: 000000000efdb9fd x15: 0000000078485854
[   64.731084][   C29] x14: 0000000000000091 x13: 0000000000000007 x12: 0000000000000007
[   64.738902][   C29] x11: 00000000dfb57e9f x10: 0000000000000000 x9 : ffff8000087bcf1c
[   64.746721][   C29] x8 : ffff00bf5e0971f0 x7 : 0000000000000000 x6 : 00000000ffffffff
[   64.754540][   C29] x5 : 0000000000000000 x4 : 0000000000000000 x3 : 0000000000000000
[   64.762357][   C29] x2 : ffff00bf5dd35f28 x1 : 0000000000000011 x0 : 0000000000000000
[   64.770175][   C29] Call trace:
[   64.773304][   C29]  smp_call_function_many_cond+0x1a4/0x3c0
[   64.778950][   C29]  kick_all_cpus_sync+0x38/0x48
[   64.783641][   C29]  bpf_int_jit_compile+0x1ec/0x628
[   64.788595][   C29]  bpf_prog_select_runtime+0xd8/0x120
[   64.793808][   C29]  bpf_prepare_filter+0x3cc/0x470
[   64.798674][   C29]  __get_filter+0xb8/0x138
[   64.802932][   C29]  sk_attach_filter+0x20/0x88
[   64.807451][   C29]  sk_setsockopt+0x5d8/0xf30
[   64.811882][   C29]  sock_setsockopt+0x1c/0x28
[   64.816313][   C29]  __sys_setsockopt+0x130/0x1a8
[   64.821006][   C29]  __arm64_sys_setsockopt+0x30/0x40
[   64.826045][   C29]  invoke_syscall+0x4c/0x110
[   64.830478][   C29]  el0_svc_common.constprop.0+0x58/0x190
[   64.835951][   C29]  do_el0_svc+0x40/0xb8
[   64.839949][   C29]  el0_svc+0x2c/0xb8
[   64.843687][   C29]  el0t_64_sync_handler+0xb8/0xc0
[   64.848553][   C29]  el0t_64_sync+0x1a4/0x1a8
[   74.221375][   C29] rcu: INFO: rcu_sched self-detected stall on CPU
[   74.227631][   C29] rcu:     29-....: (14876 ticks this GP) idle=6fbc/1/0x4000000000000000 softirq=460/460 fqs=7501
[   74.237794][   C29]  (t=15005 jiffies g=325 q=171 ncpus=32)
[   74.243355][   C29] Task dump for CPU 0:
[   74.247265][   C29] task:kworker/u64:1   state:R  running task     stack:0     pid:214   ppid:2      flags:0x0000000a
[   74.257863][   C29] Workqueue: efi_rts_wq efi_call_rts
[   74.262992][   C29] Call trace:
[   74.266120][   C29]  __switch_to+0xec/0x1d0
[   74.270293][   C29]  kallsyms_seqs_of_names+0x19d740/0x1c1d48
[   74.276031][   C29] CPU: 29 PID: 1 Comm: systemd Tainted: G             L     6.2.0-rc4+ #379
[   74.284542][   C29] Hardware name: MiTAC RAPTOR EV-883832-X3-0001/RAPTOR, BIOS 0.14 02/22/2019
[   74.293139][   C29] pstate: 20400005 (nzCv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   74.300783][   C29] pc : smp_call_function_many_cond+0x1a4/0x3c0
[   74.306777][   C29] lr : smp_call_function_many_cond+0x160/0x3c0
[   74.312771][   C29] sp : ffff80000811ba70
[   74.316767][   C29] x29: ffff80000811ba70 x28: 000000000000001f x27: ffff00bf5e0971c8
[   74.324585][   C29] x26: ffff800009e78d10 x25: 000000000000001d x24: 0000000000000020
[   74.332402][   C29] x23: ffff800009e7d548 x22: 0000000000000000 x21: ffff00bf5e0971c8
[   74.340221][   C29] x20: ffff00bf5e0971c0 x19: ffff800009e7d548 x18: 0000000000000014
[   74.348040][   C29] x17: 000000003f545a8a x16: 000000000efdb9fd x15: 0000000078485854
[   74.355857][   C29] x14: 0000000000000091 x13: 0000000000000007 x12: 0000000000000007
[   74.363675][   C29] x11: 00000000dfb57e9f x10: 0000000000000000 x9 : ffff8000087bcf1c
[   74.371493][   C29] x8 : ffff00bf5e0971f0 x7 : 0000000000000000 x6 : 00000000ffffffff
[   74.379311][   C29] x5 : 0000000000000000 x4 : 0000000000000000 x3 : 0000000000000000
[   74.387129][   C29] x2 : ffff00bf5dd35f28 x1 : 0000000000000011 x0 : 0000000000000000
[   74.394947][   C29] Call trace:
[   74.398075][   C29]  smp_call_function_many_cond+0x1a4/0x3c0
[   74.403722][   C29]  kick_all_cpus_sync+0x38/0x48
[   74.408413][   C29]  bpf_int_jit_compile+0x1ec/0x628
[   74.413366][   C29]  bpf_prog_select_runtime+0xd8/0x120
[   74.418579][   C29]  bpf_prepare_filter+0x3cc/0x470
[   74.423445][   C29]  __get_filter+0xb8/0x138
[   74.427703][   C29]  sk_attach_filter+0x20/0x88
[   74.432221][   C29]  sk_setsockopt+0x5d8/0xf30
[   74.436653][   C29]  sock_setsockopt+0x1c/0x28
[   74.441084][   C29]  __sys_setsockopt+0x130/0x1a8
[   74.445776][   C29]  __arm64_sys_setsockopt+0x30/0x40
[   74.450816][   C29]  invoke_syscall+0x4c/0x110
[   74.455249][   C29]  el0_svc_common.constprop.0+0x58/0x190
[   74.460723][   C29]  do_el0_svc+0x40/0xb8
[   74.464721][   C29]  el0_svc+0x2c/0xb8
[   74.468457][   C29]  el0t_64_sync_handler+0xb8/0xc0
[   74.473323][   C29]  el0t_64_sync+0x1a4/0x1a8



IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Justin He]

> -----Original Message-----
> From: Justin He
> Sent: Tuesday, January 31, 2023 11:22 PM
> To: Ard Biesheuvel <ardb@kernel.org>; Jason A. Donenfeld <Jason@zx2c4.com>
> Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>
> Subject: RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
>
> Hi Ard,
>
> > -----Original Message-----
> > From: Ard Biesheuvel <ardb@kernel.org>
> > Sent: Tuesday, January 31, 2023 3:19 PM
> > To: Justin He <Justin.He@arm.com>; Jason A. Donenfeld <Jason@zx2c4.com>
> > Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> > linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>
> > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> >
> > (cc Jason for awareness)
> >
> > On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
> > >
> > > I met a hung task warning and then kernel was hung forever with latest
> > > kernel on an Ampere Emag server.
> > >
> > > The root cause is kernel was hung  when invoking an efi rts call to
> > > set the RandomSeed variable during the booting stage. The
> > > arch_efi_call_virt call (set_variable) was never returned and then caused
> the
> > hung task error.
> > >
> >
> > Given that EFI variables work on this platform (as far as I know), the problem
> > may be that we are calling SetVariable() too early.
> >
> > Could you double check whether setting variables works as expected?
> > You can use efibootmgr -t 10 as root (for example) to set the boot timeout,
> and
> > check whether the new value is retained after a reboot (efibootmgr will print
> > the current value for you)
> >
> > Could you also please share the kernel log up until the point where it hangs?
> >
> The set_variable seems to be ok in 5.19+:
> root@:~# efibootmgr -t 10
> BootCurrent: 0000
> Timeout: 10 seconds
> BootOrder: 0000,0004,0003,0002,0001
> Boot0000* ubuntu
> Boot0001* grub
> Boot0002* UEFI: Built-in EFI Shell
> Boot0003* UEFI: PXE boot on MAC: 4C:38:D5:08:F6:02
> Boot0004* ubuntu
> root@:~# efibootmgr -t 9
> BootCurrent: 0000
> Timeout: 9 seconds
> BootOrder: 0000,0004,0003,0002,0001
> Boot0000* ubuntu
> Boot0001* grub
> Boot0002* UEFI: Built-in EFI Shell
> Boot0003* UEFI: PXE boot on MAC: 4C:38:D5:08:F6:02
> Boot0004* ubuntu
> root@:~# uname -a
> Linux $machine_name 5.19.0+ #228 SMP Wed Aug 17 13:22:29 UTC 2022
> aarch64 aarch64 aarch64 GNU/Linux
>
> The dmesg log until the hung(some information was removed, eg, hostname):
>
Sorry, I noticed my previous mail might be bounced back if the text is too long.
I pasted it to online Pastebin.com
https://pastebin.com/3zQyryp1

Hope it helps

Cheers,
Justin
IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Jason A. Donenfeld]

On Tue, Jan 31, 2023 at 03:21:39PM +0000, Justin He wrote:
> Hi Ard,
> 
> > -----Original Message-----
> > From: Ard Biesheuvel <ardb@kernel.org>
> > Sent: Tuesday, January 31, 2023 3:19 PM
> > To: Justin He <Justin.He@arm.com>; Jason A. Donenfeld <Jason@zx2c4.com>
> > Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> > linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>
> > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> >
> > (cc Jason for awareness)
> >
> > On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
> > >
> > > I met a hung task warning and then kernel was hung forever with latest
> > > kernel on an Ampere Emag server.
> > >
> > > The root cause is kernel was hung  when invoking an efi rts call to
> > > set the RandomSeed variable during the booting stage. The
> > > arch_efi_call_virt call (set_variable) was never returned and then caused the
> > hung task error.
> > >
> >
> > Given that EFI variables work on this platform (as far as I know), the problem
> > may be that we are calling SetVariable() too early.
> >
> > Could you double check whether setting variables works as expected?
> > You can use efibootmgr -t 10 as root (for example) to set the boot timeout, and
> > check whether the new value is retained after a reboot (efibootmgr will print
> > the current value for you)
> >
> > Could you also please share the kernel log up until the point where it hangs?
> >
> The set_variable seems to be ok in 5.19+:
> root@:~# efibootmgr -t 10
> BootCurrent: 0000
> Timeout: 10 seconds

I think what we want to learn is whether efibootmgr -t 10 works in the
latest RC. If not, it would suggest the issue isn't with the seed
setting, but with some other unrelated change.

Can you run efibootmgr -t 10 (or whatever) again on a kernel where
you've commented out these lines in efi.c inside of efisubsys_init():

    if (efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE))
        execute_with_initialized_rng(&refresh_nv_rng_seed_nb);

-->

    // if (efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE))
    //     execute_with_initialized_rng(&refresh_nv_rng_seed_nb);

Or something like that.

Jason

RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Justin He]

Hi Jason

> -----Original Message-----
> From: Jason A. Donenfeld <Jason@zx2c4.com>
> Sent: Wednesday, February 1, 2023 2:23 AM
> To: Justin He <Justin.He@arm.com>
> Cc: Ard Biesheuvel <ardb@kernel.org>; Huacai Chen <chenhuacai@kernel.org>;
> linux-efi@vger.kernel.org; linux-kernel@vger.kernel.org; Alexandru Elisei
> <Alexandru.Elisei@arm.com>
> Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
>
> On Tue, Jan 31, 2023 at 03:21:39PM +0000, Justin He wrote:
> > Hi Ard,
> >
> > > -----Original Message-----
> > > From: Ard Biesheuvel <ardb@kernel.org>
> > > Sent: Tuesday, January 31, 2023 3:19 PM
> > > To: Justin He <Justin.He@arm.com>; Jason A. Donenfeld
> > > <Jason@zx2c4.com>
> > > Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> > > linux-kernel@vger.kernel.org; Alexandru Elisei
> > > <Alexandru.Elisei@arm.com>
> > > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> > >
> > > (cc Jason for awareness)
> > >
> > > On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
> > > >
> > > > I met a hung task warning and then kernel was hung forever with
> > > > latest kernel on an Ampere Emag server.
> > > >
> > > > The root cause is kernel was hung  when invoking an efi rts call
> > > > to set the RandomSeed variable during the booting stage. The
> > > > arch_efi_call_virt call (set_variable) was never returned and then
> > > > caused the
> > > hung task error.
> > > >
> > >
> > > Given that EFI variables work on this platform (as far as I know),
> > > the problem may be that we are calling SetVariable() too early.
> > >
> > > Could you double check whether setting variables works as expected?
> > > You can use efibootmgr -t 10 as root (for example) to set the boot
> > > timeout, and check whether the new value is retained after a reboot
> > > (efibootmgr will print the current value for you)
> > >
> > > Could you also please share the kernel log up until the point where it
> hangs?
> > >
> > The set_variable seems to be ok in 5.19+:
> > root@:~# efibootmgr -t 10
> > BootCurrent: 0000
> > Timeout: 10 seconds
>
> I think what we want to learn is whether efibootmgr -t 10 works in the latest
> RC. If not, it would suggest the issue isn't with the seed setting, but with some
> other unrelated change.
>
> Can you run efibootmgr -t 10 (or whatever) again on a kernel where you've
> commented out these lines in efi.c inside of efisubsys_init():
>
>     if (efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE))
>         execute_with_initialized_rng(&refresh_nv_rng_seed_nb);
>
> -->
>
>     // if (efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE))
>     //     execute_with_initialized_rng(&refresh_nv_rng_seed_nb);
>
As your suggested (comment above execute_with_initialized_rng in latest kernel):
The efibootmgr -t X will be hung. Looks like one certain commit before your patch
broke the set_variable efi call. I will dig into the further debug and tell you the result.

---
Cheers,
Justin.
IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Justin He]

Hi Ard

> -----Original Message-----
[...]
> As your suggested (comment above execute_with_initialized_rng in latest
> kernel):
> The efibootmgr -t X will be hung. Looks like one certain commit before your
> patch broke the set_variable efi call. I will dig into the further debug and tell
> you the result.

The root cause of the hung IMO might be similar to 
commit 550b33cfd445296868a478e8413ffb2e963eed32
Author: Ard Biesheuvel <ardb@kernel.org>
Date:   Thu Nov 10 10:36:20 2022 +0100

    arm64: efi: Force the use of SetVirtualAddressMap() on Altra machines

Do you agree with the idea if I add Ampere ”eMAG” machine into the list of
Using SetVirtualAddressMap() forcibly?

Please note that even in previous kernel patch, the efibootmgr -t 10 will make
kernel hung if I passed "efi=novamap" to the boot parameter.


--
Cheers,
Justin (Jia He)

Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Ard Biesheuvel]

On Tue, 7 Feb 2023 at 04:21, Justin He <Justin.He@arm.com> wrote:
>
> Hi Ard
>
> > -----Original Message-----
> [...]
> > As your suggested (comment above execute_with_initialized_rng in latest
> > kernel):
> > The efibootmgr -t X will be hung. Looks like one certain commit before your
> > patch broke the set_variable efi call. I will dig into the further debug and tell
> > you the result.
>
> The root cause of the hung IMO might be similar to
> commit 550b33cfd445296868a478e8413ffb2e963eed32
> Author: Ard Biesheuvel <ardb@kernel.org>
> Date:   Thu Nov 10 10:36:20 2022 +0100
>
>     arm64: efi: Force the use of SetVirtualAddressMap() on Altra machines
>
> Do you agree with the idea if I add Ampere ”eMAG” machine into the list of
> Using SetVirtualAddressMap() forcibly?
>
> Please note that even in previous kernel patch, the efibootmgr -t 10 will make
> kernel hung if I passed "efi=novamap" to the boot parameter.
>

Interesting. What does dmidecode return for the family in the type 1 record?

RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Justin He]

> -----Original Message-----
[..]
> > The root cause of the hung IMO might be similar to commit
> > 550b33cfd445296868a478e8413ffb2e963eed32
> > Author: Ard Biesheuvel <ardb@kernel.org>
> > Date:   Thu Nov 10 10:36:20 2022 +0100
> >
> >     arm64: efi: Force the use of SetVirtualAddressMap() on Altra
> > machines
> >
> > Do you agree with the idea if I add Ampere ”eMAG” machine into the
> > list of Using SetVirtualAddressMap() forcibly?
> >
> > Please note that even in previous kernel patch, the efibootmgr -t 10
> > will make kernel hung if I passed "efi=novamap" to the boot parameter.
> >
> 
> Interesting. What does dmidecode return for the family in the type 1 record?

# dmidecode |grep -i family
        Family: eMAG
        Family: ARMv8

The full dmidecode log is at https://pastebin.com/M3MAJtUG


--
Cheers,
Justin (Jia He)

Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Ard Biesheuvel]

On Tue, 7 Feb 2023 at 09:49, Justin He <Justin.He@arm.com> wrote:
>
>
>
> > -----Original Message-----
> [..]
> > > The root cause of the hung IMO might be similar to commit
> > > 550b33cfd445296868a478e8413ffb2e963eed32
> > > Author: Ard Biesheuvel <ardb@kernel.org>
> > > Date:   Thu Nov 10 10:36:20 2022 +0100
> > >
> > >     arm64: efi: Force the use of SetVirtualAddressMap() on Altra
> > > machines
> > >
> > > Do you agree with the idea if I add Ampere ”eMAG” machine into the
> > > list of Using SetVirtualAddressMap() forcibly?
> > >
> > > Please note that even in previous kernel patch, the efibootmgr -t 10
> > > will make kernel hung if I passed "efi=novamap" to the boot parameter.
> > >
> >
> > Interesting. What does dmidecode return for the family in the type 1 record?
>
> # dmidecode |grep -i family
>         Family: eMAG
>         Family: ARMv8
>
> The full dmidecode log is at https://pastebin.com/M3MAJtUG
>

OK please try this:

diff --git a/drivers/firmware/efi/libstub/arm64.c
b/drivers/firmware/efi/libstub/arm64.c
index ff2d18c42ee74979..fae930dec82be7c6 100644
--- a/drivers/firmware/efi/libstub/arm64.c
+++ b/drivers/firmware/efi/libstub/arm64.c
@@ -22,7 +22,8 @@ static bool system_needs_vamap(void)
         * Ampere Altra machines crash in SetTime() if SetVirtualAddressMap()
         * has not been called prior.
         */
-       if (!type1_family || strcmp(type1_family, "Altra"))
+       if (!type1_family ||
+           (strcmp(type1_family, "Altra") && strcmp(type1_family, "eMAG")))
                return false;

        efi_warn("Working around broken SetVirtualAddressMap()\n");

RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Justin He]

Hi Ard

> -----Original Message-----
> From: Ard Biesheuvel <ardb@kernel.org>
> Sent: Tuesday, February 7, 2023 4:54 PM
> To: Justin He <Justin.He@arm.com>
> Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>;
> Jason A. Donenfeld <Jason@zx2c4.com>; nd <nd@arm.com>
> Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> 
> On Tue, 7 Feb 2023 at 09:49, Justin He <Justin.He@arm.com> wrote:
> >
> >
> >
> > > -----Original Message-----
> > [..]
> > > > The root cause of the hung IMO might be similar to commit
> > > > 550b33cfd445296868a478e8413ffb2e963eed32
> > > > Author: Ard Biesheuvel <ardb@kernel.org>
> > > > Date:   Thu Nov 10 10:36:20 2022 +0100
> > > >
> > > >     arm64: efi: Force the use of SetVirtualAddressMap() on Altra
> > > > machines
> > > >
> > > > Do you agree with the idea if I add Ampere ”eMAG” machine into the
> > > > list of Using SetVirtualAddressMap() forcibly?
> > > >
> > > > Please note that even in previous kernel patch, the efibootmgr -t
> > > > 10 will make kernel hung if I passed "efi=novamap" to the boot
> parameter.
> > > >
> > >
> > > Interesting. What does dmidecode return for the family in the type 1
> record?
> >
> > # dmidecode |grep -i family
> >         Family: eMAG
> >         Family: ARMv8
> >
> > The full dmidecode log is at https://pastebin.com/M3MAJtUG
> >
> 
> OK please try this:
> 
> diff --git a/drivers/firmware/efi/libstub/arm64.c
> b/drivers/firmware/efi/libstub/arm64.c
> index ff2d18c42ee74979..fae930dec82be7c6 100644
> --- a/drivers/firmware/efi/libstub/arm64.c
> +++ b/drivers/firmware/efi/libstub/arm64.c
> @@ -22,7 +22,8 @@ static bool system_needs_vamap(void)
>          * Ampere Altra machines crash in SetTime() if
> SetVirtualAddressMap()
>          * has not been called prior.
>          */
> -       if (!type1_family || strcmp(type1_family, "Altra"))
> +       if (!type1_family ||
> +           (strcmp(type1_family, "Altra") && strcmp(type1_family,
> + "eMAG")))
>                 return false;
> 
>         efi_warn("Working around broken SetVirtualAddressMap()\n");

Yes, it works on my eMAG server: the kernel boots.
Other than efibootmgr failure. But I noticed this efibootmgr failure even before
Commit d3549a938b7 ("avoid SetVirtualAddressMap() when possible ")

root@:~/linux# efibootmgr -t 9; efibootmgr -t 5;
Could not set Timeout: Input/output error
Could not set Timeout: Input/output error


--
Cheers,
Justin (Jia He)

Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Ard Biesheuvel]

On Tue, 7 Feb 2023 at 10:03, Justin He <Justin.He@arm.com> wrote:
>
> Hi Ard
>
> > -----Original Message-----
> > From: Ard Biesheuvel <ardb@kernel.org>
> > Sent: Tuesday, February 7, 2023 4:54 PM
> > To: Justin He <Justin.He@arm.com>
> > Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> > linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>;
> > Jason A. Donenfeld <Jason@zx2c4.com>; nd <nd@arm.com>
> > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> >
> > On Tue, 7 Feb 2023 at 09:49, Justin He <Justin.He@arm.com> wrote:
> > >
> > >
> > >
> > > > -----Original Message-----
> > > [..]
> > > > > The root cause of the hung IMO might be similar to commit
> > > > > 550b33cfd445296868a478e8413ffb2e963eed32
> > > > > Author: Ard Biesheuvel <ardb@kernel.org>
> > > > > Date:   Thu Nov 10 10:36:20 2022 +0100
> > > > >
> > > > >     arm64: efi: Force the use of SetVirtualAddressMap() on Altra
> > > > > machines
> > > > >
> > > > > Do you agree with the idea if I add Ampere ”eMAG” machine into the
> > > > > list of Using SetVirtualAddressMap() forcibly?
> > > > >
> > > > > Please note that even in previous kernel patch, the efibootmgr -t
> > > > > 10 will make kernel hung if I passed "efi=novamap" to the boot
> > parameter.
> > > > >
> > > >
> > > > Interesting. What does dmidecode return for the family in the type 1
> > record?
> > >
> > > # dmidecode |grep -i family
> > >         Family: eMAG
> > >         Family: ARMv8
> > >
> > > The full dmidecode log is at https://pastebin.com/M3MAJtUG
> > >
> >
> > OK please try this:
> >
> > diff --git a/drivers/firmware/efi/libstub/arm64.c
> > b/drivers/firmware/efi/libstub/arm64.c
> > index ff2d18c42ee74979..fae930dec82be7c6 100644
> > --- a/drivers/firmware/efi/libstub/arm64.c
> > +++ b/drivers/firmware/efi/libstub/arm64.c
> > @@ -22,7 +22,8 @@ static bool system_needs_vamap(void)
> >          * Ampere Altra machines crash in SetTime() if
> > SetVirtualAddressMap()
> >          * has not been called prior.
> >          */
> > -       if (!type1_family || strcmp(type1_family, "Altra"))
> > +       if (!type1_family ||
> > +           (strcmp(type1_family, "Altra") && strcmp(type1_family,
> > + "eMAG")))
> >                 return false;
> >
> >         efi_warn("Working around broken SetVirtualAddressMap()\n");
>
> Yes, it works on my eMAG server: the kernel boots.
> Other than efibootmgr failure. But I noticed this efibootmgr failure even before
> Commit d3549a938b7 ("avoid SetVirtualAddressMap() when possible ")
>
> root@:~/linux# efibootmgr -t 9; efibootmgr -t 5;
> Could not set Timeout: Input/output error
> Could not set Timeout: Input/output error
>

Do you get any [Firmware Bug] lines in the kernel log?

RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Justin He]

> -----Original Message-----
> From: Ard Biesheuvel <ardb@kernel.org>
> Sent: Tuesday, February 7, 2023 5:04 PM
> To: Justin He <Justin.He@arm.com>
> Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>;
> Jason A. Donenfeld <Jason@zx2c4.com>; nd <nd@arm.com>
> Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> 
> On Tue, 7 Feb 2023 at 10:03, Justin He <Justin.He@arm.com> wrote:
> >
> > Hi Ard
> >
> > > -----Original Message-----
> > > From: Ard Biesheuvel <ardb@kernel.org>
> > > Sent: Tuesday, February 7, 2023 4:54 PM
> > > To: Justin He <Justin.He@arm.com>
> > > Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> > > linux-kernel@vger.kernel.org; Alexandru Elisei
> > > <Alexandru.Elisei@arm.com>; Jason A. Donenfeld <Jason@zx2c4.com>; nd
> > > <nd@arm.com>
> > > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> > >
> > > On Tue, 7 Feb 2023 at 09:49, Justin He <Justin.He@arm.com> wrote:
> > > >
> > > >
> > > >
> > > > > -----Original Message-----
> > > > [..]
> > > > > > The root cause of the hung IMO might be similar to commit
> > > > > > 550b33cfd445296868a478e8413ffb2e963eed32
> > > > > > Author: Ard Biesheuvel <ardb@kernel.org>
> > > > > > Date:   Thu Nov 10 10:36:20 2022 +0100
> > > > > >
> > > > > >     arm64: efi: Force the use of SetVirtualAddressMap() on
> > > > > > Altra machines
> > > > > >
> > > > > > Do you agree with the idea if I add Ampere ”eMAG” machine into
> > > > > > the list of Using SetVirtualAddressMap() forcibly?
> > > > > >
> > > > > > Please note that even in previous kernel patch, the efibootmgr
> > > > > > -t
> > > > > > 10 will make kernel hung if I passed "efi=novamap" to the boot
> > > parameter.
> > > > > >
> > > > >
> > > > > Interesting. What does dmidecode return for the family in the
> > > > > type 1
> > > record?
> > > >
> > > > # dmidecode |grep -i family
> > > >         Family: eMAG
> > > >         Family: ARMv8
> > > >
> > > > The full dmidecode log is at https://pastebin.com/M3MAJtUG
> > > >
> > >
> > > OK please try this:
> > >
> > > diff --git a/drivers/firmware/efi/libstub/arm64.c
> > > b/drivers/firmware/efi/libstub/arm64.c
> > > index ff2d18c42ee74979..fae930dec82be7c6 100644
> > > --- a/drivers/firmware/efi/libstub/arm64.c
> > > +++ b/drivers/firmware/efi/libstub/arm64.c
> > > @@ -22,7 +22,8 @@ static bool system_needs_vamap(void)
> > >          * Ampere Altra machines crash in SetTime() if
> > > SetVirtualAddressMap()
> > >          * has not been called prior.
> > >          */
> > > -       if (!type1_family || strcmp(type1_family, "Altra"))
> > > +       if (!type1_family ||
> > > +           (strcmp(type1_family, "Altra") && strcmp(type1_family,
> > > + "eMAG")))
> > >                 return false;
> > >
> > >         efi_warn("Working around broken SetVirtualAddressMap()\n");
> >
> > Yes, it works on my eMAG server: the kernel boots.
> > Other than efibootmgr failure. But I noticed this efibootmgr failure
> > even before Commit d3549a938b7 ("avoid SetVirtualAddressMap() when
> > possible ")
> >
> > root@:~/linux# efibootmgr -t 9; efibootmgr -t 5; Could not set
> > Timeout: Input/output error Could not set Timeout: Input/output error
> >
> 
> Do you get any [Firmware Bug] lines in the kernel log?

No, 
I built the kernel based on:
commit d2d11f342b179f1894a901f143ec7c008caba43e (HEAD -> master, origin/master, origin/HEAD)
Author: Linus Torvalds <torvalds@linux-foundation.org>
Date:   Sun Feb 5 17:17:10 2023 -0800

    Merge branch 'fixes' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

Are you worried about your sync exception fixup patch? I think it has been included.


--
Cheers,
Justin (Jia He)

Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Ard Biesheuvel]

On Tue, 7 Feb 2023 at 10:08, Justin He <Justin.He@arm.com> wrote:
>
>
>
> > -----Original Message-----
> > From: Ard Biesheuvel <ardb@kernel.org>
> > Sent: Tuesday, February 7, 2023 5:04 PM
> > To: Justin He <Justin.He@arm.com>
> > Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> > linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>;
> > Jason A. Donenfeld <Jason@zx2c4.com>; nd <nd@arm.com>
> > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> >
> > On Tue, 7 Feb 2023 at 10:03, Justin He <Justin.He@arm.com> wrote:
> > >
> > > Hi Ard
> > >
> > > > -----Original Message-----
> > > > From: Ard Biesheuvel <ardb@kernel.org>
> > > > Sent: Tuesday, February 7, 2023 4:54 PM
> > > > To: Justin He <Justin.He@arm.com>
> > > > Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> > > > linux-kernel@vger.kernel.org; Alexandru Elisei
> > > > <Alexandru.Elisei@arm.com>; Jason A. Donenfeld <Jason@zx2c4.com>; nd
> > > > <nd@arm.com>
> > > > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> > > >
> > > > On Tue, 7 Feb 2023 at 09:49, Justin He <Justin.He@arm.com> wrote:
> > > > >
> > > > >
> > > > >
> > > > > > -----Original Message-----
> > > > > [..]
> > > > > > > The root cause of the hung IMO might be similar to commit
> > > > > > > 550b33cfd445296868a478e8413ffb2e963eed32
> > > > > > > Author: Ard Biesheuvel <ardb@kernel.org>
> > > > > > > Date:   Thu Nov 10 10:36:20 2022 +0100
> > > > > > >
> > > > > > >     arm64: efi: Force the use of SetVirtualAddressMap() on
> > > > > > > Altra machines
> > > > > > >
> > > > > > > Do you agree with the idea if I add Ampere ”eMAG” machine into
> > > > > > > the list of Using SetVirtualAddressMap() forcibly?
> > > > > > >
> > > > > > > Please note that even in previous kernel patch, the efibootmgr
> > > > > > > -t
> > > > > > > 10 will make kernel hung if I passed "efi=novamap" to the boot
> > > > parameter.
> > > > > > >
> > > > > >
> > > > > > Interesting. What does dmidecode return for the family in the
> > > > > > type 1
> > > > record?
> > > > >
> > > > > # dmidecode |grep -i family
> > > > >         Family: eMAG
> > > > >         Family: ARMv8
> > > > >
> > > > > The full dmidecode log is at https://pastebin.com/M3MAJtUG
> > > > >
> > > >
> > > > OK please try this:
> > > >
> > > > diff --git a/drivers/firmware/efi/libstub/arm64.c
> > > > b/drivers/firmware/efi/libstub/arm64.c
> > > > index ff2d18c42ee74979..fae930dec82be7c6 100644
> > > > --- a/drivers/firmware/efi/libstub/arm64.c
> > > > +++ b/drivers/firmware/efi/libstub/arm64.c
> > > > @@ -22,7 +22,8 @@ static bool system_needs_vamap(void)
> > > >          * Ampere Altra machines crash in SetTime() if
> > > > SetVirtualAddressMap()
> > > >          * has not been called prior.
> > > >          */
> > > > -       if (!type1_family || strcmp(type1_family, "Altra"))
> > > > +       if (!type1_family ||
> > > > +           (strcmp(type1_family, "Altra") && strcmp(type1_family,
> > > > + "eMAG")))
> > > >                 return false;
> > > >
> > > >         efi_warn("Working around broken SetVirtualAddressMap()\n");
> > >
> > > Yes, it works on my eMAG server: the kernel boots.
> > > Other than efibootmgr failure. But I noticed this efibootmgr failure
> > > even before Commit d3549a938b7 ("avoid SetVirtualAddressMap() when
> > > possible ")
> > >
> > > root@:~/linux# efibootmgr -t 9; efibootmgr -t 5; Could not set
> > > Timeout: Input/output error Could not set Timeout: Input/output error
> > >
> >
> > Do you get any [Firmware Bug] lines in the kernel log?
>
> No,
> I built the kernel based on:
> commit d2d11f342b179f1894a901f143ec7c008caba43e (HEAD -> master, origin/master, origin/HEAD)
> Author: Linus Torvalds <torvalds@linux-foundation.org>
> Date:   Sun Feb 5 17:17:10 2023 -0800
>
>     Merge branch 'fixes' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs
>
> Are you worried about your sync exception fixup patch? I think it has been included.
>


I would just like to understand why setvariable is still broken for you.

RE: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Justin He]

Hi Ard

> -----Original Message-----
> From: Ard Biesheuvel <ardb@kernel.org>
> Sent: Tuesday, February 7, 2023 5:09 PM
> To: Justin He <Justin.He@arm.com>
> Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> linux-kernel@vger.kernel.org; Alexandru Elisei <Alexandru.Elisei@arm.com>;
> Jason A. Donenfeld <Jason@zx2c4.com>; nd <nd@arm.com>
> Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> 
> On Tue, 7 Feb 2023 at 10:08, Justin He <Justin.He@arm.com> wrote:
> >
> >
> >
> > > -----Original Message-----
> > > From: Ard Biesheuvel <ardb@kernel.org>
> > > Sent: Tuesday, February 7, 2023 5:04 PM
> > > To: Justin He <Justin.He@arm.com>
> > > Cc: Huacai Chen <chenhuacai@kernel.org>; linux-efi@vger.kernel.org;
> > > linux-kernel@vger.kernel.org; Alexandru Elisei
> > > <Alexandru.Elisei@arm.com>; Jason A. Donenfeld <Jason@zx2c4.com>; nd
> > > <nd@arm.com>
> > > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server
> > >
> > > On Tue, 7 Feb 2023 at 10:03, Justin He <Justin.He@arm.com> wrote:
> > > >
> > > > Hi Ard
> > > >
> > > > > -----Original Message-----
> > > > > From: Ard Biesheuvel <ardb@kernel.org>
> > > > > Sent: Tuesday, February 7, 2023 4:54 PM
> > > > > To: Justin He <Justin.He@arm.com>
> > > > > Cc: Huacai Chen <chenhuacai@kernel.org>;
> > > > > linux-efi@vger.kernel.org; linux-kernel@vger.kernel.org;
> > > > > Alexandru Elisei <Alexandru.Elisei@arm.com>; Jason A. Donenfeld
> > > > > <Jason@zx2c4.com>; nd <nd@arm.com>
> > > > > Subject: Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag
> > > > > server
> > > > >
> > > > > On Tue, 7 Feb 2023 at 09:49, Justin He <Justin.He@arm.com> wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > > > -----Original Message-----
> > > > > > [..]
> > > > > > > > The root cause of the hung IMO might be similar to commit
> > > > > > > > 550b33cfd445296868a478e8413ffb2e963eed32
> > > > > > > > Author: Ard Biesheuvel <ardb@kernel.org>
> > > > > > > > Date:   Thu Nov 10 10:36:20 2022 +0100
> > > > > > > >
> > > > > > > >     arm64: efi: Force the use of SetVirtualAddressMap() on
> > > > > > > > Altra machines
> > > > > > > >
> > > > > > > > Do you agree with the idea if I add Ampere ”eMAG” machine
> > > > > > > > into the list of Using SetVirtualAddressMap() forcibly?
> > > > > > > >
> > > > > > > > Please note that even in previous kernel patch, the
> > > > > > > > efibootmgr -t
> > > > > > > > 10 will make kernel hung if I passed "efi=novamap" to the
> > > > > > > > boot
> > > > > parameter.
> > > > > > > >
> > > > > > >
> > > > > > > Interesting. What does dmidecode return for the family in
> > > > > > > the type 1
> > > > > record?
> > > > > >
> > > > > > # dmidecode |grep -i family
> > > > > >         Family: eMAG
> > > > > >         Family: ARMv8
> > > > > >
> > > > > > The full dmidecode log is at https://pastebin.com/M3MAJtUG
> > > > > >
> > > > >
> > > > > OK please try this:
> > > > >
> > > > > diff --git a/drivers/firmware/efi/libstub/arm64.c
> > > > > b/drivers/firmware/efi/libstub/arm64.c
> > > > > index ff2d18c42ee74979..fae930dec82be7c6 100644
> > > > > --- a/drivers/firmware/efi/libstub/arm64.c
> > > > > +++ b/drivers/firmware/efi/libstub/arm64.c
> > > > > @@ -22,7 +22,8 @@ static bool system_needs_vamap(void)
> > > > >          * Ampere Altra machines crash in SetTime() if
> > > > > SetVirtualAddressMap()
> > > > >          * has not been called prior.
> > > > >          */
> > > > > -       if (!type1_family || strcmp(type1_family, "Altra"))
> > > > > +       if (!type1_family ||
> > > > > +           (strcmp(type1_family, "Altra") &&
> > > > > + strcmp(type1_family,
> > > > > + "eMAG")))
> > > > >                 return false;
> > > > >
> > > > >         efi_warn("Working around broken
> > > > > SetVirtualAddressMap()\n");
> > > >
> > > > Yes, it works on my eMAG server: the kernel boots.
> > > > Other than efibootmgr failure. But I noticed this efibootmgr
> > > > failure even before Commit d3549a938b7 ("avoid
> > > > SetVirtualAddressMap() when possible ")
> > > >
> > > > root@:~/linux# efibootmgr -t 9; efibootmgr -t 5; Could not set
> > > > Timeout: Input/output error Could not set Timeout: Input/output
> > > > error
> > > >
> > >
> > > Do you get any [Firmware Bug] lines in the kernel log?
> >
> > No,
> > I built the kernel based on:
> > commit d2d11f342b179f1894a901f143ec7c008caba43e (HEAD -> master,
> > origin/master, origin/HEAD)
> > Author: Linus Torvalds <torvalds@linux-foundation.org>
> > Date:   Sun Feb 5 17:17:10 2023 -0800
> >
> >     Merge branch 'fixes' of
> > git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs
> >
> > Are you worried about your sync exception fixup patch? I think it has been
> included.
> >
> 
> 
> I would just like to understand why setvariable is still broken for you.

On an Ampere *Altra* server, the family name seems to not follow your purpose of invoking efi_get_smbios_string(1, family).

dmidecode |grep -i family -C 10

Handle 0x0001, DMI type 1, 27 bytes
System Information
        Manufacturer: GIGABYTE
        Product Name: R272-P30-00
        Version: 0100
        Serial Number: TS2035812A0022
        UUID: 00000000-0000-4000-8000-B42E99AFEF62
        Wake-up Type: Power Switch
        SKU Number: 01234567890123456789AB
        Family: Server

The full dmidecode info of Altra is at
https://pastebin.com/HQLE1yYv

--
Cheers,
Justin (Jia He)

Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Jason A. Donenfeld]

On Tue, Jan 31, 2023 at 08:18:49AM +0100, Ard Biesheuvel wrote:
> (cc Jason for awareness)
> 
> On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
> >
> > I met a hung task warning and then kernel was hung forever with latest
> > kernel on an Ampere Emag server.
> >
> > The root cause is kernel was hung  when invoking an efi rts call to set
> > the RandomSeed variable during the booting stage. The arch_efi_call_virt
> > call (set_variable) was never returned and then caused the hung task error.
> >
> 
> Given that EFI variables work on this platform (as far as I know), the
> problem may be that we are calling SetVariable() too early.
> 

On my phone and with very limited connectivity for another 10 days, but
I wonder if there's a later place we could move this block:

    if (efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE))
        execute_with_initialized_rng(&refresh_nv_rng_seed_nb);

Is there any additional initialization that happens after
efisubsys_init() that we're maybe missing out on there?

Jason

Re: [PATCH 0/2] Fix boot hang issue on Ampere Emag server

[Jason A. Donenfeld]

Actually...

On Tue, Jan 31, 2023 at 07:03:12PM +0100, Jason A. Donenfeld wrote:
> On Tue, Jan 31, 2023 at 08:18:49AM +0100, Ard Biesheuvel wrote:
> > (cc Jason for awareness)
> > 
> > On Tue, 31 Jan 2023 at 05:04, Jia He <justin.he@arm.com> wrote:
> > >
> > > I met a hung task warning and then kernel was hung forever with latest
> > > kernel on an Ampere Emag server.
> > >
> > > The root cause is kernel was hung  when invoking an efi rts call to set
> > > the RandomSeed variable during the booting stage. The arch_efi_call_virt
> > > call (set_variable) was never returned and then caused the hung task error.
> > >
> > 
> > Given that EFI variables work on this platform (as far as I know), the
> > problem may be that we are calling SetVariable() too early.
> > 
> 
> On my phone and with very limited connectivity for another 10 days, but
> I wonder if there's a later place we could move this block:
> 
>     if (efi_rt_services_supported(EFI_RT_SUPPORTED_SET_VARIABLE))
>         execute_with_initialized_rng(&refresh_nv_rng_seed_nb);
> 
> Is there any additional initialization that happens after
> efisubsys_init() that we're maybe missing out on there?

From Jia's dmesg:

[   14.209389][    C2] random: crng init done

So SetVariable isn't even being called until 14 seconds after boot. That
suggests there's something else wrong here. I wonder how it is that
efibootmgr works, but this does not... Hm?

Jason