All of lore.kernel.org
 help / color / mirror / Atom feed
* c522ad0637: kernel hang in boot stage
@ 2019-07-09  6:44 kernel test robot
  2019-07-09 17:53 ` Schmauss, Erik
  0 siblings, 1 reply; 8+ messages in thread
From: kernel test robot @ 2019-07-09  6:44 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 4210 bytes --]

FYI, we noticed the following commit (built with gcc-7):

commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA: Update table load object initialization")
https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git  master

in testcase: fio
with following parameters:

	runtime: 300s
         disk: 1SSD
         fs: ext4
         nr_task: 1
         test_size: 128G
         rw: write
         bs: 4k
         ioengine: sync
         direct: direct

test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
test-url:https://github.com/axboe/fio



on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory

caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):

[    5.408282] smp: Brought up 2 nodes, 72 CPUs
[    5.409283] smpboot: Max logical packages: 2
[    5.410282] smpboot: Total of 72 processors activated (331375.89 BogoMIPS)
[    5.605290] node 0 initialised, 15956993 pages in 192ms
[    5.611291] node 1 initialised, 16343433 pages in 198ms
[    5.621060] devtmpfs: initialized
[    5.621340] x86/mm: Memory block size: 2048MB
[    5.622967] PM: Registering ACPI NVS region [mem 0x6b521000-0x6bf50fff] (10682368 bytes)
[    5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    5.624357] futex hash table entries: 32768 (order: 9, 2097152 bytes)
[    5.626618] pinctrl core: initialized pinctrl subsystem
[    5.627368] PM: RTC time: 06:13:50, date: 2019-07-09
[    5.628697] NET: Registered protocol family 16
[    5.629457] audit: initializing netlink subsys (disabled)
[    5.630299] audit: type=2000 audit(1562652826.903:1): state=initialized audit_enabled=0 res=1
[    5.638286] cpuidle: using governor menu
[    5.642292] Detected 1 PCC Subspaces
[    5.646314] Registering PCC driver as Mailbox controller
[    5.651409] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    5.659283] ACPI: bus type PCI registered
[    5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[    5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[    5.680293] PCI: Using configuration type 1 for base access
[    5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    5.702283] ACPI: Added _OSI(Module Device)
[    5.706285] ACPI: Added _OSI(Processor Device)
[    5.710282] ACPI: Added _OSI(3.0 _SCP Extensions)
[    5.715281] ACPI: Added _OSI(Processor Aggregator Device)
[    5.720282] ACPI: Added _OSI(Linux-Dell-Video)
[    5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    5.776862] ACPI: 4 ACPI AML tables successfully acquired and loaded
[    5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    5.809488] ACPI: Dynamic OEM Table Load:
IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot
Primary Bios Version: SE5C620.86B.00.01.0014.070920180847
Backup Bios Version: SE5C620.86B.00.01.0014.070920180847
System is booting from BIOS Primary Area!
BMC Firmware Version: 1.60.56383BEF
SDR Version: SDR Package 1.60
ME Firmware Version: 04.00.04.340
Platform ID: S2600WF
System memory detected: 131072 MB
Current memory speed: 2666 MT/s
Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz
Number of physical processors identified: 2
AHCI Capable Controller 1 enabling 8 ports of 6Gb/s SATA
AHCI Capable Controller 2 enabling 6 ports of 6Gb/s SATA

USB Keyboard detected
USB Mouse detected

BMC BaseBoard IP Address 1 : 192.168.3.35
BMC BaseBoard IP Address 2 : 192.168.3.35
BMC Dedicated NIC IP Address : 192.168.3.36


           Press [Enter] to directly boot.
           Press [F2]    to enter setup and select boot options.
           Press [F6]    to show boot menu options.
           Press [F12]   to boot from network.

Best Regards,
Rong Chen


[-- Attachment #2: job-script.ksh --]
[-- Type: text/plain, Size: 7694 bytes --]

#!/bin/sh

export_top_env()
{
	export suite='fio-basic'
	export testcase='fio-basic'
	export category='benchmark'
	export runtime=300
	export nr_task=1
	export test_size='128G'
	export job_origin='/lkp/lkp/.src-20190704-134728/allot/cyclic:p1:linux-devel:devel-hourly/lkp-skl-2sp6/fio-basic-1ssd-write.yaml'
	export queue_cmdline_keys=
	export queue='vip'
	export testbox='lkp-skl-2sp6'
	export tbox_group='lkp-skl-2sp6'
	export submit_id='5d242efc0b9a93fa43b65516'
	export job_file='/lkp/jobs/scheduled/lkp-skl-2sp6/fio-basic-4k-performance-direct-1SSD-ext4-sync-1-300s-write-128G-ucod-20190709-64067-90kn4s-0.yaml'
	export id='5cf63152fc9c289db0160b42e42dd7abd25b04d2'
	export queuer_version='/lkp/lkp/.src-20190709-120259'
	export arch='x86_64'
	export need_kconfig='CONFIG_BLK_DEV_SD
CONFIG_SCSI
CONFIG_BLOCK=y
CONFIG_SATA_AHCI
CONFIG_SATA_AHCI_PLATFORM
CONFIG_ATA
CONFIG_PCI=y
CONFIG_EXT4_FS'
	export commit='c522ad0637cacca1775a3849c2b554f46577b98d'
	export ucode='0x200005e'
	export rootfs='debian-x86_64-2019-05-14.cgz'
	export kconfig='x86_64-rhel-7.6'
	export compiler='gcc-7'
	export enqueue_time='2019-07-09 14:06:53 +0800'
	export _id='5d242efc0b9a93fa43b65516'
	export _rt='/result/fio-basic/4k-performance-direct-1SSD-ext4-sync-1-300s-write-128G-ucode=0x200005e/lkp-skl-2sp6/debian-x86_64-2019-05-14.cgz/x86_64-rhel-7.6/gcc-7/c522ad0637cacca1775a3849c2b554f46577b98d'
	export user='lkp'
	export head_commit='dc590a28c45009adccf5382aac6aa0da553e384a'
	export base_commit='6fbc7275c7a9ba97877050335f290341a1fd8dbf'
	export branch='linux-next/master'
	export result_root='/result/fio-basic/4k-performance-direct-1SSD-ext4-sync-1-300s-write-128G-ucode=0x200005e/lkp-skl-2sp6/debian-x86_64-2019-05-14.cgz/x86_64-rhel-7.6/gcc-7/c522ad0637cacca1775a3849c2b554f46577b98d/0'
	export scheduler_version='/lkp/lkp/.src-20190709-120259'
	export LKP_SERVER='inn'
	export max_uptime=1500
	export initrd='/osimage/debian/debian-x86_64-2019-05-14.cgz'
	export bootloader_append='root=/dev/ram0
user=lkp
job=/lkp/jobs/scheduled/lkp-skl-2sp6/fio-basic-4k-performance-direct-1SSD-ext4-sync-1-300s-write-128G-ucod-20190709-64067-90kn4s-0.yaml
ARCH=x86_64
kconfig=x86_64-rhel-7.6
branch=linux-next/master
commit=c522ad0637cacca1775a3849c2b554f46577b98d
BOOT_IMAGE=/pkg/linux/x86_64-rhel-7.6/gcc-7/c522ad0637cacca1775a3849c2b554f46577b98d/vmlinuz-5.2.0-rc5-00008-gc522ad0637cac
max_uptime=1500
RESULT_ROOT=/result/fio-basic/4k-performance-direct-1SSD-ext4-sync-1-300s-write-128G-ucode=0x200005e/lkp-skl-2sp6/debian-x86_64-2019-05-14.cgz/x86_64-rhel-7.6/gcc-7/c522ad0637cacca1775a3849c2b554f46577b98d/0
LKP_SERVER=inn
debug
apic=debug
sysrq_always_enabled
rcupdate.rcu_cpu_stall_timeout=100
net.ifnames=0
printk.devkmsg=on
panic=-1
softlockup_panic=1
nmi_watchdog=panic
oops=panic
load_ramdisk=2
prompt_ramdisk=0
drbd.minor_count=8
systemd.log_level=err
ignore_loglevel
console=tty0
earlyprintk=ttyS0,115200
console=ttyS0,115200
vga=normal
rw'
	export modules_initrd='/pkg/linux/x86_64-rhel-7.6/gcc-7/c522ad0637cacca1775a3849c2b554f46577b98d/modules.cgz'
	export bm_initrd='/osimage/deps/debian-x86_64-2018-04-03.cgz/run-ipconfig_2018-04-03.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/lkp_2019-06-26.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/rsync-rootfs_2018-04-03.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/fs_2019-07-03.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/fio_2019-07-03.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/mpstat_2019-06-26.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/vmstat_2019-05-05.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/turbostat_2019-04-29.cgz,/osimage/pkg/debian-x86_64-2018-04-03.cgz/turbostat-x86_64-d5256b2_2019-06-26.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/perf_2019-06-26.cgz,/osimage/pkg/debian-x86_64-2018-04-03.cgz/perf-x86_64-0ecfebd2b524_2019-07-09.cgz,/osimage/pkg/debian-x86_64-2018-04-03.cgz/mpstat-x86_64-git-1_2019-04-29.cgz,/osimage/deps/debian-x86_64-2018-04-03.cgz/hw_2019-07-04.cgz'
	export lkp_initrd='/lkp/lkp/lkp-x86_64.cgz'
	export site='inn'
	export LKP_CGI_PORT=80
	export LKP_CIFS_PORT=139
	export schedule_notify_address=
	export model='Skylake-SP'
	export nr_node=2
	export nr_cpu=72
	export memory='128G'
	export nr_ssd_partitions=
	export ssd_partitions='/dev/disk/by-id/ata-INTEL_SSDSC2CW240A3_CVCV24050155240CGN-part1'
	export swap_partitions='LABEL=SWAP'
	export rootfs_partition='LABEL=LKP-ROOTFS'
	export brand='Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz'
	export kernel='/pkg/linux/x86_64-rhel-7.6/gcc-7/c522ad0637cacca1775a3849c2b554f46577b98d/vmlinuz-5.2.0-rc5-00008-gc522ad0637cac'
	export dequeue_time='2019-07-09 14:17:46 +0800'
	export job_initrd='/lkp/jobs/scheduled/lkp-skl-2sp6/fio-basic-4k-performance-direct-1SSD-ext4-sync-1-300s-write-128G-ucod-20190709-64067-90kn4s-0.cgz'

	[ -n "$LKP_SRC" ] ||
	export LKP_SRC=/lkp/${user:-lkp}/src
}

run_job()
{
	echo $$ > $TMP/run-job.pid

	. $LKP_SRC/lib/http.sh
	. $LKP_SRC/lib/job.sh
	. $LKP_SRC/lib/env.sh

	export_top_env

	run_setup nr_ssd=1 $LKP_SRC/setup/disk

	run_setup fs='ext4' $LKP_SRC/setup/fs

	run_setup rw='write' bs='4k' ioengine='sync' direct='direct' $LKP_SRC/setup/fio-setup-basic

	run_setup $LKP_SRC/setup/cpufreq_governor 'performance'

	run_monitor $LKP_SRC/monitors/wrapper kmsg
	run_monitor $LKP_SRC/monitors/no-stdout/wrapper boot-time
	run_monitor $LKP_SRC/monitors/wrapper iostat
	run_monitor $LKP_SRC/monitors/wrapper heartbeat
	run_monitor $LKP_SRC/monitors/wrapper vmstat
	run_monitor $LKP_SRC/monitors/wrapper numa-numastat
	run_monitor $LKP_SRC/monitors/wrapper numa-vmstat
	run_monitor $LKP_SRC/monitors/wrapper numa-meminfo
	run_monitor $LKP_SRC/monitors/wrapper proc-vmstat
	run_monitor $LKP_SRC/monitors/wrapper proc-stat
	run_monitor $LKP_SRC/monitors/wrapper meminfo
	run_monitor $LKP_SRC/monitors/wrapper slabinfo
	run_monitor $LKP_SRC/monitors/wrapper interrupts
	run_monitor $LKP_SRC/monitors/wrapper lock_stat
	run_monitor $LKP_SRC/monitors/wrapper latency_stats
	run_monitor $LKP_SRC/monitors/wrapper softirqs
	run_monitor $LKP_SRC/monitors/one-shot/wrapper bdi_dev_mapping
	run_monitor $LKP_SRC/monitors/wrapper diskstats
	run_monitor $LKP_SRC/monitors/wrapper nfsstat
	run_monitor $LKP_SRC/monitors/wrapper cpuidle
	run_monitor $LKP_SRC/monitors/wrapper cpufreq-stats
	run_monitor $LKP_SRC/monitors/wrapper turbostat
	run_monitor $LKP_SRC/monitors/wrapper sched_debug
	run_monitor $LKP_SRC/monitors/wrapper perf-stat
	run_monitor $LKP_SRC/monitors/wrapper mpstat
	run_monitor $LKP_SRC/monitors/no-stdout/wrapper perf-profile
	run_monitor $LKP_SRC/monitors/wrapper oom-killer
	run_monitor $LKP_SRC/monitors/plain/watchdog

	run_test $LKP_SRC/tests/wrapper fio
}

extract_stats()
{
	export stats_part_begin=
	export stats_part_end=

	$LKP_SRC/stats/wrapper fio
	$LKP_SRC/stats/wrapper kmsg
	$LKP_SRC/stats/wrapper boot-time
	$LKP_SRC/stats/wrapper iostat
	$LKP_SRC/stats/wrapper vmstat
	$LKP_SRC/stats/wrapper numa-numastat
	$LKP_SRC/stats/wrapper numa-vmstat
	$LKP_SRC/stats/wrapper numa-meminfo
	$LKP_SRC/stats/wrapper proc-vmstat
	$LKP_SRC/stats/wrapper meminfo
	$LKP_SRC/stats/wrapper slabinfo
	$LKP_SRC/stats/wrapper interrupts
	$LKP_SRC/stats/wrapper lock_stat
	$LKP_SRC/stats/wrapper latency_stats
	$LKP_SRC/stats/wrapper softirqs
	$LKP_SRC/stats/wrapper diskstats
	$LKP_SRC/stats/wrapper nfsstat
	$LKP_SRC/stats/wrapper cpuidle
	$LKP_SRC/stats/wrapper turbostat
	$LKP_SRC/stats/wrapper sched_debug
	$LKP_SRC/stats/wrapper perf-stat
	$LKP_SRC/stats/wrapper mpstat
	$LKP_SRC/stats/wrapper perf-profile

	$LKP_SRC/stats/wrapper time fio.time
	$LKP_SRC/stats/wrapper dmesg
	$LKP_SRC/stats/wrapper kmsg
	$LKP_SRC/stats/wrapper last_state
	$LKP_SRC/stats/wrapper stderr
	$LKP_SRC/stats/wrapper time
}

"$@"

[-- Attachment #3: dmesg.xz --]
[-- Type: application/x-xz, Size: 9192 bytes --]

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: c522ad0637: kernel hang in boot stage
  2019-07-09  6:44 c522ad0637: kernel hang in boot stage kernel test robot
@ 2019-07-09 17:53 ` Schmauss, Erik
  2019-07-10 11:56   ` Chen, Rong A
  0 siblings, 1 reply; 8+ messages in thread
From: Schmauss, Erik @ 2019-07-09 17:53 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 4855 bytes --]

Can you give us more information? Which function does it hang on?

Is this reproducible on every boot?

Thanks,
Erik

> -----Original Message-----
> From: Chen, Rong A
> Sent: Monday, July 8, 2019 11:45 PM
> To: Schmauss, Erik <erik.schmauss@intel.com>
> Cc: Moore, Robert <robert.moore@intel.com>; Wysocki, Rafael J
> <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>
> Subject: c522ad0637: kernel hang in boot stage
> 
> FYI, we noticed the following commit (built with gcc-7):
> 
> commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA: Update
> table load object initialization")
> https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git
> master
> 
> in testcase: fio
> with following parameters:
> 
> 	runtime: 300s
>          disk: 1SSD
>          fs: ext4
>          nr_task: 1
>          test_size: 128G
>          rw: write
>          bs: 4k
>          ioengine: sync
>          direct: direct
> 
> test-description: Fio is a tool that will spawn a number of threads or processes
> doing a particular type of I/O action as specified by the user.
> test-url:https://github.com/axboe/fio
> 
> 
> 
> on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G
> memory
> 
> caused below changes (please refer to attached dmesg/kmsg for entire
> log/backtrace):
> 
> [    5.408282] smp: Brought up 2 nodes, 72 CPUs
> [    5.409283] smpboot: Max logical packages: 2
> [    5.410282] smpboot: Total of 72 processors activated (331375.89 BogoMIPS)
> [    5.605290] node 0 initialised, 15956993 pages in 192ms
> [    5.611291] node 1 initialised, 16343433 pages in 198ms
> [    5.621060] devtmpfs: initialized
> [    5.621340] x86/mm: Memory block size: 2048MB
> [    5.622967] PM: Registering ACPI NVS region [mem 0x6b521000-0x6bf50fff]
> (10682368 bytes)
> [    5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff,
> max_idle_ns: 1911260446275000 ns
> [    5.624357] futex hash table entries: 32768 (order: 9, 2097152 bytes)
> [    5.626618] pinctrl core: initialized pinctrl subsystem
> [    5.627368] PM: RTC time: 06:13:50, date: 2019-07-09
> [    5.628697] NET: Registered protocol family 16
> [    5.629457] audit: initializing netlink subsys (disabled)
> [    5.630299] audit: type=2000 audit(1562652826.903:1): state=initialized
> audit_enabled=0 res=1
> [    5.638286] cpuidle: using governor menu
> [    5.642292] Detected 1 PCC Subspaces
> [    5.646314] Registering PCC driver as Mailbox controller
> [    5.651409] ACPI FADT declares the system doesn't support PCIe ASPM, so
> disable it
> [    5.659283] ACPI: bus type PCI registered
> [    5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
> [    5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
> 0x80000000-0x8fffffff] (base 0x80000000)
> [    5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in
> E820
> [    5.680293] PCI: Using configuration type 1 for base access
> [    5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
> [    5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
> [    5.702283] ACPI: Added _OSI(Module Device)
> [    5.706285] ACPI: Added _OSI(Processor Device)
> [    5.710282] ACPI: Added _OSI(3.0 _SCP Extensions)
> [    5.715281] ACPI: Added _OSI(Processor Aggregator Device)
> [    5.720282] ACPI: Added _OSI(Linux-Dell-Video)
> [    5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
> [    5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
> [    5.776862] ACPI: 4 ACPI AML tables successfully acquired and loaded
> [    5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
> [    5.809488] ACPI: Dynamic OEM Table Load:
> IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot
> Primary Bios Version: SE5C620.86B.00.01.0014.070920180847
> Backup Bios Version: SE5C620.86B.00.01.0014.070920180847
> System is booting from BIOS Primary Area!
> BMC Firmware Version: 1.60.56383BEF
> SDR Version: SDR Package 1.60
> ME Firmware Version: 04.00.04.340
> Platform ID: S2600WF
> System memory detected: 131072 MB
> Current memory speed: 2666 MT/s
> Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz Number of physical processors
> identified: 2 AHCI Capable Controller 1 enabling 8 ports of 6Gb/s SATA AHCI
> Capable Controller 2 enabling 6 ports of 6Gb/s SATA
> 
> USB Keyboard detected
> USB Mouse detected
> 
> BMC BaseBoard IP Address 1 : 192.168.3.35 BMC BaseBoard IP Address 2 :
> 192.168.3.35 BMC Dedicated NIC IP Address : 192.168.3.36
> 
> 
>            Press [Enter] to directly boot.
>            Press [F2]    to enter setup and select boot options.
>            Press [F6]    to show boot menu options.
>            Press [F12]   to boot from network.
> 
> Best Regards,
> Rong Chen


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: c522ad0637: kernel hang in boot stage
  2019-07-09 17:53 ` Schmauss, Erik
@ 2019-07-10 11:56   ` Chen, Rong A
  2019-07-10 12:11     ` Chen, Rong A
  0 siblings, 1 reply; 8+ messages in thread
From: Chen, Rong A @ 2019-07-10 11:56 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 6481 bytes --]

Hi Erik,

On 7/10/2019 1:53 AM, Schmauss, Erik wrote:
> Can you give us more information? Which function does it hang on?

It seems the below changes causes the issue.

diff --git a/drivers/acpi/acpica/tbxfload.c b/drivers/acpi/acpica/tbxfload.c
index ef8f8a9f3c9c5..86f1693f6d29a 100644
--- a/drivers/acpi/acpica/tbxfload.c
+++ b/drivers/acpi/acpica/tbxfload.c
@@ -297,15 +297,11 @@ acpi_status acpi_load_table(struct 
acpi_table_header *table)
         status = 
acpi_tb_install_and_load_table(ACPI_PTR_TO_PHYSADDR(table),
ACPI_TABLE_ORIGIN_EXTERNAL_VIRTUAL,
                                                 FALSE, &table_index);
-
         if (ACPI_SUCCESS(status)) {
-               /* Complete the initialization/resolution of package 
objects */

-               status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
-                                               ACPI_ROOT_OBJECT,
-                                               ACPI_UINT32_MAX, 0,
- acpi_ns_init_one_package,
-                                               NULL, NULL, NULL);
+               /* Complete the initialization/resolution of new objects */
+
+               acpi_ns_initialize_objects();
         }

         return_ACPI_STATUS(status);


>
> Is this reproducible on every boot?

yes, it always.

Best Regards,
Rong Chen


>
> Thanks,
> Erik
>
>> -----Original Message-----
>> From: Chen, Rong A
>> Sent: Monday, July 8, 2019 11:45 PM
>> To: Schmauss, Erik <erik.schmauss@intel.com>
>> Cc: Moore, Robert <robert.moore@intel.com>; Wysocki, Rafael J
>> <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>
>> Subject: c522ad0637: kernel hang in boot stage
>>
>> FYI, we noticed the following commit (built with gcc-7):
>>
>> commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA: Update
>> table load object initialization")
>> https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git
>> master
>>
>> in testcase: fio
>> with following parameters:
>>
>> 	runtime: 300s
>>           disk: 1SSD
>>           fs: ext4
>>           nr_task: 1
>>           test_size: 128G
>>           rw: write
>>           bs: 4k
>>           ioengine: sync
>>           direct: direct
>>
>> test-description: Fio is a tool that will spawn a number of threads or processes
>> doing a particular type of I/O action as specified by the user.
>> test-url:https://github.com/axboe/fio
>>
>>
>>
>> on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G
>> memory
>>
>> caused below changes (please refer to attached dmesg/kmsg for entire
>> log/backtrace):
>>
>> [    5.408282] smp: Brought up 2 nodes, 72 CPUs
>> [    5.409283] smpboot: Max logical packages: 2
>> [    5.410282] smpboot: Total of 72 processors activated (331375.89 BogoMIPS)
>> [    5.605290] node 0 initialised, 15956993 pages in 192ms
>> [    5.611291] node 1 initialised, 16343433 pages in 198ms
>> [    5.621060] devtmpfs: initialized
>> [    5.621340] x86/mm: Memory block size: 2048MB
>> [    5.622967] PM: Registering ACPI NVS region [mem 0x6b521000-0x6bf50fff]
>> (10682368 bytes)
>> [    5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff,
>> max_idle_ns: 1911260446275000 ns
>> [    5.624357] futex hash table entries: 32768 (order: 9, 2097152 bytes)
>> [    5.626618] pinctrl core: initialized pinctrl subsystem
>> [    5.627368] PM: RTC time: 06:13:50, date: 2019-07-09
>> [    5.628697] NET: Registered protocol family 16
>> [    5.629457] audit: initializing netlink subsys (disabled)
>> [    5.630299] audit: type=2000 audit(1562652826.903:1): state=initialized
>> audit_enabled=0 res=1
>> [    5.638286] cpuidle: using governor menu
>> [    5.642292] Detected 1 PCC Subspaces
>> [    5.646314] Registering PCC driver as Mailbox controller
>> [    5.651409] ACPI FADT declares the system doesn't support PCIe ASPM, so
>> disable it
>> [    5.659283] ACPI: bus type PCI registered
>> [    5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
>> [    5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
>> 0x80000000-0x8fffffff] (base 0x80000000)
>> [    5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in
>> E820
>> [    5.680293] PCI: Using configuration type 1 for base access
>> [    5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
>> [    5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
>> [    5.702283] ACPI: Added _OSI(Module Device)
>> [    5.706285] ACPI: Added _OSI(Processor Device)
>> [    5.710282] ACPI: Added _OSI(3.0 _SCP Extensions)
>> [    5.715281] ACPI: Added _OSI(Processor Aggregator Device)
>> [    5.720282] ACPI: Added _OSI(Linux-Dell-Video)
>> [    5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
>> [    5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
>> [    5.776862] ACPI: 4 ACPI AML tables successfully acquired and loaded
>> [    5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
>> [    5.809488] ACPI: Dynamic OEM Table Load:
>> IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot
>> Primary Bios Version: SE5C620.86B.00.01.0014.070920180847
>> Backup Bios Version: SE5C620.86B.00.01.0014.070920180847
>> System is booting from BIOS Primary Area!
>> BMC Firmware Version: 1.60.56383BEF
>> SDR Version: SDR Package 1.60
>> ME Firmware Version: 04.00.04.340
>> Platform ID: S2600WF
>> System memory detected: 131072 MB
>> Current memory speed: 2666 MT/s
>> Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz Number of physical processors
>> identified: 2 AHCI Capable Controller 1 enabling 8 ports of 6Gb/s SATA AHCI
>> Capable Controller 2 enabling 6 ports of 6Gb/s SATA
>>
>> USB Keyboard detected
>> USB Mouse detected
>>
>> BMC BaseBoard IP Address 1 : 192.168.3.35 BMC BaseBoard IP Address 2 :
>> 192.168.3.35 BMC Dedicated NIC IP Address : 192.168.3.36
>>
>>
>>             Press [Enter] to directly boot.
>>             Press [F2]    to enter setup and select boot options.
>>             Press [F6]    to show boot menu options.
>>             Press [F12]   to boot from network.
>>
>> Best Regards,
>> Rong Chen

^ permalink raw reply related	[flat|nested] 8+ messages in thread

* Re: c522ad0637: kernel hang in boot stage
  2019-07-10 11:56   ` Chen, Rong A
@ 2019-07-10 12:11     ` Chen, Rong A
  2019-07-10 21:59       ` Schmauss, Erik
  0 siblings, 1 reply; 8+ messages in thread
From: Chen, Rong A @ 2019-07-10 12:11 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 7843 bytes --]



On 7/10/2019 7:56 PM, Chen, Rong A wrote:
> Hi Erik,
>
> On 7/10/2019 1:53 AM, Schmauss, Erik wrote:
>> Can you give us more information? Which function does it hang on?
>
> It seems the below changes causes the issue.
>
...
Sorry, please ignore the previous conclusion.

I reverted drivers/acpi/acpica/tbxfload.c but the issue is still exist. 
so the problem part is another file:

diff --git a/drivers/acpi/acpica/exconfig.c b/drivers/acpi/acpica/exconfig.c
index 587aeeeb5070a..58c04d7067235 100644
--- a/drivers/acpi/acpica/exconfig.c
+++ b/drivers/acpi/acpica/exconfig.c
@@ -174,12 +174,9 @@ acpi_ex_load_table_op(struct acpi_walk_state 
*walk_state,
                 return_ACPI_STATUS(status);
         }

-       /* Complete the initialization/resolution of package objects */
+       /* Complete the initialization/resolution of new objects */

-       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE, ACPI_ROOT_OBJECT,
-                                       ACPI_UINT32_MAX, 0,
-                                       acpi_ns_init_one_package, NULL, 
NULL,
-                                       NULL);
+       acpi_ns_initialize_objects();

         /* Parameter Data (optional) */

@@ -437,12 +434,11 @@ acpi_ex_load_op(union acpi_operand_object *obj_desc,
                 return_ACPI_STATUS(status);
         }

-       /* Complete the initialization/resolution of package objects */
+       /* Complete the initialization/resolution of new objects */

-       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE, ACPI_ROOT_OBJECT,
-                                       ACPI_UINT32_MAX, 0,
-                                       acpi_ns_init_one_package, NULL, 
NULL,
-                                       NULL);
+       acpi_ex_exit_interpreter();
+       acpi_ns_initialize_objects();
+       acpi_ex_enter_interpreter();

         /* Store the ddb_handle into the Target operand */

>
>>
>> Is this reproducible on every boot?
>
> yes, it always.
>
> Best Regards,
> Rong Chen
>
>
>>
>> Thanks,
>> Erik
>>
>>> -----Original Message-----
>>> From: Chen, Rong A
>>> Sent: Monday, July 8, 2019 11:45 PM
>>> To: Schmauss, Erik <erik.schmauss@intel.com>
>>> Cc: Moore, Robert <robert.moore@intel.com>; Wysocki, Rafael J
>>> <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>
>>> Subject: c522ad0637: kernel hang in boot stage
>>>
>>> FYI, we noticed the following commit (built with gcc-7):
>>>
>>> commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA: Update
>>> table load object initialization")
>>> https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git 
>>>
>>> master
>>>
>>> in testcase: fio
>>> with following parameters:
>>>
>>>     runtime: 300s
>>>           disk: 1SSD
>>>           fs: ext4
>>>           nr_task: 1
>>>           test_size: 128G
>>>           rw: write
>>>           bs: 4k
>>>           ioengine: sync
>>>           direct: direct
>>>
>>> test-description: Fio is a tool that will spawn a number of threads 
>>> or processes
>>> doing a particular type of I/O action as specified by the user.
>>> test-url:https://github.com/axboe/fio
>>>
>>>
>>>
>>> on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G
>>> memory
>>>
>>> caused below changes (please refer to attached dmesg/kmsg for entire
>>> log/backtrace):
>>>
>>> [    5.408282] smp: Brought up 2 nodes, 72 CPUs
>>> [    5.409283] smpboot: Max logical packages: 2
>>> [    5.410282] smpboot: Total of 72 processors activated (331375.89 
>>> BogoMIPS)
>>> [    5.605290] node 0 initialised, 15956993 pages in 192ms
>>> [    5.611291] node 1 initialised, 16343433 pages in 198ms
>>> [    5.621060] devtmpfs: initialized
>>> [    5.621340] x86/mm: Memory block size: 2048MB
>>> [    5.622967] PM: Registering ACPI NVS region [mem 
>>> 0x6b521000-0x6bf50fff]
>>> (10682368 bytes)
>>> [    5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles: 
>>> 0xffffffff,
>>> max_idle_ns: 1911260446275000 ns
>>> [    5.624357] futex hash table entries: 32768 (order: 9, 2097152 
>>> bytes)
>>> [    5.626618] pinctrl core: initialized pinctrl subsystem
>>> [    5.627368] PM: RTC time: 06:13:50, date: 2019-07-09
>>> [    5.628697] NET: Registered protocol family 16
>>> [    5.629457] audit: initializing netlink subsys (disabled)
>>> [    5.630299] audit: type=2000 audit(1562652826.903:1): 
>>> state=initialized
>>> audit_enabled=0 res=1
>>> [    5.638286] cpuidle: using governor menu
>>> [    5.642292] Detected 1 PCC Subspaces
>>> [    5.646314] Registering PCC driver as Mailbox controller
>>> [    5.651409] ACPI FADT declares the system doesn't support PCIe 
>>> ASPM, so
>>> disable it
>>> [    5.659283] ACPI: bus type PCI registered
>>> [    5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version: 
>>> 0.5
>>> [    5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
>>> 0x80000000-0x8fffffff] (base 0x80000000)
>>> [    5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in
>>> E820
>>> [    5.680293] PCI: Using configuration type 1 for base access
>>> [    5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated 
>>> 0 pages
>>> [    5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated 
>>> 0 pages
>>> [    5.702283] ACPI: Added _OSI(Module Device)
>>> [    5.706285] ACPI: Added _OSI(Processor Device)
>>> [    5.710282] ACPI: Added _OSI(3.0 _SCP Extensions)
>>> [    5.715281] ACPI: Added _OSI(Processor Aggregator Device)
>>> [    5.720282] ACPI: Added _OSI(Linux-Dell-Video)
>>> [    5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
>>> [    5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
>>> [    5.776862] ACPI: 4 ACPI AML tables successfully acquired and loaded
>>> [    5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
>>> [    5.809488] ACPI: Dynamic OEM Table Load:
>>> IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot
>>> Primary Bios Version: SE5C620.86B.00.01.0014.070920180847
>>> Backup Bios Version: SE5C620.86B.00.01.0014.070920180847
>>> System is booting from BIOS Primary Area!
>>> BMC Firmware Version: 1.60.56383BEF
>>> SDR Version: SDR Package 1.60
>>> ME Firmware Version: 04.00.04.340
>>> Platform ID: S2600WF
>>> System memory detected: 131072 MB
>>> Current memory speed: 2666 MT/s
>>> Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz Number of physical processors
>>> identified: 2 AHCI Capable Controller 1 enabling 8 ports of 6Gb/s 
>>> SATA AHCI
>>> Capable Controller 2 enabling 6 ports of 6Gb/s SATA
>>>
>>> USB Keyboard detected
>>> USB Mouse detected
>>>
>>> BMC BaseBoard IP Address 1 : 192.168.3.35 BMC BaseBoard IP Address 2 :
>>> 192.168.3.35 BMC Dedicated NIC IP Address : 192.168.3.36
>>>
>>>
>>>             Press [Enter] to directly boot.
>>>             Press [F2]    to enter setup and select boot options.
>>>             Press [F6]    to show boot menu options.
>>>             Press [F12]   to boot from network.
>>>
>>> Best Regards,
>>> Rong Chen
> _______________________________________________
> LKP mailing list
> LKP(a)lists.01.org
> https://lists.01.org/mailman/listinfo/lkp


^ permalink raw reply related	[flat|nested] 8+ messages in thread

* Re: c522ad0637: kernel hang in boot stage
  2019-07-10 12:11     ` Chen, Rong A
@ 2019-07-10 21:59       ` Schmauss, Erik
  2019-07-11  5:19         ` Rong Chen
  0 siblings, 1 reply; 8+ messages in thread
From: Schmauss, Erik @ 2019-07-10 21:59 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 9163 bytes --]

Hi Rong,

Could you try the following patch on top of the kernel that has the hang?

Thanks,
Erik

diff --git a/drivers/acpi/acpica/exconfig.c b/drivers/acpi/acpica/exconfig.c
index 58c04d706723..46a8baf28bd0 100644
--- a/drivers/acpi/acpica/exconfig.c
+++ b/drivers/acpi/acpica/exconfig.c
@@ -176,7 +176,9 @@ acpi_ex_load_table_op(struct acpi_walk_state *walk_state,

        /* Complete the initialization/resolution of new objects */

+       acpi_ex_exit_interpreter();
        acpi_ns_initialize_objects();
+       acpi_ex_enter_interpreter();

        /* Parameter Data (optional) */

> -----Original Message-----
> From: Chen, Rong A
> Sent: Wednesday, July 10, 2019 5:12 AM
> To: Schmauss, Erik <erik.schmauss@intel.com>
> Cc: Wysocki, Rafael J <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>; Moore,
> Robert <robert.moore@intel.com>
> Subject: Re: [LKP] c522ad0637: kernel hang in boot stage
> 
> 
> 
> On 7/10/2019 7:56 PM, Chen, Rong A wrote:
> > Hi Erik,
> >
> > On 7/10/2019 1:53 AM, Schmauss, Erik wrote:
> >> Can you give us more information? Which function does it hang on?
> >
> > It seems the below changes causes the issue.
> >
> ...
> Sorry, please ignore the previous conclusion.
> 
> I reverted drivers/acpi/acpica/tbxfload.c but the issue is still exist.
> so the problem part is another file:
> 
> diff --git a/drivers/acpi/acpica/exconfig.c b/drivers/acpi/acpica/exconfig.c index
> 587aeeeb5070a..58c04d7067235 100644
> --- a/drivers/acpi/acpica/exconfig.c
> +++ b/drivers/acpi/acpica/exconfig.c
> @@ -174,12 +174,9 @@ acpi_ex_load_table_op(struct acpi_walk_state
> *walk_state,
>                  return_ACPI_STATUS(status);
>          }
> 
> -       /* Complete the initialization/resolution of package objects */
> +       /* Complete the initialization/resolution of new objects */
> 
> -       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
> ACPI_ROOT_OBJECT,
> -                                       ACPI_UINT32_MAX, 0,
> -                                       acpi_ns_init_one_package, NULL, NULL,
> -                                       NULL);
> +       acpi_ns_initialize_objects();
> 
>          /* Parameter Data (optional) */
> 
> @@ -437,12 +434,11 @@ acpi_ex_load_op(union acpi_operand_object
> *obj_desc,
>                  return_ACPI_STATUS(status);
>          }
> 
> -       /* Complete the initialization/resolution of package objects */
> +       /* Complete the initialization/resolution of new objects */
> 
> -       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
> ACPI_ROOT_OBJECT,
> -                                       ACPI_UINT32_MAX, 0,
> -                                       acpi_ns_init_one_package, NULL,
> NULL,
> -                                       NULL);
> +       acpi_ex_exit_interpreter();
> +       acpi_ns_initialize_objects();
> +       acpi_ex_enter_interpreter();
> 
>          /* Store the ddb_handle into the Target operand */
> 
> >
> >>
> >> Is this reproducible on every boot?
> >
> > yes, it always.
> >
> > Best Regards,
> > Rong Chen
> >
> >
> >>
> >> Thanks,
> >> Erik
> >>
> >>> -----Original Message-----
> >>> From: Chen, Rong A
> >>> Sent: Monday, July 8, 2019 11:45 PM
> >>> To: Schmauss, Erik <erik.schmauss@intel.com>
> >>> Cc: Moore, Robert <robert.moore@intel.com>; Wysocki, Rafael J
> >>> <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>
> >>> Subject: c522ad0637: kernel hang in boot stage
> >>>
> >>> FYI, we noticed the following commit (built with gcc-7):
> >>>
> >>> commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA:
> Update
> >>> table load object initialization")
> >>> https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-
> next.git
> >>>
> >>> master
> >>>
> >>> in testcase: fio
> >>> with following parameters:
> >>>
> >>>     runtime: 300s
> >>>           disk: 1SSD
> >>>           fs: ext4
> >>>           nr_task: 1
> >>>           test_size: 128G
> >>>           rw: write
> >>>           bs: 4k
> >>>           ioengine: sync
> >>>           direct: direct
> >>>
> >>> test-description: Fio is a tool that will spawn a number of threads
> >>> or processes
> >>> doing a particular type of I/O action as specified by the user.
> >>> test-url:https://github.com/axboe/fio
> >>>
> >>>
> >>>
> >>> on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G
> >>> memory
> >>>
> >>> caused below changes (please refer to attached dmesg/kmsg for entire
> >>> log/backtrace):
> >>>
> >>> [    5.408282] smp: Brought up 2 nodes, 72 CPUs
> >>> [    5.409283] smpboot: Max logical packages: 2
> >>> [    5.410282] smpboot: Total of 72 processors activated (331375.89
> >>> BogoMIPS)
> >>> [    5.605290] node 0 initialised, 15956993 pages in 192ms
> >>> [    5.611291] node 1 initialised, 16343433 pages in 198ms
> >>> [    5.621060] devtmpfs: initialized
> >>> [    5.621340] x86/mm: Memory block size: 2048MB
> >>> [    5.622967] PM: Registering ACPI NVS region [mem
> >>> 0x6b521000-0x6bf50fff]
> >>> (10682368 bytes)
> >>> [    5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles:
> >>> 0xffffffff,
> >>> max_idle_ns: 1911260446275000 ns
> >>> [    5.624357] futex hash table entries: 32768 (order: 9, 2097152
> >>> bytes)
> >>> [    5.626618] pinctrl core: initialized pinctrl subsystem
> >>> [    5.627368] PM: RTC time: 06:13:50, date: 2019-07-09
> >>> [    5.628697] NET: Registered protocol family 16
> >>> [    5.629457] audit: initializing netlink subsys (disabled)
> >>> [    5.630299] audit: type=2000 audit(1562652826.903:1):
> >>> state=initialized
> >>> audit_enabled=0 res=1
> >>> [    5.638286] cpuidle: using governor menu
> >>> [    5.642292] Detected 1 PCC Subspaces
> >>> [    5.646314] Registering PCC driver as Mailbox controller
> >>> [    5.651409] ACPI FADT declares the system doesn't support PCIe
> >>> ASPM, so
> >>> disable it
> >>> [    5.659283] ACPI: bus type PCI registered
> >>> [    5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version:
> >>> 0.5
> >>> [    5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
> >>> 0x80000000-0x8fffffff] (base 0x80000000)
> >>> [    5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in
> >>> E820
> >>> [    5.680293] PCI: Using configuration type 1 for base access
> >>> [    5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated
> >>> 0 pages
> >>> [    5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated
> >>> 0 pages
> >>> [    5.702283] ACPI: Added _OSI(Module Device)
> >>> [    5.706285] ACPI: Added _OSI(Processor Device)
> >>> [    5.710282] ACPI: Added _OSI(3.0 _SCP Extensions)
> >>> [    5.715281] ACPI: Added _OSI(Processor Aggregator Device)
> >>> [    5.720282] ACPI: Added _OSI(Linux-Dell-Video)
> >>> [    5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
> >>> [    5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
> >>> [    5.776862] ACPI: 4 ACPI AML tables successfully acquired and loaded
> >>> [    5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
> >>> [    5.809488] ACPI: Dynamic OEM Table Load:
> >>> IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot
> >>> Primary Bios Version: SE5C620.86B.00.01.0014.070920180847
> >>> Backup Bios Version: SE5C620.86B.00.01.0014.070920180847
> >>> System is booting from BIOS Primary Area!
> >>> BMC Firmware Version: 1.60.56383BEF
> >>> SDR Version: SDR Package 1.60
> >>> ME Firmware Version: 04.00.04.340
> >>> Platform ID: S2600WF
> >>> System memory detected: 131072 MB
> >>> Current memory speed: 2666 MT/s
> >>> Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz Number of physical processors
> >>> identified: 2 AHCI Capable Controller 1 enabling 8 ports of 6Gb/s
> >>> SATA AHCI
> >>> Capable Controller 2 enabling 6 ports of 6Gb/s SATA
> >>>
> >>> USB Keyboard detected
> >>> USB Mouse detected
> >>>
> >>> BMC BaseBoard IP Address 1 : 192.168.3.35 BMC BaseBoard IP Address 2 :
> >>> 192.168.3.35 BMC Dedicated NIC IP Address : 192.168.3.36
> >>>
> >>>
> >>>             Press [Enter] to directly boot.
> >>>             Press [F2]    to enter setup and select boot options.
> >>>             Press [F6]    to show boot menu options.
> >>>             Press [F12]   to boot from network.
> >>>
> >>> Best Regards,
> >>> Rong Chen
> > _______________________________________________
> > LKP mailing list
> > LKP(a)lists.01.org
> > https://lists.01.org/mailman/listinfo/lkp


^ permalink raw reply related	[flat|nested] 8+ messages in thread

* Re: c522ad0637: kernel hang in boot stage
  2019-07-10 21:59       ` Schmauss, Erik
@ 2019-07-11  5:19         ` Rong Chen
  2019-07-12  8:26           ` Rong Chen
  0 siblings, 1 reply; 8+ messages in thread
From: Rong Chen @ 2019-07-11  5:19 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 9492 bytes --]

On 7/11/19 5:59 AM, Schmauss, Erik wrote:
> Hi Rong,
>
> Could you try the following patch on top of the kernel that has the hang?


Hi Erik,

The patch can fix kernel hang.

Best Regards,
Rong Chen


>
> Thanks,
> Erik
>
> diff --git a/drivers/acpi/acpica/exconfig.c b/drivers/acpi/acpica/exconfig.c
> index 58c04d706723..46a8baf28bd0 100644
> --- a/drivers/acpi/acpica/exconfig.c
> +++ b/drivers/acpi/acpica/exconfig.c
> @@ -176,7 +176,9 @@ acpi_ex_load_table_op(struct acpi_walk_state *walk_state,
>
>          /* Complete the initialization/resolution of new objects */
>
> +       acpi_ex_exit_interpreter();
>          acpi_ns_initialize_objects();
> +       acpi_ex_enter_interpreter();
>
>          /* Parameter Data (optional) */
>
>> -----Original Message-----
>> From: Chen, Rong A
>> Sent: Wednesday, July 10, 2019 5:12 AM
>> To: Schmauss, Erik <erik.schmauss@intel.com>
>> Cc: Wysocki, Rafael J <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>; Moore,
>> Robert <robert.moore@intel.com>
>> Subject: Re: [LKP] c522ad0637: kernel hang in boot stage
>>
>>
>>
>> On 7/10/2019 7:56 PM, Chen, Rong A wrote:
>>> Hi Erik,
>>>
>>> On 7/10/2019 1:53 AM, Schmauss, Erik wrote:
>>>> Can you give us more information? Which function does it hang on?
>>> It seems the below changes causes the issue.
>>>
>> ...
>> Sorry, please ignore the previous conclusion.
>>
>> I reverted drivers/acpi/acpica/tbxfload.c but the issue is still exist.
>> so the problem part is another file:
>>
>> diff --git a/drivers/acpi/acpica/exconfig.c b/drivers/acpi/acpica/exconfig.c index
>> 587aeeeb5070a..58c04d7067235 100644
>> --- a/drivers/acpi/acpica/exconfig.c
>> +++ b/drivers/acpi/acpica/exconfig.c
>> @@ -174,12 +174,9 @@ acpi_ex_load_table_op(struct acpi_walk_state
>> *walk_state,
>>                   return_ACPI_STATUS(status);
>>           }
>>
>> -       /* Complete the initialization/resolution of package objects */
>> +       /* Complete the initialization/resolution of new objects */
>>
>> -       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
>> ACPI_ROOT_OBJECT,
>> -                                       ACPI_UINT32_MAX, 0,
>> -                                       acpi_ns_init_one_package, NULL, NULL,
>> -                                       NULL);
>> +       acpi_ns_initialize_objects();
>>
>>           /* Parameter Data (optional) */
>>
>> @@ -437,12 +434,11 @@ acpi_ex_load_op(union acpi_operand_object
>> *obj_desc,
>>                   return_ACPI_STATUS(status);
>>           }
>>
>> -       /* Complete the initialization/resolution of package objects */
>> +       /* Complete the initialization/resolution of new objects */
>>
>> -       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
>> ACPI_ROOT_OBJECT,
>> -                                       ACPI_UINT32_MAX, 0,
>> -                                       acpi_ns_init_one_package, NULL,
>> NULL,
>> -                                       NULL);
>> +       acpi_ex_exit_interpreter();
>> +       acpi_ns_initialize_objects();
>> +       acpi_ex_enter_interpreter();
>>
>>           /* Store the ddb_handle into the Target operand */
>>
>>>> Is this reproducible on every boot?
>>> yes, it always.
>>>
>>> Best Regards,
>>> Rong Chen
>>>
>>>
>>>> Thanks,
>>>> Erik
>>>>
>>>>> -----Original Message-----
>>>>> From: Chen, Rong A
>>>>> Sent: Monday, July 8, 2019 11:45 PM
>>>>> To: Schmauss, Erik <erik.schmauss@intel.com>
>>>>> Cc: Moore, Robert <robert.moore@intel.com>; Wysocki, Rafael J
>>>>> <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>
>>>>> Subject: c522ad0637: kernel hang in boot stage
>>>>>
>>>>> FYI, we noticed the following commit (built with gcc-7):
>>>>>
>>>>> commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA:
>> Update
>>>>> table load object initialization")
>>>>> https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-
>> next.git
>>>>> master
>>>>>
>>>>> in testcase: fio
>>>>> with following parameters:
>>>>>
>>>>>      runtime: 300s
>>>>>            disk: 1SSD
>>>>>            fs: ext4
>>>>>            nr_task: 1
>>>>>            test_size: 128G
>>>>>            rw: write
>>>>>            bs: 4k
>>>>>            ioengine: sync
>>>>>            direct: direct
>>>>>
>>>>> test-description: Fio is a tool that will spawn a number of threads
>>>>> or processes
>>>>> doing a particular type of I/O action as specified by the user.
>>>>> test-url:https://github.com/axboe/fio
>>>>>
>>>>>
>>>>>
>>>>> on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G
>>>>> memory
>>>>>
>>>>> caused below changes (please refer to attached dmesg/kmsg for entire
>>>>> log/backtrace):
>>>>>
>>>>> [    5.408282] smp: Brought up 2 nodes, 72 CPUs
>>>>> [    5.409283] smpboot: Max logical packages: 2
>>>>> [    5.410282] smpboot: Total of 72 processors activated (331375.89
>>>>> BogoMIPS)
>>>>> [    5.605290] node 0 initialised, 15956993 pages in 192ms
>>>>> [    5.611291] node 1 initialised, 16343433 pages in 198ms
>>>>> [    5.621060] devtmpfs: initialized
>>>>> [    5.621340] x86/mm: Memory block size: 2048MB
>>>>> [    5.622967] PM: Registering ACPI NVS region [mem
>>>>> 0x6b521000-0x6bf50fff]
>>>>> (10682368 bytes)
>>>>> [    5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles:
>>>>> 0xffffffff,
>>>>> max_idle_ns: 1911260446275000 ns
>>>>> [    5.624357] futex hash table entries: 32768 (order: 9, 2097152
>>>>> bytes)
>>>>> [    5.626618] pinctrl core: initialized pinctrl subsystem
>>>>> [    5.627368] PM: RTC time: 06:13:50, date: 2019-07-09
>>>>> [    5.628697] NET: Registered protocol family 16
>>>>> [    5.629457] audit: initializing netlink subsys (disabled)
>>>>> [    5.630299] audit: type=2000 audit(1562652826.903:1):
>>>>> state=initialized
>>>>> audit_enabled=0 res=1
>>>>> [    5.638286] cpuidle: using governor menu
>>>>> [    5.642292] Detected 1 PCC Subspaces
>>>>> [    5.646314] Registering PCC driver as Mailbox controller
>>>>> [    5.651409] ACPI FADT declares the system doesn't support PCIe
>>>>> ASPM, so
>>>>> disable it
>>>>> [    5.659283] ACPI: bus type PCI registered
>>>>> [    5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version:
>>>>> 0.5
>>>>> [    5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
>>>>> 0x80000000-0x8fffffff] (base 0x80000000)
>>>>> [    5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in
>>>>> E820
>>>>> [    5.680293] PCI: Using configuration type 1 for base access
>>>>> [    5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated
>>>>> 0 pages
>>>>> [    5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated
>>>>> 0 pages
>>>>> [    5.702283] ACPI: Added _OSI(Module Device)
>>>>> [    5.706285] ACPI: Added _OSI(Processor Device)
>>>>> [    5.710282] ACPI: Added _OSI(3.0 _SCP Extensions)
>>>>> [    5.715281] ACPI: Added _OSI(Processor Aggregator Device)
>>>>> [    5.720282] ACPI: Added _OSI(Linux-Dell-Video)
>>>>> [    5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
>>>>> [    5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
>>>>> [    5.776862] ACPI: 4 ACPI AML tables successfully acquired and loaded
>>>>> [    5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
>>>>> [    5.809488] ACPI: Dynamic OEM Table Load:
>>>>> IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot
>>>>> Primary Bios Version: SE5C620.86B.00.01.0014.070920180847
>>>>> Backup Bios Version: SE5C620.86B.00.01.0014.070920180847
>>>>> System is booting from BIOS Primary Area!
>>>>> BMC Firmware Version: 1.60.56383BEF
>>>>> SDR Version: SDR Package 1.60
>>>>> ME Firmware Version: 04.00.04.340
>>>>> Platform ID: S2600WF
>>>>> System memory detected: 131072 MB
>>>>> Current memory speed: 2666 MT/s
>>>>> Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz Number of physical processors
>>>>> identified: 2 AHCI Capable Controller 1 enabling 8 ports of 6Gb/s
>>>>> SATA AHCI
>>>>> Capable Controller 2 enabling 6 ports of 6Gb/s SATA
>>>>>
>>>>> USB Keyboard detected
>>>>> USB Mouse detected
>>>>>
>>>>> BMC BaseBoard IP Address 1 : 192.168.3.35 BMC BaseBoard IP Address 2 :
>>>>> 192.168.3.35 BMC Dedicated NIC IP Address : 192.168.3.36
>>>>>
>>>>>
>>>>>              Press [Enter] to directly boot.
>>>>>              Press [F2]    to enter setup and select boot options.
>>>>>              Press [F6]    to show boot menu options.
>>>>>              Press [F12]   to boot from network.
>>>>>
>>>>> Best Regards,
>>>>> Rong Chen
>>> _______________________________________________
>>> LKP mailing list
>>> LKP(a)lists.01.org
>>> https://lists.01.org/mailman/listinfo/lkp
> _______________________________________________
> LKP mailing list
> LKP(a)lists.01.org
> https://lists.01.org/mailman/listinfo/lkp

[-- Attachment #2: kmsg.xz --]
[-- Type: application/x-xz, Size: 26692 bytes --]

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: c522ad0637: kernel hang in boot stage
  2019-07-11  5:19         ` Rong Chen
@ 2019-07-12  8:26           ` Rong Chen
  2019-07-12 16:56             ` Schmauss, Erik
  0 siblings, 1 reply; 8+ messages in thread
From: Rong Chen @ 2019-07-12  8:26 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 10045 bytes --]

Hi Erik,

Will you send a patch to fix it? the issue is spreading to many trees 
after commit c522ad0637 merged to mainline tree.

Best Regards,
Rong Chen

On 7/11/19 1:19 PM, Rong Chen wrote:
> On 7/11/19 5:59 AM, Schmauss, Erik wrote:
>> Hi Rong,
>>
>> Could you try the following patch on top of the kernel that has the 
>> hang?
>
>
> Hi Erik,
>
> The patch can fix kernel hang.
>
> Best Regards,
> Rong Chen
>
>
>>
>> Thanks,
>> Erik
>>
>> diff --git a/drivers/acpi/acpica/exconfig.c 
>> b/drivers/acpi/acpica/exconfig.c
>> index 58c04d706723..46a8baf28bd0 100644
>> --- a/drivers/acpi/acpica/exconfig.c
>> +++ b/drivers/acpi/acpica/exconfig.c
>> @@ -176,7 +176,9 @@ acpi_ex_load_table_op(struct acpi_walk_state 
>> *walk_state,
>>
>>          /* Complete the initialization/resolution of new objects */
>>
>> +       acpi_ex_exit_interpreter();
>>          acpi_ns_initialize_objects();
>> +       acpi_ex_enter_interpreter();
>>
>>          /* Parameter Data (optional) */
>>
>>> -----Original Message-----
>>> From: Chen, Rong A
>>> Sent: Wednesday, July 10, 2019 5:12 AM
>>> To: Schmauss, Erik <erik.schmauss@intel.com>
>>> Cc: Wysocki, Rafael J <rafael.j.wysocki@intel.com>; LKP 
>>> <lkp@01.org>; Moore,
>>> Robert <robert.moore@intel.com>
>>> Subject: Re: [LKP] c522ad0637: kernel hang in boot stage
>>>
>>>
>>>
>>> On 7/10/2019 7:56 PM, Chen, Rong A wrote:
>>>> Hi Erik,
>>>>
>>>> On 7/10/2019 1:53 AM, Schmauss, Erik wrote:
>>>>> Can you give us more information? Which function does it hang on?
>>>> It seems the below changes causes the issue.
>>>>
>>> ...
>>> Sorry, please ignore the previous conclusion.
>>>
>>> I reverted drivers/acpi/acpica/tbxfload.c but the issue is still exist.
>>> so the problem part is another file:
>>>
>>> diff --git a/drivers/acpi/acpica/exconfig.c 
>>> b/drivers/acpi/acpica/exconfig.c index
>>> 587aeeeb5070a..58c04d7067235 100644
>>> --- a/drivers/acpi/acpica/exconfig.c
>>> +++ b/drivers/acpi/acpica/exconfig.c
>>> @@ -174,12 +174,9 @@ acpi_ex_load_table_op(struct acpi_walk_state
>>> *walk_state,
>>>                   return_ACPI_STATUS(status);
>>>           }
>>>
>>> -       /* Complete the initialization/resolution of package objects */
>>> +       /* Complete the initialization/resolution of new objects */
>>>
>>> -       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
>>> ACPI_ROOT_OBJECT,
>>> -                                       ACPI_UINT32_MAX, 0,
>>> - acpi_ns_init_one_package, NULL, NULL,
>>> -                                       NULL);
>>> +       acpi_ns_initialize_objects();
>>>
>>>           /* Parameter Data (optional) */
>>>
>>> @@ -437,12 +434,11 @@ acpi_ex_load_op(union acpi_operand_object
>>> *obj_desc,
>>>                   return_ACPI_STATUS(status);
>>>           }
>>>
>>> -       /* Complete the initialization/resolution of package objects */
>>> +       /* Complete the initialization/resolution of new objects */
>>>
>>> -       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
>>> ACPI_ROOT_OBJECT,
>>> -                                       ACPI_UINT32_MAX, 0,
>>> - acpi_ns_init_one_package, NULL,
>>> NULL,
>>> -                                       NULL);
>>> +       acpi_ex_exit_interpreter();
>>> +       acpi_ns_initialize_objects();
>>> +       acpi_ex_enter_interpreter();
>>>
>>>           /* Store the ddb_handle into the Target operand */
>>>
>>>>> Is this reproducible on every boot?
>>>> yes, it always.
>>>>
>>>> Best Regards,
>>>> Rong Chen
>>>>
>>>>
>>>>> Thanks,
>>>>> Erik
>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Chen, Rong A
>>>>>> Sent: Monday, July 8, 2019 11:45 PM
>>>>>> To: Schmauss, Erik <erik.schmauss@intel.com>
>>>>>> Cc: Moore, Robert <robert.moore@intel.com>; Wysocki, Rafael J
>>>>>> <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>
>>>>>> Subject: c522ad0637: kernel hang in boot stage
>>>>>>
>>>>>> FYI, we noticed the following commit (built with gcc-7):
>>>>>>
>>>>>> commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA:
>>> Update
>>>>>> table load object initialization")
>>>>>> https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-
>>> next.git
>>>>>> master
>>>>>>
>>>>>> in testcase: fio
>>>>>> with following parameters:
>>>>>>
>>>>>>      runtime: 300s
>>>>>>            disk: 1SSD
>>>>>>            fs: ext4
>>>>>>            nr_task: 1
>>>>>>            test_size: 128G
>>>>>>            rw: write
>>>>>>            bs: 4k
>>>>>>            ioengine: sync
>>>>>>            direct: direct
>>>>>>
>>>>>> test-description: Fio is a tool that will spawn a number of threads
>>>>>> or processes
>>>>>> doing a particular type of I/O action as specified by the user.
>>>>>> test-url:https://github.com/axboe/fio
>>>>>>
>>>>>>
>>>>>>
>>>>>> on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G
>>>>>> memory
>>>>>>
>>>>>> caused below changes (please refer to attached dmesg/kmsg for entire
>>>>>> log/backtrace):
>>>>>>
>>>>>> [    5.408282] smp: Brought up 2 nodes, 72 CPUs
>>>>>> [    5.409283] smpboot: Max logical packages: 2
>>>>>> [    5.410282] smpboot: Total of 72 processors activated (331375.89
>>>>>> BogoMIPS)
>>>>>> [    5.605290] node 0 initialised, 15956993 pages in 192ms
>>>>>> [    5.611291] node 1 initialised, 16343433 pages in 198ms
>>>>>> [    5.621060] devtmpfs: initialized
>>>>>> [    5.621340] x86/mm: Memory block size: 2048MB
>>>>>> [    5.622967] PM: Registering ACPI NVS region [mem
>>>>>> 0x6b521000-0x6bf50fff]
>>>>>> (10682368 bytes)
>>>>>> [    5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles:
>>>>>> 0xffffffff,
>>>>>> max_idle_ns: 1911260446275000 ns
>>>>>> [    5.624357] futex hash table entries: 32768 (order: 9, 2097152
>>>>>> bytes)
>>>>>> [    5.626618] pinctrl core: initialized pinctrl subsystem
>>>>>> [    5.627368] PM: RTC time: 06:13:50, date: 2019-07-09
>>>>>> [    5.628697] NET: Registered protocol family 16
>>>>>> [    5.629457] audit: initializing netlink subsys (disabled)
>>>>>> [    5.630299] audit: type=2000 audit(1562652826.903:1):
>>>>>> state=initialized
>>>>>> audit_enabled=0 res=1
>>>>>> [    5.638286] cpuidle: using governor menu
>>>>>> [    5.642292] Detected 1 PCC Subspaces
>>>>>> [    5.646314] Registering PCC driver as Mailbox controller
>>>>>> [    5.651409] ACPI FADT declares the system doesn't support PCIe
>>>>>> ASPM, so
>>>>>> disable it
>>>>>> [    5.659283] ACPI: bus type PCI registered
>>>>>> [    5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version:
>>>>>> 0.5
>>>>>> [    5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
>>>>>> 0x80000000-0x8fffffff] (base 0x80000000)
>>>>>> [    5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] 
>>>>>> reserved in
>>>>>> E820
>>>>>> [    5.680293] PCI: Using configuration type 1 for base access
>>>>>> [    5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated
>>>>>> 0 pages
>>>>>> [    5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated
>>>>>> 0 pages
>>>>>> [    5.702283] ACPI: Added _OSI(Module Device)
>>>>>> [    5.706285] ACPI: Added _OSI(Processor Device)
>>>>>> [    5.710282] ACPI: Added _OSI(3.0 _SCP Extensions)
>>>>>> [    5.715281] ACPI: Added _OSI(Processor Aggregator Device)
>>>>>> [    5.720282] ACPI: Added _OSI(Linux-Dell-Video)
>>>>>> [    5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
>>>>>> [    5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
>>>>>> [    5.776862] ACPI: 4 ACPI AML tables successfully acquired and 
>>>>>> loaded
>>>>>> [    5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
>>>>>> [    5.809488] ACPI: Dynamic OEM Table Load:
>>>>>> IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot
>>>>>> Primary Bios Version: SE5C620.86B.00.01.0014.070920180847
>>>>>> Backup Bios Version: SE5C620.86B.00.01.0014.070920180847
>>>>>> System is booting from BIOS Primary Area!
>>>>>> BMC Firmware Version: 1.60.56383BEF
>>>>>> SDR Version: SDR Package 1.60
>>>>>> ME Firmware Version: 04.00.04.340
>>>>>> Platform ID: S2600WF
>>>>>> System memory detected: 131072 MB
>>>>>> Current memory speed: 2666 MT/s
>>>>>> Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz Number of physical 
>>>>>> processors
>>>>>> identified: 2 AHCI Capable Controller 1 enabling 8 ports of 6Gb/s
>>>>>> SATA AHCI
>>>>>> Capable Controller 2 enabling 6 ports of 6Gb/s SATA
>>>>>>
>>>>>> USB Keyboard detected
>>>>>> USB Mouse detected
>>>>>>
>>>>>> BMC BaseBoard IP Address 1 : 192.168.3.35 BMC BaseBoard IP 
>>>>>> Address 2 :
>>>>>> 192.168.3.35 BMC Dedicated NIC IP Address : 192.168.3.36
>>>>>>
>>>>>>
>>>>>>              Press [Enter] to directly boot.
>>>>>>              Press [F2]    to enter setup and select boot options.
>>>>>>              Press [F6]    to show boot menu options.
>>>>>>              Press [F12]   to boot from network.
>>>>>>
>>>>>> Best Regards,
>>>>>> Rong Chen
>>>> _______________________________________________
>>>> LKP mailing list
>>>> LKP(a)lists.01.org
>>>> https://lists.01.org/mailman/listinfo/lkp
>> _______________________________________________
>> LKP mailing list
>> LKP(a)lists.01.org
>> https://lists.01.org/mailman/listinfo/lkp
>
> _______________________________________________
> LKP mailing list
> LKP(a)lists.01.org
> https://lists.01.org/mailman/listinfo/lkp


[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 18555 bytes --]

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: c522ad0637: kernel hang in boot stage
  2019-07-12  8:26           ` Rong Chen
@ 2019-07-12 16:56             ` Schmauss, Erik
  0 siblings, 0 replies; 8+ messages in thread
From: Schmauss, Erik @ 2019-07-12 16:56 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 13241 bytes --]

The commit and Rafael’s merge was removed from mainline for now. I’ve submitted a replacement patch to Linux acpi mailinglist. I’ve pasted the patch that I’ve re-submitted below. Let me know if you need anything else.

Thanks,
Erik


ACPICA commit c7ef9f3526765bed8930825dda1eed1a274b9668



Use the common internal "initialize objects" interface

Affects:

Load()

load_table()

acpi_load_table



Link: https://github.com/acpica/acpica/commit/c7ef9f35



Tested-by: Rong Chen <rong.a.chen(a)intel.com<mailto:rong.a.chen@intel.com>>

Signed-off-by: Bob Moore <robert.moore(a)intel.com<mailto:robert.moore@intel.com>>

Signed-off-by: Erik Schmauss <erik.schmauss(a)intel.com<mailto:erik.schmauss@intel.com>>

---

drivers/acpi/acpica/exconfig.c | 18 ++++++++----------  drivers/acpi/acpica/tbxfload.c | 10 +++-------

2 files changed, 11 insertions(+), 17 deletions(-)



diff --git a/drivers/acpi/acpica/exconfig.c b/drivers/acpi/acpica/exconfig.c index 587aeeeb5070..46a8baf28bd0 100644

--- a/drivers/acpi/acpica/exconfig.c

+++ b/drivers/acpi/acpica/exconfig.c

@@ -174,12 +174,11 @@ acpi_ex_load_table_op(struct acpi_walk_state *walk_state,

                           return_ACPI_STATUS(status);

              }



-            /* Complete the initialization/resolution of package objects */

+            /* Complete the initialization/resolution of new objects */



-            status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE, ACPI_ROOT_OBJECT,

-                                                                    ACPI_UINT32_MAX, 0,

-                                                                    acpi_ns_init_one_package, NULL, NULL,

-                                                                   NULL);

+            acpi_ex_exit_interpreter();

+            acpi_ns_initialize_objects();

+            acpi_ex_enter_interpreter();



             /* Parameter Data (optional) */



@@ -437,12 +436,11 @@ acpi_ex_load_op(union acpi_operand_object *obj_desc,

                           return_ACPI_STATUS(status);

              }



-            /* Complete the initialization/resolution of package objects */

+            /* Complete the initialization/resolution of new objects */



-            status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE, ACPI_ROOT_OBJECT,

-                                                                    ACPI_UINT32_MAX, 0,

-                                                                    acpi_ns_init_one_package, NULL, NULL,

-                                                                   NULL);

+            acpi_ex_exit_interpreter();

+            acpi_ns_initialize_objects();

+            acpi_ex_enter_interpreter();



             /* Store the ddb_handle into the Target operand */



diff --git a/drivers/acpi/acpica/tbxfload.c b/drivers/acpi/acpica/tbxfload.c index ef8f8a9f3c9c..86f1693f6d29 100644

--- a/drivers/acpi/acpica/tbxfload.c

+++ b/drivers/acpi/acpica/tbxfload.c

@@ -297,15 +297,11 @@ acpi_status acpi_load_table(struct acpi_table_header *table)

              status = acpi_tb_install_and_load_table(ACPI_PTR_TO_PHYSADDR(table),

                                                                                   ACPI_TABLE_ORIGIN_EXTERNAL_VIRTUAL,

                                                                                  FALSE, &table_index);

-

              if (ACPI_SUCCESS(status)) {

-                          /* Complete the initialization/resolution of package objects */



-                          status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,

-                                                                                 ACPI_ROOT_OBJECT,

-                                                                                 ACPI_UINT32_MAX, 0,

-                                                                                 acpi_ns_init_one_package,

-                                                                                 NULL, NULL, NULL);

+                         /* Complete the initialization/resolution of new objects */

+

+                         acpi_ns_initialize_objects();

              }



             return_ACPI_STATUS(status);

--

2.17.2




From: Chen, Rong A
Sent: Friday, July 12, 2019 1:27 AM
To: Schmauss, Erik <erik.schmauss@intel.com>
Cc: Wysocki, Rafael J <rafael.j.wysocki@intel.com>; LKP <lkp@01.org>; Moore, Robert <robert.moore@intel.com>
Subject: Re: [LKP] c522ad0637: kernel hang in boot stage

Hi Erik,

Will you send a patch to fix it? the issue is spreading to many trees after commit c522ad0637 merged to mainline tree.

Best Regards,
Rong Chen
On 7/11/19 1:19 PM, Rong Chen wrote:
On 7/11/19 5:59 AM, Schmauss, Erik wrote:

Hi Rong,

Could you try the following patch on top of the kernel that has the hang?


Hi Erik,

The patch can fix kernel hang.

Best Regards,
Rong Chen




Thanks,
Erik

diff --git a/drivers/acpi/acpica/exconfig.c b/drivers/acpi/acpica/exconfig.c
index 58c04d706723..46a8baf28bd0 100644
--- a/drivers/acpi/acpica/exconfig.c
+++ b/drivers/acpi/acpica/exconfig.c
@@ -176,7 +176,9 @@ acpi_ex_load_table_op(struct acpi_walk_state *walk_state,

         /* Complete the initialization/resolution of new objects */

+       acpi_ex_exit_interpreter();
         acpi_ns_initialize_objects();
+       acpi_ex_enter_interpreter();

         /* Parameter Data (optional) */


-----Original Message-----
From: Chen, Rong A
Sent: Wednesday, July 10, 2019 5:12 AM
To: Schmauss, Erik <erik.schmauss@intel.com><mailto:erik.schmauss@intel.com>
Cc: Wysocki, Rafael J <rafael.j.wysocki@intel.com><mailto:rafael.j.wysocki@intel.com>; LKP <lkp@01.org><mailto:lkp@01.org>; Moore,
Robert <robert.moore@intel.com><mailto:robert.moore@intel.com>
Subject: Re: [LKP] c522ad0637: kernel hang in boot stage



On 7/10/2019 7:56 PM, Chen, Rong A wrote:

Hi Erik,

On 7/10/2019 1:53 AM, Schmauss, Erik wrote:

Can you give us more information? Which function does it hang on?
It seems the below changes causes the issue.
...
Sorry, please ignore the previous conclusion.

I reverted drivers/acpi/acpica/tbxfload.c but the issue is still exist.
so the problem part is another file:

diff --git a/drivers/acpi/acpica/exconfig.c b/drivers/acpi/acpica/exconfig.c index
587aeeeb5070a..58c04d7067235 100644
--- a/drivers/acpi/acpica/exconfig.c
+++ b/drivers/acpi/acpica/exconfig.c
@@ -174,12 +174,9 @@ acpi_ex_load_table_op(struct acpi_walk_state
*walk_state,
                  return_ACPI_STATUS(status);
          }

-       /* Complete the initialization/resolution of package objects */
+       /* Complete the initialization/resolution of new objects */

-       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
ACPI_ROOT_OBJECT,
-                                       ACPI_UINT32_MAX, 0,
-                                       acpi_ns_init_one_package, NULL, NULL,
-                                       NULL);
+       acpi_ns_initialize_objects();

          /* Parameter Data (optional) */

@@ -437,12 +434,11 @@ acpi_ex_load_op(union acpi_operand_object
*obj_desc,
                  return_ACPI_STATUS(status);
          }

-       /* Complete the initialization/resolution of package objects */
+       /* Complete the initialization/resolution of new objects */

-       status = acpi_ns_walk_namespace(ACPI_TYPE_PACKAGE,
ACPI_ROOT_OBJECT,
-                                       ACPI_UINT32_MAX, 0,
-                                       acpi_ns_init_one_package, NULL,
NULL,
-                                       NULL);
+       acpi_ex_exit_interpreter();
+       acpi_ns_initialize_objects();
+       acpi_ex_enter_interpreter();

          /* Store the ddb_handle into the Target operand */


Is this reproducible on every boot?
yes, it always.

Best Regards,
Rong Chen



Thanks,
Erik


-----Original Message-----
From: Chen, Rong A
Sent: Monday, July 8, 2019 11:45 PM
To: Schmauss, Erik <erik.schmauss@intel.com><mailto:erik.schmauss@intel.com>
Cc: Moore, Robert <robert.moore@intel.com><mailto:robert.moore@intel.com>; Wysocki, Rafael J
<rafael.j.wysocki@intel.com><mailto:rafael.j.wysocki@intel.com>; LKP <lkp@01.org><mailto:lkp@01.org>
Subject: c522ad0637: kernel hang in boot stage

FYI, we noticed the following commit (built with gcc-7):

commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA:
Update

table load object initialization")
https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-
next.git

master

in testcase: fio
with following parameters:

     runtime: 300s
           disk: 1SSD
           fs: ext4
           nr_task: 1
           test_size: 128G
           rw: write
           bs: 4k
           ioengine: sync
           direct: direct

test-description: Fio is a tool that will spawn a number of threads
or processes
doing a particular type of I/O action as specified by the user.
test-url:https://github.com/axboe/fio



on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G
memory

caused below changes (please refer to attached dmesg/kmsg for entire
log/backtrace):

[    5.408282] smp: Brought up 2 nodes, 72 CPUs
[    5.409283] smpboot: Max logical packages: 2
[    5.410282] smpboot: Total of 72 processors activated (331375.89
BogoMIPS)
[    5.605290] node 0 initialised, 15956993 pages in 192ms
[    5.611291] node 1 initialised, 16343433 pages in 198ms
[    5.621060] devtmpfs: initialized
[    5.621340] x86/mm: Memory block size: 2048MB
[    5.622967] PM: Registering ACPI NVS region [mem
0x6b521000-0x6bf50fff]
(10682368 bytes)
[    5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles:
0xffffffff,
max_idle_ns: 1911260446275000 ns
[    5.624357] futex hash table entries: 32768 (order: 9, 2097152
bytes)
[    5.626618] pinctrl core: initialized pinctrl subsystem
[    5.627368] PM: RTC time: 06:13:50, date: 2019-07-09
[    5.628697] NET: Registered protocol family 16
[    5.629457] audit: initializing netlink subsys (disabled)
[    5.630299] audit: type=2000 audit(1562652826.903:1):
state=initialized
audit_enabled=0 res=1
[    5.638286] cpuidle: using governor menu
[    5.642292] Detected 1 PCC Subspaces
[    5.646314] Registering PCC driver as Mailbox controller
[    5.651409] ACPI FADT declares the system doesn't support PCIe
ASPM, so
disable it
[    5.659283] ACPI: bus type PCI registered
[    5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version:
0.5
[    5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
0x80000000-0x8fffffff] (base 0x80000000)
[    5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in
E820
[    5.680293] PCI: Using configuration type 1 for base access
[    5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated
0 pages
[    5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated
0 pages
[    5.702283] ACPI: Added _OSI(Module Device)
[    5.706285] ACPI: Added _OSI(Processor Device)
[    5.710282] ACPI: Added _OSI(3.0 _SCP Extensions)
[    5.715281] ACPI: Added _OSI(Processor Aggregator Device)
[    5.720282] ACPI: Added _OSI(Linux-Dell-Video)
[    5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    5.776862] ACPI: 4 ACPI AML tables successfully acquired and loaded
[    5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    5.809488] ACPI: Dynamic OEM Table Load:
IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot
Primary Bios Version: SE5C620.86B.00.01.0014.070920180847
Backup Bios Version: SE5C620.86B.00.01.0014.070920180847
System is booting from BIOS Primary Area!
BMC Firmware Version: 1.60.56383BEF
SDR Version: SDR Package 1.60
ME Firmware Version: 04.00.04.340
Platform ID: S2600WF
System memory detected: 131072 MB
Current memory speed: 2666 MT/s
Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz Number of physical processors
identified: 2 AHCI Capable Controller 1 enabling 8 ports of 6Gb/s
SATA AHCI
Capable Controller 2 enabling 6 ports of 6Gb/s SATA

USB Keyboard detected
USB Mouse detected

BMC BaseBoard IP Address 1 : 192.168.3.35 BMC BaseBoard IP Address 2 :
192.168.3.35 BMC Dedicated NIC IP Address : 192.168.3.36


             Press [Enter] to directly boot.
             Press [F2]    to enter setup and select boot options.
             Press [F6]    to show boot menu options.
             Press [F12]   to boot from network.

Best Regards,
Rong Chen
_______________________________________________
LKP mailing list
LKP(a)lists.01.org<mailto:LKP@lists.01.org>
https://lists.01.org/mailman/listinfo/lkp
_______________________________________________
LKP mailing list
LKP(a)lists.01.org<mailto:LKP@lists.01.org>
https://lists.01.org/mailman/listinfo/lkp



_______________________________________________

LKP mailing list

LKP(a)lists.01.org<mailto:LKP@lists.01.org>

https://lists.01.org/mailman/listinfo/lkp


[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 33894 bytes --]

^ permalink raw reply related	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2019-07-12 16:56 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-07-09  6:44 c522ad0637: kernel hang in boot stage kernel test robot
2019-07-09 17:53 ` Schmauss, Erik
2019-07-10 11:56   ` Chen, Rong A
2019-07-10 12:11     ` Chen, Rong A
2019-07-10 21:59       ` Schmauss, Erik
2019-07-11  5:19         ` Rong Chen
2019-07-12  8:26           ` Rong Chen
2019-07-12 16:56             ` Schmauss, Erik

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.