linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* 5.4-rc1 boot regression with kmemleak enabled
@ 2019-11-05  7:14 Amir Goldstein
  2019-11-05  9:02 ` Catalin Marinas
                   ` (2 more replies)
  0 siblings, 3 replies; 10+ messages in thread
From: Amir Goldstein @ 2019-11-05  7:14 UTC (permalink / raw)
  To: Catalin Marinas
  Cc: Theodore Tso, fstests, Matthew Wilcox, Michal Hocko, Qian Cai,
	Andrew Morton, Linus Torvalds, Linux MM, linux-kernel

[-- Attachment #1: Type: text/plain, Size: 1013 bytes --]

Hi Catalin,

My kvm-xfstests [1] VM doesn't boot with kmemleak enabled since commit
c5665868183f ("mm: kmemleak: use the memory pool for early allocations").

There is no console output when running:

$ kvm -boot order=c -net none -machine type=pc,accel=kvm:tcg -cpu host \
    -drive file=$ROOTFS,if=virtio,snapshot=on -vga none -nographic \
    -smp 2 -m 2048 -serial mon:stdio --kernel $KERNEL \
    --append 'root=/dev/vda console=ttyS0,115200'

$ kvm --version
QEMU emulator version 2.11.1(Debian 1:2.11+dfsg-1ubuntu7.19)
Copyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers

Attached defconfig saved by 'make savedefconfig'.

I tried increasing DEBUG_KMEMLEAK_MEM_POOL_SIZE, which did not help.
I also tried moving kmemleak_init() back to its old location, since this
changes seemed unrelated to the commit. Didn't help either.

Let me know if you have any suggestion how to debug this.

Thanks,
Amir.


[1] https://github.com/tytso/xfstests-bld/blob/master/Documentation/kvm-xfstests.md

[-- Attachment #2: defconfig --]
[-- Type: application/octet-stream, Size: 7580 bytes --]

CONFIG_LOCALVERSION="-xfstests"
CONFIG_SYSVIPC=y
CONFIG_POSIX_MQUEUE=y
CONFIG_AUDIT=y
CONFIG_NO_HZ=y
CONFIG_HIGH_RES_TIMERS=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_TASKSTATS=y
CONFIG_TASK_DELAY_ACCT=y
CONFIG_TASK_XACCT=y
CONFIG_TASK_IO_ACCOUNTING=y
# CONFIG_CPU_ISOLATION is not set
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_CGROUPS=y
CONFIG_CGROUP_SCHED=y
CONFIG_USER_NS=y
CONFIG_SYSFS_DEPRECATED=y
CONFIG_BLK_DEV_INITRD=y
CONFIG_CC_OPTIMIZE_FOR_SIZE=y
CONFIG_BPF_SYSCALL=y
CONFIG_USERFAULTFD=y
# CONFIG_COMPAT_BRK is not set
CONFIG_SLAB=y
CONFIG_PROFILING=y
CONFIG_SMP=y
CONFIG_X86_X2APIC=y
# CONFIG_X86_EXTENDED_PLATFORM is not set
CONFIG_HYPERVISOR_GUEST=y
CONFIG_PARAVIRT=y
CONFIG_PARAVIRT_SPINLOCKS=y
CONFIG_PARAVIRT_TIME_ACCOUNTING=y
CONFIG_MCORE2=y
CONFIG_NR_CPUS=48
# CONFIG_X86_MCE_AMD is not set
# CONFIG_MICROCODE is not set
CONFIG_X86_MSR=y
CONFIG_X86_CPUID=y
CONFIG_NUMA=y
# CONFIG_AMD_NUMA is not set
CONFIG_X86_PMEM_LEGACY=y
CONFIG_X86_CHECK_BIOS_CORRUPTION=y
CONFIG_HZ_300=y
CONFIG_KEXEC=y
CONFIG_KEXEC_FILE=y
CONFIG_CRASH_DUMP=y
# CONFIG_RANDOMIZE_BASE is not set
CONFIG_PHYSICAL_ALIGN=0x1000000
CONFIG_LEGACY_VSYSCALL_EMULATE=y
# CONFIG_SUSPEND is not set
# CONFIG_ACPI_REV_OVERRIDE_POSSIBLE is not set
CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE=y
CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
CONFIG_CPU_FREQ_GOV_ONDEMAND=y
CONFIG_CPU_IDLE_GOV_LADDER=y
# CONFIG_PCI_MMCONFIG is not set
CONFIG_IA32_EMULATION=y
CONFIG_DMI_SYSFS=y
CONFIG_JUMP_LABEL=y
CONFIG_BLK_DEV_INTEGRITY=y
CONFIG_PARTITION_ADVANCED=y
CONFIG_BSD_DISKLABEL=y
# CONFIG_MQ_IOSCHED_DEADLINE is not set
CONFIG_BINFMT_MISC=y
CONFIG_NET=y
CONFIG_PACKET=y
CONFIG_PACKET_DIAG=y
CONFIG_UNIX=y
CONFIG_UNIX_DIAG=y
CONFIG_XFRM_USER=y
CONFIG_NET_KEY=y
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_ADVANCED_ROUTER=y
CONFIG_IP_FIB_TRIE_STATS=y
CONFIG_IP_MULTIPLE_TABLES=y
CONFIG_IP_ROUTE_MULTIPATH=y
CONFIG_IP_ROUTE_VERBOSE=y
CONFIG_NET_IPIP=y
CONFIG_NET_IPGRE_DEMUX=y
CONFIG_NET_IPGRE=y
CONFIG_NET_IPGRE_BROADCAST=y
CONFIG_SYN_COOKIES=y
CONFIG_NET_FOU=y
CONFIG_INET_IPCOMP=y
CONFIG_INET_UDP_DIAG=y
CONFIG_IPV6_ROUTER_PREF=y
CONFIG_IPV6_TUNNEL=y
CONFIG_IPV6_MULTIPLE_TABLES=y
CONFIG_IPV6_SUBTREES=y
CONFIG_NETWORK_SECMARK=y
CONFIG_VLAN_8021Q=y
CONFIG_DNS_RESOLVER=y
CONFIG_NETLINK_DIAG=y
CONFIG_CGROUP_NET_PRIO=y
CONFIG_CGROUP_NET_CLASSID=y
# CONFIG_WIRELESS is not set
CONFIG_NET_9P=y
CONFIG_NET_9P_VIRTIO=y
CONFIG_CEPH_LIB=y
CONFIG_PCI=y
CONFIG_PCI_MSI=y
CONFIG_UEVENT_HELPER=y
CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug"
CONFIG_DEVTMPFS=y
CONFIG_FW_LOADER_USER_HELPER=y
CONFIG_FW_LOADER_USER_HELPER_FALLBACK=y
CONFIG_CONNECTOR=y
CONFIG_BLK_DEV_LOOP=y
CONFIG_BLK_DEV_RAM=y
CONFIG_BLK_DEV_RAM_SIZE=65536
CONFIG_VIRTIO_BLK=y
# CONFIG_SCSI_PROC_FS is not set
CONFIG_BLK_DEV_SD=y
CONFIG_SCSI_VIRTIO=y
CONFIG_ATA=y
# CONFIG_SATA_PMP is not set
# CONFIG_ATA_SFF is not set
CONFIG_MD=y
CONFIG_MD_LINEAR=y
CONFIG_MD_MULTIPATH=y
CONFIG_MD_FAULTY=y
CONFIG_BLK_DEV_DM=y
CONFIG_DM_CRYPT=y
CONFIG_DM_SNAPSHOT=y
CONFIG_DM_THIN_PROVISIONING=y
CONFIG_DM_MIRROR=y
CONFIG_DM_RAID=y
CONFIG_DM_ZERO=y
CONFIG_DM_DELAY=y
CONFIG_DM_FLAKEY=y
CONFIG_DM_LOG_WRITES=y
CONFIG_NETDEVICES=y
CONFIG_DUMMY=y
CONFIG_NETCONSOLE=y
CONFIG_NETCONSOLE_DYNAMIC=y
CONFIG_TUN=y
CONFIG_VETH=y
CONFIG_VIRTIO_NET=y
# CONFIG_ETHERNET is not set
# CONFIG_WLAN is not set
# CONFIG_INPUT_MOUSE is not set
# CONFIG_SERIO_SERPORT is not set
CONFIG_VT_HW_CONSOLE_BINDING=y
# CONFIG_LEGACY_PTYS is not set
CONFIG_DEVKMEM=y
CONFIG_SERIAL_8250=y
# CONFIG_SERIAL_8250_DEPRECATED_OPTIONS is not set
CONFIG_SERIAL_8250_CONSOLE=y
# CONFIG_SERIAL_8250_EXAR is not set
CONFIG_SERIAL_8250_NR_UARTS=32
CONFIG_SERIAL_8250_RUNTIME_UARTS=32
CONFIG_VIRTIO_CONSOLE=y
# CONFIG_HW_RANDOM_INTEL is not set
# CONFIG_HW_RANDOM_AMD is not set
# CONFIG_HW_RANDOM_VIA is not set
CONFIG_HW_RANDOM_VIRTIO=y
# CONFIG_HWMON is not set
# CONFIG_X86_PKG_TEMP_THERMAL is not set
CONFIG_RC_CORE=y
CONFIG_RC_DECODERS=y
CONFIG_IR_NEC_DECODER=y
CONFIG_IR_RC5_DECODER=y
CONFIG_IR_RC6_DECODER=y
CONFIG_IR_JVC_DECODER=y
CONFIG_IR_SONY_DECODER=y
CONFIG_IR_SANYO_DECODER=y
CONFIG_IR_SHARP_DECODER=y
CONFIG_IR_MCE_KBD_DECODER=y
CONFIG_IR_XMP_DECODER=y
CONFIG_HID_BATTERY_STRENGTH=y
CONFIG_HIDRAW=y
CONFIG_UHID=y
# CONFIG_HID_A4TECH is not set
# CONFIG_HID_APPLE is not set
# CONFIG_HID_BELKIN is not set
# CONFIG_HID_CHERRY is not set
# CONFIG_HID_CHICONY is not set
# CONFIG_HID_CYPRESS is not set
# CONFIG_HID_EZKEY is not set
# CONFIG_HID_ITE is not set
# CONFIG_HID_KENSINGTON is not set
# CONFIG_HID_LOGITECH is not set
# CONFIG_HID_MICROSOFT is not set
# CONFIG_HID_MONTEREY is not set
# CONFIG_USB_SUPPORT is not set
CONFIG_RTC_CLASS=y
# CONFIG_RTC_DRV_CMOS is not set
CONFIG_VIRT_DRIVERS=y
CONFIG_VIRTIO_PCI=y
CONFIG_VIRTIO_BALLOON=y
# CONFIG_X86_PLATFORM_DEVICES is not set
# CONFIG_IOMMU_SUPPORT is not set
CONFIG_VALIDATE_FS_PARSER=y
CONFIG_EXT2_FS=y
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
CONFIG_EXT2_FS_SECURITY=y
CONFIG_EXT4_FS=y
CONFIG_EXT4_FS_POSIX_ACL=y
CONFIG_EXT4_FS_SECURITY=y
CONFIG_EXT4_DEBUG=y
CONFIG_JBD2_DEBUG=y
CONFIG_XFS_FS=y
CONFIG_XFS_QUOTA=y
CONFIG_XFS_POSIX_ACL=y
CONFIG_XFS_RT=y
CONFIG_XFS_DEBUG=y
# CONFIG_XFS_ASSERT_FATAL is not set
CONFIG_OCFS2_FS=y
# CONFIG_OCFS2_DEBUG_MASKLOG is not set
CONFIG_BTRFS_FS=y
CONFIG_BTRFS_FS_POSIX_ACL=y
CONFIG_BTRFS_DEBUG=y
CONFIG_BTRFS_ASSERT=y
CONFIG_F2FS_FS=y
CONFIG_F2FS_FS_SECURITY=y
CONFIG_F2FS_CHECK_FS=y
CONFIG_FS_DAX=y
CONFIG_FS_ENCRYPTION=y
CONFIG_FANOTIFY=y
CONFIG_FANOTIFY_ACCESS_PERMISSIONS=y
CONFIG_QUOTA_NETLINK_INTERFACE=y
# CONFIG_PRINT_QUOTA_WARNING is not set
CONFIG_QFMT_V2=y
CONFIG_AUTOFS4_FS=y
CONFIG_FUSE_FS=y
CONFIG_CUSE=y
CONFIG_OVERLAY_FS=y
CONFIG_FSCACHE=y
CONFIG_FSCACHE_STATS=y
CONFIG_CACHEFILES=y
CONFIG_VFAT_FS=y
CONFIG_PROC_KCORE=y
CONFIG_PROC_CHILDREN=y
CONFIG_TMPFS=y
CONFIG_TMPFS_POSIX_ACL=y
CONFIG_CONFIGFS_FS=y
CONFIG_ECRYPT_FS=y
CONFIG_ECRYPT_FS_MESSAGING=y
CONFIG_HFSPLUS_FS=y
CONFIG_CRAMFS=y
CONFIG_SQUASHFS=y
CONFIG_SQUASHFS_XATTR=y
CONFIG_SQUASHFS_LZO=y
CONFIG_SQUASHFS_XZ=y
CONFIG_ROMFS_FS=y
CONFIG_UFS_FS=y
CONFIG_NFS_FS=y
CONFIG_NFSD=y
# CONFIG_RPCSEC_GSS_KRB5 is not set
CONFIG_CIFS=y
# CONFIG_CIFS_DEBUG is not set
CONFIG_CODA_FS=y
CONFIG_9P_FS=y
CONFIG_NLS_DEFAULT="utf8"
CONFIG_NLS_CODEPAGE_437=y
CONFIG_NLS_CODEPAGE_850=y
CONFIG_NLS_ASCII=y
CONFIG_NLS_ISO8859_1=y
CONFIG_DLM=y
CONFIG_SECURITY=y
# CONFIG_INTEGRITY is not set
CONFIG_LSM="yama,loadpin,safesetid,integrity,selinux,smack,tomoyo,apparmor"
# CONFIG_CRYPTO_MANAGER_DISABLE_TESTS is not set
CONFIG_CRYPTO_ECHAINIV=y
CONFIG_CRYPTO_CRC32C_INTEL=y
CONFIG_CRYPTO_CRC32_PCLMUL=y
CONFIG_CRYPTO_AES_NI_INTEL=y
CONFIG_CRYPTO_ARC4=y
CONFIG_CRYPTO_DES=y
# CONFIG_CRYPTO_HW is not set
CONFIG_PRINTK_TIME=y
CONFIG_MESSAGE_LOGLEVEL_DEFAULT=7
CONFIG_DYNAMIC_DEBUG=y
CONFIG_DEBUG_INFO=y
CONFIG_DEBUG_INFO_REDUCED=y
# CONFIG_ENABLE_MUST_CHECK is not set
CONFIG_DEBUG_SECTION_MISMATCH=y
CONFIG_MAGIC_SYSRQ=y
CONFIG_DEBUG_KERNEL=y
CONFIG_PAGE_EXTENSION=y
CONFIG_DEBUG_PAGEALLOC=y
CONFIG_DEBUG_OBJECTS=y
CONFIG_DEBUG_SLAB=y
CONFIG_DEBUG_KMEMLEAK=y
CONFIG_HARDLOCKUP_DETECTOR=y
CONFIG_BOOTPARAM_HUNG_TASK_PANIC=y
CONFIG_WQ_WATCHDOG=y
CONFIG_PANIC_TIMEOUT=5
CONFIG_SCHEDSTATS=y
CONFIG_SCHED_STACK_END_CHECK=y
CONFIG_PROVE_LOCKING=y
CONFIG_LOCK_STAT=y
CONFIG_DEBUG_ATOMIC_SLEEP=y
CONFIG_DEBUG_LIST=y
CONFIG_RCU_CPU_STALL_TIMEOUT=60
# CONFIG_RCU_TRACE is not set
CONFIG_RCU_EQS_DEBUG=y
CONFIG_FAULT_INJECTION=y
CONFIG_FAIL_MAKE_REQUEST=y
CONFIG_FAULT_INJECTION_DEBUG_FS=y
CONFIG_FTRACE_SYSCALLS=y
CONFIG_TRACER_SNAPSHOT=y
CONFIG_STACK_TRACER=y
CONFIG_BLK_DEV_IO_TRACE=y
CONFIG_FUNCTION_PROFILER=y
CONFIG_DEBUG_WX=y
# CONFIG_X86_DEBUG_FPU is not set

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05  7:14 5.4-rc1 boot regression with kmemleak enabled Amir Goldstein
@ 2019-11-05  9:02 ` Catalin Marinas
  2019-11-05  9:23 ` Qian Cai
  2019-11-05 11:54 ` Catalin Marinas
  2 siblings, 0 replies; 10+ messages in thread
From: Catalin Marinas @ 2019-11-05  9:02 UTC (permalink / raw)
  To: Amir Goldstein
  Cc: Theodore Tso, fstests, Matthew Wilcox, Michal Hocko, Qian Cai,
	Andrew Morton, Linus Torvalds, Linux MM, linux-kernel

On Tue, Nov 05, 2019 at 09:14:06AM +0200, Amir Goldstein wrote:
> My kvm-xfstests [1] VM doesn't boot with kmemleak enabled since commit
> c5665868183f ("mm: kmemleak: use the memory pool for early allocations").
> 
> There is no console output when running:
> 
> $ kvm -boot order=c -net none -machine type=pc,accel=kvm:tcg -cpu host \
>     -drive file=$ROOTFS,if=virtio,snapshot=on -vga none -nographic \
>     -smp 2 -m 2048 -serial mon:stdio --kernel $KERNEL \
>     --append 'root=/dev/vda console=ttyS0,115200'

This was fixed in 5.4-rc4, see commit 2abd839aa7e6 ("kmemleak: Do not
corrupt the object_list during clean-up").

-- 
Catalin

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05  7:14 5.4-rc1 boot regression with kmemleak enabled Amir Goldstein
  2019-11-05  9:02 ` Catalin Marinas
@ 2019-11-05  9:23 ` Qian Cai
  2019-11-05 11:54 ` Catalin Marinas
  2 siblings, 0 replies; 10+ messages in thread
From: Qian Cai @ 2019-11-05  9:23 UTC (permalink / raw)
  To: Amir Goldstein
  Cc: Catalin Marinas, Theodore Tso, fstests, Matthew Wilcox,
	Michal Hocko, Andrew Morton, Linus Torvalds, Linux MM,
	linux-kernel



> On Nov 5, 2019, at 2:14 AM, Amir Goldstein <amir73il@gmail.com> wrote:
> 
> My kvm-xfstests [1] VM doesn't boot with kmemleak enabled since commit
> c5665868183f ("mm: kmemleak: use the memory pool for early allocations").
> 
> There is no console output when running:
> 
> $ kvm -boot order=c -net none -machine type=pc,accel=kvm:tcg -cpu host \
>    -drive file=$ROOTFS,if=virtio,snapshot=on -vga none -nographic \
>    -smp 2 -m 2048 -serial mon:stdio --kernel $KERNEL \
>    --append 'root=/dev/vda console=ttyS0,115200'
> 
> $ kvm --version
> QEMU emulator version 2.11.1(Debian 1:2.11+dfsg-1ubuntu7.19)
> Copyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers
> 
> Attached defconfig saved by 'make savedefconfig'.
> 
> I tried increasing DEBUG_KMEMLEAK_MEM_POOL_SIZE, which did not help.

It probably use a bit more memory than before. Does lower the parameter help? Eventually, It should boot with POOL_SIZE=0, no?

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05  7:14 5.4-rc1 boot regression with kmemleak enabled Amir Goldstein
  2019-11-05  9:02 ` Catalin Marinas
  2019-11-05  9:23 ` Qian Cai
@ 2019-11-05 11:54 ` Catalin Marinas
  2019-11-05 12:33   ` Amir Goldstein
  2 siblings, 1 reply; 10+ messages in thread
From: Catalin Marinas @ 2019-11-05 11:54 UTC (permalink / raw)
  To: Amir Goldstein
  Cc: Theodore Tso, fstests, Matthew Wilcox, Michal Hocko, Qian Cai,
	Andrew Morton, Linus Torvalds, Linux MM, linux-kernel

(sorry if you got this message twice; our SMTP server went bust)

On Tue, Nov 05, 2019 at 09:14:06AM +0200, Amir Goldstein wrote:
> My kvm-xfstests [1] VM doesn't boot with kmemleak enabled since commit
> c5665868183f ("mm: kmemleak: use the memory pool for early allocations").
> 
> There is no console output when running:
> 
> $ kvm -boot order=c -net none -machine type=pc,accel=kvm:tcg -cpu host \
>     -drive file=$ROOTFS,if=virtio,snapshot=on -vga none -nographic \
>     -smp 2 -m 2048 -serial mon:stdio --kernel $KERNEL \
>     --append 'root=/dev/vda console=ttyS0,115200'

This was fixed in 5.4-rc4, see commit 2abd839aa7e6 ("kmemleak: Do not
corrupt the object_list during clean-up").

-- 
Catalin

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05 11:54 ` Catalin Marinas
@ 2019-11-05 12:33   ` Amir Goldstein
  2019-11-05 15:30     ` Catalin Marinas
  0 siblings, 1 reply; 10+ messages in thread
From: Amir Goldstein @ 2019-11-05 12:33 UTC (permalink / raw)
  To: Catalin Marinas
  Cc: Theodore Tso, fstests, Matthew Wilcox, Michal Hocko, Qian Cai,
	Andrew Morton, Linus Torvalds, Linux MM, linux-kernel

On Tue, Nov 5, 2019 at 1:54 PM Catalin Marinas <catalin.marinas@arm.com> wrote:
>
> (sorry if you got this message twice; our SMTP server went bust)
>
> On Tue, Nov 05, 2019 at 09:14:06AM +0200, Amir Goldstein wrote:
> > My kvm-xfstests [1] VM doesn't boot with kmemleak enabled since commit
> > c5665868183f ("mm: kmemleak: use the memory pool for early allocations").
> >
> > There is no console output when running:
> >
> > $ kvm -boot order=c -net none -machine type=pc,accel=kvm:tcg -cpu host \
> >     -drive file=$ROOTFS,if=virtio,snapshot=on -vga none -nographic \
> >     -smp 2 -m 2048 -serial mon:stdio --kernel $KERNEL \
> >     --append 'root=/dev/vda console=ttyS0,115200'
>
> This was fixed in 5.4-rc4, see commit 2abd839aa7e6 ("kmemleak: Do not
> corrupt the object_list during clean-up").
>

Did not fix my issue.
Still not booting with 5.4-rc6.
Any other suggestions?

Thanks,
Amir.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05 12:33   ` Amir Goldstein
@ 2019-11-05 15:30     ` Catalin Marinas
  2019-11-05 18:17       ` Amir Goldstein
  0 siblings, 1 reply; 10+ messages in thread
From: Catalin Marinas @ 2019-11-05 15:30 UTC (permalink / raw)
  To: Amir Goldstein
  Cc: Theodore Tso, fstests, Matthew Wilcox, Michal Hocko, Qian Cai,
	Andrew Morton, Linus Torvalds, Linux MM, linux-kernel

On Tue, Nov 05, 2019 at 02:33:48PM +0200, Amir Goldstein wrote:
> On Tue, Nov 5, 2019 at 1:54 PM Catalin Marinas <catalin.marinas@arm.com> wrote:
> > (sorry if you got this message twice; our SMTP server went bust)
> >
> > On Tue, Nov 05, 2019 at 09:14:06AM +0200, Amir Goldstein wrote:
> > > My kvm-xfstests [1] VM doesn't boot with kmemleak enabled since commit
> > > c5665868183f ("mm: kmemleak: use the memory pool for early allocations").
> > >
> > > There is no console output when running:
> > >
> > > $ kvm -boot order=c -net none -machine type=pc,accel=kvm:tcg -cpu host \
> > >     -drive file=$ROOTFS,if=virtio,snapshot=on -vga none -nographic \
> > >     -smp 2 -m 2048 -serial mon:stdio --kernel $KERNEL \
> > >     --append 'root=/dev/vda console=ttyS0,115200'
> >
> > This was fixed in 5.4-rc4, see commit 2abd839aa7e6 ("kmemleak: Do not
> > corrupt the object_list during clean-up").
> 
> Did not fix my issue.
> Still not booting with 5.4-rc6.
> Any other suggestions?

Can you pass an earlyprintk=ttyS0,115200 (if that's the correct x86
syntax) on the kernel command line? It may print some early messages
that would help with debugging.

-- 
Catalin

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05 15:30     ` Catalin Marinas
@ 2019-11-05 18:17       ` Amir Goldstein
  2019-11-05 18:22         ` Catalin Marinas
  0 siblings, 1 reply; 10+ messages in thread
From: Amir Goldstein @ 2019-11-05 18:17 UTC (permalink / raw)
  To: Catalin Marinas
  Cc: Theodore Tso, fstests, Matthew Wilcox, Michal Hocko, Qian Cai,
	Andrew Morton, Linus Torvalds, Linux MM, linux-kernel

[-- Attachment #1: Type: text/plain, Size: 1314 bytes --]

On Tue, Nov 5, 2019 at 5:31 PM Catalin Marinas <catalin.marinas@arm.com> wrote:
>
> On Tue, Nov 05, 2019 at 02:33:48PM +0200, Amir Goldstein wrote:
> > On Tue, Nov 5, 2019 at 1:54 PM Catalin Marinas <catalin.marinas@arm.com> wrote:
> > > (sorry if you got this message twice; our SMTP server went bust)
> > >
> > > On Tue, Nov 05, 2019 at 09:14:06AM +0200, Amir Goldstein wrote:
> > > > My kvm-xfstests [1] VM doesn't boot with kmemleak enabled since commit
> > > > c5665868183f ("mm: kmemleak: use the memory pool for early allocations").
> > > >
> > > > There is no console output when running:
> > > >
> > > > $ kvm -boot order=c -net none -machine type=pc,accel=kvm:tcg -cpu host \
> > > >     -drive file=$ROOTFS,if=virtio,snapshot=on -vga none -nographic \
> > > >     -smp 2 -m 2048 -serial mon:stdio --kernel $KERNEL \
> > > >     --append 'root=/dev/vda console=ttyS0,115200'
> > >
> > > This was fixed in 5.4-rc4, see commit 2abd839aa7e6 ("kmemleak: Do not
> > > corrupt the object_list during clean-up").
> >
> > Did not fix my issue.
> > Still not booting with 5.4-rc6.
> > Any other suggestions?
>
> Can you pass an earlyprintk=ttyS0,115200 (if that's the correct x86
> syntax) on the kernel command line? It may print some early messages
> that would help with debugging.
>

Attached.

Thanks,
Amir.

[-- Attachment #2: kmemleak-earlyboot-5.4.0-rc6.log --]
[-- Type: text/x-log, Size: 46003 bytes --]

early console in extract_kernel
input_data: 0x00000000037c02e9
input_len: 0x0000000000840a6d
output: 0x0000000001000000
output_len: 0x0000000002070910
kernel_total_size: 0x0000000003026000
needed_size: 0x0000000003200000
trampoline_32bit: 0x000000000009d000

Decompressing Linux... Parsing ELF... done.
Booting the kernel.
[    0.000000] Linux version 5.4.0-rc6-xfstests (amir@amir-VirtualBox) (gcc version 7.4.0 (Ubuntu 7.4.0-1ubuntu1~18.04.1)) #4302 SMP Tue Nov 5 08:52:22 IST 2019
[    0.000000] Command line: root=/dev/vda console=ttyS0,115200 earlyprintk=ttyS0,115200
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffddfff] usable
[    0.000000] BIOS-e820: [mem 0x000000007ffde000-0x000000007fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[    0.000000] printk: bootconsole [earlyser0] enabled
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.000000] Hypervisor detected: KVM
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 2c8a001, primary cpu clock
[    0.000000] kvm-clock: using sched offset of 190836459 cycles
[    0.000723] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.002847] tsc: Detected 2294.682 MHz processor
[    0.003869] last_pfn = 0x7ffde max_arch_pfn = 0x400000000
[    0.004618] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.010252] found SMP MP-table at [mem 0x000f6a80-0x000f6a8f]
[    0.011096] check: Scanning 1 areas for low memory corruption
[    0.011852] Using GB pages for direct mapping
[    0.012769] ACPI: Early table checksum verification disabled
[    0.013501] ACPI: RSDP 0x00000000000F6860 000014 (v00 BOCHS )
[    0.014248] ACPI: RSDT 0x000000007FFE1662 000030 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
[    0.015388] ACPI: FACP 0x000000007FFE14B6 000074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)
[    0.016567] ACPI: DSDT 0x000000007FFE0040 001476 (v01 BOCHS  BXPCDSDT 00000001 BXPC 00000001)
[    0.017728] ACPI: FACS 0x000000007FFE0000 000040
[    0.018327] ACPI: APIC 0x000000007FFE15AA 000080 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
[    0.019468] ACPI: HPET 0x000000007FFE162A 000038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
[    0.020658] No NUMA configuration found
[    0.021156] Faking a node at [mem 0x0000000000000000-0x000000007ffddfff]
[    0.022024] NODE_DATA(0) allocated [mem 0x7ffda000-0x7ffddfff]
[    0.022796] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.023682] #PF: supervisor read access in kernel mode
[    0.024341] #PF: error_code(0x0000) - not-present page
[    0.025000] PGD 0 P4D 0 
[    0.025326] Oops: 0000 [#1] SMP PTI
[    0.025775] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.026683] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.027836] RIP: 0010:get_stack_info+0xa7/0x146
[    0.028418] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.030843] RSP: 0000:ffffffff82403bf0 EFLAGS: 00010006
[    0.031512] RAX: 0000000000002000 RBX: ffffffff82403c90 RCX: 0000000000001000
[    0.032450] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001008
[    0.033360] RBP: 0000000000001008 R08: ffffffff82404000 R09: 0000000000000002
[    0.034273] R10: ffffffff82419800 R11: 000000000000000c R12: ffffffff82419800
[    0.035187] R13: ffffffff82403cb0 R14: ffffffff82403d20 R15: 0000000000001008
[    0.036094] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.037127] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.037923] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.038859] Call Trace:
[    0.039176] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.040060] #PF: supervisor read access in kernel mode
[    0.040719] #PF: error_code(0x0000) - not-present page
[    0.041378] PGD 0 P4D 0 
[    0.041705] Oops: 0000 [#2] SMP PTI
[    0.042153] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.043079] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.044280] RIP: 0010:get_stack_info+0xa7/0x146
[    0.044858] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.047280] RSP: 0000:ffffffff82403920 EFLAGS: 00010006
[    0.047948] RAX: 0000000000002000 RBX: ffffffff82403a10 RCX: 0000000000001000
[    0.048864] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001010
[    0.049780] RBP: 0000000000001010 R08: ffffffff82404000 R09: 0000000000000001
[    0.050712] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.051626] R13: ffffffff82403a30 R14: ffffffff82403bf0 R15: 0000000000001010
[    0.052540] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.053577] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.054316] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.055265] Call Trace:
[    0.055579] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.056462] #PF: supervisor read access in kernel mode
[    0.057118] #PF: error_code(0x0000) - not-present page
[    0.057778] PGD 0 P4D 0 
[    0.058104] Oops: 0000 [#3] SMP PTI
[    0.058616] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.059520] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.060668] RIP: 0010:get_stack_info+0xa7/0x146
[    0.061276] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.063722] RSP: 0000:ffffffff82403650 EFLAGS: 00010006
[    0.064392] RAX: 0000000000002000 RBX: ffffffff82403740 RCX: 0000000000001000
[    0.065308] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001018
[    0.066249] RBP: 0000000000001018 R08: ffffffff82404000 R09: 0000000000000001
[    0.067278] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.068195] R13: ffffffff82403760 R14: ffffffff82403920 R15: 0000000000001018
[    0.069112] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.070142] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.070923] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.071841] Call Trace:
[    0.072158] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.073036] #PF: supervisor read access in kernel mode
[    0.073692] #PF: error_code(0x0000) - not-present page
[    0.074349] PGD 0 P4D 0 
[    0.074688] Oops: 0000 [#4] SMP PTI
[    0.075135] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.076042] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.077200] RIP: 0010:get_stack_info+0xa7/0x146
[    0.077784] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.080208] RSP: 0000:ffffffff82403380 EFLAGS: 00010006
[    0.080876] RAX: 0000000000002000 RBX: ffffffff82403470 RCX: 0000000000001000
[    0.081789] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001020
[    0.082715] RBP: 0000000000001020 R08: ffffffff82404000 R09: 0000000000000001
[    0.083634] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.084544] R13: ffffffff82403490 R14: ffffffff82403650 R15: 0000000000001020
[    0.085448] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.086504] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.087411] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.088351] Call Trace:
[    0.088668] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.089544] #PF: supervisor read access in kernel mode
[    0.090238] #PF: error_code(0x0000) - not-present page
[    0.090937] PGD 0 P4D 0 
[    0.091263] Oops: 0000 [#5] SMP PTI
[    0.091709] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.092615] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.093767] RIP: 0010:get_stack_info+0xa7/0x146
[    0.094349] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.096929] RSP: 0000:ffffffff824030b0 EFLAGS: 00010006
[    0.097645] RAX: 0000000000002000 RBX: ffffffff824031a0 RCX: 0000000000001000
[    0.098605] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001028
[    0.099523] RBP: 0000000000001028 R08: ffffffff82404000 R09: 0000000000000001
[    0.100438] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.101386] R13: ffffffff824031c0 R14: ffffffff82403380 R15: 0000000000001028
[    0.102299] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.103395] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.104133] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.105055] Call Trace:
[    0.105373] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.106256] #PF: supervisor read access in kernel mode
[    0.106965] #PF: error_code(0x0000) - not-present page
[    0.107621] PGD 0 P4D 0 
[    0.107947] Oops: 0000 [#6] SMP PTI
[    0.108395] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.109300] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.110468] RIP: 0010:get_stack_info+0xa7/0x146
[    0.111074] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.113498] RSP: 0000:ffffffff82402de0 EFLAGS: 00010006
[    0.114172] RAX: 0000000000002000 RBX: ffffffff82402ed0 RCX: 0000000000001000
[    0.115117] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001030
[    0.116159] RBP: 0000000000001030 R08: ffffffff82404000 R09: 0000000000000001
[    0.117067] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.117977] R13: ffffffff82402ef0 R14: ffffffff824030b0 R15: 0000000000001030
[    0.118933] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.120007] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.120746] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.121661] Call Trace:
[    0.121978] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.122918] #PF: supervisor read access in kernel mode
[    0.123589] #PF: error_code(0x0000) - not-present page
[    0.124248] PGD 0 P4D 0 
[    0.124606] Oops: 0000 [#7] SMP PTI
[    0.125055] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.125954] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.127155] RIP: 0010:get_stack_info+0xa7/0x146
[    0.127807] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.130213] RSP: 0000:ffffffff82402b10 EFLAGS: 00010006
[    0.130918] RAX: 0000000000002000 RBX: ffffffff82402c00 RCX: 0000000000001000
[    0.131828] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001038
[    0.132735] RBP: 0000000000001038 R08: ffffffff82404000 R09: 0000000000000001
[    0.133645] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.134579] R13: ffffffff82402c20 R14: ffffffff82402de0 R15: 0000000000001038
[    0.135490] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.136557] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.137299] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.138217] Call Trace:
[    0.138564] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.139445] #PF: supervisor read access in kernel mode
[    0.140135] #PF: error_code(0x0000) - not-present page
[    0.140797] PGD 0 P4D 0 
[    0.141124] Oops: 0000 [#8] SMP PTI
[    0.141574] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.142477] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.143628] RIP: 0010:get_stack_info+0xa7/0x146
[    0.144208] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.146681] RSP: 0000:ffffffff82402840 EFLAGS: 00010006
[    0.147349] RAX: 0000000000002000 RBX: ffffffff82402930 RCX: 0000000000001000
[    0.148300] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001040
[    0.149209] RBP: 0000000000001040 R08: ffffffff82404000 R09: 0000000000000001
[    0.150113] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.151034] R13: ffffffff82402950 R14: ffffffff82402b10 R15: 0000000000001040
[    0.151939] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.152981] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.153713] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.154638] Call Trace:
[    0.154953] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.155838] #PF: supervisor read access in kernel mode
[    0.156498] #PF: error_code(0x0000) - not-present page
[    0.157173] PGD 0 P4D 0 
[    0.157551] Oops: 0000 [#9] SMP PTI
[    0.158001] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.158919] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.160101] RIP: 0010:get_stack_info+0xa7/0x146
[    0.160681] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.163060] RSP: 0000:ffffffff82402570 EFLAGS: 00010006
[    0.163731] RAX: 0000000000002000 RBX: ffffffff82402660 RCX: 0000000000001000
[    0.164635] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001048
[    0.165536] RBP: 0000000000001048 R08: ffffffff82404000 R09: 0000000000000001
[    0.166443] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.167359] R13: ffffffff82402680 R14: ffffffff82402840 R15: 0000000000001048
[    0.168264] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.169290] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.170039] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.170965] Call Trace:
[    0.171323] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.172226] #PF: supervisor read access in kernel mode
[    0.172927] #PF: error_code(0x0000) - not-present page
[    0.173576] PGD 0 P4D 0 
[    0.173898] Oops: 0000 [#10] SMP PTI
[    0.174353] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.175288] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.176431] RIP: 0010:get_stack_info+0xa7/0x146
[    0.177046] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.179458] RSP: 0000:ffffffff824022a0 EFLAGS: 00010006
[    0.180122] RAX: 0000000000002000 RBX: ffffffff82402390 RCX: 0000000000001000
[    0.181033] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001050
[    0.181936] RBP: 0000000000001050 R08: ffffffff82404000 R09: 0000000000000001
[    0.182921] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.183832] R13: ffffffff824023b0 R14: ffffffff82402570 R15: 0000000000001050
[    0.184749] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.185779] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.186561] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.187580] Call Trace:
[    0.187923] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.188801] #PF: supervisor read access in kernel mode
[    0.189457] #PF: error_code(0x0000) - not-present page
[    0.190111] PGD 0 P4D 0 
[    0.190436] Oops: 0000 [#11] SMP PTI
[    0.190938] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.191833] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.192972] RIP: 0010:get_stack_info+0xa7/0x146
[    0.193554] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.196147] RSP: 0000:ffffffff82401fd0 EFLAGS: 00010006
[    0.196815] RAX: 0000000000002000 RBX: ffffffff824020c0 RCX: 0000000000001000
[    0.197726] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001058
[    0.198697] RBP: 0000000000001058 R08: ffffffff82404000 R09: 0000000000000001
[    0.199609] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.200520] R13: ffffffff824020e0 R14: ffffffff824022a0 R15: 0000000000001058
[    0.201422] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.202450] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.203221] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.204140] Call Trace:
[    0.204457] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.205333] #PF: supervisor read access in kernel mode
[    0.206022] #PF: error_code(0x0000) - not-present page
[    0.206721] PGD 0 P4D 0 
[    0.207047] Oops: 0000 [#12] SMP PTI
[    0.207505] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.208405] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.209559] RIP: 0010:get_stack_info+0xa7/0x146
[    0.210138] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.212602] RSP: 0000:ffffffff82401d00 EFLAGS: 00010006
[    0.213270] RAX: 0000000000002000 RBX: ffffffff82401df0 RCX: 0000000000001000
[    0.214179] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001060
[    0.215111] RBP: 0000000000001060 R08: ffffffff82404000 R09: 0000000000000001
[    0.216081] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.216998] R13: ffffffff82401e10 R14: ffffffff82401fd0 R15: 0000000000001060
[    0.218001] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.219067] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.219808] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.220725] Call Trace:
[    0.221043] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.221917] #PF: supervisor read access in kernel mode
[    0.222598] #PF: error_code(0x0000) - not-present page
[    0.223254] PGD 0 P4D 0 
[    0.223580] Oops: 0000 [#13] SMP PTI
[    0.224039] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.224943] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.226152] RIP: 0010:get_stack_info+0xa7/0x146
[    0.226763] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.229272] RSP: 0000:ffffffff82401a30 EFLAGS: 00010006
[    0.229944] RAX: 0000000000002000 RBX: ffffffff82401b20 RCX: 0000000000001000
[    0.230943] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001068
[    0.231852] RBP: 0000000000001068 R08: ffffffff82404000 R09: 0000000000000001
[    0.232772] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.233678] R13: ffffffff82401b40 R14: ffffffff82401d00 R15: 0000000000001068
[    0.234629] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.235674] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.236417] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.237340] Call Trace:
[    0.237657] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.238576] #PF: supervisor read access in kernel mode
[    0.239234] #PF: error_code(0x0000) - not-present page
[    0.239891] PGD 0 P4D 0 
[    0.240214] Oops: 0000 [#14] SMP PTI
[    0.240719] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.241620] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.242791] RIP: 0010:get_stack_info+0xa7/0x146
[    0.243372] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.245741] RSP: 0000:ffffffff82401760 EFLAGS: 00010006
[    0.246405] RAX: 0000000000002000 RBX: ffffffff82401850 RCX: 0000000000001000
[    0.247404] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001070
[    0.248320] RBP: 0000000000001070 R08: ffffffff82404000 R09: 0000000000000001
[    0.249225] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.250171] R13: ffffffff82401870 R14: ffffffff82401a30 R15: 0000000000001070
[    0.251119] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.252160] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.252928] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.253838] Call Trace:
[    0.254149] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.255034] #PF: supervisor read access in kernel mode
[    0.255694] #PF: error_code(0x0000) - not-present page
[    0.256345] PGD 0 P4D 0 
[    0.256671] Oops: 0000 [#15] SMP PTI
[    0.257130] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.258035] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.259187] RIP: 0010:get_stack_info+0xa7/0x146
[    0.259764] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.262150] RSP: 0000:ffffffff82401490 EFLAGS: 00010006
[    0.262830] RAX: 0000000000002000 RBX: ffffffff82401580 RCX: 0000000000001000
[    0.263745] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001078
[    0.264676] RBP: 0000000000001078 R08: ffffffff82404000 R09: 0000000000000001
[    0.265587] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.266504] R13: ffffffff824015a0 R14: ffffffff82401760 R15: 0000000000001078
[    0.267420] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.268458] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.269193] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.270108] Call Trace:
[    0.270420] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.271299] #PF: supervisor read access in kernel mode
[    0.271958] #PF: error_code(0x0000) - not-present page
[    0.272616] PGD 0 P4D 0 
[    0.272941] Oops: 0000 [#16] SMP PTI
[    0.273396] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.274287] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.275422] RIP: 0010:get_stack_info+0xa7/0x146
[    0.276030] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.278488] RSP: 0000:ffffffff824011c0 EFLAGS: 00010006
[    0.279171] RAX: 0000000000002000 RBX: ffffffff824012b0 RCX: 0000000000001000
[    0.280073] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001080
[    0.281008] RBP: 0000000000001080 R08: ffffffff82404000 R09: 0000000000000001
[    0.281905] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.282823] R13: ffffffff824012d0 R14: ffffffff82401490 R15: 0000000000001080
[    0.283736] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.284771] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.285502] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.286421] Call Trace:
[    0.286741] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.287651] #PF: supervisor read access in kernel mode
[    0.288338] #PF: error_code(0x0000) - not-present page
[    0.289020] PGD 0 P4D 0 
[    0.289341] Oops: 0000 [#17] SMP PTI
[    0.289796] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.290709] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.291860] RIP: 0010:get_stack_info+0xa7/0x146
[    0.292443] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.295181] RSP: 0000:ffffffff82400ef0 EFLAGS: 00010006
[    0.295849] RAX: 0000000000002000 RBX: ffffffff82400fe0 RCX: 0000000000001000
[    0.296760] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001088
[    0.297668] RBP: 0000000000001088 R08: ffffffff82404000 R09: 0000000000000001
[    0.298796] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.299712] R13: ffffffff82401000 R14: ffffffff824011c0 R15: 0000000000001088
[    0.300620] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.301659] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.302395] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.303354] Call Trace:
[    0.303672] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.304553] #PF: supervisor read access in kernel mode
[    0.305212] #PF: error_code(0x0000) - not-present page
[    0.305877] PGD 0 P4D 0 
[    0.306202] Oops: 0000 [#18] SMP PTI
[    0.306700] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.307658] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.308808] RIP: 0010:get_stack_info+0xa7/0x146
[    0.309397] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.311887] RSP: 0000:ffffffff82400c20 EFLAGS: 00010006
[    0.312555] RAX: 0000000000002000 RBX: ffffffff82400d10 RCX: 0000000000001000
[    0.313469] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001090
[    0.314373] RBP: 0000000000001090 R08: ffffffff82404000 R09: 0000000000000001
[    0.315327] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.316292] R13: ffffffff82400d30 R14: ffffffff82400ef0 R15: 0000000000001090
[    0.317203] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.318243] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.319019] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.319936] Call Trace:
[    0.320253] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.321134] #PF: supervisor read access in kernel mode
[    0.321786] #PF: error_code(0x0000) - not-present page
[    0.322489] PGD 0 P4D 0 
[    0.322815] Oops: 0000 [#19] SMP PTI
[    0.323274] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.324175] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.325323] RIP: 0010:get_stack_info+0xa7/0x146
[    0.325905] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.328311] RSP: 0000:ffffffff82400950 EFLAGS: 00010006
[    0.328981] RAX: 0000000000002000 RBX: ffffffff82400a40 RCX: 0000000000001000
[    0.329890] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001098
[    0.330847] RBP: 0000000000001098 R08: ffffffff82404000 R09: 0000000000000001
[    0.331773] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.332687] R13: ffffffff82400a60 R14: ffffffff82400c20 R15: 0000000000001098
[    0.333621] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.334696] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.335437] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.336382] Call Trace:
[    0.336698] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.337624] #PF: supervisor read access in kernel mode
[    0.338329] #PF: error_code(0x0000) - not-present page
[    0.339027] PGD 0 P4D 0 
[    0.339352] Oops: 0000 [#20] SMP PTI
[    0.339808] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.340711] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.341873] RIP: 0010:get_stack_info+0xa7/0x146
[    0.342495] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.345535] RSP: 0000:ffffffff82400680 EFLAGS: 00010006
[    0.346259] RAX: 0000000000002000 RBX: ffffffff82400770 RCX: 0000000000001000
[    0.347280] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010a0
[    0.348260] RBP: 00000000000010a0 R08: ffffffff82404000 R09: 0000000000000001
[    0.349242] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.350222] R13: ffffffff82400790 R14: ffffffff82400950 R15: 00000000000010a0
[    0.351244] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.352362] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.353375] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.355515] Call Trace:
[    0.355887] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.356937] #PF: supervisor read access in kernel mode
[    0.357731] #PF: error_code(0x0000) - not-present page
[    0.358583] PGD 0 P4D 0 
[    0.358973] Thread overran stack, or stack corrupted
[    0.359664] Oops: 0000 [#21] SMP PTI
[    0.360125] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.361128] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.362285] RIP: 0010:get_stack_info+0xa7/0x146
[    0.362912] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.365348] RSP: 0000:ffffffff824003b0 EFLAGS: 00010006
[    0.366019] RAX: 0000000000002000 RBX: ffffffff824004a0 RCX: 0000000000001000
[    0.366975] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010a8
[    0.368019] RBP: 00000000000010a8 R08: ffffffff82404000 R09: 0000000000000001
[    0.368977] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.369892] R13: ffffffff824004c0 R14: ffffffff82400680 R15: 00000000000010a8
[    0.370864] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.371893] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.372628] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.373534] Call Trace:
[    0.373852] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.374772] #PF: supervisor read access in kernel mode
[    0.375425] #PF: error_code(0x0000) - not-present page
[    0.376073] PGD 0 P4D 0 
[    0.376397] Thread overran stack, or stack corrupted
[    0.377035] Oops: 0000 [#22] SMP PTI
[    0.377495] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.378396] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.379599] RIP: 0010:get_stack_info+0xa7/0x146
[    0.380199] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.382629] RSP: 0000:ffffffff824000e0 EFLAGS: 00010006
[    0.383300] RAX: 0000000000002000 RBX: ffffffff824001d0 RCX: 0000000000001000
[    0.384212] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010b0
[    0.385123] RBP: 00000000000010b0 R08: ffffffff82404000 R09: 0000000000000001
[    0.386020] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.386972] R13: ffffffff824001f0 R14: ffffffff824003b0 R15: 00000000000010b0
[    0.387890] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.388927] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.389661] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.390614] Call Trace:
[    0.390959] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.391860] #PF: supervisor read access in kernel mode
[    0.392519] #PF: error_code(0x0000) - not-present page
[    0.393179] PGD 0 P4D 0 
[    0.393505] Thread overran stack, or stack corrupted
[    0.394145] Oops: 0000 [#23] SMP PTI
[    0.394678] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.395690] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.396845] RIP: 0010:get_stack_info+0xa7/0x146
[    0.397471] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.399955] RSP: 0000:ffffffff823ffe10 EFLAGS: 00010006
[    0.400627] RAX: 0000000000002000 RBX: ffffffff823fff00 RCX: 0000000000001000
[    0.401529] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010b8
[    0.402437] RBP: 00000000000010b8 R08: ffffffff82404000 R09: 0000000000000001
[    0.403425] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.404341] R13: ffffffff823fff20 R14: ffffffff824000e0 R15: 00000000000010b8
[    0.405258] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.406306] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.407050] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.407969] Call Trace:
[    0.408285] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.409169] #PF: supervisor read access in kernel mode
[    0.409825] #PF: error_code(0x0000) - not-present page
[    0.410484] PGD 0 P4D 0 
[    0.410808] Thread overran stack, or stack corrupted
[    0.411439] Oops: 0000 [#24] SMP PTI
[    0.411895] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.412797] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.413944] RIP: 0010:get_stack_info+0xa7/0x146
[    0.414545] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.417066] RSP: 0000:ffffffff823ffb40 EFLAGS: 00010006
[    0.417739] RAX: 0000000000002000 RBX: ffffffff823ffc30 RCX: 0000000000001000
[    0.418674] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010c0
[    0.419590] RBP: 00000000000010c0 R08: ffffffff82404000 R09: 0000000000000001
[    0.420501] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.421411] R13: ffffffff823ffc50 R14: ffffffff823ffe10 R15: 00000000000010c0
[    0.422321] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.423372] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.424109] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.425017] Call Trace:
[    0.425329] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.426196] #PF: supervisor read access in kernel mode
[    0.426891] #PF: error_code(0x0000) - not-present page
[    0.427601] PGD 0 P4D 0 
[    0.427929] Thread overran stack, or stack corrupted
[    0.428563] Oops: 0000 [#25] SMP PTI
[    0.429016] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.429909] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.431073] RIP: 0010:get_stack_info+0xa7/0x146
[    0.431681] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.434044] RSP: 0000:ffffffff823ff870 EFLAGS: 00010006
[    0.434728] RAX: 0000000000002000 RBX: ffffffff823ff960 RCX: 0000000000001000
[    0.435635] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010c8
[    0.436541] RBP: 00000000000010c8 R08: ffffffff82404000 R09: 0000000000000001
[    0.437451] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.438399] R13: ffffffff823ff980 R14: ffffffff823ffb40 R15: 00000000000010c8
[    0.439341] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.440372] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.441109] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.442019] Call Trace:
[    0.442335] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.443217] #PF: supervisor read access in kernel mode
[    0.443876] #PF: error_code(0x0000) - not-present page
[    0.444529] PGD 0 P4D 0 
[    0.444855] Thread overran stack, or stack corrupted
[    0.445491] Oops: 0000 [#26] SMP PTI
[    0.445980] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.446916] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.448067] RIP: 0010:get_stack_info+0xa7/0x146
[    0.448648] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.451103] RSP: 0000:ffffffff823ff5a0 EFLAGS: 00010006
[    0.451781] RAX: 0000000000002000 RBX: ffffffff823ff690 RCX: 0000000000001000
[    0.452697] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010d0
[    0.453613] RBP: 00000000000010d0 R08: ffffffff82404000 R09: 0000000000000001
[    0.454558] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.455468] R13: ffffffff823ff6b0 R14: ffffffff823ff870 R15: 00000000000010d0
[    0.456400] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.457798] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.458666] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.459586] Call Trace:
[    0.459905] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.460792] #PF: supervisor read access in kernel mode
[    0.461488] #PF: error_code(0x0000) - not-present page
[    0.462148] PGD 0 P4D 0 
[    0.462495] Thread overran stack, or stack corrupted
[    0.463146] Oops: 0000 [#27] SMP PTI
[    0.463609] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.464519] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.465723] RIP: 0010:get_stack_info+0xa7/0x146
[    0.466307] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.468733] RSP: 0000:ffffffff823ff2d0 EFLAGS: 00010006
[    0.469408] RAX: 0000000000002000 RBX: ffffffff823ff3c0 RCX: 0000000000001000
[    0.470328] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010d8
[    0.471243] RBP: 00000000000010d8 R08: ffffffff82404000 R09: 0000000000000001
[    0.472164] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.473103] R13: ffffffff823ff3e0 R14: ffffffff823ff5a0 R15: 00000000000010d8
[    0.474021] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.475065] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.475807] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.476728] Call Trace:
[    0.477046] BUG: unable to handle page fault for address: 0000000000001ff0
[    0.477935] #PF: supervisor read access in kernel mode
[    0.478598] #PF: error_code(0x0000) - not-present page
[    0.479253] PGD 0 P4D 0 
[    0.479578] Thread overran stack, or stack corrupted
[    0.480309] Oops: 0000 [#28] SMP PTI
[    0.480767] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
[    0.481672] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
[    0.482865] RIP: 0010:get_stack_info+0xa7/0x146
[    0.483448] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.485908] RSP: 0000:ffffffff823ff000 EFLAGS: 00010006
[    0.486617] RAX: 0000000000002000 RBX: ffffffff823ff0f0 RCX: 0000000000001000
[    0.487584] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 00000000000010e0
[    0.488503] RBP: 00000000000010e0 R08: ffffffff82404000 R09: 0000000000000001
[    0.489422] R10: 7effc073058b4865 R11: 0000000000000000 R12: ffffffff82419800
[    0.490341] R13: ffffffff823ff110 R14: ffffffff823ff2d0 R15: 00000000000010e0
[    0.491301] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.492346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.493082] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.493998] Call Trace:
[    0.494312] CR2: 0000000000001ff0
[    0.494794] random: get_random_bytes called from init_oops_id+0x22/0x31 with crng_init=0
[    0.495905] ---[ end trace 5e20689545d6e929 ]---
[    0.496533] RIP: 0010:get_stack_info+0xa7/0x146
[    0.497116] Code: 04 d5 44 4a 00 82 66 85 c0 74 25 8b 0c d5 40 4a 00 82 0f b7 14 d5 46 4a 00 82 48 01 f1 48 01 c8 89 13 48 89 4b 08 48 89 43 10 <48> 8b 40 f0 eb 2b 65 48 8b 05 73 c0 ff 7e 48 8d 90 00 c0 ff ff 48
[    0.499567] RSP: 0000:ffffffff82403bf0 EFLAGS: 00010006
[    0.500237] RAX: 0000000000002000 RBX: ffffffff82403c90 RCX: 0000000000001000
[    0.501179] RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000001008
[    0.502090] RBP: 0000000000001008 R08: ffffffff82404000 R09: 0000000000000002
[    0.503034] R10: ffffffff82419800 R11: 000000000000000c R12: ffffffff82419800
[    0.503950] R13: ffffffff82403cb0 R14: ffffffff82403d20 R15: 0000000000001008
[    0.504867] FS:  0000000000000000(0000) GS:ffffffff82914000(0000) knlGS:0000000000000000
[    0.505908] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.506696] CR2: 0000000000001ff0 CR3: 0000000002412000 CR4: 00000000000606b0
[    0.507614] Kernel panic - not syncing: Attempted to kill the idle task!
[    0.508501] Rebooting in 5 seconds..
QEMU: Terminated
\r

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05 18:17       ` Amir Goldstein
@ 2019-11-05 18:22         ` Catalin Marinas
  2019-11-05 18:49           ` Thomas Gleixner
  0 siblings, 1 reply; 10+ messages in thread
From: Catalin Marinas @ 2019-11-05 18:22 UTC (permalink / raw)
  To: Amir Goldstein
  Cc: Theodore Tso, fstests, Matthew Wilcox, Michal Hocko, Qian Cai,
	Andrew Morton, Linus Torvalds, Linux MM, linux-kernel,
	Thomas Gleixner

On Tue, Nov 05, 2019 at 08:17:11PM +0200, Amir Goldstein wrote:
> On Tue, Nov 5, 2019 at 5:31 PM Catalin Marinas <catalin.marinas@arm.com> wrote:
> >
> > On Tue, Nov 05, 2019 at 02:33:48PM +0200, Amir Goldstein wrote:
> > > On Tue, Nov 5, 2019 at 1:54 PM Catalin Marinas <catalin.marinas@arm.com> wrote:
> > > > (sorry if you got this message twice; our SMTP server went bust)
> > > >
> > > > On Tue, Nov 05, 2019 at 09:14:06AM +0200, Amir Goldstein wrote:
> > > > > My kvm-xfstests [1] VM doesn't boot with kmemleak enabled since commit
> > > > > c5665868183f ("mm: kmemleak: use the memory pool for early allocations").
> > > > >
> > > > > There is no console output when running:
> > > > >
> > > > > $ kvm -boot order=c -net none -machine type=pc,accel=kvm:tcg -cpu host \
> > > > >     -drive file=$ROOTFS,if=virtio,snapshot=on -vga none -nographic \
> > > > >     -smp 2 -m 2048 -serial mon:stdio --kernel $KERNEL \
> > > > >     --append 'root=/dev/vda console=ttyS0,115200'
> > > >
> > > > This was fixed in 5.4-rc4, see commit 2abd839aa7e6 ("kmemleak: Do not
> > > > corrupt the object_list during clean-up").
> > >
> > > Did not fix my issue.
> > > Still not booting with 5.4-rc6.
> > > Any other suggestions?
> >
> > Can you pass an earlyprintk=ttyS0,115200 (if that's the correct x86
> > syntax) on the kernel command line? It may print some early messages
> > that would help with debugging.
[...]
> [    0.022796] BUG: unable to handle page fault for address: 0000000000001ff0
> [    0.023682] #PF: supervisor read access in kernel mode
> [    0.024341] #PF: error_code(0x0000) - not-present page
> [    0.025000] PGD 0 P4D 0 
> [    0.025326] Oops: 0000 [#1] SMP PTI
> [    0.025775] CPU: 0 PID: 0 Comm: swapper Not tainted 5.4.0-rc6-xfstests #4302
> [    0.026683] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1ubuntu1 04/01/2014
> [    0.027836] RIP: 0010:get_stack_info+0xa7/0x146

Ah, it looks very similar to this report:

http://lkml.kernel.org/r/20191019114421.GK9698@uranus.lan

Thomas had a patch here:

https://lore.kernel.org/linux-mm/alpine.DEB.2.21.1910231950590.1852@nanos.tec.linutronix.de/

but not sure whether it has hit mainline yet.

-- 
Catalin

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05 18:22         ` Catalin Marinas
@ 2019-11-05 18:49           ` Thomas Gleixner
  2019-11-05 19:26             ` Amir Goldstein
  0 siblings, 1 reply; 10+ messages in thread
From: Thomas Gleixner @ 2019-11-05 18:49 UTC (permalink / raw)
  To: Catalin Marinas
  Cc: Amir Goldstein, Theodore Tso, fstests, Matthew Wilcox,
	Michal Hocko, Qian Cai, Andrew Morton, Linus Torvalds, Linux MM,
	linux-kernel

On Tue, 5 Nov 2019, Catalin Marinas wrote:
> On Tue, Nov 05, 2019 at 08:17:11PM +0200, Amir Goldstein wrote:
> > [    0.027836] RIP: 0010:get_stack_info+0xa7/0x146
> 
> Ah, it looks very similar to this report:
> 
> http://lkml.kernel.org/r/20191019114421.GK9698@uranus.lan
> 
> Thomas had a patch here:
> 
> https://lore.kernel.org/linux-mm/alpine.DEB.2.21.1910231950590.1852@nanos.tec.linutronix.de/
> 
> but not sure whether it has hit mainline yet.

It's queued in tip. Will hit Linus tree during the week.

Thanks,

	tglx

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: 5.4-rc1 boot regression with kmemleak enabled
  2019-11-05 18:49           ` Thomas Gleixner
@ 2019-11-05 19:26             ` Amir Goldstein
  0 siblings, 0 replies; 10+ messages in thread
From: Amir Goldstein @ 2019-11-05 19:26 UTC (permalink / raw)
  To: Thomas Gleixner
  Cc: Catalin Marinas, Theodore Tso, fstests, Matthew Wilcox,
	Michal Hocko, Qian Cai, Andrew Morton, Linus Torvalds, Linux MM,
	linux-kernel

On Tue, Nov 5, 2019 at 8:49 PM Thomas Gleixner <tglx@linutronix.de> wrote:
>
> On Tue, 5 Nov 2019, Catalin Marinas wrote:
> > On Tue, Nov 05, 2019 at 08:17:11PM +0200, Amir Goldstein wrote:
> > > [    0.027836] RIP: 0010:get_stack_info+0xa7/0x146
> >
> > Ah, it looks very similar to this report:
> >
> > http://lkml.kernel.org/r/20191019114421.GK9698@uranus.lan
> >
> > Thomas had a patch here:
> >
> > https://lore.kernel.org/linux-mm/alpine.DEB.2.21.1910231950590.1852@nanos.tec.linutronix.de/
> >
> > but not sure whether it has hit mainline yet.
>
> It's queued in tip. Will hit Linus tree during the week.
>

Works for me.
Thanks,
Amir.

^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2019-11-05 20:50 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-11-05  7:14 5.4-rc1 boot regression with kmemleak enabled Amir Goldstein
2019-11-05  9:02 ` Catalin Marinas
2019-11-05  9:23 ` Qian Cai
2019-11-05 11:54 ` Catalin Marinas
2019-11-05 12:33   ` Amir Goldstein
2019-11-05 15:30     ` Catalin Marinas
2019-11-05 18:17       ` Amir Goldstein
2019-11-05 18:22         ` Catalin Marinas
2019-11-05 18:49           ` Thomas Gleixner
2019-11-05 19:26             ` Amir Goldstein

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).