* 💥 PANICKED: Test report for kernel 5.12.0-rc8 (block, ffa77af5)
@ 2021-04-26 8:23 CKI Project
[not found] ` <CA+QYu4r1kC6VsaPzv0kN61fkrZZ6cxxOPh5_wrgUeZrLK-Dkng@mail.gmail.com>
0 siblings, 1 reply; 2+ messages in thread
From: CKI Project @ 2021-04-26 8:23 UTC (permalink / raw)
To: skt-results-master, linux-block, axboe
Cc: Yi Zhang, Memory Management, Jan Stancek
Hello,
We ran automated tests on a recent commit from this kernel tree:
Kernel repo: https://git.kernel.org/pub/scm/linux/kernel/git/axboe/linux-block.git
Commit: ffa77af5731d - Merge branch 'for-5.13/io_uring' into for-next
The results of these automated tests are provided below.
Overall result: FAILED (see details below)
Merge: OK
Compile: OK
Tests: PANICKED
All kernel binaries, config files, and logs are available for download here:
https://arr-cki-prod-datawarehouse-public.s3.amazonaws.com/index.html?prefix=datawarehouse-public/2021/04/25/291970951
One or more kernel tests failed:
s390x:
💥 Storage blktests
💥 LTP
ppc64le:
💥 Boot test
💥 Boot test
aarch64:
💥 Boot test
💥 Boot test
x86_64:
💥 Boot test
💥 Boot test
💥 Boot test
💥 Boot test
💥 Boot test
💥 Boot test
We hope that these logs can help you find the problem quickly. For the full
detail on our testing procedures, please scroll to the bottom of this message.
Please reply to this email if you have any questions about the tests that we
ran or if you have any suggestions on how to make future tests more effective.
,-. ,-.
( C ) ( K ) Continuous
`-',-.`-' Kernel
( I ) Integration
`-'
______________________________________________________________________________
Compile testing
---------------
We compiled the kernel for 4 architectures:
aarch64:
make options: make -j24 INSTALL_MOD_STRIP=1 targz-pkg
ppc64le:
make options: make -j24 INSTALL_MOD_STRIP=1 targz-pkg
s390x:
make options: make -j24 INSTALL_MOD_STRIP=1 targz-pkg
x86_64:
make options: make -j24 INSTALL_MOD_STRIP=1 targz-pkg
Hardware testing
----------------
We booted each kernel and ran the following tests:
aarch64:
Host 1:
❌ Boot test
⚡⚡⚡ ACPI table test
⚡⚡⚡ LTP
⚡⚡⚡ CIFS Connectathon
⚡⚡⚡ POSIX pjd-fstest suites
⚡⚡⚡ Loopdev Sanity
⚡⚡⚡ Memory: fork_mem
⚡⚡⚡ Memory function: memfd_create
⚡⚡⚡ AMTU (Abstract Machine Test Utility)
⚡⚡⚡ Ethernet drivers sanity
⚡⚡⚡ storage: SCSI VPD
Host 2:
❌ Boot test
⚡⚡⚡ xfstests - ext4
⚡⚡⚡ xfstests - xfs
⚡⚡⚡ storage: software RAID testing
⚡⚡⚡ Storage: swraid mdadm raid_module test
🚧 ⚡⚡⚡ xfstests - btrfs
🚧 ⚡⚡⚡ Storage blktests
🚧 ⚡⚡⚡ Storage block - filesystem fio test
🚧 ⚡⚡⚡ Storage block - queue scheduler test
🚧 ⚡⚡⚡ Storage nvme - tcp
🚧 ⚡⚡⚡ Storage: lvm device-mapper test
🚧 ⚡⚡⚡ stress: stress-ng
ppc64le:
Host 1:
❌ Boot test
⚡⚡⚡ LTP
⚡⚡⚡ CIFS Connectathon
⚡⚡⚡ POSIX pjd-fstest suites
⚡⚡⚡ Loopdev Sanity
⚡⚡⚡ Memory: fork_mem
⚡⚡⚡ Memory function: memfd_create
⚡⚡⚡ AMTU (Abstract Machine Test Utility)
⚡⚡⚡ Ethernet drivers sanity
Host 2:
❌ Boot test
⚡⚡⚡ xfstests - ext4
⚡⚡⚡ xfstests - xfs
⚡⚡⚡ storage: software RAID testing
⚡⚡⚡ Storage: swraid mdadm raid_module test
🚧 ⚡⚡⚡ xfstests - btrfs
🚧 ⚡⚡⚡ Storage blktests
🚧 ⚡⚡⚡ Storage block - filesystem fio test
🚧 ⚡⚡⚡ Storage block - queue scheduler test
🚧 ⚡⚡⚡ Storage nvme - tcp
🚧 ⚡⚡⚡ Storage: lvm device-mapper test
s390x:
Host 1:
✅ Boot test
✅ Storage: swraid mdadm raid_module test
🚧 💥 Storage blktests
🚧 ⚡⚡⚡ Storage nvme - tcp
🚧 ⚡⚡⚡ stress: stress-ng
Host 2:
✅ Boot test
💥 LTP
⚡⚡⚡ CIFS Connectathon
⚡⚡⚡ POSIX pjd-fstest suites
⚡⚡⚡ Loopdev Sanity
⚡⚡⚡ Memory: fork_mem
⚡⚡⚡ Memory function: memfd_create
⚡⚡⚡ AMTU (Abstract Machine Test Utility)
⚡⚡⚡ Ethernet drivers sanity
x86_64:
Host 1:
❌ Boot test
⚡⚡⚡ xfstests - ext4
⚡⚡⚡ xfstests - xfs
⚡⚡⚡ xfstests - nfsv4.2
⚡⚡⚡ storage: software RAID testing
⚡⚡⚡ Storage: swraid mdadm raid_module test
🚧 ⚡⚡⚡ xfstests - btrfs
🚧 ⚡⚡⚡ xfstests - cifsv3.11
🚧 ⚡⚡⚡ Storage blktests
🚧 ⚡⚡⚡ Storage block - filesystem fio test
🚧 ⚡⚡⚡ Storage block - queue scheduler test
🚧 ⚡⚡⚡ Storage nvme - tcp
🚧 ⚡⚡⚡ Storage: lvm device-mapper test
🚧 ⚡⚡⚡ stress: stress-ng
Host 2:
❌ Boot test
⚡⚡⚡ Storage SAN device stress - mpt3sas_gen1
Host 3:
❌ Boot test
⚡⚡⚡ Storage SAN device stress - qla2xxx driver
Host 4:
❌ Boot test
⚡⚡⚡ Storage SAN device stress - qedf driver
Host 5:
❌ Boot test
⚡⚡⚡ Storage SAN device stress - lpfc driver
Host 6:
❌ Boot test
⚡⚡⚡ ACPI table test
⚡⚡⚡ LTP
⚡⚡⚡ CIFS Connectathon
⚡⚡⚡ POSIX pjd-fstest suites
⚡⚡⚡ Loopdev Sanity
⚡⚡⚡ Memory: fork_mem
⚡⚡⚡ Memory function: memfd_create
⚡⚡⚡ AMTU (Abstract Machine Test Utility)
⚡⚡⚡ Ethernet drivers sanity
⚡⚡⚡ storage: SCSI VPD
Test sources: https://gitlab.com/cki-project/kernel-tests
💚 Pull requests are welcome for new tests or improvements to existing tests!
Aborted tests
-------------
Tests that didn't complete running successfully are marked with ⚡⚡⚡.
If this was caused by an infrastructure issue, we try to mark that
explicitly in the report.
Waived tests
------------
If the test run included waived tests, they are marked with 🚧. Such tests are
executed but their results are not taken into account. Tests are waived when
their results are not reliable enough, e.g. when they're just introduced or are
being fixed.
Testing timeout
---------------
We aim to provide a report within reasonable timeframe. Tests that haven't
finished running yet are marked with ⏱.
^ permalink raw reply [flat|nested] 2+ messages in thread
* Re: 💥 PANICKED: Test report for kernel 5.12.0-rc8 (block, ffa77af5)
[not found] ` <CA+QYu4r1kC6VsaPzv0kN61fkrZZ6cxxOPh5_wrgUeZrLK-Dkng@mail.gmail.com>
@ 2021-04-26 12:47 ` Jens Axboe
0 siblings, 0 replies; 2+ messages in thread
From: Jens Axboe @ 2021-04-26 12:47 UTC (permalink / raw)
To: Bruno Goncalves, CKI Project
Cc: skt-results-master, linux-block, Memory Management, Jan Stancek,
Yi Zhang
On 4/26/21 2:40 AM, Bruno Goncalves wrote:
> We hit kernel panic with the recent commit (ffa77af5), like:
>
> [ 5.093548] usb 2-2: Product: AVO USB2 RIP
> [ 5.101546] ata3.00: configured for UDMA/100
> [ 5.104910] usb 2-2: Manufacturer: Avocent
> [ 5.104912] usb 2-2: SerialNumber: 10343009E7D
> [ 5.106686] device-mapper: uevent: version 1.0.3
> [ 5.106719] BUG: kernel NULL pointer dereference, address: 0000000000000378
> [ 5.106721] #PF: supervisor read access in kernel mode
> [ 5.106722] #PF: error_code(0x0000) - not-present page
> [ 5.106724] PGD 0 P4D 0
> [ 5.106726] Oops: 0000 [#1] SMP PTI
> [ 5.106728] CPU: 2 PID: 7 Comm: kworker/u65:0 Tainted: G I 5.12.0-rc8 #1
> [ 5.106731] Hardware name: Hewlett-Packard HP Z600 Workstation/0B54h, BIOS 786G4 v03.19 03/11/2011
> [ 5.106732] Workqueue: events_unbound async_run_entry_fn
> [ 5.106738] RIP: 0010:bio_add_hw_page+0x4f/0x180
> [ 5.106741] Code: 09 44 39 c8 0f 87 f3 00 00 00 0f b7 46 70 49 89 fc 49 89 d6 45 89 c5 66 85 c0 75 60 66 39 43 72 0f 86 d7 00 00 00 48 8b 53 08 <48> 8b 92 78 03 00 00 48 8b 52 50 8b 92 10 04 00 00 29 ea 39 53 28
> [ 5.106743] RSP: 0000:ffffa1c64005fc38 EFLAGS: 00010202
> [ 5.106745] RAX: 0000000000000000 RBX: ffff956641caad80 RCX: 0000000000000024
> [ 5.106747] RDX: 0000000000000000 RSI: ffff956641caad80 RDI: ffff95667679afa0
> [ 5.106748] RBP: 0000000000000024 R08: 0000000000000200 R09: 0000000000000400
> [ 5.106749] R10: 0000000000000002 R11: ffff956641ca9e8f R12: ffff95667679afa0
> [ 5.106750] R13: 0000000000000200 R14: ffffc299c00a9b40 R15: 0000000000000024
> [ 5.106752] FS: 0000000000000000(0000) GS:ffff9566fc080000(0000) knlGS:0000000000000000
> [ 5.106754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 5.106755] CR2: 0000000000000378 CR3: 000000002a610001 CR4: 00000000000206e0
> [ 5.106757] Call Trace:
> [ 5.106760] bio_add_pc_page+0x20/0x30
> [ 5.106762] blk_rq_map_kern+0x139/0x3f0
> [ 5.106765] __scsi_execute+0x204/0x250
> [ 5.106770] scsi_probe_and_add_lun+0x188/0xda0
> [ 5.106774] ? __pm_runtime_resume+0x58/0x80
> [ 5.106778] __scsi_add_device+0xdb/0xf0
> [ 5.106781] ata_scsi_scan_host+0x97/0x1d0
> [ 5.106784] async_run_entry_fn+0x39/0x160
> [ 5.106786] process_one_work+0x1ec/0x380
> [ 5.106789] worker_thread+0x53/0x3e0
> [ 5.106791] ? process_one_work+0x380/0x380
> [ 5.106793] kthread+0x11b/0x140
> [ 5.106796] ? __kthread_bind_mask+0x60/0x60
> [ 5.106798] ret_from_fork+0x22/0x30
> [ 5.106804] Modules linked in:
> [ 5.106805] CR2: 0000000000000378
> [ 5.106807] ---[ end trace 9b02598b51db6513 ]---
> [ 5.106808] RIP: 0010:bio_add_hw_page+0x4f/0x180
> [ 5.106811] Code: 09 44 39 c8 0f 87 f3 00 00 00 0f b7 46 70 49 89 fc 49 89 d6 45 89 c5 66 85 c0 75 60 66 39 43 72 0f 86 d7 00 00 00 48 8b 53 08 <48> 8b 92 78 03 00 00 48 8b 52 50 8b 92 10 04 00 00 29 ea 39 53 28
> [ 5.106813] RSP: 0000:ffffa1c64005fc38 EFLAGS: 00010202
> [ 5.106814] RAX: 0000000000000000 RBX: ffff956641caad80 RCX: 0000000000000024
> [ 5.106816] RDX: 0000000000000000 RSI: ffff956641caad80 RDI: ffff95667679afa0
> [ 5.106817] RBP: 0000000000000024 R08: 0000000000000200 R09: 0000000000000400
> [ 5.106818] R10: 0000000000000002 R11: ffff956641ca9e8f R12: ffff95667679afa0
> [ 5.106819] R13: 0000000000000200 R14: ffffc299c00a9b40 R15: 0000000000000024
> [ 5.106820] FS: 0000000000000000(0000) GS:ffff9566fc080000(0000) knlGS:0000000000000000
> [ 5.106822] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 5.106823] CR2: 0000000000000378 CR3: 000000002a610001 CR4: 00000000000206e0
> [ 5.410328] device-mapper: ioctl: 4.44.0-ioctl (2021-02-01) initialised: dm-devel@redhat.com <mailto:dm-devel@redhat.com>
>
>
> We can't say for sure what commit introduced the problem, but with commit "e62a826b" we didn't see this issue.
It was:
commit 15050b63567cb841e2b4137b957df52991f3b8ec
Author: Changheun Lee <nanich.lee@samsung.com>
Date: Wed Apr 21 18:47:45 2021 +0900
bio: limit bio max size
and it has been dropped.
--
Jens Axboe
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2021-04-26 12:47 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-04-26 8:23 💥 PANICKED: Test report for kernel 5.12.0-rc8 (block, ffa77af5) CKI Project
[not found] ` <CA+QYu4r1kC6VsaPzv0kN61fkrZZ6cxxOPh5_wrgUeZrLK-Dkng@mail.gmail.com>
2021-04-26 12:47 ` Jens Axboe
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.