Greetings, 0day kernel testing robot got the below dmesg and the first bad commit is https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master commit 3b745c8969c752601cb68c82a06735363563ab42 Author: Joel Fernandes (Google) AuthorDate: Sun Jun 10 16:45:44 2018 -0700 Commit: Paul E. McKenney CommitDate: Thu Jul 12 15:42:06 2018 -0700 rcutorture: Make boost test more robust Currently, with RCU_BOOST disabled, I get no failures when forcing rcutorture to test RCU boost priority inversion. The reason seems to be that we don't check for failures if the callback never ran at all for the duration of the boost-test loop. Further, the 'rtb' and 'rtbf' counters seem to be used inconsistently. 'rtb' is incremented at the start of each test and 'rtbf' is incremented per-cpu on each failure of call_rcu. So its possible 'rtbf' > 'rtb'. To test the boost with rcutorture, I did following on a 4-CPU x86 machine: modprobe rcutorture test_boost=2 sleep 20 rmmod rcutorture With patch: rtbf: 8 rtb: 12 Without patch: rtbf: 0 rtb: 2 In summary this patch: - Increments failed and total test counters once per boost-test. - Checks for failure cases correctly. Signed-off-by: Joel Fernandes (Google) Signed-off-by: Paul E. McKenney 450efca718 rcutorture: Disable RT throttling for boost tests 3b745c8969 rcutorture: Make boost test more robust c307aaf3eb Merge tag 'iommu-fixes-v4.19-rc5' of git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu 9aa0219c6a Add linux-next specific files for 20180926 +---------------------------------------------------------------------------------------+------------+------------+------------+---------------+ | | 450efca718 | 3b745c8969 | c307aaf3eb | next-20180926 | +---------------------------------------------------------------------------------------+------------+------------+------------+---------------+ | boot_successes | 182 | 0 | 37 | 0 | | boot_failures | 13 | 16 | 34 | 16 | | BUG:kernel_hang_in_test_stage | 8 | 7 | 4 | | | BUG:workqueue_lockup-pool | 4 | 2 | 1 | | | INFO:rcu_preempt_detected_stalls_on_CPUs/tasks | 1 | | | | | EIP:lock_is_held_type | 5 | 4 | 3 | | | EIP:___might_sleep | 4 | 2 | 3 | | | INFO:rcu_preempt_self-detected_stall_on_CPU | 4 | 4 | 3 | | | EIP:debug_lockdep_rcu_enabled | 1 | 2 | 2 | | | INFO:rcu_sched_detected_stalls_on_CPUs/tasks | 1 | 2 | 1 | | | Mem-Info | 1 | | | | | invoked_oom-killer:gfp_mask=0x | 1 | | | | | WARNING:at_kernel/rcu/rcutorture.c:#rcu_torture_stats_print | 0 | 7 | 29 | | | EIP:rcu_torture_stats_print | 0 | 7 | 29 | | | EIP:stutter_wait | 0 | 1 | | | | EIP:__lock_is_held | 0 | 1 | | | | EIP:queued_spin_lock_slowpath | 0 | 0 | 3 | | | INFO:rcu_sched_self-detected_stall_on_CPU | 0 | 0 | 1 | | | IP-Config:Auto-configuration_of_network_failed | 0 | 0 | 2 | | | BUG:sleeping_function_called_from_invalid_context_at_security/apparmor/include/cred.h | 0 | 0 | 0 | 16 | +---------------------------------------------------------------------------------------+------------+------------+------------+---------------+ [ 66.041535] init: tty2 main process ended, respawning [ 66.073982] init: tty3 main process (1857) terminated with status 1 [ 66.075086] init: tty3 main process ended, respawning [ 71.320525] rcu-torture: rtc: (ptrval) ver: 274 tfle: 0 rta: 275 rtaf: 0 rtf: 261 rtmbe: 0 rtbe: 0 rtbke: 0 rtbre: 0 rtbf: 10 rtb: 12 nt: 612 barrier: 0/0:0 cbflood: 11 [ 71.340077] rcu-torture: !!! [ 71.340100] WARNING: CPU: 1 PID: 48 at kernel/rcu/rcutorture.c:1478 rcu_torture_stats_print+0x198/0x389 [ 71.342317] Modules linked in: [ 71.342809] CPU: 1 PID: 48 Comm: rcu_torture_sta Tainted: G T 4.18.0-rc1-00089-g3b745c8 #1 [ 71.344269] EIP: rcu_torture_stats_print+0x198/0x389 [ 71.345037] Code: 3d 88 61 93 ca 00 75 0c 83 3d 84 61 93 ca 00 75 03 4b 7e 1a 68 ec 6c dc c9 68 0f 5f db c9 e8 59 60 ff ff f0 ff 05 94 61 93 ca <0f> 0b 58 5a 68 f1 6c dc c9 31 db e8 42 60 ff ff 5f ff 74 9d 9c 43 [ 71.348018] EAX: 00000004 EBX: 00000001 ECX: 00000001 EDX: 00000007 [ 71.348975] ESI: 00000105 EDI: ca110da0 EBP: d0a1ff84 ESP: d0a1ff08 [ 71.349935] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010202 [ 71.350977] CR0: 80050033 CR2: b7f22060 CR3: 176c09e0 CR4: 000006b0 [ 71.351933] DR0: 080d3000 DR1: b79d5800 DR2: 00000000 DR3: 00000000 [ 71.365922] DR6: ffff0ff0 DR7: 00000600 [ 71.366527] Call Trace: [ 71.366935] rcu_torture_stats+0x38/0x59 [ 71.367555] kthread+0xef/0xf4 [ 71.368036] ? rcu_torture_stats_print+0x389/0x389 [ 71.368787] ? kthread_flush_work_fn+0xd/0xd [ 71.369449] ret_from_fork+0x19/0x24 [ 71.370019] irq event stamp: 128 [ 71.370528] hardirqs last enabled at (127): [] console_unlock+0x42f/0x46a [ 71.371705] hardirqs last disabled at (128): [] common_exception+0x39/0x42 [ 71.372875] softirqs last enabled at (110): [] __do_softirq+0x18e/0x1c4 [ 71.374029] softirqs last disabled at (79): [] do_softirq_own_stack+0x1d/0x23 [ 71.375247] ---[ end trace bfc17b1da179232b ]--- [ 71.405196] Reader Pipe: 4555290 39 0 0 0 0 0 0 0 0 0 # HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD git bisect start 6bf4ca7fbc85d80446ac01c0d1d77db4d91a6d84 v4.18 -- git bisect bad ee090756962c58b32af62b768ac7c58cc53af700 # 16:43 B 2 10 1 1 Merge tag 'armsoc-defconfig' of git://git.kernel.org/pub/scm/linux/kernel/git/arm/arm-soc git bisect bad c1c2ad82c772966d3cdb9a4852329fa2cf71853a # 16:54 B 2 3 0 0 Merge tag 'edac_for_4.19' of git://git.kernel.org/pub/scm/linux/kernel/git/bp/bp git bisect bad 10f3e23f07cb0c20f9bcb77a5b5a7eb2a1b2a2fe # 17:05 B 0 2 18 1 Merge tag 'ext4_for_linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tytso/ext4 git bisect bad 30de24c7dd21348b142ee977b687afc70b392af6 # 17:20 B 0 1 16 0 Merge branch 'x86-cache-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect bad de5d1b39ea0b38a9f4dfb08966042b7b91e2df30 # 17:32 B 0 1 16 0 Merge branch 'locking-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect bad b99cdfdf0b1c077dcb24c0053d36d4ff5832224e # 17:47 B 1 2 1 1 Merge branch 'core-rcu-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good 0ad6b38ab2cc00b886c34d945b6a30fdf5108c61 # 18:05 G 16 0 0 0 Merge branch 'core-debugobjects-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good 400439275d9543286f9d3f2925c3156f888e6b18 # 18:16 G 16 0 0 0 Merge branch 'efi-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good d0daaeaf60143c02a2ef87f9f0703b63a0a7f8b3 # 18:26 G 16 0 0 0 Merge branch 'irq-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good c74859d1eb2d8578bdf6d78ba893e394085aba1a # 18:40 G 15 0 2 2 rcu: Make rcu_report_unblock_qs_rnp() warn on violated preconditions git bisect good 9622179519c52ead944c3b6a07aed9c6db3659e2 # 18:54 G 16 0 2 2 rcu: Remove "inline" from rcu_perf_print_module_parms() git bisect good c7cd161ecb2188c07ba9560ca82aee756575359f # 19:07 G 16 0 0 0 rcu: Assign higher prio to RCU threads if rcutorture is built-in git bisect good 2397d072f76b552fc21cda19686d24a8066ced22 # 19:20 G 16 0 0 0 rcutorture: Handle extended read-side critical sections git bisect bad 622be33fcbc93e9b672b99ed338369eb5e843ac3 # 19:31 B 1 1 1 1 rcutorture: Use monotonic timestamp for stall detection git bisect good 450efca7182a516a12dfcc0311abfd242bde42b2 # 20:14 G 16 0 3 3 rcutorture: Disable RT throttling for boost tests git bisect bad 3b745c8969c752601cb68c82a06735363563ab42 # 20:23 B 0 2 17 0 rcutorture: Make boost test more robust # first bad commit: [3b745c8969c752601cb68c82a06735363563ab42] rcutorture: Make boost test more robust git bisect good 450efca7182a516a12dfcc0311abfd242bde42b2 # 20:53 G 45 0 6 9 rcutorture: Disable RT throttling for boost tests # extra tests with debug options git bisect bad 3b745c8969c752601cb68c82a06735363563ab42 # 21:05 B 0 1 16 0 rcutorture: Make boost test more robust # extra tests on HEAD of linux-devel/devel-spot-201809251433 git bisect bad 030b766240e3f8af8ca8cf9de250d492a894e638 # 21:05 B 1 9 0 4 0day head guard for 'devel-spot-201809251433' # extra tests on tree/branch linus/master git bisect bad c307aaf3eb47969105887e4e8991ec00960a7ce8 # 21:54 B 4 7 1 1 Merge tag 'iommu-fixes-v4.19-rc5' of git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu # extra tests with first bad commit reverted git bisect good 7fb1a0a661cc3bd8653194d8dcd6680e43f1deee # 00:23 G 16 0 2 2 Revert "rcutorture: Make boost test more robust" # extra tests on tree/branch linux-next/master git bisect good 9aa0219c6a4cdb18c18e1b7b18202274ca802ccc # 00:34 G 16 0 16 16 Add linux-next specific files for 20180926 --- 0-DAY kernel test infrastructure Open Source Technology Center https://lists.01.org/pipermail/lkp Intel Corporation