On Wed, Aug 12, 2020 at 7:54 AM Vojtech Myslivec <vojtech@xmyslivec.cz> wrote:
>
> My colleague Michal replied to that On 05. 08. 2020:

I can't find any reply
https://lore.kernel.org/linux-raid/20200812141931.bT6w5ZM3DAPlTLvmUW5CIJWTqeVTrI7MAxdY33Z4JT8@z/

> I attach sysrq logs again here

Song requested " /proc/<pid>/stack for <pid> of md1_raid6? We may want
to sample it multiple times. "

But the tarball shows both copies empty
/proc/909/stack

sysrq+w I'll also try to attach as a file because I bet gmail will
screw up the wrapping in the paste:

Jul 31 16:31:40 backup1 kernel: sysrq: Show Blocked State
Jul 31 16:31:40 backup1 kernel:   task                        PC stack
  pid father
Jul 31 16:31:40 backup1 kernel: md1_reclaim     D    0   910      2 0x80004000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  ? __switch_to_asm+0x34/0x70
Jul 31 16:31:40 backup1 kernel:  ? __switch_to_asm+0x34/0x70
Jul 31 16:31:40 backup1 kernel:  ? wbt_exit+0x30/0x30
Jul 31 16:31:40 backup1 kernel:  ? __wbt_done+0x30/0x30
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  io_schedule+0x12/0x40
Jul 31 16:31:40 backup1 kernel:  rq_qos_wait+0xfa/0x170
Jul 31 16:31:40 backup1 kernel:  ? __switch_to_asm+0x34/0x70
Jul 31 16:31:40 backup1 kernel:  ? karma_partition+0x210/0x210
Jul 31 16:31:40 backup1 kernel:  ? wbt_exit+0x30/0x30
Jul 31 16:31:40 backup1 kernel:  wbt_wait+0x99/0xe0
Jul 31 16:31:40 backup1 kernel:  __rq_qos_throttle+0x23/0x30
Jul 31 16:31:40 backup1 kernel:  blk_mq_make_request+0x12a/0x5d0
Jul 31 16:31:40 backup1 kernel:  generic_make_request+0xcf/0x310
Jul 31 16:31:40 backup1 kernel:  submit_bio+0x42/0x1c0
Jul 31 16:31:40 backup1 kernel:  ? md_super_write.part.70+0x98/0x120 [md_mod]
Jul 31 16:31:40 backup1 kernel:  md_update_sb.part.71+0x3c0/0x8f0 [md_mod]
Jul 31 16:31:40 backup1 kernel:  r5l_do_reclaim+0x32a/0x3b0 [raid456]
Jul 31 16:31:40 backup1 kernel:  ? schedule_timeout+0x161/0x310
Jul 31 16:31:40 backup1 kernel:  ? prepare_to_wait_event+0xb6/0x140
Jul 31 16:31:40 backup1 kernel:  ? md_register_thread+0xd0/0xd0 [md_mod]
Jul 31 16:31:40 backup1 kernel:  md_thread+0x94/0x150 [md_mod]
Jul 31 16:31:40 backup1 kernel:  ? finish_wait+0x80/0x80
Jul 31 16:31:40 backup1 kernel:  kthread+0x112/0x130
Jul 31 16:31:40 backup1 kernel:  ? kthread_park+0x80/0x80
Jul 31 16:31:40 backup1 kernel:  ret_from_fork+0x22/0x40
Jul 31 16:31:40 backup1 kernel: btrfs-transacti D    0 10200      2 0x80004000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  io_schedule+0x12/0x40
Jul 31 16:31:40 backup1 kernel:  wait_on_page_bit+0x15c/0x230
Jul 31 16:31:40 backup1 kernel:  ? file_fdatawait_range+0x20/0x20
Jul 31 16:31:40 backup1 kernel:  __filemap_fdatawait_range+0x89/0xf0
Jul 31 16:31:40 backup1 kernel:  ? __clear_extent_bit+0x2bd/0x440 [btrfs]
Jul 31 16:31:40 backup1 kernel:  filemap_fdatawait_range+0xe/0x20
Jul 31 16:31:40 backup1 kernel:
__btrfs_wait_marked_extents.isra.20+0xc2/0x100 [btrfs]
Jul 31 16:31:40 backup1 kernel:
btrfs_write_and_wait_transaction.isra.24+0x67/0xd0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_commit_transaction+0x754/0xa40 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? start_transaction+0xbc/0x4d0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  transaction_kthread+0x144/0x170 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? btrfs_cleanup_transaction+0x5e0/0x5e0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  kthread+0x112/0x130
Jul 31 16:31:40 backup1 kernel:  ? kthread_park+0x80/0x80
Jul 31 16:31:40 backup1 kernel:  ret_from_fork+0x22/0x40
Jul 31 16:31:40 backup1 kernel: btrfs           D    0 30038  30032 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  wait_for_commit+0x58/0x80 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? finish_wait+0x80/0x80
Jul 31 16:31:40 backup1 kernel:  btrfs_commit_transaction+0x169/0xa40 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? btrfs_record_root_in_trans+0x56/0x60 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? start_transaction+0xbc/0x4d0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_mksubvol+0x4f0/0x530 [btrfs]
Jul 31 16:31:40 backup1 kernel:
btrfs_ioctl_snap_create_transid+0x170/0x180 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_create_v2+0x11c/0x180 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x11c2/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7fe919fb4427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007ffe760eac98 EFLAGS:
00000202 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007fe919fb4427
Jul 31 16:31:40 backup1 kernel: RDX: 00007ffe760eacd8 RSI:
0000000050009417 RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000559cb3d14260 R08:
0000000000000008 R09: 35315f31332d3730
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000202 R12: 0000559cb3d142a0
Jul 31 16:31:40 backup1 kernel: R13: 0000559cb3d142a0 R14:
0000000000000003 R15: 0000000000000004
Jul 31 16:31:40 backup1 kernel: btrfs           D    0 30247  30241 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  ? prep_new_page+0x90/0x140
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7fd2159c9427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007fff421698e8 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007fd2159c9427
Jul 31 16:31:40 backup1 kernel: RDX: 00007fff42169920 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
00005631102c22c8 R09: 00007fd215a53e80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007fff42169920 R15: 00005631102c22c8
Jul 31 16:31:40 backup1 kernel: btrfs           D    0 30586  30580 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f4e6e35a427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007fffb6891ab8 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f4e6e35a427
Jul 31 16:31:40 backup1 kernel: RDX: 00007fffb6891af0 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
000055a899f7f2ca R09: 00007f4e6e3e4e80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007fffb6891af0 R15: 000055a899f7f2ca
Jul 31 16:31:40 backup1 kernel: btrfs           D    0 30613  30607 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f527437f427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007ffe0dcd07d8 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f527437f427
Jul 31 16:31:40 backup1 kernel: RDX: 00007ffe0dcd0810 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
000055bf05f592c6 R09: 00007f5274409e80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007ffe0dcd0810 R15: 000055bf05f592c6
Jul 31 16:31:40 backup1 kernel: btrfs           D    0 31443  31437 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f6e74eb1427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007ffe270079f8 EFLAGS:
00000202 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f6e74eb1427
Jul 31 16:31:40 backup1 kernel: RDX: 00007ffe27007a30 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
000056037d0422ca R09: 00007f6e74f3be80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000202 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007ffe27007a30 R15: 000056037d0422ca
Jul 31 16:31:40 backup1 kernel: btrfs           D    0 31650  31644 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7fb16f9ae427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007ffd266be828 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007fb16f9ae427
Jul 31 16:31:40 backup1 kernel: RDX: 00007ffd266be860 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
0000563ccec6d2ca R09: 00007fb16fa38e80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007ffd266be860 R15: 0000563ccec6d2ca
Jul 31 16:31:40 backup1 kernel: btrfs           D    0 31813  31807 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f09dee75427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007ffeed6bea48 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f09dee75427
Jul 31 16:31:40 backup1 kernel: RDX: 00007ffeed6bea80 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
000055ebcdb522c8 R09: 00007f09deeffe80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007ffeed6bea80 R15: 000055ebcdb522c8
Jul 31 16:31:40 backup1 kernel: btrfs           D    0   417    411 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f614eb62427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007ffcb2850518 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f614eb62427
Jul 31 16:31:40 backup1 kernel: RDX: 00007ffcb2850550 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
000055f42641e2ca R09: 00007f614ebece80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007ffcb2850550 R15: 000055f42641e2ca
Jul 31 16:31:40 backup1 kernel: btrfs           D    0   573    567 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f40626c0427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007fffa93d57b8 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f40626c0427
Jul 31 16:31:40 backup1 kernel: RDX: 00007fffa93d57f0 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
000055bba6bae2c8 R09: 00007f406274ae80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007fffa93d57f0 R15: 000055bba6bae2c8
Jul 31 16:31:40 backup1 kernel: btrfs           D    0   811    805 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f434d293427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007fffb46312c8 EFLAGS:
00000202 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f434d293427
Jul 31 16:31:40 backup1 kernel: RDX: 00007fffb4631300 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
000056166b0872c8 R09: 00007f434d31de80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000202 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007fffb4631300 R15: 000056166b0872c8
Jul 31 16:31:40 backup1 kernel: btrfs           D    0  2200   2194 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7fd0c0e04427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007fffcdcda5d8 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007fd0c0e04427
Jul 31 16:31:40 backup1 kernel: RDX: 00007fffcdcda610 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
0000559a611ce2c7 R09: 00007fd0c0e8ee80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007fffcdcda610 R15: 0000559a611ce2c7
Jul 31 16:31:40 backup1 kernel: btrfs           D    0  2699   2693 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f9d1010e427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007ffd08c48a48 EFLAGS:
00000206 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f9d1010e427
Jul 31 16:31:40 backup1 kernel: RDX: 00007ffd08c48a80 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
00005639550432dd R09: 00007f9d10198e80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000206 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007ffd08c48a80 R15: 00005639550432dd
Jul 31 16:31:40 backup1 kernel: btrfs           D    0  2807   2801 0x00000000
Jul 31 16:31:40 backup1 kernel: Call Trace:
Jul 31 16:31:40 backup1 kernel:  ? __schedule+0x2db/0x700
Jul 31 16:31:40 backup1 kernel:  schedule+0x40/0xb0
Jul 31 16:31:40 backup1 kernel:  rwsem_down_write_slowpath+0x329/0x4e0
Jul 31 16:31:40 backup1 kernel:  btrfs_delete_subvolume+0x90/0x5f0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? d_lookup+0x25/0x50
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl_snap_destroy+0x2cd/0x330 [btrfs]
Jul 31 16:31:40 backup1 kernel:  btrfs_ioctl+0x166c/0x2de0 [btrfs]
Jul 31 16:31:40 backup1 kernel:  ? tomoyo_path_number_perm+0x68/0x1e0
Jul 31 16:31:40 backup1 kernel:  ? do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  do_vfs_ioctl+0xa4/0x680
Jul 31 16:31:40 backup1 kernel:  ksys_ioctl+0x60/0x90
Jul 31 16:31:40 backup1 kernel:  __x64_sys_ioctl+0x16/0x20
Jul 31 16:31:40 backup1 kernel:  do_syscall_64+0x52/0x170
Jul 31 16:31:40 backup1 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jul 31 16:31:40 backup1 kernel: RIP: 0033:0x7f0c33875427
Jul 31 16:31:40 backup1 kernel: Code: Bad RIP value.
Jul 31 16:31:40 backup1 kernel: RSP: 002b:00007ffeb2ed3ac8 EFLAGS:
00000202 ORIG_RAX: 0000000000000010
Jul 31 16:31:40 backup1 kernel: RAX: ffffffffffffffda RBX:
0000000000000000 RCX: 00007f0c33875427
Jul 31 16:31:40 backup1 kernel: RDX: 00007ffeb2ed3b00 RSI:
000000005000940f RDI: 0000000000000003
Jul 31 16:31:40 backup1 kernel: RBP: 0000000000000000 R08:
0000558a0ba742de R09: 00007f0c338ffe80
Jul 31 16:31:40 backup1 kernel: R10: fffffffffffffb66 R11:
0000000000000202 R12: 0000000000000003
Jul 31 16:31:40 backup1 kernel: R13: 0000000000000003 R14:
00007ffeb2ed3b00 R15: 0000558a0ba742de
Jul 31 16:32:01 backup1 CRON[5113]: pam_unix(cron:session): session
opened for user root by (uid=0)
Jul 31 16:32:01 backup1 CRON[5114]: (root) CMD (/opt/scripts/unstuck.sh)
Jul 31 16:32:01 backup1 CRON[5113]: pam_unix(cron:session): session
closed for user root
Jul 31 16:32:03 backup1 sudo[5137]:   nagios : TTY=unknown ; PWD=/ ;
USER=root ; COMMAND=/usr/lib/nagios/plugins/check_btrfs
--allocated-critical-percent 90 --allocated-warning-percent 75
--mountpoint /mnt/data
Jul 31 16:32:03 backup1 sudo[5137]: pam_unix(sudo:session): session
opened for user root by (uid=0)
Jul 31 16:32:03 backup1 sudo[5137]: pam_unix(sudo:session): session
closed for user root
Jul 31 16:32:09 backup1 sudo[5157]:   nagios : TTY=unknown ; PWD=/ ;
USER=root ; COMMAND=/usr/lib/nagios/plugins/check_ipmi_sensor
Jul 31 16:32:09 backup1 sudo[5157]: pam_unix(sudo:session): session
opened for user root by (uid=0)
Jul 31 16:32:10 backup1 sudo[5157]: pam_unix(sudo:session): session
closed for user root


One difficulty is that this is the upstream list; and kernel 5.5 is
end of life. Ordinarily older kernels are distribution responsibility.
Upstream development is mostly interested in current stable kernels at
the oldest, and mainline development kernels. But hopefully someone
will still have an idea what's going on, if it's a bug or possibly
misconfiguration.


--
Chris Murphy