Linux 4.2.4 kernel panic while balancing

Linux 4.2.4 kernel panic while balancing

[Malte Schröder]

[-- Attachment #1.1: Type: text/plain, Size: 307 bytes --]

Hi,
kernel 4.2 crashes more or less reliably when running btrfs balance.
The filesystem in question is running in RAID1 mode. This happens quite
reliably.
Btrfs filesystem check doesn't show any problems.

Dmesg output is attached.

I'll happily provide more information if needed.

Regards
Malte

[-- Attachment #1.2: gateway.dmesg --]
[-- Type: text/plain, Size: 6091 bytes --]

[  220.565775] netpoll: netconsole: local port 6666
[  220.565803] netpoll: netconsole: local IPv4 address 192.168.1.1
[  220.565827] netpoll: netconsole: interface 'eth0'
[  220.565846] netpoll: netconsole: remote port 6666
[  220.565866] netpoll: netconsole: remote IPv4 address 192.168.1.114
[  220.565891] netpoll: netconsole: remote ethernet address 60:57:18:a7:67:1e
[  220.565948] console [netcon0] enabled
[  220.565962] netconsole: network logging started
[  253.785165] BTRFS info (device sda2): relocating block group 4206312292352 flags 17
[  261.340061] BTRFS info (device sda2): found 31 extents
 ablk_helper drm_kms_helper lpc_ich mei firewire_core 8250_pci usb_common[  267.295319] ------------[ cut here ]------------
 crc_itu_t evdev mfd_core input_leds snd_hda_core led_class snd_pcsp cryptd[  267.295342] kernel BUG at fs/btrfs/extent-tree.c:1833!
 sg drm snd_pcm 8250 video[  267.295358] invalid opcode: 0000 [#1]  intel_gtt i2c_i801 snd_timer serial_core tpm_tisSMP  backlight tpm button snd agpgart
 soundcore processor tcp_cdg efivarfs microcode[  267.295375] Modules linked in: fan thermal
 netconsole configfs sit[  267.296005] CPU: 6 PID: 805 Comm: kworker/u16:9 Not tainted 4.2.4-gateway #1
[  267.296023] Hardware name: Supermicro X10SAE/X10SAE, BIOS 2.0a 05/09/2014
 tunnel4 ip_tunnel nls_iso8859_1[  267.296044] Workqueue: btrfs-extent-refs btrfs_extent_refs_helper
 nls_cp437[  267.296061] task: ffff8807fb47c680 ti: ffff8807fb4b4000 task.ti: ffff8807fb4b4000
 vfat[  267.296079] RIP: 0010:[<ffffffff921e80ce>]  fat [<ffffffff921e80ce>] insert_inline_extent_backref+0xde/0xe0
 rpcsec_gss_krb5[  267.296106] RSP: 0018:ffff8807fb4b7b48  EFLAGS: 00010293
 nfsd auth_rpcgss[  267.296121] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001
[  267.296139] RDX: ffff880000000000 RSI: 0000000000000001 RDI: 0000000000000000
 nfs_acl lockd grace[  267.296157] RBP: ffff8807fb67b800 R08: 0000000000004000 R09: ffff8807fb4b7a58
 sunrpc[  267.296175] R10: 0000000000000000 R11: 0000000000000003 R12: ffff8800cc4a9e10
 nf_log_ipv4[  267.296192] R13: 0000000000000102 R14: 0000000000000000 R15: 0000000000000000
 xt_REDIRECT nf_nat_redirect[  267.296210] FS:  0000000000000000(0000) GS:ffff88081fb80000(0000) knlGS:0000000000000000
[  267.296229] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
 ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_log_ipv6[  267.296245] CR2: 00007f2a8bc7b6e0 CR3: 00000007e5bac000 CR4: 00000000001406e0
[  267.296262] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
 nf_log_common iptable_nat[  267.296280] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
 nf_nat_ipv4[  267.296297] Stack:
[  267.296306]  0000000000000000 0000000000000102 0000000000000000 ipt_REJECT 0000000000000000
[  267.296330]  ffff880700000001 ffffffff921dbd6e nf_reject_ipv4 0000000000000000 ffffffff921e90eb
 xt_recent ip6table_nat nf_nat_ipv6[  267.296355]  ffff8807fb4b7c04 0000000000003d93 ffff8800cc4a9e18 ffff8800d909c000
 xt_comment[  267.296379] Call Trace:
 ip6t_REJECT nf_reject_ipv6[  267.296390]  [<ffffffff921dbd6e>] ? btrfs_free_path+0xe/0x20
 xt_addrtype[  267.296405]  [<ffffffff921e90eb>] ? __btrfs_free_extent.isra.77+0x31b/0xd50
 xt_policy ip6table_mangle[  267.296423]  [<ffffffff921e8172>] ? __btrfs_inc_extent_ref.isra.61+0xa2/0x280
[  267.296442]  [<ffffffff921ecf83>] ? __btrfs_run_delayed_refs+0xb73/0xf80
[  267.296461]  [<ffffffff92111deb>] ? __slab_free+0x11b/0x260
[  267.296477]  [<ffffffff922baf56>] ? blk_queue_bio+0x2a6/0x2b0
[  267.296494]  [<ffffffff921214ad>] ? __sb_start_write+0x3d/0xd0
[  267.296510]  [<ffffffff921efddc>] ? btrfs_run_delayed_refs.part.82+0x6c/0x270
[  267.296529]  [<ffffffff921f0063>] ? delayed_ref_async_start+0x73/0x90
[  267.296547]  [<ffffffff9205c7f7>] ? process_one_work+0x127/0x3f0
 xt_mark iptable_mangle xt_tcpudp iptable_raw nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_tftp xt_CT nf_nat_snmp_basic nf_conntrack_snmp nf_nat_sip ip6table_raw nf_nat_pptp nf_nat_proto_gre xt_multiport nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat_amanda nf_nat xt_NFLOG xt_LOG nf_conntrack_tftp nf_conntrack_sip nf_conntrack_sane nf_conntrack_proto_udplite nf_conntrack_proto_sctp nf_conntrack_pptp[  267.296563]  [<ffffffff9205cb02>] ? worker_thread+0x42/0x480
 nf_conntrack_proto_gre nf_conntrack_netlink nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_irc nf_conntrack_h323 ts_kmp nf_conntrack_amanda nf_conntrack_ftp nf_conntrack cpufreq_stats nfnetlink_log nfnetlink ip6table_filter ip6_tables tun iptable_filter ip_tables x_tables binfmt_misc 8021q garp mrp stp llc pl2303 hid_generic usbhid hid ftdi_sio usbserial[  267.297401]  [<ffffffff9205cac0>] ? process_one_work+0x3f0/0x3f0
 x86_pkg_temp_thermal coretemp kvm_intel kvm snd_hda_codec_realtek crct10dif_pclmul crc32_pclmul snd_hda_codec_generic snd_hda_codec_hdmi iTCO_wdt crc32c_intel ghash_clmulni_intel snd_hda_intel aesni_intel iTCO_vendor_support firewire_ohci ehci_pci xhci_pci ehci_hcd aes_x86_64 lrw xhci_hcd snd_hda_codec glue_helper i915 usbcore snd_hwdep mei_me[  267.298238]  [<ffffffff9206196c>] ? kthread+0xbc/0xe0
[  267.299108]  [<ffffffff920618b0>] ? kthread_worker_fn+0x140/0x140
[  267.299991]  [<ffffffff9255ac8f>] ? ret_from_fork+0x3f/0x70
[  267.300858]  [<ffffffff920618b0>] ? kthread_worker_fn+0x140/0x140
[  267.301712] Code: e8 48 8b 84 24 b0 00 00 00 4c 89 f9 4c 89 e6 48 89 ef 48 89 44 24 10 8b 84 24 a8 00 00 00 89 44 24 08 e8 c6 d7 ff ff 31 c0 eb b3 <0f> 0b 41 57 41 56 4d 89 ce 41 55 4d 89 c5 41 54 55 48 89 fd 53 
[  267.303620] RIP  [<ffffffff921e80ce>] insert_inline_extent_backref+0xde/0xe0
[  267.304515]  RSP <ffff8807fb4b7b48>
[  267.305437] ---[ end trace 56193c2ae8327628 ]---
[  267.431957] Kernel panic - not syncing: Fatal exception
[  267.433659] Kernel Offset: 0x11000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[  267.435116] drm_kms_helper: panic occurred, switching back to text console
[  267.529319] Rebooting in 60 seconds..
[  327.057694] ACPI MEMORY or I/O RESET_REG.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 819 bytes --]

Re: Linux 4.2.4 kernel panic while balancing

[Filipe Manana]

On Fri, Oct 23, 2015 at 4:41 PM, Malte Schröder <malte@tnxip.de> wrote:
> Hi,
> kernel 4.2 crashes more or less reliably when running btrfs balance.
> The filesystem in question is running in RAID1 mode. This happens quite
> reliably.
> Btrfs filesystem check doesn't show any problems.
>
> Dmesg output is attached.
>
> I'll happily provide more information if needed.

Yeah, we're aware of the problem.

It's being fixed/debugged/discussed in the following (recent) thread:

http://thread.gmane.org/gmane.comp.file-systems.btrfs/49517

That patch there should fix the problem if you aren't using qgroups.
If you're using qgroups, stay tuned and another fix for that case
should come soon.

thanks


>
> Regards
> Malte



-- 
Filipe David Manana,

"Reasonable men adapt themselves to the world.
 Unreasonable men adapt the world to themselves.
 That's why all progress depends on unreasonable men."