* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-06 3:04 ` Wang Xiaoguang
@ 2016-10-06 7:32 ` Stefan Priebe - Profihost AG
2016-10-06 7:35 ` Stefan Priebe - Profihost AG
` (3 subsequent siblings)
4 siblings, 0 replies; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-06 7:32 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
Thanks Wang,
i applied them both on top of vanilla v4.8 - i hope this is OK. Will
report back what happens.
Greets,
Stefan
Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
> Hi,
>
> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>> currently
>>>> I cannot confirm that as i do not have anough space to test this
>>>> without
>>>> compression ;-( But yes i've compression enabled.
>>> I might not get you, my poor english :)
>>> You mean that you only get ENOSPC error when compression is enabled?
>>>
>>> And when compression is not enabled, you do not get ENOSPC error?
>> I can't tell you. I cannot test with compression not enabled. I do not
>> have anough free space on this disk.
> I had just sent two patches to fix false enospc error for compression,
> please have a try, they fix false enospc error in my test environment.
> btrfs: fix false enospc for compression
> btrfs: improve inode's outstanding_extents computation
>
> I apply these two patchs in linux upstream tree, the latest commit
> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>
> Regards,
> Xiaoguang Wang
>
>>
>>>>> I'm trying to fix it.
>>>> That sounds good but do you also get the
>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>
>>>> kernel messages on umount? if not you might have found another problem.
>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13e ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13f ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e140 ]---
>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>> reserved=0, may_use=1908990066688, readonly=0
>>
>> Greets,
>> Stefan
>>
>>> Regards,
>>> Xiaoguang Wang
>>>
>>>> Stefan
>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>> test
>>>>>> script. Any ideas?
>>>>>>
>>>>>> Stefan
>>>>>>
>>>>>>> Reagrds,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> Greets,
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>> Greets,
>>>>>>>>>> Stefan
>>>>>>>>>> --
>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>> linux-btrfs" in
>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>> More majordomo info at
>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>
>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-06 3:04 ` Wang Xiaoguang
2016-10-06 7:32 ` Stefan Priebe - Profihost AG
@ 2016-10-06 7:35 ` Stefan Priebe - Profihost AG
2016-10-07 7:03 ` Stefan Priebe - Profihost AG
` (2 subsequent siblings)
4 siblings, 0 replies; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-06 7:35 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
Thanks Wang,
i applied them both on top of vanilla v4.8 - i hope this is OK. Will
report back what happens.
Greets,
Stefan
Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
> Hi,
>
> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>> currently
>>>> I cannot confirm that as i do not have anough space to test this
>>>> without
>>>> compression ;-( But yes i've compression enabled.
>>> I might not get you, my poor english :)
>>> You mean that you only get ENOSPC error when compression is enabled?
>>>
>>> And when compression is not enabled, you do not get ENOSPC error?
>> I can't tell you. I cannot test with compression not enabled. I do not
>> have anough free space on this disk.
> I had just sent two patches to fix false enospc error for compression,
> please have a try, they fix false enospc error in my test environment.
> btrfs: fix false enospc for compression
> btrfs: improve inode's outstanding_extents computation
>
> I apply these two patchs in linux upstream tree, the latest commit
> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>
> Regards,
> Xiaoguang Wang
>
>>
>>>>> I'm trying to fix it.
>>>> That sounds good but do you also get the
>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>
>>>> kernel messages on umount? if not you might have found another problem.
>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13e ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13f ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e140 ]---
>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>> reserved=0, may_use=1908990066688, readonly=0
>>
>> Greets,
>> Stefan
>>
>>> Regards,
>>> Xiaoguang Wang
>>>
>>>> Stefan
>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>> test
>>>>>> script. Any ideas?
>>>>>>
>>>>>> Stefan
>>>>>>
>>>>>>> Reagrds,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> Greets,
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>> Greets,
>>>>>>>>>> Stefan
>>>>>>>>>> --
>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>> linux-btrfs" in
>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>> More majordomo info at
>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>
>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-06 3:04 ` Wang Xiaoguang
2016-10-06 7:32 ` Stefan Priebe - Profihost AG
2016-10-06 7:35 ` Stefan Priebe - Profihost AG
@ 2016-10-07 7:03 ` Stefan Priebe - Profihost AG
2016-10-07 7:17 ` Wang Xiaoguang
2016-10-08 6:05 ` Stefan Priebe - Profihost AG
2016-10-10 20:06 ` Stefan Priebe - Profihost AG
4 siblings, 1 reply; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-07 7:03 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
Dear Wang,
can't use v4.8.0 as i always get OOMs and total machine crashes.
Complete traces with your patch and some more btrfs patches applied (in
the hope in fixes the OOM but it did not):
http://pastebin.com/raw/6vmRSDm1
Greets,
Stefan
Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
> Hi,
>
> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>> currently
>>>> I cannot confirm that as i do not have anough space to test this
>>>> without
>>>> compression ;-( But yes i've compression enabled.
>>> I might not get you, my poor english :)
>>> You mean that you only get ENOSPC error when compression is enabled?
>>>
>>> And when compression is not enabled, you do not get ENOSPC error?
>> I can't tell you. I cannot test with compression not enabled. I do not
>> have anough free space on this disk.
> I had just sent two patches to fix false enospc error for compression,
> please have a try, they fix false enospc error in my test environment.
> btrfs: fix false enospc for compression
> btrfs: improve inode's outstanding_extents computation
>
> I apply these two patchs in linux upstream tree, the latest commit
> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>
> Regards,
> Xiaoguang Wang
>
>>
>>>>> I'm trying to fix it.
>>>> That sounds good but do you also get the
>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>
>>>> kernel messages on umount? if not you might have found another problem.
>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13e ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13f ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e140 ]---
>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>> reserved=0, may_use=1908990066688, readonly=0
>>
>> Greets,
>> Stefan
>>
>>> Regards,
>>> Xiaoguang Wang
>>>
>>>> Stefan
>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>> test
>>>>>> script. Any ideas?
>>>>>>
>>>>>> Stefan
>>>>>>
>>>>>>> Reagrds,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> Greets,
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>> Greets,
>>>>>>>>>> Stefan
>>>>>>>>>> --
>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>> linux-btrfs" in
>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>> More majordomo info at
>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>
>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 7:03 ` Stefan Priebe - Profihost AG
@ 2016-10-07 7:17 ` Wang Xiaoguang
2016-10-07 7:47 ` Paul Jones
` (4 more replies)
0 siblings, 5 replies; 37+ messages in thread
From: Wang Xiaoguang @ 2016-10-07 7:17 UTC (permalink / raw)
To: Stefan Priebe - Profihost AG, linux-btrfs
Hi,
On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
> Dear Wang,
>
> can't use v4.8.0 as i always get OOMs and total machine crashes.
>
> Complete traces with your patch and some more btrfs patches applied (in
> the hope in fixes the OOM but it did not):
> http://pastebin.com/raw/6vmRSDm1
I didn't see any such OOMs...
Can you try holger's tree with my patches.
Regards,
Xiaoguang Wang
>
> Greets,
> Stefan
> Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
>> Hi,
>>
>> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>>> currently
>>>>> I cannot confirm that as i do not have anough space to test this
>>>>> without
>>>>> compression ;-( But yes i've compression enabled.
>>>> I might not get you, my poor english :)
>>>> You mean that you only get ENOSPC error when compression is enabled?
>>>>
>>>> And when compression is not enabled, you do not get ENOSPC error?
>>> I can't tell you. I cannot test with compression not enabled. I do not
>>> have anough free space on this disk.
>> I had just sent two patches to fix false enospc error for compression,
>> please have a try, they fix false enospc error in my test environment.
>> btrfs: fix false enospc for compression
>> btrfs: improve inode's outstanding_extents computation
>>
>> I apply these two patchs in linux upstream tree, the latest commit
>> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>>
>> Regards,
>> Xiaoguang Wang
>>
>>>>>> I'm trying to fix it.
>>>>> That sounds good but do you also get the
>>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>>
>>>>> kernel messages on umount? if not you might have found another problem.
>>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>>> ------------[ cut here ]------------
>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>> Call Trace:
>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>> ---[ end trace cee6ace13018e13e ]---
>>> ------------[ cut here ]------------
>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>> Call Trace:
>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>> ---[ end trace cee6ace13018e13f ]---
>>> ------------[ cut here ]------------
>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>>> Call Trace:
>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>> ---[ end trace cee6ace13018e140 ]---
>>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>>> reserved=0, may_use=1908990066688, readonly=0
>>>
>>> Greets,
>>> Stefan
>>>
>>>> Regards,
>>>> Xiaoguang Wang
>>>>
>>>>> Stefan
>>>>>
>>>>>> Regards,
>>>>>> Xiaoguang Wang
>>>>>>
>>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>>> test
>>>>>>> script. Any ideas?
>>>>>>>
>>>>>>> Stefan
>>>>>>>
>>>>>>>> Reagrds,
>>>>>>>> Xiaoguang Wang
>>>>>>>>
>>>>>>>>> Greets,
>>>>>>>>> Stefan
>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>> Greets,
>>>>>>>>>>> Stefan
>>>>>>>>>>> --
>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>>> linux-btrfs" in
>>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>>> More majordomo info at
>>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>
>>>>>>>>>>>
>>>>
>>
>>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 7:17 ` Wang Xiaoguang
@ 2016-10-07 7:47 ` Paul Jones
2016-10-07 7:48 ` Paul Jones
2016-10-07 7:59 ` Stefan Priebe - Profihost AG
` (3 subsequent siblings)
4 siblings, 1 reply; 37+ messages in thread
From: Paul Jones @ 2016-10-07 7:47 UTC (permalink / raw)
To: Wang Xiaoguang, Stefan Priebe - Profihost AG, linux-btrfs
[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="utf-8", Size: 990 bytes --]
> -----Original Message-----
> From: linux-btrfs-owner@vger.kernel.org [mailto:linux-btrfs-
> owner@vger.kernel.org] On Behalf Of Wang Xiaoguang
> Sent: Friday, 7 October 2016 6:17 PM
> To: Stefan Priebe - Profihost AG <s.priebe@profihost.ag>; linux-
> btrfs@vger.kernel.org
> Subject: Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
>
> Hi,
>
> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
> > Dear Wang,
> >
> > can't use v4.8.0 as i always get OOMs and total machine crashes.
> >
> > Complete traces with your patch and some more btrfs patches applied
> > (in the hope in fixes the OOM but it did not):
> > http://pastebin.com/raw/6vmRSDm1
> I didn't see any such OOMs...
> Can you try holger's tree with my patches.
>
> Regards,
> Xiaoguang Wang
> >
4.8.5 has fixed all the OOM problems for me, so try that one.
Paul.
ÿôèº{.nÇ+·®+%Ëÿ±éݶ\x17¥wÿº{.nÇ+·¥{±ý»k~ÏâØ^nr¡ö¦zË\x1aëh¨èÚ&£ûàz¿äz¹Þú+Ê+zf£¢·h§~Ûiÿÿïêÿêçz_è®\x0fæj:+v¨þ)ߣøm
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 7:47 ` Paul Jones
@ 2016-10-07 7:48 ` Paul Jones
0 siblings, 0 replies; 37+ messages in thread
From: Paul Jones @ 2016-10-07 7:48 UTC (permalink / raw)
To: Paul Jones, Wang Xiaoguang, Stefan Priebe - Profihost AG, linux-btrfs
[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="utf-8", Size: 1484 bytes --]
> -----Original Message-----
> From: linux-btrfs-owner@vger.kernel.org [mailto:linux-btrfs-
> owner@vger.kernel.org] On Behalf Of Paul Jones
> Sent: Friday, 7 October 2016 6:48 PM
> To: Wang Xiaoguang <wangxg.fnst@cn.fujitsu.com>; Stefan Priebe -
> Profihost AG <s.priebe@profihost.ag>; linux-btrfs@vger.kernel.org
> Subject: RE: BTRFS: space_info 4 has 18446742286429913088 free, is not full
>
>
> > -----Original Message-----
> > From: linux-btrfs-owner@vger.kernel.org [mailto:linux-btrfs-
> > owner@vger.kernel.org] On Behalf Of Wang Xiaoguang
> > Sent: Friday, 7 October 2016 6:17 PM
> > To: Stefan Priebe - Profihost AG <s.priebe@profihost.ag>; linux-
> > btrfs@vger.kernel.org
> > Subject: Re: BTRFS: space_info 4 has 18446742286429913088 free, is not
> > full
> >
> > Hi,
> >
> > On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
> > > Dear Wang,
> > >
> > > can't use v4.8.0 as i always get OOMs and total machine crashes.
> > >
> > > Complete traces with your patch and some more btrfs patches applied
> > > (in the hope in fixes the OOM but it did not):
> > > http://pastebin.com/raw/6vmRSDm1
> > I didn't see any such OOMs...
> > Can you try holger's tree with my patches.
> >
> > Regards,
> > Xiaoguang Wang
> > >
>
>
> 4.8.5 has fixed all the OOM problems for me, so try that one.
Sorry, just realised I meant 4.7.5!
Paul.
ÿôèº{.nÇ+·®+%Ëÿ±éݶ\x17¥wÿº{.nÇ+·¥{±ý»k~ÏâØ^nr¡ö¦zË\x1aëh¨èÚ&£ûàz¿äz¹Þú+Ê+zf£¢·h§~Ûiÿÿïêÿêçz_è®\x0fæj:+v¨þ)ߣøm
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 7:17 ` Wang Xiaoguang
2016-10-07 7:47 ` Paul Jones
@ 2016-10-07 7:59 ` Stefan Priebe - Profihost AG
2016-10-07 8:05 ` Stefan Priebe - Profihost AG
` (2 subsequent siblings)
4 siblings, 0 replies; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-07 7:59 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
Am 07.10.2016 um 09:17 schrieb Wang Xiaoguang:
> Hi,
>
> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>> Dear Wang,
>>
>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>
>> Complete traces with your patch and some more btrfs patches applied (in
>> the hope in fixes the OOM but it did not):
>> http://pastebin.com/raw/6vmRSDm1
> I didn't see any such OOMs...
> Can you try holger's tree with my patches.
Dear wang already tried that. Doesn't help. It also happens only on two
out of three servers. It starts killing low men processes after time.
But I've no idea where all those memory is consumed. (Have 64gb)
Greets,
Stefan
> Regards,
> Xiaoguang Wang
>>
>> Greets,
>> Stefan
>> Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
>>> Hi,
>>>
>>> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>>>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>>>> currently
>>>>>> I cannot confirm that as i do not have anough space to test this
>>>>>> without
>>>>>> compression ;-( But yes i've compression enabled.
>>>>> I might not get you, my poor english :)
>>>>> You mean that you only get ENOSPC error when compression is enabled?
>>>>>
>>>>> And when compression is not enabled, you do not get ENOSPC error?
>>>> I can't tell you. I cannot test with compression not enabled. I do not
>>>> have anough free space on this disk.
>>> I had just sent two patches to fix false enospc error for compression,
>>> please have a try, they fix false enospc error in my test environment.
>>> btrfs: fix false enospc for compression
>>> btrfs: improve inode's outstanding_extents computation
>>>
>>> I apply these two patchs in linux upstream tree, the latest commit
>>> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>>>
>>> Regards,
>>> Xiaoguang Wang
>>>
>>>>>>> I'm trying to fix it.
>>>>>> That sounds good but do you also get the
>>>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>>>
>>>>>> kernel messages on umount? if not you might have found another
>>>>>> problem.
>>>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>>>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e13e ]---
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>>>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e13f ]---
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>>>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>>>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e140 ]---
>>>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>>>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>>>> reserved=0, may_use=1908990066688, readonly=0
>>>>
>>>> Greets,
>>>> Stefan
>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>> Stefan
>>>>>>
>>>>>>> Regards,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>>>> test
>>>>>>>> script. Any ideas?
>>>>>>>>
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Reagrds,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>
>>>>>>>>>> Greets,
>>>>>>>>>> Stefan
>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>>> Greets,
>>>>>>>>>>>> Stefan
>>>>>>>>>>>> --
>>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>>>> linux-btrfs" in
>>>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>>>> More majordomo info at
>>>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 7:17 ` Wang Xiaoguang
2016-10-07 7:47 ` Paul Jones
2016-10-07 7:59 ` Stefan Priebe - Profihost AG
@ 2016-10-07 8:05 ` Stefan Priebe - Profihost AG
2016-10-07 8:06 ` Stefan Priebe - Profihost AG
2016-10-07 9:33 ` Holger Hoffstätte
4 siblings, 0 replies; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-07 8:05 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
this is what atop shows at mem usage 5 minutes before the crash:
MEM | tot 62.8G | free 198.2M | cache 56.8G | buff 1.4M |
slab 3.5G | shmem 1.1M | vmbal 0.0M | hptot 0.0M |
SWP | tot 3.7G | free 3.2G | | |
| | vmcom 2.8G | vmlim 35.1G |
Greets,
Stefan
Am 07.10.2016 um 09:17 schrieb Wang Xiaoguang:
> Hi,
>
> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>> Dear Wang,
>>
>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>
>> Complete traces with your patch and some more btrfs patches applied (in
>> the hope in fixes the OOM but it did not):
>> http://pastebin.com/raw/6vmRSDm1
> I didn't see any such OOMs...
> Can you try holger's tree with my patches.
>
> Regards,
> Xiaoguang Wang
>>
>> Greets,
>> Stefan
>> Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
>>> Hi,
>>>
>>> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>>>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>>>> currently
>>>>>> I cannot confirm that as i do not have anough space to test this
>>>>>> without
>>>>>> compression ;-( But yes i've compression enabled.
>>>>> I might not get you, my poor english :)
>>>>> You mean that you only get ENOSPC error when compression is enabled?
>>>>>
>>>>> And when compression is not enabled, you do not get ENOSPC error?
>>>> I can't tell you. I cannot test with compression not enabled. I do not
>>>> have anough free space on this disk.
>>> I had just sent two patches to fix false enospc error for compression,
>>> please have a try, they fix false enospc error in my test environment.
>>> btrfs: fix false enospc for compression
>>> btrfs: improve inode's outstanding_extents computation
>>>
>>> I apply these two patchs in linux upstream tree, the latest commit
>>> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>>>
>>> Regards,
>>> Xiaoguang Wang
>>>
>>>>>>> I'm trying to fix it.
>>>>>> That sounds good but do you also get the
>>>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>>>
>>>>>> kernel messages on umount? if not you might have found another
>>>>>> problem.
>>>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>>>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e13e ]---
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>>>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e13f ]---
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>>>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>>>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e140 ]---
>>>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>>>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>>>> reserved=0, may_use=1908990066688, readonly=0
>>>>
>>>> Greets,
>>>> Stefan
>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>> Stefan
>>>>>>
>>>>>>> Regards,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>>>> test
>>>>>>>> script. Any ideas?
>>>>>>>>
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Reagrds,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>
>>>>>>>>>> Greets,
>>>>>>>>>> Stefan
>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>>> Greets,
>>>>>>>>>>>> Stefan
>>>>>>>>>>>> --
>>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>>>> linux-btrfs" in
>>>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>>>> More majordomo info at
>>>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 7:17 ` Wang Xiaoguang
` (2 preceding siblings ...)
2016-10-07 8:05 ` Stefan Priebe - Profihost AG
@ 2016-10-07 8:06 ` Stefan Priebe - Profihost AG
2016-10-07 8:07 ` Wang Xiaoguang
2016-10-07 9:33 ` Holger Hoffstätte
4 siblings, 1 reply; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-07 8:06 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
and it shows:
PAG | scan 33829e5 | steal 1968e3 | stall 0 | |
| | swin 257071 | swout 346960 |
but the highest user space prog uses only 190MB.
greets,
Stefan
Am 07.10.2016 um 09:17 schrieb Wang Xiaoguang:
> Hi,
>
> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>> Dear Wang,
>>
>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>
>> Complete traces with your patch and some more btrfs patches applied (in
>> the hope in fixes the OOM but it did not):
>> http://pastebin.com/raw/6vmRSDm1
> I didn't see any such OOMs...
> Can you try holger's tree with my patches.
>
> Regards,
> Xiaoguang Wang
>>
>> Greets,
>> Stefan
>> Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
>>> Hi,
>>>
>>> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>>>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>>>> currently
>>>>>> I cannot confirm that as i do not have anough space to test this
>>>>>> without
>>>>>> compression ;-( But yes i've compression enabled.
>>>>> I might not get you, my poor english :)
>>>>> You mean that you only get ENOSPC error when compression is enabled?
>>>>>
>>>>> And when compression is not enabled, you do not get ENOSPC error?
>>>> I can't tell you. I cannot test with compression not enabled. I do not
>>>> have anough free space on this disk.
>>> I had just sent two patches to fix false enospc error for compression,
>>> please have a try, they fix false enospc error in my test environment.
>>> btrfs: fix false enospc for compression
>>> btrfs: improve inode's outstanding_extents computation
>>>
>>> I apply these two patchs in linux upstream tree, the latest commit
>>> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>>>
>>> Regards,
>>> Xiaoguang Wang
>>>
>>>>>>> I'm trying to fix it.
>>>>>> That sounds good but do you also get the
>>>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>>>
>>>>>> kernel messages on umount? if not you might have found another
>>>>>> problem.
>>>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>>>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e13e ]---
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>>>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e13f ]---
>>>> ------------[ cut here ]------------
>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>>>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>>>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>>>> Call Trace:
>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>> ---[ end trace cee6ace13018e140 ]---
>>>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>>>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>>>> reserved=0, may_use=1908990066688, readonly=0
>>>>
>>>> Greets,
>>>> Stefan
>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>> Stefan
>>>>>>
>>>>>>> Regards,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>>>> test
>>>>>>>> script. Any ideas?
>>>>>>>>
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Reagrds,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>
>>>>>>>>>> Greets,
>>>>>>>>>> Stefan
>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>>> Greets,
>>>>>>>>>>>> Stefan
>>>>>>>>>>>> --
>>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>>>> linux-btrfs" in
>>>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>>>> More majordomo info at
>>>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 8:06 ` Stefan Priebe - Profihost AG
@ 2016-10-07 8:07 ` Wang Xiaoguang
2016-10-07 8:16 ` Stefan Priebe - Profihost AG
0 siblings, 1 reply; 37+ messages in thread
From: Wang Xiaoguang @ 2016-10-07 8:07 UTC (permalink / raw)
To: Stefan Priebe - Profihost AG, linux-btrfs
hello,
On 10/07/2016 04:06 PM, Stefan Priebe - Profihost AG wrote:
> and it shows:
>
> PAG | scan 33829e5 | steal 1968e3 | stall 0 | |
> | | swin 257071 | swout 346960 |
>
> but the highest user space prog uses only 190MB.
If you don't apply my patches, there will be no OOMs in your test
environment?
I want to confirm whether this OOM is caused by my patches...
Regards,
Xiaoguang Wang
>
> greets,
> Stefan
>
> Am 07.10.2016 um 09:17 schrieb Wang Xiaoguang:
>> Hi,
>>
>> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>>> Dear Wang,
>>>
>>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>>
>>> Complete traces with your patch and some more btrfs patches applied (in
>>> the hope in fixes the OOM but it did not):
>>> http://pastebin.com/raw/6vmRSDm1
>> I didn't see any such OOMs...
>> Can you try holger's tree with my patches.
>>
>> Regards,
>> Xiaoguang Wang
>>> Greets,
>>> Stefan
>>> Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
>>>> Hi,
>>>>
>>>> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>>>>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>>>>> currently
>>>>>>> I cannot confirm that as i do not have anough space to test this
>>>>>>> without
>>>>>>> compression ;-( But yes i've compression enabled.
>>>>>> I might not get you, my poor english :)
>>>>>> You mean that you only get ENOSPC error when compression is enabled?
>>>>>>
>>>>>> And when compression is not enabled, you do not get ENOSPC error?
>>>>> I can't tell you. I cannot test with compression not enabled. I do not
>>>>> have anough free space on this disk.
>>>> I had just sent two patches to fix false enospc error for compression,
>>>> please have a try, they fix false enospc error in my test environment.
>>>> btrfs: fix false enospc for compression
>>>> btrfs: improve inode's outstanding_extents computation
>>>>
>>>> I apply these two patchs in linux upstream tree, the latest commit
>>>> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>>>>
>>>> Regards,
>>>> Xiaoguang Wang
>>>>
>>>>>>>> I'm trying to fix it.
>>>>>>> That sounds good but do you also get the
>>>>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>>>>
>>>>>>> kernel messages on umount? if not you might have found another
>>>>>>> problem.
>>>>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>>>>> ------------[ cut here ]------------
>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>>>>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>>> Call Trace:
>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>> ---[ end trace cee6ace13018e13e ]---
>>>>> ------------[ cut here ]------------
>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>>>>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>>> Call Trace:
>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>> ---[ end trace cee6ace13018e13f ]---
>>>>> ------------[ cut here ]------------
>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>>>>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>>>>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>>>>> Call Trace:
>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>> ---[ end trace cee6ace13018e140 ]---
>>>>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>>>>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>>>>> reserved=0, may_use=1908990066688, readonly=0
>>>>>
>>>>> Greets,
>>>>> Stefan
>>>>>
>>>>>> Regards,
>>>>>> Xiaoguang Wang
>>>>>>
>>>>>>> Stefan
>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Xiaoguang Wang
>>>>>>>>
>>>>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>>>>> test
>>>>>>>>> script. Any ideas?
>>>>>>>>>
>>>>>>>>> Stefan
>>>>>>>>>
>>>>>>>>>> Reagrds,
>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>
>>>>>>>>>>> Greets,
>>>>>>>>>>> Stefan
>>>>>>>>>>>
>>>>>>>>>>>> Regards,
>>>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>>>> Greets,
>>>>>>>>>>>>> Stefan
>>>>>>>>>>>>> --
>>>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>>>>> linux-btrfs" in
>>>>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>>>>> More majordomo info at
>>>>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>
>>
>>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 8:07 ` Wang Xiaoguang
@ 2016-10-07 8:16 ` Stefan Priebe - Profihost AG
2016-10-07 8:19 ` Wang Xiaoguang
0 siblings, 1 reply; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-07 8:16 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
Am 07.10.2016 um 10:07 schrieb Wang Xiaoguang:
> hello,
>
> On 10/07/2016 04:06 PM, Stefan Priebe - Profihost AG wrote:
>> and it shows:
>>
>> PAG | scan 33829e5 | steal 1968e3 | stall 0 | |
>> | | swin 257071 | swout 346960 |
>>
>> but the highest user space prog uses only 190MB.
> If you don't apply my patches, there will be no OOMs in your test
> environment?
> I want to confirm whether this OOM is caused by my patches...
This happens also without your patches. That's what i meant with can't
use v4.8.0.
Is it OK to try v4.7.6?
Greets,
Stefan
>
> Regards,
> Xiaoguang Wang
>
>>
>> greets,
>> Stefan
>>
>> Am 07.10.2016 um 09:17 schrieb Wang Xiaoguang:
>>> Hi,
>>>
>>> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>>>> Dear Wang,
>>>>
>>>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>>>
>>>> Complete traces with your patch and some more btrfs patches applied (in
>>>> the hope in fixes the OOM but it did not):
>>>> http://pastebin.com/raw/6vmRSDm1
>>> I didn't see any such OOMs...
>>> Can you try holger's tree with my patches.
>>>
>>> Regards,
>>> Xiaoguang Wang
>>>> Greets,
>>>> Stefan
>>>> Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
>>>>> Hi,
>>>>>
>>>>> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>>>>>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>>>>>> I found that compress sometime report ENOSPC error even in
>>>>>>>>> 4.8-rc8,
>>>>>>>>> currently
>>>>>>>> I cannot confirm that as i do not have anough space to test this
>>>>>>>> without
>>>>>>>> compression ;-( But yes i've compression enabled.
>>>>>>> I might not get you, my poor english :)
>>>>>>> You mean that you only get ENOSPC error when compression is enabled?
>>>>>>>
>>>>>>> And when compression is not enabled, you do not get ENOSPC error?
>>>>>> I can't tell you. I cannot test with compression not enabled. I do
>>>>>> not
>>>>>> have anough free space on this disk.
>>>>> I had just sent two patches to fix false enospc error for compression,
>>>>> please have a try, they fix false enospc error in my test environment.
>>>>> btrfs: fix false enospc for compression
>>>>> btrfs: improve inode's outstanding_extents computation
>>>>>
>>>>> I apply these two patchs in linux upstream tree, the latest commit
>>>>> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>>>>> I'm trying to fix it.
>>>>>>>> That sounds good but do you also get the
>>>>>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>>>>>
>>>>>>>> kernel messages on umount? if not you might have found another
>>>>>>>> problem.
>>>>>>> Yes, I seem similar messages, you can paste you whole dmesg info
>>>>>>> here.
>>>>>> ------------[ cut here ]------------
>>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>>>>>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp
>>>>>> kvm_intel kvm
>>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb
>>>>>> i2c_algo_bit
>>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>>>> Call Trace:
>>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>>> ---[ end trace cee6ace13018e13e ]---
>>>>>> ------------[ cut here ]------------
>>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>>>>>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp
>>>>>> kvm_intel kvm
>>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb
>>>>>> i2c_algo_bit
>>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>>>> Call Trace:
>>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>>> ---[ end trace cee6ace13018e13f ]---
>>>>>> ------------[ cut here ]------------
>>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>>>>>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp
>>>>>> kvm_intel kvm
>>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb
>>>>>> i2c_algo_bit
>>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>>>>>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>>>>>> Call Trace:
>>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>>> ---[ end trace cee6ace13018e140 ]---
>>>>>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>>>>>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>>>>>> reserved=0, may_use=1908990066688, readonly=0
>>>>>>
>>>>>> Greets,
>>>>>> Stefan
>>>>>>
>>>>>>> Regards,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>
>>>>>>>>>> I tried hard to reproduce it but i can't get it to reproduce
>>>>>>>>>> with a
>>>>>>>>>> test
>>>>>>>>>> script. Any ideas?
>>>>>>>>>>
>>>>>>>>>> Stefan
>>>>>>>>>>
>>>>>>>>>>> Reagrds,
>>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>>
>>>>>>>>>>>> Greets,
>>>>>>>>>>>> Stefan
>>>>>>>>>>>>
>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>>>>> Greets,
>>>>>>>>>>>>>> Stefan
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>>>>>> linux-btrfs" in
>>>>>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>>>>>> More majordomo info at
>>>>>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 8:16 ` Stefan Priebe - Profihost AG
@ 2016-10-07 8:19 ` Wang Xiaoguang
0 siblings, 0 replies; 37+ messages in thread
From: Wang Xiaoguang @ 2016-10-07 8:19 UTC (permalink / raw)
To: Stefan Priebe - Profihost AG, linux-btrfs
hello,
On 10/07/2016 04:16 PM, Stefan Priebe - Profihost AG wrote:
> Am 07.10.2016 um 10:07 schrieb Wang Xiaoguang:
>> hello,
>>
>> On 10/07/2016 04:06 PM, Stefan Priebe - Profihost AG wrote:
>>> and it shows:
>>>
>>> PAG | scan 33829e5 | steal 1968e3 | stall 0 | |
>>> | | swin 257071 | swout 346960 |
>>>
>>> but the highest user space prog uses only 190MB.
>> If you don't apply my patches, there will be no OOMs in your test
>> environment?
>> I want to confirm whether this OOM is caused by my patches...
> This happens also without your patches. That's what i meant with can't
> use v4.8.0.
>
> Is it OK to try v4.7.6?
OK, I see.
I think you can have a try :)
Paul Jones has mentioned that "4.7.5 has fixed all the OOM problems for
me, so try that one."
Regards,
XIaoguang Wang
>
> Greets,
> Stefan
>
>> Regards,
>> Xiaoguang Wang
>>
>>> greets,
>>> Stefan
>>>
>>> Am 07.10.2016 um 09:17 schrieb Wang Xiaoguang:
>>>> Hi,
>>>>
>>>> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>>>>> Dear Wang,
>>>>>
>>>>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>>>>
>>>>> Complete traces with your patch and some more btrfs patches applied (in
>>>>> the hope in fixes the OOM but it did not):
>>>>> http://pastebin.com/raw/6vmRSDm1
>>>> I didn't see any such OOMs...
>>>> Can you try holger's tree with my patches.
>>>>
>>>> Regards,
>>>> Xiaoguang Wang
>>>>> Greets,
>>>>> Stefan
>>>>> Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
>>>>>> Hi,
>>>>>>
>>>>>> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>>>>>>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>>>>>>> I found that compress sometime report ENOSPC error even in
>>>>>>>>>> 4.8-rc8,
>>>>>>>>>> currently
>>>>>>>>> I cannot confirm that as i do not have anough space to test this
>>>>>>>>> without
>>>>>>>>> compression ;-( But yes i've compression enabled.
>>>>>>>> I might not get you, my poor english :)
>>>>>>>> You mean that you only get ENOSPC error when compression is enabled?
>>>>>>>>
>>>>>>>> And when compression is not enabled, you do not get ENOSPC error?
>>>>>>> I can't tell you. I cannot test with compression not enabled. I do
>>>>>>> not
>>>>>>> have anough free space on this disk.
>>>>>> I had just sent two patches to fix false enospc error for compression,
>>>>>> please have a try, they fix false enospc error in my test environment.
>>>>>> btrfs: fix false enospc for compression
>>>>>> btrfs: improve inode's outstanding_extents computation
>>>>>>
>>>>>> I apply these two patchs in linux upstream tree, the latest commit
>>>>>> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>>>>>>
>>>>>> Regards,
>>>>>> Xiaoguang Wang
>>>>>>
>>>>>>>>>> I'm trying to fix it.
>>>>>>>>> That sounds good but do you also get the
>>>>>>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>>>>>>
>>>>>>>>> kernel messages on umount? if not you might have found another
>>>>>>>>> problem.
>>>>>>>> Yes, I seem similar messages, you can paste you whole dmesg info
>>>>>>>> here.
>>>>>>> ------------[ cut here ]------------
>>>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>>>>>>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>>>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp
>>>>>>> kvm_intel kvm
>>>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb
>>>>>>> i2c_algo_bit
>>>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>>>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>>>>> Call Trace:
>>>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>>>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>>>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>>>> ---[ end trace cee6ace13018e13e ]---
>>>>>>> ------------[ cut here ]------------
>>>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>>>>>>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>>>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp
>>>>>>> kvm_intel kvm
>>>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb
>>>>>>> i2c_algo_bit
>>>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>>>>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>>>>>> Call Trace:
>>>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>>>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>>>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>>>> ---[ end trace cee6ace13018e13f ]---
>>>>>>> ------------[ cut here ]------------
>>>>>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>>>>>>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>>>>>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>>>>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp
>>>>>>> kvm_intel kvm
>>>>>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>>>>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>>>>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>>>>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb
>>>>>>> i2c_algo_bit
>>>>>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>>>>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>>>>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>>>>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>>>>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>>>>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>>>>>>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>>>>>>> Call Trace:
>>>>>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>>>>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>>>>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>>>>>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>>>>>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>>>>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>>>>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>>>>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>>>>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>>>>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>>>>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>>>>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>>>>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>>>>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>>>>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>>>>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>>>>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>>>>>> ---[ end trace cee6ace13018e140 ]---
>>>>>>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>>>>>>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>>>>>>> reserved=0, may_use=1908990066688, readonly=0
>>>>>>>
>>>>>>> Greets,
>>>>>>> Stefan
>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Xiaoguang Wang
>>>>>>>>
>>>>>>>>> Stefan
>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>
>>>>>>>>>>> I tried hard to reproduce it but i can't get it to reproduce
>>>>>>>>>>> with a
>>>>>>>>>>> test
>>>>>>>>>>> script. Any ideas?
>>>>>>>>>>>
>>>>>>>>>>> Stefan
>>>>>>>>>>>
>>>>>>>>>>>> Reagrds,
>>>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>>>
>>>>>>>>>>>>> Greets,
>>>>>>>>>>>>> Stefan
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>>>>>> Greets,
>>>>>>>>>>>>>>> Stefan
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>>>>>>> linux-btrfs" in
>>>>>>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>>>>>>> More majordomo info at
>>>>>>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>
>>
>>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 7:17 ` Wang Xiaoguang
` (3 preceding siblings ...)
2016-10-07 8:06 ` Stefan Priebe - Profihost AG
@ 2016-10-07 9:33 ` Holger Hoffstätte
2016-10-08 5:56 ` Stefan Priebe - Profihost AG
2016-10-08 20:49 ` Stefan Priebe - Profihost AG
4 siblings, 2 replies; 37+ messages in thread
From: Holger Hoffstätte @ 2016-10-07 9:33 UTC (permalink / raw)
To: Wang Xiaoguang, Stefan Priebe - Profihost AG, linux-btrfs
On 10/07/16 09:17, Wang Xiaoguang wrote:
> Hi,
>
> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>> Dear Wang,
>>
>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>
>> Complete traces with your patch and some more btrfs patches applied (in
>> the hope in fixes the OOM but it did not):
>> http://pastebin.com/raw/6vmRSDm1
> I didn't see any such OOMs...
> Can you try holger's tree with my patches.
They don't really apply to either 4.4.x (because it has diverged too
much by now) or 4.8.x because of the initial dedupe support which came
in as part of 4.9rc1 - there are way too many conflicts all over the
place and merging them manually took way too much time.
It would be useful if you could rebase your patches to for-next.
Stefan, have you tried setting THP to 'madvise' or 'never'?
Try 'echo madvise > /sys/kernel/mm/transparent_hugepage/enabled'
or boot with transparent_hugepage=madvise (or never) kernel flag.
I have no idea if it will help, but it's worth a try.
-h
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 9:33 ` Holger Hoffstätte
@ 2016-10-08 5:56 ` Stefan Priebe - Profihost AG
2016-10-08 20:49 ` Stefan Priebe - Profihost AG
1 sibling, 0 replies; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-08 5:56 UTC (permalink / raw)
To: Holger Hoffstätte, Wang Xiaoguang, linux-btrfs
Hi Holger,
Am 07.10.2016 um 11:33 schrieb Holger Hoffstätte:
> On 10/07/16 09:17, Wang Xiaoguang wrote:
>> Hi,
>>
>> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>>> Dear Wang,
>>>
>>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>>
>>> Complete traces with your patch and some more btrfs patches applied (in
>>> the hope in fixes the OOM but it did not):
>>> http://pastebin.com/raw/6vmRSDm1
>> I didn't see any such OOMs...
>> Can you try holger's tree with my patches.
>
> They don't really apply to either 4.4.x (because it has diverged too
> much by now) or 4.8.x because of the initial dedupe support which came
> in as part of 4.9rc1 - there are way too many conflicts all over the
> place and merging them manually took way too much time.
> It would be useful if you could rebase your patches to for-next.
>
> Stefan, have you tried setting THP to 'madvise' or 'never'?
> Try 'echo madvise > /sys/kernel/mm/transparent_hugepage/enabled'
> or boot with transparent_hugepage=madvise (or never) kernel flag.
> I have no idea if it will help, but it's worth a try.
It's already set to never. The hosts are currently still up and running
but only if i run
echo 3 >/proc/sys/vm/drop_caches
every 30 minutes. It seems the kernel fails to reclaim the cache itself
if user space needs memory.
Greets,
Stefan
>
> -h
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-07 9:33 ` Holger Hoffstätte
2016-10-08 5:56 ` Stefan Priebe - Profihost AG
@ 2016-10-08 20:49 ` Stefan Priebe - Profihost AG
1 sibling, 0 replies; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-08 20:49 UTC (permalink / raw)
To: Holger Hoffstätte, Wang Xiaoguang, linux-btrfs
main difference between the system where oom happens is:
- Single Xeon => no OOM
- Dual Xeon / NUMA => OOM
both 64GB mem.
Am 07.10.2016 um 11:33 schrieb Holger Hoffstätte:
> On 10/07/16 09:17, Wang Xiaoguang wrote:
>> Hi,
>>
>> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote:
>>> Dear Wang,
>>>
>>> can't use v4.8.0 as i always get OOMs and total machine crashes.
>>>
>>> Complete traces with your patch and some more btrfs patches applied (in
>>> the hope in fixes the OOM but it did not):
>>> http://pastebin.com/raw/6vmRSDm1
>> I didn't see any such OOMs...
>> Can you try holger's tree with my patches.
>
> They don't really apply to either 4.4.x (because it has diverged too
> much by now) or 4.8.x because of the initial dedupe support which came
> in as part of 4.9rc1 - there are way too many conflicts all over the
> place and merging them manually took way too much time.
> It would be useful if you could rebase your patches to for-next.
>
> Stefan, have you tried setting THP to 'madvise' or 'never'?
> Try 'echo madvise > /sys/kernel/mm/transparent_hugepage/enabled'
> or boot with transparent_hugepage=madvise (or never) kernel flag.
> I have no idea if it will help, but it's worth a try.
>
> -h
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-06 3:04 ` Wang Xiaoguang
` (2 preceding siblings ...)
2016-10-07 7:03 ` Stefan Priebe - Profihost AG
@ 2016-10-08 6:05 ` Stefan Priebe - Profihost AG
2016-10-10 20:06 ` Stefan Priebe - Profihost AG
4 siblings, 0 replies; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-08 6:05 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
Hi Wang,
currently on the system where it's working fine - no ENOSPC error. But
it will take a week to be sure they don't come back.
Thanks!
Greets,
Stefan
Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
> Hi,
>
> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>> currently
>>>> I cannot confirm that as i do not have anough space to test this
>>>> without
>>>> compression ;-( But yes i've compression enabled.
>>> I might not get you, my poor english :)
>>> You mean that you only get ENOSPC error when compression is enabled?
>>>
>>> And when compression is not enabled, you do not get ENOSPC error?
>> I can't tell you. I cannot test with compression not enabled. I do not
>> have anough free space on this disk.
> I had just sent two patches to fix false enospc error for compression,
> please have a try, they fix false enospc error in my test environment.
> btrfs: fix false enospc for compression
> btrfs: improve inode's outstanding_extents computation
>
> I apply these two patchs in linux upstream tree, the latest commit
> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
>
> Regards,
> Xiaoguang Wang
>
>>
>>>>> I'm trying to fix it.
>>>> That sounds good but do you also get the
>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>
>>>> kernel messages on umount? if not you might have found another problem.
>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13e ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13f ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e140 ]---
>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>> reserved=0, may_use=1908990066688, readonly=0
>>
>> Greets,
>> Stefan
>>
>>> Regards,
>>> Xiaoguang Wang
>>>
>>>> Stefan
>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>> test
>>>>>> script. Any ideas?
>>>>>>
>>>>>> Stefan
>>>>>>
>>>>>>> Reagrds,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> Greets,
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>> Greets,
>>>>>>>>>> Stefan
>>>>>>>>>> --
>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>> linux-btrfs" in
>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>> More majordomo info at
>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>
>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-06 3:04 ` Wang Xiaoguang
` (3 preceding siblings ...)
2016-10-08 6:05 ` Stefan Priebe - Profihost AG
@ 2016-10-10 20:06 ` Stefan Priebe - Profihost AG
2016-10-11 3:16 ` Wang Xiaoguang
4 siblings, 1 reply; 37+ messages in thread
From: Stefan Priebe - Profihost AG @ 2016-10-10 20:06 UTC (permalink / raw)
To: Wang Xiaoguang, linux-btrfs
Dear Wang,
Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
> Hi,
>
> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>> currently
>>>> I cannot confirm that as i do not have anough space to test this
>>>> without
>>>> compression ;-( But yes i've compression enabled.
>>> I might not get you, my poor english :)
>>> You mean that you only get ENOSPC error when compression is enabled?
>>>
>>> And when compression is not enabled, you do not get ENOSPC error?
>> I can't tell you. I cannot test with compression not enabled. I do not
>> have anough free space on this disk.
> I had just sent two patches to fix false enospc error for compression,
> please have a try, they fix false enospc error in my test environment.
> btrfs: fix false enospc for compression
> btrfs: improve inode's outstanding_extents computation
>
> I apply these two patchs in linux upstream tree, the latest commit
> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
no space errors since 5 days! that's currently amazing. I Hope it stays
this and your patches get into 4.9.
Greets,
Stefan
>
> Regards,
> Xiaoguang Wang
>
>>
>>>>> I'm trying to fix it.
>>>> That sounds good but do you also get the
>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>
>>>> kernel messages on umount? if not you might have found another problem.
>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13e ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e13f ]---
>> ------------[ cut here ]------------
>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>> Call Trace:
>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>> ---[ end trace cee6ace13018e140 ]---
>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>> reserved=0, may_use=1908990066688, readonly=0
>>
>> Greets,
>> Stefan
>>
>>> Regards,
>>> Xiaoguang Wang
>>>
>>>> Stefan
>>>>
>>>>> Regards,
>>>>> Xiaoguang Wang
>>>>>
>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>> test
>>>>>> script. Any ideas?
>>>>>>
>>>>>> Stefan
>>>>>>
>>>>>>> Reagrds,
>>>>>>> Xiaoguang Wang
>>>>>>>
>>>>>>>> Greets,
>>>>>>>> Stefan
>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Xiaoguang Wang
>>>>>>>>>> Greets,
>>>>>>>>>> Stefan
>>>>>>>>>> --
>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>> linux-btrfs" in
>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>> More majordomo info at
>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>
>>>>>>>>>>
>>>>>
>>>
>>>
>>
>
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full
2016-10-10 20:06 ` Stefan Priebe - Profihost AG
@ 2016-10-11 3:16 ` Wang Xiaoguang
0 siblings, 0 replies; 37+ messages in thread
From: Wang Xiaoguang @ 2016-10-11 3:16 UTC (permalink / raw)
To: Stefan Priebe - Profihost AG, linux-btrfs
hi,
On 10/11/2016 04:06 AM, Stefan Priebe - Profihost AG wrote:
> Dear Wang,
>
> Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang:
>> Hi,
>>
>> On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote:
>>> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:
>>>>>> I found that compress sometime report ENOSPC error even in 4.8-rc8,
>>>>>> currently
>>>>> I cannot confirm that as i do not have anough space to test this
>>>>> without
>>>>> compression ;-( But yes i've compression enabled.
>>>> I might not get you, my poor english :)
>>>> You mean that you only get ENOSPC error when compression is enabled?
>>>>
>>>> And when compression is not enabled, you do not get ENOSPC error?
>>> I can't tell you. I cannot test with compression not enabled. I do not
>>> have anough free space on this disk.
>> I had just sent two patches to fix false enospc error for compression,
>> please have a try, they fix false enospc error in my test environment.
>> btrfs: fix false enospc for compression
>> btrfs: improve inode's outstanding_extents computation
>>
>> I apply these two patchs in linux upstream tree, the latest commit
>> is 41844e36206be90cd4d962ea49b0abc3612a99d0.
> no space errors since 5 days! that's currently amazing. I Hope it stays
> this and your patches get into 4.9.
Yeah, good news :)
OK, I'll try to get these 2 patches merged, currently they still need
some code reviews from maintainers.
Regards,
Xiaoguang Wang
>
> Greets,
> Stefan
>
>> Regards,
>> Xiaoguang Wang
>>
>>>>>> I'm trying to fix it.
>>>>> That sounds good but do you also get the
>>>>> BTRFS: space_info 4 has 18446742286429913088 free, is not full
>>>>>
>>>>> kernel messages on umount? if not you might have found another problem.
>>>> Yes, I seem similar messages, you can paste you whole dmesg info here.
>>> ------------[ cut here ]------------
>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5790
>>> btrfs_free_block_groups+0x346/0x430 [btrfs]()
>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>> CPU: 2 PID: 5187 Comm: umount Tainted: G O 4.4.22+63-ph #1
>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>> Call Trace:
>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>> [<ffffffffc05de9a6>] btrfs_free_block_groups+0x346/0x430 [btrfs]
>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>> ---[ end trace cee6ace13018e13e ]---
>>> ------------[ cut here ]------------
>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:5791
>>> btrfs_free_block_groups+0x365/0x430 [btrfs]()
>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 0000000000000000
>>> ffff880074bf0a00 ffff88103c10c088 ffff88103c10c000 ffff88103c10c098
>>> Call Trace:
>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>> [<ffffffffc05de9c5>] btrfs_free_block_groups+0x365/0x430 [btrfs]
>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>> ---[ end trace cee6ace13018e13f ]---
>>> ------------[ cut here ]------------
>>> WARNING: CPU: 2 PID: 5187 at fs/btrfs/extent-tree.c:10151
>>> btrfs_free_block_groups+0x291/0x430 [btrfs]()
>>> Modules linked in: netconsole xt_multiport iptable_filter ip_tables
>>> x_tables 8021q garp bonding x86_pkg_temp_thermal coretemp kvm_intel kvm
>>> irqbypass sb_edac crc32_pclmul edac_core i2c_i801 i40e(O) vxlan
>>> ip6_udp_tunnel udp_tunnel shpchp ipmi_si ipmi_msghandler button loop
>>> btrfs dm_mod raid10 raid0 multipath linear raid456 async_raid6_recov
>>> async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit
>>> i2c_core usbhid raid1 md_mod xhci_pci sg ehci_pci xhci_hcd ehci_hcd
>>> sd_mod ahci usbcore ptp libahci usb_common pps_core aacraid
>>> CPU: 2 PID: 5187 Comm: umount Tainted: G W O 4.4.22+63-ph #1
>>> Hardware name: Supermicro Super Server/X10SRi-F, BIOS 2.0 12/17/2015
>>> 0000000000000000 ffff880fda777d00 ffffffff813b69c3 0000000000000000
>>> ffffffffc067a099 ffff880fda777d38 ffffffff810821c6 ffff880074bf0000
>>> ffff880074bf0088 ffff880074bf0df8 ffff88103c10c000 0000000000000000
>>> Call Trace:
>>> [<ffffffff813b69c3>] dump_stack+0x63/0x90
>>> [<ffffffff810821c6>] warn_slowpath_common+0x86/0xc0
>>> [<ffffffff810822ba>] warn_slowpath_null+0x1a/0x20
>>> [<ffffffffc05de8f1>] btrfs_free_block_groups+0x291/0x430 [btrfs]
>>> [<ffffffffc05f0bad>] close_ctree+0x15d/0x330 [btrfs]
>>> [<ffffffffc05bf409>] btrfs_put_super+0x19/0x20 [btrfs]
>>> [<ffffffff811c85af>] generic_shutdown_super+0x6f/0x100
>>> [<ffffffff811c8652>] kill_anon_super+0x12/0x20
>>> [<ffffffffc05c0376>] btrfs_kill_super+0x16/0xa0 [btrfs]
>>> [<ffffffff811c7ff3>] deactivate_locked_super+0x43/0x70
>>> [<ffffffff811c807c>] deactivate_super+0x5c/0x60
>>> [<ffffffff811e3b5f>] cleanup_mnt+0x3f/0x90
>>> [<ffffffff811e3bf2>] __cleanup_mnt+0x12/0x20
>>> [<ffffffff8109dad1>] task_work_run+0x81/0xa0
>>> [<ffffffff810021c0>] exit_to_usermode_loop+0xb0/0xc0
>>> [<ffffffff81002b44>] syscall_return_slowpath+0xd4/0x130
>>> [<ffffffff8169dc0c>] int_ret_from_sys_call+0x25/0x8f
>>> ---[ end trace cee6ace13018e140 ]---
>>> BTRFS: space_info 4 has 18446742182612910080 free, is not full
>>> BTRFS: space_info total=82678120448, used=64784695296, pinned=0,
>>> reserved=0, may_use=1908990066688, readonly=0
>>>
>>> Greets,
>>> Stefan
>>>
>>>> Regards,
>>>> Xiaoguang Wang
>>>>
>>>>> Stefan
>>>>>
>>>>>> Regards,
>>>>>> Xiaoguang Wang
>>>>>>
>>>>>>> I tried hard to reproduce it but i can't get it to reproduce with a
>>>>>>> test
>>>>>>> script. Any ideas?
>>>>>>>
>>>>>>> Stefan
>>>>>>>
>>>>>>>> Reagrds,
>>>>>>>> Xiaoguang Wang
>>>>>>>>
>>>>>>>>> Greets,
>>>>>>>>> Stefan
>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Xiaoguang Wang
>>>>>>>>>>> Greets,
>>>>>>>>>>> Stefan
>>>>>>>>>>> --
>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>>>>>>>>> linux-btrfs" in
>>>>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>>>>> More majordomo info at
>>>>>>>>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>
>>>>>>>>>>>
>>>>
>>
>>
>
^ permalink raw reply [flat|nested] 37+ messages in thread