From: Jeff Mahoney <jeffm@suse.com>
To: Ronan Arraes Jardim Chagas <ronisbr@gmail.com>,
Qu Wenruo <quwenruo@cn.fujitsu.com>,
Chris Murphy <lists@colorremedies.com>,
"Austin S. Hemmelgarn" <ahferroin7@gmail.com>
Cc: Wang Xiaoguang <wangxg.fnst@cn.fujitsu.com>,
Btrfs BTRFS <linux-btrfs@vger.kernel.org>
Subject: Re: BTRFS constantly reports "No space left on device" even with a huge unallocated space
Date: Thu, 8 Sep 2016 14:49:56 -0400 [thread overview]
Message-ID: <86f87e36-db70-2ad1-cc20-3537dc7e529e@suse.com> (raw)
In-Reply-To: <1473359094.7190.1.camel@gmail.com>
[-- Attachment #1.1: Type: text/plain, Size: 4191 bytes --]
On 9/8/16 2:24 PM, Ronan Arraes Jardim Chagas wrote:
> Hi all!
>
> Em Seg, 2016-09-05 às 16:49 +0800, Qu Wenruo escreveu:
>> Just like what Wang has mentioned, would you please paste all the
>> output
>> of the contents of /sys/fs/btrfs/<your fs uuid>/allocation?
>>
>> It's recommended to use "grep . -IR <path>" to get all the data as
>> it
>> will show the file name.
>
> So, one more time, I see the problem. This time I was just using
> Firefox and I cannot recover using `btrfs balance`. I think that, one
> more time, I will need to reboot this machine. This problem is really
> causing me a lot of troubles :(
I have a hunch the list is about to be flooded with similar reports if
we don't find this one before 4.8.
commit d555b6c380c644af63dbdaa7cc14bba041a4e4dd
Author: Josef Bacik <jbacik@fb.com>
Date: Fri Mar 25 13:25:51 2016 -0400
Btrfs: warn_on for unaccounted spaces
This commit isn't the source of the bug, but it's making it a lot more
noisy. I spent a few hours last night trying to track down why xfstests
was throwing these warnings and I was able to reproduce them at least as
far back as 4.4-vanilla with -oenospc_debug enabled.
Speaking of which, can you turn on mounting with -oenospc_debug if you
haven't already?
In my case, space_info->bytes_may_use was getting accounted incorrectly.
I am able to reproduce that even with the following commit:
commit 18513091af9483ba84328d42092bd4d42a3c958f
Author: Wang Xiaoguang <wangxg.fnst@cn.fujitsu.com>
Date: Mon Jul 25 15:51:40 2016 +0800
btrfs: update btrfs_space_info's bytes_may_use timely
> grep . -IR /sys/fs/btrfs/e9efaa0c-d477-4249-830f-
> ee5956768b29/allocation
> allocation/data/flags:1
> allocation/data/bytes_pinned:0
> allocation/data/bytes_may_use:0
> allocation/data/total_bytes_pinned:202973265920
That adds up to ~ 189 GB. total_bytes is only about 42 GB.
> allocation/data/bytes_reserved:0
> allocation/data/bytes_used:45623730176
> allocation/data/single/used_bytes:45623730176
> allocation/data/single/total_bytes:46179287040
> allocation/data/total_bytes:46179287040
> allocation/data/disk_total:46179287040
> allocation/data/disk_used:45623730176
> allocation/metadata/dup/used_bytes:1120698368
> allocation/metadata/dup/total_bytes:6979321856
> allocation/metadata/flags:4
> allocation/metadata/bytes_pinned:0
> allocation/metadata/bytes_may_use:88521768960
> allocation/metadata/total_bytes_pinned:-44285952
... well that's certainly interesting. It looks like we'll need to see
how that happened. It seems like we've messed up at least that portion
of accounting.
-Jeff
> allocation/metadata/bytes_reserved:0
> allocation/metadata/bytes_used:1120698368
> allocation/metadata/total_bytes:6979321856
> allocation/metadata/disk_total:13958643712
> allocation/metadata/disk_used:2241396736
> allocation/global_rsv_size:385875968
> allocation/global_rsv_reserved:385875968
> allocation/system/dup/used_bytes:16384
> allocation/system/dup/total_bytes:33554432
> allocation/system/flags:2
> allocation/system/bytes_pinned:0
> allocation/system/bytes_may_use:0
> allocation/system/total_bytes_pinned:0
> allocation/system/bytes_reserved:0
> allocation/system/bytes_used:16384
> allocation/system/total_bytes:33554432
> allocation/system/disk_total:67108864
> allocation/system/disk_used:32768
>
> Additional information:
>
> btrfs fi usage /
> Overall:
> Device size: 1.26TiB
> Device allocated: 56.07GiB
> Device unallocated: 1.20TiB
> Device missing: 0.00B
> Used: 44.58GiB
> Free (estimated): 1.20TiB (min: 616.41GiB)
> Data ratio: 1.00
> Metadata ratio: 2.00
> Global reserve: 368.00MiB (used: 0.00B)
>
> Data,single: Size:43.01GiB, Used:42.49GiB
> /dev/sda6 43.01GiB
>
> Metadata,DUP: Size:6.50GiB, Used:1.04GiB
> /dev/sda6 13.00GiB
>
> System,DUP: Size:32.00MiB, Used:16.00KiB
> /dev/sda6 64.00MiB
>
> Unallocated:
> /dev/sda6 1.20TiB
>
> Can anyone help me?
>
> Best regards,
> Ronan Arraes
>
--
Jeff Mahoney
SUSE Labs
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 881 bytes --]
next prev parent reply other threads:[~2016-09-08 18:50 UTC|newest]
Thread overview: 82+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-08-12 17:36 BTRFS constantly reports "No space left on device" even with a huge unallocated space Ronan Arraes Jardim Chagas
2016-08-12 18:02 ` Chris Murphy
2016-08-12 19:00 ` Ronan Arraes Jardim Chagas
2016-08-12 19:37 ` Chris Murphy
2016-08-12 20:34 ` Chris Murphy
[not found] ` <CAKdnfRJeOXHmrumDkfxLTf-nU=KwZ0f7ybET-3o7kwwJDOZ2aw@mail.gmail.com>
2016-08-15 23:24 ` Chris Murphy
2016-08-16 17:49 ` Ronan Arraes Jardim Chagas
2016-08-22 19:11 ` Ronan Arraes Jardim Chagas
2016-08-22 20:39 ` Ronan Arraes Jardim Chagas
2016-08-22 20:49 ` Chris Murphy
2016-08-22 21:04 ` Ronan Arraes Jardim Chagas
2016-08-24 0:40 ` Jeff Mahoney
2016-08-25 15:58 ` Lutz Vieweg
2016-08-25 23:56 ` Chris Murphy
2016-08-26 5:59 ` Marc Haber
2016-08-29 12:12 ` Wang Xiaoguang
2016-08-29 13:20 ` Ronan Arraes Jardim Chagas
2016-08-29 15:52 ` Ronan Arraes Jardim Chagas
2016-08-29 22:25 ` Jeff Mahoney
2016-08-30 2:12 ` Wang Xiaoguang
2016-08-30 12:50 ` Ronan Arraes Jardim Chagas
2016-08-30 16:44 ` Chris Murphy
2016-08-30 16:57 ` Ronan Arraes Jardim Chagas
2016-08-31 20:49 ` Ronan Arraes Jardim Chagas
2016-08-31 21:44 ` Chris Murphy
2016-08-31 21:48 ` Chris Murphy
2016-08-31 22:47 ` Jeff Mahoney
2016-08-31 22:58 ` Chris Murphy
2016-08-31 23:03 ` Jeff Mahoney
2016-08-31 23:09 ` Chris Murphy
2016-09-01 12:57 ` Ronan Arraes Jardim Chagas
2016-09-01 13:21 ` Austin S. Hemmelgarn
2016-09-01 16:34 ` Ronan Arraes Jardim Chagas
2016-09-01 17:04 ` Austin S. Hemmelgarn
2016-09-01 17:12 ` Jeff Mahoney
2016-09-01 17:39 ` Ronan Arraes Jardim Chagas
2016-09-01 17:43 ` Jeff Mahoney
2016-09-01 17:58 ` Ronan Arraes Jardim Chagas
2016-09-01 17:45 ` Chris Murphy
2016-09-01 18:47 ` Austin S. Hemmelgarn
2016-09-02 0:12 ` Chris Murphy
2016-09-02 14:26 ` Jeff Mahoney
2016-09-02 14:43 ` Ronan Arraes Jardim Chagas
2016-09-02 14:48 ` Jeff Mahoney
2016-09-02 15:20 ` Ronan Arraes Jardim Chagas
2016-09-02 15:26 ` Jeff Mahoney
2016-09-02 19:25 ` Ronan Arraes Jardim Chagas
2016-09-05 8:49 ` Qu Wenruo
2016-09-08 18:24 ` Ronan Arraes Jardim Chagas
2016-09-08 18:49 ` Jeff Mahoney [this message]
2016-09-08 23:02 ` Jeff Mahoney
2016-09-13 20:24 ` Josef Bacik
2016-09-14 14:25 ` Jeff Mahoney
2016-09-19 2:38 ` Wang Xiaoguang
2016-09-22 13:40 ` Jeff Mahoney
[not found] ` <57DF4E44.2040506@cn.fujitsu.com>
2016-09-22 13:20 ` Ronan Arraes Jardim Chagas
2016-09-22 13:41 ` Austin S. Hemmelgarn
2016-09-22 14:03 ` Ronan Arraes Jardim Chagas
2016-09-22 14:39 ` Josef Bacik
2016-09-22 17:06 ` Ronan Arraes Jardim Chagas
2016-09-22 17:49 ` Josef Bacik
2016-09-22 17:54 ` Ronan Arraes Jardim Chagas
2016-09-23 15:20 ` [SOLVED] " Ronan Arraes Jardim Chagas
2016-09-02 19:56 ` Ronan Arraes Jardim Chagas
2016-09-02 21:34 ` Chris Murphy
2016-09-02 22:13 ` Ronan Arraes Jardim Chagas
2016-09-02 22:39 ` Chris Murphy
2016-09-03 2:47 ` Ronan Arraes Jardim Chagas
2016-09-03 3:41 ` Chris Murphy
2016-09-03 3:47 ` Ronan Arraes Jardim Chagas
2016-09-03 4:14 ` Chris Murphy
2016-09-01 17:07 ` Chris Murphy
2016-09-02 0:37 ` Qu Wenruo
2016-09-02 14:09 ` Jeff Mahoney
2016-09-14 20:15 ` Ronan Arraes Jardim Chagas
2016-09-14 22:25 ` Chris Murphy
2016-09-15 0:56 ` Ronan Arraes Jardim Chagas
2016-09-13 3:17 ` Wang Xiaoguang
2016-09-13 12:54 ` Ronan Arraes Jardim Chagas
2016-09-13 20:49 ` Ronan Arraes Jardim Chagas
2016-09-13 21:01 ` Josef Bacik
2016-09-14 14:40 ` Ronan Arraes Jardim Chagas
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=86f87e36-db70-2ad1-cc20-3537dc7e529e@suse.com \
--to=jeffm@suse.com \
--cc=ahferroin7@gmail.com \
--cc=linux-btrfs@vger.kernel.org \
--cc=lists@colorremedies.com \
--cc=quwenruo@cn.fujitsu.com \
--cc=ronisbr@gmail.com \
--cc=wangxg.fnst@cn.fujitsu.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.