From: Qu Wenruo <quwenruo.btrfs@gmx.com>
To: dsterba@suse.cz, Qu Wenruo <wqu@suse.com>
Cc: linux-btrfs@vger.kernel.org
Subject: Re: [PATCH] btrfs: tree-checker: dump the page status if hit something wrong
Date: Wed, 7 Feb 2024 07:04:06 +1030 [thread overview]
Message-ID: <f7338589-046b-42ec-8b1d-c6f247a482d8@gmx.com> (raw)
In-Reply-To: <20240206124642.GM355@twin.jikos.cz>
On 2024/2/6 23:16, David Sterba wrote:
> On Sat, Jan 27, 2024 at 10:18:36AM +1030, Qu Wenruo wrote:
>> [BUG]
>> There is a bug report about very suspicious tree-checker got triggered:
>>
>> BTRFS critical (device dm-0): corrupted node, root=256
>> block=8550954455682405139 owner mismatch, have 11858205567642294356
>> expect [256, 18446744073709551360]
>> BTRFS critical (device dm-0): corrupted node, root=256
>> block=8550954455682405139 owner mismatch, have 11858205567642294356
>> expect [256, 18446744073709551360]
>> BTRFS critical (device dm-0): corrupted node, root=256
>> block=8550954455682405139 owner mismatch, have 11858205567642294356
>> expect [256, 18446744073709551360]
>> SELinux: inode_doinit_use_xattr: getxattr returned 117 for dev=dm-0
>> ino=5737268
>>
>> [ANALYZE]
>> The root cause is still unclear, but there are some clues already:
>>
>> - Unaligned eb bytenr
>> The block bytenr is 8550954455682405139, which is not even aligned to
>> 2.
>> This bytenr is fetched from extent buffer header, not from eb->start.
>>
>> This means, at the initial time of read, eb header bytenr is still
>> correct (the very basis check to continue read), but later something
>> wrong happened, got at least the first page corrupted.
>> Thus we got such obviously incorrect value.
>>
>> - Invalid extent buffer header owner
>> The read itself is triggered for subvolume 256, but the eb header
>> owner is 11858205567642294356, which is not really possible.
>> The problem here is, subovlume id is limited to (1 << 48 - 1),
>> and this one definitely goes beyond that limit.
>>
>> So this value is another garbage.
>>
>> We already got two garbage from an extent buffer, which passed the
>> initial bytenr and csum checks, but later the contents become garbage at
>> some point.
>>
>> This looks like a page lifespan problem (e.g. we didn't proper hold the
>> page).
>>
>> [ENHANCEMENT]
>> The current tree-checker only output things from the extent buffer,
>> nothing with the page status.
>>
>> So this patch would enhance the tree-checker output by also dumpping the
>> first page, which would look like this:
>>
>> page:00000000aa9f3ce8 refcount:4 mapcount:0 mapping:00000000169aa6b6 index:0x1d0c pfn:0x1022e5
>> memcg:ffff888103456000
>> aops:btree_aops [btrfs] ino:1
>> flags: 0x2ffff0000008000(private|node=0|zone=2|lastcpupid=0xffff)
>> page_type: 0xffffffff()
>> raw: 02ffff0000008000 0000000000000000 dead000000000122 ffff88811e06e220
>> raw: 0000000000001d0c ffff888102fdb1d8 00000004ffffffff ffff888103456000
>> page dumped because: eb page dump
>> BTRFS critical (device dm-3): corrupt leaf: root=5 block=30457856 slot=6 ino=257 file_offset=0, invalid disk_bytenr for file extent, have 10617606235235216665, should be aligned to 4096
>> BTRFS error (device dm-3): read time tree block corruption detected on logical 30457856 mirror 1
>>
>> >From the dump we can see some extra info, something can help us to do
>> extra cross-checks:
>>
>> - Page refcount
>> if it's too low, it definitely means something bad.
>>
>> - Page aops
>> Any mapped eb page should have btree_aops with inode number 1.
>>
>> - Page index
>> Since a mapped eb page should has its bytenr matching the page
>> position, (index << PAGE_SHIFT) should match the bytenr of the
>> bytenr from the critical line.
>>
>> - Page Private flags
>> A mapped eb page should have Private flag set to indicate it's managed
>> by btrfs.
>>
>> Link: https://marc.info/?l=linux-btrfs&m=170629708724284&w=2
>
> Please use a link to lore.kernel.org, this keeps the threading and the
> message id is in the url so it's possible to look it up elsewhere.
The problem is, at the time of writing, lore.kernel.org is down...
That's why I have to go marc.info for it.
Just hope the infrastructure would be a little more stable than vger.
Thanks,
Qu
>
>> Signed-off-by: Qu Wenruo <wqu@suse.com>
>
> For debugging the patch is useful, I'd say go on and add it.
>
> Reviewed-by: David Sterba <dsterba@suse.com>
>
prev parent reply other threads:[~2024-02-06 20:34 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-01-26 23:48 [PATCH] btrfs: tree-checker: dump the page status if hit something wrong Qu Wenruo
2024-02-06 3:38 ` tavianator
2024-02-06 5:54 ` Qu Wenruo
2024-02-06 20:12 ` Tavian Barnes
2024-02-06 20:39 ` Qu Wenruo
2024-02-06 21:48 ` Tavian Barnes
2024-02-06 21:53 ` Qu Wenruo
2024-02-13 18:07 ` Tavian Barnes
2024-02-13 18:26 ` Tavian Barnes
2024-02-13 21:26 ` Qu Wenruo
2024-02-06 21:53 ` Tavian Barnes
2024-02-06 22:01 ` Qu Wenruo
2024-02-06 12:51 ` David Sterba
2024-02-06 20:19 ` Tavian Barnes
2024-02-06 12:46 ` David Sterba
2024-02-06 20:34 ` Qu Wenruo [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=f7338589-046b-42ec-8b1d-c6f247a482d8@gmx.com \
--to=quwenruo.btrfs@gmx.com \
--cc=dsterba@suse.cz \
--cc=linux-btrfs@vger.kernel.org \
--cc=wqu@suse.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).