From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8A47FC433EF for ; Mon, 4 Apr 2022 22:51:26 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234550AbiDDWxU (ORCPT ); Mon, 4 Apr 2022 18:53:20 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:38846 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234912AbiDDWxL (ORCPT ); Mon, 4 Apr 2022 18:53:11 -0400 Received: from mail1.merlins.org (magic.merlins.org [209.81.13.136]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D40A963BFE for ; Mon, 4 Apr 2022 15:09:37 -0700 (PDT) Received: from merlin by mail1.merlins.org with local (Exim 4.94.2 #2) id 1nbUtD-0001C0-Rc by authid ; Mon, 04 Apr 2022 15:09:35 -0700 Date: Mon, 4 Apr 2022 15:09:35 -0700 From: Marc MERLIN To: Josef Bacik Cc: Andrei Borzenkov , Zygo Blaxell , "linux-btrfs@vger.kernel.org" , Chris Murphy , Qu Wenruo Subject: Re: Rebuilding 24TB Raid5 array (was btrfs corruption: parent transid verify failed + open_ctree failed) Message-ID: <20220404220935.GH14158@merlins.org> References: <20220404174357.GT1314726@merlins.org> <20220404181055.GW1314726@merlins.org> <20220404190403.GY1314726@merlins.org> <20220404203333.GZ1314726@merlins.org> <20220404212951.GG14158@merlins.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Sysadmin: BOFH X-URL: http://marc.merlins.org/ User-Agent: Mutt/1.10.1 (2018-07-13) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: marc@merlins.org Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org On Mon, Apr 04, 2022 at 05:40:14PM -0400, Josef Bacik wrote: > Ok cool, lets do > > ./btrfs check -r 13577779511296 /dev/mapper/dshelf1a > ./btrfs check -r 13577821667328 /dev/mapper/dshelf1a > ./btrfs check -r 13577775284224 /dev/mapper/dshelf1a > > and see what those say, it looks like the tree root is stale and can't > find the root pointers for anything. Thanks, Sure thing, the last one is slightly different (found 1602088) gargamel:/var/local/src/btrfs-progs-josefbacik# ./btrfs check -r 13577779511296 /dev/mapper/dshelf1a Opening filesystem to check... parent transid verify failed on 22216704 wanted 1600938 found 1602177 parent transid verify failed on 22216704 wanted 1600938 found 1602177 parent transid verify failed on 22216704 wanted 1600938 found 1602177 Ignoring transid failure parent transid verify failed on 13577779511296 wanted 1602089 found 1602242 parent transid verify failed on 13577779511296 wanted 1602089 found 1602242 parent transid verify failed on 13577779511296 wanted 1602089 found 1602242 Ignoring transid failure ERROR: root [1 0] level 0 does not match 1 Couldn't read tree root ERROR: cannot open file system gargamel:/var/local/src/btrfs-progs-josefbacik# ./btrfs check -r 13577821667328 /dev/mapper/dshelf1a Opening filesystem to check... parent transid verify failed on 22216704 wanted 1600938 found 1602177 parent transid verify failed on 22216704 wanted 1600938 found 1602177 parent transid verify failed on 22216704 wanted 1600938 found 1602177 Ignoring transid failure parent transid verify failed on 13577821667328 wanted 1602089 found 1602242 parent transid verify failed on 13577821667328 wanted 1602089 found 1602242 parent transid verify failed on 13577821667328 wanted 1602089 found 1602242 Ignoring transid failure ERROR: root [1 0] level 0 does not match 1 Couldn't read tree root ERROR: cannot open file system gargamel:/var/local/src/btrfs-progs-josefbacik# ./btrfs check -r 13577775284224 /dev/mapper/dshelf1a Opening filesystem to check... parent transid verify failed on 22216704 wanted 1600938 found 1602177 parent transid verify failed on 22216704 wanted 1600938 found 1602177 parent transid verify failed on 22216704 wanted 1600938 found 1602177 Ignoring transid failure parent transid verify failed on 13577775284224 wanted 1602089 found 1602088 parent transid verify failed on 13577775284224 wanted 1602089 found 1602242 parent transid verify failed on 13577775284224 wanted 1602089 found 1602242 Ignoring transid failure ERROR: root [1 0] level 0 does not match 1 Couldn't read tree root ERROR: cannot open file system -- "A mouse is a device used to point at the xterm you want to type in" - A.S.R. Home page: http://marc.merlins.org/