From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <linux-btrfs-owner@kernel.org>
X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on
	aws-us-west-2-korg-lkml-1.web.codeaurora.org
Received: from vger.kernel.org (vger.kernel.org [23.128.96.18])
	by smtp.lore.kernel.org (Postfix) with ESMTP id 70736C433F5
	for <linux-btrfs@archiver.kernel.org>; Thu, 26 May 2022 21:39:29 +0000 (UTC)
Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand
        id S235959AbiEZVj2 (ORCPT <rfc822;linux-btrfs@archiver.kernel.org>);
        Thu, 26 May 2022 17:39:28 -0400
Received: from lindbergh.monkeyblade.net ([23.128.96.19]:57306 "EHLO
        lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org
        with ESMTP id S233606AbiEZVj1 (ORCPT
        <rfc822;linux-btrfs@vger.kernel.org>);
        Thu, 26 May 2022 17:39:27 -0400
Received: from mail1.merlins.org (magic.merlins.org [209.81.13.136])
        by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 333DF66AF8
        for <linux-btrfs@vger.kernel.org>; Thu, 26 May 2022 14:39:25 -0700 (PDT)
Received: from [104.132.0.105] (port=38348 helo=sauron.svh.merlins.org)
        by mail1.merlins.org with esmtpsa 
        (Cipher TLS1.3:ECDHE_SECP256R1__RSA_PSS_RSAE_SHA256__AES_256_GCM:256) (Exim 4.94.2 #2)
        id 1nuKU9-00081L-AD by authid <merlins.org> with srv_auth_plain; Thu, 26 May 2022 14:39:24 -0700
Received: from merlin by sauron.svh.merlins.org with local (Exim 4.92)
        (envelope-from <marc@merlins.org>)
        id 1nuLCW-00D6JQ-CH; Thu, 26 May 2022 14:39:24 -0700
Date:   Thu, 26 May 2022 14:39:24 -0700
From:   Marc MERLIN <marc@merlins.org>
To:     Josef Bacik <josef@toxicpanda.com>
Cc:     linux-btrfs <linux-btrfs@vger.kernel.org>
Subject: Re: Rebuilding 24TB Raid5 array (was btrfs corruption: parent
 transid verify failed + open_ctree failed)
Message-ID: <20220526213924.GB2414966@merlins.org>
References: <20220524191345.GA1751747@merlins.org>
 <CAEzrpqdTpkvguQq+MGxYBb12-RF97dgW7cccz7o2HoSkrWt8gQ@mail.gmail.com>
 <20220526171046.GB1751747@merlins.org>
 <CAEzrpqd_B13rDPCZLm9h0ji8f1oS7mCw=2d1-iiW=M26FfEcCw@mail.gmail.com>
 <20220526173119.GC1751747@merlins.org>
 <CAEzrpqemPU_=VTxGEQS2WtGiaGbHy+ssnj5MKyh=8JC36uyZ6Q@mail.gmail.com>
 <20220526181246.GA28329@merlins.org>
 <CAEzrpqfEmm0qGZkkdTgFYNjVvSn6SZwbdDUYLO2E3jV4DYELFQ@mail.gmail.com>
 <20220526191512.GE28329@merlins.org>
 <CAEzrpqetTskf-UtyfXHBajpJBci4vxdSaBXwDTm5cRs2QtNRkw@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <CAEzrpqetTskf-UtyfXHBajpJBci4vxdSaBXwDTm5cRs2QtNRkw@mail.gmail.com>
X-Sysadmin: BOFH
X-URL:  http://marc.merlins.org/
X-Broken-Reverse-DNS: no host name for IP address 104.132.0.105
X-SA-Exim-Connect-IP: 104.132.0.105
X-SA-Exim-Mail-From: marc@merlins.org
Precedence: bulk
List-ID: <linux-btrfs.vger.kernel.org>
X-Mailing-List: linux-btrfs@vger.kernel.org

On Thu, May 26, 2022 at 03:55:29PM -0400, Josef Bacik wrote:
> On Thu, May 26, 2022 at 3:15 PM Marc MERLIN <marc@merlins.org> wrote:
> >
> > On Thu, May 26, 2022 at 02:54:47PM -0400, Josef Bacik wrote:
> > > > Do I do
> > > > ./btrfs rescue tree-recover --init-extent-tree /dev/mapper/dshelf1
> > > > or
> > > > ./btrfs rescue tree-recover /dev/mapper/dshelf1
> > >
> > > Tree-recover first, lord I'm tired of our tools randomly not updating
> > > root pointers.  Thanks,
> >
> > gargamel:/var/local/src/btrfs-progs-josefbacik# ./btrfs rescue tree-recover /dev/mapper/dshelf1
> > ERROR: cannot read chunk root
> > WTF???
> > ERROR: open ctree failed
> > Tree recover failed
> 
> Sigh, I've pushed new code, build and run
> 
> ./btrfs-find-root -o 3 <device>
> 
> and let me know what it says.  Thanks,

I thought we were getting so close, but it seems we'e made a few steps
back :-/

gargamel:/var/local/src/btrfs-progs-josefbacik# ./btrfs-find-root -o 3 /dev/mapper/dshelf1
checksum verify failed on 21135360 wanted 0x00000000 found 0x3533f3b5
checksum verify failed on 21135360 wanted 0x00000000 found 0x3533f3b5
checksum verify failed on 21135360 wanted 0x00000000 found 0x3533f3b5
Csum didn't match
ERROR: cannot read chunk root
WTF???
ERROR: open ctree failed

At some point, if the FS is starting to look like it was trashed to
start with, or kind of trashed now after some of the recovery attempts,
let me know and I'll wipe and restore.
That said, if there is still data useful to improving your tools, I'm
game for a bit more, although if we hit the 2 months mark since it went
down, I'll have to eventuallly recover :)

Thanks,
Marc
-- 
"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
 
Home page: http://marc.merlins.org/                       | PGP 7F55D5F27AAF9D08