From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3F665C433EF for ; Wed, 6 Apr 2022 06:48:20 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230025AbiDFGkQ (ORCPT ); Wed, 6 Apr 2022 02:40:16 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:60394 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1841203AbiDFFgt (ORCPT ); Wed, 6 Apr 2022 01:36:49 -0400 Received: from mail-il1-x12f.google.com (mail-il1-x12f.google.com [IPv6:2607:f8b0:4864:20::12f]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5E0B323575F for ; Tue, 5 Apr 2022 18:08:44 -0700 (PDT) Received: by mail-il1-x12f.google.com with SMTP id t4so832441ilo.12 for ; Tue, 05 Apr 2022 18:08:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=toxicpanda-com.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ssilonMdOYgyl+hopbx1XcedPip0yNZ0jqgccnMl9cU=; b=jOKxnklPMw0BJvmy9U4/TotyUeY16estoPz04t6aekiCjnLaB1LzCpXHqsb7te5FoY AV+L6LLNcZxBSUXZzCx9lefjsUfAm8v8EL7nc+VNujTuKh3dw010Nwi/FAI3QqrmG82W fkJvswzyn/hMQS3f8F4Uke9TUIqT1IKlQHgoSLlLR2MWlNSd2JuRrhciY+PBB18YsjDg EGeEW3ZVBG91d4LhGMagMp6iAvkX5b5tiMEd94iOBKDyKACszSJbTyyG7xWLHEu7HnL5 ATXUkFM6A09sRwPCn4V035T90y7491rpi0oPLRn2CB09F704YiF9JVfS5pOJhb8+m3VJ iwNA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ssilonMdOYgyl+hopbx1XcedPip0yNZ0jqgccnMl9cU=; b=SaTJ3gb070XqXY89tuZRCZR8r8Pdr1zIewQI0zvl3snMAGp7RAIX79SKn0sJ0e6mna mP2SCRzRLBu2E969Foo7AA2WGoku2BZT94XGd1rCYBA1dg9jf0K5zl6myYZzSikHAQw1 N+N3oRUoFMwZUA6+iU2vAXQ2lER4bk2P48vqhgVASITQnd4Vm9HR0vjyRKjubhxlskFm 43B5MCz5JaYeV6kSmOuoAWJ1LMLWtxCnvmlWrXdnI6z1Cbp0t5fBkVbADdxZtJbNNK6j y75DQNeWIylLoGjqRE8DJ2WInJsj8KD661NJOZIhZXjVw1LXG8/7USFkubat4taih9x4 bZfw== X-Gm-Message-State: AOAM533qioUr22+10/wUu5CRbPz8OLA1KM5VNmGRfj+ULVlssCsh6BDU b/lV0iYavG5GoB2WU811hnxodh3o9kceSNlTl38XcCTFWCM= X-Google-Smtp-Source: ABdhPJyHjMoU8gqznHHCJOqfRZUsInhj1Zk2vPBy+SJReSfM66c2yR9vZ6ZlfvAyihdPdsN6EdJdAeh2hEFxb2xr8K0= X-Received: by 2002:a92:c56c:0:b0:2c9:db11:98d2 with SMTP id b12-20020a92c56c000000b002c9db1198d2mr3209584ilj.152.1649207323511; Tue, 05 Apr 2022 18:08:43 -0700 (PDT) MIME-Version: 1.0 References: <20220405203737.GE28707@merlins.org> <20220405211412.GF28707@merlins.org> <20220405212655.GH28707@merlins.org> <20220405214309.GI28707@merlins.org> <20220405225808.GJ28707@merlins.org> <20220406003521.GM28707@merlins.org> In-Reply-To: From: Josef Bacik Date: Tue, 5 Apr 2022 21:08:32 -0400 Message-ID: Subject: Re: Rebuilding 24TB Raid5 array (was btrfs corruption: parent transid verify failed + open_ctree failed) To: Marc MERLIN Cc: "linux-btrfs@vger.kernel.org" Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org On Tue, Apr 5, 2022 at 8:39 PM Josef Bacik wrote: > > On Tue, Apr 5, 2022 at 8:35 PM Marc MERLIN wrote: > > > > On Tue, Apr 05, 2022 at 08:23:42PM -0400, Josef Bacik wrote: > > > Alright it's time for the crazy. Go ahead and pull and start running. > > > This is going to take a while to run, we're basically going to walk > > > and check all the node pointers in the tree root, if it doesn't look > > > right we're going to search the metadata for the best copy to use, and > > > then update the block to point at the new block. It has to do the > > > full search every time, because we don't have time for me to properly > > > implement a cache, so don't be worried if it takes a while. > > > > > > It may print out stuff, if it looks like it's looping stop it and let > > > me know, but I don't think I fucked it up. You're going to see a lot > > > "fixed root ", "fixed slot ", if you see it repeating > > > the same slot or root then we know we have a problem. > > > > I assume this is not good? > > ERROR: failed to write bytenr 13577814573056 length 16384 devid 1 dev_bytenr 13439981355008: Operation not permitted > > > > I am running as root of course. > > > > Yeah I'm just a dumbass, try again please. Thanks, > Also keep in mind this isn't the final fix, this is the pre-repair so hopefully fsck can put the rest of it back together. Thanks, Josef