All of lore.kernel.org
 help / color / mirror / Atom feed
* raid6 fails to mount after disk failure with unclean shutdown
@ 2019-06-15  6:21 Paulsen, Alexander
  2019-06-17  4:54 ` Qu Wenruo
  0 siblings, 1 reply; 2+ messages in thread
From: Paulsen, Alexander @ 2019-06-15  6:21 UTC (permalink / raw)
  To: linux-btrfs

My raid6 fails to mount after a disk failure with unclean shutdown

From other posts I understand that if there is a still working chunk
root I could still get some data back
I have the really important data in backups, but most of my holiday
photos/videos are only on the array, so I'm happy about any partial
data that you could help me restore

I've listed below the output of what I've tried so far below

Hope you can help

Regards,
Alexander

====================
uname -a
Linux fileserver 4.19.44-gentoo #1 SMP Thu May 30 18:05:14 CEST 2019
x86_64 Intel(R) Atom(TM) CPU C2550 @ 2.40GHz GenuineIntel GNU/Linux

====================
btrfs --version
btrfs-progs v5.1

====================
btrfs fi show
warning, device 5 is missing
warning, device 5 is missing
checksum verify failed on 24535404544000 found B267AF82 wanted 3AA9B87A
checksum verify failed on 24535404544000 found 76ED7CB0 wanted 8F0CFD32
checksum verify failed on 24535404544000 found 76ED7CB0 wanted 8F0CFD32
bad tree block 24535404544000, bytenr mismatch, want=24535404544000,
have=2218124645305391268
Couldn't read chunk tree
Label: 'storageraid'  uuid: 3d64f87e-ad07-4699-b1b8-3f7641e06a40
        Total devices 7 FS bytes used 6.33TiB
        devid    1 size 3.64TiB used 1.29TiB path /dev/sdd
        devid    2 size 3.64TiB used 1.29TiB path /dev/sde
        devid    3 size 3.64TiB used 1.29TiB path /dev/sdc
        devid    4 size 2.73TiB used 1.29TiB path /dev/sdh
        devid    6 size 2.73TiB used 1.29TiB path /dev/sdg
        devid    7 size 2.73TiB used 1.29TiB path /dev/sdf
        *** Some devices missing

====================
btrfs-find-root /dev/sdc
warning, device 5 is missing
warning, device 5 is missing
Couldn't read chunk tree
ERROR: open ctree failed

====================
btrfs check /dev/sdc
Opening filesystem to check...
warning, device 5 is missing
warning, device 5 is missing
checksum verify failed on 24535404544000 found B267AF82 wanted 3AA9B87A
checksum verify failed on 24535404544000 found 76ED7CB0 wanted 8F0CFD32
checksum verify failed on 24535404544000 found 76ED7CB0 wanted 8F0CFD32
bad tree block 24535404544000, bytenr mismatch, want=24535404544000,
have=2218124645305391268
Couldn't read chunk tree
ERROR: cannot open file system

====================
mount -o ro,degraded,recovery /dev/sdc /media/storageraid/
mount: /media/storageraid: wrong fs type, bad option, bad superblock
on /dev/sdc, missing codepage or helper program, or other error.

[14387.814655] BTRFS info (device sdd): allowing degraded mounts
[14387.814660] BTRFS warning (device sdd): 'recovery' is deprecated,
use 'usebackuproot' instead
[14387.814662] BTRFS info (device sdd): trying to use backup root at mount time
[14387.814663] BTRFS info (device sdd): disk space caching is enabled
[14387.814665] BTRFS info (device sdd): has skinny extents
[14387.815969] BTRFS warning (device sdd): devid 5 uuid
19311aa5-8c43-4451-9a5a-dca5232433ee is missing
[14388.061497] BTRFS warning (device sdd): devid 5 uuid
19311aa5-8c43-4451-9a5a-dca5232433ee is missing
[14388.232021] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.232360] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.252358] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.272443] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.309782] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.329857] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.349639] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.349982] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.354073] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.374161] BTRFS error (device sdd): bad tree block start, want
23698850185216 have 0
[14388.771856] BTRFS error (device sdd): open_ctree failed


====================
btrfs rescue chunk-recover -v /dev/sdc
All Devices:
        Device: id = 6, name = /dev/sdg
        Device: id = 4, name = /dev/sdh
        Device: id = 2, name = /dev/sde
        Device: id = 7, name = /dev/sdf
        Device: id = 1, name = /dev/sdd
        Device: id = 3, name = /dev/sdc

Scanning: 109959925760 in dev0, 81973956608 in dev1, 122966462464 in
dev2, 102231920640 in dev3, 123404374016 in dev4, 119399600128 in
dev5Segmentation fault

[13286.275585] btrfs[7207]: segfault at 7f124fb40799 ip
000056380b12dd98 sp 00007f11db7fdc10 error 4 in
btrfs[56380b0c9000+d3000]
[13286.275595] Code: 48 8d 14 92 49 89 f6 41 55 48 8d 14 92 49 89 fd
41 54 55 53 48 8d 64 24 f8 8b 9c 17 f6 00 00 00 bf 01 00 00 00 48 8d
6c 18 65 <0f> b7 75 2c 49 89 f7 48 c1 e6 05 48 81 c6 a8 00 00 00 e8 11
e9 fa

====================
btrfs rescue super-recover -v /dev/sdc
All Devices:
        Device: id = 6, name = /dev/sdg
        Device: id = 4, name = /dev/sdh
        Device: id = 2, name = /dev/sde
        Device: id = 7, name = /dev/sdf
        Device: id = 1, name = /dev/sdd
        Device: id = 3, name = /dev/sdc

Before Recovering:
        [All good supers]:
                device name = /dev/sdg
                superblock bytenr = 65536

                device name = /dev/sdg
                superblock bytenr = 67108864

                device name = /dev/sdg
                superblock bytenr = 274877906944

                device name = /dev/sdh
                superblock bytenr = 65536

                device name = /dev/sdh
                superblock bytenr = 67108864

                device name = /dev/sdh
                superblock bytenr = 274877906944

                device name = /dev/sde
                superblock bytenr = 65536

                device name = /dev/sde
                superblock bytenr = 67108864

                device name = /dev/sde
                superblock bytenr = 274877906944

                device name = /dev/sdf
                superblock bytenr = 65536

                device name = /dev/sdf
                superblock bytenr = 67108864

                device name = /dev/sdf
                superblock bytenr = 274877906944

                device name = /dev/sdd
                superblock bytenr = 65536

                device name = /dev/sdd
                superblock bytenr = 67108864

                device name = /dev/sdd
                superblock bytenr = 274877906944

                device name = /dev/sdc
                superblock bytenr = 65536

                device name = /dev/sdc
                superblock bytenr = 67108864

                device name = /dev/sdc
                superblock bytenr = 274877906944

        [All bad supers]:

All supers are valid, no need to recover

====================
btrfs inspect-internal dump-super -f -a /dev/sdc
superblock: bytenr=65536, device=/dev/sdc
---------------------------------------------------------
csum_type               0 (crc32c)
csum_size               4
csum                    0x2e19b950 [match]
bytenr                  65536
flags                   0x1
                        ( WRITTEN )
magic                   _BHRfS_M [match]
fsid                    3d64f87e-ad07-4699-b1b8-3f7641e06a40
metadata_uuid           3d64f87e-ad07-4699-b1b8-3f7641e06a40
label                   storageraid
generation              106736
root                    24113334845440
sys_array_size          578
chunk_root_generation   102377
root_level              1
chunk_root              24675241885696
chunk_root_level        1
log_root                0
log_root_transid        0
log_root_level          0
total_bytes             24004733018112
bytes_used              6955368067072
sectorsize              4096
nodesize                16384
leafsize (deprecated)   16384
stripesize              4096
root_dir                6
num_devices             7
compat_flags            0x0
compat_ro_flags         0x0
incompat_flags          0x1e9
                        ( MIXED_BACKREF |
                          COMPRESS_LZO |
                          BIG_METADATA |
                          EXTENDED_IREF |
                          RAID56 |
                          SKINNY_METADATA )
cache_generation        106736
uuid_tree_generation    106736
dev_item.uuid           47b75b3c-d5fa-467b-baa3-8d655334dd54
dev_item.fsid           3d64f87e-ad07-4699-b1b8-3f7641e06a40 [match]
dev_item.type           0
dev_item.total_bytes    4000787030016
dev_item.bytes_used     1416768782336
dev_item.io_align       4096
dev_item.io_width       4096
dev_item.sector_size    4096
dev_item.devid          3
dev_item.dev_group      0
dev_item.seek_speed     0
dev_item.bandwidth      0
dev_item.generation     0
sys_chunk_array[2048]:
        item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 24535403790336)
                length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
                io_align 65536 io_width 65536 sector_size 4096
                num_stripes 7 sub_stripes 1
                        stripe 0 devid 3 offset 152908595200
                        dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
                        stripe 1 devid 2 offset 3230662656
                        dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
                        stripe 2 devid 1 offset 3250585600
                        dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
                        stripe 3 devid 5 offset 2369598259200
                        dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
                        stripe 4 devid 4 offset 2369598259200
                        dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
                        stripe 5 devid 6 offset 2369598259200
                        dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
                        stripe 6 devid 7 offset 2369598259200
                        dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
        item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM 24675241885696)
                length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
                io_align 65536 io_width 65536 sector_size 4096
                num_stripes 7 sub_stripes 1
                        stripe 0 devid 2 offset 3247439872
                        dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
                        stripe 1 devid 3 offset 152690491392
                        dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
                        stripe 2 devid 1 offset 3267362816
                        dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
                        stripe 3 devid 5 offset 1395026558976
                        dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
                        stripe 4 devid 7 offset 1395026558976
                        dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
                        stripe 5 devid 4 offset 1395026558976
                        dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
                        stripe 6 devid 6 offset 1395026558976
                        dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
backup_roots[4]:
        backup 0:
                backup_tree_root:       24113327718400  gen: 106733     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113327734784  gen: 106733     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113327833088  gen: 106733     level: 1
                backup_csum_root:       24113327931392  gen: 106733     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 1:
                backup_tree_root:       24113330208768  gen: 106734     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113330438144  gen: 106734     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113330814976  gen: 106734     level: 1
                backup_csum_root:       24113331830784  gen: 106734     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 2:
                backup_tree_root:       24113332600832  gen: 106735     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113332617216  gen: 106735     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113333010432  gen: 106735     level: 1
                backup_csum_root:       24113333403648  gen: 106735     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 3:
                backup_tree_root:       24113334845440  gen: 106736     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113334927360  gen: 106736     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113335107584  gen: 106736     level: 1
                backup_csum_root:       24113339006976  gen: 106736     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7


superblock: bytenr=67108864, device=/dev/sdc
---------------------------------------------------------
csum_type               0 (crc32c)
csum_size               4
csum                    0x8e78919e [match]
bytenr                  67108864
flags                   0x1
                        ( WRITTEN )
magic                   _BHRfS_M [match]
fsid                    3d64f87e-ad07-4699-b1b8-3f7641e06a40
metadata_uuid           3d64f87e-ad07-4699-b1b8-3f7641e06a40
label                   storageraid
generation              106736
root                    24113334845440
sys_array_size          578
chunk_root_generation   102377
root_level              1
chunk_root              24675241885696
chunk_root_level        1
log_root                0
log_root_transid        0
log_root_level          0
total_bytes             24004733018112
bytes_used              6955368067072
sectorsize              4096
nodesize                16384
leafsize (deprecated)   16384
stripesize              4096
root_dir                6
num_devices             7
compat_flags            0x0
compat_ro_flags         0x0
incompat_flags          0x1e9
                        ( MIXED_BACKREF |
                          COMPRESS_LZO |
                          BIG_METADATA |
                          EXTENDED_IREF |
                          RAID56 |
                          SKINNY_METADATA )
cache_generation        106736
uuid_tree_generation    106736
dev_item.uuid           47b75b3c-d5fa-467b-baa3-8d655334dd54
dev_item.fsid           3d64f87e-ad07-4699-b1b8-3f7641e06a40 [match]
dev_item.type           0
dev_item.total_bytes    4000787030016
dev_item.bytes_used     1416768782336
dev_item.io_align       4096
dev_item.io_width       4096
dev_item.sector_size    4096
dev_item.devid          3
dev_item.dev_group      0
dev_item.seek_speed     0
dev_item.bandwidth      0
dev_item.generation     0
sys_chunk_array[2048]:
        item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 24535403790336)
                length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
                io_align 65536 io_width 65536 sector_size 4096
                num_stripes 7 sub_stripes 1
                        stripe 0 devid 3 offset 152908595200
                        dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
                        stripe 1 devid 2 offset 3230662656
                        dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
                        stripe 2 devid 1 offset 3250585600
                        dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
                        stripe 3 devid 5 offset 2369598259200
                        dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
                        stripe 4 devid 4 offset 2369598259200
                        dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
                        stripe 5 devid 6 offset 2369598259200
                        dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
                        stripe 6 devid 7 offset 2369598259200
                        dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
        item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM 24675241885696)
                length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
                io_align 65536 io_width 65536 sector_size 4096
                num_stripes 7 sub_stripes 1
                        stripe 0 devid 2 offset 3247439872
                        dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
                        stripe 1 devid 3 offset 152690491392
                        dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
                        stripe 2 devid 1 offset 3267362816
                        dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
                        stripe 3 devid 5 offset 1395026558976
                        dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
                        stripe 4 devid 7 offset 1395026558976
                        dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
                        stripe 5 devid 4 offset 1395026558976
                        dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
                        stripe 6 devid 6 offset 1395026558976
                        dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
backup_roots[4]:
        backup 0:
                backup_tree_root:       24113327718400  gen: 106733     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113327734784  gen: 106733     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113327833088  gen: 106733     level: 1
                backup_csum_root:       24113327931392  gen: 106733     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 1:
                backup_tree_root:       24113330208768  gen: 106734     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113330438144  gen: 106734     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113330814976  gen: 106734     level: 1
                backup_csum_root:       24113331830784  gen: 106734     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 2:
                backup_tree_root:       24113332600832  gen: 106735     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113332617216  gen: 106735     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113333010432  gen: 106735     level: 1
                backup_csum_root:       24113333403648  gen: 106735     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 3:
                backup_tree_root:       24113334845440  gen: 106736     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113334927360  gen: 106736     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113335107584  gen: 106736     level: 1
                backup_csum_root:       24113339006976  gen: 106736     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7


superblock: bytenr=274877906944, device=/dev/sdc
---------------------------------------------------------
csum_type               0 (crc32c)
csum_size               4
csum                    0x73ffc7af [match]
bytenr                  274877906944
flags                   0x1
                        ( WRITTEN )
magic                   _BHRfS_M [match]
fsid                    3d64f87e-ad07-4699-b1b8-3f7641e06a40
metadata_uuid           3d64f87e-ad07-4699-b1b8-3f7641e06a40
label                   storageraid
generation              106736
root                    24113334845440
sys_array_size          578
chunk_root_generation   102377
root_level              1
chunk_root              24675241885696
chunk_root_level        1
log_root                0
log_root_transid        0
log_root_level          0
total_bytes             24004733018112
bytes_used              6955368067072
sectorsize              4096
nodesize                16384
leafsize (deprecated)   16384
stripesize              4096
root_dir                6
num_devices             7
compat_flags            0x0
compat_ro_flags         0x0
incompat_flags          0x1e9
                        ( MIXED_BACKREF |
                          COMPRESS_LZO |
                          BIG_METADATA |
                          EXTENDED_IREF |
                          RAID56 |
                          SKINNY_METADATA )
cache_generation        106736
uuid_tree_generation    106736
dev_item.uuid           47b75b3c-d5fa-467b-baa3-8d655334dd54
dev_item.fsid           3d64f87e-ad07-4699-b1b8-3f7641e06a40 [match]
dev_item.type           0
dev_item.total_bytes    4000787030016
dev_item.bytes_used     1416768782336
dev_item.io_align       4096
dev_item.io_width       4096
dev_item.sector_size    4096
dev_item.devid          3
dev_item.dev_group      0
dev_item.seek_speed     0
dev_item.bandwidth      0
dev_item.generation     0
sys_chunk_array[2048]:
        item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 24535403790336)
                length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
                io_align 65536 io_width 65536 sector_size 4096
                num_stripes 7 sub_stripes 1
                        stripe 0 devid 3 offset 152908595200
                        dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
                        stripe 1 devid 2 offset 3230662656
                        dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
                        stripe 2 devid 1 offset 3250585600
                        dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
                        stripe 3 devid 5 offset 2369598259200
                        dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
                        stripe 4 devid 4 offset 2369598259200
                        dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
                        stripe 5 devid 6 offset 2369598259200
                        dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
                        stripe 6 devid 7 offset 2369598259200
                        dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
        item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM 24675241885696)
                length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
                io_align 65536 io_width 65536 sector_size 4096
                num_stripes 7 sub_stripes 1
                        stripe 0 devid 2 offset 3247439872
                        dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
                        stripe 1 devid 3 offset 152690491392
                        dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
                        stripe 2 devid 1 offset 3267362816
                        dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
                        stripe 3 devid 5 offset 1395026558976
                        dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
                        stripe 4 devid 7 offset 1395026558976
                        dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
                        stripe 5 devid 4 offset 1395026558976
                        dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
                        stripe 6 devid 6 offset 1395026558976
                        dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
backup_roots[4]:
        backup 0:
                backup_tree_root:       24113327718400  gen: 106733     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113327734784  gen: 106733     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113327833088  gen: 106733     level: 1
                backup_csum_root:       24113327931392  gen: 106733     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 1:
                backup_tree_root:       24113330208768  gen: 106734     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113330438144  gen: 106734     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113330814976  gen: 106734     level: 1
                backup_csum_root:       24113331830784  gen: 106734     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 2:
                backup_tree_root:       24113332600832  gen: 106735     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113332617216  gen: 106735     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113333010432  gen: 106735     level: 1
                backup_csum_root:       24113333403648  gen: 106735     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

        backup 3:
                backup_tree_root:       24113334845440  gen: 106736     level: 1
                backup_chunk_root:      24675241885696  gen: 102377     level: 1
                backup_extent_root:     24113334927360  gen: 106736     level: 2
                backup_fs_root:         14085070520320  gen: 102373     level: 3
                backup_dev_root:        24113335107584  gen: 106736     level: 1
                backup_csum_root:       24113339006976  gen: 106736     level: 3
                backup_total_bytes:     24004733018112
                backup_bytes_used:      6955368067072
                backup_num_devices:     7

^ permalink raw reply	[flat|nested] 2+ messages in thread

* Re: raid6 fails to mount after disk failure with unclean shutdown
  2019-06-15  6:21 raid6 fails to mount after disk failure with unclean shutdown Paulsen, Alexander
@ 2019-06-17  4:54 ` Qu Wenruo
  0 siblings, 0 replies; 2+ messages in thread
From: Qu Wenruo @ 2019-06-17  4:54 UTC (permalink / raw)
  To: Paulsen, Alexander, linux-btrfs


[-- Attachment #1.1: Type: text/plain, Size: 30231 bytes --]



On 2019/6/15 下午2:21, Paulsen, Alexander wrote:
> My raid6 fails to mount after a disk failure with unclean shutdown
> 
> From other posts I understand that if there is a still working chunk
> root I could still get some data back
> I have the really important data in backups, but most of my holiday
> photos/videos are only on the array, so I'm happy about any partial
> data that you could help me restore
> 
> I've listed below the output of what I've tried so far below
> 
> Hope you can help
> 
> Regards,
> Alexander
> 
> ====================
> uname -a
> Linux fileserver 4.19.44-gentoo #1 SMP Thu May 30 18:05:14 CEST 2019
> x86_64 Intel(R) Atom(TM) CPU C2550 @ 2.40GHz GenuineIntel GNU/Linux
> 
> ====================
> btrfs --version
> btrfs-progs v5.1
> 
> ====================
> btrfs fi show
> warning, device 5 is missing
> warning, device 5 is missing

Already missing one device, this means now raid6 can only tolerant one
device corruption.

> checksum verify failed on 24535404544000 found B267AF82 wanted 3AA9B87A
> checksum verify failed on 24535404544000 found 76ED7CB0 wanted 8F0CFD32
> checksum verify failed on 24535404544000 found 76ED7CB0 wanted 8F0CFD32
> bad tree block 24535404544000, bytenr mismatch, want=24535404544000,
> have=2218124645305391268
> Couldn't read chunk tree

This means the corruption happens at chunk tree, which is needed to
bootstrap and a very critical tree.

Could you get that missing device back and try again before trying any
other recovery?

> Label: 'storageraid'  uuid: 3d64f87e-ad07-4699-b1b8-3f7641e06a40
>         Total devices 7 FS bytes used 6.33TiB
>         devid    1 size 3.64TiB used 1.29TiB path /dev/sdd
>         devid    2 size 3.64TiB used 1.29TiB path /dev/sde
>         devid    3 size 3.64TiB used 1.29TiB path /dev/sdc
>         devid    4 size 2.73TiB used 1.29TiB path /dev/sdh
>         devid    6 size 2.73TiB used 1.29TiB path /dev/sdg
>         devid    7 size 2.73TiB used 1.29TiB path /dev/sdf
>         *** Some devices missing
> 
> ====================
> btrfs-find-root /dev/sdc

If you want to use find-root, you at least need to use "-o 3" option.

That would be a pretty good start point.

Since chunk recovery doesn't work at all, your remaining recovery method
would be something like:
1. btrfs-find-root -o 3 /dev/sdc
   Get the bytenr of possible chunk roots.
2. btrfs check --chunk-root <bytenr> /dev/sdc
   To see if you can get pass the "Couldn't read chunk tree" error.
3. If you get a good chunk bytenr, either pass it to btrfs-restore or
   modify superblocks to allow kernel to mount it.

Thanks,
Qu

> warning, device 5 is missing
> warning, device 5 is missing
> Couldn't read chunk tree
> ERROR: open ctree failed
> 
> ====================
> btrfs check /dev/sdc
> Opening filesystem to check...
> warning, device 5 is missing
> warning, device 5 is missing
> checksum verify failed on 24535404544000 found B267AF82 wanted 3AA9B87A
> checksum verify failed on 24535404544000 found 76ED7CB0 wanted 8F0CFD32
> checksum verify failed on 24535404544000 found 76ED7CB0 wanted 8F0CFD32
> bad tree block 24535404544000, bytenr mismatch, want=24535404544000,
> have=2218124645305391268
> Couldn't read chunk tree
> ERROR: cannot open file system
> 
> ====================
> mount -o ro,degraded,recovery /dev/sdc /media/storageraid/
> mount: /media/storageraid: wrong fs type, bad option, bad superblock
> on /dev/sdc, missing codepage or helper program, or other error.
> 
> [14387.814655] BTRFS info (device sdd): allowing degraded mounts
> [14387.814660] BTRFS warning (device sdd): 'recovery' is deprecated,
> use 'usebackuproot' instead
> [14387.814662] BTRFS info (device sdd): trying to use backup root at mount time
> [14387.814663] BTRFS info (device sdd): disk space caching is enabled
> [14387.814665] BTRFS info (device sdd): has skinny extents
> [14387.815969] BTRFS warning (device sdd): devid 5 uuid
> 19311aa5-8c43-4451-9a5a-dca5232433ee is missing
> [14388.061497] BTRFS warning (device sdd): devid 5 uuid
> 19311aa5-8c43-4451-9a5a-dca5232433ee is missing
> [14388.232021] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.232360] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.252358] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.272443] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.309782] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.329857] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.349639] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.349982] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.354073] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.374161] BTRFS error (device sdd): bad tree block start, want
> 23698850185216 have 0
> [14388.771856] BTRFS error (device sdd): open_ctree failed
> 
> 
> ====================
> btrfs rescue chunk-recover -v /dev/sdc
> All Devices:
>         Device: id = 6, name = /dev/sdg
>         Device: id = 4, name = /dev/sdh
>         Device: id = 2, name = /dev/sde
>         Device: id = 7, name = /dev/sdf
>         Device: id = 1, name = /dev/sdd
>         Device: id = 3, name = /dev/sdc
> 
> Scanning: 109959925760 in dev0, 81973956608 in dev1, 122966462464 in
> dev2, 102231920640 in dev3, 123404374016 in dev4, 119399600128 in
> dev5Segmentation fault
> 
> [13286.275585] btrfs[7207]: segfault at 7f124fb40799 ip
> 000056380b12dd98 sp 00007f11db7fdc10 error 4 in
> btrfs[56380b0c9000+d3000]
> [13286.275595] Code: 48 8d 14 92 49 89 f6 41 55 48 8d 14 92 49 89 fd
> 41 54 55 53 48 8d 64 24 f8 8b 9c 17 f6 00 00 00 bf 01 00 00 00 48 8d
> 6c 18 65 <0f> b7 75 2c 49 89 f7 48 c1 e6 05 48 81 c6 a8 00 00 00 e8 11
> e9 fa
> 
> ====================
> btrfs rescue super-recover -v /dev/sdc
> All Devices:
>         Device: id = 6, name = /dev/sdg
>         Device: id = 4, name = /dev/sdh
>         Device: id = 2, name = /dev/sde
>         Device: id = 7, name = /dev/sdf
>         Device: id = 1, name = /dev/sdd
>         Device: id = 3, name = /dev/sdc
> 
> Before Recovering:
>         [All good supers]:
>                 device name = /dev/sdg
>                 superblock bytenr = 65536
> 
>                 device name = /dev/sdg
>                 superblock bytenr = 67108864
> 
>                 device name = /dev/sdg
>                 superblock bytenr = 274877906944
> 
>                 device name = /dev/sdh
>                 superblock bytenr = 65536
> 
>                 device name = /dev/sdh
>                 superblock bytenr = 67108864
> 
>                 device name = /dev/sdh
>                 superblock bytenr = 274877906944
> 
>                 device name = /dev/sde
>                 superblock bytenr = 65536
> 
>                 device name = /dev/sde
>                 superblock bytenr = 67108864
> 
>                 device name = /dev/sde
>                 superblock bytenr = 274877906944
> 
>                 device name = /dev/sdf
>                 superblock bytenr = 65536
> 
>                 device name = /dev/sdf
>                 superblock bytenr = 67108864
> 
>                 device name = /dev/sdf
>                 superblock bytenr = 274877906944
> 
>                 device name = /dev/sdd
>                 superblock bytenr = 65536
> 
>                 device name = /dev/sdd
>                 superblock bytenr = 67108864
> 
>                 device name = /dev/sdd
>                 superblock bytenr = 274877906944
> 
>                 device name = /dev/sdc
>                 superblock bytenr = 65536
> 
>                 device name = /dev/sdc
>                 superblock bytenr = 67108864
> 
>                 device name = /dev/sdc
>                 superblock bytenr = 274877906944
> 
>         [All bad supers]:
> 
> All supers are valid, no need to recover
> 
> ====================
> btrfs inspect-internal dump-super -f -a /dev/sdc
> superblock: bytenr=65536, device=/dev/sdc
> ---------------------------------------------------------
> csum_type               0 (crc32c)
> csum_size               4
> csum                    0x2e19b950 [match]
> bytenr                  65536
> flags                   0x1
>                         ( WRITTEN )
> magic                   _BHRfS_M [match]
> fsid                    3d64f87e-ad07-4699-b1b8-3f7641e06a40
> metadata_uuid           3d64f87e-ad07-4699-b1b8-3f7641e06a40
> label                   storageraid
> generation              106736
> root                    24113334845440
> sys_array_size          578
> chunk_root_generation   102377
> root_level              1
> chunk_root              24675241885696
> chunk_root_level        1
> log_root                0
> log_root_transid        0
> log_root_level          0
> total_bytes             24004733018112
> bytes_used              6955368067072
> sectorsize              4096
> nodesize                16384
> leafsize (deprecated)   16384
> stripesize              4096
> root_dir                6
> num_devices             7
> compat_flags            0x0
> compat_ro_flags         0x0
> incompat_flags          0x1e9
>                         ( MIXED_BACKREF |
>                           COMPRESS_LZO |
>                           BIG_METADATA |
>                           EXTENDED_IREF |
>                           RAID56 |
>                           SKINNY_METADATA )
> cache_generation        106736
> uuid_tree_generation    106736
> dev_item.uuid           47b75b3c-d5fa-467b-baa3-8d655334dd54
> dev_item.fsid           3d64f87e-ad07-4699-b1b8-3f7641e06a40 [match]
> dev_item.type           0
> dev_item.total_bytes    4000787030016
> dev_item.bytes_used     1416768782336
> dev_item.io_align       4096
> dev_item.io_width       4096
> dev_item.sector_size    4096
> dev_item.devid          3
> dev_item.dev_group      0
> dev_item.seek_speed     0
> dev_item.bandwidth      0
> dev_item.generation     0
> sys_chunk_array[2048]:
>         item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 24535403790336)
>                 length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
>                 io_align 65536 io_width 65536 sector_size 4096
>                 num_stripes 7 sub_stripes 1
>                         stripe 0 devid 3 offset 152908595200
>                         dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
>                         stripe 1 devid 2 offset 3230662656
>                         dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
>                         stripe 2 devid 1 offset 3250585600
>                         dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
>                         stripe 3 devid 5 offset 2369598259200
>                         dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
>                         stripe 4 devid 4 offset 2369598259200
>                         dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
>                         stripe 5 devid 6 offset 2369598259200
>                         dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
>                         stripe 6 devid 7 offset 2369598259200
>                         dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
>         item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM 24675241885696)
>                 length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
>                 io_align 65536 io_width 65536 sector_size 4096
>                 num_stripes 7 sub_stripes 1
>                         stripe 0 devid 2 offset 3247439872
>                         dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
>                         stripe 1 devid 3 offset 152690491392
>                         dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
>                         stripe 2 devid 1 offset 3267362816
>                         dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
>                         stripe 3 devid 5 offset 1395026558976
>                         dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
>                         stripe 4 devid 7 offset 1395026558976
>                         dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
>                         stripe 5 devid 4 offset 1395026558976
>                         dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
>                         stripe 6 devid 6 offset 1395026558976
>                         dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
> backup_roots[4]:
>         backup 0:
>                 backup_tree_root:       24113327718400  gen: 106733     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113327734784  gen: 106733     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113327833088  gen: 106733     level: 1
>                 backup_csum_root:       24113327931392  gen: 106733     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 1:
>                 backup_tree_root:       24113330208768  gen: 106734     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113330438144  gen: 106734     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113330814976  gen: 106734     level: 1
>                 backup_csum_root:       24113331830784  gen: 106734     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 2:
>                 backup_tree_root:       24113332600832  gen: 106735     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113332617216  gen: 106735     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113333010432  gen: 106735     level: 1
>                 backup_csum_root:       24113333403648  gen: 106735     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 3:
>                 backup_tree_root:       24113334845440  gen: 106736     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113334927360  gen: 106736     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113335107584  gen: 106736     level: 1
>                 backup_csum_root:       24113339006976  gen: 106736     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
> 
> superblock: bytenr=67108864, device=/dev/sdc
> ---------------------------------------------------------
> csum_type               0 (crc32c)
> csum_size               4
> csum                    0x8e78919e [match]
> bytenr                  67108864
> flags                   0x1
>                         ( WRITTEN )
> magic                   _BHRfS_M [match]
> fsid                    3d64f87e-ad07-4699-b1b8-3f7641e06a40
> metadata_uuid           3d64f87e-ad07-4699-b1b8-3f7641e06a40
> label                   storageraid
> generation              106736
> root                    24113334845440
> sys_array_size          578
> chunk_root_generation   102377
> root_level              1
> chunk_root              24675241885696
> chunk_root_level        1
> log_root                0
> log_root_transid        0
> log_root_level          0
> total_bytes             24004733018112
> bytes_used              6955368067072
> sectorsize              4096
> nodesize                16384
> leafsize (deprecated)   16384
> stripesize              4096
> root_dir                6
> num_devices             7
> compat_flags            0x0
> compat_ro_flags         0x0
> incompat_flags          0x1e9
>                         ( MIXED_BACKREF |
>                           COMPRESS_LZO |
>                           BIG_METADATA |
>                           EXTENDED_IREF |
>                           RAID56 |
>                           SKINNY_METADATA )
> cache_generation        106736
> uuid_tree_generation    106736
> dev_item.uuid           47b75b3c-d5fa-467b-baa3-8d655334dd54
> dev_item.fsid           3d64f87e-ad07-4699-b1b8-3f7641e06a40 [match]
> dev_item.type           0
> dev_item.total_bytes    4000787030016
> dev_item.bytes_used     1416768782336
> dev_item.io_align       4096
> dev_item.io_width       4096
> dev_item.sector_size    4096
> dev_item.devid          3
> dev_item.dev_group      0
> dev_item.seek_speed     0
> dev_item.bandwidth      0
> dev_item.generation     0
> sys_chunk_array[2048]:
>         item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 24535403790336)
>                 length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
>                 io_align 65536 io_width 65536 sector_size 4096
>                 num_stripes 7 sub_stripes 1
>                         stripe 0 devid 3 offset 152908595200
>                         dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
>                         stripe 1 devid 2 offset 3230662656
>                         dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
>                         stripe 2 devid 1 offset 3250585600
>                         dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
>                         stripe 3 devid 5 offset 2369598259200
>                         dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
>                         stripe 4 devid 4 offset 2369598259200
>                         dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
>                         stripe 5 devid 6 offset 2369598259200
>                         dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
>                         stripe 6 devid 7 offset 2369598259200
>                         dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
>         item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM 24675241885696)
>                 length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
>                 io_align 65536 io_width 65536 sector_size 4096
>                 num_stripes 7 sub_stripes 1
>                         stripe 0 devid 2 offset 3247439872
>                         dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
>                         stripe 1 devid 3 offset 152690491392
>                         dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
>                         stripe 2 devid 1 offset 3267362816
>                         dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
>                         stripe 3 devid 5 offset 1395026558976
>                         dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
>                         stripe 4 devid 7 offset 1395026558976
>                         dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
>                         stripe 5 devid 4 offset 1395026558976
>                         dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
>                         stripe 6 devid 6 offset 1395026558976
>                         dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
> backup_roots[4]:
>         backup 0:
>                 backup_tree_root:       24113327718400  gen: 106733     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113327734784  gen: 106733     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113327833088  gen: 106733     level: 1
>                 backup_csum_root:       24113327931392  gen: 106733     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 1:
>                 backup_tree_root:       24113330208768  gen: 106734     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113330438144  gen: 106734     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113330814976  gen: 106734     level: 1
>                 backup_csum_root:       24113331830784  gen: 106734     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 2:
>                 backup_tree_root:       24113332600832  gen: 106735     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113332617216  gen: 106735     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113333010432  gen: 106735     level: 1
>                 backup_csum_root:       24113333403648  gen: 106735     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 3:
>                 backup_tree_root:       24113334845440  gen: 106736     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113334927360  gen: 106736     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113335107584  gen: 106736     level: 1
>                 backup_csum_root:       24113339006976  gen: 106736     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
> 
> superblock: bytenr=274877906944, device=/dev/sdc
> ---------------------------------------------------------
> csum_type               0 (crc32c)
> csum_size               4
> csum                    0x73ffc7af [match]
> bytenr                  274877906944
> flags                   0x1
>                         ( WRITTEN )
> magic                   _BHRfS_M [match]
> fsid                    3d64f87e-ad07-4699-b1b8-3f7641e06a40
> metadata_uuid           3d64f87e-ad07-4699-b1b8-3f7641e06a40
> label                   storageraid
> generation              106736
> root                    24113334845440
> sys_array_size          578
> chunk_root_generation   102377
> root_level              1
> chunk_root              24675241885696
> chunk_root_level        1
> log_root                0
> log_root_transid        0
> log_root_level          0
> total_bytes             24004733018112
> bytes_used              6955368067072
> sectorsize              4096
> nodesize                16384
> leafsize (deprecated)   16384
> stripesize              4096
> root_dir                6
> num_devices             7
> compat_flags            0x0
> compat_ro_flags         0x0
> incompat_flags          0x1e9
>                         ( MIXED_BACKREF |
>                           COMPRESS_LZO |
>                           BIG_METADATA |
>                           EXTENDED_IREF |
>                           RAID56 |
>                           SKINNY_METADATA )
> cache_generation        106736
> uuid_tree_generation    106736
> dev_item.uuid           47b75b3c-d5fa-467b-baa3-8d655334dd54
> dev_item.fsid           3d64f87e-ad07-4699-b1b8-3f7641e06a40 [match]
> dev_item.type           0
> dev_item.total_bytes    4000787030016
> dev_item.bytes_used     1416768782336
> dev_item.io_align       4096
> dev_item.io_width       4096
> dev_item.sector_size    4096
> dev_item.devid          3
> dev_item.dev_group      0
> dev_item.seek_speed     0
> dev_item.bandwidth      0
> dev_item.generation     0
> sys_chunk_array[2048]:
>         item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 24535403790336)
>                 length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
>                 io_align 65536 io_width 65536 sector_size 4096
>                 num_stripes 7 sub_stripes 1
>                         stripe 0 devid 3 offset 152908595200
>                         dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
>                         stripe 1 devid 2 offset 3230662656
>                         dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
>                         stripe 2 devid 1 offset 3250585600
>                         dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
>                         stripe 3 devid 5 offset 2369598259200
>                         dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
>                         stripe 4 devid 4 offset 2369598259200
>                         dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
>                         stripe 5 devid 6 offset 2369598259200
>                         dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
>                         stripe 6 devid 7 offset 2369598259200
>                         dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
>         item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM 24675241885696)
>                 length 83886080 owner 2 stripe_len 65536 type SYSTEM|RAID6
>                 io_align 65536 io_width 65536 sector_size 4096
>                 num_stripes 7 sub_stripes 1
>                         stripe 0 devid 2 offset 3247439872
>                         dev_uuid 7365879e-fec3-4f58-b592-ee5d266f6311
>                         stripe 1 devid 3 offset 152690491392
>                         dev_uuid 47b75b3c-d5fa-467b-baa3-8d655334dd54
>                         stripe 2 devid 1 offset 3267362816
>                         dev_uuid e5a1ef35-39f3-49fe-b462-08ad165d6a8b
>                         stripe 3 devid 5 offset 1395026558976
>                         dev_uuid 19311aa5-8c43-4451-9a5a-dca5232433ee
>                         stripe 4 devid 7 offset 1395026558976
>                         dev_uuid e94c7ab3-c05a-49b3-866e-3c69b2094159
>                         stripe 5 devid 4 offset 1395026558976
>                         dev_uuid 2999ef12-9a84-4eb1-b78b-f13318741fec
>                         stripe 6 devid 6 offset 1395026558976
>                         dev_uuid 79cafe3d-e51f-432b-ba00-6c3354092e91
> backup_roots[4]:
>         backup 0:
>                 backup_tree_root:       24113327718400  gen: 106733     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113327734784  gen: 106733     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113327833088  gen: 106733     level: 1
>                 backup_csum_root:       24113327931392  gen: 106733     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 1:
>                 backup_tree_root:       24113330208768  gen: 106734     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113330438144  gen: 106734     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113330814976  gen: 106734     level: 1
>                 backup_csum_root:       24113331830784  gen: 106734     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 2:
>                 backup_tree_root:       24113332600832  gen: 106735     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113332617216  gen: 106735     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113333010432  gen: 106735     level: 1
>                 backup_csum_root:       24113333403648  gen: 106735     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 
>         backup 3:
>                 backup_tree_root:       24113334845440  gen: 106736     level: 1
>                 backup_chunk_root:      24675241885696  gen: 102377     level: 1
>                 backup_extent_root:     24113334927360  gen: 106736     level: 2
>                 backup_fs_root:         14085070520320  gen: 102373     level: 3
>                 backup_dev_root:        24113335107584  gen: 106736     level: 1
>                 backup_csum_root:       24113339006976  gen: 106736     level: 3
>                 backup_total_bytes:     24004733018112
>                 backup_bytes_used:      6955368067072
>                 backup_num_devices:     7
> 


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2019-06-17  4:54 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-06-15  6:21 raid6 fails to mount after disk failure with unclean shutdown Paulsen, Alexander
2019-06-17  4:54 ` Qu Wenruo

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.