Re: btrfs send and receive showing errors

["Randy Nürnberger" <ranuberger@posteo.de>]

[-- Attachment #1: Type: text/plain, Size: 11634 bytes --]

On Thu, Jan 5, 2023 at 12:49, Andrei Borzenkov wrote:
> On 05.01.2023 14:33, Randy Nürnberger wrote:
>> On Thu, Jan 5, 2023 at 11:42, Filipe Manana wrote:
>>> On Thu, Jan 5, 2023 at 10:10 AM Randy Nürnberger 
>>> <ranuberger@posteo.de> wrote:
>>>> On Wed, Jan 4, 2023 at 14:41, Filipe Manana wrote:
>>>>> On Wed, Jan 4, 2023 at 1:05 PM Randy Nürnberger 
>>>>> <ranuberger@posteo.de> wrote:
>>>>>> Hello,
>>>>>>
>>>>>> I’m in the process of copying a btrfs filesystem (a couple years 
>>>>>> old)
>>>>>> from one disk to another by using btrfs send and receive on all
>>>>>> snapshots. The snapshots were created by a tool every hour on the 
>>>>>> hour
>>>>>> as one backup measure and automatically removed as they became 
>>>>>> older.
>>>>>>
>>>>>> I got errors like the following and when I compare the copied 
>>>>>> snapshots
>>>>>> with the originals, some files are missing:
>>>>>>
>>>>>> ERROR: unlink █████ failed: No such file or directory
>>>>>> ERROR: link █████ -> █████ failed: No such file or directory
>>>>>> ERROR: utimes █████ failed: No such file or directory
>>>>>> ERROR: rmdir █████ failed: No such file or directory
>>>>>>
>>>>>> Is this a known bug and how can I help diagnosing and fixing this?
>>>>> So this is a problem caused by the sender issuing commands with 
>>>>> outdated paths.
>>>>>
>>>>> First, try doing the send operation again with a 6.1 kernel - there
>>>>> was at least one fix here that may be relevant.
>>>> I tried again with the following kernel version and still got the same
>>>> errors:
>>>> Linux arktos 6.1.0-0-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.2-1~exp1
>>>> (2023-01-01) x86_64 GNU/Linux
>>>>
>>>>> To actual debug things, in case it's not working with 6.1:
>>>>>
>>>>> 1) Show how you invoked send and receive. I.e. the full command lines
>>>>> for 'btrfs send ...' and 'btrfs receive ...'
>>>> Those are my full command lines:
>>>>
>>>> btrfs send -p /mnt/randy/randy-snapshots/2022-01-29--07-00
>>>> /mnt/randy/randy-snapshots/2022-02-27--10-00 | btrfs receive -vvv
>>>> /mnt/intern/randy-snapshots/ 2>receive-1.txt
>>>>
>>>> btrfs send -p /mnt/randy/randy-snapshots/2022-02-27--10-00
>>>> /mnt/randy/randy-snapshots/2022-03-26--07-00 | btrfs receive -vvv
>>>> /mnt/intern/randy-snapshots/ 2>receive-2.txt
>>>>
>>>>> 2) Provide the whole output of 'btrfs receive' with the -vvv command
>>>>> line option.
>>>>>        This will reveal all path names, but it's necessary to 
>>>>> debug things.
>>>>>        You've hidden path names above, so I suppose that's not 
>>>>> acceptable for you.
>>>> At least I’m not comfortable sharing the file names on this public
>>>> mailing list. I carefully tried to extract and redact what may be the
>>>> relevant parts.
>>>>
>>>> The second command line above is the first one that fails with the
>>>> following error: “ERROR: unlink Hase/Fuchs/2022-02-23 Reh.odt 
>>>> failed: No
>>>> such file or directory”.
>>>>
>>>> This is the directory listing for the snapshot before said file was
>>>> created (this snapshot can be copied without errors):
>>>>
>>>> root@arktos /m/r/randy-snapshots# ls -alh 
>>>> 2022-01-29--07-00/Hase/Fuchs/
>>>> insgesamt 2,6M
>>>> drwxrws--- 1 randy randy  136 19. Dez 2021   ./
>>>> drwxrws--- 1 randy randy  134 24. Nov 2021   ../
>>>> -rw-rw---- 1 randy randy  38K  5. Mai 2021  '2021-05-01 Igel.odt'
>>>> -rw-rw---- 1 randy randy  16K 30. Sep 2021  '2021-09-30 Wolf.odt'
>>>> -rw-rw---- 1 randy randy 2,6M 19. Dez 2021  '2021-12-19 
>>>> Wildschwein.pdf'
>>>>
>>>> This is the directory listing for the snapshot after the file has been
>>>> created (this snapshot can be copied without errors):
>>>>
>>>> root@arktos /m/r/randy-snapshots# ls -alh 
>>>> 2022-02-27--10-00/Hase/Fuchs/
>>>> insgesamt 2,7M
>>>> drwxrws---  1 randy randy  178 27. Feb 2022   ./
>>>> drwxrws---  1 randy randy  134 24. Nov 2021   ../
>>>> -rw-rw----  1 randy randy  38K  5. Mai 2021  '2021-05-01 Igel.odt'
>>>> -rw-rw----  1 randy randy  16K 30. Sep 2021  '2021-09-30 Wolf.odt'
>>>> -rw-rw----  1 randy randy 2,6M 19. Dez 2021  '2021-12-19 
>>>> Wildschwein.pdf'
>>>> -rw-rwx---+ 1 randy randy  42K 26. Feb 2022  '2022-02-23 Reh.odt'*
>>>>
>>>> This is the directory listing for the snapshot after the file has been
>>>> edited in LibreOffice and *renamed* (trying to copy this one fails):
>>>>
>>>> root@arktos /m/r/randy-snapshots# ls -alh 
>>>> 2022-03-26--07-00/Hase/Fuchs/
>>>> insgesamt 2,6M
>>>> drwxrws--- 1 randy randy  178  5. Mär 2022   ./
>>>> drwxrws--- 1 randy randy  134 24. Nov 2021   ../
>>>> -rw-rw---- 1 randy randy  38K  5. Mai 2021  '2021-05-01 Igel.odt'
>>>> -rw-rw---- 1 randy randy  16K 30. Sep 2021  '2021-09-30 Wolf.odt'
>>>> -rw-rw---- 1 randy randy 2,6M 19. Dez 2021  '2021-12-19 
>>>> Wildschwein.pdf'
>>>> -rw-rw---- 1 randy randy  18K  4. Mär 2022  '2022-03-03 Reh.odt'
>>>>
>>>> I’ve attached the outputs of the commands above. Apparently ‘btrfs 
>>>> send’
>>>> instructs ‘btrfs receive’ to unlink the file ‘Hase/Fuchs/2022-02-23
>>>> Reh.odt’ which *does* exist in the copied snapshot ‘2022-02-27--10-00’
>>>> and this fails for whatever reason.
>
> Are you sure "btrfs receive" finds the correct parent? Have you ever 
> flipped read-only property on any snapshot involved in btrfs 
> send/receive?
>
> Check "btrfs subvolume -uqR list" output for duplicated received UUID.

You are right, the parent UUID of the ‘2022-03-26--07-00’ snapshot is 
the UUID of ‘2022-01-29--07-00’ and not ‘2022-02-27--10-00’ as it should 
be. The question is why.

One year ago I once already recreated the *source* filesystem. I did 
this on a 5.10 kernel, by running the following fish-shell script:

mkfs.btrfs --metadata raid1 --data raid1 --checksum sha256 --features 
no-holes --runtime-features free-space-tree /dev/mapper/randy_1_crypt 
/dev/mapper/randy_2_crypt
mount -o noatime,compress-force=zstd:3 /dev/mapper/randy_1_crypt /mnt/randy
mkdir /mnt/randy/randy-snapshots

set snapshots /mnt/old-source/randy-snapshots/*
set destination /mnt/randy/randy-snapshots/
set subvol $snapshots[1]
set i_max (count $snapshots)
echo -e "\033[1m$subvol\033[0m (1 von $i_max)"
btrfs send -q $subvol | pv | btrfs receive $destination
for i in (seq 2 $i_max)
     set parent $snapshots[(math $i-1)]
     set subvol $snapshots[$i]
     echo -e "\033[1m$parent → $subvol\033[0m ($i von $i_max)"
     btrfs send -q -p $parent $subvol | pv | btrfs receive $destination
end

Then I moved the last snapshot and flipped its read-only property to get 
my new main working directory:

mv /mnt/randy/randy-snapshots/2022-01-24--11-53 /mnt/randy/randy
btrfs property set -ts /mnt/randy/randy ro false

I can’t remember getting any errors and all the file hashes underneath 
the final /mnt/randy/randy did equal those of the old source.

I’ve attached the output of ‘btrfs subvolume list’ for the source and 
the target filesystem.

>
>>> The reason is very likely because the file was renamed, but the unlink
>>> operation is using the old name (pre-rename name), instead of the new
>>> name.
>>>
>>> For the second receive, there should be other operations affecting the
>>> file path Hase/Fuchs/2022-02-23 Reh.odt:
>>
>> Unfortunately, there are not.
>>
>> I’m not sure how LibreOffice saves files, but it may create a new file
>> and then replace the old one, so the unlink of the old file name can
>> make sense, I think.
>>
>> When I compare the two copied snapshots, the file is indeed gone, so the
>> unlink operation actually seems to have worked?
>>
>> root@arktos /m/i/randy-snapshots# ls -alh 2022-02-27--10-00/Hase/Fuchs/
>> insgesamt 2,7M
>> drwxrws---  1 randy randy  178 27. Feb 2022   ./
>> drwxrws---  1 randy randy  134 24. Nov 2021   ../
>> -rw-rw----  1 randy randy  38K  5. Mai 2021  '2021-05-01 Igel.odt'
>> -rw-rw----  1 randy randy  16K 30. Sep 2021  '2021-09-30 Wolf.odt'
>> -rw-rw----  1 randy randy 2,6M 19. Dez 2021  '2021-12-19 
>> Wildschwein.pdf'
>> -rw-rwx---+ 1 randy randy  42K 26. Feb 2022  '2022-02-23 Reh.odt'*
>>
>> root@arktos /m/i/randy-snapshots# ls -alh 2022-03-26--07-00/Hase/Fuchs/
>> insgesamt 2,6M
>> drwxrws--- 1 randy randy  136  5. Mär 2022   ./
>> drwxrws--- 1 randy randy  134 24. Nov 2021   ../
>> -rw-rw---- 1 randy randy  38K  5. Mai 2021  '2021-05-01 Igel.odt'
>> -rw-rw---- 1 randy randy  16K 30. Sep 2021  '2021-09-30 Wolf.odt'
>> -rw-rw---- 1 randy randy 2,6M 19. Dez 2021  '2021-12-19 Wildschwein.pdf'
>>
>> I also just compiled btrfs-progs v6.1.1 and tried those and still got
>> the same error.
>>
>>>
>>> utimes Hase/Fuchs
>>> […]
>>> unlink Hase/Fuchs/2022-02-23 Reh.odt
>>> ERROR: unlink Hase/Fuchs/2022-02-23 Reh.odt failed: No such file or 
>>> directory
>>>
>>> Somewhere in the [...] there must be at least one rename of
>>> Hase/Fuchs/2022-02-23 Reh.odt into something else.
>>> It would be interesting to see more of the receive log to determine if
>>> and why that rename happened.
>>>
>>> If this is blocking you right now, you can do a full send of the
>>> snapshot at /mnt/randy/randy-snapshots/2022-03-26--07-00.
>>> That will, almost certainly, succeed. Though it will be slower.
>>
>> Thanks, I’m just copying my filesystem onto bigger disks and that can
>> wait some time.
>>
>>>
>>> Thanks.
>>>
>>>
>>>> # sha256sum
>>>> /mnt/randy/randy-snapshots/2022-02-27--10-00/Hase/Fuchs/2022-02-23\ 
>>>> Reh.odt
>>>> 09ab560f8e2d79e61d253550eda5f388aceddb1b51792e01e589e86a53cdd226
>>>>
>>>> # sha256sum
>>>> /mnt/intern/randy-snapshots/2022-02-27--10-00/Hase/Fuchs/2022-02-23\
>>>> Reh.odt
>>>> 09ab560f8e2d79e61d253550eda5f388aceddb1b51792e01e589e86a53cdd226
>>>>
>>>>> Thanks.
>>>>>
>>>>>> # uname -a  # this is the kernel on which this originally happend
>>>>>> Linux arktos 5.10.0-20-amd64 #1 SMP Debian 5.10.158-2 (2022-12-13)
>>>>>> x86_64 GNU/Linux
>>>>>>
>>>>>>
>>>>>> # uname -a  # I already retried everything on the latest Debian
>>>>>> backports kernel with the same results
>>>>>> Linux arktos 6.0.0-0.deb11.6-amd64 #1 SMP PREEMPT_DYNAMIC Debian
>>>>>> 6.0.12-1~bpo11+1 (2022-12-19) x86_64 GNU/Linux
>>>>>>
>>>>>> # btrfs --version
>>>>>> btrfs-progs v5.10.1
>>>>>>
>>>>>> # btrfs fi sh /mnt/randy  # this is the source
>>>>>> Label: none  uuid: 84bba855-578d-48db-80eb-49f1029c7543
>>>>>>             Total devices 2 FS bytes used 2.04TiB
>>>>>>             devid    1 size 4.00TiB used 2.05TiB path 
>>>>>> /dev/mapper/randy_1_crypt
>>>>>>             devid    2 size 4.00TiB used 2.05TiB path 
>>>>>> /dev/mapper/randy_2_crypt
>>>>>>
>>>>>> # btrfs fi df /mnt/randy
>>>>>> Data, RAID1: total=2.02TiB, used=2.02TiB
>>>>>> System, RAID1: total=8.00MiB, used=320.00KiB
>>>>>> Metadata, RAID1: total=25.00GiB, used=22.99GiB
>>>>>> GlobalReserve, single: total=512.00MiB, used=0.00B
>>>>>>
>>>>>>
>>>>>> # btrfs fi sh /mnt/intern  # this is the target
>>>>>> Label: none  uuid: ebb94498-644c-42cd-892f-37886173523c
>>>>>>             Total devices 2 FS bytes used 1.91TiB
>>>>>>             devid    1 size 8.00TiB used 1.91TiB path
>>>>>> /dev/mapper/vg_arktos_hdd_b-lv_randy_1
>>>>>>             devid    2 size 8.00TiB used 1.91TiB path
>>>>>> /dev/mapper/vg_arktos_hdd_b-lv_randy_2
>>>>>>
>>>>>> # btrfs fi df /mnt/intern
>>>>>> Data, RAID1: total=1.89TiB, used=1.89TiB
>>>>>> System, RAID1: total=8.00MiB, used=288.00KiB
>>>>>> Metadata, RAID1: total=21.00GiB, used=20.76GiB
>>>>>> GlobalReserve, single: total=512.00MiB, used=0.00B
>>
>

[-- Attachment #2: subvolume-list-source.txt --]
[-- Type: text/plain, Size: 12354 bytes --]

ID 2020 gen 596 top level 5 parent_uuid 9b66b1e4-fa6c-2f4a-8379-231cbaa7769d received_uuid a98dd202-b528-264d-bd82-c9e07562e810 uuid e6f1bd57-5235-8c4d-8082-deaef3351daa path randy-snapshots/2021-06-27--13-00
ID 2022 gen 599 top level 5 parent_uuid e6f1bd57-5235-8c4d-8082-deaef3351daa received_uuid 5bc04547-28b8-ad4c-8fc0-fdc336882dd5 uuid 3c9c72c8-a190-7d43-92d5-0098e38e3fd6 path randy-snapshots/2021-07-30--22-00
ID 2024 gen 602 top level 5 parent_uuid 3c9c72c8-a190-7d43-92d5-0098e38e3fd6 received_uuid 1056fbaf-6e92-ba4a-bcef-cae50db71112 uuid ddde7784-bc30-5249-b1c2-3c9edc86d0f1 path randy-snapshots/2021-08-28--18-00
ID 2026 gen 606 top level 5 parent_uuid ddde7784-bc30-5249-b1c2-3c9edc86d0f1 received_uuid 215c8c10-996a-7446-a6ae-76e99433640e uuid 66e89882-2065-d248-ba88-b3eb49d29cee path randy-snapshots/2021-09-25--20-00
ID 2046 gen 628 top level 5 parent_uuid c5c55660-1290-064c-8452-2ae42ddd5a90 received_uuid 1543a180-3064-4447-94ea-850d4ae754dd uuid e5eb4cc2-e4d7-3f4d-9505-6ecfb405474d path randy-snapshots/2021-10-31--13-00
ID 2073 gen 644 top level 5 parent_uuid f689a4f9-fb83-2e4b-aa13-38e097be81b5 received_uuid 2f1746d8-a25c-204c-b74f-0605d445be8f uuid 217c661b-4a47-ef41-8511-65043ee3b645 path randy-snapshots/2021-11-27--19-00
ID 2270 gen 717 top level 5 parent_uuid 9a520141-fbf4-fd4b-853f-690e3981ae87 received_uuid 7840fe0c-8dda-d94f-a07d-c4bd9e3b429b uuid cacb7fa0-37ac-9c44-abd9-d3aeda499ea3 path randy-snapshots/2021-12-31--22-00
ID 2326 gen 3141 top level 5 parent_uuid f0d7eee1-ae15-4d41-b3a6-60bb71aaf030 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 161d4216-88ad-494e-8f10-a4b798c43632 path randy
ID 2331 gen 811 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 5f32e737-d24b-9847-8829-ab53c9854bff path randy-snapshots/2022-01-29--07-00
ID 2393 gen 1061 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 24c1e164-af08-a342-9e55-96d779f68107 path randy-snapshots/2022-02-27--10-00
ID 2468 gen 1412 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid ebc8010a-4353-9b42-8fc6-eeaeb4ed7160 path randy-snapshots/2022-03-26--07-00
ID 2520 gen 1591 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 685c3cc2-bc7d-184b-8b98-7079414337c2 path randy-snapshots/2022-04-30--07-00
ID 2643 gen 1853 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 0b3ca4e6-12a5-c644-9c9c-d56c8b085951 path randy-snapshots/2022-05-28--13-00
ID 2678 gen 1989 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 71d48faf-5f1a-c444-bb7d-d383b1760a02 path randy-snapshots/2022-06-25--07-00
ID 2728 gen 2167 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid c409a4b1-9c9e-c247-b5bf-c325dcf37442 path randy-snapshots/2022-07-30--07-00
ID 2774 gen 2338 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 9a228d8d-6354-734b-9629-da36522210c9 path randy-snapshots/2022-08-27--07-00
ID 2798 gen 2471 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 9daeab29-291a-e749-90ef-94015b714962 path randy-snapshots/2022-09-04--22-00
ID 2805 gen 2490 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 0da2d153-632f-6243-b129-056e81cbab8b path randy-snapshots/2022-09-10--07-00
ID 2814 gen 2518 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 16841f00-1630-8a40-ac9c-7d7f4f6f35e3 path randy-snapshots/2022-09-17--07-00
ID 2828 gen 2555 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 715b2403-e22c-2043-963c-4837f995fbc3 path randy-snapshots/2022-09-25--21-00
ID 2838 gen 2584 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 474c1eb9-fa5d-8c49-aed0-a07b92d24c35 path randy-snapshots/2022-10-01--07-00
ID 2846 gen 2611 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 8e09dac0-8df9-0142-b2c8-bbe64f6f6c35 path randy-snapshots/2022-10-08--07-00
ID 2854 gen 2634 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 1de30ecc-f31b-7d4e-90e0-b90af5cabd3e path randy-snapshots/2022-10-15--07-00
ID 2860 gen 2651 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 4083508a-b024-d449-b612-602a4f36df5b path randy-snapshots/2022-10-22--07-00
ID 2872 gen 2697 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 8909aaf6-b818-1642-b3b2-253cf45b6999 path randy-snapshots/2022-10-30--20-00
ID 2880 gen 2721 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 43bfbf87-2a7f-5e41-8471-6e5228b40490 path randy-snapshots/2022-11-06--02-00
ID 2891 gen 2749 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid b48ad9fa-b444-8e4f-b8a3-c4f9e487b57c path randy-snapshots/2022-11-12--07-00
ID 2899 gen 2780 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid b8c1c9a8-86e0-5a4b-9d8a-99db726c604a path randy-snapshots/2022-11-19--07-00
ID 2912 gen 2826 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid fa0d25dc-af89-2644-968b-c82773af7201 path randy-snapshots/2022-11-27--22-00
ID 2939 gen 2891 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid effc10b4-14a7-6843-a10b-d635fb072c17 path randy-snapshots/2022-12-04--09-00
ID 2940 gen 2893 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 74530e4a-505b-4b44-be0e-e8bebfb72f49 path randy-snapshots/2022-12-05--07-00
ID 2942 gen 2901 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid ae1771e8-9ab9-f64b-a51c-335416802736 path randy-snapshots/2022-12-07--14-00
ID 2943 gen 2903 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 643cf260-7104-1242-9271-f8dbe1412383 path randy-snapshots/2022-12-08--07-00
ID 2944 gen 2905 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 8eb7369f-3261-2742-bc39-9e3c5d0ac011 path randy-snapshots/2022-12-09--07-00
ID 2945 gen 2909 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 1363d673-f805-1946-abe7-bbeab15fc3ef path randy-snapshots/2022-12-10--07-00
ID 2947 gen 2916 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid ca320f95-39ae-d845-acb3-7fd34e91ad50 path randy-snapshots/2022-12-12--07-00
ID 2948 gen 2918 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid ce769c6d-bb4f-9941-9f33-5efe9affa4f4 path randy-snapshots/2022-12-13--07-00
ID 2951 gen 2926 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 3d40a32d-203d-de40-93a7-db79d40d1b5e path randy-snapshots/2022-12-14--15-00
ID 2954 gen 2935 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 0a66d431-2fa2-9542-8689-0eba3eea6017 path randy-snapshots/2022-12-15--22-00
ID 2957 gen 2950 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 47807843-f86e-fb49-98e8-51d539f8ebcc path randy-snapshots/2022-12-16--20-00
ID 2959 gen 2960 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid bbe8b671-8c68-aa49-bb92-e2fb32573305 path randy-snapshots/2022-12-17--23-00
ID 2961 gen 2971 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 59a6958b-b2da-494f-af7c-3dfa4af33fc0 path randy-snapshots/2022-12-18--16-00
ID 2963 gen 2977 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 9c120102-4d82-3049-a4cf-19320df05d42 path randy-snapshots/2022-12-19--21-00
ID 2965 gen 2983 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 9bb99dee-0c4c-fa41-ac79-a93a3c51caf2 path randy-snapshots/2022-12-20--21-00
ID 2970 gen 3005 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 0a792d68-6374-744e-a3df-ece3de5765b9 path randy-snapshots/2022-12-21--21-00
ID 2976 gen 3036 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid e013f9db-91d8-6f44-8996-8b6ff0cad61f path randy-snapshots/2022-12-22--23-00
ID 2979 gen 3050 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid d42085f5-df4c-c34e-8689-740d3c830acc path randy-snapshots/2022-12-23--07-00
ID 2980 gen 3052 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid e6e6591e-cf89-5e4e-97e8-fad0c56c1cb8 path randy-snapshots/2022-12-24--07-00
ID 2981 gen 3059 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid e55ebaaf-903b-4b4d-9d8e-3a61bcff690b path randy-snapshots/2022-12-26--02-00
ID 2983 gen 3070 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid aca28ea9-56d8-0847-96db-bbbbcd40c763 path randy-snapshots/2022-12-27--15-00
ID 2984 gen 3072 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 015a4b18-7e61-2445-a7c7-efb572185a5a path randy-snapshots/2022-12-28--07-00
ID 2985 gen 3080 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 4b4902d4-eef9-fe40-9c0c-05919cdd8701 path randy-snapshots/2022-12-29--01-00
ID 2986 gen 3082 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid c5d26887-2344-e043-a795-25a6ef7cf3f4 path randy-snapshots/2022-12-29--07-00
ID 2987 gen 3084 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 8b75274e-3321-0849-8456-6a76c6636a5e path randy-snapshots/2022-12-29--11-00
ID 2988 gen 3089 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 68853890-6443-904f-81a2-6800ce784a7c path randy-snapshots/2022-12-29--12-00
ID 2989 gen 3091 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid bade1883-bfbf-504a-87a9-7bdc39949cfd path randy-snapshots/2022-12-29--15-00
ID 2990 gen 3093 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid c6963d0f-5ab0-6e4c-a120-e56a7aaa717e path randy-snapshots/2022-12-30--07-00
ID 2991 gen 3096 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid baba0331-e9ea-e449-b673-36ce7d339f14 path randy-snapshots/2022-12-31--01-00
ID 2992 gen 3100 top level 5 parent_uuid 161d4216-88ad-494e-8f10-a4b798c43632 received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 4a043acc-bbc1-5d48-a864-9d5c21cca0d1 path randy-snapshots/2022-12-31--07-00

[-- Attachment #3: subvolume-list-target.txt --]
[-- Type: text/plain, Size: 2080 bytes --]

ID 256 gen 467 top level 5 parent_uuid -                                    received_uuid a98dd202-b528-264d-bd82-c9e07562e810 uuid ad177e5b-9fc5-4f43-b603-1121d5fc965d path randy-snapshots/2021-06-27--13-00
ID 257 gen 470 top level 5 parent_uuid ad177e5b-9fc5-4f43-b603-1121d5fc965d received_uuid 5bc04547-28b8-ad4c-8fc0-fdc336882dd5 uuid 3a0570f8-13a0-5b46-bc90-8418f5284f48 path randy-snapshots/2021-07-30--22-00
ID 258 gen 473 top level 5 parent_uuid 3a0570f8-13a0-5b46-bc90-8418f5284f48 received_uuid 1056fbaf-6e92-ba4a-bcef-cae50db71112 uuid 7d7423c2-dfbf-3545-8c43-8beac745a97c path randy-snapshots/2021-08-28--18-00
ID 259 gen 476 top level 5 parent_uuid 7d7423c2-dfbf-3545-8c43-8beac745a97c received_uuid 215c8c10-996a-7446-a6ae-76e99433640e uuid 29acc7a2-e82a-1e49-97a2-8c30e326baa6 path randy-snapshots/2021-09-25--20-00
ID 260 gen 483 top level 5 parent_uuid 29acc7a2-e82a-1e49-97a2-8c30e326baa6 received_uuid 1543a180-3064-4447-94ea-850d4ae754dd uuid 12d05de7-d93c-0341-8f7e-f06e07bcbaf3 path randy-snapshots/2021-10-31--13-00
ID 261 gen 489 top level 5 parent_uuid 12d05de7-d93c-0341-8f7e-f06e07bcbaf3 received_uuid 2f1746d8-a25c-204c-b74f-0605d445be8f uuid 0a1be929-08e6-a042-8eaa-9a915ed7e68a path randy-snapshots/2021-11-27--19-00
ID 262 gen 559 top level 5 parent_uuid 0a1be929-08e6-a042-8eaa-9a915ed7e68a received_uuid 7840fe0c-8dda-d94f-a07d-c4bd9e3b429b uuid f0198883-2fa7-7840-87c2-08c04fb6c13e path randy-snapshots/2021-12-31--22-00
ID 263 gen 692 top level 5 parent_uuid f0198883-2fa7-7840-87c2-08c04fb6c13e received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid d17fdecb-240a-8744-857b-c1352f3ab0ea path randy-snapshots/2022-01-29--07-00
ID 317 gen 692 top level 5 parent_uuid d17fdecb-240a-8744-857b-c1352f3ab0ea received_uuid 5b98e81e-0e9b-814a-b191-19fe36517d1c uuid 81a5ef26-3a42-9049-9f40-dc78aeef4198 path randy-snapshots/2022-02-27--10-00
ID 318 gen 693 top level 5 parent_uuid d17fdecb-240a-8744-857b-c1352f3ab0ea received_uuid -                                    uuid 2d2caa0a-3707-6843-b60d-79dd63df3cec path randy-snapshots/2022-03-26--07-00