Linux-BTRFS Archive on lore.kernel.org
 help / color / Atom feed
From: Eric Mesa <eric@ericmesa.com>
To: Andrei Borzenkov <arvidjaar@gmail.com>
Cc: Chris Murphy <lists@colorremedies.com>,
	Btrfs BTRFS <linux-btrfs@vger.kernel.org>
Subject: Re: Issues with btrfs send/receive with parents
Date: Wed, 12 Jun 2019 19:03:04 -0400
Message-ID: <2331470.mWhmLaHhuV@supermario.mushroomkingdom> (raw)
In-Reply-To: <21ecc5c2-7e4c-803e-5299-7ee150d6af4f@gmail.com>

[-- Attachment #1: Type: text/plain, Size: 9806 bytes --]

On Wednesday, June 12, 2019 1:43:00 AM EDT Andrei Borzenkov wrote:
> 11.06.2019 7:19, Eric Mesa пишет:
> > On Monday, June 10, 2019 11:39:53 PM EDT Andrei Borzenkov wrote:
> >> 11.06.2019 4:10, Chris Murphy пишет:
> >>> It's most useful if you show exact commands because actually it's not
> >>> always obvious to everyone what the logic should be and the error
> >>> handling doesn't always stop a user from doing something that doesn't
> >>> make a lot of sense. We need to know the name of the rw subvolume; the
> >>> command to snapshot it; the full send/receive command for that first
> >>> snapshot; the command for a subsequent snapshot; and the command to
> >>> incrementally send/receive it.
> >> 
> >> And the actual output of each command, not description what user thinks
> >> has happened.
> > 
> > Here is a new session where I'll capture everything - well, on the defrag
> > I'll do a snip.
> > 
> > #btrfs fi defrag -v -r /home/
> > 
> > ...there follows a list of files that just scrolls infinitely....
> > /home/ermesa/.dropbox-dist/dropbox-lnx.x86_64-74.4.115/_bisect.cpython-37m
> > -
> > x86_64-linux-gnu.so
> > /home/ermesa/.dropbox-dist/dropbox-lnx.x86_64-74.4.115/
> > tornado.speedups.cpython-37m-x86_64-linux-gnu.so
> > /home/ermesa/.bash_history
> > total 1 failures
> > 
> > # sync
> > 
> > # btrfs sub snap -r /home/ /home/.snapshots/2019-06-10-2353
> > Create a readonly snapshot of '/home/' in
> > '/home/.snapshots/2019-06-10-2353'
> > 
> > # btrfs send -vvv -p /home/.snapshots/2019-06-10-1718/ /home/.snapshots/
> > 2019-06-10-2353/ | ssh root@tanukimario btrfs receive
> > /media/backups/backups1/ supermario-home
> > At subvol /home/.snapshots/2019-06-10-2353/
> > ERROR: link ermesa/.mozilla/firefox/n35gu0fb.default/bookmarkbackups/
> > bookmarks-2019-06-10_679_I1bs5PtgsPwtyXvcvcRdSg==.jsonlz4 ->
> > ermesa/.mozilla/ firefox/n35gu0fb.default/bookmarkbackups/
> > bookmarks-2019-06-09_679_I1bs5PtgsPwtyXvcvcRdSg==.jsonlz4 failed: No such
> > file or directory
> 
> Does
> ermesa/.mozilla/firefox/n35gu0fb.default/bookmarkbackups/bookmarks-2019-06-0
> 9_679_I1bs5PtgsPwtyXvcvcRdSg==.jsonlz4 actually exist in snapshot
> /home/.snapshots/2019-06-10-1718/ on source?
> 
> ls -lR
> /home/.snapshots/2019-06-10-1718/ermesa/.mozilla/n35gu0fb.default/bookmarkba
> ckups
> 
> What is the content of the same directory in matching snapshot on
> destination?
> 
> Please show "btrfs subvolume list -qRu /home" for source and "btrfs
> subvolume list -qRu /media/backups/backups1/supermario-home" for
> destination.


Sure thing. Thanks for your help. 

This is source disk:

#  ls -lR /home/.snapshots/2019-06-10-1718/ermesa/.mozilla/n35gu0fb.default/
bookmarkbackups/
ls: cannot access '/home/.snapshots/2019-06-10-1718/ermesa/.mozilla/
n35gu0fb.default/bookmarkbackups/': No such file or directory

You didn't ask for the child, but I'm going to do it in that, too:

# ls -lR /home/.snapshots/2019-06-10-2353/ermesa/.mozilla/n35gu0fb.default/
bookmarkbackups/
ls: cannot access '/home/.snapshots/2019-06-10-2353/ermesa/.mozilla/
n35gu0fb.default/bookmarkbackups/': No such file or directory

One more thing you didn't ask for, but since this is the ancestor of all -p 
snapshots that actually worked:

# ls -lR /home/.snapshots/2019-06-05-postdefrag/ermesa/.mozilla/
n35gu0fb.default/bookmarkbackups/
ls: cannot access '/home/.snapshots/2019-06-05-postdefrag/ermesa/.mozilla/
n35gu0fb.default/bookmarkbackups/': No such file or directory

On the destination disk:

# pwd                                                                                                                                                                             
/media/backups/backups1/supermario-home

# ls -lR 2019-06-10-1718/ermesa/.mozilla/n35gu0fb.default/bookmarkbackups/                                                                                                        
ls: cannot access '2019-06-10-1718/ermesa/.mozilla/n35gu0fb.default/
bookmarkbackups/': No such file or directory


On the source disk:

# btrfs subvolume list -qRu /home
ID 822 gen 3042780 top level 5 parent_uuid c6101e57-acd3-e54c-a957-
b2b6a033bc42 received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
7247f4a0-6ea2-0d49-b5c5-1ea2ecb8980a path home
ID 823 gen 3042727 top level 822 parent_uuid -                                    
received_uuid -                                    uuid f83e53b6-dc88-1a44-
a5e8-f220d5d21083 path .snapshots
ID 2515 gen 3008316 top level 823 parent_uuid 7247f4a0-6ea2-0d49-
b5c5-1ea2ecb8980a received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
8ef83478-86be-8a47-a425-1dc6957a0fbe path .snapshots/2019-06-05-postdefrag
ID 2516 gen 3021663 top level 823 parent_uuid 7247f4a0-6ea2-0d49-
b5c5-1ea2ecb8980a received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
cbb67aec-02ed-8247-afee-38ae94555471 path .snapshots/2019-06-08-1437
ID 2518 gen 3027353 top level 823 parent_uuid 7247f4a0-6ea2-0d49-
b5c5-1ea2ecb8980a received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
ca361150-1050-5844-bff7-de5c89b5cc05 path .snapshots/2019-06-09-1550
ID 2519 gen 3028168 top level 823 parent_uuid 7247f4a0-6ea2-0d49-
b5c5-1ea2ecb8980a received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
5fa82b5e-59e1-2549-a939-5dabc99c0f2a path .snapshots/2019-06-09-1944
ID 2520 gen 3032614 top level 823 parent_uuid 7247f4a0-6ea2-0d49-
b5c5-1ea2ecb8980a received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
df437aaf-0f40-344e-8302-932ea8e5f197 path .snapshots/2019-06-10-1718
ID 2521 gen 3034140 top level 823 parent_uuid 7247f4a0-6ea2-0d49-
b5c5-1ea2ecb8980a received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
2b985685-d88b-784a-b870-8f5f8fcdd08c path .snapshots/2019-06-10-2353


On the destination disk: (I deleted 2019-06-2353 since it wasn't a valid 
backup and I didn't want to get confused when determining which backups I 
could delete)

btrfs subvolume list -qRu /media/backups/backups1/supermario-home
ID 257 gen 15047 top level 5 parent_uuid -                                    
received_uuid -                                    uuid 5d93ca75-
f423-9840-893e-6324f7e79e02 path backups
ID 258 gen 15049 top level 257 parent_uuid -                                    
received_uuid -                                    uuid 8b60359a-9525-4044-
ac04-4982f1f1fe3a path backups/supermario-home
ID 826 gen 14290 top level 257 parent_uuid -                                    
received_uuid -                                    uuid c7dc0373-7e2a-bb44-
b32c-172aac73b8a7 path backups/VG_ROMs
ID 827 gen 4313 top level 826 parent_uuid -                                    
received_uuid a85853e1-848f-ac46-93c6-da5035cc8042 uuid 0ef9b4f9-
f8b6-8943-8714-38e9376019bf path backups/VG_ROMs/2017-01-21-original
ID 1021 gen 4334 top level 826 parent_uuid 0ef9b4f9-
f8b6-8943-8714-38e9376019bf received_uuid c7356dd2-9fa3-1141-8433-4ba96e4cdcd6 
uuid 8c46bc72-9738-d24e-bb9a-c1edcf7a4755 path backups/VG_ROMs/2019-05-30
ID 1024 gen 15048 top level 257 parent_uuid -                                    
received_uuid -                                    uuid bc92cd25-cf4b-
d24c-8cf5-ddb0df654e05 path backups/Comics
ID 1025 gen 9890 top level 1024 parent_uuid -                                    
received_uuid fd3e9edb-854a-4143-993e-e2a8bbd4cedb uuid 
7a5bd7be-43aa-7f44-9443-ff96cf575175 path backups/Comics/2019-05-30
ID 1027 gen 4336 top level 826 parent_uuid 8c46bc72-9738-d24e-bb9a-
c1edcf7a4755 received_uuid -                                    uuid 85b5572b-
edc3-6d48-8b4d-3c956cae2da5 path backups/VG_ROMs/ROMs_NFS-orig
ID 1602 gen 15047 top level 257 parent_uuid -                                    
received_uuid -                                    uuid 13ab4679-
eccb-6544-8176-6f494236f1c9 path backups/Archive
ID 1603 gen 9964 top level 1602 parent_uuid -                                    
received_uuid 3c48ee45-4454-2f4a-86b7-5c498ffb784d uuid ab3efbd4-e78f-f745-
b401-b653e0ad6667 path backups/Archive/2019-06-01
ID 2726 gen 10165 top level 1024 parent_uuid 7a5bd7be-43aa-7f44-9443-
ff96cf575175 received_uuid 0df42045-b04a-5f43-924e-69b39e1b3ce6 uuid 
f46a045c-41c4-c543-ba5f-948b97e43746 path backups/Comics/2019-06-03
ID 2728 gen 12315 top level 1602 parent_uuid ab3efbd4-e78f-f745-b401-
b653e0ad6667 received_uuid 649d6bec-9f54-2a44-8fed-8e6e9c054f8c uuid 
255c8dc8-8d61-9342-9f3c-af06fe82daf6 path backups/Archive/2019-06-03
ID 2732 gen 10171 top level 1024 parent_uuid f46a045c-41c4-c543-
ba5f-948b97e43746 received_uuid a3a6b2d9-0b30-a342-bafb-6a3a70258994 uuid 
0cb98f03-0152-494c-935f-d6af45cf23dd path backups/Comics/2019-06-03p2
ID 2977 gen 12337 top level 1602 parent_uuid 255c8dc8-8d61-9342-9f3c-
af06fe82daf6 received_uuid 1404041e-6456-2641-a35a-f30f08baf250 uuid 
42eb5475-1b2f-8948-8333-b8a1267455e0 path backups/Archive/2019-06-05
ID 2983 gen 15033 top level 258 parent_uuid -                                    
received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 7685ff5c-0a72-
f94e-93d7-7736f68b3ec5 path 2019-06-05-postdefrag
ID 3545 gen 14310 top level 258 parent_uuid 7685ff5c-0a72-
f94e-93d7-7736f68b3ec5 received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
26791559-bd47-e44f-9e2f-0ea258615429 path 2019-06-08-1437
ID 3550 gen 14878 top level 258 parent_uuid 7685ff5c-0a72-
f94e-93d7-7736f68b3ec5 received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
7c9787bc-fbc4-c146-b88b-e5dd10918eaa path 2019-06-09-1944
ID 3582 gen 15012 top level 258 parent_uuid 7685ff5c-0a72-
f94e-93d7-7736f68b3ec5 received_uuid ab1ea98a-b950-2047-802d-3b26568e2e14 uuid 
44963c1e-7bc7-f34a-9370-ce180ce05b69 path 2019-06-10-1718

--
Eric Mesa

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

  reply index

Thread overview: 14+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-06-10 23:56 Eric Mesa
2019-06-11  1:10 ` Chris Murphy
2019-06-11  3:39   ` Andrei Borzenkov
2019-06-11  4:19     ` Eric Mesa
2019-06-12  5:43       ` Andrei Borzenkov
2019-06-12 23:03         ` Eric Mesa [this message]
2019-06-12 23:11           ` Eric Mesa
2019-06-13  6:26           ` Andrei Borzenkov
2019-06-13 21:22             ` Eric Mesa
2019-06-14  3:55               ` Chris Murphy
2019-07-14 20:59                 ` Eric Mesa
2019-06-18  4:15               ` Andrei Borzenkov
2019-06-11  3:47   ` Eric Mesa
2019-06-11  1:11 ` Remi Gauvin

Reply instructions:

You may reply publically to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=2331470.mWhmLaHhuV@supermario.mushroomkingdom \
    --to=eric@ericmesa.com \
    --cc=arvidjaar@gmail.com \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=lists@colorremedies.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

Linux-BTRFS Archive on lore.kernel.org

Archives are clonable:
	git clone --mirror https://lore.kernel.org/linux-btrfs/0 linux-btrfs/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 linux-btrfs linux-btrfs/ https://lore.kernel.org/linux-btrfs \
		linux-btrfs@vger.kernel.org linux-btrfs@archiver.kernel.org
	public-inbox-index linux-btrfs


Newsgroup available over NNTP:
	nntp://nntp.lore.kernel.org/org.kernel.vger.linux-btrfs


AGPL code for this site: git clone https://public-inbox.org/ public-inbox