linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: "André Malm" <admin@sheepa.org>
To: Chris Murphy <lists@colorremedies.com>
Cc: linux-btrfs <linux-btrfs@vger.kernel.org>
Subject: Re: Btrfs send with parent different size depending on source of files.
Date: Mon, 18 Feb 2019 20:58:44 +0100	[thread overview]
Message-ID: <47ac7b0a-269c-5580-fb3b-2504111901cf@sheepa.org> (raw)
In-Reply-To: <CAJCQCtSE++nn=mVEpKt3vgpnDXXnooD2zg6aUJ6DdkphVDHQkg@mail.gmail.com>

What causes the extent to be incomplete? And can I avoid it? I tried 
with my example but with wget with a larger file (1G) and the diff 
produces was only 60MB which indicates that it "mostly" works.

Basically what I'm trying to achieve is having a "reference" / "master" 
btrfs subvolume where i add / edit / remove files continuously. From 
where i can cp --reflink=always some of those files to new "child" 
subvolumes as needed. As long as the files are still in the master 
subvolume I'll only send the diff of the data. The plan is to have this 
master subvolume across multiple remote machines (synced with rsync or 
perhaps btrfs send / receive) and being able to update / change it as 
needed but always only sending the diffs of the child subvolumes. Maybe 
this is a bit optimistic.

On 2019-02-18 19:06, Chris Murphy wrote:
> On Mon, Feb 18, 2019 at 6:05 AM André Malm <admin@sheepa.org> wrote:
>> So the takeaway from this is that btrfs send doesn't work this way, I
>> can't copy a file with reflink=always and expect it to be diffed
>> correctly as in a parent-child situation or?
> Sorry about the confusion, André. What you're doing isn't described or
> explained in existing documentation: man page, wiki, or list archive,
> it's only explained in this thread. So, all I can say is it's going to
> take some testing on your part and possibly documentation and example
> improvements, for this alternative usage.
>
> At the moment, based on Andrei's explanation and example, what you're
> trying to do is valid. He also explained why you're seeing different
> results in send stream output in your dd vs wget example: it's the
> files themselves not the application.
>
> "The last extent is incomplete which causes btrfs to not attempt cloning."
>



  reply	other threads:[~2019-02-18 19:58 UTC|newest]

Thread overview: 30+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-02-14 11:37 Btrfs send with parent different size depending on source of files André Malm
2019-02-14 22:37 ` Chris Murphy
2019-02-15  4:00   ` Remi Gauvin
2019-02-15 18:38     ` Chris Murphy
2019-02-15 18:56       ` Remi Gauvin
2019-02-16 20:10         ` Andrei Borzenkov
2019-02-15 17:45   ` Andrei Borzenkov
2019-02-15 19:11     ` Chris Murphy
2019-02-16 20:26       ` Andrei Borzenkov
2019-02-16 20:32         ` Andrei Borzenkov
2019-02-18 18:00         ` Chris Murphy
2019-02-15 19:29 ` Remi Gauvin
2019-02-15 19:41   ` Remi Gauvin
2019-02-16 20:08 ` Andrei Borzenkov
2019-02-17  3:11   ` Remi Gauvin
2019-02-18 13:05     ` André Malm
2019-02-18 18:06       ` Chris Murphy
2019-02-18 19:58         ` André Malm [this message]
2019-02-18 20:59           ` Graham Cobb
2019-02-18 21:22           ` Chris Murphy
2019-02-18 21:36             ` André Malm
2019-02-18 22:28               ` Chris Murphy
2019-02-18 22:58                 ` André Malm
2019-02-18 23:49                   ` Chris Murphy
2019-02-18 23:58                     ` André Malm
2019-02-19  0:16                       ` Chris Murphy
2019-02-19  0:17                         ` Chris Murphy
2019-02-19  0:28                         ` André Malm
2019-02-19  3:54                           ` Chris Murphy
2019-02-19 12:05                             ` André Malm

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=47ac7b0a-269c-5580-fb3b-2504111901cf@sheepa.org \
    --to=admin@sheepa.org \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=lists@colorremedies.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).