linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* 3.15-rc5 btrfs send/receive corruption errors?
@ 2014-05-10 22:07 Marc MERLIN
  2014-05-10 22:42 ` Marc MERLIN
  0 siblings, 1 reply; 11+ messages in thread
From: Marc MERLIN @ 2014-05-10 22:07 UTC (permalink / raw)
  To: linux-btrfs, Filipe David Manana

Howdy,

While moving data back to a brand new btrfs FS I had just created (with
3.14 tools and under 3.15), I got this:

legolas:/mnt/btrfs_pool2# for i in tmp_ro.20140507_09:00:31 root_ro.20140507_10:00:20 usr_ro.20140507_09:00:41 var_ro.20140507_09:00:58 home_ro.20140507_10:00:01; do btrfs send $i | btrfs receive /mnt/btrfs_pool1/; done
At subvol tmp_ro.20140507_09:00:31
At subvol tmp_ro.20140507_09:00:31
At subvol root_ro.20140507_10:00:20
At subvol root_ro.20140507_10:00:20
At subvol usr_ro.20140507_09:00:41
At subvol usr_ro.20140507_09:00:41
At subvol var_ro.20140507_09:00:58
At subvol var_ro.20140507_09:00:58
ERROR: chown www/Q\x17\x06\x04����Q\x17\x06\x04��� failed. No such file or directory
At subvol home_ro.20140507_10:00:01
At subvol home_ro.20140507_10:00:01
ERROR: chmod merlin/.config/google-chrome-mysetup/\x04���� failed. No such file or directory
legolas:/mnt/btrfs_pool2#

legolas:/mnt/btrfs_pool2/var_ro.20140507_09:00:58/www# ls
shows no file that looks like Q^W^F^D����Q^W^F^D��� 

Same deal with merlin/.config/google-chrome-mysetup/

However, I see:
legolas:/mnt/btrfs_pool1/home_ro.20140507_10:00:01# l
total 16
drwxr-xr-x 1 root   root    20 May 10 09:09 ./
drwxr-xr-x 1 root   root   244 May 10 07:50 ../
drwx------ 1 root   root     0 May 10 09:09 ?0$?/
drwxr-xr-x 1 merlin merlin 198 May  7 06:21 merlin/
=> corruption

and
legolas:/mnt/btrfs_pool1/var_ro.20140507_09:00:58# l
total 24
(...)
drwx------ 1 root root  276 May 10 09:07 o1346374-23116-0/
drwx------ 1 root root   38 May 10 09:07 o671296-2268-0/
drwx------ 1 root root   48 May 10 09:07 o676276-2269-0/
drwx------ 1 root root   24 May 10 09:07 o676661-2269-0/
drwx------ 1 root root   72 May 10 09:07 o677466-2270-0/
drwx------ 1 root root  278 May 10 09:07 o718029-2271-0/
drwx------ 1 root root   96 May 10 09:07 o952662-7468-0/
drwxr-xr-x 1 root root    0 Jan 29  2012 opt/
drwx------ 1 root root    0 May 10 09:08 ?Q???????Q???????Q???????/
=> corruption too

I could believe that btrfs has an issue on the source drive, but 
ls -l looks clean on the source, and clearly looks corrupted on the
destination after send/receive.

Any clues?

I'll try reverting to 3.14 if I have enough time this morning to see
if the error happens again.

Thanks,
Marc
-- 
"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors?
  2014-05-10 22:07 3.15-rc5 btrfs send/receive corruption errors? Marc MERLIN
@ 2014-05-10 22:42 ` Marc MERLIN
  2014-05-11  0:06   ` Chris Murphy
  2014-05-12 23:26   ` Marc MERLIN
  0 siblings, 2 replies; 11+ messages in thread
From: Marc MERLIN @ 2014-05-10 22:42 UTC (permalink / raw)
  To: linux-btrfs, Filipe David Manana

On Sat, May 10, 2014 at 03:07:10PM -0700, Marc MERLIN wrote:
> Howdy,
> 
> While moving data back to a brand new btrfs FS I had just created (with
> 3.14 tools and under 3.15), I got this:
> 
> legolas:/mnt/btrfs_pool2# for i in tmp_ro.20140507_09:00:31 root_ro.20140507_10:00:20 usr_ro.20140507_09:00:41 var_ro.20140507_09:00:58 home_ro.20140507_10:00:01; do btrfs send $i | btrfs receive /mnt/btrfs_pool1/; done
> At subvol tmp_ro.20140507_09:00:31
> At subvol tmp_ro.20140507_09:00:31
> At subvol root_ro.20140507_10:00:20
> At subvol root_ro.20140507_10:00:20
> At subvol usr_ro.20140507_09:00:41
> At subvol usr_ro.20140507_09:00:41
> At subvol var_ro.20140507_09:00:58
> At subvol var_ro.20140507_09:00:58
> ERROR: chown www/Q\x17\x06\x04����Q\x17\x06\x04��� failed. No such file or directory
> At subvol home_ro.20140507_10:00:01
> At subvol home_ro.20140507_10:00:01
> ERROR: chmod merlin/.config/google-chrome-mysetup/\x04���� failed. No such file or directory
> legolas:/mnt/btrfs_pool2#
> 
> legolas:/mnt/btrfs_pool2/var_ro.20140507_09:00:58/www# ls
> shows no file that looks like Q^W^F^D����Q^W^F^D��� 
> 
> Same deal with merlin/.config/google-chrome-mysetup/
> 
> However, I see:
> legolas:/mnt/btrfs_pool1/home_ro.20140507_10:00:01# l
> total 16
> drwxr-xr-x 1 root   root    20 May 10 09:09 ./
> drwxr-xr-x 1 root   root   244 May 10 07:50 ../
> drwx------ 1 root   root     0 May 10 09:09 ?0$?/
> drwxr-xr-x 1 merlin merlin 198 May  7 06:21 merlin/
> => corruption

I tried with 3.14.3 and it went further, however it died with
legolas:/mnt/btrfs_pool2# btrfs send  home_ro.20140507_10:00:01 | btrfs receive /mnt/btrfs_pool1/
At subvol home_ro.20140507_10:00:01
At subvol home_ro.20140507_10:00:01
ERROR: send ioctl failed with -5: Input/output error
ERROR: unexpected EOF in stream.

I'll look up -5 later when I have time, but I guess there is a problem
on the source that is causing copies to fail with both kernels?

Marc
-- 
"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors?
  2014-05-10 22:42 ` Marc MERLIN
@ 2014-05-11  0:06   ` Chris Murphy
  2014-05-11  0:16     ` Marc MERLIN
       [not found]     ` <E1WiphR-0003MN-50@legolas.merlins.org>
  2014-05-12 23:26   ` Marc MERLIN
  1 sibling, 2 replies; 11+ messages in thread
From: Chris Murphy @ 2014-05-11  0:06 UTC (permalink / raw)
  To: Btrfs BTRFS, Marc MERLIN


On May 10, 2014, at 4:42 PM, Marc MERLIN <marc@merlins.org> wrote:

> On Sat, May 10, 2014 at 03:07:10PM -0700, Marc MERLIN wrote:
>> Howdy,
>> 
>> While moving data back to a brand new btrfs FS I had just created (with
>> 3.14 tools and under 3.15), I got this:
>> 
>> legolas:/mnt/btrfs_pool2# for i in tmp_ro.20140507_09:00:31 root_ro.20140507_10:00:20 usr_ro.20140507_09:00:41 var_ro.20140507_09:00:58 home_ro.20140507_10:00:01; do btrfs send $i | btrfs receive /mnt/btrfs_pool1/; done
>> At subvol tmp_ro.20140507_09:00:31
>> At subvol tmp_ro.20140507_09:00:31
>> At subvol root_ro.20140507_10:00:20
>> At subvol root_ro.20140507_10:00:20
>> At subvol usr_ro.20140507_09:00:41
>> At subvol usr_ro.20140507_09:00:41
>> At subvol var_ro.20140507_09:00:58
>> At subvol var_ro.20140507_09:00:58
>> ERROR: chown www/Q\x17\x06\x04����Q\x17\x06\x04��� failed. No such file or directory
>> At subvol home_ro.20140507_10:00:01
>> At subvol home_ro.20140507_10:00:01
>> ERROR: chmod merlin/.config/google-chrome-mysetup/\x04���� failed. No such file or directory
>> legolas:/mnt/btrfs_pool2#
>> 
>> legolas:/mnt/btrfs_pool2/var_ro.20140507_09:00:58/www# ls
>> shows no file that looks like Q^W^F^D����Q^W^F^D��� 
>> 
>> Same deal with merlin/.config/google-chrome-mysetup/
>> 
>> However, I see:
>> legolas:/mnt/btrfs_pool1/home_ro.20140507_10:00:01# l
>> total 16
>> drwxr-xr-x 1 root   root    20 May 10 09:09 ./
>> drwxr-xr-x 1 root   root   244 May 10 07:50 ../
>> drwx------ 1 root   root     0 May 10 09:09 ?0$?/
>> drwxr-xr-x 1 merlin merlin 198 May  7 06:21 merlin/
>> => corruption
> 
> I tried with 3.14.3 and it went further, however it died with
> legolas:/mnt/btrfs_pool2# btrfs send  home_ro.20140507_10:00:01 | btrfs receive /mnt/btrfs_pool1/
> At subvol home_ro.20140507_10:00:01
> At subvol home_ro.20140507_10:00:01
> ERROR: send ioctl failed with -5: Input/output error
> ERROR: unexpected EOF in stream.
> 
> I'll look up -5 later when I have time, but I guess there is a problem
> on the source that is causing copies to fail with both kernels?\

I think the issue might be there are still problems and changing code on the receive side (btrfs-progs). The kernel side code responsible for send is probably working correctly.


Chris Murphy

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors?
  2014-05-11  0:06   ` Chris Murphy
@ 2014-05-11  0:16     ` Marc MERLIN
  2014-05-11  0:50       ` Chris Murphy
       [not found]     ` <E1WiphR-0003MN-50@legolas.merlins.org>
  1 sibling, 1 reply; 11+ messages in thread
From: Marc MERLIN @ 2014-05-11  0:16 UTC (permalink / raw)
  To: Chris Murphy; +Cc: Btrfs BTRFS

On Sat, May 10, 2014 at 06:06:46PM -0600, Chris Murphy wrote:
> I think the issue might be there are still problems and changing code on the receive side (btrfs-progs). The kernel side code responsible for send is probably working correctly.

Mmmh, good point, I didn't consider that.
Do you think I should downgrade btrfs-progs back down from 3.14 to 3.12?

Marc
-- 
"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors?
  2014-05-11  0:16     ` Marc MERLIN
@ 2014-05-11  0:50       ` Chris Murphy
  0 siblings, 0 replies; 11+ messages in thread
From: Chris Murphy @ 2014-05-11  0:50 UTC (permalink / raw)
  To: Marc MERLIN; +Cc: Btrfs BTRFS


On May 10, 2014, at 6:16 PM, Marc MERLIN <marc@merlins.org> wrote:

> On Sat, May 10, 2014 at 06:06:46PM -0600, Chris Murphy wrote:
>> I think the issue might be there are still problems and changing code on the receive side (btrfs-progs). The kernel side code responsible for send is probably working correctly.
> 
> Mmmh, good point, I didn't consider that.
> Do you think I should downgrade btrfs-progs back down from 3.14 to 3.12?

If anything, David's btrfs-integration branch, but I'm not sure what its status is at the moment compared to 3.14.


Chris Murphy

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors? Does scrub warn of silent corruption?
       [not found]     ` <E1WiphR-0003MN-50@legolas.merlins.org>
@ 2014-05-11  2:29       ` Marc MERLIN
  0 siblings, 0 replies; 11+ messages in thread
From: Marc MERLIN @ 2014-05-11  2:29 UTC (permalink / raw)
  To: linux-btrfs, Filipe David Manana, Chris Murphy

On Sat, May 10, 2014 at 04:57:18PM -0700, Marc MERLIN wrote:
> On Sat, May 10, 2014 at 03:42:49PM -0700, Marc MERLIN wrote:
> > I tried with 3.14.3 and it went further, however it died with
> > legolas:/mnt/btrfs_pool2# btrfs send  home_ro.20140507_10:00:01 | btrfs receive /mnt/btrfs_pool1/
> > At subvol home_ro.20140507_10:00:01
> > At subvol home_ro.20140507_10:00:01
> > ERROR: send ioctl failed with -5: Input/output error
> > ERROR: unexpected EOF in stream.
> > 
> > I'll look up -5 later when I have time, but I guess there is a problem
> > on the source that is causing copies to fail with both kernels?
> 
> This brings me back to the earlier question:
> 
> When my other FS died, scrub ran ok just earlier.
> 
> Now, having 2 btrfs sends (not incremental, full) fail with 2 kernels
> would indicate that something might be wrong on the source filesystem.
> 
> Yet, last night's scrub ran fine too:
> 
> On Fri, May 09, 2014 at 11:39:13AM -0700, Anacron wrote:
> > /etc/cron.daily/btrfs-scrub:
> > scrub device /dev/mapper/cryptroot (id 1) done
> > 	scrub started at Fri May  9 06:09:14 2014 and finished after 19153 seconds
> > 	total bytes scrubbed: 646.15GiB with 0 errors
> 
> So, does scrub actually make sure everything on my filesystem is sane,
> or can it miss some kinds of corruptions?

I'm thinking that there must be some corruption on btrfs_pool2,
because:

On Sat, May 10, 2014 at 06:06:46PM -0600, Chris Murphy wrote:
> I think the issue might be there are still problems and changing code on the receive side (btrfs-progs). The kernel side code responsible for send is probably working correctly.

I tried
3.15 and progs 3.12
3.15 and progs 3.14
3.14 and progs 3.12
3.14 and progs 3.14

All 4 failed to run
legolas:/mnt/btrfs_pool2# btrfs send home_ro.20140507_10:00:01 | btrfs receive /mnt/btrfs_pool1/

3.14 gives:
ERROR: send ioctl failed with -5: Input/output error
ERROR: unexpected EOF in stream.

3.15 gives a more detailled message how it can't rename some corrupted
filename (regardless of whether I use progs 3.12 or 3.14).

So, since scrub tells me my FS is ok, is scrub right, or do I have a
file pattern that is causing a bug in btrfs send ?

Thanks,
Marc
-- 
"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors? Does scrub warn of silent corruption?
  2014-05-10 22:42 ` Marc MERLIN
  2014-05-11  0:06   ` Chris Murphy
@ 2014-05-12 23:26   ` Marc MERLIN
  2014-05-13 20:11     ` Filipe David Manana
  1 sibling, 1 reply; 11+ messages in thread
From: Marc MERLIN @ 2014-05-12 23:26 UTC (permalink / raw)
  To: linux-btrfs, Filipe David Manana

On Sat, May 10, 2014 at 04:57:18PM -0700, Marc MERLIN wrote:
> On Sat, May 10, 2014 at 03:42:49PM -0700, Marc MERLIN wrote:
> > I tried with 3.14.3 and it went further, however it died with
> > legolas:/mnt/btrfs_pool2# btrfs send  home_ro.20140507_10:00:01 | btrfs receive /mnt/btrfs_pool1/
> > At subvol home_ro.20140507_10:00:01
> > At subvol home_ro.20140507_10:00:01
> > ERROR: send ioctl failed with -5: Input/output error
> > ERROR: unexpected EOF in stream.
> > 
> > I'll look up -5 later when I have time, but I guess there is a problem
> > on the source that is causing copies to fail with both kernels?
> 
> This brings me back to the earlier question:
> 
> When my other FS died, scrub ran ok just earlier.
> 
> Now, having 2 btrfs sends (not incremental, full) fail with 2 kernels
> would indicate that something might be wrong on the source filesystem.

So I copied the entire FS back to the SSD using rsync instead of btrfs
send/receive and as far as I can tell all the data got over fine.

Is there anything you'd like from the subvolumes on the source that
btrfs cannot process and that I'm going to delete so that I can start
syncing back from the SSD to the HDD?

Thanks,
Marc
-- 
"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors? Does scrub warn of silent corruption?
  2014-05-12 23:26   ` Marc MERLIN
@ 2014-05-13 20:11     ` Filipe David Manana
  2014-05-14 13:26       ` Marc MERLIN
  0 siblings, 1 reply; 11+ messages in thread
From: Filipe David Manana @ 2014-05-13 20:11 UTC (permalink / raw)
  To: Marc MERLIN; +Cc: linux-btrfs

On Tue, May 13, 2014 at 12:26 AM, Marc MERLIN <marc@merlins.org> wrote:
> On Sat, May 10, 2014 at 04:57:18PM -0700, Marc MERLIN wrote:
>> On Sat, May 10, 2014 at 03:42:49PM -0700, Marc MERLIN wrote:
>> > I tried with 3.14.3 and it went further, however it died with
>> > legolas:/mnt/btrfs_pool2# btrfs send  home_ro.20140507_10:00:01 | btrfs receive /mnt/btrfs_pool1/
>> > At subvol home_ro.20140507_10:00:01
>> > At subvol home_ro.20140507_10:00:01
>> > ERROR: send ioctl failed with -5: Input/output error
>> > ERROR: unexpected EOF in stream.
>> >
>> > I'll look up -5 later when I have time, but I guess there is a problem
>> > on the source that is causing copies to fail with both kernels?
>>
>> This brings me back to the earlier question:
>>
>> When my other FS died, scrub ran ok just earlier.
>>
>> Now, having 2 btrfs sends (not incremental, full) fail with 2 kernels
>> would indicate that something might be wrong on the source filesystem.
>
> So I copied the entire FS back to the SSD using rsync instead of btrfs
> send/receive and as far as I can tell all the data got over fine.
>
> Is there anything you'd like from the subvolumes on the source that
> btrfs cannot process and that I'm going to delete so that I can start
> syncing back from the SSD to the HDD?

For the issue you had with send sending weird path names, I just found
a case that leads to it (or a crash or some other weird stuff):

https://patchwork.kernel.org/patch/4170401/

But you really need to be using a lot of hard links and deleting them,
so maybe it's caused by something else.

thanks

>
> Thanks,
> Marc
> --
> "A mouse is a device used to point at the xterm you want to type in" - A.S.R.
> Microsoft is to operating systems ....
>                                       .... what McDonalds is to gourmet cooking
> Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901



-- 
Filipe David Manana,

"Reasonable men adapt themselves to the world.
 Unreasonable men adapt the world to themselves.
 That's why all progress depends on unreasonable men."

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors? Does scrub warn of silent corruption?
  2014-05-13 20:11     ` Filipe David Manana
@ 2014-05-14 13:26       ` Marc MERLIN
  2014-05-17 22:23         ` Marc MERLIN
  0 siblings, 1 reply; 11+ messages in thread
From: Marc MERLIN @ 2014-05-14 13:26 UTC (permalink / raw)
  To: Filipe David Manana; +Cc: linux-btrfs

On Tue, May 13, 2014 at 09:11:34PM +0100, Filipe David Manana wrote:
> > Is there anything you'd like from the subvolumes on the source that
> > btrfs cannot process and that I'm going to delete so that I can start
> > syncing back from the SSD to the HDD?
> 
> For the issue you had with send sending weird path names, I just found
> a case that leads to it (or a crash or some other weird stuff):
> 
> https://patchwork.kernel.org/patch/4170401/
> 
> But you really need to be using a lot of hard links and deleting them,
> so maybe it's caused by something else.

Unfortunately, even with your patch, I see get
legolas:/mnt/btrfs_pool2# btrfs send home_ro.20140507_10\:00\:01 | btrfs receive /mnt/btrfs_pool1/
At subvol home_ro.20140507_10:00:01
At subvol home_ro.20140507_10:00:01
ERROR: chown merlin/.config/google-chrome-mysetup/\x01��� failed. No such file or directory


I just ran btrfsck and I see nothing majorly wrong with the source
filesystem:
legolas:~# btrfsck /dev/mapper/disk2 2>&1 |tee /tmp/fsck
checking extents
checking free space cache
checking fs roots
root 22504 inode 1926322 errors 400, nbytes wrong
Checking filesystem on /dev/mapper/disk2
UUID: 6afd4707-876c-46d6-9de2-21c4085b7bed
free space inode generation (0) did not match free space cache generation (78684)
free space inode generation (0) did not match free space cache generation (75988)
free space inode generation (0) did not match free space cache generation (76193)
free space inode generation (0) did not match free space cache generation (28818)
free space inode generation (0) did not match free space cache generation (28818)
free space inode generation (0) did not match free space cache generation (33187)
free space inode generation (0) did not match free space cache generation (31543)
free space inode generation (0) did not match free space cache generation (16710)
found 283033724420 bytes used err is 1
total csum bytes: 663653972
total tree bytes: 7333687296
total fs tree bytes: 5844262912
total extent tree bytes: 631451648
btree space waste bytes: 1497868045
file data blocks allocated: 1081231372288
 referenced 807338209280
Btrfs v3.14.1


To be clear, I do not need this to work, this is a snapshot I'm going to
delete anyway, but if there is anything you'd like me to try or capture
for you to help with improving the code, please let me know.

Marc
-- 
"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors? Does scrub warn of silent corruption?
  2014-05-14 13:26       ` Marc MERLIN
@ 2014-05-17 22:23         ` Marc MERLIN
  2014-05-19 12:54           ` Filipe David Manana
  0 siblings, 1 reply; 11+ messages in thread
From: Marc MERLIN @ 2014-05-17 22:23 UTC (permalink / raw)
  To: Filipe David Manana; +Cc: linux-btrfs

Before I delete this and start over, anything else you'd like from it?

Also, it the 3.15rc5 deadlock I had, did not occur again.
So, I think it may well have been related to my doing a big
send/receive.
See "3.15rc5 deadlock" thread.

Marc

On Wed, May 14, 2014 at 06:26:18AM -0700, Marc MERLIN wrote:
> On Tue, May 13, 2014 at 09:11:34PM +0100, Filipe David Manana wrote:
> > > Is there anything you'd like from the subvolumes on the source that
> > > btrfs cannot process and that I'm going to delete so that I can start
> > > syncing back from the SSD to the HDD?
> > 
> > For the issue you had with send sending weird path names, I just found
> > a case that leads to it (or a crash or some other weird stuff):
> > 
> > https://patchwork.kernel.org/patch/4170401/
> > 
> > But you really need to be using a lot of hard links and deleting them,
> > so maybe it's caused by something else.
> 
> Unfortunately, even with your patch, I see get
> legolas:/mnt/btrfs_pool2# btrfs send home_ro.20140507_10\:00\:01 | btrfs receive /mnt/btrfs_pool1/
> At subvol home_ro.20140507_10:00:01
> At subvol home_ro.20140507_10:00:01
> ERROR: chown merlin/.config/google-chrome-mysetup/\x01��� failed. No such file or directory
> 
> 
> I just ran btrfsck and I see nothing majorly wrong with the source
> filesystem:
> legolas:~# btrfsck /dev/mapper/disk2 2>&1 |tee /tmp/fsck
> checking extents
> checking free space cache
> checking fs roots
> root 22504 inode 1926322 errors 400, nbytes wrong
> Checking filesystem on /dev/mapper/disk2
> UUID: 6afd4707-876c-46d6-9de2-21c4085b7bed
> free space inode generation (0) did not match free space cache generation (78684)
> free space inode generation (0) did not match free space cache generation (75988)
> free space inode generation (0) did not match free space cache generation (76193)
> free space inode generation (0) did not match free space cache generation (28818)
> free space inode generation (0) did not match free space cache generation (28818)
> free space inode generation (0) did not match free space cache generation (33187)
> free space inode generation (0) did not match free space cache generation (31543)
> free space inode generation (0) did not match free space cache generation (16710)
> found 283033724420 bytes used err is 1
> total csum bytes: 663653972
> total tree bytes: 7333687296
> total fs tree bytes: 5844262912
> total extent tree bytes: 631451648
> btree space waste bytes: 1497868045
> file data blocks allocated: 1081231372288
>  referenced 807338209280
> Btrfs v3.14.1
> 
> 
> To be clear, I do not need this to work, this is a snapshot I'm going to
> delete anyway, but if there is anything you'd like me to try or capture
> for you to help with improving the code, please let me know.
> 
> Marc
> -- 
> "A mouse is a device used to point at the xterm you want to type in" - A.S.R.
> Microsoft is to operating systems ....
>                                       .... what McDonalds is to gourmet cooking
> Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901
> --
> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

-- 
"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 3.15-rc5 btrfs send/receive corruption errors? Does scrub warn of silent corruption?
  2014-05-17 22:23         ` Marc MERLIN
@ 2014-05-19 12:54           ` Filipe David Manana
  0 siblings, 0 replies; 11+ messages in thread
From: Filipe David Manana @ 2014-05-19 12:54 UTC (permalink / raw)
  To: Marc MERLIN; +Cc: linux-btrfs

On Sat, May 17, 2014 at 11:23 PM, Marc MERLIN <marc@merlins.org> wrote:
> Before I delete this and start over, anything else you'd like from it?

Can you create an image of the fs with btrfs-image
(https://btrfs.wiki.kernel.org/index.php/Btrfs-image) and uploaded it
somewhere (or send it to me directly) to see if it's easy to
reproduce?

thanks

>
> Also, it the 3.15rc5 deadlock I had, did not occur again.
> So, I think it may well have been related to my doing a big
> send/receive.
> See "3.15rc5 deadlock" thread.
>
> Marc
>
> On Wed, May 14, 2014 at 06:26:18AM -0700, Marc MERLIN wrote:
>> On Tue, May 13, 2014 at 09:11:34PM +0100, Filipe David Manana wrote:
>> > > Is there anything you'd like from the subvolumes on the source that
>> > > btrfs cannot process and that I'm going to delete so that I can start
>> > > syncing back from the SSD to the HDD?
>> >
>> > For the issue you had with send sending weird path names, I just found
>> > a case that leads to it (or a crash or some other weird stuff):
>> >
>> > https://patchwork.kernel.org/patch/4170401/
>> >
>> > But you really need to be using a lot of hard links and deleting them,
>> > so maybe it's caused by something else.
>>
>> Unfortunately, even with your patch, I see get
>> legolas:/mnt/btrfs_pool2# btrfs send home_ro.20140507_10\:00\:01 | btrfs receive /mnt/btrfs_pool1/
>> At subvol home_ro.20140507_10:00:01
>> At subvol home_ro.20140507_10:00:01
>> ERROR: chown merlin/.config/google-chrome-mysetup/ ��� failed. No such file or directory
>>
>>
>> I just ran btrfsck and I see nothing majorly wrong with the source
>> filesystem:
>> legolas:~# btrfsck /dev/mapper/disk2 2>&1 |tee /tmp/fsck
>> checking extents
>> checking free space cache
>> checking fs roots
>> root 22504 inode 1926322 errors 400, nbytes wrong
>> Checking filesystem on /dev/mapper/disk2
>> UUID: 6afd4707-876c-46d6-9de2-21c4085b7bed
>> free space inode generation (0) did not match free space cache generation (78684)
>> free space inode generation (0) did not match free space cache generation (75988)
>> free space inode generation (0) did not match free space cache generation (76193)
>> free space inode generation (0) did not match free space cache generation (28818)
>> free space inode generation (0) did not match free space cache generation (28818)
>> free space inode generation (0) did not match free space cache generation (33187)
>> free space inode generation (0) did not match free space cache generation (31543)
>> free space inode generation (0) did not match free space cache generation (16710)
>> found 283033724420 bytes used err is 1
>> total csum bytes: 663653972
>> total tree bytes: 7333687296
>> total fs tree bytes: 5844262912
>> total extent tree bytes: 631451648
>> btree space waste bytes: 1497868045
>> file data blocks allocated: 1081231372288
>>  referenced 807338209280
>> Btrfs v3.14.1
>>
>>
>> To be clear, I do not need this to work, this is a snapshot I'm going to
>> delete anyway, but if there is anything you'd like me to try or capture
>> for you to help with improving the code, please let me know.
>>
>> Marc
>> --
>> "A mouse is a device used to point at the xterm you want to type in" - A.S.R.
>> Microsoft is to operating systems ....
>>                                       .... what McDonalds is to gourmet cooking
>> Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>
>
> --
> "A mouse is a device used to point at the xterm you want to type in" - A.S.R.
> Microsoft is to operating systems ....
>                                       .... what McDonalds is to gourmet cooking
> Home page: http://marc.merlins.org/                         | PGP 1024R/763BE901



-- 
Filipe David Manana,

"Reasonable men adapt themselves to the world.
 Unreasonable men adapt the world to themselves.
 That's why all progress depends on unreasonable men."

^ permalink raw reply	[flat|nested] 11+ messages in thread

end of thread, other threads:[~2014-05-19 12:54 UTC | newest]

Thread overview: 11+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2014-05-10 22:07 3.15-rc5 btrfs send/receive corruption errors? Marc MERLIN
2014-05-10 22:42 ` Marc MERLIN
2014-05-11  0:06   ` Chris Murphy
2014-05-11  0:16     ` Marc MERLIN
2014-05-11  0:50       ` Chris Murphy
     [not found]     ` <E1WiphR-0003MN-50@legolas.merlins.org>
2014-05-11  2:29       ` 3.15-rc5 btrfs send/receive corruption errors? Does scrub warn of silent corruption? Marc MERLIN
2014-05-12 23:26   ` Marc MERLIN
2014-05-13 20:11     ` Filipe David Manana
2014-05-14 13:26       ` Marc MERLIN
2014-05-17 22:23         ` Marc MERLIN
2014-05-19 12:54           ` Filipe David Manana

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).