Linux-BTRFS Archive on lore.kernel.org
 help / color / Atom feed
* Read-only snapshot send speed very slow after modify original data. Need help
@ 2019-10-30 12:07 Michael
  2019-10-30 12:38 ` Filipe Manana
  2019-11-06 14:48 ` Michael
  0 siblings, 2 replies; 4+ messages in thread
From: Michael @ 2019-10-30 12:07 UTC (permalink / raw)
  To: linux-btrfs

Hi linux-btrfs,

Step to reproduce

1) mkfs.btrfs -draid6 -mraid6 /dev/sd[abcdefgh]

2) mount 
-onoatime,nodiratime,thread_pool=24,max_inline=0,ssd_spread,compress-force=zstd 
/dev/sda /mnt/test/

3) btrfs subvol create /mnt/test/subvol/

4) dd if=/dev/zero of=/mnt/test/subvol/test.dat bs=1M count=65536

5) btrfs subvol snapshot -r /mnt/test/subvol /mnt/test/subvol.ro

6) btrfs send /mnt/test/subvol.ro | pv >/dev/null

64,1GiB 0:01:18 [ 833MiB/s]  - fast

7) for i in {1..16384}; do echo $i; printf '\x01\x02\x03' | dd 
of=/mnt/test/subvol/test.dat bs=1 seek=$(($i * 1024 * 1024)) count=3 
conv=notrunc; done

8) btrfs send /mnt/test/subvol.ro | pv >/dev/null

I stop it at 0:01:18

464MiB 0:01:18 [4,67MiB/s] - very very slow


uname -a
Linux storage.domain.com 5.3.7-200.fc30.x86_64 #1 SMP Fri Oct 18 
20:13:59 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Read-only snapshot send speed very slow after modify original data. Need help
  2019-10-30 12:07 Read-only snapshot send speed very slow after modify original data. Need help Michael
@ 2019-10-30 12:38 ` Filipe Manana
  2019-10-30 12:54   ` Michael
  2019-11-06 14:48 ` Michael
  1 sibling, 1 reply; 4+ messages in thread
From: Filipe Manana @ 2019-10-30 12:38 UTC (permalink / raw)
  To: Michael; +Cc: linux-btrfs

On Wed, Oct 30, 2019 at 12:17 PM Michael <mclaud@roznica.com.ua> wrote:
>
> Hi linux-btrfs,
>
> Step to reproduce
>
> 1) mkfs.btrfs -draid6 -mraid6 /dev/sd[abcdefgh]
>
> 2) mount
> -onoatime,nodiratime,thread_pool=24,max_inline=0,ssd_spread,compress-force=zstd
> /dev/sda /mnt/test/

Have you tried without raid6, like single disk device case for
example? And without compression?
Did such dramatic difference happened as well?

Thanks.

>
> 3) btrfs subvol create /mnt/test/subvol/
>
> 4) dd if=/dev/zero of=/mnt/test/subvol/test.dat bs=1M count=65536
>
> 5) btrfs subvol snapshot -r /mnt/test/subvol /mnt/test/subvol.ro
>
> 6) btrfs send /mnt/test/subvol.ro | pv >/dev/null
>
> 64,1GiB 0:01:18 [ 833MiB/s]  - fast
>
> 7) for i in {1..16384}; do echo $i; printf '\x01\x02\x03' | dd
> of=/mnt/test/subvol/test.dat bs=1 seek=$(($i * 1024 * 1024)) count=3
> conv=notrunc; done
>
> 8) btrfs send /mnt/test/subvol.ro | pv >/dev/null
>
> I stop it at 0:01:18
>
> 464MiB 0:01:18 [4,67MiB/s] - very very slow
>
>
> uname -a
> Linux storage.domain.com 5.3.7-200.fc30.x86_64 #1 SMP Fri Oct 18
> 20:13:59 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
>


-- 
Filipe David Manana,

“Whether you think you can, or you think you can't — you're right.”

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Read-only snapshot send speed very slow after modify original data. Need help
  2019-10-30 12:38 ` Filipe Manana
@ 2019-10-30 12:54   ` Michael
  0 siblings, 0 replies; 4+ messages in thread
From: Michael @ 2019-10-30 12:54 UTC (permalink / raw)
  To: fdmanana; +Cc: linux-btrfs

30.10.2019 14:38, Filipe Manana пишет:
> On Wed, Oct 30, 2019 at 12:17 PM Michael <mclaud@roznica.com.ua> wrote:
>> Hi linux-btrfs,
>>
>> Step to reproduce
>>
>> 1) mkfs.btrfs -draid6 -mraid6 /dev/sd[abcdefgh]
>>
>> 2) mount
>> -onoatime,nodiratime,thread_pool=24,max_inline=0,ssd_spread,compress-force=zstd
>> /dev/sda /mnt/test/
> Have you tried without raid6, like single disk device case for
> example? And without compression?
> Did such dramatic difference happened as well?
>
> Thanks.

without compression step 8: ~800MiB/s - fast

raid1, raid10, raid5, raid6, single drive step 8 with compression: ~4MiB/s

>
>> 3) btrfs subvol create /mnt/test/subvol/
>>
>> 4) dd if=/dev/zero of=/mnt/test/subvol/test.dat bs=1M count=65536
>>
>> 5) btrfs subvol snapshot -r /mnt/test/subvol /mnt/test/subvol.ro
>>
>> 6) btrfs send /mnt/test/subvol.ro | pv >/dev/null
>>
>> 64,1GiB 0:01:18 [ 833MiB/s]  - fast
>>
>> 7) for i in {1..16384}; do echo $i; printf '\x01\x02\x03' | dd
>> of=/mnt/test/subvol/test.dat bs=1 seek=$(($i * 1024 * 1024)) count=3
>> conv=notrunc; done
>>
>> 8) btrfs send /mnt/test/subvol.ro | pv >/dev/null
>>
>> I stop it at 0:01:18
>>
>> 464MiB 0:01:18 [4,67MiB/s] - very very slow
>>
>>
>> uname -a
>> Linux storage.domain.com 5.3.7-200.fc30.x86_64 #1 SMP Fri Oct 18
>> 20:13:59 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
>>
>

-- 
С уважением, Михаил
067-786-11-75

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Read-only snapshot send speed very slow after modify original data. Need help
  2019-10-30 12:07 Read-only snapshot send speed very slow after modify original data. Need help Michael
  2019-10-30 12:38 ` Filipe Manana
@ 2019-11-06 14:48 ` Michael
  1 sibling, 0 replies; 4+ messages in thread
From: Michael @ 2019-11-06 14:48 UTC (permalink / raw)
  To: linux-btrfs

30.10.2019 14:07, Michael пишет:
> Hi linux-btrfs,
>
> Step to reproduce
>
> 1) mkfs.btrfs -draid6 -mraid6 /dev/sd[abcdefgh]
>
> 2) mount 
> -onoatime,nodiratime,thread_pool=24,max_inline=0,ssd_spread,compress-force=zstd 
> /dev/sda /mnt/test/
>
> 3) btrfs subvol create /mnt/test/subvol/
>
> 4) dd if=/dev/zero of=/mnt/test/subvol/test.dat bs=1M count=65536
>
> 5) btrfs subvol snapshot -r /mnt/test/subvol /mnt/test/subvol.ro
>
> 6) btrfs send /mnt/test/subvol.ro | pv >/dev/null
>
> 64,1GiB 0:01:18 [ 833MiB/s]  - fast
>
> 7) for i in {1..16384}; do echo $i; printf '\x01\x02\x03' | dd 
> of=/mnt/test/subvol/test.dat bs=1 seek=$(($i * 1024 * 1024)) count=3 
> conv=notrunc; done
>
> 8) btrfs send /mnt/test/subvol.ro | pv >/dev/null
>
> I stop it at 0:01:18
>
> 464MiB 0:01:18 [4,67MiB/s] - very very slow
Does this problem concern me only?
>
>
> uname -a
> Linux storage.domain.com 5.3.7-200.fc30.x86_64 #1 SMP Fri Oct 18 
> 20:13:59 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
>


^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, back to index

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-10-30 12:07 Read-only snapshot send speed very slow after modify original data. Need help Michael
2019-10-30 12:38 ` Filipe Manana
2019-10-30 12:54   ` Michael
2019-11-06 14:48 ` Michael

Linux-BTRFS Archive on lore.kernel.org

Archives are clonable:
	git clone --mirror https://lore.kernel.org/linux-btrfs/0 linux-btrfs/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 linux-btrfs linux-btrfs/ https://lore.kernel.org/linux-btrfs \
		linux-btrfs@vger.kernel.org
	public-inbox-index linux-btrfs

Example config snippet for mirrors

Newsgroup available over NNTP:
	nntp://nntp.lore.kernel.org/org.kernel.vger.linux-btrfs


AGPL code for this site: git clone https://public-inbox.org/public-inbox.git