From: Andrea Gelmini <andrea.gelmini@gmail.com>
To: Zygo Blaxell <ce3g8jdj@umail.furryterror.org>
Cc: Marc MERLIN <marc@merlins.org>, Roman Mamedov <rm@romanrm.net>,
Andrei Borzenkov <arvidjaar@gmail.com>,
Josef Bacik <josef@toxicpanda.com>,
Chris Murphy <lists@colorremedies.com>,
Qu Wenruo <quwenruo.btrfs@gmx.com>,
"linux-btrfs@vger.kernel.org" <linux-btrfs@vger.kernel.org>
Subject: Re: Suggestions for building new 44TB Raid5 array
Date: Wed, 6 Jul 2022 11:09:06 +0200 [thread overview]
Message-ID: <CAK-xaQbO_k=sN=XC=cQCLj_+ERBpg8Tt2EFipeTgd1iBJt+5Fg@mail.gmail.com> (raw)
In-Reply-To: <YrFWb52k5wu1L0cg@hungrycats.org>
Il giorno mar 21 giu 2022 alle ore 07:26 Zygo Blaxell
<ce3g8jdj@umail.furryterror.org> ha scritto:
> How many years ago was this? There's no such limit today. Here is a
> 500TB LV with 4TB of cache:
Good to know, thanks!
> There is a limit on metadata size, but you can override it in lvm.conf.
> Presumably if you have a 100TB+ filesystem, you also have enough RAM lying
> around to make the metadata size larger (it's 2.8GB at chunk size 128,
> but that's not unreasonable for 4096GB of cache).
Yeap. We have at least 48GB of RAM on each server.
Well, I use them all to run beesd on night (tweaked the sources)
Fun part, I found this project:
https://github.com/pkolaczk/fclones
It's a recent(!) file-based deduplicator in Rust, with parallelism on
every stages, hard/soft liks and range clones.
Perfect for my needs and blazing fast.
Ciao,
Gelma
next prev parent reply other threads:[~2022-07-06 9:13 UTC|newest]
Thread overview: 24+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-06-11 4:51 Suggestions for building new 44TB Raid5 array Marc MERLIN
2022-06-11 9:30 ` Roman Mamedov
[not found] ` <CAK-xaQYc1PufsvksqP77HMe4ZVTkWuRDn2C3P-iMTQzrbQPLGQ@mail.gmail.com>
2022-06-11 14:52 ` Marc MERLIN
2022-06-11 17:54 ` Roman Mamedov
2022-06-12 17:31 ` Marc MERLIN
2022-06-12 21:21 ` Roman Mamedov
2022-06-13 17:46 ` Marc MERLIN
2022-06-13 18:06 ` Roman Mamedov
2022-06-14 4:51 ` Marc MERLIN
2022-06-13 18:10 ` Zygo Blaxell
2022-06-13 18:13 ` Marc MERLIN
2022-06-13 18:29 ` Roman Mamedov
2022-06-13 20:08 ` Zygo Blaxell
2022-06-14 6:36 ` Torbjörn Jansson
2022-06-20 20:37 ` Andrea Gelmini
2022-06-21 5:26 ` Zygo Blaxell
2022-07-06 9:09 ` Andrea Gelmini [this message]
2022-06-11 23:44 ` Zygo Blaxell
2022-06-14 11:03 ` ronnie sahlberg
[not found] ` <5e1733e6-471e-e7cb-9588-3280e659bfc2@aqueos.com>
2022-06-20 15:01 ` Marc MERLIN
2022-06-20 15:52 ` Ghislain Adnet
2022-06-20 16:27 ` Marc MERLIN
2022-06-20 17:02 ` Andrei Borzenkov
2022-06-20 17:26 ` Marc MERLIN
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CAK-xaQbO_k=sN=XC=cQCLj_+ERBpg8Tt2EFipeTgd1iBJt+5Fg@mail.gmail.com' \
--to=andrea.gelmini@gmail.com \
--cc=arvidjaar@gmail.com \
--cc=ce3g8jdj@umail.furryterror.org \
--cc=josef@toxicpanda.com \
--cc=linux-btrfs@vger.kernel.org \
--cc=lists@colorremedies.com \
--cc=marc@merlins.org \
--cc=quwenruo.btrfs@gmx.com \
--cc=rm@romanrm.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.