All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Ralf Groß" <ralf.gross+xfs@gmail.com>
To: linux-xfs@vger.kernel.org
Subject: Re: memory requirements for a 400TB fs with reflinks
Date: Tue, 23 Mar 2021 10:39:27 +0100	[thread overview]
Message-ID: <CANSSxyk0sKzTmUKitwsxvip-N+TdLmPDrHYFAL9TUDB7gs1Bsg@mail.gmail.com> (raw)
In-Reply-To: <20210322215039.GV63242@dread.disaster.area>

Hi Dave,

> People are busy, and you posted on a weekend. Have some patience,
> please.

I know, sorry for that.

> ....
>
> So there's no one answer - the amount of RAM xfs_repair might need
> largely depends on what you are storing in the filesystem.

I just checked our existing backups repositories. The backup files are
VMware image backup files, daily ones are smaller, weekly/GFS larger.
But the are not millions of smaller files. For primary backup there
are ~25.000 files in 68 TB of a 100 TB share, for a new repository
with a 400 TB fs this would result in ~150.000 files. For the the
secondary copy repository I see 3000 files in a 100 TB share. This
would there result in ~200.000 files in a 700 TB repository. Is there
any formula to calculate the memory requirement for a number of files?

Ralf

  reply	other threads:[~2021-03-23  9:40 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-03-20 18:01 memory requirements for a 400TB fs with reflinks Ralf Groß
2021-03-22 16:50 ` Ralf Groß
2021-03-22 21:50   ` Dave Chinner
2021-03-23  9:39     ` Ralf Groß [this message]
2021-03-23 22:02       ` Dave Chinner
2021-03-23  9:31   ` Lucas Stach

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CANSSxyk0sKzTmUKitwsxvip-N+TdLmPDrHYFAL9TUDB7gs1Bsg@mail.gmail.com \
    --to=ralf.gross+xfs@gmail.com \
    --cc=linux-xfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body. 
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.