All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Pal, Laszlo" <vlad@vlad.hu>
To: linux-btrfs@vger.kernel.org
Subject: Re: performance recommendations
Date: Mon, 15 Feb 2021 20:30:31 +0100	[thread overview]
Message-ID: <CAFTxqD8fGcL1j904b=yFPUwYjJi_bz5iVcxkNC5BoLZ8Wm12ZA@mail.gmail.com> (raw)
In-Reply-To: <CAFTxqD_-OiGjA3EEycKwKGteYPmA6OjPhMxce8f1w8Ly=wd2pg@mail.gmail.com>

So,

I'm trying to recover this stuff... this is a CentOS7 based system
running for almost two years. It was never too fast, but did what I
intended to do, but today I've observed very very bad performance on
ls, rm and other complicated commands. Like rm <any single file> takes
forever and in iotop I can see this command is using 50% of i/o
together with btrfs-transacti, so something definitely wrong

I've added ram and cpu to the VM, but it does not help. Now, I'm also
trying to modify fstab to add noatime, autodefrag

In the journal I can see some "free cache file invalid, skip" warnings

Can anyone offer me some help, so at least I can boot the machine
(right now the boot times out on mount task, so I can have either
emergency mode or rescuecd)

Thank you
Laszlo

On Mon, Feb 15, 2021 at 3:53 PM Pal, Laszlo <vlad@vlad.hu> wrote:
>
> Hi,
>
> I'm not sure this is the right place to ask, but let me try :) I have
> a server where I mainly using btrfs because of the builtin compress
> feature. This is a central log server, storing logs from tens of
> thousands devices, using a text files in thousands of directories in
> millions of files.
>
> I've started to think it was not the best idea to choose btrfs for this :)
>
> The performance of this server was always worst than others where I
> don't use btrfs, but I thought this is just because the i/o overhead
> of compression and the not-so-good esx host providing the disk to this
> machine. But now, even rm a single file takes ages, so there is
> something definitely wrong. So, I'm looking for some recommendations
> for such an environment where the data-security functions of btrfs is
> not as important than the performance.
>
> I was searching the net for some comprehensive performance documents
> for months, but I cannot find it so far.
>
> Thank you in advance
> Laszlo

  reply	other threads:[~2021-02-15 19:32 UTC|newest]

Thread overview: 13+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-02-15 14:53 performance recommendations Pal, Laszlo
2021-02-15 19:30 ` Pal, Laszlo [this message]
     [not found]   ` <B7BDEFC2-2444-4926-8FFC-D78B6CE5CB4E@vlad.hu>
2021-02-15 21:50     ` Pal, Laszlo
2021-02-16  6:08       ` Piotr Szymaniak
2021-02-16  7:17 ` Nikolay Borisov
2021-02-16  8:54   ` Pal, Laszlo
2021-02-16  9:02     ` Nikolay Borisov
2021-02-16 10:28     ` Lionel Bouton
     [not found]     ` <aeed56c3-e641-46a1-5692-04c6ae75d212@gmail.com>
2021-02-16 17:03       ` Pal, Laszlo
2021-02-16 17:49         ` Leonidas Spyropoulos
2021-02-16 18:01           ` Pal, Laszlo
2021-02-16 18:21             ` Lionel Bouton
2021-02-16 19:31               ` Pal, Laszlo

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='CAFTxqD8fGcL1j904b=yFPUwYjJi_bz5iVcxkNC5BoLZ8Wm12ZA@mail.gmail.com' \
    --to=vlad@vlad.hu \
    --cc=linux-btrfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.