linux-lvm.redhat.com archive mirror
 help / color / mirror / Atom feed
From: Gionatan Danti <g.danti@assyoma.it>
To: Zdenek Kabelac <zkabelac@redhat.com>,
	LVM general discussion and development <linux-lvm@redhat.com>
Subject: Re: [linux-lvm] Higher than expected metadata usage?
Date: Tue, 27 Mar 2018 12:58:40 +0200	[thread overview]
Message-ID: <0a45b797-70f3-6220-b7f5-525aacc40f0e@assyoma.it> (raw)
In-Reply-To: <5efcabfd-fad5-a228-8887-b9f4d38d2d1d@redhat.com>

On 27/03/2018 12:18, Zdenek Kabelac wrote:
> Tool for size estimation is giving some 'rough' first guess/first choice 
> number.
> 
> The metadata usage is based in real-word data manipulation - so while 
> it's relatively easy to 'cup'� a single thin LV metadata usage - once 
> there is a lot of sharing between many different volumes - the exact 
> size estimation
> is difficult - as it depend on the order how the 'btree' has been 
> constructed.
> 
> I.e. it is surely true the i.e. defragmentation of thin-pool may give 
> you a more compact tree consuming less space - but the amount of work 
> needed to get thin-pool into the most optimal configuration doesn't pay 
> off.� So you need to live with cases, where the metadata usage behaves 
> in a bit unpredictable manner - since it's more preferred speed over the 
> smallest consumed space - which could be very pricey in terms of CPU and 
> memory usage.
> 
> So as it has been said - metadata is 'accounted' in chunks for a 
> userspace app (like lvm2 is or what you get with 'dmsetup status') - but 
> how much free space is left in these individual chunks is kernel 
> internal...

Ok, understood.

> It's time to move on, you address 7TB and you 'extremely' care about 
> couple MB 'hint here' - try to investigate how much space is wasted in 
> filesystem itself ;)

Mmm no, I am caring for the couple MBs themselves. I was concerned about 
the possibility to get a full metadata device by writing far less data 
than expected. But I now get the point.

Thanks.

-- 
Danti Gionatan
Supporto Tecnico
Assyoma S.r.l. - www.assyoma.it
email: g.danti@assyoma.it - info@assyoma.it
GPG public key ID: FF5F32A8

  reply	other threads:[~2018-03-27 10:58 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-03-27  7:44 [linux-lvm] Higher than expected metadata usage? Gionatan Danti
2018-03-27  8:30 ` Zdenek Kabelac
2018-03-27  9:40   ` Gionatan Danti
2018-03-27 10:18     ` Zdenek Kabelac
2018-03-27 10:58       ` Gionatan Danti [this message]
2018-03-27 11:06         ` Gionatan Danti
2018-03-27 10:39 ` Zdenek Kabelac
2018-03-27 11:05   ` Gionatan Danti
2018-03-27 12:52     ` Zdenek Kabelac

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=0a45b797-70f3-6220-b7f5-525aacc40f0e@assyoma.it \
    --to=g.danti@assyoma.it \
    --cc=linux-lvm@redhat.com \
    --cc=zkabelac@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).