From: Miklos Szeredi <miklos@szeredi.hu>
To: garyhuang <zjh.20052005@163.com>
Cc: "linux-unionfs@vger.kernel.org" <linux-unionfs@vger.kernel.org>
Subject: Re: Overlayfs performance issue
Date: Thu, 21 Jan 2021 08:45:33 +0100 [thread overview]
Message-ID: <CAJfpeguF=v6WBRRgC+MGvQJ4Bni-Qp2Eb-0tUKqEUEz9sh4dbQ@mail.gmail.com> (raw)
In-Reply-To: <2701751f.acd1.1772201657e.Coremail.zjh.20052005@163.com>
On Wed, Jan 20, 2021 at 11:54 PM garyhuang <zjh.20052005@163.com> wrote:
>
> Hi Miklos,
>
> Have you ever come into this?
>
> 1. dockerd with overlay2
> a. Running nginx in container mounting the host directory which contains the file to be accessed (docker -v xxx:xxx)
> b. Running nginx in container mounting the host file directly
> The RPS varies too much (RPS(a) < RPS(b)), the more the workers are, the bigger the discount is
>
> 2. dockerd with devicemapper
> Running nginx in container with both the same mounting scenarios, the RPS is not discounted
>
> 3. nginx on host, no performance discounted too. The RPS equals to container with devicemapper.
>
> It is kernel related with big extra spinlock consumption observed by perf when running dockerd with overlayfs even the file is mounted from outside host path.
It's not clear where the contention is coming from. Can you get some
detail from the perf trace where we can see which overlayfs functions
are involved?
Thanks,
Miklos
parent reply other threads:[~2021-01-21 7:47 UTC|newest]
Thread overview: expand[flat|nested] mbox.gz Atom feed
[parent not found: <2701751f.acd1.1772201657e.Coremail.zjh.20052005@163.com>]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CAJfpeguF=v6WBRRgC+MGvQJ4Bni-Qp2Eb-0tUKqEUEz9sh4dbQ@mail.gmail.com' \
--to=miklos@szeredi.hu \
--cc=linux-unionfs@vger.kernel.org \
--cc=zjh.20052005@163.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).