From: Roman Gushchin <guro@fb.com>
To: Dennis Zhou <dennis@kernel.org>
Cc: Jan Kara <jack@suse.cz>, Tejun Heo <tj@kernel.org>,
<linux-fsdevel@vger.kernel.org>, <linux-kernel@vger.kernel.org>,
<linux-mm@kvack.org>, Alexander Viro <viro@zeniv.linux.org.uk>,
Dave Chinner <dchinner@redhat.com>, <cgroups@vger.kernel.org>
Subject: Re: [PATCH v8 8/8] writeback, cgroup: release dying cgwbs by switching attached inodes
Date: Tue, 8 Jun 2021 15:37:19 -0700 [thread overview]
Message-ID: <YL/xH+DBAYWM6eXK@carbon.dhcp.thefacebook.com> (raw)
In-Reply-To: <YL+WC5beBH/N0ddz@google.com>
On Tue, Jun 08, 2021 at 04:08:43PM +0000, Dennis Zhou wrote:
> Hello,
>
> On Mon, Jun 07, 2021 at 06:31:23PM -0700, Roman Gushchin wrote:
> > Asynchronously try to release dying cgwbs by switching attached inodes
> > to the nearest living ancestor wb. It helps to get rid of per-cgroup
> > writeback structures themselves and of pinned memory and block cgroups,
> > which are significantly larger structures (mostly due to large per-cpu
> > statistics data). This prevents memory waste and helps to avoid
> > different scalability problems caused by large piles of dying cgroups.
> >
> > Reuse the existing mechanism of inode switching used for foreign inode
> > detection. To speed things up batch up to 115 inode switching in a
> > single operation (the maximum number is selected so that the resulting
> > struct inode_switch_wbs_context can fit into 1024 bytes). Because
> > every switching consists of two steps divided by an RCU grace period,
> > it would be too slow without batching. Please note that the whole
> > batch counts as a single operation (when increasing/decreasing
> > isw_nr_in_flight). This allows to keep umounting working (flush the
> > switching queue), however prevents cleanups from consuming the whole
> > switching quota and effectively blocking the frn switching.
> >
> > A cgwb cleanup operation can fail due to different reasons (e.g. not
> > enough memory, the cgwb has an in-flight/pending io, an attached inode
> > in a wrong state, etc). In this case the next scheduled cleanup will
> > make a new attempt. An attempt is made each time a new cgwb is offlined
> > (in other words a memcg and/or a blkcg is deleted by a user). In the
> > future an additional attempt scheduled by a timer can be implemented.
> >
> > Signed-off-by: Roman Gushchin <guro@fb.com>
> > Acked-by: Tejun Heo <tj@kernel.org>
> > Acked-by: Dennis Zhou <dennis@kernel.org>
> > ---
> > fs/fs-writeback.c | 102 ++++++++++++++++++++++++++++---
> > include/linux/backing-dev-defs.h | 1 +
> > include/linux/writeback.h | 1 +
> > mm/backing-dev.c | 67 +++++++++++++++++++-
> > 4 files changed, 159 insertions(+), 12 deletions(-)
> >
> > diff --git a/fs/fs-writeback.c b/fs/fs-writeback.c
> > index 737ac27adb77..96eb6e6cdbc2 100644
> > --- a/fs/fs-writeback.c
> > +++ b/fs/fs-writeback.c
> > @@ -225,6 +225,12 @@ void wb_wait_for_completion(struct wb_completion *done)
> > /* one round can affect upto 5 slots */
> > #define WB_FRN_MAX_IN_FLIGHT 1024 /* don't queue too many concurrently */
> >
> > +/*
> > + * Maximum inodes per isw. A specific value has been chosen to make
> > + * struct inode_switch_wbs_context fit into 1024 bytes kmalloc.
> > + */
> > +#define WB_MAX_INODES_PER_ISW 115
> > +
> > static atomic_t isw_nr_in_flight = ATOMIC_INIT(0);
> > static struct workqueue_struct *isw_wq;
> >
> > @@ -503,6 +509,24 @@ static void inode_switch_wbs_work_fn(struct work_struct *work)
> > atomic_dec(&isw_nr_in_flight);
> > }
> >
> > +static bool inode_prepare_wbs_switch(struct inode *inode,
> > + struct bdi_writeback *new_wb)
> > +{
> > + /* while holding I_WB_SWITCH, no one else can update the association */
> > + spin_lock(&inode->i_lock);
> > + if (!(inode->i_sb->s_flags & SB_ACTIVE) ||
> > + inode->i_state & (I_WB_SWITCH | I_FREEING | I_WILL_FREE) ||
> > + inode_to_wb(inode) == new_wb) {
> > + spin_unlock(&inode->i_lock);
> > + return false;
> > + }
> > + inode->i_state |= I_WB_SWITCH;
> > + __iget(inode);
> > + spin_unlock(&inode->i_lock);
> > +
> > + return true;
> > +}
> > +
> > /**
> > * inode_switch_wbs - change the wb association of an inode
> > * @inode: target inode
> > @@ -540,17 +564,8 @@ static void inode_switch_wbs(struct inode *inode, int new_wb_id)
> > if (!isw->new_wb)
> > goto out_free;
> >
> > - /* while holding I_WB_SWITCH, no one else can update the association */
> > - spin_lock(&inode->i_lock);
> > - if (!(inode->i_sb->s_flags & SB_ACTIVE) ||
> > - inode->i_state & (I_WB_SWITCH | I_FREEING | I_WILL_FREE) ||
> > - inode_to_wb(inode) == isw->new_wb) {
> > - spin_unlock(&inode->i_lock);
> > + if (!inode_prepare_wbs_switch(inode, isw->new_wb))
> > goto out_free;
> > - }
> > - inode->i_state |= I_WB_SWITCH;
> > - __iget(inode);
> > - spin_unlock(&inode->i_lock);
> >
> > isw->inodes[0] = inode;
> >
> > @@ -571,6 +586,73 @@ static void inode_switch_wbs(struct inode *inode, int new_wb_id)
> > kfree(isw);
> > }
> >
> > +/**
> > + * cleanup_offline_cgwb - detach associated inodes
> > + * @wb: target wb
> > + *
> > + * Switch all inodes attached to @wb to a nearest living ancestor's wb in order
> > + * to eventually release the dying @wb. Returns %true if not all inodes were
> > + * switched and the function has to be restarted.
> > + */
> > +bool cleanup_offline_cgwb(struct bdi_writeback *wb)
> > +{
> > + struct cgroup_subsys_state *memcg_css;
> > + struct inode_switch_wbs_context *isw;
> > + struct inode *inode;
> > + int nr;
> > + bool restart = false;
> > +
> > + isw = kzalloc(sizeof(*isw) + WB_MAX_INODES_PER_ISW *
> > + sizeof(struct inode *), GFP_KERNEL);
> > + if (!isw)
> > + return restart;
> > +
> > + atomic_inc(&isw_nr_in_flight);
> > +
> > + for (memcg_css = wb->memcg_css->parent; memcg_css;
> > + memcg_css = memcg_css->parent) {
> > + isw->new_wb = wb_get_lookup(wb->bdi, memcg_css);
>
> Should this be wb_get_create()? I suspect intermediate cgroups wouldn't
> have cgwb's due to the no internal process constraint. cgwb's aren't
> like blkcgs where they pin the parent and maintain the tree hierarchy.
Yes, it's a good point. I'll change to wb_get_create() and send v9 soon.
Thank you!
prev parent reply other threads:[~2021-06-08 22:37 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-06-08 1:31 [PATCH v8 0/8] cgroup, blkcg: prevent dirty inodes to pin dying memory cgroups Roman Gushchin
2021-06-08 1:31 ` [PATCH v8 1/8] writeback, cgroup: do not switch inodes with I_WILL_FREE flag Roman Gushchin
2021-06-08 1:31 ` [PATCH v8 2/8] writeback, cgroup: add smp_mb() to cgroup_writeback_umount() Roman Gushchin
2021-06-08 8:43 ` Jan Kara
2021-06-08 1:31 ` [PATCH v8 3/8] writeback, cgroup: increment isw_nr_in_flight before grabbing an inode Roman Gushchin
2021-06-08 8:45 ` Jan Kara
2021-06-08 1:31 ` [PATCH v8 4/8] writeback, cgroup: switch to rcu_work API in inode_switch_wbs() Roman Gushchin
2021-06-08 1:31 ` [PATCH v8 5/8] writeback, cgroup: keep list of inodes attached to bdi_writeback Roman Gushchin
2021-06-08 1:31 ` [PATCH v8 6/8] writeback, cgroup: split out the functional part of inode_switch_wbs_work_fn() Roman Gushchin
2021-06-08 1:31 ` [PATCH v8 7/8] writeback, cgroup: support switching multiple inodes at once Roman Gushchin
2021-06-08 1:31 ` [PATCH v8 8/8] writeback, cgroup: release dying cgwbs by switching attached inodes Roman Gushchin
2021-06-08 8:54 ` Jan Kara
2021-06-08 16:08 ` Dennis Zhou
2021-06-08 22:37 ` Roman Gushchin [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=YL/xH+DBAYWM6eXK@carbon.dhcp.thefacebook.com \
--to=guro@fb.com \
--cc=cgroups@vger.kernel.org \
--cc=dchinner@redhat.com \
--cc=dennis@kernel.org \
--cc=jack@suse.cz \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=tj@kernel.org \
--cc=viro@zeniv.linux.org.uk \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).