From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.5 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A6C12C433DB for ; Tue, 2 Feb 2021 18:48:02 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 3B92364E75 for ; Tue, 2 Feb 2021 18:48:02 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 3B92364E75 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=cmpxchg.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 5A9C66B0071; Tue, 2 Feb 2021 13:48:00 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 536FF6B0072; Tue, 2 Feb 2021 13:48:00 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 315FD6B0073; Tue, 2 Feb 2021 13:48:00 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0231.hostedemail.com [216.40.44.231]) by kanga.kvack.org (Postfix) with ESMTP id 0DED16B0071 for ; Tue, 2 Feb 2021 13:48:00 -0500 (EST) Received: from smtpin25.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id BBA97180AD80F for ; Tue, 2 Feb 2021 18:47:59 +0000 (UTC) X-FDA: 77774212278.25.straw66_420f588275cd Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin25.hostedemail.com (Postfix) with ESMTP id 8E5401804E3A8 for ; Tue, 2 Feb 2021 18:47:59 +0000 (UTC) X-HE-Tag: straw66_420f588275cd X-Filterd-Recvd-Size: 7977 Received: from mail-qk1-f176.google.com (mail-qk1-f176.google.com [209.85.222.176]) by imf17.hostedemail.com (Postfix) with ESMTP for ; Tue, 2 Feb 2021 18:47:59 +0000 (UTC) Received: by mail-qk1-f176.google.com with SMTP id l27so20843860qki.9 for ; Tue, 02 Feb 2021 10:47:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cmpxchg-org.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=XT+JmgvaZOl0uziPjZmcv+RThYrP5A/U4TIbmhwqks0=; b=CD4IDH/zzGOlaHncy8YNUVjQm/YufoLAqbtib1Ch7ybgevCSkokoyoEE3mDGi649k6 uISfIK4Zhrz0TY/k0WF131nO/i1D4UkZTNHH3vKWaWWQYQkfe8Tjh8Ji0Y+MWF2Ja2lE QpRKdxGp+Fj6/Gu0pDy/5mXW9duKwRtwAPmou0o58ON0XVbPiGU+boZdjFyCQPLwgmbB 7zSc0z3e4r+RdUOyryCsgPdTLPenmZk7qkob+pro+yEqTurvBfZiGHboma9diumUprF9 //fG61ZYz3az/cPkAxqodIrLcS9f9y1F2LIRUO0WaGMPm7KsZqk7ZA/TisuxoO3FaYfY 8g7g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=XT+JmgvaZOl0uziPjZmcv+RThYrP5A/U4TIbmhwqks0=; b=RNyXiWApaTDWTpCAVe8q7dbiLC6Uqfrqke/y1W2XuKQCEcAn7ZSVlFIg5LaCGSp5bF kpQ1yRIibZwv+Q4VhZfciU4loXziQi25wTlIxdJoLQ4kPZ0Kk8fR7VLI/SnvuKyZ+dN2 L2WG7g881qmGTD+B+mrIXQLgx4jwjzXFv1Yngz6vUfG2zLIFfGxvIP3vohoW0oV2guUI nqemTIVJaUCLKZpw63vyl2Trz41sslh6J4PvPNe1nY86zrxaKmXoki/eXCxvpkoQvmQh x6UwPq8DZJleNiMuphKF09ieTdjfTCNKhMxkZeqZDQz2nSkFjv0PHBRF6xKRUTqAP07n YSmQ== X-Gm-Message-State: AOAM531MSrVa1Kq+R9TbrMrEra+8Y8ulB0vOSiyRtCtTdNCzKFU0+eIU WOO2G/My4WD/okPyuOLihbY6CA== X-Google-Smtp-Source: ABdhPJxPedtnjVsyY8n38Z9X98YOBxEnI4tIs5n3uUt0HHVmzh2yVH5YgSvWMWxFrXTvHEnobPV6EQ== X-Received: by 2002:a37:ad1:: with SMTP id 200mr23205999qkk.195.1612291678246; Tue, 02 Feb 2021 10:47:58 -0800 (PST) Received: from localhost (70.44.39.90.res-cmts.bus.ptd.net. [70.44.39.90]) by smtp.gmail.com with ESMTPSA id k129sm18116923qkf.108.2021.02.02.10.47.57 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 02 Feb 2021 10:47:57 -0800 (PST) From: Johannes Weiner To: Andrew Morton , Tejun Heo Cc: Michal Hocko , Roman Gushchin , linux-mm@kvack.org, cgroups@vger.kernel.org, linux-kernel@vger.kernel.org, kernel-team@fb.com Subject: [PATCH 4/7] cgroup: rstat: support cgroup1 Date: Tue, 2 Feb 2021 13:47:43 -0500 Message-Id: <20210202184746.119084-5-hannes@cmpxchg.org> X-Mailer: git-send-email 2.30.0 In-Reply-To: <20210202184746.119084-1-hannes@cmpxchg.org> References: <20210202184746.119084-1-hannes@cmpxchg.org> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Rstat currently only supports the default hierarchy in cgroup2. In order to replace memcg's private stats infrastructure - used in both cgroup1 and cgroup2 - with rstat, the latter needs to support cgroup1. The initialization and destruction callbacks for regular cgroups are already in place. Remove the cgroup_on_dfl() guards to handle cgroup1. The initialization of the root cgroup is currently hardcoded to only handle cgrp_dfl_root.cgrp. Move those callbacks to cgroup_setup_root() and cgroup_destroy_root() to handle the default root as well as the various cgroup1 roots we may set up during mounting. The linking of css to cgroups happens in code shared between cgroup1 and cgroup2 as well. Simply remove the cgroup_on_dfl() guard. Linkage of the root css to the root cgroup is a bit trickier: per default, the root css of a subsystem controller belongs to the default hierarchy (i.e. the cgroup2 root). When a controller is mounted in its cgroup1 version, the root css is stolen and moved to the cgroup1 root; on unmount, the css moves back to the default hierarchy. Annotate rebind_subsystems() to move the root css linkage along between roots. Signed-off-by: Johannes Weiner --- kernel/cgroup/cgroup.c | 34 +++++++++++++++++++++------------- kernel/cgroup/rstat.c | 2 -- 2 files changed, 21 insertions(+), 15 deletions(-) diff --git a/kernel/cgroup/cgroup.c b/kernel/cgroup/cgroup.c index 9153b20e5cc6..e049edd66776 100644 --- a/kernel/cgroup/cgroup.c +++ b/kernel/cgroup/cgroup.c @@ -1339,6 +1339,7 @@ static void cgroup_destroy_root(struct cgroup_root = *root) =20 mutex_unlock(&cgroup_mutex); =20 + cgroup_rstat_exit(cgrp); kernfs_destroy_root(root->kf_root); cgroup_free_root(root); } @@ -1751,6 +1752,12 @@ int rebind_subsystems(struct cgroup_root *dst_root= , u16 ss_mask) &dcgrp->e_csets[ss->id]); spin_unlock_irq(&css_set_lock); =20 + if (ss->css_rstat_flush) { + list_del_rcu(&css->rstat_css_node); + list_add_rcu(&css->rstat_css_node, + &dcgrp->rstat_css_list); + } + /* default hierarchy doesn't enable controllers by default */ dst_root->subsys_mask |=3D 1 << ssid; if (dst_root =3D=3D &cgrp_dfl_root) { @@ -1971,10 +1978,14 @@ int cgroup_setup_root(struct cgroup_root *root, u= 16 ss_mask) if (ret) goto destroy_root; =20 - ret =3D rebind_subsystems(root, ss_mask); + ret =3D cgroup_rstat_init(root_cgrp); if (ret) goto destroy_root; =20 + ret =3D rebind_subsystems(root, ss_mask); + if (ret) + goto exit_stats; + ret =3D cgroup_bpf_inherit(root_cgrp); WARN_ON_ONCE(ret); =20 @@ -2006,6 +2017,8 @@ int cgroup_setup_root(struct cgroup_root *root, u16= ss_mask) ret =3D 0; goto out; =20 +exit_stats: + cgroup_rstat_exit(root_cgrp); destroy_root: kernfs_destroy_root(root->kf_root); root->kf_root =3D NULL; @@ -4934,8 +4947,7 @@ static void css_free_rwork_fn(struct work_struct *w= ork) cgroup_put(cgroup_parent(cgrp)); kernfs_put(cgrp->kn); psi_cgroup_free(cgrp); - if (cgroup_on_dfl(cgrp)) - cgroup_rstat_exit(cgrp); + cgroup_rstat_exit(cgrp); kfree(cgrp); } else { /* @@ -4976,8 +4988,7 @@ static void css_release_work_fn(struct work_struct = *work) /* cgroup release path */ TRACE_CGROUP_PATH(release, cgrp); =20 - if (cgroup_on_dfl(cgrp)) - cgroup_rstat_flush(cgrp); + cgroup_rstat_flush(cgrp); =20 spin_lock_irq(&css_set_lock); for (tcgrp =3D cgroup_parent(cgrp); tcgrp; @@ -5034,7 +5045,7 @@ static void init_and_link_css(struct cgroup_subsys_= state *css, css_get(css->parent); } =20 - if (cgroup_on_dfl(cgrp) && ss->css_rstat_flush) + if (ss->css_rstat_flush) list_add_rcu(&css->rstat_css_node, &cgrp->rstat_css_list); =20 BUG_ON(cgroup_css(cgrp, ss)); @@ -5159,11 +5170,9 @@ static struct cgroup *cgroup_create(struct cgroup = *parent, const char *name, if (ret) goto out_free_cgrp; =20 - if (cgroup_on_dfl(parent)) { - ret =3D cgroup_rstat_init(cgrp); - if (ret) - goto out_cancel_ref; - } + ret =3D cgroup_rstat_init(cgrp); + if (ret) + goto out_cancel_ref; =20 /* create the directory */ kn =3D kernfs_create_dir(parent->kn, name, mode, cgrp); @@ -5250,8 +5259,7 @@ static struct cgroup *cgroup_create(struct cgroup *= parent, const char *name, out_kernfs_remove: kernfs_remove(cgrp->kn); out_stat_exit: - if (cgroup_on_dfl(parent)) - cgroup_rstat_exit(cgrp); + cgroup_rstat_exit(cgrp); out_cancel_ref: percpu_ref_exit(&cgrp->self.refcnt); out_free_cgrp: diff --git a/kernel/cgroup/rstat.c b/kernel/cgroup/rstat.c index d51175cedfca..faa767a870ba 100644 --- a/kernel/cgroup/rstat.c +++ b/kernel/cgroup/rstat.c @@ -285,8 +285,6 @@ void __init cgroup_rstat_boot(void) =20 for_each_possible_cpu(cpu) raw_spin_lock_init(per_cpu_ptr(&cgroup_rstat_cpu_lock, cpu)); - - BUG_ON(cgroup_rstat_init(&cgrp_dfl_root.cgrp)); } =20 /* --=20 2.30.0