From: jingrui <jingrui@huawei.com> To: "tj@kernel.org" <tj@kernel.org>, Lizefan <lizefan@huawei.com>, "hannes@cmpxchg.org" <hannes@cmpxchg.org>, "hannes@cmpxchg.org" <hannes@cmpxchg.org>, "mhocko@kernel.org" <mhocko@kernel.org>, "vdavydov.dev@gmail.com" <vdavydov.dev@gmail.com> Cc: "akpm@linux-foundation.org" <akpm@linux-foundation.org>, "linux-mm@kvack.org" <linux-mm@kvack.org>, "cgroups@vger.kernel.org" <cgroups@vger.kernel.org>, "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>, caihaomin <caihaomin@huawei.com>, "Weiwei (N)" <wick.wei@huawei.com> Subject: PROBLEM: cgroup cost too much memory when transfer small files to tmpfs Date: Tue, 21 Jul 2020 11:19:52 +0000 [thread overview] Message-ID: <2E04DD7753BE0E4ABABF0B664610AD6F2620CAF7@dggeml528-mbx.china.huawei.com> (raw) Cc: Johannes Weiner <hannes@cmpxchg.org> ; Michal Hocko <mhocko@kernel.org>; Vladimir Davydov <vdavydov.dev@gmail.com> Thanks. --- PROBLEM: cgroup cost too much memory when transfer small files to tmpfs. keywords: cgroup PERCPU/memory cost too much. description: We send small files from node-A to node-B tmpfs /tmp directory using sftp. On node-B the systemd configured with pam on like below. cat /etc/pam.d/password-auth | grep systemd -session optional pam_systemd.so So when transfer a file, a systemd session is created, that means a cgroup is created, then file saved at /tmp will associated with a cgroup object. After file transferred, session and cgroup-dir will be removed, but the file in /tmp still associated with the cgroup object. The PERCPU memory in cgroup/css object cost a lot(about 0.5MB/per-cgroup-object) on 200/cpus machine. When lot of small files transferred to tmpfs, the cgroup/css object memory cost become huge in this scenes to be used. systemd related issue: https://github.com/systemd/systemd/issues/16499 kernel version: 4.19+ Problem: 1. Do we have any idea to descrease cgroup memory cost in this case? 2. When user remove cgroup directory, does it possible associated file memory to root cgroup? 3. Can we provide an option that do not associate memory with cgroup in tmpfs?
WARNING: multiple messages have this Message-ID (diff)
From: jingrui <jingrui-hv44wF8Li93QT0dZR+AlfA@public.gmane.org> To: "tj-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org" <tj-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>, Lizefan <lizefan-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>, "hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org" <hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org>, "hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org" <hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org>, "mhocko-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org" <mhocko-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>, "vdavydov.dev-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org" <vdavydov.dev-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> Cc: "akpm-de/tnXTf+JLsfHDXvbKv3WD2FQJk+8+b@public.gmane.org" <akpm-de/tnXTf+JLsfHDXvbKv3WD2FQJk+8+b@public.gmane.org>, "linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org" <linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org>, "cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org" <cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>, "linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org" <linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>, caihaomin <caihaomin-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>, "Weiwei (N)" <wick.wei-hv44wF8Li93QT0dZR+AlfA@public.gmane.org> Subject: PROBLEM: cgroup cost too much memory when transfer small files to tmpfs Date: Tue, 21 Jul 2020 11:19:52 +0000 [thread overview] Message-ID: <2E04DD7753BE0E4ABABF0B664610AD6F2620CAF7@dggeml528-mbx.china.huawei.com> (raw) Cc: Johannes Weiner <hannes@cmpxchg.org> ; Michal Hocko <mhocko@kernel.org>; Vladimir Davydov <vdavydov.dev@gmail.com> Thanks. --- PROBLEM: cgroup cost too much memory when transfer small files to tmpfs. keywords: cgroup PERCPU/memory cost too much. description: We send small files from node-A to node-B tmpfs /tmp directory using sftp. On node-B the systemd configured with pam on like below. cat /etc/pam.d/password-auth | grep systemd -session optional pam_systemd.so So when transfer a file, a systemd session is created, that means a cgroup is created, then file saved at /tmp will associated with a cgroup object. After file transferred, session and cgroup-dir will be removed, but the file in /tmp still associated with the cgroup object. The PERCPU memory in cgroup/css object cost a lot(about 0.5MB/per-cgroup-object) on 200/cpus machine. When lot of small files transferred to tmpfs, the cgroup/css object memory cost become huge in this scenes to be used. systemd related issue: https://github.com/systemd/systemd/issues/16499 kernel version: 4.19+ Problem: 1. Do we have any idea to descrease cgroup memory cost in this case? 2. When user remove cgroup directory, does it possible associated file memory to root cgroup? 3. Can we provide an option that do not associate memory with cgroup in tmpfs?
next reply other threads:[~2020-07-21 11:20 UTC|newest] Thread overview: 24+ messages / expand[flat|nested] mbox.gz Atom feed top 2020-07-21 11:19 jingrui [this message] 2020-07-21 11:19 ` PROBLEM: cgroup cost too much memory when transfer small files to tmpfs jingrui 2020-07-21 14:45 ` Shakeel Butt 2020-07-21 14:45 ` Shakeel Butt 2020-07-21 14:45 ` Shakeel Butt 2020-07-21 17:41 ` Johannes Weiner 2020-07-21 17:41 ` Johannes Weiner 2020-07-21 18:49 ` Roman Gushchin 2020-07-21 18:49 ` Roman Gushchin 2020-07-21 19:12 ` Shakeel Butt 2020-07-21 19:12 ` Shakeel Butt 2020-07-21 19:12 ` Shakeel Butt 2020-07-21 19:27 ` Roman Gushchin 2020-07-21 19:27 ` Roman Gushchin 2020-07-24 7:55 ` Michal Hocko 2020-07-24 7:55 ` Michal Hocko 2020-07-24 9:35 ` 答复: " jingrui 2020-07-24 9:35 ` jingrui 2020-07-24 11:35 ` Michal Hocko 2020-07-24 11:35 ` Michal Hocko 2020-07-27 3:14 ` jingrui 2020-07-27 3:14 ` jingrui 2020-07-27 13:40 ` 答复: " Fangxiuning (Jack, EulerOS) 2020-07-27 13:40 ` Fangxiuning (Jack, EulerOS)
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=2E04DD7753BE0E4ABABF0B664610AD6F2620CAF7@dggeml528-mbx.china.huawei.com \ --to=jingrui@huawei.com \ --cc=akpm@linux-foundation.org \ --cc=caihaomin@huawei.com \ --cc=cgroups@vger.kernel.org \ --cc=hannes@cmpxchg.org \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-mm@kvack.org \ --cc=lizefan@huawei.com \ --cc=mhocko@kernel.org \ --cc=tj@kernel.org \ --cc=vdavydov.dev@gmail.com \ --cc=wick.wei@huawei.com \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.