All of lore.kernel.org
 help / color / mirror / Atom feed
From: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
To: "Aneesh Kumar K.V" <aneesh.kumar@linux.vnet.ibm.com>
Cc: Michal Hocko <mhocko@suse.cz>,
	linux-mm@kvack.org, mgorman@suse.de, dhillf@gmail.com,
	aarcange@redhat.com, akpm@linux-foundation.org,
	hannes@cmpxchg.org, linux-kernel@vger.kernel.org,
	cgroups@vger.kernel.org
Subject: Re: [PATCH -V4 04/10] memcg: Add HugeTLB extension
Date: Thu, 29 Mar 2012 09:18:39 +0900	[thread overview]
Message-ID: <4F73AA5F.5050604@jp.fujitsu.com> (raw)
In-Reply-To: <87y5qk1vat.fsf@skywalker.in.ibm.com>

(2012/03/29 2:37), Aneesh Kumar K.V wrote:

> Michal Hocko <mhocko@suse.cz> writes:
> 
>> On Fri 16-03-12 23:09:24, Aneesh Kumar K.V wrote:
>> [...]
>>> diff --git a/mm/memcontrol.c b/mm/memcontrol.c
>>> index 6728a7a..4b36c5e 100644
>>> --- a/mm/memcontrol.c
>>> +++ b/mm/memcontrol.c
>> [...]
>>> @@ -4887,6 +5013,7 @@ err_cleanup:
>>>  static struct cgroup_subsys_state * __ref
>>>  mem_cgroup_create(struct cgroup_subsys *ss, struct cgroup *cont)
>>>  {
>>> +	int idx;
>>>  	struct mem_cgroup *memcg, *parent;
>>>  	long error = -ENOMEM;
>>>  	int node;
>>> @@ -4929,9 +5056,14 @@ mem_cgroup_create(struct cgroup_subsys *ss, struct cgroup *cont)
>>>  		 * mem_cgroup(see mem_cgroup_put).
>>>  		 */
>>>  		mem_cgroup_get(parent);
>>> +		for (idx = 0; idx < HUGE_MAX_HSTATE; idx++)
>>> +			res_counter_init(&memcg->hugepage[idx],
>>> +					 &parent->hugepage[idx]);
>>
>> Hmm, I do not think we want to make groups deeper in the hierarchy
>> unlimited as we cannot reclaim. Shouldn't we copy the limit from the parent?
>> Still not ideal but slightly more expected behavior IMO.
> 
> But we should be limiting the child group based on parent's limit only
> when hierarchy is set right ?
> 
>>
>> The hierarchy setups are still interesting and the limitations should be
>> described in the documentation...
>>
> 
> It should behave similar to memcg. ie, if hierarchy is set, then we limit
> using MIN(parent's limit, child's limit). May be I am missing some of
> the details of memcg use_hierarchy config. My goal was to keep it
> similar to memcg. Can you explain why do you think the patch would
> make it any different ?
> 


Maybe this is a different story but....

Tejun(Cgroup Maintainer) asked us to remove 'use_hierarchy' settings because
most of other cgroups are hierarchical(*). I answered that improvement in res_counter 
latency is required. And now, we have some idea to improve res_counter.
(I'd like to try this after page_cgroup diet series..)

If we change and drop use_hierarchy, the usage similar to current use_hierarchy=0
will be..

	/cgroup/memory/			       = unlimited
			level1		       = unlimited
				level2	       = unlimited
					level3 = limit

To do this, after improvement of res_counter, we entry use_hierarchy into
feature-removal-list and wait for 2 versions..So, this will not affect
your developments, anyway.
 
Thanks,
-Kame

(*) AFAIK, blkio cgroup needs tons of work to be hierarchical...



WARNING: multiple messages have this Message-ID (diff)
From: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
To: "Aneesh Kumar K.V" <aneesh.kumar@linux.vnet.ibm.com>
Cc: Michal Hocko <mhocko@suse.cz>,
	linux-mm@kvack.org, mgorman@suse.de, dhillf@gmail.com,
	aarcange@redhat.com, akpm@linux-foundation.org,
	hannes@cmpxchg.org, linux-kernel@vger.kernel.org,
	cgroups@vger.kernel.org
Subject: Re: [PATCH -V4 04/10] memcg: Add HugeTLB extension
Date: Thu, 29 Mar 2012 09:18:39 +0900	[thread overview]
Message-ID: <4F73AA5F.5050604@jp.fujitsu.com> (raw)
In-Reply-To: <87y5qk1vat.fsf@skywalker.in.ibm.com>

(2012/03/29 2:37), Aneesh Kumar K.V wrote:

> Michal Hocko <mhocko@suse.cz> writes:
> 
>> On Fri 16-03-12 23:09:24, Aneesh Kumar K.V wrote:
>> [...]
>>> diff --git a/mm/memcontrol.c b/mm/memcontrol.c
>>> index 6728a7a..4b36c5e 100644
>>> --- a/mm/memcontrol.c
>>> +++ b/mm/memcontrol.c
>> [...]
>>> @@ -4887,6 +5013,7 @@ err_cleanup:
>>>  static struct cgroup_subsys_state * __ref
>>>  mem_cgroup_create(struct cgroup_subsys *ss, struct cgroup *cont)
>>>  {
>>> +	int idx;
>>>  	struct mem_cgroup *memcg, *parent;
>>>  	long error = -ENOMEM;
>>>  	int node;
>>> @@ -4929,9 +5056,14 @@ mem_cgroup_create(struct cgroup_subsys *ss, struct cgroup *cont)
>>>  		 * mem_cgroup(see mem_cgroup_put).
>>>  		 */
>>>  		mem_cgroup_get(parent);
>>> +		for (idx = 0; idx < HUGE_MAX_HSTATE; idx++)
>>> +			res_counter_init(&memcg->hugepage[idx],
>>> +					 &parent->hugepage[idx]);
>>
>> Hmm, I do not think we want to make groups deeper in the hierarchy
>> unlimited as we cannot reclaim. Shouldn't we copy the limit from the parent?
>> Still not ideal but slightly more expected behavior IMO.
> 
> But we should be limiting the child group based on parent's limit only
> when hierarchy is set right ?
> 
>>
>> The hierarchy setups are still interesting and the limitations should be
>> described in the documentation...
>>
> 
> It should behave similar to memcg. ie, if hierarchy is set, then we limit
> using MIN(parent's limit, child's limit). May be I am missing some of
> the details of memcg use_hierarchy config. My goal was to keep it
> similar to memcg. Can you explain why do you think the patch would
> make it any different ?
> 


Maybe this is a different story but....

Tejun(Cgroup Maintainer) asked us to remove 'use_hierarchy' settings because
most of other cgroups are hierarchical(*). I answered that improvement in res_counter 
latency is required. And now, we have some idea to improve res_counter.
(I'd like to try this after page_cgroup diet series..)

If we change and drop use_hierarchy, the usage similar to current use_hierarchy=0
will be..

	/cgroup/memory/			       = unlimited
			level1		       = unlimited
				level2	       = unlimited
					level3 = limit

To do this, after improvement of res_counter, we entry use_hierarchy into
feature-removal-list and wait for 2 versions..So, this will not affect
your developments, anyway.
 
Thanks,
-Kame

(*) AFAIK, blkio cgroup needs tons of work to be hierarchical...


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: KAMEZAWA Hiroyuki <kamezawa.hiroyu-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
To: "Aneesh Kumar K.V"
	<aneesh.kumar-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org>
Cc: Michal Hocko <mhocko-AlSwsSmVLrQ@public.gmane.org>,
	linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org,
	mgorman-l3A5Bk7waGM@public.gmane.org,
	dhillf-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org,
	aarcange-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org,
	akpm-de/tnXTf+JLsfHDXvbKv3WD2FQJk+8+b@public.gmane.org,
	hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org,
	linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: Re: [PATCH -V4 04/10] memcg: Add HugeTLB extension
Date: Thu, 29 Mar 2012 09:18:39 +0900	[thread overview]
Message-ID: <4F73AA5F.5050604@jp.fujitsu.com> (raw)
In-Reply-To: <87y5qk1vat.fsf-6yE53ggjAfyqSkle7U1LjlaTQe2KTcn/@public.gmane.org>

(2012/03/29 2:37), Aneesh Kumar K.V wrote:

> Michal Hocko <mhocko-AlSwsSmVLrQ@public.gmane.org> writes:
> 
>> On Fri 16-03-12 23:09:24, Aneesh Kumar K.V wrote:
>> [...]
>>> diff --git a/mm/memcontrol.c b/mm/memcontrol.c
>>> index 6728a7a..4b36c5e 100644
>>> --- a/mm/memcontrol.c
>>> +++ b/mm/memcontrol.c
>> [...]
>>> @@ -4887,6 +5013,7 @@ err_cleanup:
>>>  static struct cgroup_subsys_state * __ref
>>>  mem_cgroup_create(struct cgroup_subsys *ss, struct cgroup *cont)
>>>  {
>>> +	int idx;
>>>  	struct mem_cgroup *memcg, *parent;
>>>  	long error = -ENOMEM;
>>>  	int node;
>>> @@ -4929,9 +5056,14 @@ mem_cgroup_create(struct cgroup_subsys *ss, struct cgroup *cont)
>>>  		 * mem_cgroup(see mem_cgroup_put).
>>>  		 */
>>>  		mem_cgroup_get(parent);
>>> +		for (idx = 0; idx < HUGE_MAX_HSTATE; idx++)
>>> +			res_counter_init(&memcg->hugepage[idx],
>>> +					 &parent->hugepage[idx]);
>>
>> Hmm, I do not think we want to make groups deeper in the hierarchy
>> unlimited as we cannot reclaim. Shouldn't we copy the limit from the parent?
>> Still not ideal but slightly more expected behavior IMO.
> 
> But we should be limiting the child group based on parent's limit only
> when hierarchy is set right ?
> 
>>
>> The hierarchy setups are still interesting and the limitations should be
>> described in the documentation...
>>
> 
> It should behave similar to memcg. ie, if hierarchy is set, then we limit
> using MIN(parent's limit, child's limit). May be I am missing some of
> the details of memcg use_hierarchy config. My goal was to keep it
> similar to memcg. Can you explain why do you think the patch would
> make it any different ?
> 


Maybe this is a different story but....

Tejun(Cgroup Maintainer) asked us to remove 'use_hierarchy' settings because
most of other cgroups are hierarchical(*). I answered that improvement in res_counter 
latency is required. And now, we have some idea to improve res_counter.
(I'd like to try this after page_cgroup diet series..)

If we change and drop use_hierarchy, the usage similar to current use_hierarchy=0
will be..

	/cgroup/memory/			       = unlimited
			level1		       = unlimited
				level2	       = unlimited
					level3 = limit

To do this, after improvement of res_counter, we entry use_hierarchy into
feature-removal-list and wait for 2 versions..So, this will not affect
your developments, anyway.
 
Thanks,
-Kame

(*) AFAIK, blkio cgroup needs tons of work to be hierarchical...


  reply	other threads:[~2012-03-29  0:20 UTC|newest]

Thread overview: 130+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-03-16 17:39 [PATCH -V4 00/10] memcg: Add memcg extension to control HugeTLB allocation Aneesh Kumar K.V
2012-03-16 17:39 ` Aneesh Kumar K.V
2012-03-16 17:39 ` [PATCH -V4 01/10] hugetlb: rename max_hstate to hugetlb_max_hstate Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  2:07   ` KAMEZAWA Hiroyuki
2012-03-19  2:07     ` KAMEZAWA Hiroyuki
2012-03-28  9:18   ` Michal Hocko
2012-03-28  9:18     ` Michal Hocko
2012-03-28  9:18     ` Michal Hocko
2012-03-16 17:39 ` [PATCH -V4 02/10] hugetlbfs: don't use ERR_PTR with VM_FAULT* values Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  2:11   ` KAMEZAWA Hiroyuki
2012-03-19  2:11     ` KAMEZAWA Hiroyuki
2012-03-19  2:11     ` KAMEZAWA Hiroyuki
2012-03-19  6:37     ` Aneesh Kumar K.V
2012-03-19  6:37       ` Aneesh Kumar K.V
2012-03-28  9:25   ` Michal Hocko
2012-03-28  9:25     ` Michal Hocko
2012-03-28 11:35     ` Aneesh Kumar K.V
2012-03-28 11:35       ` Aneesh Kumar K.V
2012-03-28 11:35       ` Aneesh Kumar K.V
2012-03-16 17:39 ` [PATCH -V4 03/10] hugetlbfs: Add an inline helper for finding hstate index Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  2:15   ` KAMEZAWA Hiroyuki
2012-03-19  2:15     ` KAMEZAWA Hiroyuki
2012-03-28  9:41   ` Michal Hocko
2012-03-28  9:41     ` Michal Hocko
2012-03-16 17:39 ` [PATCH -V4 04/10] memcg: Add HugeTLB extension Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  2:38   ` KAMEZAWA Hiroyuki
2012-03-19  2:38     ` KAMEZAWA Hiroyuki
2012-03-19  2:38     ` KAMEZAWA Hiroyuki
2012-03-19  6:52     ` Aneesh Kumar K.V
2012-03-19  6:52       ` Aneesh Kumar K.V
2012-03-19  6:52       ` Aneesh Kumar K.V
2012-03-19  7:00       ` KAMEZAWA Hiroyuki
2012-03-19  7:00         ` KAMEZAWA Hiroyuki
2012-03-19  7:00         ` KAMEZAWA Hiroyuki
2012-03-19 11:39         ` Glauber Costa
2012-03-19 12:07           ` KAMEZAWA Hiroyuki
2012-03-19 12:07             ` KAMEZAWA Hiroyuki
2012-03-21  4:48           ` Aneesh Kumar K.V
2012-03-21  4:48             ` Aneesh Kumar K.V
2012-03-21  4:48             ` Aneesh Kumar K.V
2012-03-21  5:22             ` KAMEZAWA Hiroyuki
2012-03-21  5:22               ` KAMEZAWA Hiroyuki
2012-03-21  5:22               ` KAMEZAWA Hiroyuki
2012-03-28 11:33   ` Michal Hocko
2012-03-28 11:33     ` Michal Hocko
2012-03-28 11:33     ` Michal Hocko
2012-03-28 13:40     ` Aneesh Kumar K.V
2012-03-28 13:40       ` Aneesh Kumar K.V
2012-03-28 15:44       ` Michal Hocko
2012-03-28 15:44         ` Michal Hocko
2012-03-28 13:40   ` Michal Hocko
2012-03-28 13:40     ` Michal Hocko
2012-03-28 17:37     ` Aneesh Kumar K.V
2012-03-28 17:37       ` Aneesh Kumar K.V
2012-03-28 17:37       ` Aneesh Kumar K.V
2012-03-29  0:18       ` KAMEZAWA Hiroyuki [this message]
2012-03-29  0:18         ` KAMEZAWA Hiroyuki
2012-03-29  0:18         ` KAMEZAWA Hiroyuki
2012-03-29  7:57       ` Michal Hocko
2012-03-29  7:57         ` Michal Hocko
2012-03-29  7:57         ` Michal Hocko
2012-03-16 17:39 ` [PATCH -V4 05/10] hugetlb: add charge/uncharge calls for HugeTLB alloc/free Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  2:41   ` KAMEZAWA Hiroyuki
2012-03-19  2:41     ` KAMEZAWA Hiroyuki
2012-03-19  2:41     ` KAMEZAWA Hiroyuki
2012-03-19  7:01     ` Aneesh Kumar K.V
2012-03-19  7:01       ` Aneesh Kumar K.V
2012-03-28 13:17   ` Michal Hocko
2012-03-28 13:17     ` Michal Hocko
2012-03-28 13:17     ` Michal Hocko
2012-03-28 17:39     ` Aneesh Kumar K.V
2012-03-28 17:39       ` Aneesh Kumar K.V
2012-03-28 17:39       ` Aneesh Kumar K.V
2012-03-29  8:10       ` Michal Hocko
2012-03-29  8:10         ` Michal Hocko
2012-03-30 10:40         ` Aneesh Kumar K.V
2012-03-30 10:40           ` Aneesh Kumar K.V
2012-03-30 10:46           ` Michal Hocko
2012-03-30 10:46             ` Michal Hocko
2012-03-30 10:46             ` Michal Hocko
2012-03-16 17:39 ` [PATCH -V4 06/10] memcg: track resource index in cftype private Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  2:43   ` KAMEZAWA Hiroyuki
2012-03-19  2:43     ` KAMEZAWA Hiroyuki
2012-03-19  2:43     ` KAMEZAWA Hiroyuki
2012-03-16 17:39 ` [PATCH -V4 07/10] hugetlbfs: Add memcg control files for hugetlbfs Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  2:56   ` KAMEZAWA Hiroyuki
2012-03-19  2:56     ` KAMEZAWA Hiroyuki
2012-03-19  7:14     ` Aneesh Kumar K.V
2012-03-19  7:14       ` Aneesh Kumar K.V
2012-03-19  7:14       ` Aneesh Kumar K.V
2012-03-19  7:34       ` KAMEZAWA Hiroyuki
2012-03-19  7:34         ` KAMEZAWA Hiroyuki
2012-03-19  7:34         ` KAMEZAWA Hiroyuki
2012-03-20  9:22         ` Aneesh Kumar K.V
2012-03-20  9:22           ` Aneesh Kumar K.V
2012-03-16 17:39 ` [PATCH -V4 08/10] hugetlbfs: Add a list for tracking in-use HugeTLB pages Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  3:00   ` KAMEZAWA Hiroyuki
2012-03-19  3:00     ` KAMEZAWA Hiroyuki
2012-03-19  3:00     ` KAMEZAWA Hiroyuki
2012-03-19  8:59     ` Aneesh Kumar K.V
2012-03-19  8:59       ` Aneesh Kumar K.V
2012-03-28 13:58   ` Michal Hocko
2012-03-28 13:58     ` Michal Hocko
2012-03-28 17:38     ` Aneesh Kumar K.V
2012-03-28 17:38       ` Aneesh Kumar K.V
2012-03-29  8:11       ` Michal Hocko
2012-03-29  8:11         ` Michal Hocko
2012-03-16 17:39 ` [PATCH -V4 09/10] memcg: move HugeTLB resource count to parent cgroup on memcg removal Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-19  3:04   ` KAMEZAWA Hiroyuki
2012-03-19  3:04     ` KAMEZAWA Hiroyuki
2012-03-19  3:04     ` KAMEZAWA Hiroyuki
2012-03-19  9:00     ` Aneesh Kumar K.V
2012-03-19  9:00       ` Aneesh Kumar K.V
2012-03-28 14:07   ` Michal Hocko
2012-03-28 14:07     ` Michal Hocko
2012-03-28 14:07     ` Michal Hocko
2012-03-16 17:39 ` [PATCH -V4 10/10] memcg: Add memory controller documentation for hugetlb management Aneesh Kumar K.V
2012-03-16 17:39   ` Aneesh Kumar K.V
2012-03-28 14:36   ` Michal Hocko
2012-03-28 14:36     ` Michal Hocko
2012-03-28 14:36     ` Michal Hocko

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4F73AA5F.5050604@jp.fujitsu.com \
    --to=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=aarcange@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=aneesh.kumar@linux.vnet.ibm.com \
    --cc=cgroups@vger.kernel.org \
    --cc=dhillf@gmail.com \
    --cc=hannes@cmpxchg.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mgorman@suse.de \
    --cc=mhocko@suse.cz \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.