From: Johannes Weiner <jweiner@redhat.com> To: Andrew Morton <akpm@linux-foundation.org> Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>, Daisuke Nishimura <nishimura@mxp.nes.nec.co.jp>, Balbir Singh <bsingharora@gmail.com>, Ying Han <yinghan@google.com>, Michal Hocko <mhocko@suse.cz>, Greg Thelen <gthelen@google.com>, Michel Lespinasse <walken@google.com>, Rik van Riel <riel@redhat.com>, Minchan Kim <minchan.kim@gmail.com>, Christoph Hellwig <hch@infradead.org>, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [patch 08/11] mm: vmscan: convert global reclaim to per-memcg LRU lists Date: Mon, 12 Sep 2011 12:57:25 +0200 [thread overview] Message-ID: <1315825048-3437-9-git-send-email-jweiner@redhat.com> (raw) In-Reply-To: <1315825048-3437-1-git-send-email-jweiner@redhat.com> The global per-zone LRU lists are about to go away on memcg-enabled kernels, global reclaim must be able to find its pages on the per-memcg LRU lists. Since the LRU pages of a zone are distributed over all existing memory cgroups, a scan target for a zone is complete when all memory cgroups are scanned for their proportional share of a zone's memory. The forced scanning of small scan targets from kswapd is limited to zones marked unreclaimable, otherwise kswapd can quickly overreclaim by force-scanning the LRU lists of multiple memory cgroups. Signed-off-by: Johannes Weiner <jweiner@redhat.com> --- mm/vmscan.c | 39 ++++++++++++++++++++++----------------- 1 files changed, 22 insertions(+), 17 deletions(-) diff --git a/mm/vmscan.c b/mm/vmscan.c index bb4d8b8..053609e 100644 --- a/mm/vmscan.c +++ b/mm/vmscan.c @@ -1887,7 +1887,7 @@ static void get_scan_count(struct mem_cgroup_zone *mz, struct scan_control *sc, * latencies, so it's better to scan a minimum amount there as * well. */ - if (current_is_kswapd()) + if (current_is_kswapd() && mz->zone->all_unreclaimable) force_scan = true; if (!global_reclaim(sc)) force_scan = true; @@ -2111,16 +2111,6 @@ static void shrink_zone(int priority, struct zone *zone, }; struct mem_cgroup *mem; - if (global_reclaim(sc)) { - struct mem_cgroup_zone mz = { - .mem_cgroup = NULL, - .zone = zone, - }; - - shrink_mem_cgroup_zone(priority, &mz, sc); - return; - } - mem = mem_cgroup_iter(root, NULL, &iter); do { struct mem_cgroup_zone mz = { @@ -2134,6 +2124,10 @@ static void shrink_zone(int priority, struct zone *zone, * scanned it with decreasing priority levels until * nr_to_reclaim had been reclaimed. This priority * cycle is thus over after a single memcg. + * + * Direct reclaim and kswapd, on the other hand, have + * to scan all memory cgroups to fulfill the overall + * scan target for the zone. */ if (!global_reclaim(sc)) { mem_cgroup_iter_break(root, mem); @@ -2451,13 +2445,24 @@ unsigned long try_to_free_mem_cgroup_pages(struct mem_cgroup *mem_cont, static void age_active_anon(struct zone *zone, struct scan_control *sc, int priority) { - struct mem_cgroup_zone mz = { - .mem_cgroup = NULL, - .zone = zone, - }; + struct mem_cgroup *mem; + + if (!total_swap_pages) + return; + + mem = mem_cgroup_iter(NULL, NULL, NULL); + do { + struct mem_cgroup_zone mz = { + .mem_cgroup = mem, + .zone = zone, + }; - if (inactive_anon_is_low(&mz)) - shrink_active_list(SWAP_CLUSTER_MAX, &mz, sc, priority, 0); + if (inactive_anon_is_low(&mz)) + shrink_active_list(SWAP_CLUSTER_MAX, &mz, + sc, priority, 0); + + mem = mem_cgroup_iter(NULL, mem, NULL); + } while (mem); } /* -- 1.7.6
WARNING: multiple messages have this Message-ID (diff)
From: Johannes Weiner <jweiner@redhat.com> To: Andrew Morton <akpm@linux-foundation.org> Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>, Daisuke Nishimura <nishimura@mxp.nes.nec.co.jp>, Balbir Singh <bsingharora@gmail.com>, Ying Han <yinghan@google.com>, Michal Hocko <mhocko@suse.cz>, Greg Thelen <gthelen@google.com>, Michel Lespinasse <walken@google.com>, Rik van Riel <riel@redhat.com>, Minchan Kim <minchan.kim@gmail.com>, Christoph Hellwig <hch@infradead.org>, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [patch 08/11] mm: vmscan: convert global reclaim to per-memcg LRU lists Date: Mon, 12 Sep 2011 12:57:25 +0200 [thread overview] Message-ID: <1315825048-3437-9-git-send-email-jweiner@redhat.com> (raw) In-Reply-To: <1315825048-3437-1-git-send-email-jweiner@redhat.com> The global per-zone LRU lists are about to go away on memcg-enabled kernels, global reclaim must be able to find its pages on the per-memcg LRU lists. Since the LRU pages of a zone are distributed over all existing memory cgroups, a scan target for a zone is complete when all memory cgroups are scanned for their proportional share of a zone's memory. The forced scanning of small scan targets from kswapd is limited to zones marked unreclaimable, otherwise kswapd can quickly overreclaim by force-scanning the LRU lists of multiple memory cgroups. Signed-off-by: Johannes Weiner <jweiner@redhat.com> --- mm/vmscan.c | 39 ++++++++++++++++++++++----------------- 1 files changed, 22 insertions(+), 17 deletions(-) diff --git a/mm/vmscan.c b/mm/vmscan.c index bb4d8b8..053609e 100644 --- a/mm/vmscan.c +++ b/mm/vmscan.c @@ -1887,7 +1887,7 @@ static void get_scan_count(struct mem_cgroup_zone *mz, struct scan_control *sc, * latencies, so it's better to scan a minimum amount there as * well. */ - if (current_is_kswapd()) + if (current_is_kswapd() && mz->zone->all_unreclaimable) force_scan = true; if (!global_reclaim(sc)) force_scan = true; @@ -2111,16 +2111,6 @@ static void shrink_zone(int priority, struct zone *zone, }; struct mem_cgroup *mem; - if (global_reclaim(sc)) { - struct mem_cgroup_zone mz = { - .mem_cgroup = NULL, - .zone = zone, - }; - - shrink_mem_cgroup_zone(priority, &mz, sc); - return; - } - mem = mem_cgroup_iter(root, NULL, &iter); do { struct mem_cgroup_zone mz = { @@ -2134,6 +2124,10 @@ static void shrink_zone(int priority, struct zone *zone, * scanned it with decreasing priority levels until * nr_to_reclaim had been reclaimed. This priority * cycle is thus over after a single memcg. + * + * Direct reclaim and kswapd, on the other hand, have + * to scan all memory cgroups to fulfill the overall + * scan target for the zone. */ if (!global_reclaim(sc)) { mem_cgroup_iter_break(root, mem); @@ -2451,13 +2445,24 @@ unsigned long try_to_free_mem_cgroup_pages(struct mem_cgroup *mem_cont, static void age_active_anon(struct zone *zone, struct scan_control *sc, int priority) { - struct mem_cgroup_zone mz = { - .mem_cgroup = NULL, - .zone = zone, - }; + struct mem_cgroup *mem; + + if (!total_swap_pages) + return; + + mem = mem_cgroup_iter(NULL, NULL, NULL); + do { + struct mem_cgroup_zone mz = { + .mem_cgroup = mem, + .zone = zone, + }; - if (inactive_anon_is_low(&mz)) - shrink_active_list(SWAP_CLUSTER_MAX, &mz, sc, priority, 0); + if (inactive_anon_is_low(&mz)) + shrink_active_list(SWAP_CLUSTER_MAX, &mz, + sc, priority, 0); + + mem = mem_cgroup_iter(NULL, mem, NULL); + } while (mem); } /* -- 1.7.6 -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/ Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2011-09-12 10:58 UTC|newest] Thread overview: 130+ messages / expand[flat|nested] mbox.gz Atom feed top 2011-09-12 10:57 [patch 0/11] mm: memcg naturalization -rc3 Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-12 10:57 ` [patch 01/11] mm: memcg: consolidate hierarchy iteration primitives Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-12 22:37 ` Kirill A. Shutemov 2011-09-12 22:37 ` Kirill A. Shutemov 2011-09-13 5:40 ` Johannes Weiner 2011-09-13 5:40 ` Johannes Weiner 2011-09-19 13:06 ` Michal Hocko 2011-09-19 13:06 ` Michal Hocko 2011-09-13 10:06 ` KAMEZAWA Hiroyuki 2011-09-13 10:06 ` KAMEZAWA Hiroyuki 2011-09-19 12:53 ` Michal Hocko 2011-09-19 12:53 ` Michal Hocko 2011-09-20 8:45 ` Johannes Weiner 2011-09-20 8:45 ` Johannes Weiner 2011-09-20 8:53 ` Michal Hocko 2011-09-20 8:53 ` Michal Hocko 2011-09-12 10:57 ` [patch 02/11] mm: vmscan: distinguish global reclaim from global LRU scanning Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-12 23:02 ` Kirill A. Shutemov 2011-09-12 23:02 ` Kirill A. Shutemov 2011-09-13 5:48 ` Johannes Weiner 2011-09-13 5:48 ` Johannes Weiner 2011-09-13 10:07 ` KAMEZAWA Hiroyuki 2011-09-13 10:07 ` KAMEZAWA Hiroyuki 2011-09-19 13:23 ` Michal Hocko 2011-09-19 13:23 ` Michal Hocko 2011-09-19 13:46 ` Michal Hocko 2011-09-19 13:46 ` Michal Hocko 2011-09-20 8:52 ` Johannes Weiner 2011-09-20 8:52 ` Johannes Weiner 2011-09-12 10:57 ` [patch 03/11] mm: vmscan: distinguish between memcg triggering reclaim and memcg being scanned Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-13 10:23 ` KAMEZAWA Hiroyuki 2011-09-13 10:23 ` KAMEZAWA Hiroyuki 2011-09-19 14:29 ` Michal Hocko 2011-09-19 14:29 ` Michal Hocko 2011-09-20 8:58 ` Johannes Weiner 2011-09-20 8:58 ` Johannes Weiner 2011-09-20 9:17 ` Michal Hocko 2011-09-20 9:17 ` Michal Hocko 2011-09-29 7:55 ` Johannes Weiner 2011-09-29 7:55 ` Johannes Weiner 2011-09-12 10:57 ` [patch 04/11] mm: memcg: per-priority per-zone hierarchy scan generations Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-13 10:27 ` KAMEZAWA Hiroyuki 2011-09-13 10:27 ` KAMEZAWA Hiroyuki 2011-09-13 11:03 ` Johannes Weiner 2011-09-13 11:03 ` Johannes Weiner 2011-09-14 0:55 ` KAMEZAWA Hiroyuki 2011-09-14 0:55 ` KAMEZAWA Hiroyuki 2011-09-14 5:56 ` Johannes Weiner 2011-09-14 5:56 ` Johannes Weiner 2011-09-14 7:40 ` KAMEZAWA Hiroyuki 2011-09-14 7:40 ` KAMEZAWA Hiroyuki 2011-09-20 8:15 ` Michal Hocko 2011-09-20 8:15 ` Michal Hocko 2011-09-20 8:45 ` Michal Hocko 2011-09-20 8:45 ` Michal Hocko 2011-09-20 9:10 ` Johannes Weiner 2011-09-20 9:10 ` Johannes Weiner 2011-09-20 12:37 ` Michal Hocko 2011-09-20 12:37 ` Michal Hocko 2011-09-12 10:57 ` [patch 05/11] mm: move memcg hierarchy reclaim to generic reclaim code Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-13 10:31 ` KAMEZAWA Hiroyuki 2011-09-13 10:31 ` KAMEZAWA Hiroyuki 2011-09-20 13:09 ` Michal Hocko 2011-09-20 13:09 ` Michal Hocko 2011-09-20 13:29 ` Johannes Weiner 2011-09-20 13:29 ` Johannes Weiner 2011-09-20 14:08 ` Michal Hocko 2011-09-20 14:08 ` Michal Hocko 2011-09-12 10:57 ` [patch 06/11] mm: memcg: remove optimization of keeping the root_mem_cgroup LRU lists empty Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-13 10:34 ` KAMEZAWA Hiroyuki 2011-09-13 10:34 ` KAMEZAWA Hiroyuki 2011-09-20 15:02 ` Michal Hocko 2011-09-20 15:02 ` Michal Hocko 2011-09-29 9:20 ` Johannes Weiner 2011-09-29 9:20 ` Johannes Weiner 2011-09-29 9:49 ` Michal Hocko 2011-09-29 9:49 ` Michal Hocko 2011-09-12 10:57 ` [patch 07/11] mm: vmscan: convert unevictable page rescue scanner to per-memcg LRU lists Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-13 10:37 ` KAMEZAWA Hiroyuki 2011-09-13 10:37 ` KAMEZAWA Hiroyuki 2011-09-21 12:33 ` Michal Hocko 2011-09-21 12:33 ` Michal Hocko 2011-09-21 13:47 ` Johannes Weiner 2011-09-21 13:47 ` Johannes Weiner 2011-09-21 14:08 ` Michal Hocko 2011-09-21 14:08 ` Michal Hocko 2011-09-12 10:57 ` Johannes Weiner [this message] 2011-09-12 10:57 ` [patch 08/11] mm: vmscan: convert global reclaim " Johannes Weiner 2011-09-13 10:41 ` KAMEZAWA Hiroyuki 2011-09-13 10:41 ` KAMEZAWA Hiroyuki 2011-09-21 13:10 ` Michal Hocko 2011-09-21 13:10 ` Michal Hocko 2011-09-21 13:51 ` Johannes Weiner 2011-09-21 13:51 ` Johannes Weiner 2011-09-21 13:57 ` Michal Hocko 2011-09-21 13:57 ` Michal Hocko 2011-09-12 10:57 ` [patch 09/11] mm: collect LRU list heads into struct lruvec Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-13 10:43 ` KAMEZAWA Hiroyuki 2011-09-13 10:43 ` KAMEZAWA Hiroyuki 2011-09-21 13:43 ` Michal Hocko 2011-09-21 13:43 ` Michal Hocko 2011-09-21 15:15 ` Michal Hocko 2011-09-21 15:15 ` Michal Hocko 2011-09-12 10:57 ` [patch 10/11] mm: make per-memcg LRU lists exclusive Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-13 10:47 ` KAMEZAWA Hiroyuki 2011-09-13 10:47 ` KAMEZAWA Hiroyuki 2011-09-21 15:24 ` Michal Hocko 2011-09-21 15:24 ` Michal Hocko 2011-09-21 15:47 ` Johannes Weiner 2011-09-21 15:47 ` Johannes Weiner 2011-09-21 16:05 ` Michal Hocko 2011-09-21 16:05 ` Michal Hocko 2011-09-12 10:57 ` [patch 11/11] mm: memcg: remove unused node/section info from pc->flags Johannes Weiner 2011-09-12 10:57 ` Johannes Weiner 2011-09-13 10:50 ` KAMEZAWA Hiroyuki 2011-09-13 10:50 ` KAMEZAWA Hiroyuki 2011-09-21 15:32 ` Michal Hocko 2011-09-21 15:32 ` Michal Hocko 2011-09-13 20:35 ` [patch 0/11] mm: memcg naturalization -rc3 Kirill A. Shutemov 2011-09-13 20:35 ` Kirill A. Shutemov
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=1315825048-3437-9-git-send-email-jweiner@redhat.com \ --to=jweiner@redhat.com \ --cc=akpm@linux-foundation.org \ --cc=bsingharora@gmail.com \ --cc=gthelen@google.com \ --cc=hch@infradead.org \ --cc=kamezawa.hiroyu@jp.fujitsu.com \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-mm@kvack.org \ --cc=mhocko@suse.cz \ --cc=minchan.kim@gmail.com \ --cc=nishimura@mxp.nes.nec.co.jp \ --cc=riel@redhat.com \ --cc=walken@google.com \ --cc=yinghan@google.com \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.