From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753546AbbBXQvu (ORCPT ); Tue, 24 Feb 2015 11:51:50 -0500 Received: from cantor2.suse.de ([195.135.220.15]:44707 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753169AbbBXQvs (ORCPT ); Tue, 24 Feb 2015 11:51:48 -0500 Date: Tue, 24 Feb 2015 17:51:46 +0100 From: Michal Hocko To: Minchan Kim Cc: Andrew Morton , linux-kernel@vger.kernel.org, linux-mm@kvack.org, Rik van Riel , Johannes Weiner , Mel Gorman , Shaohua Li , Yalin.Wang@sonymobile.com Subject: Re: [PATCH RFC 4/4] mm: support MADV_FREE in swapless system Message-ID: <20150224165146.GC14939@dhcp22.suse.cz> References: <1424765897-27377-1-git-send-email-minchan@kernel.org> <1424765897-27377-4-git-send-email-minchan@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1424765897-27377-4-git-send-email-minchan@kernel.org> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue 24-02-15 17:18:17, Minchan Kim wrote: > Historically, we have disabled reclaiming completely with swapoff > or non-swap configurable system. It did make sense but problem > for lazy free pages is that we couldn't get a chance to discard > hinted pages in reclaim path in those systems. > > That's why current MADV_FREE implmentation drop pages instantly > like MADV_DONTNNED in swapless system so that users on those > systems couldn't get the benefit of MADV_FREE. > > This patch makes VM try to reclaim anonymous pages on swapless > system. Basic strategy is to try reclaim anonymous pages > if there are pages in *inactive anon*. Nice idea. > In non-swap config system, VM doesn't do aging/reclaiming > anonymous LRU list so inactive anon LRU list should be always > empty. So, if there are some pages in inactive anon LRU, > it means they are MADV_FREE hinted pages so VM try to reclaim > them and discard or promote them onto active list. > > In swap-config-but-not-yet-swapon, VM doesn't do aging/reclaiming > anonymous LRU list so inactive anon LRU list would be empty but > it might be not always true because some pages could remain > inactive anon list if the admin had swapon before. So, if there > are some pages in inactive anon LRU, it means they are MADV_FREE > hinted pages or non-hinted pages which have stayed before. > VM try to reclaim them and discard or promote them onto active list > so we could have only hinted pages on inactive anon LRU list > after a while. > > In swap-enabled-and-full, VM does aging but not try to reclaim > in current implementation. However, we try to reclaim them by > this patch so reclaim efficiency would be worse than old. > I don't know how many such workloads(ie, doing a job with > full-swap for a long time) we should take care of are. Talking about performance when the swap is full is a bit funny. The system is crawling at the time most probably. > Hope the comment. > > On swapoff system with 3G ram, there are 10 processes with below > > loop = 12; > mmap(256M); again what is the memory pressure which fills up the rest of the memory. > while (loop--) { > memset(256M); > madvise(MADV_FREE or MADV_DONTNEED); > sleep(1); > } > > 1) dontneed: 5.40user 24.75system 0:15.36elapsed > 2) madvfree + this patch: 5.18user 6.90system 0:13.39elapsed > > Signed-off-by: Minchan Kim > --- > mm/madvise.c | 21 ++++++++------------- > mm/vmscan.c | 32 +++++++++++++++++++++----------- > 2 files changed, 29 insertions(+), 24 deletions(-) > [...] > diff --git a/mm/vmscan.c b/mm/vmscan.c > index 671e47edb584..1574cd783ab9 100644 > --- a/mm/vmscan.c > +++ b/mm/vmscan.c > @@ -163,16 +163,23 @@ static bool global_reclaim(struct scan_control *sc) > > static unsigned long zone_reclaimable_pages(struct zone *zone) > { > - int nr; > + unsigned long file, anon; > > - nr = zone_page_state(zone, NR_ACTIVE_FILE) + > - zone_page_state(zone, NR_INACTIVE_FILE); > + file = zone_page_state(zone, NR_ACTIVE_FILE) + > + zone_page_state(zone, NR_INACTIVE_FILE); > > - if (get_nr_swap_pages() > 0) > - nr += zone_page_state(zone, NR_ACTIVE_ANON) + > - zone_page_state(zone, NR_INACTIVE_ANON); > + /* > + * Although there is no swap space, we should consider > + * lazy free pages in inactive anon LRU list. > + */ > + if (total_swap_pages > 0) { > + anon = zone_page_state(zone, NR_ACTIVE_ANON) + > + zone_page_state(zone, NR_INACTIVE_ANON); > + } else { > + anon = zone_page_state(zone, NR_INACTIVE_ANON); > + } Hmm, this doesn't look right to me. The zone would be considered reclaimable even though it is not in fact. Most of the systems are configured with swap and this would break those AFAICS. > - return nr; > + return file + anon; > } > > bool zone_reclaimable(struct zone *zone) > @@ -2002,8 +2009,11 @@ static void get_scan_count(struct lruvec *lruvec, int swappiness, > if (!global_reclaim(sc)) > force_scan = true; > > - /* If we have no swap space, do not bother scanning anon pages. */ > - if (!sc->may_swap || (get_nr_swap_pages() <= 0)) { > + /* > + * If we have no inactive anon page, do not bother scanning > + * anon pages. > + */ > + if (!sc->may_swap || !zone_page_state(zone, NR_INACTIVE_ANON)) { > scan_balance = SCAN_FILE; > goto out; > } but later in the function we are considering active anon pages as well. Does this work at all? > @@ -2344,8 +2354,8 @@ static inline bool should_continue_reclaim(struct zone *zone, > */ > pages_for_compaction = (2UL << sc->order); > inactive_lru_pages = zone_page_state(zone, NR_INACTIVE_FILE); > - if (get_nr_swap_pages() > 0) > - inactive_lru_pages += zone_page_state(zone, NR_INACTIVE_ANON); > + inactive_lru_pages += zone_page_state(zone, NR_INACTIVE_ANON); > + > if (sc->nr_reclaimed < pages_for_compaction && > inactive_lru_pages > pages_for_compaction) > return true; > -- > 1.9.1 > -- Michal Hocko SUSE Labs