All of lore.kernel.org
 help / color / mirror / Atom feed
From: Johannes Weiner <hannes@cmpxchg.org>
To: Minchan Kim <minchan.kim@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Rik van Riel <riel@redhat.com>,
	KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	linux-mm <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>,
	Peter Zijlstra <peterz@infradead.org>,
	Wu Fengguang <fengguang.wu@intel.com>,
	Nick Piggin <npiggin@kernel.dk>, Mel Gorman <mel@csn.ul.ie>
Subject: Re: [PATCH v4 2/7] deactivate invalidated pages
Date: Tue, 7 Dec 2010 16:19:39 +0100	[thread overview]
Message-ID: <20101207151939.GF2356@cmpxchg.org> (raw)
In-Reply-To: <20101207150710.GA26613@barrios-desktop>

On Wed, Dec 08, 2010 at 12:07:10AM +0900, Minchan Kim wrote:
> On Tue, Dec 07, 2010 at 03:49:24PM +0100, Johannes Weiner wrote:
> > On Mon, Dec 06, 2010 at 02:29:10AM +0900, Minchan Kim wrote:
> > > Changelog since v3:
> > >  - Change function comments - suggested by Johannes
> > >  - Change function name - suggested by Johannes
> > >  - add only dirty/writeback pages to deactive pagevec
> > 
> > Why the extra check?
> > 
> > > @@ -359,8 +360,16 @@ unsigned long invalidate_mapping_pages(struct address_space *mapping,
> > >  			if (lock_failed)
> > >  				continue;
> > >  
> > > -			ret += invalidate_inode_page(page);
> > > -
> > > +			ret = invalidate_inode_page(page);
> > > +			/*
> > > +			 * If the page is dirty or under writeback, we can not
> > > +			 * invalidate it now.  But we assume that attempted
> > > +			 * invalidation is a hint that the page is no longer
> > > +			 * of interest and try to speed up its reclaim.
> > > +			 */
> > > +			if (!ret && (PageDirty(page) || PageWriteback(page)))
> > > +				deactivate_page(page);
> > 
> > The writeback completion handler does not take the page lock, so you
> > can still miss pages that finish writeback before this test, no?
> 
> Yes. but I think it's rare and even though it happens, it's not critical.
> > 
> > Can you explain why you felt the need to add these checks?
> 
> invalidate_inode_page can return 0 although the pages is !{dirty|writeback}.
> Look invalidate_complete_page. As easiest example, if the page has buffer and
> try_to_release_page can't release the buffer, it could return 0.

Ok, but somebody still tried to truncate the page, so why shouldn't we
try to reclaim it?  The reason for deactivating at this location is
that truncation is a strong hint for reclaim, not that it failed due
to dirty/writeback pages.

What's the problem with deactivating pages where try_to_release_page()
failed?

I don't think we should add more logic than necessary.  If there is a
good reason for it, it needs to get a code comment at least.

WARNING: multiple messages have this Message-ID (diff)
From: Johannes Weiner <hannes@cmpxchg.org>
To: Minchan Kim <minchan.kim@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Rik van Riel <riel@redhat.com>,
	KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	linux-mm <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>,
	Peter Zijlstra <peterz@infradead.org>,
	Wu Fengguang <fengguang.wu@intel.com>,
	Nick Piggin <npiggin@kernel.dk>, Mel Gorman <mel@csn.ul.ie>
Subject: Re: [PATCH v4 2/7] deactivate invalidated pages
Date: Tue, 7 Dec 2010 16:19:39 +0100	[thread overview]
Message-ID: <20101207151939.GF2356@cmpxchg.org> (raw)
In-Reply-To: <20101207150710.GA26613@barrios-desktop>

On Wed, Dec 08, 2010 at 12:07:10AM +0900, Minchan Kim wrote:
> On Tue, Dec 07, 2010 at 03:49:24PM +0100, Johannes Weiner wrote:
> > On Mon, Dec 06, 2010 at 02:29:10AM +0900, Minchan Kim wrote:
> > > Changelog since v3:
> > >  - Change function comments - suggested by Johannes
> > >  - Change function name - suggested by Johannes
> > >  - add only dirty/writeback pages to deactive pagevec
> > 
> > Why the extra check?
> > 
> > > @@ -359,8 +360,16 @@ unsigned long invalidate_mapping_pages(struct address_space *mapping,
> > >  			if (lock_failed)
> > >  				continue;
> > >  
> > > -			ret += invalidate_inode_page(page);
> > > -
> > > +			ret = invalidate_inode_page(page);
> > > +			/*
> > > +			 * If the page is dirty or under writeback, we can not
> > > +			 * invalidate it now.  But we assume that attempted
> > > +			 * invalidation is a hint that the page is no longer
> > > +			 * of interest and try to speed up its reclaim.
> > > +			 */
> > > +			if (!ret && (PageDirty(page) || PageWriteback(page)))
> > > +				deactivate_page(page);
> > 
> > The writeback completion handler does not take the page lock, so you
> > can still miss pages that finish writeback before this test, no?
> 
> Yes. but I think it's rare and even though it happens, it's not critical.
> > 
> > Can you explain why you felt the need to add these checks?
> 
> invalidate_inode_page can return 0 although the pages is !{dirty|writeback}.
> Look invalidate_complete_page. As easiest example, if the page has buffer and
> try_to_release_page can't release the buffer, it could return 0.

Ok, but somebody still tried to truncate the page, so why shouldn't we
try to reclaim it?  The reason for deactivating at this location is
that truncation is a strong hint for reclaim, not that it failed due
to dirty/writeback pages.

What's the problem with deactivating pages where try_to_release_page()
failed?

I don't think we should add more logic than necessary.  If there is a
good reason for it, it needs to get a code comment at least.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom policy in Canada: sign http://dissolvethecrtc.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2010-12-07 15:20 UTC|newest]

Thread overview: 109+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-12-05 17:29 [PATCH v4 0/7] f/madivse(DONTNEED) support Minchan Kim
2010-12-05 17:29 ` Minchan Kim
2010-12-05 17:29 ` [PATCH v4 1/7] Fix checkpatch's report in swap.c Minchan Kim
2010-12-05 17:29   ` Minchan Kim
2010-12-06  1:47   ` Rik van Riel
2010-12-06  1:47     ` Rik van Riel
2010-12-07 14:37   ` Johannes Weiner
2010-12-07 14:37     ` Johannes Weiner
2010-12-05 17:29 ` [PATCH v4 2/7] deactivate invalidated pages Minchan Kim
2010-12-05 17:29   ` Minchan Kim
2010-12-06 14:53   ` Mel Gorman
2010-12-06 14:53     ` Mel Gorman
2010-12-07 14:49   ` Johannes Weiner
2010-12-07 14:49     ` Johannes Weiner
2010-12-07 15:07     ` Minchan Kim
2010-12-07 15:07       ` Minchan Kim
2010-12-07 15:19       ` Johannes Weiner [this message]
2010-12-07 15:19         ` Johannes Weiner
2010-12-07 15:26         ` Minchan Kim
2010-12-07 15:26           ` Minchan Kim
2010-12-07 15:56           ` Johannes Weiner
2010-12-07 15:56             ` Johannes Weiner
2010-12-07 22:51             ` Minchan Kim
2010-12-07 22:51               ` Minchan Kim
2010-12-08  0:56               ` KAMEZAWA Hiroyuki
2010-12-08  0:56                 ` KAMEZAWA Hiroyuki
2010-12-08  1:43                 ` Minchan Kim
2010-12-08  1:43                   ` Minchan Kim
2010-12-08  1:56                   ` KAMEZAWA Hiroyuki
2010-12-08  1:56                     ` KAMEZAWA Hiroyuki
2010-12-08  2:15                     ` Minchan Kim
2010-12-08  2:15                       ` Minchan Kim
2010-12-08  6:56                       ` Balbir Singh
2010-12-08  6:56                         ` Balbir Singh
2010-12-09  0:19                         ` Minchan Kim
2010-12-09  0:19                           ` Minchan Kim
2010-12-05 17:29 ` [PATCH v4 3/7] move memcg reclaimable page into tail of inactive list Minchan Kim
2010-12-05 17:29   ` Minchan Kim
2010-12-06  0:04   ` KAMEZAWA Hiroyuki
2010-12-06  0:04     ` KAMEZAWA Hiroyuki
2010-12-06  3:04   ` Rik van Riel
2010-12-06  3:04     ` Rik van Riel
2010-12-07  0:17     ` Minchan Kim
2010-12-07  0:17       ` Minchan Kim
2010-12-06  3:34   ` Balbir Singh
2010-12-06  3:34     ` Balbir Singh
2010-12-07  0:20     ` Minchan Kim
2010-12-07  0:20       ` Minchan Kim
2010-12-07 14:52   ` Johannes Weiner
2010-12-07 14:52     ` Johannes Weiner
2010-12-08  8:08   ` KOSAKI Motohiro
2010-12-08  8:08     ` KOSAKI Motohiro
2010-12-05 17:29 ` [PATCH v4 4/7] Reclaim invalidated page ASAP Minchan Kim
2010-12-05 17:29   ` Minchan Kim
2010-12-07 15:05   ` Johannes Weiner
2010-12-07 15:05     ` Johannes Weiner
2010-12-07 15:21     ` Minchan Kim
2010-12-07 15:21       ` Minchan Kim
2010-12-08  8:04   ` KOSAKI Motohiro
2010-12-08  8:04     ` KOSAKI Motohiro
2010-12-08  8:16     ` Minchan Kim
2010-12-08  8:16       ` Minchan Kim
2010-12-08 13:01       ` Ben Gamari
2010-12-08 13:01         ` Ben Gamari
2010-12-08 23:10         ` Minchan Kim
2010-12-08 23:10           ` Minchan Kim
2010-12-13 15:31           ` Minchan Kim
2010-12-13 15:31             ` Minchan Kim
2010-12-13 20:06             ` Ben Gamari
2010-12-13 20:06               ` Ben Gamari
2010-12-14  2:36               ` Minchan Kim
2010-12-14  2:36                 ` Minchan Kim
2011-07-25  3:08                 ` Ben Gamari
2011-07-25  3:08                   ` Ben Gamari
2011-07-25  3:47                   ` Minchan Kim
2011-07-25  3:47                     ` Minchan Kim
2010-12-14  2:07             ` KAMEZAWA Hiroyuki
2010-12-14  2:07               ` KAMEZAWA Hiroyuki
2010-12-14  2:34               ` Minchan Kim
2010-12-14  2:34                 ` Minchan Kim
2010-12-05 17:29 ` [PATCH v4 5/7] add profile information for invalidated page reclaim Minchan Kim
2010-12-05 17:29   ` Minchan Kim
2010-12-06  3:24   ` Rik van Riel
2010-12-06  3:24     ` Rik van Riel
2010-12-08  8:02   ` KOSAKI Motohiro
2010-12-08  8:02     ` KOSAKI Motohiro
2010-12-08  8:13     ` Minchan Kim
2010-12-08  8:13       ` Minchan Kim
2010-12-08  8:36       ` KOSAKI Motohiro
2010-12-08  8:36         ` KOSAKI Motohiro
2010-12-05 17:29 ` [PATCH v4 6/7] Remove zap_details NULL dependency Minchan Kim
2010-12-05 17:29   ` Minchan Kim
2010-12-06  3:25   ` Rik van Riel
2010-12-06  3:25     ` Rik van Riel
2010-12-07  4:26   ` Hugh Dickins
2010-12-07  4:26     ` Hugh Dickins
2010-12-07  5:30     ` Minchan Kim
2010-12-07  5:30       ` Minchan Kim
2010-12-05 17:29 ` [PATCH v4 7/7] Prevent activation of page in madvise_dontneed Minchan Kim
2010-12-05 17:29   ` Minchan Kim
2010-12-07  4:48   ` Hugh Dickins
2010-12-07  4:48     ` Hugh Dickins
2010-12-07  5:44     ` Minchan Kim
2010-12-08  7:26       ` Hugh Dickins
2010-12-08  7:26         ` Hugh Dickins
2010-12-08  7:55         ` Minchan Kim
2010-12-08  7:55           ` Minchan Kim
     [not found] ` <AANLkTim71krrCcmhTTCZTzxeUDkvOdBTOkeYQu6EXt32@mail.gmail.com>
2010-12-07  1:52   ` [PATCH v4 0/7] f/madivse(DONTNEED) support Ben Gamari
2010-12-07  2:16     ` Minchan Kim

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20101207151939.GF2356@cmpxchg.org \
    --to=hannes@cmpxchg.org \
    --cc=akpm@linux-foundation.org \
    --cc=fengguang.wu@intel.com \
    --cc=kosaki.motohiro@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mel@csn.ul.ie \
    --cc=minchan.kim@gmail.com \
    --cc=npiggin@kernel.dk \
    --cc=peterz@infradead.org \
    --cc=riel@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.