All of lore.kernel.org
 help / color / mirror / Atom feed
From: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>
To: Wu Fengguang <fengguang.wu@intel.com>
Cc: kosaki.motohiro@jp.fujitsu.com, "Li,
	Shaohua" <shaohua.li@intel.com>,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"akpm@linux-foundation.org" <akpm@linux-foundation.org>
Subject: Re: [PATCH]vmscan: handle underflow for get_scan_ratio
Date: Wed, 31 Mar 2010 15:00:52 +0900 (JST)	[thread overview]
Message-ID: <20100331145602.03A7.A69D9226@jp.fujitsu.com> (raw)
In-Reply-To: <20100331055108.GA21963@localhost>

> KOSAKI-san,
> 
> On Wed, Mar 31, 2010 at 01:38:12PM +0800, KOSAKI Motohiro wrote:
> > > On Tue, Mar 30, 2010 at 02:08:53PM +0800, KOSAKI Motohiro wrote:
> > > > Hi
> > > > 
> > > > > Commit 84b18490d1f1bc7ed5095c929f78bc002eb70f26 introduces a regression.
> > > > > With it, our tmpfs test always oom. The test has a lot of rotated anon
> > > > > pages and cause percent[0] zero. Actually the percent[0] is a very small
> > > > > value, but our calculation round it to zero. The commit makes vmscan
> > > > > completely skip anon pages and cause oops.
> > > > > An option is if percent[x] is zero in get_scan_ratio(), forces it
> > > > > to 1. See below patch.
> > > > > But the offending commit still changes behavior. Without the commit, we scan
> > > > > all pages if priority is zero, below patch doesn't fix this. Don't know if
> > > > > It's required to fix this too.
> > > > 
> > > > Can you please post your /proc/meminfo and reproduce program? I'll digg it.
> > > > 
> > > > Very unfortunately, this patch isn't acceptable. In past time, vmscan 
> > > > had similar logic, but 1% swap-out made lots bug reports. 
> > > if 1% is still big, how about below patch?
> > 
> > This patch makes a lot of sense than previous. however I think <1% anon ratio
> > shouldn't happen anyway because file lru doesn't have reclaimable pages.
> > <1% seems no good reclaim rate.
> > 
> > perhaps I'll take your patch for stable tree. but we need to attack the root
> > cause. iow, I guess we need to fix scan ratio equation itself.
> 
> I tend to regard this patch as a general improvement for both
> .33-stable and .34. 
> 
> I do agree with you that it's desirable to do more test&analyze and
> check further for possibly hidden problems.

Yeah, I don't want ignore .33-stable too. if I can't find the root cause
in 2-3 days, I'll revert guilty patch anyway.



WARNING: multiple messages have this Message-ID (diff)
From: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>
To: Wu Fengguang <fengguang.wu@intel.com>
Cc: kosaki.motohiro@jp.fujitsu.com, "Li,
	Shaohua" <shaohua.li@intel.com>,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"akpm@linux-foundation.org" <akpm@linux-foundation.org>
Subject: Re: [PATCH]vmscan: handle underflow for get_scan_ratio
Date: Wed, 31 Mar 2010 15:00:52 +0900 (JST)	[thread overview]
Message-ID: <20100331145602.03A7.A69D9226@jp.fujitsu.com> (raw)
In-Reply-To: <20100331055108.GA21963@localhost>

> KOSAKI-san,
> 
> On Wed, Mar 31, 2010 at 01:38:12PM +0800, KOSAKI Motohiro wrote:
> > > On Tue, Mar 30, 2010 at 02:08:53PM +0800, KOSAKI Motohiro wrote:
> > > > Hi
> > > > 
> > > > > Commit 84b18490d1f1bc7ed5095c929f78bc002eb70f26 introduces a regression.
> > > > > With it, our tmpfs test always oom. The test has a lot of rotated anon
> > > > > pages and cause percent[0] zero. Actually the percent[0] is a very small
> > > > > value, but our calculation round it to zero. The commit makes vmscan
> > > > > completely skip anon pages and cause oops.
> > > > > An option is if percent[x] is zero in get_scan_ratio(), forces it
> > > > > to 1. See below patch.
> > > > > But the offending commit still changes behavior. Without the commit, we scan
> > > > > all pages if priority is zero, below patch doesn't fix this. Don't know if
> > > > > It's required to fix this too.
> > > > 
> > > > Can you please post your /proc/meminfo and reproduce program? I'll digg it.
> > > > 
> > > > Very unfortunately, this patch isn't acceptable. In past time, vmscan 
> > > > had similar logic, but 1% swap-out made lots bug reports. 
> > > if 1% is still big, how about below patch?
> > 
> > This patch makes a lot of sense than previous. however I think <1% anon ratio
> > shouldn't happen anyway because file lru doesn't have reclaimable pages.
> > <1% seems no good reclaim rate.
> > 
> > perhaps I'll take your patch for stable tree. but we need to attack the root
> > cause. iow, I guess we need to fix scan ratio equation itself.
> 
> I tend to regard this patch as a general improvement for both
> .33-stable and .34. 
> 
> I do agree with you that it's desirable to do more test&analyze and
> check further for possibly hidden problems.

Yeah, I don't want ignore .33-stable too. if I can't find the root cause
in 2-3 days, I'll revert guilty patch anyway.


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2010-03-31  6:00 UTC|newest]

Thread overview: 97+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-03-30  5:53 [PATCH]vmscan: handle underflow for get_scan_ratio Shaohua Li
2010-03-30  5:53 ` Shaohua Li
2010-03-30  6:08 ` KOSAKI Motohiro
2010-03-30  6:08   ` KOSAKI Motohiro
2010-03-30  6:32   ` Shaohua Li
2010-03-30  6:40     ` KOSAKI Motohiro
2010-03-30  6:40       ` KOSAKI Motohiro
2010-03-30  6:53       ` Shaohua Li
2010-03-30  6:53         ` Shaohua Li
2010-03-30  7:31         ` KOSAKI Motohiro
2010-03-30  7:31           ` KOSAKI Motohiro
2010-03-30  8:13           ` Shaohua Li
2010-03-30  8:13             ` Shaohua Li
2010-03-31  4:53   ` Shaohua Li
2010-03-31  4:53     ` Shaohua Li
2010-03-31  5:38     ` KOSAKI Motohiro
2010-03-31  5:38       ` KOSAKI Motohiro
2010-03-31  5:51       ` Wu Fengguang
2010-03-31  5:51         ` Wu Fengguang
2010-03-31  6:00         ` KOSAKI Motohiro [this message]
2010-03-31  6:00           ` KOSAKI Motohiro
2010-03-31  6:03           ` Wu Fengguang
2010-03-31  6:03             ` Wu Fengguang
2010-04-01 22:16           ` Andrew Morton
2010-04-01 22:16             ` Andrew Morton
2010-04-02  9:13             ` KOSAKI Motohiro
2010-04-02  9:13               ` KOSAKI Motohiro
2010-04-06  1:22               ` Wu Fengguang
2010-04-06  1:22                 ` Wu Fengguang
2010-04-06  3:36               ` Rik van Riel
2010-04-06  3:36                 ` Rik van Riel
2010-03-31  5:53       ` KOSAKI Motohiro
2010-03-31  5:53         ` KOSAKI Motohiro
2010-04-02  6:50         ` Shaohua Li
2010-04-02  6:50           ` Shaohua Li
2010-04-02  9:14           ` KOSAKI Motohiro
2010-04-02  9:14             ` KOSAKI Motohiro
2010-04-02  9:24             ` Shaohua Li
2010-04-02  9:24               ` Shaohua Li
2010-04-04 14:19               ` KOSAKI Motohiro
2010-04-04 14:19                 ` KOSAKI Motohiro
2010-04-06  1:25                 ` Shaohua Li
2010-04-06  1:25                   ` Shaohua Li
2010-04-06  1:36                   ` KOSAKI Motohiro
2010-04-06  1:36                     ` KOSAKI Motohiro
2010-04-06  1:50                   ` Wu Fengguang
2010-04-06  1:50                     ` Wu Fengguang
2010-04-06  2:06                     ` KOSAKI Motohiro
2010-04-06  2:06                       ` KOSAKI Motohiro
2010-04-06  2:30                       ` Wu Fengguang
2010-04-06  2:30                         ` Wu Fengguang
2010-04-06  2:58                         ` KOSAKI Motohiro
2010-04-06  2:58                           ` KOSAKI Motohiro
2010-04-06  3:31                           ` Wu Fengguang
2010-04-06  3:31                             ` Wu Fengguang
2010-04-06  3:40                             ` Rik van Riel
2010-04-06  3:40                               ` Rik van Riel
2010-04-06  4:49                               ` Wu Fengguang
2010-04-06  4:49                                 ` Wu Fengguang
2010-04-06  5:09                                 ` Shaohua Li
2010-04-06  5:09                                   ` Shaohua Li
2010-04-04  0:48           ` Wu Fengguang
2010-04-04  0:48             ` Wu Fengguang
2010-04-06  1:27             ` Shaohua Li
2010-04-06  1:27               ` Shaohua Li
2010-04-06  5:03           ` Wu Fengguang
2010-04-06  5:03             ` Wu Fengguang
2010-04-06  5:36             ` Shaohua Li
2010-04-06  5:36               ` Shaohua Li
2010-04-09  6:51             ` Shaohua Li
2010-04-09  6:51               ` Shaohua Li
2010-04-09 21:20               ` Andrew Morton
2010-04-09 21:20                 ` Andrew Morton
2010-04-09 21:25                 ` Rik van Riel
2010-04-09 21:25                   ` Rik van Riel
2010-04-13  1:30                   ` KOSAKI Motohiro
2010-04-13  1:30                     ` KOSAKI Motohiro
2010-04-13  2:42                     ` Rik van Riel
2010-04-13  2:42                       ` Rik van Riel
2010-04-13  7:55                       ` KOSAKI Motohiro
2010-04-13  7:55                         ` KOSAKI Motohiro
2010-04-13  8:55                         ` KOSAKI Motohiro
2010-04-13  8:55                           ` KOSAKI Motohiro
2010-04-14  1:27                           ` Shaohua Li
2010-04-14  1:27                             ` Shaohua Li
2010-04-15  3:25                             ` KOSAKI Motohiro
2010-04-15  3:25                               ` KOSAKI Motohiro
2010-04-12  1:57                 ` Shaohua Li
2010-04-12  1:57                   ` Shaohua Li
2010-03-31  5:41     ` Wu Fengguang
2010-03-31  5:41       ` Wu Fengguang
2010-03-30 10:17 ` Minchan Kim
2010-03-30 10:17   ` Minchan Kim
2010-03-30 10:25   ` KOSAKI Motohiro
2010-03-30 10:25     ` KOSAKI Motohiro
2010-03-30 11:56 ` Balbir Singh
2010-03-30 11:56   ` Balbir Singh

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20100331145602.03A7.A69D9226@jp.fujitsu.com \
    --to=kosaki.motohiro@jp.fujitsu.com \
    --cc=akpm@linux-foundation.org \
    --cc=fengguang.wu@intel.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=shaohua.li@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.