From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752184AbbCQHHi (ORCPT ); Tue, 17 Mar 2015 03:07:38 -0400 Received: from ipmail07.adl2.internode.on.net ([150.101.137.131]:5076 "EHLO ipmail07.adl2.internode.on.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751478AbbCQHHf (ORCPT ); Tue, 17 Mar 2015 03:07:35 -0400 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2BCFwBS0gdV/wYQLHlbgwaBLII+sBoBAQECAQaYdgICAQECgTVNAQEBAQEBfYQQAQU6HCMQCAMOCgklDwUlAyETiC7JBgEBAQEGAgEfGIVyhQ2EcQeDF4EWBZomgRyDLI9TI4QCKjGCQwEBAQ Date: Tue, 17 Mar 2015 18:06:55 +1100 From: Dave Chinner To: Mel Gorman Cc: Linus Torvalds , Ingo Molnar , Andrew Morton , Aneesh Kumar , Linux Kernel Mailing List , Linux-MM , xfs@oss.sgi.com, ppc-dev Subject: Re: [PATCH 4/4] mm: numa: Slow PTE scan rate if migration failures occur Message-ID: <20150317070655.GB10105@dastard> References: <20150308100223.GC15487@gmail.com> <20150309112936.GD26657@destitution> <20150309191943.GF26657@destitution> <20150312131045.GE3406@suse.de> <20150312184925.GH3406@suse.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20150312184925.GH3406@suse.de> User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Mar 12, 2015 at 06:49:26PM +0000, Mel Gorman wrote: > On Thu, Mar 12, 2015 at 09:20:36AM -0700, Linus Torvalds wrote: > > On Thu, Mar 12, 2015 at 6:10 AM, Mel Gorman wrote: > > > > > > I believe you're correct and it matches what was observed. I'm still > > > travelling and wireless is dirt but managed to queue a test using pmd_dirty > > > > Ok, thanks. > > > > I'm not entirely happy with that change, and I suspect the whole > > heuristic should be looked at much more (maybe it should also look at > > whether it's executable, for example), but it's a step in the right > > direction. > > > > I can follow up when I'm back in work properly. As you have already pulled > this in directly, can you also consider pulling in "mm: thp: return the > correct value for change_huge_pmd" please? The other two patches were very > minor can be resent through the normal paths later. TO close the loop here, now I'm back home and can run tests: config 3.19 4.0-rc1 4.0-rc4 defaults 8m08s 9m34s 9m14s -o ag_stride=-1 4m04s 4m38s 4m11s -o bhash=101073 6m04s 17m43s 7m35s -o ag_stride=-1,bhash=101073 4m54s 9m58s 7m50s It's better but there are still significant regressions, especially for the large memory footprint cases. I haven't had a chance to look at any stats or profiles yet, so I don't know yet whether this is still page fault related or some other problem.... Cheers, Dave -- Dave Chinner david@fromorbit.com From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (Postfix) with ESMTP id 80AC07F56 for ; Tue, 17 Mar 2015 02:07:40 -0500 (CDT) Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by relay3.corp.sgi.com (Postfix) with ESMTP id F32CCAC002 for ; Tue, 17 Mar 2015 00:07:36 -0700 (PDT) Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by cuda.sgi.com with ESMTP id 0rCyzoioqPwt3rld for ; Tue, 17 Mar 2015 00:07:34 -0700 (PDT) Date: Tue, 17 Mar 2015 18:06:55 +1100 From: Dave Chinner Subject: Re: [PATCH 4/4] mm: numa: Slow PTE scan rate if migration failures occur Message-ID: <20150317070655.GB10105@dastard> References: <20150308100223.GC15487@gmail.com> <20150309112936.GD26657@destitution> <20150309191943.GF26657@destitution> <20150312131045.GE3406@suse.de> <20150312184925.GH3406@suse.de> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20150312184925.GH3406@suse.de> List-Id: XFS Filesystem from SGI List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: xfs-bounces@oss.sgi.com Sender: xfs-bounces@oss.sgi.com To: Mel Gorman Cc: ppc-dev , Linux Kernel Mailing List , xfs@oss.sgi.com, Linux-MM , Aneesh Kumar , Andrew Morton , Linus Torvalds , Ingo Molnar On Thu, Mar 12, 2015 at 06:49:26PM +0000, Mel Gorman wrote: > On Thu, Mar 12, 2015 at 09:20:36AM -0700, Linus Torvalds wrote: > > On Thu, Mar 12, 2015 at 6:10 AM, Mel Gorman wrote: > > > > > > I believe you're correct and it matches what was observed. I'm still > > > travelling and wireless is dirt but managed to queue a test using pmd_dirty > > > > Ok, thanks. > > > > I'm not entirely happy with that change, and I suspect the whole > > heuristic should be looked at much more (maybe it should also look at > > whether it's executable, for example), but it's a step in the right > > direction. > > > > I can follow up when I'm back in work properly. As you have already pulled > this in directly, can you also consider pulling in "mm: thp: return the > correct value for change_huge_pmd" please? The other two patches were very > minor can be resent through the normal paths later. TO close the loop here, now I'm back home and can run tests: config 3.19 4.0-rc1 4.0-rc4 defaults 8m08s 9m34s 9m14s -o ag_stride=-1 4m04s 4m38s 4m11s -o bhash=101073 6m04s 17m43s 7m35s -o ag_stride=-1,bhash=101073 4m54s 9m58s 7m50s It's better but there are still significant regressions, especially for the large memory footprint cases. I haven't had a chance to look at any stats or profiles yet, so I don't know yet whether this is still page fault related or some other problem.... Cheers, Dave -- Dave Chinner david@fromorbit.com _______________________________________________ xfs mailing list xfs@oss.sgi.com http://oss.sgi.com/mailman/listinfo/xfs From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pa0-f44.google.com (mail-pa0-f44.google.com [209.85.220.44]) by kanga.kvack.org (Postfix) with ESMTP id 4EBB96B0038 for ; Tue, 17 Mar 2015 03:07:37 -0400 (EDT) Received: by padcy3 with SMTP id cy3so1269677pad.3 for ; Tue, 17 Mar 2015 00:07:37 -0700 (PDT) Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net. [150.101.137.131]) by mx.google.com with ESMTP id pr2si27412974pdb.188.2015.03.17.00.07.34 for ; Tue, 17 Mar 2015 00:07:36 -0700 (PDT) Date: Tue, 17 Mar 2015 18:06:55 +1100 From: Dave Chinner Subject: Re: [PATCH 4/4] mm: numa: Slow PTE scan rate if migration failures occur Message-ID: <20150317070655.GB10105@dastard> References: <20150308100223.GC15487@gmail.com> <20150309112936.GD26657@destitution> <20150309191943.GF26657@destitution> <20150312131045.GE3406@suse.de> <20150312184925.GH3406@suse.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20150312184925.GH3406@suse.de> Sender: owner-linux-mm@kvack.org List-ID: To: Mel Gorman Cc: Linus Torvalds , Ingo Molnar , Andrew Morton , Aneesh Kumar , Linux Kernel Mailing List , Linux-MM , xfs@oss.sgi.com, ppc-dev On Thu, Mar 12, 2015 at 06:49:26PM +0000, Mel Gorman wrote: > On Thu, Mar 12, 2015 at 09:20:36AM -0700, Linus Torvalds wrote: > > On Thu, Mar 12, 2015 at 6:10 AM, Mel Gorman wrote: > > > > > > I believe you're correct and it matches what was observed. I'm still > > > travelling and wireless is dirt but managed to queue a test using pmd_dirty > > > > Ok, thanks. > > > > I'm not entirely happy with that change, and I suspect the whole > > heuristic should be looked at much more (maybe it should also look at > > whether it's executable, for example), but it's a step in the right > > direction. > > > > I can follow up when I'm back in work properly. As you have already pulled > this in directly, can you also consider pulling in "mm: thp: return the > correct value for change_huge_pmd" please? The other two patches were very > minor can be resent through the normal paths later. TO close the loop here, now I'm back home and can run tests: config 3.19 4.0-rc1 4.0-rc4 defaults 8m08s 9m34s 9m14s -o ag_stride=-1 4m04s 4m38s 4m11s -o bhash=101073 6m04s 17m43s 7m35s -o ag_stride=-1,bhash=101073 4m54s 9m58s 7m50s It's better but there are still significant regressions, especially for the large memory footprint cases. I haven't had a chance to look at any stats or profiles yet, so I don't know yet whether this is still page fault related or some other problem.... Cheers, Dave -- Dave Chinner david@fromorbit.com -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ipmail07.adl2.internode.on.net (ipmail07.adl2.internode.on.net [150.101.137.131]) by lists.ozlabs.org (Postfix) with ESMTP id 4C26F1A0BAF for ; Tue, 17 Mar 2015 18:07:33 +1100 (AEDT) Date: Tue, 17 Mar 2015 18:06:55 +1100 From: Dave Chinner To: Mel Gorman Subject: Re: [PATCH 4/4] mm: numa: Slow PTE scan rate if migration failures occur Message-ID: <20150317070655.GB10105@dastard> References: <20150308100223.GC15487@gmail.com> <20150309112936.GD26657@destitution> <20150309191943.GF26657@destitution> <20150312131045.GE3406@suse.de> <20150312184925.GH3406@suse.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii In-Reply-To: <20150312184925.GH3406@suse.de> Cc: ppc-dev , Linux Kernel Mailing List , xfs@oss.sgi.com, Linux-MM , Aneesh Kumar , Andrew Morton , Linus Torvalds , Ingo Molnar List-Id: Linux on PowerPC Developers Mail List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , On Thu, Mar 12, 2015 at 06:49:26PM +0000, Mel Gorman wrote: > On Thu, Mar 12, 2015 at 09:20:36AM -0700, Linus Torvalds wrote: > > On Thu, Mar 12, 2015 at 6:10 AM, Mel Gorman wrote: > > > > > > I believe you're correct and it matches what was observed. I'm still > > > travelling and wireless is dirt but managed to queue a test using pmd_dirty > > > > Ok, thanks. > > > > I'm not entirely happy with that change, and I suspect the whole > > heuristic should be looked at much more (maybe it should also look at > > whether it's executable, for example), but it's a step in the right > > direction. > > > > I can follow up when I'm back in work properly. As you have already pulled > this in directly, can you also consider pulling in "mm: thp: return the > correct value for change_huge_pmd" please? The other two patches were very > minor can be resent through the normal paths later. TO close the loop here, now I'm back home and can run tests: config 3.19 4.0-rc1 4.0-rc4 defaults 8m08s 9m34s 9m14s -o ag_stride=-1 4m04s 4m38s 4m11s -o bhash=101073 6m04s 17m43s 7m35s -o ag_stride=-1,bhash=101073 4m54s 9m58s 7m50s It's better but there are still significant regressions, especially for the large memory footprint cases. I haven't had a chance to look at any stats or profiles yet, so I don't know yet whether this is still page fault related or some other problem.... Cheers, Dave -- Dave Chinner david@fromorbit.com