From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754363Ab3LQQIN (ORCPT ); Tue, 17 Dec 2013 11:08:13 -0500 Received: from cantor2.suse.de ([195.135.220.15]:59260 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754201Ab3LQQIL (ORCPT ); Tue, 17 Dec 2013 11:08:11 -0500 Date: Tue, 17 Dec 2013 16:08:08 +0000 From: Mel Gorman To: Johannes Weiner Cc: Andrew Morton , Dave Hansen , Rik van Riel , Linux-MM , LKML Subject: Re: [PATCH 3/7] mm: page_alloc: Use zone node IDs to approximate locality Message-ID: <20131217160808.GF11295@suse.de> References: <1386943807-29601-1-git-send-email-mgorman@suse.de> <1386943807-29601-4-git-send-email-mgorman@suse.de> <20131216202507.GZ21724@cmpxchg.org> <20131217111352.GZ11295@suse.de> <20131217153829.GC21724@cmpxchg.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline In-Reply-To: <20131217153829.GC21724@cmpxchg.org> User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Dec 17, 2013 at 10:38:29AM -0500, Johannes Weiner wrote: > On Tue, Dec 17, 2013 at 11:13:52AM +0000, Mel Gorman wrote: > > On Mon, Dec 16, 2013 at 03:25:07PM -0500, Johannes Weiner wrote: > > > On Fri, Dec 13, 2013 at 02:10:03PM +0000, Mel Gorman wrote: > > > > zone_local is using node_distance which is a more expensive call than > > > > necessary. On x86, it's another function call in the allocator fast path > > > > and increases cache footprint. This patch makes the assumption zones on a > > > > local node will share the same node ID. The necessary information should > > > > already be cache hot. > > > > > > > > Signed-off-by: Mel Gorman > > > > --- > > > > mm/page_alloc.c | 2 +- > > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > > > > index 64020eb..fd9677e 100644 > > > > --- a/mm/page_alloc.c > > > > +++ b/mm/page_alloc.c > > > > @@ -1816,7 +1816,7 @@ static void zlc_clear_zones_full(struct zonelist *zonelist) > > > > > > > > static bool zone_local(struct zone *local_zone, struct zone *zone) > > > > { > > > > - return node_distance(local_zone->node, zone->node) == LOCAL_DISTANCE; > > > > + return zone_to_nid(zone) == numa_node_id(); > > > > > > Why numa_node_id()? We pass in the preferred zone as @local_zone: > > > > > > > Initially because I was thinking "local node" and numa_node_id() is a > > per-cpu variable that should be cheap to access and in some cases > > cache-hot as the top-level gfp API calls numa_node_id(). > > > > Thinking about it more though it still makes sense because the preferred > > zone is not necessarily local. If the allocation request requires ZONE_DMA32 > > and the local node does not have that zone then preferred zone is on a > > remote node. > > Don't we treat everything in relation to the preferred zone? Usually yes, but this time we really care about whether the memory is local or remote. It makes sense to me as it is and struggle to see an advantage of expressing it in terms of the preferred zone. Minimally zone_local would need to be renamed if it could return true for a remote zone and I see no advantage in doing that. I might be stuck in a "la la la, everything is fine" rut. -- Mel Gorman SUSE Labs From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ea0-f169.google.com (mail-ea0-f169.google.com [209.85.215.169]) by kanga.kvack.org (Postfix) with ESMTP id 701566B0035 for ; Tue, 17 Dec 2013 11:08:11 -0500 (EST) Received: by mail-ea0-f169.google.com with SMTP id l9so2555345eaj.14 for ; Tue, 17 Dec 2013 08:08:10 -0800 (PST) Received: from mx2.suse.de (cantor2.suse.de. [195.135.220.15]) by mx.google.com with ESMTPS id i1si19087543eev.236.2013.12.17.08.08.10 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Tue, 17 Dec 2013 08:08:10 -0800 (PST) Date: Tue, 17 Dec 2013 16:08:08 +0000 From: Mel Gorman Subject: Re: [PATCH 3/7] mm: page_alloc: Use zone node IDs to approximate locality Message-ID: <20131217160808.GF11295@suse.de> References: <1386943807-29601-1-git-send-email-mgorman@suse.de> <1386943807-29601-4-git-send-email-mgorman@suse.de> <20131216202507.GZ21724@cmpxchg.org> <20131217111352.GZ11295@suse.de> <20131217153829.GC21724@cmpxchg.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline In-Reply-To: <20131217153829.GC21724@cmpxchg.org> Sender: owner-linux-mm@kvack.org List-ID: To: Johannes Weiner Cc: Andrew Morton , Dave Hansen , Rik van Riel , Linux-MM , LKML On Tue, Dec 17, 2013 at 10:38:29AM -0500, Johannes Weiner wrote: > On Tue, Dec 17, 2013 at 11:13:52AM +0000, Mel Gorman wrote: > > On Mon, Dec 16, 2013 at 03:25:07PM -0500, Johannes Weiner wrote: > > > On Fri, Dec 13, 2013 at 02:10:03PM +0000, Mel Gorman wrote: > > > > zone_local is using node_distance which is a more expensive call than > > > > necessary. On x86, it's another function call in the allocator fast path > > > > and increases cache footprint. This patch makes the assumption zones on a > > > > local node will share the same node ID. The necessary information should > > > > already be cache hot. > > > > > > > > Signed-off-by: Mel Gorman > > > > --- > > > > mm/page_alloc.c | 2 +- > > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > > > > index 64020eb..fd9677e 100644 > > > > --- a/mm/page_alloc.c > > > > +++ b/mm/page_alloc.c > > > > @@ -1816,7 +1816,7 @@ static void zlc_clear_zones_full(struct zonelist *zonelist) > > > > > > > > static bool zone_local(struct zone *local_zone, struct zone *zone) > > > > { > > > > - return node_distance(local_zone->node, zone->node) == LOCAL_DISTANCE; > > > > + return zone_to_nid(zone) == numa_node_id(); > > > > > > Why numa_node_id()? We pass in the preferred zone as @local_zone: > > > > > > > Initially because I was thinking "local node" and numa_node_id() is a > > per-cpu variable that should be cheap to access and in some cases > > cache-hot as the top-level gfp API calls numa_node_id(). > > > > Thinking about it more though it still makes sense because the preferred > > zone is not necessarily local. If the allocation request requires ZONE_DMA32 > > and the local node does not have that zone then preferred zone is on a > > remote node. > > Don't we treat everything in relation to the preferred zone? Usually yes, but this time we really care about whether the memory is local or remote. It makes sense to me as it is and struggle to see an advantage of expressing it in terms of the preferred zone. Minimally zone_local would need to be renamed if it could return true for a remote zone and I see no advantage in doing that. I might be stuck in a "la la la, everything is fine" rut. -- Mel Gorman SUSE Labs -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org