From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932559Ab0JDTnj (ORCPT ); Mon, 4 Oct 2010 15:43:39 -0400 Received: from smtp-out.google.com ([74.125.121.35]:30720 "EHLO smtp-out.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S932193Ab0JDTni (ORCPT ); Mon, 4 Oct 2010 15:43:38 -0400 DomainKey-Signature: a=rsa-sha1; c=nofws; d=google.com; s=beta; h=date:from:x-x-sender:to:cc:subject:in-reply-to:message-id :references:user-agent:mime-version:content-type; b=OCtFNUK4j4Eg0Cud7DIbkkCPryQTCLLQGtmRODHMCuKZgRmfQKHLpsPxDhzxsTHxWQ 6UQx58sr9OkYgA+gKMbg== Date: Mon, 4 Oct 2010 12:43:27 -0700 (PDT) From: David Rientjes X-X-Sender: rientjes@chino.kir.corp.google.com To: KOSAKI Motohiro cc: Christoph Lameter , Mel Gorman , Rob Mueller , linux-kernel@vger.kernel.org, Bron Gondwana , linux-mm Subject: Re: Default zone_reclaim_mode = 1 on NUMA kernel is bad forfile/email/web servers In-Reply-To: <20101004211112.E8B1.A69D9226@jp.fujitsu.com> Message-ID: References: <20100927110049.6B31.A69D9226@jp.fujitsu.com> <20101004211112.E8B1.A69D9226@jp.fujitsu.com> User-Agent: Alpine 2.00 (DEB 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-System-Of-Record: true Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, 4 Oct 2010, KOSAKI Motohiro wrote: > Recently, Robert Mueller reported zone_reclaim_mode doesn't work > properly on his new NUMA server (Dual Xeon E5520 + Intel S5520UR MB). > He is using Cyrus IMAPd and it's built on a very traditional > single-process model. > > * a master process which reads config files and manages the other > process > * multiple imapd processes, one per connection > * multiple pop3d processes, one per connection > * multiple lmtpd processes, one per connection > * periodical "cleanup" processes. > > Then, there are thousands of independent processes. The problem is, > recent Intel motherboard turn on zone_reclaim_mode by default and > traditional prefork model software don't work fine on it. > Unfortunatelly, Such model is still typical one even though 21th > century. We can't ignore them. > > This patch raise zone_reclaim_mode threshold to 30. 30 don't have > specific meaning. but 20 mean one-hop QPI/Hypertransport and such > relatively cheap 2-4 socket machine are often used for tradiotional > server as above. The intention is, their machine don't use > zone_reclaim_mode. > > Note: ia64 and Power have arch specific RECLAIM_DISTANCE definition. > then this patch doesn't change such high-end NUMA machine behavior. > > Cc: Mel Gorman > Cc: Christoph Lameter > Cc: Bron Gondwana > Cc: Robert Mueller > Signed-off-by: KOSAKI Motohiro Acked-by: David Rientjes We already do this, but I guess it never got pushed to mainline. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail202.messagelabs.com (mail202.messagelabs.com [216.82.254.227]) by kanga.kvack.org (Postfix) with ESMTP id C75D16B004A for ; Mon, 4 Oct 2010 15:43:37 -0400 (EDT) Received: from wpaz9.hot.corp.google.com (wpaz9.hot.corp.google.com [172.24.198.73]) by smtp-out.google.com with ESMTP id o94JhW3R019527 for ; Mon, 4 Oct 2010 12:43:32 -0700 Received: from pwj1 (pwj1.prod.google.com [10.241.219.65]) by wpaz9.hot.corp.google.com with ESMTP id o94Jgw6p012822 for ; Mon, 4 Oct 2010 12:43:31 -0700 Received: by pwj1 with SMTP id 1so1376967pwj.20 for ; Mon, 04 Oct 2010 12:43:30 -0700 (PDT) Date: Mon, 4 Oct 2010 12:43:27 -0700 (PDT) From: David Rientjes Subject: Re: Default zone_reclaim_mode = 1 on NUMA kernel is bad forfile/email/web servers In-Reply-To: <20101004211112.E8B1.A69D9226@jp.fujitsu.com> Message-ID: References: <20100927110049.6B31.A69D9226@jp.fujitsu.com> <20101004211112.E8B1.A69D9226@jp.fujitsu.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-linux-mm@kvack.org To: KOSAKI Motohiro Cc: Christoph Lameter , Mel Gorman , Rob Mueller , linux-kernel@vger.kernel.org, Bron Gondwana , linux-mm List-ID: On Mon, 4 Oct 2010, KOSAKI Motohiro wrote: > Recently, Robert Mueller reported zone_reclaim_mode doesn't work > properly on his new NUMA server (Dual Xeon E5520 + Intel S5520UR MB). > He is using Cyrus IMAPd and it's built on a very traditional > single-process model. > > * a master process which reads config files and manages the other > process > * multiple imapd processes, one per connection > * multiple pop3d processes, one per connection > * multiple lmtpd processes, one per connection > * periodical "cleanup" processes. > > Then, there are thousands of independent processes. The problem is, > recent Intel motherboard turn on zone_reclaim_mode by default and > traditional prefork model software don't work fine on it. > Unfortunatelly, Such model is still typical one even though 21th > century. We can't ignore them. > > This patch raise zone_reclaim_mode threshold to 30. 30 don't have > specific meaning. but 20 mean one-hop QPI/Hypertransport and such > relatively cheap 2-4 socket machine are often used for tradiotional > server as above. The intention is, their machine don't use > zone_reclaim_mode. > > Note: ia64 and Power have arch specific RECLAIM_DISTANCE definition. > then this patch doesn't change such high-end NUMA machine behavior. > > Cc: Mel Gorman > Cc: Christoph Lameter > Cc: Bron Gondwana > Cc: Robert Mueller > Signed-off-by: KOSAKI Motohiro Acked-by: David Rientjes We already do this, but I guess it never got pushed to mainline. -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org