From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752508AbdDMQDn (ORCPT ); Thu, 13 Apr 2017 12:03:43 -0400 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:35942 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751119AbdDMQDk (ORCPT ); Thu, 13 Apr 2017 12:03:40 -0400 Date: Thu, 13 Apr 2017 09:03:33 -0700 From: "Paul E. McKenney" To: Peter Zijlstra Cc: linux-kernel@vger.kernel.org, mingo@kernel.org, jiangshanlai@gmail.com, dipankar@in.ibm.com, akpm@linux-foundation.org, mathieu.desnoyers@efficios.com, josh@joshtriplett.org, tglx@linutronix.de, rostedt@goodmis.org, dhowells@redhat.com, edumazet@google.com, fweisbec@gmail.com, oleg@redhat.com, bobby.prani@gmail.com Subject: Re: [PATCH tip/core/rcu 04/13] rcu: Make RCU_FANOUT_LEAF help text more explicit about skew_tick Reply-To: paulmck@linux.vnet.ibm.com References: <20170412165441.GA17149@linux.vnet.ibm.com> <1492016149-18834-4-git-send-email-paulmck@linux.vnet.ibm.com> <20170413091535.r6iw7s3pc2znvl6b@hirez.programming.kicks-ass.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20170413091535.r6iw7s3pc2znvl6b@hirez.programming.kicks-ass.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-TM-AS-GCONF: 00 x-cbid: 17041316-0040-0000-0000-00000314E6C3 X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00006929; HX=3.00000240; KW=3.00000007; PH=3.00000004; SC=3.00000208; SDB=6.00847051; UDB=6.00417876; IPR=6.00625485; BA=6.00005288; NDR=6.00000001; ZLA=6.00000005; ZF=6.00000009; ZB=6.00000000; ZP=6.00000000; ZH=6.00000000; ZU=6.00000002; MB=3.00015033; XFM=3.00000013; UTC=2017-04-13 16:03:37 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 17041316-0041-0000-0000-00000708F2BF Message-Id: <20170413160332.GZ3956@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-04-13_11:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 spamscore=0 suspectscore=0 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1702020001 definitions=main-1704130137 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Apr 13, 2017 at 11:15:35AM +0200, Peter Zijlstra wrote: > On Wed, Apr 12, 2017 at 09:55:40AM -0700, Paul E. McKenney wrote: > > If you set RCU_FANOUT_LEAF too high, you can get lock contention > > on the leaf rcu_node, and you should boot with the skew_tick kernel > > parameter set in order to avoid this lock contention. This commit > > therefore upgrades the RCU_FANOUT_LEAF help text to explicitly state > > this. > > > > Signed-off-by: Paul E. McKenney > > --- > > init/Kconfig | 10 ++++++++-- > > 1 file changed, 8 insertions(+), 2 deletions(-) > > > > diff --git a/init/Kconfig b/init/Kconfig > > index a92f27da4a27..946e561e67b7 100644 > > --- a/init/Kconfig > > +++ b/init/Kconfig > > @@ -612,11 +612,17 @@ config RCU_FANOUT_LEAF > > initialization. These systems tend to run CPU-bound, and thus > > are not helped by synchronized interrupts, and thus tend to > > skew them, which reduces lock contention enough that large > > - leaf-level fanouts work well. > > + leaf-level fanouts work well. That said, setting leaf-level > > + fanout to a large number will likely cause problematic > > + lock contention on the leaf-level rcu_node structures unless > > + you boot with the skew_tick kernel parameter. > > Why mention a way out of a problem you shouldn't have to begin with? > > Just state its bad and result in lock contention and leave it at that. To avoid people tuning huge machines having to wait for me to give them an answer as to why they are suffering lock contention after cranking up the value of RCU_FANOUT_LEAF. Or am I missing your point? Thanx, Paul