From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1750967AbdAQDwJ (ORCPT ); Mon, 16 Jan 2017 22:52:09 -0500 Received: from mx0a-001b2d01.pphosted.com ([148.163.156.1]:58174 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750820AbdAQDvc (ORCPT ); Mon, 16 Jan 2017 22:51:32 -0500 Date: Mon, 16 Jan 2017 16:54:03 -0800 From: "Paul E. McKenney" To: Peter Zijlstra Cc: linux-kernel@vger.kernel.org, mingo@kernel.org, jiangshanlai@gmail.com, dipankar@in.ibm.com, akpm@linux-foundation.org, mathieu.desnoyers@efficios.com, josh@joshtriplett.org, tglx@linutronix.de, rostedt@goodmis.org, dhowells@redhat.com, edumazet@google.com, dvhart@linux.intel.com, fweisbec@gmail.com, oleg@redhat.com, bobby.prani@gmail.com, mhocko@kernel.org Subject: Re: [PATCH tip/core/rcu 11/20] sched,rcu: Make cond_resched() provide RCU quiescent state Reply-To: paulmck@linux.vnet.ibm.com References: <20170114091255.GA20854@linux.vnet.ibm.com> <1484385201-22227-11-git-send-email-paulmck@linux.vnet.ibm.com> <20170116171130.GC6500@twins.programming.kicks-ass.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20170116171130.GC6500@twins.programming.kicks-ass.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-TM-AS-GCONF: 00 X-Content-Scanned: Fidelis XPS MAILER x-cbid: 17011700-0012-0000-0000-0000135E8BCD X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00006446; HX=3.00000240; KW=3.00000007; PH=3.00000004; SC=3.00000199; SDB=6.00808601; UDB=6.00393822; IPR=6.00585961; BA=6.00005062; NDR=6.00000001; ZLA=6.00000005; ZF=6.00000009; ZB=6.00000000; ZP=6.00000000; ZH=6.00000000; ZU=6.00000002; MB=3.00013943; XFM=3.00000011; UTC=2017-01-17 00:54:08 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 17011700-0013-0000-0000-00004A91F9E0 Message-Id: <20170117005403.GW5238@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-01-16_18:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 spamscore=0 suspectscore=0 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1612050000 definitions=main-1701170008 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jan 16, 2017 at 06:11:30PM +0100, Peter Zijlstra wrote: > On Sat, Jan 14, 2017 at 01:13:12AM -0800, Paul E. McKenney wrote: > > There is some confusion as to which of cond_resched() or > > cond_resched_rcu_qs() should be added to long in-kernel loops. > > This commit therefore eliminates the decision by adding RCU > > quiescent states to cond_resched(). > > Which would make: rcu_read_lock(); cond_resched(); rcu_read_unlock(); > invalid under preemptible RCU. Is it already? In theory, yes. In practice, I just tested it with preemption and lockdep enabled, and it didn't complain. If further testing finds complaints, we can either fix those uses (preferred) or revert this patch. > > Warning: This is a prototype. For example, it does not correctly > > handle Tasks RCU. Which is OK for the moment, given that no one > > actually uses Tasks RCU yet. > > > --- a/kernel/sched/core.c > > +++ b/kernel/sched/core.c > > @@ -4907,6 +4907,7 @@ int __sched _cond_resched(void) > > preempt_schedule_common(); > > return 1; > > } > > + rcu_all_qs(); > > return 0; > > } > > Still not a real fan of this, it does make cond_resched() touch a bunch > more cachelines, also, I suppose that if we're going to do this, we > should make __cond_resched_lock() and __cond_resched_softirq() act > similarly. Michal (now CCed) argues that having to distinguish between cond_resched() and cond_resched_rcu_qs() is overly burdensome. Michal? Any thoughts on how we might remove this burden without the additional cache misses? I will take another look as well to see what could make it lower cost. There are probably ways... Would it make sense to have RCU maintain a need-rcu_all_qs() flage in the same cacheline as the __preempt_count? Perhaps throttling the writes to this flag from the RCU grace-period kthreads to once per 100 milliseconds or so? Thanx, Paul