From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S934449AbdDGRPZ (ORCPT ); Fri, 7 Apr 2017 13:15:25 -0400 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:47416 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S933430AbdDGRPR (ORCPT ); Fri, 7 Apr 2017 13:15:17 -0400 Date: Fri, 7 Apr 2017 10:15:13 -0700 From: "Paul E. McKenney" To: Steven Rostedt Cc: linux-kernel@vger.kernel.org, Ingo Molnar , Andrew Morton Subject: Re: [PATCH 6/5 v2] rcu/tracing: Add rcu_disabled to denote when rcu_irq_enter() will not work Reply-To: paulmck@linux.vnet.ibm.com References: <20170407140106.051135969@goodmis.org> <20170407123516.0560f48c@gandalf.local.home> <20170407164220.GY1600@linux.vnet.ibm.com> <20170407130315.4bd61ad7@gandalf.local.home> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20170407130315.4bd61ad7@gandalf.local.home> User-Agent: Mutt/1.5.21 (2010-09-15) X-TM-AS-GCONF: 00 x-cbid: 17040717-0052-0000-0000-000001CCA8A3 X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00006894; HX=3.00000240; KW=3.00000007; PH=3.00000004; SC=3.00000208; SDB=6.00844357; UDB=6.00416200; IPR=6.00622655; BA=6.00005275; NDR=6.00000001; ZLA=6.00000005; ZF=6.00000009; ZB=6.00000000; ZP=6.00000000; ZH=6.00000000; ZU=6.00000002; MB=3.00014953; XFM=3.00000013; UTC=2017-04-07 17:15:14 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 17040717-0053-0000-0000-00004FC4B9BE Message-Id: <20170407171513.GA1600@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-04-07_15:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 spamscore=0 suspectscore=0 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1702020001 definitions=main-1704070140 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Apr 07, 2017 at 01:03:15PM -0400, Steven Rostedt wrote: > From: "Steven Rostedt (VMware)" > > Tracing uses rcu_irq_enter() as a way to make sure that RCU is watching when > it needs to use rcu_read_lock() and friends. This is because tracing can > happen as RCU is about to enter user space, or about to go idle, and RCU > does not watch for RCU read side critical sections as it makes the > transition. > > There is a small location within the RCU infrastructure that rcu_irq_enter() > itself will not work. If tracing were to occur in that section it will break > if it tries to use rcu_irq_enter(). > > Originally, this happens with the stack_tracer, because it will call > save_stack_trace when it encounters stack usage that is greater than any > stack usage it had encountered previously. There was a case where that > happened in the RCU section where rcu_irq_enter() did not work, and lockdep > complained loudly about it. To fix it, stack tracing added a call to be > disabled and RCU would disable stack tracing during the critical section > that rcu_irq_enter() was inoperable. This solution worked, but there are > other cases that use rcu_irq_enter() and it would be a good idea to let RCU > give a way to let others know that rcu_irq_enter() will not work. For > example, in trace events. > > Another helpful aspect of this change is that it also moves the per cpu > variable called in the RCU critical section into a cache locale along with > other RCU per cpu variables used in that same location. > > I'm keeping the stack_trace_disable() code, as that still could be used in > the future by places that really need to disable it. And since it's only a > static inline, it wont take up any kernel text if it is not used. > > Signed-off-by: Steven Rostedt (VMware) Looks good! Acked-by: Paul E. McKenney > --- > include/linux/rcupdate.h | 5 +++++ > kernel/rcu/tree.c | 18 ++++++++++++++++-- > kernel/trace/trace_stack.c | 8 ++++++++ > 3 files changed, 29 insertions(+), 2 deletions(-) > > diff --git a/include/linux/rcupdate.h b/include/linux/rcupdate.h > index de88b33..b096685 100644 > --- a/include/linux/rcupdate.h > +++ b/include/linux/rcupdate.h > @@ -97,6 +97,7 @@ void do_trace_rcu_torture_read(const char *rcutorturename, > unsigned long secs, > unsigned long c_old, > unsigned long c); > +bool rcu_irq_enter_disabled(void); > #else > static inline void rcutorture_get_gp_data(enum rcutorture_type test_type, > int *flags, > @@ -113,6 +114,10 @@ static inline void rcutorture_record_test_transition(void) > static inline void rcutorture_record_progress(unsigned long vernum) > { > } > +bool rcu_irq_enter_disabled(void) > +{ > + return false; > +} > #ifdef CONFIG_RCU_TRACE > void do_trace_rcu_torture_read(const char *rcutorturename, > struct rcu_head *rhp, > diff --git a/kernel/rcu/tree.c b/kernel/rcu/tree.c > index 8b4d273..a6dcf3b 100644 > --- a/kernel/rcu/tree.c > +++ b/kernel/rcu/tree.c > @@ -285,6 +285,20 @@ static DEFINE_PER_CPU(struct rcu_dynticks, rcu_dynticks) = { > }; > > /* > + * There's a few places, currently just in the tracing infrastructure, > + * that uses rcu_irq_enter() to make sure RCU is watching. But there's > + * a small location where that will not even work. In those cases > + * rcu_irq_enter_disabled() needs to be checked to make sure rcu_irq_enter() > + * can be called. > + */ > +static DEFINE_PER_CPU(bool, disable_rcu_irq_enter); > + > +bool rcu_irq_enter_disabled(void) > +{ > + return this_cpu_read(disable_rcu_irq_enter); > +} > + > +/* > * Record entry into an extended quiescent state. This is only to be > * called when not already in an extended quiescent state. > */ > @@ -800,10 +814,10 @@ static void rcu_eqs_enter_common(bool user) > do_nocb_deferred_wakeup(rdp); > } > rcu_prepare_for_idle(); > - stack_tracer_disable(); > + __this_cpu_inc(disable_rcu_irq_enter); > rdtp->dynticks_nesting = 0; /* Breaks tracing momentarily. */ > rcu_dynticks_eqs_enter(); /* After this, tracing works again. */ > - stack_tracer_enable(); > + __this_cpu_dec(disable_rcu_irq_enter); > rcu_dynticks_task_enter(); > > /* > diff --git a/kernel/trace/trace_stack.c b/kernel/trace/trace_stack.c > index f2f02ff..76aa04d 100644 > --- a/kernel/trace/trace_stack.c > +++ b/kernel/trace/trace_stack.c > @@ -96,6 +96,14 @@ check_stack(unsigned long ip, unsigned long *stack) > if (in_nmi()) > return; > > + /* > + * There's a slight chance that we are tracing inside the > + * RCU infrastructure, and rcu_irq_enter() will not work > + * as expected. > + */ > + if (unlikely(rcu_irq_enter_disabled())) > + return; > + > local_irq_save(flags); > arch_spin_lock(&stack_trace_max_lock); > > -- > 2.9.3 >