From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752559Ab3CBRNn (ORCPT ); Sat, 2 Mar 2013 12:13:43 -0500 Received: from e23smtp02.au.ibm.com ([202.81.31.144]:55590 "EHLO e23smtp02.au.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752190Ab3CBRNk (ORCPT ); Sat, 2 Mar 2013 12:13:40 -0500 Message-ID: <513232B6.9060905@linux.vnet.ibm.com> Date: Sat, 02 Mar 2013 22:41:18 +0530 From: "Srivatsa S. Bhat" User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:15.0) Gecko/20120828 Thunderbird/15.0 MIME-Version: 1.0 To: Lai Jiangshan CC: Michel Lespinasse , Oleg Nesterov , Lai Jiangshan , linux-doc@vger.kernel.org, peterz@infradead.org, fweisbec@gmail.com, linux-kernel@vger.kernel.org, namhyung@kernel.org, mingo@kernel.org, linux-arch@vger.kernel.org, linux@arm.linux.org.uk, xiaoguangrong@linux.vnet.ibm.com, wangyun@linux.vnet.ibm.com, paulmck@linux.vnet.ibm.com, nikunj@linux.vnet.ibm.com, linux-pm@vger.kernel.org, rusty@rustcorp.com.au, rostedt@goodmis.org, rjw@sisk.pl, vincent.guittot@linaro.org, tglx@linutronix.de, linux-arm-kernel@lists.infradead.org, netdev@vger.kernel.org, sbw@mit.edu, tj@kernel.org, akpm@linux-foundation.org, linuxppc-dev@lists.ozlabs.org Subject: Re: [PATCH V2] lglock: add read-preference local-global rwlock References: <512BBAD8.8010006@linux.vnet.ibm.com> <512C7A38.8060906@linux.vnet.ibm.com> <512CC509.1050000@linux.vnet.ibm.com> <512D0D67.9010609@linux.vnet.ibm.com> <512E7879.20109@linux.vnet.ibm.com> <5130E8E2.50206@cn.fujitsu.com> <20130301182854.GA3631@redhat.com> <5131FB4C.7070408@cn.fujitsu.com> In-Reply-To: <5131FB4C.7070408@cn.fujitsu.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Scanned: Fidelis XPS MAILER x-cbid: 13030217-5490-0000-0000-0000030C1868 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 03/02/2013 06:44 PM, Lai Jiangshan wrote: > From 345a7a75c314ff567be48983e0892bc69c4452e7 Mon Sep 17 00:00:00 2001 > From: Lai Jiangshan > Date: Sat, 2 Mar 2013 20:33:14 +0800 > Subject: [PATCH] lglock: add read-preference local-global rwlock > > Current lglock is not read-preference, so it can't be used on some cases > which read-preference rwlock can do. Example, get_cpu_online_atomic(). > [...] > diff --git a/kernel/lglock.c b/kernel/lglock.c > index 6535a66..52e9b2c 100644 > --- a/kernel/lglock.c > +++ b/kernel/lglock.c > @@ -87,3 +87,71 @@ void lg_global_unlock(struct lglock *lg) > preempt_enable(); > } > EXPORT_SYMBOL(lg_global_unlock); > + > +#define FALLBACK_BASE (1UL << 30) > + > +void lg_rwlock_local_read_lock(struct lgrwlock *lgrw) > +{ > + struct lglock *lg = &lgrw->lglock; > + > + preempt_disable(); > + if (likely(!__this_cpu_read(*lgrw->reader_refcnt))) { > + rwlock_acquire_read(&lg->lock_dep_map, 0, 0, _RET_IP_); > + if (unlikely(!arch_spin_trylock(this_cpu_ptr(lg->lock)))) { > + read_lock(&lgrw->fallback_rwlock); > + __this_cpu_write(*lgrw->reader_refcnt, FALLBACK_BASE); > + return; > + } > + } > + > + __this_cpu_inc(*lgrw->reader_refcnt); > +} > +EXPORT_SYMBOL(lg_rwlock_local_read_lock); > + > +void lg_rwlock_local_read_unlock(struct lgrwlock *lgrw) > +{ > + switch (__this_cpu_read(*lgrw->reader_refcnt)) { > + case 1: > + __this_cpu_write(*lgrw->reader_refcnt, 0); > + lg_local_unlock(&lgrw->lglock); > + return; This should be a break, instead of a return, right? Otherwise, there will be a preempt imbalance... > + case FALLBACK_BASE: > + __this_cpu_write(*lgrw->reader_refcnt, 0); > + read_unlock(&lgrw->fallback_rwlock); > + rwlock_release(&lg->lock_dep_map, 1, _RET_IP_); > + break; > + default: > + __this_cpu_dec(*lgrw->reader_refcnt); > + break; > + } > + > + preempt_enable(); > +} Regards, Srivatsa S. Bhat From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from e23smtp02.au.ibm.com (e23smtp02.au.ibm.com [202.81.31.144]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "e23smtp02.au.ibm.com", Issuer "GeoTrust SSL CA" (not verified)) by ozlabs.org (Postfix) with ESMTPS id 1CADC2C02CC for ; Sun, 3 Mar 2013 04:13:38 +1100 (EST) Received: from /spool/local by e23smtp02.au.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Sun, 3 Mar 2013 03:07:12 +1000 Received: from d23relay05.au.ibm.com (d23relay05.au.ibm.com [9.190.235.152]) by d23dlp02.au.ibm.com (Postfix) with ESMTP id 09A5A2BB0054 for ; Sun, 3 Mar 2013 04:13:34 +1100 (EST) Received: from d23av01.au.ibm.com (d23av01.au.ibm.com [9.190.234.96]) by d23relay05.au.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id r22H0rtc50790404 for ; Sun, 3 Mar 2013 04:00:53 +1100 Received: from d23av01.au.ibm.com (loopback [127.0.0.1]) by d23av01.au.ibm.com (8.14.4/8.13.1/NCO v10.0 AVout) with ESMTP id r22HDVCc008885 for ; Sun, 3 Mar 2013 04:13:33 +1100 Message-ID: <513232B6.9060905@linux.vnet.ibm.com> Date: Sat, 02 Mar 2013 22:41:18 +0530 From: "Srivatsa S. Bhat" MIME-Version: 1.0 To: Lai Jiangshan Subject: Re: [PATCH V2] lglock: add read-preference local-global rwlock References: <512BBAD8.8010006@linux.vnet.ibm.com> <512C7A38.8060906@linux.vnet.ibm.com> <512CC509.1050000@linux.vnet.ibm.com> <512D0D67.9010609@linux.vnet.ibm.com> <512E7879.20109@linux.vnet.ibm.com> <5130E8E2.50206@cn.fujitsu.com> <20130301182854.GA3631@redhat.com> <5131FB4C.7070408@cn.fujitsu.com> In-Reply-To: <5131FB4C.7070408@cn.fujitsu.com> Content-Type: text/plain; charset=UTF-8 Cc: Lai Jiangshan , linux-doc@vger.kernel.org, peterz@infradead.org, fweisbec@gmail.com, linux-kernel@vger.kernel.org, Michel Lespinasse , mingo@kernel.org, linux-arch@vger.kernel.org, linux@arm.linux.org.uk, xiaoguangrong@linux.vnet.ibm.com, wangyun@linux.vnet.ibm.com, paulmck@linux.vnet.ibm.com, nikunj@linux.vnet.ibm.com, linux-pm@vger.kernel.org, rusty@rustcorp.com.au, rostedt@goodmis.org, rjw@sisk.pl, namhyung@kernel.org, tglx@linutronix.de, linux-arm-kernel@lists.infradead.org, netdev@vger.kernel.org, Oleg Nesterov , vincent.guittot@linaro.org, sbw@mit.edu, tj@kernel.org, akpm@linux-foundation.org, linuxppc-dev@lists.ozlabs.org List-Id: Linux on PowerPC Developers Mail List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , On 03/02/2013 06:44 PM, Lai Jiangshan wrote: > From 345a7a75c314ff567be48983e0892bc69c4452e7 Mon Sep 17 00:00:00 2001 > From: Lai Jiangshan > Date: Sat, 2 Mar 2013 20:33:14 +0800 > Subject: [PATCH] lglock: add read-preference local-global rwlock > > Current lglock is not read-preference, so it can't be used on some cases > which read-preference rwlock can do. Example, get_cpu_online_atomic(). > [...] > diff --git a/kernel/lglock.c b/kernel/lglock.c > index 6535a66..52e9b2c 100644 > --- a/kernel/lglock.c > +++ b/kernel/lglock.c > @@ -87,3 +87,71 @@ void lg_global_unlock(struct lglock *lg) > preempt_enable(); > } > EXPORT_SYMBOL(lg_global_unlock); > + > +#define FALLBACK_BASE (1UL << 30) > + > +void lg_rwlock_local_read_lock(struct lgrwlock *lgrw) > +{ > + struct lglock *lg = &lgrw->lglock; > + > + preempt_disable(); > + if (likely(!__this_cpu_read(*lgrw->reader_refcnt))) { > + rwlock_acquire_read(&lg->lock_dep_map, 0, 0, _RET_IP_); > + if (unlikely(!arch_spin_trylock(this_cpu_ptr(lg->lock)))) { > + read_lock(&lgrw->fallback_rwlock); > + __this_cpu_write(*lgrw->reader_refcnt, FALLBACK_BASE); > + return; > + } > + } > + > + __this_cpu_inc(*lgrw->reader_refcnt); > +} > +EXPORT_SYMBOL(lg_rwlock_local_read_lock); > + > +void lg_rwlock_local_read_unlock(struct lgrwlock *lgrw) > +{ > + switch (__this_cpu_read(*lgrw->reader_refcnt)) { > + case 1: > + __this_cpu_write(*lgrw->reader_refcnt, 0); > + lg_local_unlock(&lgrw->lglock); > + return; This should be a break, instead of a return, right? Otherwise, there will be a preempt imbalance... > + case FALLBACK_BASE: > + __this_cpu_write(*lgrw->reader_refcnt, 0); > + read_unlock(&lgrw->fallback_rwlock); > + rwlock_release(&lg->lock_dep_map, 1, _RET_IP_); > + break; > + default: > + __this_cpu_dec(*lgrw->reader_refcnt); > + break; > + } > + > + preempt_enable(); > +} Regards, Srivatsa S. Bhat From mboxrd@z Thu Jan 1 00:00:00 1970 From: srivatsa.bhat@linux.vnet.ibm.com (Srivatsa S. Bhat) Date: Sat, 02 Mar 2013 22:41:18 +0530 Subject: [PATCH V2] lglock: add read-preference local-global rwlock In-Reply-To: <5131FB4C.7070408@cn.fujitsu.com> References: <512BBAD8.8010006@linux.vnet.ibm.com> <512C7A38.8060906@linux.vnet.ibm.com> <512CC509.1050000@linux.vnet.ibm.com> <512D0D67.9010609@linux.vnet.ibm.com> <512E7879.20109@linux.vnet.ibm.com> <5130E8E2.50206@cn.fujitsu.com> <20130301182854.GA3631@redhat.com> <5131FB4C.7070408@cn.fujitsu.com> Message-ID: <513232B6.9060905@linux.vnet.ibm.com> To: linux-arm-kernel@lists.infradead.org List-Id: linux-arm-kernel.lists.infradead.org On 03/02/2013 06:44 PM, Lai Jiangshan wrote: > From 345a7a75c314ff567be48983e0892bc69c4452e7 Mon Sep 17 00:00:00 2001 > From: Lai Jiangshan > Date: Sat, 2 Mar 2013 20:33:14 +0800 > Subject: [PATCH] lglock: add read-preference local-global rwlock > > Current lglock is not read-preference, so it can't be used on some cases > which read-preference rwlock can do. Example, get_cpu_online_atomic(). > [...] > diff --git a/kernel/lglock.c b/kernel/lglock.c > index 6535a66..52e9b2c 100644 > --- a/kernel/lglock.c > +++ b/kernel/lglock.c > @@ -87,3 +87,71 @@ void lg_global_unlock(struct lglock *lg) > preempt_enable(); > } > EXPORT_SYMBOL(lg_global_unlock); > + > +#define FALLBACK_BASE (1UL << 30) > + > +void lg_rwlock_local_read_lock(struct lgrwlock *lgrw) > +{ > + struct lglock *lg = &lgrw->lglock; > + > + preempt_disable(); > + if (likely(!__this_cpu_read(*lgrw->reader_refcnt))) { > + rwlock_acquire_read(&lg->lock_dep_map, 0, 0, _RET_IP_); > + if (unlikely(!arch_spin_trylock(this_cpu_ptr(lg->lock)))) { > + read_lock(&lgrw->fallback_rwlock); > + __this_cpu_write(*lgrw->reader_refcnt, FALLBACK_BASE); > + return; > + } > + } > + > + __this_cpu_inc(*lgrw->reader_refcnt); > +} > +EXPORT_SYMBOL(lg_rwlock_local_read_lock); > + > +void lg_rwlock_local_read_unlock(struct lgrwlock *lgrw) > +{ > + switch (__this_cpu_read(*lgrw->reader_refcnt)) { > + case 1: > + __this_cpu_write(*lgrw->reader_refcnt, 0); > + lg_local_unlock(&lgrw->lglock); > + return; This should be a break, instead of a return, right? Otherwise, there will be a preempt imbalance... > + case FALLBACK_BASE: > + __this_cpu_write(*lgrw->reader_refcnt, 0); > + read_unlock(&lgrw->fallback_rwlock); > + rwlock_release(&lg->lock_dep_map, 1, _RET_IP_); > + break; > + default: > + __this_cpu_dec(*lgrw->reader_refcnt); > + break; > + } > + > + preempt_enable(); > +} Regards, Srivatsa S. Bhat