From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751733AbdFHH3z (ORCPT ); Thu, 8 Jun 2017 03:29:55 -0400 Received: from mail-pg0-f65.google.com ([74.125.83.65]:36827 "EHLO mail-pg0-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751035AbdFHH3x (ORCPT ); Thu, 8 Jun 2017 03:29:53 -0400 Date: Thu, 8 Jun 2017 17:29:38 +1000 From: Nicholas Piggin To: Peter Zijlstra Cc: torvalds@linux-foundation.org, will.deacon@arm.com, oleg@redhat.com, paulmck@linux.vnet.ibm.com, benh@kernel.crashing.org, mpe@ellerman.id.au, linux-kernel@vger.kernel.org, mingo@kernel.org, stern@rowland.harvard.edu, linuxppc-dev Subject: Re: [RFC][PATCH 5/5] powerpc: Remove SYNC from _switch Message-ID: <20170608172938.62b30475@roar.ozlabs.ibm.com> In-Reply-To: <20170608065400.zhfao5lba6i3s7j6@hirez.programming.kicks-ass.net> References: <20170607161501.819948352@infradead.org> <20170607162013.905320602@infradead.org> <20170608103244.1b4b24c9@roar.ozlabs.ibm.com> <20170608065400.zhfao5lba6i3s7j6@hirez.programming.kicks-ass.net> Organization: IBM X-Mailer: Claws Mail 3.14.1 (GTK+ 2.24.31; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, 8 Jun 2017 08:54:00 +0200 Peter Zijlstra wrote: > On Thu, Jun 08, 2017 at 10:32:44AM +1000, Nicholas Piggin wrote: > > On Wed, 07 Jun 2017 18:15:06 +0200 > > Peter Zijlstra wrote: > > > > > Now that the scheduler's rq->lock is RCsc and thus provides full > > > transitivity between scheduling actions. And since we cannot migrate > > > current, a task needs a switch-out and a switch-in in order to > > > migrate, in which case the RCsc provides all the ordering we need. > > > > Hi Peter, > > > > I'm actually just working on removing this right now too, so > > good timing. > > > > I think we can't "just" remove it, because it is required to order > > MMIO on powerpc as well. > > How is MMIO special? That is, there is only MMIO before we call into > schedule() right? So the rq->lock should be sufficient to order that > too. MMIO uses different barriers. spinlock and smp_ type barriers do not order it. > > > > But what I have done is to comment that some other primitives are > > already providing the hwsync for other, so we don't have to add > > another one in _switch. > > Right, so this patch relies on the smp_mb__before_spinlock -> > smp_mb__after_spinlock conversion that makes the rq->lock RCsc and > should thus provide the required SYNC for migrations. AFAIKS either one will do, so long as there is a hwsync there. The point is just that I have added some commentary in the generic and powerpc parts to make it clear we're relying on that behavior of the primitive. smp_mb* is not guaranteed to order MMIO, it's just that it does on powerpc. > That said, I think you can already use the smp_mb__before_spinlock() as > that is done with IRQs disabled, but its a more difficult argument. The > rq->lock RCsc property should be more obvious. This is what I got. https://patchwork.ozlabs.org/patch/770154/ But I'm not sure if I followed I'm not sure why it's a more difficult argument: any time a process moves it must first execute a hwsync on the current CPU after it has performed all its access there, and then it must execute hwsync on the new CPU before it performs any new access.