From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from fieldses.org ([173.255.197.46]:49436 "EHLO fieldses.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726953AbeHJC4m (ORCPT ); Thu, 9 Aug 2018 22:56:42 -0400 Date: Thu, 9 Aug 2018 20:29:22 -0400 From: "J. Bruce Fields" To: NeilBrown Cc: Jeff Layton , Alexander Viro , Martin Wilck , linux-fsdevel@vger.kernel.org, Frank Filz , linux-kernel@vger.kernel.org Subject: Re: [PATCH 0/5 - V2] locks: avoid thundering-herd wake-ups Message-ID: <20180810002922.GA3915@fieldses.org> References: <153378012255.1220.6754153662007899557.stgit@noble> <20180809173245.GM23873@fieldses.org> <87lg9frxyc.fsf@notabene.neil.brown.name> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87lg9frxyc.fsf@notabene.neil.brown.name> Sender: linux-fsdevel-owner@vger.kernel.org List-ID: On Fri, Aug 10, 2018 at 08:12:43AM +1000, NeilBrown wrote: > On Thu, Aug 09 2018, J. Bruce Fields wrote: > > > I think there's also a problem with multiple tasks sharing the same > > lock owner. > > > > So, all locks are exclusive locks for the same range. We have four > > tasks. Tasks 1 and 4 share the same owner, the others' owners are > > distinct. > > > > - Task 1 gets a lock. > > - Task 2 gets a conflicting lock. > > - Task 3 gets another conflicting lock. So now we the tree is > > 3->2->1. > > - Task 1's lock is released. > > - Before task 2 is scheduled, task 4 acquires a new lock. > > - Task 2 waits on task 4's lock, we now have > > 3->2->4. > > > > Task 3 shouldn't be waiting--the lock it's requesting has the same owner > > as the lock task 4 holds--but we fail to wake up task 3. > > So task 1 and task 4 are threads in the one process - OK. > Tasks 2 and 3 are threads in two other processes. > > So 2 and 3 conflict with either 1 or 4 equally - why should task 3 be > woken? > > I suspect you got the numbers bit mixed up, Whoops. > but in any case, the "conflict()" function that is passed around takes > ownership into account when assessing if one lock conflicts with > another. Right, I know, but, let me try again: All locks are exclusive locks for the same range. Only tasks 3 and 4 share the the same owner. - Task 1 gets a lock. - Task 2 requests a conflicting lock, so we have 2->1. - Task 3 requests a conflicting lock, so we have 3->2->1. - Task 1 unlocks. We wake up task 2, but it isn't scheduled yet. - Task 4 gets a new lock. - Task 2 runs, discovers the conflict, and waits. Now we have: 3->2->4. There is no conflict between the lock 3 requested and the lock 4 holds, but 3 is not woken up. This is another version of the first problem: there's information we need (the owners of the waiting locks in the tree) that we can't determine just from looking at the root of the tree. I'm not sure what to do about that. --b.