From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756119AbdLVMok (ORCPT ); Fri, 22 Dec 2017 07:44:40 -0500 Received: from mail.kernel.org ([198.145.29.99]:52160 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752485AbdLVMoa (ORCPT ); Fri, 22 Dec 2017 07:44:30 -0500 DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 2E71D21891 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=goodmis.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=rostedt@goodmis.org Date: Fri, 22 Dec 2017 07:44:26 -0500 From: Steven Rostedt To: Petr Mladek Cc: LKML , akpm@linux-foundation.org, linux-mm@kvack.org, Cong Wang , Dave Hansen , Johannes Weiner , Mel Gorman , Michal Hocko , Sergey Senozhatsky , Vlastimil Babka , Peter Zijlstra , Linus Torvalds , Jan Kara , Mathieu Desnoyers , Tetsuo Handa , rostedt@rostedt.homelinux.com Subject: Re: [PATCH v4] printk: Add console owner and waiter logic to load balance console writes Message-ID: <20171222074426.5df24526@gandalf.local.home> In-Reply-To: <20171222102927.eiunret5ykx55bvq@pathway.suse.cz> References: <20171108102723.602216b1@gandalf.local.home> <20171222102927.eiunret5ykx55bvq@pathway.suse.cz> X-Mailer: Claws Mail 3.14.0 (GTK+ 2.24.31; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, 22 Dec 2017 11:31:31 +0100 Petr Mladek wrote: > > Index: linux-trace.git/kernel/printk/printk.c > > =================================================================== > > --- linux-trace.git.orig/kernel/printk/printk.c > > +++ linux-trace.git/kernel/printk/printk.c > > @@ -2141,6 +2196,7 @@ void console_unlock(void) > > static u64 seen_seq; > > unsigned long flags; > > bool wake_klogd = false; > > + bool waiter = false; > > bool do_cond_resched, retry; > > > > if (console_suspended) { > > @@ -2229,14 +2285,64 @@ skip: > > console_seq++; > > raw_spin_unlock(&logbuf_lock); > > > > + /* > > + * While actively printing out messages, if another printk() > > + * were to occur on another CPU, it may wait for this one to > > + * finish. This task can not be preempted if there is a > > + * waiter waiting to take over. > > + */ > > + raw_spin_lock(&console_owner_lock); > > + console_owner = current; > > + raw_spin_unlock(&console_owner_lock); > > One idea. We could do the above only when "do_cond_resched" is false. > I mean that we could allow stealing the console duty only from > atomic context. I'd like to hold off before making a change like that. I thought about it, but by saying "atomic" is more important than "non-atomic" can also lead to problems. Once you don't allow stealing, you just changed printk to be unbounded again. Maybe that's not an issue. But I'd rather add that as an enhancement in case. I could make this a patch series, and we can build cases like this up. > > If I get it correctly, this variable is always true in schedulable > context. > > > + > > + /* The waiter may spin on us after setting console_owner */ > > + spin_acquire(&console_owner_dep_map, 0, 0, _THIS_IP_); > > + > > stop_critical_timings(); /* don't trace print latency */ > > call_console_drivers(ext_text, ext_len, text, len); > > start_critical_timings(); > > + > > + raw_spin_lock(&console_owner_lock); > > + waiter = READ_ONCE(console_waiter); > > + console_owner = NULL; > > + raw_spin_unlock(&console_owner_lock); > > + > > + /* > > + * If there is a waiter waiting for us, then pass the > > + * rest of the work load over to that waiter. > > + */ > > + if (waiter) > > + break; > > + > > + /* There was no waiter, and nothing will spin on us here */ > > + spin_release(&console_owner_dep_map, 1, _THIS_IP_); > > + > > printk_safe_exit_irqrestore(flags); > > > > if (do_cond_resched) > > cond_resched(); > > On the contrary, we could allow steeling the console semaphore > when sleeping here. It would allow to get the messages out > faster. It might help to move the duty to someone who is > actually producing many messages or even the panic() caller. Good point. I'll add a patch that adds that feature too. Thanks! -- Steve