From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 069BCC433E0 for ; Mon, 3 Aug 2020 10:49:54 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id D8BEE2076C for ; Mon, 3 Aug 2020 10:49:53 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="exPCUDNk"; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="WW2P/omh" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726125AbgHCKtt (ORCPT ); Mon, 3 Aug 2020 06:49:49 -0400 Received: from Galois.linutronix.de ([193.142.43.55]:35218 "EHLO galois.linutronix.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725933AbgHCKtj (ORCPT ); Mon, 3 Aug 2020 06:49:39 -0400 From: Thomas Gleixner DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1596451777; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=KCcHpfOYP09p8zY14r/HtTxM2t9JURMOmwbTy+WTzEQ=; b=exPCUDNkIUSsEk+m93wt286ygaaCqgwqdD6dmnXCCpNcDlS+ANw9TPI9tyr9UedVBK91yK wVaETPEKGYC5SuiO+opVJKVO178taH1yV/dGFfN39zIxD3YgRh+SQcfpoUGQuET13hfuL9 VY5+0MzVXbK17SuypLCIscQQk5nOETJePrsN7SpH255LdJGIceMxTGHnqJtDk2gm+VJSfj R36bdYgczuRW1CHB9G2WXL/hRvLovDRtGtlR0lj8zs6/r7n3svbJEBeGQBrgLPkrNopYWT OfqiQ9u0GZrFZ0ETjfYAHYPjudz5ETLh1r+1fP4Cy4T1KLe2SwNqm/5JGwKmHg== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1596451777; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=KCcHpfOYP09p8zY14r/HtTxM2t9JURMOmwbTy+WTzEQ=; b=WW2P/omh52HC9kFYVAeeg3h+L56cnLkgbjiWsO8VD72lowVNM28fz0fbaLs9T49RJDULRX eY0JDYKN9PJq8EAA== To: Kurt Kanzenbach , Vladimir Oltean Cc: Alison Wang , catalin.marinas@arm.com, will@kernel.org, paulmck@kernel.org, mw@semihalf.com, leoyang.li@nxp.com, vladimir.oltean@nxp.com, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, Anna-Maria Gleixner , Peter Zijlstra Subject: Re: [RFC PATCH] arm64: defconfig: Disable fine-grained task level IRQ time accounting In-Reply-To: <873654m9zi.fsf@kurt> References: <20200729033934.22349-1-alison.wang@nxp.com> <877dumbtoi.fsf@kurt> <20200729094943.lsmhsqlnl7rlnl6f@skbuf> <87mu3ho48v.fsf@kurt> <20200730082228.r24zgdeiofvwxijm@skbuf> <873654m9zi.fsf@kurt> Date: Mon, 03 Aug 2020 12:49:36 +0200 Message-ID: <87lfiwm2bj.fsf@nanos.tec.linutronix.de> MIME-Version: 1.0 Content-Type: text/plain Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Kurt, Kurt Kanzenbach writes: > On Thu Jul 30 2020, Vladimir Oltean wrote: > OK. I've reproduced it on a Marvell Armada SoC with v5.6 mainline. See > splats below. Running with irq time accounting enabled, kills the > machine immediately. However, I'm not getting the possible deadlock > warnings in 8250 as you did. So that might be unrelated. > > Unfortunately I have no idea what to debug here. lets look at the facts we have so far. 1) When irq accounting is disabled, RT throttling kicks in as expected. 2) With irq accounting the RT throttler does not kick in and the RCU stall/lockups happen. Not much, but there is clearly interaction between irq time accounting and scheduler accounting. Can you please reduce /proc/sys/kernel/sched_rt_runtime_us in steps of 50000? At least in theory, reduction should bring the throttling back. Thanks, tglx From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 294DBC433E0 for ; Mon, 3 Aug 2020 10:51:02 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id E6F5B20775 for ; Mon, 3 Aug 2020 10:51:01 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="Jn1O3ETs"; dkim=fail reason="signature verification failed" (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="exPCUDNk"; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="WW2P/omh" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org E6F5B20775 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linutronix.de Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:MIME-Version:Message-ID:Date:References:In-Reply-To: Subject:To:From:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=E3G+O99H4h2+kXahfpGP5DhutOlkcg/GgmHYQ5/wn48=; b=Jn1O3ETs+4E830C8XYREoZGdk f4PbSpzuf/VbznGnf0GGH8ys5RgT7LjH8VV+AhKBkUsxZ+igxeamTRmK0RIhkrhJnhYnaPlqxCpfh 2rl92uA7KeeLle6goVCiEK3CfeVoOMgCLlE3CRIOaJ2O5ras0TPAK7d+cDBHc7RyuqgWKLRdwyH9J m+gAfEsDZo3JtrUbh4y9gLG3AWtsKzFc4F92SAD9NRv7K+LkiepolxlGcJlPn/djngcdOuoJ9Y3Dg EnS2P3x8okAlCdIuYsgDZsKpKY1H/BI2ius+wHx+A1VHItP2hS37uUrp3cyEg2C3analoGATq+dUo zxgMsSSfw==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1k2Y2L-0002Ng-BT; Mon, 03 Aug 2020 10:49:45 +0000 Received: from galois.linutronix.de ([2a0a:51c0:0:12e:550::1]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1k2Y2I-0002MY-48 for linux-arm-kernel@lists.infradead.org; Mon, 03 Aug 2020 10:49:42 +0000 From: Thomas Gleixner DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1596451777; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=KCcHpfOYP09p8zY14r/HtTxM2t9JURMOmwbTy+WTzEQ=; b=exPCUDNkIUSsEk+m93wt286ygaaCqgwqdD6dmnXCCpNcDlS+ANw9TPI9tyr9UedVBK91yK wVaETPEKGYC5SuiO+opVJKVO178taH1yV/dGFfN39zIxD3YgRh+SQcfpoUGQuET13hfuL9 VY5+0MzVXbK17SuypLCIscQQk5nOETJePrsN7SpH255LdJGIceMxTGHnqJtDk2gm+VJSfj R36bdYgczuRW1CHB9G2WXL/hRvLovDRtGtlR0lj8zs6/r7n3svbJEBeGQBrgLPkrNopYWT OfqiQ9u0GZrFZ0ETjfYAHYPjudz5ETLh1r+1fP4Cy4T1KLe2SwNqm/5JGwKmHg== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1596451777; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=KCcHpfOYP09p8zY14r/HtTxM2t9JURMOmwbTy+WTzEQ=; b=WW2P/omh52HC9kFYVAeeg3h+L56cnLkgbjiWsO8VD72lowVNM28fz0fbaLs9T49RJDULRX eY0JDYKN9PJq8EAA== To: Kurt Kanzenbach , Vladimir Oltean Subject: Re: [RFC PATCH] arm64: defconfig: Disable fine-grained task level IRQ time accounting In-Reply-To: <873654m9zi.fsf@kurt> References: <20200729033934.22349-1-alison.wang@nxp.com> <877dumbtoi.fsf@kurt> <20200729094943.lsmhsqlnl7rlnl6f@skbuf> <87mu3ho48v.fsf@kurt> <20200730082228.r24zgdeiofvwxijm@skbuf> <873654m9zi.fsf@kurt> Date: Mon, 03 Aug 2020 12:49:36 +0200 Message-ID: <87lfiwm2bj.fsf@nanos.tec.linutronix.de> MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20200803_064942_272554_3E57AB56 X-CRM114-Status: UNSURE ( 8.67 ) X-CRM114-Notice: Please train this message. X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: paulmck@kernel.org, Anna-Maria Gleixner , catalin.marinas@arm.com, Alison Wang , linux-kernel@vger.kernel.org, leoyang.li@nxp.com, Peter Zijlstra , vladimir.oltean@nxp.com, mw@semihalf.com, will@kernel.org, linux-arm-kernel@lists.infradead.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Kurt, Kurt Kanzenbach writes: > On Thu Jul 30 2020, Vladimir Oltean wrote: > OK. I've reproduced it on a Marvell Armada SoC with v5.6 mainline. See > splats below. Running with irq time accounting enabled, kills the > machine immediately. However, I'm not getting the possible deadlock > warnings in 8250 as you did. So that might be unrelated. > > Unfortunately I have no idea what to debug here. lets look at the facts we have so far. 1) When irq accounting is disabled, RT throttling kicks in as expected. 2) With irq accounting the RT throttler does not kick in and the RCU stall/lockups happen. Not much, but there is clearly interaction between irq time accounting and scheduler accounting. Can you please reduce /proc/sys/kernel/sched_rt_runtime_us in steps of 50000? At least in theory, reduction should bring the throttling back. Thanks, tglx _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel