From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from wp530.webpack.hosteurope.de (wp530.webpack.hosteurope.de [80.237.130.52]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 81613629 for ; Mon, 23 May 2022 09:28:35 +0000 (UTC) Received: from [2a02:8108:963f:de38:eca4:7d19:f9a2:22c5]; authenticated by wp530.webpack.hosteurope.de running ExIM with esmtpsa (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) id 1nt4MF-0007Ub-GJ; Mon, 23 May 2022 11:28:11 +0200 Message-ID: Date: Mon, 23 May 2022 11:28:08 +0200 Precedence: bulk X-Mailing-List: regressions@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.9.0 Content-Language: en-US To: Stefan Wahren , Marcelo Tosatti , Andrew Morton , Nicolas Saenz Julienne Cc: Borislav Petkov , Minchan Kim , Matthew Wilcox , Mel Gorman , Juri Lelli , Thomas Gleixner , Sebastian Andrzej Siewior , "Paul E. McKenney" , linux-kernel@vger.kernel.org, linux-mm@kvack.org, Linux ARM , Phil Elwell , regressions@lists.linux.dev References: <77d6d498-7dd9-03eb-60f2-d7e682bb1b20@i2se.com> From: Thorsten Leemhuis Subject: Re: vchiq: Performance regression since 5.18-rc1 In-Reply-To: <77d6d498-7dd9-03eb-60f2-d7e682bb1b20@i2se.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-bounce-key: webpack.hosteurope.de;regressions@leemhuis.info;1653298115;efadc79d; X-HE-SMSGID: 1nt4MF-0007Ub-GJ [TLDR: I'm adding this regression report to the list of tracked regressions; all text from me you find below is based on a few templates paragraphs you might have encountered already already in similar form.] Hi, this is your Linux kernel regression tracker. On 22.05.22 01:22, Stefan Wahren wrote: > > while testing the staging/vc04_services/interface/vchiq_arm driver with > my Raspberry Pi 3 B+ (multi_v7_defconfig) i noticed a huge performance > regression since [ff042f4a9b050895a42cae893cc01fa2ca81b95c] mm: > lru_cache_disable: replace work queue synchronization with synchronize_rcu > > Usually i run "vchiq_test -f 1" to see the driver is still working [1]. > > Before commit: > > real    0m1,500s > user    0m0,068s > sys    0m0,846s > > After commit: > > real    7m11,449s > user    0m2,049s > sys    0m0,023s Thanks for the report. To be sure below issue doesn't fall through the cracks unnoticed, I'm adding it to regzbot, my Linux kernel regression tracking bot: #regzbot ^introduced ff042f4a9b050895a42cae893cc01fa2ca81b95 #regzbot title mm: chiq_test runs 7 minutes instead of ~ 1 second. #regzbot ignore-activity This isn't a regression? This issue or a fix for it are already discussed somewhere else? It was fixed already? You want to clarify when the regression started to happen? Or point out I got the title or something else totally wrong? Then just reply -- ideally with also telling regzbot about it, as explained here: https://linux-regtracking.leemhuis.info/tracked-regression/ Reminder for developers: When fixing the issue, add 'Link:' tags pointing to the report (the mail this one replied to), as the kernel's documentation call for; above page explains why this is important for tracked regressions. Ciao, Thorsten (wearing his 'the Linux kernel's regression tracker' hat) P.S.: As the Linux kernel's regression tracker I deal with a lot of reports and sometimes miss something important when writing mails like this. If that's the case here, don't hesitate to tell me in a public reply, it's in everyone's interest to set the public record straight. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 83673C433EF for ; Mon, 23 May 2022 10:41:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:Subject:From:References:Cc: To:MIME-Version:Date:Message-ID:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=49QyKxzghbjzXh+PUtiO8SOlp6mHn9xDTyeEXg+W2Lg=; b=ARboqSveiF5X8L 2fYl05M91SFntcB/nYMGr56+isztdJL7RuqLJVidpkjicC6WeOQtrwhmPbf/bj6Scq+/U+4WPtSph O9+c/1kZxvgob+mJmFW0r1UmVTGH7eStd5BiJYkC8itYEvX1OByX6FFywDdnDaYosJh1hewO+Tx/9 RsVeWJxY7DRpXx6C5gvF4ePPuZsFNobsUXZ3iAep0F0ofkC6IaLr7bGuZTmEyWQhapfheUWhkuDVN N9vNnjd8qORMS7NZJ6fPFbzVI/Pian9yCY58lmVQ7rEvP1a2cIRdTn0Xv82ICBAhCfDFNFtKfn1/W lyk39Bx1Ic+2KRItO8qQ==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1nt5Th-003KM0-EA; Mon, 23 May 2022 10:39:57 +0000 Received: from wp530.webpack.hosteurope.de ([2a01:488:42:1000:50ed:8234::]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1nt4MU-002qHu-Mm for linux-arm-kernel@lists.infradead.org; Mon, 23 May 2022 09:28:28 +0000 Received: from [2a02:8108:963f:de38:eca4:7d19:f9a2:22c5]; authenticated by wp530.webpack.hosteurope.de running ExIM with esmtpsa (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) id 1nt4MF-0007Ub-GJ; Mon, 23 May 2022 11:28:11 +0200 Message-ID: Date: Mon, 23 May 2022 11:28:08 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.9.0 Content-Language: en-US To: Stefan Wahren , Marcelo Tosatti , Andrew Morton , Nicolas Saenz Julienne Cc: Borislav Petkov , Minchan Kim , Matthew Wilcox , Mel Gorman , Juri Lelli , Thomas Gleixner , Sebastian Andrzej Siewior , "Paul E. McKenney" , linux-kernel@vger.kernel.org, linux-mm@kvack.org, Linux ARM , Phil Elwell , regressions@lists.linux.dev References: <77d6d498-7dd9-03eb-60f2-d7e682bb1b20@i2se.com> From: Thorsten Leemhuis Subject: Re: vchiq: Performance regression since 5.18-rc1 In-Reply-To: <77d6d498-7dd9-03eb-60f2-d7e682bb1b20@i2se.com> X-bounce-key: webpack.hosteurope.de; regressions@leemhuis.info; 1653298106; d83b3b70; X-HE-SMSGID: 1nt4MF-0007Ub-GJ X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20220523_022826_909684_B2172525 X-CRM114-Status: GOOD ( 13.99 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org W1RMRFI6IEknbSBhZGRpbmcgdGhpcyByZWdyZXNzaW9uIHJlcG9ydCB0byB0aGUgbGlzdCBvZiB0 cmFja2VkCnJlZ3Jlc3Npb25zOyBhbGwgdGV4dCBmcm9tIG1lIHlvdSBmaW5kIGJlbG93IGlzIGJh c2VkIG9uIGEgZmV3IHRlbXBsYXRlcwpwYXJhZ3JhcGhzIHlvdSBtaWdodCBoYXZlIGVuY291bnRl cmVkIGFscmVhZHkgYWxyZWFkeSBpbiBzaW1pbGFyIGZvcm0uXQoKSGksIHRoaXMgaXMgeW91ciBM aW51eCBrZXJuZWwgcmVncmVzc2lvbiB0cmFja2VyLgoKT24gMjIuMDUuMjIgMDE6MjIsIFN0ZWZh biBXYWhyZW4gd3JvdGU6Cj4gCj4gd2hpbGUgdGVzdGluZyB0aGUgc3RhZ2luZy92YzA0X3NlcnZp Y2VzL2ludGVyZmFjZS92Y2hpcV9hcm0gZHJpdmVyIHdpdGgKPiBteSBSYXNwYmVycnkgUGkgMyBC KyAobXVsdGlfdjdfZGVmY29uZmlnKSBpIG5vdGljZWQgYSBodWdlIHBlcmZvcm1hbmNlCj4gcmVn cmVzc2lvbiBzaW5jZSBbZmYwNDJmNGE5YjA1MDg5NWE0MmNhZTg5M2NjMDFmYTJjYTgxYjk1Y10g bW06Cj4gbHJ1X2NhY2hlX2Rpc2FibGU6IHJlcGxhY2Ugd29yayBxdWV1ZSBzeW5jaHJvbml6YXRp b24gd2l0aCBzeW5jaHJvbml6ZV9yY3UKPiAKPiBVc3VhbGx5IGkgcnVuICJ2Y2hpcV90ZXN0IC1m IDEiIHRvIHNlZSB0aGUgZHJpdmVyIGlzIHN0aWxsIHdvcmtpbmcgWzFdLgo+IAo+IEJlZm9yZSBj b21taXQ6Cj4gCj4gcmVhbMKgwqDCoCAwbTEsNTAwcwo+IHVzZXLCoMKgwqAgMG0wLDA2OHMKPiBz eXPCoMKgwqAgMG0wLDg0NnMKPiAKPiBBZnRlciBjb21taXQ6Cj4gCj4gcmVhbMKgwqDCoCA3bTEx LDQ0OXMKPiB1c2VywqDCoMKgIDBtMiwwNDlzCj4gc3lzwqDCoMKgIDBtMCwwMjNzCgpUaGFua3Mg Zm9yIHRoZSByZXBvcnQuCgpUbyBiZSBzdXJlIGJlbG93IGlzc3VlIGRvZXNuJ3QgZmFsbCB0aHJv dWdoIHRoZSBjcmFja3MgdW5ub3RpY2VkLCBJJ20KYWRkaW5nIGl0IHRvIHJlZ3pib3QsIG15IExp bnV4IGtlcm5lbCByZWdyZXNzaW9uIHRyYWNraW5nIGJvdDoKCiNyZWd6Ym90IF5pbnRyb2R1Y2Vk IGZmMDQyZjRhOWIwNTA4OTVhNDJjYWU4OTNjYzAxZmEyY2E4MWI5NQojcmVnemJvdCB0aXRsZSBt bTogY2hpcV90ZXN0IHJ1bnMgNyBtaW51dGVzIGluc3RlYWQgb2YgfiAxIHNlY29uZC4KI3JlZ3pi b3QgaWdub3JlLWFjdGl2aXR5CgpUaGlzIGlzbid0IGEgcmVncmVzc2lvbj8gVGhpcyBpc3N1ZSBv ciBhIGZpeCBmb3IgaXQgYXJlIGFscmVhZHkKZGlzY3Vzc2VkIHNvbWV3aGVyZSBlbHNlPyBJdCB3 YXMgZml4ZWQgYWxyZWFkeT8gWW91IHdhbnQgdG8gY2xhcmlmeSB3aGVuCnRoZSByZWdyZXNzaW9u IHN0YXJ0ZWQgdG8gaGFwcGVuPyBPciBwb2ludCBvdXQgSSBnb3QgdGhlIHRpdGxlIG9yCnNvbWV0 aGluZyBlbHNlIHRvdGFsbHkgd3Jvbmc/IFRoZW4ganVzdCByZXBseSAtLSBpZGVhbGx5IHdpdGgg YWxzbwp0ZWxsaW5nIHJlZ3pib3QgYWJvdXQgaXQsIGFzIGV4cGxhaW5lZCBoZXJlOgpodHRwczov L2xpbnV4LXJlZ3RyYWNraW5nLmxlZW1odWlzLmluZm8vdHJhY2tlZC1yZWdyZXNzaW9uLwoKUmVt aW5kZXIgZm9yIGRldmVsb3BlcnM6IFdoZW4gZml4aW5nIHRoZSBpc3N1ZSwgYWRkICdMaW5rOicg dGFncwpwb2ludGluZyB0byB0aGUgcmVwb3J0ICh0aGUgbWFpbCB0aGlzIG9uZSByZXBsaWVkIHRv KSwgYXMgdGhlIGtlcm5lbCdzCmRvY3VtZW50YXRpb24gY2FsbCBmb3I7IGFib3ZlIHBhZ2UgZXhw bGFpbnMgd2h5IHRoaXMgaXMgaW1wb3J0YW50IGZvcgp0cmFja2VkIHJlZ3Jlc3Npb25zLgoKQ2lh bywgVGhvcnN0ZW4gKHdlYXJpbmcgaGlzICd0aGUgTGludXgga2VybmVsJ3MgcmVncmVzc2lvbiB0 cmFja2VyJyBoYXQpCgpQLlMuOiBBcyB0aGUgTGludXgga2VybmVsJ3MgcmVncmVzc2lvbiB0cmFj a2VyIEkgZGVhbCB3aXRoIGEgbG90IG9mCnJlcG9ydHMgYW5kIHNvbWV0aW1lcyBtaXNzIHNvbWV0 aGluZyBpbXBvcnRhbnQgd2hlbiB3cml0aW5nIG1haWxzIGxpa2UKdGhpcy4gSWYgdGhhdCdzIHRo ZSBjYXNlIGhlcmUsIGRvbid0IGhlc2l0YXRlIHRvIHRlbGwgbWUgaW4gYSBwdWJsaWMKcmVwbHks IGl0J3MgaW4gZXZlcnlvbmUncyBpbnRlcmVzdCB0byBzZXQgdGhlIHB1YmxpYyByZWNvcmQgc3Ry YWlnaHQuCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwps aW51eC1hcm0ta2VybmVsIG1haWxpbmcgbGlzdApsaW51eC1hcm0ta2VybmVsQGxpc3RzLmluZnJh ZGVhZC5vcmcKaHR0cDovL2xpc3RzLmluZnJhZGVhZC5vcmcvbWFpbG1hbi9saXN0aW5mby9saW51 eC1hcm0ta2VybmVsCg==