From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 634B2C48286 for ; Thu, 1 Feb 2024 18:45:58 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:Message-ID:Date:References :In-Reply-To:Subject:Cc:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=VYv8t+rsRlkvaRXhKaoSATA+CDwc89iVhQckf3Y+yOs=; b=uE39rEVAvDHUEL n4nkH3cqF1nn+kPzNzgXmIg4mTDG4RMCVBFNVk8KMuXNUa+tYY87ukqZJ0HQFSlWAIdoILuaFQ8Z3 e2pjt+ic2j6LGGXUaazfJpQjGt7GpMB/7o9NsPSgyvdJt9imr2jcvqhkpB/+F26clavw5v9hAFJPK c4G1fUqzsQtRqsQzrtUwZFTV3qnciLi5yMfO5S0Hae3fIRtV9/UW5FHlgtc0hI98+21TxsFDLLQHE iSwf5/khcEOJf+27uSfP/wOcYZLP6AJCdlpQeNK8qvMgv0m60FhYRidGyV4Sz41Ta/H5kA5eAcghR SaHR3K8pdokh2oynLEkA==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.97.1 #2 (Red Hat Linux)) id 1rVc4Q-00000009482-324w; Thu, 01 Feb 2024 18:45:54 +0000 Received: from dfw.source.kernel.org ([139.178.84.217]) by bombadil.infradead.org with esmtps (Exim 4.97.1 #2 (Red Hat Linux)) id 1rVc4N-00000009474-10A6; Thu, 01 Feb 2024 18:45:52 +0000 Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id A7DE86209C; Thu, 1 Feb 2024 18:45:50 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id CFC48C433F1; Thu, 1 Feb 2024 18:45:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1706813150; bh=2o/ahhkt5Da88tuJdKbbZRhXmWTFExDo+7XxsQ7oVYQ=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=S0ZdmOBJIASmEToKqAwweWHUharcJbrOm7XEwIlMbJbqU/Z5d6O7MgLhMLxToW7fa 3qMOum1NuNKAXFxEv3wcvbsTYvBIxQukjg2XqhPlmV01Hxd6Hx806YBnI1QgWp1v3L d+qmvY7J8fOteYOtKlpVON3n7u0fakqBBkRM/BQZ5RIgvvu+FHoxFyBBlUE/h7D3XQ u0yRqoptcebxxI2OM7Dadf0GhXbQ8jpre0VXXrk0IuiKeTbggqilJesyAyhNPWIjr+ Ew4QD2ajVA8cTj1FbLwH2sLI1Jcb3Mz//nwbTIXOFPf8v4zCqU4TXvxD9G/4P6hQ6Z egzTErOJ3GB6w== From: =?utf-8?B?QmrDtnJuIFTDtnBlbA==?= To: Anup Patel Cc: Palmer Dabbelt , Paul Walmsley , Thomas Gleixner , Rob Herring , Krzysztof Kozlowski , Frank Rowand , Conor Dooley , devicetree@vger.kernel.org, Saravana Kannan , Marc Zyngier , Anup Patel , linux-kernel@vger.kernel.org, Atish Patra , linux-riscv@lists.infradead.org, linux-arm-kernel@lists.infradead.org, Andrew Jones Subject: Re: [PATCH v12 00/25] Linux RISC-V AIA Support In-Reply-To: References: <20240127161753.114685-1-apatel@ventanamicro.com> <87r0hzuw87.fsf@all.your.base.are.belong.to.us> <87le87uulb.fsf@all.your.base.are.belong.to.us> <87cytjvybb.fsf@all.your.base.are.belong.to.us> <87ttmuq3m7.fsf@all.your.base.are.belong.to.us> <87fryeognc.fsf@all.your.base.are.belong.to.us> Date: Thu, 01 Feb 2024 19:45:47 +0100 Message-ID: <87v878dnvo.fsf@all.your.base.are.belong.to.us> MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20240201_104551_392984_AE527225 X-CRM114-Status: GOOD ( 34.85 ) X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org QW51cCBQYXRlbCA8YXBhdGVsQHZlbnRhbmFtaWNyby5jb20+IHdyaXRlczoKCj4gT24gVHVlLCBK YW4gMzAsIDIwMjQgYXQgMTE6MTnigK9QTSBCasO2cm4gVMO2cGVsIDxiam9ybkBrZXJuZWwub3Jn PiB3cm90ZToKPj4KPj4gQW51cCBQYXRlbCA8YXBhdGVsQHZlbnRhbmFtaWNyby5jb20+IHdyaXRl czoKPj4KPj4gPiBPbiBUdWUsIEphbiAzMCwgMjAyNCBhdCA4OjE44oCvUE0gQmrDtnJuIFTDtnBl bCA8Ympvcm5Aa2VybmVsLm9yZz4gd3JvdGU6Cj4+ID4+Cj4+ID4+IEJqw7ZybiBUw7ZwZWwgPGJq b3JuQGtlcm5lbC5vcmc+IHdyaXRlczoKPj4gPj4KPj4gPj4gPiBBbnVwIFBhdGVsIDxhcGF0ZWxA dmVudGFuYW1pY3JvLmNvbT4gd3JpdGVzOgo+PiA+PiA+Cj4+ID4+ID4+IE9uIFR1ZSwgSmFuIDMw LCAyMDI0IGF0IDE6MjLigK9QTSBCasO2cm4gVMO2cGVsIDxiam9ybkBrZXJuZWwub3JnPiB3cm90 ZToKPj4gPj4gPj4+Cj4+ID4+ID4+PiBCasO2cm4gVMO2cGVsIDxiam9ybkBrZXJuZWwub3JnPiB3 cml0ZXM6Cj4+ID4+ID4+Pgo+PiA+PiA+Pj4gPiBBbnVwIFBhdGVsIDxhcGF0ZWxAdmVudGFuYW1p Y3JvLmNvbT4gd3JpdGVzOgo+PiA+PiA+Pj4gPgo+PiA+PiA+Pj4gPj4gVGhlIFJJU0MtViBBSUEg c3BlY2lmaWNhdGlvbiBpcyByYXRpZmllZCBhcy1wZXIgdGhlIFJJU0MtViBpbnRlcm5hdGlvbmFs Cj4+ID4+ID4+PiA+PiBwcm9jZXNzLiBUaGUgbGF0ZXN0IHJhdGlmaWVkIEFJQSBzcGVjaWZjYXRp b24gY2FuIGJlIGZvdW5kIGF0Ogo+PiA+PiA+Pj4gPj4gaHR0cHM6Ly9naXRodWIuY29tL3Jpc2N2 L3Jpc2N2LWFpYS9yZWxlYXNlcy9kb3dubG9hZC8xLjAvcmlzY3YtaW50ZXJydXB0cy0xLjAucGRm Cj4+ID4+ID4+PiA+Pgo+PiA+PiA+Pj4gPj4gQXQgYSBoaWdoLWxldmVsLCB0aGUgQUlBIHNwZWNp ZmljYXRpb24gYWRkcyB0aHJlZSB0aGluZ3M6Cj4+ID4+ID4+PiA+PiAxKSBBSUEgQ1NScwo+PiA+ PiA+Pj4gPj4gICAgLSBJbXByb3ZlZCBsb2NhbCBpbnRlcnJ1cHQgc3VwcG9ydAo+PiA+PiA+Pj4g Pj4gMikgSW5jb21pbmcgTWVzc2FnZSBTaWduYWxlZCBJbnRlcnJ1cHQgQ29udHJvbGxlciAoSU1T SUMpCj4+ID4+ID4+PiA+PiAgICAtIFBlci1IQVJUIE1TSSBjb250cm9sbGVyCj4+ID4+ID4+PiA+ PiAgICAtIFN1cHBvcnQgTVNJIHZpcnR1YWxpemF0aW9uCj4+ID4+ID4+PiA+PiAgICAtIFN1cHBv cnQgSVBJIGFsb25nIHdpdGggdmlydHVhbGl6YXRpb24KPj4gPj4gPj4+ID4+IDMpIEFkdmFuY2Vk IFBsYXRmb3JtLUxldmVsIEludGVycnVwdCBDb250cm9sbGVyIChBUExJQykKPj4gPj4gPj4+ID4+ ICAgIC0gV2lyZWQgaW50ZXJydXB0IGNvbnRyb2xsZXIKPj4gPj4gPj4+ID4+ICAgIC0gSW4gTVNJ LW1vZGUsIGNvbnZlcnRzIHdpcmVkIGludGVycnVwdCBpbnRvIE1TSXMgKGkuZS4gTVNJIGdlbmVy YXRvcikKPj4gPj4gPj4+ID4+ICAgIC0gSW4gRGlyZWN0LW1vZGUsIGluamVjdHMgZXh0ZXJuYWwg aW50ZXJydXB0cyBkaXJlY3RseSBpbnRvIEhBUlRzCj4+ID4+ID4+PiA+Pgo+PiA+PiA+Pj4gPj4g Rm9yIGFuIG92ZXJ2aWV3IG9mIHRoZSBBSUEgc3BlY2lmaWNhdGlvbiwgcmVmZXIgdGhlIEFJQSB2 aXJ0dWFsaXphdGlvbgo+PiA+PiA+Pj4gPj4gdGFsayBhdCBLVk0gRm9ydW0gMjAyMjoKPj4gPj4g Pj4+ID4+IGh0dHBzOi8vc3RhdGljLnNjaGVkLmNvbS9ob3N0ZWRfZmlsZXMva3ZtZm9ydW0yMDIy L2ExL0FJQV9WaXJ0dWFsaXphdGlvbl9pbl9LVk1fUklTQ1ZfZmluYWwucGRmCj4+ID4+ID4+PiA+ PiBodHRwczovL3d3dy55b3V0dWJlLmNvbS93YXRjaD92PXIwNzFkTDhaMHlvCj4+ID4+ID4+PiA+ Pgo+PiA+PiA+Pj4gPj4gVG8gdGVzdCB0aGlzIHNlcmllcywgdXNlIFFFTVUgdjcuMiAob3IgaGln aGVyKSBhbmQgT3BlblNCSSB2MS4yIChvciBoaWdoZXIpLgo+PiA+PiA+Pj4gPj4KPj4gPj4gPj4+ ID4+IFRoZXNlIHBhdGNoZXMgY2FuIGFsc28gYmUgZm91bmQgaW4gdGhlIHJpc2N2X2FpYV92MTIg YnJhbmNoIGF0Ogo+PiA+PiA+Pj4gPj4gaHR0cHM6Ly9naXRodWIuY29tL2F2cGF0ZWwvbGludXgu Z2l0Cj4+ID4+ID4+PiA+Pgo+PiA+PiA+Pj4gPj4gQ2hhbmdlcyBzaW5jZSB2MTE6Cj4+ID4+ID4+ PiA+PiAgLSBSZWJhc2VkIG9uIExpbnV4LTYuOC1yYzEKPj4gPj4gPj4+ID4+ICAtIEluY2x1ZGVk IGtlcm5lbC9pcnEgcmVsYXRlZCBwYXRjaGVzIGZyb20gImdlbmlycSwgaXJxY2hpcDogQ29udmVy dCBBUk0KPj4gPj4gPj4+ID4+ICAgIE1TSSBoYW5kbGluZyB0byBwZXIgZGV2aWNlIE1TSSBkb21h aW5zIiBzZXJpZXMgYnkgVGhvbWFzLgo+PiA+PiA+Pj4gPj4gICAgKFBBVENINywgUEFUQ0g4LCBQ QVRDSDksIFBBVENIMTQsIFBBVENIMTYsIFBBVENIMTcsIFBBVENIMTgsIFBBVENIMTksCj4+ID4+ ID4+PiA+PiAgICAgUEFUQ0gyMCwgUEFUQ0gyMSwgUEFUQ0gyMiwgUEFUQ0gyMywgYW5kIFBBVENI MzIgb2YKPj4gPj4gPj4+ID4+ICAgICBodHRwczovL2xvcmUua2VybmVsLm9yZy9saW51eC1hcm0t a2VybmVsLzIwMjIxMTIxMTM1NjUzLjIwODYxMTIzM0BsaW51dHJvbml4LmRlLykKPj4gPj4gPj4+ ID4+ICAtIFVwZGF0ZWQgQVBMSUMgTVNJLW1vZGUgZHJpdmVyIHRvIHVzZSB0aGUgbmV3IFdJUkVE X1RPX01TSSBtZWNoYW5pc20uCj4+ID4+ID4+PiA+PiAgLSBVcGRhdGVkIElNU0lDIGRyaXZlciB0 byBzdXBwb3J0IHBlci1kZXZpY2UgTVNJIGRvbWFpbnMgZm9yIFBDSSBhbmQKPj4gPj4gPj4+ID4+ ICAgIHBsYXRmb3JtIGRldmljZXMuCj4+ID4+ID4+PiA+Cj4+ID4+ID4+PiA+IFRoYW5rcyBmb3Ig d29ya2luZyBvbiB0aGlzLCBBbnVwISBJJ20gc3RpbGwgcmV2aWV3aW5nIHRoZSBwYXRjaGVzLgo+ PiA+PiA+Pj4gPgo+PiA+PiA+Pj4gPiBJJ20gaGl0dGluZyBhIGJvb3QgaGFuZyBpbiB0ZXh0IHBh dGNoaW5nLCB3aXRoIHRoaXMgc2VyaWVzIGFwcGxpZWQgb24KPj4gPj4gPj4+ID4gNi44LXJjMi4g SVBJIGlzc3Vlcz8KPj4gPj4gPj4+Cj4+ID4+ID4+PiBOb3QgdGV4dCBwYXRjaGluZyEgT25lIGNw dSBzcGlubmluZyBpbiBzbXBfY2FsbF9mdW5jdGlvbl9tYW55X2NvbmQoKSBhbmQKPj4gPj4gPj4+ IHRoZSBvdGhlcnMgYXJlIGluIGNwdV9yZWxheCgpLiBTbWVsbHMgbGlrZSBJUEkuLi4KPj4gPj4g Pj4KPj4gPj4gPj4gSSB0cmllZCBib290ZWZpIGZyb20gVS1Cb290IG11bHRpcGxlIHRpbWVzIGJ1 dCBjYW4ndCByZXByb2R1Y2UgdGhlCj4+ID4+ID4+IGlzc3VlIHlvdSBhcmUgc2VlaW5nLgo+PiA+ PiA+Cj4+ID4+ID4gVGhhbmtzISBJIGNhbiByZXByb2R1Y2Ugd2l0aG91dCBFRkksIGFuZCBzaW1w bGVyIGNvbW1hbmQtbGluZToKPj4gPj4gPgo+PiA+PiA+IHFlbXUtc3lzdGVtLXJpc2N2NjQgXAo+ PiA+PiA+ICAgLWJpb3MgL3BhdGgvdG8vZndfZHluYW1pYy5iaW4gXAo+PiA+PiA+ICAgLWtlcm5l bCAvcGF0aC90by9JbWFnZSBcCj4+ID4+ID4gICAtYXBwZW5kICdlYXJseWNvbiBjb25zb2xlPXR0 eTAgY29uc29sZT10dHlTMCcgXAo+PiA+PiA+ICAgLW1hY2hpbmUgdmlydCxhaWE9YXBsaWMtaW1z aWMgXAo+PiA+PiA+ICAgLW5vLXJlYm9vdCAtbm9kZWZhdWx0cyAtbm9ncmFwaGljIFwKPj4gPj4g PiAgIC1zbXAgNCBcCj4+ID4+ID4gICAtb2JqZWN0IHJuZy1yYW5kb20sZmlsZW5hbWU9L2Rldi91 cmFuZG9tLGlkPXJuZzAgXAo+PiA+PiA+ICAgLWRldmljZSB2aXJ0aW8tcm5nLWRldmljZSxybmc9 cm5nMCBcCj4+ID4+ID4gICAtbSA0RyAtY2hhcmRldiBzdGRpbyxpZD1jaGFyMCAtc2VyaWFsIGNo YXJkZXY6Y2hhcjAKPj4gPj4gPgo+PiA+PiA+IEkgY2FuIHJlcHJvZHVjZSB3aXRoIHlvdXIgdXBz dHJlYW0gcmlzY3ZfYWlhX3YxMiBwbHVzIHRoZSBjb25maWcgaW4gdGhlCj4+ID4+ID4gZ2lzdCBb MV0sIGFuZCBhbGwgbGF0ZXN0IFFFTVUvT3BlblNCSToKPj4gPj4gPgo+PiA+PiA+IFFFTVU6IDEx YmU3MDY3N2M3MCAoIk1lcmdlIHRhZyAncHVsbC12ZmlvLTIwMjQwMTI5JyBvZiBodHRwczovL2dp dGh1Yi5jb20vbGVnb2F0ZXIvcWVtdSBpbnRvIHN0YWdpbmciKQo+PiA+PiA+IE9wZW5TQkk6IGJi OTBhOWViZjZkOSAoImxpYjogc2JpOiBQcmludCBudW1iZXIgb2YgZGVidWcgdHJpZ2dlcnMgZm91 bmQiKQo+PiA+PiA+IExpbnV4OiBkOWI5ZDZlYjk4N2YgKCJNQUlOVEFJTkVSUzogQWRkIGVudHJ5 IGZvciBSSVNDLVYgQUlBIGRyaXZlcnMiKQo+PiA+PiA+Cj4+ID4+ID4gUmVtb3ZpbmcgIixhaWE9 YXBsaWMtaW1zaWMiIGZyb20gdGhlIENMSSBhYm92ZSBjb21wbGV0ZXMgdGhlIGJvb3QgKGkuZS4K Pj4gPj4gPiBwYW5pY2tpbmcgYWJvdXQgbWlzc2luZyByb290IG1vdW50IDstKSkKPj4gPj4KPj4g Pj4gTW9yZSBjb250ZXh0OyBUaGUgaGFuZyBpcyBkdXJpbmcgYSBsYXRlIGluaXRjYWxsLCB3aGVy ZSBhbiBmdHJhY2UgZGlyZWN0Cj4+ID4+IChyZWdpc3Rlcl9mdHJhY2VfZGlyZWN0KCkpIG1vZGlm aWNhdGlvbiBpcyBkb25lLgo+PiA+Pgo+PiA+PiBTdG9wIG1hY2hpbmUgaXMgdXNlZCB0byBjYWxs IGludG8gX19mdHJhY2VfbW9kaWZ5X2NhbGwoKS4gVGhlbiBpbnRvIHRoZQo+PiA+PiBhcmNoIHNw ZWNpZmljIHBhdGNoX3RleHRfbm9zeW5jKCksIHdoZXJlIGZsdXNoX2ljYWNoZV9yYW5nZSgpIGhh bmdzIGluCj4+ID4+IGZsdXNoX2ljYWNoZV9hbGwoKS4gRnJvbSAib25fZWFjaF9jcHUoaXBpX3Jl bW90ZV9mZW5jZV9pLCBOVUxMLCAxKTsiIHRvCj4+ID4+IG9uX2VhY2hfY3B1X2NvbmRfbWFzaygp ICJzbXBfY2FsbF9mdW5jdGlvbl9tYW55X2NvbmQobWFzaywgZnVuYywgaW5mbywKPj4gPj4gc2Nm X2ZsYWdzLCBjb25kX2Z1bmMpOyIgd2hpY2ggbmV2ZXIgcmV0dXJucyBmcm9tICJjc2RfbG9ja193 YWl0KGNzZCkiCj4+ID4+IHJpZ2h0IGJlZm9yZSB0aGUgZW5kIG9mIHRoZSBmdW5jdGlvbi4KPj4g Pj4KPj4gPj4gQW55IGlkZWFzPyBEaXNhYmxpbmcgQ09ORklHX0hJRF9CUEYsIHRoYXQgZG9lcyB0 aGUgZWFybHkgZnRyYWNlIGNvZGUKPj4gPj4gcGF0Y2hpbmcgZml4ZXMgdGhlIGJvb3QgaGFuZywg YnV0IGl0IGRvZXMgc2VlbSByZWxhdGVkIHRvIElQSS4uLgo+PiA+Pgo+PiA+IExvb2tzIGxpa2Ug Zmx1c2hfaWNhY2hlX2FsbCgpIGRvZXMgbm90IHVzZSB0aGUgSVBJcyAob25fZWFjaF9jcHUoKQo+ PiA+IGFuZCBmcmllbmRzKSBjb3JyZWN0bHkuCj4+ID4KPj4gPiBPbiBvdGhlciBoYW5kLCB0aGUg Zmx1c2hfaWNhY2hlX21tKCkgZG9lcyB0aGUgcmlnaHQgdGhpbmcgYnkKPj4gPiBkb2luZyBsb2Nh bCBmbHVzaCBvbiB0aGUgY3VycmVudCBDUFUgYW5kIElQSSBiYXNlZCBmbHVzaCBvbiBvdGhlcgo+ PiA+IENQVXMuCj4+ID4KPj4gPiBDYW4geW91IHRyeSB0aGUgZm9sbG93aW5nIHBhdGNoID8KPj4g Pgo+PiA+IGRpZmYgLS1naXQgYS9hcmNoL3Jpc2N2L21tL2NhY2hlZmx1c2guYyBiL2FyY2gvcmlz Y3YvbW0vY2FjaGVmbHVzaC5jCj4+ID4gaW5kZXggNTVhMzRmMjAyMGE4Li5hM2RmYmU0ZGU4MzIg MTAwNjQ0Cj4+ID4gLS0tIGEvYXJjaC9yaXNjdi9tbS9jYWNoZWZsdXNoLmMKPj4gPiArKysgYi9h cmNoL3Jpc2N2L21tL2NhY2hlZmx1c2guYwo+PiA+IEBAIC0xOSwxMiArMTksMTggQEAgc3RhdGlj IHZvaWQgaXBpX3JlbW90ZV9mZW5jZV9pKHZvaWQgKmluZm8pCj4+ID4KPj4gPiAgdm9pZCBmbHVz aF9pY2FjaGVfYWxsKHZvaWQpCj4+ID4gIHsKPj4gPiArICAgIGNwdW1hc2tfdCBvdGhlcnM7Cj4+ ID4gKwo+PiA+ICAgICAgbG9jYWxfZmx1c2hfaWNhY2hlX2FsbCgpOwo+PiA+Cj4+ID4gKyAgICBj cHVtYXNrX2FuZG5vdCgmb3RoZXJzLCBjcHVfb25saW5lX21hc2ssIGNwdW1hc2tfb2Yoc21wX3By b2Nlc3Nvcl9pZCgpKSk7Cj4+ID4gKyAgICBpZiAoY3B1bWFza19lbXB0eSgmb3RoZXJzKSkKPj4g PiArICAgICAgICByZXR1cm47Cj4+ID4gKwo+PiA+ICAgICAgaWYgKElTX0VOQUJMRUQoQ09ORklH X1JJU0NWX1NCSSkgJiYgIXJpc2N2X3VzZV9pcGlfZm9yX3JmZW5jZSgpKQo+PiA+IC0gICAgICAg IHNiaV9yZW1vdGVfZmVuY2VfaShOVUxMKTsKPj4gPiArICAgICAgICBzYmlfcmVtb3RlX2ZlbmNl X2koJm90aGVycyk7Cj4+ID4gICAgICBlbHNlCj4+ID4gLSAgICAgICAgb25fZWFjaF9jcHUoaXBp X3JlbW90ZV9mZW5jZV9pLCBOVUxMLCAxKTsKPj4gPiArICAgICAgICBvbl9lYWNoX2NwdV9tYXNr KCZvdGhlcnMsIGlwaV9yZW1vdGVfZmVuY2VfaSwgTlVMTCwgMSk7Cj4+ID4gIH0KPj4gPiAgRVhQ T1JUX1NZTUJPTChmbHVzaF9pY2FjaGVfYWxsKTsKPj4KPj4gVW5mb3J0dW5hdGVseSwgSSBzZWUg dGhlIHNhbWUgaGFuZy4gTE1LIGlmIHlvdSdkIGxpa2UgbWUgdG8gdHJ5IGFueXRoaW5nCj4+IGVs c2UuCj4KPiBJIHdhcyBhYmxlIHRvIHJlcHJvZHVjZSB0aGlzIGF0IG15IGVuZCBidXQgSSBoYWQg dG8gdXNlIHlvdXIgY29uZmlnLgo+Cj4gRGlnZ2luZyBmdXJ0aGVyLCBpdCBzZWVtcyB0aGUgaXNz dWUgaXMgb2JzZXJ2ZWQgb25seSB3aGVuIHdlIHVzZQo+IGluLWtlcm5lbCBJUElzIGZvciBjYWNo ZSBmbHVzaGluZyAoaW5zdGVhZCBvZiBTQkkgY2FsbHMpIGFsb25nIHdpdGgKPiBzb21lIG9mIHRo ZSB0cmFjZXJzIChvciBkZWJ1Z2dpbmcgZmVhdHVyZXMpIGVuYWJsZWQuIFdpdGggdGhlIHRyYWNl cnMKPiAob3IgZGVidWcgZmVhdHVyZXMpIGRpc2FibGVkIHdlIGRvbid0IHNlZSBhbnkgaXNzdWUu IEluIGZhY3QsIHRoZQo+IHVwc3RyZWFtIGRlZmNvbmZpZyB3b3JrcyBwZXJmZWN0bHkgZmluZSB3 aXRoIEFJQSBkcml2ZXJzIGFuZAo+IGluLWtlcm5lbCBJUElzLgoKU2FtZSBoZXJlLiBJIG9ubHkg c2VlIHRoZSBpc3N1ZSBmb3IgKm9uZSogc2NlbmFyaW8uIE90aGVyIHRoYW4gdGhhdApzY2VuYXJp bywgQUlBIGlzIHdvcmtpbmcgZmluZSEgV2UncmUgZG9pbmcgZnRyYWNlIHRleHQgcGF0Y2hpbmcs IGFuZCBJCndvbmRlciBpZiB0aGlzIGlzIHRoZSBpc3N1ZS4gUklTQy1WICh1bmZvcnR1bmF0ZWx5 KSBzdGlsbCByZWx5IG9uCnN0b3BfbWFjaGluZSgpIHRleHQgcGF0Y2hpbmcgKHdoaWNoIHdpbGwg Y2hhbmdlISkuCgpBZ2FpbiwgdGhlIGhhbmcgaXMgaW4gc3RvcF9tYWNoaW5lKCkgY29udGV4dCwg d2hlcmUgaW50ZXJydXB0cyBzaG91bGQKdmVyeSBtdWNoIGJlIGRpc2FibGVkLCByaWdodD8gU28s IHRyaWdnZXJpbmcgYW4gSVBJIHdpbGwgYmUgaW1wb3NzaWJsZS4KCkR1bXBpbmcgbXN0YXR1cyBp biBRRU1VOgogIHwgbXN0YXR1cyAgMDAwMDAwMGEwMDAwMDBhMAogIHwgbXN0YXR1cyAgMDAwMDAw MGEwMDAwMDBhMAogIHwgbXN0YXR1cyAgMDAwMDAwMGEwMDAwMDBhMAogIHwgbXN0YXR1cyAgMDAw MDAwMGEwMDAwMDBhMAoKSW5kZWVkIHNzdGF0dXMuU0lFIGlzIDAuCgpTZWVtcyBsaWtlIHRoZSBi dWcgaXMgdGhhdCB0ZXh0IHBhdGNoaW5nIGlzIHRyeWluZyB0byBpc3N1ZSBhbiBJUEk6CiAgfCBb PGZmZmZmZmZmODAxMTQ1ZDQ+XSBzbXBfY2FsbF9mdW5jdGlvbl9tYW55X2NvbmQrMHg4MWUvMHg4 YmEKICB8IFs8ZmZmZmZmZmY4MDExNDcxNj5dIG9uX2VhY2hfY3B1X2NvbmRfbWFzaysweDNlLzB4 ZGUKICB8IFs8ZmZmZmZmZmY4MDAxMzk2OD5dIGZsdXNoX2ljYWNoZV9hbGwrMHg5OC8weGM0CiAg fCBbPGZmZmZmZmZmODAwMDljMjY+XSBwYXRjaF90ZXh0X25vc3luYysweDdjLzB4MTQ2CiAgfCBb PGZmZmZmZmZmODBlZjkxMTY+XSBfX2Z0cmFjZV9tb2RpZnlfY2FsbC5jb25zdHByb3AuMCsweGNh LzB4MTIwCiAgfCBbPGZmZmZmZmZmODBlZjkxOGM+XSBmdHJhY2VfdXBkYXRlX2Z0cmFjZV9mdW5j KzB4MjAvMHg0MAogIHwgWzxmZmZmZmZmZjgwZWZiOGFjPl0gZnRyYWNlX21vZGlmeV9hbGxfY29k ZSsweDVhLzB4MWQ4CiAgfCBbPGZmZmZmZmZmODBlZmJhNTA+XSBfX2Z0cmFjZV9tb2RpZnlfY29k ZSsweDI2LzB4NDIKICB8IFs8ZmZmZmZmZmY4MDEzMTczND5dIG11bHRpX2NwdV9zdG9wKzB4MTRl LzB4MWQ4CiAgfCBbPGZmZmZmZmZmODAxMzEwN2E+XSBjcHVfc3RvcHBlcl90aHJlYWQrMHg5ZS8w eDE4MgogIHwgWzxmZmZmZmZmZjgwMDc3YTA0Pl0gc21wYm9vdF90aHJlYWRfZm4rMHhmOC8weDFk MgogIHwgWzxmZmZmZmZmZjgwMDcxOGZjPl0ga3RocmVhZCsweGU4LzB4MTA4CiAgfCBbPGZmZmZm ZmZmODBmMWNkZTY+XSByZXRfZnJvbV9mb3JrKzB4ZS8weDIwCgoKQmrDtnJuCgpfX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpsaW51eC1yaXNjdiBtYWlsaW5n IGxpc3QKbGludXgtcmlzY3ZAbGlzdHMuaW5mcmFkZWFkLm9yZwpodHRwOi8vbGlzdHMuaW5mcmFk ZWFkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2xpbnV4LXJpc2N2Cg== From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id D44ACC4828D for ; Thu, 1 Feb 2024 18:46:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:Message-ID:Date:References :In-Reply-To:Subject:Cc:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=kxvJCPOqx5CHbXYoGHOHYEO27u2r72UjJS3JRNRNvyc=; b=41aD42T26vP+gl j19VN8W3PQ8bp0IwXN92090PIrlXjE/aBkH0TyDNJfKTA/gpFFuutZeZX0zP55SuGv8D4A8LSZQNf sdjxnfzAQ4O/Z1MZeXup0FrrbOhvBNSIU7B+JN1dxyQK9wfNBBy8AaUcBFMm+I3W++HkresyYrxsI Ucsm8w+Dlq0eWGfZXfb9JCAOD4PB4ah7YuJx8/hvKkroTkjt1gqTiqZA5+nGQ3mkL2ueY/lQ7otcp 8nikDXcx4V+a0BVt2guNsDwCyApx3NiBUYlu5SiT5dAHOt1dPUvvssEWOw+MsOAjhmdlTNm2XscUz HmqvtE7EePMlKKSqSG/g==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.97.1 #2 (Red Hat Linux)) id 1rVc4Q-0000000947k-06Ld; Thu, 01 Feb 2024 18:45:54 +0000 Received: from dfw.source.kernel.org ([139.178.84.217]) by bombadil.infradead.org with esmtps (Exim 4.97.1 #2 (Red Hat Linux)) id 1rVc4N-00000009474-10A6; Thu, 01 Feb 2024 18:45:52 +0000 Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id A7DE86209C; Thu, 1 Feb 2024 18:45:50 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id CFC48C433F1; Thu, 1 Feb 2024 18:45:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1706813150; bh=2o/ahhkt5Da88tuJdKbbZRhXmWTFExDo+7XxsQ7oVYQ=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=S0ZdmOBJIASmEToKqAwweWHUharcJbrOm7XEwIlMbJbqU/Z5d6O7MgLhMLxToW7fa 3qMOum1NuNKAXFxEv3wcvbsTYvBIxQukjg2XqhPlmV01Hxd6Hx806YBnI1QgWp1v3L d+qmvY7J8fOteYOtKlpVON3n7u0fakqBBkRM/BQZ5RIgvvu+FHoxFyBBlUE/h7D3XQ u0yRqoptcebxxI2OM7Dadf0GhXbQ8jpre0VXXrk0IuiKeTbggqilJesyAyhNPWIjr+ Ew4QD2ajVA8cTj1FbLwH2sLI1Jcb3Mz//nwbTIXOFPf8v4zCqU4TXvxD9G/4P6hQ6Z egzTErOJ3GB6w== From: =?utf-8?B?QmrDtnJuIFTDtnBlbA==?= To: Anup Patel Cc: Palmer Dabbelt , Paul Walmsley , Thomas Gleixner , Rob Herring , Krzysztof Kozlowski , Frank Rowand , Conor Dooley , devicetree@vger.kernel.org, Saravana Kannan , Marc Zyngier , Anup Patel , linux-kernel@vger.kernel.org, Atish Patra , linux-riscv@lists.infradead.org, linux-arm-kernel@lists.infradead.org, Andrew Jones Subject: Re: [PATCH v12 00/25] Linux RISC-V AIA Support In-Reply-To: References: <20240127161753.114685-1-apatel@ventanamicro.com> <87r0hzuw87.fsf@all.your.base.are.belong.to.us> <87le87uulb.fsf@all.your.base.are.belong.to.us> <87cytjvybb.fsf@all.your.base.are.belong.to.us> <87ttmuq3m7.fsf@all.your.base.are.belong.to.us> <87fryeognc.fsf@all.your.base.are.belong.to.us> Date: Thu, 01 Feb 2024 19:45:47 +0100 Message-ID: <87v878dnvo.fsf@all.your.base.are.belong.to.us> MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20240201_104551_392984_AE527225 X-CRM114-Status: GOOD ( 34.85 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org QW51cCBQYXRlbCA8YXBhdGVsQHZlbnRhbmFtaWNyby5jb20+IHdyaXRlczoKCj4gT24gVHVlLCBK YW4gMzAsIDIwMjQgYXQgMTE6MTnigK9QTSBCasO2cm4gVMO2cGVsIDxiam9ybkBrZXJuZWwub3Jn PiB3cm90ZToKPj4KPj4gQW51cCBQYXRlbCA8YXBhdGVsQHZlbnRhbmFtaWNyby5jb20+IHdyaXRl czoKPj4KPj4gPiBPbiBUdWUsIEphbiAzMCwgMjAyNCBhdCA4OjE44oCvUE0gQmrDtnJuIFTDtnBl bCA8Ympvcm5Aa2VybmVsLm9yZz4gd3JvdGU6Cj4+ID4+Cj4+ID4+IEJqw7ZybiBUw7ZwZWwgPGJq b3JuQGtlcm5lbC5vcmc+IHdyaXRlczoKPj4gPj4KPj4gPj4gPiBBbnVwIFBhdGVsIDxhcGF0ZWxA dmVudGFuYW1pY3JvLmNvbT4gd3JpdGVzOgo+PiA+PiA+Cj4+ID4+ID4+IE9uIFR1ZSwgSmFuIDMw LCAyMDI0IGF0IDE6MjLigK9QTSBCasO2cm4gVMO2cGVsIDxiam9ybkBrZXJuZWwub3JnPiB3cm90 ZToKPj4gPj4gPj4+Cj4+ID4+ID4+PiBCasO2cm4gVMO2cGVsIDxiam9ybkBrZXJuZWwub3JnPiB3 cml0ZXM6Cj4+ID4+ID4+Pgo+PiA+PiA+Pj4gPiBBbnVwIFBhdGVsIDxhcGF0ZWxAdmVudGFuYW1p Y3JvLmNvbT4gd3JpdGVzOgo+PiA+PiA+Pj4gPgo+PiA+PiA+Pj4gPj4gVGhlIFJJU0MtViBBSUEg c3BlY2lmaWNhdGlvbiBpcyByYXRpZmllZCBhcy1wZXIgdGhlIFJJU0MtViBpbnRlcm5hdGlvbmFs Cj4+ID4+ID4+PiA+PiBwcm9jZXNzLiBUaGUgbGF0ZXN0IHJhdGlmaWVkIEFJQSBzcGVjaWZjYXRp b24gY2FuIGJlIGZvdW5kIGF0Ogo+PiA+PiA+Pj4gPj4gaHR0cHM6Ly9naXRodWIuY29tL3Jpc2N2 L3Jpc2N2LWFpYS9yZWxlYXNlcy9kb3dubG9hZC8xLjAvcmlzY3YtaW50ZXJydXB0cy0xLjAucGRm Cj4+ID4+ID4+PiA+Pgo+PiA+PiA+Pj4gPj4gQXQgYSBoaWdoLWxldmVsLCB0aGUgQUlBIHNwZWNp ZmljYXRpb24gYWRkcyB0aHJlZSB0aGluZ3M6Cj4+ID4+ID4+PiA+PiAxKSBBSUEgQ1NScwo+PiA+ PiA+Pj4gPj4gICAgLSBJbXByb3ZlZCBsb2NhbCBpbnRlcnJ1cHQgc3VwcG9ydAo+PiA+PiA+Pj4g Pj4gMikgSW5jb21pbmcgTWVzc2FnZSBTaWduYWxlZCBJbnRlcnJ1cHQgQ29udHJvbGxlciAoSU1T SUMpCj4+ID4+ID4+PiA+PiAgICAtIFBlci1IQVJUIE1TSSBjb250cm9sbGVyCj4+ID4+ID4+PiA+ PiAgICAtIFN1cHBvcnQgTVNJIHZpcnR1YWxpemF0aW9uCj4+ID4+ID4+PiA+PiAgICAtIFN1cHBv cnQgSVBJIGFsb25nIHdpdGggdmlydHVhbGl6YXRpb24KPj4gPj4gPj4+ID4+IDMpIEFkdmFuY2Vk IFBsYXRmb3JtLUxldmVsIEludGVycnVwdCBDb250cm9sbGVyIChBUExJQykKPj4gPj4gPj4+ID4+ ICAgIC0gV2lyZWQgaW50ZXJydXB0IGNvbnRyb2xsZXIKPj4gPj4gPj4+ID4+ICAgIC0gSW4gTVNJ LW1vZGUsIGNvbnZlcnRzIHdpcmVkIGludGVycnVwdCBpbnRvIE1TSXMgKGkuZS4gTVNJIGdlbmVy YXRvcikKPj4gPj4gPj4+ID4+ICAgIC0gSW4gRGlyZWN0LW1vZGUsIGluamVjdHMgZXh0ZXJuYWwg aW50ZXJydXB0cyBkaXJlY3RseSBpbnRvIEhBUlRzCj4+ID4+ID4+PiA+Pgo+PiA+PiA+Pj4gPj4g Rm9yIGFuIG92ZXJ2aWV3IG9mIHRoZSBBSUEgc3BlY2lmaWNhdGlvbiwgcmVmZXIgdGhlIEFJQSB2 aXJ0dWFsaXphdGlvbgo+PiA+PiA+Pj4gPj4gdGFsayBhdCBLVk0gRm9ydW0gMjAyMjoKPj4gPj4g Pj4+ID4+IGh0dHBzOi8vc3RhdGljLnNjaGVkLmNvbS9ob3N0ZWRfZmlsZXMva3ZtZm9ydW0yMDIy L2ExL0FJQV9WaXJ0dWFsaXphdGlvbl9pbl9LVk1fUklTQ1ZfZmluYWwucGRmCj4+ID4+ID4+PiA+ PiBodHRwczovL3d3dy55b3V0dWJlLmNvbS93YXRjaD92PXIwNzFkTDhaMHlvCj4+ID4+ID4+PiA+ Pgo+PiA+PiA+Pj4gPj4gVG8gdGVzdCB0aGlzIHNlcmllcywgdXNlIFFFTVUgdjcuMiAob3IgaGln aGVyKSBhbmQgT3BlblNCSSB2MS4yIChvciBoaWdoZXIpLgo+PiA+PiA+Pj4gPj4KPj4gPj4gPj4+ ID4+IFRoZXNlIHBhdGNoZXMgY2FuIGFsc28gYmUgZm91bmQgaW4gdGhlIHJpc2N2X2FpYV92MTIg YnJhbmNoIGF0Ogo+PiA+PiA+Pj4gPj4gaHR0cHM6Ly9naXRodWIuY29tL2F2cGF0ZWwvbGludXgu Z2l0Cj4+ID4+ID4+PiA+Pgo+PiA+PiA+Pj4gPj4gQ2hhbmdlcyBzaW5jZSB2MTE6Cj4+ID4+ID4+ PiA+PiAgLSBSZWJhc2VkIG9uIExpbnV4LTYuOC1yYzEKPj4gPj4gPj4+ID4+ICAtIEluY2x1ZGVk IGtlcm5lbC9pcnEgcmVsYXRlZCBwYXRjaGVzIGZyb20gImdlbmlycSwgaXJxY2hpcDogQ29udmVy dCBBUk0KPj4gPj4gPj4+ID4+ICAgIE1TSSBoYW5kbGluZyB0byBwZXIgZGV2aWNlIE1TSSBkb21h aW5zIiBzZXJpZXMgYnkgVGhvbWFzLgo+PiA+PiA+Pj4gPj4gICAgKFBBVENINywgUEFUQ0g4LCBQ QVRDSDksIFBBVENIMTQsIFBBVENIMTYsIFBBVENIMTcsIFBBVENIMTgsIFBBVENIMTksCj4+ID4+ ID4+PiA+PiAgICAgUEFUQ0gyMCwgUEFUQ0gyMSwgUEFUQ0gyMiwgUEFUQ0gyMywgYW5kIFBBVENI MzIgb2YKPj4gPj4gPj4+ID4+ICAgICBodHRwczovL2xvcmUua2VybmVsLm9yZy9saW51eC1hcm0t a2VybmVsLzIwMjIxMTIxMTM1NjUzLjIwODYxMTIzM0BsaW51dHJvbml4LmRlLykKPj4gPj4gPj4+ ID4+ICAtIFVwZGF0ZWQgQVBMSUMgTVNJLW1vZGUgZHJpdmVyIHRvIHVzZSB0aGUgbmV3IFdJUkVE X1RPX01TSSBtZWNoYW5pc20uCj4+ID4+ID4+PiA+PiAgLSBVcGRhdGVkIElNU0lDIGRyaXZlciB0 byBzdXBwb3J0IHBlci1kZXZpY2UgTVNJIGRvbWFpbnMgZm9yIFBDSSBhbmQKPj4gPj4gPj4+ID4+ ICAgIHBsYXRmb3JtIGRldmljZXMuCj4+ID4+ID4+PiA+Cj4+ID4+ID4+PiA+IFRoYW5rcyBmb3Ig d29ya2luZyBvbiB0aGlzLCBBbnVwISBJJ20gc3RpbGwgcmV2aWV3aW5nIHRoZSBwYXRjaGVzLgo+ PiA+PiA+Pj4gPgo+PiA+PiA+Pj4gPiBJJ20gaGl0dGluZyBhIGJvb3QgaGFuZyBpbiB0ZXh0IHBh dGNoaW5nLCB3aXRoIHRoaXMgc2VyaWVzIGFwcGxpZWQgb24KPj4gPj4gPj4+ID4gNi44LXJjMi4g SVBJIGlzc3Vlcz8KPj4gPj4gPj4+Cj4+ID4+ID4+PiBOb3QgdGV4dCBwYXRjaGluZyEgT25lIGNw dSBzcGlubmluZyBpbiBzbXBfY2FsbF9mdW5jdGlvbl9tYW55X2NvbmQoKSBhbmQKPj4gPj4gPj4+ IHRoZSBvdGhlcnMgYXJlIGluIGNwdV9yZWxheCgpLiBTbWVsbHMgbGlrZSBJUEkuLi4KPj4gPj4g Pj4KPj4gPj4gPj4gSSB0cmllZCBib290ZWZpIGZyb20gVS1Cb290IG11bHRpcGxlIHRpbWVzIGJ1 dCBjYW4ndCByZXByb2R1Y2UgdGhlCj4+ID4+ID4+IGlzc3VlIHlvdSBhcmUgc2VlaW5nLgo+PiA+ PiA+Cj4+ID4+ID4gVGhhbmtzISBJIGNhbiByZXByb2R1Y2Ugd2l0aG91dCBFRkksIGFuZCBzaW1w bGVyIGNvbW1hbmQtbGluZToKPj4gPj4gPgo+PiA+PiA+IHFlbXUtc3lzdGVtLXJpc2N2NjQgXAo+ PiA+PiA+ICAgLWJpb3MgL3BhdGgvdG8vZndfZHluYW1pYy5iaW4gXAo+PiA+PiA+ICAgLWtlcm5l bCAvcGF0aC90by9JbWFnZSBcCj4+ID4+ID4gICAtYXBwZW5kICdlYXJseWNvbiBjb25zb2xlPXR0 eTAgY29uc29sZT10dHlTMCcgXAo+PiA+PiA+ICAgLW1hY2hpbmUgdmlydCxhaWE9YXBsaWMtaW1z aWMgXAo+PiA+PiA+ICAgLW5vLXJlYm9vdCAtbm9kZWZhdWx0cyAtbm9ncmFwaGljIFwKPj4gPj4g PiAgIC1zbXAgNCBcCj4+ID4+ID4gICAtb2JqZWN0IHJuZy1yYW5kb20sZmlsZW5hbWU9L2Rldi91 cmFuZG9tLGlkPXJuZzAgXAo+PiA+PiA+ICAgLWRldmljZSB2aXJ0aW8tcm5nLWRldmljZSxybmc9 cm5nMCBcCj4+ID4+ID4gICAtbSA0RyAtY2hhcmRldiBzdGRpbyxpZD1jaGFyMCAtc2VyaWFsIGNo YXJkZXY6Y2hhcjAKPj4gPj4gPgo+PiA+PiA+IEkgY2FuIHJlcHJvZHVjZSB3aXRoIHlvdXIgdXBz dHJlYW0gcmlzY3ZfYWlhX3YxMiBwbHVzIHRoZSBjb25maWcgaW4gdGhlCj4+ID4+ID4gZ2lzdCBb MV0sIGFuZCBhbGwgbGF0ZXN0IFFFTVUvT3BlblNCSToKPj4gPj4gPgo+PiA+PiA+IFFFTVU6IDEx YmU3MDY3N2M3MCAoIk1lcmdlIHRhZyAncHVsbC12ZmlvLTIwMjQwMTI5JyBvZiBodHRwczovL2dp dGh1Yi5jb20vbGVnb2F0ZXIvcWVtdSBpbnRvIHN0YWdpbmciKQo+PiA+PiA+IE9wZW5TQkk6IGJi OTBhOWViZjZkOSAoImxpYjogc2JpOiBQcmludCBudW1iZXIgb2YgZGVidWcgdHJpZ2dlcnMgZm91 bmQiKQo+PiA+PiA+IExpbnV4OiBkOWI5ZDZlYjk4N2YgKCJNQUlOVEFJTkVSUzogQWRkIGVudHJ5 IGZvciBSSVNDLVYgQUlBIGRyaXZlcnMiKQo+PiA+PiA+Cj4+ID4+ID4gUmVtb3ZpbmcgIixhaWE9 YXBsaWMtaW1zaWMiIGZyb20gdGhlIENMSSBhYm92ZSBjb21wbGV0ZXMgdGhlIGJvb3QgKGkuZS4K Pj4gPj4gPiBwYW5pY2tpbmcgYWJvdXQgbWlzc2luZyByb290IG1vdW50IDstKSkKPj4gPj4KPj4g Pj4gTW9yZSBjb250ZXh0OyBUaGUgaGFuZyBpcyBkdXJpbmcgYSBsYXRlIGluaXRjYWxsLCB3aGVy ZSBhbiBmdHJhY2UgZGlyZWN0Cj4+ID4+IChyZWdpc3Rlcl9mdHJhY2VfZGlyZWN0KCkpIG1vZGlm aWNhdGlvbiBpcyBkb25lLgo+PiA+Pgo+PiA+PiBTdG9wIG1hY2hpbmUgaXMgdXNlZCB0byBjYWxs IGludG8gX19mdHJhY2VfbW9kaWZ5X2NhbGwoKS4gVGhlbiBpbnRvIHRoZQo+PiA+PiBhcmNoIHNw ZWNpZmljIHBhdGNoX3RleHRfbm9zeW5jKCksIHdoZXJlIGZsdXNoX2ljYWNoZV9yYW5nZSgpIGhh bmdzIGluCj4+ID4+IGZsdXNoX2ljYWNoZV9hbGwoKS4gRnJvbSAib25fZWFjaF9jcHUoaXBpX3Jl bW90ZV9mZW5jZV9pLCBOVUxMLCAxKTsiIHRvCj4+ID4+IG9uX2VhY2hfY3B1X2NvbmRfbWFzaygp ICJzbXBfY2FsbF9mdW5jdGlvbl9tYW55X2NvbmQobWFzaywgZnVuYywgaW5mbywKPj4gPj4gc2Nm X2ZsYWdzLCBjb25kX2Z1bmMpOyIgd2hpY2ggbmV2ZXIgcmV0dXJucyBmcm9tICJjc2RfbG9ja193 YWl0KGNzZCkiCj4+ID4+IHJpZ2h0IGJlZm9yZSB0aGUgZW5kIG9mIHRoZSBmdW5jdGlvbi4KPj4g Pj4KPj4gPj4gQW55IGlkZWFzPyBEaXNhYmxpbmcgQ09ORklHX0hJRF9CUEYsIHRoYXQgZG9lcyB0 aGUgZWFybHkgZnRyYWNlIGNvZGUKPj4gPj4gcGF0Y2hpbmcgZml4ZXMgdGhlIGJvb3QgaGFuZywg YnV0IGl0IGRvZXMgc2VlbSByZWxhdGVkIHRvIElQSS4uLgo+PiA+Pgo+PiA+IExvb2tzIGxpa2Ug Zmx1c2hfaWNhY2hlX2FsbCgpIGRvZXMgbm90IHVzZSB0aGUgSVBJcyAob25fZWFjaF9jcHUoKQo+ PiA+IGFuZCBmcmllbmRzKSBjb3JyZWN0bHkuCj4+ID4KPj4gPiBPbiBvdGhlciBoYW5kLCB0aGUg Zmx1c2hfaWNhY2hlX21tKCkgZG9lcyB0aGUgcmlnaHQgdGhpbmcgYnkKPj4gPiBkb2luZyBsb2Nh bCBmbHVzaCBvbiB0aGUgY3VycmVudCBDUFUgYW5kIElQSSBiYXNlZCBmbHVzaCBvbiBvdGhlcgo+ PiA+IENQVXMuCj4+ID4KPj4gPiBDYW4geW91IHRyeSB0aGUgZm9sbG93aW5nIHBhdGNoID8KPj4g Pgo+PiA+IGRpZmYgLS1naXQgYS9hcmNoL3Jpc2N2L21tL2NhY2hlZmx1c2guYyBiL2FyY2gvcmlz Y3YvbW0vY2FjaGVmbHVzaC5jCj4+ID4gaW5kZXggNTVhMzRmMjAyMGE4Li5hM2RmYmU0ZGU4MzIg MTAwNjQ0Cj4+ID4gLS0tIGEvYXJjaC9yaXNjdi9tbS9jYWNoZWZsdXNoLmMKPj4gPiArKysgYi9h cmNoL3Jpc2N2L21tL2NhY2hlZmx1c2guYwo+PiA+IEBAIC0xOSwxMiArMTksMTggQEAgc3RhdGlj IHZvaWQgaXBpX3JlbW90ZV9mZW5jZV9pKHZvaWQgKmluZm8pCj4+ID4KPj4gPiAgdm9pZCBmbHVz aF9pY2FjaGVfYWxsKHZvaWQpCj4+ID4gIHsKPj4gPiArICAgIGNwdW1hc2tfdCBvdGhlcnM7Cj4+ ID4gKwo+PiA+ICAgICAgbG9jYWxfZmx1c2hfaWNhY2hlX2FsbCgpOwo+PiA+Cj4+ID4gKyAgICBj cHVtYXNrX2FuZG5vdCgmb3RoZXJzLCBjcHVfb25saW5lX21hc2ssIGNwdW1hc2tfb2Yoc21wX3By b2Nlc3Nvcl9pZCgpKSk7Cj4+ID4gKyAgICBpZiAoY3B1bWFza19lbXB0eSgmb3RoZXJzKSkKPj4g PiArICAgICAgICByZXR1cm47Cj4+ID4gKwo+PiA+ICAgICAgaWYgKElTX0VOQUJMRUQoQ09ORklH X1JJU0NWX1NCSSkgJiYgIXJpc2N2X3VzZV9pcGlfZm9yX3JmZW5jZSgpKQo+PiA+IC0gICAgICAg IHNiaV9yZW1vdGVfZmVuY2VfaShOVUxMKTsKPj4gPiArICAgICAgICBzYmlfcmVtb3RlX2ZlbmNl X2koJm90aGVycyk7Cj4+ID4gICAgICBlbHNlCj4+ID4gLSAgICAgICAgb25fZWFjaF9jcHUoaXBp X3JlbW90ZV9mZW5jZV9pLCBOVUxMLCAxKTsKPj4gPiArICAgICAgICBvbl9lYWNoX2NwdV9tYXNr KCZvdGhlcnMsIGlwaV9yZW1vdGVfZmVuY2VfaSwgTlVMTCwgMSk7Cj4+ID4gIH0KPj4gPiAgRVhQ T1JUX1NZTUJPTChmbHVzaF9pY2FjaGVfYWxsKTsKPj4KPj4gVW5mb3J0dW5hdGVseSwgSSBzZWUg dGhlIHNhbWUgaGFuZy4gTE1LIGlmIHlvdSdkIGxpa2UgbWUgdG8gdHJ5IGFueXRoaW5nCj4+IGVs c2UuCj4KPiBJIHdhcyBhYmxlIHRvIHJlcHJvZHVjZSB0aGlzIGF0IG15IGVuZCBidXQgSSBoYWQg dG8gdXNlIHlvdXIgY29uZmlnLgo+Cj4gRGlnZ2luZyBmdXJ0aGVyLCBpdCBzZWVtcyB0aGUgaXNz dWUgaXMgb2JzZXJ2ZWQgb25seSB3aGVuIHdlIHVzZQo+IGluLWtlcm5lbCBJUElzIGZvciBjYWNo ZSBmbHVzaGluZyAoaW5zdGVhZCBvZiBTQkkgY2FsbHMpIGFsb25nIHdpdGgKPiBzb21lIG9mIHRo ZSB0cmFjZXJzIChvciBkZWJ1Z2dpbmcgZmVhdHVyZXMpIGVuYWJsZWQuIFdpdGggdGhlIHRyYWNl cnMKPiAob3IgZGVidWcgZmVhdHVyZXMpIGRpc2FibGVkIHdlIGRvbid0IHNlZSBhbnkgaXNzdWUu IEluIGZhY3QsIHRoZQo+IHVwc3RyZWFtIGRlZmNvbmZpZyB3b3JrcyBwZXJmZWN0bHkgZmluZSB3 aXRoIEFJQSBkcml2ZXJzIGFuZAo+IGluLWtlcm5lbCBJUElzLgoKU2FtZSBoZXJlLiBJIG9ubHkg c2VlIHRoZSBpc3N1ZSBmb3IgKm9uZSogc2NlbmFyaW8uIE90aGVyIHRoYW4gdGhhdApzY2VuYXJp bywgQUlBIGlzIHdvcmtpbmcgZmluZSEgV2UncmUgZG9pbmcgZnRyYWNlIHRleHQgcGF0Y2hpbmcs IGFuZCBJCndvbmRlciBpZiB0aGlzIGlzIHRoZSBpc3N1ZS4gUklTQy1WICh1bmZvcnR1bmF0ZWx5 KSBzdGlsbCByZWx5IG9uCnN0b3BfbWFjaGluZSgpIHRleHQgcGF0Y2hpbmcgKHdoaWNoIHdpbGwg Y2hhbmdlISkuCgpBZ2FpbiwgdGhlIGhhbmcgaXMgaW4gc3RvcF9tYWNoaW5lKCkgY29udGV4dCwg d2hlcmUgaW50ZXJydXB0cyBzaG91bGQKdmVyeSBtdWNoIGJlIGRpc2FibGVkLCByaWdodD8gU28s IHRyaWdnZXJpbmcgYW4gSVBJIHdpbGwgYmUgaW1wb3NzaWJsZS4KCkR1bXBpbmcgbXN0YXR1cyBp biBRRU1VOgogIHwgbXN0YXR1cyAgMDAwMDAwMGEwMDAwMDBhMAogIHwgbXN0YXR1cyAgMDAwMDAw MGEwMDAwMDBhMAogIHwgbXN0YXR1cyAgMDAwMDAwMGEwMDAwMDBhMAogIHwgbXN0YXR1cyAgMDAw MDAwMGEwMDAwMDBhMAoKSW5kZWVkIHNzdGF0dXMuU0lFIGlzIDAuCgpTZWVtcyBsaWtlIHRoZSBi dWcgaXMgdGhhdCB0ZXh0IHBhdGNoaW5nIGlzIHRyeWluZyB0byBpc3N1ZSBhbiBJUEk6CiAgfCBb PGZmZmZmZmZmODAxMTQ1ZDQ+XSBzbXBfY2FsbF9mdW5jdGlvbl9tYW55X2NvbmQrMHg4MWUvMHg4 YmEKICB8IFs8ZmZmZmZmZmY4MDExNDcxNj5dIG9uX2VhY2hfY3B1X2NvbmRfbWFzaysweDNlLzB4 ZGUKICB8IFs8ZmZmZmZmZmY4MDAxMzk2OD5dIGZsdXNoX2ljYWNoZV9hbGwrMHg5OC8weGM0CiAg fCBbPGZmZmZmZmZmODAwMDljMjY+XSBwYXRjaF90ZXh0X25vc3luYysweDdjLzB4MTQ2CiAgfCBb PGZmZmZmZmZmODBlZjkxMTY+XSBfX2Z0cmFjZV9tb2RpZnlfY2FsbC5jb25zdHByb3AuMCsweGNh LzB4MTIwCiAgfCBbPGZmZmZmZmZmODBlZjkxOGM+XSBmdHJhY2VfdXBkYXRlX2Z0cmFjZV9mdW5j KzB4MjAvMHg0MAogIHwgWzxmZmZmZmZmZjgwZWZiOGFjPl0gZnRyYWNlX21vZGlmeV9hbGxfY29k ZSsweDVhLzB4MWQ4CiAgfCBbPGZmZmZmZmZmODBlZmJhNTA+XSBfX2Z0cmFjZV9tb2RpZnlfY29k ZSsweDI2LzB4NDIKICB8IFs8ZmZmZmZmZmY4MDEzMTczND5dIG11bHRpX2NwdV9zdG9wKzB4MTRl LzB4MWQ4CiAgfCBbPGZmZmZmZmZmODAxMzEwN2E+XSBjcHVfc3RvcHBlcl90aHJlYWQrMHg5ZS8w eDE4MgogIHwgWzxmZmZmZmZmZjgwMDc3YTA0Pl0gc21wYm9vdF90aHJlYWRfZm4rMHhmOC8weDFk MgogIHwgWzxmZmZmZmZmZjgwMDcxOGZjPl0ga3RocmVhZCsweGU4LzB4MTA4CiAgfCBbPGZmZmZm ZmZmODBmMWNkZTY+XSByZXRfZnJvbV9mb3JrKzB4ZS8weDIwCgoKQmrDtnJuCgpfX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpsaW51eC1hcm0ta2VybmVsIG1h aWxpbmcgbGlzdApsaW51eC1hcm0ta2VybmVsQGxpc3RzLmluZnJhZGVhZC5vcmcKaHR0cDovL2xp c3RzLmluZnJhZGVhZC5vcmcvbWFpbG1hbi9saXN0aW5mby9saW51eC1hcm0ta2VybmVsCg== From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 5002A84FA8; Thu, 1 Feb 2024 18:45:52 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706813153; cv=none; b=r6DMQKvLW30Yb8yIS0y4/xsQa0EQS/roP9zc57AZs7L2UYwh/hy7vPWNDp6vpiqgJCIMLpxUKy3rjS+hsYYk97I1mWdZxJhPpB9bG/OS0CA3t5nVfLyE3l2WAbNrosowN+IhPTPfaJxJhpqyrs0fOAr6mSmnMCuy0ZB0040Qyc8= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1706813153; c=relaxed/simple; bh=2o/ahhkt5Da88tuJdKbbZRhXmWTFExDo+7XxsQ7oVYQ=; h=From:To:Cc:Subject:In-Reply-To:References:Date:Message-ID: MIME-Version:Content-Type; b=A/Hdbw9EtNpdL1GJA5HjV2cwS7ejDG4fuA2/LEmUCbvp27anV2TpJBqaeuJY7v8pGcLz86oVIs1DItrnWM8l5kAs9+W5CMp5mBSrP0NKFEuvx5K3jTG6FmzNDh96o15fY3n6rGwyl13l8aHqBqxlas3xjznmtNX4fl8a2X5YsrE= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=S0ZdmOBJ; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="S0ZdmOBJ" Received: by smtp.kernel.org (Postfix) with ESMTPSA id CFC48C433F1; Thu, 1 Feb 2024 18:45:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1706813150; bh=2o/ahhkt5Da88tuJdKbbZRhXmWTFExDo+7XxsQ7oVYQ=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=S0ZdmOBJIASmEToKqAwweWHUharcJbrOm7XEwIlMbJbqU/Z5d6O7MgLhMLxToW7fa 3qMOum1NuNKAXFxEv3wcvbsTYvBIxQukjg2XqhPlmV01Hxd6Hx806YBnI1QgWp1v3L d+qmvY7J8fOteYOtKlpVON3n7u0fakqBBkRM/BQZ5RIgvvu+FHoxFyBBlUE/h7D3XQ u0yRqoptcebxxI2OM7Dadf0GhXbQ8jpre0VXXrk0IuiKeTbggqilJesyAyhNPWIjr+ Ew4QD2ajVA8cTj1FbLwH2sLI1Jcb3Mz//nwbTIXOFPf8v4zCqU4TXvxD9G/4P6hQ6Z egzTErOJ3GB6w== From: =?utf-8?B?QmrDtnJuIFTDtnBlbA==?= To: Anup Patel Cc: Palmer Dabbelt , Paul Walmsley , Thomas Gleixner , Rob Herring , Krzysztof Kozlowski , Frank Rowand , Conor Dooley , devicetree@vger.kernel.org, Saravana Kannan , Marc Zyngier , Anup Patel , linux-kernel@vger.kernel.org, Atish Patra , linux-riscv@lists.infradead.org, linux-arm-kernel@lists.infradead.org, Andrew Jones Subject: Re: [PATCH v12 00/25] Linux RISC-V AIA Support In-Reply-To: References: <20240127161753.114685-1-apatel@ventanamicro.com> <87r0hzuw87.fsf@all.your.base.are.belong.to.us> <87le87uulb.fsf@all.your.base.are.belong.to.us> <87cytjvybb.fsf@all.your.base.are.belong.to.us> <87ttmuq3m7.fsf@all.your.base.are.belong.to.us> <87fryeognc.fsf@all.your.base.are.belong.to.us> Date: Thu, 01 Feb 2024 19:45:47 +0100 Message-ID: <87v878dnvo.fsf@all.your.base.are.belong.to.us> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Anup Patel writes: > On Tue, Jan 30, 2024 at 11:19=E2=80=AFPM Bj=C3=B6rn T=C3=B6pel wrote: >> >> Anup Patel writes: >> >> > On Tue, Jan 30, 2024 at 8:18=E2=80=AFPM Bj=C3=B6rn T=C3=B6pel wrote: >> >> >> >> Bj=C3=B6rn T=C3=B6pel writes: >> >> >> >> > Anup Patel writes: >> >> > >> >> >> On Tue, Jan 30, 2024 at 1:22=E2=80=AFPM Bj=C3=B6rn T=C3=B6pel wrote: >> >> >>> >> >> >>> Bj=C3=B6rn T=C3=B6pel writes: >> >> >>> >> >> >>> > Anup Patel writes: >> >> >>> > >> >> >>> >> The RISC-V AIA specification is ratified as-per the RISC-V int= ernational >> >> >>> >> process. The latest ratified AIA specifcation can be found at: >> >> >>> >> https://github.com/riscv/riscv-aia/releases/download/1.0/riscv= -interrupts-1.0.pdf >> >> >>> >> >> >> >>> >> At a high-level, the AIA specification adds three things: >> >> >>> >> 1) AIA CSRs >> >> >>> >> - Improved local interrupt support >> >> >>> >> 2) Incoming Message Signaled Interrupt Controller (IMSIC) >> >> >>> >> - Per-HART MSI controller >> >> >>> >> - Support MSI virtualization >> >> >>> >> - Support IPI along with virtualization >> >> >>> >> 3) Advanced Platform-Level Interrupt Controller (APLIC) >> >> >>> >> - Wired interrupt controller >> >> >>> >> - In MSI-mode, converts wired interrupt into MSIs (i.e. MSI= generator) >> >> >>> >> - In Direct-mode, injects external interrupts directly into= HARTs >> >> >>> >> >> >> >>> >> For an overview of the AIA specification, refer the AIA virtua= lization >> >> >>> >> talk at KVM Forum 2022: >> >> >>> >> https://static.sched.com/hosted_files/kvmforum2022/a1/AIA_Virt= ualization_in_KVM_RISCV_final.pdf >> >> >>> >> https://www.youtube.com/watch?v=3Dr071dL8Z0yo >> >> >>> >> >> >> >>> >> To test this series, use QEMU v7.2 (or higher) and OpenSBI v1.= 2 (or higher). >> >> >>> >> >> >> >>> >> These patches can also be found in the riscv_aia_v12 branch at: >> >> >>> >> https://github.com/avpatel/linux.git >> >> >>> >> >> >> >>> >> Changes since v11: >> >> >>> >> - Rebased on Linux-6.8-rc1 >> >> >>> >> - Included kernel/irq related patches from "genirq, irqchip: = Convert ARM >> >> >>> >> MSI handling to per device MSI domains" series by Thomas. >> >> >>> >> (PATCH7, PATCH8, PATCH9, PATCH14, PATCH16, PATCH17, PATCH18= , PATCH19, >> >> >>> >> PATCH20, PATCH21, PATCH22, PATCH23, and PATCH32 of >> >> >>> >> https://lore.kernel.org/linux-arm-kernel/20221121135653.20= 8611233@linutronix.de/) >> >> >>> >> - Updated APLIC MSI-mode driver to use the new WIRED_TO_MSI m= echanism. >> >> >>> >> - Updated IMSIC driver to support per-device MSI domains for = PCI and >> >> >>> >> platform devices. >> >> >>> > >> >> >>> > Thanks for working on this, Anup! I'm still reviewing the patch= es. >> >> >>> > >> >> >>> > I'm hitting a boot hang in text patching, with this series appl= ied on >> >> >>> > 6.8-rc2. IPI issues? >> >> >>> >> >> >>> Not text patching! One cpu spinning in smp_call_function_many_con= d() and >> >> >>> the others are in cpu_relax(). Smells like IPI... >> >> >> >> >> >> I tried bootefi from U-Boot multiple times but can't reproduce the >> >> >> issue you are seeing. >> >> > >> >> > Thanks! I can reproduce without EFI, and simpler command-line: >> >> > >> >> > qemu-system-riscv64 \ >> >> > -bios /path/to/fw_dynamic.bin \ >> >> > -kernel /path/to/Image \ >> >> > -append 'earlycon console=3Dtty0 console=3DttyS0' \ >> >> > -machine virt,aia=3Daplic-imsic \ >> >> > -no-reboot -nodefaults -nographic \ >> >> > -smp 4 \ >> >> > -object rng-random,filename=3D/dev/urandom,id=3Drng0 \ >> >> > -device virtio-rng-device,rng=3Drng0 \ >> >> > -m 4G -chardev stdio,id=3Dchar0 -serial chardev:char0 >> >> > >> >> > I can reproduce with your upstream riscv_aia_v12 plus the config in= the >> >> > gist [1], and all latest QEMU/OpenSBI: >> >> > >> >> > QEMU: 11be70677c70 ("Merge tag 'pull-vfio-20240129' of https://gith= ub.com/legoater/qemu into staging") >> >> > OpenSBI: bb90a9ebf6d9 ("lib: sbi: Print number of debug triggers fo= und") >> >> > Linux: d9b9d6eb987f ("MAINTAINERS: Add entry for RISC-V AIA drivers= ") >> >> > >> >> > Removing ",aia=3Daplic-imsic" from the CLI above completes the boot= (i.e. >> >> > panicking about missing root mount ;-)) >> >> >> >> More context; The hang is during a late initcall, where an ftrace dir= ect >> >> (register_ftrace_direct()) modification is done. >> >> >> >> Stop machine is used to call into __ftrace_modify_call(). Then into t= he >> >> arch specific patch_text_nosync(), where flush_icache_range() hangs in >> >> flush_icache_all(). From "on_each_cpu(ipi_remote_fence_i, NULL, 1);" = to >> >> on_each_cpu_cond_mask() "smp_call_function_many_cond(mask, func, info, >> >> scf_flags, cond_func);" which never returns from "csd_lock_wait(csd)" >> >> right before the end of the function. >> >> >> >> Any ideas? Disabling CONFIG_HID_BPF, that does the early ftrace code >> >> patching fixes the boot hang, but it does seem related to IPI... >> >> >> > Looks like flush_icache_all() does not use the IPIs (on_each_cpu() >> > and friends) correctly. >> > >> > On other hand, the flush_icache_mm() does the right thing by >> > doing local flush on the current CPU and IPI based flush on other >> > CPUs. >> > >> > Can you try the following patch ? >> > >> > diff --git a/arch/riscv/mm/cacheflush.c b/arch/riscv/mm/cacheflush.c >> > index 55a34f2020a8..a3dfbe4de832 100644 >> > --- a/arch/riscv/mm/cacheflush.c >> > +++ b/arch/riscv/mm/cacheflush.c >> > @@ -19,12 +19,18 @@ static void ipi_remote_fence_i(void *info) >> > >> > void flush_icache_all(void) >> > { >> > + cpumask_t others; >> > + >> > local_flush_icache_all(); >> > >> > + cpumask_andnot(&others, cpu_online_mask, cpumask_of(smp_processor= _id())); >> > + if (cpumask_empty(&others)) >> > + return; >> > + >> > if (IS_ENABLED(CONFIG_RISCV_SBI) && !riscv_use_ipi_for_rfence()) >> > - sbi_remote_fence_i(NULL); >> > + sbi_remote_fence_i(&others); >> > else >> > - on_each_cpu(ipi_remote_fence_i, NULL, 1); >> > + on_each_cpu_mask(&others, ipi_remote_fence_i, NULL, 1); >> > } >> > EXPORT_SYMBOL(flush_icache_all); >> >> Unfortunately, I see the same hang. LMK if you'd like me to try anything >> else. > > I was able to reproduce this at my end but I had to use your config. > > Digging further, it seems the issue is observed only when we use > in-kernel IPIs for cache flushing (instead of SBI calls) along with > some of the tracers (or debugging features) enabled. With the tracers > (or debug features) disabled we don't see any issue. In fact, the > upstream defconfig works perfectly fine with AIA drivers and > in-kernel IPIs. Same here. I only see the issue for *one* scenario. Other than that scenario, AIA is working fine! We're doing ftrace text patching, and I wonder if this is the issue. RISC-V (unfortunately) still rely on stop_machine() text patching (which will change!). Again, the hang is in stop_machine() context, where interrupts should very much be disabled, right? So, triggering an IPI will be impossible. Dumping mstatus in QEMU: | mstatus 0000000a000000a0 | mstatus 0000000a000000a0 | mstatus 0000000a000000a0 | mstatus 0000000a000000a0 Indeed sstatus.SIE is 0. Seems like the bug is that text patching is trying to issue an IPI: | [] smp_call_function_many_cond+0x81e/0x8ba | [] on_each_cpu_cond_mask+0x3e/0xde | [] flush_icache_all+0x98/0xc4 | [] patch_text_nosync+0x7c/0x146 | [] __ftrace_modify_call.constprop.0+0xca/0x120 | [] ftrace_update_ftrace_func+0x20/0x40 | [] ftrace_modify_all_code+0x5a/0x1d8 | [] __ftrace_modify_code+0x26/0x42 | [] multi_cpu_stop+0x14e/0x1d8 | [] cpu_stopper_thread+0x9e/0x182 | [] smpboot_thread_fn+0xf8/0x1d2 | [] kthread+0xe8/0x108 | [] ret_from_fork+0xe/0x20 Bj=C3=B6rn