From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8CA9AC433E0 for ; Thu, 21 Jan 2021 18:31:00 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 4E88023A40 for ; Thu, 21 Jan 2021 18:31:00 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729213AbhAUSaK (ORCPT ); Thu, 21 Jan 2021 13:30:10 -0500 Received: from mout.gmx.net ([212.227.15.19]:54001 "EHLO mout.gmx.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726663AbhAUSYL (ORCPT ); Thu, 21 Jan 2021 13:24:11 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1611253347; bh=vjQW4TKGsW2UmvXkX37wzzORNHRYtgG6i43MdHHFZyA=; h=X-UI-Sender-Class:Subject:From:In-Reply-To:Date:Cc:References:To; b=Ifq3yy+Q7lX4+Xfh1riVy5QJshuBoKgtno4+JF9a+3kdEZEavjT84nBF9nxTpn/iJ VPzPpn4/R5HGKFnFuxabUuiDhF7BenSOAeHp/3cWzSOaWufKBMt/+a3j2zYcmmywwi iCA7lqGb9kVS/BUm8UYfx5uEAYNLDX25OubSKEas= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [10.42.0.78] ([83.204.192.78]) by mail.gmx.net (mrgmx004 [212.227.17.184]) with ESMTPSA (Nemesis) id 1MBUqL-1lAfLI0U2x-00D2B9; Thu, 21 Jan 2021 19:22:27 +0100 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.5\)) Subject: Re: [RFC PATCH 3/7] arm64: mm: use nGnRnE instead of nGnRE on Apple processors From: Mohamed Mediouni In-Reply-To: Date: Thu, 21 Jan 2021 19:22:24 +0100 Cc: Will Deacon , Linux ARM , Catalin Marinas , Mark Rutland , Hector Martin , linux-kernel@vger.kernel.org, Stan Skowronek Content-Transfer-Encoding: quoted-printable Message-Id: References: <20210120132717.395873-1-mohamed.mediouni@caramail.com> <20210120132717.395873-4-mohamed.mediouni@caramail.com> <20210121112725.GA21750@willie-the-truck> <20210121124742.GA22123@willie-the-truck> <39067FDD-F7D3-4F37-8B43-1A9FCF80EEE5@caramail.com> <195e2bfe3a5e5503d9988b517159300e@kernel.org> <20210121175525.GB22963@willie-the-truck> To: Marc Zyngier X-Mailer: Apple Mail (2.3654.60.0.2.5) X-Provags-ID: V03:K1:oJoietTKBhqTacvuUkJhKDBzQhk4Fw1I8oOwZyqTy8PuEG05V8p ekOb75Wlvcot5alrctaV+g34TthGeQNLyY1TEcs32cx1c1JlfU0LyV5/sVP5TaPCes6jEE5 2x8HFk4dAsPyUSyVjq/XWEJ++yluOtqfMGDraR+S3bMkxa3zynxgI510dwzCY9575qpGwZx R6kBBpJYe5aQMUiCYur4g== X-UI-Out-Filterresults: notjunk:1;V03:K0:U7hoWESd7vc=:GE0XZFpaUwr7sxDB6iP6KN wd8CN6nExOuTnwum7nfBJBjkBgBby5++usJ+JAQ1PW3ZgWW1c1PKo3dG228MmCsq46YzE5yLR fVEdvbp+tmwphhNqPFQuaFaL3Wkcj44tYIMjfHNmGBlzdk1YIVoInjCZWvCrHU+ouXMeeUKrs brt4KQk+8C72QiXFwgBlUhgQAGhRzdWKREya512/URst8pW4vMmS9w89RS8GRgZlHS/bfIpCJ s7NCBDgWzKeR7fIT4z1Lm4p7KwQfxo02NL32TcO91ypvcnPJ4wCyqrIdrqsG+C9ByyDgh4XP9 8Y2ACZv48iBRiyo0ajpYw6+M3JtMZi+774uDZ5HaW5yVmGj67r3GdnQA8hpUOTjor6a9u9yMa bDOgwIhNZEojSD6he3mMwHGcfSxdoza9j9BDu7D6omGdrszLXL3b3UHtBLk0DnOARl9RCy408 wHVatGClgS/gjXk74ZwZs4RHH4OrVlEpoh4v91y8NX1l+6jwLCczKyiio8iIq3p+rG0LW7A9w o/tQSkrY1wz+ENpLWQVLh0hmUrKKugZZYF0lHMSOsWct9UwQpNnUy3g0uvorhUTw+ANZAX6QT YUuSg/jVm0QFSMvfVsbLq0FwxF0KqJc4BDIiqQJtnNc6NP7f+Un4xfjpXkdiNZqSP55oNqmZB sj69yPVeLRn0AmWAU5eiTSch1S+hlKb6M5miLGbUpYtMJ55Ulb8JB7ocIf4OR5hy6djhSGZCf Tv1kDtjpFDInXLfmah34p11DvELAKOYfAm8eafyuxeT99ocVG8FvZslGDO2rBoIyMtiDO3qHj E1NNCb4jjFHXtrRzPVEAzSDhNX0rgFJFtmFCzipOIRhmBgyOiI47f6RYrzlc7hudoT4Bawn0E h6pvGuwqI3XcT7Zlkl1n/lZyZ3Oajo8ww1bdNiIHM= Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org > On 21 Jan 2021, at 19:15, Marc Zyngier wrote: >=20 > On 2021-01-21 17:55, Will Deacon wrote: >> On Thu, Jan 21, 2021 at 04:25:54PM +0000, Marc Zyngier wrote: >>> On 2021-01-21 15:12, Mohamed Mediouni wrote: >>>> Please ignore that patch. >>>>=20 >>>> It turns out that the PCIe controller on Apple M1 expects posted >>>> writes and so the memory range for it ought to be set nGnRE. >>>> So, we need to use nGnRnE for on-chip MMIO and nGnRE for PCIe BARs. >>>>=20 >>>> The MAIR approach isn=E2=80=99t adequate for such a thing, so = we=E2=80=99ll have to >>>> look elsewhere. >>> Well, there isn't many alternative to having a memory type defined >>> in MAIR if you want to access your PCIe devices with specific >>> semantics. >>> It probably means defining a memory type for PCI only, but: >>> - we only have a single free MT entry, and I'm not sure we can >>> afford to waste this on a specific platform (can we re-purpose >>> GRE instead?), >> We already have an nGnRnE MAIR for config space accesses. >=20 > I'm confused. If M1 needs nGnRE for PCI, and overrides nGnRE to nE > for its in-SoC accesses, where does nGnRE goes? >=20 > Or do you propose that it is the page tables that get a different > MT index? >=20 That MAIR patch that I added overrides nGnRE accesses to nGnRnE. Linux tries to access to those SoC devices using nGnRE as the device memory type without that workaround. Maybe have a device tree property to override the used device memory = type for a given device on the SoC? Or that=E2=80=99s too big for what=E2=80=99= s at the end just one=20 particular set of SoCs? But what the hardware wants is accesses to in-SoC devices being nGnRnE and access to the PCIe BARs being nGnRE. So both have to be supported=E2=80=A6 > M. > --=20 > Jazz is not dead. It just smells funny... From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.7 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C7E9BC433E0 for ; Thu, 21 Jan 2021 18:24:13 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 6E9B923A54 for ; Thu, 21 Jan 2021 18:24:13 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 6E9B923A54 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=caramail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:To:References:Message-Id:Date:In-Reply-To:From: Subject:Mime-Version:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=vTNqtlNSl/NEVcj7RarGMd1/IwbBke7kSmDynNC4rFI=; b=Sw1HniLanknjbXknUaQ6M95Pb 2NbVJUlp53fBFGJ/DfcM0cOF3XoN50x7jtwSLOtFdkBK4IzGG8d/z8i35UUR5IHQmGYXsJLlGi3iv 4f7UQdS1lA9m1mHpz9QYDVibmxgGZe9kKNOaL6+y1vLuz8OIllCWrUhsvICqRkhIN+tEd5ksL6pZk dg0R0+OItL9AxUBlmqddJb0Tz/ZIHmlbFtIXL+JkmeSzFEyKIth0kuVKHHXdZprm1TjgO6GKOvG/V 3wIYNa/GXuP2s2JPjmfEmCW1QqD5gdFTX4V6pCX3X/N10FOryud0GtmmRrw1FqUEiQPma0ltZoesb 9e7LE7dXQ==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1l2ebO-0001fa-0l; Thu, 21 Jan 2021 18:22:38 +0000 Received: from mout.gmx.net ([212.227.15.19]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1l2ebK-0001ez-Ni for linux-arm-kernel@lists.infradead.org; Thu, 21 Jan 2021 18:22:36 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1611253347; bh=vjQW4TKGsW2UmvXkX37wzzORNHRYtgG6i43MdHHFZyA=; h=X-UI-Sender-Class:Subject:From:In-Reply-To:Date:Cc:References:To; b=Ifq3yy+Q7lX4+Xfh1riVy5QJshuBoKgtno4+JF9a+3kdEZEavjT84nBF9nxTpn/iJ VPzPpn4/R5HGKFnFuxabUuiDhF7BenSOAeHp/3cWzSOaWufKBMt/+a3j2zYcmmywwi iCA7lqGb9kVS/BUm8UYfx5uEAYNLDX25OubSKEas= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [10.42.0.78] ([83.204.192.78]) by mail.gmx.net (mrgmx004 [212.227.17.184]) with ESMTPSA (Nemesis) id 1MBUqL-1lAfLI0U2x-00D2B9; Thu, 21 Jan 2021 19:22:27 +0100 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.5\)) Subject: Re: [RFC PATCH 3/7] arm64: mm: use nGnRnE instead of nGnRE on Apple processors From: Mohamed Mediouni In-Reply-To: Date: Thu, 21 Jan 2021 19:22:24 +0100 Message-Id: References: <20210120132717.395873-1-mohamed.mediouni@caramail.com> <20210120132717.395873-4-mohamed.mediouni@caramail.com> <20210121112725.GA21750@willie-the-truck> <20210121124742.GA22123@willie-the-truck> <39067FDD-F7D3-4F37-8B43-1A9FCF80EEE5@caramail.com> <195e2bfe3a5e5503d9988b517159300e@kernel.org> <20210121175525.GB22963@willie-the-truck> To: Marc Zyngier X-Mailer: Apple Mail (2.3654.60.0.2.5) X-Provags-ID: V03:K1:oJoietTKBhqTacvuUkJhKDBzQhk4Fw1I8oOwZyqTy8PuEG05V8p ekOb75Wlvcot5alrctaV+g34TthGeQNLyY1TEcs32cx1c1JlfU0LyV5/sVP5TaPCes6jEE5 2x8HFk4dAsPyUSyVjq/XWEJ++yluOtqfMGDraR+S3bMkxa3zynxgI510dwzCY9575qpGwZx R6kBBpJYe5aQMUiCYur4g== X-UI-Out-Filterresults: notjunk:1;V03:K0:U7hoWESd7vc=:GE0XZFpaUwr7sxDB6iP6KN wd8CN6nExOuTnwum7nfBJBjkBgBby5++usJ+JAQ1PW3ZgWW1c1PKo3dG228MmCsq46YzE5yLR fVEdvbp+tmwphhNqPFQuaFaL3Wkcj44tYIMjfHNmGBlzdk1YIVoInjCZWvCrHU+ouXMeeUKrs brt4KQk+8C72QiXFwgBlUhgQAGhRzdWKREya512/URst8pW4vMmS9w89RS8GRgZlHS/bfIpCJ s7NCBDgWzKeR7fIT4z1Lm4p7KwQfxo02NL32TcO91ypvcnPJ4wCyqrIdrqsG+C9ByyDgh4XP9 8Y2ACZv48iBRiyo0ajpYw6+M3JtMZi+774uDZ5HaW5yVmGj67r3GdnQA8hpUOTjor6a9u9yMa bDOgwIhNZEojSD6he3mMwHGcfSxdoza9j9BDu7D6omGdrszLXL3b3UHtBLk0DnOARl9RCy408 wHVatGClgS/gjXk74ZwZs4RHH4OrVlEpoh4v91y8NX1l+6jwLCczKyiio8iIq3p+rG0LW7A9w o/tQSkrY1wz+ENpLWQVLh0hmUrKKugZZYF0lHMSOsWct9UwQpNnUy3g0uvorhUTw+ANZAX6QT YUuSg/jVm0QFSMvfVsbLq0FwxF0KqJc4BDIiqQJtnNc6NP7f+Un4xfjpXkdiNZqSP55oNqmZB sj69yPVeLRn0AmWAU5eiTSch1S+hlKb6M5miLGbUpYtMJ55Ulb8JB7ocIf4OR5hy6djhSGZCf Tv1kDtjpFDInXLfmah34p11DvELAKOYfAm8eafyuxeT99ocVG8FvZslGDO2rBoIyMtiDO3qHj E1NNCb4jjFHXtrRzPVEAzSDhNX0rgFJFtmFCzipOIRhmBgyOiI47f6RYrzlc7hudoT4Bawn0E h6pvGuwqI3XcT7Zlkl1n/lZyZ3Oajo8ww1bdNiIHM= X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210121_132235_659673_8751A4F0 X-CRM114-Status: GOOD ( 17.79 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Mark Rutland , Catalin Marinas , Hector Martin , linux-kernel@vger.kernel.org, Will Deacon , Linux ARM , Stan Skowronek Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Cj4gT24gMjEgSmFuIDIwMjEsIGF0IDE5OjE1LCBNYXJjIFp5bmdpZXIgPG1hekBrZXJuZWwub3Jn PiB3cm90ZToKPiAKPiBPbiAyMDIxLTAxLTIxIDE3OjU1LCBXaWxsIERlYWNvbiB3cm90ZToKPj4g T24gVGh1LCBKYW4gMjEsIDIwMjEgYXQgMDQ6MjU6NTRQTSArMDAwMCwgTWFyYyBaeW5naWVyIHdy b3RlOgo+Pj4gT24gMjAyMS0wMS0yMSAxNToxMiwgTW9oYW1lZCBNZWRpb3VuaSB3cm90ZToKPj4+ PiBQbGVhc2UgaWdub3JlIHRoYXQgcGF0Y2guCj4+Pj4gCj4+Pj4gSXQgdHVybnMgb3V0IHRoYXQg dGhlIFBDSWUgY29udHJvbGxlciBvbiBBcHBsZSBNMSBleHBlY3RzIHBvc3RlZAo+Pj4+IHdyaXRl cyBhbmQgc28gdGhlIG1lbW9yeSByYW5nZSBmb3IgaXQgb3VnaHQgdG8gYmUgc2V0IG5HblJFLgo+ Pj4+IFNvLCB3ZSBuZWVkIHRvIHVzZSBuR25SbkUgZm9yIG9uLWNoaXAgTU1JTyBhbmQgbkduUkUg Zm9yIFBDSWUgQkFScy4KPj4+PiAKPj4+PiBUaGUgTUFJUiBhcHByb2FjaCBpc27igJl0IGFkZXF1 YXRlIGZvciBzdWNoIGEgdGhpbmcsIHNvIHdl4oCZbGwgaGF2ZSB0bwo+Pj4+IGxvb2sgZWxzZXdo ZXJlLgo+Pj4gV2VsbCwgdGhlcmUgaXNuJ3QgbWFueSBhbHRlcm5hdGl2ZSB0byBoYXZpbmcgYSBt ZW1vcnkgdHlwZSBkZWZpbmVkCj4+PiBpbiBNQUlSIGlmIHlvdSB3YW50IHRvIGFjY2VzcyB5b3Vy IFBDSWUgZGV2aWNlcyB3aXRoIHNwZWNpZmljCj4+PiBzZW1hbnRpY3MuCj4+PiBJdCBwcm9iYWJs eSBtZWFucyBkZWZpbmluZyBhIG1lbW9yeSB0eXBlIGZvciBQQ0kgb25seSwgYnV0Ogo+Pj4gLSB3 ZSBvbmx5IGhhdmUgYSBzaW5nbGUgZnJlZSBNVCBlbnRyeSwgYW5kIEknbSBub3Qgc3VyZSB3ZSBj YW4KPj4+IGFmZm9yZCB0byB3YXN0ZSB0aGlzIG9uIGEgc3BlY2lmaWMgcGxhdGZvcm0gKGNhbiB3 ZSByZS1wdXJwb3NlCj4+PiBHUkUgaW5zdGVhZD8pLAo+PiBXZSBhbHJlYWR5IGhhdmUgYW4gbkdu Um5FIE1BSVIgZm9yIGNvbmZpZyBzcGFjZSBhY2Nlc3Nlcy4KPiAKPiBJJ20gY29uZnVzZWQuIElm IE0xIG5lZWRzIG5HblJFIGZvciBQQ0ksIGFuZCBvdmVycmlkZXMgbkduUkUgdG8gbkUKPiBmb3Ig aXRzIGluLVNvQyBhY2Nlc3Nlcywgd2hlcmUgZG9lcyBuR25SRSBnb2VzPwo+IAo+IE9yIGRvIHlv dSBwcm9wb3NlIHRoYXQgaXQgaXMgdGhlIHBhZ2UgdGFibGVzIHRoYXQgZ2V0IGEgZGlmZmVyZW50 Cj4gTVQgaW5kZXg/Cj4gCgpUaGF0IE1BSVIgcGF0Y2ggdGhhdCBJIGFkZGVkIG92ZXJyaWRlcyBu R25SRSBhY2Nlc3NlcyB0byBuR25SbkUuCgpMaW51eCB0cmllcyB0byBhY2Nlc3MgdG8gdGhvc2Ug U29DIGRldmljZXMgdXNpbmcgbkduUkUgYXMgdGhlIGRldmljZQptZW1vcnkgdHlwZSB3aXRob3V0 IHRoYXQgd29ya2Fyb3VuZC4KCk1heWJlIGhhdmUgYSBkZXZpY2UgdHJlZSBwcm9wZXJ0eSB0byBv dmVycmlkZSB0aGUgdXNlZCBkZXZpY2UgbWVtb3J5IHR5cGUKZm9yIGEgZ2l2ZW4gZGV2aWNlIG9u IHRoZSBTb0M/IE9yIHRoYXTigJlzIHRvbyBiaWcgZm9yIHdoYXTigJlzIGF0IHRoZSBlbmQganVz dCBvbmUgCnBhcnRpY3VsYXIgc2V0IG9mIFNvQ3M/CgpCdXQgd2hhdCB0aGUgaGFyZHdhcmUgd2Fu dHMgaXMgYWNjZXNzZXMgdG8gaW4tU29DIGRldmljZXMgYmVpbmcgbkduUm5FCmFuZCBhY2Nlc3Mg dG8gdGhlIFBDSWUgQkFScyBiZWluZyBuR25SRS4KClNvIGJvdGggaGF2ZSB0byBiZSBzdXBwb3J0 ZWTigKYKCj4gICAgICAgTS4KPiAtLSAKPiBKYXp6IGlzIG5vdCBkZWFkLiBJdCBqdXN0IHNtZWxs cyBmdW5ueS4uLgoKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fCmxpbnV4LWFybS1rZXJuZWwgbWFpbGluZyBsaXN0CmxpbnV4LWFybS1rZXJuZWxAbGlzdHMu aW5mcmFkZWFkLm9yZwpodHRwOi8vbGlzdHMuaW5mcmFkZWFkLm9yZy9tYWlsbWFuL2xpc3RpbmZv L2xpbnV4LWFybS1rZXJuZWwK