From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-17.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI,NICE_REPLY_A, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id BBCC2C11F67 for ; Tue, 29 Jun 2021 12:04:25 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id A40ED61D40 for ; Tue, 29 Jun 2021 12:04:25 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232855AbhF2MGv (ORCPT ); Tue, 29 Jun 2021 08:06:51 -0400 Received: from smtp-fw-2101.amazon.com ([72.21.196.25]:62494 "EHLO smtp-fw-2101.amazon.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232493AbhF2MGq (ORCPT ); Tue, 29 Jun 2021 08:06:46 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1624968259; x=1656504259; h=message-id:date:mime-version:subject:to:cc:references: from:in-reply-to:content-transfer-encoding; bh=4VTqRt/doBhcHug+DYEpXm+V0vDuSlC/ctdi9x/3mQY=; b=SaDfVkv2Tt48PjDiFVFJRvuLGygL5RCpOtrvTZhUgVP9y1sSHvfWtwch hjoUtgJ6tjEXCtdHtly5S9W7CDBw//4oHn1wzYp0/kWhd178vAEmeQ/Pr ovExh0xsHz8/svWH4xapjge35TkSr59TE5UCEzBLMUjg76/WnxuG2UmXK 8=; X-IronPort-AV: E=Sophos;i="5.83,308,1616457600"; d="scan'208";a="119057987" Received: from iad12-co-svc-p1-lb1-vlan2.amazon.com (HELO email-inbound-relay-2b-baacba05.us-west-2.amazon.com) ([10.43.8.2]) by smtp-border-fw-2101.iad2.amazon.com with ESMTP; 29 Jun 2021 12:04:10 +0000 Received: from EX13MTAUWC002.ant.amazon.com (pdx1-ws-svc-p6-lb9-vlan2.pdx.amazon.com [10.236.137.194]) by email-inbound-relay-2b-baacba05.us-west-2.amazon.com (Postfix) with ESMTPS id F07C8A1FD3; Tue, 29 Jun 2021 12:04:08 +0000 (UTC) Received: from EX13D20UWC001.ant.amazon.com (10.43.162.244) by EX13MTAUWC002.ant.amazon.com (10.43.162.240) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Tue, 29 Jun 2021 12:04:08 +0000 Received: from [192.168.9.117] (10.43.161.153) by EX13D20UWC001.ant.amazon.com (10.43.162.244) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Tue, 29 Jun 2021 12:04:05 +0000 Message-ID: <50d48c57-b6f4-aad9-2471-ea3d3066563d@amazon.com> Date: Tue, 29 Jun 2021 14:04:03 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:90.0) Gecko/20100101 Thunderbird/90.0 Subject: Re: [PATCH v4 1/3] iommu: io-pgtable: add DART pagetable format Content-Language: en-US To: Sven Peter , Will Deacon , "Robin Murphy" , Joerg Roedel CC: Arnd Bergmann , , "Hector Martin" , , Marc Zyngier , Mohamed Mediouni , "Stan Skowronek" , , "Mark Kettenis" , Petr Mladek via iommu , Alyssa Rosenzweig , Rob Herring , "Rouven Czerwinski" References: <20210627143405.77298-1-sven@svenpeter.dev> <20210627143405.77298-2-sven@svenpeter.dev> <3a43b2de-6a71-2373-8695-5e96657c8fc2@amazon.com> From: Alexander Graf In-Reply-To: X-Originating-IP: [10.43.161.153] X-ClientProxiedBy: EX13D21UWA004.ant.amazon.com (10.43.160.252) To EX13D20UWC001.ant.amazon.com (10.43.162.244) Content-Type: text/plain; charset="utf-8"; format="flowed" Content-Transfer-Encoding: base64 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org CgpPbiAyOS4wNi4yMSAwOTozNywgU3ZlbiBQZXRlciB3cm90ZToKPiAKPiBPbiBNb24sIEp1biAy OCwgMjAyMSwgYXQgMTI6NTQsIEFsZXhhbmRlciBHcmFmIHdyb3RlOgo+Pgo+Pgo+PiBPbiAyNy4w Ni4yMSAxNjozNCwgU3ZlbiBQZXRlciB3cm90ZToKPj4+Cj4+PiBBcHBsZSdzIERBUlQgaW9tbXUg dXNlcyBhIHBhZ2V0YWJsZSBmb3JtYXQgdGhhdCBzaGFyZXMgc29tZQo+Pj4gc2ltaWxhcml0aWVz IHdpdGggdGhlIG9uZXMgYWxyZWFkeSBpbXBsZW1lbnRlZCBieSBpby1wZ3RhYmxlLmMuCj4+PiBB ZGQgYSBuZXcgZm9ybWF0IHZhcmlhbnQgdG8gc3VwcG9ydCB0aGUgcmVxdWlyZWQgZGlmZmVyZW5j ZXMKPj4+IHNvIHRoYXQgd2UgZG9uJ3QgaGF2ZSB0byBkdXBsaWNhdGUgdGhlIHBhZ2V0YWJsZSBo YW5kbGluZyBjb2RlLgo+Pj4KPj4+IFNpZ25lZC1vZmYtYnk6IFN2ZW4gUGV0ZXIgPHN2ZW5Ac3Zl bnBldGVyLmRldj4KPj4+IC0tLQo+Pj4gICAgZHJpdmVycy9pb21tdS9pby1wZ3RhYmxlLWFybS5j IHwgNjIgKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKwo+Pj4gICAgZHJpdmVycy9p b21tdS9pby1wZ3RhYmxlLmMgICAgIHwgIDEgKwo+Pj4gICAgaW5jbHVkZS9saW51eC9pby1wZ3Rh YmxlLmggICAgIHwgIDcgKysrKwo+Pj4gICAgMyBmaWxlcyBjaGFuZ2VkLCA3MCBpbnNlcnRpb25z KCspCj4+Pgo+Pj4gZGlmZiAtLWdpdCBhL2RyaXZlcnMvaW9tbXUvaW8tcGd0YWJsZS1hcm0uYyBi L2RyaXZlcnMvaW9tbXUvaW8tcGd0YWJsZS1hcm0uYwo+Pj4gaW5kZXggODdkZWY1OGU3OWI1Li4x ZGQ1YzQ1YjRiNWIgMTAwNjQ0Cj4+PiAtLS0gYS9kcml2ZXJzL2lvbW11L2lvLXBndGFibGUtYXJt LmMKPj4+ICsrKyBiL2RyaXZlcnMvaW9tbXUvaW8tcGd0YWJsZS1hcm0uYwo+Pj4gQEAgLTEyNyw2 ICsxMjcsOSBAQAo+Pj4gICAgI2RlZmluZSBBUk1fTUFMSV9MUEFFX01FTUFUVFJfSU1QX0RFRiAg MHg4OFVMTAo+Pj4gICAgI2RlZmluZSBBUk1fTUFMSV9MUEFFX01FTUFUVFJfV1JJVEVfQUxMT0Mg MHg4RFVMTAo+Pj4KPj4+ICsjZGVmaW5lIEFQUExFX0RBUlRfUFRFX1BST1RfTk9fV1JJVEUgKDE8 PDcpCj4+PiArI2RlZmluZSBBUFBMRV9EQVJUX1BURV9QUk9UX05PX1JFQUQgKDE8PDgpCj4+PiAr Cj4+PiAgICAvKiBJT1BURSBhY2Nlc3NvcnMgKi8KPj4+ICAgICNkZWZpbmUgaW9wdGVfZGVyZWYo cHRlLGQpIF9fdmEoaW9wdGVfdG9fcGFkZHIocHRlLCBkKSkKPj4+Cj4+PiBAQCAtMzgxLDYgKzM4 NCwxNSBAQCBzdGF0aWMgYXJtX2xwYWVfaW9wdGUgYXJtX2xwYWVfcHJvdF90b19wdGUoc3RydWN0 IGFybV9scGFlX2lvX3BndGFibGUgKmRhdGEsCj4+PiAgICB7Cj4+PiAgICAgICAgICAgYXJtX2xw YWVfaW9wdGUgcHRlOwo+Pj4KPj4+ICsgICAgICAgaWYgKGRhdGEtPmlvcC5mbXQgPT0gQVJNX0FQ UExFX0RBUlQpIHsKPj4+ICsgICAgICAgICAgICAgICBwdGUgPSAwOwo+Pj4gKyAgICAgICAgICAg ICAgIGlmICghKHByb3QgJiBJT01NVV9XUklURSkpCj4+PiArICAgICAgICAgICAgICAgICAgICAg ICBwdGUgfD0gQVBQTEVfREFSVF9QVEVfUFJPVF9OT19XUklURTsKPj4+ICsgICAgICAgICAgICAg ICBpZiAoIShwcm90ICYgSU9NTVVfUkVBRCkpCj4+PiArICAgICAgICAgICAgICAgICAgICAgICBw dGUgfD0gQVBQTEVfREFSVF9QVEVfUFJPVF9OT19SRUFEOwo+Pj4gKyAgICAgICAgICAgICAgIHJl dHVybiBwdGU7Cj4+Cj4+IFdoYXQgYWJvdXQgdGhlIG90aGVyIGJpdHMsIHN1Y2ggYXMgc2hhcmFi aWxpdHksIFhOLCBldGM/IERvIHRoZXkgbm90Cj4+IGV4aXN0IG9uIERBUlQ/IE9yIGhhdmUgdGhl eSBub3QgYmVlbiByZXZlcnNlIGVuZ2luZWVyZWQgYW5kIDBzIGhhcHBlbiB0bwo+PiAianVzdCB3 b3JrIj8KPiAKPiBJJ20gZmFpcmx5IGNlcnRhaW4gdGhleSBkb24ndCBleGlzdCAob3IgYXJlIGF0 IGxlYXN0IG5vdCB1c2VkIGJ5IFhOVSkuCj4gCj4gVGhlIGNvLXByb2Nlc3NvcnMgdGhhdCBjYW4g cnVuIGNvZGUgYWxzbyBlaXRoZXIgdXNlIGFuIGVudGlyZSBzZXBhcmF0ZSBpb21tdQo+IChlLmcu IHRoZSBHUFUpIG9yIG9ubHkgdXNlIERBUlQgYXMgYSAic2Vjb25kIHN0YWdlIiBhbmQgaGF2ZSB0 aGVpciBvd24KPiBNTVUgd2hpY2ggZS5nLiBoYW5kbGVzIFhOIChlLmcuIHRoZSBTRVAgb3IgQU9Q KS4KCk9rIDopLgoKPiAKPj4KPj4+ICsgICAgICAgfQo+Pj4gKwo+Pj4gICAgICAgICAgIGlmIChk YXRhLT5pb3AuZm10ID09IEFSTV82NF9MUEFFX1MxIHx8Cj4+PiAgICAgICAgICAgICAgIGRhdGEt PmlvcC5mbXQgPT0gQVJNXzMyX0xQQUVfUzEpIHsKPj4+ICAgICAgICAgICAgICAgICAgIHB0ZSA9 IEFSTV9MUEFFX1BURV9uRzsKPj4+IEBAIC0xMDQzLDYgKzEwNTUsNTEgQEAgYXJtX21hbGlfbHBh ZV9hbGxvY19wZ3RhYmxlKHN0cnVjdCBpb19wZ3RhYmxlX2NmZyAqY2ZnLCB2b2lkICpjb29raWUp Cj4+PiAgICAgICAgICAgcmV0dXJuIE5VTEw7Cj4+PiAgICB9Cj4+Pgo+Pj4gK3N0YXRpYyBzdHJ1 Y3QgaW9fcGd0YWJsZSAqCj4+PiArYXBwbGVfZGFydF9hbGxvY19wZ3RhYmxlKHN0cnVjdCBpb19w Z3RhYmxlX2NmZyAqY2ZnLCB2b2lkICpjb29raWUpCj4+PiArewo+Pj4gKyAgICAgICBzdHJ1Y3Qg YXJtX2xwYWVfaW9fcGd0YWJsZSAqZGF0YTsKPj4+ICsgICAgICAgaW50IGk7Cj4+PiArCj4+PiAr ICAgICAgIGlmIChjZmctPm9hcyA+IDM2KQo+Pj4gKyAgICAgICAgICAgICAgIHJldHVybiBOVUxM Owo+Pj4gKwo+Pj4gKyAgICAgICBkYXRhID0gYXJtX2xwYWVfYWxsb2NfcGd0YWJsZShjZmcpOwo+ Pj4gKyAgICAgICBpZiAoIWRhdGEpCj4+PiArICAgICAgICAgICAgICAgcmV0dXJuIE5VTEw7Cj4+ PiArCj4+PiArICAgICAgIC8qCj4+PiArICAgICAgICAqIEFwcGxlJ3MgREFSVCBhbHdheXMgcmVx dWlyZXMgdGhyZWUgbGV2ZWxzIHdpdGggdGhlIGZpcnN0IGxldmVsIGJlaW5nCj4+PiArICAgICAg ICAqIHN0b3JlZCBpbiBmb3VyIE1NSU8gcmVnaXN0ZXJzLiBXZSBhbHdheXMgY29uY2F0ZW5hdGUg dGhlIGZpcnN0IGFuZAo+Pj4gKyAgICAgICAgKiBzZWNvbmQgbGV2ZWwgc28gdGhhdCB3ZSBvbmx5 IGhhdmUgdG8gc2V0dXAgdGhlIE1NSU8gcmVnaXN0ZXJzIG9uY2UuCj4+PiArICAgICAgICAqIFRo aXMgcmVzdWx0cyBpbiBhbiBlZmZlY3RpdmUgdHdvIGxldmVsIHBhZ2V0YWJsZS4KPj4+ICsgICAg ICAgICovCj4+PiArICAgICAgIGlmIChkYXRhLT5zdGFydF9sZXZlbCA8IDEpCj4+PiArICAgICAg ICAgICAgICAgcmV0dXJuIE5VTEw7Cj4+PiArICAgICAgIGlmIChkYXRhLT5zdGFydF9sZXZlbCA9 PSAxICYmIGRhdGEtPnBnZF9iaXRzID4gMikKPj4+ICsgICAgICAgICAgICAgICByZXR1cm4gTlVM TDsKPj4+ICsgICAgICAgaWYgKGRhdGEtPnN0YXJ0X2xldmVsID4gMSkKPj4+ICsgICAgICAgICAg ICAgICBkYXRhLT5wZ2RfYml0cyA9IDA7Cj4+PiArICAgICAgIGRhdGEtPnN0YXJ0X2xldmVsID0g MjsKPj4+ICsgICAgICAgY2ZnLT5hcHBsZV9kYXJ0X2NmZy5uX3R0YnJzID0gMSA8PCBkYXRhLT5w Z2RfYml0czsKPj4KPj4gTWF5YmUgYWRkIGEgQlVHX09OIGlmIG5fdHRicnMgPiBBUlJBWV9TSVpF KHR0YnIpPyBPciBhbHRlcm5hdGl2ZWx5LCBkbyBhCj4+IG5vcm1hbCBydW50aW1lIGNoZWNrIGFu ZCBiYWlsIG91dCB0aGVuLgo+IAo+IG5fdHRicnMgY2FuJ3QgYWN0dWFsbHkgYmUgbGFyZ2VyIHRo YW4gNCBhdCB0aGlzIHBvaW50IGFscmVhZHkgZHVlIHRvIHRoZQo+IHByZXZpb3VzIGNoZWNrcy4K PiBJIGNhbiBhZGQgYSBCVUdfT04gdGhvdWdoIGp1c3QgdG8gbWFrZSBpdCBleHBsaWNpdCBhbmQg YmUgc2FmZSBpbiBjYXNlIHRob3NlCj4gY2hlY2tzIG9yIHRoZSBhcnJheSBzaXplIGV2ZXIgY2hh bmdlLgoKQWgsIG5vdyBJIHNlZSBpdCB0b28uIE5vIHdvcnJpZXMgdGhlbiAtIEkgYWdyZWUgdGhh dCB5b3UgaGF2ZSBhbGwgY2FzZXMgCmNvdmVyZWQuCgpSZXZpZXdlZC1ieTogQWxleGFuZGVyIEdy YWYgPGdyYWZAYW1hem9uLmNvbT4KCgpBbGV4CgoKCkFtYXpvbiBEZXZlbG9wbWVudCBDZW50ZXIg R2VybWFueSBHbWJICktyYXVzZW5zdHIuIDM4CjEwMTE3IEJlcmxpbgpHZXNjaGFlZnRzZnVlaHJ1 bmc6IENocmlzdGlhbiBTY2hsYWVnZXIsIEpvbmF0aGFuIFdlaXNzCkVpbmdldHJhZ2VuIGFtIEFt dHNnZXJpY2h0IENoYXJsb3R0ZW5idXJnIHVudGVyIEhSQiAxNDkxNzMgQgpTaXR6OiBCZXJsaW4K VXN0LUlEOiBERSAyODkgMjM3IDg3OQoKCg== From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-15.1 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 51064C11F66 for ; Tue, 29 Jun 2021 12:04:24 +0000 (UTC) Received: from smtp1.osuosl.org (smtp1.osuosl.org [140.211.166.138]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id D5B4D61006 for ; Tue, 29 Jun 2021 12:04:23 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org D5B4D61006 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=lists.linux-foundation.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=iommu-bounces@lists.linux-foundation.org Received: from localhost (localhost [127.0.0.1]) by smtp1.osuosl.org (Postfix) with ESMTP id 95431836F0; Tue, 29 Jun 2021 12:04:23 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp1.osuosl.org ([127.0.0.1]) by localhost (smtp1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1TmVDPaE9AFS; Tue, 29 Jun 2021 12:04:22 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [140.211.9.56]) by smtp1.osuosl.org (Postfix) with ESMTPS id 6DD1B835A7; Tue, 29 Jun 2021 12:04:22 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id 49A91C001A; Tue, 29 Jun 2021 12:04:22 +0000 (UTC) Received: from smtp2.osuosl.org (smtp2.osuosl.org [IPv6:2605:bc80:3010::133]) by lists.linuxfoundation.org (Postfix) with ESMTP id 2A73DC000E for ; Tue, 29 Jun 2021 12:04:21 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with ESMTP id 1640B402DA for ; Tue, 29 Jun 2021 12:04:21 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Authentication-Results: smtp2.osuosl.org (amavisd-new); dkim=pass (1024-bit key) header.d=amazon.com Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Q9TDwf-4fWGh for ; Tue, 29 Jun 2021 12:04:20 +0000 (UTC) X-Greylist: whitelisted by SQLgrey-1.8.0 Received: from smtp-fw-2101.amazon.com (smtp-fw-2101.amazon.com [72.21.196.25]) by smtp2.osuosl.org (Postfix) with ESMTPS id 34AB24037B for ; Tue, 29 Jun 2021 12:04:20 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1624968260; x=1656504260; h=message-id:date:mime-version:subject:to:cc:references: from:in-reply-to:content-transfer-encoding; bh=4VTqRt/doBhcHug+DYEpXm+V0vDuSlC/ctdi9x/3mQY=; b=HbHk8tReUr8yitD8kESugPGJwL5QSKIbq7r5xKMHszY0nAlJYG88mv1N G3A+pSg0leTeZYIhHaUEd6PckzN/vyX4gYnZITua54r2iwr8SOkAWeUpJ /pUQs1mOHLD1gTcG/M4cn6FmvLOo6USks34zyLm6i0M4+jJM6KzqkqOEC Y=; X-IronPort-AV: E=Sophos;i="5.83,308,1616457600"; d="scan'208";a="119057987" Received: from iad12-co-svc-p1-lb1-vlan2.amazon.com (HELO email-inbound-relay-2b-baacba05.us-west-2.amazon.com) ([10.43.8.2]) by smtp-border-fw-2101.iad2.amazon.com with ESMTP; 29 Jun 2021 12:04:10 +0000 Received: from EX13MTAUWC002.ant.amazon.com (pdx1-ws-svc-p6-lb9-vlan2.pdx.amazon.com [10.236.137.194]) by email-inbound-relay-2b-baacba05.us-west-2.amazon.com (Postfix) with ESMTPS id F07C8A1FD3; Tue, 29 Jun 2021 12:04:08 +0000 (UTC) Received: from EX13D20UWC001.ant.amazon.com (10.43.162.244) by EX13MTAUWC002.ant.amazon.com (10.43.162.240) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Tue, 29 Jun 2021 12:04:08 +0000 Received: from [192.168.9.117] (10.43.161.153) by EX13D20UWC001.ant.amazon.com (10.43.162.244) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Tue, 29 Jun 2021 12:04:05 +0000 Message-ID: <50d48c57-b6f4-aad9-2471-ea3d3066563d@amazon.com> Date: Tue, 29 Jun 2021 14:04:03 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:90.0) Gecko/20100101 Thunderbird/90.0 Subject: Re: [PATCH v4 1/3] iommu: io-pgtable: add DART pagetable format Content-Language: en-US To: Sven Peter , Will Deacon , "Robin Murphy" , Joerg Roedel References: <20210627143405.77298-1-sven@svenpeter.dev> <20210627143405.77298-2-sven@svenpeter.dev> <3a43b2de-6a71-2373-8695-5e96657c8fc2@amazon.com> In-Reply-To: X-Originating-IP: [10.43.161.153] X-ClientProxiedBy: EX13D21UWA004.ant.amazon.com (10.43.160.252) To EX13D20UWC001.ant.amazon.com (10.43.162.244) Cc: Arnd Bergmann , Rouven Czerwinski , devicetree@vger.kernel.org, Marc Zyngier , Hector Martin , linux-kernel@vger.kernel.org, Petr Mladek via iommu , Rob Herring , Alyssa Rosenzweig , Mohamed Mediouni , Mark Kettenis , linux-arm-kernel@lists.infradead.org, Stan Skowronek X-BeenThere: iommu@lists.linux-foundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Development issues for Linux IOMMU support List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: Alexander Graf via iommu Reply-To: Alexander Graf Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Errors-To: iommu-bounces@lists.linux-foundation.org Sender: "iommu" On 29.06.21 09:37, Sven Peter wrote: > > On Mon, Jun 28, 2021, at 12:54, Alexander Graf wrote: >> >> >> On 27.06.21 16:34, Sven Peter wrote: >>> >>> Apple's DART iommu uses a pagetable format that shares some >>> similarities with the ones already implemented by io-pgtable.c. >>> Add a new format variant to support the required differences >>> so that we don't have to duplicate the pagetable handling code. >>> >>> Signed-off-by: Sven Peter >>> --- >>> drivers/iommu/io-pgtable-arm.c | 62 ++++++++++++++++++++++++++++++++++ >>> drivers/iommu/io-pgtable.c | 1 + >>> include/linux/io-pgtable.h | 7 ++++ >>> 3 files changed, 70 insertions(+) >>> >>> diff --git a/drivers/iommu/io-pgtable-arm.c b/drivers/iommu/io-pgtable-arm.c >>> index 87def58e79b5..1dd5c45b4b5b 100644 >>> --- a/drivers/iommu/io-pgtable-arm.c >>> +++ b/drivers/iommu/io-pgtable-arm.c >>> @@ -127,6 +127,9 @@ >>> #define ARM_MALI_LPAE_MEMATTR_IMP_DEF 0x88ULL >>> #define ARM_MALI_LPAE_MEMATTR_WRITE_ALLOC 0x8DULL >>> >>> +#define APPLE_DART_PTE_PROT_NO_WRITE (1<<7) >>> +#define APPLE_DART_PTE_PROT_NO_READ (1<<8) >>> + >>> /* IOPTE accessors */ >>> #define iopte_deref(pte,d) __va(iopte_to_paddr(pte, d)) >>> >>> @@ -381,6 +384,15 @@ static arm_lpae_iopte arm_lpae_prot_to_pte(struct arm_lpae_io_pgtable *data, >>> { >>> arm_lpae_iopte pte; >>> >>> + if (data->iop.fmt == ARM_APPLE_DART) { >>> + pte = 0; >>> + if (!(prot & IOMMU_WRITE)) >>> + pte |= APPLE_DART_PTE_PROT_NO_WRITE; >>> + if (!(prot & IOMMU_READ)) >>> + pte |= APPLE_DART_PTE_PROT_NO_READ; >>> + return pte; >> >> What about the other bits, such as sharability, XN, etc? Do they not >> exist on DART? Or have they not been reverse engineered and 0s happen to >> "just work"? > > I'm fairly certain they don't exist (or are at least not used by XNU). > > The co-processors that can run code also either use an entire separate iommu > (e.g. the GPU) or only use DART as a "second stage" and have their own > MMU which e.g. handles XN (e.g. the SEP or AOP). Ok :). > >> >>> + } >>> + >>> if (data->iop.fmt == ARM_64_LPAE_S1 || >>> data->iop.fmt == ARM_32_LPAE_S1) { >>> pte = ARM_LPAE_PTE_nG; >>> @@ -1043,6 +1055,51 @@ arm_mali_lpae_alloc_pgtable(struct io_pgtable_cfg *cfg, void *cookie) >>> return NULL; >>> } >>> >>> +static struct io_pgtable * >>> +apple_dart_alloc_pgtable(struct io_pgtable_cfg *cfg, void *cookie) >>> +{ >>> + struct arm_lpae_io_pgtable *data; >>> + int i; >>> + >>> + if (cfg->oas > 36) >>> + return NULL; >>> + >>> + data = arm_lpae_alloc_pgtable(cfg); >>> + if (!data) >>> + return NULL; >>> + >>> + /* >>> + * Apple's DART always requires three levels with the first level being >>> + * stored in four MMIO registers. We always concatenate the first and >>> + * second level so that we only have to setup the MMIO registers once. >>> + * This results in an effective two level pagetable. >>> + */ >>> + if (data->start_level < 1) >>> + return NULL; >>> + if (data->start_level == 1 && data->pgd_bits > 2) >>> + return NULL; >>> + if (data->start_level > 1) >>> + data->pgd_bits = 0; >>> + data->start_level = 2; >>> + cfg->apple_dart_cfg.n_ttbrs = 1 << data->pgd_bits; >> >> Maybe add a BUG_ON if n_ttbrs > ARRAY_SIZE(ttbr)? Or alternatively, do a >> normal runtime check and bail out then. > > n_ttbrs can't actually be larger than 4 at this point already due to the > previous checks. > I can add a BUG_ON though just to make it explicit and be safe in case those > checks or the array size ever change. Ah, now I see it too. No worries then - I agree that you have all cases covered. Reviewed-by: Alexander Graf Alex Amazon Development Center Germany GmbH Krausenstr. 38 10117 Berlin Geschaeftsfuehrung: Christian Schlaeger, Jonathan Weiss Eingetragen am Amtsgericht Charlottenburg unter HRB 149173 B Sitz: Berlin Ust-ID: DE 289 237 879 _______________________________________________ iommu mailing list iommu@lists.linux-foundation.org https://lists.linuxfoundation.org/mailman/listinfo/iommu From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-14.9 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_ADSP_ALL,DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI,NICE_REPLY_A, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id BCCB0C11F66 for ; Tue, 29 Jun 2021 12:06:12 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 8693E61D6E for ; Tue, 29 Jun 2021 12:06:12 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 8693E61D6E Authentication-Results: mail.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=amazon.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:Content-Type: Content-Transfer-Encoding:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:From:References:CC:To:Subject: MIME-Version:Date:Message-ID:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=pSYVJX/WbX0gXZfBRGHcQFHm8hqA9VQq9wtsD2B5wKM=; b=WLJwTOvSuZH9ts FnBRAMc98QyADQ5PIw13i7poUDovvy/gZNZdqCk7V09NPP6iB9Wke39tO49O4oPHsQ6Hsxbbed0Vl Jpn20gEdfJft7343gwPR1LFx7luTp42W0q7B2dDPLhS4VgEhypwFWIZURRX3R2TLmFnNMeNseaL3r d7xM05A1sRG0dB+5ljtT8B8Z5/EkzBPSxuqLDQbmAy2C2i2ZZZvZ5ww2V5b6JHVi2KolFQxOv7u5z WoeOMwETdzCwq3+mpEJyJqBKazYqGTBCak6qRSMejJ8Za8OkMIORkBtISLydqw/bDdHfCI6yTzUip dNfnxqghvS2qWAm/X95g==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1lyCTa-00AlHN-Tt; Tue, 29 Jun 2021 12:04:27 +0000 Received: from smtp-fw-2101.amazon.com ([72.21.196.25]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1lyCTW-00AlGY-Jp for linux-arm-kernel@lists.infradead.org; Tue, 29 Jun 2021 12:04:24 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1624968262; x=1656504262; h=message-id:date:mime-version:subject:to:cc:references: from:in-reply-to:content-transfer-encoding; bh=4VTqRt/doBhcHug+DYEpXm+V0vDuSlC/ctdi9x/3mQY=; b=p2dtAKHjBVCSonUUOOLf7HkYDWNQu8qwoEp6cUjZT/mX1v3oZe2LrPad f+5lmoi5hH/OXHoN0etxzlE7g2avpAm8gyWCRRXsWmSAK03aW9lTwnb4C MEF7iXP54ofzB/CJmcO/jySRPpoejHyr/VKUtZhZFYXMgZ1yrp8spKgFW U=; X-IronPort-AV: E=Sophos;i="5.83,308,1616457600"; d="scan'208";a="119057987" Received: from iad12-co-svc-p1-lb1-vlan2.amazon.com (HELO email-inbound-relay-2b-baacba05.us-west-2.amazon.com) ([10.43.8.2]) by smtp-border-fw-2101.iad2.amazon.com with ESMTP; 29 Jun 2021 12:04:10 +0000 Received: from EX13MTAUWC002.ant.amazon.com (pdx1-ws-svc-p6-lb9-vlan2.pdx.amazon.com [10.236.137.194]) by email-inbound-relay-2b-baacba05.us-west-2.amazon.com (Postfix) with ESMTPS id F07C8A1FD3; Tue, 29 Jun 2021 12:04:08 +0000 (UTC) Received: from EX13D20UWC001.ant.amazon.com (10.43.162.244) by EX13MTAUWC002.ant.amazon.com (10.43.162.240) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Tue, 29 Jun 2021 12:04:08 +0000 Received: from [192.168.9.117] (10.43.161.153) by EX13D20UWC001.ant.amazon.com (10.43.162.244) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Tue, 29 Jun 2021 12:04:05 +0000 Message-ID: <50d48c57-b6f4-aad9-2471-ea3d3066563d@amazon.com> Date: Tue, 29 Jun 2021 14:04:03 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:90.0) Gecko/20100101 Thunderbird/90.0 Subject: Re: [PATCH v4 1/3] iommu: io-pgtable: add DART pagetable format Content-Language: en-US To: Sven Peter , Will Deacon , "Robin Murphy" , Joerg Roedel CC: Arnd Bergmann , , "Hector Martin" , , Marc Zyngier , Mohamed Mediouni , "Stan Skowronek" , , "Mark Kettenis" , Petr Mladek via iommu , Alyssa Rosenzweig , Rob Herring , "Rouven Czerwinski" References: <20210627143405.77298-1-sven@svenpeter.dev> <20210627143405.77298-2-sven@svenpeter.dev> <3a43b2de-6a71-2373-8695-5e96657c8fc2@amazon.com> From: Alexander Graf In-Reply-To: X-Originating-IP: [10.43.161.153] X-ClientProxiedBy: EX13D21UWA004.ant.amazon.com (10.43.160.252) To EX13D20UWC001.ant.amazon.com (10.43.162.244) X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210629_050422_834598_62F5C4B5 X-CRM114-Status: GOOD ( 25.58 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On 29.06.21 09:37, Sven Peter wrote: > > On Mon, Jun 28, 2021, at 12:54, Alexander Graf wrote: >> >> >> On 27.06.21 16:34, Sven Peter wrote: >>> >>> Apple's DART iommu uses a pagetable format that shares some >>> similarities with the ones already implemented by io-pgtable.c. >>> Add a new format variant to support the required differences >>> so that we don't have to duplicate the pagetable handling code. >>> >>> Signed-off-by: Sven Peter >>> --- >>> drivers/iommu/io-pgtable-arm.c | 62 ++++++++++++++++++++++++++++++++++ >>> drivers/iommu/io-pgtable.c | 1 + >>> include/linux/io-pgtable.h | 7 ++++ >>> 3 files changed, 70 insertions(+) >>> >>> diff --git a/drivers/iommu/io-pgtable-arm.c b/drivers/iommu/io-pgtable-arm.c >>> index 87def58e79b5..1dd5c45b4b5b 100644 >>> --- a/drivers/iommu/io-pgtable-arm.c >>> +++ b/drivers/iommu/io-pgtable-arm.c >>> @@ -127,6 +127,9 @@ >>> #define ARM_MALI_LPAE_MEMATTR_IMP_DEF 0x88ULL >>> #define ARM_MALI_LPAE_MEMATTR_WRITE_ALLOC 0x8DULL >>> >>> +#define APPLE_DART_PTE_PROT_NO_WRITE (1<<7) >>> +#define APPLE_DART_PTE_PROT_NO_READ (1<<8) >>> + >>> /* IOPTE accessors */ >>> #define iopte_deref(pte,d) __va(iopte_to_paddr(pte, d)) >>> >>> @@ -381,6 +384,15 @@ static arm_lpae_iopte arm_lpae_prot_to_pte(struct arm_lpae_io_pgtable *data, >>> { >>> arm_lpae_iopte pte; >>> >>> + if (data->iop.fmt == ARM_APPLE_DART) { >>> + pte = 0; >>> + if (!(prot & IOMMU_WRITE)) >>> + pte |= APPLE_DART_PTE_PROT_NO_WRITE; >>> + if (!(prot & IOMMU_READ)) >>> + pte |= APPLE_DART_PTE_PROT_NO_READ; >>> + return pte; >> >> What about the other bits, such as sharability, XN, etc? Do they not >> exist on DART? Or have they not been reverse engineered and 0s happen to >> "just work"? > > I'm fairly certain they don't exist (or are at least not used by XNU). > > The co-processors that can run code also either use an entire separate iommu > (e.g. the GPU) or only use DART as a "second stage" and have their own > MMU which e.g. handles XN (e.g. the SEP or AOP). Ok :). > >> >>> + } >>> + >>> if (data->iop.fmt == ARM_64_LPAE_S1 || >>> data->iop.fmt == ARM_32_LPAE_S1) { >>> pte = ARM_LPAE_PTE_nG; >>> @@ -1043,6 +1055,51 @@ arm_mali_lpae_alloc_pgtable(struct io_pgtable_cfg *cfg, void *cookie) >>> return NULL; >>> } >>> >>> +static struct io_pgtable * >>> +apple_dart_alloc_pgtable(struct io_pgtable_cfg *cfg, void *cookie) >>> +{ >>> + struct arm_lpae_io_pgtable *data; >>> + int i; >>> + >>> + if (cfg->oas > 36) >>> + return NULL; >>> + >>> + data = arm_lpae_alloc_pgtable(cfg); >>> + if (!data) >>> + return NULL; >>> + >>> + /* >>> + * Apple's DART always requires three levels with the first level being >>> + * stored in four MMIO registers. We always concatenate the first and >>> + * second level so that we only have to setup the MMIO registers once. >>> + * This results in an effective two level pagetable. >>> + */ >>> + if (data->start_level < 1) >>> + return NULL; >>> + if (data->start_level == 1 && data->pgd_bits > 2) >>> + return NULL; >>> + if (data->start_level > 1) >>> + data->pgd_bits = 0; >>> + data->start_level = 2; >>> + cfg->apple_dart_cfg.n_ttbrs = 1 << data->pgd_bits; >> >> Maybe add a BUG_ON if n_ttbrs > ARRAY_SIZE(ttbr)? Or alternatively, do a >> normal runtime check and bail out then. > > n_ttbrs can't actually be larger than 4 at this point already due to the > previous checks. > I can add a BUG_ON though just to make it explicit and be safe in case those > checks or the array size ever change. Ah, now I see it too. No worries then - I agree that you have all cases covered. Reviewed-by: Alexander Graf Alex Amazon Development Center Germany GmbH Krausenstr. 38 10117 Berlin Geschaeftsfuehrung: Christian Schlaeger, Jonathan Weiss Eingetragen am Amtsgericht Charlottenburg unter HRB 149173 B Sitz: Berlin Ust-ID: DE 289 237 879 _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel