From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-15.3 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1807EC48BD1 for ; Thu, 10 Jun 2021 09:09:07 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 006CE613F5 for ; Thu, 10 Jun 2021 09:09:06 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230265AbhFJJLB (ORCPT ); Thu, 10 Jun 2021 05:11:01 -0400 Received: from foss.arm.com ([217.140.110.172]:54442 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230083AbhFJJLB (ORCPT ); Thu, 10 Jun 2021 05:11:01 -0400 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id F0001D6E; Thu, 10 Jun 2021 02:09:04 -0700 (PDT) Received: from [10.57.6.115] (unknown [10.57.6.115]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id EBEB53F719; Thu, 10 Jun 2021 02:09:03 -0700 (PDT) Subject: Re: [PATCH] iommu/io-pgtable-arm: Optimize partial walk flush for large scatter-gather list To: Sai Prakash Ranjan Cc: linux-arm-msm@vger.kernel.org, linux-kernel@vger.kernel.org, iommu@lists.linux-foundation.org, Will Deacon , linux-arm-kernel@lists.infradead.org References: <20210609145315.25750-1-saiprakash.ranjan@codeaurora.org> From: Robin Murphy Message-ID: <35bfd245-45e2-8083-b620-330d6dbd7bd7@arm.com> Date: Thu, 10 Jun 2021 10:08:58 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-arm-msm@vger.kernel.org On 2021-06-10 06:24, Sai Prakash Ranjan wrote: > Hi Robin, > > On 2021-06-10 00:14, Robin Murphy wrote: >> On 2021-06-09 15:53, Sai Prakash Ranjan wrote: >>> Currently for iommu_unmap() of large scatter-gather list with page size >>> elements, the majority of time is spent in flushing of partial walks in >>> __arm_lpae_unmap() which is a VA based TLB invalidation (TLBIVA for >>> arm-smmu). >>> >>> For example: to unmap a 32MB scatter-gather list with page size elements >>> (8192 entries), there are 16->2MB buffer unmaps based on the pgsize (2MB >>> for 4K granule) and each of 2MB will further result in 512 TLBIVAs >>> (2MB/4K) >>> resulting in a total of 8192 TLBIVAs (512*16) for 16->2MB causing a huge >>> overhead. >>> >>> So instead use io_pgtable_tlb_flush_all() to invalidate the entire >>> context >>> if size (pgsize) is greater than the granule size (4K, 16K, 64K). For >>> this >>> example of 32MB scatter-gather list unmap, this results in just 16 ASID >>> based TLB invalidations or tlb_flush_all() callback (TLBIASID in case of >>> arm-smmu) as opposed to 8192 TLBIVAs thereby increasing the >>> performance of >>> unmaps drastically. >>> >>> Condition (size > granule size) is chosen for io_pgtable_tlb_flush_all() >>> because for any granule with supported pgsizes, we will have at least >>> 512 >>> TLB invalidations for which tlb_flush_all() is already recommended. For >>> example, take 4K granule with 2MB pgsize, this will result in 512 TLBIVA >>> in partial walk flush. >>> >>> Test on QTI SM8150 SoC for 10 iterations of iommu_{map_sg}/unmap: >>> (average over 10 iterations) >>> >>> Before this optimization: >>> >>>      size        iommu_map_sg      iommu_unmap >>>        4K            2.067 us         1.854 us >>>       64K            9.598 us         8.802 us >>>        1M          148.890 us       130.718 us >>>        2M          305.864 us        67.291 us >>>       12M         1793.604 us       390.838 us >>>       16M         2386.848 us       518.187 us >>>       24M         3563.296 us       775.989 us >>>       32M         4747.171 us      1033.364 us >>> >>> After this optimization: >>> >>>      size        iommu_map_sg      iommu_unmap >>>        4K            1.723 us         1.765 us >>>       64K            9.880 us         8.869 us >>>        1M          155.364 us       135.223 us >>>        2M          303.906 us         5.385 us >>>       12M         1786.557 us        21.250 us >>>       16M         2391.890 us        27.437 us >>>       24M         3570.895 us        39.937 us >>>       32M         4755.234 us        51.797 us >>> >>> This is further reduced once the map/unmap_pages() support gets in which >>> will result in just 1 tlb_flush_all() as opposed to 16 tlb_flush_all(). >>> >>> Signed-off-by: Sai Prakash Ranjan >>> --- >>>   drivers/iommu/io-pgtable-arm.c | 7 +++++-- >>>   1 file changed, 5 insertions(+), 2 deletions(-) >>> >>> diff --git a/drivers/iommu/io-pgtable-arm.c >>> b/drivers/iommu/io-pgtable-arm.c >>> index 87def58e79b5..c3cb9add3179 100644 >>> --- a/drivers/iommu/io-pgtable-arm.c >>> +++ b/drivers/iommu/io-pgtable-arm.c >>> @@ -589,8 +589,11 @@ static size_t __arm_lpae_unmap(struct >>> arm_lpae_io_pgtable *data, >>>             if (!iopte_leaf(pte, lvl, iop->fmt)) { >>>               /* Also flush any partial walks */ >>> -            io_pgtable_tlb_flush_walk(iop, iova, size, >>> -                          ARM_LPAE_GRANULE(data)); >>> +            if (size > ARM_LPAE_GRANULE(data)) >>> +                io_pgtable_tlb_flush_all(iop); >>> +            else >> >> Erm, when will the above condition ever not be true? ;) >> > > Ah right, silly me :) > >> Taking a step back, though, what about the impact to drivers other >> than SMMUv2? > > Other drivers would be msm_iommu.c, qcom_iommu.c which does the same > thing as arm-smmu-v2 (page based invalidations), then there is ipmmu-vmsa.c > which does tlb_flush_all() for flush walk. > >> In particular I'm thinking of SMMUv3.2 where the whole >> range can be invalidated by VA in a single command anyway, so the >> additional penalties of TLBIALL are undesirable. >> > > Right, so I am thinking we can have a new generic quirk > IO_PGTABLE_QUIRK_RANGE_INV > to choose between range based invalidations(tlb_flush_walk) and > tlb_flush_all(). > In this case of arm-smmu-v3.2, we can tie up ARM_SMMU_FEAT_RANGE_INV > with this quirk > and have something like below, thoughts? > > if (iop->cfg.quirks & IO_PGTABLE_QUIRK_RANGE_INV) >         io_pgtable_tlb_flush_walk(iop, iova, size, >                                   ARM_LPAE_GRANULE(data)); > else >         io_pgtable_tlb_flush_all(iop); The design here has always been that io-pgtable says *what* needs invalidating, and we left it up to the drivers to decide exactly *how*. Even though things have evolved a bit I don't think that has fundamentally changed - tlb_flush_walk is now only used in this one place (technically I suppose it could be renamed tlb_flush_table but it's not worth the churn), so drivers can implement their own preferred table-invalidating behaviour even more easily than choosing whether to bounce a quirk through the common code or not. Consider what you've already seen for the Renesas IPMMU, or SMMUv1 stage 2... I'm instinctively a little twitchy about making this a blanket optimisation for SMMUv2 since I still remember the palaver with our display and MMU-500 integrations, where it had to implement the dodgy "prefetch" register to trigger translations before scanning out a frame since it couldn't ever afford a TLB miss, thus TLBIALL when freeing an old buffer would be a dangerous hammer to swing. However IIRC it also had to ensure everything was mapped as 2MB blocks to guarantee fitting everything in the TLBs in the first place, so I guess it would still work out OK due to never realistically unmapping a whole table at once anyway. Cheers, Robin. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-15.3 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 12E31C47094 for ; Thu, 10 Jun 2021 09:09:10 +0000 (UTC) Received: from smtp3.osuosl.org (smtp3.osuosl.org [140.211.166.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id AC32861403 for ; Thu, 10 Jun 2021 09:09:09 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org AC32861403 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=arm.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=iommu-bounces@lists.linux-foundation.org Received: from localhost (localhost [127.0.0.1]) by smtp3.osuosl.org (Postfix) with ESMTP id 7BA5360744; Thu, 10 Jun 2021 09:09:09 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp3.osuosl.org ([127.0.0.1]) by localhost (smtp3.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id VM9qrE6Ip2OU; Thu, 10 Jun 2021 09:09:08 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [IPv6:2605:bc80:3010:104::8cd3:938]) by smtp3.osuosl.org (Postfix) with ESMTPS id 2527A605EC; Thu, 10 Jun 2021 09:09:08 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id F1180C000E; Thu, 10 Jun 2021 09:09:07 +0000 (UTC) Received: from smtp4.osuosl.org (smtp4.osuosl.org [140.211.166.137]) by lists.linuxfoundation.org (Postfix) with ESMTP id 9C4F6C000B for ; Thu, 10 Jun 2021 09:09:07 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp4.osuosl.org (Postfix) with ESMTP id 75312405CC for ; Thu, 10 Jun 2021 09:09:07 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp4.osuosl.org ([127.0.0.1]) by localhost (smtp4.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id aG1CTVNGVU-z for ; Thu, 10 Jun 2021 09:09:06 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by smtp4.osuosl.org (Postfix) with ESMTP id E20D0405C6 for ; Thu, 10 Jun 2021 09:09:05 +0000 (UTC) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id F0001D6E; Thu, 10 Jun 2021 02:09:04 -0700 (PDT) Received: from [10.57.6.115] (unknown [10.57.6.115]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id EBEB53F719; Thu, 10 Jun 2021 02:09:03 -0700 (PDT) Subject: Re: [PATCH] iommu/io-pgtable-arm: Optimize partial walk flush for large scatter-gather list To: Sai Prakash Ranjan References: <20210609145315.25750-1-saiprakash.ranjan@codeaurora.org> From: Robin Murphy Message-ID: <35bfd245-45e2-8083-b620-330d6dbd7bd7@arm.com> Date: Thu, 10 Jun 2021 10:08:58 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: Content-Language: en-GB Cc: linux-arm-msm@vger.kernel.org, iommu@lists.linux-foundation.org, Will Deacon , linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org X-BeenThere: iommu@lists.linux-foundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Development issues for Linux IOMMU support List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: iommu-bounces@lists.linux-foundation.org Sender: "iommu" T24gMjAyMS0wNi0xMCAwNjoyNCwgU2FpIFByYWthc2ggUmFuamFuIHdyb3RlOgo+IEhpIFJvYmlu LAo+IAo+IE9uIDIwMjEtMDYtMTAgMDA6MTQsIFJvYmluIE11cnBoeSB3cm90ZToKPj4gT24gMjAy MS0wNi0wOSAxNTo1MywgU2FpIFByYWthc2ggUmFuamFuIHdyb3RlOgo+Pj4gQ3VycmVudGx5IGZv ciBpb21tdV91bm1hcCgpIG9mIGxhcmdlIHNjYXR0ZXItZ2F0aGVyIGxpc3Qgd2l0aCBwYWdlIHNp emUKPj4+IGVsZW1lbnRzLCB0aGUgbWFqb3JpdHkgb2YgdGltZSBpcyBzcGVudCBpbiBmbHVzaGlu ZyBvZiBwYXJ0aWFsIHdhbGtzIGluCj4+PiBfX2FybV9scGFlX3VubWFwKCkgd2hpY2ggaXMgYSBW QSBiYXNlZCBUTEIgaW52YWxpZGF0aW9uIChUTEJJVkEgZm9yCj4+PiBhcm0tc21tdSkuCj4+Pgo+ Pj4gRm9yIGV4YW1wbGU6IHRvIHVubWFwIGEgMzJNQiBzY2F0dGVyLWdhdGhlciBsaXN0IHdpdGgg cGFnZSBzaXplIGVsZW1lbnRzCj4+PiAoODE5MiBlbnRyaWVzKSwgdGhlcmUgYXJlIDE2LT4yTUIg YnVmZmVyIHVubWFwcyBiYXNlZCBvbiB0aGUgcGdzaXplICgyTUIKPj4+IGZvciA0SyBncmFudWxl KSBhbmQgZWFjaCBvZiAyTUIgd2lsbCBmdXJ0aGVyIHJlc3VsdCBpbiA1MTIgVExCSVZBcyAKPj4+ ICgyTUIvNEspCj4+PiByZXN1bHRpbmcgaW4gYSB0b3RhbCBvZiA4MTkyIFRMQklWQXMgKDUxMiox NikgZm9yIDE2LT4yTUIgY2F1c2luZyBhIGh1Z2UKPj4+IG92ZXJoZWFkLgo+Pj4KPj4+IFNvIGlu c3RlYWQgdXNlIGlvX3BndGFibGVfdGxiX2ZsdXNoX2FsbCgpIHRvIGludmFsaWRhdGUgdGhlIGVu dGlyZSAKPj4+IGNvbnRleHQKPj4+IGlmIHNpemUgKHBnc2l6ZSkgaXMgZ3JlYXRlciB0aGFuIHRo ZSBncmFudWxlIHNpemUgKDRLLCAxNkssIDY0SykuIEZvciAKPj4+IHRoaXMKPj4+IGV4YW1wbGUg b2YgMzJNQiBzY2F0dGVyLWdhdGhlciBsaXN0IHVubWFwLCB0aGlzIHJlc3VsdHMgaW4ganVzdCAx NiBBU0lECj4+PiBiYXNlZCBUTEIgaW52YWxpZGF0aW9ucyBvciB0bGJfZmx1c2hfYWxsKCkgY2Fs bGJhY2sgKFRMQklBU0lEIGluIGNhc2Ugb2YKPj4+IGFybS1zbW11KSBhcyBvcHBvc2VkIHRvIDgx OTIgVExCSVZBcyB0aGVyZWJ5IGluY3JlYXNpbmcgdGhlIAo+Pj4gcGVyZm9ybWFuY2Ugb2YKPj4+ IHVubWFwcyBkcmFzdGljYWxseS4KPj4+Cj4+PiBDb25kaXRpb24gKHNpemUgPiBncmFudWxlIHNp emUpIGlzIGNob3NlbiBmb3IgaW9fcGd0YWJsZV90bGJfZmx1c2hfYWxsKCkKPj4+IGJlY2F1c2Ug Zm9yIGFueSBncmFudWxlIHdpdGggc3VwcG9ydGVkIHBnc2l6ZXMsIHdlIHdpbGwgaGF2ZSBhdCBs ZWFzdCAKPj4+IDUxMgo+Pj4gVExCIGludmFsaWRhdGlvbnMgZm9yIHdoaWNoIHRsYl9mbHVzaF9h bGwoKSBpcyBhbHJlYWR5IHJlY29tbWVuZGVkLiBGb3IKPj4+IGV4YW1wbGUsIHRha2UgNEsgZ3Jh bnVsZSB3aXRoIDJNQiBwZ3NpemUsIHRoaXMgd2lsbCByZXN1bHQgaW4gNTEyIFRMQklWQQo+Pj4g aW4gcGFydGlhbCB3YWxrIGZsdXNoLgo+Pj4KPj4+IFRlc3Qgb24gUVRJIFNNODE1MCBTb0MgZm9y IDEwIGl0ZXJhdGlvbnMgb2YgaW9tbXVfe21hcF9zZ30vdW5tYXA6Cj4+PiAoYXZlcmFnZSBvdmVy IDEwIGl0ZXJhdGlvbnMpCj4+Pgo+Pj4gQmVmb3JlIHRoaXMgb3B0aW1pemF0aW9uOgo+Pj4KPj4+ IMKgwqDCoMKgIHNpemXCoMKgwqDCoMKgwqDCoCBpb21tdV9tYXBfc2fCoMKgwqDCoMKgIGlvbW11 X3VubWFwCj4+PiDCoMKgwqDCoMKgwqAgNEvCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDIuMDY3IHVz wqDCoMKgwqDCoMKgwqDCoCAxLjg1NCB1cwo+Pj4gwqDCoMKgwqDCoCA2NEvCoMKgwqDCoMKgwqDC oMKgwqDCoMKgIDkuNTk4IHVzwqDCoMKgwqDCoMKgwqDCoCA4LjgwMiB1cwo+Pj4gwqDCoMKgwqDC oMKgIDFNwqDCoMKgwqDCoMKgwqDCoMKgIDE0OC44OTAgdXPCoMKgwqDCoMKgwqAgMTMwLjcxOCB1 cwo+Pj4gwqDCoMKgwqDCoMKgIDJNwqDCoMKgwqDCoMKgwqDCoMKgIDMwNS44NjQgdXPCoMKgwqDC oMKgwqDCoCA2Ny4yOTEgdXMKPj4+IMKgwqDCoMKgwqAgMTJNwqDCoMKgwqDCoMKgwqDCoCAxNzkz LjYwNCB1c8KgwqDCoMKgwqDCoCAzOTAuODM4IHVzCj4+PiDCoMKgwqDCoMKgIDE2TcKgwqDCoMKg wqDCoMKgwqAgMjM4Ni44NDggdXPCoMKgwqDCoMKgwqAgNTE4LjE4NyB1cwo+Pj4gwqDCoMKgwqDC oCAyNE3CoMKgwqDCoMKgwqDCoMKgIDM1NjMuMjk2IHVzwqDCoMKgwqDCoMKgIDc3NS45ODkgdXMK Pj4+IMKgwqDCoMKgwqAgMzJNwqDCoMKgwqDCoMKgwqDCoCA0NzQ3LjE3MSB1c8KgwqDCoMKgwqAg MTAzMy4zNjQgdXMKPj4+Cj4+PiBBZnRlciB0aGlzIG9wdGltaXphdGlvbjoKPj4+Cj4+PiDCoMKg wqDCoCBzaXplwqDCoMKgwqDCoMKgwqAgaW9tbXVfbWFwX3NnwqDCoMKgwqDCoCBpb21tdV91bm1h cAo+Pj4gwqDCoMKgwqDCoMKgIDRLwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAxLjcyMyB1c8KgwqDC oMKgwqDCoMKgwqAgMS43NjUgdXMKPj4+IMKgwqDCoMKgwqAgNjRLwqDCoMKgwqDCoMKgwqDCoMKg wqDCoCA5Ljg4MCB1c8KgwqDCoMKgwqDCoMKgwqAgOC44NjkgdXMKPj4+IMKgwqDCoMKgwqDCoCAx TcKgwqDCoMKgwqDCoMKgwqDCoCAxNTUuMzY0IHVzwqDCoMKgwqDCoMKgIDEzNS4yMjMgdXMKPj4+ IMKgwqDCoMKgwqDCoCAyTcKgwqDCoMKgwqDCoMKgwqDCoCAzMDMuOTA2IHVzwqDCoMKgwqDCoMKg wqDCoCA1LjM4NSB1cwo+Pj4gwqDCoMKgwqDCoCAxMk3CoMKgwqDCoMKgwqDCoMKgIDE3ODYuNTU3 IHVzwqDCoMKgwqDCoMKgwqAgMjEuMjUwIHVzCj4+PiDCoMKgwqDCoMKgIDE2TcKgwqDCoMKgwqDC oMKgwqAgMjM5MS44OTAgdXPCoMKgwqDCoMKgwqDCoCAyNy40MzcgdXMKPj4+IMKgwqDCoMKgwqAg MjRNwqDCoMKgwqDCoMKgwqDCoCAzNTcwLjg5NSB1c8KgwqDCoMKgwqDCoMKgIDM5LjkzNyB1cwo+ Pj4gwqDCoMKgwqDCoCAzMk3CoMKgwqDCoMKgwqDCoMKgIDQ3NTUuMjM0IHVzwqDCoMKgwqDCoMKg wqAgNTEuNzk3IHVzCj4+Pgo+Pj4gVGhpcyBpcyBmdXJ0aGVyIHJlZHVjZWQgb25jZSB0aGUgbWFw L3VubWFwX3BhZ2VzKCkgc3VwcG9ydCBnZXRzIGluIHdoaWNoCj4+PiB3aWxsIHJlc3VsdCBpbiBq dXN0IDEgdGxiX2ZsdXNoX2FsbCgpIGFzIG9wcG9zZWQgdG8gMTYgdGxiX2ZsdXNoX2FsbCgpLgo+ Pj4KPj4+IFNpZ25lZC1vZmYtYnk6IFNhaSBQcmFrYXNoIFJhbmphbiA8c2FpcHJha2FzaC5yYW5q YW5AY29kZWF1cm9yYS5vcmc+Cj4+PiAtLS0KPj4+IMKgIGRyaXZlcnMvaW9tbXUvaW8tcGd0YWJs ZS1hcm0uYyB8IDcgKysrKystLQo+Pj4gwqAgMSBmaWxlIGNoYW5nZWQsIDUgaW5zZXJ0aW9ucygr KSwgMiBkZWxldGlvbnMoLSkKPj4+Cj4+PiBkaWZmIC0tZ2l0IGEvZHJpdmVycy9pb21tdS9pby1w Z3RhYmxlLWFybS5jIAo+Pj4gYi9kcml2ZXJzL2lvbW11L2lvLXBndGFibGUtYXJtLmMKPj4+IGlu ZGV4IDg3ZGVmNThlNzliNS4uYzNjYjlhZGQzMTc5IDEwMDY0NAo+Pj4gLS0tIGEvZHJpdmVycy9p b21tdS9pby1wZ3RhYmxlLWFybS5jCj4+PiArKysgYi9kcml2ZXJzL2lvbW11L2lvLXBndGFibGUt YXJtLmMKPj4+IEBAIC01ODksOCArNTg5LDExIEBAIHN0YXRpYyBzaXplX3QgX19hcm1fbHBhZV91 bm1hcChzdHJ1Y3QgCj4+PiBhcm1fbHBhZV9pb19wZ3RhYmxlICpkYXRhLAo+Pj4gwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCBpZiAoIWlvcHRlX2xlYWYocHRlLCBsdmwsIGlvcC0+Zm10KSkgewo+Pj4g wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgLyogQWxzbyBmbHVzaCBhbnkgcGFydGlhbCB3YWxr cyAqLwo+Pj4gLcKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgaW9fcGd0YWJsZV90bGJfZmx1c2hfd2Fs ayhpb3AsIGlvdmEsIHNpemUsCj4+PiAtwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgQVJNX0xQQUVfR1JBTlVMRShkYXRhKSk7Cj4+PiArwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCBpZiAoc2l6ZSA+IEFSTV9MUEFFX0dSQU5VTEUoZGF0YSkpCj4+PiArwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIGlvX3BndGFibGVfdGxiX2ZsdXNoX2FsbChpb3Ap Owo+Pj4gK8KgwqDCoMKgwqDCoMKgwqDCoMKgwqAgZWxzZQo+Pgo+PiBFcm0sIHdoZW4gd2lsbCB0 aGUgYWJvdmUgY29uZGl0aW9uIGV2ZXIgbm90IGJlIHRydWU/IDspCj4+Cj4gCj4gQWggcmlnaHQs IHNpbGx5IG1lIDopCj4gCj4+IFRha2luZyBhIHN0ZXAgYmFjaywgdGhvdWdoLCB3aGF0IGFib3V0 IHRoZSBpbXBhY3QgdG8gZHJpdmVycyBvdGhlcgo+PiB0aGFuIFNNTVV2Mj8KPiAKPiBPdGhlciBk cml2ZXJzIHdvdWxkIGJlIG1zbV9pb21tdS5jLCBxY29tX2lvbW11LmMgd2hpY2ggZG9lcyB0aGUg c2FtZQo+IHRoaW5nIGFzIGFybS1zbW11LXYyIChwYWdlIGJhc2VkIGludmFsaWRhdGlvbnMpLCB0 aGVuIHRoZXJlIGlzIGlwbW11LXZtc2EuYwo+IHdoaWNoIGRvZXMgdGxiX2ZsdXNoX2FsbCgpIGZv ciBmbHVzaCB3YWxrLgo+IAo+PiBJbiBwYXJ0aWN1bGFyIEknbSB0aGlua2luZyBvZiBTTU1VdjMu MiB3aGVyZSB0aGUgd2hvbGUKPj4gcmFuZ2UgY2FuIGJlIGludmFsaWRhdGVkIGJ5IFZBIGluIGEg c2luZ2xlIGNvbW1hbmQgYW55d2F5LCBzbyB0aGUKPj4gYWRkaXRpb25hbCBwZW5hbHRpZXMgb2Yg VExCSUFMTCBhcmUgdW5kZXNpcmFibGUuCj4+Cj4gCj4gUmlnaHQsIHNvIEkgYW0gdGhpbmtpbmcg d2UgY2FuIGhhdmUgYSBuZXcgZ2VuZXJpYyBxdWlyayAKPiBJT19QR1RBQkxFX1FVSVJLX1JBTkdF X0lOVgo+IHRvIGNob29zZSBiZXR3ZWVuIHJhbmdlIGJhc2VkIGludmFsaWRhdGlvbnModGxiX2Zs dXNoX3dhbGspIGFuZCAKPiB0bGJfZmx1c2hfYWxsKCkuCj4gSW4gdGhpcyBjYXNlIG9mIGFybS1z bW11LXYzLjIsIHdlIGNhbiB0aWUgdXAgQVJNX1NNTVVfRkVBVF9SQU5HRV9JTlYgCj4gd2l0aCB0 aGlzIHF1aXJrCj4gYW5kIGhhdmUgc29tZXRoaW5nIGxpa2UgYmVsb3csIHRob3VnaHRzPwo+IAo+ IGlmIChpb3AtPmNmZy5xdWlya3MgJiBJT19QR1RBQkxFX1FVSVJLX1JBTkdFX0lOVikKPiAgwqDC oMKgwqDCoMKgwqAgaW9fcGd0YWJsZV90bGJfZmx1c2hfd2Fsayhpb3AsIGlvdmEsIHNpemUsCj4g IMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCBBUk1fTFBBRV9HUkFOVUxFKGRhdGEpKTsKPiBlbHNlCj4gIMKgwqDCoMKgwqDC oMKgIGlvX3BndGFibGVfdGxiX2ZsdXNoX2FsbChpb3ApOwoKVGhlIGRlc2lnbiBoZXJlIGhhcyBh bHdheXMgYmVlbiB0aGF0IGlvLXBndGFibGUgc2F5cyAqd2hhdCogbmVlZHMgCmludmFsaWRhdGlu ZywgYW5kIHdlIGxlZnQgaXQgdXAgdG8gdGhlIGRyaXZlcnMgdG8gZGVjaWRlIGV4YWN0bHkgKmhv dyouIApFdmVuIHRob3VnaCB0aGluZ3MgaGF2ZSBldm9sdmVkIGEgYml0IEkgZG9uJ3QgdGhpbmsg dGhhdCBoYXMgCmZ1bmRhbWVudGFsbHkgY2hhbmdlZCAtIHRsYl9mbHVzaF93YWxrIGlzIG5vdyBv bmx5IHVzZWQgaW4gdGhpcyBvbmUgCnBsYWNlICh0ZWNobmljYWxseSBJIHN1cHBvc2UgaXQgY291 bGQgYmUgcmVuYW1lZCB0bGJfZmx1c2hfdGFibGUgYnV0IAppdCdzIG5vdCB3b3J0aCB0aGUgY2h1 cm4pLCBzbyBkcml2ZXJzIGNhbiBpbXBsZW1lbnQgdGhlaXIgb3duIHByZWZlcnJlZCAKdGFibGUt aW52YWxpZGF0aW5nIGJlaGF2aW91ciBldmVuIG1vcmUgZWFzaWx5IHRoYW4gY2hvb3Npbmcgd2hl dGhlciB0byAKYm91bmNlIGEgcXVpcmsgdGhyb3VnaCB0aGUgY29tbW9uIGNvZGUgb3Igbm90LiBD b25zaWRlciB3aGF0IHlvdSd2ZSAKYWxyZWFkeSBzZWVuIGZvciB0aGUgUmVuZXNhcyBJUE1NVSwg b3IgU01NVXYxIHN0YWdlIDIuLi4KCkknbSBpbnN0aW5jdGl2ZWx5IGEgbGl0dGxlIHR3aXRjaHkg YWJvdXQgbWFraW5nIHRoaXMgYSBibGFua2V0IApvcHRpbWlzYXRpb24gZm9yIFNNTVV2MiBzaW5j ZSBJIHN0aWxsIHJlbWVtYmVyIHRoZSBwYWxhdmVyIHdpdGggb3VyIApkaXNwbGF5IGFuZCBNTVUt NTAwIGludGVncmF0aW9ucywgd2hlcmUgaXQgaGFkIHRvIGltcGxlbWVudCB0aGUgZG9kZ3kgCiJw cmVmZXRjaCIgcmVnaXN0ZXIgdG8gdHJpZ2dlciB0cmFuc2xhdGlvbnMgYmVmb3JlIHNjYW5uaW5n IG91dCBhIGZyYW1lIApzaW5jZSBpdCBjb3VsZG4ndCBldmVyIGFmZm9yZCBhIFRMQiBtaXNzLCB0 aHVzIFRMQklBTEwgd2hlbiBmcmVlaW5nIGFuIApvbGQgYnVmZmVyIHdvdWxkIGJlIGEgZGFuZ2Vy b3VzIGhhbW1lciB0byBzd2luZy4gSG93ZXZlciBJSVJDIGl0IGFsc28gCmhhZCB0byBlbnN1cmUg ZXZlcnl0aGluZyB3YXMgbWFwcGVkIGFzIDJNQiBibG9ja3MgdG8gZ3VhcmFudGVlIGZpdHRpbmcg CmV2ZXJ5dGhpbmcgaW4gdGhlIFRMQnMgaW4gdGhlIGZpcnN0IHBsYWNlLCBzbyBJIGd1ZXNzIGl0 IHdvdWxkIHN0aWxsIAp3b3JrIG91dCBPSyBkdWUgdG8gbmV2ZXIgcmVhbGlzdGljYWxseSB1bm1h cHBpbmcgYSB3aG9sZSB0YWJsZSBhdCBvbmNlIAphbnl3YXkuCgpDaGVlcnMsClJvYmluLgpfX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwppb21tdSBtYWlsaW5n IGxpc3QKaW9tbXVAbGlzdHMubGludXgtZm91bmRhdGlvbi5vcmcKaHR0cHM6Ly9saXN0cy5saW51 eGZvdW5kYXRpb24ub3JnL21haWxtYW4vbGlzdGluZm8vaW9tbXU= From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-15.4 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 47192C47094 for ; Thu, 10 Jun 2021 09:45:09 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 017EE60C40 for ; Thu, 10 Jun 2021 09:45:08 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 017EE60C40 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=arm.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:Content-Type: Content-Transfer-Encoding:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:Date:Message-ID:From: References:Cc:To:Subject:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=DCfK4OUbLXlY7yhB2z+L1PRvwIdMj2w/nO/abvg60mM=; b=vQlv1VyLuPSGCl268JPIN0xGc9 b8DH0vu3WuDZNyW6DSbMQEsasAKiDMtRR33QOEANKWceUiPLDVs6E9j0cTWHzlLVVa+Ha5mtHdRv7 euNZcsrjo8JwWiit+vl+015hUi0/Iv+m93aEV1tXhBgdWuXQdr31muMtAciQVU5URh7JC7+1Ks20q FED1+5bn64d0n3y//mG3hdxzwRlBVsxEcdrgWeItEI530mWK4nOVmphRp3ywbtOuRp1jQ5v5bu13O +PJqF/XUTYv2rtvVyp8eFlTstVehQ/YIwIM4fRew9xFlpmxQEpya8TWE6CsRIQhB3Ds8WRyCGfUye BnAl4nxg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1lrHDH-000FQ9-Ca; Thu, 10 Jun 2021 09:43:00 +0000 Received: from foss.arm.com ([217.140.110.172]) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1lrGgX-0006jv-Be for linux-arm-kernel@lists.infradead.org; Thu, 10 Jun 2021 09:09:11 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id F0001D6E; Thu, 10 Jun 2021 02:09:04 -0700 (PDT) Received: from [10.57.6.115] (unknown [10.57.6.115]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id EBEB53F719; Thu, 10 Jun 2021 02:09:03 -0700 (PDT) Subject: Re: [PATCH] iommu/io-pgtable-arm: Optimize partial walk flush for large scatter-gather list To: Sai Prakash Ranjan Cc: linux-arm-msm@vger.kernel.org, linux-kernel@vger.kernel.org, iommu@lists.linux-foundation.org, Will Deacon , linux-arm-kernel@lists.infradead.org References: <20210609145315.25750-1-saiprakash.ranjan@codeaurora.org> From: Robin Murphy Message-ID: <35bfd245-45e2-8083-b620-330d6dbd7bd7@arm.com> Date: Thu, 10 Jun 2021 10:08:58 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: Content-Language: en-GB X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210610_020909_546882_3F4357D6 X-CRM114-Status: GOOD ( 27.30 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org T24gMjAyMS0wNi0xMCAwNjoyNCwgU2FpIFByYWthc2ggUmFuamFuIHdyb3RlOgo+IEhpIFJvYmlu LAo+IAo+IE9uIDIwMjEtMDYtMTAgMDA6MTQsIFJvYmluIE11cnBoeSB3cm90ZToKPj4gT24gMjAy MS0wNi0wOSAxNTo1MywgU2FpIFByYWthc2ggUmFuamFuIHdyb3RlOgo+Pj4gQ3VycmVudGx5IGZv ciBpb21tdV91bm1hcCgpIG9mIGxhcmdlIHNjYXR0ZXItZ2F0aGVyIGxpc3Qgd2l0aCBwYWdlIHNp emUKPj4+IGVsZW1lbnRzLCB0aGUgbWFqb3JpdHkgb2YgdGltZSBpcyBzcGVudCBpbiBmbHVzaGlu ZyBvZiBwYXJ0aWFsIHdhbGtzIGluCj4+PiBfX2FybV9scGFlX3VubWFwKCkgd2hpY2ggaXMgYSBW QSBiYXNlZCBUTEIgaW52YWxpZGF0aW9uIChUTEJJVkEgZm9yCj4+PiBhcm0tc21tdSkuCj4+Pgo+ Pj4gRm9yIGV4YW1wbGU6IHRvIHVubWFwIGEgMzJNQiBzY2F0dGVyLWdhdGhlciBsaXN0IHdpdGgg cGFnZSBzaXplIGVsZW1lbnRzCj4+PiAoODE5MiBlbnRyaWVzKSwgdGhlcmUgYXJlIDE2LT4yTUIg YnVmZmVyIHVubWFwcyBiYXNlZCBvbiB0aGUgcGdzaXplICgyTUIKPj4+IGZvciA0SyBncmFudWxl KSBhbmQgZWFjaCBvZiAyTUIgd2lsbCBmdXJ0aGVyIHJlc3VsdCBpbiA1MTIgVExCSVZBcyAKPj4+ ICgyTUIvNEspCj4+PiByZXN1bHRpbmcgaW4gYSB0b3RhbCBvZiA4MTkyIFRMQklWQXMgKDUxMiox NikgZm9yIDE2LT4yTUIgY2F1c2luZyBhIGh1Z2UKPj4+IG92ZXJoZWFkLgo+Pj4KPj4+IFNvIGlu c3RlYWQgdXNlIGlvX3BndGFibGVfdGxiX2ZsdXNoX2FsbCgpIHRvIGludmFsaWRhdGUgdGhlIGVu dGlyZSAKPj4+IGNvbnRleHQKPj4+IGlmIHNpemUgKHBnc2l6ZSkgaXMgZ3JlYXRlciB0aGFuIHRo ZSBncmFudWxlIHNpemUgKDRLLCAxNkssIDY0SykuIEZvciAKPj4+IHRoaXMKPj4+IGV4YW1wbGUg b2YgMzJNQiBzY2F0dGVyLWdhdGhlciBsaXN0IHVubWFwLCB0aGlzIHJlc3VsdHMgaW4ganVzdCAx NiBBU0lECj4+PiBiYXNlZCBUTEIgaW52YWxpZGF0aW9ucyBvciB0bGJfZmx1c2hfYWxsKCkgY2Fs bGJhY2sgKFRMQklBU0lEIGluIGNhc2Ugb2YKPj4+IGFybS1zbW11KSBhcyBvcHBvc2VkIHRvIDgx OTIgVExCSVZBcyB0aGVyZWJ5IGluY3JlYXNpbmcgdGhlIAo+Pj4gcGVyZm9ybWFuY2Ugb2YKPj4+ IHVubWFwcyBkcmFzdGljYWxseS4KPj4+Cj4+PiBDb25kaXRpb24gKHNpemUgPiBncmFudWxlIHNp emUpIGlzIGNob3NlbiBmb3IgaW9fcGd0YWJsZV90bGJfZmx1c2hfYWxsKCkKPj4+IGJlY2F1c2Ug Zm9yIGFueSBncmFudWxlIHdpdGggc3VwcG9ydGVkIHBnc2l6ZXMsIHdlIHdpbGwgaGF2ZSBhdCBs ZWFzdCAKPj4+IDUxMgo+Pj4gVExCIGludmFsaWRhdGlvbnMgZm9yIHdoaWNoIHRsYl9mbHVzaF9h bGwoKSBpcyBhbHJlYWR5IHJlY29tbWVuZGVkLiBGb3IKPj4+IGV4YW1wbGUsIHRha2UgNEsgZ3Jh bnVsZSB3aXRoIDJNQiBwZ3NpemUsIHRoaXMgd2lsbCByZXN1bHQgaW4gNTEyIFRMQklWQQo+Pj4g aW4gcGFydGlhbCB3YWxrIGZsdXNoLgo+Pj4KPj4+IFRlc3Qgb24gUVRJIFNNODE1MCBTb0MgZm9y IDEwIGl0ZXJhdGlvbnMgb2YgaW9tbXVfe21hcF9zZ30vdW5tYXA6Cj4+PiAoYXZlcmFnZSBvdmVy IDEwIGl0ZXJhdGlvbnMpCj4+Pgo+Pj4gQmVmb3JlIHRoaXMgb3B0aW1pemF0aW9uOgo+Pj4KPj4+ IMKgwqDCoMKgIHNpemXCoMKgwqDCoMKgwqDCoCBpb21tdV9tYXBfc2fCoMKgwqDCoMKgIGlvbW11 X3VubWFwCj4+PiDCoMKgwqDCoMKgwqAgNEvCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDIuMDY3IHVz wqDCoMKgwqDCoMKgwqDCoCAxLjg1NCB1cwo+Pj4gwqDCoMKgwqDCoCA2NEvCoMKgwqDCoMKgwqDC oMKgwqDCoMKgIDkuNTk4IHVzwqDCoMKgwqDCoMKgwqDCoCA4LjgwMiB1cwo+Pj4gwqDCoMKgwqDC oMKgIDFNwqDCoMKgwqDCoMKgwqDCoMKgIDE0OC44OTAgdXPCoMKgwqDCoMKgwqAgMTMwLjcxOCB1 cwo+Pj4gwqDCoMKgwqDCoMKgIDJNwqDCoMKgwqDCoMKgwqDCoMKgIDMwNS44NjQgdXPCoMKgwqDC oMKgwqDCoCA2Ny4yOTEgdXMKPj4+IMKgwqDCoMKgwqAgMTJNwqDCoMKgwqDCoMKgwqDCoCAxNzkz LjYwNCB1c8KgwqDCoMKgwqDCoCAzOTAuODM4IHVzCj4+PiDCoMKgwqDCoMKgIDE2TcKgwqDCoMKg wqDCoMKgwqAgMjM4Ni44NDggdXPCoMKgwqDCoMKgwqAgNTE4LjE4NyB1cwo+Pj4gwqDCoMKgwqDC oCAyNE3CoMKgwqDCoMKgwqDCoMKgIDM1NjMuMjk2IHVzwqDCoMKgwqDCoMKgIDc3NS45ODkgdXMK Pj4+IMKgwqDCoMKgwqAgMzJNwqDCoMKgwqDCoMKgwqDCoCA0NzQ3LjE3MSB1c8KgwqDCoMKgwqAg MTAzMy4zNjQgdXMKPj4+Cj4+PiBBZnRlciB0aGlzIG9wdGltaXphdGlvbjoKPj4+Cj4+PiDCoMKg wqDCoCBzaXplwqDCoMKgwqDCoMKgwqAgaW9tbXVfbWFwX3NnwqDCoMKgwqDCoCBpb21tdV91bm1h cAo+Pj4gwqDCoMKgwqDCoMKgIDRLwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAxLjcyMyB1c8KgwqDC oMKgwqDCoMKgwqAgMS43NjUgdXMKPj4+IMKgwqDCoMKgwqAgNjRLwqDCoMKgwqDCoMKgwqDCoMKg wqDCoCA5Ljg4MCB1c8KgwqDCoMKgwqDCoMKgwqAgOC44NjkgdXMKPj4+IMKgwqDCoMKgwqDCoCAx TcKgwqDCoMKgwqDCoMKgwqDCoCAxNTUuMzY0IHVzwqDCoMKgwqDCoMKgIDEzNS4yMjMgdXMKPj4+ IMKgwqDCoMKgwqDCoCAyTcKgwqDCoMKgwqDCoMKgwqDCoCAzMDMuOTA2IHVzwqDCoMKgwqDCoMKg wqDCoCA1LjM4NSB1cwo+Pj4gwqDCoMKgwqDCoCAxMk3CoMKgwqDCoMKgwqDCoMKgIDE3ODYuNTU3 IHVzwqDCoMKgwqDCoMKgwqAgMjEuMjUwIHVzCj4+PiDCoMKgwqDCoMKgIDE2TcKgwqDCoMKgwqDC oMKgwqAgMjM5MS44OTAgdXPCoMKgwqDCoMKgwqDCoCAyNy40MzcgdXMKPj4+IMKgwqDCoMKgwqAg MjRNwqDCoMKgwqDCoMKgwqDCoCAzNTcwLjg5NSB1c8KgwqDCoMKgwqDCoMKgIDM5LjkzNyB1cwo+ Pj4gwqDCoMKgwqDCoCAzMk3CoMKgwqDCoMKgwqDCoMKgIDQ3NTUuMjM0IHVzwqDCoMKgwqDCoMKg wqAgNTEuNzk3IHVzCj4+Pgo+Pj4gVGhpcyBpcyBmdXJ0aGVyIHJlZHVjZWQgb25jZSB0aGUgbWFw L3VubWFwX3BhZ2VzKCkgc3VwcG9ydCBnZXRzIGluIHdoaWNoCj4+PiB3aWxsIHJlc3VsdCBpbiBq dXN0IDEgdGxiX2ZsdXNoX2FsbCgpIGFzIG9wcG9zZWQgdG8gMTYgdGxiX2ZsdXNoX2FsbCgpLgo+ Pj4KPj4+IFNpZ25lZC1vZmYtYnk6IFNhaSBQcmFrYXNoIFJhbmphbiA8c2FpcHJha2FzaC5yYW5q YW5AY29kZWF1cm9yYS5vcmc+Cj4+PiAtLS0KPj4+IMKgIGRyaXZlcnMvaW9tbXUvaW8tcGd0YWJs ZS1hcm0uYyB8IDcgKysrKystLQo+Pj4gwqAgMSBmaWxlIGNoYW5nZWQsIDUgaW5zZXJ0aW9ucygr KSwgMiBkZWxldGlvbnMoLSkKPj4+Cj4+PiBkaWZmIC0tZ2l0IGEvZHJpdmVycy9pb21tdS9pby1w Z3RhYmxlLWFybS5jIAo+Pj4gYi9kcml2ZXJzL2lvbW11L2lvLXBndGFibGUtYXJtLmMKPj4+IGlu ZGV4IDg3ZGVmNThlNzliNS4uYzNjYjlhZGQzMTc5IDEwMDY0NAo+Pj4gLS0tIGEvZHJpdmVycy9p b21tdS9pby1wZ3RhYmxlLWFybS5jCj4+PiArKysgYi9kcml2ZXJzL2lvbW11L2lvLXBndGFibGUt YXJtLmMKPj4+IEBAIC01ODksOCArNTg5LDExIEBAIHN0YXRpYyBzaXplX3QgX19hcm1fbHBhZV91 bm1hcChzdHJ1Y3QgCj4+PiBhcm1fbHBhZV9pb19wZ3RhYmxlICpkYXRhLAo+Pj4gwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCBpZiAoIWlvcHRlX2xlYWYocHRlLCBsdmwsIGlvcC0+Zm10KSkgewo+Pj4g wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgLyogQWxzbyBmbHVzaCBhbnkgcGFydGlhbCB3YWxr cyAqLwo+Pj4gLcKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgaW9fcGd0YWJsZV90bGJfZmx1c2hfd2Fs ayhpb3AsIGlvdmEsIHNpemUsCj4+PiAtwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgQVJNX0xQQUVfR1JBTlVMRShkYXRhKSk7Cj4+PiArwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCBpZiAoc2l6ZSA+IEFSTV9MUEFFX0dSQU5VTEUoZGF0YSkpCj4+PiArwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIGlvX3BndGFibGVfdGxiX2ZsdXNoX2FsbChpb3Ap Owo+Pj4gK8KgwqDCoMKgwqDCoMKgwqDCoMKgwqAgZWxzZQo+Pgo+PiBFcm0sIHdoZW4gd2lsbCB0 aGUgYWJvdmUgY29uZGl0aW9uIGV2ZXIgbm90IGJlIHRydWU/IDspCj4+Cj4gCj4gQWggcmlnaHQs IHNpbGx5IG1lIDopCj4gCj4+IFRha2luZyBhIHN0ZXAgYmFjaywgdGhvdWdoLCB3aGF0IGFib3V0 IHRoZSBpbXBhY3QgdG8gZHJpdmVycyBvdGhlcgo+PiB0aGFuIFNNTVV2Mj8KPiAKPiBPdGhlciBk cml2ZXJzIHdvdWxkIGJlIG1zbV9pb21tdS5jLCBxY29tX2lvbW11LmMgd2hpY2ggZG9lcyB0aGUg c2FtZQo+IHRoaW5nIGFzIGFybS1zbW11LXYyIChwYWdlIGJhc2VkIGludmFsaWRhdGlvbnMpLCB0 aGVuIHRoZXJlIGlzIGlwbW11LXZtc2EuYwo+IHdoaWNoIGRvZXMgdGxiX2ZsdXNoX2FsbCgpIGZv ciBmbHVzaCB3YWxrLgo+IAo+PiBJbiBwYXJ0aWN1bGFyIEknbSB0aGlua2luZyBvZiBTTU1VdjMu MiB3aGVyZSB0aGUgd2hvbGUKPj4gcmFuZ2UgY2FuIGJlIGludmFsaWRhdGVkIGJ5IFZBIGluIGEg c2luZ2xlIGNvbW1hbmQgYW55d2F5LCBzbyB0aGUKPj4gYWRkaXRpb25hbCBwZW5hbHRpZXMgb2Yg VExCSUFMTCBhcmUgdW5kZXNpcmFibGUuCj4+Cj4gCj4gUmlnaHQsIHNvIEkgYW0gdGhpbmtpbmcg d2UgY2FuIGhhdmUgYSBuZXcgZ2VuZXJpYyBxdWlyayAKPiBJT19QR1RBQkxFX1FVSVJLX1JBTkdF X0lOVgo+IHRvIGNob29zZSBiZXR3ZWVuIHJhbmdlIGJhc2VkIGludmFsaWRhdGlvbnModGxiX2Zs dXNoX3dhbGspIGFuZCAKPiB0bGJfZmx1c2hfYWxsKCkuCj4gSW4gdGhpcyBjYXNlIG9mIGFybS1z bW11LXYzLjIsIHdlIGNhbiB0aWUgdXAgQVJNX1NNTVVfRkVBVF9SQU5HRV9JTlYgCj4gd2l0aCB0 aGlzIHF1aXJrCj4gYW5kIGhhdmUgc29tZXRoaW5nIGxpa2UgYmVsb3csIHRob3VnaHRzPwo+IAo+ IGlmIChpb3AtPmNmZy5xdWlya3MgJiBJT19QR1RBQkxFX1FVSVJLX1JBTkdFX0lOVikKPiAgwqDC oMKgwqDCoMKgwqAgaW9fcGd0YWJsZV90bGJfZmx1c2hfd2Fsayhpb3AsIGlvdmEsIHNpemUsCj4g IMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCBBUk1fTFBBRV9HUkFOVUxFKGRhdGEpKTsKPiBlbHNlCj4gIMKgwqDCoMKgwqDC oMKgIGlvX3BndGFibGVfdGxiX2ZsdXNoX2FsbChpb3ApOwoKVGhlIGRlc2lnbiBoZXJlIGhhcyBh bHdheXMgYmVlbiB0aGF0IGlvLXBndGFibGUgc2F5cyAqd2hhdCogbmVlZHMgCmludmFsaWRhdGlu ZywgYW5kIHdlIGxlZnQgaXQgdXAgdG8gdGhlIGRyaXZlcnMgdG8gZGVjaWRlIGV4YWN0bHkgKmhv dyouIApFdmVuIHRob3VnaCB0aGluZ3MgaGF2ZSBldm9sdmVkIGEgYml0IEkgZG9uJ3QgdGhpbmsg dGhhdCBoYXMgCmZ1bmRhbWVudGFsbHkgY2hhbmdlZCAtIHRsYl9mbHVzaF93YWxrIGlzIG5vdyBv bmx5IHVzZWQgaW4gdGhpcyBvbmUgCnBsYWNlICh0ZWNobmljYWxseSBJIHN1cHBvc2UgaXQgY291 bGQgYmUgcmVuYW1lZCB0bGJfZmx1c2hfdGFibGUgYnV0IAppdCdzIG5vdCB3b3J0aCB0aGUgY2h1 cm4pLCBzbyBkcml2ZXJzIGNhbiBpbXBsZW1lbnQgdGhlaXIgb3duIHByZWZlcnJlZCAKdGFibGUt aW52YWxpZGF0aW5nIGJlaGF2aW91ciBldmVuIG1vcmUgZWFzaWx5IHRoYW4gY2hvb3Npbmcgd2hl dGhlciB0byAKYm91bmNlIGEgcXVpcmsgdGhyb3VnaCB0aGUgY29tbW9uIGNvZGUgb3Igbm90LiBD b25zaWRlciB3aGF0IHlvdSd2ZSAKYWxyZWFkeSBzZWVuIGZvciB0aGUgUmVuZXNhcyBJUE1NVSwg b3IgU01NVXYxIHN0YWdlIDIuLi4KCkknbSBpbnN0aW5jdGl2ZWx5IGEgbGl0dGxlIHR3aXRjaHkg YWJvdXQgbWFraW5nIHRoaXMgYSBibGFua2V0IApvcHRpbWlzYXRpb24gZm9yIFNNTVV2MiBzaW5j ZSBJIHN0aWxsIHJlbWVtYmVyIHRoZSBwYWxhdmVyIHdpdGggb3VyIApkaXNwbGF5IGFuZCBNTVUt NTAwIGludGVncmF0aW9ucywgd2hlcmUgaXQgaGFkIHRvIGltcGxlbWVudCB0aGUgZG9kZ3kgCiJw cmVmZXRjaCIgcmVnaXN0ZXIgdG8gdHJpZ2dlciB0cmFuc2xhdGlvbnMgYmVmb3JlIHNjYW5uaW5n IG91dCBhIGZyYW1lIApzaW5jZSBpdCBjb3VsZG4ndCBldmVyIGFmZm9yZCBhIFRMQiBtaXNzLCB0 aHVzIFRMQklBTEwgd2hlbiBmcmVlaW5nIGFuIApvbGQgYnVmZmVyIHdvdWxkIGJlIGEgZGFuZ2Vy b3VzIGhhbW1lciB0byBzd2luZy4gSG93ZXZlciBJSVJDIGl0IGFsc28gCmhhZCB0byBlbnN1cmUg ZXZlcnl0aGluZyB3YXMgbWFwcGVkIGFzIDJNQiBibG9ja3MgdG8gZ3VhcmFudGVlIGZpdHRpbmcg CmV2ZXJ5dGhpbmcgaW4gdGhlIFRMQnMgaW4gdGhlIGZpcnN0IHBsYWNlLCBzbyBJIGd1ZXNzIGl0 IHdvdWxkIHN0aWxsIAp3b3JrIG91dCBPSyBkdWUgdG8gbmV2ZXIgcmVhbGlzdGljYWxseSB1bm1h cHBpbmcgYSB3aG9sZSB0YWJsZSBhdCBvbmNlIAphbnl3YXkuCgpDaGVlcnMsClJvYmluLgoKX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KbGludXgtYXJtLWtl cm5lbCBtYWlsaW5nIGxpc3QKbGludXgtYXJtLWtlcm5lbEBsaXN0cy5pbmZyYWRlYWQub3JnCmh0 dHA6Ly9saXN0cy5pbmZyYWRlYWQub3JnL21haWxtYW4vbGlzdGluZm8vbGludXgtYXJtLWtlcm5l bAo=