From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 951A6C47094 for ; Thu, 10 Jun 2021 09:36:35 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 6D52F6124C for ; Thu, 10 Jun 2021 09:36:35 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229778AbhFJJia (ORCPT ); Thu, 10 Jun 2021 05:38:30 -0400 Received: from m43-7.mailgun.net ([69.72.43.7]:46617 "EHLO m43-7.mailgun.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230151AbhFJJia (ORCPT ); Thu, 10 Jun 2021 05:38:30 -0400 DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mg.codeaurora.org; q=dns/txt; s=smtp; t=1623317794; h=Message-ID: References: In-Reply-To: Subject: Cc: To: From: Date: Content-Transfer-Encoding: Content-Type: MIME-Version: Sender; bh=3Nr5XeD9lkZbSovGodMNy9bg536mnJtqaK+uPHyUp30=; b=ZyoFiQMJsttLWS34+mLJmZYw+DGLEBRTmrqW+I+v0X62EFsrgfysmqUdPVXKrDtjEsNIgeT0 32aEq6LtE2uv/6hQFav1aMSx207zdNJ5vnNL+Mma0c4H6BxcfBNeSjndm8qf2uRrzz2jq4YJ r500srgE7nce3zFFzEJdoTcN8/M= X-Mailgun-Sending-Ip: 69.72.43.7 X-Mailgun-Sid: WyI1MzIzYiIsICJsaW51eC1hcm0tbXNtQHZnZXIua2VybmVsLm9yZyIsICJiZTllNGEiXQ== Received: from smtp.codeaurora.org (ec2-35-166-182-171.us-west-2.compute.amazonaws.com [35.166.182.171]) by smtp-out-n07.prod.us-east-1.postgun.com with SMTP id 60c1dd1be27c0cc77f04814f (version=TLS1.2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256); Thu, 10 Jun 2021 09:36:27 GMT Sender: saiprakash.ranjan=codeaurora.org@mg.codeaurora.org Received: by smtp.codeaurora.org (Postfix, from userid 1001) id 532DAC433D3; Thu, 10 Jun 2021 09:36:26 +0000 (UTC) Received: from mail.codeaurora.org (localhost.localdomain [127.0.0.1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: saiprakash.ranjan) by smtp.codeaurora.org (Postfix) with ESMTPSA id E64D4C433F1; Thu, 10 Jun 2021 09:36:23 +0000 (UTC) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Thu, 10 Jun 2021 15:06:23 +0530 From: Sai Prakash Ranjan To: Robin Murphy Cc: linux-arm-msm@vger.kernel.org, linux-kernel@vger.kernel.org, iommu@lists.linux-foundation.org, Will Deacon , linux-arm-kernel@lists.infradead.org Subject: Re: [PATCH] iommu/io-pgtable-arm: Optimize partial walk flush for large scatter-gather list In-Reply-To: <35bfd245-45e2-8083-b620-330d6dbd7bd7@arm.com> References: <20210609145315.25750-1-saiprakash.ranjan@codeaurora.org> <35bfd245-45e2-8083-b620-330d6dbd7bd7@arm.com> Message-ID: <12067ffb8243b220cf03e83aaac3e823@codeaurora.org> X-Sender: saiprakash.ranjan@codeaurora.org User-Agent: Roundcube Webmail/1.3.9 Precedence: bulk List-ID: X-Mailing-List: linux-arm-msm@vger.kernel.org Hi Robin, On 2021-06-10 14:38, Robin Murphy wrote: > On 2021-06-10 06:24, Sai Prakash Ranjan wrote: >> Hi Robin, >> >> On 2021-06-10 00:14, Robin Murphy wrote: >>> On 2021-06-09 15:53, Sai Prakash Ranjan wrote: >>>> Currently for iommu_unmap() of large scatter-gather list with page >>>> size >>>> elements, the majority of time is spent in flushing of partial walks >>>> in >>>> __arm_lpae_unmap() which is a VA based TLB invalidation (TLBIVA for >>>> arm-smmu). >>>> >>>> For example: to unmap a 32MB scatter-gather list with page size >>>> elements >>>> (8192 entries), there are 16->2MB buffer unmaps based on the pgsize >>>> (2MB >>>> for 4K granule) and each of 2MB will further result in 512 TLBIVAs >>>> (2MB/4K) >>>> resulting in a total of 8192 TLBIVAs (512*16) for 16->2MB causing a >>>> huge >>>> overhead. >>>> >>>> So instead use io_pgtable_tlb_flush_all() to invalidate the entire >>>> context >>>> if size (pgsize) is greater than the granule size (4K, 16K, 64K). >>>> For this >>>> example of 32MB scatter-gather list unmap, this results in just 16 >>>> ASID >>>> based TLB invalidations or tlb_flush_all() callback (TLBIASID in >>>> case of >>>> arm-smmu) as opposed to 8192 TLBIVAs thereby increasing the >>>> performance of >>>> unmaps drastically. >>>> >>>> Condition (size > granule size) is chosen for >>>> io_pgtable_tlb_flush_all() >>>> because for any granule with supported pgsizes, we will have at >>>> least 512 >>>> TLB invalidations for which tlb_flush_all() is already recommended. >>>> For >>>> example, take 4K granule with 2MB pgsize, this will result in 512 >>>> TLBIVA >>>> in partial walk flush. >>>> >>>> Test on QTI SM8150 SoC for 10 iterations of iommu_{map_sg}/unmap: >>>> (average over 10 iterations) >>>> >>>> Before this optimization: >>>> >>>>      size        iommu_map_sg      iommu_unmap >>>>        4K            2.067 us         1.854 us >>>>       64K            9.598 us         8.802 us >>>>        1M          148.890 us       130.718 us >>>>        2M          305.864 us        67.291 us >>>>       12M         1793.604 us       390.838 us >>>>       16M         2386.848 us       518.187 us >>>>       24M         3563.296 us       775.989 us >>>>       32M         4747.171 us      1033.364 us >>>> >>>> After this optimization: >>>> >>>>      size        iommu_map_sg      iommu_unmap >>>>        4K            1.723 us         1.765 us >>>>       64K            9.880 us         8.869 us >>>>        1M          155.364 us       135.223 us >>>>        2M          303.906 us         5.385 us >>>>       12M         1786.557 us        21.250 us >>>>       16M         2391.890 us        27.437 us >>>>       24M         3570.895 us        39.937 us >>>>       32M         4755.234 us        51.797 us >>>> >>>> This is further reduced once the map/unmap_pages() support gets in >>>> which >>>> will result in just 1 tlb_flush_all() as opposed to 16 >>>> tlb_flush_all(). >>>> >>>> Signed-off-by: Sai Prakash Ranjan >>>> --- >>>>   drivers/iommu/io-pgtable-arm.c | 7 +++++-- >>>>   1 file changed, 5 insertions(+), 2 deletions(-) >>>> >>>> diff --git a/drivers/iommu/io-pgtable-arm.c >>>> b/drivers/iommu/io-pgtable-arm.c >>>> index 87def58e79b5..c3cb9add3179 100644 >>>> --- a/drivers/iommu/io-pgtable-arm.c >>>> +++ b/drivers/iommu/io-pgtable-arm.c >>>> @@ -589,8 +589,11 @@ static size_t __arm_lpae_unmap(struct >>>> arm_lpae_io_pgtable *data, >>>>             if (!iopte_leaf(pte, lvl, iop->fmt)) { >>>>               /* Also flush any partial walks */ >>>> -            io_pgtable_tlb_flush_walk(iop, iova, size, >>>> -                          ARM_LPAE_GRANULE(data)); >>>> +            if (size > ARM_LPAE_GRANULE(data)) >>>> +                io_pgtable_tlb_flush_all(iop); >>>> +            else >>> >>> Erm, when will the above condition ever not be true? ;) >>> >> >> Ah right, silly me :) >> >>> Taking a step back, though, what about the impact to drivers other >>> than SMMUv2? >> >> Other drivers would be msm_iommu.c, qcom_iommu.c which does the same >> thing as arm-smmu-v2 (page based invalidations), then there is >> ipmmu-vmsa.c >> which does tlb_flush_all() for flush walk. >> >>> In particular I'm thinking of SMMUv3.2 where the whole >>> range can be invalidated by VA in a single command anyway, so the >>> additional penalties of TLBIALL are undesirable. >>> >> >> Right, so I am thinking we can have a new generic quirk >> IO_PGTABLE_QUIRK_RANGE_INV >> to choose between range based invalidations(tlb_flush_walk) and >> tlb_flush_all(). >> In this case of arm-smmu-v3.2, we can tie up ARM_SMMU_FEAT_RANGE_INV >> with this quirk >> and have something like below, thoughts? >> >> if (iop->cfg.quirks & IO_PGTABLE_QUIRK_RANGE_INV) >>         io_pgtable_tlb_flush_walk(iop, iova, size, >>                                   ARM_LPAE_GRANULE(data)); >> else >>         io_pgtable_tlb_flush_all(iop); > > The design here has always been that io-pgtable says *what* needs > invalidating, and we left it up to the drivers to decide exactly > *how*. Even though things have evolved a bit I don't think that has > fundamentally changed - tlb_flush_walk is now only used in this one > place (technically I suppose it could be renamed tlb_flush_table but > it's not worth the churn), so drivers can implement their own > preferred table-invalidating behaviour even more easily than choosing > whether to bounce a quirk through the common code or not. Consider > what you've already seen for the Renesas IPMMU, or SMMUv1 stage 2... > Thanks for the explanation, makes sense. If I am not mistaken, I see that you are suggesting to move this logic based on size and granule-size to arm-smmu-v2 driver and one more thing below.. > I'm instinctively a little twitchy about making this a blanket > optimisation for SMMUv2 since I still remember the palaver with our > display and MMU-500 integrations, where it had to implement the dodgy > "prefetch" register to trigger translations before scanning out a > frame since it couldn't ever afford a TLB miss, thus TLBIALL when > freeing an old buffer would be a dangerous hammer to swing. However > IIRC it also had to ensure everything was mapped as 2MB blocks to > guarantee fitting everything in the TLBs in the first place, so I > guess it would still work out OK due to never realistically unmapping > a whole table at once anyway. > You are also hinting to not do this for all SMMUv2 implementations and make it QCOM specific? If I am wrong in my assumptions here, please let me know otherwise I will prepare the patch :) Thanks, Sai -- QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, hosted by The Linux Foundation From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E5107C48BCD for ; Thu, 10 Jun 2021 09:36:51 +0000 (UTC) Received: from smtp1.osuosl.org (smtp1.osuosl.org [140.211.166.138]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 9241161426 for ; Thu, 10 Jun 2021 09:36:51 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9241161426 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=codeaurora.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=iommu-bounces@lists.linux-foundation.org Received: from localhost (localhost [127.0.0.1]) by smtp1.osuosl.org (Postfix) with ESMTP id 51D1F83D10; Thu, 10 Jun 2021 09:36:51 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp1.osuosl.org ([127.0.0.1]) by localhost (smtp1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NeSTmCPkmiEz; Thu, 10 Jun 2021 09:36:50 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [140.211.9.56]) by smtp1.osuosl.org (Postfix) with ESMTPS id E476883CF2; Thu, 10 Jun 2021 09:36:49 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id C45EDC000D; Thu, 10 Jun 2021 09:36:49 +0000 (UTC) Received: from smtp2.osuosl.org (smtp2.osuosl.org [140.211.166.133]) by lists.linuxfoundation.org (Postfix) with ESMTP id 41824C000B for ; Thu, 10 Jun 2021 09:36:48 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with UTF8SMTP id 283E540214 for ; Thu, 10 Jun 2021 09:36:48 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Authentication-Results: smtp2.osuosl.org (amavisd-new); dkim=pass (1024-bit key) header.d=mg.codeaurora.org Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with UTF8SMTP id bjjZO1l524n3 for ; Thu, 10 Jun 2021 09:36:47 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.8.0 Received: from m43-7.mailgun.net (m43-7.mailgun.net [69.72.43.7]) by smtp2.osuosl.org (Postfix) with UTF8SMTPS id 1B08E401DF for ; Thu, 10 Jun 2021 09:36:44 +0000 (UTC) DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mg.codeaurora.org; q=dns/txt; s=smtp; t=1623317807; h=Message-ID: References: In-Reply-To: Subject: Cc: To: From: Date: Content-Transfer-Encoding: Content-Type: MIME-Version: Sender; bh=3Nr5XeD9lkZbSovGodMNy9bg536mnJtqaK+uPHyUp30=; b=tBYmu4LSRH6PicFLhT75KRQvo4ruf9F4UkQmeNw1rnaDjoGe2IkROO2I+wC5TPpIdC9mM8IE o2bE3RLneD86FMkGYYXjcFPbc312B/A7rrHXfZxYki4GhhsDs1V/KNsE2x2S/pxIZk6fSOGN Y1NUb5/fkqhurd7qGiylOjXbOng= X-Mailgun-Sending-Ip: 69.72.43.7 X-Mailgun-Sid: WyI3NDkwMCIsICJpb21tdUBsaXN0cy5saW51eC1mb3VuZGF0aW9uLm9yZyIsICJiZTllNGEiXQ== Received: from smtp.codeaurora.org (ec2-35-166-182-171.us-west-2.compute.amazonaws.com [35.166.182.171]) by smtp-out-n07.prod.us-west-2.postgun.com with SMTP id 60c1dd19b6ccaab7530e5689 (version=TLS1.2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256); Thu, 10 Jun 2021 09:36:25 GMT Received: by smtp.codeaurora.org (Postfix, from userid 1001) id 2D0BEC43460; Thu, 10 Jun 2021 09:36:25 +0000 (UTC) Received: from mail.codeaurora.org (localhost.localdomain [127.0.0.1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: saiprakash.ranjan) by smtp.codeaurora.org (Postfix) with ESMTPSA id E64D4C433F1; Thu, 10 Jun 2021 09:36:23 +0000 (UTC) MIME-Version: 1.0 Date: Thu, 10 Jun 2021 15:06:23 +0530 From: Sai Prakash Ranjan To: Robin Murphy Subject: Re: [PATCH] iommu/io-pgtable-arm: Optimize partial walk flush for large scatter-gather list In-Reply-To: <35bfd245-45e2-8083-b620-330d6dbd7bd7@arm.com> References: <20210609145315.25750-1-saiprakash.ranjan@codeaurora.org> <35bfd245-45e2-8083-b620-330d6dbd7bd7@arm.com> Message-ID: <12067ffb8243b220cf03e83aaac3e823@codeaurora.org> X-Sender: saiprakash.ranjan@codeaurora.org User-Agent: Roundcube Webmail/1.3.9 Cc: linux-arm-msm@vger.kernel.org, iommu@lists.linux-foundation.org, Will Deacon , linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org X-BeenThere: iommu@lists.linux-foundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Development issues for Linux IOMMU support List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: iommu-bounces@lists.linux-foundation.org Sender: "iommu" SGkgUm9iaW4sCgpPbiAyMDIxLTA2LTEwIDE0OjM4LCBSb2JpbiBNdXJwaHkgd3JvdGU6Cj4gT24g MjAyMS0wNi0xMCAwNjoyNCwgU2FpIFByYWthc2ggUmFuamFuIHdyb3RlOgo+PiBIaSBSb2JpbiwK Pj4gCj4+IE9uIDIwMjEtMDYtMTAgMDA6MTQsIFJvYmluIE11cnBoeSB3cm90ZToKPj4+IE9uIDIw MjEtMDYtMDkgMTU6NTMsIFNhaSBQcmFrYXNoIFJhbmphbiB3cm90ZToKPj4+PiBDdXJyZW50bHkg Zm9yIGlvbW11X3VubWFwKCkgb2YgbGFyZ2Ugc2NhdHRlci1nYXRoZXIgbGlzdCB3aXRoIHBhZ2Ug Cj4+Pj4gc2l6ZQo+Pj4+IGVsZW1lbnRzLCB0aGUgbWFqb3JpdHkgb2YgdGltZSBpcyBzcGVudCBp biBmbHVzaGluZyBvZiBwYXJ0aWFsIHdhbGtzIAo+Pj4+IGluCj4+Pj4gX19hcm1fbHBhZV91bm1h cCgpIHdoaWNoIGlzIGEgVkEgYmFzZWQgVExCIGludmFsaWRhdGlvbiAoVExCSVZBIGZvcgo+Pj4+ IGFybS1zbW11KS4KPj4+PiAKPj4+PiBGb3IgZXhhbXBsZTogdG8gdW5tYXAgYSAzMk1CIHNjYXR0 ZXItZ2F0aGVyIGxpc3Qgd2l0aCBwYWdlIHNpemUgCj4+Pj4gZWxlbWVudHMKPj4+PiAoODE5MiBl bnRyaWVzKSwgdGhlcmUgYXJlIDE2LT4yTUIgYnVmZmVyIHVubWFwcyBiYXNlZCBvbiB0aGUgcGdz aXplIAo+Pj4+ICgyTUIKPj4+PiBmb3IgNEsgZ3JhbnVsZSkgYW5kIGVhY2ggb2YgMk1CIHdpbGwg ZnVydGhlciByZXN1bHQgaW4gNTEyIFRMQklWQXMgCj4+Pj4gKDJNQi80SykKPj4+PiByZXN1bHRp bmcgaW4gYSB0b3RhbCBvZiA4MTkyIFRMQklWQXMgKDUxMioxNikgZm9yIDE2LT4yTUIgY2F1c2lu ZyBhIAo+Pj4+IGh1Z2UKPj4+PiBvdmVyaGVhZC4KPj4+PiAKPj4+PiBTbyBpbnN0ZWFkIHVzZSBp b19wZ3RhYmxlX3RsYl9mbHVzaF9hbGwoKSB0byBpbnZhbGlkYXRlIHRoZSBlbnRpcmUgCj4+Pj4g Y29udGV4dAo+Pj4+IGlmIHNpemUgKHBnc2l6ZSkgaXMgZ3JlYXRlciB0aGFuIHRoZSBncmFudWxl IHNpemUgKDRLLCAxNkssIDY0SykuIAo+Pj4+IEZvciB0aGlzCj4+Pj4gZXhhbXBsZSBvZiAzMk1C IHNjYXR0ZXItZ2F0aGVyIGxpc3QgdW5tYXAsIHRoaXMgcmVzdWx0cyBpbiBqdXN0IDE2IAo+Pj4+ IEFTSUQKPj4+PiBiYXNlZCBUTEIgaW52YWxpZGF0aW9ucyBvciB0bGJfZmx1c2hfYWxsKCkgY2Fs bGJhY2sgKFRMQklBU0lEIGluIAo+Pj4+IGNhc2Ugb2YKPj4+PiBhcm0tc21tdSkgYXMgb3Bwb3Nl ZCB0byA4MTkyIFRMQklWQXMgdGhlcmVieSBpbmNyZWFzaW5nIHRoZSAKPj4+PiBwZXJmb3JtYW5j ZSBvZgo+Pj4+IHVubWFwcyBkcmFzdGljYWxseS4KPj4+PiAKPj4+PiBDb25kaXRpb24gKHNpemUg PiBncmFudWxlIHNpemUpIGlzIGNob3NlbiBmb3IgCj4+Pj4gaW9fcGd0YWJsZV90bGJfZmx1c2hf YWxsKCkKPj4+PiBiZWNhdXNlIGZvciBhbnkgZ3JhbnVsZSB3aXRoIHN1cHBvcnRlZCBwZ3NpemVz LCB3ZSB3aWxsIGhhdmUgYXQgCj4+Pj4gbGVhc3QgNTEyCj4+Pj4gVExCIGludmFsaWRhdGlvbnMg Zm9yIHdoaWNoIHRsYl9mbHVzaF9hbGwoKSBpcyBhbHJlYWR5IHJlY29tbWVuZGVkLiAKPj4+PiBG b3IKPj4+PiBleGFtcGxlLCB0YWtlIDRLIGdyYW51bGUgd2l0aCAyTUIgcGdzaXplLCB0aGlzIHdp bGwgcmVzdWx0IGluIDUxMiAKPj4+PiBUTEJJVkEKPj4+PiBpbiBwYXJ0aWFsIHdhbGsgZmx1c2gu Cj4+Pj4gCj4+Pj4gVGVzdCBvbiBRVEkgU004MTUwIFNvQyBmb3IgMTAgaXRlcmF0aW9ucyBvZiBp b21tdV97bWFwX3NnfS91bm1hcDoKPj4+PiAoYXZlcmFnZSBvdmVyIDEwIGl0ZXJhdGlvbnMpCj4+ Pj4gCj4+Pj4gQmVmb3JlIHRoaXMgb3B0aW1pemF0aW9uOgo+Pj4+IAo+Pj4+IMKgwqDCoMKgIHNp emXCoMKgwqDCoMKgwqDCoCBpb21tdV9tYXBfc2fCoMKgwqDCoMKgIGlvbW11X3VubWFwCj4+Pj4g wqDCoMKgwqDCoMKgIDRLwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAyLjA2NyB1c8KgwqDCoMKgwqDC oMKgwqAgMS44NTQgdXMKPj4+PiDCoMKgwqDCoMKgIDY0S8KgwqDCoMKgwqDCoMKgwqDCoMKgwqAg OS41OTggdXPCoMKgwqDCoMKgwqDCoMKgIDguODAyIHVzCj4+Pj4gwqDCoMKgwqDCoMKgIDFNwqDC oMKgwqDCoMKgwqDCoMKgIDE0OC44OTAgdXPCoMKgwqDCoMKgwqAgMTMwLjcxOCB1cwo+Pj4+IMKg wqDCoMKgwqDCoCAyTcKgwqDCoMKgwqDCoMKgwqDCoCAzMDUuODY0IHVzwqDCoMKgwqDCoMKgwqAg NjcuMjkxIHVzCj4+Pj4gwqDCoMKgwqDCoCAxMk3CoMKgwqDCoMKgwqDCoMKgIDE3OTMuNjA0IHVz wqDCoMKgwqDCoMKgIDM5MC44MzggdXMKPj4+PiDCoMKgwqDCoMKgIDE2TcKgwqDCoMKgwqDCoMKg wqAgMjM4Ni44NDggdXPCoMKgwqDCoMKgwqAgNTE4LjE4NyB1cwo+Pj4+IMKgwqDCoMKgwqAgMjRN wqDCoMKgwqDCoMKgwqDCoCAzNTYzLjI5NiB1c8KgwqDCoMKgwqDCoCA3NzUuOTg5IHVzCj4+Pj4g wqDCoMKgwqDCoCAzMk3CoMKgwqDCoMKgwqDCoMKgIDQ3NDcuMTcxIHVzwqDCoMKgwqDCoCAxMDMz LjM2NCB1cwo+Pj4+IAo+Pj4+IEFmdGVyIHRoaXMgb3B0aW1pemF0aW9uOgo+Pj4+IAo+Pj4+IMKg wqDCoMKgIHNpemXCoMKgwqDCoMKgwqDCoCBpb21tdV9tYXBfc2fCoMKgwqDCoMKgIGlvbW11X3Vu bWFwCj4+Pj4gwqDCoMKgwqDCoMKgIDRLwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAxLjcyMyB1c8Kg wqDCoMKgwqDCoMKgwqAgMS43NjUgdXMKPj4+PiDCoMKgwqDCoMKgIDY0S8KgwqDCoMKgwqDCoMKg wqDCoMKgwqAgOS44ODAgdXPCoMKgwqDCoMKgwqDCoMKgIDguODY5IHVzCj4+Pj4gwqDCoMKgwqDC oMKgIDFNwqDCoMKgwqDCoMKgwqDCoMKgIDE1NS4zNjQgdXPCoMKgwqDCoMKgwqAgMTM1LjIyMyB1 cwo+Pj4+IMKgwqDCoMKgwqDCoCAyTcKgwqDCoMKgwqDCoMKgwqDCoCAzMDMuOTA2IHVzwqDCoMKg wqDCoMKgwqDCoCA1LjM4NSB1cwo+Pj4+IMKgwqDCoMKgwqAgMTJNwqDCoMKgwqDCoMKgwqDCoCAx Nzg2LjU1NyB1c8KgwqDCoMKgwqDCoMKgIDIxLjI1MCB1cwo+Pj4+IMKgwqDCoMKgwqAgMTZNwqDC oMKgwqDCoMKgwqDCoCAyMzkxLjg5MCB1c8KgwqDCoMKgwqDCoMKgIDI3LjQzNyB1cwo+Pj4+IMKg wqDCoMKgwqAgMjRNwqDCoMKgwqDCoMKgwqDCoCAzNTcwLjg5NSB1c8KgwqDCoMKgwqDCoMKgIDM5 LjkzNyB1cwo+Pj4+IMKgwqDCoMKgwqAgMzJNwqDCoMKgwqDCoMKgwqDCoCA0NzU1LjIzNCB1c8Kg wqDCoMKgwqDCoMKgIDUxLjc5NyB1cwo+Pj4+IAo+Pj4+IFRoaXMgaXMgZnVydGhlciByZWR1Y2Vk IG9uY2UgdGhlIG1hcC91bm1hcF9wYWdlcygpIHN1cHBvcnQgZ2V0cyBpbiAKPj4+PiB3aGljaAo+ Pj4+IHdpbGwgcmVzdWx0IGluIGp1c3QgMSB0bGJfZmx1c2hfYWxsKCkgYXMgb3Bwb3NlZCB0byAx NiAKPj4+PiB0bGJfZmx1c2hfYWxsKCkuCj4+Pj4gCj4+Pj4gU2lnbmVkLW9mZi1ieTogU2FpIFBy YWthc2ggUmFuamFuIDxzYWlwcmFrYXNoLnJhbmphbkBjb2RlYXVyb3JhLm9yZz4KPj4+PiAtLS0K Pj4+PiDCoCBkcml2ZXJzL2lvbW11L2lvLXBndGFibGUtYXJtLmMgfCA3ICsrKysrLS0KPj4+PiDC oCAxIGZpbGUgY2hhbmdlZCwgNSBpbnNlcnRpb25zKCspLCAyIGRlbGV0aW9ucygtKQo+Pj4+IAo+ Pj4+IGRpZmYgLS1naXQgYS9kcml2ZXJzL2lvbW11L2lvLXBndGFibGUtYXJtLmMgCj4+Pj4gYi9k cml2ZXJzL2lvbW11L2lvLXBndGFibGUtYXJtLmMKPj4+PiBpbmRleCA4N2RlZjU4ZTc5YjUuLmMz Y2I5YWRkMzE3OSAxMDA2NDQKPj4+PiAtLS0gYS9kcml2ZXJzL2lvbW11L2lvLXBndGFibGUtYXJt LmMKPj4+PiArKysgYi9kcml2ZXJzL2lvbW11L2lvLXBndGFibGUtYXJtLmMKPj4+PiBAQCAtNTg5 LDggKzU4OSwxMSBAQCBzdGF0aWMgc2l6ZV90IF9fYXJtX2xwYWVfdW5tYXAoc3RydWN0IAo+Pj4+ IGFybV9scGFlX2lvX3BndGFibGUgKmRhdGEsCj4+Pj4gwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBp ZiAoIWlvcHRlX2xlYWYocHRlLCBsdmwsIGlvcC0+Zm10KSkgewo+Pj4+IMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgIC8qIEFsc28gZmx1c2ggYW55IHBhcnRpYWwgd2Fsa3MgKi8KPj4+PiAtwqDC oMKgwqDCoMKgwqDCoMKgwqDCoCBpb19wZ3RhYmxlX3RsYl9mbHVzaF93YWxrKGlvcCwgaW92YSwg c2l6ZSwKPj4+PiAtwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqAgQVJNX0xQQUVfR1JBTlVMRShkYXRhKSk7Cj4+Pj4gK8KgwqDCoMKgwqDCoMKgwqDCoMKg wqAgaWYgKHNpemUgPiBBUk1fTFBBRV9HUkFOVUxFKGRhdGEpKQo+Pj4+ICvCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgaW9fcGd0YWJsZV90bGJfZmx1c2hfYWxsKGlvcCk7Cj4+Pj4gK8Kg wqDCoMKgwqDCoMKgwqDCoMKgwqAgZWxzZQo+Pj4gCj4+PiBFcm0sIHdoZW4gd2lsbCB0aGUgYWJv dmUgY29uZGl0aW9uIGV2ZXIgbm90IGJlIHRydWU/IDspCj4+PiAKPj4gCj4+IEFoIHJpZ2h0LCBz aWxseSBtZSA6KQo+PiAKPj4+IFRha2luZyBhIHN0ZXAgYmFjaywgdGhvdWdoLCB3aGF0IGFib3V0 IHRoZSBpbXBhY3QgdG8gZHJpdmVycyBvdGhlcgo+Pj4gdGhhbiBTTU1VdjI/Cj4+IAo+PiBPdGhl ciBkcml2ZXJzIHdvdWxkIGJlIG1zbV9pb21tdS5jLCBxY29tX2lvbW11LmMgd2hpY2ggZG9lcyB0 aGUgc2FtZQo+PiB0aGluZyBhcyBhcm0tc21tdS12MiAocGFnZSBiYXNlZCBpbnZhbGlkYXRpb25z KSwgdGhlbiB0aGVyZSBpcyAKPj4gaXBtbXUtdm1zYS5jCj4+IHdoaWNoIGRvZXMgdGxiX2ZsdXNo X2FsbCgpIGZvciBmbHVzaCB3YWxrLgo+PiAKPj4+IEluIHBhcnRpY3VsYXIgSSdtIHRoaW5raW5n IG9mIFNNTVV2My4yIHdoZXJlIHRoZSB3aG9sZQo+Pj4gcmFuZ2UgY2FuIGJlIGludmFsaWRhdGVk IGJ5IFZBIGluIGEgc2luZ2xlIGNvbW1hbmQgYW55d2F5LCBzbyB0aGUKPj4+IGFkZGl0aW9uYWwg cGVuYWx0aWVzIG9mIFRMQklBTEwgYXJlIHVuZGVzaXJhYmxlLgo+Pj4gCj4+IAo+PiBSaWdodCwg c28gSSBhbSB0aGlua2luZyB3ZSBjYW4gaGF2ZSBhIG5ldyBnZW5lcmljIHF1aXJrIAo+PiBJT19Q R1RBQkxFX1FVSVJLX1JBTkdFX0lOVgo+PiB0byBjaG9vc2UgYmV0d2VlbiByYW5nZSBiYXNlZCBp bnZhbGlkYXRpb25zKHRsYl9mbHVzaF93YWxrKSBhbmQgCj4+IHRsYl9mbHVzaF9hbGwoKS4KPj4g SW4gdGhpcyBjYXNlIG9mIGFybS1zbW11LXYzLjIsIHdlIGNhbiB0aWUgdXAgQVJNX1NNTVVfRkVB VF9SQU5HRV9JTlYgCj4+IHdpdGggdGhpcyBxdWlyawo+PiBhbmQgaGF2ZSBzb21ldGhpbmcgbGlr ZSBiZWxvdywgdGhvdWdodHM/Cj4+IAo+PiBpZiAoaW9wLT5jZmcucXVpcmtzICYgSU9fUEdUQUJM RV9RVUlSS19SQU5HRV9JTlYpCj4+ICDCoMKgwqDCoMKgwqDCoCBpb19wZ3RhYmxlX3RsYl9mbHVz aF93YWxrKGlvcCwgaW92YSwgc2l6ZSwKPj4gIMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBBUk1fTFBBRV9HUkFOVUxFKGRh dGEpKTsKPj4gZWxzZQo+PiAgwqDCoMKgwqDCoMKgwqAgaW9fcGd0YWJsZV90bGJfZmx1c2hfYWxs KGlvcCk7Cj4gCj4gVGhlIGRlc2lnbiBoZXJlIGhhcyBhbHdheXMgYmVlbiB0aGF0IGlvLXBndGFi bGUgc2F5cyAqd2hhdCogbmVlZHMKPiBpbnZhbGlkYXRpbmcsIGFuZCB3ZSBsZWZ0IGl0IHVwIHRv IHRoZSBkcml2ZXJzIHRvIGRlY2lkZSBleGFjdGx5Cj4gKmhvdyouIEV2ZW4gdGhvdWdoIHRoaW5n cyBoYXZlIGV2b2x2ZWQgYSBiaXQgSSBkb24ndCB0aGluayB0aGF0IGhhcwo+IGZ1bmRhbWVudGFs bHkgY2hhbmdlZCAtIHRsYl9mbHVzaF93YWxrIGlzIG5vdyBvbmx5IHVzZWQgaW4gdGhpcyBvbmUK PiBwbGFjZSAodGVjaG5pY2FsbHkgSSBzdXBwb3NlIGl0IGNvdWxkIGJlIHJlbmFtZWQgdGxiX2Zs dXNoX3RhYmxlIGJ1dAo+IGl0J3Mgbm90IHdvcnRoIHRoZSBjaHVybiksIHNvIGRyaXZlcnMgY2Fu IGltcGxlbWVudCB0aGVpciBvd24KPiBwcmVmZXJyZWQgdGFibGUtaW52YWxpZGF0aW5nIGJlaGF2 aW91ciBldmVuIG1vcmUgZWFzaWx5IHRoYW4gY2hvb3NpbmcKPiB3aGV0aGVyIHRvIGJvdW5jZSBh IHF1aXJrIHRocm91Z2ggdGhlIGNvbW1vbiBjb2RlIG9yIG5vdC4gQ29uc2lkZXIKPiB3aGF0IHlv dSd2ZSBhbHJlYWR5IHNlZW4gZm9yIHRoZSBSZW5lc2FzIElQTU1VLCBvciBTTU1VdjEgc3RhZ2Ug Mi4uLgo+IAoKVGhhbmtzIGZvciB0aGUgZXhwbGFuYXRpb24sIG1ha2VzIHNlbnNlLiBJZiBJIGFt IG5vdCBtaXN0YWtlbiwgSSBzZWUgCnRoYXQKeW91IGFyZSBzdWdnZXN0aW5nIHRvIG1vdmUgdGhp cyBsb2dpYyBiYXNlZCBvbiBzaXplIGFuZCBncmFudWxlLXNpemUgdG8KYXJtLXNtbXUtdjIgZHJp dmVyIGFuZCBvbmUgbW9yZSB0aGluZyBiZWxvdy4uCgoKPiBJJ20gaW5zdGluY3RpdmVseSBhIGxp dHRsZSB0d2l0Y2h5IGFib3V0IG1ha2luZyB0aGlzIGEgYmxhbmtldAo+IG9wdGltaXNhdGlvbiBm b3IgU01NVXYyIHNpbmNlIEkgc3RpbGwgcmVtZW1iZXIgdGhlIHBhbGF2ZXIgd2l0aCBvdXIKPiBk aXNwbGF5IGFuZCBNTVUtNTAwIGludGVncmF0aW9ucywgd2hlcmUgaXQgaGFkIHRvIGltcGxlbWVu dCB0aGUgZG9kZ3kKPiAicHJlZmV0Y2giIHJlZ2lzdGVyIHRvIHRyaWdnZXIgdHJhbnNsYXRpb25z IGJlZm9yZSBzY2FubmluZyBvdXQgYQo+IGZyYW1lIHNpbmNlIGl0IGNvdWxkbid0IGV2ZXIgYWZm b3JkIGEgVExCIG1pc3MsIHRodXMgVExCSUFMTCB3aGVuCj4gZnJlZWluZyBhbiBvbGQgYnVmZmVy IHdvdWxkIGJlIGEgZGFuZ2Vyb3VzIGhhbW1lciB0byBzd2luZy4gSG93ZXZlcgo+IElJUkMgaXQg YWxzbyBoYWQgdG8gZW5zdXJlIGV2ZXJ5dGhpbmcgd2FzIG1hcHBlZCBhcyAyTUIgYmxvY2tzIHRv Cj4gZ3VhcmFudGVlIGZpdHRpbmcgZXZlcnl0aGluZyBpbiB0aGUgVExCcyBpbiB0aGUgZmlyc3Qg cGxhY2UsIHNvIEkKPiBndWVzcyBpdCB3b3VsZCBzdGlsbCB3b3JrIG91dCBPSyBkdWUgdG8gbmV2 ZXIgcmVhbGlzdGljYWxseSB1bm1hcHBpbmcKPiBhIHdob2xlIHRhYmxlIGF0IG9uY2UgYW55d2F5 Lgo+IAoKWW91IGFyZSBhbHNvIGhpbnRpbmcgdG8gbm90IGRvIHRoaXMgZm9yIGFsbCBTTU1VdjIg aW1wbGVtZW50YXRpb25zIGFuZCAKbWFrZQppdCBRQ09NIHNwZWNpZmljPwoKSWYgSSBhbSB3cm9u ZyBpbiBteSBhc3N1bXB0aW9ucyBoZXJlLCBwbGVhc2UgbGV0IG1lIGtub3cgb3RoZXJ3aXNlIEkg CndpbGwKcHJlcGFyZSB0aGUgcGF0Y2ggOikKClRoYW5rcywKU2FpCgotLSAKUVVBTENPTU0gSU5E SUEsIG9uIGJlaGFsZiBvZiBRdWFsY29tbSBJbm5vdmF0aW9uIENlbnRlciwgSW5jLiBpcyBhIApt ZW1iZXIKb2YgQ29kZSBBdXJvcmEgRm9ydW0sIGhvc3RlZCBieSBUaGUgTGludXggRm91bmRhdGlv bgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwppb21tdSBt YWlsaW5nIGxpc3QKaW9tbXVAbGlzdHMubGludXgtZm91bmRhdGlvbi5vcmcKaHR0cHM6Ly9saXN0 cy5saW51eGZvdW5kYXRpb24ub3JnL21haWxtYW4vbGlzdGluZm8vaW9tbXU=