From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.3 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8ECBDC2B9F4 for ; Thu, 17 Jun 2021 14:16:21 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 6CA92613A9 for ; Thu, 17 Jun 2021 14:16:21 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231809AbhFQOS1 (ORCPT ); Thu, 17 Jun 2021 10:18:27 -0400 Received: from mail.efficios.com ([167.114.26.124]:54884 "EHLO mail.efficios.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229716AbhFQOSY (ORCPT ); Thu, 17 Jun 2021 10:18:24 -0400 Received: from localhost (localhost [127.0.0.1]) by mail.efficios.com (Postfix) with ESMTP id 98BF933AEF8; Thu, 17 Jun 2021 10:16:14 -0400 (EDT) Received: from mail.efficios.com ([127.0.0.1]) by localhost (mail03.efficios.com [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id NQ5nwdb_CSGL; Thu, 17 Jun 2021 10:16:13 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by mail.efficios.com (Postfix) with ESMTP id 940CC33AEF7; Thu, 17 Jun 2021 10:16:13 -0400 (EDT) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.efficios.com 940CC33AEF7 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=efficios.com; s=default; t=1623939373; bh=PPPq0X6QUD3zkAKDaJYB0a4dhhEK2iuXQUmjCr94ufo=; h=Date:From:To:Message-ID:MIME-Version; b=Tp6w/FWv/15PBsm+sZdeYHS2fGUFFDxva9d8Q43DW/PFsLMkGpEoAhtU5H4ys8LTy wdQds1SYsU0tW0Sv3/Esbm4SptIGscsIXbQfaj2lkEY42W5H2LxA0NI7hSOg/Tk0R8 RuyJatVGwuM+3gSDUWA+2IX7j9/BHtwfexP+veVKe9KhQBLes6fLpcEv38p6y/8c7X sSRx5na+oQl3zvjKAoY7rELzuLwdK4qDfzcvfMwlbVoe8MyoBeQmM+bdg0u5Wje6Xy vd5EhWDcJXMMF0rFANM29DBE7EfdJMQmKodEQJyejT3EU2NRBEecWnLUkXf1jQqHJM iB+i559Gejy1g== X-Virus-Scanned: amavisd-new at efficios.com Received: from mail.efficios.com ([127.0.0.1]) by localhost (mail03.efficios.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id eSxuNMgKD58p; Thu, 17 Jun 2021 10:16:13 -0400 (EDT) Received: from localhost (unknown [192.222.236.144]) by mail.efficios.com (Postfix) with ESMTPSA id 3B0FD33B0B7; Thu, 17 Jun 2021 10:16:13 -0400 (EDT) Date: Thu, 17 Jun 2021 10:16:12 -0400 From: Mathieu Desnoyers To: Mark Rutland Cc: Andy Lutomirski , "Russell King (Oracle)" , the arch/x86 maintainers , Dave Hansen , Linux Kernel Mailing List , linux-mm@kvack.org, Andrew Morton , Nicholas Piggin , "Peter Zijlstra (Intel)" , linux-arm-kernel@lists.infradead.org Subject: Re: [PATCH 7/8] membarrier: Remove arm (32) support for SYNC_CORE Message-ID: <20210617141612.GA18005@localhost> References: <2142129092ff9aa00e600c42a26c4015b7f5ceec.1623813516.git.luto@kernel.org> <20210617103524.GA82133@C02TD0UTHF1T.local> <20210617112305.GK22278@shell.armlinux.org.uk> <20210617113349.GB82133@C02TD0UTHF1T.local> <394219d4-36a6-4e7f-a03c-8590551b099a@www.fastmail.com> <20210617135133.GA86101@C02TD0UTHF1T.local> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <20210617135133.GA86101@C02TD0UTHF1T.local> User-Agent: Mutt/1.10.1 (2018-07-13) Content-Transfer-Encoding: quoted-printable Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 17-Jun-2021 02:51:33 PM, Mark Rutland wrote: > On Thu, Jun 17, 2021 at 06:41:41AM -0700, Andy Lutomirski wrote: > >=20 > >=20 > > On Thu, Jun 17, 2021, at 4:33 AM, Mark Rutland wrote: > > > On Thu, Jun 17, 2021 at 12:23:05PM +0100, Russell King (Oracle) wro= te: > > > > On Thu, Jun 17, 2021 at 11:40:46AM +0100, Mark Rutland wrote: > > > > > On Tue, Jun 15, 2021 at 08:21:12PM -0700, Andy Lutomirski wrote= : > > > > > > On arm32, the only way to safely flush icache from usermode i= s to call > > > > > > cacheflush(2). This also handles any required pipeline flush= es, so > > > > > > membarrier's SYNC_CORE feature is useless on arm. Remove it. > > > > >=20 > > > > > Unfortunately, it's a bit more complicated than that, and these= days > > > > > SYNC_CORE is equally necessary on arm as on arm64. This is some= thing > > > > > that changed in the architecture over time, but since ARMv7 we = generally > > > > > need both the cache maintenance *and* a context synchronization= event > > > > > (the latter must occur on the CPU which will execute the instru= ctions). > > > > >=20 > > > > > If you look at the latest ARMv7-AR manual (ARM DDI 406C.d), sec= tion > > > > > A3.5.4 "Concurrent modification and execution of instructions" = covers > > > > > this. That manual can be found at: > > > > >=20 > > > > > https://developer.arm.com/documentation/ddi0406/latest/ > > > >=20 > > > > Looking at that, sys_cacheflush() meets this. The manual details = a > > > > series of cache maintenance calls in "step 1" that the modifying = thread > > > > must issue - this is exactly what sys_cacheflush() does. The same= is > > > > true for ARMv6, except the "ISB" terminology is replaced by a > > > > "PrefetchFlush" terminology. (I checked DDI0100I). > > > >=20 > > > > "step 2" requires an ISB on the "other CPU" prior to executing th= at > > > > code. As I understand it, in ARMv7, userspace can issue an ISB it= self. > > > >=20 > > > > For ARMv6K, it doesn't have ISB, but instead has a CP15 instructi= on > > > > for this that isn't availble to userspace. This is where we come = to > > > > the situation about ARM 11MPCore, and whether we continue to supp= ort > > > > it or not. > > > >=20 > > > > So, I think we're completely fine with ARMv7 under 32-bit ARM ker= nels > > > > as userspace has everything that's required. ARMv6K is a differen= t > > > > matter as we've already identified for several reasons. > > >=20 > > > Sure, and I agree we should not change cacheflush(). > > >=20 > > > The point of membarrier(SYNC_CORE) is that you can move the cost of= that > > > ISB out of the fast-path in the executing thread(s) and into the > > > slow-path on the thread which generated the code. > > >=20 > > > So e.g. rather than an executing thread always having to do: > > >=20 > > > LDR , [] > > > ISB // in case funcptr was just updated > > > BLR > > >=20 > > > ... you have the thread generating the code use membarrier(SYNC_COR= E) > > > prior to plublishing the funcptr, and the fast-path on all the exec= uting > > > threads can be: > > >=20 > > > LDR [] > > > BLR > > >=20 > > > ... and thus I think we still want membarrier(SYNC_CORE) so that pe= ople > > > can do this, even if there are other means to achieve the same > > > functionality. > >=20 > > I had the impression that sys_cacheflush() did that. Am I wrong? >=20 > Currently sys_cacheflush() doesn't do this, and IIUC it has never done > remote context synchronization even for architectures that need that > (e.g. x86 requiring a serializing instruction). >=20 > > In any event, I=E2=80=99m even more convinced that no new SYNC_CORE a= rches > > should be added. We need a new API that just does the right thing.=20 >=20 > My intuition is the other way around, and that this is a gnereally > useful thing for architectures that require context synchronization. >=20 > It's not clear to me what "the right thing" would mean specifically, an= d > on architectures with userspace cache maintenance JITs can usually do > the most optimal maintenance, and only need help for the context > synchronization. If I can attempt to summarize the current situation for ARMv7: - In addition to the cache flushing on the core doing the code update, the architecture requires every core to perform a context synchronizing instruction before executing the updated code. - sys_cacheflush() don't do this core sync on every core. It also takes a single address range as parameter. - ARM, ARM64, powerpc, powerpc64, x86, x86-64 all currently handle the context synchronization requirement for updating user-space code on SMP with sys_membarrier SYNC_CORE. It's not, however, meant to replace explicit cache flushing operations if those are needed. So removing membarrier SYNC_CORE from ARM would be a step backward here. On ARMv7, the SYNC_CORE is needed _in addition_ to sys_cacheflush. Adding a sync-core operation at the end of sys_cacheflush would be inefficient for common GC use-cases where a rather large set of address ranges are invalidated in one go: for this, we either want the GC to: - Invoke sys_cacheflush for each targeted range, and then issue a single sys_membarrier SYNC_CORE, or - Implement a new "sys_cacheflush_iov" which takes an iovec input. There I see that it could indeed invalidate all relevant cache lines *and* issue the SYNC_CORE at the end. But shoehorning the SYNC_CORE in the pre-existing sys_cacheflush after the fact seems like a bad idea. Thanks, Mathieu --=20 Mathieu Desnoyers EfficiOS Inc. http://www.efficios.com From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.4 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 783B2C49361 for ; Thu, 17 Jun 2021 14:18:20 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id BC645613CA for ; Thu, 17 Jun 2021 14:18:18 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org BC645613CA Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=efficios.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=cCrb7wxHXZdgmzgYcPDsZ9JJrrQUyKnUn2omRysgjlE=; b=r18bpp1Ou2q9nI NbYFeE8ztWsbFbtrUgOh9q/Y/vhA1rjQ/AtX9yd+wc9uS/sA+C72w0X2v80S3vGv0OObUgkITFiEZ EiHGyTj4Xe3RIltXVIg6fHdzaIPv0xfc4ZVm5AULA9Ze5LcCEHCb2r7ovdHQhSy2cWGvg6LhD66mu mSvRXfbHqobHh4TRfxssfOZXwMDtm+9hORXVKevp36X4H1Lzh7BL7T2IHs/sYArDxbQorAcSrsKbO 8hw8b+BubLRJaguvIEwwoa8fSD0flpgyrcFwxQnPiI3D2sAUYuc07Hj9UpQL1u5vqiEA87e6/zcaU 05u9F5osPATzUix3ptGg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1ltsok-00AeM0-Q1; Thu, 17 Jun 2021 14:16:26 +0000 Received: from mail.efficios.com ([167.114.26.124]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1ltsof-00AeJ6-Pr for linux-arm-kernel@lists.infradead.org; Thu, 17 Jun 2021 14:16:24 +0000 Received: from localhost (localhost [127.0.0.1]) by mail.efficios.com (Postfix) with ESMTP id 98BF933AEF8; Thu, 17 Jun 2021 10:16:14 -0400 (EDT) Received: from mail.efficios.com ([127.0.0.1]) by localhost (mail03.efficios.com [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id NQ5nwdb_CSGL; Thu, 17 Jun 2021 10:16:13 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by mail.efficios.com (Postfix) with ESMTP id 940CC33AEF7; Thu, 17 Jun 2021 10:16:13 -0400 (EDT) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.efficios.com 940CC33AEF7 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=efficios.com; s=default; t=1623939373; bh=PPPq0X6QUD3zkAKDaJYB0a4dhhEK2iuXQUmjCr94ufo=; h=Date:From:To:Message-ID:MIME-Version; b=Tp6w/FWv/15PBsm+sZdeYHS2fGUFFDxva9d8Q43DW/PFsLMkGpEoAhtU5H4ys8LTy wdQds1SYsU0tW0Sv3/Esbm4SptIGscsIXbQfaj2lkEY42W5H2LxA0NI7hSOg/Tk0R8 RuyJatVGwuM+3gSDUWA+2IX7j9/BHtwfexP+veVKe9KhQBLes6fLpcEv38p6y/8c7X sSRx5na+oQl3zvjKAoY7rELzuLwdK4qDfzcvfMwlbVoe8MyoBeQmM+bdg0u5Wje6Xy vd5EhWDcJXMMF0rFANM29DBE7EfdJMQmKodEQJyejT3EU2NRBEecWnLUkXf1jQqHJM iB+i559Gejy1g== X-Virus-Scanned: amavisd-new at efficios.com Received: from mail.efficios.com ([127.0.0.1]) by localhost (mail03.efficios.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id eSxuNMgKD58p; Thu, 17 Jun 2021 10:16:13 -0400 (EDT) Received: from localhost (unknown [192.222.236.144]) by mail.efficios.com (Postfix) with ESMTPSA id 3B0FD33B0B7; Thu, 17 Jun 2021 10:16:13 -0400 (EDT) Date: Thu, 17 Jun 2021 10:16:12 -0400 From: Mathieu Desnoyers To: Mark Rutland Cc: Andy Lutomirski , "Russell King (Oracle)" , the arch/x86 maintainers , Dave Hansen , Linux Kernel Mailing List , linux-mm@kvack.org, Andrew Morton , Nicholas Piggin , "Peter Zijlstra (Intel)" , linux-arm-kernel@lists.infradead.org Subject: Re: [PATCH 7/8] membarrier: Remove arm (32) support for SYNC_CORE Message-ID: <20210617141612.GA18005@localhost> References: <2142129092ff9aa00e600c42a26c4015b7f5ceec.1623813516.git.luto@kernel.org> <20210617103524.GA82133@C02TD0UTHF1T.local> <20210617112305.GK22278@shell.armlinux.org.uk> <20210617113349.GB82133@C02TD0UTHF1T.local> <394219d4-36a6-4e7f-a03c-8590551b099a@www.fastmail.com> <20210617135133.GA86101@C02TD0UTHF1T.local> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20210617135133.GA86101@C02TD0UTHF1T.local> User-Agent: Mutt/1.10.1 (2018-07-13) X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210617_071622_012514_0B790DA1 X-CRM114-Status: GOOD ( 46.64 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org T24gMTctSnVuLTIwMjEgMDI6NTE6MzMgUE0sIE1hcmsgUnV0bGFuZCB3cm90ZToKPiBPbiBUaHUs IEp1biAxNywgMjAyMSBhdCAwNjo0MTo0MUFNIC0wNzAwLCBBbmR5IEx1dG9taXJza2kgd3JvdGU6 Cj4gPiAKPiA+IAo+ID4gT24gVGh1LCBKdW4gMTcsIDIwMjEsIGF0IDQ6MzMgQU0sIE1hcmsgUnV0 bGFuZCB3cm90ZToKPiA+ID4gT24gVGh1LCBKdW4gMTcsIDIwMjEgYXQgMTI6MjM6MDVQTSArMDEw MCwgUnVzc2VsbCBLaW5nIChPcmFjbGUpIHdyb3RlOgo+ID4gPiA+IE9uIFRodSwgSnVuIDE3LCAy MDIxIGF0IDExOjQwOjQ2QU0gKzAxMDAsIE1hcmsgUnV0bGFuZCB3cm90ZToKPiA+ID4gPiA+IE9u IFR1ZSwgSnVuIDE1LCAyMDIxIGF0IDA4OjIxOjEyUE0gLTA3MDAsIEFuZHkgTHV0b21pcnNraSB3 cm90ZToKPiA+ID4gPiA+ID4gT24gYXJtMzIsIHRoZSBvbmx5IHdheSB0byBzYWZlbHkgZmx1c2gg aWNhY2hlIGZyb20gdXNlcm1vZGUgaXMgdG8gY2FsbAo+ID4gPiA+ID4gPiBjYWNoZWZsdXNoKDIp LiAgVGhpcyBhbHNvIGhhbmRsZXMgYW55IHJlcXVpcmVkIHBpcGVsaW5lIGZsdXNoZXMsIHNvCj4g PiA+ID4gPiA+IG1lbWJhcnJpZXIncyBTWU5DX0NPUkUgZmVhdHVyZSBpcyB1c2VsZXNzIG9uIGFy bS4gIFJlbW92ZSBpdC4KPiA+ID4gPiA+IAo+ID4gPiA+ID4gVW5mb3J0dW5hdGVseSwgaXQncyBh IGJpdCBtb3JlIGNvbXBsaWNhdGVkIHRoYW4gdGhhdCwgYW5kIHRoZXNlIGRheXMKPiA+ID4gPiA+ IFNZTkNfQ09SRSBpcyBlcXVhbGx5IG5lY2Vzc2FyeSBvbiBhcm0gYXMgb24gYXJtNjQuIFRoaXMg aXMgc29tZXRoaW5nCj4gPiA+ID4gPiB0aGF0IGNoYW5nZWQgaW4gdGhlIGFyY2hpdGVjdHVyZSBv dmVyIHRpbWUsIGJ1dCBzaW5jZSBBUk12NyB3ZSBnZW5lcmFsbHkKPiA+ID4gPiA+IG5lZWQgYm90 aCB0aGUgY2FjaGUgbWFpbnRlbmFuY2UgKmFuZCogYSBjb250ZXh0IHN5bmNocm9uaXphdGlvbiBl dmVudAo+ID4gPiA+ID4gKHRoZSBsYXR0ZXIgbXVzdCBvY2N1ciBvbiB0aGUgQ1BVIHdoaWNoIHdp bGwgZXhlY3V0ZSB0aGUgaW5zdHJ1Y3Rpb25zKS4KPiA+ID4gPiA+IAo+ID4gPiA+ID4gSWYgeW91 IGxvb2sgYXQgdGhlIGxhdGVzdCBBUk12Ny1BUiBtYW51YWwgKEFSTSBEREkgNDA2Qy5kKSwgc2Vj dGlvbgo+ID4gPiA+ID4gQTMuNS40ICJDb25jdXJyZW50IG1vZGlmaWNhdGlvbiBhbmQgZXhlY3V0 aW9uIG9mIGluc3RydWN0aW9ucyIgY292ZXJzCj4gPiA+ID4gPiB0aGlzLiBUaGF0IG1hbnVhbCBj YW4gYmUgZm91bmQgYXQ6Cj4gPiA+ID4gPiAKPiA+ID4gPiA+IAlodHRwczovL2RldmVsb3Blci5h cm0uY29tL2RvY3VtZW50YXRpb24vZGRpMDQwNi9sYXRlc3QvCj4gPiA+ID4gCj4gPiA+ID4gTG9v a2luZyBhdCB0aGF0LCBzeXNfY2FjaGVmbHVzaCgpIG1lZXRzIHRoaXMuIFRoZSBtYW51YWwgZGV0 YWlscyBhCj4gPiA+ID4gc2VyaWVzIG9mIGNhY2hlIG1haW50ZW5hbmNlIGNhbGxzIGluICJzdGVw IDEiIHRoYXQgdGhlIG1vZGlmeWluZyB0aHJlYWQKPiA+ID4gPiBtdXN0IGlzc3VlIC0gdGhpcyBp cyBleGFjdGx5IHdoYXQgc3lzX2NhY2hlZmx1c2goKSBkb2VzLiBUaGUgc2FtZSBpcwo+ID4gPiA+ IHRydWUgZm9yIEFSTXY2LCBleGNlcHQgdGhlICJJU0IiIHRlcm1pbm9sb2d5IGlzIHJlcGxhY2Vk IGJ5IGEKPiA+ID4gPiAiUHJlZmV0Y2hGbHVzaCIgdGVybWlub2xvZ3kuIChJIGNoZWNrZWQgRERJ MDEwMEkpLgo+ID4gPiA+IAo+ID4gPiA+ICJzdGVwIDIiIHJlcXVpcmVzIGFuIElTQiBvbiB0aGUg Im90aGVyIENQVSIgcHJpb3IgdG8gZXhlY3V0aW5nIHRoYXQKPiA+ID4gPiBjb2RlLiBBcyBJIHVu ZGVyc3RhbmQgaXQsIGluIEFSTXY3LCB1c2Vyc3BhY2UgY2FuIGlzc3VlIGFuIElTQiBpdHNlbGYu Cj4gPiA+ID4gCj4gPiA+ID4gRm9yIEFSTXY2SywgaXQgZG9lc24ndCBoYXZlIElTQiwgYnV0IGlu c3RlYWQgaGFzIGEgQ1AxNSBpbnN0cnVjdGlvbgo+ID4gPiA+IGZvciB0aGlzIHRoYXQgaXNuJ3Qg YXZhaWxibGUgdG8gdXNlcnNwYWNlLiBUaGlzIGlzIHdoZXJlIHdlIGNvbWUgdG8KPiA+ID4gPiB0 aGUgc2l0dWF0aW9uIGFib3V0IEFSTSAxMU1QQ29yZSwgYW5kIHdoZXRoZXIgd2UgY29udGludWUg dG8gc3VwcG9ydAo+ID4gPiA+IGl0IG9yIG5vdC4KPiA+ID4gPiAKPiA+ID4gPiBTbywgSSB0aGlu ayB3ZSdyZSBjb21wbGV0ZWx5IGZpbmUgd2l0aCBBUk12NyB1bmRlciAzMi1iaXQgQVJNIGtlcm5l bHMKPiA+ID4gPiBhcyB1c2Vyc3BhY2UgaGFzIGV2ZXJ5dGhpbmcgdGhhdCdzIHJlcXVpcmVkLiBB Uk12NksgaXMgYSBkaWZmZXJlbnQKPiA+ID4gPiBtYXR0ZXIgYXMgd2UndmUgYWxyZWFkeSBpZGVu dGlmaWVkIGZvciBzZXZlcmFsIHJlYXNvbnMuCj4gPiA+IAo+ID4gPiBTdXJlLCBhbmQgSSBhZ3Jl ZSB3ZSBzaG91bGQgbm90IGNoYW5nZSBjYWNoZWZsdXNoKCkuCj4gPiA+IAo+ID4gPiBUaGUgcG9p bnQgb2YgbWVtYmFycmllcihTWU5DX0NPUkUpIGlzIHRoYXQgeW91IGNhbiBtb3ZlIHRoZSBjb3N0 IG9mIHRoYXQKPiA+ID4gSVNCIG91dCBvZiB0aGUgZmFzdC1wYXRoIGluIHRoZSBleGVjdXRpbmcg dGhyZWFkKHMpIGFuZCBpbnRvIHRoZQo+ID4gPiBzbG93LXBhdGggb24gdGhlIHRocmVhZCB3aGlj aCBnZW5lcmF0ZWQgdGhlIGNvZGUuCj4gPiA+IAo+ID4gPiBTbyBlLmcuIHJhdGhlciB0aGFuIGFu IGV4ZWN1dGluZyB0aHJlYWQgYWx3YXlzIGhhdmluZyB0byBkbzoKPiA+ID4gCj4gPiA+IAlMRFIJ PHJlZz4sIFs8ZnVuY3B0cj5dCj4gPiA+IAlJU0IJLy8gaW4gY2FzZSBmdW5jcHRyIHdhcyBqdXN0 IHVwZGF0ZWQKPiA+ID4gCUJMUgk8cmVnPgo+ID4gPiAKPiA+ID4gLi4uIHlvdSBoYXZlIHRoZSB0 aHJlYWQgZ2VuZXJhdGluZyB0aGUgY29kZSB1c2UgbWVtYmFycmllcihTWU5DX0NPUkUpCj4gPiA+ IHByaW9yIHRvIHBsdWJsaXNoaW5nIHRoZSBmdW5jcHRyLCBhbmQgdGhlIGZhc3QtcGF0aCBvbiBh bGwgdGhlIGV4ZWN1dGluZwo+ID4gPiB0aHJlYWRzIGNhbiBiZToKPiA+ID4gCj4gPiA+IAlMRFIJ PHJlZz4gWzxmdW5jcHRyPl0KPiA+ID4gCUJMUgk8cmVnPgo+ID4gPiAKPiA+ID4gLi4uIGFuZCB0 aHVzIEkgdGhpbmsgd2Ugc3RpbGwgd2FudCBtZW1iYXJyaWVyKFNZTkNfQ09SRSkgc28gdGhhdCBw ZW9wbGUKPiA+ID4gY2FuIGRvIHRoaXMsIGV2ZW4gaWYgdGhlcmUgYXJlIG90aGVyIG1lYW5zIHRv IGFjaGlldmUgdGhlIHNhbWUKPiA+ID4gZnVuY3Rpb25hbGl0eS4KPiA+IAo+ID4gSSBoYWQgdGhl IGltcHJlc3Npb24gdGhhdCBzeXNfY2FjaGVmbHVzaCgpIGRpZCB0aGF0LiAgQW0gSSB3cm9uZz8K PiAKPiBDdXJyZW50bHkgc3lzX2NhY2hlZmx1c2goKSBkb2Vzbid0IGRvIHRoaXMsIGFuZCBJSVVD IGl0IGhhcyBuZXZlciBkb25lCj4gcmVtb3RlIGNvbnRleHQgc3luY2hyb25pemF0aW9uIGV2ZW4g Zm9yIGFyY2hpdGVjdHVyZXMgdGhhdCBuZWVkIHRoYXQKPiAoZS5nLiB4ODYgcmVxdWlyaW5nIGEg c2VyaWFsaXppbmcgaW5zdHJ1Y3Rpb24pLgo+IAo+ID4gSW4gYW55IGV2ZW50LCBJ4oCZbSBldmVu IG1vcmUgY29udmluY2VkIHRoYXQgbm8gbmV3IFNZTkNfQ09SRSBhcmNoZXMKPiA+IHNob3VsZCBi ZSBhZGRlZC4gV2UgbmVlZCBhIG5ldyBBUEkgdGhhdCBqdXN0IGRvZXMgdGhlIHJpZ2h0IHRoaW5n LiAKPiAKPiBNeSBpbnR1aXRpb24gaXMgdGhlIG90aGVyIHdheSBhcm91bmQsIGFuZCB0aGF0IHRo aXMgaXMgYSBnbmVyZWFsbHkKPiB1c2VmdWwgdGhpbmcgZm9yIGFyY2hpdGVjdHVyZXMgdGhhdCBy ZXF1aXJlIGNvbnRleHQgc3luY2hyb25pemF0aW9uLgo+IAo+IEl0J3Mgbm90IGNsZWFyIHRvIG1l IHdoYXQgInRoZSByaWdodCB0aGluZyIgd291bGQgbWVhbiBzcGVjaWZpY2FsbHksIGFuZAo+IG9u IGFyY2hpdGVjdHVyZXMgd2l0aCB1c2Vyc3BhY2UgY2FjaGUgbWFpbnRlbmFuY2UgSklUcyBjYW4g dXN1YWxseSBkbwo+IHRoZSBtb3N0IG9wdGltYWwgbWFpbnRlbmFuY2UsIGFuZCBvbmx5IG5lZWQg aGVscCBmb3IgdGhlIGNvbnRleHQKPiBzeW5jaHJvbml6YXRpb24uCgpJZiBJIGNhbiBhdHRlbXB0 IHRvIHN1bW1hcml6ZSB0aGUgY3VycmVudCBzaXR1YXRpb24gZm9yIEFSTXY3OgoKLSBJbiBhZGRp dGlvbiB0byB0aGUgY2FjaGUgZmx1c2hpbmcgb24gdGhlIGNvcmUgZG9pbmcgdGhlIGNvZGUgdXBk YXRlLAogIHRoZSBhcmNoaXRlY3R1cmUgcmVxdWlyZXMgZXZlcnkgY29yZSB0byBwZXJmb3JtIGEg Y29udGV4dCBzeW5jaHJvbml6aW5nCiAgaW5zdHJ1Y3Rpb24gYmVmb3JlIGV4ZWN1dGluZyB0aGUg dXBkYXRlZCBjb2RlLgoKLSBzeXNfY2FjaGVmbHVzaCgpIGRvbid0IGRvIHRoaXMgY29yZSBzeW5j IG9uIGV2ZXJ5IGNvcmUuIEl0IGFsc28gdGFrZXMgYQogIHNpbmdsZSBhZGRyZXNzIHJhbmdlIGFz IHBhcmFtZXRlci4KCi0gQVJNLCBBUk02NCwgcG93ZXJwYywgcG93ZXJwYzY0LCB4ODYsIHg4Ni02 NCBhbGwgY3VycmVudGx5IGhhbmRsZSB0aGUKICBjb250ZXh0IHN5bmNocm9uaXphdGlvbiByZXF1 aXJlbWVudCBmb3IgdXBkYXRpbmcgdXNlci1zcGFjZSBjb2RlIG9uCiAgU01QIHdpdGggc3lzX21l bWJhcnJpZXIgU1lOQ19DT1JFLiBJdCdzIG5vdCwgaG93ZXZlciwgbWVhbnQgdG8gcmVwbGFjZQog IGV4cGxpY2l0IGNhY2hlIGZsdXNoaW5nIG9wZXJhdGlvbnMgaWYgdGhvc2UgYXJlIG5lZWRlZC4K ClNvIHJlbW92aW5nIG1lbWJhcnJpZXIgU1lOQ19DT1JFIGZyb20gQVJNIHdvdWxkIGJlIGEgc3Rl cCBiYWNrd2FyZCBoZXJlLgpPbiBBUk12NywgdGhlIFNZTkNfQ09SRSBpcyBuZWVkZWQgX2luIGFk ZGl0aW9uXyB0byBzeXNfY2FjaGVmbHVzaC4KCkFkZGluZyBhIHN5bmMtY29yZSBvcGVyYXRpb24g YXQgdGhlIGVuZCBvZiBzeXNfY2FjaGVmbHVzaCB3b3VsZCBiZQppbmVmZmljaWVudCBmb3IgY29t bW9uIEdDIHVzZS1jYXNlcyB3aGVyZSBhIHJhdGhlciBsYXJnZSBzZXQgb2YgYWRkcmVzcwpyYW5n ZXMgYXJlIGludmFsaWRhdGVkIGluIG9uZSBnbzogZm9yIHRoaXMsIHdlIGVpdGhlciB3YW50IHRo ZSBHQyB0bzoKCi0gSW52b2tlIHN5c19jYWNoZWZsdXNoIGZvciBlYWNoIHRhcmdldGVkIHJhbmdl LCBhbmQgdGhlbiBpc3N1ZSBhIHNpbmdsZQogIHN5c19tZW1iYXJyaWVyIFNZTkNfQ09SRSwgb3IK Ci0gSW1wbGVtZW50IGEgbmV3ICJzeXNfY2FjaGVmbHVzaF9pb3YiIHdoaWNoIHRha2VzIGFuIGlv dmVjIGlucHV0LiBUaGVyZQogIEkgc2VlIHRoYXQgaXQgY291bGQgaW5kZWVkIGludmFsaWRhdGUg YWxsIHJlbGV2YW50IGNhY2hlIGxpbmVzICphbmQqCiAgaXNzdWUgdGhlIFNZTkNfQ09SRSBhdCB0 aGUgZW5kLgoKQnV0IHNob2Vob3JuaW5nIHRoZSBTWU5DX0NPUkUgaW4gdGhlIHByZS1leGlzdGlu ZyBzeXNfY2FjaGVmbHVzaCBhZnRlcgp0aGUgZmFjdCBzZWVtcyBsaWtlIGEgYmFkIGlkZWEuCgpU aGFua3MsCgpNYXRoaWV1CgotLSAKTWF0aGlldSBEZXNub3llcnMKRWZmaWNpT1MgSW5jLgpodHRw Oi8vd3d3LmVmZmljaW9zLmNvbQoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX18KbGludXgtYXJtLWtlcm5lbCBtYWlsaW5nIGxpc3QKbGludXgtYXJtLWtlcm5l bEBsaXN0cy5pbmZyYWRlYWQub3JnCmh0dHA6Ly9saXN0cy5pbmZyYWRlYWQub3JnL21haWxtYW4v bGlzdGluZm8vbGludXgtYXJtLWtlcm5lbAo=