From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id B6490C433F5 for ; Sat, 2 Apr 2022 10:29:09 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1354334AbiDBKa7 (ORCPT ); Sat, 2 Apr 2022 06:30:59 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:54502 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S239592AbiDBKaz (ORCPT ); Sat, 2 Apr 2022 06:30:55 -0400 Received: from szxga01-in.huawei.com (szxga01-in.huawei.com [45.249.212.187]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 060FE49266 for ; Sat, 2 Apr 2022 03:29:03 -0700 (PDT) Received: from canpemm500009.china.huawei.com (unknown [172.30.72.56]) by szxga01-in.huawei.com (SkyGuard) with ESMTP id 4KVtWr1Z9nzgY97; Sat, 2 Apr 2022 18:27:20 +0800 (CST) Received: from [10.67.102.169] (10.67.102.169) by canpemm500009.china.huawei.com (7.192.105.203) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.21; Sat, 2 Apr 2022 18:29:00 +0800 CC: , Catalin Marinas , Will Deacon , Sudeep Holla , Greg Kroah-Hartman , "Rafael J. Wysocki" , Ingo Molnar , Peter Zijlstra , Juri Lelli , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Daniel Bristot de Oliveira , "linux-arm-kernel@lists.infradead.org" , "linux-kernel@vger.kernel.org" Subject: Re: [PATCH] sched: topology: make cache topology separate from cpu topology To: =?UTF-8?B?546L5pOO?= , Vincent Guittot References: <1646917125-20038-1-git-send-email-wangqing@vivo.com> From: Yicong Yang Message-ID: Date: Sat, 2 Apr 2022 18:29:00 +0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.5.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit X-Originating-IP: [10.67.102.169] X-ClientProxiedBy: dggems705-chm.china.huawei.com (10.3.19.182) To canpemm500009.china.huawei.com (7.192.105.203) X-CFilter-Loop: Reflected Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Qing, On 2022/4/2 17:34, 王擎 wrote: > >>> >>> >>>>> >>>>> >>>>>>> >>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>>> On Thu, 10 Mar 2022 at 13:59, Qing Wang wrote: >>>>>>>>>>> >>>>>>>>>>> From: Wang Qing >>>>>>>>>>> >>>>>>>>>>> Some architectures(e.g. ARM64), caches are implemented below: >>>>>>>>>>> cluster:                     ****** cluster 0 *****      ****** cluster 1 ***** >>>>>>>>>>> core:                         0      1          2      3          4      5           6      7 >>>>>>>>> (add cache level 1)        c0    c1        c2    c3         c4    c5         c6    c7 >>>>>>>>>>> cache(Leveln):         **cache0**  **cache1**  **cache2**  **cache3** >>>>>>>>> (add cache level 3)        *************share level 3 cache *************** >>>>>>>>>>> sd_llc_id(current):     0      0          0      0          4      4           4      4 >>>>>>>>>>> sd_llc_id(should be): 0      0          2      2          4      4           6      6 >>>>>>>>>>> >>>>>>>>> Here, n always be 2 in ARM64, but others are also possible. >>>>>>>>> core[0,1] form a complex(ARMV9),  which share L2 cache, core[2,3] is the same. >>>>>>>>> >>>>>>>>>>> Caches and cpus have different topology, this causes cpus_share_cache() >>>>>>>>>>> return the wrong value, which will affect the CPU load balance. >>>>>>>>>>> >>>>>>>>>> What does your current scheduler topology  look like? >>>>>>>>>> >>>>>>>>>> For CPU 0 to 3, do you have the below ? >>>>>>>>>> DIE [0     -     3] [4-7] >>>>>>>>>> MC  [0] [1] [2] [3] >>>>>>>>> >>>>>>>>> The current scheduler topology consistent with CPU topology: >>>>>>>>> DIE  [0-7] >>>>>>>>> MC  [0-3] [4-7]  (SD_SHARE_PKG_RESOURCES) >>>>>>>>> Most Android phones have this topology. >>>>>>>>>> >>>>>>>>>> But you would like something like below for cpu 0-1 instead ? >>>>>>>>>> DIE [0     -     3] [4-7] >>>>>>>>>> CLS [0 - 1] [2 - 3] >>>>>>>>>> MC  [0] [1] >>>>>>>>>> >>>>>>>>>> with SD_SHARE_PKG_RESOURCES only set to MC level ? >>>>>>>>> >>>>>>>>> We don't change the current scheduler topology, but the >>>>>>>>> cache topology should be separated like below: >>>>>>>> >>>>>>>> The scheduler topology is not only cpu topology but a mixed of cpu and >>>>>>>> cache/memory cache topology >>>>>>>> >>>>>>>>> [0-7]                          (shared level 3 cache ) >>>>>>>>> [0-1] [2-3][4-5][6-7]   (shared level 2 cache ) >>>>>>>> >>>>>>>> So you don't  bother the intermediate cluster level which is even simpler. >>>>>>>> you have to modify generic arch topology so that cpu_coregroup_mask >>>>>>>> returns the correct cpu mask directly. >>>>>>>> >>>>>>>> You will notice a llc_sibling field that is currently used by acpi but >>>>>>>> not DT to return llc cpu mask >>>>>>>> >>>>>>> cpu_topology[].llc_sibling describe the last level cache of whole system, >>>>>>> not in the sched_domain. >>>>>>> >>>>>>> in the above cache topology, llc_sibling is 0xff([0-7]) , it describes >>>>>> >>>>>> If llc_sibling was 0xff([0-7] on your system, you would have only one level: >>>>>> MC[0-7] >>>>> >>>>> Sorry, but I don't get it, why llc_sibling was 0xff([0-7] means MC[0-7]? >>>>> In our system(Android), llc_sibling is indeed 0xff([0-7]) , because they >>>>> shared the llc(L3), but we also have two level: >>>>> DIE [0-7] >>>>> MC [0-3][4-6] >>>>> It makes sense, [0-3] are little cores, [4-7] are bit cores, se only up migrate >>>>> when misfit. We won't change it. >>>>> >>>>>> >>>>>>> the L3 cache sibling, but sd_llc_id describes the maximum shared cache >>>>>>> in sd, which should be [0-1] instead of [0-3]. >>>>>> >>>>>> sd_llc_id describes the last sched_domain with SD_SHARE_PKG_RESOURCES. >>>>>> If you want llc to be [0-3] make sure that the >>>>>> sched_domain_topology_level array returns the correct cpumask with >>>>>> this flag >>>>> >>>>> Acturely, we want sd_llc to be [0-1] [2-3], but if the MC domain don't have >>>> >>>> sd_llc_id refers to a scheduler domain but your patch breaks this so >>>> if you want a llc that reflects this topo:  [0-1] [2-3] you must >>>> provide a sched_domain level with this topo >>> >>> Maybe we should add a shared-cache level(SC), like what CLS does: >>> >>> DIE  [0-7] (shared level 3 cache, SD_SHARE_PKG_RESOURCES) >>> MC  [0-3] [4-7]  (not SD_SHARE_PKG_RESOURCES) >>> CLS  (if necessary) >>> SC    [0-1][2-3][4-5][6-7] (shared level 2 cache, SD_SHARE_PKG_RESOURCES) >>> SMT (if necessary) >>> >>> SC means a couple of CPUs which are placed closely by sharing >>> mid-level caches, but not enough to be a cluster. >> >> what you name SC above looks the same as CLS which should not be mixed >> with Arm cluster terminology > > Do you mean cluster is equal to shared cache instead of containing, SC just > means shared cache, but not form a cluster, a CLS can contain many SCs. > The cluster is a topology level above the CPUs but under LLC. On Kunpeng 920 the cpus in a CLS will share L3T and on Intel's Jacobsville cpus in a CLS will share L2[1]. Seems you're using a DT based system. I think the parsing of cluster level is not supported on DT yet so you cannot see it. Otherwise with right cpu topology reported you will have a CLS level in which the cpus share L2 cache, just like Jacobsville. [1] https://lore.kernel.org/all/20210924085104.44806-4-21cnbao@gmail.com/ > If as you said, SC looks the same as CLS, should we rename CLS to SC to > avoid confusion? > > Thanks, > Wang > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 1FF1FC433F5 for ; Sat, 2 Apr 2022 10:30:35 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:Date: Message-ID:From:References:To:Subject:CC:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Owner; bh=b9sj8Wl3WafQQ7021RKFw4co+1bE+lircNNtK2fo+Gg=; b=klsarAzfO6BQW1VVX/PTF2pnk1 0vAojbaY4UeGF242s9S0AZIOVHA3vaKdS5kJsZQ6xIDFfEXfVXHmlvXRUeyuACMmZ8fSEU2IvAq1l MlF7fp7ItdXQKGE40l0jSuS/CG2+NVuEqlDABHz8QAj5ldzWAwrJFC+66ls7oSnAFbWa0/RimXD5m oyeSK36SPiW7AWCJE5b8IPYGTKEDrSowtDHyEi1KnvJqB5rvR11qUSEDYKzb+jR9IWfe7DcupSF8T 59gvl+6bskkbSXpsWCNTnqWE9AdAoYeoHSu6QaZ5LvSwjxMv9abxS4DRGstBOpimbU/rwst9ZnMZk 7xVfi1Eg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1nab0L-008UlR-6a; Sat, 02 Apr 2022 10:29:13 +0000 Received: from szxga01-in.huawei.com ([45.249.212.187]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1nab0F-008Ujs-2p for linux-arm-kernel@lists.infradead.org; Sat, 02 Apr 2022 10:29:09 +0000 Received: from canpemm500009.china.huawei.com (unknown [172.30.72.56]) by szxga01-in.huawei.com (SkyGuard) with ESMTP id 4KVtWr1Z9nzgY97; Sat, 2 Apr 2022 18:27:20 +0800 (CST) Received: from [10.67.102.169] (10.67.102.169) by canpemm500009.china.huawei.com (7.192.105.203) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.21; Sat, 2 Apr 2022 18:29:00 +0800 CC: , Catalin Marinas , Will Deacon , Sudeep Holla , Greg Kroah-Hartman , "Rafael J. Wysocki" , Ingo Molnar , Peter Zijlstra , Juri Lelli , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Daniel Bristot de Oliveira , "linux-arm-kernel@lists.infradead.org" , "linux-kernel@vger.kernel.org" Subject: Re: [PATCH] sched: topology: make cache topology separate from cpu topology To: =?UTF-8?B?546L5pOO?= , Vincent Guittot References: <1646917125-20038-1-git-send-email-wangqing@vivo.com> From: Yicong Yang Message-ID: Date: Sat, 2 Apr 2022 18:29:00 +0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.5.1 MIME-Version: 1.0 In-Reply-To: X-Originating-IP: [10.67.102.169] X-ClientProxiedBy: dggems705-chm.china.huawei.com (10.3.19.182) To canpemm500009.china.huawei.com (7.192.105.203) X-CFilter-Loop: Reflected X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20220402_032907_525678_A150A914 X-CRM114-Status: GOOD ( 15.49 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org SGkgUWluZywKCk9uIDIwMjIvNC8yIDE3OjM0LCDnjovmk44gd3JvdGU6Cj4gCj4+Pgo+Pj4KPj4+ Pj4KPj4+Pj4KPj4+Pj4+Pgo+Pj4+Pj4+Cj4+Pj4+Pj4+Pgo+Pj4+Pj4+Pj4KPj4+Pj4+Pj4+PiBP biBUaHUsIDEwIE1hciAyMDIyIGF0IDEzOjU5LCBRaW5nIFdhbmcgPHdhbmdxaW5nQHZpdm8uY29t PiB3cm90ZToKPj4+Pj4+Pj4+Pj4KPj4+Pj4+Pj4+Pj4gRnJvbTogV2FuZyBRaW5nIDx3YW5ncWlu Z0B2aXZvLmNvbT4KPj4+Pj4+Pj4+Pj4KPj4+Pj4+Pj4+Pj4gU29tZSBhcmNoaXRlY3R1cmVzKGUu Zy4gQVJNNjQpLCBjYWNoZXMgYXJlIGltcGxlbWVudGVkIGJlbG93Ogo+Pj4+Pj4+Pj4+PiBjbHVz dGVyOsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgKioqKioqIGNsdXN0 ZXIgMCAqKioqKsKgwqDCoMKgwqAgKioqKioqIGNsdXN0ZXIgMSAqKioqKgo+Pj4+Pj4+Pj4+PiBj b3JlOsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAwwqDC oMKgwqDCoCAxwqDCoMKgwqDCoMKgwqDCoMKgIDLCoMKgwqDCoMKgIDPCoMKgwqDCoMKgwqDCoMKg wqAgNMKgwqDCoMKgwqAgNcKgwqDCoMKgwqDCoMKgwqDCoMKgIDbCoMKgwqDCoMKgIDcKPj4+Pj4+ Pj4+IChhZGQgY2FjaGUgbGV2ZWwgMSnCoMKgwqDCoMKgwqDCoCBjMMKgwqDCoCBjMcKgwqDCoMKg wqDCoMKgIGMywqDCoMKgIGMzwqDCoMKgwqDCoMKgwqDCoCBjNMKgwqDCoCBjNcKgwqDCoMKgwqDC oMKgwqAgYzbCoMKgwqAgYzcKPj4+Pj4+Pj4+Pj4gY2FjaGUoTGV2ZWxuKTrCoMKgwqDCoMKgwqDC oMKgICoqY2FjaGUwKirCoCAqKmNhY2hlMSoqwqAgKipjYWNoZTIqKsKgICoqY2FjaGUzKioKPj4+ Pj4+Pj4+IChhZGQgY2FjaGUgbGV2ZWwgMynCoMKgwqDCoMKgwqDCoCAqKioqKioqKioqKioqc2hh cmUgbGV2ZWwgMyBjYWNoZSAqKioqKioqKioqKioqKioKPj4+Pj4+Pj4+Pj4gc2RfbGxjX2lkKGN1 cnJlbnQpOsKgwqDCoMKgIDDCoMKgwqDCoMKgIDDCoMKgwqDCoMKgwqDCoMKgwqAgMMKgwqDCoMKg wqAgMMKgwqDCoMKgwqDCoMKgwqDCoCA0wqDCoMKgwqDCoCA0wqDCoMKgwqDCoMKgwqDCoMKgwqAg NMKgwqDCoMKgwqAgNAo+Pj4+Pj4+Pj4+PiBzZF9sbGNfaWQoc2hvdWxkIGJlKTogMMKgwqDCoMKg wqAgMMKgwqDCoMKgwqDCoMKgwqDCoCAywqDCoMKgwqDCoCAywqDCoMKgwqDCoMKgwqDCoMKgIDTC oMKgwqDCoMKgIDTCoMKgwqDCoMKgwqDCoMKgwqDCoCA2wqDCoMKgwqDCoCA2Cj4+Pj4+Pj4+Pj4+ Cj4+Pj4+Pj4+PiBIZXJlLCBuIGFsd2F5cyBiZSAyIGluIEFSTTY0LCBidXQgb3RoZXJzIGFyZSBh bHNvIHBvc3NpYmxlLgo+Pj4+Pj4+Pj4gY29yZVswLDFdIGZvcm0gYSBjb21wbGV4KEFSTVY5KSzC oCB3aGljaCBzaGFyZSBMMiBjYWNoZSwgY29yZVsyLDNdIGlzIHRoZSBzYW1lLgo+Pj4+Pj4+Pj4K Pj4+Pj4+Pj4+Pj4gQ2FjaGVzIGFuZCBjcHVzIGhhdmUgZGlmZmVyZW50IHRvcG9sb2d5LCB0aGlz IGNhdXNlcyBjcHVzX3NoYXJlX2NhY2hlKCkKPj4+Pj4+Pj4+Pj4gcmV0dXJuIHRoZSB3cm9uZyB2 YWx1ZSwgd2hpY2ggd2lsbCBhZmZlY3QgdGhlIENQVSBsb2FkIGJhbGFuY2UuCj4+Pj4+Pj4+Pj4+ Cj4+Pj4+Pj4+Pj4gV2hhdCBkb2VzIHlvdXIgY3VycmVudCBzY2hlZHVsZXIgdG9wb2xvZ3nCoCBs b29rIGxpa2U/Cj4+Pj4+Pj4+Pj4KPj4+Pj4+Pj4+PiBGb3IgQ1BVIDAgdG8gMywgZG8geW91IGhh dmUgdGhlIGJlbG93ID8KPj4+Pj4+Pj4+PiBESUUgWzDCoMKgwqDCoCAtwqDCoMKgwqAgM10gWzQt N10KPj4+Pj4+Pj4+PiBNQ8KgIFswXSBbMV0gWzJdIFszXQo+Pj4+Pj4+Pj4KPj4+Pj4+Pj4+IFRo ZSBjdXJyZW50IHNjaGVkdWxlciB0b3BvbG9neSBjb25zaXN0ZW50IHdpdGggQ1BVIHRvcG9sb2d5 Ogo+Pj4+Pj4+Pj4gRElFwqAgWzAtN10KPj4+Pj4+Pj4+IE1DwqAgWzAtM10gWzQtN13CoCAoU0Rf U0hBUkVfUEtHX1JFU09VUkNFUykKPj4+Pj4+Pj4+IE1vc3QgQW5kcm9pZCBwaG9uZXMgaGF2ZSB0 aGlzIHRvcG9sb2d5Lgo+Pj4+Pj4+Pj4+Cj4+Pj4+Pj4+Pj4gQnV0IHlvdSB3b3VsZCBsaWtlIHNv bWV0aGluZyBsaWtlIGJlbG93IGZvciBjcHUgMC0xIGluc3RlYWQgPwo+Pj4+Pj4+Pj4+IERJRSBb MMKgwqDCoMKgIC3CoMKgwqDCoCAzXSBbNC03XQo+Pj4+Pj4+Pj4+IENMUyBbMCAtIDFdIFsyIC0g M10KPj4+Pj4+Pj4+PiBNQ8KgIFswXSBbMV0KPj4+Pj4+Pj4+Pgo+Pj4+Pj4+Pj4+IHdpdGggU0Rf U0hBUkVfUEtHX1JFU09VUkNFUyBvbmx5IHNldCB0byBNQyBsZXZlbCA/Cj4+Pj4+Pj4+Pgo+Pj4+ Pj4+Pj4gV2UgZG9uJ3QgY2hhbmdlIHRoZSBjdXJyZW50IHNjaGVkdWxlciB0b3BvbG9neSwgYnV0 IHRoZQo+Pj4+Pj4+Pj4gY2FjaGUgdG9wb2xvZ3kgc2hvdWxkIGJlIHNlcGFyYXRlZCBsaWtlIGJl bG93Ogo+Pj4+Pj4+Pgo+Pj4+Pj4+PiBUaGUgc2NoZWR1bGVyIHRvcG9sb2d5IGlzIG5vdCBvbmx5 IGNwdSB0b3BvbG9neSBidXQgYSBtaXhlZCBvZiBjcHUgYW5kCj4+Pj4+Pj4+IGNhY2hlL21lbW9y eSBjYWNoZSB0b3BvbG9neQo+Pj4+Pj4+Pgo+Pj4+Pj4+Pj4gWzAtN13CoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCAoc2hhcmVkIGxldmVsIDMgY2FjaGUg KQo+Pj4+Pj4+Pj4gWzAtMV0gWzItM11bNC01XVs2LTddwqDCoCAoc2hhcmVkIGxldmVsIDIgY2Fj aGUgKQo+Pj4+Pj4+Pgo+Pj4+Pj4+PiBTbyB5b3UgZG9uJ3TCoCBib3RoZXIgdGhlIGludGVybWVk aWF0ZSBjbHVzdGVyIGxldmVsIHdoaWNoIGlzIGV2ZW4gc2ltcGxlci4KPj4+Pj4+Pj4geW91IGhh dmUgdG8gbW9kaWZ5IGdlbmVyaWMgYXJjaCB0b3BvbG9neSBzbyB0aGF0IGNwdV9jb3JlZ3JvdXBf bWFzawo+Pj4+Pj4+PiByZXR1cm5zIHRoZSBjb3JyZWN0IGNwdSBtYXNrIGRpcmVjdGx5Lgo+Pj4+ Pj4+Pgo+Pj4+Pj4+PiBZb3Ugd2lsbCBub3RpY2UgYSBsbGNfc2libGluZyBmaWVsZCB0aGF0IGlz IGN1cnJlbnRseSB1c2VkIGJ5IGFjcGkgYnV0Cj4+Pj4+Pj4+IG5vdCBEVCB0byByZXR1cm4gbGxj IGNwdSBtYXNrCj4+Pj4+Pj4+Cj4+Pj4+Pj4gY3B1X3RvcG9sb2d5W10ubGxjX3NpYmxpbmcgZGVz Y3JpYmUgdGhlIGxhc3QgbGV2ZWwgY2FjaGUgb2Ygd2hvbGUgc3lzdGVtLAo+Pj4+Pj4+IG5vdCBp biB0aGUgc2NoZWRfZG9tYWluLgo+Pj4+Pj4+Cj4+Pj4+Pj4gaW4gdGhlIGFib3ZlIGNhY2hlIHRv cG9sb2d5LCBsbGNfc2libGluZyBpcyAweGZmKFswLTddKSAsIGl0IGRlc2NyaWJlcwo+Pj4+Pj4K Pj4+Pj4+IElmIGxsY19zaWJsaW5nIHdhcyAweGZmKFswLTddIG9uIHlvdXIgc3lzdGVtLCB5b3Ug d291bGQgaGF2ZSBvbmx5IG9uZSBsZXZlbDoKPj4+Pj4+IE1DWzAtN10KPj4+Pj4KPj4+Pj4gU29y cnksIGJ1dCBJIGRvbid0IGdldCBpdCwgd2h5IGxsY19zaWJsaW5nIHdhcyAweGZmKFswLTddIG1l YW5zIE1DWzAtN10/Cj4+Pj4+IEluIG91ciBzeXN0ZW0oQW5kcm9pZCksIGxsY19zaWJsaW5nIGlz IGluZGVlZCAweGZmKFswLTddKSAsIGJlY2F1c2UgdGhleQo+Pj4+PiBzaGFyZWQgdGhlIGxsYyhM MyksIGJ1dCB3ZSBhbHNvIGhhdmUgdHdvIGxldmVsOgo+Pj4+PiBESUUgWzAtN10KPj4+Pj4gTUMg WzAtM11bNC02XQo+Pj4+PiBJdCBtYWtlcyBzZW5zZSwgWzAtM10gYXJlIGxpdHRsZSBjb3Jlcywg WzQtN10gYXJlIGJpdCBjb3Jlcywgc2Ugb25seSB1cCBtaWdyYXRlCj4+Pj4+IHdoZW4gbWlzZml0 LiBXZSB3b24ndCBjaGFuZ2UgaXQuCj4+Pj4+Cj4+Pj4+Pgo+Pj4+Pj4+IHRoZSBMMyBjYWNoZSBz aWJsaW5nLCBidXQgc2RfbGxjX2lkIGRlc2NyaWJlcyB0aGUgbWF4aW11bSBzaGFyZWQgY2FjaGUK Pj4+Pj4+PiBpbiBzZCwgd2hpY2ggc2hvdWxkIGJlIFswLTFdIGluc3RlYWQgb2YgWzAtM10uCj4+ Pj4+Pgo+Pj4+Pj4gc2RfbGxjX2lkIGRlc2NyaWJlcyB0aGUgbGFzdCBzY2hlZF9kb21haW4gd2l0 aCBTRF9TSEFSRV9QS0dfUkVTT1VSQ0VTLgo+Pj4+Pj4gSWYgeW91IHdhbnQgbGxjIHRvIGJlIFsw LTNdIG1ha2Ugc3VyZSB0aGF0IHRoZQo+Pj4+Pj4gc2NoZWRfZG9tYWluX3RvcG9sb2d5X2xldmVs IGFycmF5IHJldHVybnMgdGhlIGNvcnJlY3QgY3B1bWFzayB3aXRoCj4+Pj4+PiB0aGlzIGZsYWcK Pj4+Pj4KPj4+Pj4gQWN0dXJlbHksIHdlIHdhbnQgc2RfbGxjIHRvIGJlIFswLTFdIFsyLTNdLCBi dXQgaWYgdGhlIE1DIGRvbWFpbiBkb24ndCBoYXZlCj4+Pj4KPj4+PiBzZF9sbGNfaWQgcmVmZXJz IHRvIGEgc2NoZWR1bGVyIGRvbWFpbiBidXQgeW91ciBwYXRjaCBicmVha3MgdGhpcyBzbwo+Pj4+ IGlmIHlvdSB3YW50IGEgbGxjIHRoYXQgcmVmbGVjdHMgdGhpcyB0b3BvOsKgIFswLTFdIFsyLTNd IHlvdSBtdXN0Cj4+Pj4gcHJvdmlkZSBhIHNjaGVkX2RvbWFpbiBsZXZlbCB3aXRoIHRoaXMgdG9w bwo+Pj4KPj4+IE1heWJlIHdlIHNob3VsZCBhZGQgYSBzaGFyZWQtY2FjaGUgbGV2ZWwoU0MpLCBs aWtlIHdoYXQgQ0xTIGRvZXM6Cj4+Pgo+Pj4gRElFwqAgWzAtN10gKHNoYXJlZCBsZXZlbCAzIGNh Y2hlLCBTRF9TSEFSRV9QS0dfUkVTT1VSQ0VTKQo+Pj4gTUPCoCBbMC0zXSBbNC03XcKgIChub3Qg U0RfU0hBUkVfUEtHX1JFU09VUkNFUykKPj4+IENMU8KgIChpZiBuZWNlc3NhcnkpCj4+PiBTQ8Kg wqDCoCBbMC0xXVsyLTNdWzQtNV1bNi03XSAoc2hhcmVkIGxldmVsIDIgY2FjaGUsIFNEX1NIQVJF X1BLR19SRVNPVVJDRVMpCj4+PiBTTVQgKGlmIG5lY2Vzc2FyeSkKPj4+Cj4+PiBTQyBtZWFucyBh IGNvdXBsZSBvZiBDUFVzIHdoaWNoIGFyZSBwbGFjZWQgY2xvc2VseSBieSBzaGFyaW5nCj4+PiBt aWQtbGV2ZWwgY2FjaGVzLCBidXQgbm90IGVub3VnaCB0byBiZSBhIGNsdXN0ZXIuCj4+Cj4+IHdo YXQgeW91IG5hbWUgU0MgYWJvdmUgbG9va3MgdGhlIHNhbWUgYXMgQ0xTIHdoaWNoIHNob3VsZCBu b3QgYmUgbWl4ZWQKPj4gd2l0aCBBcm0gY2x1c3RlciB0ZXJtaW5vbG9neQo+IAo+IERvIHlvdSBt ZWFuIGNsdXN0ZXIgaXMgZXF1YWwgdG8gc2hhcmVkIGNhY2hlIGluc3RlYWQgb2YgY29udGFpbmlu ZywgU0MganVzdCAKPiBtZWFucyBzaGFyZWQgY2FjaGUsIGJ1dCBub3QgZm9ybSBhIGNsdXN0ZXIs IGEgQ0xTIGNhbiBjb250YWluIG1hbnkgU0NzLgo+IAoKVGhlIGNsdXN0ZXIgaXMgYSB0b3BvbG9n eSBsZXZlbCBhYm92ZSB0aGUgQ1BVcyBidXQgdW5kZXIgTExDLiBPbiBLdW5wZW5nIDkyMCB0aGUg Y3B1cwppbiBhIENMUyB3aWxsIHNoYXJlIEwzVCBhbmQgb24gSW50ZWwncyBKYWNvYnN2aWxsZSBj cHVzIGluIGEgQ0xTIHdpbGwgc2hhcmUgTDJbMV0uCgpTZWVtcyB5b3UncmUgdXNpbmcgYSBEVCBi YXNlZCBzeXN0ZW0uIEkgdGhpbmsgdGhlIHBhcnNpbmcgb2YgY2x1c3RlciBsZXZlbCBpcyBub3QK c3VwcG9ydGVkIG9uIERUIHlldCBzbyB5b3UgY2Fubm90IHNlZSBpdC4gT3RoZXJ3aXNlIHdpdGgg cmlnaHQgY3B1IHRvcG9sb2d5IHJlcG9ydGVkCnlvdSB3aWxsIGhhdmUgYSBDTFMgbGV2ZWwgaW4g d2hpY2ggdGhlIGNwdXMgc2hhcmUgTDIgY2FjaGUsIGp1c3QgbGlrZSBKYWNvYnN2aWxsZS4KClsx XSBodHRwczovL2xvcmUua2VybmVsLm9yZy9hbGwvMjAyMTA5MjQwODUxMDQuNDQ4MDYtNC0yMWNu YmFvQGdtYWlsLmNvbS8KCj4gSWYgYXMgeW91IHNhaWQsIFNDIGxvb2tzIHRoZSBzYW1lIGFzIENM Uywgc2hvdWxkIHdlIHJlbmFtZSBDTFMgdG8gU0MgdG8gCj4gYXZvaWQgY29uZnVzaW9uPwo+IAo+ IFRoYW5rcywKPiBXYW5nCj4gCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fXwpsaW51eC1hcm0ta2VybmVsIG1haWxpbmcgbGlzdApsaW51eC1hcm0ta2VybmVs QGxpc3RzLmluZnJhZGVhZC5vcmcKaHR0cDovL2xpc3RzLmluZnJhZGVhZC5vcmcvbWFpbG1hbi9s aXN0aW5mby9saW51eC1hcm0ta2VybmVsCg==