From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS, USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 82BCAC433FE for ; Wed, 22 Sep 2021 19:52:30 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 653D161050 for ; Wed, 22 Sep 2021 19:52:30 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237278AbhIVTx7 (ORCPT ); Wed, 22 Sep 2021 15:53:59 -0400 Received: from us-smtp-delivery-124.mimecast.com ([170.10.133.124]:22239 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S237262AbhIVTxx (ORCPT ); Wed, 22 Sep 2021 15:53:53 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1632340341; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xKJgefLdWJy0dp9TYiGmtdcSy+WA2ewqvdcD0wX0UjM=; b=GfCwVW7gBe6f2cLwBpZlazaSDDefEFmdU9kFIjM7dG0iZlLtFFFeDqfReWio1q1tG1kud5 F7vRt3S+vzf7Z9WdCYqNuemWu4b7uCP9PLmhShH/j2o+ijZkmOtkZwMbyUtR9ERImjsqOw iXeJayXt6bpyZZyKoSVaBs/Sp8DBcIg= Received: from mail-qt1-f200.google.com (mail-qt1-f200.google.com [209.85.160.200]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-380-G5zSQINEPkmGkcBBXwUKkQ-1; Wed, 22 Sep 2021 15:52:20 -0400 X-MC-Unique: G5zSQINEPkmGkcBBXwUKkQ-1 Received: by mail-qt1-f200.google.com with SMTP id z16-20020ac86b90000000b0029eec160182so11006789qts.9 for ; Wed, 22 Sep 2021 12:52:20 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:subject:to:cc:references:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=xKJgefLdWJy0dp9TYiGmtdcSy+WA2ewqvdcD0wX0UjM=; b=cccklwJ+K+YDPX4KjAGYpeaD5qZ5gH3C+s/1jUT6j2DqDljKU0z6C/L5yOcqFFSaJl Zyqw7vcGN11fox9QAi+wEKL6R7Ig5sGiRf3rRuJy2XPSL/v+LZw74c6DaiUW8ftiL/9t s10rcSwspZaleHPMI5ow14z9ydmz6WXXHMuC+IqM1tBO0jciVoFZXCGG3jQca6LeP2JF DGYutGjX3jrh/WfJpzG2WSUEwkOduP1bMUs6Vk8pwFca0EVjzv4pYklnNfNEcoGn/qc3 p19at1YukLGbIRJvEvtH5AqWcyJxSLi5aQeIK7me4c16/Hfosb0/vGPIP94nUVVHve4+ zrFQ== X-Gm-Message-State: AOAM5339Wh0KDTxgSss0DRI8FocycfJjDfDlb2C7jb569v9nyHafGgoQ llYSB2sR3cDaOqiFZUD1cPvvk0464pG8GvBAa9dWge8IeWwlC/bQDGj8rg6UN69hWySCyH6mjjN 2Uu//80aAuUjd0tCTp280/z8I X-Received: by 2002:a37:a8c1:: with SMTP id r184mr1063024qke.389.1632340340190; Wed, 22 Sep 2021 12:52:20 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxvWXlOT4CAVdD5eoMa4qYxPLr98GVG+fY6djJAvqKhRJ80pZbxe74g2EjlcdKhL3xmrArIxw== X-Received: by 2002:a37:a8c1:: with SMTP id r184mr1062990qke.389.1632340339926; Wed, 22 Sep 2021 12:52:19 -0700 (PDT) Received: from llong.remote.csb ([2601:191:8500:76c0::cdbc]) by smtp.gmail.com with ESMTPSA id 188sm2533277qkm.21.2021.09.22.12.52.18 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 22 Sep 2021 12:52:19 -0700 (PDT) From: Waiman Long X-Google-Original-From: Waiman Long Subject: Re: [PATCH v15 3/6] locking/qspinlock: Introduce CNA into the slow path of qspinlock To: Davidlohr Bueso , Alex Kogan Cc: linux@armlinux.org.uk, peterz@infradead.org, mingo@redhat.com, will.deacon@arm.com, arnd@arndb.de, linux-arch@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, tglx@linutronix.de, bp@alien8.de, hpa@zytor.com, x86@kernel.org, guohanjun@huawei.com, jglauber@marvell.com, steven.sistare@oracle.com, daniel.m.jordan@oracle.com, dave.dice@oracle.com References: <20210514200743.3026725-1-alex.kogan@oracle.com> <20210514200743.3026725-4-alex.kogan@oracle.com> <20210922192528.ob22pu54oeqsoeno@offworld> Message-ID: <8e743acb-ec75-ea03-493a-d57154ab8fed@redhat.com> Date: Wed, 22 Sep 2021 15:52:18 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: <20210922192528.ob22pu54oeqsoeno@offworld> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 9/22/21 3:25 PM, Davidlohr Bueso wrote: > On Fri, 14 May 2021, Alex Kogan wrote: > >> diff --git a/Documentation/admin-guide/kernel-parameters.txt >> b/Documentation/admin-guide/kernel-parameters.txt >> index a816935d23d4..94d35507560c 100644 >> --- a/Documentation/admin-guide/kernel-parameters.txt >> +++ b/Documentation/admin-guide/kernel-parameters.txt >> @@ -3515,6 +3515,16 @@ >>             NUMA balancing. >>             Allowed values are enable and disable >> >> +    numa_spinlock=    [NUMA, PV_OPS] Select the NUMA-aware variant >> +            of spinlock. The options are: >> +            auto - Enable this variant if running on a multi-node >> +            machine in native environment. >> +            on  - Unconditionally enable this variant. > > Is there any reason why the user would explicitly pass the on option > when the auto thing already does the multi-node check? Perhaps strange > numa topologies? Otherwise I would say it's not needed and the fewer > options we give the user for low level locking the better. I asked Alex to put in a command line option because we may want to disable it on a multi-socket server if we want to. > >> +            off - Unconditionally disable this variant. >> + >> +            Not specifying this option is equivalent to >> +            numa_spinlock=auto. >> + >>     numa_zonelist_order= [KNL, BOOT] Select zonelist order for NUMA. >>             'node', 'default' can be specified >>             This can be set from sysctl after boot. >> diff --git a/arch/x86/Kconfig b/arch/x86/Kconfig >> index 0045e1b44190..819c3dad8afc 100644 >> --- a/arch/x86/Kconfig >> +++ b/arch/x86/Kconfig >> @@ -1564,6 +1564,26 @@ config NUMA >> >>       Otherwise, you should say N. >> >> +config NUMA_AWARE_SPINLOCKS >> +    bool "Numa-aware spinlocks" >> +    depends on NUMA >> +    depends on QUEUED_SPINLOCKS >> +    depends on 64BIT >> +    # For now, we depend on PARAVIRT_SPINLOCKS to make the patching >> work. >> +    # This is awkward, but hopefully would be resolved once >> static_call() >> +    # is available. >> +    depends on PARAVIRT_SPINLOCKS > > We now have static_call() - see 9183c3f9ed7. I agree that it is now time to look at using the static call for slowpath switching. > > >> +    default y >> +    help >> +      Introduce NUMA (Non Uniform Memory Access) awareness into >> +      the slow path of spinlocks. >> + >> +      In this variant of qspinlock, the kernel will try to keep the >> lock >> +      on the same node, thus reducing the number of remote cache >> misses, >> +      while trading some of the short term fairness for better >> performance. >> + >> +      Say N if you want absolute first come first serve fairness. > > This would also need a depends on !PREEMPT_RT, no? Raw spinlocks > really want > the determinism. Agreed Cheers, Longman From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3B9A9C433F5 for ; Wed, 22 Sep 2021 19:55:21 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 0592C61050 for ; Wed, 22 Sep 2021 19:55:20 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 0592C61050 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:Content-Type: Content-Transfer-Encoding:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:Date:Message-ID:References: Cc:To:Subject:From:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=EuwfTY7/k78OaQBJnhsbWT+0AbiL2r/0sLOFw3MEx9M=; b=BQvV+EjEdSV6OvZxkaGn/nuMVW TbInnNGsZIFo2bxv1tQCkBV1ZQJ+XgMlFt89bvXufM5DhVf3WmcYtcPtw1LleJ/qnL+hTUmMRhGkV WcH7C9HksP1GVHwgRHM6pmRz7JQFUjvChK5KBRAuFhcf5ANagtAEYZdw76zocutLrq21B4wwMy0VR DMBsVV0840IkzywSAUDK6raI4heywLE+kvvgBFeN4DxFJfsKjHzQsuehQFfASHBk3JAmtFvncn2aZ IY69batOrj5AiQK3RqElPoS3C90CuQ0RcxmLgoQAYyjLDGr8zUe2pgcmEBZOGUCYnf4aP/1SDyc91 kkPipA6g==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1mT8IA-009WXx-6K; Wed, 22 Sep 2021 19:52:30 +0000 Received: from us-smtp-delivery-124.mimecast.com ([170.10.133.124]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1mT8I4-009WVz-RY for linux-arm-kernel@lists.infradead.org; Wed, 22 Sep 2021 19:52:26 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1632340343; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xKJgefLdWJy0dp9TYiGmtdcSy+WA2ewqvdcD0wX0UjM=; b=h6/MY52kn7NTnKijKgu6rAa2gXqUXSG7Opn/aTxdkRxpyF7604UuODq6ttKm6NlwwgsYmc AIz8Zd7kOTkbHNljOT/AQuOR0jcCenajjFfphCKL/kqU/Hdv6qlCj2ePgbSbGR0FvdYXvc Vhus6zeUqRfSxJEHnRh/fMAjlMn0H6s= Received: from mail-qk1-f200.google.com (mail-qk1-f200.google.com [209.85.222.200]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-226-T0NUPj9qMKOWLaYuvAvIAw-1; Wed, 22 Sep 2021 15:52:20 -0400 X-MC-Unique: T0NUPj9qMKOWLaYuvAvIAw-1 Received: by mail-qk1-f200.google.com with SMTP id h10-20020a05620a284a00b003d30e8c8cb5so12353626qkp.11 for ; Wed, 22 Sep 2021 12:52:20 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:subject:to:cc:references:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=xKJgefLdWJy0dp9TYiGmtdcSy+WA2ewqvdcD0wX0UjM=; b=cKxcvGyo7V29npwftYsa4xyxIYOnLPhYam9pmZt96ees9rDVsbfynYVmxDYYXeunfN Zq94TFOk+qQ/nZRDXIrybcXAKkhqFzvbyb8LpcFrQ941TKySc16mnSHJJ82KO3Lthp0V M2clMv9joU5sv/rfgUZpgL/I0PQqnwIa3rQn9uPGV9PwF7x3ULgduL09AhVZix22IP6v /YQKtdCFpmWVtb0NSxHW6Bxw9N5wnQPJNWe54ZVSjHtXZnB2kAWZmupQ0ld+37qRDkEp JUeUXGrnGrFvQFfrr4XNSh3G45hn3CY1NKkGlcGS6VWw2aJyogd3akDzvnqTEYtyTT9G JINw== X-Gm-Message-State: AOAM5326DUOjrgOSpXX4u1TrvAuMtEVaQH993knmx0ruprJUhlZpwmNg QSTkkbnJDeSddmPhMflyrjcR/8cSWOl402PgoWvxdtCjtbpvkBe3JTMHG7UmmUi8iN7eIGmRW5H k9/lXkP/7bqD1ucv5iMIUwfsRSnsh89N6jRU= X-Received: by 2002:a37:a8c1:: with SMTP id r184mr1063021qke.389.1632340340190; Wed, 22 Sep 2021 12:52:20 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxvWXlOT4CAVdD5eoMa4qYxPLr98GVG+fY6djJAvqKhRJ80pZbxe74g2EjlcdKhL3xmrArIxw== X-Received: by 2002:a37:a8c1:: with SMTP id r184mr1062990qke.389.1632340339926; Wed, 22 Sep 2021 12:52:19 -0700 (PDT) Received: from llong.remote.csb ([2601:191:8500:76c0::cdbc]) by smtp.gmail.com with ESMTPSA id 188sm2533277qkm.21.2021.09.22.12.52.18 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 22 Sep 2021 12:52:19 -0700 (PDT) From: Waiman Long X-Google-Original-From: Waiman Long Subject: Re: [PATCH v15 3/6] locking/qspinlock: Introduce CNA into the slow path of qspinlock To: Davidlohr Bueso , Alex Kogan Cc: linux@armlinux.org.uk, peterz@infradead.org, mingo@redhat.com, will.deacon@arm.com, arnd@arndb.de, linux-arch@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, tglx@linutronix.de, bp@alien8.de, hpa@zytor.com, x86@kernel.org, guohanjun@huawei.com, jglauber@marvell.com, steven.sistare@oracle.com, daniel.m.jordan@oracle.com, dave.dice@oracle.com References: <20210514200743.3026725-1-alex.kogan@oracle.com> <20210514200743.3026725-4-alex.kogan@oracle.com> <20210922192528.ob22pu54oeqsoeno@offworld> Message-ID: <8e743acb-ec75-ea03-493a-d57154ab8fed@redhat.com> Date: Wed, 22 Sep 2021 15:52:18 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: <20210922192528.ob22pu54oeqsoeno@offworld> Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=llong@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210922_125224_994504_B9AE3939 X-CRM114-Status: GOOD ( 27.29 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org T24gOS8yMi8yMSAzOjI1IFBNLCBEYXZpZGxvaHIgQnVlc28gd3JvdGU6Cj4gT24gRnJpLCAxNCBN YXkgMjAyMSwgQWxleCBLb2dhbiB3cm90ZToKPgo+PiBkaWZmIC0tZ2l0IGEvRG9jdW1lbnRhdGlv bi9hZG1pbi1ndWlkZS9rZXJuZWwtcGFyYW1ldGVycy50eHQgCj4+IGIvRG9jdW1lbnRhdGlvbi9h ZG1pbi1ndWlkZS9rZXJuZWwtcGFyYW1ldGVycy50eHQKPj4gaW5kZXggYTgxNjkzNWQyM2Q0Li45 NGQzNTUwNzU2MGMgMTAwNjQ0Cj4+IC0tLSBhL0RvY3VtZW50YXRpb24vYWRtaW4tZ3VpZGUva2Vy bmVsLXBhcmFtZXRlcnMudHh0Cj4+ICsrKyBiL0RvY3VtZW50YXRpb24vYWRtaW4tZ3VpZGUva2Vy bmVsLXBhcmFtZXRlcnMudHh0Cj4+IEBAIC0zNTE1LDYgKzM1MTUsMTYgQEAKPj4gwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCBOVU1BIGJhbGFuY2luZy4KPj4gwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBB bGxvd2VkIHZhbHVlcyBhcmUgZW5hYmxlIGFuZCBkaXNhYmxlCj4+Cj4+ICvCoMKgwqAgbnVtYV9z cGlubG9jaz3CoMKgwqAgW05VTUEsIFBWX09QU10gU2VsZWN0IHRoZSBOVU1BLWF3YXJlIHZhcmlh bnQKPj4gK8KgwqDCoMKgwqDCoMKgwqDCoMKgwqAgb2Ygc3BpbmxvY2suIFRoZSBvcHRpb25zIGFy ZToKPj4gK8KgwqDCoMKgwqDCoMKgwqDCoMKgwqAgYXV0byAtIEVuYWJsZSB0aGlzIHZhcmlhbnQg aWYgcnVubmluZyBvbiBhIG11bHRpLW5vZGUKPj4gK8KgwqDCoMKgwqDCoMKgwqDCoMKgwqAgbWFj aGluZSBpbiBuYXRpdmUgZW52aXJvbm1lbnQuCj4+ICvCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIG9u wqAgLSBVbmNvbmRpdGlvbmFsbHkgZW5hYmxlIHRoaXMgdmFyaWFudC4KPgo+IElzIHRoZXJlIGFu eSByZWFzb24gd2h5IHRoZSB1c2VyIHdvdWxkIGV4cGxpY2l0bHkgcGFzcyB0aGUgb24gb3B0aW9u Cj4gd2hlbiB0aGUgYXV0byB0aGluZyBhbHJlYWR5IGRvZXMgdGhlIG11bHRpLW5vZGUgY2hlY2s/ IFBlcmhhcHMgc3RyYW5nZQo+IG51bWEgdG9wb2xvZ2llcz8gT3RoZXJ3aXNlIEkgd291bGQgc2F5 IGl0J3Mgbm90IG5lZWRlZCBhbmQgdGhlIGZld2VyCj4gb3B0aW9ucyB3ZSBnaXZlIHRoZSB1c2Vy IGZvciBsb3cgbGV2ZWwgbG9ja2luZyB0aGUgYmV0dGVyLgoKSSBhc2tlZCBBbGV4IHRvIHB1dCBp biBhIGNvbW1hbmQgbGluZSBvcHRpb24gYmVjYXVzZSB3ZSBtYXkgd2FudCB0byAKZGlzYWJsZSBp dCBvbiBhIG11bHRpLXNvY2tldCBzZXJ2ZXIgaWYgd2Ugd2FudCB0by4KCgo+Cj4+ICvCoMKgwqDC oMKgwqDCoMKgwqDCoMKgIG9mZiAtIFVuY29uZGl0aW9uYWxseSBkaXNhYmxlIHRoaXMgdmFyaWFu dC4KPj4gKwo+PiArwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBOb3Qgc3BlY2lmeWluZyB0aGlzIG9w dGlvbiBpcyBlcXVpdmFsZW50IHRvCj4+ICvCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIG51bWFfc3Bp bmxvY2s9YXV0by4KPj4gKwo+PiDCoMKgwqDCoG51bWFfem9uZWxpc3Rfb3JkZXI9IFtLTkwsIEJP T1RdIFNlbGVjdCB6b25lbGlzdCBvcmRlciBmb3IgTlVNQS4KPj4gwqDCoMKgwqDCoMKgwqDCoMKg wqDCoCAnbm9kZScsICdkZWZhdWx0JyBjYW4gYmUgc3BlY2lmaWVkCj4+IMKgwqDCoMKgwqDCoMKg wqDCoMKgwqAgVGhpcyBjYW4gYmUgc2V0IGZyb20gc3lzY3RsIGFmdGVyIGJvb3QuCj4+IGRpZmYg LS1naXQgYS9hcmNoL3g4Ni9LY29uZmlnIGIvYXJjaC94ODYvS2NvbmZpZwo+PiBpbmRleCAwMDQ1 ZTFiNDQxOTAuLjgxOWMzZGFkOGFmYyAxMDA2NDQKPj4gLS0tIGEvYXJjaC94ODYvS2NvbmZpZwo+ PiArKysgYi9hcmNoL3g4Ni9LY29uZmlnCj4+IEBAIC0xNTY0LDYgKzE1NjQsMjYgQEAgY29uZmln IE5VTUEKPj4KPj4gwqDCoMKgwqDCoCBPdGhlcndpc2UsIHlvdSBzaG91bGQgc2F5IE4uCj4+Cj4+ ICtjb25maWcgTlVNQV9BV0FSRV9TUElOTE9DS1MKPj4gK8KgwqDCoCBib29sICJOdW1hLWF3YXJl IHNwaW5sb2NrcyIKPj4gK8KgwqDCoCBkZXBlbmRzIG9uIE5VTUEKPj4gK8KgwqDCoCBkZXBlbmRz IG9uIFFVRVVFRF9TUElOTE9DS1MKPj4gK8KgwqDCoCBkZXBlbmRzIG9uIDY0QklUCj4+ICvCoMKg wqAgIyBGb3Igbm93LCB3ZSBkZXBlbmQgb24gUEFSQVZJUlRfU1BJTkxPQ0tTIHRvIG1ha2UgdGhl IHBhdGNoaW5nIAo+PiB3b3JrLgo+PiArwqDCoMKgICMgVGhpcyBpcyBhd2t3YXJkLCBidXQgaG9w ZWZ1bGx5IHdvdWxkIGJlIHJlc29sdmVkIG9uY2UgCj4+IHN0YXRpY19jYWxsKCkKPj4gK8KgwqDC oCAjIGlzIGF2YWlsYWJsZS4KPj4gK8KgwqDCoCBkZXBlbmRzIG9uIFBBUkFWSVJUX1NQSU5MT0NL Uwo+Cj4gV2Ugbm93IGhhdmUgc3RhdGljX2NhbGwoKSAtIHNlZSA5MTgzYzNmOWVkNy4KSSBhZ3Jl ZSB0aGF0IGl0IGlzIG5vdyB0aW1lIHRvIGxvb2sgYXQgdXNpbmcgdGhlIHN0YXRpYyBjYWxsIGZv ciAKc2xvd3BhdGggc3dpdGNoaW5nLgo+Cj4KPj4gK8KgwqDCoCBkZWZhdWx0IHkKPj4gK8KgwqDC oCBoZWxwCj4+ICvCoMKgwqDCoMKgIEludHJvZHVjZSBOVU1BIChOb24gVW5pZm9ybSBNZW1vcnkg QWNjZXNzKSBhd2FyZW5lc3MgaW50bwo+PiArwqDCoMKgwqDCoCB0aGUgc2xvdyBwYXRoIG9mIHNw aW5sb2Nrcy4KPj4gKwo+PiArwqDCoMKgwqDCoCBJbiB0aGlzIHZhcmlhbnQgb2YgcXNwaW5sb2Nr LCB0aGUga2VybmVsIHdpbGwgdHJ5IHRvIGtlZXAgdGhlIAo+PiBsb2NrCj4+ICvCoMKgwqDCoMKg IG9uIHRoZSBzYW1lIG5vZGUsIHRodXMgcmVkdWNpbmcgdGhlIG51bWJlciBvZiByZW1vdGUgY2Fj aGUgCj4+IG1pc3NlcywKPj4gK8KgwqDCoMKgwqAgd2hpbGUgdHJhZGluZyBzb21lIG9mIHRoZSBz aG9ydCB0ZXJtIGZhaXJuZXNzIGZvciBiZXR0ZXIgCj4+IHBlcmZvcm1hbmNlLgo+PiArCj4+ICvC oMKgwqDCoMKgIFNheSBOIGlmIHlvdSB3YW50IGFic29sdXRlIGZpcnN0IGNvbWUgZmlyc3Qgc2Vy dmUgZmFpcm5lc3MuCj4KPiBUaGlzIHdvdWxkIGFsc28gbmVlZCBhIGRlcGVuZHMgb24gIVBSRUVN UFRfUlQsIG5vPyBSYXcgc3BpbmxvY2tzIAo+IHJlYWxseSB3YW50Cj4gdGhlIGRldGVybWluaXNt LiAKCkFncmVlZAoKQ2hlZXJzLApMb25nbWFuCgoKX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX18KbGludXgtYXJtLWtlcm5lbCBtYWlsaW5nIGxpc3QKbGludXgt YXJtLWtlcm5lbEBsaXN0cy5pbmZyYWRlYWQub3JnCmh0dHA6Ly9saXN0cy5pbmZyYWRlYWQub3Jn L21haWxtYW4vbGlzdGluZm8vbGludXgtYXJtLWtlcm5lbAo=