From mboxrd@z Thu Jan 1 00:00:00 1970 From: Karol Herbst Subject: Re: [PATCH v4] pci: prevent putting nvidia GPUs into lower device states on certain intel bridges Date: Wed, 20 Nov 2019 12:51:17 +0100 Message-ID: References: <20191017121901.13699-1-kherbst@redhat.com> <20191119214955.GA223696@google.com> <20191120101816.GX11621@lahna.fi.intel.com> <20191120112212.GA11621@lahna.fi.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Return-path: In-Reply-To: Sender: linux-kernel-owner@vger.kernel.org To: "Rafael J. Wysocki" Cc: Mika Westerberg , Bjorn Helgaas , LKML , Lyude Paul , "Rafael J . Wysocki" , Linux PCI , Linux PM , dri-devel , nouveau , Dave Airlie , Mario Limonciello List-Id: dri-devel@lists.freedesktop.org On Wed, Nov 20, 2019 at 12:48 PM Rafael J. Wysocki wrot= e: > > On Wed, Nov 20, 2019 at 12:22 PM Mika Westerberg > wrote: > > > > On Wed, Nov 20, 2019 at 11:52:22AM +0100, Rafael J. Wysocki wrote: > > > On Wed, Nov 20, 2019 at 11:18 AM Mika Westerberg > > > wrote: > > > > > > > > Hi Karol, > > > > > > > > On Tue, Nov 19, 2019 at 11:26:45PM +0100, Karol Herbst wrote: > > > > > On Tue, Nov 19, 2019 at 10:50 PM Bjorn Helgaas wrote: > > > > > > > > > > > > [+cc Dave] > > > > > > > > > > > > On Thu, Oct 17, 2019 at 02:19:01PM +0200, Karol Herbst wrote: > > > > > > > Fixes state transitions of Nvidia Pascal GPUs from D3cold int= o higher device > > > > > > > states. > > > > > > > > > > > > > > v2: convert to pci_dev quirk > > > > > > > put a proper technical explanation of the issue as a in-c= ode comment > > > > > > > v3: disable it only for certain combinations of intel and nvi= dia hardware > > > > > > > v4: simplify quirk by setting flag on the GPU itself > > > > > > > > > > > > I have zero confidence that we understand the real problem, but= we do > > > > > > need to do something with this. I'll merge it for v5.5 if we g= et the > > > > > > minor procedural stuff below straightened out. > > > > > > > > > > > > > > > > Thanks, and I agree with your statement, but at this point I thin= k > > > > > only Intel can help out digging deeper as I see no way to debug t= his > > > > > further. > > > > > > > > I don't have anything against this patch, as long as the quirk stay= s > > > > limited to the particular root port leading to the NVIDIA GPU. The > > > > reason why I think it should to be limited is that I'm pretty certa= in > > > > the problem is not in the root port itself. I have here a KBL based > > > > Thinkpad X1 Carbon 6th gen that can put the TBT controller into D3c= old > > > > (it is connected to PCH root port) and it wakes up there just fine,= so > > > > don't want to break that. > > > > > > > > Now, PCIe devices cannot go into D3cold all by themselves. They alw= ays > > > > need help from the platform side which is ACPI in this case. This i= s > > > > done by having the device to have _PR3 method that returns one or m= ore > > > > power resources that the OS is supposed to turn off when the device= is > > > > put into D3cold. All of that is implemented as form of ACPI methods= that > > > > pretty much do the hardware specific things that are outside of PCI= e > > > > spec to get the device into D3cold. At high level the _OFF() method > > > > causes the root port to broadcast PME_Turn_Off message that results= the > > > > link to enter L2/3 ready, it then asserts PERST, configures WAKE (b= oth > > > > can be GPIOs) and finally removes power (if the link goes into L3, > > > > otherwise it goes into L2). > > > > > > > > I think this is where the problem actually lies - the ASL methods t= hat > > > > are used to put the device into D3cold and back. We know that in Wi= ndows > > > > this all works fine so unless Windows quirks the root port the same= way > > > > there is another reason behind this. > > > > > > > > In case of Dell XPS 9560 (IIRC that's the machine you have) the > > > > corresponding power resource is called \_SB.PCI0.PEG0.PG00 and its > > > > _ON/_OFF methods end up calling PGON()/PGOF() accordingly. The meth= ods > > > > itself do lots of things and it is hard to follow the dissassembled > > > > ASL which does not have any comments but there are couple of things= that > > > > stand out where we may go into a different path. One of them is thi= s in > > > > the PGOF() method: > > > > > > > > If (((OSYS <=3D 0x07D9) || ((OSYS =3D=3D 0x07DF) && (_REV =3D=3D= 0x05)))) > > > > > > > > The ((OSYS =3D=3D 0x07DF) && (_REV =3D=3D 0x05)) checks specificall= y for Linux > > > > (see [1] and 18d78b64fddc ("ACPI / init: Make it possible to overri= de > > > > _REV")) so it might be that Dell people tested this at some point i= n > > > > Linux as well. Added Mario in case he has any ideas. > > > > > > > > Previously I suggested you to try the ACPI method tracing to see wh= at > > > > happens inside PGOF(). Did you have time to try it? It may provide = more > > > > information about that is happening inside those methods and hopefu= lly > > > > point us to the root cause. > > > > > > > > Also if you haven't tried already passing acpi_rev_override in the > > > > command line makes the _REV to return 5 so it should go into the "L= inux" > > > > path in PGOF(). > > > > > > Oh, so does it look like we are trying to work around AML that tried > > > to work around some problematic behavior in Linux at one point? > > > > Yes, it looks like so if I read the ASL right. > > OK, so that would call for a DMI-based quirk as the real cause for the > issue seems to be the AML in question, which means a firmware problem. > And I disagree as this is a linux specific workaround and windows goes that path and succeeds. This firmware based workaround was added, because it broke on Linux. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C091EC432C3 for ; Wed, 20 Nov 2019 11:51:41 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id A0894223D0 for ; Wed, 20 Nov 2019 11:51:41 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org A0894223D0 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 1009E6E340; Wed, 20 Nov 2019 11:51:41 +0000 (UTC) Received: from us-smtp-delivery-1.mimecast.com (us-smtp-2.mimecast.com [207.211.31.81]) by gabe.freedesktop.org (Postfix) with ESMTPS id BE1786E354 for ; Wed, 20 Nov 2019 11:51:34 +0000 (UTC) Received: from mail-qv1-f69.google.com (mail-qv1-f69.google.com [209.85.219.69]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-105-wxdcq1urOQqiqUUAx0Xu5g-1; Wed, 20 Nov 2019 06:51:29 -0500 Received: by mail-qv1-f69.google.com with SMTP id i32so16907298qvi.21 for ; Wed, 20 Nov 2019 03:51:29 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=CFyc/FUMDYyl2BocV0QKj5FHf/d/2FxPovJ0RWOX7+w=; b=RMrQ/gnpEa7PjK+fcyGaWg6k3lQteTTqch9vJfWQjXWeQmJ9r95rjMnrvnoVLsAKFD 31voSAFd4whblBKU0jQENF7VDqHSQNwCisw4UsDB6jR0n+Ff9kFgTG0d3H2HclhdjEsu h9izDEn+syquse0pt+3yj88OJV5zApzX0cXtpqk1sYdp5SbDdml8gguJzg3Y+vqWoj+F I43S92lb6E7cLR7KCVel8qtRTDFcLxwVuVmAv77LqPV4mvcrNbG+LXr4vLgQtAHsnpXt lXeNFNvO96oFhbEIGowrQNT7dpmK1TUel6gNnk4P3pCaCKLgm7I6c23X9G7EtwV+d8gW bFnQ== X-Gm-Message-State: APjAAAXf3r6BY7xgPs5QZ2055ldSqN0LS46ypDiZ/oXE1r7uOT2aXONH 0vRvtjFauQW2+dFSMG9FSbCIGAAvtxe8kWgrXayBDqaqNUoyTg/SmxhSr2T8IYnQvqtTNqy4nWc 9Qry7rey5Y1zKh5nrt9Kmvu+yJe7tOmTdLLADdY7X0Jtr X-Received: by 2002:a05:6214:14f0:: with SMTP id k16mr2065694qvw.113.1574250689374; Wed, 20 Nov 2019 03:51:29 -0800 (PST) X-Google-Smtp-Source: APXvYqxmoVHi1aepvACHCY2OtChU4LEM17did3RPg+o9gU8lcAL0EutXabIB172KzXiQD117jaDtm40U40hXQku32kA= X-Received: by 2002:a05:6214:14f0:: with SMTP id k16mr2065670qvw.113.1574250689023; Wed, 20 Nov 2019 03:51:29 -0800 (PST) MIME-Version: 1.0 References: <20191017121901.13699-1-kherbst@redhat.com> <20191119214955.GA223696@google.com> <20191120101816.GX11621@lahna.fi.intel.com> <20191120112212.GA11621@lahna.fi.intel.com> In-Reply-To: From: Karol Herbst Date: Wed, 20 Nov 2019 12:51:17 +0100 Message-ID: Subject: Re: [PATCH v4] pci: prevent putting nvidia GPUs into lower device states on certain intel bridges To: "Rafael J. Wysocki" X-MC-Unique: wxdcq1urOQqiqUUAx0Xu5g-1 X-Mimecast-Spam-Score: 0 X-Mailman-Original-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1574250693; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iPxRqpnj1VRvKWjlC4bBmohXIj2CvgKB/Q/qWInRYCM=; b=c1cv8ExlTQsm5bWXNPt4GCJJ+xaP5GwoFxlmpSpvE+SXNzkwJpcMbGNlou61EUfDs7/9DH jbXmbgEypPmT7wHvNiLEQtIAixs4qszODEGhwc909Lp9t6++8mjR6c0Efs7dZjU2/9ln0F d6SqL+d4hKlk0EiCKeUwucGrNkOjUDI= X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Linux PM , Linux PCI , Mika Westerberg , Mario Limonciello , "Rafael J . Wysocki" , LKML , dri-devel , Bjorn Helgaas , nouveau Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" Message-ID: <20191120115117.F9ghSRSYRiOGBVvVGFiQIGQgUW4d_m_PE7gS_qCs54Y@z> T24gV2VkLCBOb3YgMjAsIDIwMTkgYXQgMTI6NDggUE0gUmFmYWVsIEouIFd5c29ja2kgPHJhZmFl bEBrZXJuZWwub3JnPiB3cm90ZToKPgo+IE9uIFdlZCwgTm92IDIwLCAyMDE5IGF0IDEyOjIyIFBN IE1pa2EgV2VzdGVyYmVyZwo+IDxtaWthLndlc3RlcmJlcmdAaW50ZWwuY29tPiB3cm90ZToKPiA+ Cj4gPiBPbiBXZWQsIE5vdiAyMCwgMjAxOSBhdCAxMTo1MjoyMkFNICswMTAwLCBSYWZhZWwgSi4g V3lzb2NraSB3cm90ZToKPiA+ID4gT24gV2VkLCBOb3YgMjAsIDIwMTkgYXQgMTE6MTggQU0gTWlr YSBXZXN0ZXJiZXJnCj4gPiA+IDxtaWthLndlc3RlcmJlcmdAaW50ZWwuY29tPiB3cm90ZToKPiA+ ID4gPgo+ID4gPiA+IEhpIEthcm9sLAo+ID4gPiA+Cj4gPiA+ID4gT24gVHVlLCBOb3YgMTksIDIw MTkgYXQgMTE6MjY6NDVQTSArMDEwMCwgS2Fyb2wgSGVyYnN0IHdyb3RlOgo+ID4gPiA+ID4gT24g VHVlLCBOb3YgMTksIDIwMTkgYXQgMTA6NTAgUE0gQmpvcm4gSGVsZ2FhcyA8aGVsZ2Fhc0BrZXJu ZWwub3JnPiB3cm90ZToKPiA+ID4gPiA+ID4KPiA+ID4gPiA+ID4gWytjYyBEYXZlXQo+ID4gPiA+ ID4gPgo+ID4gPiA+ID4gPiBPbiBUaHUsIE9jdCAxNywgMjAxOSBhdCAwMjoxOTowMVBNICswMjAw LCBLYXJvbCBIZXJic3Qgd3JvdGU6Cj4gPiA+ID4gPiA+ID4gRml4ZXMgc3RhdGUgdHJhbnNpdGlv bnMgb2YgTnZpZGlhIFBhc2NhbCBHUFVzIGZyb20gRDNjb2xkIGludG8gaGlnaGVyIGRldmljZQo+ ID4gPiA+ID4gPiA+IHN0YXRlcy4KPiA+ID4gPiA+ID4gPgo+ID4gPiA+ID4gPiA+IHYyOiBjb252 ZXJ0IHRvIHBjaV9kZXYgcXVpcmsKPiA+ID4gPiA+ID4gPiAgICAgcHV0IGEgcHJvcGVyIHRlY2hu aWNhbCBleHBsYW5hdGlvbiBvZiB0aGUgaXNzdWUgYXMgYSBpbi1jb2RlIGNvbW1lbnQKPiA+ID4g PiA+ID4gPiB2MzogZGlzYWJsZSBpdCBvbmx5IGZvciBjZXJ0YWluIGNvbWJpbmF0aW9ucyBvZiBp bnRlbCBhbmQgbnZpZGlhIGhhcmR3YXJlCj4gPiA+ID4gPiA+ID4gdjQ6IHNpbXBsaWZ5IHF1aXJr IGJ5IHNldHRpbmcgZmxhZyBvbiB0aGUgR1BVIGl0c2VsZgo+ID4gPiA+ID4gPgo+ID4gPiA+ID4g PiBJIGhhdmUgemVybyBjb25maWRlbmNlIHRoYXQgd2UgdW5kZXJzdGFuZCB0aGUgcmVhbCBwcm9i bGVtLCBidXQgd2UgZG8KPiA+ID4gPiA+ID4gbmVlZCB0byBkbyBzb21ldGhpbmcgd2l0aCB0aGlz LiAgSSdsbCBtZXJnZSBpdCBmb3IgdjUuNSBpZiB3ZSBnZXQgdGhlCj4gPiA+ID4gPiA+IG1pbm9y IHByb2NlZHVyYWwgc3R1ZmYgYmVsb3cgc3RyYWlnaHRlbmVkIG91dC4KPiA+ID4gPiA+ID4KPiA+ ID4gPiA+Cj4gPiA+ID4gPiBUaGFua3MsIGFuZCBJIGFncmVlIHdpdGggeW91ciBzdGF0ZW1lbnQs IGJ1dCBhdCB0aGlzIHBvaW50IEkgdGhpbmsKPiA+ID4gPiA+IG9ubHkgSW50ZWwgY2FuIGhlbHAg b3V0IGRpZ2dpbmcgZGVlcGVyIGFzIEkgc2VlIG5vIHdheSB0byBkZWJ1ZyB0aGlzCj4gPiA+ID4g PiBmdXJ0aGVyLgo+ID4gPiA+Cj4gPiA+ID4gSSBkb24ndCBoYXZlIGFueXRoaW5nIGFnYWluc3Qg dGhpcyBwYXRjaCwgYXMgbG9uZyBhcyB0aGUgcXVpcmsgc3RheXMKPiA+ID4gPiBsaW1pdGVkIHRv IHRoZSBwYXJ0aWN1bGFyIHJvb3QgcG9ydCBsZWFkaW5nIHRvIHRoZSBOVklESUEgR1BVLiBUaGUK PiA+ID4gPiByZWFzb24gd2h5IEkgdGhpbmsgaXQgc2hvdWxkIHRvIGJlIGxpbWl0ZWQgaXMgdGhh dCBJJ20gcHJldHR5IGNlcnRhaW4KPiA+ID4gPiB0aGUgcHJvYmxlbSBpcyBub3QgaW4gdGhlIHJv b3QgcG9ydCBpdHNlbGYuIEkgaGF2ZSBoZXJlIGEgS0JMIGJhc2VkCj4gPiA+ID4gVGhpbmtwYWQg WDEgQ2FyYm9uIDZ0aCBnZW4gdGhhdCBjYW4gcHV0IHRoZSBUQlQgY29udHJvbGxlciBpbnRvIEQz Y29sZAo+ID4gPiA+IChpdCBpcyBjb25uZWN0ZWQgdG8gUENIIHJvb3QgcG9ydCkgYW5kIGl0IHdh a2VzIHVwIHRoZXJlIGp1c3QgZmluZSwgc28KPiA+ID4gPiBkb24ndCB3YW50IHRvIGJyZWFrIHRo YXQuCj4gPiA+ID4KPiA+ID4gPiBOb3csIFBDSWUgZGV2aWNlcyBjYW5ub3QgZ28gaW50byBEM2Nv bGQgYWxsIGJ5IHRoZW1zZWx2ZXMuIFRoZXkgYWx3YXlzCj4gPiA+ID4gbmVlZCBoZWxwIGZyb20g dGhlIHBsYXRmb3JtIHNpZGUgd2hpY2ggaXMgQUNQSSBpbiB0aGlzIGNhc2UuIFRoaXMgaXMKPiA+ ID4gPiBkb25lIGJ5IGhhdmluZyB0aGUgZGV2aWNlIHRvIGhhdmUgX1BSMyBtZXRob2QgdGhhdCBy ZXR1cm5zIG9uZSBvciBtb3JlCj4gPiA+ID4gcG93ZXIgcmVzb3VyY2VzIHRoYXQgdGhlIE9TIGlz IHN1cHBvc2VkIHRvIHR1cm4gb2ZmIHdoZW4gdGhlIGRldmljZSBpcwo+ID4gPiA+IHB1dCBpbnRv IEQzY29sZC4gQWxsIG9mIHRoYXQgaXMgaW1wbGVtZW50ZWQgYXMgZm9ybSBvZiBBQ1BJIG1ldGhv ZHMgdGhhdAo+ID4gPiA+IHByZXR0eSBtdWNoIGRvIHRoZSBoYXJkd2FyZSBzcGVjaWZpYyB0aGlu Z3MgdGhhdCBhcmUgb3V0c2lkZSBvZiBQQ0llCj4gPiA+ID4gc3BlYyB0byBnZXQgdGhlIGRldmlj ZSBpbnRvIEQzY29sZC4gQXQgaGlnaCBsZXZlbCB0aGUgX09GRigpIG1ldGhvZAo+ID4gPiA+IGNh dXNlcyB0aGUgcm9vdCBwb3J0IHRvIGJyb2FkY2FzdCBQTUVfVHVybl9PZmYgbWVzc2FnZSB0aGF0 IHJlc3VsdHMgdGhlCj4gPiA+ID4gbGluayB0byBlbnRlciBMMi8zIHJlYWR5LCBpdCB0aGVuIGFz c2VydHMgUEVSU1QsIGNvbmZpZ3VyZXMgV0FLRSAoYm90aAo+ID4gPiA+IGNhbiBiZSBHUElPcykg YW5kIGZpbmFsbHkgcmVtb3ZlcyBwb3dlciAoaWYgdGhlIGxpbmsgZ29lcyBpbnRvIEwzLAo+ID4g PiA+IG90aGVyd2lzZSBpdCBnb2VzIGludG8gTDIpLgo+ID4gPiA+Cj4gPiA+ID4gSSB0aGluayB0 aGlzIGlzIHdoZXJlIHRoZSBwcm9ibGVtIGFjdHVhbGx5IGxpZXMgLSB0aGUgQVNMIG1ldGhvZHMg dGhhdAo+ID4gPiA+IGFyZSB1c2VkIHRvIHB1dCB0aGUgZGV2aWNlIGludG8gRDNjb2xkIGFuZCBi YWNrLiBXZSBrbm93IHRoYXQgaW4gV2luZG93cwo+ID4gPiA+IHRoaXMgYWxsIHdvcmtzIGZpbmUg c28gdW5sZXNzIFdpbmRvd3MgcXVpcmtzIHRoZSByb290IHBvcnQgdGhlIHNhbWUgd2F5Cj4gPiA+ ID4gdGhlcmUgaXMgYW5vdGhlciByZWFzb24gYmVoaW5kIHRoaXMuCj4gPiA+ID4KPiA+ID4gPiBJ biBjYXNlIG9mIERlbGwgWFBTIDk1NjAgKElJUkMgdGhhdCdzIHRoZSBtYWNoaW5lIHlvdSBoYXZl KSB0aGUKPiA+ID4gPiBjb3JyZXNwb25kaW5nIHBvd2VyIHJlc291cmNlIGlzIGNhbGxlZCBcX1NC LlBDSTAuUEVHMC5QRzAwIGFuZCBpdHMKPiA+ID4gPiBfT04vX09GRiBtZXRob2RzIGVuZCB1cCBj YWxsaW5nIFBHT04oKS9QR09GKCkgYWNjb3JkaW5nbHkuIFRoZSBtZXRob2RzCj4gPiA+ID4gaXRz ZWxmIGRvIGxvdHMgb2YgdGhpbmdzIGFuZCBpdCBpcyBoYXJkIHRvIGZvbGxvdyB0aGUgZGlzc2Fz c2VtYmxlZAo+ID4gPiA+IEFTTCB3aGljaCBkb2VzIG5vdCBoYXZlIGFueSBjb21tZW50cyBidXQg dGhlcmUgYXJlIGNvdXBsZSBvZiB0aGluZ3MgdGhhdAo+ID4gPiA+IHN0YW5kIG91dCB3aGVyZSB3 ZSBtYXkgZ28gaW50byBhIGRpZmZlcmVudCBwYXRoLiBPbmUgb2YgdGhlbSBpcyB0aGlzIGluCj4g PiA+ID4gdGhlIFBHT0YoKSBtZXRob2Q6Cj4gPiA+ID4KPiA+ID4gPiAgICBJZiAoKChPU1lTIDw9 IDB4MDdEOSkgfHwgKChPU1lTID09IDB4MDdERikgJiYgKF9SRVYgPT0gMHgwNSkpKSkKPiA+ID4g Pgo+ID4gPiA+IFRoZSAoKE9TWVMgPT0gMHgwN0RGKSAmJiAoX1JFViA9PSAweDA1KSkgY2hlY2tz IHNwZWNpZmljYWxseSBmb3IgTGludXgKPiA+ID4gPiAoc2VlIFsxXSBhbmQgMThkNzhiNjRmZGRj ICgiQUNQSSAvIGluaXQ6IE1ha2UgaXQgcG9zc2libGUgdG8gb3ZlcnJpZGUKPiA+ID4gPiBfUkVW IikpIHNvIGl0IG1pZ2h0IGJlIHRoYXQgRGVsbCBwZW9wbGUgdGVzdGVkIHRoaXMgYXQgc29tZSBw b2ludCBpbgo+ID4gPiA+IExpbnV4IGFzIHdlbGwuIEFkZGVkIE1hcmlvIGluIGNhc2UgaGUgaGFz IGFueSBpZGVhcy4KPiA+ID4gPgo+ID4gPiA+IFByZXZpb3VzbHkgSSBzdWdnZXN0ZWQgeW91IHRv IHRyeSB0aGUgQUNQSSBtZXRob2QgdHJhY2luZyB0byBzZWUgd2hhdAo+ID4gPiA+IGhhcHBlbnMg aW5zaWRlIFBHT0YoKS4gRGlkIHlvdSBoYXZlIHRpbWUgdG8gdHJ5IGl0PyBJdCBtYXkgcHJvdmlk ZSBtb3JlCj4gPiA+ID4gaW5mb3JtYXRpb24gYWJvdXQgdGhhdCBpcyBoYXBwZW5pbmcgaW5zaWRl IHRob3NlIG1ldGhvZHMgYW5kIGhvcGVmdWxseQo+ID4gPiA+IHBvaW50IHVzIHRvIHRoZSByb290 IGNhdXNlLgo+ID4gPiA+Cj4gPiA+ID4gQWxzbyBpZiB5b3UgaGF2ZW4ndCB0cmllZCBhbHJlYWR5 IHBhc3NpbmcgYWNwaV9yZXZfb3ZlcnJpZGUgaW4gdGhlCj4gPiA+ID4gY29tbWFuZCBsaW5lIG1h a2VzIHRoZSBfUkVWIHRvIHJldHVybiA1IHNvIGl0IHNob3VsZCBnbyBpbnRvIHRoZSAiTGludXgi Cj4gPiA+ID4gcGF0aCBpbiBQR09GKCkuCj4gPiA+Cj4gPiA+IE9oLCBzbyBkb2VzIGl0IGxvb2sg bGlrZSB3ZSBhcmUgdHJ5aW5nIHRvIHdvcmsgYXJvdW5kIEFNTCB0aGF0IHRyaWVkCj4gPiA+IHRv IHdvcmsgYXJvdW5kIHNvbWUgcHJvYmxlbWF0aWMgYmVoYXZpb3IgaW4gTGludXggYXQgb25lIHBv aW50Pwo+ID4KPiA+IFllcywgaXQgbG9va3MgbGlrZSBzbyBpZiBJIHJlYWQgdGhlIEFTTCByaWdo dC4KPgo+IE9LLCBzbyB0aGF0IHdvdWxkIGNhbGwgZm9yIGEgRE1JLWJhc2VkIHF1aXJrIGFzIHRo ZSByZWFsIGNhdXNlIGZvciB0aGUKPiBpc3N1ZSBzZWVtcyB0byBiZSB0aGUgQU1MIGluIHF1ZXN0 aW9uLCB3aGljaCBtZWFucyBhIGZpcm13YXJlIHByb2JsZW0uCj4KCkFuZCBJIGRpc2FncmVlIGFz IHRoaXMgaXMgYSBsaW51eCBzcGVjaWZpYyB3b3JrYXJvdW5kIGFuZCB3aW5kb3dzIGdvZXMKdGhh dCBwYXRoIGFuZCBzdWNjZWVkcy4gVGhpcyBmaXJtd2FyZSBiYXNlZCB3b3JrYXJvdW5kIHdhcyBh ZGRlZCwKYmVjYXVzZSBpdCBicm9rZSBvbiBMaW51eC4KCl9fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fCmRyaS1kZXZlbCBtYWlsaW5nIGxpc3QKZHJpLWRldmVs QGxpc3RzLmZyZWVkZXNrdG9wLm9yZwpodHRwczovL2xpc3RzLmZyZWVkZXNrdG9wLm9yZy9tYWls bWFuL2xpc3RpbmZvL2RyaS1kZXZlbA==