From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.6 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 27009C35656 for ; Fri, 21 Feb 2020 11:51:18 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id DAACF24650 for ; Fri, 21 Feb 2020 11:51:17 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=citrix.com header.i=@citrix.com header.b="OZLTIKh1" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728274AbgBULvP (ORCPT ); Fri, 21 Feb 2020 06:51:15 -0500 Received: from esa4.hc3370-68.iphmx.com ([216.71.155.144]:7892 "EHLO esa4.hc3370-68.iphmx.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728186AbgBULvM (ORCPT ); Fri, 21 Feb 2020 06:51:12 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1582285872; h=date:from:to:cc:subject:message-id:references: mime-version:content-transfer-encoding:in-reply-to; bh=rkTHwapBz7ayghLmZpskUOnKPxyODDcUxzL7ge8Xcgw=; b=OZLTIKh1todi/eF9m5Zuw3e9FZEB208cvD/izr6fF51TJPS2N0TSYqR4 6Ap5YuK1xxh7K19MUlsOXe4oNWYUWCoqTG1Wx0Q1yqjdhxWGXldm55R3G KiNjwjVU3w7qy4AllGqLyTaLsITZY3VdlftLBuZo8vrRaw3FpH1v/N+4V 8=; Authentication-Results: esa4.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=roger.pau@citrix.com; spf=Pass smtp.mailfrom=roger.pau@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa4.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: Iy6vkmYvTTmAxcv0sDnk287OqaApR945+t3bbH8+KbvqO+kHUjaYPybqDsL2Uz3ckkNdz7m7Ij Y/kSARbsrffvGwZ0DdF9joLHQxzx+xK9WlQ/XDSamvWxHYxvaUCzUm0cfcLxehNY2mp7FjoWjT D4xjlWsuciis2JlVC9Q0xgZJzdXhb7ZyOnQTX4w+09xcbPdlJMXCastv+6vAPcXH/ReEzapMJk MexwEdNGylwcSepie7bUtm+7uwAyQBY4nMkkPM9+s4Fdfth/Af4mJg7YaOlCyON2+hTYr7itc9 ax0= X-SBRS: 2.7 X-MesageID: 13435837 X-Ironport-Server: esa4.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.70,468,1574139600"; d="scan'208";a="13435837" Date: Fri, 21 Feb 2020 12:51:03 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: "Durrant, Paul" CC: "Agarwal, Anchal" , "Valentin, Eduardo" , "len.brown@intel.com" , "peterz@infradead.org" , "benh@kernel.crashing.org" , "x86@kernel.org" , "linux-mm@kvack.org" , "pavel@ucw.cz" , "hpa@zytor.com" , "tglx@linutronix.de" , "sstabellini@kernel.org" , "fllinden@amaozn.com" , "Kamata, Munehisa" , "mingo@redhat.com" , "xen-devel@lists.xenproject.org" , "Singh, Balbir" , "axboe@kernel.dk" , "konrad.wilk@oracle.com" , "bp@alien8.de" , "boris.ostrovsky@oracle.com" , "jgross@suse.com" , "netdev@vger.kernel.org" , "linux-pm@vger.kernel.org" , "rjw@rjwysocki.net" , "linux-kernel@vger.kernel.org" , "vkuznets@redhat.com" , "davem@davemloft.net" , "Woodhouse, David" Subject: Re: [Xen-devel] [RFC PATCH v3 06/12] xen-blkfront: add callbacks for PM suspend and hibernation Message-ID: <20200221115103.GY4679@Air-de-Roger> References: <20200220083904.GI4679@Air-de-Roger> <20200220154507.GO4679@Air-de-Roger> <20200220164839.GR4679@Air-de-Roger> <20200221092219.GU4679@Air-de-Roger> <5ddf980a3fba4fb39571184e688cefc5@EX13D32EUC003.ant.amazon.com> <20200221102130.GW4679@Air-de-Roger> <66a211bae1de4be9861ef8393607d1b3@EX13D32EUC003.ant.amazon.com> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <66a211bae1de4be9861ef8393607d1b3@EX13D32EUC003.ant.amazon.com> X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL01.citrite.net (10.69.22.125) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Feb 21, 2020 at 10:33:42AM +0000, Durrant, Paul wrote: > > -----Original Message----- > > From: Roger Pau Monné > > Sent: 21 February 2020 10:22 > > To: Durrant, Paul > > Cc: Agarwal, Anchal ; Valentin, Eduardo > > ; len.brown@intel.com; peterz@infradead.org; > > benh@kernel.crashing.org; x86@kernel.org; linux-mm@kvack.org; > > pavel@ucw.cz; hpa@zytor.com; tglx@linutronix.de; sstabellini@kernel.org; > > fllinden@amaozn.com; Kamata, Munehisa ; > > mingo@redhat.com; xen-devel@lists.xenproject.org; Singh, Balbir > > ; axboe@kernel.dk; konrad.wilk@oracle.com; > > bp@alien8.de; boris.ostrovsky@oracle.com; jgross@suse.com; > > netdev@vger.kernel.org; linux-pm@vger.kernel.org; rjw@rjwysocki.net; > > linux-kernel@vger.kernel.org; vkuznets@redhat.com; davem@davemloft.net; > > Woodhouse, David > > Subject: Re: [Xen-devel] [RFC PATCH v3 06/12] xen-blkfront: add callbacks > > for PM suspend and hibernation > > > > On Fri, Feb 21, 2020 at 09:56:54AM +0000, Durrant, Paul wrote: > > > > -----Original Message----- > > > > From: Roger Pau Monné > > > > Sent: 21 February 2020 09:22 > > > > To: Durrant, Paul > > > > Cc: Agarwal, Anchal ; Valentin, Eduardo > > > > ; len.brown@intel.com; peterz@infradead.org; > > > > benh@kernel.crashing.org; x86@kernel.org; linux-mm@kvack.org; > > > > pavel@ucw.cz; hpa@zytor.com; tglx@linutronix.de; > > sstabellini@kernel.org; > > > > fllinden@amaozn.com; Kamata, Munehisa ; > > > > mingo@redhat.com; xen-devel@lists.xenproject.org; Singh, Balbir > > > > ; axboe@kernel.dk; konrad.wilk@oracle.com; > > > > bp@alien8.de; boris.ostrovsky@oracle.com; jgross@suse.com; > > > > netdev@vger.kernel.org; linux-pm@vger.kernel.org; rjw@rjwysocki.net; > > > > linux-kernel@vger.kernel.org; vkuznets@redhat.com; > > davem@davemloft.net; > > > > Woodhouse, David > > > > Subject: Re: [Xen-devel] [RFC PATCH v3 06/12] xen-blkfront: add > > callbacks > > > > for PM suspend and hibernation > > > > > > > > On Thu, Feb 20, 2020 at 05:01:52PM +0000, Durrant, Paul wrote: > > > > > > > Hopefully what I said above illustrates why it may not be 100% > > > > common. > > > > > > > > > > > > Yes, that's fine. I don't expect it to be 100% common (as I guess > > > > > > that the hooks will have different prototypes), but I expect > > > > > > that routines can be shared, and that the approach taken can be > > the > > > > > > same. > > > > > > > > > > > > For example one necessary difference will be that xenbus initiated > > > > > > suspend won't close the PV connection, in case suspension fails. > > On PM > > > > > > suspend you seem to always close the connection beforehand, so you > > > > > > will always have to re-negotiate on resume even if suspension > > failed. > > > > > > > > > > > > What I'm mostly worried about is the different approach to ring > > > > > > draining. Ie: either xenbus is changed to freeze the queues and > > drain > > > > > > the shared rings, or PM uses the already existing logic of not > > > > > > flushing the rings an re-issuing in-flight requests on resume. > > > > > > > > > > > > > > > > Yes, that's needs consideration. I don’t think the same semantic can > > be > > > > suitable for both. E.g. in a xen-suspend we need to freeze with as > > little > > > > processing as possible to avoid dirtying RAM late in the migration > > cycle, > > > > and we know that in-flight data can wait. But in a transition to S4 we > > > > need to make sure that at least all the in-flight blkif requests get > > > > completed, since they probably contain bits of the guest's memory > > image > > > > and that's not going to get saved any other way. > > > > > > > > Thanks, that makes sense and something along this lines should be > > > > added to the commit message IMO. > > > > > > > > Wondering about S4, shouldn't we expect the queues to already be > > > > empty? As any subsystem that wanted to store something to disk should > > > > make sure requests have been successfully completed before > > > > suspending. > > > > > > What about writing the suspend image itself? Normal filesystem I/O > > > will have been flushed of course, but whatever vestigial kernel > > > actually writes out the hibernation file may well expect a final > > > D0->D3 on the storage device to cause a flush. > > > > Hm, I have no idea really. I think whatever writes to the disk before > > suspend should actually make sure requests have completed, but what > > you suggest might also be a possibility. > > > > Can you figure out whether there are requests on the ring or in the > > queue before suspending? > > Well there's clearly pending stuff in the ring if rsp_prod != req_prod :-) Right, I assume there's no document that states what's the expected state for queues &c when switching PM states, so we have to assume that there might be in-flight requests on the ring and in the driver queues. > As for internal queues, I don't know how blkfront manages that (or whether it has any pending work queue at all). There are no internal queues, just the generic ones from blk_mq which every block device has IIRC. Thanks, Roger. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.6 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1B15EC35646 for ; Fri, 21 Feb 2020 11:51:35 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id E0AE7208C4 for ; Fri, 21 Feb 2020 11:51:34 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=citrix.com header.i=@citrix.com header.b="OZLTIKh1" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org E0AE7208C4 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=citrix.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1j56pv-0000F3-9f; Fri, 21 Feb 2020 11:51:15 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1j56pt-0000Es-Ks for xen-devel@lists.xenproject.org; Fri, 21 Feb 2020 11:51:13 +0000 X-Inumbo-ID: 74f323ca-54a0-11ea-aa99-bc764e2007e4 Received: from esa4.hc3370-68.iphmx.com (unknown [216.71.155.144]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 74f323ca-54a0-11ea-aa99-bc764e2007e4; Fri, 21 Feb 2020 11:51:12 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1582285872; h=date:from:to:cc:subject:message-id:references: mime-version:content-transfer-encoding:in-reply-to; bh=rkTHwapBz7ayghLmZpskUOnKPxyODDcUxzL7ge8Xcgw=; b=OZLTIKh1todi/eF9m5Zuw3e9FZEB208cvD/izr6fF51TJPS2N0TSYqR4 6Ap5YuK1xxh7K19MUlsOXe4oNWYUWCoqTG1Wx0Q1yqjdhxWGXldm55R3G KiNjwjVU3w7qy4AllGqLyTaLsITZY3VdlftLBuZo8vrRaw3FpH1v/N+4V 8=; Authentication-Results: esa4.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=roger.pau@citrix.com; spf=Pass smtp.mailfrom=roger.pau@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of roger.pau@citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa4.hc3370-68.iphmx.com: domain of roger.pau@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="roger.pau@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="roger.pau@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: Iy6vkmYvTTmAxcv0sDnk287OqaApR945+t3bbH8+KbvqO+kHUjaYPybqDsL2Uz3ckkNdz7m7Ij Y/kSARbsrffvGwZ0DdF9joLHQxzx+xK9WlQ/XDSamvWxHYxvaUCzUm0cfcLxehNY2mp7FjoWjT D4xjlWsuciis2JlVC9Q0xgZJzdXhb7ZyOnQTX4w+09xcbPdlJMXCastv+6vAPcXH/ReEzapMJk MexwEdNGylwcSepie7bUtm+7uwAyQBY4nMkkPM9+s4Fdfth/Af4mJg7YaOlCyON2+hTYr7itc9 ax0= X-SBRS: 2.7 X-MesageID: 13435837 X-Ironport-Server: esa4.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.70,468,1574139600"; d="scan'208";a="13435837" Date: Fri, 21 Feb 2020 12:51:03 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: "Durrant, Paul" Message-ID: <20200221115103.GY4679@Air-de-Roger> References: <20200220083904.GI4679@Air-de-Roger> <20200220154507.GO4679@Air-de-Roger> <20200220164839.GR4679@Air-de-Roger> <20200221092219.GU4679@Air-de-Roger> <5ddf980a3fba4fb39571184e688cefc5@EX13D32EUC003.ant.amazon.com> <20200221102130.GW4679@Air-de-Roger> <66a211bae1de4be9861ef8393607d1b3@EX13D32EUC003.ant.amazon.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <66a211bae1de4be9861ef8393607d1b3@EX13D32EUC003.ant.amazon.com> X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL01.citrite.net (10.69.22.125) Subject: Re: [Xen-devel] [RFC PATCH v3 06/12] xen-blkfront: add callbacks for PM suspend and hibernation X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: "Valentin, Eduardo" , "peterz@infradead.org" , "benh@kernel.crashing.org" , "linux-kernel@vger.kernel.org" , "linux-mm@kvack.org" , "pavel@ucw.cz" , "hpa@zytor.com" , "tglx@linutronix.de" , "sstabellini@kernel.org" , "fllinden@amaozn.com" , "x86@kernel.org" , "mingo@redhat.com" , "xen-devel@lists.xenproject.org" , "Singh, Balbir" , "len.brown@intel.com" , "jgross@suse.com" , "konrad.wilk@oracle.com" , "Agarwal, Anchal" , "bp@alien8.de" , "boris.ostrovsky@oracle.com" , "axboe@kernel.dk" , "netdev@vger.kernel.org" , "linux-pm@vger.kernel.org" , "rjw@rjwysocki.net" , "Kamata, Munehisa" , "vkuznets@redhat.com" , "davem@davemloft.net" , "Woodhouse, David" Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" T24gRnJpLCBGZWIgMjEsIDIwMjAgYXQgMTA6MzM6NDJBTSArMDAwMCwgRHVycmFudCwgUGF1bCB3 cm90ZToKPiA+IC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tCj4gPiBGcm9tOiBSb2dlciBQYXUg TW9ubsOpIDxyb2dlci5wYXVAY2l0cml4LmNvbT4KPiA+IFNlbnQ6IDIxIEZlYnJ1YXJ5IDIwMjAg MTA6MjIKPiA+IFRvOiBEdXJyYW50LCBQYXVsIDxwZHVycmFudEBhbWF6b24uY28udWs+Cj4gPiBD YzogQWdhcndhbCwgQW5jaGFsIDxhbmNoYWxhZ0BhbWF6b24uY29tPjsgVmFsZW50aW4sIEVkdWFy ZG8KPiA+IDxlZHV2YWxAYW1hem9uLmNvbT47IGxlbi5icm93bkBpbnRlbC5jb207IHBldGVyekBp bmZyYWRlYWQub3JnOwo+ID4gYmVuaEBrZXJuZWwuY3Jhc2hpbmcub3JnOyB4ODZAa2VybmVsLm9y ZzsgbGludXgtbW1Aa3ZhY2sub3JnOwo+ID4gcGF2ZWxAdWN3LmN6OyBocGFAenl0b3IuY29tOyB0 Z2x4QGxpbnV0cm9uaXguZGU7IHNzdGFiZWxsaW5pQGtlcm5lbC5vcmc7Cj4gPiBmbGxpbmRlbkBh bWFvem4uY29tOyBLYW1hdGEsIE11bmVoaXNhIDxrYW1hdGFtQGFtYXpvbi5jb20+Owo+ID4gbWlu Z29AcmVkaGF0LmNvbTsgeGVuLWRldmVsQGxpc3RzLnhlbnByb2plY3Qub3JnOyBTaW5naCwgQmFs YmlyCj4gPiA8c2JsYmlyQGFtYXpvbi5jb20+OyBheGJvZUBrZXJuZWwuZGs7IGtvbnJhZC53aWxr QG9yYWNsZS5jb207Cj4gPiBicEBhbGllbjguZGU7IGJvcmlzLm9zdHJvdnNreUBvcmFjbGUuY29t OyBqZ3Jvc3NAc3VzZS5jb207Cj4gPiBuZXRkZXZAdmdlci5rZXJuZWwub3JnOyBsaW51eC1wbUB2 Z2VyLmtlcm5lbC5vcmc7IHJqd0Byand5c29ja2kubmV0Owo+ID4gbGludXgta2VybmVsQHZnZXIu a2VybmVsLm9yZzsgdmt1em5ldHNAcmVkaGF0LmNvbTsgZGF2ZW1AZGF2ZW1sb2Z0Lm5ldDsKPiA+ IFdvb2Rob3VzZSwgRGF2aWQgPGR3bXdAYW1hem9uLmNvLnVrPgo+ID4gU3ViamVjdDogUmU6IFtY ZW4tZGV2ZWxdIFtSRkMgUEFUQ0ggdjMgMDYvMTJdIHhlbi1ibGtmcm9udDogYWRkIGNhbGxiYWNr cwo+ID4gZm9yIFBNIHN1c3BlbmQgYW5kIGhpYmVybmF0aW9uCj4gPiAKPiA+IE9uIEZyaSwgRmVi IDIxLCAyMDIwIGF0IDA5OjU2OjU0QU0gKzAwMDAsIER1cnJhbnQsIFBhdWwgd3JvdGU6Cj4gPiA+ ID4gLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0KPiA+ID4gPiBGcm9tOiBSb2dlciBQYXUgTW9u bsOpIDxyb2dlci5wYXVAY2l0cml4LmNvbT4KPiA+ID4gPiBTZW50OiAyMSBGZWJydWFyeSAyMDIw IDA5OjIyCj4gPiA+ID4gVG86IER1cnJhbnQsIFBhdWwgPHBkdXJyYW50QGFtYXpvbi5jby51az4K PiA+ID4gPiBDYzogQWdhcndhbCwgQW5jaGFsIDxhbmNoYWxhZ0BhbWF6b24uY29tPjsgVmFsZW50 aW4sIEVkdWFyZG8KPiA+ID4gPiA8ZWR1dmFsQGFtYXpvbi5jb20+OyBsZW4uYnJvd25AaW50ZWwu Y29tOyBwZXRlcnpAaW5mcmFkZWFkLm9yZzsKPiA+ID4gPiBiZW5oQGtlcm5lbC5jcmFzaGluZy5v cmc7IHg4NkBrZXJuZWwub3JnOyBsaW51eC1tbUBrdmFjay5vcmc7Cj4gPiA+ID4gcGF2ZWxAdWN3 LmN6OyBocGFAenl0b3IuY29tOyB0Z2x4QGxpbnV0cm9uaXguZGU7Cj4gPiBzc3RhYmVsbGluaUBr ZXJuZWwub3JnOwo+ID4gPiA+IGZsbGluZGVuQGFtYW96bi5jb207IEthbWF0YSwgTXVuZWhpc2Eg PGthbWF0YW1AYW1hem9uLmNvbT47Cj4gPiA+ID4gbWluZ29AcmVkaGF0LmNvbTsgeGVuLWRldmVs QGxpc3RzLnhlbnByb2plY3Qub3JnOyBTaW5naCwgQmFsYmlyCj4gPiA+ID4gPHNibGJpckBhbWF6 b24uY29tPjsgYXhib2VAa2VybmVsLmRrOyBrb25yYWQud2lsa0BvcmFjbGUuY29tOwo+ID4gPiA+ IGJwQGFsaWVuOC5kZTsgYm9yaXMub3N0cm92c2t5QG9yYWNsZS5jb207IGpncm9zc0BzdXNlLmNv bTsKPiA+ID4gPiBuZXRkZXZAdmdlci5rZXJuZWwub3JnOyBsaW51eC1wbUB2Z2VyLmtlcm5lbC5v cmc7IHJqd0Byand5c29ja2kubmV0Owo+ID4gPiA+IGxpbnV4LWtlcm5lbEB2Z2VyLmtlcm5lbC5v cmc7IHZrdXpuZXRzQHJlZGhhdC5jb207Cj4gPiBkYXZlbUBkYXZlbWxvZnQubmV0Owo+ID4gPiA+ IFdvb2Rob3VzZSwgRGF2aWQgPGR3bXdAYW1hem9uLmNvLnVrPgo+ID4gPiA+IFN1YmplY3Q6IFJl OiBbWGVuLWRldmVsXSBbUkZDIFBBVENIIHYzIDA2LzEyXSB4ZW4tYmxrZnJvbnQ6IGFkZAo+ID4g Y2FsbGJhY2tzCj4gPiA+ID4gZm9yIFBNIHN1c3BlbmQgYW5kIGhpYmVybmF0aW9uCj4gPiA+ID4K PiA+ID4gPiBPbiBUaHUsIEZlYiAyMCwgMjAyMCBhdCAwNTowMTo1MlBNICswMDAwLCBEdXJyYW50 LCBQYXVsIHdyb3RlOgo+ID4gPiA+ID4gPiA+IEhvcGVmdWxseSB3aGF0IEkgc2FpZCBhYm92ZSBp bGx1c3RyYXRlcyB3aHkgaXQgbWF5IG5vdCBiZSAxMDAlCj4gPiA+ID4gY29tbW9uLgo+ID4gPiA+ ID4gPgo+ID4gPiA+ID4gPiBZZXMsIHRoYXQncyBmaW5lLiBJIGRvbid0IGV4cGVjdCBpdCB0byBi ZSAxMDAlIGNvbW1vbiAoYXMgSSBndWVzcwo+ID4gPiA+ID4gPiB0aGF0IHRoZSBob29rcyB3aWxs IGhhdmUgZGlmZmVyZW50IHByb3RvdHlwZXMpLCBidXQgSSBleHBlY3QKPiA+ID4gPiA+ID4gdGhh dCByb3V0aW5lcyBjYW4gYmUgc2hhcmVkLCBhbmQgdGhhdCB0aGUgYXBwcm9hY2ggdGFrZW4gY2Fu IGJlCj4gPiB0aGUKPiA+ID4gPiA+ID4gc2FtZS4KPiA+ID4gPiA+ID4KPiA+ID4gPiA+ID4gRm9y IGV4YW1wbGUgb25lIG5lY2Vzc2FyeSBkaWZmZXJlbmNlIHdpbGwgYmUgdGhhdCB4ZW5idXMgaW5p dGlhdGVkCj4gPiA+ID4gPiA+IHN1c3BlbmQgd29uJ3QgY2xvc2UgdGhlIFBWIGNvbm5lY3Rpb24s IGluIGNhc2Ugc3VzcGVuc2lvbiBmYWlscy4KPiA+IE9uIFBNCj4gPiA+ID4gPiA+IHN1c3BlbmQg eW91IHNlZW0gdG8gYWx3YXlzIGNsb3NlIHRoZSBjb25uZWN0aW9uIGJlZm9yZWhhbmQsIHNvIHlv dQo+ID4gPiA+ID4gPiB3aWxsIGFsd2F5cyBoYXZlIHRvIHJlLW5lZ290aWF0ZSBvbiByZXN1bWUg ZXZlbiBpZiBzdXNwZW5zaW9uCj4gPiBmYWlsZWQuCj4gPiA+ID4gPiA+Cj4gPiA+ID4gPiA+IFdo YXQgSSdtIG1vc3RseSB3b3JyaWVkIGFib3V0IGlzIHRoZSBkaWZmZXJlbnQgYXBwcm9hY2ggdG8g cmluZwo+ID4gPiA+ID4gPiBkcmFpbmluZy4gSWU6IGVpdGhlciB4ZW5idXMgaXMgY2hhbmdlZCB0 byBmcmVlemUgdGhlIHF1ZXVlcyBhbmQKPiA+IGRyYWluCj4gPiA+ID4gPiA+IHRoZSBzaGFyZWQg cmluZ3MsIG9yIFBNIHVzZXMgdGhlIGFscmVhZHkgZXhpc3RpbmcgbG9naWMgb2Ygbm90Cj4gPiA+ ID4gPiA+IGZsdXNoaW5nIHRoZSByaW5ncyBhbiByZS1pc3N1aW5nIGluLWZsaWdodCByZXF1ZXN0 cyBvbiByZXN1bWUuCj4gPiA+ID4gPiA+Cj4gPiA+ID4gPgo+ID4gPiA+ID4gWWVzLCB0aGF0J3Mg bmVlZHMgY29uc2lkZXJhdGlvbi4gSSBkb27igJl0IHRoaW5rIHRoZSBzYW1lIHNlbWFudGljIGNh bgo+ID4gYmUKPiA+ID4gPiBzdWl0YWJsZSBmb3IgYm90aC4gRS5nLiBpbiBhIHhlbi1zdXNwZW5k IHdlIG5lZWQgdG8gZnJlZXplIHdpdGggYXMKPiA+IGxpdHRsZQo+ID4gPiA+IHByb2Nlc3Npbmcg YXMgcG9zc2libGUgdG8gYXZvaWQgZGlydHlpbmcgUkFNIGxhdGUgaW4gdGhlIG1pZ3JhdGlvbgo+ ID4gY3ljbGUsCj4gPiA+ID4gYW5kIHdlIGtub3cgdGhhdCBpbi1mbGlnaHQgZGF0YSBjYW4gd2Fp dC4gQnV0IGluIGEgdHJhbnNpdGlvbiB0byBTNCB3ZQo+ID4gPiA+IG5lZWQgdG8gbWFrZSBzdXJl IHRoYXQgYXQgbGVhc3QgYWxsIHRoZSBpbi1mbGlnaHQgYmxraWYgcmVxdWVzdHMgZ2V0Cj4gPiA+ ID4gY29tcGxldGVkLCBzaW5jZSB0aGV5IHByb2JhYmx5IGNvbnRhaW4gYml0cyBvZiB0aGUgZ3Vl c3QncyBtZW1vcnkKPiA+IGltYWdlCj4gPiA+ID4gYW5kIHRoYXQncyBub3QgZ29pbmcgdG8gZ2V0 IHNhdmVkIGFueSBvdGhlciB3YXkuCj4gPiA+ID4KPiA+ID4gPiBUaGFua3MsIHRoYXQgbWFrZXMg c2Vuc2UgYW5kIHNvbWV0aGluZyBhbG9uZyB0aGlzIGxpbmVzIHNob3VsZCBiZQo+ID4gPiA+IGFk ZGVkIHRvIHRoZSBjb21taXQgbWVzc2FnZSBJTU8uCj4gPiA+ID4KPiA+ID4gPiBXb25kZXJpbmcg YWJvdXQgUzQsIHNob3VsZG4ndCB3ZSBleHBlY3QgdGhlIHF1ZXVlcyB0byBhbHJlYWR5IGJlCj4g PiA+ID4gZW1wdHk/IEFzIGFueSBzdWJzeXN0ZW0gdGhhdCB3YW50ZWQgdG8gc3RvcmUgc29tZXRo aW5nIHRvIGRpc2sgc2hvdWxkCj4gPiA+ID4gbWFrZSBzdXJlIHJlcXVlc3RzIGhhdmUgYmVlbiBz dWNjZXNzZnVsbHkgY29tcGxldGVkIGJlZm9yZQo+ID4gPiA+IHN1c3BlbmRpbmcuCj4gPiA+Cj4g PiA+IFdoYXQgYWJvdXQgd3JpdGluZyB0aGUgc3VzcGVuZCBpbWFnZSBpdHNlbGY/IE5vcm1hbCBm aWxlc3lzdGVtIEkvTwo+ID4gPiB3aWxsIGhhdmUgYmVlbiBmbHVzaGVkIG9mIGNvdXJzZSwgYnV0 IHdoYXRldmVyIHZlc3RpZ2lhbCBrZXJuZWwKPiA+ID4gYWN0dWFsbHkgd3JpdGVzIG91dCB0aGUg aGliZXJuYXRpb24gZmlsZSBtYXkgd2VsbCBleHBlY3QgYSBmaW5hbAo+ID4gPiBEMC0+RDMgb24g dGhlIHN0b3JhZ2UgZGV2aWNlIHRvIGNhdXNlIGEgZmx1c2guCj4gPiAKPiA+IEhtLCBJIGhhdmUg bm8gaWRlYSByZWFsbHkuIEkgdGhpbmsgd2hhdGV2ZXIgd3JpdGVzIHRvIHRoZSBkaXNrIGJlZm9y ZQo+ID4gc3VzcGVuZCBzaG91bGQgYWN0dWFsbHkgbWFrZSBzdXJlIHJlcXVlc3RzIGhhdmUgY29t cGxldGVkLCBidXQgd2hhdAo+ID4geW91IHN1Z2dlc3QgbWlnaHQgYWxzbyBiZSBhIHBvc3NpYmls aXR5Lgo+ID4gCj4gPiBDYW4geW91IGZpZ3VyZSBvdXQgd2hldGhlciB0aGVyZSBhcmUgcmVxdWVz dHMgb24gdGhlIHJpbmcgb3IgaW4gdGhlCj4gPiBxdWV1ZSBiZWZvcmUgc3VzcGVuZGluZz8KPiAK PiBXZWxsIHRoZXJlJ3MgY2xlYXJseSBwZW5kaW5nIHN0dWZmIGluIHRoZSByaW5nIGlmIHJzcF9w cm9kICE9IHJlcV9wcm9kIDotKQoKUmlnaHQsIEkgYXNzdW1lIHRoZXJlJ3Mgbm8gZG9jdW1lbnQg dGhhdCBzdGF0ZXMgd2hhdCdzIHRoZSBleHBlY3RlZApzdGF0ZSBmb3IgcXVldWVzICZjIHdoZW4g c3dpdGNoaW5nIFBNIHN0YXRlcywgc28gd2UgaGF2ZSB0byBhc3N1bWUKdGhhdCB0aGVyZSBtaWdo dCBiZSBpbi1mbGlnaHQgcmVxdWVzdHMgb24gdGhlIHJpbmcgYW5kIGluIHRoZSBkcml2ZXIKcXVl dWVzLgoKPiBBcyBmb3IgaW50ZXJuYWwgcXVldWVzLCBJIGRvbid0IGtub3cgaG93IGJsa2Zyb250 IG1hbmFnZXMgdGhhdCAob3Igd2hldGhlciBpdCBoYXMgYW55IHBlbmRpbmcgd29yayBxdWV1ZSBh dCBhbGwpLgoKVGhlcmUgYXJlIG5vIGludGVybmFsIHF1ZXVlcywganVzdCB0aGUgZ2VuZXJpYyBv bmVzIGZyb20gYmxrX21xIHdoaWNoCmV2ZXJ5IGJsb2NrIGRldmljZSBoYXMgSUlSQy4KClRoYW5r cywgUm9nZXIuCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f XwpYZW4tZGV2ZWwgbWFpbGluZyBsaXN0Clhlbi1kZXZlbEBsaXN0cy54ZW5wcm9qZWN0Lm9yZwpo dHRwczovL2xpc3RzLnhlbnByb2plY3Qub3JnL21haWxtYW4vbGlzdGluZm8veGVuLWRldmVs