From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by smtp.lore.kernel.org (Postfix) with ESMTP id 185DCC433F5 for ; Thu, 3 Feb 2022 20:28:30 +0000 (UTC) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id DB00840143; Thu, 3 Feb 2022 21:28:29 +0100 (CET) Received: from mail-io1-f54.google.com (mail-io1-f54.google.com [209.85.166.54]) by mails.dpdk.org (Postfix) with ESMTP id 9812840140 for ; Thu, 3 Feb 2022 21:28:28 +0100 (CET) Received: by mail-io1-f54.google.com with SMTP id y84so4867518iof.0 for ; Thu, 03 Feb 2022 12:28:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=L80csEzCHxaPziuZIrVfKDzJdMpojyimCAeEkQNNZNk=; b=XwDLxhxFdL8NCy1rulPxllu7rvVEASD3xGhZ7VlN1imihBbqswYnvQ37Xl5l1swwnl 2dB7LcfCV9MGpcuMpWDXMim5vHeT6pLVC34Pg+SdqhSQtz1PJNCJ/Sr3Dj8GIW2NZV1l raXpd8t7oKMroAMXQcsn7b8Vq4+i3ry61y2BY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=L80csEzCHxaPziuZIrVfKDzJdMpojyimCAeEkQNNZNk=; b=fijVKhScMa1LrETgvH8JH+wMJat5xW+LWm/EpS/AnOJn71zaC1O1XvJgtGggWWFOS6 HK9Fteen+aJv371w1aRz+VC2fpk1gLTGsmLSdczTszXWgDxTOoXscXB2EEvDz2NdeIbI gxrf7v00nkXVYbeYUff5TJc1AwOUDZ7BAnCnaNAB238ah7/LRDCaAdERIDNeyjJQLFHc ds6jMnmMFX12yJjUn0bxxicP4qsNwOMn9a89lhbIaqvesgzAquGXFx6ePvtUTCMvmVE0 f9DbzZyiFYFiw5ytGFBe01KbjxRuaYATUEBB3vZ+JBRm6LeYIX/LiqwYqjjnrpLBdIAp 84Cw== X-Gm-Message-State: AOAM532c66rrf+itkZrTcJK92cYc78wMZwLw/qPRBDfttWGDUD8ALwWG TqBubcTlK8ZfCi8ziTX416YXHB6qZdbRT7pFgbDqJg== X-Google-Smtp-Source: ABdhPJzsdryAgc9uGu8DaLTaR/kT4FD+vJ+hgUktv3zUo4sCOU5blKRaMoxOiP38HtMXiRP+YzabY7YnFIyP9uQjCvk= X-Received: by 2002:a05:6638:40ab:: with SMTP id m43mr15062416jam.53.1643920107770; Thu, 03 Feb 2022 12:28:27 -0800 (PST) MIME-Version: 1.0 References: <20201009034832.10302-1-kalesh-anakkur.purayil@broadcom.com> <20220128124830.427-1-kalesh-anakkur.purayil@broadcom.com> <20220128124830.427-2-kalesh-anakkur.purayil@broadcom.com> <1bd15a49-b53c-b1e7-bed4-2f8aef55a0f9@intel.com> In-Reply-To: From: Ajit Khaparde Date: Thu, 3 Feb 2022 12:28:11 -0800 Message-ID: Subject: Re: [dpdk-dev] [PATCH v7 1/4] ethdev: support device reset and recovery events To: Ferruh Yigit Cc: Kalesh Anakkur Purayil , dpdk-dev , Thomas Monjalon , Andrew Rybchenko , Konstantin Ananyev , Asaf Penso , Stephen Hemminger , "jerinj@marvell.com" Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="00000000000015a87705d722fa9f" X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org --00000000000015a87705d722fa9f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Feb 1, 2022 at 5:20 AM Ferruh Yigit wrote: > > On 2/1/2022 1:09 PM, Kalesh Anakkur Purayil wrote: > > Thank you Ferruh for the review. Please see inline. > > > > On Tue, Feb 1, 2022 at 5:41 PM Ferruh Yigit > wrote: > > > > On 1/28/2022 12:48 PM, Kalesh A P wrote: > > > From: Kalesh AP > > > > > > > Adding support for the device reset and recovery events in the > > > rte_eth_event framework. FW error and FW reset conditions would = be > > > managed internally by the PMD without needing application interv= ention. > > > In such cases, PMD would need reset/recovery events to notify ap= plication > > > that PMD is undergoing a reset. > > > > > > While most of the recovery process is transparent to the applica= tion since > > > most of the driver ensures recovery from FW reset or FW error co= nditions, > > > the application will have to reprogram any flows which were offl= oaded to > > > the underlying hardware. > > > > > > Signed-off-by: Kalesh AP > > > > Signed-off-by: Somnath Kotur > > > > Reviewed-by: Ajit Khaparde > > > > > More developer cc'ed. > > > > > --- > > > doc/guides/prog_guide/poll_mode_drv.rst | 24 +++++++++++++++++= +++++++ > > > lib/ethdev/rte_ethdev.h | 18 +++++++++++++++++= + > > > 2 files changed, 42 insertions(+) > > > > > > diff --git a/doc/guides/prog_guide/poll_mode_drv.rst b/doc/guide= s/prog_guide/poll_mode_drv.rst > > > index 6831289..9ecc0e4 100644 > > > --- a/doc/guides/prog_guide/poll_mode_drv.rst > > > +++ b/doc/guides/prog_guide/poll_mode_drv.rst > > > @@ -623,3 +623,27 @@ by application. > > > The PMD itself should not call rte_eth_dev_reset(). The PMD ca= n trigger > > > the application to handle reset event. It is duty of applicati= on to > > > handle all synchronization before it calls rte_eth_dev_reset()= . > > > + > > > +Error recovery support > > > +~~~~~~~~~~~~~~~~~~~~~~ > > > + > > > +When the PMD detects a FW reset or error condition, it may try = to recover > > > +from the error without needing the application intervention. In= such cases, > > > +PMD would need events to notify the application that it is unde= rgoing > > > +an error recovery. > > > + > > > +The PMD should trigger RTE_ETH_EVENT_ERR_RECOVERING event to no= tify the > > > +application that PMD detected a FW reset or FW error condition.= PMD may > > > +try to recover from the error by itself. Data path may be quies= ced and > > > +control path operations may fail during the recovery period. Th= e application > > > +should stop polling till it receives RTE_ETH_EVENT_RECOVERED ev= ent from the PMD. > > > + > > > > Between the time FW error occurred and the application receive the = RECOVERING event, > > datapath will continue to poll and application may call control API= s, so the event > > really is not solving the issue and driver somehow should be sure t= his won't crash > > the application, in that case not sure about the benefit of this ev= ent. > > > > [Kalesh]: As soon as the driver detects a FW dead or reset condition, i= t sets the fastpath pointers to dummy functions. This will prevent the cras= h. All control path operations would fail with -EBUSY. This change is alrea= dy there in bnxt PMD. This event is a notification to the application that = the PMD is recovering from a FW error condition so that it can stop polling= and issue control path operations. > > > > This was my point indeed. PMD can't rely on this event and should take ac= tions (for both > datapath and control path) to prevent possible crash/error. If that is th= e case event > doesn't have that much benefit since PMD already has to protect itself. This is an attempt to prevent PMD and applications from encountering unexpected situations because of an error in hardware or firmware. The unexpected scenarios can include lockups to segfaults apart from other situations. When hardware or firmware encounters and error, propagating it to the application for it to react can be slow, time consuming and could be vendor specific. Instead in the case of Broadcom devices we are trying to contain the detection and recovery within the hardware, firmware mostly and to a small extent driver framework. In the case of kernel drivers, this allows avoiding a system reset as much as possible while in the case of DPDK PMD, it can prevent application reloads or ungraceful exits. The PMD generated notification to the application will be more like a "For Your Information" for most of the applications. But applications can decide to act on the notification and take specific steps - like flushing or deleting all the existing flow rules, meters etc.. without waiting for success or failure indication. Applications can also re-offload the flow rules, recreate meters based on the notification allowing them to sync with the fresh hardware, firmware state. We think other PMD can also take advantage of these notifications to provide better reliability, accessibility and serviceability in general. Thanks Ajit > > > > > > +The PMD should trigger RTE_ETH_EVENT_RECOVERED event to notify = the application > > > +that the it has recovered from the error condition. PMD re-conf= igures the port > > > +to the state prior to the error condition. Control path and dat= a path are up now. > > > +Since the device has undergone a reset, flow rules offloaded pr= ior to reset > > > +may be lost and the application should recreate the rules again= . > > > + > > > > I think the most difficult part here is clarify what application sh= ould do > > when this event received consistent for all devices, "flow rules ma= y be lost" > > looks very vague to me. > > Unless it is not clear for application what to do when this event i= s received, > > it is not that useful or it will be specific to some PMDs. And I ca= n see it is > > hard to clarify this but perhaps we can define a set of common beha= vior. > > Not sure what others are thinking. > > > > [Kalesh]: Sure, let's wait for others' opinions as well. > > > > > > > +The PMD should trigger RTE_ETH_EVENT_INTR_RMV event to notify t= he application > > > +that it has failed to recover from the error condition. The dev= ice may not be > > > +usable anymore. > > > diff --git a/lib/ethdev/rte_ethdev.h b/lib/ethdev/rte_ethdev.h > > > index 147cc1c..a46819f 100644 > > > --- a/lib/ethdev/rte_ethdev.h > > > +++ b/lib/ethdev/rte_ethdev.h > > > @@ -3818,6 +3818,24 @@ enum rte_eth_event_type { > > > RTE_ETH_EVENT_DESTROY, /**< port is released */ > > > RTE_ETH_EVENT_IPSEC, /**< IPsec offload related event *= / > > > RTE_ETH_EVENT_FLOW_AGED,/**< New aged-out flows is detecte= d */ > > > + RTE_ETH_EVENT_ERR_RECOVERING, > > > + /**< port recovering from an error > > > + * > > > + * PMD detected a FW reset or error condit= ion. > > > + * PMD will try to recover from the error. > > > + * Data path may be quiesced and Control p= ath operations > > > + * may fail at this time. > > > + */ > > > > Please put multi line comments before enum, Andrew did a set of cle= anups for these. > > > > [Kalesh]: Sure, will do. > > > > > > > + RTE_ETH_EVENT_RECOVERED, > > > + /**< port recovered from an error > > > + * > > > + * PMD has recovered from the error condit= ion. > > > + * Control path and Data path are up now. > > > + * PMD re-configures the port to the state= prior to the error. > > > + * Since the device has undergone a reset,= flow rules > > > + * offloaded prior to reset may be lost an= d > > > + * the application should recreate the rul= es again. > > > + */ > > > RTE_ETH_EVENT_MAX /**< max value of this enum */ > > > }; > > > > > > > > > > > -- > > Regards, > > Kalesh A P > --00000000000015a87705d722fa9f Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIIQdgYJKoZIhvcNAQcCoIIQZzCCEGMCAQExDzANBglghkgBZQMEAgEFADALBgkqhkiG9w0BBwGg gg3NMIIFDTCCA/WgAwIBAgIQeEqpED+lv77edQixNJMdADANBgkqhkiG9w0BAQsFADBMMSAwHgYD VQQLExdHbG9iYWxTaWduIFJvb3QgQ0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UE AxMKR2xvYmFsU2lnbjAeFw0yMDA5MTYwMDAwMDBaFw0yODA5MTYwMDAwMDBaMFsxCzAJBgNVBAYT AkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMTEwLwYDVQQDEyhHbG9iYWxTaWduIEdDQyBS MyBQZXJzb25hbFNpZ24gMiBDQSAyMDIwMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA vbCmXCcsbZ/a0fRIQMBxp4gJnnyeneFYpEtNydrZZ+GeKSMdHiDgXD1UnRSIudKo+moQ6YlCOu4t rVWO/EiXfYnK7zeop26ry1RpKtogB7/O115zultAz64ydQYLe+a1e/czkALg3sgTcOOcFZTXk38e aqsXsipoX1vsNurqPtnC27TWsA7pk4uKXscFjkeUE8JZu9BDKaswZygxBOPBQBwrA5+20Wxlk6k1 e6EKaaNaNZUy30q3ArEf30ZDpXyfCtiXnupjSK8WU2cK4qsEtj09JS4+mhi0CTCrCnXAzum3tgcH cHRg0prcSzzEUDQWoFxyuqwiwhHu3sPQNmFOMwIDAQABo4IB2jCCAdYwDgYDVR0PAQH/BAQDAgGG MGAGA1UdJQRZMFcGCCsGAQUFBwMCBggrBgEFBQcDBAYKKwYBBAGCNxQCAgYKKwYBBAGCNwoDBAYJ KwYBBAGCNxUGBgorBgEEAYI3CgMMBggrBgEFBQcDBwYIKwYBBQUHAxEwEgYDVR0TAQH/BAgwBgEB /wIBADAdBgNVHQ4EFgQUljPR5lgXWzR1ioFWZNW+SN6hj88wHwYDVR0jBBgwFoAUj/BLf6guRSSu TVD6Y5qL3uLdG7wwegYIKwYBBQUHAQEEbjBsMC0GCCsGAQUFBzABhiFodHRwOi8vb2NzcC5nbG9i YWxzaWduLmNvbS9yb290cjMwOwYIKwYBBQUHMAKGL2h0dHA6Ly9zZWN1cmUuZ2xvYmFsc2lnbi5j b20vY2FjZXJ0L3Jvb3QtcjMuY3J0MDYGA1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFs c2lnbi5jb20vcm9vdC1yMy5jcmwwWgYDVR0gBFMwUTALBgkrBgEEAaAyASgwQgYKKwYBBAGgMgEo CjA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAN BgkqhkiG9w0BAQsFAAOCAQEAdAXk/XCnDeAOd9nNEUvWPxblOQ/5o/q6OIeTYvoEvUUi2qHUOtbf jBGdTptFsXXe4RgjVF9b6DuizgYfy+cILmvi5hfk3Iq8MAZsgtW+A/otQsJvK2wRatLE61RbzkX8 9/OXEZ1zT7t/q2RiJqzpvV8NChxIj+P7WTtepPm9AIj0Keue+gS2qvzAZAY34ZZeRHgA7g5O4TPJ /oTd+4rgiU++wLDlcZYd/slFkaT3xg4qWDepEMjT4T1qFOQIL+ijUArYS4owpPg9NISTKa1qqKWJ jFoyms0d0GwOniIIbBvhI2MJ7BSY9MYtWVT5jJO3tsVHwj4cp92CSFuGwunFMzCCA18wggJHoAMC AQICCwQAAAAAASFYUwiiMA0GCSqGSIb3DQEBCwUAMEwxIDAeBgNVBAsTF0dsb2JhbFNpZ24gUm9v dCBDQSAtIFIzMRMwEQYDVQQKEwpHbG9iYWxTaWduMRMwEQYDVQQDEwpHbG9iYWxTaWduMB4XDTA5 MDMxODEwMDAwMFoXDTI5MDMxODEwMDAwMFowTDEgMB4GA1UECxMXR2xvYmFsU2lnbiBSb290IENB IC0gUjMxEzARBgNVBAoTCkdsb2JhbFNpZ24xEzARBgNVBAMTCkdsb2JhbFNpZ24wggEiMA0GCSqG SIb3DQEBAQUAA4IBDwAwggEKAoIBAQDMJXaQeQZ4Ihb1wIO2hMoonv0FdhHFrYhy/EYCQ8eyip0E XyTLLkvhYIJG4VKrDIFHcGzdZNHr9SyjD4I9DCuul9e2FIYQebs7E4B3jAjhSdJqYi8fXvqWaN+J J5U4nwbXPsnLJlkNc96wyOkmDoMVxu9bi9IEYMpJpij2aTv2y8gokeWdimFXN6x0FNx04Druci8u nPvQu7/1PQDhBjPogiuuU6Y6FnOM3UEOIDrAtKeh6bJPkC4yYOlXy7kEkmho5TgmYHWyn3f/kRTv riBJ/K1AFUjRAjFhGV64l++td7dkmnq/X8ET75ti+w1s4FRpFqkD2m7pg5NxdsZphYIXAgMBAAGj QjBAMA4GA1UdDwEB/wQEAwIBBjAPBgNVHRMBAf8EBTADAQH/MB0GA1UdDgQWBBSP8Et/qC5FJK5N UPpjmove4t0bvDANBgkqhkiG9w0BAQsFAAOCAQEAS0DbwFCq/sgM7/eWVEVJu5YACUGssxOGhigH M8pr5nS5ugAtrqQK0/Xx8Q+Kv3NnSoPHRHt44K9ubG8DKY4zOUXDjuS5V2yq/BKW7FPGLeQkbLmU Y/vcU2hnVj6DuM81IcPJaP7O2sJTqsyQiunwXUaMld16WCgaLx3ezQA3QY/tRG3XUyiXfvNnBB4V 14qWtNPeTCekTBtzc3b0F5nCH3oO4y0IrQocLP88q1UOD5F+NuvDV0m+4S4tfGCLw0FREyOdzvcy a5QBqJnnLDMfOjsl0oZAzjsshnjJYS8Uuu7bVW/fhO4FCU29KNhyztNiUGUe65KXgzHZs7XKR1g/ XzCCBVUwggQ9oAMCAQICDBCmE9BT7srhoNHDEDANBgkqhkiG9w0BAQsFADBbMQswCQYDVQQGEwJC RTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTExMC8GA1UEAxMoR2xvYmFsU2lnbiBHQ0MgUjMg UGVyc29uYWxTaWduIDIgQ0EgMjAyMDAeFw0yMTAyMjIxNDE4MjdaFw0yMjA5MjIxNDUxNDlaMIGW MQswCQYDVQQGEwJJTjESMBAGA1UECBMJS2FybmF0YWthMRIwEAYDVQQHEwlCYW5nYWxvcmUxFjAU BgNVBAoTDUJyb2FkY29tIEluYy4xHDAaBgNVBAMTE0FqaXQgS3VtYXIgS2hhcGFyZGUxKTAnBgkq hkiG9w0BCQEWGmFqaXQua2hhcGFyZGVAYnJvYWRjb20uY29tMIIBIjANBgkqhkiG9w0BAQEFAAOC AQ8AMIIBCgKCAQEAwXsxfYF9jpj9zve1vXxD491SrWDVlcmLMdnOS1c7POMC8lbbgvp1o2kIu/3n xCVFTai5H6rHZgrFItNNVZ+XaJW9Ob9eiSuXdnAu5gVdTb+IFAf4S/PT2LXzpP07M7vyvm/yvA+8 HtVfapzqqTNYdNVUpq28MYsKEWbnyK94x5+C3oCAV4bpNnMoPNtKrMhvOdpTREQRyew8hyy3/Mz7 RIaCW0xx+14NTQe17dkH6CEEpmCjejneq/FU0gmbuorwHoP9mOiqeh23/ZKVpmFO/eiDtvMNAMDW 6LzhOk/pMklUPTHu/gQNW3OQebyhyFUHiBSp8rDkfWZT57Asd0PtdQIDAQABo4IB2zCCAdcwDgYD VR0PAQH/BAQDAgWgMIGjBggrBgEFBQcBAQSBljCBkzBOBggrBgEFBQcwAoZCaHR0cDovL3NlY3Vy ZS5nbG9iYWxzaWduLmNvbS9jYWNlcnQvZ3NnY2NyM3BlcnNvbmFsc2lnbjJjYTIwMjAuY3J0MEEG CCsGAQUFBzABhjVodHRwOi8vb2NzcC5nbG9iYWxzaWduLmNvbS9nc2djY3IzcGVyc29uYWxzaWdu MmNhMjAyMDBNBgNVHSAERjBEMEIGCisGAQQBoDIBKAowNDAyBggrBgEFBQcCARYmaHR0cHM6Ly93 d3cuZ2xvYmFsc2lnbi5jb20vcmVwb3NpdG9yeS8wCQYDVR0TBAIwADBJBgNVHR8EQjBAMD6gPKA6 hjhodHRwOi8vY3JsLmdsb2JhbHNpZ24uY29tL2dzZ2NjcjNwZXJzb25hbHNpZ24yY2EyMDIwLmNy bDAlBgNVHREEHjAcgRphaml0LmtoYXBhcmRlQGJyb2FkY29tLmNvbTATBgNVHSUEDDAKBggrBgEF BQcDBDAfBgNVHSMEGDAWgBSWM9HmWBdbNHWKgVZk1b5I3qGPzzAdBgNVHQ4EFgQUPHif0ihgndR0 h7r3sANaOIu2yM8wDQYJKoZIhvcNAQELBQADggEBAAEuLXDnP0Xd2zAMpQobXLUyqbpqGMO6ycQc Xq4H2YYlSNKVwPA+ZAVdUOzbSimBKlx8mzAEHkI3Ll1yXlYeT4UwkfWV9fioyGuQelLN1sGzi5bm WEpaSIbR1eiJMtzxUPwpRTn19gHZVueIot2Gw0fEYgHiMJpUr6xBWv2QNXULu/E8qvbXIRh2iycq 5rWFggX/JHglO8nVqzb1ImzqzVMFnDN15h3j8ryy2MIvZ8VDQRP7l81IXaTvVwaKpWMgV6rfQOi6 aOQZuOKkad7qoCkS5N2oSsvxi+rZtDaJJNsDjs05y5JZZQtBlfAmdYS+mmvkPjZ1iaLTzk59o/Yo fNkxggJtMIICaQIBATBrMFsxCzAJBgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNh MTEwLwYDVQQDEyhHbG9iYWxTaWduIEdDQyBSMyBQZXJzb25hbFNpZ24gMiBDQSAyMDIwAgwQphPQ U+7K4aDRwxAwDQYJYIZIAWUDBAIBBQCggdQwLwYJKoZIhvcNAQkEMSIEIKQCXf2MKlLWiG7qDw8O MDPL/Dm1aUUl8hddYJ9nhdfjMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkF MQ8XDTIyMDIwMzIwMjgyOFowaQYJKoZIhvcNAQkPMVwwWjALBglghkgBZQMEASowCwYJYIZIAWUD BAEWMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzALBgkqhkiG9w0BAQowCwYJKoZIhvcNAQEHMAsG CWCGSAFlAwQCATANBgkqhkiG9w0BAQEFAASCAQCgc0lLHDLNMLTuWs1XtcbS6uncdcRe3ev6/NY0 XZTEW1pyKN3oBx7EFzgei21/Nw4eYwKYr6YtLlzpiWf1ue+xld1VDqWH0PQ7GOy+PAqT20reC5Gu Uz7/nBUdOKjmWGyR5mrZTnCbUiR69BRSfXr8A+SjMdaeWPtLI5la/j29rjI8n4rY8xEU9K6+nv4a fuci4Kq7Dbs/qtPKWDLPx6KkuZruD+4gjSvUNsEzPVHcIwX7DAwC5TPeEBM9vrqS70xnaa0AG53u AH2AfPyFMIzaHRcWlptrIY7bRQOeRLySP2kg3wU5PC45JDq5ZavuIEeyAUZtMR4DrUR9GXMslviA --00000000000015a87705d722fa9f--