From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9BB9EC56202 for ; Wed, 25 Nov 2020 16:08:06 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 1DFA0206F7 for ; Wed, 25 Nov 2020 16:08:06 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=amdcloud.onmicrosoft.com header.i=@amdcloud.onmicrosoft.com header.b="rpMsGyGD" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730673AbgKYQHu (ORCPT ); Wed, 25 Nov 2020 11:07:50 -0500 Received: from mail-mw2nam12on2079.outbound.protection.outlook.com ([40.107.244.79]:10208 "EHLO NAM12-MW2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1730668AbgKYQHt (ORCPT ); Wed, 25 Nov 2020 11:07:49 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HxbUKS1bxdzOHZI5GRpwNtspIEGhAyShRVN/Hxjf+c0YxrsOoSXjvjBYjaEq5+i2nbvwwBEtOw5rOsBljmJb5HqnzEIQcoZfSQvn0M8/bFqkjrxIqJ+UTF4XdP9i806xuL8UEFR6f842O1joZ+nSRaY8d+Qo4Kej+aRubl2H0ltf71R1tQI691QL0yJLikbFBCWSFa4uxMkV0Q2IPPYSZlRBy3pAuG/8C2aQQhh6uFdd2SxjsEBz0POHYlTOPLyDK9Wp5VbW5StiNIbs4ysOQF1elrlpLvCji9kL4vx2lsQESkHP7/WP9MXHj7ReRM2BChJGg3GvERrn+HK4Ac4viQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bbzgO8plCR1iIhBABTSibizgekAzrR+p9Vgk6IuzSsg=; b=cdAIiGOsQRK1snQt4H6nj79CgUiAHRbS0+gsmHPxtocpAwNObaz6mACkpu3vGYzLLGUlcHE7wynZD0wRErnkocFA+Odv3Hzk87z9Z5MiPxAWAiFmv3KFJO8rV7mciAea7amrcwkbT2dQYft6v1V3wiub0UzrXltDmVQLjOs86QzLcoQHe95Xf4EgsfN/rs5ARfMr0IfpaU2Ac8uKd2EaKqT78ZRYIFzmBVzaL2lhjpVitVb5d1RNx53XjhpLfifIo6NDygYPtLTCxuoXwaus3K88yTdUqy98oFxMEwV2Jwa5qSbO+H7zxD+u9ix7X2LlLvfBwzMHWg920VUTGhzKFQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amdcloud.onmicrosoft.com; s=selector2-amdcloud-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bbzgO8plCR1iIhBABTSibizgekAzrR+p9Vgk6IuzSsg=; b=rpMsGyGDVsIDzfAFknz3WxiR7Uzw6+oOL6MNBgr1lfU1tzi28+Yr3xcMO2+4iN+nga7mdNPzTLif05a0TUK2JIisq74E/GH4xYHzl9HphON/fkdG9RLIQdGoR+Qw2p632NuEbhSYt6l8bTzNZo7siFFfPWIkGWemH1Ga8fltrX4= Received: from MN2PR12MB4488.namprd12.prod.outlook.com (2603:10b6:208:24e::19) by MN2PR12MB4174.namprd12.prod.outlook.com (2603:10b6:208:15f::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3611.22; Wed, 25 Nov 2020 16:07:42 +0000 Received: from MN2PR12MB4488.namprd12.prod.outlook.com ([fe80::fca3:155c:bf43:94af]) by MN2PR12MB4488.namprd12.prod.outlook.com ([fe80::fca3:155c:bf43:94af%6]) with mapi id 15.20.3589.030; Wed, 25 Nov 2020 16:07:42 +0000 From: "Deucher, Alexander" To: "Merger, Edgar [AUTOSOL/MAS/AUGS]" , "Huang, Ray" , "Kuehling, Felix" CC: Will Deacon , "linux-kernel@vger.kernel.org" , "linux-pci@vger.kernel.org" , "iommu@lists.linux-foundation.org" , Bjorn Helgaas , Joerg Roedel , "Zhu, Changfeng" Subject: RE: [EXTERNAL] Re: [PATCH] PCI: Mark AMD Raven iGPU ATS as broken Thread-Topic: [EXTERNAL] Re: [PATCH] PCI: Mark AMD Raven iGPU ATS as broken Thread-Index: AQHWwZ6+dZH+wAWtiUyhnWNLDE7tj6nWM/hwgAAaPwCAAATSgIAAg9SAgAAMxACAAH6N8IAA/GuAgAA1X4CAAA1TAIAAY5nQ Date: Wed, 25 Nov 2020 16:07:42 +0000 Message-ID: References: <20201123134410.10648-1-will@kernel.org> <20201123223356.GC12069@willie-the-truck> <218017ab-defd-c77d-9055-286bf49bee86@amd.com> <20201124064301.GA536919@hr-amd> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: msip_labels: MSIP_Label_0d814d60-469d-470c-8cb0-58434e2bf457_Enabled=true; MSIP_Label_0d814d60-469d-470c-8cb0-58434e2bf457_SetDate=2020-11-24T15:01:54Z; MSIP_Label_0d814d60-469d-470c-8cb0-58434e2bf457_Method=Privileged; MSIP_Label_0d814d60-469d-470c-8cb0-58434e2bf457_Name=Public_0; MSIP_Label_0d814d60-469d-470c-8cb0-58434e2bf457_SiteId=3dd8961f-e488-4e60-8e11-a82d994e183d; MSIP_Label_0d814d60-469d-470c-8cb0-58434e2bf457_ActionId=de2f7a10-55c4-48b3-9a56-00005e730a8e; MSIP_Label_0d814d60-469d-470c-8cb0-58434e2bf457_ContentBits=1 msip_label_0d814d60-469d-470c-8cb0-58434e2bf457_enabled: true msip_label_0d814d60-469d-470c-8cb0-58434e2bf457_setdate: 2020-11-25T16:07:35Z msip_label_0d814d60-469d-470c-8cb0-58434e2bf457_method: Privileged msip_label_0d814d60-469d-470c-8cb0-58434e2bf457_name: Public_0 msip_label_0d814d60-469d-470c-8cb0-58434e2bf457_siteid: 3dd8961f-e488-4e60-8e11-a82d994e183d msip_label_0d814d60-469d-470c-8cb0-58434e2bf457_actionid: 37ffaa45-a58f-4d49-a70b-0000ad658905 msip_label_0d814d60-469d-470c-8cb0-58434e2bf457_contentbits: 0 authentication-results: emerson.com; dkim=none (message not signed) header.d=none;emerson.com; dmarc=none action=none header.from=amd.com; x-originating-ip: [192.161.78.5] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 1995a809-a87a-4a32-2145-08d8915c3d7b x-ms-traffictypediagnostic: MN2PR12MB4174: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:5797; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: h948ORIi127y8B47IK7CQb4qIdvfohP00h93q2F1KntwYhQAUWoA1QCTsuJIxME/fpIc0PU2LXZ8WL9sD3R1kQZgA6hKM5mGDfIj7i+6LG9wcHRZiVaDAnwm6JexZII0sUr6TewXpPSEFd1B6Gp0KGaA6LIj+uOgGMnSjQVrZGCFV5AVjDNffx8Z+3ZPgIdBXbhcRF/9e7FI0IlE1ILxTrf+FVqwKqVrF8KSIAnUwb+jXoi46K7Yc2bShFVqbaeCgDISMvmMy8tNLNQJ3q+yFPMHt4Ys0MQtDE2MBYk9o/qKLlzMWBuUELFA6R2nXB5jS3toLl6jkPY5xb4A2ByqNaWhjkPhPM1+1q200UDIoPjmjVu8x2QyaR40WdTvOaH2/iJF4JtacV339D2GuSjrFpLpqKRCG0ph58E09/+2aPaEtrPPdpKQwyBXjakLPWD4sP+SkW8N3KCQXJEuF8O++w== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MN2PR12MB4488.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(6506007)(30864003)(83380400001)(19627235002)(55016002)(66946007)(9686003)(33656002)(66616009)(8936002)(66476007)(66446008)(64756008)(66556008)(86362001)(71200400001)(186003)(26005)(6636002)(76116006)(7696005)(2906002)(45080400002)(966005)(110136005)(54906003)(99936003)(4001150100001)(53546011)(498600001)(52536014)(4326008)(8676002)(5660300002)(579004)(505234006);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?HEo4MEhScd0oyu+G0oVSyvf+rp5nl4XsgvNTG7q17MDIOFnndKHEGl6PqS?= =?iso-8859-1?Q?nmEB5jhwAENwIQo6LvNLQozF+kNvbTKZoMVJ9QZmuoM2WUL7WrVAgZqX/L?= =?iso-8859-1?Q?jbXjLgDImXlL0c9na+cD7hFpoLNHz5qlj3JSfCCcTDIH1jIjXZsrt1w26K?= =?iso-8859-1?Q?NC6Bf2mn0c+Je/CCgv8DJGKIRVz+ozdmINP1BDxFBlFabGwoWIIjni8HvF?= =?iso-8859-1?Q?SDO4xJUxMkeicAhSnCeVhfXvm98Vn5jYUwoFaEzIW+ipqh2nzy5PBunak4?= =?iso-8859-1?Q?jB2ADFJLJJNHIe1ddxR4v9NQBjH/AZZQaIbTnbYMRPiSo0yJhs2gs+fbFQ?= =?iso-8859-1?Q?M/RYYahakmU4Y+TyYELM2yCRwh8oSPx0Q7mwpCseL+cvTuv/699QRdDM5B?= =?iso-8859-1?Q?znn7A8o47zTu0KrVVJcXUxnH8Ha81PNFBx+xoWtqIdDWmcF3K2BiLtN5UJ?= =?iso-8859-1?Q?EnJ2uqpPCyKfmwcsPvA+WrrYdbmg1edB6wZ52pHNXMKr5N6heNEAFAmicr?= =?iso-8859-1?Q?YFec1fT0Hrj7WzDjjxluBGpheSC4fw9DTm3XzDeIJ+nVcrsxZyT1Ivo2wH?= =?iso-8859-1?Q?EC4Zo7PwfB7Lqdo93eWoQ1L64PvX/HkxXEUfOXOVN5KSLAgQH3iUPzKrIx?= =?iso-8859-1?Q?VTdnauceRzm68YucMYSMg5ZSHhRHwYrfrxyknmK8a1LxOj0fdlb5EQgLOT?= =?iso-8859-1?Q?uaNqokJx9HVWaw0pOj6RKJzCWhB0D1xxMFsej+22A6Xnk8J4O1Z5HSF7nS?= =?iso-8859-1?Q?sJ67QK+/Gfw8wy0KFpvQkLnVwhPaYDHM9p11GFkIeE5TlwoaWKeJGqUtg/?= =?iso-8859-1?Q?NnHab4spv1fnrOFRVApTn2giQDoCbn/8ZbaZLxBRxecOOwbhHauuJfNmvf?= =?iso-8859-1?Q?/SRia36rNzlG0BbHXS0W22UsHsUnddfH9g4ZGL1ESaY67VNswDLqGyuDcw?= =?iso-8859-1?Q?V1jD1KN4JCAXzr/3lQJSGl9SaMxlgiNjt1sscLFx7sY+5tLTUo6d09DBss?= =?iso-8859-1?Q?TbE+1yjjPhrAGTghY=3D?= Content-Type: multipart/mixed; boundary="_002_MN2PR12MB4488C655936CE25DC0C3EA5EF7FA0MN2PR12MB4488namp_" MIME-Version: 1.0 X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MN2PR12MB4488.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1995a809-a87a-4a32-2145-08d8915c3d7b X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Nov 2020 16:07:42.6846 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: b4krnI55sfxUkDfXzDFwvXNTRTLO9xL0eW7nI0De7Ol+wpcTHKnYW4sQzwZUhZSUawz4+NExzVrur81eKPlnfw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4174 Precedence: bulk List-ID: X-Mailing-List: linux-pci@vger.kernel.org --_002_MN2PR12MB4488C655936CE25DC0C3EA5EF7FA0MN2PR12MB4488namp_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable [AMD Public Use] > -----Original Message----- > From: Merger, Edgar [AUTOSOL/MAS/AUGS] > > Sent: Wednesday, November 25, 2020 5:04 AM > To: Deucher, Alexander ; Huang, Ray > ; Kuehling, Felix > Cc: Will Deacon ; linux-kernel@vger.kernel.org; linux- > pci@vger.kernel.org; iommu@lists.linux-foundation.org; Bjorn Helgaas > ; Joerg Roedel ; Zhu, Changfeng > > Subject: RE: [EXTERNAL] Re: [PATCH] PCI: Mark AMD Raven iGPU ATS as > broken >=20 > I do have also other problems with this unit, when IOMMU is enabled and > pci=3Dnoats is not set as kernel parameter. >=20 > [ 2004.265906] amdgpu 0000:0b:00.0: [drm:amdgpu_ib_ring_tests [amdgpu]] > *ERROR* IB test failed on gfx (-110). > [ 2004.266024] [drm:amdgpu_device_delayed_init_work_handler [amdgpu]] > *ERROR* ib ring test failed (-110). >=20 Is this seen on all instances of this chip or only specific silicon? I.e.,= could this be a bad chip? Would it be possible to test a newer sbios? I = think the attached patch should work if we can't get it fixed on the platfo= rm side. It should only enable the quirk on your particular platform. Alex > -----Original Message----- > From: Merger, Edgar [AUTOSOL/MAS/AUGS] > Sent: Mittwoch, 25. November 2020 10:16 > To: 'Deucher, Alexander' ; 'Huang, Ray' > ; 'Kuehling, Felix' > Cc: 'Will Deacon' ; 'linux-kernel@vger.kernel.org' kernel@vger.kernel.org>; 'linux-pci@vger.kernel.org' pci@vger.kernel.org>; 'iommu@lists.linux-foundation.org' > ; 'Bjorn Helgaas' > ; 'Joerg Roedel' ; 'Zhu, > Changfeng' > Subject: RE: [EXTERNAL] Re: [PATCH] PCI: Mark AMD Raven iGPU ATS as > broken >=20 > Remark: >=20 > Systems with R1305G APU (which show the issue) have the following VGA- > Controller: > 0b:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] > Picasso (rev cf) >=20 > Systems with V1404I APU (which do not show the issue) have the following > VGA-Controller: > 0b:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] > Raven Ridge [Radeon Vega Series / Radeon Vega Mobile Series] (rev 83) >=20 > "rev cf" vs. "ref 83" is probably what you where referring to with PCI Re= vision > ID. >=20 > -----Original Message----- > From: Merger, Edgar [AUTOSOL/MAS/AUGS] > Sent: Mittwoch, 25. November 2020 07:05 > To: 'Deucher, Alexander' ; Huang, Ray > ; Kuehling, Felix > Cc: Will Deacon ; linux-kernel@vger.kernel.org; linux- > pci@vger.kernel.org; iommu@lists.linux-foundation.org; Bjorn Helgaas > ; Joerg Roedel ; Zhu, Changfeng > > Subject: RE: [EXTERNAL] Re: [PATCH] PCI: Mark AMD Raven iGPU ATS as > broken >=20 > I see that problem only on systems that use a R1305G APU >=20 > sudo cat /sys/kernel/debug/dri/0/amdgpu_firmware_info >=20 > shows >=20 > VCE feature version: 0, firmware version: 0x00000000 UVD feature version:= 0, > firmware version: 0x00000000 MC feature version: 0, firmware version: > 0x00000000 ME feature version: 50, firmware version: 0x000000a3 PFP > feature version: 50, firmware version: 0x000000bb CE feature version: 50, > firmware version: 0x0000004f RLC feature version: 1, firmware version: > 0x00000049 RLC SRLC feature version: 1, firmware version: 0x00000001 RLC > SRLG feature version: 1, firmware version: 0x00000001 RLC SRLS feature > version: 1, firmware version: 0x00000001 MEC feature version: 50, firmwar= e > version: 0x000001b5 > MEC2 feature version: 50, firmware version: 0x000001b5 SOS feature versio= n: > 0, firmware version: 0x00000000 ASD feature version: 0, firmware version: > 0x21000030 TA XGMI feature version: 0, firmware version: 0x00000000 TA > RAS feature version: 0, firmware version: 0x00000000 SMC feature version:= 0, > firmware version: 0x00002527 > SDMA0 feature version: 41, firmware version: 0x000000a9 VCN feature > version: 0, firmware version: 0x0110901c DMCU feature version: 0, firmwar= e > version: 0x00000001 VBIOS version: 113-RAVEN2-117 >=20 > We are also using V1404I APU on the same boards and I haven=B4t seen the > issue on those boards >=20 > These boards give me slightly different info: sudo cat > /sys/kernel/debug/dri/0/amdgpu_firmware_info >=20 > VCE feature version: 0, firmware version: 0x00000000 UVD feature version:= 0, > firmware version: 0x00000000 MC feature version: 0, firmware version: > 0x00000000 ME feature version: 47, firmware version: 0x000000a2 PFP > feature version: 47, firmware version: 0x000000b9 CE feature version: 47, > firmware version: 0x0000004e RLC feature version: 1, firmware version: > 0x00000213 RLC SRLC feature version: 1, firmware version: 0x00000001 RLC > SRLG feature version: 1, firmware version: 0x00000001 RLC SRLS feature > version: 1, firmware version: 0x00000001 MEC feature version: 47, firmwar= e > version: 0x000001ab > MEC2 feature version: 47, firmware version: 0x000001ab SOS feature versio= n: > 0, firmware version: 0x00000000 ASD feature version: 0, firmware version: > 0x21000013 TA XGMI feature version: 0, firmware version: 0x00000000 TA > RAS feature version: 0, firmware version: 0x00000000 SMC feature version:= 0, > firmware version: 0x00001e5b > SDMA0 feature version: 41, firmware version: 0x000000a9 VCN feature > version: 0, firmware version: 0x0110901c DMCU feature version: 0, firmwar= e > version: 0x00000000 VBIOS version: 113-RAVEN-116 >=20 >=20 >=20 >=20 > 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Root > Complex > 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 IOMMU > 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Model= s > 00h-1fh) PCIe Dummy Host Bridge > 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe > GPP Bridge [6:0] > 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Zeppelin Switch > Upstream (PCIE SW.US) > 00:01.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe > GPP Bridge [6:0] > 00:01.5 PCI bridge: Advanced Micro Devices, Inc. [AMD] Zeppelin Switch > Upstream (PCIE SW.US) > 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Model= s > 00h-1fh) PCIe Dummy Host Bridge > 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Internal PCIe GPP Bridge 0 to Bus A > 00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Internal PCIe GPP Bridge 0 to Bus B > 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller > (rev 61) > 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (re= v > 51) > 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Device 24: Function 0 > 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Device 24: Function 1 > 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Device 24: Function 2 > 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Device 24: Function 3 > 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Device 24: Function 4 > 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Device 24: Function 5 > 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Device 24: Function 6 > 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 > Device 24: Function 7 > 01:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. > RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 0e) > 01:00.1 Serial controller: Realtek Semiconductor Co., Ltd. Device 816a (r= ev 0e) > 01:00.2 Serial controller: Realtek Semiconductor Co., Ltd. Device 816b (r= ev 0e) > 01:00.3 IPMI Interface: Realtek Semiconductor Co., Ltd. Device 816c (rev = 0e) > 01:00.4 USB controller: Realtek Semiconductor Co., Ltd. Device 816d (rev = 0e) > 02:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network > Connection (rev 03) > 03:00.0 PCI bridge: Pericom Semiconductor PI7C9X2G608GP PCIe2 6-Port/8- > Lane Packet Switch > 04:01.0 PCI bridge: Pericom Semiconductor PI7C9X2G608GP PCIe2 6-Port/8- > Lane Packet Switch > 04:02.0 PCI bridge: Pericom Semiconductor PI7C9X2G608GP PCIe2 6-Port/8- > Lane Packet Switch > 04:03.0 PCI bridge: Pericom Semiconductor PI7C9X2G608GP PCIe2 6-Port/8- > Lane Packet Switch > 04:04.0 PCI bridge: Pericom Semiconductor PI7C9X2G608GP PCIe2 6-Port/8- > Lane Packet Switch > 04:05.0 PCI bridge: Pericom Semiconductor PI7C9X2G608GP PCIe2 6-Port/8- > Lane Packet Switch > 06:00.0 Serial controller: Asix Electronics Corporation Device 9100 > 06:00.1 Serial controller: Asix Electronics Corporation Device 9100 > 07:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network > Connection (rev 03) > 0a:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network > Connection (rev 03) > 0b:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] > Picasso (rev cf) > 0b:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] > Raven/Raven2/Fenghuang HDMI/DP Audio Controller > 0b:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family = 17h > (Models 10h-1fh) Platform Security Processor > 0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Raven2 USB 3.1 > 0b:00.5 Multimedia controller: Advanced Micro Devices, Inc. [AMD] > Raven/Raven2/FireFlight/Renoir Audio Processor > 0b:00.7 Non-VGA unclassified device: Advanced Micro Devices, Inc. [AMD] > Raven/Raven2/Renoir Non-Sensor Fusion Hub KMDF driver > 0c:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA > Controller [AHCI mode] (rev 61) >=20 > PCI Revision ID is 06 I believe. Got that from this lspci -xx >=20 > 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Zeppelin Switch > Upstream (PCIE SW.US) > 00: 22 10 5d 14 07 04 10 00 00 00 04 06 10 00 81 00 > 10: 00 00 00 00 00 00 00 00 00 02 02 00 f1 01 00 00 > 20: e0 fc e0 fc f1 ff 01 00 00 00 00 00 00 00 00 00 > 30: 00 00 00 00 50 00 00 00 00 00 00 00 ff 00 12 00 > 40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > 50: 01 58 03 c8 00 00 00 00 10 a0 42 01 22 80 00 00 > 60: 1f 29 00 00 13 38 73 03 42 00 11 30 00 00 04 00 > 70: 00 00 40 01 18 00 01 00 00 00 00 00 bf 01 70 00 > 80: 06 00 00 00 0e 00 00 00 03 00 01 00 00 00 00 00 > 90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > a0: 05 c0 81 00 00 00 e0 fe 00 00 00 00 00 00 00 00 > b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > c0: 0d c8 00 00 22 10 34 12 08 00 03 a8 00 00 00 00 > d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > e0: 00 00 00 00 4c 8a 05 00 00 00 00 00 00 00 00 00 > f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >=20 > -----Original Message----- > From: Deucher, Alexander > Sent: Dienstag, 24. November 2020 16:06 > To: Merger, Edgar [AUTOSOL/MAS/AUGS] ; > Huang, Ray ; Kuehling, Felix > > Cc: Will Deacon ; linux-kernel@vger.kernel.org; linux- > pci@vger.kernel.org; iommu@lists.linux-foundation.org; Bjorn Helgaas > ; Joerg Roedel ; Zhu, Changfeng > > Subject: RE: [EXTERNAL] Re: [PATCH] PCI: Mark AMD Raven iGPU ATS as > broken >=20 > [AMD Public Use] >=20 > > -----Original Message----- > > From: Merger, Edgar [AUTOSOL/MAS/AUGS] > > > Sent: Tuesday, November 24, 2020 2:29 AM > > To: Huang, Ray ; Kuehling, Felix > > > > Cc: Will Deacon ; Deucher, Alexander > > ; linux-kernel@vger.kernel.org; linux- > > pci@vger.kernel.org; iommu@lists.linux-foundation.org; Bjorn Helgaas > > ; Joerg Roedel ; Zhu, > Changfeng > > > > Subject: RE: [EXTERNAL] Re: [PATCH] PCI: Mark AMD Raven iGPU ATS as > > broken > > > > Module Version : PiccasoCpu 10 > > AGESA Version : PiccasoPI 100A > > > > I did not try to enter the system in any other way (like via ssh) than > > via Desktop. >=20 > You can get this information from the amdgpu driver. E.g., sudo cat > /sys/kernel/debug/dri/0/amdgpu_firmware_info . Also what is the PCI > revision id of your chip (from lspci)? Also are you just seeing this on = specific > versions of the sbios? >=20 > Thanks, >=20 > Alex >=20 >=20 > > > > -----Original Message----- > > From: Huang Rui > > Sent: Dienstag, 24. November 2020 07:43 > > To: Kuehling, Felix > > Cc: Will Deacon ; Deucher, Alexander > > ; linux-kernel@vger.kernel.org; linux- > > pci@vger.kernel.org; iommu@lists.linux-foundation.org; Bjorn Helgaas > > ; Merger, Edgar [AUTOSOL/MAS/AUGS] > > ; Joerg Roedel ; > Changfeng > > Zhu > > Subject: [EXTERNAL] Re: [PATCH] PCI: Mark AMD Raven iGPU ATS as > broken > > > > On Tue, Nov 24, 2020 at 06:51:11AM +0800, Kuehling, Felix wrote: > > > On 2020-11-23 5:33 p.m., Will Deacon wrote: > > > > On Mon, Nov 23, 2020 at 09:04:14PM +0000, Deucher, Alexander wrote: > > > >> [AMD Public Use] > > > >> > > > >>> -----Original Message----- > > > >>> From: Will Deacon > > > >>> Sent: Monday, November 23, 2020 8:44 AM > > > >>> To: linux-kernel@vger.kernel.org > > > >>> Cc: linux-pci@vger.kernel.org; iommu@lists.linux-foundation.org; > > > >>> Will Deacon ; Bjorn Helgaas > > > >>> ; Deucher, Alexander > > > >>> ; Edgar Merger > > > >>> ; Joerg Roedel > > > >>> Subject: [PATCH] PCI: Mark AMD Raven iGPU ATS as broken > > > >>> > > > >>> Edgar Merger reports that the AMD Raven GPU does not work > > > >>> reliably on his system when the IOMMU is enabled: > > > >>> > > > >>> | [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx > > > >>> timeout, signaled seq=3D1, emitted seq=3D3 > > > >>> | [...] > > > >>> | amdgpu 0000:0b:00.0: GPU reset begin! > > > >>> | AMD-Vi: Completion-Wait loop timed out > > > >>> | iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT > > > >>> device=3D0b:00.0 address=3D0x38edc0970] > > > >>> > > > >>> This is indicative of a hardware/platform configuration issue > > > >>> so, since disabling ATS has been shown to resolve the problem, > > > >>> add a quirk to match this particular device while Edgar > > > >>> follows-up with AMD > > for more information. > > > >>> > > > >>> Cc: Bjorn Helgaas > > > >>> Cc: Alex Deucher > > > >>> Reported-by: Edgar Merger > > > >>> Suggested-by: Joerg Roedel > > > >>> Link: > > > >>> > > > https://nam11.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Furld > > efense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps- > 3A__nam11.safelinks.p& > > > ;data=3D04%7C01%7CAlexander.Deucher%40amd.com%7C1d797071822d47ce6 > c9808d8 > > > 9129698f%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637418954 > 3633797 > > > 99%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luM > zIiLCJBTiI > > > 6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=3DVLlzQtS3KWZqQslcJKZYrG > sj6eMk3 > > VWaE%2BXhbNdRx80%3D&reserved=3D0 > > rotection.outlook.com_-3Furl-3Dhttps-253A-252F- > 252Furld&d=3DDwIFAw&c=3DjOU > > > RTkCZzT8tVB5xPEYIm3YJGoxoTaQsQPzPKJGaWbo&r=3DBJxhacqqa4K1PJGm6_- > 862rdSP1 > > 3_P6LVp7j_9l1xmg&m=3DMMI_EgCqeOX4EvIftpL7agRxJ- > udp1CLokf2QWuzFgE&s=3DZLdz6 > > OgavzNn2vSzsgyL1IB6MbK7hPKavOYwbLhyTPU&e=3D > > efense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps- > > > 3A__lore%26d%3DDwIDAw%26c%3DjOURTkCZzT8tVB5xPEYIm3YJGoxoTaQs > > QPzPKJGaWbo%26r%3DBJxhacqqa4K1PJGm6_- > > > 862rdSP13_P6LVp7j_9l1xmg%26m%3DlNXu2xwvyxEZ3PzoVmXMBXXS55jsmf > > > DicuQFJqkIOH4%26s%3D_5VDNCRQdA7AhsvvZ3TJJtQZ2iBp9c9tFHIleTYT_ZM > > > %26e%3D&data=3D04%7C01%7CAlexander.Deucher%40amd.com%7C6d5f > > > a241f9634692c03908d8904a942c%7C3dd8961fe4884e608e11a82d994e183d%7 > > > C0%7C0%7C637417997272974427%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi > > > MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C100 > > > 0&sdata=3DOEgYlw%2F1YP0C%2FnWBRQUxwBH56mGOJxYMWSQ%2Fj1Y > > 9f6Q%3D&reserved=3D0 . > > > >>> kernel.org/linux- > > > >>> > > iommu/MWHPR10MB1310F042A30661D4158520B589FC0@MWHPR10M > > > >>> B1310.namprd10.prod.outlook.com > > > >>> > > > her%40amd.com%7C1a883fe14d0c408e7d9508d88fb5df4e%7C3dd8961fe488 > > > >>> > > > 4e608e11a82d994e183d%7C0%7C0%7C637417358593629699%7CUnknown%7 > > > >>> > > > CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwi > > > >>> > > > LCJXVCI6Mn0%3D%7C1000&sdata=3DTMgKldWzsX8XZ0l7q3%2BszDWXQJJ > > > >>> LOUfX5oGaoLN8n%2B8%3D&reserved=3D0 > > > >>> Signed-off-by: Will Deacon > > > >>> --- > > > >>> > > > >>> Hi all, > > > >>> > > > >>> Since Joerg is away at the moment, I'm posting this to try to > > > >>> make some progress with the thread in the Link: tag. > > > >> + Felix > > > >> > > > >> What system is this? Can you provide more details? Does a sbios > > > >> update fix this? Disabling ATS for all Ravens will break GPU > > > >> compute for a lot of people. I'd prefer to just black list this > > > >> particular system (e.g., just SSIDs or revision) if possible. > > > > > > +Ray > > > > > > There are already many systems where the IOMMU is disabled in the > > > BIOS, or the CRAT table reporting the APU compute capabilities is > > > broken. Ray has been working on a fallback to make APUs behave like > > > dGPUs on such systems. That should also cover this case where ATS is > > > blacklisted. That said, it affects the programming model, because we > > > don't support the unified and coherent memory model on dGPUs like we > > > do on APUs with IOMMUv2. So it would be good to make the conditions > > > for this workaround as narrow as possible. > > > > Yes, besides the comments from Alex and Felix, may we get your > > firmware version (SMC firmware which is from SBIOS) and device id? > > > > > >>> | [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx > > > >>> timeout, signaled seq=3D1, emitted seq=3D3 > > > > It looks only gfx ib test passed, and fails to lanuch desktop, am I rig= ht? > > > > We would like to see whether it is Raven, Raven kicker (new Raven), or > > Picasso. In our side, per the internal test result, we didn't see the > > similiar issue on Raven kicker and Picasso platform. > > > > Thanks, > > Ray > > > > > > > > These are the relevant changes in KFD and Thunk for reference: > > > > > > ### KFD ### > > > > > > commit 914913ab04dfbcd0226ecb6bc99d276832ea2908 > > > Author: Huang Rui > > > Date:=A0=A0 Tue Aug 18 14:54:23 2020 +0800 > > > > > > =A0=A0=A0 drm/amdkfd: implement the dGPU fallback path for apu (v6) > > > > > > =A0=A0=A0 We still have a few iommu issues which need to address, so > > > force raven > > > =A0=A0=A0 as "dgpu" path for the moment. > > > > > > =A0=A0=A0 This is to add the fallback path to bypass IOMMU if IOMMU = v2 is > > > disabled > > > =A0=A0=A0 or ACPI CRAT table not correct. > > > > > > =A0=A0=A0 v2: Use ignore_crat parameter to decide whether it will go= with > > > IOMMUv2. > > > =A0=A0=A0 v3: Align with existed thunk, don't change the way of rave= n, > > > only renoir > > > =A0=A0=A0=A0=A0=A0=A0 will use "dgpu" path by default. > > > =A0=A0=A0 v4: don't update global ignore_crat in the driver, and rev= ise > > > fallback > > > =A0=A0=A0=A0=A0=A0=A0 function if CRAT is broken. > > > =A0=A0=A0 v5: refine acpi crat good but no iommu support case, and r= ename > > > the > > > =A0=A0=A0=A0=A0=A0=A0 title. > > > =A0=A0=A0 v6: fix the issue of dGPU initialized firstly, just modify= the > > > report > > > =A0=A0=A0=A0=A0=A0=A0 value in the node_show(). > > > > > > =A0=A0=A0 Signed-off-by: Huang Rui > > > =A0=A0=A0 Reviewed-by: Felix Kuehling > > > =A0=A0=A0 Signed-off-by: Alex Deucher > > > > > > ### Thunk ### > > > > > > commit e32482fa4b9ca398c8bdc303920abfd672592764 > > > Author: Huang Rui > > > Date:=A0=A0 Tue Aug 18 18:54:05 2020 +0800 > > > > > > =A0=A0=A0 libhsakmt: remove is_dgpu flag in the hsa_gfxip_table > > > > > > =A0=A0=A0 Whether use dgpu path will check the props which exposed f= rom > kernel. > > > =A0=A0=A0 We won't need hard code in the ASIC table. > > > > > > =A0=A0=A0 Signed-off-by: Huang Rui > > > =A0=A0=A0 Change-Id: I0c018a26b219914a41197ff36dbec7a75945d452 > > > > > > commit 7c60f6d912034aa67ed27b47a29221422423f5cc > > > Author: Huang Rui > > > Date:=A0=A0 Thu Jul 30 10:22:23 2020 +0800 > > > > > > =A0=A0=A0 libhsakmt: implement the method that using flag which expo= sed > > > by kfd to configure is_dgpu > > > > > > =A0=A0=A0 KFD already implemented the fallback path for APU. Thunk w= ill > > > use flag > > > =A0=A0=A0 which exposed by kfd to configure is_dgpu instead of hardc= ode > before. > > > > > > =A0=A0=A0 Signed-off-by: Huang Rui > > > =A0=A0=A0 Change-Id: I445f6cf668f9484dd06cd9ae1bb3cfe7428ec7eb > > > > > > Regards, > > > =A0 Felix > > > > > > > > > > Cheers, Alex. I'll have to defer to Edgar for the details, as my > > > > understanding from the original thread over at: > > > > > > > > > > > https://nam11.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Furld > > efense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps- > 3A__nam11.safelinks.p& > > > ;data=3D04%7C01%7CAlexander.Deucher%40amd.com%7C1d797071822d47ce6 > c9808d8 > > > 9129698f%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637418954 > 3633797 > > > 99%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luM > zIiLCJBTiI > > > 6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=3DVLlzQtS3KWZqQslcJKZYrG > sj6eMk3 > > VWaE%2BXhbNdRx80%3D&reserved=3D0 > > rotection.outlook.com_-3Furl-3Dhttps-253A-252F- > 252Fur&d=3DDwIFAw&c=3DjOURT > > kCZzT8tVB5xPEYIm3YJGoxoTaQsQPzPKJGaWbo&r=3DBJxhacqqa4K1PJGm6_- > 862rdSP13_ > > P6LVp7j_9l1xmg&m=3DMMI_EgCqeOX4EvIftpL7agRxJ- > udp1CLokf2QWuzFgE&s=3DIPZRolk > > y3TYlbWPsOkY37MbDdzwhc1b_LaE6JkaOkOo&e=3D > > > > ldefense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps- > > 3A__lore.kernel.org&a > > > > > > > mp;data=3D04%7C01%7CAlexander.Deucher%40amd.com%7C6d5fa241f963469 > > 2c039 > > > > > > > 08d8904a942c%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C63741 > > 79972 > > > > > > > 72974427%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoi > > V2luMzI > > > > > > > iLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=3DiKTPucGQqcRXET > > QZiQz > > > > j90WdJeCYDytdZHJ1ZiUyR%2FM%3D&reserved=3D0 > > > > _linux-2Diommu_MWHPR10MB1310CDB6829DDCF5EA84A14689150- > > 40MWHPR10MB131 > > > > > > > 0.namprd10.prod.outlook.com_&d=3DDwIDAw&c=3DjOURTkCZzT8tVB5xPEYIm3Y > > JGoxo > > > > TaQsQPzPKJGaWbo&r=3DBJxhacqqa4K1PJGm6_- > > 862rdSP13_P6LVp7j_9l1xmg&m=3DlNXu > > > > > > > 2xwvyxEZ3PzoVmXMBXXS55jsmfDicuQFJqkIOH4&s=3DdsAVVJbD7gJIj3ctZpnnU > > 60y21 > > > > ijWZmZ8xmOK1cO_O0&e=3D > > > > > > > > is that this is a board developed by his company. > > > > > > > > Edgar -- please can you answer Alex's questions? > > > > > > > > Will --_002_MN2PR12MB4488C655936CE25DC0C3EA5EF7FA0MN2PR12MB4488namp_ Content-Type: application/octet-stream; name="0001-PCI-quirks-Add-an-ATS-quirk-for-a-Picasso-APU.patch" Content-Description: 0001-PCI-quirks-Add-an-ATS-quirk-for-a-Picasso-APU.patch Content-Disposition: attachment; filename="0001-PCI-quirks-Add-an-ATS-quirk-for-a-Picasso-APU.patch"; size=1615; creation-date="Wed, 25 Nov 2020 16:06:35 GMT"; modification-date="Wed, 25 Nov 2020 15:59:18 GMT" Content-Transfer-Encoding: base64 RnJvbSA0ZTllODAxNTBkYzRkNzM2YjgzMzEzN2Q1NThlMTI2ZjQ0MTE1OTA1IE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBBbGV4IERldWNoZXIgPGFsZXhhbmRlci5kZXVjaGVyQGFtZC5j b20+CkRhdGU6IFdlZCwgMjUgTm92IDIwMjAgMTA6NTc6MTUgLTA1MDAKU3ViamVjdDogW1BBVENI XSBQQ0k6IHF1aXJrczogQWRkIGFuIEFUUyBxdWlyayBmb3IgYSBQaWNhc3NvIEFQVQoKVGhpcyBp cyB2ZXJ5IHNwZWNpZmljIHRvIGEgcGFydGljdWxhciBwbGF0Zm9ybSwgYmVjYXVzZQpBVFMgaXMg cmVxdWlyZWQgZm9yIEdQVSBjb21wdXRlIGFuZCB0aGlzIGlzIG5vdCBrbm93bgp0byBiZSBhbiBp c3N1ZSBvbiBhbnkgb3RoZXIgUGljYXNzbyBwbGF0Zm9ybXMuCgpTaWduZWQtb2ZmLWJ5OiBBbGV4 IERldWNoZXIgPGFsZXhhbmRlci5kZXVjaGVyQGFtZC5jb20+Ci0tLQogZHJpdmVycy9wY2kvcXVp cmtzLmMgfCAxMyArKysrKysrKysrKysrCiAxIGZpbGUgY2hhbmdlZCwgMTMgaW5zZXJ0aW9ucygr KQoKZGlmZiAtLWdpdCBhL2RyaXZlcnMvcGNpL3F1aXJrcy5jIGIvZHJpdmVycy9wY2kvcXVpcmtz LmMKaW5kZXggZjcwNjkyYWM3OWM1Li5kNmUzODQ1ZDVkMDQgMTAwNjQ0Ci0tLSBhL2RyaXZlcnMv cGNpL3F1aXJrcy5jCisrKyBiL2RyaXZlcnMvcGNpL3F1aXJrcy5jCkBAIC01MTY0LDYgKzUxNjQs MTcgQEAgc3RhdGljIHZvaWQgcXVpcmtfYW1kX2hhcnZlc3Rfbm9fYXRzKHN0cnVjdCBwY2lfZGV2 ICpwZGV2KQogCSAgICAocGRldi0+ZGV2aWNlID09IDB4NzM0MCAmJiBwZGV2LT5yZXZpc2lvbiAh PSAweGM1KSkKIAkJcmV0dXJuOwogCisJaWYgKHBkZXYtPmRldmljZSA9PSAweDE1ZDgpIHsKKwkJ aWYgKHBkZXYtPnJldmlzaW9uID09IDB4Y2YgJiYKKwkJICAgIHBkZXYtPnN1YnN5c3RlbV92ZW5k b3IgPT0gMHhlYTUwICYmCisJCSAgICAocGRldi0+c3Vic3lzdGVtX2RldmljZSA9PSAweDBjMTkg fHwKKwkJICAgICBwZGV2LT5zdWJzeXN0ZW1fZGV2aWNlID09IDB4MGMxMCkpCisJCQlnb3RvIG5v X2F0czsKKwkJZWxzZQorCQkJcmV0dXJuOworCX0KKworbm9fYXRzOgogCXBjaV9pbmZvKHBkZXYs ICJkaXNhYmxpbmcgQVRTXG4iKTsKIAlwZGV2LT5hdHNfY2FwID0gMDsKIH0KQEAgLTUxNzYsNiAr NTE4Nyw4IEBAIERFQ0xBUkVfUENJX0ZJWFVQX0ZJTkFMKFBDSV9WRU5ET1JfSURfQVRJLCAweDY5 MDAsIHF1aXJrX2FtZF9oYXJ2ZXN0X25vX2F0cyk7CiBERUNMQVJFX1BDSV9GSVhVUF9GSU5BTChQ Q0lfVkVORE9SX0lEX0FUSSwgMHg3MzEyLCBxdWlya19hbWRfaGFydmVzdF9ub19hdHMpOwogLyog QU1EIE5hdmkxNCBkR1BVICovCiBERUNMQVJFX1BDSV9GSVhVUF9GSU5BTChQQ0lfVkVORE9SX0lE X0FUSSwgMHg3MzQwLCBxdWlya19hbWRfaGFydmVzdF9ub19hdHMpOworLyogQU1EIFJhdmVuIHBs YXRmb3JtIGlHUFUgKi8KK0RFQ0xBUkVfUENJX0ZJWFVQX0ZJTkFMKFBDSV9WRU5ET1JfSURfQVRJ LCAweDE1ZDgsIHF1aXJrX2FtZF9oYXJ2ZXN0X25vX2F0cyk7CiAjZW5kaWYgLyogQ09ORklHX1BD SV9BVFMgKi8KIAogLyogRnJlZXNjYWxlIFBDSWUgZG9lc24ndCBzdXBwb3J0IE1TSSBpbiBSQyBt b2RlICovCi0tIAoyLjI1LjQKCg== --_002_MN2PR12MB4488C655936CE25DC0C3EA5EF7FA0MN2PR12MB4488namp_--