From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id B4F21C433EF for ; Fri, 25 Feb 2022 00:16:40 +0000 (UTC) Received: from list by lists.xenproject.org with outflank-mailman.278687.476036 (Exim 4.92) (envelope-from ) id 1nNOHN-0004gW-Je; Fri, 25 Feb 2022 00:16:13 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 278687.476036; Fri, 25 Feb 2022 00:16:13 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1nNOHN-0004gP-F3; Fri, 25 Feb 2022 00:16:13 +0000 Received: by outflank-mailman (input) for mailman id 278687; Fri, 25 Feb 2022 00:16:11 +0000 Received: from se1-gles-sth1-in.inumbo.com ([159.253.27.254] helo=se1-gles-sth1.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1nNOHL-0004gJ-OO for xen-devel@lists.xen.org; Fri, 25 Feb 2022 00:16:11 +0000 Received: from wind.enjellic.com (wind.enjellic.com [76.10.64.91]) by se1-gles-sth1.inumbo.com (Halon) with ESMTP id 1ec6ffc0-95d0-11ec-8eb8-a37418f5ba1a; Fri, 25 Feb 2022 01:16:05 +0100 (CET) Received: from wind.enjellic.com (localhost [127.0.0.1]) by wind.enjellic.com (8.15.2/8.15.2) with ESMTP id 21P0G3Lt005995; Thu, 24 Feb 2022 18:16:03 -0600 Received: (from greg@localhost) by wind.enjellic.com (8.15.2/8.15.2/Submit) id 21P0G2Hk005994; Thu, 24 Feb 2022 18:16:02 -0600 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: 1ec6ffc0-95d0-11ec-8eb8-a37418f5ba1a Date: Thu, 24 Feb 2022 18:16:02 -0600 From: "Dr. Greg" To: Jan Beulich Cc: xen-devel@lists.xen.org Subject: Re: IGD pass-through failures since 4.10. Message-ID: <20220225001602.GB5755@wind.enjellic.com> Reply-To: "Dr. Greg" References: <20220214060011.GA24404@wind.enjellic.com> <198ef291-4dee-ddac-aef6-8451bc1e880c@suse.com> <20220217201534.GA29303@wind.enjellic.com> <20220222185230.GA15532@wind.enjellic.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4i X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.3 (wind.enjellic.com [127.0.0.1]); Thu, 24 Feb 2022 18:16:03 -0600 (CST) On Wed, Feb 23, 2022 at 09:59:48AM +0100, Jan Beulich wrote: Hi, I hope the end of the week is going well for everyone. > On 22.02.2022 19:52, Dr. Greg wrote: > > On Fri, Feb 18, 2022 at 08:04:14AM +0100, Jan Beulich wrote: > >> On 17.02.2022 21:15, Dr. Greg wrote: > >>> On Mon, Feb 14, 2022 at 09:56:34AM +0100, Jan Beulich wrote: > >>> In the case of the logs above, the following command sequence is being > >>> executed upon termination of the domain: > >>> > >>> # Unbind devices. > >>> echo 0000:00:14.0 >| /sys/bus/pci/drivers/pciback/unbind > >>> echo 0000:00:02.0 >| /sys/bus/pci/drivers/pciback/unbind > >>> > >>> # Rebind devices. > >>> echo 0000:00:14.0 >| /sys/bus/pci/drivers/xhci_hcd/bind > >>> echo 0000:00:02.0 >| /sys/bus/pci/drivers/i915/bind > > > >> ... you may still want to try replacing these with > >> "xl pci-assignable-add ..." / "xl pci-assignable-remove ...". > > > > We tested using the 'xl pci-assignable-add/remove' sequences and we > > believe this may have resulted in the proper return of the devices to > > dom0 but haven't been able to verify that since the Windows VM is now > > throwing the VIDEO_TDR error. > > > > Unless we are misunderstanding something the 'xl > > pci-assignable-remove' sequence requires the manual re-binding of the > > devices to their dom0 drivers. > Hmm, I thought drivers would be rebound, but I'm not a tool stack > person. Looking at libxl__device_pci_assignable_remove() at least > support this assumption of mine. You did use the command's -r > option, didn't you? No we weren't and I now see the -r option. We have already re-worked our setup scripts to use pci-assignable-add and will verify the -r option works as advertised, thanks for the tip. We had our lab machine broken for a couple of days where it wouldn't start an IGD pass-through session in any way shape or form. We got that sorted out and will now go back to 4.15.2 and verify what works and doesn't work and report back. > Jan Have a good weekend. As always, Dr. G.W. Wettstein, Ph.D. Enjellic Systems Development, LLC. 4206 N. 19th Ave. Specializing in information infra-structure Fargo, ND 58102 development. PH: 701-281-1686 EMAIL: greg@enjellic.com ------------------------------------------------------------------------------ "On the other hand, the Linux philosophy is 'laugh in the face of danger'. Oops. Wrong one. 'Do it yourself'. Thats it." -- Linus Torvalds