From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.7 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3CD09C5519F for ; Wed, 18 Nov 2020 09:25:00 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 7F24821D7E for ; Wed, 18 Nov 2020 09:24:59 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 7F24821D7E Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=antioche.eu.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.29643.59218 (Exim 4.92) (envelope-from ) id 1kfJhk-00063D-CE; Wed, 18 Nov 2020 09:24:44 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 29643.59218; Wed, 18 Nov 2020 09:24:44 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kfJhk-000636-8v; Wed, 18 Nov 2020 09:24:44 +0000 Received: by outflank-mailman (input) for mailman id 29643; Wed, 18 Nov 2020 09:24:43 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kfJhj-000630-Bn for xen-devel@lists.xenproject.org; Wed, 18 Nov 2020 09:24:43 +0000 Received: from chassiron.antioche.eu.org (unknown [2001:41d0:fe9d:1101::1]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id b07cff6f-d614-4f7e-b4d9-18b0e88a0c1b; Wed, 18 Nov 2020 09:24:41 +0000 (UTC) Received: from sandettie.soc.lip6.fr (82-64-3-41.subs.proxad.net [82.64.3.41]) by chassiron.antioche.eu.org (8.15.2/8.15.2) with ESMTPS id 0AI9OVwe026567 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=OK); Wed, 18 Nov 2020 10:24:31 +0100 (MET) Received: by sandettie.soc.lip6.fr (Postfix, from userid 373) id E1CAD2E9CA8; Wed, 18 Nov 2020 10:24:25 +0100 (MET) Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kfJhj-000630-Bn for xen-devel@lists.xenproject.org; Wed, 18 Nov 2020 09:24:43 +0000 X-Inumbo-ID: b07cff6f-d614-4f7e-b4d9-18b0e88a0c1b Received: from chassiron.antioche.eu.org (unknown [2001:41d0:fe9d:1101::1]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id b07cff6f-d614-4f7e-b4d9-18b0e88a0c1b; Wed, 18 Nov 2020 09:24:41 +0000 (UTC) Received: from sandettie.soc.lip6.fr (82-64-3-41.subs.proxad.net [82.64.3.41]) by chassiron.antioche.eu.org (8.15.2/8.15.2) with ESMTPS id 0AI9OVwe026567 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=OK); Wed, 18 Nov 2020 10:24:31 +0100 (MET) Received: by sandettie.soc.lip6.fr (Postfix, from userid 373) id E1CAD2E9CA8; Wed, 18 Nov 2020 10:24:25 +0100 (MET) Date: Wed, 18 Nov 2020 10:24:25 +0100 From: Manuel Bouyer To: Roger Pau =?iso-8859-1?Q?Monn=E9?= Cc: xen-devel@lists.xenproject.org Subject: Re: NetBSD dom0 PVH: hardware interrupts stalls Message-ID: <20201118092425.GC1085@antioche.eu.org> References: <20201117150949.GA3791@antioche.eu.org> <20201117155807.a7jgmftnj6njg6oz@Air-de-Roger> <20201117164033.GB3093@antioche.eu.org> <20201118085738.wpnfmjagxjf6cofp@Air-de-Roger> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20201118085738.wpnfmjagxjf6cofp@Air-de-Roger> X-Greylist: Sender succeeded STARTTLS authentication, not delayed by milter-greylist-4.4.3 (chassiron.antioche.eu.org [151.127.5.145]); Wed, 18 Nov 2020 10:24:32 +0100 (MET) On Wed, Nov 18, 2020 at 09:57:38AM +0100, Roger Pau Monné wrote: > On Tue, Nov 17, 2020 at 05:40:33PM +0100, Manuel Bouyer wrote: > > On Tue, Nov 17, 2020 at 04:58:07PM +0100, Roger Pau Monné wrote: > > > [...] > > > > > > I have attached a patch below that will dump the vIO-APIC info as part > > > of the 'i' debug key output, can you paste the whole output of the 'i' > > > debug key when the system stalls? > > > > see attached file. Note that the kernel did unstall while 'i' output was > > being printed, so it is mixed with some NetBSD kernel output. > > The idt entry of the 'ioapic2 pin2' interrupt is 103 on CPU 0. > > > > I also put the whole sequence at > > http://www-soc.lip6.fr/~bouyer/xen-log3.txt > > On one of the instances the pin shows up as masked, but I'm not sure > if that's relevant since later it shows up as unmasked. Might just be > part of how NetBSD handles such interrupts. Yes, NetBSD can mask an interrupt source if the interrupts needs to be delayed. It will be unmasked once the interrupt has been handled. Would it be possible that Xen misses an unmask write, or fails to call the vector if the interrupt is again pending at the time of the unmask ? > [...] > On a maybe unrelated question, how do you setup the event channel > callback, is it using HVM_PARAM_CALLBACK_IRQ and > HVM_PARAM_CALLBACK_TYPE_VECTOR? Yes, the code is at https://github.com/NetBSD/src/blob/f9a54eaecfb47bce597f72f6cae8861f4d486eb4/sys/arch/xen/xen/hypervisor.c#L457 > > Are you EOI'ing such vector on the local APIC when servicing the > interrupt? I think it's OK. the code is at https://github.com/NetBSD/src/blob/f9a54eaecfb47bce597f72f6cae8861f4d486eb4/sys/arch/amd64/amd64/vector.S#L770 -- Manuel Bouyer NetBSD: 26 ans d'experience feront toujours la difference --