From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D4EA6C433DB for ; Wed, 31 Mar 2021 09:50:33 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 2867F61962 for ; Wed, 31 Mar 2021 09:50:33 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 2867F61962 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:51910 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lRXUd-0007SO-Si for qemu-devel@archiver.kernel.org; Wed, 31 Mar 2021 05:50:31 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:50872) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lRXTf-0006xw-Cy for qemu-devel@nongnu.org; Wed, 31 Mar 2021 05:49:31 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:25875) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lRXTZ-0008E9-06 for qemu-devel@nongnu.org; Wed, 31 Mar 2021 05:49:31 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1617184163; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KM6axZvf8aMfqdXREeVh6kApwGC8vB7+oUiRpBmWULM=; b=ezcoiDRPn/8wEHxZsU6GISLl9suM5JUeWnp8J8x58zPNdmkOvDPoK0jK4M66PbNOl7rcD2 O+ECZ/vOvfnLWW2ADSvPFYSYkOL1uz7OmdDl6reBteQ+tFbJkmk1Hq7iOF5GT4vcF+kQBS Xk6nniXfKX2jJiGajgh4IxZuy4DE3lM= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-265-JmmA9uZcMbaDlP4NFcj_AQ-1; Wed, 31 Mar 2021 05:49:21 -0400 X-MC-Unique: JmmA9uZcMbaDlP4NFcj_AQ-1 Received: from smtp.corp.redhat.com (int-mx05.intmail.prod.int.phx2.redhat.com [10.5.11.15]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 054898030D0; Wed, 31 Mar 2021 09:49:20 +0000 (UTC) Received: from localhost (unknown [10.40.208.53]) by smtp.corp.redhat.com (Postfix) with ESMTP id 738C06A902; Wed, 31 Mar 2021 09:49:16 +0000 (UTC) Date: Wed, 31 Mar 2021 11:49:14 +0200 From: Igor Mammedov To: David Gibson Subject: Re: [PATCH 0/4] DEVICE_NOT_DELETED/DEVICE_UNPLUG_ERROR QAPI events Message-ID: <20210331114914.50950465@redhat.com> In-Reply-To: References: <20210312200740.815014-1-danielhb413@gmail.com> <20210330012831.2ce0514c@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.15 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=imammedo@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Received-SPF: pass client-ip=216.205.24.124; envelope-from=imammedo@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "Daniel P. =?UTF-8?B?QmVycmFuZ8Op?=" , qemu-devel@nongnu.org, Daniel Henrique Barboza , groug@kaod.org, armbru@redhat.com, qemu-ppc@nongnu.org Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On Wed, 31 Mar 2021 10:46:49 +1100 David Gibson wrote: > On Tue, Mar 30, 2021 at 01:28:31AM +0200, Igor Mammedov wrote: > > On Wed, 24 Mar 2021 16:09:59 -0300 > > Daniel Henrique Barboza wrote: > > > > > On 3/23/21 10:40 PM, David Gibson wrote: > > > > On Tue, Mar 23, 2021 at 02:10:22PM -0300, Daniel Henrique Barboza wrote: > > > >> > > > >> > > > >> On 3/22/21 10:12 PM, David Gibson wrote: > > > >>> On Fri, Mar 12, 2021 at 05:07:36PM -0300, Daniel Henrique Barboza wrote: > > > >>>> Hi, > > > >>>> > > > >>>> This series adds 2 new QAPI events, DEVICE_NOT_DELETED and > > > >>>> DEVICE_UNPLUG_ERROR. They were (and are still being) discussed in [1]. > > > >>>> > > > >>>> Patches 1 and 3 are independent of the ppc patches and can be applied > > > >>>> separately. Patches 2 and 4 are based on David's ppc-for-6.0 branch and > > > >>>> are dependent on the QAPI patches. > > > >>> > > > >>> Implementation looks fine, but I think there's a bit more to discuss > > > >>> before we can apply. > > > >>> > > > >>> I think it would make sense to re-order this and put UNPLUG_ERROR > > > >>> first. Its semantics are clearer, and I think there's a stronger case > > > >>> for it. > > > >> > > > >> Alright > > > >> > > > >>> > > > >>> I'm a bit less sold on DEVICE_NOT_DELETED, after consideration. Does > > > >>> it really tell the user/management anything useful beyond what > > > >>> receiving neither a DEVICE_DELETED nor a DEVICE_UNPLUG_ERROR does? > > > >> > > > >> > > > >> It informs that the hotunplug operation exceed the timeout that QEMU > > > >> internals considers adequate, but QEMU can't assert that it was caused > > > >> by an error or an unexpected delay. The end result is that the device > > > >> is not going to be deleted from QMP, so DEVICE_NOT_DELETED. > > > > > > > > Is it, though? I mean, it is with this implementation for papr: > > > > because we clear the unplug_requested flag, even if the guest later > > > > tries to complete the unplug, it will fail. > > > > > > > > But if I understand what Markus was saying correctly, that might not > > > > be possible for all hotplug systems. I believe Markus was suggesting > > > > that DEVICE_NOT_DELETED could just mean that we haven't deleted the > > > > device yet, but it could still happen later. > > > > > > > > And in that case, I'm not yet sold on the value of a message that > > > > essentially just means "Ayup, still dunno what's happening, sorry". > > > > > > > >> Perhaps we should just be straightforward and create a DEVICE_UNPLUG_TIMEOUT > > > >> event. > > > > > > > > Hm... what if we added a "reason" field to UNPLUG_ERROR. That could > > > > be "guest rejected hotplug", or something more specific, in the rare > > > > case that the guest has a way of signalling something more specific, > > > > or "timeout" - but the later *only* to be sent in cases where on the > > > > timeout we're able to block any later completion of the unplug (as we > > > > can on papr). > > > > Is canceling unplug on timeout documented somewhere (like some spec)? > > Uh.. not as such. In the PAPR model, hotplugs and unplugs are mostly > guest directed, so the question doesn't really arise. > > > If not it might (theoretically) confuse guest when it tries to unplug > > after timeout and leave guest in some unexpected state. > > Possible, but probably not that likely. The mechanism we use to > "cancel" the hotplugs is that we just fail the hypercalls that the > guest will need to call to actually complete the hotplug. We also > fail those in some other situations, and that seems to work. > > That said, I no longer think this cancelling on timeout is a good > idea, since it mismatches what happens on other platforms more than I > think we need to. > > My now preferred approach is to revert the timeout changes, but > instead allow retries of unplugs to be issued. I think that's just a > matter of resending the unplug message to the guest, while making it > otherwise a no-op on the qemu side. Yep, all we need to do is notify QEMU user, so it knows that unplug has failed. Then It can decide on it's own what to do with it and also when. > > > I believe that's already covered by the existing API: > > > > > > > > > +# @DEVICE_UNPLUG_ERROR: > > > +# > > > +# Emitted when a device hot unplug error occurs. > > > +# > > > +# @device: device name > > > +# > > > +# @msg: Informative message > > > > > > The 'informative message' would be the reason the event occurred. In patch > > > 4/4, for the memory hotunplug refused by the guest, it is being set as: > > > > > > qapi_error = g_strdup_printf("Memory hotunplug rejected by the guest " > > > "for device %s", dev->id); > > > qapi_event_send_device_unplug_error(dev->id, qapi_error); > > > > > > > > > > > > We could use the same DEVICE_UNPLUG_ERROR event in the CPU hotunplug timeout > > > case (currently on patch 2/4) by just changing 'msg', e.g.: > > > > > > > > > qapi_error = g_strdup_printf("CPU hotunplug timeout for device %s", dev->id); > > > qapi_event_send_device_unplug_error(dev->id, qapi_error); > > > > > > > lets make everything support ACPI (just kidding). > > Heh. If nothing else, doesn't help us with existing guests. > > > maybe we can reuse already existing ACPI_DEVICE_OST instead of DEVICE_UNPLUG_ERROR > > which sort of does the same thing (and more) but instead of strings uses status codes > > defined by spec. > > Hmm. I'm a bit dubious about issuing ACPI messages for a non ACPI > guest, but maybe that could work. May be we can rename it to be ACPI agnostic (though I'm not sure how renaming QAPI interfaces should be done (it might upset libvirt for example)). (My point was that ACPI spec had already gone through all the trouble defining status of completion and documenting it. Also libvirt supports this notification. It looks like worthwhile thing to consider if can somehow reuse it outside of x86 world) > > Idea similar to DEVICE_UNPLUG_ERROR was considered back then, but instead of QEMU being > > a poor translator of status codes to non machine-readable strings we went with > > exposing well documented status codes to user. This way user can implement > > specific reactions to particular errors just looking at JSON + spec. > > > > > Thanks, > > > > > > DHB > > > > > > > > > > > > > > Thoughs, Markus? > > > > > > > > > >