From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.2 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 72EBBC3A59F for ; Thu, 29 Aug 2019 13:13:44 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 48638215EA for ; Thu, 29 Aug 2019 13:13:44 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 48638215EA Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:49828 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1i3KFD-0003so-BU for qemu-devel@archiver.kernel.org; Thu, 29 Aug 2019 09:13:43 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:50874) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1i3KEA-0002tY-4j for qemu-devel@nongnu.org; Thu, 29 Aug 2019 09:12:39 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1i3KE7-0004bH-Og for qemu-devel@nongnu.org; Thu, 29 Aug 2019 09:12:37 -0400 Received: from mx1.redhat.com ([209.132.183.28]:57732) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1i3KE7-0004aV-Fm; Thu, 29 Aug 2019 09:12:35 -0400 Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id A9F0B308FB9A; Thu, 29 Aug 2019 13:12:33 +0000 (UTC) Received: from angien.pipo.sk (unknown [10.43.2.229]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 0E63F60C44; Thu, 29 Aug 2019 13:12:27 +0000 (UTC) Date: Thu, 29 Aug 2019 15:12:25 +0200 From: Peter Krempa To: Igor Mammedov Message-ID: <20190829131225.GJ13714@angien.pipo.sk> References: <20190816170750.23910-1-ehabkost@redhat.com> <871rx5eq8j.fsf@dusky.pond.sub.org> <20190828143524.GA7642@habkost.net> <20190828185718.0e4eced8@redhat.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="RVlUGXxwBj5SDcM9" Content-Disposition: inline In-Reply-To: <20190828185718.0e4eced8@redhat.com> X-PGP-Key-ID: 0xD018682B X-PGP-Key-Fingerprint: D294 FF38 A6A2 BF40 6C75 5DEF 36EC 16AC D018 682B User-Agent: Mutt/1.12.1 (2019-06-15) X-Scanned-By: MIMEDefang 2.79 on 10.5.11.12 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.43]); Thu, 29 Aug 2019 13:12:33 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.132.183.28 Subject: Re: [Qemu-devel] [PATCH v2] pc: Don't make die-id mandatory unless necessary X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Cornelia Huck , Vanderson Martins do Rosario , Eduardo Habkost , Like Xu , Erik Skultety , qemu-stable@nongnu.org, "Michael S. Tsirkin" , qemu-devel@nongnu.org, Markus Armbruster , qemu-s390x@nongnu.org, qemu-ppc@nongnu.org, Paolo Bonzini , David Gibson , Richard Henderson Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" --RVlUGXxwBj5SDcM9 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Aug 28, 2019 at 18:57:18 +0200, Igor Mammedov wrote: > On Wed, 28 Aug 2019 11:35:24 -0300 > Eduardo Habkost wrote: >=20 > > On Wed, Aug 28, 2019 at 08:52:28AM +0200, Markus Armbruster wrote: > > > Eduardo Habkost writes: > > > =20 > > > > We have this issue reported when using libvirt to hotplug CPUs: > > > > https://bugzilla.redhat.com/show_bug.cgi?id=3D1741451 > > > > > > > > Basically, libvirt is not copying die-id from > > > > query-hotpluggable-cpus, but die-id is now mandatory. > > > > > > > > We could blame libvirt and say it is not following the documented > > > > interface, because we have this buried in the QAPI schema > > > > documentation: > > > > =20 > > > >> Note: currently there are 5 properties that could be present > > > >> but management should be prepared to pass through other > > > >> properties with device_add command to allow for future > > > >> interface extension. This also requires the filed names to be kept= in > > > >> sync with the properties passed to -device/device_add. =20 > > > > > > > > But I don't think this would be reasonable from us. We can just > > > > make QEMU more flexible and let die-id to be omitted when there's > > > > no ambiguity. This will allow us to keep compatibility with > > > > existing libvirt versions. > > > > > > > > Test case included to ensure we don't break this again. > > > > > > > > Fixes: commit 176d2cda0dee ("i386/cpu: Consolidate die-id validity = in smp context") > > > > Signed-off-by: Eduardo Habkost > > > > --- > > > > Changes v1 -> v2: > > > > * v1 was "pc: Don't make CPU properties mandatory unless necessary" > > > > * Make only die-id optional (Igor Mammedov) > > > > --- > > > > hw/i386/pc.c | 8 ++++++ > > > > tests/acceptance/pc_cpu_hotplug_props.py | 35 ++++++++++++++++++++= ++++ > > > > 2 files changed, 43 insertions(+) > > > > create mode 100644 tests/acceptance/pc_cpu_hotplug_props.py > > > > > > > > diff --git a/hw/i386/pc.c b/hw/i386/pc.c > > > > index 3ab4bcb3ca..9c3f6ae828 100644 > > > > --- a/hw/i386/pc.c > > > > +++ b/hw/i386/pc.c > > > > @@ -2406,6 +2406,14 @@ static void pc_cpu_pre_plug(HotplugHandler *= hotplug_dev, > > > > int max_socket =3D (ms->smp.max_cpus - 1) / > > > > smp_threads / smp_cores / pcms->sm= p_dies; > > > > =20 > > > > + /* > > > > + * die-id was optional in QEMU 4.0 and older, so keep it o= ptional > > > > + * if there's only one die per socket. > > > > + */ =20 > > >=20 > > > Is this comment worth its keep? =20 > >=20 > > It's not obvious from the code why die-id is optional and all the > > other properties are not. The purpose of the comment is to > > clarify that. > >=20 > > > =20 > > > > + if (cpu->die_id < 0 && pcms->smp_dies =3D=3D 1) { > > > > + cpu->die_id =3D 0; > > > > + } > > > > + > > > > if (cpu->socket_id < 0) { > > > > error_setg(errp, "CPU socket-id is not set"); > > > > return; > > > > diff --git a/tests/acceptance/pc_cpu_hotplug_props.py b/tests/accep= tance/pc_cpu_hotplug_props.py > > > > new file mode 100644 > > > > index 0000000000..08b7e632c6 > > > > --- /dev/null > > > > +++ b/tests/acceptance/pc_cpu_hotplug_props.py > > > > @@ -0,0 +1,35 @@ > > > > +# > > > > +# Ensure CPU die-id can be omitted on -device > > > > +# > > > > +# Copyright (c) 2019 Red Hat Inc > > > > +# > > > > +# Author: > > > > +# Eduardo Habkost > > > > +# > > > > +# This library is free software; you can redistribute it and/or > > > > +# modify it under the terms of the GNU Lesser General Public > > > > +# License as published by the Free Software Foundation; either > > > > +# version 2 of the License, or (at your option) any later version. > > > > +# > > > > +# This library is distributed in the hope that it will be useful, > > > > +# but WITHOUT ANY WARRANTY; without even the implied warranty of > > > > +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU > > > > +# Lesser General Public License for more details. > > > > +# > > > > +# You should have received a copy of the GNU Lesser General Public > > > > +# License along with this library; if not, see . > > > > +# > > > > + > > > > +from avocado_qemu import Test > > > > + > > > > +class OmittedCPUProps(Test): > > > > + """ > > > > + :avocado: tags=3Darch:x86_64 > > > > + """ > > > > + def test_no_die_id(self): > > > > + self.vm.add_args('-nodefaults', '-S') > > > > + self.vm.add_args('-smp', '1,sockets=3D2,cores=3D2,threads= =3D2,maxcpus=3D8') > > > > + self.vm.add_args('-cpu', 'qemu64') > > > > + self.vm.add_args('-device', 'qemu64-x86_64-cpu,socket-id= =3D1,core-id=3D0,thread-id=3D0') > > > > + self.vm.launch() > > > > + self.assertEquals(len(self.vm.command('query-cpus')), 2) = =20 >=20 > test_plug_with_device_add_x86() is supposed to test device_add (currently= broken), > so do we really need more heavy avocado tests, > how about adding this test to tests/cpu-plug-test.c > ('make check' is used much more often by developers) >=20 > > > This tests intentionally violates the "a CPU hot-plug with -device mu= st > > > specify all the properties returned by query-hotpluggable-cpus" rule > > > laid down in qapi/machine.json, and the change to pc.c permits it. > > >=20 > > > Missing: a suitable update to the rule. =20 > >=20 > > Intentional, because I don't want decisions about documentation > > to block the regression fix from being merged. > >=20 > > >=20 > > > In addition, I'd like us to either work on making the rule stick in t= he > > > future (see my reply to Igor for an idea), or ditch the rule. But > > > that's outside the scope of this regression fix. =20 > >=20 > > I'd prefer to ditch the rule, or at least change it to be a > > suggestion instead of a requirement. > Perhaps someone reads docs and uses API as designed (libvirt is not the o= nly user) >=20 > I'd prefer to allow implicit die-id in 4.1 and 'stable' as that > ship has already sailed and make it mandatory since 4.2 as it is > supposed to be (+opening bug on libvirt - hoping that API would > be fixed properly this time). >=20 >=20 > Another related to die-id series bug: > We should hide die-id from query-hotpluggable-cpus output > for 4.0 and older machine types as well, so it won't break > migration for users that implement interface as documented > as it won't be possible to start > old-qemu-4.0 -device cpufoo,die-id=3D0,... > since that "-device cpufoo,die-id=3D0,..." were used on new-qemu source. >=20 > PS: > Adding affected targets maintainers to the loop to see if > we can drop restriction. >=20 > Even though it works fine for die-id and I don't see immediate problems > with relaxing rule, I reluctant to do it, since instead of simple > "add all properties you were told to" > implicit rules would evolve into mess similar to smp_parse() over time. >=20 > Also if we would need to change implicit values logic down the road > it would be a pain like with any default parameters in QEMU, which is > a good reason against relaxing rule. Hi, after a discussion with Igor I'm preparing patches which take the 'props' verbatim and use it for hotplug. It's a fairly simple change in libvirt. Originally I've opted to reconstruct the props from internal data since it was simpler as the values were already parsed into internal structures anyways. With some persuation we could even get it into libvirt during the freeze so that with new libvirt the released stuff will not break any more. --RVlUGXxwBj5SDcM9 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEUn7DGLvflazX+2GwHGwCByjY1GoFAl1nzzYACgkQHGwCByjY 1GotMA//XHHr90tFiTanzSHw+W8TFeR9LnXXWY2Mk20c9kDR0QjBPYFsfvdHwM1A /3M9CUYCl/kK26NK0Ycc2TWjRq0B/XW7IR/HxjXyACgXXCqIn7UdAQPjrKwrzA62 lpNLlnX+YHVEsLwC2zMgubS7/tEMr9Y9rCgau3KPiH48WkwEjRvogEhz+zkUdy8d MzkE2X2MPi1v2DlwQmOaE1waKrVgXYVBFL7nqFqN0QEFVdH+5qGpOc6Pza8rCYlj 4cXC69C/0vwwV8tKYIo+yBTn7Qp8DE/3FZTrmdaDHP1LiUyyuEsCd516uXl6/Tim /3UAwU/OsxC5jOOfdQB83M4tTkXucInA5e8p8v9ZIDqA8SFkvKR6lBbTYiZbsQ/V O3ZPRxUcrBYCjxwnNcW1zMyB8e8WZU1uANitrRC24xrS0wIosLHUP0WOVRJ5NrFf +OUrW+a3T3U6wD+/f8aBqhzOtq0UzHv2BhWIGwaP2jrnG4IgMQdZsVDBydIBpNu9 MgL8qX3rbuxsDSMkYOrQWIw5RkIbwhm5/LNt8F4jg4rtfInoBMJAMVgXMJqyf+Q2 PDTUBvaaJ1/ZuKeyTYWTxjoL4Is4l4bLMfgM5EoUitckzpudDqmpJqGgZNkTuPDs c+sYnZyRMVZA8pbNtG0A+agg61V4lZbk7ncmKmIPv1w/4Mm+wOM= =l4nM -----END PGP SIGNATURE----- --RVlUGXxwBj5SDcM9--