From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id D5398C433F5 for ; Fri, 6 May 2022 20:12:19 +0000 (UTC) Received: from mail-yb1-f177.google.com (mail-yb1-f177.google.com [209.85.219.177]) by mx.groups.io with SMTP id smtpd.web12.2743.1651867930469274676 for ; Fri, 06 May 2022 13:12:10 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20210112 header.b=VYXYahIR; spf=pass (domain: gmail.com, ip: 209.85.219.177, mailfrom: bruce.ashfield@gmail.com) Received: by mail-yb1-f177.google.com with SMTP id v59so14694808ybi.12 for ; Fri, 06 May 2022 13:12:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=HxdhGyZc0Ts7GATp+TnpytGltTlZb7UyTHFlmV+NG/g=; b=VYXYahIRqltnnCNoSQ+6Y4Tnwv1t3jO3gNJUrmzNxy3/V4Z2+xTOqMRp2GmGHEvWCp nSOLrqZ21X8vYT9scUnWMNfSxwFqHs8xWAbs+j+Ep7mHzdbjawdGtBPJxGNRXOhOapr/ uhiXQzTW+9jvEAXFU8WYieumqCCx//uJ0tGkrOhVUQQukd8lnDmyN+j2FSSgn4VfZb/S 2Ohh8TJT3diWFy4CqwqlLQ4BWEC3yjuy5UWBLEg78UxH57A8gSqktOBuNPZqFJfqZ6YR WGIA5MCyN1iX8SdaXACp3ePo+Lbo9SOKONNHvnPgEtm/u4wFUIoxrAj2Rnnnoauj9sPj 0m2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=HxdhGyZc0Ts7GATp+TnpytGltTlZb7UyTHFlmV+NG/g=; b=m9glyk5fsVvF0nA1LCgKIaZ+sBT91AAvCx+Uw4Lci3tjG5ZvqGYRBP+XmMonPFarll RdllU05nje+ekMBx86/FiIp/lPfOSfmnBebvQ8VO25oAYfkRPK2DSU0rAfhtSiRC50et KB6BSj3bzRsBPEit5/sXbhKDziRHSxASHreM9DMOXkQqShQRgKNntviTkaAyC+OGVoAl 1wuDqtTBg3od1GCCI4ZS5VhJNL+5oKEG5Vqcs6I9veMpsuRsJRZ+DzpF2DoxleCv5OkY WGvDlxKPuqTkClwySG7y7q4W/yFounVYGDb6qT9RL+IfaIilEu09AFp21Y+arfH+HvSJ fEfQ== X-Gm-Message-State: AOAM532KC707vlxLeXK1PaLwp7Gdvdp4z7maqP6e/VNuyvfqOqghCkxl j0esUBhHUXBEosd+qsHYMXjKF0lC8jWEf+WdtK4= X-Google-Smtp-Source: ABdhPJxe39SlBEM8ygwuRm3RpoyFrnRg0iBec/jdc1H1dY8efTVNQT1eqEjRh0spLaFt+EEUVN+qYWWUd6XszieQXnY= X-Received: by 2002:a25:3795:0:b0:648:fa25:5268 with SMTP id e143-20020a253795000000b00648fa255268mr4095435yba.153.1651867929520; Fri, 06 May 2022 13:12:09 -0700 (PDT) MIME-Version: 1.0 References: <20220428000609.26814-1-christopher.w.clark@gmail.com> <20220428000609.26814-2-christopher.w.clark@gmail.com> <4B991E23-6D0F-46B7-BDD9-5A94662FA0F2@arm.com> <16EC90D8EC771C3B.14104@lists.yoctoproject.org> In-Reply-To: <16EC90D8EC771C3B.14104@lists.yoctoproject.org> From: Bruce Ashfield Date: Fri, 6 May 2022 16:11:58 -0400 Message-ID: Subject: Re: [meta-virtualization][PATCH v2 1/3] xen, xen-tools: add recommendation for Qemu for non-hvm x86 To: Bruce Ashfield Cc: Bertrand Marquis , "christopher.w.clark@gmail.com" , "meta-virtualization@lists.yoctoproject.org" , "cardoe@cardoe.com" , "dpsmith@apertussolutions.com" , "scott.davis@starlab.io" , Diego Sueiro , "jdmason@kudzu.us" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 06 May 2022 20:12:19 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/meta-virtualization/message/7253 On Fri, May 6, 2022 at 12:27 PM Bruce Ashfield via lists.yoctoproject.org wrote: > > On Fri, May 6, 2022 at 11:08 AM Bertrand Marquis > wrote: > > > > > > > > > On 6 May 2022, at 14:39, Bruce Ashfield wr= ote: > > > > > > On Fri, May 6, 2022 at 9:04 AM Bertrand Marquis > > > wrote: > > >> > > >> Hi Bruce, > > >> > > >>> On 5 May 2022, at 15:44, Bruce Ashfield = wrote: > > >>> > > >>> On Fri, Apr 29, 2022 at 9:40 AM Bertrand Marquis > > >>> wrote: > > >>>> > > >>>> Hi Bruce, > > >>>> > > >>>>> On 29 Apr 2022, at 14:30, Bruce Ashfield wrote: > > >>>>> > > >>>>> On Fri, Apr 29, 2022 at 9:23 AM Bertrand Marquis > > >>>>> wrote: > > >>>>>> > > >>>>>> Hi Christopher, > > >>>>>> > > >>>>>>> On 28 Apr 2022, at 01:06, Christopher Clark via lists.yoctoproj= ect.org wrote: > > >>>>>>> > > >>>>>>> The Spectre and Meltdown mitigations for Xen run PV guests with= in > > >>>>>>> HVM virtual machines, so Qemu is no longer only needed for syst= ems > > >>>>>>> configured to run HVM guests. > > >>>>>>> > > >>>>>>> With the split xen hypervisor and tools recipes, the bios depen= dencies > > >>>>>>> belong in the tools recipe, so move them and replace the hvm > > >>>>>>> PACKAGECONFIG option with the recommendation based on target ar= ch. > > >>>>>>> > > >>>>>>> Signed-off-by: Christopher Clark > > >>>>>> Reviewed-by: Bertrand Marquis > > >>>>>> > > >>>>>> I can build and run on x86 qemu and I get stuck during init in D= om0 (which is apparently already known). > > >>>>>> > > >>>>> > > >>>>> It is likely the xencommond init.d still causing issues. > > >>>>> > > >>>>> I'm doing a revert of all those changes locally, and will start s= ome tests. > > >>>> > > >>>> Please let me know if you need some testing. > > >>>> On my side, I have the issue on arm64, arm32 and x86 at the moment= . > > >>> > > >>> I'm still able to build and boot here, so I haven't reproduced the > > >>> issue .. so I'm still hesitating to revert all the xencommons chang= es, > > >>> as I can't prove to myself they are the issue. > > >>> > > >>> I created a kirkstone branch today, and I'll be adding the latest X= en > > >>> patches to it, but I need to get a handle on what everyone is seein= g > > >>> for failures. > > >>> > > >>> I assume you are still seeing problems with the boot on all the > > >>> platforms you mentioned above ? > > >> > > >> Here is the linux logs for dom0 on my system: > > >> [ 7.854317] EXT4-fs (vda): re-mounted. Opts: (null). Quota mode: dis= abled. > > >> Configuring packages on first boot.... > > >> (This may take several minutes. Please do not power off the machine.= ) > > >> Running postinst /etc/rpm-postinsts/100-sysvinit-inittab... > > >> update-rc.d: /etc/init.d/run-postinsts exists during rc.d purge (con= tinuing) > > >> Removing any system startup links for run-postinsts ... > > >> /etc/rcS.d/S99run-postinsts > > >> INIT: Entering runlevel: 5 > > >> Configuring network interfaces... udhcpc: started, v1.35.0 > > >> udhcpc: broadcasting discover > > >> udhcpc: broadcasting discover > > >> udhcpc: broadcasting discover > > >> udhcpc: no lease, failing > > >> ifup: failed to bring up eth0 > > >> Starting random number generator daemon. > > >> Starting OpenBSD Secure Shell server: sshd > > >> generating ssh RSA host key... > > >> sync: ignoring all arguments > > >> sync: ignoring all arguments > > >> generating ssh ECDSA host key... > > >> sync: ignoring all arguments > > >> sync: ignoring all arguments > > >> generating ssh ED25519 host key... > > >> sync: ignoring all arguments > > >> sync: ignoring all arguments > > >> done. > > >> Starting syslogd/klogd: done > > >> Starting domain watchdog daemon: xenwatchdogd startup > > >> > > >> > > >> And it stays stuck there. > > >> > > >> This is arm64 but I have the same on x86 with almost the same logs. > > >> > > >> If you want me to test something in particular to check if it solves= the issue, just tell me what. > > >> I do not have much time to investigate right now but I will try to d= ig a bit from middle of next week so please keep me in touch. > > >> > > > > > > Thanks for the data point .. it is very helpful! > > > > > > Would it be possible to get a log of the image you built, and how you > > > launched it ? I'm assuming it is standard, but i'm looking for > > > anything that might show how I'm doing something differently! > > > > For the easy parts: > > - config: MACHINE=3Dqemuarm64, DISTRO_FEATURES =3D " virtualization xen= " > > - build Xen-image-minimal > > - launch: runqemu serialstdio nographic > > > > I am using current xen staging with a modified xen recipe but I just tr= ied with stable 4.16 and I have exactly the same. > > > > Here is my build config: > > Build Configuration: > > BB_VERSION =3D "2.0.0" > > BUILD_SYS =3D "x86_64-linux" > > NATIVELSBSTRING =3D "universal" > > TARGET_SYS =3D "aarch64-poky-linux" > > MACHINE =3D "qemuarm64" > > DISTRO =3D "poky" > > DISTRO_VERSION =3D "4.0" > > TUNE_FEATURES =3D "aarch64 armv8a crc cortexa57" > > TARGET_FPU =3D "" > > meta > > meta-poky > > meta-yocto-bsp =3D "stable:d53ac6e9561d782818d5491b7c4066f4a712d3= 58" > > meta-oe > > meta-python > > meta-filesystems > > meta-networking =3D "stable:bb2b5b31a80eb164e47649036878773614e4db= df" > > meta-virtualization =3D "stable:ea91e97711e3ceda4f4eab9db0d393568ee8bb= 46" > > meta-arm-toolchain > > meta-arm > > meta-arm-bsp =3D "stable:50b34c5cc9496441152ad28bf1022e5fc5ab0a= 7e" > > > > For the build log could you be a bit more specific as there are a lot o= f logs. > > > > I'm ok without the build logs, what you have above lets me get close. > > My main development box uses systemd as the init system for the > distro, are you using poky + sysvinit ? > > Poky (Yocto Project Reference Distro) > 4.1+snapshot-5f85f75ecf1d5ea48975a04436bce947fd2bb41f qemux86-64 hvc0 > qemux86-64 login: root > root@qemux86-64:~# uname -a > Linux qemux86-64 5.15.37-yocto-standard #1 SMP PREEMPT Tue May 3 > 23:43:14 UTC 2022 x86_64 GNU/Linux > > I'll keep trying to reproduce the issues here. A clean build with sysvinit has failed to bring up the console on a secondary builder (both qemux86-64 and quemarm64) I'll do some debug and see how it has gone wrong (since xencommon should be firing for sysvinit). Bruce Bruce > > Bruce > > > Meta-virtualization status is kirkstone + patch for qemu-arm32 support. > > > > Cheers > > Bertrand > > > > > > > > Bruce > > > > > >> Cheers > > >> Bertrand > > >> > > >> > > >>> > > >>> Bruce > > >>> > > >>>> > > >>>> Chees > > >>>> Bertrand > > >>>> > > >>>>> > > >>>>> Bruce > > >>>>> > > >>>>>> Cheers > > >>>>>> Bertrand > > >>>>>> > > >>>>>> > > >>>>>>> --- > > >>>>>>> Unchanged since v1 > > >>>>>>> > > >>>>>>> recipes-extended/xen/xen-tools.inc | 9 ++------- > > >>>>>>> recipes-extended/xen/xen.inc | 6 +++--- > > >>>>>>> 2 files changed, 5 insertions(+), 10 deletions(-) > > >>>>>>> > > >>>>>>> diff --git a/recipes-extended/xen/xen-tools.inc b/recipes-exten= ded/xen/xen-tools.inc > > >>>>>>> index 6bbc8cd..54bc477 100644 > > >>>>>>> --- a/recipes-extended/xen/xen-tools.inc > > >>>>>>> +++ b/recipes-extended/xen/xen-tools.inc > > >>>>>>> @@ -30,14 +30,9 @@ RDEPENDS:${PN} =3D "\ > > >>>>>>> > > >>>>>>> RDEPENDS:${PN}-dev =3D "" > > >>>>>>> > > >>>>>>> -# Qemu is necessary on ARM platforms, and to support HVM guest= s on x86 > > >>>>>>> -QEMU =3D "${@bb.utils.contains('PACKAGECONFIG', 'hvm', 'qemu',= '', d)}" > > >>>>>>> -QEMU:arm =3D "qemu" > > >>>>>>> -QEMU:aarch64 =3D "qemu" > > >>>>>>> - > > >>>>>>> RRECOMMENDS:${PN} =3D " \ > > >>>>>>> - ${QEMU} \ > > >>>>>>> - ${@bb.utils.contains('PACKAGECONFIG', 'hvm', 'seabios', '', d= )} \ > > >>>>>>> + qemu \ > > >>>>>>> + ${@bb.utils.contains('XEN_TARGET_ARCH', 'x86_64', 'seabios ip= xe vgabios', '', d)} \ > > >>>>>>> ${@bb.utils.contains('PACKAGECONFIG', 'externalblktap', '', '${= BLKTAP_RRECOMMENDS}', d)} \ > > >>>>>>> ${PN}-flask \ > > >>>>>>> ${PN}-hvmloader \ > > >>>>>>> diff --git a/recipes-extended/xen/xen.inc b/recipes-extended/xe= n/xen.inc > > >>>>>>> index 8b86de5..4c38ccf 100644 > > >>>>>>> --- a/recipes-extended/xen/xen.inc > > >>>>>>> +++ b/recipes-extended/xen/xen.inc > > >>>>>>> @@ -9,13 +9,11 @@ require xen-arch.inc > > >>>>>>> PACKAGECONFIG ??=3D " \ > > >>>>>>> sdl \ > > >>>>>>> ${@bb.utils.contains('DISTRO_FEATURES', 'systemd', 'systemd', '= ', d)} \ > > >>>>>>> - ${@bb.utils.contains('XEN_TARGET_ARCH', 'x86_64', 'hvm', '', = d)} \ > > >>>>>>> " > > >>>>>>> > > >>>>>>> PACKAGECONFIG[sdl] =3D "--enable-sdl,--disable-sdl,virtual/libs= dl," > > >>>>>>> PACKAGECONFIG[xsm] =3D "--enable-xsmpolicy,--disable-xsmpolicy,= checkpolicy-native," > > >>>>>>> PACKAGECONFIG[systemd] =3D "--enable-systemd,--disable-systemd,= systemd," > > >>>>>>> -PACKAGECONFIG[hvm] =3D "--with-system-seabios=3D"/usr/share/fi= rmware/bios.bin",--disable-seabios,seabios ipxe vgabios," > > >>>>>>> PACKAGECONFIG[externalblktap] =3D ",,," > > >>>>>>> > > >>>>>>> DEPENDS =3D " \ > > >>>>>>> @@ -132,7 +130,9 @@ EXTRA_OECONF +=3D " \ > > >>>>>>> --disable-rombios \ > > >>>>>>> --disable-ocamltools \ > > >>>>>>> --disable-qemu-traditional \ > > >>>>>>> - ${@bb.utils.contains('XEN_TARGET_ARCH', 'x86_64', '--enable-p= vshim', '--disable-pvshim', d)} \ > > >>>>>>> + ${@bb.utils.contains('XEN_TARGET_ARCH', 'x86_64', \ > > >>>>>>> + '--enable-pvshim --with-system-seabios=3D"/usr/share/firmware= /bios.bin"', \ > > >>>>>>> + '--disable-pvshim --disable-seabios', d)} \ > > >>>>>>> " > > >>>>>>> > > >>>>>>> EXTRA_OEMAKE +=3D "STDVGA_ROM=3D${STAGING_DIR_HOST}/usr/share/f= irmware/vgabios-0.7a.bin" > > >>>>>>> -- > > >>>>>>> 2.25.1 > > >>>>>>> > > >>>>>>> > > >>>>>>> > > >>>>>>> > > >>>>>> > > >>>>>> IMPORTANT NOTICE: The contents of this email and any attachments= are confidential and may also be privileged. If you are not the intended r= ecipient, please notify the sender immediately and do not disclose the cont= ents to any other person, use it for any purpose, or store or copy the info= rmation in any medium. Thank you. > > >>>>> > > >>>>> > > >>>>> > > >>>>> -- > > >>>>> - Thou shalt not follow the NULL pointer, for chaos and madness a= wait > > >>>>> thee at its end > > >>>>> - "Use the force Harry" - Gandalf, Star Trek II > > >>>> > > >>>> IMPORTANT NOTICE: The contents of this email and any attachments a= re confidential and may also be privileged. If you are not the intended rec= ipient, please notify the sender immediately and do not disclose the conten= ts to any other person, use it for any purpose, or store or copy the inform= ation in any medium. Thank you. > > >>> > > >>> > > >>> > > >>> -- > > >>> - Thou shalt not follow the NULL pointer, for chaos and madness awa= it > > >>> thee at its end > > >>> - "Use the force Harry" - Gandalf, Star Trek II > > >> > > >> IMPORTANT NOTICE: The contents of this email and any attachments are= confidential and may also be privileged. If you are not the intended recip= ient, please notify the sender immediately and do not disclose the contents= to any other person, use it for any purpose, or store or copy the informat= ion in any medium. Thank you. > > > > > > > > > > > > -- > > > - Thou shalt not follow the NULL pointer, for chaos and madness await > > > thee at its end > > > - "Use the force Harry" - Gandalf, Star Trek II > > > > IMPORTANT NOTICE: The contents of this email and any attachments are co= nfidential and may also be privileged. If you are not the intended recipien= t, please notify the sender immediately and do not disclose the contents to= any other person, use it for any purpose, or store or copy the information= in any medium. Thank you. > > > > > > > > > -- > - Thou shalt not follow the NULL pointer, for chaos and madness await > thee at its end > - "Use the force Harry" - Gandalf, Star Trek II > > -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- > Links: You receive all messages sent to this group. > View/Reply Online (#7252): https://lists.yoctoproject.org/g/meta-virtuali= zation/message/7252 > Mute This Topic: https://lists.yoctoproject.org/mt/90743682/1050810 > Group Owner: meta-virtualization+owner@lists.yoctoproject.org > Unsubscribe: https://lists.yoctoproject.org/g/meta-virtualization/unsub [= bruce.ashfield@gmail.com] > -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- > -- - Thou shalt not follow the NULL pointer, for chaos and madness await thee at its end - "Use the force Harry" - Gandalf, Star Trek II