From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=3.0 tests=BAYES_00,DATE_IN_PAST_24_48, DKIM_INVALID,DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A4911C433B4 for ; Wed, 14 Apr 2021 17:44:51 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id C0E4C61179 for ; Wed, 14 Apr 2021 17:44:50 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C0E4C61179 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linaro.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:50648 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lWjZJ-0004OJ-NL for qemu-devel@archiver.kernel.org; Wed, 14 Apr 2021 13:44:49 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:57546) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lWjTs-0001hK-Jz for qemu-devel@nongnu.org; Wed, 14 Apr 2021 13:39:12 -0400 Received: from mail-wr1-x42d.google.com ([2a00:1450:4864:20::42d]:41535) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1lWjTq-00088b-CL for qemu-devel@nongnu.org; Wed, 14 Apr 2021 13:39:12 -0400 Received: by mail-wr1-x42d.google.com with SMTP id k26so4255884wrc.8 for ; Wed, 14 Apr 2021 10:39:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=references:user-agent:from:to:cc:subject:date:in-reply-to :message-id:mime-version:content-transfer-encoding; bh=TDPEG2cH3L7X+4i5F1+bNLj/iJyyIT9eI9xso1EYQ7c=; b=Ya7yWXNrJdLI+Tfagd8xa7GTtGN+XWzceGUzu6Z3imABRK40OwZEJq46ceeXtJwBBl VGcvDLogw1G25ihPc5pYecAFFVaWgDQ2yI8EqvPwEFhwrMGL/HCkEpVIhIFp+BuI+gCF FzHp+n+RkkZyc1EHwh6AFwpk+t+u5wyxO1EvxVyNF2sPq4pHLZCdrBMKAahU/vfT2Nqq 9b4m4lqqtMRVzz8EeluaFtUIuIJvLISQdb+1Wf0hCIF9uEqQ0z4EwdQHGPNyDOItnIvD mKdLYJzfFjNfuHsHHKzKfgs5/DbrpE+j8frruHLBall5UeC1D24uBnYuLuHc8FHlSAoO 8UYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:references:user-agent:from:to:cc:subject:date :in-reply-to:message-id:mime-version:content-transfer-encoding; bh=TDPEG2cH3L7X+4i5F1+bNLj/iJyyIT9eI9xso1EYQ7c=; b=G8j9uJMq7qhpe6754na8isc4E3BAOprE45nvFxVpbrP5KLumB+jLqw59IxJk5OtO7i rJIvu8J5kzG5T4gJ+YnV1aoAeFxkPSH8yt2bS8AoppJAlqE+PuhHyiLwfLIh9ROVqChU Y2+LYisK84mpxeZOakypVSh2/lCSklV8/zMvDVRClHfqI7l6PsmsO3BVoftp6ZspMfxP 5wk8DrxvERcsY2X6EVJNY28j1yF9urRDO+6DEkq4mgp49RJaSfY1zCJV9Fmzc1vi0B/9 /CPdqMVq+l3RjHvsQ8Za53Lzc0lK6eg9g7pUF2NTt51Dq7/6ObYUnEhV84Vfymcma2KJ mmXQ== X-Gm-Message-State: AOAM531Ft15g/+1YlIt+cazxFzI0HYXNi/4nOTberPGuMr5cGgfTyK7e txlZkWf10eMkWaS5VwpESU1R7w== X-Google-Smtp-Source: ABdhPJzoVVF780FhETqvC/6o543upRsipuWgZoJ7wvdl0somLwcdDdQHw/PEStONsPMGUjBkYBlzCA== X-Received: by 2002:adf:e8c3:: with SMTP id k3mr19500822wrn.400.1618421948463; Wed, 14 Apr 2021 10:39:08 -0700 (PDT) Received: from zen.linaroharston ([51.148.130.216]) by smtp.gmail.com with ESMTPSA id c1sm72135wrx.89.2021.04.14.10.39.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 14 Apr 2021 10:39:07 -0700 (PDT) Received: from zen (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id AA9FA1FF7E; Wed, 14 Apr 2021 18:39:06 +0100 (BST) References: <20200929224857.1225107-1-philmd@redhat.com> <87eefvnx3s.fsf@linaro.org> <7a720701-a34f-ccf4-d116-a0f0703b5f83@redhat.com> <87ft03wd3w.fsf@linaro.org> User-agent: mu4e 1.5.11; emacs 28.0.50 From: Alex =?utf-8?Q?Benn=C3=A9e?= To: Philippe =?utf-8?Q?Mathieu-Daud=C3=A9?= Subject: Re: [PATCH] tests/acceptance: Add a 'virt_kvm' test using the GICv3 Date: Tue, 13 Apr 2021 17:32:35 +0100 In-reply-to: Message-ID: <87k0p4lq9x.fsf@linaro.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2a00:1450:4864:20::42d; envelope-from=alex.bennee@linaro.org; helo=mail-wr1-x42d.google.com X-Spam_score_int: -7 X-Spam_score: -0.8 X-Spam_bar: / X-Spam_report: (-0.8 / 5.0 requ) BAYES_00=-1.9, DATE_IN_PAST_24_48=1.34, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: qemu-devel@nongnu.org, Wainer dos Santos Moschetta , Willian Rampazzo , qemu-arm@nongnu.org, Cleber Rosa , Paolo Bonzini Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" Philippe Mathieu-Daud=C3=A9 writes: > Hi Alex, > > On 4/12/21 7:55 PM, Philippe Mathieu-Daud=C3=A9 wrote: >> On 4/6/21 7:12 PM, Alex Benn=C3=A9e wrote: >>> >>> Philippe Mathieu-Daud=C3=A9 writes: >>> >>>> On 3/31/21 5:45 PM, Alex Benn=C3=A9e wrote: >>>>> >>>>> Philippe Mathieu-Daud=C3=A9 writes: >>>>> >>>>>> The current 'virt_kvm' test is restricted to GICv2, but can also >>>>>> work with a GICv3. Duplicate it but add a GICv3 test which can be >>>>>> tested on some hardware. >>>>>> >>>>>> Noticed while running: >>>>>> >>>>>> $ avocado --show=3Dapp run -t machine:virt tests/acceptance/ >>>>>> ... >>>>>> (2/6) tests/acceptance/boot_linux.py:BootLinuxAarch64.test_virt_kvm= : ERROR: Unexpected empty reply from server (1.82 s) >>>>>> >>>>>> The job.log content is: >>>>>> >>>>>> L0351 DEBUG| Output: 'qemu-system-aarch64: host does not support i= n-kernel GICv2 emulation\n' >>>>>> >>>>>> With this patch: >>>>>> >>>>>> $ avocado --show=3Dapp run -t device:gicv3 tests/acceptance/ >>>>>> (1/1) >>>>>> tests/acceptance/boot_linux.py:BootLinuxAarch64.test_virt_kvm_gicv3: >>>>>> PASS (55.10 s) >>>>> >>>>> On the new aarch64 machine which is GICv3 I get the following: >>>>> >>>>> (006/142) tests/acceptance/boot_linux.py:BootLinuxAarch64.test_virt_= kvm_gicv2: ERROR: Unexpected empty reply from server (0.47 s) >>>>> >>>>> which it shouldn't have run. However: >>>>> >>>>> ./tests/venv/bin/avocado --show=3Dapp run -t device:gic3 tests/acce= ptance/ >>>>> Test Suite could not be create. No test references provided nor any= other arguments resolved into tests >>>>> >>>>> Is this something that has regressed or am I doing it wrong? >>>> >>>> Typo in the tag: "device:gic3" -> "device:gicv3" >>> >>> Doh! >>> >>> But what about: >>> >>> /tests/venv/bin/avocado run tests/acceptance/boot_linux.py:BootLinuxAar= ch64.test_virt_kvm_gicv2 >>> JOB ID : 396696d8f9d31d970878cb46025b2ced76f3623f >>> JOB LOG : /home/alex/avocado/job-results/job-2021-04-06T17.11-396696= d/job.log >>> (1/1) tests/acceptance/boot_linux.py:BootLinuxAarch64.test_virt_kvm_gi= cv2: ERROR: Unexpected empty reply from server (0.65 s) >>> RESULTS : PASS 0 | ERROR 1 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 = | CANCEL 0 >>> JOB TIME : 0.96 s >>> >>> why doesn't that skip? >>=20 >> /home/phil/avocado/job-results/job-2021-04-12T17.51-efdca81/job.log >> 2021-04-12 17:52:44,589 machine L0389 DEBUG| Output: >> "qemu-system-aarch64: Could not find ROM image >> '/home/phil/qemu/build/host/pc-bios/edk2-aarch64-code.fd'\n" >>=20 >> Missing prerequisite: >>=20 >> $ ninja pc-bios/edk2-aarch64-code.fd >> [1/1] Generating edk2-aarch64-code.fd with a custom command (wrapped by >> meson to capture output) >>=20 >> Then we are good: >>=20 >> $ avocado --show=3Dapp,console run -t device:gicv3 tests/acceptance >> JOB ID : e84401e5cc3ae53a3094c79491e661385cc7b4a7 >> JOB LOG : >> /home/phil/avocado/job-results/job-2021-04-12T17.53-e84401e/job.log >> (1/1) >> tests/acceptance/boot_linux.py:BootLinuxAarch64.test_virt_kvm_gicv3: >> PASS (16.38 s) >> RESULTS : PASS 1 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | >> CANCEL 0 >> JOB TIME : 16.70 s >>=20 >> Probably some missing dependency in Makefile/Meson? > > Are you using multiple build directories? Yes - many. > I could reproduce doing: > > $ mkdir A B > $ cd A > $ make check-qtest-aarch64 > $ avocado --show=3Dapp,console run -t device:gicv3 tests/acceptance > $ cd ../B > $ ninja qemu-system-aarch64 > $ avocado --show=3Dapp,console run -t device:gicv3 tests/acceptance > > In A edk2-aarch64-code.fd has been expanded in A/pc-bios/, > in B it isn't. > > check-acceptance is a Makefile rule, not a ninja one... > I suppose we need to convert it to ninja to be able to use the > rest of the dependencies checks. > > Cc'ing Paolo because I'm not sure what the best move and where > to plug things. --=20 Alex Benn=C3=A9e