From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 30F9DC54E5D for ; Mon, 18 Mar 2024 16:31:38 +0000 (UTC) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rmFtL-0004OX-Si; Mon, 18 Mar 2024 12:31:15 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rmFtH-0004Lb-Fo for qemu-devel@nongnu.org; Mon, 18 Mar 2024 12:31:12 -0400 Received: from mail-wr1-x431.google.com ([2a00:1450:4864:20::431]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1rmFt9-0007GP-UP for qemu-devel@nongnu.org; Mon, 18 Mar 2024 12:31:11 -0400 Received: by mail-wr1-x431.google.com with SMTP id ffacd0b85a97d-33e570ef661so2019170f8f.1 for ; Mon, 18 Mar 2024 09:31:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1710779461; x=1711384261; darn=nongnu.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=PEdqDypgvV9UvALboPC/K8lW+p/kX9nAGkTPSqIkesg=; b=rtD2gUNJT88IED8KzdVMX+LIR2bnqt6sUmSE1Jk2q4X9n3gHcZym3o9TGTUeOfcx+P K1fxw8YbqD8brA2319UXlRhOHgRn+aA0pQrznhFOLnF2yCBb34RfAQfup0flSmlxXH3v IzE7qMtBqwmPTvPjg5TLUv/NTHG5HL+8rXFprxUzzBblJtOx8ksWO8biM0dwVY58qhWK O/oh3scFGAHV8a6sH2tkc7pbUn33dNm2ap6r4hST2Bl2F5W+MyiX+n2NVyvymPqeBbWm cx0LRY8VOYnW6wCRmIQNA0JZT/HgaOKVqT+/F/tMLbwraSgqwauRJR9OhvfGVdiGIWnH PqjQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1710779461; x=1711384261; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=PEdqDypgvV9UvALboPC/K8lW+p/kX9nAGkTPSqIkesg=; b=O/camZTWcT+CU62GQPSY7ZmAESQKlSswGwMgThKvRlgDYsVN8FVthqZObMDBLL6E65 yp73kr1raaZb7/f1dQgybM65pVNN+rAP7rvDIC9YAWxIqV98kK3NYZKVAnCbQEgEyQli 7VBYTz/TMG0vMvRRXlVgHmCb27Rn84i7rLykMTX1Vwvns3ZJ3meXY9lMK/q2YmIt7LXL TvTXurzYHgNSTaUcLLxoelLiNtNaEsKW9OotBRrfC73ZBV/9Q2f+cXSHEvIiK6hoBKJE vBvSW0hE43H4Jb97KyDpMG6G4OckFZWpbNcnWmJyRgdVXfzV8TKNzin8t0rpx8+M/tEr xKQA== X-Forwarded-Encrypted: i=1; AJvYcCW37Ck1GSv54gDFXKnHaQHCnIay4CujWxWMrCFakZeTRXfg9S/F9rCEF38Rnx18OZNMnqcAR+er1f6dJKDQ5t63kPL59qk= X-Gm-Message-State: AOJu0YyjAiglGlooCCzCX02yVsvjr4/Lg/i1rxpMfITWNzXfHLZGy5pA 9TghS1WANnKpaEsq5vsLGMQ8coQkHSGL7FwJTTu3dUzk2mRtdEeAx6g27ipdQAo= X-Google-Smtp-Source: AGHT+IGdR0ATPW9nNSfQndhrhG/RBPeFOAgRerh0XShRrUXiWr/w3d9HeHfCfJZ5MAZbl2dpcww/+w== X-Received: by 2002:adf:a395:0:b0:33e:c271:7fa8 with SMTP id l21-20020adfa395000000b0033ec2717fa8mr9307477wrb.63.1710779461560; Mon, 18 Mar 2024 09:31:01 -0700 (PDT) Received: from [192.168.69.100] (vit94-h02-176-184-29-165.dsl.sta.abo.bbox.fr. [176.184.29.165]) by smtp.gmail.com with ESMTPSA id a26-20020a5d457a000000b0033e7e9c8657sm10163161wrc.45.2024.03.18.09.31.00 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 18 Mar 2024 09:31:01 -0700 (PDT) Message-ID: <42cdcb79-1873-4987-9a20-92c803b3668d@linaro.org> Date: Mon, 18 Mar 2024 17:30:58 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v3 0/4] tests/avocado: update sbsa-ref firmware to latest Content-Language: en-US To: Marcin Juszkiewicz , qemu-devel@nongnu.org Cc: Radoslaw Biernacki , Peter Maydell , Leif Lindholm , Cleber Rosa , Wainer dos Santos Moschetta , Beraldo Leal , Brad Smith , qemu-arm@nongnu.org References: <20240318-sbsa-ref-firmware-update-v3-0-1c33b995a538@linaro.org> From: =?UTF-8?Q?Philippe_Mathieu-Daud=C3=A9?= In-Reply-To: <20240318-sbsa-ref-firmware-update-v3-0-1c33b995a538@linaro.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Received-SPF: pass client-ip=2a00:1450:4864:20::431; envelope-from=philmd@linaro.org; helo=mail-wr1-x431.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Hi Marcin, On 18/3/24 15:08, Marcin Juszkiewicz wrote: > Updating sbsa-ref firmware for QEMU CI was manual task. Now it is > replaced by CI job run on CodeLinaro Gitlab instance. > > This patchset updates to current state: > > - Trusted Firmware v2.10.2 (latest LTS) > - Tianocore EDK2 stable202402 (latest release) > > And Tianocore EDK2-platforms commit 085c2fb (edk2-platforms does not > have releases). > > Firmware images were built using Debian 'bookworm' cross gcc 12.2.0 > compiler. > > And while I am in that file I dropped use of 'virtio-rng-pci' device as > sbsa-ref is supposed to emulate physical hardware. > > Added 'max' tests with 'pauth=off' and 'pauth-impdef=on' variants. > > (01/11) test_sbsaref_edk2_firmware: PASS (2.51 s) > (02/11) test_sbsaref_alpine_linux_cortex_a57: PASS (23.72 s) > (03/11) test_sbsaref_alpine_linux_neoverse_n1: PASS (23.70 s) > (04/11) test_sbsaref_alpine_linux_max_pauth_off: PASS (23.00 s) > (05/11) test_sbsaref_alpine_linux_max_pauth_impdef: PASS (29.03 s) > (06/11) test_sbsaref_alpine_linux_max: PASS (80.69 s) This one is timeouting for me, should we skip it with AVOCADO_TIMEOUT_EXPECTED? (See below) > (07/11) test_sbsaref_openbsd73_cortex_a57: PASS (16.05 s) > (08/11) test_sbsaref_openbsd73_neoverse_n1: PASS (15.97 s) > (09/11) test_sbsaref_openbsd73_max_pauth_off: PASS (16.22 s) > (10/11) test_sbsaref_openbsd73_max_pauth_impdef: PASS (16.11 s) > (11/11) test_sbsaref_openbsd73_max: PASS (16.08 s) > > Signed-off-by: Marcin Juszkiewicz > --- > Changes in v3: > - left OpenBSD at 7.3 (7.4+ is known to not boot) > https://gitlab.com/qemu-project/qemu/-/issues/2224 > https://marc.info/?l=openbsd-arm&m=171050428327850&w=2 > - added pauth variants of 'max' to OpenBSD tests > - Link to v2: https://lore.kernel.org/r/20240314-sbsa-ref-firmware-update-v2-0-b557c56559cd@linaro.org > > Changes in v2: > - disabled 'max' tests on OpenBSD > - moved tags to 'one tag per line' > - added 'os:linux' tags to Alpine ones > - Link to v1: https://lore.kernel.org/r/20240313-sbsa-ref-firmware-update-v1-0-e166703c5424@linaro.org > > --- > Marcin Juszkiewicz (4): > tests/avocado: update sbsa-ref firmware > tests/avocado: drop virtio-rng from sbsa-ref tests > tests/avocado: sbsa-ref: add Alpine tests for misc 'max' setup > tests/avocado: sbsa-ref: add OpenBSD tests for misc 'max' setup $ make check-avocado AVOCADO_TAGS='machine:sbsa-ref' ninja: no work to do. JOB ID : 76d5dc90c6f70f0801c5269ff1c1db6c0d2cb27b JOB LOG : build/system_arm/tests/results/job-2024-03-18T15.54-76d5dc9/job.log (1/7) tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_edk2_firmware: PASS (4.96 s) (2/7) tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_alpine_linux_cortex_a57: PASS (52.67 s) (3/7) tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_alpine_linux_neoverse_n1: PASS (51.01 s) (4/7) tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_alpine_linux_max: INTERRUPTED: Test interrupted by SIGTERM\nRunner error occurred: Timeout reached\nOriginal status: ERROR\n{'name': '4-tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_alpine_linux_max', 'logdir': 'build/system_... (180.50 s) (5/7) tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_openbsd73_cortex_a57: PASS (21.15 s) (6/7) tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_openbsd73_neoverse_n1: PASS (20.88 s) (7/7) tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_openbsd73_max: PASS (20.70 s) RESULTS : PASS 6 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 1 | CANCEL 0 JOB TIME : 355.21 s make: *** [tests/Makefile.include:139: check-avocado] Error 8 Looking at debug.log: 15:56:17 DEBUG| Opening console file 15:56:17 DEBUG| Opening console socket 15:56:17 DEBUG| NOTICE: Booting Trusted Firmware 15:56:17 DEBUG| NOTICE: BL1: v2.9(release):v2.9.0-764-g7c3ff62d2 15:56:17 DEBUG| NOTICE: BL1: Built : 12:32:06, Sep 27 2023 15:56:17 DEBUG| NOTICE: BL1: Booting BL2 15:56:17 DEBUG| NOTICE: BL2: v2.9(release):v2.9.0-764-g7c3ff62d2 15:56:17 DEBUG| NOTICE: BL2: Built : 12:32:06, Sep 27 2023 15:56:17 DEBUG| NOTICE: BL1: Booting BL31 15:56:17 DEBUG| NOTICE: BL31: v2.9(release):v2.9.0-764-g7c3ff62d2 15:56:17 DEBUG| NOTICE: BL31: Built : 12:32:06, Sep 27 2023 15:56:17 DEBUG| UEFI firmware (version 1.0 built at 15:45:23 on Sep 20 2023) ... 15:57:48 DEBUG| * Mounting security filesystem ... [ ok ] 15:57:49 DEBUG| * Mounting debug filesystem ... [ ok ] 15:57:49 DEBUG| * Mounting persistent storage (pstore) filesystem ... [ ok ] 15:57:50 DEBUG| * Mounting efivarfs filesystem ... [ ok ] 15:57:51 DEBUG| * Starting busybox mdev ... [ ok ] 15:58:05 DEBUG| * Scanning hardware for mdev ... [ ok ] 15:59:05 DEBUG| * Loading hardware drivers ... [ ok ] 15:59:05 DEBUG| * WARNING: clock skew detected! 15:59:07 DEBUG| * Setting the local clock based on last shutdown time ... [ ok ] 15:59:11 DEBUG| * Loading modules ... [ ok ] 15:59:13 ERROR| 15:59:13 ERROR| RuntimeError: Test interrupted by SIGTERM