[Qemu-devel] [PULL 0/6] Python queue, 2019-06-11

[Qemu-devel] [PULL 0/6] Python queue, 2019-06-11

[Eduardo Habkost]

Changes from 2019-06-07: Python 2 deprecation and Python 3 check
for 3.5+ were removed.

The following changes since commit 219dca61ebf41625831d4f96a720852baf44b762:

  Merge remote-tracking branch 'remotes/ehabkost/tags/x86-next-pull-request' into staging (2019-06-11 16:02:07 +0100)

are available in the Git repository at:

  git://github.com/ehabkost/qemu.git tags/python-next-pull-request

for you to fetch changes up to 6d7a134da4afebe8551a69329478415cfb4cbe91:

  travis: Make check-acceptance job more verbose (2019-06-11 14:13:09 -0300)

----------------------------------------------------------------
Python queue, 2019-06-11

* New boot_linux_console test cases (Philippe Mathieu-Daudé)
* Make check-acceptance Travis job more verbose (Eduardo Habkost)

----------------------------------------------------------------

Eduardo Habkost (1):
  travis: Make check-acceptance job more verbose

Philippe Mathieu-Daudé (5):
  tests/boot_linux_console: Let extract_from_deb handle various
    compressions
  BootLinuxConsoleTest: Do not log empty lines
  BootLinuxConsoleTest: Test the SmartFusion2 board
  BootLinuxConsoleTest: Test nanoMIPS kernels on the I7200 CPU
  BootLinuxConsoleTest: Run kerneltests BusyBox on Malta

 .travis.yml                            |   2 +-
 tests/acceptance/boot_linux_console.py | 145 ++++++++++++++++++++++++-
 2 files changed, 142 insertions(+), 5 deletions(-)

-- 
2.18.0.rc1.1.g3f1ff2140

[Qemu-devel] [PULL 1/6] tests/boot_linux_console: Let extract_from_deb handle various compressions

[Eduardo Habkost]

From: Philippe Mathieu-Daudé <philmd@redhat.com>

Debian binary package format supports various compressions.

Per man deb(5):

  NAME
    deb - Debian binary package format

  FORMAT
    ...
    The third, last required member is named data.tar.  It contains the
    filesystem as a tar archive, either not compressed (supported since
    dpkg 1.10.24), or compressed with gzip (with .gz extension),
    xz (with .xz extension, supported since dpkg 1.15.6),
    bzip2 (with .bz2 extension, supported since dpkg 1.10.24) or
    lzma (with .lzma extension, supported since dpkg 1.13.25).

List the archive files to have the 3rd name with the correct extension.

The function avocado.utils.archive.extract() will handle the different
compression format for us.

Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Message-Id: <20190312234541.2887-2-philmd@redhat.com>
Reviewed-by: Cleber Rosa <crosa@redhat.com>
Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
---
 tests/acceptance/boot_linux_console.py | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)

diff --git a/tests/acceptance/boot_linux_console.py b/tests/acceptance/boot_linux_console.py
index d5c500ea30..6aa084e049 100644
--- a/tests/acceptance/boot_linux_console.py
+++ b/tests/acceptance/boot_linux_console.py
@@ -55,8 +55,9 @@ class BootLinuxConsole(Test):
         """
         cwd = os.getcwd()
         os.chdir(self.workdir)
-        process.run("ar x %s data.tar.gz" % deb)
-        archive.extract("data.tar.gz", self.workdir)
+        file_path = process.run("ar t %s" % deb).stdout_text.split()[2]
+        process.run("ar x %s %s" % (deb, file_path))
+        archive.extract(file_path, self.workdir)
         os.chdir(cwd)
         return self.workdir + path
 
-- 
2.18.0.rc1.1.g3f1ff2140

[Qemu-devel] [PULL 2/6] BootLinuxConsoleTest: Do not log empty lines

[Eduardo Habkost]

From: Philippe Mathieu-Daudé <f4bug@amsat.org>

Avoid to log empty lines in console debug logs.

Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20190520220635.10961-2-f4bug@amsat.org>
Reviewed-by: Alistair Francis <alistair.francis@wdc.com>
Reviewed-by: Cleber Rosa <crosa@redhat.com>
Tested-by: Cleber Rosa <crosa@redhat.com>
Acked-by: Aleksandar Markovic <amarkovic@wavecomp.com>
Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
---
 tests/acceptance/boot_linux_console.py | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)

diff --git a/tests/acceptance/boot_linux_console.py b/tests/acceptance/boot_linux_console.py
index 6aa084e049..e86e66900a 100644
--- a/tests/acceptance/boot_linux_console.py
+++ b/tests/acceptance/boot_linux_console.py
@@ -37,8 +37,10 @@ class BootLinuxConsole(Test):
         console = self.vm.console_socket.makefile()
         console_logger = logging.getLogger('console')
         while True:
-            msg = console.readline()
-            console_logger.debug(msg.strip())
+            msg = console.readline().strip()
+            if not msg:
+                continue
+            console_logger.debug(msg)
             if success_message in msg:
                 break
             if failure_message in msg:
-- 
2.18.0.rc1.1.g3f1ff2140

[Qemu-devel] [PULL 3/6] BootLinuxConsoleTest: Test the SmartFusion2 board

[Eduardo Habkost]

From: Philippe Mathieu-Daudé <f4bug@amsat.org>

Similar to the x86_64/pc test, it boots a Linux kernel on an
Emcraft board and verify the serial is working.

If ARM is a target being built, "make check-acceptance" will
automatically include this test by the use of the "arch:arm" tags.

Alternatively, this test can be run using:

  $ avocado run -t arch:arm tests/acceptance
  $ avocado run -t machine:emcraft_sf2 tests/acceptance

Based on the recommended test setup from Subbaraya Sundeep:
https://lists.gnu.org/archive/html/qemu-devel/2017-05/msg03810.html

Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20190520220635.10961-3-f4bug@amsat.org>
Reviewed-by: Alistair Francis <alistair.francis@wdc.com>
Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
---
 tests/acceptance/boot_linux_console.py | 27 ++++++++++++++++++++++++++
 1 file changed, 27 insertions(+)

diff --git a/tests/acceptance/boot_linux_console.py b/tests/acceptance/boot_linux_console.py
index e86e66900a..e6b5ed5dda 100644
--- a/tests/acceptance/boot_linux_console.py
+++ b/tests/acceptance/boot_linux_console.py
@@ -179,6 +179,33 @@ class BootLinuxConsole(Test):
         console_pattern = 'Kernel command line: %s' % kernel_command_line
         self.wait_for_console_pattern(console_pattern)
 
+    def test_arm_emcraft_sf2(self):
+        """
+        :avocado: tags=arch:arm
+        :avocado: tags=machine:emcraft_sf2
+        :avocado: tags=endian:little
+        """
+        uboot_url = ('https://raw.githubusercontent.com/'
+                     'Subbaraya-Sundeep/qemu-test-binaries/'
+                     'fa030bd77a014a0b8e360d3b7011df89283a2f0b/u-boot')
+        uboot_hash = 'abba5d9c24cdd2d49cdc2a8aa92976cf20737eff'
+        uboot_path = self.fetch_asset(uboot_url, asset_hash=uboot_hash)
+        spi_url = ('https://raw.githubusercontent.com/'
+                   'Subbaraya-Sundeep/qemu-test-binaries/'
+                   'fa030bd77a014a0b8e360d3b7011df89283a2f0b/spi.bin')
+        spi_hash = '85f698329d38de63aea6e884a86fbde70890a78a'
+        spi_path = self.fetch_asset(spi_url, asset_hash=spi_hash)
+
+        self.vm.set_machine('emcraft-sf2')
+        self.vm.set_console()
+        kernel_command_line = self.KERNEL_COMMON_COMMAND_LINE
+        self.vm.add_args('-kernel', uboot_path,
+                         '-append', kernel_command_line,
+                         '-drive', 'file=' + spi_path + ',if=mtd,format=raw',
+                         '-no-reboot')
+        self.vm.launch()
+        self.wait_for_console_pattern('init started: BusyBox')
+
     def test_s390x_s390_ccw_virtio(self):
         """
         :avocado: tags=arch:s390x
-- 
2.18.0.rc1.1.g3f1ff2140

[Qemu-devel] [PULL 4/6] BootLinuxConsoleTest: Test nanoMIPS kernels on the I7200 CPU

[Eduardo Habkost]

From: Philippe Mathieu-Daudé <f4bug@amsat.org>

Similar to the x86_64/pc test, it boots a Linux kernel on a Malta
machine and verify the serial is working.

Use the documentation added in commit f7d257cb4a17 to test
nanoMIPS kernels and the I7200 CPU.

This test can be run using:

  $ avocado --show=console run -t arch:mipsel tests/acceptance/boot_linux_console.py
  console: [    0.000000] Linux version 4.15.18-00432-gb2eb9a8b (emubuild@mipscs563) (gcc version 6.3.0 (Codescape GNU Tools 2018.04-02 for nanoMIPS Linux)) #1 SMP Wed Jun 27 11:10:08 PDT 2018
  console: [    0.000000] GCRs appear to have been moved (expected them at 0x1fbf8000)!
  console: [    0.000000] GCRs appear to have been moved (expected them at 0x1fbf8000)!
  console: [    0.000000] CPU0 revision is: 00010000 (MIPS GENERIC QEMU)
  console: [    0.000000] MIPS: machine is mti,malta
  console: [    0.000000] Determined physical RAM map:
  console: [    0.000000]  memory: 08000000 @ 00000000 (usable)
  console: [    0.000000] earlycon: ns16550a0 at I/O port 0x3f8 (options '38400n8')
  console: [    0.000000] bootconsole [ns16550a0] enabled
  console: [    0.000000] User-defined physical RAM map:
  console: [    0.000000]  memory: 10000000 @ 00000000 (usable)
  console: [    0.000000] Initrd not found or empty - disabling initrd
  console: [    0.000000] MIPS CPS SMP unable to proceed without a CM
  console: [    0.000000] Primary instruction cache 32kB, VIPT, 4-way, linesize 32 bytes.
  console: [    0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliases, linesize 32 bytes
  console: [    0.000000] This processor doesn't support highmem. -262144k highmem ignored
  console: [    0.000000] Zone ranges:
  console: [    0.000000]   Normal   [mem 0x0000000000000000-0x000000000fffffff]
  console: [    0.000000]   HighMem  empty
  console: [    0.000000] Movable zone start for each node
  console: [    0.000000] Early memory node ranges
  console: [    0.000000]   node   0: [mem 0x0000000000000000-0x000000000fffffff]
  console: [    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000000fffffff]
  console: [    0.000000] random: get_random_bytes called from start_kernel+0x60/0x2f0 with crng_init=0
  console: [    0.000000] percpu: Embedded 16 pages/cpu @(ptrval) s36620 r8192 d20724 u65536
  console: [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 64960
  console: [    0.000000] Kernel command line: printk.time=0 mem=256m@@0x0 console=ttyS0 earlycon

Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20190520231910.12184-3-f4bug@amsat.org>
Acked-by: Aleksandar Markovic <amarkovic@wavecomp.com>
Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
---
 tests/acceptance/boot_linux_console.py | 58 ++++++++++++++++++++++++++
 1 file changed, 58 insertions(+)

diff --git a/tests/acceptance/boot_linux_console.py b/tests/acceptance/boot_linux_console.py
index e6b5ed5dda..5d8380a23b 100644
--- a/tests/acceptance/boot_linux_console.py
+++ b/tests/acceptance/boot_linux_console.py
@@ -10,6 +10,8 @@
 
 import os
 import logging
+import lzma
+import shutil
 
 from avocado_qemu import Test
 from avocado.utils import process
@@ -138,6 +140,62 @@ class BootLinuxConsole(Test):
         console_pattern = 'Kernel command line: %s' % kernel_command_line
         self.wait_for_console_pattern(console_pattern)
 
+    def do_test_mips_malta32el_nanomips(self, kernel_url, kernel_hash):
+        kernel_path_xz = self.fetch_asset(kernel_url, asset_hash=kernel_hash)
+        kernel_path = self.workdir + "kernel"
+        with lzma.open(kernel_path_xz, 'rb') as f_in:
+            with open(kernel_path, 'wb') as f_out:
+                shutil.copyfileobj(f_in, f_out)
+
+        self.vm.set_machine('malta')
+        self.vm.set_console()
+        kernel_command_line = (self.KERNEL_COMMON_COMMAND_LINE
+                               + 'mem=256m@@0x0 '
+                               + 'console=ttyS0')
+        self.vm.add_args('-no-reboot',
+                         '-cpu', 'I7200',
+                         '-kernel', kernel_path,
+                         '-append', kernel_command_line)
+        self.vm.launch()
+        console_pattern = 'Kernel command line: %s' % kernel_command_line
+        self.wait_for_console_pattern(console_pattern)
+
+    def test_mips_malta32el_nanomips_4k(self):
+        """
+        :avocado: tags=arch:mipsel
+        :avocado: tags=machine:malta
+        :avocado: tags=endian:little
+        """
+        kernel_url = ('https://mipsdistros.mips.com/LinuxDistro/nanomips/'
+                      'kernels/v4.15.18-432-gb2eb9a8b07a1-20180627102142/'
+                      'generic_nano32r6el_page4k.xz')
+        kernel_hash = '477456aafd2a0f1ddc9482727f20fe9575565dd6'
+        self.do_test_mips_malta32el_nanomips(kernel_url, kernel_hash)
+
+    def test_mips_malta32el_nanomips_16k_up(self):
+        """
+        :avocado: tags=arch:mipsel
+        :avocado: tags=machine:malta
+        :avocado: tags=endian:little
+        """
+        kernel_url = ('https://mipsdistros.mips.com/LinuxDistro/nanomips/'
+                      'kernels/v4.15.18-432-gb2eb9a8b07a1-20180627102142/'
+                      'generic_nano32r6el_page16k_up.xz')
+        kernel_hash = 'e882868f944c71c816e832e2303b7874d044a7bc'
+        self.do_test_mips_malta32el_nanomips(kernel_url, kernel_hash)
+
+    def test_mips_malta32el_nanomips_64k_dbg(self):
+        """
+        :avocado: tags=arch:mipsel
+        :avocado: tags=machine:malta
+        :avocado: tags=endian:little
+        """
+        kernel_url = ('https://mipsdistros.mips.com/LinuxDistro/nanomips/'
+                      'kernels/v4.15.18-432-gb2eb9a8b07a1-20180627102142/'
+                      'generic_nano32r6el_page64k_dbg.xz')
+        kernel_hash = '18d1c68f2e23429e266ca39ba5349ccd0aeb7180'
+        self.do_test_mips_malta32el_nanomips(kernel_url, kernel_hash)
+
     def test_aarch64_virt(self):
         """
         :avocado: tags=arch:aarch64
-- 
2.18.0.rc1.1.g3f1ff2140

[Qemu-devel] [PULL 5/6] BootLinuxConsoleTest: Run kerneltests BusyBox on Malta

[Eduardo Habkost]

From: Philippe Mathieu-Daudé <f4bug@amsat.org>

This tests boots a Linux kernel on a Malta machine up to a
busybox shell on the serial console. Few commands are executed
before halting the machine (via reboot).

We use the initrd cpio image from the kerneltests project:
https://kerneltests.org/

If MIPS is a target being built, "make check-acceptance" will
automatically include this test by the use of the "arch:mips" tags.

Alternatively, this test can be run using:

  $ avocado --show=console run -t arch:mips tests/acceptance/boot_linux_console.py
  [...]
  console: Boot successful.
  [...]
  console: / # uname -a
  console: Linux buildroot 4.5.0-2-4kc-malta #1 Debian 4.5.5-1 (2016-05-29) mips GNU/Linux
  console: / # reboot
  console: / # reboot: Restarting system

Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20190520231910.12184-4-f4bug@amsat.org>
Acked-by: Aleksandar Markovic <amarkovic@wavecomp.com>
Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
---
 tests/acceptance/boot_linux_console.py | 49 ++++++++++++++++++++++++++
 1 file changed, 49 insertions(+)

diff --git a/tests/acceptance/boot_linux_console.py b/tests/acceptance/boot_linux_console.py
index 5d8380a23b..32159503e9 100644
--- a/tests/acceptance/boot_linux_console.py
+++ b/tests/acceptance/boot_linux_console.py
@@ -11,6 +11,7 @@
 import os
 import logging
 import lzma
+import gzip
 import shutil
 
 from avocado_qemu import Test
@@ -49,6 +50,11 @@ class BootLinuxConsole(Test):
                 fail = 'Failure message found in console: %s' % failure_message
                 self.fail(fail)
 
+    def exec_command_and_wait_for_pattern(self, command, success_message):
+        command += '\n'
+        self.vm.console_socket.sendall(command.encode())
+        self.wait_for_console_pattern(success_message)
+
     def extract_from_deb(self, deb, path):
         """
         Extracts a file from a deb package into the test workdir
@@ -140,6 +146,49 @@ class BootLinuxConsole(Test):
         console_pattern = 'Kernel command line: %s' % kernel_command_line
         self.wait_for_console_pattern(console_pattern)
 
+    def test_mips_malta_cpio(self):
+        """
+        :avocado: tags=arch:mips
+        :avocado: tags=machine:malta
+        :avocado: tags=endian:big
+        """
+        deb_url = ('http://snapshot.debian.org/archive/debian/'
+                   '20160601T041800Z/pool/main/l/linux/'
+                   'linux-image-4.5.0-2-4kc-malta_4.5.5-1_mips.deb')
+        deb_hash = 'a3c84f3e88b54e06107d65a410d1d1e8e0f340f8'
+        deb_path = self.fetch_asset(deb_url, asset_hash=deb_hash)
+        kernel_path = self.extract_from_deb(deb_path,
+                                            '/boot/vmlinux-4.5.0-2-4kc-malta')
+        initrd_url = ('https://github.com/groeck/linux-build-test/raw/'
+                      '8584a59ed9e5eb5ee7ca91f6d74bbb06619205b8/rootfs/'
+                      'mips/rootfs.cpio.gz')
+        initrd_hash = 'bf806e17009360a866bf537f6de66590de349a99'
+        initrd_path_gz = self.fetch_asset(initrd_url, asset_hash=initrd_hash)
+        initrd_path = self.workdir + "rootfs.cpio"
+
+        with gzip.open(initrd_path_gz, 'rb') as f_in:
+            with open(initrd_path, 'wb') as f_out:
+                shutil.copyfileobj(f_in, f_out)
+
+        self.vm.set_machine('malta')
+        self.vm.set_console()
+        kernel_command_line = (self.KERNEL_COMMON_COMMAND_LINE
+                               + 'console=ttyS0 console=tty '
+                               + 'rdinit=/sbin/init noreboot')
+        self.vm.add_args('-kernel', kernel_path,
+                         '-initrd', initrd_path,
+                         '-append', kernel_command_line,
+                         '-no-reboot')
+        self.vm.launch()
+        self.wait_for_console_pattern('Boot successful.')
+
+        self.exec_command_and_wait_for_pattern('cat /proc/cpuinfo',
+                                               'BogoMIPS')
+        self.exec_command_and_wait_for_pattern('uname -a',
+                                               'Debian')
+        self.exec_command_and_wait_for_pattern('reboot',
+                                               'reboot: Restarting system')
+
     def do_test_mips_malta32el_nanomips(self, kernel_url, kernel_hash):
         kernel_path_xz = self.fetch_asset(kernel_url, asset_hash=kernel_hash)
         kernel_path = self.workdir + "kernel"
-- 
2.18.0.rc1.1.g3f1ff2140

[Qemu-devel] [PULL 6/6] travis: Make check-acceptance job more verbose

[Eduardo Habkost]

It will help us debug issues when tests fail.

Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
---
 .travis.yml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/.travis.yml b/.travis.yml
index b053a836a3..a08a7b7278 100644
--- a/.travis.yml
+++ b/.travis.yml
@@ -225,7 +225,7 @@ matrix:
     # Acceptance (Functional) tests
     - env:
         - CONFIG="--python=/usr/bin/python3 --target-list=x86_64-softmmu,mips-softmmu,mips64el-softmmu,aarch64-softmmu,arm-softmmu,s390x-softmmu,alpha-softmmu"
-        - TEST_CMD="make check-acceptance"
+        - TEST_CMD="make AVOCADO_SHOW=test check-acceptance"
       addons:
         apt:
           packages:
-- 
2.18.0.rc1.1.g3f1ff2140

Re: [Qemu-devel] [PULL 6/6] travis: Make check-acceptance job more verbose

[Philippe Mathieu-Daudé]

On 6/11/19 7:14 PM, Eduardo Habkost wrote:
> It will help us debug issues when tests fail.
> 
> Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
> ---
>  .travis.yml | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
> 
> diff --git a/.travis.yml b/.travis.yml
> index b053a836a3..a08a7b7278 100644
> --- a/.travis.yml
> +++ b/.travis.yml
> @@ -225,7 +225,7 @@ matrix:
>      # Acceptance (Functional) tests
>      - env:
>          - CONFIG="--python=/usr/bin/python3 --target-list=x86_64-softmmu,mips-softmmu,mips64el-softmmu,aarch64-softmmu,arm-softmmu,s390x-softmmu,alpha-softmmu"
> -        - TEST_CMD="make check-acceptance"
> +        - TEST_CMD="make AVOCADO_SHOW=test check-acceptance"
>        addons:
>          apt:
>            packages:
> 

Cleber, can you help figuring what's wrong here?

https://travis-ci.org/qemu/qemu/jobs/544805900

The tests seems successfull, is it possible the verbose logging returns
error to the shell even if the test succeed?

INIT
05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
PARAMS (key=timeout, path=*, default=90) => 90
Test metadata:
  filename:
/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py
  teststmpdir: /tmp/avocado_6tk1s4nz
  workdir:
/tmp/avocado_ifg2df04/avocado_job_zqdrt4ht/05-_home_travis_build_qemu_qemu_tests_acceptance_boot_linux_console.py_BootLinuxConsole.test_aarch64_virt
START
05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
DATA (filename=output.expected) => NOT FOUND (data sources: variant,
test, file)
PARAMS (key=arch, path=*, default=aarch64) => 'aarch64'
PARAMS (key=qemu_bin, path=*,
default=aarch64-softmmu/qemu-system-aarch64) =>
'aarch64-softmmu/qemu-system-aarch64'
Fetching
https://download.fedoraproject.org/pub/fedora/linux/releases/29/Everything/aarch64/os/images/pxeboot/vmlinuz
->
/home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz.g3ehffso
Retrieved URL
"https://download.fedoraproject.org/pub/fedora/linux/releases/29/Everything/aarch64/os/images/pxeboot/vmlinuz":
content-length 8623423, date: "Wed, 12 Jun 2019 18:54:21 GMT",
last-modified: "Sun, 21 Oct 2018 00:43:09 GMT"
VM launch command: 'aarch64-softmmu/qemu-system-aarch64 -chardev
socket,id=mon,path=/var/tmp/tmptpv0noew/qemu-6334-monitor.sock -mon
chardev=mon,mode=control -display none -vga none -machine virt -chardev
socket,id=console,path=/var/tmp/tmptpv0noew/qemu-6334-console.sock,server,nowait
-serial chardev:console -cpu cortex-a53 -kernel
/home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz
-append printk.time=0 console=ttyAMA0'
>>> {'execute': 'qmp_capabilities'}
<<< {'return': {}}
Booting Linux on physical CPU 0x0000000000 [0x410fd034]
Linux version 4.18.16-300.fc29.aarch64
(mockbuild@buildvm-aarch64-02.arm.fedoraproject.org) (gcc version 8.2.1
20180801 (Red Hat 8.2.1-2) (GCC)) #1 SMP Sat Oct 20 23:12:22 UTC 2018
Machine model: linux,dummy-virt
efi: Getting EFI parameters from FDT:
efi: UEFI not found.
cma: Failed to reserve 64 MiB
NUMA: No NUMA configuration found
NUMA: Faking a node at [mem 0x0000000000000000-0x0000000047ffffff]
NUMA: NODE_DATA [mem 0x47f9c780-0x47fa9fff]
Zone ranges:
DMA32    [mem 0x0000000040000000-0x0000000047ffffff]
Normal   empty
Movable zone start for each node
Early memory node ranges
node   0: [mem 0x0000000040000000-0x0000000047ffffff]
Initmem setup node 0 [mem 0x0000000040000000-0x0000000047ffffff]
psci: probing for conduit method from DT.
psci: PSCIv0.2 detected in firmware.
psci: Using standard PSCI v0.2 function IDs
psci: Trusted OS migration not required
percpu: Embedded 23 pages/cpu @(____ptrval____) s53528 r8192 d32488 u94208
Detected VIPT I-cache on CPU0
CPU features: enabling workaround for ARM erratum 843419
CPU features: detected: Kernel page table isolation (KPTI)
Built 1 zonelists, mobility grouping on.  Total pages: 32256
Policy zone: DMA32
Kernel command line: printk.time=0 console=ttyAMA0
>>> {'execute': 'quit'}
qemu received signal 9: aarch64-softmmu/qemu-system-aarch64 -chardev
socket,id=mon,path=/var/tmp/tmptpv0noew/qemu-6334-monitor.sock -mon
chardev=mon,mode=control -display none -vga none -machine virt -chardev
socket,id=console,path=/var/tmp/tmptpv0noew/qemu-6334-console.sock,server,nowait
-serial chardev:console -cpu cortex-a53 -kernel
/home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz
-append printk.time=0 console=ttyAMA0
DATA (filename=output.expected) => NOT FOUND (data sources: variant,
test, file)
DATA (filename=stdout.expected) => NOT FOUND (data sources: variant,
test, file)
DATA (filename=stderr.expected) => NOT FOUND (data sources: variant,
test, file)
Not logging /var/log/syslog (lack of permissions)
PASS
05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
Runner error occurred: Timeout reached
Original status: PASS
{'fail_class': None, 'name':
'05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt',
'timeout': 90, 'time_elapsed': 90.49569606781006, 'params': [],
'time_end': 1560365750.8509598, 'logdir':
'/home/travis/build/qemu/qemu/tests/results/job-2019-06-12T18.51-6779368/test-results/05-_home_travis_build_qemu_qemu_tests_acceptance_boot_linux_console.py_BootLinuxConsole.test_aarch64_virt',
'status': 'PASS', 'whiteboard': '', 'fail_reason': None, 'traceback':
None, 'job_unique_id': '6779368b0faa619be34d024bad5ee46367c44df0',
'class_name': 'BootLinuxConsole', 'paused': False, 'time_start':
1560365660.3552637, 'job_logdir':
'/home/travis/build/qemu/qemu/tests/results/job-2019-06-12T18.51-6779368',
'running': False, 'logfile':
'/home/travis/build/qemu/qemu/tests/results/job-2019-06-12T18.51-6779368/test-results/05-_home_travis_build_qemu_qemu_tests_acceptance_boot_linux_console.py_BootLinuxConsole.test_aarch64_virt/debug.log'}
File /etc/avocado/sysinfo/commands does not exist.
File /etc/avocado/sysinfo/files does not exist.
File /etc/avocado/sysinfo/profilers does not exist.
Journalctl collection failed: Command 'journalctl --quiet --lines 1
--output json' failed.
stdout: b''
stderr: b'No journal files were opened due to insufficient permissions.\n'
additional_info: None

Thanks,

Phil.

Re: [Qemu-devel] [PULL 6/6] travis: Make check-acceptance job more verbose

[Eduardo Habkost]

On Wed, Jun 12, 2019 at 10:49:18PM +0200, Philippe Mathieu-Daudé wrote:
> On 6/11/19 7:14 PM, Eduardo Habkost wrote:
> > It will help us debug issues when tests fail.
> > 
> > Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
> > ---
> >  .travis.yml | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> > 
> > diff --git a/.travis.yml b/.travis.yml
> > index b053a836a3..a08a7b7278 100644
> > --- a/.travis.yml
> > +++ b/.travis.yml
> > @@ -225,7 +225,7 @@ matrix:
> >      # Acceptance (Functional) tests
> >      - env:
> >          - CONFIG="--python=/usr/bin/python3 --target-list=x86_64-softmmu,mips-softmmu,mips64el-softmmu,aarch64-softmmu,arm-softmmu,s390x-softmmu,alpha-softmmu"
> > -        - TEST_CMD="make check-acceptance"
> > +        - TEST_CMD="make AVOCADO_SHOW=test check-acceptance"
> >        addons:
> >          apt:
> >            packages:
> > 
> 
> Cleber, can you help figuring what's wrong here?
> 
> https://travis-ci.org/qemu/qemu/jobs/544805900
> 
> The tests seems successfull, is it possible the verbose logging returns
> error to the shell even if the test succeed?

That's exactly what this patch does.  On my next pull request I
will replace this with Cleber's patch that dumps the error log
only if tests failed.

-- 
Eduardo

Re: [Qemu-devel] [PULL 6/6] travis: Make check-acceptance job more verbose

[Philippe Mathieu-Daudé]

On 6/12/19 10:52 PM, Eduardo Habkost wrote:
> On Wed, Jun 12, 2019 at 10:49:18PM +0200, Philippe Mathieu-Daudé wrote:
>> On 6/11/19 7:14 PM, Eduardo Habkost wrote:
>>> It will help us debug issues when tests fail.
>>>
>>> Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
>>> ---
>>>  .travis.yml | 2 +-
>>>  1 file changed, 1 insertion(+), 1 deletion(-)
>>>
>>> diff --git a/.travis.yml b/.travis.yml
>>> index b053a836a3..a08a7b7278 100644
>>> --- a/.travis.yml
>>> +++ b/.travis.yml
>>> @@ -225,7 +225,7 @@ matrix:
>>>      # Acceptance (Functional) tests
>>>      - env:
>>>          - CONFIG="--python=/usr/bin/python3 --target-list=x86_64-softmmu,mips-softmmu,mips64el-softmmu,aarch64-softmmu,arm-softmmu,s390x-softmmu,alpha-softmmu"
>>> -        - TEST_CMD="make check-acceptance"
>>> +        - TEST_CMD="make AVOCADO_SHOW=test check-acceptance"
>>>        addons:
>>>          apt:
>>>            packages:
>>>
>>
>> Cleber, can you help figuring what's wrong here?
>>
>> https://travis-ci.org/qemu/qemu/jobs/544805900
>>
>> The tests seems successfull, is it possible the verbose logging returns
>> error to the shell even if the test succeed?
> 
> That's exactly what this patch does.  On my next pull request I
> will replace this with Cleber's patch that dumps the error log
> only if tests failed.

Ah OK, this is annoying because now all Travis builds are marked as
failed. Maybe Peter can apply your patch directly to master as a build fix?

Re: [Qemu-devel] [PULL 6/6] travis: Make check-acceptance job more verbose

[Cleber Rosa]

On Wed, Jun 12, 2019 at 10:49:18PM +0200, Philippe Mathieu-Daudé wrote:
> On 6/11/19 7:14 PM, Eduardo Habkost wrote:
> > It will help us debug issues when tests fail.
> > 
> > Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
> > ---
> >  .travis.yml | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> > 
> > diff --git a/.travis.yml b/.travis.yml
> > index b053a836a3..a08a7b7278 100644
> > --- a/.travis.yml
> > +++ b/.travis.yml
> > @@ -225,7 +225,7 @@ matrix:
> >      # Acceptance (Functional) tests
> >      - env:
> >          - CONFIG="--python=/usr/bin/python3 --target-list=x86_64-softmmu,mips-softmmu,mips64el-softmmu,aarch64-softmmu,arm-softmmu,s390x-softmmu,alpha-softmmu"
> > -        - TEST_CMD="make check-acceptance"
> > +        - TEST_CMD="make AVOCADO_SHOW=test check-acceptance"
> >        addons:
> >          apt:
> >            packages:
> > 
> 
> Cleber, can you help figuring what's wrong here?
> 
> https://travis-ci.org/qemu/qemu/jobs/544805900
> 
> The tests seems successfull, is it possible the verbose logging returns
> error to the shell even if the test succeed?
>

There's some confusion here... To the best of my knowledge this failure is
not associated with Eduardo's change of the of the AVOCADO_SHOW variable.
This seems to be we hitting this:

  https://bugs.launchpad.net/qemu/+bug/1829779

Which was also discussed in other threads, such as:

  https://lists.gnu.org/archive/html/qemu-devel/2019-06/msg01254.html

We have identified two ways to work around this, and about two days
ago Eduardo and myself settled on one of them.  I'll send a patch in
a few.

> INIT
> 05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
> PARAMS (key=timeout, path=*, default=90) => 90
> Test metadata:
>   filename:
> /home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py
>   teststmpdir: /tmp/avocado_6tk1s4nz
>   workdir:
> /tmp/avocado_ifg2df04/avocado_job_zqdrt4ht/05-_home_travis_build_qemu_qemu_tests_acceptance_boot_linux_console.py_BootLinuxConsole.test_aarch64_virt
> START
> 05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
> DATA (filename=output.expected) => NOT FOUND (data sources: variant,
> test, file)
> PARAMS (key=arch, path=*, default=aarch64) => 'aarch64'
> PARAMS (key=qemu_bin, path=*,
> default=aarch64-softmmu/qemu-system-aarch64) =>
> 'aarch64-softmmu/qemu-system-aarch64'
> Fetching
> https://download.fedoraproject.org/pub/fedora/linux/releases/29/Everything/aarch64/os/images/pxeboot/vmlinuz
> ->
> /home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz.g3ehffso
> Retrieved URL
> "https://download.fedoraproject.org/pub/fedora/linux/releases/29/Everything/aarch64/os/images/pxeboot/vmlinuz":
> content-length 8623423, date: "Wed, 12 Jun 2019 18:54:21 GMT",
> last-modified: "Sun, 21 Oct 2018 00:43:09 GMT"
> VM launch command: 'aarch64-softmmu/qemu-system-aarch64 -chardev
> socket,id=mon,path=/var/tmp/tmptpv0noew/qemu-6334-monitor.sock -mon
> chardev=mon,mode=control -display none -vga none -machine virt -chardev
> socket,id=console,path=/var/tmp/tmptpv0noew/qemu-6334-console.sock,server,nowait
> -serial chardev:console -cpu cortex-a53 -kernel
> /home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz
> -append printk.time=0 console=ttyAMA0'
> >>> {'execute': 'qmp_capabilities'}
> <<< {'return': {}}
> Booting Linux on physical CPU 0x0000000000 [0x410fd034]
> Linux version 4.18.16-300.fc29.aarch64
> (mockbuild@buildvm-aarch64-02.arm.fedoraproject.org) (gcc version 8.2.1
> 20180801 (Red Hat 8.2.1-2) (GCC)) #1 SMP Sat Oct 20 23:12:22 UTC 2018
> Machine model: linux,dummy-virt
> efi: Getting EFI parameters from FDT:
> efi: UEFI not found.
> cma: Failed to reserve 64 MiB
> NUMA: No NUMA configuration found
> NUMA: Faking a node at [mem 0x0000000000000000-0x0000000047ffffff]
> NUMA: NODE_DATA [mem 0x47f9c780-0x47fa9fff]
> Zone ranges:
> DMA32    [mem 0x0000000040000000-0x0000000047ffffff]
> Normal   empty
> Movable zone start for each node
> Early memory node ranges
> node   0: [mem 0x0000000040000000-0x0000000047ffffff]
> Initmem setup node 0 [mem 0x0000000040000000-0x0000000047ffffff]
> psci: probing for conduit method from DT.
> psci: PSCIv0.2 detected in firmware.
> psci: Using standard PSCI v0.2 function IDs
> psci: Trusted OS migration not required
> percpu: Embedded 23 pages/cpu @(____ptrval____) s53528 r8192 d32488 u94208
> Detected VIPT I-cache on CPU0
> CPU features: enabling workaround for ARM erratum 843419
> CPU features: detected: Kernel page table isolation (KPTI)
> Built 1 zonelists, mobility grouping on.  Total pages: 32256
> Policy zone: DMA32
> Kernel command line: printk.time=0 console=ttyAMA0
> >>> {'execute': 'quit'}

Notice how QEMU gets stuck here.

- Cleber.

> qemu received signal 9: aarch64-softmmu/qemu-system-aarch64 -chardev
> socket,id=mon,path=/var/tmp/tmptpv0noew/qemu-6334-monitor.sock -mon
> chardev=mon,mode=control -display none -vga none -machine virt -chardev
> socket,id=console,path=/var/tmp/tmptpv0noew/qemu-6334-console.sock,server,nowait
> -serial chardev:console -cpu cortex-a53 -kernel
> /home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz
> -append printk.time=0 console=ttyAMA0
> DATA (filename=output.expected) => NOT FOUND (data sources: variant,
> test, file)
> DATA (filename=stdout.expected) => NOT FOUND (data sources: variant,
> test, file)
> DATA (filename=stderr.expected) => NOT FOUND (data sources: variant,
> test, file)
> Not logging /var/log/syslog (lack of permissions)
> PASS
> 05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
> Runner error occurred: Timeout reached
> Original status: PASS
> {'fail_class': None, 'name':
> '05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt',
> 'timeout': 90, 'time_elapsed': 90.49569606781006, 'params': [],
> 'time_end': 1560365750.8509598, 'logdir':
> '/home/travis/build/qemu/qemu/tests/results/job-2019-06-12T18.51-6779368/test-results/05-_home_travis_build_qemu_qemu_tests_acceptance_boot_linux_console.py_BootLinuxConsole.test_aarch64_virt',
> 'status': 'PASS', 'whiteboard': '', 'fail_reason': None, 'traceback':
> None, 'job_unique_id': '6779368b0faa619be34d024bad5ee46367c44df0',
> 'class_name': 'BootLinuxConsole', 'paused': False, 'time_start':
> 1560365660.3552637, 'job_logdir':
> '/home/travis/build/qemu/qemu/tests/results/job-2019-06-12T18.51-6779368',
> 'running': False, 'logfile':
> '/home/travis/build/qemu/qemu/tests/results/job-2019-06-12T18.51-6779368/test-results/05-_home_travis_build_qemu_qemu_tests_acceptance_boot_linux_console.py_BootLinuxConsole.test_aarch64_virt/debug.log'}
> File /etc/avocado/sysinfo/commands does not exist.
> File /etc/avocado/sysinfo/files does not exist.
> File /etc/avocado/sysinfo/profilers does not exist.
> Journalctl collection failed: Command 'journalctl --quiet --lines 1
> --output json' failed.
> stdout: b''
> stderr: b'No journal files were opened due to insufficient permissions.\n'
> additional_info: None
> 
> Thanks,
> 
> Phil.
> 

Re: [Qemu-devel] [PULL 6/6] travis: Make check-acceptance job more verbose

[Philippe Mathieu-Daudé]

On 6/13/19 12:47 AM, Cleber Rosa wrote:
> On Wed, Jun 12, 2019 at 10:49:18PM +0200, Philippe Mathieu-Daudé wrote:
>> On 6/11/19 7:14 PM, Eduardo Habkost wrote:
>>> It will help us debug issues when tests fail.
>>>
>>> Signed-off-by: Eduardo Habkost <ehabkost@redhat.com>
>>> ---
>>>  .travis.yml | 2 +-
>>>  1 file changed, 1 insertion(+), 1 deletion(-)
>>>
>>> diff --git a/.travis.yml b/.travis.yml
>>> index b053a836a3..a08a7b7278 100644
>>> --- a/.travis.yml
>>> +++ b/.travis.yml
>>> @@ -225,7 +225,7 @@ matrix:
>>>      # Acceptance (Functional) tests
>>>      - env:
>>>          - CONFIG="--python=/usr/bin/python3 --target-list=x86_64-softmmu,mips-softmmu,mips64el-softmmu,aarch64-softmmu,arm-softmmu,s390x-softmmu,alpha-softmmu"
>>> -        - TEST_CMD="make check-acceptance"
>>> +        - TEST_CMD="make AVOCADO_SHOW=test check-acceptance"
>>>        addons:
>>>          apt:
>>>            packages:
>>>
>>
>> Cleber, can you help figuring what's wrong here?
>>
>> https://travis-ci.org/qemu/qemu/jobs/544805900
>>
>> The tests seems successfull, is it possible the verbose logging returns
>> error to the shell even if the test succeed?
>>
> 
> There's some confusion here... To the best of my knowledge this failure is
> not associated with Eduardo's change of the of the AVOCADO_SHOW variable.
> This seems to be we hitting this:
> 
>   https://bugs.launchpad.net/qemu/+bug/1829779
> 
> Which was also discussed in other threads, such as:
> 
>   https://lists.gnu.org/archive/html/qemu-devel/2019-06/msg01254.html

Oh you are right, thanks for clearing this (and working on a fix!).

Regards,

Phil.

> 
> We have identified two ways to work around this, and about two days
> ago Eduardo and myself settled on one of them.  I'll send a patch in
> a few.
> 
>> INIT
>> 05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
>> PARAMS (key=timeout, path=*, default=90) => 90
>> Test metadata:
>>   filename:
>> /home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py
>>   teststmpdir: /tmp/avocado_6tk1s4nz
>>   workdir:
>> /tmp/avocado_ifg2df04/avocado_job_zqdrt4ht/05-_home_travis_build_qemu_qemu_tests_acceptance_boot_linux_console.py_BootLinuxConsole.test_aarch64_virt
>> START
>> 05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
>> DATA (filename=output.expected) => NOT FOUND (data sources: variant,
>> test, file)
>> PARAMS (key=arch, path=*, default=aarch64) => 'aarch64'
>> PARAMS (key=qemu_bin, path=*,
>> default=aarch64-softmmu/qemu-system-aarch64) =>
>> 'aarch64-softmmu/qemu-system-aarch64'
>> Fetching
>> https://download.fedoraproject.org/pub/fedora/linux/releases/29/Everything/aarch64/os/images/pxeboot/vmlinuz
>> ->
>> /home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz.g3ehffso
>> Retrieved URL
>> "https://download.fedoraproject.org/pub/fedora/linux/releases/29/Everything/aarch64/os/images/pxeboot/vmlinuz":
>> content-length 8623423, date: "Wed, 12 Jun 2019 18:54:21 GMT",
>> last-modified: "Sun, 21 Oct 2018 00:43:09 GMT"
>> VM launch command: 'aarch64-softmmu/qemu-system-aarch64 -chardev
>> socket,id=mon,path=/var/tmp/tmptpv0noew/qemu-6334-monitor.sock -mon
>> chardev=mon,mode=control -display none -vga none -machine virt -chardev
>> socket,id=console,path=/var/tmp/tmptpv0noew/qemu-6334-console.sock,server,nowait
>> -serial chardev:console -cpu cortex-a53 -kernel
>> /home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz
>> -append printk.time=0 console=ttyAMA0'
>>>>> {'execute': 'qmp_capabilities'}
>> <<< {'return': {}}
>> Booting Linux on physical CPU 0x0000000000 [0x410fd034]
>> Linux version 4.18.16-300.fc29.aarch64
>> (mockbuild@buildvm-aarch64-02.arm.fedoraproject.org) (gcc version 8.2.1
>> 20180801 (Red Hat 8.2.1-2) (GCC)) #1 SMP Sat Oct 20 23:12:22 UTC 2018
>> Machine model: linux,dummy-virt
>> efi: Getting EFI parameters from FDT:
>> efi: UEFI not found.
>> cma: Failed to reserve 64 MiB
>> NUMA: No NUMA configuration found
>> NUMA: Faking a node at [mem 0x0000000000000000-0x0000000047ffffff]
>> NUMA: NODE_DATA [mem 0x47f9c780-0x47fa9fff]
>> Zone ranges:
>> DMA32    [mem 0x0000000040000000-0x0000000047ffffff]
>> Normal   empty
>> Movable zone start for each node
>> Early memory node ranges
>> node   0: [mem 0x0000000040000000-0x0000000047ffffff]
>> Initmem setup node 0 [mem 0x0000000040000000-0x0000000047ffffff]
>> psci: probing for conduit method from DT.
>> psci: PSCIv0.2 detected in firmware.
>> psci: Using standard PSCI v0.2 function IDs
>> psci: Trusted OS migration not required
>> percpu: Embedded 23 pages/cpu @(____ptrval____) s53528 r8192 d32488 u94208
>> Detected VIPT I-cache on CPU0
>> CPU features: enabling workaround for ARM erratum 843419
>> CPU features: detected: Kernel page table isolation (KPTI)
>> Built 1 zonelists, mobility grouping on.  Total pages: 32256
>> Policy zone: DMA32
>> Kernel command line: printk.time=0 console=ttyAMA0
>>>>> {'execute': 'quit'}
> 
> Notice how QEMU gets stuck here.
> 
> - Cleber.
> 
>> qemu received signal 9: aarch64-softmmu/qemu-system-aarch64 -chardev
>> socket,id=mon,path=/var/tmp/tmptpv0noew/qemu-6334-monitor.sock -mon
>> chardev=mon,mode=control -display none -vga none -machine virt -chardev
>> socket,id=console,path=/var/tmp/tmptpv0noew/qemu-6334-console.sock,server,nowait
>> -serial chardev:console -cpu cortex-a53 -kernel
>> /home/travis/avocado/data/cache/by_location/e959d0e1dd72e77653e218e666198db1f3d0c213/vmlinuz
>> -append printk.time=0 console=ttyAMA0
>> DATA (filename=output.expected) => NOT FOUND (data sources: variant,
>> test, file)
>> DATA (filename=stdout.expected) => NOT FOUND (data sources: variant,
>> test, file)
>> DATA (filename=stderr.expected) => NOT FOUND (data sources: variant,
>> test, file)
>> Not logging /var/log/syslog (lack of permissions)
>> PASS
>> 05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
>> Runner error occurred: Timeout reached
[...]

Re: [Qemu-devel] [PULL 0/6] Python queue, 2019-06-11

[Peter Maydell]

On Tue, 11 Jun 2019 at 18:15, Eduardo Habkost <ehabkost@redhat.com> wrote:
>
> Changes from 2019-06-07: Python 2 deprecation and Python 3 check
> for 3.5+ were removed.
>
> The following changes since commit 219dca61ebf41625831d4f96a720852baf44b762:
>
>   Merge remote-tracking branch 'remotes/ehabkost/tags/x86-next-pull-request' into staging (2019-06-11 16:02:07 +0100)
>
> are available in the Git repository at:
>
>   git://github.com/ehabkost/qemu.git tags/python-next-pull-request
>
> for you to fetch changes up to 6d7a134da4afebe8551a69329478415cfb4cbe91:
>
>   travis: Make check-acceptance job more verbose (2019-06-11 14:13:09 -0300)
>
> ----------------------------------------------------------------
> Python queue, 2019-06-11
>
> * New boot_linux_console test cases (Philippe Mathieu-Daudé)
> * Make check-acceptance Travis job more verbose (Eduardo Habkost)
>
> ----------------------------------------------------------------


Applied, thanks.

Please update the changelog at https://wiki.qemu.org/ChangeLog/4.1
for any user-visible changes.

-- PMM

Re: [Qemu-devel] [PULL 0/6] Python queue, 2019-06-11

[Peter Maydell]

On Tue, 11 Jun 2019 at 18:15, Eduardo Habkost <ehabkost@redhat.com> wrote:
>
> Changes from 2019-06-07: Python 2 deprecation and Python 3 check
> for 3.5+ were removed.
>
> The following changes since commit 219dca61ebf41625831d4f96a720852baf44b762:
>
>   Merge remote-tracking branch 'remotes/ehabkost/tags/x86-next-pull-request' into staging (2019-06-11 16:02:07 +0100)
>
> are available in the Git repository at:
>
>   git://github.com/ehabkost/qemu.git tags/python-next-pull-request
>
> for you to fetch changes up to 6d7a134da4afebe8551a69329478415cfb4cbe91:
>
>   travis: Make check-acceptance job more verbose (2019-06-11 14:13:09 -0300)
>
> ----------------------------------------------------------------
> Python queue, 2019-06-11
>
> * New boot_linux_console test cases (Philippe Mathieu-Daudé)
> * Make check-acceptance Travis job more verbose (Eduardo Habkost)
>
> ----------------------------------------------------------------
>
> Eduardo Habkost (1):
>   travis: Make check-acceptance job more verbose
>
> Philippe Mathieu-Daudé (5):
>   tests/boot_linux_console: Let extract_from_deb handle various
>     compressions
>   BootLinuxConsoleTest: Do not log empty lines
>   BootLinuxConsoleTest: Test the SmartFusion2 board
>   BootLinuxConsoleTest: Test nanoMIPS kernels on the I7200 CPU
>   BootLinuxConsoleTest: Run kerneltests BusyBox on Malta

Hi -- it looks like the Travis check-acceptance run started
failing when this pull was merged. Could somebody have a look
at it, please?

https://travis-ci.org/qemu/qemu/jobs/544724911

thanks
-- PMM

Re: [Qemu-devel] [PULL 0/6] Python queue, 2019-06-11

[Cleber Rosa]

On Tue, Jun 18, 2019 at 02:27:29PM +0100, Peter Maydell wrote:
> On Tue, 11 Jun 2019 at 18:15, Eduardo Habkost <ehabkost@redhat.com> wrote:
> >
> > Changes from 2019-06-07: Python 2 deprecation and Python 3 check
> > for 3.5+ were removed.
> >
> > The following changes since commit 219dca61ebf41625831d4f96a720852baf44b762:
> >
> >   Merge remote-tracking branch 'remotes/ehabkost/tags/x86-next-pull-request' into staging (2019-06-11 16:02:07 +0100)
> >
> > are available in the Git repository at:
> >
> >   git://github.com/ehabkost/qemu.git tags/python-next-pull-request
> >
> > for you to fetch changes up to 6d7a134da4afebe8551a69329478415cfb4cbe91:
> >
> >   travis: Make check-acceptance job more verbose (2019-06-11 14:13:09 -0300)
> >
> > ----------------------------------------------------------------
> > Python queue, 2019-06-11
> >
> > * New boot_linux_console test cases (Philippe Mathieu-Daudé)
> > * Make check-acceptance Travis job more verbose (Eduardo Habkost)
> >
> > ----------------------------------------------------------------
> >
> > Eduardo Habkost (1):
> >   travis: Make check-acceptance job more verbose
> >
> > Philippe Mathieu-Daudé (5):
> >   tests/boot_linux_console: Let extract_from_deb handle various
> >     compressions
> >   BootLinuxConsoleTest: Do not log empty lines
> >   BootLinuxConsoleTest: Test the SmartFusion2 board
> >   BootLinuxConsoleTest: Test nanoMIPS kernels on the I7200 CPU
> >   BootLinuxConsoleTest: Run kerneltests BusyBox on Malta
> 
> Hi -- it looks like the Travis check-acceptance run started
> failing when this pull was merged. Could somebody have a look
> at it, please?
> 
> https://travis-ci.org/qemu/qemu/jobs/544724911
>
> thanks
> -- PMM

Hi Peter,

I'm looking at it.  Strangely enough, I don't see any error or
failures, but only a couple of skips (besides passes):

 PASS 01-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_x86_64_pc
 PASS 02-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_mips_malta
 PASS 03-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_mips64el_malta
 PASS 04-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_mips_malta_cpio
 PASS 05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
 PASS 06-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_arm_virt
 PASS 07-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_arm_emcraft_sf2
 PASS 08-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_s390x_s390_ccw_virtio
 PASS 09-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_alpha_clipper
 PASS 10-/home/travis/build/qemu/qemu/tests/acceptance/cpu_queries.py:QueryCPUModelExpansion.test
 PASS 11-/home/travis/build/qemu/qemu/tests/acceptance/empty_cpu_model.py:EmptyCPUModel.test
 PASS 12-/home/travis/build/qemu/qemu/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_exit_error_msg_with_linux_v3_6
 PASS 13-/home/travis/build/qemu/qemu/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_work_with_linux_v4_16
 SKIP 14-/home/travis/build/qemu/qemu/tests/acceptance/linux_ssh_mips_malta.py:LinuxSSH.test_mips_malta32eb_kernel3_2_0 -> TestSkipError: Running on Travis-CI
 SKIP 15-/home/travis/build/qemu/qemu/tests/acceptance/linux_ssh_mips_malta.py:LinuxSSH.test_mips_malta64el_kernel3_2_0 -> TestSkipError: Running on Travis-CI
 PASS 16-/home/travis/build/qemu/qemu/tests/acceptance/migration.py:Migration.test_migration_with_tcp_localhost
 PASS 17-/home/travis/build/qemu/qemu/tests/acceptance/version.py:Version.test_qmp_human_info_version
 PASS 18-/home/travis/build/qemu/qemu/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_conventional_devs
 PASS 19-/home/travis/build/qemu/qemu/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_modern_only_devs
 PASS 20-/home/travis/build/qemu/qemu/tests/acceptance/vnc.py:Vnc.test_no_vnc
 PASS 21-/home/travis/build/qemu/qemu/tests/acceptance/vnc.py:Vnc.test_no_vnc_change_password
 PASS 22-/home/travis/build/qemu/qemu/tests/acceptance/vnc.py:Vnc.test_vnc_change_password_requires_a_password
 PASS 23-/home/travis/build/qemu/qemu/tests/acceptance/vnc.py:Vnc.test_vnc_change_password

And Avocado *should* return 0 for those results (I tried it on my
system and this is indeed what I get).  I'm investigating other
possibilities and will let you know.

Regards,
- Cleber.

Re: [Qemu-devel] [PULL 0/6] Python queue, 2019-06-11

[Cleber Rosa]

On Tue, Jun 18, 2019 at 10:01:53AM -0400, Cleber Rosa wrote:
> On Tue, Jun 18, 2019 at 02:27:29PM +0100, Peter Maydell wrote:
> > On Tue, 11 Jun 2019 at 18:15, Eduardo Habkost <ehabkost@redhat.com> wrote:
> > >
> > > Changes from 2019-06-07: Python 2 deprecation and Python 3 check
> > > for 3.5+ were removed.
> > >
> > > The following changes since commit 219dca61ebf41625831d4f96a720852baf44b762:
> > >
> > >   Merge remote-tracking branch 'remotes/ehabkost/tags/x86-next-pull-request' into staging (2019-06-11 16:02:07 +0100)
> > >
> > > are available in the Git repository at:
> > >
> > >   git://github.com/ehabkost/qemu.git tags/python-next-pull-request
> > >
> > > for you to fetch changes up to 6d7a134da4afebe8551a69329478415cfb4cbe91:
> > >
> > >   travis: Make check-acceptance job more verbose (2019-06-11 14:13:09 -0300)
> > >
> > > ----------------------------------------------------------------
> > > Python queue, 2019-06-11
> > >
> > > * New boot_linux_console test cases (Philippe Mathieu-Daudé)
> > > * Make check-acceptance Travis job more verbose (Eduardo Habkost)
> > >
> > > ----------------------------------------------------------------
> > >
> > > Eduardo Habkost (1):
> > >   travis: Make check-acceptance job more verbose
> > >
> > > Philippe Mathieu-Daudé (5):
> > >   tests/boot_linux_console: Let extract_from_deb handle various
> > >     compressions
> > >   BootLinuxConsoleTest: Do not log empty lines
> > >   BootLinuxConsoleTest: Test the SmartFusion2 board
> > >   BootLinuxConsoleTest: Test nanoMIPS kernels on the I7200 CPU
> > >   BootLinuxConsoleTest: Run kerneltests BusyBox on Malta
> > 
> > Hi -- it looks like the Travis check-acceptance run started
> > failing when this pull was merged. Could somebody have a look
> > at it, please?
> > 
> > https://travis-ci.org/qemu/qemu/jobs/544724911
> >
> > thanks
> > -- PMM
> 
> Hi Peter,
> 
> I'm looking at it.  Strangely enough, I don't see any error or
> failures, but only a couple of skips (besides passes):
> 
>  PASS 01-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_x86_64_pc
>  PASS 02-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_mips_malta
>  PASS 03-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_mips64el_malta
>  PASS 04-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_mips_malta_cpio
>  PASS 05-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt
>  PASS 06-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_arm_virt
>  PASS 07-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_arm_emcraft_sf2
>  PASS 08-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_s390x_s390_ccw_virtio
>  PASS 09-/home/travis/build/qemu/qemu/tests/acceptance/boot_linux_console.py:BootLinuxConsole.test_alpha_clipper
>  PASS 10-/home/travis/build/qemu/qemu/tests/acceptance/cpu_queries.py:QueryCPUModelExpansion.test
>  PASS 11-/home/travis/build/qemu/qemu/tests/acceptance/empty_cpu_model.py:EmptyCPUModel.test
>  PASS 12-/home/travis/build/qemu/qemu/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_exit_error_msg_with_linux_v3_6
>  PASS 13-/home/travis/build/qemu/qemu/tests/acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_work_with_linux_v4_16
>  SKIP 14-/home/travis/build/qemu/qemu/tests/acceptance/linux_ssh_mips_malta.py:LinuxSSH.test_mips_malta32eb_kernel3_2_0 -> TestSkipError: Running on Travis-CI
>  SKIP 15-/home/travis/build/qemu/qemu/tests/acceptance/linux_ssh_mips_malta.py:LinuxSSH.test_mips_malta64el_kernel3_2_0 -> TestSkipError: Running on Travis-CI
>  PASS 16-/home/travis/build/qemu/qemu/tests/acceptance/migration.py:Migration.test_migration_with_tcp_localhost
>  PASS 17-/home/travis/build/qemu/qemu/tests/acceptance/version.py:Version.test_qmp_human_info_version
>  PASS 18-/home/travis/build/qemu/qemu/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_conventional_devs
>  PASS 19-/home/travis/build/qemu/qemu/tests/acceptance/virtio_version.py:VirtioVersionCheck.test_modern_only_devs
>  PASS 20-/home/travis/build/qemu/qemu/tests/acceptance/vnc.py:Vnc.test_no_vnc
>  PASS 21-/home/travis/build/qemu/qemu/tests/acceptance/vnc.py:Vnc.test_no_vnc_change_password
>  PASS 22-/home/travis/build/qemu/qemu/tests/acceptance/vnc.py:Vnc.test_vnc_change_password_requires_a_password
>  PASS 23-/home/travis/build/qemu/qemu/tests/acceptance/vnc.py:Vnc.test_vnc_change_password
> 
> And Avocado *should* return 0 for those results (I tried it on my
> system and this is indeed what I get).  I'm investigating other
> possibilities and will let you know.
>
> Regards,
> - Cleber.

I take that back. The simple "egrep" I didn't show the interruption
during test tearDown() that ocurred here for aarch64:

 - https://travis-ci.org/qemu/qemu/jobs/544724911#L3909

And here for arm:

 - https://travis-ci.org/qemu/qemu/jobs/544724911#L3959

With the revert that Eduardo just proposed, it should be eaiser to see
that those tests actually finished with status INTERRUPTED.

Now, the core issue Which is this related to this:

 - https://bugs.launchpad.net/qemu/+bug/1829779

Some people contributed to discussions around this, and the general
outcome is that we need to workaround the current sitation in the
test code.  So, I'm working on a patch and will send ASAP.

- Cleber.