[PULL v2 00/22] Integration testing patches for 2021-09-27

[PULL v2 00/22] Integration testing patches for 2021-09-27

[Philippe Mathieu-Daudé]

The following changes since commit de8ed1055c2ce18c95f597eb10df360dcb534f99:

  Merge remote-tracking branch 'remotes/armbru/tags/pull-qapi-2021-09-25-v2' into staging (2021-09-27 15:03:42 +0100)

are available in the Git repository at:

  https://github.com/philmd/qemu.git tags/integration-testing-20210927

for you to fetch changes up to 4c5fc0c5fc496c147adb15536e4ac808feccf2cf:

  tests/acceptance: Test powernv machines (2021-09-27 19:21:37 +0200)

----------------------------------------------------------------
Integration testing patches

- More Linux kernel record/replay tests (Pavel Dovgalyuk)
- Various fixes (Willian Rampazzo, Cleber Rosa)
- Split machine_ppc.py per machine (David Gibson)
- Add AVOCADO_TESTS command line environment variable (Willian Rampazzo)
- Test PowerPC PowerNV 8/9 machines (Cédric Le Goater)

v2:
- Added missing test from Cédric.
----------------------------------------------------------------

Cleber Rosa (6):
  Acceptance Tests: add standard clean up at test tearDown()
  Acceptance Tests: improve check-acceptance description
  acceptance/tests/vnc.py: use explicit syntax for enabling passwords
  tests/acceptance/boot_xen.py: removed unused import
  tests/acceptance/ppc_prep_40p.py: NetBSD 7.1.2 location update
  tests/acceptance/ppc_prep_40p.py: clean up unused import

Cédric Le Goater (1):
  tests/acceptance: Test powernv machines

David Gibson (1):
  qemu: Split machine_ppc.py acceptance tests

Pavel Dovgalyuk (5):
  tests/acceptance: add replay kernel test for s390x
  tests/acceptance: add replay kernel test for openrisc
  tests/acceptance: add replay kernel test for nios2
  tests/acceptance: add replay kernel test for alpha
  tests/acceptance: Linux boot test for record/replay

Willian Rampazzo (9):
  Acceptance tests: add myself as a reviewer for the acceptance tests
  avocado_qemu: standardize super() call following PEP3135
  avocado_qemu: fix import module based on isort
  avocado_qemu: tweak ssh connect method
  avocado_qemu: explicitly return None to avoid R1710
  avocado_qemu: fix inheritance order on LinuxTest class
  tests/Makefile: allow control over tags during check-acceptance
  docs/devel/testing: add instruction to run a single acceptance test
  tests/Makefile: add AVOCADO_TESTS option to make check-acceptance

 docs/devel/testing.rst                    |  69 +++++++++++++
 MAINTAINERS                               |   6 +-
 tests/Makefile.include                    |  19 +++-
 tests/acceptance/avocado_qemu/__init__.py |  30 +++---
 tests/acceptance/boot_linux_console.py    |  35 +++++++
 tests/acceptance/boot_xen.py              |   1 -
 tests/acceptance/machine_ppc.py           |  69 -------------
 tests/acceptance/ppc_mpc8544ds.py         |  32 ++++++
 tests/acceptance/ppc_prep_40p.py          |   5 +-
 tests/acceptance/ppc_pseries.py           |  35 +++++++
 tests/acceptance/ppc_virtex_ml507.py      |  34 +++++++
 tests/acceptance/replay_kernel.py         |  54 ++++++++++
 tests/acceptance/replay_linux.py          | 116 ++++++++++++++++++++++
 tests/acceptance/vnc.py                   |   2 +-
 14 files changed, 409 insertions(+), 98 deletions(-)
 delete mode 100644 tests/acceptance/machine_ppc.py
 create mode 100644 tests/acceptance/ppc_mpc8544ds.py
 create mode 100644 tests/acceptance/ppc_pseries.py
 create mode 100644 tests/acceptance/ppc_virtex_ml507.py
 create mode 100644 tests/acceptance/replay_linux.py

-- 
2.31.1

[PULL v2 22/22] tests/acceptance: Test powernv machines

[Philippe Mathieu-Daudé]

From: Cédric Le Goater <clg@kaod.org>

Fetch the OpenPOWER images to boot the powernv8 and powernv9 machines
with a simple PCI layout.

Cc: Cleber Rosa <crosa@redhat.com>
Cc: Philippe Mathieu-Daudé <philmd@redhat.com>
Cc: Wainer dos Santos Moschetta <wainersm@redhat.com>
Signed-off-by: Cédric Le Goater <clg@kaod.org>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Tested-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Message-Id: <20210817093036.1288791-1-clg@kaod.org>
---
 tests/acceptance/boot_linux_console.py | 35 ++++++++++++++++++++++++++
 1 file changed, 35 insertions(+)

diff --git a/tests/acceptance/boot_linux_console.py b/tests/acceptance/boot_linux_console.py
index 0a49c0e2760..06fc967f6c4 100644
--- a/tests/acceptance/boot_linux_console.py
+++ b/tests/acceptance/boot_linux_console.py
@@ -1176,6 +1176,41 @@ def test_ppc64_e500(self):
         tar_hash = '6951d86d644b302898da2fd701739c9406527fe1'
         self.do_test_advcal_2018('19', tar_hash, 'uImage')
 
+    def do_test_ppc64_powernv(self, proc):
+        images_url = ('https://github.com/open-power/op-build/releases/download/v2.7/')
+
+        kernel_url = images_url + 'zImage.epapr'
+        kernel_hash = '0ab237df661727e5392cee97460e8674057a883c5f74381a128fa772588d45cd'
+        kernel_path = self.fetch_asset(kernel_url, asset_hash=kernel_hash,
+                                       algorithm='sha256')
+        self.vm.set_console()
+        self.vm.add_args('-kernel', kernel_path,
+                         '-append', 'console=tty0 console=hvc0',
+                         '-device', 'pcie-pci-bridge,id=bridge1,bus=pcie.1,addr=0x0',
+                         '-device', 'nvme,bus=pcie.2,addr=0x0,serial=1234',
+                         '-device', 'e1000e,bus=bridge1,addr=0x3',
+                         '-device', 'nec-usb-xhci,bus=bridge1,addr=0x2')
+        self.vm.launch()
+
+        self.wait_for_console_pattern("CPU: " + proc + " generation processor")
+        self.wait_for_console_pattern("zImage starting: loaded")
+        self.wait_for_console_pattern("Run /init as init process")
+        self.wait_for_console_pattern("Creating 1 MTD partitions")
+
+    def test_ppc_powernv8(self):
+        """
+        :avocado: tags=arch:ppc64
+        :avocado: tags=machine:powernv8
+        """
+        self.do_test_ppc64_powernv('P8')
+
+    def test_ppc_powernv9(self):
+        """
+        :avocado: tags=arch:ppc64
+        :avocado: tags=machine:powernv9
+        """
+        self.do_test_ppc64_powernv('P9')
+
     def test_ppc_g3beige(self):
         """
         :avocado: tags=arch:ppc
-- 
2.31.1

Re: [PULL v2 00/22] Integration testing patches for 2021-09-27

[Peter Maydell]

On Mon, 27 Sept 2021 at 18:43, Philippe Mathieu-Daudé <philmd@redhat.com> wrote:
>
> The following changes since commit de8ed1055c2ce18c95f597eb10df360dcb534f99:
>
>   Merge remote-tracking branch 'remotes/armbru/tags/pull-qapi-2021-09-25-v2' into staging (2021-09-27 15:03:42 +0100)
>
> are available in the Git repository at:
>
>   https://github.com/philmd/qemu.git tags/integration-testing-20210927
>
> for you to fetch changes up to 4c5fc0c5fc496c147adb15536e4ac808feccf2cf:
>
>   tests/acceptance: Test powernv machines (2021-09-27 19:21:37 +0200)
>
> ----------------------------------------------------------------
> Integration testing patches
>
> - More Linux kernel record/replay tests (Pavel Dovgalyuk)
> - Various fixes (Willian Rampazzo, Cleber Rosa)
> - Split machine_ppc.py per machine (David Gibson)
> - Add AVOCADO_TESTS command line environment variable (Willian Rampazzo)
> - Test PowerPC PowerNV 8/9 machines (Cédric Le Goater)
>
> v2:
> - Added missing test from Cédric.


Applied, thanks.

Please update the changelog at https://wiki.qemu.org/ChangeLog/6.2
for any user-visible changes.

-- PMM