From: Pavel Dovgalyuk <dovgaluk@ispras.ru>
To: "Alex Bennée" <alex.bennee@linaro.org>,
"Pavel Dovgalyuk" <Pavel.Dovgaluk@gmail.com>
Cc: wrampazz@redhat.com, qemu-devel@nongnu.org,
pavel.dovgaluk@ispras.ru, crosa@redhat.com, pbonzini@redhat.com,
philmd@redhat.com
Subject: Re: [PATCH v2 11/11] tests/acceptance: Linux boot test for record/replay
Date: Thu, 28 May 2020 09:17:49 +0300 [thread overview]
Message-ID: <817484e7-e2e7-2eef-92ad-c68e94a237c1@ispras.ru> (raw)
In-Reply-To: <87ftbl5nvt.fsf@linaro.org>
On 27.05.2020 19:44, Alex Bennée wrote:
> Pavel Dovgalyuk <Pavel.Dovgaluk@gmail.com> writes:
>
>> This patch adds a test for record/replay, which boots Linux
>> image from the disk and interacts with the network.
>> The idea and code of this test is borrowed from boot_linux.py
>> However, currently record/replay works only for x86_64,
>> therefore other tests were excluded.
>>
>> Each test consists of the following phases:
>> - downloading the disk image
>> - recording the execution
>> - replaying the execution
>>
>> Replay does not validates the output, but waits until QEMU
>> finishes the execution. This is reasonable, because
>> QEMU usually hangs when replay goes wrong.
> Two things:
>
> - We need to tag these tests as slow so they aren't run by default
Which flag is responsible for this?
> - 1800s is a long timeout to wait for to know it's a problem
Right, I just doubled boot_linux timeout. I think, that it could be reduced.
>
> Looking at the log shows my test is still running? Maybe we can check
> the output as we go?
How this could look like?
>
>> Signed-off-by: Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
>> ---
>> 0 files changed
>>
>> diff --git a/MAINTAINERS b/MAINTAINERS
>> index e9a9ce4f66..97f066a9b2 100644
>> --- a/MAINTAINERS
>> +++ b/MAINTAINERS
>> @@ -2498,6 +2498,7 @@ F: include/sysemu/replay.h
>> F: docs/replay.txt
>> F: stubs/replay.c
>> F: tests/acceptance/replay_kernel.py
>> +F: tests/acceptance/replay_linux.py
>>
>> IOVA Tree
>> M: Peter Xu <peterx@redhat.com>
>> diff --git a/tests/acceptance/replay_linux.py b/tests/acceptance/replay_linux.py
>> new file mode 100644
>> index 0000000000..7c5971f156
>> --- /dev/null
>> +++ b/tests/acceptance/replay_linux.py
>> @@ -0,0 +1,97 @@
>> +# Record/replay test that boots a complete Linux system via a cloud image
>> +#
>> +# Copyright (c) 2020 ISP RAS
>> +#
>> +# Author:
>> +# Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
>> +#
>> +# This work is licensed under the terms of the GNU GPL, version 2 or
>> +# later. See the COPYING file in the top-level directory.
>> +
>> +import os
>> +
>> +from avocado.utils import cloudinit
>> +from avocado.utils import network
>> +from avocado.utils import vmimage
>> +from avocado.utils import datadrainer
>> +from avocado.utils.path import find_command
>> +from boot_linux import BootLinuxBase
>> +
>> +class ReplayLinux(BootLinuxBase):
>> + """
>> + Boots a Linux system, checking for a successful initialization
>> + """
>> +
>> + timeout = 1800
>> + chksum = None
>> + hdd = 'ide-hd'
>> + cd = 'ide-cd'
>> + bus = 'ide'
>> +
>> + def setUp(self):
>> + super(ReplayLinux, self).setUp()
>> + self.boot_path = self.download_boot()
>> + self.cloudinit_path = self.download_cloudinit()
>> +
>> + def vm_add_disk(self, vm, path, id, device):
>> + bus_string = ''
>> + if self.bus:
>> + bus_string = ',bus=%s.%d' % (self.bus, id,)
>> + vm.add_args('-drive', 'file=%s,snapshot,id=disk%s,if=none' % (path, id))
>> + vm.add_args('-drive', 'driver=blkreplay,id=disk%s-rr,if=none,image=disk%s' % (id, id))
>> + vm.add_args('-device', '%s,drive=disk%s-rr%s' % (device, id, bus_string))
>> +
>> + def launch_and_wait(self, record, args, shift):
>> + vm = self.get_vm()
>> + vm.add_args('-smp', '1')
>> + vm.add_args('-m', '1024')
>> + vm.add_args('-object', 'filter-replay,id=replay,netdev=hub0port0')
>> + if args:
>> + vm.add_args(*args)
>> + self.vm_add_disk(vm, self.boot_path, 0, self.hdd)
>> + self.vm_add_disk(vm, self.cloudinit_path, 1, self.cd)
>> + if record:
>> + mode = 'record'
>> + else:
>> + mode = 'replay'
>> + vm.add_args('-icount', 'shift=%s,rr=%s,rrfile=%s' %
>> + (shift, mode, os.path.join(self.workdir, 'replay.bin')))
>> +
>> + vm.set_console()
>> + vm.launch()
>> + console_drainer = datadrainer.LineLogger(vm.console_socket.fileno(),
>> + logger=self.log.getChild('console'),
>> + stop_check=(lambda : not vm.is_running()))
>> + console_drainer.start()
>> + if record:
>> + self.log.info('VM launched, waiting for boot confirmation from guest')
>> + cloudinit.wait_for_phone_home(('0.0.0.0', self.phone_home_port), self.name)
>> + vm.shutdown()
>> + else:
>> + self.log.info('VM launched, waiting the recorded execution to be replayed')
>> + vm.wait()
>> +
>> + def run_rr(self, args=None, shift=7):
>> + self.launch_and_wait(True, args, shift)
>> + self.launch_and_wait(False, args, shift)
>> +
>> +class ReplayLinuxX8664(ReplayLinux):
>> + """
>> + :avocado: tags=arch:x86_64
>> + """
>> +
>> + chksum = 'e3c1b309d9203604922d6e255c2c5d098a309c2d46215d8fc026954f3c5c27a0'
>> +
>> + def test_pc_i440fx(self):
>> + """
>> + :avocado: tags=machine:pc
>> + :avocado: tags=accel:tcg
>> + """
>> + self.run_rr(shift=1)
>> +
>> + def test_pc_q35(self):
>> + """
>> + :avocado: tags=machine:q35
>> + :avocado: tags=accel:tcg
>> + """
>> + self.run_rr(shift=3)
>
next prev parent reply other threads:[~2020-05-28 6:18 UTC|newest]
Thread overview: 38+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-05-27 10:30 [PATCH v2 00/11] Record/replay acceptance tests Pavel Dovgalyuk
2020-05-27 10:30 ` [PATCH v2 01/11] tests/acceptance: allow console interaction with specific VMs Pavel Dovgalyuk
2020-05-27 14:20 ` Alex Bennée
2020-05-27 14:42 ` Willian Rampazzo
2020-05-27 10:30 ` [PATCH v2 02/11] tests/acceptance: refactor boot_linux_console test to allow code reuse Pavel Dovgalyuk
2020-05-27 14:31 ` Alex Bennée
2020-05-27 10:30 ` [PATCH v2 03/11] tests/acceptance: add base class record/replay kernel tests Pavel Dovgalyuk
2020-05-27 14:41 ` Philippe Mathieu-Daudé
2020-05-27 15:20 ` Alex Bennée
2020-05-28 7:19 ` Pavel Dovgalyuk
2020-05-28 8:28 ` Alex Bennée
2020-05-29 5:58 ` Pavel Dovgalyuk
2020-05-27 10:31 ` [PATCH v2 04/11] tests/acceptance: add kernel record/replay test for x86_64 Pavel Dovgalyuk
2020-05-27 14:53 ` Philippe Mathieu-Daudé
2020-05-28 7:12 ` Pavel Dovgalyuk
2020-05-28 8:38 ` Philippe Mathieu-Daudé
2020-05-28 11:07 ` Alex Bennée
2020-05-28 11:32 ` Philippe Mathieu-Daudé
2020-05-27 15:40 ` Alex Bennée
2020-05-27 16:20 ` Alex Bennée
2020-05-28 7:26 ` Pavel Dovgalyuk
2020-05-27 15:41 ` Alex Bennée
2020-05-28 6:12 ` Pavel Dovgalyuk
2020-05-28 13:26 ` Alex Bennée
2020-05-29 5:56 ` Pavel Dovgalyuk
2020-05-29 9:20 ` Alex Bennée
2020-05-27 10:31 ` [PATCH v2 05/11] tests/acceptance: add record/replay test for aarch64 Pavel Dovgalyuk
2020-05-27 14:44 ` Philippe Mathieu-Daudé
2020-05-27 10:31 ` [PATCH v2 06/11] tests/acceptance: add record/replay test for arm Pavel Dovgalyuk
2020-05-27 10:31 ` [PATCH v2 07/11] tests/acceptance: add record/replay test for ppc64 Pavel Dovgalyuk
2020-05-27 10:31 ` [PATCH v2 08/11] tests/acceptance: add record/replay test for m68k Pavel Dovgalyuk
2020-05-27 10:31 ` [PATCH v2 09/11] tests/acceptance: record/replay tests with advcal images Pavel Dovgalyuk
2020-05-27 10:31 ` [PATCH v2 10/11] tests/acceptance: refactor boot_linux to allow code reuse Pavel Dovgalyuk
2020-05-27 10:31 ` [PATCH v2 11/11] tests/acceptance: Linux boot test for record/replay Pavel Dovgalyuk
2020-05-27 16:44 ` Alex Bennée
2020-05-28 6:17 ` Pavel Dovgalyuk [this message]
2020-05-27 13:41 ` [PATCH v2 00/11] Record/replay acceptance tests no-reply
2020-05-27 14:53 ` Philippe Mathieu-Daudé
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=817484e7-e2e7-2eef-92ad-c68e94a237c1@ispras.ru \
--to=dovgaluk@ispras.ru \
--cc=Pavel.Dovgaluk@gmail.com \
--cc=alex.bennee@linaro.org \
--cc=crosa@redhat.com \
--cc=pavel.dovgaluk@ispras.ru \
--cc=pbonzini@redhat.com \
--cc=philmd@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=wrampazz@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).