From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:48367) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fYZl9-0007gj-Le for qemu-devel@nongnu.org; Thu, 28 Jun 2018 12:27:08 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fYZl6-0005xU-Gj for qemu-devel@nongnu.org; Thu, 28 Jun 2018 12:27:03 -0400 Received: from mx3-rdu2.redhat.com ([66.187.233.73]:55196 helo=mx1.redhat.com) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1fYZl6-0005vD-B5 for qemu-devel@nongnu.org; Thu, 28 Jun 2018 12:27:00 -0400 References: <20180622004435.10291-1-f4bug@amsat.org> <87muvevrqt.fsf@linaro.org> From: Cleber Rosa Message-ID: <8f45f2f0-0e3e-7b0d-ff92-9fd21f1cb8f7@redhat.com> Date: Thu, 28 Jun 2018 12:26:56 -0400 MIME-Version: 1.0 In-Reply-To: <87muvevrqt.fsf@linaro.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable Subject: Re: [Qemu-devel] [PATCH v2 0/6] Avocado: start multi-arch tests, add a Travis job List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: =?UTF-8?Q?Alex_Benn=c3=a9e?= , =?UTF-8?Q?Philippe_Mathieu-Daud=c3=a9?= Cc: Eduardo Habkost , qemu-devel@nongnu.org, =?UTF-8?B?THVrw6HFoSBEb2t0b3I=?= , Fam Zheng , Aurelien Jarno On 06/28/2018 11:46 AM, Alex Benn=C3=A9e wrote: >=20 > Philippe Mathieu-Daud=C3=A9 writes: >=20 >> Hi, >> >> Another neanderthal approach to add multi-arch acceptance tests using >> Avocado. >> >> Since Cleber Rosa work got merged [0], I can restart my previous attem= pt [1] >> at using Avocado in QEMU. >> Cleber Rosa rewrote my previous v1 [1], in good python, now this v2 pu= shes >> a bit further: >> - we can now run other archs >> - Avocado is integrated into Travis CI >> >> I'm not sure Travis is the best CI available for those tests, but it r= uns >> quite fast: >> >> ... >> LINK x86_64-softmmu/qemu-system-x86_64 >> JOB ID : a3a56af3c02d193e862ce660aae1d9c72926dcb6 >> JOB LOG : /home/travis/avocado/job-results/job-2018-06-21T23.49= -a3a56af/job.log >> (1/7) tests/acceptance/boot_linux_console.py:BootLinuxConsoleX86_= 64.test: PASS (3.89 s) >> (2/7) tests/acceptance/boot_linux_console.py:BootLinuxConsoleMips= .test: PASS (1.83 s) >> (3/7) tests/acceptance/version.py:Version.test_qmp_human_info_ver= sion: PASS (0.05 s) >> (4/7) tests/acceptance/vnc.py:Vnc.test_no_vnc: PASS (0.04 s) >> (5/7) tests/acceptance/vnc.py:Vnc.test_no_vnc_change_password: P= ASS (0.04 s) >> (6/7) tests/acceptance/vnc.py:Vnc.test_vnc_change_password_requir= es_a_password: PASS (0.05 s) >> (7/7) tests/acceptance/vnc.py:Vnc.test_vnc_change_password: PASS= (0.05 s) >> RESULTS : PASS 7 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRU= PT 0 | CANCEL 0 >> JOB TIME : 6.21 s >=20 > Hmm however if I do: >=20 > pip install --user avocado-framework > avocado run tests/acceptance >=20 > I get: >=20 > Failed to load plugin from module "avocado_vt.plugins.vt_list": Impo= rtError('No module named netaddr',) > Failed to load plugin from module "avocado_vt.plugins.vt": ImportErr= or('No module named netaddr',) > Failed to load plugin from module "avocado_vt.plugins.vt_bootstrap":= OSError(13, 'Permission denied') Alex, These are errors related to your installation of Avocado-*VT*[1]. > Error running method "run" of plugin "virt": 'Namespace' object has = no attribute 'default_avocado_params' > Avocado crashed unexpectedly: [Errno 13] Permission denied: '/var/li= b/libvirt/images/avocado_sg6NRi' > You can find details in /var/tmp/avocado-traceback-2018-06-28_16:44:= 25-DGb1CG.log >=20 And these from Avocado-*Virt*[2]. Neither of those are used in the tests under "tests/acceptance". > Which I seem to remember from last time I looked into this. I think > avocado makes a bunch of assumptions about the filesystem and OS layout > which is hard to gloss over for something you should be able to run > straight out of the source tree. >=20 >=20 These Avocado-*VT* issues deserve a better look indeed. Would you please describe (if not here, under a GH issue) your environment? Thanks, - Cleber. [1] - https://github.com/avocado-framework/avocado-vt [2] - https://github.com/avocado-framework/avocado-virt >> >> Done. Your build exited with 0. >> >> Job ran for 5 min 34 sec >> >> I couldn't add the Alpha tests because all the vmlinux kernels I found >> online are gzipped, so I'm waiting some upstream Avocado merges before= . >> >> Cleber: I hope you can help me pythonizing this series :p >> >> Regards, >> >> Phil. >> >> [0]: http://lists.nongnu.org/archive/html/qemu-devel/2018-06/msg04531.= html >> [1]: http://lists.nongnu.org/archive/html/qemu-devel/2018-04/msg03076.= html >> >> Philippe Mathieu-Daud=C3=A9 (6): >> avocado: Add a Test.arch property >> tests/acceptance: Rename the x86-64 specific BootLinuxConsole test >> tests/acceptance: Improve the Avocado tags >> tests/acceptance: Add a BootLinuxConsoleMips test >> tests/acceptance: Add a kludge to not use the default console >> travis: Add Avocado tests >> >> .travis.yml | 8 +++++ >> scripts/qemu.py | 6 ++-- >> tests/acceptance/avocado_qemu/__init__.py | 17 ++++++--- >> tests/acceptance/boot_linux_console.py | 44 +++++++++++++++++++++-= - >> 4 files changed, 67 insertions(+), 8 deletions(-) >=20 >=20 > -- > Alex Benn=C3=A9e >=20 --=20 Cleber Rosa [ Sr Software Engineer - Virtualization Team - Red Hat ] [ Avocado Test Framework - avocado-framework.github.io ] [ 7ABB 96EB 8B46 B94D 5E0F E9BB 657E 8D33 A5F2 09F3 ]