All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Alex Bennée" <alex.bennee@linaro.org>
To: qemu-devel@nongnu.org
Cc: fam@euphon.net, berrange@redhat.com,
	"Robert Foley" <robert.foley@linaro.org>,
	"Philippe Mathieu-Daudé" <philmd@redhat.com>,
	richard.henderson@linaro.org, f4bug@amsat.org,
	"Alex Bennée" <alex.bennee@linaro.org>,
	cota@braap.org, aurelien@aurel32.net
Subject: [PATCH  v2 06/25] tests/vm: Add common Ubuntu python module
Date: Wed, 24 Jun 2020 15:04:27 +0100	[thread overview]
Message-ID: <20200624140446.15380-7-alex.bennee@linaro.org> (raw)
In-Reply-To: <20200624140446.15380-1-alex.bennee@linaro.org>

From: Robert Foley <robert.foley@linaro.org>

Add a common Ubuntu python module and make use of
it with the ubuntu.i386 script.
This is preparation for adding an Ubuntu script
ubuntu.aarch64.  Splitting out the common
logic such as build_image() will reduce duplication.

Signed-off-by: Robert Foley <robert.foley@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Message-Id: <20200601211421.1277-5-robert.foley@linaro.org>
---
 tests/vm/ubuntu.i386 | 46 +++++++++------------------------
 tests/vm/ubuntuvm.py | 60 ++++++++++++++++++++++++++++++++++++++++++++
 2 files changed, 72 insertions(+), 34 deletions(-)
 create mode 100644 tests/vm/ubuntuvm.py

diff --git a/tests/vm/ubuntu.i386 b/tests/vm/ubuntu.i386
index 24527cc78c7..5ce72610a6c 100755
--- a/tests/vm/ubuntu.i386
+++ b/tests/vm/ubuntu.i386
@@ -11,15 +11,22 @@
 # the COPYING file in the top-level directory.
 #
 
-import os
 import sys
-import subprocess
 import basevm
-import time
+import ubuntuvm
 
-class UbuntuX86VM(basevm.BaseVM):
+DEFAULT_CONFIG = {
+    'install_cmds' : "apt-get update,"\
+                     "apt-get build-dep -y qemu,"\
+                     "apt-get install -y libfdt-dev language-pack-en",
+}
+
+class UbuntuX86VM(ubuntuvm.UbuntuVM):
     name = "ubuntu.i386"
     arch = "i386"
+    image_link="https://cloud-images.ubuntu.com/releases/bionic/"\
+               "release-20191114/ubuntu-18.04-server-cloudimg-i386.img"
+    image_sha256="28969840626d1ea80bb249c08eef1a4533e8904aa51a327b40f37ac4b4ff04ef"
     BUILD_SCRIPT = """
         set -e;
         cd $(mktemp -d);
@@ -29,34 +36,5 @@ class UbuntuX86VM(basevm.BaseVM):
         make --output-sync {target} -j{jobs} {verbose};
     """
 
-    def build_image(self, img):
-        cimg = self._download_with_cache(
-            "https://cloud-images.ubuntu.com/releases/bionic/release-20191114/ubuntu-18.04-server-cloudimg-i386.img",
-            sha256sum="28969840626d1ea80bb249c08eef1a4533e8904aa51a327b40f37ac4b4ff04ef")
-        img_tmp = img + ".tmp"
-        subprocess.check_call(["cp", "-f", cimg, img_tmp])
-        self.exec_qemu_img("resize", img_tmp, "50G")
-        self.boot(img_tmp, extra_args = [
-            "-device", "VGA",
-            "-cdrom", self.gen_cloud_init_iso()
-        ])
-        self.wait_ssh()
-        self.ssh_root_check("touch /etc/cloud/cloud-init.disabled")
-        self.ssh_root_check("apt-get update")
-        self.ssh_root_check("apt-get install -y cloud-initramfs-growroot")
-        # Don't check the status in case the guest hang up too quickly
-        self.ssh_root("sync && reboot")
-        time.sleep(5)
-        self.wait_ssh()
-        # The previous update sometimes doesn't survive a reboot, so do it again
-        self.ssh_root_check("sed -ie s/^#\ deb-src/deb-src/g /etc/apt/sources.list")
-        self.ssh_root_check("apt-get update")
-        self.ssh_root_check("apt-get build-dep -y qemu")
-        self.ssh_root_check("apt-get install -y libfdt-dev language-pack-en")
-        self.ssh_root("poweroff")
-        self.wait()
-        os.rename(img_tmp, img)
-        return 0
-
 if __name__ == "__main__":
-    sys.exit(basevm.main(UbuntuX86VM))
+    sys.exit(basevm.main(UbuntuX86VM, DEFAULT_CONFIG))
diff --git a/tests/vm/ubuntuvm.py b/tests/vm/ubuntuvm.py
new file mode 100644
index 00000000000..6689ad87aa8
--- /dev/null
+++ b/tests/vm/ubuntuvm.py
@@ -0,0 +1,60 @@
+#!/usr/bin/env python3
+#
+# Ubuntu VM testing library
+#
+# Copyright 2017 Red Hat Inc.
+# Copyright 2020 Linaro
+#
+# Authors:
+#  Robert Foley <robert.foley@linaro.org>
+#  Originally based on ubuntu.i386 Fam Zheng <famz@redhat.com>
+#
+# This code is licensed under the GPL version 2 or later.  See
+# the COPYING file in the top-level directory.
+
+import os
+import subprocess
+import basevm
+
+class UbuntuVM(basevm.BaseVM):
+
+    def __init__(self, args, config=None):
+        self.login_prompt = "ubuntu-{}-guest login:".format(self.arch)
+        basevm.BaseVM.__init__(self, args, config)
+
+    def build_image(self, img):
+        """Build an Ubuntu VM image.  The child class will
+           define the install_cmds to init the VM."""
+        os_img = self._download_with_cache(self.image_link,
+                                           sha256sum=self.image_sha256)
+        img_tmp = img + ".tmp"
+        subprocess.check_call(["cp", "-f", os_img, img_tmp])
+        self.exec_qemu_img("resize", img_tmp, "+50G")
+        ci_img = self.gen_cloud_init_iso()
+
+        self.boot(img_tmp, extra_args = [ "-device", "VGA", "-cdrom", ci_img, ])
+
+        # First command we issue is fix for slow ssh login.
+        self.wait_ssh(wait_root=True,
+                      cmd="chmod -x /etc/update-motd.d/*")
+        # Wait for cloud init to finish
+        self.wait_ssh(wait_root=True,
+                      cmd="ls /var/lib/cloud/instance/boot-finished")
+        self.ssh_root("touch /etc/cloud/cloud-init.disabled")
+        # Disable auto upgrades.
+        # We want to keep the VM system state stable.
+        self.ssh_root('sed -ie \'s/"1"/"0"/g\' '\
+                      '/etc/apt/apt.conf.d/20auto-upgrades')
+        self.ssh_root("sed -ie s/^#\ deb-src/deb-src/g /etc/apt/sources.list")
+
+        # If the user chooses not to do the install phase,
+        # then we will jump right to the graceful shutdown
+        if self._config['install_cmds'] != "":
+            # Issue the install commands.
+            # This can be overriden by the user in the config .yml.
+            install_cmds = self._config['install_cmds'].split(',')
+            for cmd in install_cmds:
+                self.ssh_root(cmd)
+        self.graceful_shutdown()
+        os.rename(img_tmp, img)
+        return 0
-- 
2.20.1



  parent reply	other threads:[~2020-06-24 14:07 UTC|newest]

Thread overview: 33+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-06-24 14:04 [PATCH v2 00/25] testing/next (vm, gitlab, docker) Alex Bennée
2020-06-24 14:04 ` [PATCH v2 01/25] iotests: Fix 051 output after qdev_init_nofail() removal Alex Bennée
2020-07-03  8:07   ` Kevin Wolf
2020-07-03  9:52     ` Max Reitz
2020-07-03 10:02       ` Alex Bennée
2020-07-03 10:12         ` Max Reitz
2020-07-03 12:14       ` Kevin Wolf
2020-06-24 14:04 ` [PATCH v2 02/25] crypto/linux_keyring: fix 'secret_keyring' configure test Alex Bennée
2020-06-24 14:38   ` Thomas Huth
2020-06-24 14:04 ` [PATCH v2 03/25] tests/vm: pass args through to BaseVM's __init__ Alex Bennée
2020-06-24 14:04 ` [PATCH v2 04/25] tests/vm: Add configuration to basevm.py Alex Bennée
2020-06-24 14:04 ` [PATCH v2 05/25] tests/vm: Added configuration file support Alex Bennée
2020-06-24 14:04 ` Alex Bennée [this message]
2020-06-24 14:04 ` [PATCH v2 07/25] tests/vm: Added a new script for ubuntu.aarch64 Alex Bennée
2020-06-24 14:04 ` [PATCH v2 08/25] tests/vm: Added a new script for centos.aarch64 Alex Bennée
2020-06-24 14:04 ` [PATCH v2 09/25] tests/vm: change scripts to use self._config Alex Bennée
2020-06-24 14:04 ` [PATCH v2 10/25] python/qemu: Add ConsoleSocket for optional use in QEMUMachine Alex Bennée
2020-06-24 14:04 ` [PATCH v2 11/25] tests/vm: Add workaround to consume console Alex Bennée
2020-06-24 14:04 ` [PATCH v2 12/25] tests/vm: switch from optsparse to argparse Alex Bennée
2020-06-24 14:04 ` [PATCH v2 13/25] tests/vm: allow us to take advantage of MTTCG Alex Bennée
2020-06-24 14:04 ` [PATCH v2 14/25] tests/docker: check for an parameters not empty string Alex Bennée
2020-06-24 14:04 ` [PATCH v2 15/25] tests/docker: change tag naming scheme of our images Alex Bennée
2020-06-24 14:04 ` [PATCH v2 16/25] .gitignore: un-ignore .gitlab-ci.d Alex Bennée
2020-06-24 14:04 ` [PATCH v2 17/25] gitlab: introduce explicit "container" and "build" stages Alex Bennée
2020-06-24 14:04 ` [PATCH v2 18/25] gitlab: build all container images during CI Alex Bennée
2020-06-24 14:04 ` [PATCH v2 19/25] gitlab: convert jobs to use custom built containers Alex Bennée
2020-06-24 14:04 ` [PATCH v2 20/25] gitlab: build containers with buildkit and metadata Alex Bennée
2020-06-24 14:04 ` [PATCH v2 21/25] tests/docker: add --registry support to tooling Alex Bennée
2020-06-24 14:04 ` [PATCH v2 22/25] gitlab: add acceptance testing to system builds Alex Bennée
2020-06-24 14:04 ` [PATCH v2 23/25] gitlab: enable check-tcg for linux-user tests Alex Bennée
2020-06-24 14:04 ` [PATCH v2 24/25] gitlab: add avocado asset caching Alex Bennée
2020-06-24 14:56   ` Daniel P. Berrangé
2020-06-24 14:04 ` [PATCH v2 25/25] gitlab: split build-disabled into two phases Alex Bennée

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20200624140446.15380-7-alex.bennee@linaro.org \
    --to=alex.bennee@linaro.org \
    --cc=aurelien@aurel32.net \
    --cc=berrange@redhat.com \
    --cc=cota@braap.org \
    --cc=f4bug@amsat.org \
    --cc=fam@euphon.net \
    --cc=philmd@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=richard.henderson@linaro.org \
    --cc=robert.foley@linaro.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.