[Qemu-devel] [PATCH] Add a gitlab-ci file for Continuous Integration testing on Gitlab

[Qemu-devel] [PATCH] Add a gitlab-ci file for Continuous Integration testing on Gitlab

[Thomas Huth]

This is very convenient for people who store their QEMU git trees on
gitlab.com: Automatic CI pipelines are now run for each branch that is
pushed to the server. Since the runtime of the jobs is limited to 1h
we distribute the targets into multiple pipelines - this way the jobs
finish within 30 minutes.

Signed-off-by: Thomas Huth <thuth@redhat.com>
---
 In case somebody is interested, the result looks e.g. like this on gitlab:
 https://gitlab.com/huth/qemu/pipelines/29255979

 .gitlab-ci.yml | 48 ++++++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 48 insertions(+)
 create mode 100644 .gitlab-ci.yml

diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml
new file mode 100644
index 0000000..18a77bc
--- /dev/null
+++ b/.gitlab-ci.yml
@@ -0,0 +1,48 @@
+before_script:
+ - apt-get update -qq
+ - apt-get install -y -qq flex bison libglib2.0-dev libpixman-1-dev
+
+build-system1:
+ script:
+ - apt-get install -y -qq libgtk-3-dev libvte-dev nettle-dev libcacard-dev
+      libusb-dev libvde-dev libspice-protocol-dev libgl1-mesa-dev
+ - ./configure --enable-werror --target-list="aarch64-softmmu alpha-softmmu
+      cris-softmmu hppa-softmmu lm32-softmmu moxie-softmmu microblazeel-softmmu
+      microblaze-softmmu mips-softmmu mips64el-softmmu m68k-softmmu ppc-softmmu"
+ - make -j2
+ - make -j2 check
+
+build-system2:
+ script:
+ - apt-get install -y -qq libsdl2-dev libgcrypt-dev libbrlapi-dev libaio-dev
+      libfdt-dev liblzo2-dev librdmacm-dev libibverbs-dev libibumad-dev
+ - ./configure --enable-werror --target-list="tricore-softmmu unicore32-softmmu
+      riscv32-softmmu riscv64-softmmu s390x-softmmu sh4-softmmu sparc-softmmu
+      sparc64-softmmu x86_64-softmmu xtensa-softmmu nios2-softmmu or1k-softmmu"
+ - make -j2
+ - make -j2 check
+
+build-clang:
+ script:
+ - apt-get install -y -qq clang libgtk-3-dev libsdl2-dev libbluetooth-dev
+      xfslibs-dev libiscsi-dev libnfs-dev libseccomp-dev gnutls-dev librbd-dev
+ - CC="clang" ./configure --enable-werror --target-list="tilegx-linux-user
+      arm-softmmu i386-softmmu ppc64-softmmu s390x-softmmu sparc-softmmu"
+ - make -j2
+ - make -j2 check
+
+build-disabled:
+ script:
+ - ./configure --enable-werror --disable-tcg --disable-slirp --disable-libxml2
+      --disable-capstone --disable-live-block-migration --disable-glusterfs
+      --disable-replication --disable-coroutine-pool --disable-smartcard
+      --disable-guest-agent --disable-curses --disable-curl --disable-tpm
+      --disable-qom-cast-debug --disable-spice --disable-vhost-vsock
+      --disable-vhost-net --disable-vhost-crypto --disable-vhost-user
+ - make -j2
+
+build-user:
+ script:
+ - ./configure --enable-werror --disable-system --disable-guest-agent
+ - make -j2
+ - make -j2 check
-- 
1.8.3.1

Re: [Qemu-devel] [PATCH] Add a gitlab-ci file for Continuous Integration testing on Gitlab

[Daniel P. Berrangé]

On Mon, Sep 03, 2018 at 05:08:46PM +0200, Thomas Huth wrote:
> This is very convenient for people who store their QEMU git trees on
> gitlab.com: Automatic CI pipelines are now run for each branch that is
> pushed to the server. Since the runtime of the jobs is limited to 1h
> we distribute the targets into multiple pipelines - this way the jobs
> finish within 30 minutes.
> 
> Signed-off-by: Thomas Huth <thuth@redhat.com>
> ---
>  In case somebody is interested, the result looks e.g. like this on gitlab:
>  https://gitlab.com/huth/qemu/pipelines/29255979
> 
>  .gitlab-ci.yml | 48 ++++++++++++++++++++++++++++++++++++++++++++++++
>  1 file changed, 48 insertions(+)
>  create mode 100644 .gitlab-ci.yml
> 
> diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml
> new file mode 100644
> index 0000000..18a77bc
> --- /dev/null
> +++ b/.gitlab-ci.yml
> @@ -0,0 +1,48 @@
> +before_script:
> + - apt-get update -qq
> + - apt-get install -y -qq flex bison libglib2.0-dev libpixman-1-dev
> +
> +build-system1:
> + script:
> + - apt-get install -y -qq libgtk-3-dev libvte-dev nettle-dev libcacard-dev
> +      libusb-dev libvde-dev libspice-protocol-dev libgl1-mesa-dev
> + - ./configure --enable-werror --target-list="aarch64-softmmu alpha-softmmu
> +      cris-softmmu hppa-softmmu lm32-softmmu moxie-softmmu microblazeel-softmmu
> +      microblaze-softmmu mips-softmmu mips64el-softmmu m68k-softmmu ppc-softmmu"
> + - make -j2
> + - make -j2 check

Hmm, we already have a problem with the travis CI bulds that we're stuck
on outdated Ubuntu.

We also already have a set of dockerfiles in tests/docker/ for various
build configs maintaniers are expected to use.

Both Travis and GitLab CI are capable of using docker images.

What's blocking us in both Travis & GitLab cases is that we're not
publishing the docker images for QEMU yet. If we can get that working,
then all the CI can use pre-build docker images, saving the time
for downloading the same DPKG files each time, as the docker images
would be cached by the CI system IIUC.

The other reason I think it would be desirable is to get more consistency
between the various build systems used in QEMU.

Regards,
Daniel
-- 
|: https://berrange.com      -o-    https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org         -o-            https://fstop138.berrange.com :|
|: https://entangle-photo.org    -o-    https://www.instagram.com/dberrange :|