From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-12.5 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 59011C4361B for ; Thu, 10 Dec 2020 21:08:36 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id F140F22DBF for ; Thu, 10 Dec 2020 21:08:35 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org F140F22DBF Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.49920.88273 (Exim 4.92) (envelope-from ) id 1knTAg-0002sx-Kq; Thu, 10 Dec 2020 21:08:18 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 49920.88273; Thu, 10 Dec 2020 21:08:18 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1knTAg-0002sq-Gt; Thu, 10 Dec 2020 21:08:18 +0000 Received: by outflank-mailman (input) for mailman id 49920; Thu, 10 Dec 2020 21:08:16 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1knTAe-0002sl-Ph for xen-devel@lists.xenproject.org; Thu, 10 Dec 2020 21:08:16 +0000 Received: from mail.kernel.org (unknown [198.145.29.99]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 23a2b38f-d31d-469a-8a06-b7fb7a38cfc7; Thu, 10 Dec 2020 21:08:16 +0000 (UTC) X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: 23a2b38f-d31d-469a-8a06-b7fb7a38cfc7 Date: Thu, 10 Dec 2020 13:08:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1607634495; bh=f0+B46ne+W0cDoni+oCaiX6Lb/zEDd88jj5OahkV8GY=; h=From:To:cc:Subject:In-Reply-To:References:From; b=GEDiMAzM5txj/HavJrVIwc6L+aQZ+96gHeGfnWgXt8dGQVVxJLx1xHOz5dQYfztHo gJd7QfWPM2+wTOPYDd4epfRWR1B7IUuFdfWIRPLULOrhVtTdJeBpJfUkdFCYVBPUBa 8TsgrFtSc08xpaYspRE0BpLZSE7vZiqoO+NkebleikrxbKM97ziuuFWcnCU4/v2MjN Q33QqVyoMp52RGGUqgnPTguLoubQfx4j1GFfmlR1MfJBQxm8xx0i91DdWz7tO1rWX6 1Ey5MXZhNQiaJURStJDxpdXOKgeD5EbIlx3DzcPbmKFx3YcRFGmagTYdzQHaZe5ioI f0nfV7MElEPmQ== From: Stefano Stabellini X-X-Sender: sstabellini@sstabellini-ThinkPad-T480s To: Wei Liu , cardoe@cardoe.com cc: Stefano Stabellini , xen-devel@lists.xenproject.org, famzheng@amazon.com, Bertrand.Marquis@arm.com, julien@xen.org, andrew.cooper3@citrix.com Subject: gitlab-docker-machine-oyster failure, Was: [PATCH v6 00/25] xl / libxl: named PCI pass-through devices In-Reply-To: <20201210155638.mxjx4zmjqmcpk7z3@liuwe-devbox-debian-v2> Message-ID: References: <160746448732.12203.10647684023172140005@600e7e483b3a> <20201209161433.d7xpx5zwtikd3fmk@liuwe-devbox-debian-v2> <20201210155638.mxjx4zmjqmcpk7z3@liuwe-devbox-debian-v2> User-Agent: Alpine 2.21 (DEB 202 2017-01-01) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Hi Doug, After chatting with Wei on IRC, it became obvious that the issue is that gitlab-docker-machine-oyster failed, see its grey status here under "Runners": https://gitlab.com/xen-project/patchew/xen/-/settings/ci_cd Maybe it is just a matter of rebooting the VM? Doug, could you give it a try? Thank you! Cheers, Stefano On Thu, 10 Dec 2020, Wei Liu wrote: > On Wed, Dec 09, 2020 at 06:41:03PM -0800, Stefano Stabellini wrote: > > On Wed, 9 Dec 2020, Stefano Stabellini wrote: > > > On Wed, 9 Dec 2020, Wei Liu wrote: > > > > On Tue, Dec 08, 2020 at 05:02:50PM -0800, Stefano Stabellini wrote: > > > > > The pipeline failed because the "fedora-gcc-debug" build failed with a > > > > > timeout: > > > > > > > > > > ERROR: Job failed: execution took longer than 1h0m0s seconds > > > > > > > > > > given that all the other jobs passed (including the other Fedora job), I > > > > > take this failed because the gitlab-ci x86 runners were overloaded? > > > > > > > > > > > > > The CI system is configured to auto-scale as the number of jobs grows. > > > > The limit is set to 10 (VMs) at the moment. > > > > > > > > https://gitlab.com/xen-project/xen-gitlab-ci/-/commit/832bfd72ea3a227283bf3df88b418a9aae95a5a4 > > > > > > > > I haven't looked at the log, but the number of build jobs looks rather > > > > larger than when we get started. Maybe the limit of 10 is not good > > > > enough? > > > > > > Interesting! That's only for the x86 runners, not the ARM runners (we > > > only have 1 ARM64 runner), is that right? > > > > > > If we could increase the number of VMs for x86 I think that would be > > > helpful because we have very many x86 jobs. > > > > I don't know what is going on but at the moment there seems to be only > > one x86 build active > > (https://gitlab.com/xen-project/patchew/xen/-/pipelines/227280736). > > Should there be at least 3 of them? > > Not sure what you meant here. That pipeline is green. > > It may take some time for the CI to scale up if it is "cold". By default > there is only 1 standby runner to reduce cost.