From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-12.9 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2D364C43457 for ; Thu, 15 Oct 2020 16:09:40 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id AA05922248 for ; Thu, 15 Oct 2020 16:09:39 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="pcoWROS+" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org AA05922248 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7547.19832 (Exim 4.92) (envelope-from ) id 1kT5on-0000o8-Jw; Thu, 15 Oct 2020 16:09:29 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7547.19832; Thu, 15 Oct 2020 16:09:29 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5on-0000nv-Fc; Thu, 15 Oct 2020 16:09:29 +0000 Received: by outflank-mailman (input) for mailman id 7547; Thu, 15 Oct 2020 16:09:28 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5om-0000mi-3O for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:28 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id dd437341-70cf-41f8-ab23-e7417d87276f; Thu, 15 Oct 2020 16:09:27 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ol-0000gl-0Z for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:27 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5ok-0006fE-W1 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:26 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WR-0000oB-0p; Thu, 15 Oct 2020 16:50:31 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5om-0000mi-3O for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:28 +0000 X-Inumbo-ID: dd437341-70cf-41f8-ab23-e7417d87276f Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id dd437341-70cf-41f8-ab23-e7417d87276f; Thu, 15 Oct 2020 16:09:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=Eb2yZLxvdxwd6Ruht+D5KNOOBqV7wkTSytbhDN+ksww=; b=pcoWROS+3Qx7axDTdPcbd1X2zg YDzlPXdGcMkg/HXAmGrVVr1QZWy5Wg8HIj+akL2PuMqCmwHJXN7xugVx+ur3oVxQWafXfeDn3qqjN TH8HThuWkxsRhpotYAAJwqkEuUNhqwu9ZJoGJdfmTGlNd3Jw8AMb1SPJthZQHHtL8hK4=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ol-0000gl-0Z for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:27 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5ok-0006fE-W1 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:26 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WR-0000oB-0p; Thu, 15 Oct 2020 16:50:31 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 17/17] cr-daily-branch: Heuristics for when to do immediate retest flight Date: Thu, 15 Oct 2020 16:50:19 +0100 Message-Id: <20201015155019.20705-18-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Do not do a retest if it would involve retesting more than 10% of the original flight, or if it wouldn't get a push even if the retests pass. Signed-off-by: Ian Jackson --- cr-daily-branch | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/cr-daily-branch b/cr-daily-branch index 9b1961bd..e54ca227 100755 --- a/cr-daily-branch +++ b/cr-daily-branch @@ -497,11 +497,26 @@ while true; do OSSTEST_IMMEDIATE_RETRY=false retry_jobs=$( perl <$mrof -wne ' + $n_blockers = $1 if m/^nblockers (\d+)\s*$/; + $n_jobs = $1 if m/^njobs (\d+)\s*$/; next unless m/^regression (\S+) /; my $j = $1; next if $j =~ m/^build/; $r{$j}++; + sub nope { + print STDERR "no retry: @_\n"; + exit 0; + } END { + my $n_retry_jobs = scalar(keys %r); + print STDERR <<"END"; +n_retry_jobs=$n_retry_jobs n_blockers=$n_blockers n_jobs=$n_jobs +END + nope("other blockers") if + $n_retry_jobs < $n_blockers; + nope("too many regressions") if + $n_retry_jobs > 1 && + $n_retry_jobs > $n_jobs/10; print "copy-jobs '$flight' $_ " foreach sort keys %r; }' -- 2.20.1