Re: Notification of your branch being tested by zero day bot?

From: Steven Rostedt <rostedt@goodmis.org>
To: Philip Li <philip.li@intel.com>
Cc: Greg KH <gregkh@linuxfoundation.org>,
	lkp@intel.com,
	"workflows@vger.kernel.org" <workflows@vger.kernel.org>,
	oliver.sang@intel.com
Subject: Re: Notification of your branch being tested by zero day bot?
Date: Wed, 18 Sep 2019 09:38:22 -0400	[thread overview]
Message-ID: <20190918093822.7bc78236@gandalf.local.home> (raw)
In-Reply-To: <20190918073138.GA1295@intel.com>

On Wed, 18 Sep 2019 15:31:38 +0800
Philip Li <philip.li@intel.com> wrote:

> > On Thu, Sep 12, 2019 at 11:02:30AM -0400, Steven Rostedt wrote:  
> > > Would it be possible to have an opt-in for the zero day bot to send an
> > > email when a branch is being tested? Similar to the "SUCCESS" opt-in
> > > email.  
> do you mean something like BUILD start notification? This is good idea,
> we can support this.

That would be great.

> 
> > > 
> > > That is, it would be nice to see an email that lets you know that a
> > > branch you pushed to kernel.org is being tested. Currently there's a
> > > bit of limbo when a push happens, and you need to wait, perhaps several
> > > days, to see a result. In the mean time you have no idea if there's any
> > > progress going on. A notification would be nice.  
> > 
> > What is "implied" here is the fact that due to the flaky-ness of 0-day
> > these days, we really do not know if it is running or not.  
> sorry that 0day ci had issue in July time frame, but it was recovered
> from August to generate report continuously. We will keep monitoring the
> healthy status to avoid any inconvenience.
> 

Thanks.

> > 
> > Lately it seems like it is "not" running, but due to the lack of any
> > status, it's really hard to tell how long a maintainer should wait
> > before "giving up" on getting a timely response and just relying on
> > their own judgement.  
> Currently, if a repo is opt in for success notification, it will receive
> build incomplete if the full build test can't be done within 1 day.
> We will consider to enable this for all maintainer's repo.

Hmm, perhaps that should be opt-in as well. Not sure if every build
maintainer would like that notification. But we should definitely try
to find a way to inform those that would like to be notified. Several
developers have mentioned they were unaware of the SUCCESS notification
opt in, and would like to be added to it. Perhaps a one time email to
all maintainers not currently opt-in to the success notification to ask
them if they would like to be opted in, instead of just spamming them
with this information.

-- Steve