Running arbitrary tests in CI

Running arbitrary tests in CI

[Matt Spinler]

Hi,

Following up to the thread that talks about being able to run extra 
tests in CI:
https://lists.ozlabs.org/pipermail/openbmc/2019-September/018329.html

I could definitely use something like this, so I am thinking of putting 
up the
commit to do the: run any run-ci.sh in the repo.

Are there any additional ideas or other comments on a way to do this?

Thanks

Re: Running arbitrary tests in CI

[Andrew Geissler]

> On Oct 24, 2019, at 9:25 AM, Matt Spinler <mspinler@linux.ibm.com> wrote:
> 
> Hi,
> 
> Following up to the thread that talks about being able to run extra tests in CI:
> https://lists.ozlabs.org/pipermail/openbmc/2019-September/018329.html
> 
> I could definitely use something like this, so I am thinking of putting up the
> commit to do the: run any run-ci.sh in the repo.
> 
> Are there any additional ideas or other comments on a way to do this?

Nothing from me. If you get the script in there, I’ll make the CI jenkins job
to call it.

> 
> Thanks

Re: Running arbitrary tests in CI

[Matt Spinler]

On 10/24/2019 9:30 AM, Andrew Geissler wrote:
>
>> On Oct 24, 2019, at 9:25 AM, Matt Spinler <mspinler@linux.ibm.com> wrote:
>>
>> Hi,
>>
>> Following up to the thread that talks about being able to run extra tests in CI:
>> https://lists.ozlabs.org/pipermail/openbmc/2019-September/018329.html
>>
>> I could definitely use something like this, so I am thinking of putting up the
>> commit to do the: run any run-ci.sh in the repo.
>>
>> Are there any additional ideas or other comments on a way to do this?
> Nothing from me. If you get the script in there, I’ll make the CI jenkins job
> to call it.
Just to clarify, I plan on adding this to unit-test.py so it will search 
for those scripts in
every repo automatically.

>> Thanks

Re: Running arbitrary tests in CI

[Shawn McCarney]

Sounds great to me.  I need something like this for what I'm working on.

On 10/24/2019 9:25 AM, Matt Spinler wrote:
> Hi,
>
> Following up to the thread that talks about being able to run extra 
> tests in CI:
> https://lists.ozlabs.org/pipermail/openbmc/2019-September/018329.html
>
> I could definitely use something like this, so I am thinking of 
> putting up the
> commit to do the: run any run-ci.sh in the repo.
>
> Are there any additional ideas or other comments on a way to do this?
>
> Thanks

Re: Running arbitrary tests in CI

[Matt Spinler]

Change here: 
https://gerrit.openbmc-project.xyz/c/openbmc/openbmc-build-scripts/+/26574/

On 10/24/2019 9:25 AM, Matt Spinler wrote:
> Hi,
>
> Following up to the thread that talks about being able to run extra 
> tests in CI:
> https://lists.ozlabs.org/pipermail/openbmc/2019-September/018329.html
>
> I could definitely use something like this, so I am thinking of 
> putting up the
> commit to do the: run any run-ci.sh in the repo.
>
> Are there any additional ideas or other comments on a way to do this?
>
> Thanks

Re: Running arbitrary tests in CI

[Emily Shaffer]

[-- Attachment #1: Type: text/plain, Size: 812 bytes --]

If I understand it, it sounds like you're planning to let us write tests in
any form, not just as part of the build, right?

Sounds rad 👍

 - Emily

On Fri, Oct 25, 2019, 8:12 AM Matt Spinler <mspinler@linux.ibm.com> wrote:

> Change here:
> https://gerrit.openbmc-project.xyz/c/openbmc/openbmc-build-scripts/+/26574/
>
> On 10/24/2019 9:25 AM, Matt Spinler wrote:
> > Hi,
> >
> > Following up to the thread that talks about being able to run extra
> > tests in CI:
> > https://lists.ozlabs.org/pipermail/openbmc/2019-September/018329.html
> >
> > I could definitely use something like this, so I am thinking of
> > putting up the
> > commit to do the: run any run-ci.sh in the repo.
> >
> > Are there any additional ideas or other comments on a way to do this?
> >
> > Thanks
>
>

[-- Attachment #2: Type: text/html, Size: 1503 bytes --]