* RE: Tests run on CIP-LAVA platform
@ 2022-10-17 13:01 P T, Sarath
2022-10-18 12:07 ` [cip-dev] " Chris Paterson
0 siblings, 1 reply; 4+ messages in thread
From: P T, Sarath @ 2022-10-17 13:01 UTC (permalink / raw)
To: cip-dev
[-- Attachment #1: Type: text/plain, Size: 1811 bytes --]
Hi Team ,
I can see in Linaro/test-definitions (https://github.com/Linaro/test-definitions/tree/master/automated/linux) there are 123 test-suites are present but only 4 test-suites are running on cip lava ?
Few more queries I am having regarding this.
i) Is CIP running the full QA of Linaro/test-definitions test-suites in any other platform ?
ii) All of the tests which has been run in the LAVA CIP platform is 2mins duration. Is there a particular reason for choosing these much duration of tests ?
Regards
Sarath P T
From: P T, Sarath
Sent: 17 October 2022 12:34
To: 'cip-dev@lists.cip-project.org' <cip-dev@lists.cip-project.org>
Subject: Tests run on CIP-LAVA platform
Hi Team,
I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.
Test-case
CIP LAVA job link
Status
Comments
i) spectre-meltdown-checker-test
https://lava.ciplatform.org/scheduler/job/686074
Not run
Reason of failure
./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench
https://lava.ciplatform.org/results/634343
PASS
iii) cyclictest
https://lava.ciplatform.org/results/634097
SKIP
Reason of failure
$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving "/usr/bin/cyclictest: unrecognized option" error
iv) cyclicdeadline
https://lava.ciplatform.org/results/633692
Not run
Reason of failure
while executing cyclicdeadline.sh getting an error like
/usr/bin/cyclicdeadline: invalid option -- 'q'
Is there any specific reason why few test-cases are running through LAVA ?
Regards
Sarath P T
[-- Attachment #2: Type: text/html, Size: 21904 bytes --]
^ permalink raw reply [flat|nested] 4+ messages in thread
* RE: [cip-dev] Tests run on CIP-LAVA platform
2022-10-17 13:01 Tests run on CIP-LAVA platform P T, Sarath
@ 2022-10-18 12:07 ` Chris Paterson
0 siblings, 0 replies; 4+ messages in thread
From: Chris Paterson @ 2022-10-18 12:07 UTC (permalink / raw)
To: cip-dev
Hello Sarath,
> From: cip-dev@lists.cip-project.org <cip-dev@lists.cip-project.org> On
> Behalf Of P T, Sarath via lists.cip-project.org
> Sent: 17 October 2022 14:01
>
> Hi Team ,
>
> I can see in Linaro/test-definitions (https://github.com/Linaro/test-
> definitions/tree/master/automated/linux) there are
> 123 test-suites are present but only 4 test-suites are running on cip lava ?
The tests we currently run in our GitLab CI setup are listed here:
https://wiki.linuxfoundation.org/civilinfrastructureplatform/ciptesting/centalisedtesting/cioverview#when_tests_are_run
Note that in KernelCI a lot more gets tested.
You can see the latest testing run on the v5.10.147-cip18 release here:
https://linux.kernelci.org/test/job/cip/branch/linux-5.10.y-cip/kernel/v5.10.147-cip18/
>
> Few more queries I am having regarding this.
> i) Is CIP running the full QA of Linaro/test-definitions test-suites in any
> other platform ?
We have only added a small sub-set to our GitLab CI testing.
As shown in the links above, more are run through KernelCI.
> ii) All of the tests which has been run in the LAVA CIP platform is 2mins
> duration. Is there a particular reason for choosing these much duration of
> tests ?
The test length depends on the test.
Some tests for example take much longer. For example this ltp-syscalls test took 1h45m:
https://lava.ciplatform.org/scheduler/job/763898
Kind regards, Chris
>
>
> Regards
> Sarath P T
>
>
>
>
>
> From: P T, Sarath
> Sent: 17 October 2022 12:34
> To: 'cip-dev@lists.cip-project.org' <cip-dev@lists.cip-project.org>
> Subject: Tests run on CIP-LAVA platform
>
>
>
> Hi Team,
>
>
>
> I could able to see there are few tests are running in the CIP LAVA platform. I
> am showing the list below what all LAVA tests are running in the CIP LAVA
> platform.
>
>
>
>
>
> Test-case
>
> CIP LAVA job link
>
> Status
>
> Comments
>
> i) spectre-meltdown-checker-test
>
> https://lava.ciplatform.org/scheduler/job/686074
> <https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.
> ciplatform.org%2Fscheduler%2Fjob%2F686074&data=05%7C01%7Cchris.pate
> rson2%40renesas.com%7C628a9bfc449c4f32dee008dab03fb7ac%7C53d82571
> da1947e49cb4625a166a4a2a%7C0%7C0%7C638016084971574185%7CUnknow
> n%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1ha
> WwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=lHQbDUMj23SLAG2%2B
> qPEY1CtjYQ68%2B59QcgSpsGIg6WI%3D&reserved=0>
>
> Not run
>
> Reason of failure
>
>
> ./spectre-meltdown-checker.sh: Permission denied.
>
> ii) hackbench
>
> https://lava.ciplatform.org/results/634343
> <https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.
> ciplatform.org%2Fresults%2F634343&data=05%7C01%7Cchris.paterson2%40r
> enesas.com%7C628a9bfc449c4f32dee008dab03fb7ac%7C53d82571da1947e49
> cb4625a166a4a2a%7C0%7C0%7C638016084971574185%7CUnknown%7CTWFp
> bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC
> I6Mn0%3D%7C3000%7C%7C%7C&sdata=uM4%2F3rQ3QezNTAegpfi%2BjhKB
> %2Fy6VgjhHQ1i0yjbHXoY%3D&reserved=0>
>
> PASS
>
>
>
> iii) cyclictest
>
> https://lava.ciplatform.org/results/634097
> <https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.
> ciplatform.org%2Fresults%2F634097&data=05%7C01%7Cchris.paterson2%40r
> enesas.com%7C628a9bfc449c4f32dee008dab03fb7ac%7C53d82571da1947e49
> cb4625a166a4a2a%7C0%7C0%7C638016084971574185%7CUnknown%7CTWFp
> bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC
> I6Mn0%3D%7C3000%7C%7C%7C&sdata=%2BsVty8GVrmvdAcL%2BXOXQv8s
> N4FiAJgnPDqzEfIMXCIo%3D&reserved=0>
>
> SKIP
>
> Reason of failure
>
>
>
> $ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving
> “/usr/bin/cyclictest: unrecognized option” error
>
> iv) cyclicdeadline
>
> https://lava.ciplatform.org/results/633692
> <https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.
> ciplatform.org%2Fresults%2F633692&data=05%7C01%7Cchris.paterson2%40r
> enesas.com%7C628a9bfc449c4f32dee008dab03fb7ac%7C53d82571da1947e49
> cb4625a166a4a2a%7C0%7C0%7C638016084971574185%7CUnknown%7CTWFp
> bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC
> I6Mn0%3D%7C3000%7C%7C%7C&sdata=hzllFtkK7G6mNHHfIO%2BsSb7pAGd
> Nag5mEtAx0FnH1Ek%3D&reserved=0>
>
> Not run
>
> Reason of failure
>
>
>
> while executing cyclicdeadline.sh getting an error like
>
> /usr/bin/cyclicdeadline: invalid option -- 'q'
>
>
>
>
>
> Is there any specific reason why few test-cases are running through LAVA ?
>
>
> Regards
>
> Sarath P T
>
>
^ permalink raw reply [flat|nested] 4+ messages in thread
* Tests run on CIP-LAVA platform
@ 2022-10-17 7:03 P T, Sarath
2022-10-18 12:07 ` Chris Paterson
0 siblings, 1 reply; 4+ messages in thread
From: P T, Sarath @ 2022-10-17 7:03 UTC (permalink / raw)
To: cip-dev
[-- Attachment #1: Type: text/plain, Size: 1097 bytes --]
Hi Team,
I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.
Test-case
CIP LAVA job link
Status
Comments
i) spectre-meltdown-checker-test
https://lava.ciplatform.org/scheduler/job/686074
Not run
Reason of failure
./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench
https://lava.ciplatform.org/results/634343
PASS
iii) cyclictest
https://lava.ciplatform.org/results/634097
SKIP
Reason of failure
$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving "/usr/bin/cyclictest: unrecognized option" error
iv) cyclicdeadline
https://lava.ciplatform.org/results/633692
Not run
Reason of failure
while executing cyclicdeadline.sh getting an error like
/usr/bin/cyclicdeadline: invalid option -- 'q'
Is there any specific reason why few test-cases are running through LAVA ?
Regards
Sarath P T
[-- Attachment #2: Type: text/html, Size: 14287 bytes --]
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2022-10-18 12:07 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-10-17 13:01 Tests run on CIP-LAVA platform P T, Sarath
2022-10-18 12:07 ` [cip-dev] " Chris Paterson
-- strict thread matches above, loose matches on Subject: below --
2022-10-17 7:03 P T, Sarath
2022-10-18 12:07 ` Chris Paterson
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.