RE: [cip-dev] Tests run on CIP-LAVA platform

["P T, Sarath" <Sarath_PT@mentor.com>]

[-- Attachment #1: Type: text/plain, Size: 4356 bytes --]

Hi Chris, ​

I can see in Linaro/test-definitions (https://github.com/Linaro/test-definitions/tree/master/automated/linux) there are 123 test-suites are present but only 4 test-suites are running on cip lava ?

Few more queries I am having regarding this.
      i)   Is CIP  running the full QA of Linaro/test-definitions test-suites in any other platform ?
      ii)  All of the tests which has been run in the LAVA CIP platform is 2mins duration. Is there a particular reason for choosing these much duration of tests ?

Regards
Sarath P T


From: cip-dev@lists.cip-project.org [mailto:cip-dev@lists.cip-project.org] On Behalf Of Chris Paterson
Sent: 18 October 2022 17:38
To: cip-dev@lists.cip-project.org
Subject: Re: [cip-dev] Tests run on CIP-LAVA platform

Hello Sarath,

Some of those test jobs you linked to are very old.

Looking at more recent jobs the smc issue you reported is no longer there.

However the RT tests are having issues completing the test due to “/usr/bin/env: 'python': No such file or directory”.
The tests seem to get run, but the final step is a python script that parses the results.
We’ll have to get that fixed.

Kind regards, Chris

From: cip-dev@lists.cip-project.org<mailto:cip-dev@lists.cip-project.org> <cip-dev@lists.cip-project.org<mailto:cip-dev@lists.cip-project.org>> On Behalf Of P T, Sarath via lists.cip-project.org
Sent: 17 October 2022 08:04
To: cip-dev@lists.cip-project.org<mailto:cip-dev@lists.cip-project.org>
Subject: [cip-dev] Tests run on CIP-LAVA platform

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.


Test-case

CIP LAVA job link

Status

Comments


i)                 spectre-meltdown-checker-test

https://lava.ciplatform.org/scheduler/job/686074<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fscheduler%2Fjob%2F686074&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=s6LI32yl%2BAq2kMacyP1plIr7bu9DFfaCHGw5ez6E9tY%3D&reserved=0>

Not run

Reason of failure

./spectre-meltdown-checker.sh: Permission denied.


ii)               hackbench

https://lava.ciplatform.org/results/634343<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634343&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4ajRpqUrsZX0CSIbsFRUWpNJ6cyRoAHXGM2NDzhWlII%3D&reserved=0>

PASS




iii)             cyclictest

https://lava.ciplatform.org/results/634097<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634097&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=m0f%2FygYtt4U4%2Fm7qJ1wHviYPItQxh46wrjXd7iWJSXY%3D&reserved=0>

SKIP

Reason of failure

$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error


iv)              cyclicdeadline

https://lava.ciplatform.org/results/633692<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F633692&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466625902%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Q3ixEoBSW8Ld28zwN2bqCjMPqd1UzIPELHdnbTD72Yk%3D&reserved=0>

Not run

Reason of failure


while executing cyclicdeadline.sh getting an error like

/usr/bin/cyclicdeadline: invalid option -- 'q'



Is there any specific reason why few test-cases are running through LAVA ?


Regards

Sarath P T


[-- Attachment #2: Type: text/html, Size: 20294 bytes --]