[Fuego] Benchmark.Interbench test fails with ImportError on the latest 'next' branch

[Fuego] Benchmark.Interbench test fails with ImportError on the latest 'next' branch

[Dhinakar Kalyanasundaram]

[-- Attachment #1.1: Type: text/html, Size: 2404 bytes --]

[-- Attachment #1.2: 201602111742151_N3WZA6X7.png --]
[-- Type: image/png, Size: 33527 bytes --]

[-- Attachment #2: testlog.txt --]
[-- Type: application/octet-stream, Size: 2210 bytes --]

loops_per_ms unknown; benchmarking...
798068 loops_per_ms saved to file interbench.loops_per_ms
Creating file for read load...

Using 798068 loops per ms, running every load for 30 seconds
Benchmarking kernel 4.4.0-93-generic at datestamp 201709271813

--- Benchmarking simulated cpu of Audio in the presence of simulated ---
Load	Latency +/- SD (ms)  Max Latency   % Desired CPU  % Deadlines Met
None	   0.1 +/- 0.1        0.1		 100	        100
Video	   0.0 +/- 0.1        0.1		 100	        100
X	   0.1 +/- 0.1        0.3		 100	        100
Burn	   0.0 +/- 0.0        0.0		 100	        100
Write	   0.0 +/- 0.0        0.1		 100	        100
Read	   0.0 +/- 0.0        0.1		 100	        100
Compile	   0.0 +/- 0.0        0.0		 100	        100
Memload	   0.0 +/- 0.0        0.2		 100	        100

--- Benchmarking simulated cpu of Video in the presence of simulated ---
Load	Latency +/- SD (ms)  Max Latency   % Desired CPU  % Deadlines Met
None	   0.0 +/- 0.0        0.1		 100	        100
X	   0.0 +/- 0.0        0.2		 100	        100
Burn	   0.0 +/- 0.0        0.1		 100	        100
Write	   0.0 +/- 0.0        0.2		 100	        100
Read	   0.0 +/- 0.0        0.2		 100	        100
Compile	   0.0 +/- 0.0        0.1		 100	        100
Memload	   0.1 +/- 0.1        2.0		 100	        100

--- Benchmarking simulated cpu of X in the presence of simulated ---
Load	Latency +/- SD (ms)  Max Latency   % Desired CPU  % Deadlines Met
None	   0.0 +/- 0.0        0.1		 100	        100
Video	   0.0 +/- 0.0        0.0		 100	        100
Burn	   0.0 +/- 0.0        0.0		 100	        100
Write	   0.0 +/- 0.0        0.1		 100	        100
Read	   0.0 +/- 0.0        0.1		 100	        100
Compile	   0.0 +/- 0.0        0.1		 100	        100
Memload	   0.0 +/- 0.0        0.1		 100	        100

--- Benchmarking simulated cpu of Gaming in the presence of simulated ---
Load	Latency +/- SD (ms)  Max Latency   % Desired CPU
None	   0.0 +/- 0.0        0.0		 100
Video	   0.0 +/- 0.0        0.0		 100
X	   0.0 +/- 0.0        0.0		 100
Burn	   0.0 +/- 0.0        0.0		 100
Write	   0.0 +/- 0.0        0.0		 100
Read	   0.0 +/- 0.0        0.0		 100
Compile	   0.0 +/- 0.0        0.0		 100
Memload	   0.0 +/- 0.0        0.0		 100

Re: [Fuego] Benchmark.Interbench test fails with ImportError on the latest 'next' branch

[Bird, Timothy]

> -----Original Message-----
> From Dhinakar Kalyanasundaram on Wednesday, September 27, 2017 6:21 AM
> 
> Benchmark.Interbench test fails with ImportError on the latest 'next' branch.
> 
> Should I manually import 'FileLock' module?
> 

Yes.  If you haven't rebuilt your docker container for 1.2, then do
$ pip install filelock

(and possibly 'pip install python-jenkins==0.4.14')
(and possibly 'sudo apt-get install python-parsedatetime')

 -- Tim

> 
> The snippet of the error is pasted below.
> 
> I have attached the testlog.txt for reference.
> 
> FYI  I am executing these tests on an x86 target (Ubuntu 16.04 PC).
> 
> ....
> 
>   File "/fuego-core/engine/scripts/parser/fuego_parser_results.py", line 31,
> in <module>
>     from filelock import FileLock
> ImportError: No module named filelock
> ERROR: results did not satisfy the threshold
> Fuego: all test phases complete!
> Build step 'Execute shell' marked build as failure
> ....
> 
> 
> 
> Regards,
> 
> Dhinakar,
> 
> Senior Technical Manager,
> 
> 2-07-526, Phoenix Building,
> 
> +91-9902007650
> 
> Samsung Research Institute, Bangalore.
> 
> 
> 
> 
> <http://ext.samsung.net/mail/ext/v1/external/status/update?userid=dhina
> kar.k&do=bWFpbElEPTIwMTcwOTI3MTMyMDUzZXBjbXM1cDM2ZDk4YTI0NT
> lmNWJkZjNjNjNlYWEwYzU5ZGY2ZjcwNyZyZWNpcGllbnRBZGRyZXNzPWZ1ZW
> dvQGxpc3RzLmxpbnV4Zm91bmRhdGlvbi5vcmc_>

[Fuego] Benchmark.GLMark build fails on the latest 'next' branch

[Dhinakar Kalyanasundaram]

[-- Attachment #1: Type: text/html, Size: 61225 bytes --]

[-- Attachment #2: 201602111742151_N3WZA6X7.png --]
[-- Type: image/png, Size: 33527 bytes --]

[Fuego] Benchmark.lmbench2 build fails on the latest 'next' branch

[Dhinakar Kalyanasundaram]

[-- Attachment #1: Type: text/html, Size: 4113 bytes --]

[-- Attachment #2: 201602111742151_N3WZA6X7.png --]
[-- Type: image/png, Size: 33527 bytes --]

Re: [Fuego] Benchmark.lmbench2 build fails on the latest 'next' branch

[Bird, Timothy]

> -----Original Message-----
> From: Dhinakar Kalyanasundaram on Wednesday, September 27, 2017 7:05 AM
> Benchmark.lmbench2 build fails with the below error.
> 
> I have cloned 'fuego-core' today so it is up to date.
> 
> I did a 'git pull' from within 'fuego' directory to get the latest updates.
> 
> May be something wrong in my environment. But many other benchmarks &
> functional tests are passing.
> 
> I am only reporting the failed ones initially executed on X86-64 target.

This is a real bug in the 1.2 release (not in your environment).

Thanks for the report.  I've made a fix and pushed it to my 'next'
branch.

See https://bitbucket.org/tbird20d/fuego-core/commits/b68c4b86b1e45ec4873fbac7318f888b4b945b9a

Thanks for all the testing and especially for taking the time to report the bugs.
 -- Tim

Re: [Fuego] Benchmark.Interbench test fails with ImportError on the latest 'next' branch

[Bird, Timothy]

> -----Original Message-----
> From: Bird, Timoth on Wednesday, September 27, 2017 6:38 AM
> > -----Original Message-----
> > From Dhinakar Kalyanasundaram on Wednesday, September 27, 2017 6:21
> AM
> >
> > Benchmark.Interbench test fails with ImportError on the latest 'next'
> branch.
> >
> > Should I manually import 'FileLock' module?
> >

Just to be clear - was this the only test that failed with this ImportError?
That's strange, since the code in question should be called for every test,
and the mechanism to import auxiliary python modules should not 
be different from test-to-test.

Please let me know if only Benchmark.Interbench had this issue.

Thanks,
 -- Tim

Re: [Fuego] Benchmark.Interbench test fails with ImportError on the latest 'next' branch

[Dhinakar Kalyanasundaram]

[-- Attachment #1: Type: text/html, Size: 3204 bytes --]

[-- Attachment #2: 201602111742151_N3WZA6X7.png --]
[-- Type: image/png, Size: 33527 bytes --]

Re: [Fuego] Benchmark.GLMark build fails on the latest 'next' branch

[Bird, Timothy]

> -----Original Message-----
> From: Dhinakar Kalyanasundaram on Wednesday, September 27, 2017 6:55 AM

> Benchmark.GLMark build fails with the below error.
> 
> Just wanted to confirm that GLMark, gtkperf, blobsallad tests should work
> out-of-the-box on X86-64 target (Ubuntu 16.04 PC) or some pre-requisites
> need to be setup. Please let me know.
> 
> ....

I took a look at these, and they do require some extra '-dev' packages
to build.  Here are my results:
 blobsallad requires libsdl and libcaior
 GLmark requires libsdl
 x11perf require libxmuu and libxmu

I was able to get them to build inside my docker container by adding the following packages:
libsdl1.2-dev libcairo libxmu libxmuu.

These dependencies need to be put into the tests themselves, so at least users can
know if some part of their toolchain (SDK dependency) or runtime environment
(board/distribution dependency) is missing, and how to fix it.  I've added these packages
into the Dockerfile in my 'next' branch, but you can avoid rebuilding your container if
you just 'apt-get install' these manually inside the container.

Note that add the materials to the SDK will allow the tests to build, but the target board
still needs the appropriate runtime libraries in order to actually execute the tests.

Thanks,
 -- Tim