[Fuego] Problems with the next branch

[Fuego] Problems with the next branch

[dhinakar k]

[-- Attachment #1: Type: text/plain, Size: 2634 bytes --]

Hi,

I cloned 'next' branch and started the container.
But I see the following error while executing 'ftc list-boards' command.
It seems ftc is not working.
Please check the below error message and let me know what is the issue.
I have also tried deleting and creating a new docker container but the
result is the same.

Regards,
Dhinakar

dhinakar@Ubuntu-RC510:~/fuego$
./fuego-host-scripts/docker-start-container.sh
Starting Fuego container (fuego-container)
[ ok ] Starting Jenkins Continuous Integration Server: jenkins.
[ ok ] Starting network benchmark server.
root@Ubuntu-RC510:/# ftc list-boards
Traceback (most recent call last):
  File "/usr/local/bin/ftc", line 53, in <module>
    import requests
  File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line 68, in
<module>
    _attach_namespace(urllib3, 'requests.packages')
  File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line 63, in
_attach_namespace
    module = __import__(name)
  File "/usr/lib/python2.7/dist-packages/urllib3/contrib/pyopenssl.py",
line 55, in <module>
    import OpenSSL.SSL
  File "/usr/lib/python2.7/dist-packages/OpenSSL/__init__.py", line 8, in
<module>
    from OpenSSL import rand, crypto, SSL
  File "/usr/lib/python2.7/dist-packages/OpenSSL/rand.py", line 11, in
<module>
    from OpenSSL._util import (
  File "/usr/lib/python2.7/dist-packages/OpenSSL/_util.py", line 4, in
<module>
    binding = Binding()
  File
"/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py",
line 89, in __init__
    self._ensure_ffi_initialized()
  File
"/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py",
line 113, in _ensure_ffi_initialized
    libraries=libraries,
  File
"/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/utils.py",
line 80, in build_ffi
    extra_link_args=extra_link_args,
  File "/usr/lib/python2.7/dist-packages/cffi/api.py", line 340, in verify
    lib = self.verifier.load_library()
  File "/usr/lib/python2.7/dist-packages/cffi/verifier.py", line 75, in
load_library
    return self._load_library()
  File "/usr/lib/python2.7/dist-packages/cffi/verifier.py", line 151, in
_load_library
    return self._vengine.load_library()
  File "/usr/lib/python2.7/dist-packages/cffi/vengine_cpy.py", line 149, in
load_library
    raise ffiplatform.VerificationError(error)
cffi.ffiplatform.VerificationError: importing
'/usr/lib/python2.7/dist-packages/cryptography/_
Cryptography_cffi_36a40ff0x2bad1bae.x86_64-linux-gnu.so':
/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0: undefined symbol:
cheak_defer, version OPENSSL_1.0.0
root@Ubuntu-RC510:/#

[-- Attachment #2: Type: text/html, Size: 3303 bytes --]

Re: [Fuego] Problems with the next branch

[Daniel Sangorrin]

Hi Dhinakar,

Thanks for reporting, I'll try to confirm that and come back to you.

Regards,
Daniel

> -----Original Message-----
> From: fuego-bounces@lists.linuxfoundation.org [mailto:fuego-bounces@lists.linuxfoundation.org] On Behalf Of dhinakar k
> Sent: Wednesday, May 31, 2017 10:43 AM
> To: fuego@lists.linuxfoundation.org
> Subject: [Fuego] Problems with the next branch
> 
> Hi,
> 
> 
> I cloned 'next' branch and started the container.
> 
> But I see the following error while executing 'ftc list-boards' command.
> 
> It seems ftc is not working.
> 
> Please check the below error message and let me know what is the issue.
> 
> I have also tried deleting and creating a new docker container but the result is the same.
> 
> 
> Regards,
> 
> Dhinakar
> 
> 
> dhinakar@Ubuntu-RC510:~/fuego$ ./fuego-host-scripts/docker-start-container.sh
> Starting Fuego container (fuego-container)
> [ ok ] Starting Jenkins Continuous Integration Server: jenkins.
> [ ok ] Starting network benchmark server.
> root@Ubuntu-RC510:/# ftc list-boards
> Traceback (most recent call last):
>   File "/usr/local/bin/ftc", line 53, in <module>
>     import requests
>   File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line 68, in <module>
>     _attach_namespace(urllib3, 'requests.packages')
>   File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line 63, in _attach_namespace
>     module = __import__(name)
>   File "/usr/lib/python2.7/dist-packages/urllib3/contrib/pyopenssl.py", line 55, in <module>
>     import OpenSSL.SSL
>   File "/usr/lib/python2.7/dist-packages/OpenSSL/__init__.py", line 8, in <module>
>     from OpenSSL import rand, crypto, SSL
>   File "/usr/lib/python2.7/dist-packages/OpenSSL/rand.py", line 11, in <module>
>     from OpenSSL._util import (
>   File "/usr/lib/python2.7/dist-packages/OpenSSL/_util.py", line 4, in <module>
>     binding = Binding()
>   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py", line 89, in __init__
>     self._ensure_ffi_initialized()
>   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py", line 113, in _ensure_ffi_initialized
>     libraries=libraries,
>   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/utils.py", line 80, in build_ffi
>     extra_link_args=extra_link_args,
>   File "/usr/lib/python2.7/dist-packages/cffi/api.py", line 340, in verify
>     lib = self.verifier.load_library()
>   File "/usr/lib/python2.7/dist-packages/cffi/verifier.py", line 75, in load_library
>     return self._load_library()
>   File "/usr/lib/python2.7/dist-packages/cffi/verifier.py", line 151, in _load_library
>     return self._vengine.load_library()
>   File "/usr/lib/python2.7/dist-packages/cffi/vengine_cpy.py", line 149, in load_library
>     raise ffiplatform.VerificationError(error)
> cffi.ffiplatform.VerificationError: importing '/usr/lib/python2.7/dist-
> packages/cryptography/_Cryptography_cffi_36a40ff0x2bad1bae.x86_64-linux-gnu.so
> <http://Cryptography_cffi_36a40ff0x2bad1bae.x86_64-linux-gnu.so> ': /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0: undefined
> symbol: cheak_defer, version OPENSSL_1.0.0
> root@Ubuntu-RC510:/#
> 
> 

Re: [Fuego] Problems with the next branch

[dhinakar k]

[-- Attachment #1: Type: text/plain, Size: 3521 bytes --]

Thank you very much Daniel.

Regards,
Dhinakar

On May 31, 2017 9:42 AM, "Daniel Sangorrin" <daniel.sangorrin@toshiba.co.jp>
wrote:

> Hi Dhinakar,
>
> Thanks for reporting, I'll try to confirm that and come back to you.
>
> Regards,
> Daniel
>
> > -----Original Message-----
> > From: fuego-bounces@lists.linuxfoundation.org [mailto:
> fuego-bounces@lists.linuxfoundation.org] On Behalf Of dhinakar k
> > Sent: Wednesday, May 31, 2017 10:43 AM
> > To: fuego@lists.linuxfoundation.org
> > Subject: [Fuego] Problems with the next branch
> >
> > Hi,
> >
> >
> > I cloned 'next' branch and started the container.
> >
> > But I see the following error while executing 'ftc list-boards' command.
> >
> > It seems ftc is not working.
> >
> > Please check the below error message and let me know what is the issue.
> >
> > I have also tried deleting and creating a new docker container but the
> result is the same.
> >
> >
> > Regards,
> >
> > Dhinakar
> >
> >
> > dhinakar@Ubuntu-RC510:~/fuego$ ./fuego-host-scripts/docker-
> start-container.sh
> > Starting Fuego container (fuego-container)
> > [ ok ] Starting Jenkins Continuous Integration Server: jenkins.
> > [ ok ] Starting network benchmark server.
> > root@Ubuntu-RC510:/# ftc list-boards
> > Traceback (most recent call last):
> >   File "/usr/local/bin/ftc", line 53, in <module>
> >     import requests
> >   File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line
> 68, in <module>
> >     _attach_namespace(urllib3, 'requests.packages')
> >   File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line
> 63, in _attach_namespace
> >     module = __import__(name)
> >   File "/usr/lib/python2.7/dist-packages/urllib3/contrib/pyopenssl.py",
> line 55, in <module>
> >     import OpenSSL.SSL
> >   File "/usr/lib/python2.7/dist-packages/OpenSSL/__init__.py", line 8,
> in <module>
> >     from OpenSSL import rand, crypto, SSL
> >   File "/usr/lib/python2.7/dist-packages/OpenSSL/rand.py", line 11, in
> <module>
> >     from OpenSSL._util import (
> >   File "/usr/lib/python2.7/dist-packages/OpenSSL/_util.py", line 4, in
> <module>
> >     binding = Binding()
> >   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py",
> line 89, in __init__
> >     self._ensure_ffi_initialized()
> >   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py",
> line 113, in _ensure_ffi_initialized
> >     libraries=libraries,
> >   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/utils.py",
> line 80, in build_ffi
> >     extra_link_args=extra_link_args,
> >   File "/usr/lib/python2.7/dist-packages/cffi/api.py", line 340, in
> verify
> >     lib = self.verifier.load_library()
> >   File "/usr/lib/python2.7/dist-packages/cffi/verifier.py", line 75, in
> load_library
> >     return self._load_library()
> >   File "/usr/lib/python2.7/dist-packages/cffi/verifier.py", line 151,
> in _load_library
> >     return self._vengine.load_library()
> >   File "/usr/lib/python2.7/dist-packages/cffi/vengine_cpy.py", line
> 149, in load_library
> >     raise ffiplatform.VerificationError(error)
> > cffi.ffiplatform.VerificationError: importing '/usr/lib/python2.7/dist-
> > packages/cryptography/_Cryptography_cffi_36a40ff0x2bad1bae.
> x86_64-linux-gnu.so
> > <http://Cryptography_cffi_36a40ff0x2bad1bae.x86_64-linux-gnu.so> ':
> /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0: undefined
> > symbol: cheak_defer, version OPENSSL_1.0.0
> > root@Ubuntu-RC510:/#
> >
> >
>
>
>
>

[-- Attachment #2: Type: text/html, Size: 5109 bytes --]

Re: [Fuego] Problems with the next branch

[dhinakar k]

[-- Attachment #1: Type: text/plain, Size: 3936 bytes --]

Also in the next release there will be only fuego_test.sh files in the
/engine/tests/<test_folders> ? Because the Jenkins job still refers to the
.sh folder based on test name for e.g. blobsallad.sh

Please confirm.

Regards,
Dhinakar

On May 31, 2017 10:06 AM, "dhinakar k" <dhinakar.k@gmail.com> wrote:

> Thank you very much Daniel.
>
> Regards,
> Dhinakar
>
> On May 31, 2017 9:42 AM, "Daniel Sangorrin" <daniel.sangorrin@toshiba.co.
> jp> wrote:
>
>> Hi Dhinakar,
>>
>> Thanks for reporting, I'll try to confirm that and come back to you.
>>
>> Regards,
>> Daniel
>>
>> > -----Original Message-----
>> > From: fuego-bounces@lists.linuxfoundation.org [mailto:
>> fuego-bounces@lists.linuxfoundation.org] On Behalf Of dhinakar k
>> > Sent: Wednesday, May 31, 2017 10:43 AM
>> > To: fuego@lists.linuxfoundation.org
>> > Subject: [Fuego] Problems with the next branch
>> >
>> > Hi,
>> >
>> >
>> > I cloned 'next' branch and started the container.
>> >
>> > But I see the following error while executing 'ftc list-boards' command.
>> >
>> > It seems ftc is not working.
>> >
>> > Please check the below error message and let me know what is the issue.
>> >
>> > I have also tried deleting and creating a new docker container but the
>> result is the same.
>> >
>> >
>> > Regards,
>> >
>> > Dhinakar
>> >
>> >
>> > dhinakar@Ubuntu-RC510:~/fuego$ ./fuego-host-scripts/docker-st
>> art-container.sh
>> > Starting Fuego container (fuego-container)
>> > [ ok ] Starting Jenkins Continuous Integration Server: jenkins.
>> > [ ok ] Starting network benchmark server.
>> > root@Ubuntu-RC510:/# ftc list-boards
>> > Traceback (most recent call last):
>> >   File "/usr/local/bin/ftc", line 53, in <module>
>> >     import requests
>> >   File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line
>> 68, in <module>
>> >     _attach_namespace(urllib3, 'requests.packages')
>> >   File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line
>> 63, in _attach_namespace
>> >     module = __import__(name)
>> >   File "/usr/lib/python2.7/dist-packages/urllib3/contrib/pyopenssl.py",
>> line 55, in <module>
>> >     import OpenSSL.SSL
>> >   File "/usr/lib/python2.7/dist-packages/OpenSSL/__init__.py", line 8,
>> in <module>
>> >     from OpenSSL import rand, crypto, SSL
>> >   File "/usr/lib/python2.7/dist-packages/OpenSSL/rand.py", line 11, in
>> <module>
>> >     from OpenSSL._util import (
>> >   File "/usr/lib/python2.7/dist-packages/OpenSSL/_util.py", line 4, in
>> <module>
>> >     binding = Binding()
>> >   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py",
>> line 89, in __init__
>> >     self._ensure_ffi_initialized()
>> >   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py",
>> line 113, in _ensure_ffi_initialized
>> >     libraries=libraries,
>> >   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/utils.py",
>> line 80, in build_ffi
>> >     extra_link_args=extra_link_args,
>> >   File "/usr/lib/python2.7/dist-packages/cffi/api.py", line 340, in
>> verify
>> >     lib = self.verifier.load_library()
>> >   File "/usr/lib/python2.7/dist-packages/cffi/verifier.py", line 75,
>> in load_library
>> >     return self._load_library()
>> >   File "/usr/lib/python2.7/dist-packages/cffi/verifier.py", line 151,
>> in _load_library
>> >     return self._vengine.load_library()
>> >   File "/usr/lib/python2.7/dist-packages/cffi/vengine_cpy.py", line
>> 149, in load_library
>> >     raise ffiplatform.VerificationError(error)
>> > cffi.ffiplatform.VerificationError: importing '/usr/lib/python2.7/dist-
>> > packages/cryptography/_Cryptography_cffi_36a40ff0x2bad1bae.x
>> 86_64-linux-gnu.so
>> > <http://Cryptography_cffi_36a40ff0x2bad1bae.x86_64-linux-gnu.so> ':
>> /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0: undefined
>> > symbol: cheak_defer, version OPENSSL_1.0.0
>> > root@Ubuntu-RC510:/#
>> >
>> >
>>
>>
>>
>>

[-- Attachment #2: Type: text/html, Size: 5884 bytes --]

Re: [Fuego] Problems with the next branch

[Bird, Timothy]

> -----Original Message-----
> From: dhinakar k on Wednesday, May 31, 2017 1:54 PM
>
> Also in the next release there will be only fuego_test.sh files in the
> /engine/tests/<test_folders> ? Because the Jenkins job still refers to the .sh
> folder based on test name for e.g. blobsallad.sh
> 
Jenkins jobs defined in Fuego 1.1 are not compatible with the Fuego 1.2 tests.
This was one of the major refactorings in the v1.2 release (the 'next' branch).

You should removing the existing jobs, and re-creating them, using ftc.
(Use the ftc remove-jobs and ftc add-jobs commands).
 -- Tim

Re: [Fuego] Problems with the next branch

[Bird, Timothy]

> -----Original Message-----
> From Bird, Timothy on Wednesday, May 31, 2017 4:18 PM
> (Use the ftc remove-jobs and ftc add-jobs commands).

That should be 'ftc rm-jobs', not 'ftc remove-jobs', BTW.
 -- Tim

Re: [Fuego] Problems with the next branch

[Dhinakar Kalyanasundaram]

[-- Attachment #1: Type: text/html, Size: 6989 bytes --]

[-- Attachment #2: 201602111742151_N3WZA6X7.png --]
[-- Type: image/png, Size: 33527 bytes --]

Re: [Fuego] Problems with the next branch

[dhinakar k]

[-- Attachment #1.1: Type: text/plain, Size: 5043 bytes --]

Sorry again posting this message to Fuego forum as my settings to send a
text based email from Office email ID is not working. I think there is some
encryption enabled in my office email server.

Thanks Tim,

It works for me after removing all the old jobs and creating new ones.
Thanks much.

@Daniel

The 'ftc' commands issue which I posted in my first post with subject
-> 'Problems with the next branch' does not occur @office.

I have that issue with fuego setup at my home. I will troubleshoot and try
to fix it.

@Office, 'ftc' commands work and I am able to remove and create new jobs.

But I get 'Fuego error reason: ERROR: problem while running the parser'
error for some of the tests mentioned below.

1. Benchmark.blobsallad

2. Benchmark.fio

3. Benchmark.internbench

4. Benchmark.openSSL

5. Benchmark.stream

I have provided below the a part of the log of Benchmark.blobsallad test, I
think the issue is common across.

Please let me know if you want the other logs as well.

................................

.................................

+ echo '##### doing fuego phase: processing ########'
##### doing fuego phase: processing ########
+ processing
+ local RETURN_VALUE=0
+ call_if_present test_processing
+ declare -f -F test_processing
+ return 0
+ '[' 0 -ne 0 ']'
+ fail_check_cases
+ testlog=/fuego-rw/logs/Benchmark.blobsallad/ubuntu-x86-target.default.1.1/
testlog.txt
+ slog_prefix=/fuego-rw/logs/Benchmark.blobsallad/ubuntu-
x86-target.default.1.1/syslog
++ echo BENCHMARK.BLOBSALLAD
++ tr . _
+ upName=BENCHMARK_BLOBSALLAD
+ fcname=BENCHMARK_BLOBSALLAD_FAIL_CASE_COUNT
+ fcc=1
+ '[' -z 1 ']'
+ echo 'Going to check 1 fail cases for ubuntu-x86-target.default.
Benchmark.blobsallad'
Going to check 1 fail cases for ubuntu-x86-target.default.
Benchmark.blobsallad
+ fcc=0
++ seq 0 0
+ for n in '$(seq 0 $fcc)'
+ fpvarname=BENCHMARK_BLOBSALLAD_FAIL_REGEXP_0
+ fpvarmsg=BENCHMARK_BLOBSALLAD_FAIL_MESSAGE_0
+ fpvarslog=BENCHMARK_BLOBSALLAD_FAIL_0_SYSLOG
+ fptemplate='xrandr: command not found'
+ fpmessage='target system does not have xrandr'
+ fpslog=
+ '[' '!' -z '' ']'
+ grep -e 'xrandr: command not found' /fuego-rw/logs/Benchmark.
blobsallad/ubuntu-x86-target.default.1.1/testlog.txt
+ echo 'No fail cases detected for ubuntu-x86-target.default.
Benchmark.blobsallad'
No fail cases detected for ubuntu-x86-target.default.Benchmark.blobsallad
+ '[' 0 -ne 0 ']'
+ syslog_cmp
+ PREFIX=/fuego-rw/logs/Benchmark.blobsallad/ubuntu-
x86-target.default.1.1/syslog
+ rc=0
+ '[' -f /fuego-rw/logs/Benchmark.blobsallad/ubuntu-x86-target.default.1.1/syslog.before.txt
']'
+ diff -ua /fuego-rw/logs/Benchmark.blobsallad/ubuntu-x86-target.default.1.1/syslog.before.txt
/fuego-rw/logs/Benchmark.blobsallad/ubuntu-x86-target.
default.1.1/syslog.after.txt
+ grep -vEf /fuego-core/engine/scripts/syslog.ignore
+ grep -E -e '\.(Bug:|Oops)'
+ '[' 0 -eq 1 ']'
+ return 0
+ '[' 0 -ne 0 ']'
+ PYTHON_ARGS='-W ignore::DeprecationWarning -W ignore::UserWarning'
+ '[' -e /fuego-core/engine/tests/Benchmark.blobsallad/parser.py ']'
+ run_python -W ignore::DeprecationWarning -W ignore::UserWarning
/fuego-core/engine/tests/Benchmark.blobsallad/parser.py
+ '[' '!' -z /usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
']'
+ echo 'running python with PATH=/usr/local/bin:/usr/
local/bin:/usr/bin:/bin:/usr/local/games:/usr/games'
running python with PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/
local/games:/usr/games
+ PATH=/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/
local/games:/usr/games
+ python -W ignore::DeprecationWarning -W ignore::UserWarning
/fuego-core/engine/tests/Benchmark.blobsallad/parser.py
Reading current values from /fuego-rw/logs/Benchmark.
blobsallad/ubuntu-x86-target.default.1.1/testlog.txt
+ rc=1
+ '[' 1 -eq 0 ']'
+ '[' 1 -eq 2 ']'
+ '[' 1 -eq 3 ']'
+ abort_job 'ERROR: problem while running the parser'
+ set +x

*** ABORTED ***

Fuego error reason: ERROR: problem while running the parser

Build was aborted
Aborted by unknown <http://107.108.83.19:8080/fuego/user/unknown>
[description-setter] Description set:  <a href="/fuego/userContent/
fuego.logs/Benchmark.blobsallad/ubuntu-x86-target.
default.1.1/testlog.txt">log</a>
Finished: ABORTED



Regards,

Dhinakar,

Senior Technical Manager,

2-07-526, Phoenix Building,

+91-9902007650

Samsung Research Institute, Bangalore.





--------- *Original Message* ---------

*Sender* : Bird, Timothy <Tim.Bird@sony.com>

*Date* : 2017-05-31 12:55 (GMT+5:30)

*Title* : Re: [Fuego] Problems with the next branch

*To : *null<Tim.Bird@sony.com>, null<dhinakar.k@gmail.com>, null<
daniel.sangorrin@toshiba.co.jp>

*CC : *null<fuego@lists.linuxfoundation.org>



> -----Original Message-----
> From Bird, Timothy on Wednesday, May 31, 2017 4:18 PM
> (Use the ftc remove-jobs and ftc add-jobs commands).

That should be 'ftc rm-jobs', not 'ftc remove-jobs', BTW.
 -- Tim
_______________________________________________
Fuego mailing listFuego@lists.linuxfoundation.orghttps://lists.linuxfoundation.org/mailman/listinfo/fuego

[-- Attachment #1.2: Type: text/html, Size: 7845 bytes --]

[-- Attachment #2: 201602111742151_N3WZA6X7.png --]
[-- Type: image/png, Size: 33527 bytes --]