Re: [review-request] adamian/20140429-toastertesting

Re: [review-request] adamian/20140429-toastertesting

[Alex's Testing Bot]

[-- Attachment #1: Type: text/plain, Size: 4515 bytes --]

Using local DB settings commit:  95a31f48b199d8df9c85a050acc994738ab61c1d
test: prerequisites 
/bin/bash
/usr/bin/git
/usr/bin/curl
/usr/bin/linkchecker

test: current working directory: /home/ddalex/ssd/yocto/poky, branch adamian/20140429-toastertesting
test: checking out: HEAD is now at 72aa761 tem
Fetching origin
Fetching contrib

Your branch and 'contrib/adamian/20140429-toastertesting' have diverged,
and have 2 and 1 different commit each, respectively.
  (use "git pull" to merge the remote branch into yours)

test: rebasing on master: First, rewinding head to replay your work on top of it...
Applying: bitbake: Toaster: selftest framework for pull requests
Applying: itbake: toaster: add commands to process email review request
Applying: tem

test: cherry-picking local DB settings: [test_adamian/20140429-toastertesting c197d50] DO NOT MERGE: test settings for mysql
 1 file changed, 4 insertions(+), 4 deletions(-)

test: verifing python syntax 

test: syncing the db 
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)

Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)

test: running Django tests 
Creating test database for alias 'default'...
Destroying test database for alias 'default'...


test: creating temp build env: 
You had no conf/local.conf file. This configuration file has therefore been
created for you with some default values. You may wish to edit it to use a 
different MACHINE (target hardware) or enable parallel build options to take 
advantage of multiple cores for example. See the file for more information as 
common configuration options are commented.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/

You had no conf/bblayers.conf file. The configuration file has been created for
you with some default values. To add additional metadata layers into your
configuration please add entries to this file.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/



### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
The system will start.
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)
Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)
server address: 127.0.0.1, server port: 8200
Successful start.
 
test: connecting to running server 
test: crawling site, it may take a while
test: checking 4xx/5xx HTML errors 

       ALL OK


cleanup: Deleting temp build environment 

### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
Shutting down bitbake memory resident server with bitbake -m
----------------------------------------The system will stop.
ERROR: Could not connect to server at localhost:8200 ([Errno 111] Connection refused)
Successful stop.

cleanup: restoring: HEAD is now at c197d50 DO NOT MERGE: test settings for mysql

Your branch and 'contrib/adamian/20140429-toastertesting' have diverged,
and have 2 and 1 different commit each, respectively.
  (use "git pull" to merge the remote branch into yours)

Deleted branch test_adamian/20140429-toastertesting (was c197d50).


[-- Attachment #2: Type: text/html, Size: 5580 bytes --]

Re: [review-request] adamian/20140429-toastertesting

[Damian, Alexandru]

[-- Attachment #1: Type: text/plain, Size: 3612 bytes --]

The tool is designed to be both available locally, for each developer, and
to automatically run on new emails with review requests.

To run the tool locally, you just make sure you have all of your work
committed, be in the poky/ directory, and run

$ python bitbake/lib/toaster/manage.py selftest {branchname}

Where {branchname} is the name of the branch you want to test.

And this is about it.

Alex


On Wed, May 14, 2014 at 4:58 AM, Reyna, David L (Wind River) <
david.reyna@windriver.com> wrote:

>  Hi Alex,
>
>
>
> This tool looks really useful.
>
>
>
> I think your goal is to have it such that contributors can run this tool
> locally before they post a review request. Perhaps you can give us a
> tutorial at some point on how we  can individually use this tool.
>
>
>
> Thanks,
>
> David
>
>
>
> *From:* toaster-bounces@yoctoproject.org [mailto:
> toaster-bounces@yoctoproject.org] *On Behalf Of *Damian, Alexandru
> *Sent:* Tuesday, April 29, 2014 7:20 AM
> *To:* toaster@yoctoproject.org
> *Subject:* [Toaster] [review-request] adamian/20140429-toastertesting
>
>
>
> Hello all,
>
>
>
> In a bid to get more help from automating sanity testing, I've written a
> Toaster command that will trigger some testing on a submitted review
> request. In short - if you've got a branch ready for submission, this test
> will make sure that the new code will not break anything already working.
>
>
>
>
>
> How this works:
>
>  - the command should be run in the root poky source directory, i.e. where
> you git clone'd the poky tree;
>
> - run *./bitbake/lib/toaster/manage.py selftest branch-to-test*
>
> - it takes a branch as parameter, and performs a suite of tests on that
> branch before cleaning up.
>
>
>
> *!IMPORTANT!*
>
> - It doesn't need a "build" directory or running "source
> oe-init-build-env".
>
> - It supports applying a custom database configuration to allow usage of a
> speedier backend than sqlite. The custom configuration should come in the
> form of a GIT commit id - see the source.
>
>
>
>
>
> Basically what this command does is:
>
>
>
> - verifies that the submitted branch can be cleanly rebased on top of
> origin/master
>
> - verifies that there are no python syntax errors in the new branch
>
> - *runs any defined Django tests for Toaster*
>
> - verifies that the system starts and stops correctly, using a temporary
> build environment
>
> - crawls the website and verifies that there are no links that get a 404,
> and there are no broken pages (i.e. 500)
>
>
>
> The results are printed to standard output.
>
>
>
>
>
>
>
> Planned development include:
>
> - include running the *oe-selftest* tests for Toaster
>
> - *automated integration* with the *toaster mailing list* to
> automatically test and report back the test result by email for each and
> all  [review-request] pull requests
>
>
>
>
>
>
>
> The proper way to extend this command to run any tests you want to add is
> to either:
>
> - add a standard Django test if you're developing Django front-end code
>
> - add a *oe-selftest* Toaster test if you're developing Toaster back-end
> code outside of the direct scope of the Django project.
>
>
>
>
>
> Any new automated test for existing or planned features will be greatly
> appreciated !
>
>
>
>
> I'm waiting your comments on the initiative and the patch.
>
>
>
> Cheers,
>
> Alex
>
>
>
> --
>
> Alex Damian
>
> Yocto Project
>
> SSG / OTC
>



-- 
Alex Damian
Yocto Project
SSG / OTC

[-- Attachment #2: Type: text/html, Size: 12421 bytes --]

Re: [review-request] adamian/20140429-toastertesting

[Reyna, David]

[-- Attachment #1: Type: text/plain, Size: 2674 bytes --]

Hi Alex,

This tool looks really useful.

I think your goal is to have it such that contributors can run this tool locally before they post a review request. Perhaps you can give us a tutorial at some point on how we  can individually use this tool.

Thanks,
David

From: toaster-bounces@yoctoproject.org [mailto:toaster-bounces@yoctoproject.org] On Behalf Of Damian, Alexandru
Sent: Tuesday, April 29, 2014 7:20 AM
To: toaster@yoctoproject.org
Subject: [Toaster] [review-request] adamian/20140429-toastertesting

Hello all,

In a bid to get more help from automating sanity testing, I've written a Toaster command that will trigger some testing on a submitted review request. In short - if you've got a branch ready for submission, this test will make sure that the new code will not break anything already working.


How this works:
 - the command should be run in the root poky source directory, i.e. where you git clone'd the poky tree;
- run ./bitbake/lib/toaster/manage.py selftest branch-to-test
- it takes a branch as parameter, and performs a suite of tests on that branch before cleaning up.

!IMPORTANT!
- It doesn't need a "build" directory or running "source oe-init-build-env".
- It supports applying a custom database configuration to allow usage of a speedier backend than sqlite. The custom configuration should come in the form of a GIT commit id - see the source.


Basically what this command does is:

- verifies that the submitted branch can be cleanly rebased on top of origin/master
- verifies that there are no python syntax errors in the new branch
- runs any defined Django tests for Toaster
- verifies that the system starts and stops correctly, using a temporary build environment
- crawls the website and verifies that there are no links that get a 404, and there are no broken pages (i.e. 500)

The results are printed to standard output.



Planned development include:
- include running the oe-selftest tests for Toaster
- automated integration with the toaster mailing list to automatically test and report back the test result by email for each and all  [review-request] pull requests



The proper way to extend this command to run any tests you want to add is to either:
- add a standard Django test if you're developing Django front-end code
- add a oe-selftest Toaster test if you're developing Toaster back-end code outside of the direct scope of the Django project.


Any new automated test for existing or planned features will be greatly appreciated !


I'm waiting your comments on the initiative and the patch.

Cheers,
Alex

--
Alex Damian
Yocto Project
SSG / OTC

[-- Attachment #2: Type: text/html, Size: 12292 bytes --]

Re: [review-request] adamian/20140429-toastertesting

[Alex's Testing Bot]

[-- Attachment #1: Type: text/plain, Size: 4229 bytes --]

Using local DB settings commit:  95a31f48b199d8df9c85a050acc994738ab61c1d
test: prerequisites 
/bin/bash
/usr/bin/git
/usr/bin/curl
/usr/bin/linkchecker

test: current working directory: /home/ddalex/ssd/yocto/poky, branch adamian/20140513-toastertesting
test: checking out: HEAD is now at 01845e1 temp
Fetching origin
Fetching contrib

Your branch is based on 'contrib/adamian/20140429-toastertesting', but the upstream is gone.
  (use "git branch --unset-upstream" to fixup)

test: rebasing on master: Current branch test_adamian/20140429-toastertesting is up to date.

test: cherry-picking local DB settings: [test_adamian/20140429-toastertesting 50f69e8] DO NOT MERGE: test settings for mysql
 1 file changed, 4 insertions(+), 4 deletions(-)

test: verifing python syntax 

test: syncing the db 
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)

Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)

test: running Django tests 
Creating test database for alias 'default'...
Destroying test database for alias 'default'...


test: creating temp build env: 
You had no conf/local.conf file. This configuration file has therefore been
created for you with some default values. You may wish to edit it to use a 
different MACHINE (target hardware) or enable parallel build options to take 
advantage of multiple cores for example. See the file for more information as 
common configuration options are commented.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/

You had no conf/bblayers.conf file. The configuration file has been created for
you with some default values. To add additional metadata layers into your
configuration please add entries to this file.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/



### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
The system will start.
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)
Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)
server address: 127.0.0.1, server port: 8200
Successful start.
 
test: connecting to running server 
test: crawling site, it may take a while
test: checking 4xx/5xx HTML errors 

       ALL OK


cleanup: Deleting temp build environment 

### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
Shutting down bitbake memory resident server with bitbake -m
The system will stop.
ERROR: Could not connect to server at localhost:8200 ([Errno 111] Connection refused)
Successful stop.

cleanup: restoring: HEAD is now at 50f69e8 DO NOT MERGE: test settings for mysql

Your branch is ahead of 'contrib/adamian/20140513-toastertesting' by 1 commit.
  (use "git push" to publish your local commits)

Deleted branch test_adamian/20140429-toastertesting (was 50f69e8).


[-- Attachment #2: Type: text/html, Size: 5269 bytes --]

Re: [review-request] adamian/20140429-toastertesting

[Alex's Testing Bot]

[-- Attachment #1: Type: text/plain, Size: 4229 bytes --]

Using local DB settings commit:  95a31f48b199d8df9c85a050acc994738ab61c1d
test: prerequisites 
/bin/bash
/usr/bin/git
/usr/bin/curl
/usr/bin/linkchecker

test: current working directory: /home/ddalex/ssd/yocto/poky, branch adamian/20140513-toastertesting
test: checking out: HEAD is now at 01845e1 temp
Fetching origin
Fetching contrib

Your branch is based on 'contrib/adamian/20140429-toastertesting', but the upstream is gone.
  (use "git branch --unset-upstream" to fixup)

test: rebasing on master: Current branch test_adamian/20140429-toastertesting is up to date.

test: cherry-picking local DB settings: [test_adamian/20140429-toastertesting 05dacfa] DO NOT MERGE: test settings for mysql
 1 file changed, 4 insertions(+), 4 deletions(-)

test: verifing python syntax 

test: syncing the db 
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)

Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)

test: running Django tests 
Creating test database for alias 'default'...
Destroying test database for alias 'default'...


test: creating temp build env: 
You had no conf/local.conf file. This configuration file has therefore been
created for you with some default values. You may wish to edit it to use a 
different MACHINE (target hardware) or enable parallel build options to take 
advantage of multiple cores for example. See the file for more information as 
common configuration options are commented.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/

You had no conf/bblayers.conf file. The configuration file has been created for
you with some default values. To add additional metadata layers into your
configuration please add entries to this file.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/



### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
The system will start.
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)
Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)
server address: 127.0.0.1, server port: 8200
Successful start.
 
test: connecting to running server 
test: crawling site, it may take a while
test: checking 4xx/5xx HTML errors 

       ALL OK


cleanup: Deleting temp build environment 

### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
Shutting down bitbake memory resident server with bitbake -m
The system will stop.
ERROR: Could not connect to server at localhost:8200 ([Errno 111] Connection refused)
Successful stop.

cleanup: restoring: HEAD is now at 05dacfa DO NOT MERGE: test settings for mysql

Your branch is ahead of 'contrib/adamian/20140513-toastertesting' by 1 commit.
  (use "git push" to publish your local commits)

Deleted branch test_adamian/20140429-toastertesting (was 05dacfa).


[-- Attachment #2: Type: text/html, Size: 5269 bytes --]

Re: [review-request] adamian/20140429-toastertesting

[Alex's Testing Bot]

[-- Attachment #1: Type: text/plain, Size: 4229 bytes --]

Using local DB settings commit:  95a31f48b199d8df9c85a050acc994738ab61c1d
test: prerequisites 
/bin/bash
/usr/bin/git
/usr/bin/curl
/usr/bin/linkchecker

test: current working directory: /home/ddalex/ssd/yocto/poky, branch adamian/20140513-toastertesting
test: checking out: HEAD is now at 01845e1 temp
Fetching origin
Fetching contrib

Your branch is based on 'contrib/adamian/20140429-toastertesting', but the upstream is gone.
  (use "git branch --unset-upstream" to fixup)

test: rebasing on master: Current branch test_adamian/20140429-toastertesting is up to date.

test: cherry-picking local DB settings: [test_adamian/20140429-toastertesting 43a960d] DO NOT MERGE: test settings for mysql
 1 file changed, 4 insertions(+), 4 deletions(-)

test: verifing python syntax 

test: syncing the db 
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)

Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)

test: running Django tests 
Creating test database for alias 'default'...
Destroying test database for alias 'default'...


test: creating temp build env: 
You had no conf/local.conf file. This configuration file has therefore been
created for you with some default values. You may wish to edit it to use a 
different MACHINE (target hardware) or enable parallel build options to take 
advantage of multiple cores for example. See the file for more information as 
common configuration options are commented.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/

You had no conf/bblayers.conf file. The configuration file has been created for
you with some default values. To add additional metadata layers into your
configuration please add entries to this file.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/



### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
The system will start.
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)
Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)
server address: 127.0.0.1, server port: 8200
Successful start.
 
test: connecting to running server 
test: crawling site, it may take a while
test: checking 4xx/5xx HTML errors 

       ALL OK


cleanup: Deleting temp build environment 

### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
Shutting down bitbake memory resident server with bitbake -m
The system will stop.
ERROR: Could not connect to server at localhost:8200 ([Errno 111] Connection refused)
Successful stop.

cleanup: restoring: HEAD is now at 43a960d DO NOT MERGE: test settings for mysql

Your branch is ahead of 'contrib/adamian/20140513-toastertesting' by 1 commit.
  (use "git push" to publish your local commits)

Deleted branch test_adamian/20140429-toastertesting (was 43a960d).


[-- Attachment #2: Type: text/html, Size: 5269 bytes --]

Re: [review-request] adamian/20140429-toastertesting

[Alex's Testing Bot]

[-- Attachment #1: Type: text/plain, Size: 4345 bytes --]

Using local DB settings commit:  95a31f48b199d8df9c85a050acc994738ab61c1d
test: prerequisites 
/bin/bash
/usr/bin/git
/usr/bin/curl
/usr/bin/linkchecker

test: current working directory: /home/ddalex/ssd/yocto/poky, branch adamian/20140513-toastertesting
test: checking out: HEAD is now at 4e41c25 bitbake: toaster: add commands to process email review request
Fetching origin
Fetching contrib

Your branch is based on 'contrib/adamian/20140429-toastertesting', but the upstream is gone.
  (use "git branch --unset-upstream" to fixup)

test: rebasing on master: Current branch test_adamian/20140429-toastertesting is up to date.

test: cherry-picking local DB settings: [test_adamian/20140429-toastertesting 6976d57] DO NOT MERGE: test settings for mysql
 1 file changed, 4 insertions(+), 4 deletions(-)

test: verifing python syntax 

test: syncing the db 
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)

Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)

test: running Django tests 
Creating test database for alias 'default'...
Destroying test database for alias 'default'...


test: creating temp build env: 
You had no conf/local.conf file. This configuration file has therefore been
created for you with some default values. You may wish to edit it to use a 
different MACHINE (target hardware) or enable parallel build options to take 
advantage of multiple cores for example. See the file for more information as 
common configuration options are commented.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/

You had no conf/bblayers.conf file. The configuration file has been created for
you with some default values. To add additional metadata layers into your
configuration please add entries to this file.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/



### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
The system will start.
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)
Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)
server address: 127.0.0.1, server port: 8200
Successful start.
 
test: connecting to running server 
test: crawling site, it may take a while
test: checking 4xx/5xx HTML errors 

       ALL OK


cleanup: Deleting temp build environment 

### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
Shutting down bitbake memory resident server with bitbake -m
The system will stop.
ERROR: Could not connect to server at localhost:8200 ([Errno 111] Connection refused)
Successful stop.

cleanup: restoring: HEAD is now at 6976d57 DO NOT MERGE: test settings for mysql

Your branch and 'contrib/adamian/20140513-toastertesting' have diverged,
and have 2 and 2 different commits each, respectively.
  (use "git pull" to merge the remote branch into yours)

Deleted branch test_adamian/20140429-toastertesting (was 6976d57).


[-- Attachment #2: Type: text/html, Size: 5390 bytes --]

Re: [review-request] adamian/20140429-toastertesting

[Alex's Testing Bot]

[-- Attachment #1: Type: text/plain, Size: 4441 bytes --]

Using local DB settings commit:  95a31f48b199d8df9c85a050acc994738ab61c1d
test: prerequisites 
/bin/bash
/usr/bin/git
/usr/bin/curl
/usr/bin/linkchecker

test: current working directory: /home/ddalex/ssd/yocto/poky, branch adamian/20140429-toastertesting
test: checking out: HEAD is now at 687bf0e tem
Fetching origin
Fetching contrib

Your branch and 'contrib/adamian/20140429-toastertesting' have diverged,
and have 2 and 1 different commit each, respectively.
  (use "git pull" to merge the remote branch into yours)

test: rebasing on master: First, rewinding head to replay your work on top of it...
Applying: bitbake: Toaster: selftest framework for pull requests
Applying: itbake: toaster: add commands to process email review request
Applying: tem

test: cherry-picking local DB settings: [test_adamian/20140429-toastertesting c5ebf2b] DO NOT MERGE: test settings for mysql
 1 file changed, 4 insertions(+), 4 deletions(-)

test: verifing python syntax 

test: syncing the db 
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)

Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)

test: running Django tests 
Creating test database for alias 'default'...
Destroying test database for alias 'default'...


test: creating temp build env: 
You had no conf/local.conf file. This configuration file has therefore been
created for you with some default values. You may wish to edit it to use a 
different MACHINE (target hardware) or enable parallel build options to take 
advantage of multiple cores for example. See the file for more information as 
common configuration options are commented.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/

You had no conf/bblayers.conf file. The configuration file has been created for
you with some default values. To add additional metadata layers into your
configuration please add entries to this file.

The Yocto Project has extensive documentation about OE including a reference manual
which can be found at:
    http://yoctoproject.org/documentation

For more information about OpenEmbedded see their website:
    http://www.openembedded.org/



### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
The system will start.
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.staticfiles
 > django.contrib.humanize
 > south

Not synced (use migrations):
 - orm
(use ./manage.py migrate to migrate these)
Running migrations for orm:
- Nothing to migrate.
 - Loading initial data for orm.
Installed 0 object(s) from 0 fixture(s)
server address: 127.0.0.1, server port: 8200
Successful start.
 
test: connecting to running server 
test: crawling site, it may take a while
test: checking 4xx/5xx HTML errors 

       ALL OK


cleanup: Deleting temp build environment 

### Shell environment set up for builds. ###

You can now run 'bitbake <target>'

Common targets are:
    core-image-minimal
    core-image-sato
    meta-toolchain
    adt-installer
    meta-ide-support

You can also run generated qemu images with a command like 'runqemu qemux86'
Shutting down bitbake memory resident server with bitbake -m
The system will stop.
ERROR: Could not connect to server at localhost:8200 ([Errno 111] Connection refused)
Successful stop.

cleanup: restoring: HEAD is now at 687bf0e tem

Your branch and 'contrib/adamian/20140429-toastertesting' have diverged,
and have 2 and 1 different commit each, respectively.
  (use "git pull" to merge the remote branch into yours)

Deleted branch test_adamian/20140429-toastertesting (was c5ebf2b).


[-- Attachment #2: Type: text/html, Size: 5506 bytes --]

[review-request] adamian/20140429-toastertesting

[Damian, Alexandru]

[-- Attachment #1: Type: text/plain, Size: 923 bytes --]

Hello,

I have a new version of the automated review-request testing patch.

I'm adding a command (*emailrecv) *that is used to read incoming mails
(through a pipe, e.g. setting a .forward file) and trigger the integration
self test for any new review-request email.

The first benefit you get is an automated check if your review request can
be cleanly rebased on master. To correctly trigger this, please use the
review request header set to:

"[review-request] branch/name"

where branch/name is the poky-contrib branch name, e.g.
adamian/20140429-toastertesting

I have set this up running on a spare machine, and I'm hoping to reduce
turn-around time for patches that cannot be cleanly rebased on latest
master, or avoid really simple errors as python syntax errors.

Please let me know if you see anything going wrong with this.

Thank you,
Alex

-- 
Alex Damian
Yocto Project
SSG / OTC

[-- Attachment #2: Type: text/html, Size: 1722 bytes --]

[review-request] adamian/20140429-toastertesting

[Damian, Alexandru]

[-- Attachment #1: Type: text/plain, Size: 2176 bytes --]

Hello all,

In a bid to get more help from automating sanity testing, I've written a
Toaster command that will trigger some testing on a submitted review
request. In short - if you've got a branch ready for submission, this test
will make sure that the new code will not break anything already working.


How this works:
 - the command should be run in the root poky source directory, i.e. where
you git clone'd the poky tree;
- run *./bitbake/lib/toaster/manage.py selftest branch-to-test*
- it takes a branch as parameter, and performs a suite of tests on that
branch before cleaning up.

*!IMPORTANT!*
- It doesn't need a "build" directory or running "source oe-init-build-env".
- It supports applying a custom database configuration to allow usage of a
speedier backend than sqlite. The custom configuration should come in the
form of a GIT commit id - see the source.


Basically what this command does is:

- verifies that the submitted branch can be cleanly rebased on top of
origin/master
- verifies that there are no python syntax errors in the new branch
- *runs any defined Django tests for Toaster*
- verifies that the system starts and stops correctly, using a temporary
build environment
- crawls the website and verifies that there are no links that get a 404,
and there are no broken pages (i.e. 500)

The results are printed to standard output.



Planned development include:
- include running the *oe-selftest* tests for Toaster
- *automated integration* with the *toaster mailing list* to automatically
test and report back the test result by email for each and all
 [review-request] pull requests



The proper way to extend this command to run any tests you want to add is
to either:
- add a standard Django test if you're developing Django front-end code
- add a *oe-selftest* Toaster test if you're developing Toaster back-end
code outside of the direct scope of the Django project.


Any new automated test for existing or planned features will be greatly
appreciated !


I'm waiting your comments on the initiative and the patch.

Cheers,
Alex

-- 
Alex Damian
Yocto Project
SSG / OTC

[-- Attachment #2: Type: text/html, Size: 5600 bytes --]