Problem setting up Toaster production enviroment

* Problem setting up Toaster production enviroment
@ 2016-05-12 22:32 Sebastian Salmhofer
  2016-05-13  7:05 ` Smith, Elliot
  0 siblings, 1 reply; 3+ messages in thread
From: Sebastian Salmhofer @ 2016-05-12 22:32 UTC (permalink / raw)
  To: toaster

[-- Attachment #1: Type: text/plain, Size: 11721 bytes --]

Hi,

I am new to Yocto Project and I am trying to set up Toaster. I had no
problem setting up Yocto Project and doing a test build on the command line.
Now I want to use toaster but I can't get it to work for me.
I am using Lubuntu 15.10 but I tried Ubuntu 15.10 as well with the same
results.
I am using the user manual (
http://www.yoctoproject.org/docs/1.8/toaster-manual/toaster-manual.html),
wiki (
https://wiki.yoctoproject.org/wiki/Setting_up_a_production_instance_of_Toaster)
as well as this post (
https://lists.yoctoproject.org/pipermail/toaster/2015-December/003525.html).
I think there are some mistakes in the manual and also on the wiki, but I
managed to get a routine that works without major problems, I will show it
later, and the Toaster GUI works. The problem is I can not build. I always
get an error ('NoneType' object has no attribute 'rfind').
The settings in toaster are all default, release is krogoth and the
build-image is core-image-sato.
The console puts out this:

> 2016-05-12 23:43:06,319 DEBUG runbuilds: starting build Test (Release
> krogoth (krogoth), BBV krogoth (Branch: krogoth)) in progress, environment
> BuildEnvironment object
> 2016-05-12 23:43:06,390 DEBUG localhostbecontroller, our git repos are
> {(u'git://git.yoctoproject.org/meta-yocto', u'krogoth'): [(u'meta-poky',
>                                                            u'meta-poky'),
>
> (u'meta-yocto-bsp',
>
>  u'meta-yocto-bsp')],
>  (u'git://git.yoctoproject.org/poky', u'krogoth'): [('bitbake',
> u'bitbake'),
>                                                     (u'openembedded-core',
>                                                      u'meta')]}
> 2016-05-12 23:43:06,390 DEBUG lbc_shellcmmd: (/var/www/toaster/poky/) git
> remote -v
> 2016-05-12 23:43:06,417 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:06,417 INFO Using pre-checked out source for layer
> {'git://git.yoctoproject.org/poky': u'/var/www/toaster/poky/'}
> 2016-05-12 23:43:06,417 DEBUG localhostbecontroller: giturl git://
> git.yoctoproject.org/poky:krogoth checking out in current directory
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth
> 2016-05-12 23:43:06,418 DEBUG localhostbecontroller git-copying
> /var/www/toaster/poky/ to
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth
> 2016-05-12 23:43:06,418 DEBUG lbc_shellcmmd: (/var/www/toaster/poky/) git
> clone "/var/www/toaster/poky/"
> "/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth"
> 2016-05-12 23:43:10,665 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:10,666 DEBUG lbc_shellcmmd:
> (/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth)
> git remote remove origin
> 2016-05-12 23:43:10,699 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:10,700 DEBUG lbc_shellcmmd:
> (/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth)
> git remote add origin "git://git.yoctoproject.org/poky"
> 2016-05-12 23:43:10,725 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:10,726 DEBUG localhostbecontroller: checking out commit
> krogoth to
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth
> 2016-05-12 23:43:10,726 DEBUG lbc_shellcmmd:
> (/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth)
> git fetch --all && git reset --hard "origin/krogoth"
> 2016-05-12 23:43:17,266 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:17,267 DEBUG localhostbecontroller: selected poky dir
> name
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth
> 2016-05-12 23:43:17,267 DEBUG localhostbecontroller: localdirpath expected
> '/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth/bitbake'
> 2016-05-12 23:43:17,267 DEBUG localhostbecontroller: localdirpath expected
> '/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth/meta'
> 2016-05-12 23:43:17,267 DEBUG localhostbecontroller: giturl git://
> git.yoctoproject.org/meta-yocto:krogoth checking out in current directory
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth
> 2016-05-12 23:43:17,267 DEBUG localhostbecontroller: cloning git://
> git.yoctoproject.org/meta-yocto in
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth
> 2016-05-12 23:43:17,267 DEBUG lbc_shellcmmd: (/var/www/toaster/poky/) git
> clone "git://git.yoctoproject.org/meta-yocto"
> "/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth"
> 2016-05-12 23:43:20,155 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:20,155 DEBUG localhostbecontroller: checking out commit
> krogoth to
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth
> 2016-05-12 23:43:20,155 DEBUG lbc_shellcmmd:
> (/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth)
> git fetch --all && git reset --hard "origin/krogoth"
> 2016-05-12 23:43:20,809 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:20,809 DEBUG localhostbecontroller: localdirpath expected
> '/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth/meta-poky'
> 2016-05-12 23:43:20,809 DEBUG localhostbecontroller: localdirpath expected
> '/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth/meta-yocto-bsp'
> 2016-05-12 23:43:20,810 DEBUG localhostbecontroller: current layer list
> [u'/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth/meta',
>
>  u'/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth/meta-poky',
>
>  u'/var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_meta-yocto_krogoth/meta-yocto-bsp']
> 2016-05-12 23:43:20,813 DEBUG lbc_shellcmmd: (/var/www/toaster/poky/) bash
> -c 'source
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth/oe-init-build-env
> /var/www/toaster/poky//build-toaster-2'
> 2016-05-12 23:43:20,972 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:20,987 DEBUG lbc_shellcmmd: (/var/www/toaster/poky/) bash
> -c "source
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth/oe-init-build-env
> /var/www/toaster/poky//build-toaster-2; BITBAKE_UI=""
> /var/www/toaster/poky/_toaster_clones/_git___git.yoctoproject.org_poky_krogoth/bitbake/bin/bitbake
> --read /var/www/toaster/poky//build-toaster-2/conf/toaster.conf
> --server-only -t xmlrpc -B 0.0.0.0:0"
> 2016-05-12 23:43:22,004 DEBUG localhostbecontroller: shellcmd success
> 2016-05-12 23:43:22,005 DEBUG localhostbecontroller: bitbake port 34754
> 2016-05-12 23:43:22,093 ERROR runbuilds: Error launching build 'NoneType'
> object has no attribute 'rfind'
> Traceback (most recent call last):
>   File
> "/var/www/toaster/poky/bitbake/lib/toaster/bldcontrol/management/commands/runbuilds.py",
> line 67, in schedule
>     "%d:%d" % (br.pk, bec.be.pk))
>   File
> "/var/www/toaster/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py",
> line 323, in triggerBuild
>     local_bitbake = os.path.join(os.path.dirname(os.getenv('BBBASEDIR')),
>   File "/var/www/toaster/venv/lib/python2.7/posixpath.py", line 122, in
> dirname
>     i = p.rfind('/') + 1
> AttributeError: 'NoneType' object has no attribute 'rfind'
> 2016-05-12 23:43:23,302 DEBUG Saving error 'NoneType' object has no
> attribute 'rfind' (Test (Release krogoth (krogoth), BBV krogoth (Branch:
> krogoth)) failed)

This is how I installed everything:
I was pasting all commands into the console one by one by hand, so this is
not a script, just a "log" what I did. '#' means I didn't past whats after
it in the same line.

First setting up the Yocto Project:

> sudo apt-get install gawk wget git-core diffstat unzip texinfo
> gcc-multilib build-essential chrpath socat
> sudo apt-get install libsdl1.2-dev xterm
> sudo apt-get install autoconf automake libtool libglib2.0-dev
> libarchive-dev
> git clone git://git.yoctoproject.org/poky
> cd poky
> git checkout krogoth

And Toaster:

> sudo apt-get install apache2 libapache2-mod-wsgi mysql-server
> python-virtualenv libmysqlclient-dev python-dev python-mysqldb
> #mysql asks to set root password
>

#I don't care about security, as I am just using it localy at home and at
> this point I just want it to work anyway
> sudo chmod -R 777 /var/www
> mkdir -p /var/www/toaster
> cd /var/www/toaster/
> git clone git://git.yoctoproject.org/poky
> cd poky
> git checkout krogoth
>

cd /var/www/toaster/
> virtualenv venv
> source ./venv/bin/activate
> pip install -r ./poky/bitbake/toaster-requirements.txt
> pip install mysql
> pip install MySQL-python
> pip install mysqlclient
>

#Editing the following in
> /var/www/toaster/poky/bitbake/lib/toaster/toastermain/settings.py
> #DATABASES = {
> #    'default': {
> #        'ENGINE': 'django.db.backends.mysql',
> #        'NAME': 'toaster_data',
> #        'USER': 'toaster',
> #        'PASSWORD': 'toaster',
> #        'HOST': 'localhost',
> #        'PORT': '3306',
> #}

#

#STATIC_ROOT = '/var/www/toaster/static_files/'
>
#

#Don't care about that either, just put in something random

#SECRET_KEY = '$%_^=olgg64c0zwwlfkoy0ehk-u3$70-8f5+&thpkjks4st8o9T'
>

mysql -u root -p
> CREATE DATABASE toaster_data;
> CREATE USER 'toaster'@'localhost' identified by 'toaster';
> GRANT all on toaster_data.* to 'toaster'@'localhost';
> quit
>

cd  /var/www/toaster/poky/
> ./bitbake/lib/toaster/manage.py syncdb
> ./bitbake/lib/toaster/manage.py migrate
> ./bitbake/lib/toaster/manage.py loadconf ./meta-poky/conf/toasterconf.json
> TOASTER_DIR=/var/www/toaster/poky/
> TOASTER_CONF=./meta-poky/conf/toasterconf.json
> ./bitbake/lib/toaster/manage.py checksettings
> ./bitbake/lib/toaster/manage.py lsupdates   #Showed some debug
> information, I think some bb stuff is duplicated, I don't have the exact
> output unfortunately and don't know if it causes the problem
> ./bitbake/lib/toaster/manage.py collectstatic
>

sudo nano /etc/apache2/conf-available/toaster.conf
> #Paste the following:
> #Alias /static /var/www/toaster/static_files
> #<Directory /var/www/toaster/static_files>
> # Order allow,deny
> # Allow from all
> # Require all granted
> #</Directory>
> #WSGIDaemonProcess toaster_wsgi
> python-path=/var/www/toaster/poky/bitbake/lib/toaster:/var/www/toaster/venv/lib/python2.7/site-packages
> #WSGIScriptAlias /
> "/var/www/toaster/poky/bitbake/lib/toaster/toastermain/wsgi.py"
> #<Location />
> #    WSGIProcessGroup toaster_wsgi
> #</Location>
>

sudo a2enmod wsgi
> sudo a2enconf toaster
> chmod +x bitbake/lib/toaster/toastermain/wsgi.py
> sudo service apache2 restart
>

#And to start it up:
>
> /var/www/toaster/poky/bitbake/lib/toaster/manage.py runbuilds

Does anyone here know whats wrong and how I can fix? Or is there a better
manual somewhere?
I tried everything I could think of. I reinstalled the OS a few times and
tried to reinstall Yocto Project and Toaster from scratch on a fresh OS.
Eventually I got to where Toaster at least starts and I can use the GUI,
now I just need it to also build.
I would be really thankful if you could help me to get this to run, so if
anyone has an idea please tell me what to do.

Thanks in advance and
kind regards

Sebastian Salmhofer

[-- Attachment #2: Type: text/html, Size: 18361 bytes --]

^ permalink raw reply	[flat|nested] 3+ messages in thread