Tuesday, March 17, 2015

Running Katana

I have been developing features on top of buildbot on a project that we internally called Katana, which is a custom version based on 0.8.7.p1. Here Na’tosha gives a very good explanation about the project. 

Now, I’m going to quickly go over some of the features and  provide a more detailed explanation on how to get started running katana.

Overall features
Some of the features and customizations we have developed for katana:
  • Multiple project support
  • Build status page filters the information by project / branches
  • Trigger builds and upload / download artifact dependencies
  • New UI design
  • Real-time data
  • Authentication AD/LDAP, etc

Get the code
git clone https://github.com/Unity-Technologies/buildbot.git src
git checkout katana (this is our stable branch)

Development environment
You can run katana in the same way as you do with buildbot (with a few differences):

Setup python virtual environment
virtualenv --no-site-packages katana-venv/
source katana-venv/bin/activate

Python modules
We are using the following modules
pip install -Iv SQLAlchemy-migrate==0.7.2
pip install -Iv SQLAlchemy==0.7.9
pip install python-ldap
pip install mock
pip install mysql-python

Setup the master and slave
pip install -e master
pip install -e slave

Check the running version
buildbot --version
buildslave --version

Run the tests
trial buildbot.test
trial buildslave.test

Create the buildmaster
buildbot create-master buildmaster

Change configuration file
mv master.cfg.sample master.cfg

Change html folder
Set the public_html folder to the one matching the resources (src)
c['status'].append(html.WebStatus(http_port=8010, authz=authz_cfg,
                                 public_html="../src/www"))


Running the master
You should be able to see katana  at http://localhost:8010/ after running:
buildbot start




You should be able to login to katana using pyflakes user and password, the default example configuration should look this:


authz_cfg=authz.Authz(
   # change any of these to True to enable; see the manual for more
   # options
   auth=auth.BasicAuth([("pyflakes","pyflakes")]),
   gracefulShutdown = False,
   forceBuild = 'auth', # use this to test your slave once it is set up
   forceAllBuilds = False,
   pingBuilder = False,
   stopBuild = False,
   stopAllBuilds = False,
   cancelPendingBuild = False,
)

If you sign in using pyflakes usr/password you will see Katana running

That's all, next time will bring more examples of using Katana.

43 comments:

  1. Hi,
    thank you for this great recipe…
    However, there is a problem if I use the "SQLAlchemy==0.7.9"
    I had to install "SQLAlchemy==0.7.10" ( by "pip install -Uv SQLAlchemy" ) for buildbot to work

    My config : Ubuntu 14.04.2 LTS
    pip list :
    alabaster (0.7.6)
    argparse (1.2.1)
    Babel (1.3)
    buildbot (1.2.12-2-g791f32d)
    buildbot-slave (1.2.12-2-g791f32d)
    decorator (3.4.2)
    docutils (0.12)
    funcsigs (0.4)
    Jinja2 (2.7.3)
    MarkupSafe (0.23)
    mock (1.1.3)
    MySQL-python (1.2.5)
    pbr (1.3.0)
    pip (1.5.4)
    pyflakes (0.9.2)
    Pygments (2.0.2)
    python-dateutil (1.5)
    pytz (2015.4)
    setuptools (2.2)
    six (1.9.0)
    snowballstemmer (1.2.0)
    Sphinx (1.3.1)
    sphinx-rtd-theme (0.1.8)
    SQLAlchemy (0.7.10)
    sqlalchemy-migrate (0.7.2)
    Tempita (0.5.2)
    Twisted (15.2.1)
    wsgiref (0.1.2)
    zope.interface (4.1.2)

    regards

    jmb

    ReplyDelete
  2. I've been trying to get katana installed and running on Ubuntu server 14.04.3 LTS, but I'm getting stuck after executing:
    "pip install -e master"

    I'ts complaining about SQLAlchemy-migration:

    "Could not find a version that satisfies the requirement sqlalchemy-migrate==0.6.1,==0.7.0,==0.7.1,==0.7.2 (from buildbot===1.1.8-275-g804d540) (from versions: 0.3.0, 0.4.2, 0.4.3, 0.4.4, 0.4.5, 0.5.1.2, 0.5.2, 0.5.3, 0.5.4, 0.6, 0.6.1, 0.7, 0.7.1, 0.7.2, 0.8.1, 0.8.2, 0.8.4, 0.8.5, 0.9, 0.9.1, 0.9.2, 0.9.4, 0.9.5, 0.9.6, 0.9.7, 0.9.8, 0.10.0)
    Some externally hosted files were ignored as access to them may be unreliable (use --allow-external sqlalchemy-migrate to allow).
    No matching distribution found for sqlalchemy-migrate==0.6.1,==0.7.0,==0.7.1,==0.7.2 (from buildbot===1.1.8-275-g804d540)"

    My pip list does show that SQLAlchemy (0.7.10) and sqlalchemy-migrate (0.7.2) are available.
    You have any clue what could be causing this?

    ReplyDelete
  3. Hola Mariangela, muchas gracias por el tutorial, me ha ayudado bastante!

    Saludos desde Venezuela

    ReplyDelete
  4. I am Alecia,from what I can read. It has been sad news and scam to everyone about Voodoo casters or so. But to me they are so real cause one worked for me not quite two weeks.i met this man on a blog his name is Dr Abalaka is a very powerful man.I traveled down to where his shrine his and we both did the ritual and sacrifice.he had no website site, and now me and my ex are living very ok now.I don't know about you but Voodoo is real;love marriage,finance, job promotion ,lottery Voodoo,poker voodoo,golf Voodoo,Law & Court case Spells,money voodoo,weigh loss voodoo,diabetic voodoo,hypertensive voodoo,high cholesterol voodoo,Trouble in marriage,Barrenness(need a child),Luck, Money Spells,it's all he does. I used my money to purchase everything he used he never collected a dime from. He told me I can repay him anytime with anything from my heart. Now I don't know how to do that. If you can help or you need his help write him on (dr.abalaka@outlook.com) i believe that your story will change for better,or if you have any question you can contact me here as 1001madonado@gmail.com if you have any question Thank you.

    ReplyDelete
  5. This comment has been removed by the author.

    ReplyDelete
  6. Wow it is really wonderful and awesome thus it is very much useful for me to understand many concepts and helped me a lot. it is really explainable very well and i got more information from your blog.

    rpa training in chennai | rpa training in chennai
    rpa training in pune | rpa online training | rpa training in bangalore

    ReplyDelete
  7. Superb. I really enjoyed very much with this article here. Really it is an amazing article I had ever read. I hope it will help a lot for all. Thank you so much for this amazing posts and please keep update like this excellent article. thank you for sharing such a great blog with us.
    python training in pune | python training institute in chennai | python training in Bangalore

    ReplyDelete
  8. Whoa! I’m enjoying the template/theme of this website. It’s simple, yet effective. A lot of times it’s very hard to get that “perfect balance” between superb usability and visual appeal. I must say you’ve done a very good job with this.


    AWS Training in BTM Layout |Best AWS Training in BTM Layout

    AWS Training in Marathahalli | Best AWS Training in Marathahalli



    ReplyDelete
  9. Thank you for written this blog regarding to core technology.This is very Helpful and informative blog.
    Devops Training in Chennai | Devops Training Institute in Chennai

    ReplyDelete
  10. Great Post,really it was very helpful for us.
    Thanks a lot for sharing!
    I found this blog to be very useful!!
    Python training in Bangalore

    ReplyDelete
  11. Attend The Python training in bangalore From ExcelR. Practical Python training in bangalore Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Python training in bangalore.
    python training in bangalore

    ReplyDelete
  12. Great blog. All posts have something to learn. Your work is very good and i appreciate you and hopping for some more informative posts. Download Speech Recognition

    ReplyDelete
  13. For Hadoop Training in Bangalore Visit : HadoopTraining in Bangalore

    ReplyDelete
  14. It is the best article to read this information.good topic to discuss this article.I am very enjoy to read this information.It is to get the inspiration for me to go to the next level.thanks
    Ai & Artificial Intelligence Course in Chennai
    PHP Training in Chennai
    Ethical Hacking Course in Chennai Blue Prism Training in Chennai
    UiPath Training in Chennai

    ReplyDelete
  15. Thanks for providing recent updates regarding the concern, I look forward to read more.
    Data Science Institute in Bangalore

    ReplyDelete
  16. I’m excited to uncover this page. I need to to thank you for ones time for this particularly fantastic read!! I definitely really liked every part of it and i also have you saved to look at new information in your site.
    java training in chennai

    java training in tambaram

    aws training in chennai

    aws training in tambaram

    python training in chennai

    python training in tambaram

    selenium training in chennai

    selenium training in tambaram

    ReplyDelete
  17. Great post! I am see the programming coding and step by step execute the outputs.I am gather this coding more information. It's helpful for me my friend. Also great blog here with all of the valuable information you have.
    angular js training in chennai

    angular js training in omr

    full stack training in chennai

    full stack training in omr

    php training in chennai

    php training in omr

    photoshop training in chennai

    photoshop training in omr

    ReplyDelete
  18. I really like your writing style, great date, thank you for posting.pmp certification in malaysia

    ReplyDelete
  19. very impressive information and excellent writing skill, found very unique thank you.
    typeerror nonetype object is not subscriptable

    ReplyDelete
  20. These musings just knocked my socks off. I am happy you have posted this.
    hrdf training course

    ReplyDelete
  21. Nice post and i check your blog everyday and try to learn something from your blog. Thank you and waiting for your new post.
    unindent does not match any outer indentation level python

    ReplyDelete
  22. Fantastic blog with unique content and information provided was very valuable waiting for next blog update thank you .
    Ethical Hacking Course in Bangalore

    ReplyDelete
  23. Excellent blog information shared was very informative looking forward for next blog thank you.
    Data Science Course in Hyderabad 360DigiTMG

    ReplyDelete

  24. Really impressed! Everything is very open and very clear clarification of issues. It contains true facts. Your website is very valuable. Thanks for sharing.
    Digital Marketing Course

    ReplyDelete
  25. I wanted to thank you for this great read!! I definitely enjoying every little bit of it I have you bookmarked to check out new stuff you post.
    data scientist training and placement

    ReplyDelete
  26. I am impressed by the information that you have on this blog. It shows how well you understand this subject.
    data scientist course in malaysia

    ReplyDelete
  27. Appealing, notice. I essentially found your blog and needed to broadcast that i've valued perusing your weblog posts. After each one in all extent of portion of, I can truly buy into your feed, and that I objective you might compose again rapidly! Office Product Key Free

    ReplyDelete
  28. Very fine transmission. I just found your blog and wanted to articulate that i've in all actuality cherished riding your blog entries. After every evil be buying in for your feed and I reason you compose behind extra rapidly! Vysor Pro Crack

    ReplyDelete
  29. Wishing my love, who loves to wrap me in a bear hug, a happy teddy day! · I wish my teddy bear will always be happy and merry all through life.. Teddy Bear Quotes

    ReplyDelete


  30. I enjoy your posts. You did an excellent job. Thank you for the information that was helpful.
    Windscribe VPN Premium

    ReplyDelete