Changes

== Project Details == === Release 0.1 === ==== Goals ====* Add in a new build step to Buildbot* Allow Buildbot to connect with Amazon's EC2 service[[User:Armenzg|Armen Zambrano]]

    Note: You will need to install can see more information about individual releases by following the boto library located [http://boto.googlecode.com/files/boto-0.9a.tar.gz here]links below.

Basically, this first version attempts to connect to an * [[Buildbot and EC2 account, and then display the connection information to show that it has connected/0.3]]

It uses a library called "boto", * [[Buildbot and this library is used to connect to all of [http://www.amazon.com/gpEC2/browse0.html?node=3435361 Amazon's Web Services4]]

To use this in a * [[Buildbot configuration file, simply call the connect_to_ec2() function, which takes in as paramaters, an Amazon id key, and an Amazon secret keyEC2/0.5]]

Example:<pre> connection = connect_to_ec2("73ghf9h38fh", "75vo87rVO*&V%O7o75v7i%i75I&5li7%i75")<[[Buildbot and EC2/pre>0.6 | Buildbot and EC2/0.6/0.7]]

=== Release 0.2 === ==== Goals ==== * Start New Instances* Add new instances to build slave list* Start a build on an EC2 instance build slave ==== Downloads ====&nbsp;&nbsp;&nbsp;&nbsp;[http://zenit.senecac.on.ca/wiki/imgs/EC2BuildSlave_nokey.zip EC2BuildSlave.py]&nbsp;&nbsp;&nbsp;&nbsp;*Just put this file into your buildbot installation folder so python can access it<br/>&nbsp;&nbsp;&nbsp;&nbsp;[http://zenit.senecac.on.ca/wiki/imgs/Master.zip Master.cfg] ==== About ==== To use the EC2 service with Buildbot, there needs to be some way for Buildbot to dynamically generate a list of build slaves. These build slaves (or just slaves) are hosted as a virtual machine on the and EC2 service.  This will work by extending the BuildSlave class to add in some new functionality for starting a new EC2 instance. So, every time you add a new slave to the slave list, another instance will be spwaned, so that you can spawn as many instances as you think you will need to complete a build. This new BuildSlave class will start a new instance, which will then proceed to send the connection information of the master to the new instance. How exactly, I'm not exactly sure, because it takes a minute for the virtual instance to start up.  The rest basically takes care of itself. Still have to think about how to turn the new EC2 instances off after the build is done. ====/0.2.1=========About=====I have made a slight modification to the EC2BuildSlave.<br/>It now requires some additional input, because I had been hardcoding some values in, and thats sloppy, so I corrected it to allow you to put any variable parameters in the config file.<br/>Basically, you will lay out a new EC2BuildSlave like this:  from buildbot.EC2BuildSlave import EC2BuildSlave c['slaves'9] = [EC2BuildSlave("bot1name", "bot1passwd", "public key", "private key", "dns", "instance-id")] //Where dns = www.whatever.com:8898, or 88.123.55.456:8898 //and public/private key is your public/private key from Amazon //and instance-id is the instance you would like to launch ("ami-87d530ee") =====Downloads=====* [[http://zenit.senecac.on.ca/wiki/imgs/Buildbot_EC2.zip Patch]] The EC2BuildSlave.py goes into your python's framework folder for Buildbot (note: on my mac, this is<br/> /Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/site-packages/buildbot/) ---- === Release 0.3 === ==== Goals ==== ==== Downloads ==== ==== About ====

<th style="width: 1517%;"><br />'''''Task'''''<br /><br /></th> <th style="width: 4535%;"><br />'''''Details'''''<br /><br /></th> <th style="width: 105%;"><br />'''''Priority'''''<br /><br /></th> <th style="width: 10%;"><br />'''''Contributors'''''<br /><br /></th> <th style="width: 1015%;"><br />'''''Status'''''<br /><br /></th> <th style=" width: 4%;"><br />'''''Target'''''<br /><br /></th> <th style=" width: 4%;"><br />'''''Completed'''''<br /><br /></th> <th style="width: 10%;"><br />'''''Link'''''(s)<br /><br /></th>

<td>Define new build step0.1 Release</td> <td>Add a new build step to Covering the build master config file. The build step will be in an external file and imported into the build master config file.basics</td> <td style="background-color: red; text-align: center; font-weight: bold; font-size: bigger">High</td> <td>[[User:Awdelyea|Adam Delyea]]</td>

<td>[http:&nbsp;<//buildbot.net/repos/release/docs/buildbot.html#Writing-New-BuildSteps Writing New Build Steps]td> <td>&nbsp;</td>

<td>Connect To EC2 using Python0.2 Release</td> <td>Utilize the EC2 python library to connect to an account on the EC2 network. Once connected, display some information about the users account to prove it's actually connecting.</td> <td style="background-color: red; text-align: center; font-weight: bold; font-size: bigger">High</td> <td>[[User:Awdelyea|Adam Delyea]]</td>

<td>&nbsp;<ul><li>[http://code.google.com/p/boto/ Boto Amazon Web Services Library in Python]</li><li>[http://jimmyg.org/2007/09/01/amazon-ec2-for-people-who-prefer-debian-and-python-over-fedora-and-java/ EC2 hearts Python]</litd> </ultd>&nbsp;</td>

<td>Start new instances0.3 Release</td> <td>Allow Buildbot to spawn an instance on demand. This could possibly be a function called right before the build slave list is populated, and would pass back an array of build slaves.</td> <td style="background-color: red; text-align: center; font-weight: bold; font-size: bigger">High</td> <td>[[User:Awdelyea|Adam Delyea]]</td>

<td>Adam Delyea&nbsp;</td> <td>&nbsp;</td>

<td>Add new instances to build slave list</td> <td>Allow newly created EC2 instances to be added to the build slave list0.<div style="background-color: grey; text-align: center;">After looking more closely at how the buildslave is created, this goal doesn't make any sense, since this is not really how the buildslave list works. </div> </td> <td style="background-color: grey; text-align: center; font-size: bigger">Cut</td> <td>Adam Delyea4 Release</td>

<td>Start a new build on an EC2 instance</td> <td>Allow Buildbot to successfully start a build using a build slave on an EC2 instance</td> <td style="background-color: green; text-align: center; font-weight: bold; font-size: bigger">Done</td> <td>Adam Delyea0.5 Release</td>

<td>Load a script on startup in LinuxTesting</td> <td>Make People needed to download the revisions and test them to make sure it possible works in different environments. Note, this will require you to have a script load when Linux startsyour own EC2 account. </td> <td style="background-color: grey; text-align: center; font-weight: bold; font-size: bigger">Expired</td> <td style="background-color: gold; text-align: center; font-weight: bold; font-size: bigger">NEEDED! ***<br />[http://zenit.senecac.on.ca/wiki/index.php/User:dominic Dominic Baranski]</td> <td style="background-color: greengrey; text-align: center; font-weight: bold; font-size: bigger">DoneExpired</td> <td>Adam Delyea&nbsp;</td> <td>&nbsp;</td>

<td>Testing<del>Different Builds</del></td> <td>People needed <del>Need different projects to download the revisions try and test them build, to make sure it works in different environmentsto build projects other than Mozilla</del><br />This is no longer a priority. Note, Building with Mozilla is the focus of this will require you project. The EC2 functionality can be extracted and used to have your own EC2 accountbuild any program / system. </td> <td style="background-color: lightbluegrey; text-align: center; font-weight: bold; font-size: bigger">LowExpired</td> <td style="background-color: gold; text-align: center; font-weight: bold; font-size: bigger">NEEDED! ***<br />[http://zenit.senecac.on.ca/wiki/index.php/User:dominic Dominic Baranski]</td> <td style="background-color: grey; text-align: center; font-weight: bold; font-size: bigger">Expired</td>Not Started <td>&nbsp;</td> <td>&nbsp;</td>

<td>Different BuildsComplete Documentation</td> <td>Need different projects to try and build, to make sure it works to build projects other than Mozilla</td> <td style="background-color: lightblueorange; text-align: center; font-weight: bold; font-size: bigger">LowMedium</td> <td>[[User:Awdelyea|Adam Delyea]]</td> <td style="background-color: goldgreen; text-align: center; font-weight: bold; font-size: bigger">NEEDED! ***In Progress</td> <td>Not Started&nbsp;</td> <td>&nbsp;</td>

<div style="background-color: gold; text-align: center; font-weight: bold;">&nbsp;<br />*** Would you like to contribute? Well here's an excellent opportunity for you to do just that! Feel free to e-mail me at <awdelyea@learngmail.senecac.on.cacom><br />&nbsp;</div><br/>