Winter 2010 Posters/Koji Builder

From CDOT Wiki
Revision as of 16:56, 19 April 2010 by Dpcabra1 (talk | contribs) (→‎Images)
Jump to: navigation, search

Title

Koji Builder by: David Cabral (dpcabra1@learn.senecac.on.ca)

Introduction

The goal was to create machines/builders that work with the koji-hub to build packages on the ARM (armv5tel) architecture. Fedora Project doesn't have the resources to maintain the ARM architecture for all its packages and with the increase of actual ARM systems being used, the need of builders have too increased. Kojid is the build daemon that runs on the build machines. It's primary responsibility is polling for incoming build requests and handling them accordingly. Kojid is written in Python and communicates with koji-hub via XML-RPC.

Description

Setting up the builders according to the koji-hub configuration. The builder relys heavily on the koji-hub to be configured before kojid could functional. Kojid and koji-hub need to communicate with each other, so we use SSL Certifications to authenticate the requests. Each builder needs it's own certificate and needs to be put in the PostgreSQL database. Kojid uses Mock to create a chroot of a minimal installation to test the packages and make sure they install correctly and if the SRPM work it creates all the RPMs. We used one actual ARM machine and nine virtual machines to familiarize the steps involved in getting builders to work with a Koji Hub. The final goal is to make a Koji farm dedicated to building ARM packages for Fedora since the architecture is getting more and more popular everyday. Since there is only one other ARM Koji Farm which doesn't seem to be too current, we hope to create a current and ever going package building environment. Creating this farm will help with the Fedora Project Community development and Seneca to create interest in software building and release.

Challenges

  • Builder had to be added to the PostgreSQL database before starting Kojid on the builders.
  • After installing and configuring the builders they didn't seem to authenticate do to some complications with the certifications. Once new certifications where made the issues ceased.
  • Koji-hub was seeing the builder and getting updates. However, the builder wasn't returning a ready signal. After digging threw the logs, we saw it was because the machines didn't have enough space on the systems to do actual builds. The virtual machines were re-sized to include some extra space and koji-hub finally got a ready signal from the builders.
  • Documentation was lacking on the web, but it didn't create much problem for the builders since the Fedora Project wiki had the basic configurations required to setup kojid. After just a few weeks, the blogs we wrote became the top search items on Google.
  • Understanding the relationship of package creation and Koji's method of organizing software packages in the database. This is still a learning process as Koji has just become fully functional.

Conclusion

Kojid is written in Python and uses XML-RPC to send requests between the builder and the koji-hub. Koji uses Mock to build its packages and then returns a status signal back to the koji-hub for easy accessibility of the logs. Koji-hub requires PostgreSQL to create a database to contain information of the builders and status of package building. Kojid works directly with the koji-hub. They use SSL Certifications to authenticate the requests and the packages so no rogue files/machines can interfere. Once the builders where configured and koji-hub was finally finished updating the repository information, the building of packages seemed to work without much other trouble. Koji has been setup and seems to be working.

Links

Special Thanks

  • Chris Tyler
  • Dennis Gillmore
  • The students of the SBR600 class

A special thanks to all of you.

Images

None that I can find that isn't already linked by someone that works for my poster!

Perhaps, this image? http://www.nuhorizons.com/development/images/Client-Block-Diagram-2-sm.jpg

Retrieved from "https://wiki.cdot.senecapolytechnic.ca/w/index.php?title=Winter_2010_Posters/Koji_Builder&oldid=38623"