Changes

[[Category:SBR600]][[Category:Fall 2010 SBR600]]{{Admon/important|Tentative Schedule|Please note that the schedule here is tentative. Week-by-week details will be filled in as the course progresses.}} = Week 1 (September 6) - Introduction === Tuesday ==* Welcome* Introductions* Intro to Build & Release** Brief overview of the process*** Versioning & repository systems*** Compilation*** Testing*** Packaging*** Compositing*** Release*** Distribution*** Mirroring** These steps vary according to the particular project/product. For example, when distributing software physically, "Release" means performing a release-to-manufacturing (RTM), where the final "gold disk" is sent to the duplicating house to be mass-produced; but when distributing software electronically, "Release" means sending the software to the online distribution system. The sequence of steps also varies between projects/products.* Introduction to Free Software and Open Source** The [http://fsf.org Free Software Foundation]** The [http://opensource.org Open Source Initiative]* Introduction to the Fedora Project** [[:fedora:Main Page|Fedora Project]]** Fedora ARM Secondary Architecture project at [[Fedora ARM Secondary Architecture|Seneca]] and at the [[:fedora:Architectures/ARM|Fedora Project]]* Course Layout** Project-based course** Working with Open Source** Working with the Fedora Project* <span style="background: #ffff00">[[SBR600 Communication Tools|Communication Tools]]</span> - '''Resource page for setting up wiki, IRC, and FAS2 accounts'''* [[SBR600|Course Outline]]* Visit the [[CDOT]] Area == Friday ==* Make* Makefile Basics** Targets, Dependencies, and Commands** Implied rules (e.g., .o files)** Examples* Building software from a source tarball using a makefile == Readings/Resources''' ==* Two simple [http://matrix.senecac.on.ca/~chris.tyler/osd600/makefile-examples.tgz makefile examples] == ToDo =='''By Friday, September 10:'''#'''Communication Lab'''#* Set up your accounts (wiki, IRC, FAS2).'''#* Create a blog post which will appear on the OpenSource@Seneca Planet which introduces yourself. Include:#*# An introduction. Tell us a bit about yourself.#*# A portion of an IRC conversation you've had with someone on a Fedora or Seneca IRC channel.#*# A link to your User page on the Seneca wikis#*# A link to your User page on the Fedora wiki#** Note: don't just dump this stuff in a blog post, add some introductory text as well!#* Add an entry to the [[Fall 2010 SBR600 Participants]] page#'''Fedora Set-Up'''#* Ensure you have a working, currently-supported (F12 or F13) Fedora system (on a laptop, on a SATA disk pack for use in the Seneca labs, or on a desktop machine at home) '''Lab 1: By Monday, September 13:'''# '''Lab 1'''#* Build 2 packages from Source#*# The NLED editor from [http://cdot.senecac.on.ca http://cdot.senecac.on.ca]#*# Any package that uses a configure script -- SourceForge might be a good place to look for such packages.#* Blog about the experience. = Week 2 (September 13) - RPM Packages I = == Tuesday ==* Discussion of issues related to building** Finding dependencies.** <code>-j''X''</code> flag to enable multiple jobs === RPM Packages === * Purpose* What's in an RPM package file** Metadata*** What the package provides*** Dependencies*** Packager, date, license, summary, description, ...** Digital signature** Software** Data*** Fonts*** Icons*** Sample data** Documentation** Configuration files** Setup scripts*** Pre-install*** Post-install*** Pre-uninstall*** Post-uninstall*** Triggers === The RPM Database === * Purpose of the database* Querying the RPM database** rpm -q == Friday == === Creating Packages === * Packaging scenarios* Setting up a Packaging Environment** Needed packages*** rpm-build*** rpmdevtools*** rpmlint*** yum-utils** Setting up the RPM tree*** run <code>rpmdev-setuptree</code>* Taking a look at existing source RPMS (useful as examples)** Installing *** <code>yumdownloader --source <i>nameofpackage</i></code>*** <code>rpm -i <i>nameofpackage</i>.src.rpm</code>*** Source will be in ~/rpmbuild/SOURCES and specfile will be in ~/rpmbuild/SPECS** Examine the specfile** Rebuild on the local machine -- takes a source RPM (SRPM) as input, produces binary and source RPMs as output*** <code>rpmbuild --rebuild <i>nameofpackage</i>.src.rpm</code>** Building from the spec file -- takes a specfile and source code as input, produces binary and source RPMs as output*** <code>cd ~/rpmbuild/SPECS; rpmbuild -ba <i>nameofpackage</i>.spec</code> === Writing a specfile === * Run <code>rpmdev-newspec ''packagename''</code> in ~/rpmbuild/SPECS* Edit the skeleton specfile.* Test it: <code>rpmbuild -ba ''packagename''.spec</code>** If successful, output will be binary RPM(s) in ~/rpmbuild/RPMS and source RPM in ~/rpmbuild/SRPMS*** Can install binary RPM with: <code>rpm -i ''rpmname''</code>** If unsuccessful, read the error messages carefully.* Check it with rpmlint: <code>rpmlint ''packagename''*</code>** Remember to check the spec file as well as the binary and source RPMs.** Correct any errors found. === Layout of a specfile === * Basic Sections# preamble - basic metadata# %prep - commands to prepare the package for building# %build - commands to build the package# %install - commands to install the built files#REDIRECT %check - commands to check/test the built files (optional, often not included)# %clean - commands to clean up the disk space# %files - list of files to be included in the pacakge# %changelog - record of the package's change-history* Scriptlets** %pre -- run before installation** %post -- run after installation** %preun -- run before uninstallation** %postun -- run after uninstallation*** Note that during upgrade, the installation of the new package is considered to happen before the removal of the old package.* Macros** %{_tmppath}** %{buildroot}** %{_bindir}** %{_datadir}** %{_mandir}** %{_smp_flags}** %setup** %configure** %makeinstall === Creating a Simple Package === * NLED* Writing the specfile* Testing the specfile* Using rpmlint === Resources === * [[Winter :fedora:PackageMaintainers|Fedora Package Maintainers page]]** [[:fedora:PackageMaintainers/CreatingPackageHowTo|Packaging How-To]] See also "Fedora Linux" chapter 5 (see Seneca Library website > eBooks > View All > Safari > Fedora Linux). == ToDo == * Finish tasks from week 1 if not already completed.** Remember, marking in this course is done on the basis of blog posts which appear on the planet.** You should have two blog posts on the planet by now: One with a link to your Seneca and Fedora user pages plus a snippet of IRC conversation, and one with a reflection on your experience compiling software from source code.* Rebuild an existing Fedora SRPM. The <code>-j</code> value in your ~/.rpmbuild config file controls how many simultaneous jobs <code>make</code> starts. Experiment to see which value results in the fastest build time for the software you have chosen on your particular hardware. Blog about your experience -- don't bog down your blog with technical output, but instead focus on the process and results, and your reflections (for example: did you get the value you expected? was it a fast or slow process? did you automate it with a script or do it manually? what seems to affect the results?).<!-- * Take the software you compiled last week and package it (not Nled!). Blog about the experience. Include a link to your source RPM (and optionally your binary RPM) from your blog. Do ''not'' use the Fedora spec file. '''Please complete this by Monday, January 20.''' -->* Listen to the [http://cdot.senecac.on.ca/audio/sbr600/ audio recording] of last Fall's conference call with Jesse Keating, Fedora Release Engineer* Start considering the projects on the [[SBR600 Potential Projects|potential projects]] list. = Week 3 (September 20) - Using Mock and Koji =  == rpmlint: Checking for a clean spec file, SRPM, and RPM == <code>rpmlint</code> is a spec file, SRPM (.src.rpm), and RPM (.rpm) checker. To use it, supply the names of the file(s) to be checked as argument(s):  rpmlint ''foo.spec foo*.rpm'' Notice that the checks performed vary based on the input file. For example, some errors in the spec file (such as the summary ending in a period ".") could be determined from the spec file, but only show up when the SRPM/RPM is checked. Each run will report the number of errors and warnings; errors are serious problems which should not be ignored, while warnings may be ignored depending on the context. == mock: Testing BuildRequires == It's often difficult to get the BuildRequires in a spec file exactly right, because it's easy to overlook packages that are coincidentally installed on the machine. <code>mock</code> is a tool that uses the chroot system call to create a "cleanroom" environment for the build, so that any missing BuildRequires cause the build to fail. {{Admon/note|The '''mock''' Group|To use mock, you will need to add yourself to the '''mock''' group: <code>usermod -G mock ''yourUserName''</code>}} To build with mock:  mock -r ''fedora-13-x86_64'' --rebuild ''foo*.src.rpm'' The value ''fedora-13-x86_64'' may be changed to any of the config files found in <code>/etc/mock</code> in order to test building based on the libraries and available packages for a specific architecture and Fedora release. If errors are reported, review the log files (see the mock output to determine the directory containing the log files). == koji: Testing multiple architectures == <code>koji</code> is a client-server system which allows you to queue builds within the Fedora build farm. This permits you to test whether your package builds on several different architectures, which is especially useful when you don't otherwise have access to the machines of that architecture. {{Admon/note|Koji Setup|Note that koji requires some setup, particularly for certificate-based authentication. See the [[:fedora:PackageMaintainers/UsingKoji|UsingKoji]] page on the Fedora wiki for setup instructions.}} To queue a build for all four Fedora-supported architectures (currently i386, x86_64, ppc, and ppc64):  koji build ''dist-f12'' --scratch ''foo*.src.rpm'' In this example, ''dist-f12'' selects the package repository (similar to the <code>-r</code> option for mock, except that the build arch is not specified); <code>--scratch</code> specifies that this is a scratch build (the results are not kept or fed to Bodhi). To perform a build that will be passed to Bodhi for distribution, substitute <code>--rebuild</code> for <code>--scratch</code> (do not do this until you have passed the package review and sponsor procedures). {{Admon/note|ARM Build|You can queue an ARM build by specifying the server "arm.koji.fedoraproject.org" on the Koji command line (or in <code>/etc/koji.conf</code>).}} == Resources == * rpmlint** [[:fedora:Common Rpmlint issues]]* mock** [[:fedora:Projects/Mock|Mock Project page]]** [[:fedora:Using_Mock_to_test_package_builds]]* koji** [[:fedora:PackageMaintainers/UsingKoji|Using Koji]] == ToDo == * Test your RPM from last week with:** rpmlint** mock** koji * Blog about your experience. = Week 4 (September 27) - Using Mock and Koji II = = Week 5 (October 4) - Repositories/Distributing = == Signing RPM packages == An RPM signature, like the digital signature used on many other software-signing systems, is a private key encryption of a checksum. RPM uses the GPG libraries for signing. # Create a GPG key: <code>gpg --gen-key</code># Add the e-mail address associated with your gpg key to the <code>%_gpg_name</code> macro in <code>~/.rpmmacros</code> -- the line will look like this: <code>%_gpg_name "<i>e-mail-address</i></code># Find (or make) some packages to put in your repository. Make sure that the epoch-version-release is higher than that of any package with the same name in the Fedora repositories.# Sign those packages with: <code>rpm --addsign <i>packagefile</i></code> == Creating a YUM repository == A yum repository is just a directory of packages and some metadata. # Create a directory that can be served. The protocol used to serve that directory could be http, ftp, nfs, or something else (the files can be served by putting them on a DVD too!). For http, create the directory within <code>/var/www/html</code># Put your signed packages in that directory.# Create the repository metadata for that directory: <code>createrepo <i>/name/of/directory</i></code> Notice that the repository metadata will be placed in a directory named <code>repodata</code> == Testing == # Create a new repository file in <code>/etc/yum.repos.d</code> by copying and modifying an existing file in that directory. Keep <code>gpgcheck=1</code> but comment out the <code>gpgkey</code> file.# Confirm that you cannot install from that repository using yum.# Uncomment the <code>gpgkey</code> line, and point it to a new file within <code>/etc/pki/rpm-gpg/</code># Create that file by running (as your regular user): <code>gpg --export --armour <i>e-mail-address</i></code> and saving the output# Confirm that you can now install from your repository. You should be asked whether you wish to import the key for your repo. == Repository-release RPM == To make it easier for users to access your repository, create a RPM containing:# Your repo file# Your GPG key Take a look at the [http://rpmfusion.org/ RPMFusion] release RPM for an example. == ToDo == Project# Make sure your entry in the [[Fall 2010 SBR600 Weekly ScheduleProject Table]]is complete, and that your project plan on your project page is filled in (including 0.1, 0.2, and 0.3 targets). Lab# Create an RPM package that will install your repository configuration file and the key.# Test it.# Blog about this lab, and include a link to your repository RPM package. = Weeks 6 - 13 =* Project work = Week 8 =* Git** See http://git-scm.org for basic notes and tutorials* Using a Git repository == ToDo ===== Simple Remote Repository Exercise ===* Clone the repository: git clone git://england.proximity.on.ca/play cd play* Add a branch for your stuff: git checkout -b $YourName (add and commit some stuff:)* Push the branch to the server: git push --all* Verify that the branch is on the server: git ls-remote* Pull someone else's branch: git pull origin $SomeoneElsesBranch git checkout $SomeoneElsesBranch = Exam Week =