OPS235 Lab 3 - CentOS7 - HD2

LAB PREPARATION

Learning how to conserve disk space is essential for the efficient operation of a Linux computer system. You will learn how to manipulate the size of Linux file-system sizes (via LVM) in Lab5.

You will download and compile the game called lbreakout2 which is only available as compressed source code.

Purpose / Objectives of Lab3

In this lab, you are going to identify potential problems such as running out of space to run a GUI, or forgetting your root password. You will also learn to conserve hard disk space by learning how to compress and decompress files that are stored on your computer server. In addition, you will learn alternative methods of how to install applications (i.e. programs).

Main Objectives

• Learn to boot your Centos VM into Single User mode for rescue purposes
• Create and extract archive files (tar and tar.gz)
• Install applications using various methods:

• Download, decompress and archive file from the Internet, then compile source code in order to install an application.
• Use yum utility to install software from local source programs (on DVD drive)
• Use yum utility to install software from repositories (online storage areas)
• Learn how to add repositories (online software storage areas) to install less common applications.

• Demonstrate the use of Bash Shell scripts to automate routine tasks (generate a customized software report)

Minimum Required Materials			Linux Command Reference
Removable SATA Hard Disk	USB key (for backups)	Lab3 Log Book	Archiving / Compiling tar gzip, gunzip make Software Manangement rpm yum	Miscellaneous ls more wget chmod vi	Matrix On-line Tutorials: Shell Scripting Basics - Part 4 (The sed Utility): /home/murray.saul/scripting-4

INVESTIGATION 1: TROUBLESHOOTING BOOTING & FORGOTTEN ROOT PASSWORD

Press e at Grub Boot Menu to edit

Part 1: Common Booting Issues

There are a few "classic problems" that students can encounter with their virtual machines and their host machine after performing lab2. Although all OPS235 students may not encounter these problems, it is good to be aware of what a potential problem may look like, and know how to solve that problem.

A few common problems are:

• I Can't boot into Graphical Mode on my c7host machine
• I Forgot My Regular User Password
• I Forgot My root Password
• I Can't Start My Virtual Machine

Troubleshooting consists of 3 basic elements:

• Asking Questions (eg. what was done recently prior to problem?)
• Eliminating what the problem IS NOT
• Having Tenacity and patience (ability to focus on finding the cause of the problem)

Add the boot option single and then press ctrl-x to boot into single user mode

Part 2: Booting into Single-User Mode

If you cannot log graphically into your machine (first two common problems), there is a trick to boot your system into single-user mode. This mode does not provide networking, graphics, or logging in as other regular users, but can connect to a text-based interface as the root user. This method will only work if a GRUB (Grand Unified Boot-loader) password has not been set, or that you haven't forgotten the GRUB password.

Perform the following steps:

1. Launch your c7host machine, and login as as a regular user.
2. Boot-up your centos1 VM. when the Grub Boot menu appears, press the letter e (for "edit").
3. Using your arrow keys, scroll to next screen to linux, or linux16, or linux-efi command and type the word single as an argument after quiet (see diagram for reference) and then press ctrl-x to boot.
4. The system should boot into text-based mode. Enter your root password.
5. One thing to look at is partition space usage. Issue the command: df -h
6. If you notice 0% free space in the / partition, then there is a problem. This most likely is caused by not following steps to create a compressed copy of the VM image. If that is the case, locate the large image backup and remove it. Do NOT remove the image in /var/lib/libvirt/images directory!
7. You can use the passwd command to reset your regular user password (eg. passwd regularuserid). You can press ctrl-c if you wish to abort (i.e. not change password).
8. To restart in graphical mode, simply enter the command reboot.

Add rw init=/sysroot/bin/sh as shown and then press ctrl-x to boot into single user no root password mode

Part 3: Resetting Forgotten Root Password

Unfortunately, booting into Single-User Mode does not work if you forgot your root password, since the procedure in the previous part requires that you enter your root password. In order to reset your root password, you need to perform a different procedure (shown below).

Perform the following steps:

1. The procedure to reset root's password is different than shown above.
2. Make certain that your centos1 VM that you used in Part2 has been shutdown.
3. Start your centos1 VM, but press e at the Grub boot menu.
4. Using your arrow keys, move to linux or linux-efi command and replace the argument ro with the argument rw init=/sysroot/bin/sh (see diagram for reference) and then press ctrl-x to boot.
5. The system should boot into text-based mode without prompting for root's password.
6. Issue the command: chroot /sysroot
   
   
7. Issue the command: passwd root in order to change your root password (press ctrl-c if you wish to abort - i.e. not change password).
8. To restart in graphical mode, simply enter the command reboot.

Catastrophic Boot Problems

Not being able to start your c7host due to Kernel Panic or some sort of catastrophic disk failure is not as easy to fix. You might be able to boot from your Centos LIVE DVD, open a terminal and mount the partition via command line and look for possible problems (setup files like /etc/fstab). Lab5 will discuss more about mounting and the /etc/fstab file. The "worst-case scenario" would be to purchase a new hard disk, perform lab1 completely, perform lab2 to install and set-up virtualization software, then restore your VM image and xml file backups (eg. decompressing images, issuing virsh define commands for .xml files). That is why consistently performing backups of ALL of your VMS at the end of each lab is absolutely essential! You have been warned!

Answer INVESTIGATION 1 observations / questions in your lab log book.

INVESTIGATION 2: ARCHIVING & RESTORING FILES

Part 1: Creating a File Archive

One method to help prevent running out of hard disk space is to compress or archive files so they take up less space on your computer system. Archiving files is also a popular method to bundle files together into one smaller file for fast transfers to other computer servers.

Perform the following steps:

1. Boot up your centos3 VM.
2. Change your working directory to /usr/share/doc/sudo*
3. Use the tar (tape archiver) command to create an archive file named "/tmp/archive1.tar" by issuing the following command:
   tar cvf /tmp/archive1.tar .

Warning!
Don't miss the . at the end of the tar command (where indicated). It specifies what should go into the archive: the contents of the current directory.

4. What do the options c, v, and f mean?
5. Record the archive file size.
6. Compress the file using gzip by issuing the command: gzip /tmp/archive1.tar
7. Record the archive file size after compression.
8. Make sure you're still in /usr/share/doc/sudo* and then create a compressed archive by issuing the following command:
   tar cvzf /tmp/archive2.tar.gz .
9. What does the z option do?
10. Compare the sizes of /tmp/archive1.tar.gz and /tmp/archive2.tar.gz. Why are they so close in size?

Part 2: Restoring Files From an Archive

Perform the following steps:

1. Remain in your centos3 VM.
2. Create the directory /tmp/extract1
3. Change to the /tmp/extract1 directory.
4. Move the file archive1.tar.gz to your current directory.
5. Unzip the first archive you created by issuing the command: gunzip archive1.tar.gz
6. Extract the files from the first archive by issuing the command: tar xvf archive1.tar
7. Are all the files there?
8. Compare /tmp/extract1/README and /usr/share/doc/sudo*/README. Are they exactly the same? Why?
9. Create the directory /tmp/extract2
10. Move the file archive2.tgz to the /tmp/extract2 directory.
11. Extract the files from the second archive by issuing the following command: tar xvzf /tmp/extract2/archive2.tar.gz</b>
12. Note that this time a separate gunzip command was not needed. Why?
13. Repeat the previous command, leaving out the option z. Does it work? Why?
14. Compare the README file in this directory with the original file. Are they exactly the same?

Answer Investigation 2 observations / questions in your lab log book.

INVESTIGATION 3: MANAGING SOFTWARE PACKAGES

Internet Connection In order for the yum install command to work you require a connection to the Internet.

Part 1: Managing Software and Repositories with Yum

We will learn how to install software packages with the yum utility. This command is useful for installing software since it automatically resolves software dependencies prior to installing the software. Upon your Centos OS install, a link to a software repository is automatically made to allow for easy software updates.

Unfortunately, there is no guarantee that a particular software package is contained on the default repository. In order to overcome this problem, you can add other repositories that may contain the application that you wish to install.

Perform the following steps:

1. Make certain that you are in your c7host VM.
2. Issue the command: yum install elinks
3. Now issue the command: yum info elinks
4. How can you tell if the elinks package has been installed?
5. To remove the elinks package issue the command: yum remove elinks
6. Verify that the elinks package has been removed. Also verify that the application called: xchat is not installed.
7. Use the wget command to download the xchat rpm binary from the following URL:

http://mirror.centos.org/centos/7/os/x86_64/Packages/xchat-2.8.8-23.el7.x86_64.rpm

What do you think is the purpose of the numbers also contained in the filename?

8. Issue the command: yum localinstall xchat-2.8.8-23.el7.x86_64.rpm
9. Verify that the xchat command has been installed.
10. Run the xchat application. What does it say if you run this application as root?

IRCs: A Great Tool for Linux Administrators Although Search Engines (like Google) are a system administrator's good friend, Internet Relay Chats (IRCs) are also a great tool for system administrators to help obtain information. Many website offer information on how to connect to IRCs (both nodes (eg. FreeNode) and irc channel (eg. #linux). You can now use your newly-created application called xchat to do this. A few tips to consider with IRCs: Do your Homework (read docs first!) Ask specific questions Not all chats are friendly Be patient when asking questions (use courtesy) The advise is free (you get what you pay for!)

11. We will now look at how we can add different repositories to our c7host machine.
12. As root, issue the following command: yum repolist
13. Take a few moments to view the contents of the file. Do you see which repositories are used by the yum command? Write down the repositories in your lab logbook.
14. View the following link to see a general listing of repositories:
    [ Available Repositories for Centos ].
15. To add the epel repository, issue the command:
    sudo yum install epel-release
16. To verify that you have added the repository, you can issue the command: yum repolist
17. Unused and unneeded software can present a security risk and ties up disk space needlessly. Find at least 4 other packages to remove on your c7host machine(for example: sound & video, games, etc) that you're not using on your system. Be careful to ensure that removing those packages does not also remove other software that you do need.

Installing Development Libraries In the future, remember the above procedure whenever installing software from source. Sometimes, you need to install additional tools or libraries in order to compile a particular software package

Part 2: Compiling Source Code from a Downloaded Archived File

Sometimes, some software may not be available on repositories to install with the yum command. They may be available from web-pages to download, and compile. Now that you know how to create and decompress "zipped tarball archives", we will demonstrate how to install applications from websites containing these types of archives. Although this method is not as "user-friendly" as using the yum command, this method is useful if the application is NOT contained in regular software repositories...

In order to build software from source code, you must have the appropriate software development tools (such as make and gcc) and libraries (such as GTK) installed. The required tools will vary depending on the computer languages used in the software being built.

Perform the following steps:

1. Remain in your c7host VM, but make certain that you are logged in as a regular user (i.e. NOT root!).
2. Perform a Netsearch for the pattern: lbreakout2 tar.gz
3. Go to an appropriate webpage and download a "zipped tarball" (compressed source code) for the lbreakout2 game (filename should be something like: lbreakout2.tar.gz)
4. Change to the directory where you downloaded that file (most likely ~/Downloads).
5. Use the tar command to compress the "zipped tarball" called something like (not may be exactly): lbreakout2.tar.gz.
6. Change to the directory that contains that lbreakout2 source code.

Using && and || Conditional Statements A very useful trick when running several commands in sequence is to use conditional statments. The && conditional will run the subsequent command only if the previous command returns a true (0) exit status, for example: ./configure && make. The || conditional will run the subsequent command only if the previous command returns a false (non-zero) exit status, for example: ./configure || echo "Houston, we have a problem". These conditional can be combined, for example: ./configure && make || echo "Houston, we have a problem"

7. Issue the following command:
   ./configure && make
   Most likely, you will get an ERROR! What do you think the error is telling you?
   
8. Issue the following command to install the files for application development by issuing the command:
   yum groupinstall "Development Tools"
9. Issue the command in step 7. You should get another ERROR! What dependency is missing?
10. Issue the following command to install the library files for SQL by issuing the command:
    yum install SDL-devel
11. Reissue the ./configure && make command. Where you successful?
12. Run the command lbreakout2. Where you successful?
13. You need to run a command to make this program available regardless of your current directory. Login as root, change to the sub-directory lbreakout and issue the command:
    make install
14. Run the command: lbreakout . Did it work? What command could you issue to confirm this game was installed without actually running this program?

Bash Shell Scripting Tips: The Here Document A neat little trick involving a special type of redirection of stdin symbol: << that allows input to be redirected to a command from within the command. Examples: cat <<+ This is a test message This is the second line + mail -s "test message" youremailaddr <<+ This is a test message I hope you like it. + tr [a-z] [A-Z] <<+ i like ops235 i love scripting. + Using sed to Manipulate Text The Linux command sed stands for Streaming Editor which is an effective way to manipulate a text file, output sent from a command, or from within a "here document". This command can manipulate matching text on a variety of criteria (such as line number(s), regular expression match, etc). Commands can then be used for manipulation such as omitting, printing, substituting, adding, and inserting text. The sed option -n suppresses display of text so the print (p) command can be used; otherwise, the text will be displayed (with edits via the sed command instructions). Results of text manipulation with sed can be stored in a variable using command substitution, or redirected to a file. NEVER redirect the stdout from a sed command to the same input file (or the input file will be destroyed)! Examples sed 's/|/ /g' <<+ I|like|weekends! + sed 's/$/\n/g' <<+ This text should be double-spaced! +

Part 3: Generating Sofware Package Information with Shell Scripts

We will continue with using shell scripts to create a Software Information Report that manipulates output generated by the rpm command. The sed and awk commands are very useful tools in shell scripting to manipulate text. In this lab, we will be using sed to allow the user to select certain portions from the rpm command (options -qi).

Perform the following steps:

1. Use your c7host VM for this section.
2. Open a Bash shell terminal and login as root.
3. Use a text editor (such as vi or nano) to create a Bash Shell script called: packageInfo.bash in root's home directory.
4. Enter the following text content into your text-editing session:


#!/bin/bash

# packageInfo.bash
# Purpose: Generates a report to displaying specified information of installed software
#
# USAGE: ./packageInfo.bash [application-name]
#
# Author: *** INSERT YOUR NAME ***
# Date: *** CURRENT DATE ***

if [ $HOME != "/root" ] # only runs if logged in as root
then
 echo "You must be logged in as root." >&2
 exit 1
fi


4. Save your editing session, but remain in the text editor.
5. The code displayed below will require the user to include only one argument after the command (script) which will be the application name. The following code will also generate the report title and current date. Add the following code

if [ $# -ne 1 ]
then
  echo "Your command must have a application-name as argument" >&2
  echo "USAGE: $0 [application-name]" >&2
  exit 1
fi

# Create report title (echo with -e option allows newline \n character to be used)
echo -e "\nSOFTWARE PACKAGE INFORMATION REPORT" > /root/package-info.txt
echo -e "Date: $(date +'%A %B %d, %Y (%H:%M:%p)')\n\n " >> /root/package-info.txt


6. Save your editing session, but remain in the text editor.
7. The code displayed below uses a trick called the "Here Document" to redirect stdin from within the command (a quick way to display output on the screen). The read command will store the different information report items as words (separated by a space). The sed command used to convert the spaces to pipes (|) and stored into another variable. This allows the sed command to use extended regular expressions to print rpm elements that match those various patterns to be added to the report. Add the following code

# Clear screen and use Here Document to display select on report items to read into variable
clear
cat <<+
Available Package Information Items:

Name
Summary
Version
License
Source
URL
+
read -p "Enter word(s) shown above separated by spaces: " choice

# Convert spaces to pipe symbol (|)
processedChoice=$(echo $choice | sed 's/ /|/g')

# Use sed with extended regular expressions to only print those matching report elements
rpm -qi $1 | sed -r -n "/($processedChoice)/ p" >> /root/package-info.txt

cat <<+
File "/root/package-info.txt" has been created
+


8. Save, set permissions, and then run that shell script for the application gedit. Did it create that report? Try running the script without an argument - What did it do?
9. Use the wget command to download, study, and run the following shell scripts on-line:

   https://scs.senecac.on.ca/~murray.saul/packageInfoGraphical.bash

10. Try to understand what this Bash Shell script does.
11. You have completed lab3. Proceed to Completing The Lab, and follow the instructions for "lab sign-off".

Answer the Investigation 3 observations / questions in your lab log book.

LAB 3 SIGN-OFF (SHOW INSTRUCTOR)

Time for a new backup!
If you have successfully completed this lab, make a new backup of your virtual machines as well as your host machine.

Perform the Following Steps:

1. Make certain that your c7host and centos3 VMs are running.
2. Switch to your c7host machine, open a shell terminal, and login as root.
3. Change to the directory: /root/bin
4. Issue the Linux command: wget http://matrix.senecac.on.ca/~murray.saul/ops235/lab3-check.bash
5. Give the lab3-check.bash file execute permissions (for the file owner).
6. Run the shell script and if any warnings, make fixes and re-run shell script until you receive "congratulations" message.
7. Arrange proof of the following on the screen:
   ✓ centos3 VM:

   • Archived files created
   • Archive files restored

   ✓ c7host Machine:

   • One repository added for yum
   • Run the lab3-check.bash script in front of your instructor (must have all  OK  messages)

   ✓ Lab3 log-book filled out.

Practice For Quizzes, Tests, Midterm & Final Exam

1. What is the purpose of booting into single-user mode?
2. List the steps in order to boot into single-user mode.
3. List the steps to reset a forgotten root password.
4. What is the difference between a .tgz file and a .tar.gz file? What do these stand for?
5. What is the purpose of a repository?
6. What is source code?
7. How do you build software from source code?
8. What does yum do that compiled source code does not?
9. Other than running an installed package, what commands can you issue to verify that the package was installed?
10. List the steps to remove a package via yum command.
11. List the steps to install a package using the yum command.
12. List the steps to add a repository to be used with yum.
13. What is the command to list all repositories associated with the yum command?
14. What is the command to view all repositories that have been added to-date?
15. How do you use the sed command to modify text?
16. What is the Here-Document, and how can it be used in issuing command and shell scripting?