OPS245 Lab 2
LAB PREPARATION
Purpose / Objectives of Lab 2
In this lab, you will create 3 remaining virtual machines using another virtualization program called KVM that will run in your c7host VM. These VMs will be used throughout the remainder of this course to learn how to administer them (installing software, managing services, networking, etc).
While you are performing this lab, it is recommended to generally note the major differences in the different installation methods, and which method you prefer to use if you were a Linux system administrator in charge of installing many Linux distributions for an organization.
Main Objectives
- Installing additional Virtualization Software on your c7host machine (KVM)
- Create 3 separate VMs (virtual machines) using different installation methods:
- centos1: Network CentOS Installation (Graphical)
- centos2: Network CentOS Installation (minimal install - CLI only)
- centos3: Network CentOS Installation with Kickstart configuration file (CLI only)
- Manipulate virtual machines by CLI (virsh)
- Properly backup VM images and backup VM configuration files
- Create and run Bash Shell scripts to automatically create a post-install report for an installed VM.
Minimum Required Materials |
Linux Command Reference | ||||
Virtualization |
Miscellaneous |
Matrix Online Tutorials:
|
INVESTIGATION 1: SETUP FOR NESTED VIRTUAL MACHINES
Part 1: Install KVM Virtualization Application
We will now install the KVM package in order to create our remaining "nested" VMs. We will also be starting several services (including iptables) and disabling the firewalld service. We will learn more about managing firewalls using iptables in lab6.
- Perform the following steps:
- Log into your c7host machine.
- perform a software update on your c7host VM by issuing the following command:
sudo yum update
- Using elevated privileges, install the virtualization software by issuing the command:
sudo yum install qemu-kvm qemu-img virt-manager libvirt libvirt-python \
libvirt-client virt-install virt-viewer bridge-utils - Restart your c7host virtual machine. If you fail to do this, you may experience virtualization network problems.
- Start the virtualization service:
sudo systemctl start libvirtd
NOTE: The most recent variants of CentOS and Fedora are using a service called firewalld that replaces iptables, however the iptables service is still in relatively common usage and knowing how to use it also works with firewalld. In this course we will concentrate on iptables. - To disable and remove firewalld, issue the following commands:
sudo systemctl disable firewalld
sudo systemctl stop firewalld
sudo yum remove firewalld
- To install and enable the IPTables services, issue the following commands:
sudo yum install iptables-services
sudo systemctl enable iptables
sudo systemctl start iptables
- Start the graphical tool by selecting the menu options Applications>System Tools>Virtual Machine Manager or by typing the command
virt-manager
- You will be learning in the next investigation to perform several different types of CentOS Linux installs.
Part 2: Configure VMware Workstation for Nested VMs
Although we are using VMware Workstation to run our c7host VM, we will now install and configure another virtualization package called KVM in order to install the remaining VMs for this course. Since we are "nesting" VMs (i.e. running a VM inside another VM) we need to configure our c7host's Linux boot-up parameters in order to allow these VMs to run efficiently.
- Perform the following steps:
- In a terminal use elavated privileges to edit the file called: /boot/efi/EFI/centos/grub.cfg
- If this file doesn't exist, double-check your UEFI settings in VMWare Workstation for c7host. If BIOS is selected, you MUST redo Lab 1.
- Search for the first occurrence of the Linux Kernel boot command. Do not make the following changes on more than one entry!
- Insert the boot option: kvm-intel.nested=1 at the end of the Linux kernel boot options.
linuxefi /vmlinuz-3.10.0-1062.1.2.el7.x86_64 root=/dev/mapper/centos_c7host-root ro crashkernel=auto rd.lvm.lv=centos_c7host/root rd.lvm.lv=centos_c7host/swap rhgb quiet LANG=en_CA.UTF-8 kvm-intel.nested=1
initrdefi /initramfs-3.10.0-1062.1.2.el7.x86_64.img
OR
linuxefi /boot/vmlinuz-3.10.0-1062.el7.x86_64 root=/dev/mapper/centos_c7host-root ro crashkernel=auto rd.lvm.lv=centos_c7host/root rd.lvm.lv=centos_c7host/swap rhgb quiet LANG=en_CA.UTF-8 kvm-intel.nested=1
initrdefi /boot/initramfs-3.10.0-1062.el7.x86_64.img
- Save your editing changes, close the virtual machine application, and reboot your c7host VM.
- If you configured your c7host VM for nested VMs, then you should get the output
Y
when you issue the following command:cat /sys/module/kvm_intel/parameters/nested
- For AMD processors, check the /sys/module/kvm_amd/parameters/nested file.
- And if kvm_intel directory doesn't exist, double-check your Processors => Virtualization Engine (Intel VT-x/EPT...) settings in VMWare Workstation.
Answer the INVESTIGATION 1 observations / questions in your lab log book.
INVESTIGATION 2: INSTALL NESTED VIRTUAL MACHINES (KVM)
Part 1: Installing VM from a Network (Graphical)
- VM Details:
- VM Name (and hostname): centos1
- Boot media: Network installation
- CentOS Full Network Install URL:
- VM Image Pathname: /var/lib/libvirt/images/centos1.qcow2
- Memory: 2048MB
- Disk space: 15GB
- CPUs: 2
- Perform the following steps:
- Launch the KVM virtual machine manager by clicking Applications -> System Tools -> Virtual Machine Manager.
- When prompted, enter your root password.
- Click the create a new VM icon located near the top left-corner of the application window.
- Select the Network Install option and click Forward.
- Enter (copy and paste) the URL located at the top of this section (depending whether you are at Seneca College or not) and click Forward.
- Set RAM size to 2048 MB and click Forward.
- Set Hard Disk size to 15GB and click Forward.
- Enter the name: centos1, AND then select the option: Customize configuration before install, and click Finish.
- Another dialog will appear. Click CPUs (or "processors") and on right-side under Configuration select Copy Host CPU Configuration, click Apply, and then click Begin Installation at the top left-hand side.
- During the install, select Gnome Desktop software selection). For partitioning, select I will configure partition settings, click done, then select Click here to create them automatically. Set the / partition for ext4 file-system type, and click Done.
- Set the correct Date and Time Zone, and then click on Network and Hostname. The network should be turned on. For hostname, enter: centos1 and then click Done.
- Make sure that when you create your regular user account you check the box to make them an administrator.
- Complete the installation. Login to your regular user account, and perform a sudo yum update for the centos1 VM (reboot if required). Make certain to adjust your screen-saver settings if desired.
- Repeat the steps as you did in the previous investigation (Investigation1 Part 1) to stop and disable firewalld, install iptables-services, start and enable iptables for this newly-created VM.
- Repeat the steps as you did with c7host post-install to turn off SELinux and perform a yum update.
- Issue the following command to obtain the IPADDR for your centos1 VM to record in your lab2 logbook:
ip address show
- Record the time taken to install, and compare this to the time taken by the previous installations in your lab2 logbook.
Part 2: Installing from a Network (Minimal install - CLI)
- VM Details:
- VM Name (and hostname): centos2
- Boot media: Network installation
- CentOS Full Network Install URL:
- VM Image Pathname: /var/lib/libvirt/images/centos2.qcow2
- Memory: 2048MB
- Disk space: 20GB
- CPUs: 1
- Perform the following steps:
- Create the VM (called centos2) as you did with the centos1 machine.
- Make certain to enter the name: centos2, AND then select the option: Customize configuration before install, and select Copy Host CPU Configuration, click Apply, and then click Begin Installation.
- When selecting the install options for centos2, do the same operation that you did in centos1 (but with Minimal Install software selection instead), but after automatically creating the partitions, reduce the size of the root logical volume to 8 GiB and add a logical volume with a size of 2 GiB (mount point: /home, name: home, and make certain root and /home logical volumes have ext4 file system).
- Complete the installation. Login to your regular user account.
- Repeat the steps as you did in the previous investigation (Investigation1 Part 1) to stop and disable firewalld, install iptables-services, start and enable iptables for this newly-created VM.
- Repeat the steps as you did with c7host post-install to turn off SELinux (using the command 'vi' instead of 'vim') and perform a yum update.
- Issue the following command to obtain and record your centos2 IPADDR in your lab2 logbook:
ip address show
- Record the time taken to install, and compare this to the time taken by the previous installations in your lab2 logbook.
Part 3: Installing from a Network using a Kickstart File
- VM Details:
- VM Name (and hostname): centos3
- Boot media: Network installation
- CentOS 7 Full Install Network URL:
- Kickstart File URL (Kernel options):
- VM Image Pathname: /var/lib/libvirt/images/centos3.qcow2
- Memory: 2048MB (IMPORTANT Do not use less than 2048MB during installation.)
- Disk space: 15GB
- CPUs: 2
- Perform the following steps:
- Create the VM (called centos3)
- During the install, copy the network URL, then click the URL options to expand the kernel options input textbox. Type the following in the kernel options textbox:
- Then click the forward button to proceed. Make certain to select the correct Memory Size and Disk Space size shown in the VM Details above
- Make certain to enter the name: centos3, AND then select the option: Customize configuration before install, and select Copy Host CPU Configuration, click Apply, and then click Begin Installation.
- Observe the installation. How is it different from booting from a downloaded image?
- Record the time taken to install, and compare this to the time taken by the previous installations.
If during the installation, you see the message at the bottom Pane is Dead, click the Virtual Machine menu at the top, select Shut Down -> Force Off, right-click on centos3 in the virtual manager window and select Delete. Redo the VM setup for a new instance of the centos3 VM. - What happens when the installation is finished?
- In a web browser, click the kickstart (KS) link above. This link is a text file. Read through it to find the following information (pay attention to lines starting with #) and record it in your Lab Logbook:
- Regular-user account name
- Regular-user account password
- Root Password
- Boot the virtual machine and log in (use the user ID and password information from the previous step to gain access to this VM).
- Compare the experience to the first time you booted the other virtual machines.
- Repeat the steps as you did in the previous investigation (Investigation1 Part 1) to stop and disable firewalld, install iptables-services, start and enable iptables for this newly-created VM.
- Repeat the steps as you did with c7host post-install to turn off SELinux and perform a yum update.
- Issue the following command to obtain and record your centos2 IPADDR in your lab2 logbook:
ip address
- Remember that centos3 is text-based interface only (no graphics). To recover from a blank screen, press a key (like the SPACE key) to return to the screen display.
- Record the time taken to install, and compare this to the time taken by the previous installations in your lab2 logbook.
Answer the INVESTIGATION 2 observations / questions in your lab log book.
INVESTIGATION 3: MANAGING VIRTUAL MACHINES (KVM)
Part 1: Backing Up Virtual Machines
- Perform the following steps:
- Shut down your centos1, centos2, and centos3 VMs. For centos2 and centos3, which are CLI-only, you can issue the following command to shutdown:
sudo shutdown -h
. Please be patient, the VMs will shut down! - In your c7host VM, open a new Terminal window.
- Use elevated privileges ist the size and names of files in
/var/lib/libvirt/images/
- What do these files contain?
- Use the command
sudo -i
and enter your password if prompted. You are now root until you use the commandexit
to return to your normal user account. - Change to the images directory by issuing the following command:
cd/var/lib/libvirt/images/
. Note that you did not need to use sudo, as you are already using elevated permissions. - Make a compressed backup of your centos1.qcow2, centos2.qcow2, and centos3.qcow2 files to your regular user's home directory by issuing each command (one at a time):
gzip < centos1.qcow2 > ~YourRegularUsername/centos1.qcow2.backup.gz
gzip < centos2.qcow2 > ~YourRegularUsername/centos2.qcow2.backup.gz
gzip < centos3.qcow2 > ~YourRegularUsername/centos3.qcow2.backup.gz
- NOTE: Make certain to use the redirection signs "<" and ">" properly in the command!
- Compare the size of the compressed and original files (hint: use ls -lh). If file is very large (like 15GB), you didn't compress it and you need to remove that file and perform the previous step until you get it right!
- Once you are sure you have all three VMs backed up, use the
exit
command to revert back to your normal user. - Start the centos3 VM.
- Make certain that you are in your VM and not in your main system!
- Wreck only your centos3 system! Try this command inside the centos3 virtual machine:
sudo rm -rf /*
(ignore error messages). - Shut down and restart the centos3 VM. It will not boot since all system files have been removed!
- Restore the original image from the backup from your home directory to your images directory by typing this command:
sudo gunzip < ~YourUserId/centos3.qcow2.backup.gz > /var/lib/libvirt/images/centos3.qcow2
- Restart the VM. Is it working normally?
- You should also make a copy of the XML configuration file for each VM in case you "wipe" and re-install the host machine, and want to add a restored VM backups to the virtual machine manager list. We will demonstrate using the centos3 XML configuration file, and prove that a "clone" can be added to your list.Please perform the following step:
- Execute the following command:
virsh dumpxml centos3 > centos3.xml
- Examine the file
centos3.xml
. What does it contain? What format is it in?
Part 2: Restoring Virtual Machines
- We will now learn how to download a compressed image file and XML configuration file and add it as a VM to the Virtual Machine Manager menu.
- Issue the following commands:
- Use gunzip with elevated privileges to decompress the qcow2 image file into the /var/lib/libvirt/images directory.
- Issue the command:
virsh define centos4.xml
- What happened in the virtual manager window? To remove a VM entry in the Virtual Manager window, simply issue the command: virsh undefine vm_name (without the .xml file extension)
- Start up your new centos4 VM.
- Click on the user OPS235, and click the cog icon.
- Notice Cinnamon (Software Rendering) is selected. The Cinnamon desktop environment has been installed on this VM. From this menu, you can select other installed desktop environments. This is how you switch between them. Write it down.
- Login with the password ops235. Feel free to explore the new environment.
- Prior to your practical test, you will be required to perform a similar operation to download, unzip and run a VM image for your practical test.
- For the remainder of these labs, it is assumed that you will backup both the images and XML configuration files for all Virtual machines, when asked to backup your virtual machines. It is also highly recommended to backup these files to an external storage device (eg. USB key) in case the host machine gets "wiped" and you need to rebuild your HOST machine and then restore your Virtual Machines...
- Answer this question in your log book:
- In order to fully back up a virtual machine, what information should be saved in addition to the virtual machine image?
Part 3: Using Shell Scripts for VM Backup & Management
You will continue our use of Bash Shell scripting by first creating a Bash Shell script that will allow the Linux sysadmin to select their created VMs for backup to root's home directory. Afterwards you will download, view and run a couple Bash Shell scripts that use the virsh command to start and stop your virtual machines.
- Perform the following steps:
- Start the centos1 virtual machine, and stop the centos2 and centos3 virtual machines.
- Switch to the c7host machine, and open a shell terminal.
- Enter these admin commands into your c7host machine and note the result:
-
virsh list
-
virsh list --all
-
virsh list --inactive
-
- Now, shut-down your centos1 VM normally, and close the centos1 VM window.
- Switch to your terminal and issue the command:
virsh start centos1
- Using the appropriate command check to see if your centos1 VM is now running.
- There are other commands that can be used (such as suspend, or shutdown). The "shutdown" command may not always work since it relies on the guest handling a particular ACPI event. Why do you think it is useful to have commands to manipulate VMs?
- Open a Bash shell terminal.
- Use elevated privileges to create a directory called /root/bin.
- Use a text editor (such as
vi
ornano
) to create a Bash Shell script called:backupVM.bash
in /root/bin directory. - Enter the following text content into your text-editing session:
#!/bin/bash
# backupVM.bash
# Purpose: Backs up pre-defined virtual machines
#
# USAGE: ./backupVM.bash
#
# Author: *** INSERT YOUR NAME ***
# Date: *** CURRENT DATE ***
if [ $PWD != "/root" ] # only runs if in root's directory
then
echo "You must be located in /root" >&2
exit 1
fi
- Save your editing session, but remain in the text editor.
- This shell script is designed particularly for your centos1, centos2, and centos3 VMS.
- The code displayed below will prompt the user if they wish for all VMs to be backed-up; otherwise, allow the user the option of specifying which VMs to be backed-up. Add the following code
read -p "Backup all VMs? (y|n):" answer # prompt if all VMs to be backed-up
if [ "$answer" = "y" ] # Backup all VMs if answer is yes
then
for num in 1 2 3 # Determinant loop for 3 arguments: 1, 2, and 3
do
echo "Backing up VM #$num"
gzip < /var/lib/libvirt/images/centos$num.qcow2 > /root/centos$num.qcow2.backup.gz
echo "VM #$num BACKUP DONE"
done
elif [ "$answer" = "n" ]
then
read -p "Which VM should be backed up? (1/2/3): " numanswer
until echo $numanswer | grep "^[123]$" >> /dev/null # Look for match of single digit: 1,2, or 3
do
read -p "Invalid Selection. Select 1, 2, or 3: " numanswer
done
echo "Backing up VM #$numanswer"
gzip < /var/lib/libvirt/images/centos$numanswer.qcow2 > /root/centos$numanswer.qcow2.backup.gz
echo "VM #$numanswer BACKUP DONE"
else
echo "Invalid Selection... Aborting program"
exit 2
fi
- Save, set permissions, and then run that shell script to backup centos1. Since that script will only work if you are in root's home directory, you will need to use the technique you learned earlier to temporarily become root. Confirm that this script did backup this image to root's home directory
- Use the
wget
command to download, study, and run the following shell scripts on-line:https://ict.senecacollege.ca/~ops235/labs/vm-start-text.bash
https://ict.senecacollege.ca/~ops235/labs/vm-stop-text.bashhttps://ict.senecacollege.ca/~ops235/labs/vm-start.bash
https://ict.senecacollege.ca/~ops235/labs/vm-stop.bash - Try to understand what these Bash Shell scripts do.
- You have completed lab2. Proceed to Completing The Lab, and follow the instructions for "lab sign-off".
Answer INVESTIGATION 3 observations / questions in your lab log book.
INVESTIGATION 4: USING PYTHON TO AUTOMATE MANAGING VIRTUAL MACHINES
UNDER CONSTRUCTION
This week you have added some significant capabilities to your python scripting. The ability to run loops and make decisions makes your scripts much more powerful. In this investigation you will write a python script that backs up every VM you have, regardless of its name. It will also allow the user to specify which VMs they want backed up, just in case they only want one or two.
- In your bin directory, create the file backupVM.py, and populate with our standard beginning
#!/usr/bin/env python3 # backupVM.py
# Purpose: Backs up virtual machines
#
# USAGE: ./backupVM.py
#
# Author: *** INSERT YOUR NAME ***
# Date: *** CURRENT DATE ***
import os
currentuser = os.popen('whoami')
if currentuser.read() != 'root':
print("You must be root")
exit()
else:
for machine in {'centos1','centos2','centos3'}:
print('Backing up' + machine)
os.system('gzip < /var/lib/libvirt/images/' + machine + '.qcow2 > ~backups/' + machine + '.qcow2.gz')
- Try to run that script. You'll notice it does not work. No matter what you do, it always says you are not root.
- Modify the print statement that tells the user they must be root to also include the current username, then run the program again.
- It should print out root, but with an axtra new-line. You may have noticed this in your other python scripts so far: the data we get from os.popen() has an extra new-line on the end. We need to modify the string it gives us a bit. See the side-bar for hints on how to do so.
- Modify the if statement so it is just getting the current username, not the username and a newline. You can do this using several steps and several variables, but it can also be done in a single line.
- Now that the script recognizes you as being root (or at least running the script with root permissions), it should work. Notice how we've used the + to combine several strings together to pass to the os.system command. We did this because this script needs the python variable to be evaluated before the whole line gets handed over to os.system. If you left the variable names inside the quotes, python will ignore them as just being part of a string. By putting them outside of a string, and concatenating their value to that string, we can evaluate them and feed them into that command.
LAB 2 SIGN-OFF (SHOW INSTRUCTOR)
Follow the submission instructions for lab 2 on Blackboard.
- Perform the Following Steps:
- Use the virsh start command to launch all the VMs (centos1, centos2, and centos3).
- Inside each virtual machine, run
ip a
on the command line. Open a Terminal window in centos1 to do so. You'll need the IP address of each machine for the next steps. - Switch to your c7host VM, open a terminal, login as root, and change directory to /root/bin.
- Issue the Linux command:
wget https://ict.senecacollege.ca/~ops235/labs/lab2-check.bash
- Give the lab2-check.bash file execute permissions (for the file owner).
- Run the shell script and if any warnings, make fixes and re-run shell script until you receive "congratulations" message.
- Arrange proof of the following on the screen:
- ✓ All VMs:
- All 4 VMs created and running
- Proof of yum updates on ALL VMs (i.e. results from yum update command)
- ✓c7host VM:
- Run the lab2-check.bash script in front of your instructor (must have all
OK
messages)
- Run the lab2-check.bash script in front of your instructor (must have all
- ✓ Lab2 logbook notes completed.
- ✓ All VMs:
- Upload a screenshot of the proof listed above, the output file generated by the lab2-check.bash script, and your backupVM.py to blackboard.
Practice For Quizzes, Tests, Midterm & Final Exam
- What is the name of the CentOS installation program?
- What is the name of the file created by the CentOS installation program?
- Which type of installation works best for confirming compatibility with hardware before installation? Why?
- Which type of installation works best for installing large numbers of computers? Why?
- How can you reduce the number of software updates required immediately after installation?
- How do you start and stop virtual machines?
- How do you SSH into your virtual machines?
- List the steps to install a VM from:
- Downloaded iso file
- Network install (without kickstart file)
- Network install (with kickstart file)
- What is the purpose of the virsh command?
- How to start and stop VMs using the virsh command?
- List the steps to correctly backup your VMs to a USB disk
- List the steps to correctly restore your VMs from a USB disk to your c7host VM.
- How can you prompt the user for data and store into a variable?
- How do you perform mathematical operations in the Bash shell and within a Bash shell script?
- What is the difference between a determinant loop and an in-determinant loop?
- Show a few examples how loops can be used to error-check when prompting the user for data.
- What is the purpose of the && and || symbols when used with logic?'
- What does the command rpm -qi centos-release do and why is it important?
- What is the difference between rpm -q centos-release and uname -a?