Changes

<li value="8">Start the graphical tool by selecting the menu options '''Applications'''>'''System Tools'''>'''Virtual Machine Manager''' or by typing the command<b><code><span style="color:#3366CC;font-size:1.2em;"> virt-manager</span></code></b>(without sudo!)</li>

# Insert the boot option: '''kvm-intel.nested=1''' (for AMD processors '''kvm-amd.nested=1''') at the end of the Linux kernel boot options.

<li>If you configured your c7host VM for nested VMs, then you should get the output <b><code><span style="color:#3366CC;font-size:1.2em;">Y</span></code></b> when you issue the following command:<br><b><code><span style="color:#3366CC;font-size:1.2em;">cat /sys/module/kvm_intel/parameters/nested</span></code></b></li><ul><li>For '''AMD''' processors, check the /sys/module/'''kvm_amd'''/parameters/nested file.You should get the output <b><code><span style="color:#3366CC;font-size:1.2em;">1</span></code></b></li></ul>

:::*Seneca Lab: httpshttp://mirror.senecacollege.ca/centos/7/os/x86_64/('''NOTE: requires VPN'''):::*Home: httpshttp://mirror.netflash.net/centos/7/os/x86_64/

# Set RAM size to 2048 MB and CPUs to 2, then click '''Forward'''.

#<span style="background-color:yellow;">During the install, select '''Gnome Desktop''' (software selection). For partitioning, select '''I will configure partition settingspartitions'''settings, click done, then select '''Click here to create them automatically'''. Set the / partition for '''ext4''' file-system type, and click '''Done'''.</span>#<span style="background-color:yellow;">Set the correct '''Date and Time Zone''', and then click on '''Network and Hostname'''. The network should be turned on'''ON'''. For hostname, enter: '''centos1''' and then click '''Done'''.</span>

<ol><li value="1314"><span style="background-color:yellow;">Repeat the steps as you did in the previous investigation ([https://wiki.cdot.senecacollege.ca/wiki/OPS235_Lab_2OPS245_Lab_2#Part_1:_Install_KVM_Virtualization_Application Investigation1 Part 1]) to '''stop , disable and disable remove firewalld, install iptables-services, start and enable iptables''' for this newly-created VM.</span></li><li><span style="background-color:yellow;">Repeat the steps as you did with c7host post-install to '''turn off (permissive) SELinux''' and perform a '''yum update'''.</span></li>

:::*Seneca Lab: httpshttp://mirror.senecacollege.ca/centos/7/os/x86_64/('''NOTE: requires VPN'''):::*Home: httpshttp://mirror.netflash.net/centos/7/os/x86_64/

#<span style="background-color:yellow;">Repeat the steps as you did in the previous investigation ([https://wiki.cdot.senecacollege.ca/wiki/OPS235_Lab_2OPS245_Lab_2#Part_1:_Install_KVM_Virtualization_Application Investigation1 Part 1]) to '''stop and disable firewalld, install iptables-services, start and enable iptables''' for this newly-created VM.</span># <span style="background-color:yellow;">Repeat the steps as you did with c7host post-install to '''turn off (permissive) SELinux''' (using the command 'vi' instead of 'vim') and perform a '''yum update'''.</span>

:::* Home:''' <span style="color:green;font-weight:bold">ks=</span>https://ictraw.senecacollegegithubusercontent.cacom/~peter.callaghanOPS245/ops245labs/labsmain/centos7-kickstart.cfg

# During the install, copy the network URL, then click the '''URL options''' to expand the '''kernel options''' input textbox. Type the following in the kernel options textbox: <ul><li><span style="color:green;font-weight:bold">ks=</span>https://ictraw.senecacollegegithubusercontent.cacom/~peter.callaghanOPS245/ops245labs/labsmain/centos7-kickstart.cfg</li></ul>

# <span style="background-color:yellow;">Repeat the steps as you did in the previous investigation ([https://wiki.cdot.senecacollege.ca/wiki/OPS235_Lab_2OPS245_Lab_2#Part_1:_Install_KVM_Virtualization_Application Investigation1 Part 1]) to '''stop and disable firewalld, install iptables-services, start and enable iptables''' for this newly-created VM.</span>

# Shut down your '''centos1''', '''centos2''', and '''centos3''' VMs. For ''centos2'' and ''centos3'', which are CLI-only, you can issue the following command to shutdown: <b><code><span style="color:#3366CC;font-size:1.2em;">sudo shutdown -hpoweroff</span></code></b>. Please be patient, the VMs will shut down!

# Use elevated privileges ist to list the size and names of files in<b><code><span style="color:#3366CC;font-size:1.2em;">/var/lib/libvirt/images/</span></code></b><ul><li>What do these files contain?</li></ul># Use the command <b><code><span style="color:#3366CC;font-size:1.2em;">sudo -i</span></code></b> and enter your password if prompted. You are now root until you use the command <b><code><span style="color:#3366CC;font-size:1.2em;">'''exit</span></code></b> ''' to return to your normal user account.

# Make a compressed backup of your '''centos1.qcow2''', '''centos2.qcow2''', and '''centos3.qcow2''' files to your regular user's home directory by issuing each command (- one at a time(create '''backups''' directory '''within your regular user's home directory''' before running these commands):<br><b><code><span style="color:#3366CC;font-size:1.2em;">gzip < centos1.qcow2 > ~YourRegularUsername/backups/centos1.qcow2.gz</span></code></b><br><b><code><span style="color:#3366CC;font-size:1.2em;">gzip < centos2.qcow2 > ~YourRegularUsername/backups/centos2.qcow2.gz</span></code></b><br><b><code><span style="color:#3366CC;font-size:1.2em;">gzip < centos3.qcow2 > ~YourRegularUsername/backups/centos3.qcow2.gz</span></code></b><ul>'''NOTE:''' Make certain to use the redirection signs "<" and ">" properly in the command!</ul>

<ol><li value="57"> Compare the size of the compressed and original files (hint: use '''ls -lh'''). If file is very large (like 15GB), you didn't compress it and you need to remove that file and perform the previous step until you get it right!</li><li>Once you are '''sure you have all three VMs backed up''', use the <b><code><span style="color:#3366CC;font-size:1.2em;">exit</span></code></b> command to revert back to your normal user.</li>

<li> Shut down and restart the centos3 VM(you may need to use the '''Force Reset''' option to do so). It </lI><li> When the machine restarts it will not boot since all system files have been removed!</li><li> Use the '''Force Off''' option to turn centos3 back off.</li><li> Restore the original image from the backup from your home directory to your '''images''' directory by typing <b><code><span style="color:#3366CC;font-size:1.2em;">sudo -i</span></code></b> command first [do not forget to '''exit''' when you are done], then this command:<br><b><code><span style="color:#3366CC;font-size:1.2em;">sudo gunzip < ~YourUserIdYourRegularUsername/backups/centos3.qcow2.gz > /var/lib/libvirt/images/centos3.qcow2'''</span></code></b></li>

<li> Execute the following command: <b><code><span style="color:#3366CC;font-size:1.2em;">sudo virsh dumpxml centos3 > centos3.xml</span></code></b></li>

# Issue the following commands:<ul><li><b><code><span style="color:#3366CC;font-size:1.2em;">wget https://ictmatrix.senecacollege.ca/~ops235ops245/centos4.qcow2.backup.gz</span></code></b></li><li><b><code><span style="color:#3366CC;font-size:1.2em;">wget https://ictmatrix.senecacollege.ca/~ops235/labsops245/centos4.xml</span></code></b></li></ul>

# Issue the command: <b><code><span style="color:#3366CC;font-size:1.2em;">sudo virsh define centos4.xml</span></code></b># What happened in the virtual manager window? To In order to remove a VM entry in the Virtual Manager window, simply issue the command: '''virsh undefine vm_nameVM_name''' (without the '''.xml''' file extension)

# Click on the user <i>OPS235OPS245</i>, and click the cog icon.

# Login with the password <b><i>ops235ops245</i></b>. Feel free to explore the new environment.

=== Part 3: Using Shell Scripts the Command Line for VM Backup &amp; State Management===

{{Admon/tip|Bash Shell Scripting Tips:|<br>'''<u>Data Input</u>'''<br><ul><li>A shell script can obtain data from a number of methods: '''reading input files''', using '''arguments when issuing command''' (positional parameters), or '''prompting for data to store in a variable'''. The later method can be accomplished by using the '''read''' command.<br><br></li><li>Example:<br><br>''read -p "Enter your name: " userName''.<br><br></li></ul>'''<u>Mathematical Expressions</u>'''<br><ul><li>In the bash shell scripting, data is stored in variable as text, not other data types (ints, floats, chars, etc) like in compiled programs like C or Java. In order to have a shell script perform '''mathematical operations''', number or variable need to be surrounded by two sets of parenthesis '''((..))''' in order to convert a number stored as text to a binary number.<br><br></li><li>Examples<br><br>''var1&#61;5;var2&#61;10''<br>''echo "$var1 + $var2 &#61; $((var1+var2))"''<br><br>'''Note:''' shell does not perform floating point calculations (like '''5/10'''). Instead, other commands like '''awk''' or '''bc''' would be required for floating point calculations (decimals)<br><br></li></ul><u>'''Loops (for / while / until)'''</u><ul><li>Determinant loops (such as '''for''' loops) usually repeat for a preset number of times (eg. counts, positional parameters stored). In-determinant loops (such as '''while''' or '''until''' loops) may repeat based on unknown conditions (like waiting for user to enter correct data).<br><br></li><li>Conditional statements '''&amp;&amp;''' (run if previous command or test is true) and '''&#124;&#124;''' (run is previous command or test is false) can also be used when testing multiple conditions.<br><br></li><li>Examples:<br>''set ops235 is fun''<br>''for x''<br>''do''<br>&nbsp;''echo "argument is $x"''<br>''done''<br><br>''for x in $(ls)''<br>''do''<br> &nbsp;''echo "Filename: $x"''<br>''done''<br><br>''read -p "enter a whole number: " num''<br>''until echo $num &#124; grep -q "^[0-9][0-9]*$"''<br>''do''<br> &nbsp;''read -p "Incorrect. Please enter WHOLE NUMBER: " num''<br>''done''<br><br>''read -p "pick a number between 1 and 10: " num''<br>''while [ $num -lt 1 ] &#124;&#124; [ $num -gt 10 ]<br>''do''<br> &nbsp;''read -p "Incorrect. Please pick number between 1 and 10: " num''<br>''done''<br><br></li></ul>}}

You will continue our use of the Bash Shell scripting by first creating a Bash Shell script that examining commands will allow the Linux sysadmin to select gather information about and manage their created VMs for backup to root's home directory. Afterwards you will download, view and run a couple Bash Shell scripts that use the virsh command to start and stop your virtual machinesVirtual Machines.

:: <b><code><span style="color:#3366CC;font-size:1.2em;">sudo virsh list</span></code></b>:: <b><code><span style="color:#3366CC;font-size:1.2em;">sudo virsh list --all</span></code></b>:: <b><code><span style="color:#3366CC;font-size:1.2em;">sudo virsh list --inactive</span></code></b><ol><li value="4">Now, shut-down your centos1 VM normally, and close the centos1 VM window.</li><li>Switch to your terminal and issue the command: <b><code><span style="color:#3366CC;font-size:1.2em;">sudo virsh start centos1</span></code></b></li><li>Using the appropriate command check to see if your centos1 VM is now running.</li><li>There are other commands that can be used (such as '''suspend''', or '''shutdown'''). The "shutdown" command may not always work since it relies on the guest handling a particular ACPI event. Why do you think it is useful to have commands to manipulate VMs?</li></ol>

<ol><li value="9">Open a Bash shell terminal.</li><li>Use elevated privileges to create a directory called /root/bin.</li><li>Use a text editor (such as <b><code><span style="color:#3366CC;font-size:1.2em;">vi</span></code></b> or <b><code><span style="color:#3366CC;font-size:1.2em;">nano</span></code></b>) to create a Bash Shell script called: <b><code><span style="color:#3366CC;font-size:1.2em;">backupVM.bash</span></code></b> in /root/bin directory.</li><li>Enter the following text content into your text-editing session:</li></ol><code style="color:#3366CC;font-family:courier;font-size:.9em;"><br>&#35;!/bin/bash  &#35; backupVM.bash<br>&#35; Purpose: Backs up pre-defined virtual machines<br>&#35;<br>&#35; USAGE: ./backupVM.bash<br>&#35;<br>&#35; Author: *** INSERT YOUR NAME ***<br>&#35; Date: *** CURRENT DATE ***  if [ $PWD != "/root" ] # only runs if in root's directory<br>then<br>&nbsp;echo "You must be located in /root" >&2<br>&nbsp;exit 1<br>fi</code><br><ol><li value="12">Save your editing session, but remain in the text editor.</li><li>This shell script is designed particularly for your centos1, centos2, and centos3 VMS.</li><li>The code displayed below will prompt the user if they wish for all VMs to be backed-up; otherwise, allow the user the option of specifying which VMs to be backed-up. Add the following code</li></ol><br><code style="color:#3366CC;font-family:courier;font-size:.9em;"> read -p "Backup all VMs? (y|n):" answer # prompt if all VMs to be backed-up if [ "$answer" = "y" ] # Backup all VMs if answer is yes<br>then<br>&nbsp;for num in 1 2 3 # Determinant loop for 3 arguments: 1, 2, and 3<br>&nbsp;do<br>&nbsp;&nbsp;echo "Backing up VM #$num"<br>&nbsp;&nbsp;gzip < /var/lib/libvirt/images/centos$num.qcow2 > ~yourusername/backups/centos$num.qcow2.gz<br><br>&nbsp;&nbsp;echo "VM #$num BACKUP DONE"<br>&nbsp;done<br><br>elif [ "$answer" = "n" ]<br>then<br>&nbsp;read -p "Which VM should be backed up? (1/2/3): " numanswer<br>&nbsp;until echo $numanswer | grep "^[123]$" >> /dev/null # Look for match of single digit: 1,2, or 3<br>&nbsp;do<br>&nbsp;&nbsp;read -p "Invalid Selection. Select 1, 2, or 3: " numanswer<br>&nbsp;done<br>&nbsp;echo "Backing up VM #$numanswer"<br>&nbsp;gzip < /var/lib/libvirt/images/centos$numanswer.qcow2 > ~yourusername/centos$numanswer.qcow2.gz<br><br>&nbsp;echo "VM #$numanswer BACKUP DONE"<br>else<br>&nbsp;echo "Invalid Selection... Aborting program"<br>&nbsp;exit 2<br>fi </code>  <ol><li value="15">Save, set permissions, and then run that shell script to backup centos1. Since that script will only work if you are in root's home directory, you will need to use the technique you learned earlier to temporarily become root. Confirm that this script did backup this image to root's home directory</li><li>Use the <b><code>wget</code></b> command to download, study, and run the following shell scripts on-line:<blockquote><b><code><span style=" pointer-events:none;cursor:default;color:#3366CC;font-size:1.2em;">https://ict.senecacollege.ca/~ops235/labs/vm-start-text.bash<br>https://ict.senecacollege.ca/~ops235/labs/vm-stop-text.bash</span></code></b><br><b><code><span style=" pointer-events:none;cursor:default;color:#3366CC;font-size:1.2em;">https://ict.senecacollege.ca/~ops235/labs/vm-start.bash<br>https://ict.senecacollege.ca/~ops235/labs/vm-stop.bash</span></code></b></blockquote></li><li>Try to understand what these Bash Shell scripts do.</li><li>You have completed lab2. Proceed to Completing The Lab, and follow the instructions for "lab sign-off".</li></ol> 

This week you have added some significant capabilities to your python scripting. The ability to run loops and make decisions makes your scripts much more powerful. In this investigation you will write a python script that backs up the centos1, centos2, and centos3 VMs, or lets the user to specify which VMs they want backed up.

<li>In your '''bin ''' directory, create the file '''backupVM.py''', and populate with our standard beginning

&#35;!/usr/bin/env python3<br />

&nbsp;&nbsp;for machine in {print('Backing up centos1','centos2','centos3'}:)<br />&nbsp;&nbsp;os.system('gzip < /var/lib/libvirt/images/centos1.qcow2 > ~YourRegularUsername/backups/centos1.qcow2.gz')<br />&nbsp;&nbsp;print('Backing upcentos2' + machine)<br />&nbsp;&nbsp;os.system('gzip < /var/lib/libvirt/images/centos2.qcow2 > ~YourRegularUsername/backups/centos2.qcow2.gz')<br />&nbsp;&nbsp;print('Backing up centos3')<br />&nbsp;&nbsp;os.system('gzip < /var/lib/libvirt/images/' + machine + 'centos3.qcow2 > ~YourRegularUsername/backups/' + machine + 'centos3.qcow2.gz')<br />

<li>Now Test your script to make sure it works. If it doesn't, go back and fix it. '''Do not continue until it successfully makes backups of your VMs'''.</li><li>There is a weakness to this script as written. Every time you run it, it will make a backup of all three VMs. But what if you only made a change to one of them? Do we really need to wait through a full backup cycle for two machines that didn't change? As the script is currently written, we do. But we can make it better. We've provided the scripts with some comments below.</li><li><code style="color:#3366CC;font-family:courier;font-size:.9em;">&#35;!/usr/bin/env python3<br />&#35;&nbsp;backupVM.py<br />&#35;&nbsp;Purpose: Backs up virtual machines<br />&#35;<br />&#35;&nbsp;USAGE: ./backupVM.py<br />&#35;<br />&#35;&nbsp;Author: *** INSERT YOUR NAME ***<br />&#35;&nbsp;Date: *** CURRENT DATE ***<br />import os<br /><br />&#35;Make sure script recognizes you as is being run with elevated permissions<br />currentuser = os.popen('whoami').read().strip()<br />if currentuser != 'root ':<br />&nbsp;&nbsp;print(or at least running the "You must be root")<br />&nbsp;&nbsp;exit()<br />else<br /><br />&#35;The rest of this script identifies steps with root permissions)comments 'Step <something>'.<br />&#35;This is not a normal standard for commenting, it should workhas been done here to link the script<br />&#35; to the instructions on the wiki. <br /><br />&#35;Step A: Notice how we've used Find out if user wants to back up all VMs<br />&#35;Step B-1:use the + existing loop to combine several strings together back up all the VMs<br />&nbsp;&nbsp;print('Backing up centos1')<br />&nbsp;&nbsp;os.system('gzip < /var/lib/libvirt/images/centos1.qcow2 > ~YourRegularUsername/backups/centos1.qcow2.gz')<br />&nbsp;&nbsp;print('Backing up centos2')<br />&nbsp;&nbsp;os.system('gzip < /var/lib/libvirt/images/centos2.qcow2 > ~YourRegularUsername/backups/centos2.qcow2.gz')<br />&nbsp;&nbsp;print('Backing up centos3')<br />&nbsp;&nbsp;os.system('gzip < /var/lib/libvirt/images/centos3.qcow2 > ~YourRegularUsername/backups/centos3.qcow2.gz')<br />&#35;Step B-2: They don't want to pass back up all VMs, prompt them for which VM they want to back up<br />&#35;Step C: Prompt the user for the name of the osVM they want to back up<br />&#35;Step C-1: If the user chose Centos1, back up that machine.<br />&#35;Step C-2: If the user chose Centos2, back up that machine.<br />&#35;Step C-3: If the user chose Centos3, back up that machine.system command<br /></code></li><li>Before the block that backs up each machine add a prompt to ask the user if they want to back up all machines. We Use an if statement to check if they said yes (See comment 'Step A').<ul><li>if they did this because this script needs say yes, back up all the VMs using your existing block (Comment step B-1).</li><li>If they didn't say yes, do nothing for now (you could even use python variable 's pass statement).</li></ul></li><li>Test your script to make sure it works. Check what happens if you say 'yes' to be evaluated before the whole line gets handed over prompt, and check what happens if you say things other than 'yes'.</li><li>Now we have a script that asks the user if they want to back up all VMS, and if they say they do, it does. But if they don't want to osback up every VM, it currently does nothing.system</li><li>Add an else statement at comment Step B-2 to handle the user not wanting to back up every VM. If Inside that else clause (Comment step C) ask the user which VM they would like to back up (you left can even give them the variable names of available VMs (Centos1, Centos2, Centos3).</li><li>Now nest an if statement inside the quotesthat else (Comments C-1, C-2, python will ignore them as and C-3) so that your script can handle what your user just being part of a stringresponded with. If they asked for Centos1, back up Centos1. If they want to back up Centos2, only back up Centos2, etc. Hint: You might want to use elif for this.</li><li>Test your script again. By putting them outside of You should now have a stringscript that:<ul><li>Makes sure the user is running the script with elevated permissions.</li><li>Asks the user if they want to back up every VM.</li><li>If they want to back up every VM, and concatenating their value it backs up every VM.</li><li>If the user does not want to that stringback up every VM, we can evaluate the script asks them and feed them into which VM they do want to back up.</li><li>If the user selected a single VM, the script will back up that commandone VM.</li><li>Convert Now you may notice another issue with the rest script: The gzip lines are almost identical. The only difference in them is the name of the bash script above into pythonVM file being backed up. In the portion of code where you back up each machine individually (comment steps C-1, C-2, then test your python version and C-3) try replacing the machine name in the gzip command with a string variable that holds the machine's name instead. Note that you will have to make sure it worksus of string concatenation for this to work correctly.</li></ul></li>

# Issue the Linux command: <b><code><span style="color:#3366CC;font-size:1.2em;">wget https://ictraw.senecacollegegithubusercontent.cacom/~peter.callaghanOPS245/ops245labs/labsmain/lab2-check.bash</span></code></b>

::&#x2713; '''<u>All</u> VMs''':<blockquote><ul><li>All 4 nested VMs '''created''' and '''running'''</li><li> Proof of '''yum updates''' on ALL VMs (i.e. results from '''yum update''' command)</li></ul></blockquote>

#Upload a screenshot of the proof listed above, the output file generated by the lab2-check.bash script, your log book, and your backupVM.py to blackboard.