Tutorial12: Shell Scripting - Part 2
Contents
ADDITIONAL SHELL SCRIPTING
Main Objectives of this Practice Tutorial
- Explain how to construct if-else and if-elif-else control flow statements.
- Explain the purpose of command substitution
- Explain how to issue the for loop control flow statement using a list with command substitution.
- Explain how to configure and use the .bashrc start-up file.
Tutorial Reference Material
| Course Notes |
Linux Command/Shortcut Reference |
YouTube Videos | ||
| Course Notes:
|
Additional Control Flow Statements / techniques | Startup Files
|
Brauer Instructional Videos: | |
KEY CONCEPTS
Additional Logic Statements
if-else statement:
Unlike using only an if statement, an if-else statement take two different sets of actions
based on the results of the test condition.
How it Works:
When the test condition returns a TRUE value, then the Linux Commands between
then and else statements are executed.
If the test returns a FALSE value, then the the Linux Commands between
the else and fi statements are executed.
Example:
num1=5
num2=10
if test $num1 –lt $num2
then
echo “Less Than”
else
echo “Greater Than or Equal to”
fi
if-elif-else statement:
The elif statement can be used to perform additional conditional tests of the previous test condition tests FALSE. This statement is used to make your logic control-flow statement to be more adaptable.
How it Works:
If the test condition returns a TRUE value, then the Linux Commands between
then and else statements are executed.
If the test returns a FALSE value, then a new condition is tested,
and action is taken if the result is TRUE, then the Linux Commands between
then and else statements are executed. Additional elif statements can be used if additional conditional testing is required . Eventually, an action will be taken
when the final test condition is FALSE.
Example:
num1=5
num2=10
if test $num1 –lt $num2
then
echo “Less Than”
elif test $num1 –gt $num2
then
echo “Greater Than”
else echo “Equal to”
fi
Additional Loop Statements
Command Substitution:
Command substitution is a facility that allows a command
to be run and its output to be pasted back on the command line as arguments to another command.
Reference: https://en.wikipedia.org/wiki/Command_substitution
Usage:
command1 $(command2)
or
command1 `command2`
Examples:
file $(ls)
mail -s "message" $(cat email-list.txt) < message.txt
Using the for Loop with Command Substitution
Let’s issue the for loop with a list using command substitution.
In the example below, we will use command substitution to issue the ls command and
have that output (filenames) become arguments for the for loop.
Example:
for x in $(ls)
do
echo “The item is: $x”
done
While Loops:
The while loop is useful to loop based on the result from a test condition or command result.
This type of loop is very useful for error-checking.
How it Works:
The condition/expression is evaluated, and if the condition/expression is TRUE,
the code within … the block is executed.
This repeats until the condition/expression becomes FALSE.
Reference: https://en.wikipedia.org/wiki/While_loop
Example:
answer=10
read –p “pick a number between 1 and 10: “ guess
while test $guess –eq 10
do read –p “Try again: “ guess
done
echo “You are correct”
Mathematical Operations:
Since you did not have to declare a data-type of a variable, user-defined variables store values as only text. This creates a problem if you want to perform math operations. In order to convert values stored as text in the shell to binary numbers, you need to use a command in order to accomplish that task.
The older method is to use the expr command.
Example:
num1=5;num2=10
result=$(expr $num1 + $num2)
echo "$num1 + $num2 = $result"
5 + 10 = 15
A short-cut to convert text values to binary numbers is to contain within a double set of round brackets: (( ))
Example:
num1=5;num2=10
((result $num1 - $num2))
echo "$num1 - $num2 = $result"
5 - 10 = -5
Alternative Example:
num1=5;num2=10
echo "$num1 x $num2 = $((num1 * num2))"
5 x 10 = 50
Example using a Loop:
value=1
while [ $value -le 5 ]
do
echo "$value"
((value=value+1)) # could also use ((value++))
done
1
2
3
4
5
Using Startup Files
Shell configuration (start-up) files are scripts that are run when you log in, log out, or start a new shell. The start-up files can be used, for example, to set the prompt and screen display, create local variables, or create temporary Linux commands (aliases)
The /etc/profile file belongs to the root user and is the first start-up file that executes when you log in, regardless of shell.
User-specific config start-up files are in the user's home directory: ~/.bash_profile runs when you log in ~/.bashrc runs when you start an interactive sub-shell.
Logout Files
There is a file that resets or restores the shell environment (including shut-down of programs running in the shell) when the user logs out of their shell. User-specific logout start-up files are in the user's home directory: ~/.bash_logout
INVESTIGATION 1: ADDITIONAL LOGIC STATEMENTS
In this section, you will learn additional control-flow statements to allow your shell scripts to be more flexible.
Perform the Following Steps:
- Login to your matrix account.
- Issue a command to confirm you are located in your home directory.
- Issue a Linux command to create a directory called advanced
- Issue a Linux command to change to the advanced directory.
- Issue a Linux command to confirm you are located in the advanced directory.
In a previous tutorial, you learned how to use the if control-flow statement. You will now learn to use the if-else statement
to take two different actions based on if the condition tests either TRUE or FALSE. - Use a text editor like vi or nano to create the text file called if-3.bash (eg. vi if-3.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Enter the following lines in your shell script:
#!/bin/bash
clear
read -p "Enter the first number: " num1
read -p "Enter the second number: " num2
if [ $num1 -gt $num2 ]
then
echo "The first number is greater than the second number."
else
echo "The first number is less than or equal to the second number."
fi - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Issue the following linux command to add execute permissions for your shell script:
chmod u+x if-3.bash - Run your shell script by issuing: ./if-3.bash
What do you notice? Try running the script several times with numbers different and equal to each other to
confirm that the shell script works correctly.
It would be nice to have a separate result of the numbers are equal to each other.
In order to achieve this, you can use an if-elif-else statement. - Use a text editor like vi or nano to create the text file called if-4.bash (eg. vi if-4.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Enter the following lines in your shell script:
#!/bin/bash
clear
read -p "Enter the first number: " num1
read -p "Enter the second number: " num2
if [ $num1 -gt $num2 ]
then
echo "The first number is greater than the second number."
elif [ $num1 -lt $num2 ]
then
echo "The first number is less than the second number."
else
echo "The first number is equal to the second number."
fi - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Issue the following linux command to add execute permissions for your shell script:
chmod u+x if-4.bash - Run your shell script by issuing: ./if-4.bash
What do you notice? Try running the script several times with numbers different and equal to each other
to confirm that the shell script works correctly.
A classic shell script to demonstrate many different paths or actions to take depending of multiple testing
using an if-elif-else statement would be a mark to letter grade converter. - Use a text editor like vi or nano to create the text file called if-5.bash (eg. vi if-5.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Enter the following lines in your shell script:
#!/bin/bash
clear
read -p "Enter a mark (0-100): " mark
if [ $mark -ge 80 ]
then
echo "You receive an A grade."
elif [ $mark -ge 70 ]
then
echo "The receive a B grade."
elif [ $mark -ge 60 ]
then
echo "The receive a C grade."
elif [ $mark -ge 50 ]
then
echo "The receive a D grade."
else
echo "You receive an F grade."
fi - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Issue the following linux command to add execute permissions for your shell script:
chmod u+x if-5.bash - Run your shell script by issuing: ./if-5.bash
What do you notice? Run several times to confirm that the shell script runs correctly for all mark (grade) categories.
- In the next investigation, you will learn more about the for loop and learn how to use the while loop for error-checking.
INVESTIGATION 2: ADDITIONAL LOOPING STATEMENTS
In this section, you will learn more about the for loop and learn how to use the while loop for error-checking.
Perform the Following Steps:
- Issue a Linux command to confirm you are located in the advanced directory.
- Use the more command to view the contents of the text file called for-1.bash (eg. more for-1.bash)
As you should have noticed from tutorial 10 that the for loop can use a list.
You can also use the for loop with positional parameters stored as arguments from an executed shell script.
We will revisit this now.
You can also use the for loop with a list using command substitution - this is an effective technique to loop within a shell script. - Before creating a new shell script, let's learn to use command substitution from the Bash Shell to store arguments as positional parameters and use them for practice. Issue the following linux command to set positional parameters in your current shell:
set apples oranges bananas pears - Issue the following linux command:
echo $#
What do you notice? - Issue the following linux command:
echo $*
What do you notice?
These positional parameters could be used with a for loop. To simplify things, let's create another shell script that uses command substitution and a for loop. - Use a text editor like vi or nano to create the text file called for-3.bash (eg. vi for-3.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Enter the following lines in your shell script:
#!/bin/bash
clear
set 10 9 8 7 6 5 4 3 2 1
for x
do
echo $x
done
echo "blast-off!" - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Add execute permissions for the owner of this script and run this script.
What do you notice? How does the result differ from the shell script called for-2.bash. Why?
Let's create another shell script to run a loop for each file that is contained in your current directory using command substitution. - Use a text editor like vi or nano to create the text file called for-4.bash (eg. vi for-4.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Enter the following lines in your shell script:
#!/bin/bash
clear
set $(ls)
echo Here are files in my current directory:"
echo
for x
do
echo " $x"
done - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Add execute permissions and run this shell script
What do you notice?
We can reduce a line in our shell script by using command substitution in the for loop instead of using the set command.
Let's demonstrate this in another shell script. - Use a text editor like vi or nano to create the text file called for-5.bash (eg. vi for-5.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Enter the following lines in your shell script:
#!/bin/bash
clear
echo Here are files in my current directory:"
echo
for x in $(ls)
do
echo " $x"
done - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Add execute permissions for this shell script and run the shell script
What do you notice? Does the output for this shell script differ than for-4.bash? Why?
We now want to introduce you to the use of error-checking. - Use the more command to view the text file called for-5.bash (eg. more for-5.bash)
Take a few moments to re-familiarize yourself with this shell script - Run your shell script by issuing: ./for-5.bash
When prompted, enter a letter instead of a number. What happens?
Let's edit the for-5.bash shell script to perform error-checking to force the user to enter a numeric value between 0 and 100.
NOTE: The while statement can be used with the test command (or a simple linux command or a linux pipeline command) for error checking. In our case, we will use a pipeline command with extended regular expressions. In order to loop while the result is TRUE (not FALSE), you can use the negation symbol (!) to set the test condition to the opposite. - Use a text editor like vi or nano to edit the text file called for-5.bash (eg. vi for-5.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Add the following lines in your shell script AFTER the read statement to prompt the user for a mark:
while ! echo $mark | egrep "^[0-9]{1,}$" > /dev/null 2> /dev/null
do
read -p "Not a valid number. Enter a mark (0-100): " mark
done - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Run your shell script by issuing:
./for-5.bash - When prompted, enter a letter instead of a number. What happens?
Does the shell script allow you to enter an invalid grade like 200 or -6?
Let's add an additional error-checking loop to force the user to enter a number between 0 and 100. - Use a text editor like vi or nano to edit the text file called for-5.bash (eg. vi for-5.bash)
- Add the following lines in your shell script AFTER the PREVIOUSLY ADDED
error-checking code block to force the user to enter a valid number:
while [ $mark -lt 0 ] || [ $mark -gt 100 ]
do
read -p "Invalid number range. Enter a mark (0-100): " mark
done - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Run your shell script by issuing:
./for-5.bash - When prompted, enter a letter instead of a number. What happens?
Does the shell script allow you to enter an invalid grade like 200 or -6?
Let's learn how to perform math operations in a shell script, and then incorporate math operations within a loop. - Use a text editor like vi or nano to create the text file called for-6.bash (eg. vi for-6.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Enter the following lines in your shell script:
#!/bin/bash
value=1
while [ $value -le 5 ]
do
echo "$value"
value=value+1
done - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Set execute permissions for this shell script and run your shell script by issuing: ./for-6.bash
What do you notice? You should have noticed an error message. - To demonstrate what went wrong, issue the following commands:
num1=5;num2=10
result=$num1+$num2
echo $result
Notice that the user-defined variable stores the text "10+5" which is NOT the expected result of adding the number 10 and 5.
As you may recall in class, we need to convert a number stored as text into a binary number for calculations (in this case, advance the value by 1 for each loop). We can accomplish this by either using the expr command, or by surrounding our math operation within a set of two round brackets. - To demonstrate, issue the following set of commands:
num1=5;num2=10
sum=$(expr $num1+$num2)
echo $sum
((product=$num1*$num2))
echo $product
Let's correct our for-6.bash shell script to correctly use math operations. - Use a text editor like vi or nano to edit the text file called for-6.bash (eg. vi for-6.bash)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Edit line 6 and change to the following:
((value=value+1))
Note: For those familiar with other programming languages, you can achieve the same results by using: ((value++)) - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- Add execute permissions for the owner of this script and run this script.
What do you notice? - Issue the following to run a checking script:
bash /home/murray.saul/scripts/week12-check-1 - If you encounter errors, make corrections and re-run the checking script until you
receive a congratulations message, then you can proceed.
- In the next investigation, you will learn to create and test-out the ~/.bashrc start-up file to customize your Bash shell.
INVESTIGATION 3: USING START-UP FILES
In this section, you will learn how to customize your Bash Linux shell environment by creating and testing a start-up file.
Perform the Following Steps:
- Issue a Linux command to change to your home directory.
- Issue a Linux command to confirm you are located in the home directory.
- Use the more command to view the contents of the start-up file called /etc/profile (eg. more /etc/profile)
This file contains the default settings when you open your Bourne shell (eg. if issuing the command sh). - Use the more command to view the contents of the start-up file called /etc/bashrc (eg. more /etc/bashrc)
This file contains the default settings when you open your Bash shell (eg. if issuing the command bash).
Since we are using the Bash shell by default, let's create a customized Bash start-up file.
This startup file is located in your home directory using the name ".bashrc" - Let's move your .bashrc file to prevent accidental overwrite. Issue the following linux command:
mv ~/.bashrc ~/.bashrc.bk
If you experience an error message "No such file or directory", just ignore since there is no startup file to backup. - Use a text editor like vi or nano to create the text file called ~/.bashrc (eg. vi ~/.bashrc)
If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule. - Enter the following lines in your shell script (the symbol "[" is the open square bracket symbol):
clear
echo -e -n "\e[0;34m"
echo "Last Time Logged in (for security):"
echo
lastlog -u $USER
echo
echo -e -n "\e[m" - Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).
- You can test run the startup file without exiting and re-entering your Bash shell environment.
Issue the following:
. ~/.bashrc
What do you notice? - Exit your current Bash shell session.
- Login again to your matrix account.
Did you start-up file customize your Bash shell environment with colours? - Issue the following to run a checking script:
bash /home/murray.saul/scripts/week12-check-2 - If you encounter errors, make corrections and re-run the checking script until you
receive a congratulations message, then you can proceed. - Issue the following linux command to restore your previous settings for your bashrc startup file:
mv ~/.bashrc.bk ~/.bashrc
If you experience an error message "No such file or directory", just ignore. - After you complete the Review Questions sections to get additional practice, then work on your online assignment 3,
sections 4 to 6 labelled: More Scripting (add), Yet More Scripting (oldfiles), and sed And awk
WHERE DO I GO FROM HERE?
I hope this series of tutorials have been helpful in teaching you basic Linux OS skills.
In order to get efficient in working in the Linux environment requires practice and applying what you have learned to administering Linux operating systems including users, applications, network services and network security.
Although you are NOT required to perform Linux administration for this course, there are useful course notes and tutorials for advanced Linux server administration that have been created for the Networking / Computer Support Specialist stream:
Take care and good luck in your future endeavours,
Murray Saul
LINUX PRACTICE QUESTIONS
The purpose of this section is to obtain extra practice to help with quizzes, your midterm, and your final exam.
Here is a link to the MS Word Document of ALL of the questions displayed below but with extra room to answer on the document to simulate a quiz:
https://ict.senecacollege.ca/~murray.saul/uli101/uli101_week12_practice.docx
Your instructor may take-up these questions during class. It is up to the student to attend classes in order to obtain the answers to the following questions. Your instructor will NOT provide these answers in any other form (eg. e-mail, etc).
Review Questions:
- Create a Bash shell script called retire.bash that when run, clears the screen, and then prompts the user for their age. If the age entered is less than 65, then display a message that the person is NOT eligible to retire. If the age is equal to 65, then display a message that the person just turned 65 and can retire. If the age is greater than 65, then display the message that the user is over 65 and why have they not have already retired already?
- Add code to the retire.bash script created in the previous question to force the user to enter only an integer to provide error-checking for this shell script.
- What is the purpose of the /etc/profile startup file?
- What is the purpose of the /etc/bashrc startup file?
- What is the purpose of the ~/.bashrc startup file?
- What is the purpose of the ~/.bash_logout file?
- Write code for the ~/.bashrc file below to clear the screen, welcome the user by their username, and display a list of all users currently logged into your Matrix server. Insert blank lines between each of those elements.
- Write a command to run the recently created ~/.bashrc startup file from the previous question without exiting and re-logging into your Matrix account.
