Difference between revisions of "Tutorial12: Shell Scripting - Part 2"

From CDOT Wiki
Jump to: navigation, search
(Main Objectives of this Practice Tutorial)
(Tutorial Reference Material)
Line 29: Line 29:
  
  
|  style="padding-left:15px;" |Additional Control Flow Statements
+
|  style="padding-left:15px;" |Additional Control Flow Statements / techniques
 
* [https://www.tutorialspoint.com/unix/if-else-statement.htm if-else]
 
* [https://www.tutorialspoint.com/unix/if-else-statement.htm if-else]
 
* [https://www.tutorialspoint.com/unix/if-else-statement.htm if-elif-else]
 
* [https://www.tutorialspoint.com/unix/if-else-statement.htm if-elif-else]
 
* [https://www.cyberciti.biz/faq/bash-for-loop/#:~:text=A%20'for%20loop'%20is%20a,files%20using%20a%20for%20loop. for Loop]
 
* [https://www.cyberciti.biz/faq/bash-for-loop/#:~:text=A%20'for%20loop'%20is%20a,files%20using%20a%20for%20loop. for Loop]
 +
* [https://www.gnu.org/software/bash/manual/html_node/Command-Substitution.html Using Command Substitution]
 
* [https://bash.cyberciti.biz/guide/While_loop while Loop]<br><br>
 
* [https://bash.cyberciti.biz/guide/While_loop while Loop]<br><br>
  

Revision as of 10:08, 27 October 2020

ADDITIONAL SHELL SCRIPTING


Main Objectives of this Practice Tutorial

  • Explain how to construct if-else and if-elif-else control flow statements.
  • Explain the purpose of command substitution
  • Explain how to issue the for loop control flow statement using a list with command substitution.
  • Explain how to configure and use the .bashrc start-up file.


Tutorial Reference Material

Course Notes
Linux Command/Shortcut Reference
YouTube Videos
Course Notes:


Additional Control Flow Statements / techniques Startup Files


Brauer Instructional Videos:

KEY CONCEPTS

Additional Logic Statements


Example of how an if-else statement works.
(Image licensed under cc)

Unlike using only an if statement, an if-else statement take two different sets of actions
based on the results of the test condition.

How it Works:
When the test condition returns a TRUE value, then the Linux Commands between
then and else statements are executed.
If the test returns a FALSE value, then the the Linux Commands between
the else and fi statements are executed.

Example:

num1=5
num2=10
if test $num1 –lt $num2
then
   echo “Less Than”
else
echo    “Greater Than or Equal to”
fi


Example of how an if-elif-else statement works.
(Image licensed under cc)

The elif statement can be used to perform additional conditional tests of the previous test condition tests FALSE. This statement is used to make your logic control-flow statement to be more adaptable.

How it Works:
If the test condition returns a TRUE value, then the Linux Commands between
then and else statements are executed.

If the test returns a FALSE value, then a new condition is tested,
and action is taken if the result is TRUE, then the Linux Commands between
then and else statements are executed. Additional elif statements can be used if additional conditional testing is required . Eventually, an action will be taken
when the final test condition is FALSE.

Example:

num1=5
num2=10
if test $num1 –lt $num2
then    echo “Less Than”
elif test $num1 –gt $num2
then
   echo “Greater Than”
else    echo “Equal to”
fi


Additional Loop Statements

Example of how a for loop with command substitution works.

Command substitution is a facility that allows a command
to be run and its output to be pasted back on the command line as arguments to another command.

Reference: https://en.wikipedia.org/wiki/Command_substitution

Usage:

command1 $(command2)
or
command1 `command2`


Examples:

file $(ls)
mail -s "message" $(cat email-list.txt) < message.txt

Using for Loop with Command Substitution

Let’s issue the for loop with a list using command substitution.
In the example below, we will use command substitution to issue the ls command and
have that output (filenames) become arguments for the for loop.

Example:

for x in $(ls)
do
   echo “The item is: $x”
done


Example of how a while loop works.
(Image licensed under cc)

The while loop is useful to loop based on the result from a test condition or command result.
This type of loop is very useful for error-checking.

How it Works:
The condition/expression is evaluated, and if the condition/expression is TRUE,
the code within … the block is executed.
This repeats until the condition/expression becomes FALSE.
Reference: https://en.wikipedia.org/wiki/While_loop

Example:

answer=10
read –p “pick a number between 1 and 10: “ guess
while test $guess –eq 10
do    read –p “Try again: “ guess
done
echo “You are correct”


Using Startup Files

Shell configuration (start-up) files are scripts that are run when you log in, log out, or start a new shell. The start-up files can be used, for example, to set the prompt and screen display, create local variables, or create temporary Linux commands (aliases)

The /etc/profile file belongs to the root user and is the first start-up file that executes when you log in, regardless of shell.

User-specific config start-up files are in the user's home directory: ~/.bash_profile runs when you log in ~/.bashrc runs when you start an interactive sub-shell.

Logout Files

There is a file that resets or restores the shell environment (including shut-down of programs running in the shell) when the user logs out of their shell. User-specific logout start-up files are in the user's home directory: ~/.bash_logout

INVESTIGATION 1: ADDITIONAL LOGIC STATEMENTS


In this section, you will learn additional control-flow statements to allow your shell scripts to be more flexible.


Perform the Following Steps:

  1. Login to your matrix account.

  2. Issue a command to confirm you are located in your home directory.

    In a previous tutorial, you learned how to use the if control-flow statement. You will now learn to use the if-else statement
    to take two different actions based on if the condition tests either TRUE or FALSE.

  3. Use a text editor like vi or nano to create the text file called if-3.bash (eg. vi if-3.bash)

    If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule.

  4. Enter the following lines in your shell script:
    #!/bin/bash
    clear
    read -p "Enter the first number: " num1
    read -p "Enter the second number: " num2
    if [ $num1 -gt $num2 ]
    then
       echo "The first number is greater than the second number."
    else
       echo "The first number is less than or equal to the second number."
    fi


  5. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  6. Issue the following linux command to add execute permissions for your shell script:
    chmod u+x if-3.bash

  7. Run your shell script by issuing: ./if-3.bash

    What do you notice? Try running the script several times with numbers different and equal to each other to
    confirm that the shell script works correctly.

    It would be nice to have a separate result of the numbers are equal to each other.
    In order to achieve this, you can use an if-elif-else statement.

  8. Use a text editor like vi or nano to create the text file called if-4.bash (eg. vi if-4.bash)

    If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule.

  9. Enter the following lines in your shell script:
    #!/bin/bash
    clear
    read -p "Enter the first number: " num1
    read -p "Enter the second number: " num2
    if [ $num1 -gt $num2 ]
    then
       echo "The first number is greater than the second number."
    elif [ $num1 -lt $num2 ]
    then
       echo "The first number is less than the second number."
    else
       echo "The first number is equal to the second number."
    fi


  10. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  11. Issue the following linux command to add execute permissions for your shell script:
    chmod u+x if-4.bash

  12. Run your shell script by issuing: ./if-4.bash

    What do you notice? Try running the script several times with numbers different and equal to each other
    to confirm that the shell script works correctly.

    A classic shell script to demonstrate many different paths or actions to take depending of multiple testing
    using an if-elif-else statement would be a mark to letter grade converter.

  13. Use a text editor like vi or nano to create the text file called if-5.bash (eg. vi if-5.bash)

    If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule.

  14. Enter the following lines in your shell script:
    #!/bin/bash
    clear
    read -p "Enter a mark (0-100): " mark
    if [ $mark -ge 80 ]
    then
       echo "You receive an A grade."
    elif [ $mark -ge 70 ]
    then
       echo "The receive a B grade."
    elif [ $mark -ge 60 ]
    then
       echo "The receive a C grade."
    elif [ $mark -ge 50 ]
    then
       echo "The receive a D grade."
    else
       echo "You receive an F grade."
    fi


  15. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  16. Issue the following linux command to add execute permissions for your shell script:
    chmod u+x if-5.bash

  17. Run your shell script by issuing: ./if-5.bash

    What do you notice? Run several times to confirm that the shell script runs correctly for all mark (grade) categories.

In the next investigation, you will learn more about the for loop and learn how to use the while loop for error-checking.

INVESTIGATION 2: ADDITIONAL LOOPING STATEMENTS

In this section, you will learn more about the for loop and learn how to use the while loop for error-checking.


Perform the Following Steps:

  1. Use the more command to view the contents of the text file called for-1.bash (eg. more for-1.bash)

    As you should have noticed from tutorial 10 that the for loop can use a list.
    You can also use the for loop with positional parameters stored as arguments from an executed shell script.
    We will revisit this now.

    You can also use the for loop with a list using command substitution - this is an effective technique to loop within a shell script.

  2. Before creating a new shell script, let's learn to use command substitution from the Bash Shell to store arguments as positional parameters and use them for practice. Issue the following linux command to set positional parameters in your current shell:
    set apples oranges bananas pears

  3. Issue the following linux command:
    echo $#

    What do you notice?

  4. Issue the following linux command:
    echo $*

    What do you notice?

    These positional parameters could be used with a for loop. To simplify things, let's create another shell script that uses command substitution and a for loop.

  5. Use a text editor like vi or nano to create the text file called for-2.bash (eg. vi for-3.bash)

    If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule.

  6. Enter the following lines in your shell script:
    #!/bin/bash
    clear
    set 10 9 8 7 6 5 4 3 2 1
    for x
    do
       echo $x
    done
    echo "blast-off!"


  7. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  8. Issue the following linux command to add execute permissions for your shell script:
    chmod u+x for-3.bash

  9. Run your shell script by issuing: ./for-3.bash

    What do you notice? How does the result differ from the shell script called for-2.bash. Why?

    Let's create another shell script to run a loop for each file that is contained in your current directory using command substitution.

  10. Use a text editor like vi or nano to create the text file called for-4.bash (eg. vi for-4.bash)

    If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule.

  11. Enter the following lines in your shell script:
    #!/bin/bash
    clear
    set $(ls)
    echo Here are files in my current directory:"
    echo
    for x
    do
       echo "    $x"
    done


  12. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  13. Issue the following linux command to add execute permissions for your shell script:
    chmod u+x for-4.bash

  14. Run your shell script by issuing: ./for-4.bash

    What do you notice?

    We can reduce a line in our shell script by using command substitution in the for loop instead of using the set command.
    Let's demonstrate this in another shell script.

  15. Use a text editor like vi or nano to create the text file called for-5.bash (eg. vi for-5.bash)

    If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule.

  16. Enter the following lines in your shell script:
    #!/bin/bash
    clear
    echo Here are files in my current directory:"
    echo
    for x in $(ls)
    do
       echo "    $x"
    done
  17. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  18. Issue the following linux command to add execute permissions for your shell script:
    chmod u+x for-5.bash

  19. Run your shell script by issuing: ./for-5.bash

    What do you notice? Does the output for this shell script differ than for-4.bash? Why?

    The last thing in this section is to introduce you to error-checking.

  20. Use the more command to view the text file called if-5.bash (eg. more if-5.bash)

    Take a few moments to re-familiarize yourself with this shell script

  21. Run your shell script by issuing: ./if-5.bash

    When prompted, enter a letter instead of a number. What happens?

    Let's edit the if-5.bash shell script to perform error-checking to force the user to enter a numeric value between 0 and 100.

    NOTE: The while statement can be used with the test command (or a simple linux command or a linux pipeline command) for error checking. In our case, we will use a pipeline command with extended regular expressions. In order to loop while the result is TRUE (not FALSE), you can use the negation symbol (!) to set the test condition to the opposite.

  22. Use a text editor like vi or nano to edit the text file called if-5.bash (eg. vi if-5.bash)

    If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule.

  23. Add the following lines in your shell script AFTER the read statement to prompt the user for a mark:

    while ! echo $mark | egrep "^[0-9]{1,}$" > /dev/null 2> /dev/null
    do
       read -p "Not a valid number. Enter a mark (0-100): " mark
    done


  24. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  25. Run your shell script by issuing:
    ./if-5.bash

  26. When prompted, enter a letter instead of a number. What happens?
    Does the shell script allow you to enter an invalid grade like 200 or -6?

    Let's add an additional error-checking loop to force the user to enter a number between 0 and 100.

  27. Use a text editor like vi or nano to edit the text file called if-5.bash (eg. vi if-5.bash)

  28. Add the following lines in your shell script AFTER the PREVIOUSLY ADDED error-checking code block to force the user to enter a valid number:

    while [ $mark -lt 0 ] || [ $mark -gt 100 ]
    do
       read -p "Invalid number range. Enter a mark (0-100): " mark
    done


  29. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  30. Run your shell script by issuing:
    ./if-5.bash

  31. When prompted, enter a letter instead of a number. What happens?
    Does the shell script allow you to enter an invalid grade like 200 or -6?

In the next investigation, you will learn to create and test-out the ~/.bashrc start-up file to customize your Bash shell.

INVESTIGATION 3: USING START-UP FILES

In this section, you will learn how to customize your Bash Linux shell environment by creating and testing a start-up file.


Perform the Following Steps:

  1. Use the more command to view the contents of the start-up file called /etc/profile (eg. more /etc/profile)

    This file contains the default settings when you open your Bourne shell (eg. if issuing the command sh).

  2. Use the more command to view the contents of the start-up file called /etc/bashrc (eg. more /etc/bashrc)

    This file contains the default settings when you open your Bash shell (eg. if issuing the command bash).

    Since we are using the Bash shell by default, let's create a customized Bash start-up file.
    This startup file is located in your home directory using the name ".bashrc"

  3. Let's move your .bashrc file to prevent accidental overwrite. Issue the following linux command:
    mv ~/.bashrc ~.bashrc.bk

    If you experience an error message "No such file or directory", just ignore since there is no startup file to backup.

  4. Use a text editor like vi or nano to create the text file called ~/.bashrc (eg. vi ~/.bashrc)

    If you are using the nano text editor, refer to notes on text editing in a previous week in the course schedule.

  5. Enter the following lines in your shell script (the symbol "[" is the open square bracket symbol):
    clear
    echo -e -n "\e[0;34m"
    echo "Last Time Logged in (for security):"
    echo
    lastlog -u $USER
    echo
    echo -e -n "\e[m"


  6. Save your editing session and exit the text editor (eg. with vi: press ESC, then type :wx followed by ENTER).

  7. You can test run the startup file without exiting and re-entering your Bash shell environment.
    Issue the following:
    . ~/.bashrc

    What do you notice?

  8. Exit your current Bash shell session.

  9. Login again to your matrix account.

    Did you start-up file customize your Bash shell environment with colours?

  10. Issue the following linux command to restore your previous settings for your bashrc startup file:
    mv ~/.bashrc.bk ~/.bashrc

    If you experience an error message "No such file or directory", just ignore.

  11. After you complete the Review Questions sections to get additional practice, then work on your online assignment 3,
    sections 4 to 6 labelled: More Scripting (add), Yet More Scripting (oldfiles), and sed And awk

WHERE DO I GO FROM HERE?

I hope this series of tutorials have been helpful in teaching you basic Linux OS skills.

In order to get efficient in working in the Linux environment requires practice and applying what you have learned to administering Linux operating systems including users, applications, network services and network security.

Although you are NOT required to perform Linux administration for this course, there are useful course notes and tutorials for advanced Linux server administration that have been created for the Networking / Computer Support Specialist stream:



Take care and good luck in your future endeavours,

Murray Saul

LINUX PRACTICE QUESTIONS

The purpose of this section is to obtain extra practice to help with quizzes, your midterm, and your final exam.

Here is a link to the MS Word Document of ALL of the questions displayed below but with extra room to answer on the document to simulate a quiz:

https://ict.senecacollege.ca/~murray.saul/uli101/uli101_week12_practice.docx

Your instructor may take-up these questions during class. It is up to the student to attend classes in order to obtain the answers to the following questions. Your instructor will NOT provide these answers in any other form (eg. e-mail, etc).


Review Questions:

  1. Create a Bash shell script called retire.bash that when run, clears the screen, and then prompts the user for their age. If the age entered is less than 65, then display a message that the person is NOT eligible to retire. If the age is equal to 65, then display a message that the person just turned 65 and can retire. If the age is greater than 65, then display the message that the user is over 65 and why have they not have already retired already?

  2. Add code to the retire.bash script created in the previous question to force the user to enter only an integer to provide error-checking for this shell script.

  3. What is the purpose of the /etc/profile startup file?

  4. What is the purpose of the /etc/bashrc startup file?

  5. What is the purpose of the ~/.bashrc startup file?

  6. What is the purpose of the ~/.bash_logout file?

  7. Write code for the ~/.bashrc file below to clear the screen, welcome the user by their username, and display a list of all users currently logged into your Matrix server. Insert blank lines between each of those elements.

  8. Write a command to run the recently created ~/.bashrc startup file from the previous question without exiting and re-logging into your Matrix account.