Tutorial8: Links / Process Management

From CDOT Wiki
Revision as of 14:51, 24 February 2021 by Msaul (talk | contribs) (Main Objectives of this Practice Tutorial)
Jump to: navigation, search

LINKING FILES / MANAGING PROCESSES


Main Objectives of this Practice Tutorial

  • Define the term inode as it relates Unix / Linux Files
  • Define the terms: Hard Link and Symbolic Link
  • Issue the ln command to create hard and symbolic links
  • Define and understand the purpose of a process in Unix / Linux
  • Run and terminate processes in the foreground and background
  • Display and manipulate background and foreground processes
  • Use alias and history commands in Unix/Linux


Tutorial Reference Material

Course Notes
Concepts / Commands
YouTube Videos
Course Notes:


Links

Managing Processes

Linux Commands Brauer Instructional Videos:

KEY CONCEPTS

Linking Files

Links are powerful and add flexibility to Linux filesystems because everything is a file.

There are two types of Linux filesystem links: hard and soft. The difference between the two types of links is significant, but both types are used to solve similar problems. They both provide multiple directory entries (or references) to a single file, but they do it quite differently.


Reference: https://opensource.com/article/17/6/linking-linux-filesystem


inode (index) Number of a File:

Each inode stores the attributes and disk block locations of the object's data.
(Image licensed under cc)
The inode number is like a finger-print, and is considered to be unique for each file on the Unix / Linux file system.

The inode (index node) is a data structure in a Unix-style file system that describes a file-system object such as a file or a directory. Each inode stores the attributes and disk block locations of the object's data. File-system object attributes may include metadata (times of last change, access, modification), as well as owner and permission data.

Reference: https://en.wikipedia.org/wiki/Inode


The inode number is like a finger-print, and is considered to be unique for each file on the Unix / Linux file system.

Referring to the diagram on the far right, issuing the ls command with the -i option
displays the inode number for each file. You can see that each file
(whether it is a directory or regular file) has its own unique inode number.


Hard Links:

(Image licensed under cc)
Image manipulated by author]
Hard links share the same inode number. Hard links are very good for backup purposes.

A Hard link is a reference to the physical data on a file system.

Advantages of hard links are that if one hard link remains (even if original file has been removed), the data in that hard linked file is NOT lost, as well as hard linked files will automatically be updated to that of the original file since they share the same i-node number.

Disadvantages of hard links are that they take-up extra space,
you cannot hard link directories, and you cannot hard link files from other Unix/Linux servers
(since the inode number may already be used by the other Unix/Linux server).


Examples:

touch myfile.txt
ln myfile.txt myfile1.hard.lnk
ln myfile.txt myfile2.hard.lnk
ln myfile.txt ~/backups/myfile.hard.lnk


Symbolic Links:

(Image licensed under cc)
Symbolic links do NOT share the same i-node number. Symbolic links are very good for short-cuts to other files (including directories) but NOT for backup purposes.

A Symbolic Link is an indirect pointer to a file and are also known as soft link or symlink.

Advantages of symbolic links are that they are shortcuts to other files, where the symbolic link only contains the pathname to the original file, you can create symbolic links
on different Unix/Linux servers, and that you can create symbolic links for directories.

Disadvantages of symbolic links are that they are NOT good for backup purposes
since a symbolic link can point to a nonexistent file (referred to as a "broken link").


Examples:

touch otherfile.txt
ln -s otherfile.txt otherfile1.sym.lnk
ln -s otherfile.txt otherfile2.sym.lnk
ln -s otherfile.txt ~/backups/otherfile.sym.lnk


Managing Processes

(Image licensed under cc)

All programs that are running on a Unix/Linux computer system are referred to as processes:

  • Each process has an owner
  • Each process has a unique ID (PID)
  • Processes in UNIX can run in the foreground or background
  • Programs / Commands can be run in the background by placing an ampersand & after the command
    (eg. program-name &)

UNIX processes are hierarchical:

  • The process structure has a root, parents, and children, etc.
  • Creation of a new process is called forking or spawning
  • The Parent process can spawn a child process, and in turn spawn their own child processes
  • Processes keep their PID for their entire life
  • Usually a parent sleeps when a child is executing
    (the exception is when the child process is running in the background)

Users can learn to manage processes to become more productive while working in the Unix / Linux Command-line environment.


Below are common Linux commands / keyboard shortcuts to manage processes:

Linux Command / Key CombinationPurpose
psThe ps (process status) command displays snapshot information about processes. By default, the ps command displays information only about the current terminal (ps -l provides a detailed listing, ps -U username shows all)

Examples: ps , ps -l , ps -ef , ps -u , ps aux
topThe top command provides a realtime status of running processes.
NOTE: You can press ctrl-c to exit
fgThe fg (foreground) command moves a background job from the current environment into the foreground. The fg command issued without arguments will place the most recent process in the background to the foreground. Example: fg %job-number
<ctrl><c>Terminates a process running in the foreground
<ctrl><z>Sends a process running in the foreground into the background.
bgThe bg utility resumes suspended jobs from the current environment. The bg command issued without arguments will run the most recent process that was placed into the background.
Example: bg %job-number
jobsThe jobs utility displays the status of jobs that were started in the current shell environment
Examples:
jobs
[1]+ Stopped vim a   <-- Job #1 (+ means most recent process sent to background)
[2]  Running sleep 200 &  <-- Job #2
[3]  Running sleep 300 &  <-- Job #3
[4]- Running sleep 400 &  <-- Job #4 (- means second recent process sent to background)

killThe kill command sends the specified signal to the specified processes or process groups. If no signal is specified, the TERM signal is sent. The default action for this signal is to terminate the process.
Examples:
kill PID , kill -9 PID , kill %job-number ,
kill -9 %job-number

Aliases / Command History

Alias:

Assigns a new name to an existing utility

Example:

alias (Alias command without an argument will display all the aliases currently set)

Other Examples:

alias dir=ls
alias ls='ls -al'
alias clearfile='cat /dev/null >'

unalias alias-name (removes alias from memory)


Command History:

The filename ~/.bash_history stores recently executed command lines

<up> or <down> Move to previous command or next command within Bash shell prompt
fc -l display last 16 commands
history | moredisplay all stored commands
!numre-execute an issued command number by command number (determined from history command)
!xxxre-execute an issued command beginning with string "xxx"


INVESTIGATION 1: LINKING FILES


In this section, you will learn how to create hard links and symbolic links on your Matrix account.


Perform the Following Steps:

  1. Login to your matrix account.

  2. Issue a command to confirm you are located in your home directory.

  3. Issue the following Linux command to create a directory called ~/links:
    mkdir ~/links

  4. Issue the ls command to confirm that the directory called ~/links exists.

  5. Use a text editor to create a file called ~/links/data-file.txt

  6. Enter the following text displayed below:

    This is line 1
    This is line 2
    This is line 3

  7. Save your editing session and exit your text editor.

  8. Issue the following Linux command:
    ls -li ~/links/data-file.txt

    View the i-node number for this file. What does this i-node number represent?

  9. Issue the following Linux command to create the following hard link in the same directory:
    ln ~/links/data-file.txt ~/links/data-file.hard.lnk

  10. Issue the ls -li command for the ~/links directory.

    What do you notice about both of these file's i-node numbers?

  11. Use a text editor to edit the file ~/links/data-file.txt and add some additional lines to this file.

  12. Save your editing session and exit your text editor.

  13. Issue the following Linux command:
    cat ~/links/data-file.hard.lnk

    What do you noticed what happened to this linked file?

  14. Use a text editor to edit the hard-linked file ~/links/data-file.txt.hard.lnk and add some additional lines to this file.

  15. Save your editing session and exit your text editor.

  16. Issue the following Linux command:
    cat ~/links/data-file.hard.lnk

    What do you noticed what happened to this original file?

  17. Issue the following Linux command to create a hard-linked file in your home directory:
    ln ~/links/data-file.txt ~/data-file.hard.lnk

  18. Issue the ls -i command to determine the i-node number for the file called ~/data-file.hard.lnk

    What do you notice about this file's i-node number?

  19. Issue the following Linux command to check that you created those hard links:
    bash /home/murray.saul/scripts/week8-check-1

    If you encounter errors, then view the feedback to make corrections, and then re-run the checking script.
    If you receive a congratulation message that there are no errors, then proceed with this tutorial.

  20. Issue the following Linux command to remove the ~/links directory and its contents:
    rm -rf ~/links

  21. Issue a Linux command to confirm that the ~/links directory has been removed.

  22. Issue the following Linux command to view the contents of your linked file in your home directory:
    cat ~/data-file.hard.lnk

    What do you notice? What does this tell you about hard links?

  23. Issue the following Linux command to create a directory called ~/links2:
    mkdir ~/links2

  24. Issue the ls command to confirm that the directory called ~/links2 exists.

  25. Use a text editor to create a file called ~/links2/text-file.txt

  26. Enter the following text displayed below:

    This is line one
    This is line two
    This is line three

  27. Save your editing session and exit your text editor.

  28. Issue the following Linux command to create the following symbolic link in the same directory:
    ln -s ~/links2/text-file.txt ~/links2/text-file.sym.lnk

  29. Issue the ls -li command for the ~/links2 directory.

    What do you notice about both of these file's i-node numbers?
    What do you notice about the size of the file ~/links2/text-file.sym.lnk?
    What pathname do you think it represents?

  30. Change to your home directory.

  31. Issue the following Linux command to create the following symbolic link in your home directory:
    ln -s ~/links2/text-file.txt ~/text-file.sym.lnk

  32. Issue the ls -l command for the ~/text-file.txt.sym.lnk file.

    What do you notice? What is the file size?
    What pathname do you think this file contains?

  33. Issue the following Linux command:
    cat ~/text-file.txt.sym.lnk

    What did you notice?

  34. Issue the following Linux command to check that you created those symbolic links:
    bash /home/murray.saul/scripts/week8-check-2

    If you encounter errors, then view the feedback to make corrections, and then re-run the checking script.
    If you receive a congratulation message that there are no errors, then proceed with this tutorial.

  35. Issue the following Linux command to remove the ~/links2 directory:
    rm -rf ~/links2

  36. Re-issue the Linux command you performed in step #31.

    What happened? Why?

  37. Issue the following Linux command:
    ls -l ~/text-file.txt.sym.lnk

    What do you notice?

  38. Issue the following Linux command: ln -s ~uli101 linux

  39. Issue the following Linux command: linux/assign1

    What happened? Why?


In the next investigation, you will learn how to manage processes on your Matrix server.

INVESTIGATION 2: MANAGING PROCESSES

In this section, you will learn how to manage processes on a Unix / Linux server.


Perform the Following Steps:

  1. Make certain that you are logged into your Matrix account.

  2. Issue the following Linux command: sleep 700

    NOTE: The sleep command waits for a specified number of seconds before returning to the shell prompt. It is useful in order to force a pause in a sequence of commands.

  3. Notice that this process will run for 700 seconds, and is forcing the user to wait until this process finishes.
    A process that is running in the terminal is referred to as a foreground process.

    The Unix/Linux system is designed to allow users to send preemptive signals to manage those processes.

  4. Press the key combination: <ctrl><c>

    You should notice that the process that was running in the foreground has been interrupted (i.e. terminated). NOTE: The ctrl-c key combination sends SIGINT (Signal Interrupt) to terminate a process that is running.

  5. Reissue the Linux command: sleep 700

  6. Press the key combination: <ctrl><z>

  7. You should now see output similar to what is displayed below:
    [1]+ Stopped sleep 700

    NOTE: This indicates that this process has been placed into the background.
    This is useful in order to "free-up" the terminal to run other commands.

  8. Clear your bash shell terminal screen.

  9. Issue the following Linux command: jobs

    You should see the following output similar that was displayed above:
    [1]+ Stopped sleep 700

    This display indicates that this process (that is now in the background) has stopped.
    In other words, the sleep command is NOT counting-down to zero to terminate.

    NOTE: You need to use the bg command to run that process that was sent into the background.

  10. Issue the following Linux command: bg

    NOTE: You can use the bg command WITHOUT arguments to specify the most recent process
    that was placed into the background. From the jobs command, the process that has a plus sign "+"
    indicates the most recent process placed into the background.

  11. Issue the following Linux command: jobs

    You should see the following output similar that was displayed above:
    [1]+ sleep 700 &

    This display indicates that this process in the background is running in the background
    (denoted by the ampersand character "&"). Now the command is counting-down to zero.

  12. Issue the following Linux command: fg

    You should notice that the sleep command is now running in the foreground.

    You can run commands with ampersand "&" to run processes in the background.

  13. Press the key combination: <ctrl><c> to terminate the process running in the foreground.

  14. Issue the following Linux command: sleep 500 & sleep 600 & sleep 700 &

  15. Issue the jobs command. What do you notice?

  16. Issue the following Linux command: kill %1

    NOTE: You can specify job number preceded by percent % with the
    kill, bg, and fg commands to specify the processes' job number.

  17. Issue the jobs command. What do you notice?

  18. Issue the following Linux commands:
    kill %2
    kill %3

  19. Issue the jobs command. What do you notice?

    You can also manipulate processes by their PID (process ID).

  20. Let's use grouping to run several commands in sequence within a single process.

  21. Issue the following Linux command: (sleep 400; sleep 500; sleep 600) &

  22. Issue the jobs command. What do you notice?

  23. Issue the following Linux command: ps

    What is the PID of the previously issued Linux command in the background?

  24. Issue the following Linux command (using the PID number instead of "PID"):
    kill PID

  25. Issue the jobs command. Is the sleep process still running?

    NOTE: You need to issue the kill -9 PID command if the previous commands did not work.

  26. Issue the following Linux command (using the PID number instead of "PID"):
    kill -9 PID

  27. Issue the jobs and ps commands to confirm there are no processes running in the background.

In the next investigation, you will learn how to create aliases and view command history on your Matrix server.

INVESTIGATION 3: ALIASES / COMMAND HISTORY


In this section, you will learn how to manage aliases and Linux command history on your Matrix account.


Perform the Following Steps:

  1. Make certain that you are logged into your Matrix account.

  2. Issue the following Linux command: alias

    Take a few moments to view existing aliases that have previously been declared.
    Take a few moments to run those aliases to see what happens.

  3. Issue the following to create an alias: alias lal='ls -al'

  4. Issue the following alias: lal

    What do you notice?

  5. Issue the following to create another alias (lowercase l and h):
    alias lh='ls --human-readable --size -1 -S --classify'

  6. Issue the following command to confirm that this newly-created alias is stored in memory:

    alias | grep "lh"

  7. Issue the following alias: lh

    What do you think this command does?

  8. Logout of your Matrix account, than log into your Matrix account.

  9. Reissue the lh alias. What happened?

  10. Issue the alias command without any arguments to see if it is stored in memory.

  11. Reissue the command to create the lh alias in step #5.

  12. Run the lh alias to confirm that it is properly set in memory.

  13. Issue the following Linux command to edit your ~/.bashrc startup file:
    nano ~/.bashrc

  14. Add the following line at the bottom of this file:
    alias lh='ls --human-readable --size -1 -S --classify'

  15. Save your editing changes and exit your text editor.

  16. Logout of your Matrix account, than log into your Matrix account.

  17. Reissue the lh alias. What happened?

  18. Issue the following Linux command: unalias lh

  19. Run the lh alias to see what happens.

    What happenned?

  20. Logout of your Matrix account, than log into your Matrix account.

  21. Reissue the lh alias. What happened? Why?

  22. Issue the following Linux command to check your work:
    bash /home/murray.saul/scripts/week8-check-3

    If you encounter errors, then view the feedback to make corrections, and then re-run the checking script.
    If you receive a congratulation message that there are no errors, then proceed with this tutorial.

  23. Issue the following Linux command: history | grep "lh"

    What do you notice?

  24. Press an exclamation mark ! immediately followed by the number by one of those commands listed in the history list and press ENTER

    What happened?

  25. Type the following: !unalias and press ENTER

    What happened?

  26. Issue the following Linux command: history | grep "lh"

    What happened?

  27. After you complete the Review Questions sections to get additional practice, then work on your
    online assignment 2 and complete section4 labelled: Linking files and directories.

LINUX PRACTICE QUESTIONS

The purpose of this section is to obtain extra practice to help with quizzes, your midterm, and your final exam.

Here is a link to the MS Word Document of ALL of the questions displayed below but with extra room to answer on the document to simulate a quiz:

https://ict.senecacollege.ca/~murray.saul/uli101/uli101_week8_practice.docx

Your instructor may take-up these questions during class. It is up to the student to attend classes in order to obtain the answers to the following questions. Your instructor will NOT provide these answers in any other form (eg. e-mail, etc).


Review Questions:

  1. Hard Links:
    1. What is the purpose of creating a hard-link?
    2. What is a limitation of a hard link?
    3. Write a single Linux command to create a hard link called ~/backup/myfile.txt.lnk for the existing file called ~/myfile.txt
    4. Write a single Linux command to display the i-node number for both files. Are the i-node numbers identical?

  2. Symbolic (Soft) Links:
    1. What is the purpose of creating a symbolic (soft) link?
    2. What is a limitation of a symbolic (soft) link?
    3. Write a single Linux command to create a symbolic link called ~/shortcuts/murray.saul.lnk
      to the existing directory called ~murray.saul
    4. Are the i-node numbers identical for both of those files?
    5. What data is contained in the file called ~/shortcuts/murray.saul.lnk?

  3. Background / Foreground Processes:
    1. Write a single Linux command to run the program called ~/clean.sh in the background.
    2. Write a single Linux command to place the previously issued program in the foreground.
    3. Write a single Linux command to confirm that this program is running in the background.
    4. What key-combination would you issue to send that program again into the background?
    5. Write a single Linux command to have that process sent into the background to continue running?

  4. Managing Background processes:
    Use the following diagram to answer the accompanying questions.
    Each of the following questions will use the diagram below and are treated as independent situations.

    [1]  Stopped vim a
    [2]- Stopped vim b
    [3]+ Stopped vim c
    1. Write a single Linux command to bring the second-recently process placed in the background into the foreground.
    2. Write a single Linux command to terminate job #3.

  5. Write a single Linux command to display running processes in “real-time”.
  6. Write a single Linux command to terminate a process that has the following PID: 22384

  7. Aliases / History:
    1. Write a linux command to create an alias called ld that issues the command: ls -ld
    2. Write a linux command to unset the alias created in the previous question.
    3. Issue a Linux command to list history of commands that match the pattern called touch.

  8. Create a table listing each Linux command, useful options and command purpose for the following Linux commands:
    ln , ps , top , fg , bg , jobs , kill , alias , unalias , history