Difference between revisions of "Tutorial2: Unix / Linux File Management"
(→Pathnames) |
|||
(754 intermediate revisions by 3 users not shown) | |||
Line 1: | Line 1: | ||
− | =UNIX / LINUX FILE MANAGEMENT= | + | {{Admon/caution|DO NOT USE THIS VERSION OF THE LAB. This page will no longer be updated.|'''New version here:''' https://seneca-ictoer.github.io/ULI101/A-Tutorials/tutorial2<br />'''Andrew's students please go here:''' http://wiki.littlesvr.ca/wiki/OPS145_Lab_2}} |
− | + | =UNIX / LINUX FILE MANAGEMENT CONCEPTS= | |
===Main Objectives of this Practice Tutorial=== | ===Main Objectives of this Practice Tutorial=== | ||
− | + | :* Understand the purpose of '''directories''' and '''directory pathnames'''. | |
− | :* Understand the | + | :* Use common '''Unix / Linux commands''' to perform '''directory management''' tasks. |
− | + | :* Use '''Text Editors''' to create and modify text files | |
− | + | :* Use Common Unix / Linux commands to '''manage''' and '''manipulate''' text files. | |
− | |||
− | :* Use | ||
− | |||
− | :* Use | ||
− | |||
− | |||
===Tutorial Reference Material=== | ===Tutorial Reference Material=== | ||
Line 19: | Line 13: | ||
|- valign="top" | |- valign="top" | ||
− | |colspan=" | + | |colspan="1" style="font-size:16px;font-weight:bold;border-bottom: thin solid black;border-spacing:0px;"|Course Notes<br> |
|colspan="2" style="font-size:16px;font-weight:bold;border-bottom: thin solid black;border-spacing:0px;padding-left:15px;"|Linux Command/Shortcut Reference<br> | |colspan="2" style="font-size:16px;font-weight:bold;border-bottom: thin solid black;border-spacing:0px;padding-left:15px;"|Linux Command/Shortcut Reference<br> | ||
Line 27: | Line 21: | ||
|- valign="top" style="padding-left:15px;" | |- valign="top" style="padding-left:15px;" | ||
− | |colspan=" | + | |colspan="1" |'''Slides:'''<ul><li>Week 2 Lecture 1 Notes:<br> [https://wiki.cdot.senecacollege.ca/uli101/slides/ULI101-2.1.pdf PDF] | [https://wiki.cdot.senecacollege.ca/uli101/slides/ULI101-2.1.pptx PPTX]</li><li>Week 2 Lecture 2 Notes:<br> [https://wiki.cdot.senecacollege.ca/uli101/slides/ULI101-2.2.pdf PDF] | [https://wiki.cdot.senecacollege.ca/uli101/slides/ULI101-2.2.pptx PPTX]</li></ul>'''Tutorials:'''<ul><li>[http://www.cheat-sheets.org/saved-copy/Nano_Cheat_Sheet.pdf Nano Reference Sheet (PDF)]</li><li>[https://www.smashingmagazine.com/2010/05/vi-editor-linux-terminal-cheat-sheet-pdf Vi Reference Sheet (PDF)]</li></ul> |
− | | style="padding-left:15px;" | | + | | style="padding-left:15px;" |'''File Management:''' |
*[http://man7.org/linux/man-pages/man1/pwd.1.html pwd]<br> | *[http://man7.org/linux/man-pages/man1/pwd.1.html pwd]<br> | ||
*[http://man7.org/linux/man-pages/man1/cd.1p.html cd]<br> | *[http://man7.org/linux/man-pages/man1/cd.1p.html cd]<br> | ||
*[http://man7.org/linux/man-pages/man1/ls.1p.html ls]<br> | *[http://man7.org/linux/man-pages/man1/ls.1p.html ls]<br> | ||
+ | *[https://www.systutorials.com/docs/linux/man/1-tree/ tree]<br> | ||
*[http://man7.org/linux/man-pages/man1/mkdir.1.html mkdir]<br> | *[http://man7.org/linux/man-pages/man1/mkdir.1.html mkdir]<br> | ||
*[http://man7.org/linux/man-pages/man1/rmdir.1.html rmdir]<br> | *[http://man7.org/linux/man-pages/man1/rmdir.1.html rmdir]<br> | ||
Line 40: | Line 35: | ||
*[http://man7.org/linux/man-pages/man1/rm.1.html rm] , [http://man7.org/linux/man-pages/man1/rm.1.html rm -r]<br> | *[http://man7.org/linux/man-pages/man1/rm.1.html rm] , [http://man7.org/linux/man-pages/man1/rm.1.html rm -r]<br> | ||
− | | style="padding-left:15px;"|Text File | + | | style="padding-left:15px;"|'''Text Editors /<br>File Content:''' |
+ | *[http://man7.org/linux/man-pages/man1/vi.1p.html vi] , *[https://linux.die.net/man/1/nano nano]<br> | ||
*[http://man7.org/linux/man-pages/man1/cat.1.html cat]<br> | *[http://man7.org/linux/man-pages/man1/cat.1.html cat]<br> | ||
*[http://man7.org/linux/man-pages/man1/more.1.html more] , [http://man7.org/linux/man-pages/man1/less.1.html less]<br> | *[http://man7.org/linux/man-pages/man1/more.1.html more] , [http://man7.org/linux/man-pages/man1/less.1.html less]<br> | ||
+ | * [http://man7.org/linux/man-pages/man1/head.1.html head] , [http://man7.org/linux/man-pages/man1/tail.1.html tail] | ||
*[http://man7.org/linux/man-pages/man1/touch.1.html touch]<br> | *[http://man7.org/linux/man-pages/man1/touch.1.html touch]<br> | ||
*[http://man7.org/linux/man-pages/man1/file.1.html file]<br> | *[http://man7.org/linux/man-pages/man1/file.1.html file]<br> | ||
Line 50: | Line 47: | ||
*[http://man7.org/linux/man-pages/man1/uniq.1.html uniq]<br> | *[http://man7.org/linux/man-pages/man1/uniq.1.html uniq]<br> | ||
*[http://linuxcommand.org/lc3_man_pages/grep1.html grep]<br> | *[http://linuxcommand.org/lc3_man_pages/grep1.html grep]<br> | ||
− | |||
− | |||
− | |||
+ | |colspan="1" style="padding-left:15px;" width="30%"|'''Brauer Instructional Videos:'''<ul><li>[https://www.youtube.com/watch?v=UfAFAipked0&list=PLU1b1f-2Oe90TuYfifnWulINjMv_Wr16N&index=3 Basic File Actions<br>(touch, ls -l, cp, cp -r, mv, mkdir, mkdir -p, rm, rmdir, rm -r)]</ul> | ||
+ | |||
+ | |} | ||
+ | = KEY CONCEPTS= | ||
− | + | ===Unix / Linux Directories=== | |
− | | | + | [[Image:directory-structure-1.png|thumb|right|350px|In Unix / Linux (as opposed to MS Windows), there are no drive letters (such as '''C:''', or '''D:''').<br><br> All files and directories appear under a single ancestor directory called "the '''root''' directory".]] |
+ | To better '''organize''' files (eg. text, images, documents, spreadsheets, programs) within your Matrix account, they should be stored in '''directories'''. To further organize <u>many</u> files, directories<br> may contain '''sub-directories'''. | ||
− | + | The Unix / Linux file system is '''hierarchical''', like other operating systems such as '''Windows''', '''macOS''', etc. In Unix / Linux (as opposed to Windows), there are no drive letters (such as '''C:''', or '''D:'''). | |
− | + | All files and directories appear under a single ancestor directory called the "'''root directory'''". | |
− | |||
− | |||
− | + | Learning how to issue Linux commands for '''navigating''' and '''manipulating''' directory and files within the the Linux filesystem are '''essential skills''' for Linux users and Linux system administrators (i.e. ''sysadmins''). | |
− | + | In the Linux (Unix) OS, the "'''root directory'''" / is the starting directory, and other "''child directories''", "'''grandchild directories'''", etc. can be created as required. The hierarchical structure resembles an "''upside-down tree''". | |
− | + | There is actually a command called <code>tree</code> that displays a "'''directory tree diagram'''"! | |
− | |||
− | === Pathnames === | + | === Directory Pathnames === |
+ | [[Image:path-name.png|thumb|right|180px|A pathname points to a file system location by '''following the directory tree hierarchy'''.]] | ||
+ | ''A '''pathname''' is used to specify a '''route to a file''' within the file system. | ||
− | A ''' | + | A pathname '''points''' to a file system location by '''following the directory tree hierarchy''' expressed in a string of characters in which path components, separated by a delimiting character, represent each directory. The '''delimiting character''' is most commonly the slash ("'''/'''").'' Reference: https://en.wikipedia.org/wiki/Path_(computing) |
− | + | The following table displays and defines '''commonly used directories''' (listed by directory pathname) for for ALL Unix / Linux Filesystems: | |
+ | [[Image:directory-structure-2.png|thumb|right|500px|'''Common directory pathnames'''<br>for for ALL Unix / Linux Filesystems.]]<table cellpadding="5"><tr><th style="border-bottom: 1px solid black;">Directory Pathname</th><th style="border-bottom: 1px solid black;">Purpose</th></tr><tr><td>'''/'''</td><td>Root directory (ancestor to all directories)</td></tr><tr><td>'''/home'''</td><td>Used to store users’ home directories | ||
+ | </td></tr><tr><td>'''/home/username'''</td><td>A '''<u>specific</u>''' User's Home Directory</td></tr><tr><td>'''/bin'''</td><td>Common system binaries (commands) </td></tr><tr><td>'''/usr/bin'''</td><td>Common utilities (commands) for users. </td></tr><tr><td>'''/usr/sbin'''</td><td>Common utilities for system administration </td></tr><tr><td>'''/etc'''</td><td>System administration files (eg. passwd)</td></tr><tr><td>'''/var'''</td><td>Dynamic files (log and mail files)</td></tr><tr><td>'''/tmp , /var/tmp'''</td><td>Temporary files for programs</td></tr><tr><td>'''/dev'''</td><td>Device driver files (terminals, printers, etc.) | ||
+ | </td></tr></table> | ||
− | + | When you log into your Matrix account, you are automatically directed to your '''home''' directory. This directory is where the user can store files, and create subdirectories to organize their files. | |
− | |||
+ | =INVESTIGATION 1: CREATING & MANAGING DIRECTORIES= | ||
+ | {{Admon/caution|This weekly tutorial must be completed by Friday in Week 3 by 11:59pm to obtain a grade of 2% towards this course.|}} | ||
− | + | In this investigation, you will learn how to '''create''', '''navigate''', '''list directory contents''' and '''remove''' directories in your Matrix account. | |
− | |||
− | |||
− | + | '''Directory File Naming Rules''' | |
− | + | Before you learn how to create directories, it is important to understand what represents an appropriate '''directory filename'''. | |
− | |||
− | + | Listed below are some common '''file-naming rules''': | |
− | |||
+ | * Unix/Linux characters are '''case sensitive'''. It is recommended to be consistent (e.g. use all lowercase letters) | ||
+ | * Adopt a '''consistent directory naming scheme''' (this will help you to navigate within your directory structure) | ||
+ | * Make your directory names '''meaningful''' | ||
+ | * '''Avoid non-alphanumeric characters''', as they may have a special meaning to the system that will make your work more difficult when changing to directories, etc. | ||
+ | * '''Avoid using spaces''' for directory names (consider periods, hyphens, and underscores instead) | ||
− | + | ===Part 1: Creating Directories === | |
− | + | [[Image:directory-structure-3.png|thumb|right|350px|'''Tree Diagram''' of Directory Structure to Create in your '''Home''' Directory (displayed in blue text).]] | |
+ | Creating subdirectories within your home directory makes it more '''efficient''' to save and access files on your Linux server. | ||
− | + | A comparison would be rooms in a '''house'''. If there were no rooms, just one large room in a 3,000 square foot house, it would be "messy" and difficult to locate items. Each '''room''' in a house is used to for a '''specific purpose''' to be more productive to perform a task such as a kitchen, bedroom, bathroom, etc. | |
− | + | You will be creating the following '''directory structure''' within your home directory (refer to diagram on the right side). | |
'''Perform the Following Steps:''' | '''Perform the Following Steps:''' | ||
− | + | '''NOTE:''' For several of the following commands, you will be using '''<u>your</u> Seneca username''' to replace the text:"'''your-seneca-id'''" in a pathname. | |
+ | For example, if your Seneca user ID was '''mkhan''' then you would display the pathname ''/home/your-seneca-id'' as: '''/home/mkhan''' | ||
+ | # '''Login''' to your matrix account (you should know how to do this from performing [https://wiki.cdot.senecacollege.ca/wiki/Tutorial_1:_Using_Your_Matrix_Server_Account#INVESTIGATION_1:_ACCESSING_YOUR_MATRIX_LINUX_ACCOUNT Tutorial 1 INVESTIGATION 1].<br><br> | ||
+ | # Issue a command to '''confirm''' that you are located in your home directory<br>(you should know how to do this from performing [https://wiki.cdot.senecacollege.ca/wiki/Tutorial_1:_Using_Your_Matrix_Server_Account#INVESTIGATION_2:_USING_THE_LINUX_SHELL Tutorial 1 INVESTIGATION 2]<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">mkdir /home/your-seneca-id/uli101xx</span><br>(remember: use <u>your</u> Seneca username instead of "your-seneca-id")<br><br>'''NOTE:''' You should always confirm that you have created a directory.<br>This can be done by issuing the '''ls''' command.<br><br>[[Image:directory-structure-4.png|thumb|right|350px|'''Creating''' and '''Confirming''' the Creation of a Directory.]] | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">ls /home/your-seneca-id/uli101xx</span><br><br>There are no contents that are contained in this newly-created directory; therefore, no contents appear. A useful option '''-d''' can be used to confirm that the actual <u>directory</u> has been created as opposed to viewing the contents of the directory.<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">ls -d /home/your-seneca-id/uli101xx</span><br><br>You should now see just the directory listed. You can also combine the '''-d''' and '''-l''' options to provide more detail regarding the newly-created directory.<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">ls -d -l /home/your-seneca-id/uli101xx</span><br><br>How can you confirm from the output of this command that the file uli101xx is a directory?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">ls -ld /home/your-seneca-id/uli101xx</span><br><br>Is the output from this command the same was the output from the previous command?<br>If so, what does this say about how to use multiple options for Linux commands?<br><br> | ||
+ | # Issue the following Linux command to create the '''acp100xx''' and '''xyz100xx''' directories:<br><span style="color:blue;font-weight:bold;font-family:courier;">mkdir /home/your-seneca-id/acp100xx /home/your-seneca-id/xyz100xx</span><br><br>'''NOTE:''' You can create multiple directories by issuing the '''mkdir''' command with <u>multiple arguments</u>.<br><br> | ||
+ | # Issue the following Linux command to confirm that those directories have been created:<br><span style="color:blue;font-weight:bold;font-family:courier;">ls -ld /home/your-seneca-id/acp100xx /home/your-seneca-id/xyz100xx</span><br><br>'''Using a FULL pathname starting from the root directory (i.e. /) requires is a LOT of typing!.<br>Since we are already located in our home directory, we don't have to start from<br>the root directory. This is called a "relative" pathname.'''<br><br> | ||
+ | # We will now create the subdirectories that are contained in the '''uli101xx''' directory.<br>Issue the following Linux command to move to the '''uli101xx''' directory using a '''relative''' pathname:<br><span style="color:blue;font-weight:bold;font-family:courier;">cd uli101xx</span><br><br> | ||
+ | # Issue a Linux command to confirm that your current location is in the ''uli101xx'' directory.<br>You should know how to issue this command from a previous tutorial.<br><br> | ||
+ | # Issue the following Linux command to create the directories called '''notes''', '''tutorials''' and '''samples''':<br><span style="color:blue;font-weight:bold;font-family:courier;">mkdir notes tutorials samples</span><br><br> | ||
+ | # Issue a Linux command to confirm that those directories have been created<br>(you should already know how to do this).<br><br>There are better ways to create the same directory structure without using the '''cd''' command.<br><br>Issuing the '''cd''' command '''<u>prior</u>''' to issuing other commands indicates to others that you are a novice or "'''newbie'''".<br>You can actually '''lose marks''' on quizzes or tests if you issue multiple Linux commands to performed tasks that can be performed<br>using a single Linux command with '''pathnames'''.<br><br> | ||
+ | # Issue the following Linux command to return to your home directory: <span style="color:blue;font-weight:bold;font-family:courier;">cd</span><br><br> | ||
+ | # Issue a Linux command to confirm that you are now located in your home directory.<br><br>Although we will teach you how to '''remove''' directories and their contents in another investigation,<br>let's remove the created directory structure' and '''recreate''' the same directory structure<br>using just <u>one</u> command using pathnames.<br><br> | ||
+ | # Issue the following Linux command to remove all of the directories that you have created:<br><span style="color:blue;font-weight:bold;font-family:courier;">rm -r uli101xx acp100xx xyz100xx</span><br><br> | ||
+ | # Issue a Linux command to confirm that the '''uli101xx''', '''acp100xx''' and '''xyz100xx''' directories have been removed.<br><br> | ||
+ | # Issue the following single Linux command to create the entire directory structure:<br><span style="color:blue;font-weight:bold;font-family:courier;">mkdir -p uli101xx/notes uli101xx/tutorials uli101xx/samples acp100xx xyz100xx</span><br><br>'''NOTE:''' The '''-p''' option allows "parent" directories to be automatically created first to then create their subdirectories.<br><br> | ||
+ | # Issue the following Linux command to confirm that all of the directories have been created:<br><span style="color:blue;font-weight:bold;font-family:courier;">ls -ld uli101xx/ uli101xx/notes uli101xx/tutorials uli101xx/samples acp100xx xyz100xx</span> | ||
<br><br> | <br><br> | ||
+ | '''Running a Shell Script to Check your Work''' | ||
+ | |||
+ | Although you are being asked to create the directory structure, you might have made some mistakes:<br>For Example:<br> | ||
+ | |||
+ | * Forgetting to create a directory. | ||
+ | * Making syntax errors (eg. spelling or mixing up character case) | ||
+ | * Not creating subdirectories within specified directories. | ||
+ | |||
+ | |||
+ | <table align="right"><tr valign="top"><td>[[Image:script-check-1.png|thumb|right|250px|If all checks pass, then user performed task correctly and can continue.]]</td><td>[[Image:script-check-2.png|thumb|right|450px|If there is a warning, then feedback is provided to user to correct and re-run checking script.]]</td></table> | ||
+ | To check for mistakes, a '''shell script''' has been created to check your work. If the checking shell script detects an '''error''', then it will provide feedback and offer constructive feedback on how to fix that problem so you can re-run the checking shell scripts until your work is correct. | ||
+ | |||
− | + | '''Perform the Following Steps:''' | |
+ | # Make certain that your current directory is '''your home directory'''.<br><br> | ||
+ | # Issue the following Linux command to run a checking script:<br><span style="color:blue;font-weight:bold;font-family:courier;">~uli101/week2-check-1</span><br><br> | ||
+ | # If you encounter errors, then view the feedback to make corrections, and then re-run the checking script. If you receive a congratulation message that there are no errors, then proceed to the next part. | ||
<br> | <br> | ||
− | |||
− | ===Part | + | ===Part 2: Viewing Directory Contents / Copying & Moving Directories=== |
− | + | ||
+ | Now that you have learned how to efficiently create your directory structure, you will now learn how to issue Linux commands<br>to '''view directory contents''' as well as '''copy''' and '''move''' directories. | ||
'''Perform the Following Steps:''' | '''Perform the Following Steps:''' | ||
+ | <table align="right"><tr valign="top"><td>[[Image:directory-structure-5.png|thumb|right|250px|Output of the '''tree''' command to display directory structure.]]</td><td>[[Image:directory-structure-6.png|thumb|right|250px|Output of the '''ls -R''' command to display directory structure.]]</td></table> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">tree</span><br><br>'''NOTE:''' You should see the directory structure that you created in the previous investigation. You can also issue the '''tree''' command using a directory pathname to display the directory structure for a specific scope.<br><br>You can also use the '''-R''' option for the '''ls''' command to display all directories and subdirectories for a specified directory path (referred to as a '''recursive directory listing''').<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">ls -lR </span><br><br>What directories do you see?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">ls -lR uli101xx</span><br><br>Note the differences between both of these commands (i.e. using and <u>not</u> using a pathname).<br><br>You can copy and move entire directories (and their contents) to other directories.<br><br><table align="right"><tr valign="top"><td>[[Image:directory-structure-7.png|thumb|right|250px|Output of the '''tree''' command to confirm copy of '''uli101xx''' directory (and contents) to the '''xyz100xx''' directory.]]</td><td>[[Image:directory-structure-8.png|thumb|right|300px|Output of the '''tree''' command to confirm movement of '''acp100 directory''' directory (and contents) to the '''xyz100xx''' diredtory.]]</td></tr></table> | ||
+ | # Issue the following Linux command:<br><span style="color:blue;font-weight:bold;font-family:courier;">cp -R uli101xx xyz100xx</span><br><br> | ||
+ | #Issue the following Linux command to display the directory structure of your home directory to confirm you copied the uli101xx directory:<br><span style="color:blue;font-weight:bold;font-family:courier;">tree </span><br><br><br><br><br><br> | ||
+ | # Issue the following Linux command:<br><span style="color:blue;font-weight:bold;font-family:courier;">mv acp100xx xyz100xx/uli101xx/tutorials</span><br><br> | ||
+ | #Issue the following Linux command to display the directory structure of your home directory to confirm you moved the acp100xx directory:<br><span style="color:blue;font-weight:bold;font-family:courier;">tree </span><br><br>Let's run a checking script to see if you moved and copied the directories correctly.<br><br> | ||
+ | # Make certain that your current directory is '''your home directory'''.<br><br> | ||
+ | # Issue the following Linux command run checking script:<br><span style="color:blue;font-weight:bold;font-family:courier;">~uli101/week2-check-2</span><br><br> | ||
+ | # If you encounter errors. make corrections and re-run the checking script until you receive a congratulations message, and proceed to the next investigation.<br><br> | ||
− | + | ===Part 3: Removing Directories === | |
− | + | In this investigation, we will learn how to '''safely remove''' directories and their contents. | |
− | |||
'''Perform the Following Steps:''' | '''Perform the Following Steps:''' | ||
− | # | + | # Confirm that you are located in your home directory.<br><br>The '''rmdir''' command is used to remove <u>empty</u> directories.<br><br> |
+ | # Issue the following Linux command to remove the empty directory called '''tutorials''': <span style="color:blue;font-weight:bold;font-family:courier;">rmdir uli101xx/tutorials</span><br><br> | ||
+ | # Issue a command to confirm that you removed the '''tutorials''' directory.<br><br> | ||
+ | # Issue the following Linux command to remove the empty directory called '''uli101xx''': <span style="color:blue;font-weight:bold;font-family:courier;">rmdir uli101xx</span><br><br>NOTE: You should get an '''error message''', since the '''uli101xx''' directory is '''NOT''' empty.<br><br>To remove non-empty directories, you can use the '''rm -r''' command.<br>The '''-r''' option stands for recursive, which can travel down the directory paths and their contents.<br><br> | ||
+ | # Issue the following Linux command to remove the '''uli101xx''' directory and its contents: <span style="color:blue;font-weight:bold;font-family:courier;">rm -r uli101xx</span><br><br> | ||
+ | # Issue the '''tree''' command to confirm that the uli101xx directory (contained in your home directory) and its contents have been removed.<br><br>'''NOTE:''' To <u>safely</u> remove non-empty directories, you can add the '''-i''' option which will prompt the user if they wish to remove contents as it your travel recursively down a directory to remove directories and their contents.<br><br> | ||
+ | # Issue the following Linux command (entering "y" when prompted): <span style="color:blue;font-weight:bold;font-family:courier;">rm -ri xyz100xx</span><br><br>'''NOTE:''' You should have removed all directories that you have created.<br><br>Let's run a checking script to confirm that you have correctly removed all of those directories.<br><br> | ||
+ | # Issue the '''tree''' command to confirm that all of those recently created directories have been removed.<br><br> | ||
+ | # Issue the following Linux command to run a checking script to confirm removal of those directories:<br><span style="color:blue;font-weight:bold;font-family:courier;">~uli101/week2-check-3</span><br><br> | ||
+ | # If you encounter errors, make corrections and re-run the checking script until you receive a congratulations message, and proceed to the next INVESTIGATION.<br><br> | ||
+ | =INVESTIGATION 2: MANAGING TEXT FILES= | ||
+ | <table align="right"><tr valign="top"><td>[[Image:nano-text-editor-1.png|thumb|right|250px|The '''Nano Text Editor''' is Easy to Operate for Novice Users.]]</td><td>[[Image:vi-text-editor-1.png|thumb|right|300px|The '''vi Text Editor''', although taking longer to master, has outstanding features and allow the user to be more productive with editing text files.]]</td></tr></table> | ||
+ | Since IT students will be working in the Unix / Linux command line environment, it is useful to learn a least two common command-line '''text editors'''. | ||
− | + | Although '''programming students''' can use '''graphical IDE's''' to code and compile programs, they can '''create source code''' using a text editor and '''compile their source code''' in the '''Matrix''' server to generate executable programs (without having to transfer them for compilation or execution). | |
− | + | '''Networking and Tech Support students''' can use a text editor to '''edit configuration files'''. These students in upper grades will become familiar with the process of installing, configuring, and running network services and text editors are an important tools to help setup but also "tweak" or make '''periodic changes in networking services configuration'''. | |
− | + | The two most readily-available command line text editors in Linux are '''Nano''' and '''vi'''. The Nano text editor would seem like an easier-to-use text editor, but vi (although taking longer to learn) has outstanding features and allow the user to be more productive with editing text files. | |
− | |||
− | : | + | ===Part 1: Creating Text Files Using The Nano Text Editor=== |
− | |||
− | |||
− | |||
− | |||
− | + | You will now learn basic editing skills using the '''Nano''' text editor including '''creating''', '''editing''', and '''saving''' text files. | |
− | |||
− | |||
'''Perform the Following Steps:''' | '''Perform the Following Steps:''' | ||
− | # x<br><br> | + | # Make certain that you are located in your home directory.<br><br>[[Image:directory-structure-10.png|right|150px|thumb|]] |
+ | # '''Create''' the following directory structure (displayed on the right side) by issuing a '''single Linux command'''<br>(You should know how to do this from the previous INVESTIGATION).<br><br> | ||
+ | # Issue a Linux command to check that you correctly created those directories.<br><br> | ||
+ | # Issue the following Linux command to edit a text file called '''mytext.txt''' in the '''linux/practice''' directory:<br><span style="color:blue;font-weight:bold;font-family:courier;">nano textedit/practice/mytext.txt</span><br><br>'''NOTE:''' When using the '''Nano''' text editor, you are placed in '''INPUT''' mode, so you can enter text immediately.<br><br>[[Image:nano-text-editor-2.png|right|400px|thumb|Enter the following text that appears in this diagram.]] | ||
+ | # Enter the lines shown in the other diagram of the nano text editor on the right side.<br><br>'''NOTE:''' Refer to the table below for a list of common '''Nano''' navigation & editing commands:<br><br><table cellpadding="5"><tr><th style="border-bottom: 1px solid black;">Key(s)</th><th style="border-bottom: 1px solid black;">Purpose</th></tr><tr valign="top"><td style="font-family:courier">'''<ctrl><SPACEBAR>''',<br>'''<esc><6>'''</td><td>Move forward/backward one word</td></tr><tr valign="top"><td style="font-family:courier">'''<ctrl><a>''',<br> '''<ctrl><e>'''</td><td>Move to beginning/end of line</td></tr><tr><td style="font-family:courier">'''<ctrl><k>'''</td><td>Cut line</td></tr><tr><td style="font-family:courier">'''<esc>6'''</td><td>Copy Line</td></tr><tr><td style="font-family:courier">'''<ctrl><u>'''</td><td>Paste Cut/Copied Text</td></tr><tr><td style="font-family:courier">'''<ctrl><g>'''</td><td>Display help screen (ctrl-x to exit help screen)</td></tr><tr><td style="font-family:courier">'''<ctrl><x>'''</td><td>Save editing changes and exit</td></tr></table><br> | ||
+ | # Referring to the table above, practice navigating and editing your entered lines for practice.<br><br> | ||
+ | # To '''save''' your editing session, press: <span style="color:blue;font-weight:bold;font-family:courier;"><ctrl>x</span><br><br> | ||
+ | # You will be prompted to modify your file: type the letter <span style="font-family:courier;color:blue;font-weight:bold">y</span> for '''yes'''.<br><br> | ||
+ | # The name of the file will be displayed, Press <span style="color:blue;font-weight:bold;font-family:courier;">ENTER</span>.to save editing changes for that file name.<br><br>'''NOTE:''' This prompt for file name allows you to change the name of the file if you wish.<br>By pressing '''ENTER''', it will accept the default filename.<br><br> | ||
+ | # Perform some more editing operations based on the editing chart above.<br><br> | ||
+ | # '''Save''' your editing session and '''exit''' your text editor.<br><br> | ||
+ | ===Part 2: Creating Text Files Using The vi Text Editor=== | ||
+ | [[Image:vi-screen.png|right|300px|thumb|Using the '''vi''' text editor.]] | ||
+ | You will now learn basic editing skills using the '''vi''' ('''vim''') text editor including '''creating''', '''editing''', and '''saving''' text files. | ||
− | + | The '''vi''' ('''vim''') text editor (although taking longer to learn) has outstanding features to increase coding productivity. | |
− | + | The major different between nano and vi is that '''vi starts in COMMAND LINE mode'''. You need to issue letter commands to enter text. Also you can press colon “: ” in COMMAND mode to enter more complex commands. | |
− | + | '''Perform the Following Steps:''' | |
− | '''Perform the | ||
− | # x | + | # Make certain that you are located in your home directory.<br><br> |
+ | # Issue the following Linux command to edit a text file called '''othertext.txt''' in the '''linux/practice''' directory:<br><span style="color:blue;font-weight:bold;font-family:courier;">vi textedit/practice/othertext.txt</span><br><br>'''NOTE:''' When using the '''vi''' text editor, you are placed in '''COMMAND''' mode,<br>so you need to issue a command to switch to ''INPUT'' mode.<br><br>[[Image:vi-text-editor-a.png|right|200px|thumb|Enter the following text that appears in this diagram.]] | ||
+ | # Type the following key to enter ''INPUT'' mode: <span style="color:blue;font-weight:bold;font-family:courier;">i</span><br><br>You should notice you are in ''INSERT'' mode by seeing the notification '''-- INSERT --'''<br>at the bottom left-hand side of the application screen.<br><br> | ||
+ | # Enter the line shown in the other diagram of the vi text editor on the right side.<br><br> | ||
+ | # While on the first line, press the following key to enter ''COMMAND'' mode: <span style="color:blue;font-weight:bold;font-family:courier;">ESC</span><br><br>You should see the ''-- INSERT --'' notification disappear indicating that you are in ''COMMAND'' mode.<br><br>'''NOTE:''' Refer to the table below for a list of<br>the most common '''vi''' ('''vim''') navigation & editing commands:<br><br><table cellpadding="5"><tr><th style="border-bottom: 1px solid black;">Key(s)</th><th style="border-bottom: 1px solid black;">Purpose</th></tr><tr><td style="font-family:courier">'''i'''</td><td>Enter '''INPUT''' mode</td></tr><tr><td style="font-family:courier">'''<esc>'''</td><td>Return to '''COMMAND''' MODE</td></tr><tr><td style="font-family:courier">'''x'''</td><td>Delete text to the right in COMMAND mode</td></tr><tr><td style="font-family:courier">'''W'''</td><td>Move forward one word in COMMAND mode</td></tr><tr><td style="font-family:courier">'''B'''</td><td>Move back one word in COMMAND mode</td></tr><tr><td style="font-family:courier">'''dd'''</td><td>Cut line in COMMAND mode</td></tr><tr><td style="font-family:courier">'''yy'''</td><td>Copy Line in COMMAND mode</td></tr><tr><td style="font-family:courier">'''p / P'''</td><td>Paste Cut/Copied Text below/above line in COMMAND mode</td></tr><tr><td style="font-family:courier">'''u'''</td><td>Undo previous editing command</td></tr><tr><td style="font-family:courier">''':help'''</td><td>Display help screen in COMMAND mode</td></tr><tr><td style="font-family:courier">''':x'''</td><td>Save editing changes and exit (in COMMAND mode)</td></tr><tr><td style="font-family:courier">''':w name'''</td><td>Save editing changes to "name" in COMMAND mode</td></tr><tr><td style="font-family:courier">''':q!'''</td><td>Abort editing session and exit (in COMMAND mode)</td></tr></table><br>Once you can get used to working in INPUT and COMMAND mode, it is easier to perform<br>text editing operations in '''vi''' via ''COMMAND'' mode as opposed to nano!<br><br> | ||
+ | # Type the following keys to <u>copy</u> the current line: <span style="color:blue;font-weight:bold;font-family:courier;">yy</span><br><br> | ||
+ | # Type the following key to <u>paste</u> the copied line: <span style="color:blue;font-weight:bold;font-family:courier;">p</span><br><br>What did you notice?<br><br> | ||
+ | # Type the following keys: <span style="color:blue;font-weight:bold;font-family:courier;">u</span><br><br>What did you notice?<br><br> | ||
+ | # Type the following keys: <span style="color:blue;font-weight:bold;font-family:courier;">3p</span><br><br>What did you notice?<br><br>[[Image:vi-text-editor-b.png|right|200px|thumb|Use a combination of '''arrow''' keys and the '''w''' and '''b''' keys while in COMMAND mode to change the correct words for the '''third''' and '''fourth''' lines.]] | ||
+ | # Use the up or down '''arrow''' keys to move to the second line.<br><br> | ||
+ | # Type either the '''w''' and/or '''b''' keys to move the cursor to the beginning of the word: '''first'''.<br><br> | ||
+ | # Type the '''x''' keys to remove the word called '''first'''.<br><br> | ||
+ | # Type the '''i''' key to enter INSERT mode.<br><br> | ||
+ | # Type the word: '''second'''<br><br> | ||
+ | # Press the '''ESC''' key to enter COMMAND mode.<br><br> | ||
+ | # Repeat steps '''11''' to '''16''' to change the words for line number for lines '''3''' and '''4'''.<br><br> | ||
+ | # Move to the 4th line (i.e. last line).<br><br> | ||
+ | # Type the following keys: <span style="color:blue;font-weight:bold;font-family:courier;">dd</span><br><br>What did you notice?<br><br>Let's save editing changes and exit the vi text editor.<br><br> | ||
+ | # Type the following keys: <span style="color:blue;font-weight:bold;font-family:courier;">:x</span> and press '''ENTER'''<br><br>What did you notice?<br><br> | ||
+ | # Issue the same command that you performed in '''Step #2''' to confirm that you had properly edited that file.<br><br> | ||
+ | # '''Save''' and '''exit''' your vi editing session.<br><br>[[Image:vi-text-editor-2.png|right|250px|thumb|The online vi-tutorial provides users "hands-on" experience of using the vi text editor.]]An '''online tutorial''' has been created to give you "hands-on" experience on how to use vi text editor. It is <u>recommended</u> that you run this online tutorial in your Matrix account to learn how to create and edit text files with the vi text editor.<br><br> | ||
+ | # Issue the following to run the vi online tutorial:<br><span style="color:blue;font-weight:bold;font-family:courier;">/home/jason.carman/vi-tutorial<br><br> | ||
+ | # In the tutorial menu, select the first menu item labelled "'''USING THE VI TEXT EDITOR'''"<br><br> | ||
+ | #Read and follow the instructions in the tutorial. Eventually, it will display a '''simulated''' vi environment<br>and will provide you with "'''hands-on'''" practice using the vi text editor. As far as this author is aware,<br>there is NO "hands-on" tutorial for the nano text editor in this particular format.<br><br> | ||
+ | # When you have completed that section, you will be returned to the main menu.<br>If you want to get extra practice, you can select the menu item labelled "'''REVIEW EXERCISE'''".<br><br> | ||
+ | # When you want to exit the tutorial, select the menu option to exit the tutorial.<br><br> | ||
+ | : It is recommended to try both text editors, and choose the text editor that you feel that is easier to use.<br><br> | ||
+ | ===Part 3: Manage & Manipulate Text File Content=== | ||
+ | We conclude this tutorial by learning to '''manage''', '''view''' or '''manipulate the <u>display</u>''' of text files. This is HIGHLY ADVISED in case you only want to view contents and '''NOT''' edit text file contents which can cause accidental erasure of data. | ||
− | <br><br> | + | '''Perform the Following Steps:''' |
+ | |||
+ | # Make certain that you are located in your home directory.<br><br> | ||
+ | # Refer to the following table of '''Text File Management Commands:'''<br><br><table cellpadding="5"><tr><th style="border-bottom: 1px solid black;" width="20%">Linux Command</th><th style="border-bottom: 1px solid black;">Purpose</th></tr><tr><td style="font-family:courier">'''touch'''</td><td>Create empty file(s) / Updates Existing File's Date/Time Stamp</td></tr><tr><td style="font-family:courier">'''cat'''</td><td>Display text file's contents without editing (small files)</td></tr><tr><td style="font-family:courier">'''more , less'''</td><td>Display / Navigate within large text files without editing</td></tr><tr><td style="font-family:courier">'''cp'''</td><td>Copy text file(s)</td></tr><tr><td style="font-family:courier">'''mv'''</td><td>Move / Rename text files</td></tr><tr><td style="font-family:courier">'''rm'''</td><td>Remove text file(s)</td></tr><tr valign="top"><td style="font-family:courier">'''sort'''</td><td>Sorts (rearranges) order of file contents when displayed. Content is sorted alphabetically by default. The '''-n'''''Italic text'' option sorts numerically, '''-r''' performs a reverse sort</td></tr><tr valign="top"><td style="font-family:courier">'''head''' , '''tail'''</td><td>Displays the first / last 10 lines of a text file by default. An option using a value will display the number of lines (e.g. <span style="font-family:courier">head -5 filename</span> will display first 5 lines, <span style="font-family:courier">tail -5 filename</span> will display last 5 lines).</td></tr><tr valign="top"><td style="font-family:courier">'''grep'''</td><td>Displays file contents that match a pattern</td></tr><tr valign="top"><td style="font-family:courier">'''uniq'''</td><td>Displays identical consecutive lines only once</td></tr><tr valign="top"><td style="font-family:courier">'''diff''' file1 file2</td><td>Displays differences between 2 files</td></tr><tr><td style="font-family:courier">'''file'''</td><td>Gives info about the contents of the file (e.g. file with no extention)</td></tr><tr><td style="font-family:courier">'''find'''</td><td>To find files matching specified characteristics: <!-- <table><tr><td width="30%">'''<span style="font-family:courier">find . -name "file*"</span>'''</td><td>List pathname of any filenames beginning with "file",<br>from the current directory and any subdirectories</td></tr><tr valign="top"><td>'''<span style="font-family:courier">find . -size +50k</span>'''</td><td>List pathname of any files larger than 50 kb, from the current directory and any subdirectories</td></tr><tr valign="top"><td>'''<span style="font-family:courier">find . -mmin -5</span>''' </td><td>List files modified less than 5 minutes ago</td></tr><tr> valign="top"><td>'''<span style="font-family:courier">find -P .</span>'''</td><td>Lists file pathnames in the current directory</td></tr></table> --> </td></tr></table><br> | ||
+ | # Issue the following Linux command to create three <u>empty</u> text files in your current directory:<br><span style="color:blue;font-weight:bold;font-family:courier;">touch a.txt b.txt c.txt</span><br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">ls -l a.txt b.txt c.txt</span><br><br>Check the size in the detailed listing to confirm that these newly-created files are empty.<br><br>[[Image:vi-screen-40.png|right|300px|thumb|Nano text editor containing numbers '''1 to 40'''<br>on separate lines.]] | ||
+ | # Use the '''nano''' text editor to edit the empty file called '''a.txt'''. <br><br>Type the number "'''1'''" and press '''ENTER'''. On the second line, type the number "'''2'''" and press '''ENTER'''.<br>Continue entering increasing number values until you reach the number '''40''' on line 40<br>(refer to the diagram on the right).<br><br> | ||
+ | # '''Save''' and '''exit''' your editing session.<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">cat a.txt</span><br><br>Can you see all of the contents?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">more a.txt</span><br><br>'''NOTE:''' The '''more''' command uses the same navigation keys as with the '''man''' command<br>(refer to week 1 notes for reference). Try using keys that you used to navigate the man pages.<br><br>What is the advantage of using the more command?<br><br> | ||
+ | # Type the letter "<span style="color:blue;font-weight:bold;font-family:courier;">q</span>" to exit the ''more'' command.<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">less a.txt</span><br><br>Is there any difference between the '''more''' and '''less''' commands?<br>(again press '''q''' to quit)<br><br> | ||
+ | # issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">sort a.txt</span><br><br>Why does the output not look what you expected? Why?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">sort -n a.txt</span><br><br>Try the same command using both the '''-n''' and '''-r''' options to see what happens.<br><br> | ||
+ | # issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">head a.txt</span><br><br>What is the output from this command display?<br><br> | ||
+ | # issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">head -7 a.txt</span><br><br>What is the output from this command display?<br><br> | ||
+ | # issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">tail a.txt</span><br><br>What is the output from this command display?<br>How would you issue this command to display only the '''last line''' contained in that file?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">grep 2 a.txt</span><br><br>What type of output appear? Why did these lines appear (what do they all have in common)?<br><br>[[Image:end-of-line.png|right|200px|thumb|Edit the '''a.txt''' file and add to the bottom 5 new lines each consisting of the <u>same</u> text: "'''end of line'''".]] | ||
+ | # Edit the '''a.txt''' file and add to the bottom 5 new lines each consisting<br>of the <u>same</u> text: "'''end of line'''" (refer to diagram on right).<br><br> | ||
+ | # '''Save''' your editing session and '''exit''' your text editor.<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">uniq a.txt</span><br><br>What do you notice happened to those newly created lines?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">cp a.txt a.txt.bk</span><br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">cp a.txt b.txt</span><br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">mv a.txt aa.txt</span><br><br> | ||
+ | # Issue a Linux command to view the directory contents.<br><br>What happened to the file called '''a.txt'''? Why?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">file b.txt</span><br><br>What sort of information did it provide?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">diff aa.txt b.txt</span><br><br>Was there any output? If not, why?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">diff aa.txt c.txt</span><br><br> What do you think is the purpose of this output?<br><br> | ||
+ | # Issue the following Linux command: <span style="color:blue;font-weight:bold;font-family:courier;">find -P . </span><br><br>What is the output of this command?<br><br> | ||
+ | # Issue the following Linux command:<br><span style="color:blue;font-weight:bold;font-family:courier;">rm aa.txt b.txt a.txt.bk c.txt</span><br><br> | ||
+ | # Issue the '''ls''' command to verify that these files have been removed.<br><br> | ||
+ | # Complete the '''LINUX PRACTICE QUESTIONS''' to get additional practice. | ||
= LINUX PRACTICE QUESTIONS = | = LINUX PRACTICE QUESTIONS = | ||
Line 177: | Line 302: | ||
simulate a quiz: | simulate a quiz: | ||
− | https:// | + | * https://wiki.cdot.senecacollege.ca/uli101/files/uli101_week2_practice.docx |
Your instructor may take-up these questions during class. It is up to the student to attend classes in order to obtain the answers to the following questions. Your instructor will NOT provide these answers in any other form (eg. e-mail, etc). | Your instructor may take-up these questions during class. It is up to the student to attend classes in order to obtain the answers to the following questions. Your instructor will NOT provide these answers in any other form (eg. e-mail, etc). | ||
+ | '''Review Questions:''' | ||
+ | |||
+ | For each of the following questions, use a pathname starting from the '''root''' directory (i.e. “/”). | ||
+ | |||
+ | [[Image:tree-diagram.png|right|350px|thumb|]] | ||
+ | # Write a single Linux command to create the directory structure starting from your home directory from the diagram displayed on the right. | ||
+ | # Write a Linux command to display a detailed listing of '''history''' directory.<br>How would this command differ if you wanted to also view hidden files as well? | ||
+ | # Write a Linux command to change to the '''project''' directory.<br>What command would you issue to return to your home directory? | ||
+ | # Write a Linux command to copy the '''project''' directory and its contents to the '''history''' directory. | ||
+ | # Write a Linux command to move the directory called '''directories''' to the '''history''' directory. | ||
+ | # Write a Linux command to remove both directories named '''1''' and '''2'''. | ||
+ | # Write a Linux command to remove the '''concepts''' directory and its contents. | ||
+ | # Write a Linux command to remove the '''concepts''' directory and prompt the user if they want to remove this directory’s contents. | ||
+ | # Write a single Linux command to create the following empty files in the concepts directory: | ||
+ | #* '''myfile.txt''' | ||
+ | #* '''yourfile.txt''' | ||
+ | #* '''thefile.txt''' | ||
+ | # Write a Linux command to view the contents of the myfile.txt text file to prove it is empty. What is the difference between the commands: '''cat''', '''more''' and '''less'''? | ||
+ | # Write a Linux command to sort the contents of a file called '''practice/customers.txt''' | ||
+ | # Write a Linux command to display the first 4 lines of a file called '''practice/customers.txt''' | ||
+ | # Write a Linux command to display the last line of a file called '''practice/customers.txt''' | ||
+ | # Write a Linux command to match a line containing the pattern '''Linux''' in a file called '''practice/customers.txt''' | ||
+ | # Write a Linux command to display unique occurrences of consecutive lines in a file called '''practice/customers.txt''' | ||
+ | # Create a '''table''' listing each Linux command, useful options that are displayed near the top of this tutorial labelled: '''Tutorial Reference Material''' | ||
+ | |||
+ | _________________________________________________________________________________ | ||
+ | |||
+ | Author: Murray Saul | ||
− | + | License: LGPL version 3 | |
+ | Link: https://www.gnu.org/licenses/lgpl.html | ||
− | + | _________________________________________________________________________________ | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
[[Category:ULI101]] | [[Category:ULI101]] |
Latest revision as of 19:34, 4 September 2023
Contents
UNIX / LINUX FILE MANAGEMENT CONCEPTS
Main Objectives of this Practice Tutorial
- Understand the purpose of directories and directory pathnames.
- Use common Unix / Linux commands to perform directory management tasks.
- Use Text Editors to create and modify text files
- Use Common Unix / Linux commands to manage and manipulate text files.
Tutorial Reference Material
Course Notes |
Linux Command/Shortcut Reference |
YouTube Videos | |
Slides:Tutorials:
|
File Management: | Text Editors / File Content: |
Brauer Instructional Videos: |
KEY CONCEPTS
Unix / Linux Directories
To better organize files (eg. text, images, documents, spreadsheets, programs) within your Matrix account, they should be stored in directories. To further organize many files, directories
may contain sub-directories.
The Unix / Linux file system is hierarchical, like other operating systems such as Windows, macOS, etc. In Unix / Linux (as opposed to Windows), there are no drive letters (such as C:, or D:).
All files and directories appear under a single ancestor directory called the "root directory".
Learning how to issue Linux commands for navigating and manipulating directory and files within the the Linux filesystem are essential skills for Linux users and Linux system administrators (i.e. sysadmins).
In the Linux (Unix) OS, the "root directory" / is the starting directory, and other "child directories", "grandchild directories", etc. can be created as required. The hierarchical structure resembles an "upside-down tree".
There is actually a command called tree
that displays a "directory tree diagram"!
Directory Pathnames
A pathname is used to specify a route to a file within the file system.
A pathname points to a file system location by following the directory tree hierarchy expressed in a string of characters in which path components, separated by a delimiting character, represent each directory. The delimiting character is most commonly the slash ("/"). Reference: https://en.wikipedia.org/wiki/Path_(computing)
The following table displays and defines commonly used directories (listed by directory pathname) for for ALL Unix / Linux Filesystems:
Directory Pathname | Purpose |
---|---|
/ | Root directory (ancestor to all directories) |
/home | Used to store users’ home directories |
/home/username | A specific User's Home Directory |
/bin | Common system binaries (commands) |
/usr/bin | Common utilities (commands) for users. |
/usr/sbin | Common utilities for system administration |
/etc | System administration files (eg. passwd) |
/var | Dynamic files (log and mail files) |
/tmp , /var/tmp | Temporary files for programs |
/dev | Device driver files (terminals, printers, etc.) |
When you log into your Matrix account, you are automatically directed to your home directory. This directory is where the user can store files, and create subdirectories to organize their files.
INVESTIGATION 1: CREATING & MANAGING DIRECTORIES
In this investigation, you will learn how to create, navigate, list directory contents and remove directories in your Matrix account.
Directory File Naming Rules
Before you learn how to create directories, it is important to understand what represents an appropriate directory filename.
Listed below are some common file-naming rules:
- Unix/Linux characters are case sensitive. It is recommended to be consistent (e.g. use all lowercase letters)
- Adopt a consistent directory naming scheme (this will help you to navigate within your directory structure)
- Make your directory names meaningful
- Avoid non-alphanumeric characters, as they may have a special meaning to the system that will make your work more difficult when changing to directories, etc.
- Avoid using spaces for directory names (consider periods, hyphens, and underscores instead)
Part 1: Creating Directories
Creating subdirectories within your home directory makes it more efficient to save and access files on your Linux server.
A comparison would be rooms in a house. If there were no rooms, just one large room in a 3,000 square foot house, it would be "messy" and difficult to locate items. Each room in a house is used to for a specific purpose to be more productive to perform a task such as a kitchen, bedroom, bathroom, etc.
You will be creating the following directory structure within your home directory (refer to diagram on the right side).
Perform the Following Steps:
NOTE: For several of the following commands, you will be using your Seneca username to replace the text:"your-seneca-id" in a pathname.
For example, if your Seneca user ID was mkhan then you would display the pathname /home/your-seneca-id as: /home/mkhan
- Login to your matrix account (you should know how to do this from performing Tutorial 1 INVESTIGATION 1.
- Issue a command to confirm that you are located in your home directory
(you should know how to do this from performing Tutorial 1 INVESTIGATION 2 - Issue the following Linux command: mkdir /home/your-seneca-id/uli101xx
(remember: use your Seneca username instead of "your-seneca-id")
NOTE: You should always confirm that you have created a directory.
This can be done by issuing the ls command. - Issue the following Linux command: ls /home/your-seneca-id/uli101xx
There are no contents that are contained in this newly-created directory; therefore, no contents appear. A useful option -d can be used to confirm that the actual directory has been created as opposed to viewing the contents of the directory. - Issue the following Linux command: ls -d /home/your-seneca-id/uli101xx
You should now see just the directory listed. You can also combine the -d and -l options to provide more detail regarding the newly-created directory. - Issue the following Linux command: ls -d -l /home/your-seneca-id/uli101xx
How can you confirm from the output of this command that the file uli101xx is a directory? - Issue the following Linux command: ls -ld /home/your-seneca-id/uli101xx
Is the output from this command the same was the output from the previous command?
If so, what does this say about how to use multiple options for Linux commands? - Issue the following Linux command to create the acp100xx and xyz100xx directories:
mkdir /home/your-seneca-id/acp100xx /home/your-seneca-id/xyz100xx
NOTE: You can create multiple directories by issuing the mkdir command with multiple arguments. - Issue the following Linux command to confirm that those directories have been created:
ls -ld /home/your-seneca-id/acp100xx /home/your-seneca-id/xyz100xx
Using a FULL pathname starting from the root directory (i.e. /) requires is a LOT of typing!.
Since we are already located in our home directory, we don't have to start from
the root directory. This is called a "relative" pathname. - We will now create the subdirectories that are contained in the uli101xx directory.
Issue the following Linux command to move to the uli101xx directory using a relative pathname:
cd uli101xx - Issue a Linux command to confirm that your current location is in the uli101xx directory.
You should know how to issue this command from a previous tutorial. - Issue the following Linux command to create the directories called notes, tutorials and samples:
mkdir notes tutorials samples - Issue a Linux command to confirm that those directories have been created
(you should already know how to do this).
There are better ways to create the same directory structure without using the cd command.
Issuing the cd command prior to issuing other commands indicates to others that you are a novice or "newbie".
You can actually lose marks on quizzes or tests if you issue multiple Linux commands to performed tasks that can be performed
using a single Linux command with pathnames. - Issue the following Linux command to return to your home directory: cd
- Issue a Linux command to confirm that you are now located in your home directory.
Although we will teach you how to remove directories and their contents in another investigation,
let's remove the created directory structure' and recreate the same directory structure
using just one command using pathnames. - Issue the following Linux command to remove all of the directories that you have created:
rm -r uli101xx acp100xx xyz100xx - Issue a Linux command to confirm that the uli101xx, acp100xx and xyz100xx directories have been removed.
- Issue the following single Linux command to create the entire directory structure:
mkdir -p uli101xx/notes uli101xx/tutorials uli101xx/samples acp100xx xyz100xx
NOTE: The -p option allows "parent" directories to be automatically created first to then create their subdirectories. - Issue the following Linux command to confirm that all of the directories have been created:
ls -ld uli101xx/ uli101xx/notes uli101xx/tutorials uli101xx/samples acp100xx xyz100xx
Running a Shell Script to Check your Work
Although you are being asked to create the directory structure, you might have made some mistakes:
For Example:
- Forgetting to create a directory.
- Making syntax errors (eg. spelling or mixing up character case)
- Not creating subdirectories within specified directories.
To check for mistakes, a shell script has been created to check your work. If the checking shell script detects an error, then it will provide feedback and offer constructive feedback on how to fix that problem so you can re-run the checking shell scripts until your work is correct.
Perform the Following Steps:
- Make certain that your current directory is your home directory.
- Issue the following Linux command to run a checking script:
~uli101/week2-check-1 - If you encounter errors, then view the feedback to make corrections, and then re-run the checking script. If you receive a congratulation message that there are no errors, then proceed to the next part.
Part 2: Viewing Directory Contents / Copying & Moving Directories
Now that you have learned how to efficiently create your directory structure, you will now learn how to issue Linux commands
to view directory contents as well as copy and move directories.
Perform the Following Steps:
- Issue the following Linux command: tree
NOTE: You should see the directory structure that you created in the previous investigation. You can also issue the tree command using a directory pathname to display the directory structure for a specific scope.
You can also use the -R option for the ls command to display all directories and subdirectories for a specified directory path (referred to as a recursive directory listing). - Issue the following Linux command: ls -lR
What directories do you see? - Issue the following Linux command: ls -lR uli101xx
Note the differences between both of these commands (i.e. using and not using a pathname).
You can copy and move entire directories (and their contents) to other directories. - Issue the following Linux command:
cp -R uli101xx xyz100xx - Issue the following Linux command to display the directory structure of your home directory to confirm you copied the uli101xx directory:
tree - Issue the following Linux command:
mv acp100xx xyz100xx/uli101xx/tutorials - Issue the following Linux command to display the directory structure of your home directory to confirm you moved the acp100xx directory:
tree
Let's run a checking script to see if you moved and copied the directories correctly. - Make certain that your current directory is your home directory.
- Issue the following Linux command run checking script:
~uli101/week2-check-2 - If you encounter errors. make corrections and re-run the checking script until you receive a congratulations message, and proceed to the next investigation.
Part 3: Removing Directories
In this investigation, we will learn how to safely remove directories and their contents.
Perform the Following Steps:
- Confirm that you are located in your home directory.
The rmdir command is used to remove empty directories. - Issue the following Linux command to remove the empty directory called tutorials: rmdir uli101xx/tutorials
- Issue a command to confirm that you removed the tutorials directory.
- Issue the following Linux command to remove the empty directory called uli101xx: rmdir uli101xx
NOTE: You should get an error message, since the uli101xx directory is NOT empty.
To remove non-empty directories, you can use the rm -r command.
The -r option stands for recursive, which can travel down the directory paths and their contents. - Issue the following Linux command to remove the uli101xx directory and its contents: rm -r uli101xx
- Issue the tree command to confirm that the uli101xx directory (contained in your home directory) and its contents have been removed.
NOTE: To safely remove non-empty directories, you can add the -i option which will prompt the user if they wish to remove contents as it your travel recursively down a directory to remove directories and their contents. - Issue the following Linux command (entering "y" when prompted): rm -ri xyz100xx
NOTE: You should have removed all directories that you have created.
Let's run a checking script to confirm that you have correctly removed all of those directories. - Issue the tree command to confirm that all of those recently created directories have been removed.
- Issue the following Linux command to run a checking script to confirm removal of those directories:
~uli101/week2-check-3 - If you encounter errors, make corrections and re-run the checking script until you receive a congratulations message, and proceed to the next INVESTIGATION.
INVESTIGATION 2: MANAGING TEXT FILES
Since IT students will be working in the Unix / Linux command line environment, it is useful to learn a least two common command-line text editors.
Although programming students can use graphical IDE's to code and compile programs, they can create source code using a text editor and compile their source code in the Matrix server to generate executable programs (without having to transfer them for compilation or execution).
Networking and Tech Support students can use a text editor to edit configuration files. These students in upper grades will become familiar with the process of installing, configuring, and running network services and text editors are an important tools to help setup but also "tweak" or make periodic changes in networking services configuration.
The two most readily-available command line text editors in Linux are Nano and vi. The Nano text editor would seem like an easier-to-use text editor, but vi (although taking longer to learn) has outstanding features and allow the user to be more productive with editing text files.
Part 1: Creating Text Files Using The Nano Text Editor
You will now learn basic editing skills using the Nano text editor including creating, editing, and saving text files.
Perform the Following Steps:
- Make certain that you are located in your home directory.
- Create the following directory structure (displayed on the right side) by issuing a single Linux command
(You should know how to do this from the previous INVESTIGATION). - Issue a Linux command to check that you correctly created those directories.
- Issue the following Linux command to edit a text file called mytext.txt in the linux/practice directory:
nano textedit/practice/mytext.txt
NOTE: When using the Nano text editor, you are placed in INPUT mode, so you can enter text immediately. - Enter the lines shown in the other diagram of the nano text editor on the right side.
NOTE: Refer to the table below for a list of common Nano navigation & editing commands:Key(s) Purpose <ctrl><SPACEBAR>,
<esc><6>Move forward/backward one word <ctrl><a>,
<ctrl><e>Move to beginning/end of line <ctrl><k> Cut line <esc>6 Copy Line <ctrl><u> Paste Cut/Copied Text <ctrl><g> Display help screen (ctrl-x to exit help screen) <ctrl><x> Save editing changes and exit - Referring to the table above, practice navigating and editing your entered lines for practice.
- To save your editing session, press: <ctrl>x
- You will be prompted to modify your file: type the letter y for yes.
- The name of the file will be displayed, Press ENTER.to save editing changes for that file name.
NOTE: This prompt for file name allows you to change the name of the file if you wish.
By pressing ENTER, it will accept the default filename. - Perform some more editing operations based on the editing chart above.
- Save your editing session and exit your text editor.
Part 2: Creating Text Files Using The vi Text Editor
You will now learn basic editing skills using the vi (vim) text editor including creating, editing, and saving text files.
The vi (vim) text editor (although taking longer to learn) has outstanding features to increase coding productivity.
The major different between nano and vi is that vi starts in COMMAND LINE mode. You need to issue letter commands to enter text. Also you can press colon “: ” in COMMAND mode to enter more complex commands.
Perform the Following Steps:
- Make certain that you are located in your home directory.
- Issue the following Linux command to edit a text file called othertext.txt in the linux/practice directory:
vi textedit/practice/othertext.txt
NOTE: When using the vi text editor, you are placed in COMMAND mode,
so you need to issue a command to switch to INPUT mode. - Type the following key to enter INPUT mode: i
You should notice you are in INSERT mode by seeing the notification -- INSERT --
at the bottom left-hand side of the application screen. - Enter the line shown in the other diagram of the vi text editor on the right side.
- While on the first line, press the following key to enter COMMAND mode: ESC
You should see the -- INSERT -- notification disappear indicating that you are in COMMAND mode.
NOTE: Refer to the table below for a list of
the most common vi (vim) navigation & editing commands:Key(s) Purpose i Enter INPUT mode <esc> Return to COMMAND MODE x Delete text to the right in COMMAND mode W Move forward one word in COMMAND mode B Move back one word in COMMAND mode dd Cut line in COMMAND mode yy Copy Line in COMMAND mode p / P Paste Cut/Copied Text below/above line in COMMAND mode u Undo previous editing command :help Display help screen in COMMAND mode :x Save editing changes and exit (in COMMAND mode) :w name Save editing changes to "name" in COMMAND mode :q! Abort editing session and exit (in COMMAND mode)
Once you can get used to working in INPUT and COMMAND mode, it is easier to perform
text editing operations in vi via COMMAND mode as opposed to nano! - Type the following keys to copy the current line: yy
- Type the following key to paste the copied line: p
What did you notice? - Type the following keys: u
What did you notice? - Type the following keys: 3p
What did you notice? - Use the up or down arrow keys to move to the second line.
- Type either the w and/or b keys to move the cursor to the beginning of the word: first.
- Type the x keys to remove the word called first.
- Type the i key to enter INSERT mode.
- Type the word: second
- Press the ESC key to enter COMMAND mode.
- Repeat steps 11 to 16 to change the words for line number for lines 3 and 4.
- Move to the 4th line (i.e. last line).
- Type the following keys: dd
What did you notice?
Let's save editing changes and exit the vi text editor. - Type the following keys: :x and press ENTER
What did you notice? - Issue the same command that you performed in Step #2 to confirm that you had properly edited that file.
- Save and exit your vi editing session.
An online tutorial has been created to give you "hands-on" experience on how to use vi text editor. It is recommended that you run this online tutorial in your Matrix account to learn how to create and edit text files with the vi text editor. - Issue the following to run the vi online tutorial:
/home/jason.carman/vi-tutorial - In the tutorial menu, select the first menu item labelled "USING THE VI TEXT EDITOR"
- Read and follow the instructions in the tutorial. Eventually, it will display a simulated vi environment
and will provide you with "hands-on" practice using the vi text editor. As far as this author is aware,
there is NO "hands-on" tutorial for the nano text editor in this particular format. - When you have completed that section, you will be returned to the main menu.
If you want to get extra practice, you can select the menu item labelled "REVIEW EXERCISE". - When you want to exit the tutorial, select the menu option to exit the tutorial.
- It is recommended to try both text editors, and choose the text editor that you feel that is easier to use.
Part 3: Manage & Manipulate Text File Content
We conclude this tutorial by learning to manage, view or manipulate the display of text files. This is HIGHLY ADVISED in case you only want to view contents and NOT edit text file contents which can cause accidental erasure of data.
Perform the Following Steps:
- Make certain that you are located in your home directory.
- Refer to the following table of Text File Management Commands:
Linux Command Purpose touch Create empty file(s) / Updates Existing File's Date/Time Stamp cat Display text file's contents without editing (small files) more , less Display / Navigate within large text files without editing cp Copy text file(s) mv Move / Rename text files rm Remove text file(s) sort Sorts (rearranges) order of file contents when displayed. Content is sorted alphabetically by default. The -nItalic text option sorts numerically, -r performs a reverse sort head , tail Displays the first / last 10 lines of a text file by default. An option using a value will display the number of lines (e.g. head -5 filename will display first 5 lines, tail -5 filename will display last 5 lines). grep Displays file contents that match a pattern uniq Displays identical consecutive lines only once diff file1 file2 Displays differences between 2 files file Gives info about the contents of the file (e.g. file with no extention) find To find files matching specified characteristics: - Issue the following Linux command to create three empty text files in your current directory:
touch a.txt b.txt c.txt - Issue the following Linux command: ls -l a.txt b.txt c.txt
Check the size in the detailed listing to confirm that these newly-created files are empty. - Use the nano text editor to edit the empty file called a.txt.
Type the number "1" and press ENTER. On the second line, type the number "2" and press ENTER.
Continue entering increasing number values until you reach the number 40 on line 40
(refer to the diagram on the right). - Save and exit your editing session.
- Issue the following Linux command: cat a.txt
Can you see all of the contents? - Issue the following Linux command: more a.txt
NOTE: The more command uses the same navigation keys as with the man command
(refer to week 1 notes for reference). Try using keys that you used to navigate the man pages.
What is the advantage of using the more command? - Type the letter "q" to exit the more command.
- Issue the following Linux command: less a.txt
Is there any difference between the more and less commands?
(again press q to quit) - issue the following Linux command: sort a.txt
Why does the output not look what you expected? Why? - Issue the following Linux command: sort -n a.txt
Try the same command using both the -n and -r options to see what happens. - issue the following Linux command: head a.txt
What is the output from this command display? - issue the following Linux command: head -7 a.txt
What is the output from this command display? - issue the following Linux command: tail a.txt
What is the output from this command display?
How would you issue this command to display only the last line contained in that file? - Issue the following Linux command: grep 2 a.txt
What type of output appear? Why did these lines appear (what do they all have in common)? - Edit the a.txt file and add to the bottom 5 new lines each consisting
of the same text: "end of line" (refer to diagram on right). - Save your editing session and exit your text editor.
- Issue the following Linux command: uniq a.txt
What do you notice happened to those newly created lines? - Issue the following Linux command: cp a.txt a.txt.bk
- Issue the following Linux command: cp a.txt b.txt
- Issue the following Linux command: mv a.txt aa.txt
- Issue a Linux command to view the directory contents.
What happened to the file called a.txt? Why? - Issue the following Linux command: file b.txt
What sort of information did it provide? - Issue the following Linux command: diff aa.txt b.txt
Was there any output? If not, why? - Issue the following Linux command: diff aa.txt c.txt
What do you think is the purpose of this output? - Issue the following Linux command: find -P .
What is the output of this command? - Issue the following Linux command:
rm aa.txt b.txt a.txt.bk c.txt - Issue the ls command to verify that these files have been removed.
- Complete the LINUX PRACTICE QUESTIONS to get additional practice.
LINUX PRACTICE QUESTIONS
The purpose of this section is to obtain extra practice to help with quizzes, your midterm, and your final exam.
Here is a link to the MS Word Document of ALL of the questions displayed below but with extra room to answer on the document to simulate a quiz:
Your instructor may take-up these questions during class. It is up to the student to attend classes in order to obtain the answers to the following questions. Your instructor will NOT provide these answers in any other form (eg. e-mail, etc).
Review Questions:
For each of the following questions, use a pathname starting from the root directory (i.e. “/”).
- Write a single Linux command to create the directory structure starting from your home directory from the diagram displayed on the right.
- Write a Linux command to display a detailed listing of history directory.
How would this command differ if you wanted to also view hidden files as well? - Write a Linux command to change to the project directory.
What command would you issue to return to your home directory? - Write a Linux command to copy the project directory and its contents to the history directory.
- Write a Linux command to move the directory called directories to the history directory.
- Write a Linux command to remove both directories named 1 and 2.
- Write a Linux command to remove the concepts directory and its contents.
- Write a Linux command to remove the concepts directory and prompt the user if they want to remove this directory’s contents.
- Write a single Linux command to create the following empty files in the concepts directory:
- myfile.txt
- yourfile.txt
- thefile.txt
- Write a Linux command to view the contents of the myfile.txt text file to prove it is empty. What is the difference between the commands: cat, more and less?
- Write a Linux command to sort the contents of a file called practice/customers.txt
- Write a Linux command to display the first 4 lines of a file called practice/customers.txt
- Write a Linux command to display the last line of a file called practice/customers.txt
- Write a Linux command to match a line containing the pattern Linux in a file called practice/customers.txt
- Write a Linux command to display unique occurrences of consecutive lines in a file called practice/customers.txt
- Create a table listing each Linux command, useful options that are displayed near the top of this tutorial labelled: Tutorial Reference Material
_________________________________________________________________________________
Author: Murray Saul
License: LGPL version 3 Link: https://www.gnu.org/licenses/lgpl.html
_________________________________________________________________________________