Changes

← Older edit

Tutorial6: File Transfer / Sending Email Messages

5,047 bytes added, 19:35, 4 September 2023

no edit summary

{{Admon/caution|DO NOT USE THIS VERSION OF THE LAB. This page will no longer be updated.|'''New version here:''' https://seneca-ictoer.github.io/ULI101/A-Tutorials/tutorial6 '''Andrew's students please go here:''' http://wiki.littlesvr.ca/wiki/OPS145_Lab_6}}

=TRANSFERRING FILES BETWEEN COMPUTERS=

:* Securely '''transfer''' copies of files between Unix/Linux servers using the '''sftp''' command

:* Use the '''~~mail~~ssh''' command to ~~send email messages to your Seneca email account~~run and view commands on a '''remote computer''' from a '''local computer'''.

:* Use the '''mail''' command to send email with '''file attachments''' to your Seneca email account

|- valign="top" style="padding-left:15px;"

|colspan="2" |~~Course Notes~~'''Slides:'''<ul><li>Week 6 Lecture 1 Notes: [https://~~ict~~wiki.cdot.senecacollege.ca/~~~murray.saul~~uli101/~~uli101~~slides/ULI101-~~Week6~~6.1.pdf PDF] | [https://~~ict~~wiki.cdot.senecacollege.ca/~~~murray.saul~~uli101/~~uli101~~slides/ULI101-~~Week6~~6.1.pptx PPTX]</li></ul>

| style="padding-left:15px;" |'''Definitions:'''

* [https://en.wikipedia.org/wiki/Secure_copy Secure Copy]

* [https://en.wikipedia.org/wiki/SSH_File_Transfer_Protocol Secure File Transfer Protocol]

* [https://en.wikipedia.org/wiki/Mail_(Unix) Email]

| style="padding-left:15px;"|'''File Transfer Commands:'''

* [http://man7.org/linux/man-pages/man1/scp.1.html scp]

* [http://man7.org/linux/man-pages/man1/sftp.1.html sftp]

* [https://man.openbsd.org/mail mail]

|colspan="1" style="padding-left:15px;" width="30%"|'''Instructional Videos:'''<ul><li>[https://www.youtube.com/watch?v=EBvxbuhDKBw Using scp Command]</li><li>[https://www.youtube.com/watch?v=QcKYFEgfV-I Using sftp Command]</li><li>[https://www.youtube.com/watch?v=Iuf_mLrvh2o Using the mail Command]</li></ul>

|}

= KEY CONCEPTS =

The '''ssh''' Linux command is a '''suite of tools''' to allow the user to issue Linux commandssecurely between ~~securely between~~ Unix / Linux servers, as well as securely '''copy''' and '''transfer''' files among Unix/Linux servers.

In this tutorial, you will learn several different methods to securely transfer files from your Matrix Linux account to other computers using Linux commands including '''scp''', '''sftp''' and '''mail'''.

===Issuing Commands on Remote Unix/Linux Servers===

[[Image:ssh-remote.png|thumb|right|350px|The '''ssh''' command can be used to run and view commands on '''remote computer''' from a '''local computer'''.

]]

You can use the '''ssh''' command to issue Unix/Linux commands on a '''remote''' server from your local computer without logging into a remote server (such as Matrix).

~~You can use the '''ssh''' command to issue Unix/Linux commands on a '''remote''' server without logging in to a remote session.~~

''~~Example~~Command Usage:''

'''ssh username@matrix.senecacollege.ca ls-l'''

You will be prompted for your Matrix account password, then the contents of your home directory~~ ~~in your remote Matrix account will be displayed~~, although you will remain~~ on your local computer's terminal.

===Secure Copy (scp)===

[[Image:scp-diagram.png|thumb|right|~~450px~~350px|The '''scp''' Unix/Linux command is used to securely copy files between Unix/Linux servers.]]~~''Secure copy protocol (~~The '''scp''') command is ~~a means of~~ used to securely ~~transferring computer~~ copy files between a your '''local ~~host~~ ''' computer and a '''remote ~~host or between two remote hosts~~''' Unix/Linux server. It The usage for the ''scp'' command is ~~based on~~ similar to the ~~Secure Shell (SSH) protocol. "SCP" commonly refers to both~~ '''cp''' command with the ~~Secure Copy Protocol~~ addition of '''user name''' and ~~the program itself.~~'''host name'''.

~~Reference: https://en.wikipedia.org/wiki/Secure_copy~~

''Command Usage:''

~~The usage for the '''scp''' command is similar to the '''cp''' command with the addition of host names, for example:~~ '''scp local.file username@host:destination-pathname''' '''scp local.file username@host:''' '''scp ~~local.file~~ user@host:file-pathname local-pathname'''

The most common '''mistake''' that students make is forgetting to add the '''colon''' character ":" after the remote hostname.

The user name in the command can be '''omitted''' if it's the same as on the local host. Multiple file and recursive directory copy (i.e. option '''-Rr''') is supported.

[[Image:sftp-diagram.png|thumb|right|350px|The '''sftp''' Unix/Linux command is used to securely transfer (copy) files between Unix/Linux servers.]]

''sftp is a file transfer program, similar to ftp, which performs all operations over an encrypted ssh transport. It may also use many features of ssh, such as '''public key authentication''' and '''compression'''.''

~~Reference: http://man7~~'''FTP''' stands for '''File Transfer Protocol''' which provides a set of '''rules''' on how to convert data that is transferred between computers (both identical and different operating systems).~~org/linux/man-pages/man1~~The '''sftp''' command performs file transfers securely</~~sftp.1~~u> using encryption.~~html~~

'''FTP''' is an acronym for '''File Transfer Protocol''' which provides a set of '''rules''' on how to convert data that is transferred between computer servers (both identical and different operating systems).

~~The usage for the~~ ''~~'sftp'~~Command Usage:'' ~~command is displayed below:~~

'''sftp username@hostname'''

~~When you login via the sftp command, the '''sftp prompt''' appears. The ftp prompt is like a Bash shell prompt, but with a limited number of commands.~~

~~When issuing sftp commands, it is important to understand that the local server relates to the server where you first issued the sftp command.~~

Below is a table that provide '''basic sftp commands''' to perform file transfer and management commands. Some of those commands loosely resemble Unix/Linux commands. Commands for the local computer has a '''lowercase l''' (not a number) for the command.

When you login via the ''sftp'' command, the '''sftp prompt''' appears. The sftp prompt is like a Bash shell prompt, but with a limited number of commands. When issuing sftp commands, the local server relates to the server where you first issued the sftp command. Refer to the diagram on the right for local and remote ''sftp'' commands.

[[Image:graphical-sftp-application.png|thumb|right|250px|'''Graphical''' SFTP application.]]

<table border="1" cellspacing="0" cellpadding="5"><tr style="text-align:center;"><th>Operation</th><td>'''sftp Command''' (Local Server)</td><td>'''sftp Command''' (Remote Server)</td></tr><tr><td>Display current working directory</td><th>lpwd</th><th>pwd</th></tr><tr><td>Display directory contents</td><th>lls</th><th>ls</th></tr><tr><td>Create Directory</td><th>lmkdir</th><th>mkdir</th></tr><tr><td>Change directory location</td><th>lcd</th><th>cd</th></tr><tr><td>Upload file to remote server</td><th>put</th><th>-</th></tr><tr><td>Download file to local server</td><th>get</th><th>-</th></tr></table>

~~[[Image:graphical-sftp-application.png|thumb|right|250px|'''Graphical''' SFTP application.]]~~

~~ ~~

'''<big>Graphical SFTP Applications</big>'''

Although it is important to ~~learn~~ know how to use the '''sftp''' command~~-line sftp and is considered coverage ~~for ''quizzes'', ''midterm '' and ''final exam'', there are '''graphical sftp applications''' that provide an alternative to issuing commands.

If you installed the graphical '''Secure Shell Client''' application in your Windows computer from performing [https://wiki.cdot.senecacollege.ca/wiki/Tutorial_1:_Using_Your_Matrix_Server_Account#CONNECTING_TO_YOUR_MATRIX_ACCOUNT_FROM_A_GRAPHICAL_WINDOWS_APPLICATION TUTORIAL 1 INVESTIGATION 1],~~ ~~you can ~~run a graphical~~ use this application ~~from~~ to transfer files between your computer ~~desktop~~and your Matrix account by graphically '''navigating''', '''selecting''' and '''dragging''' files between computers.~~ ~~

===Sending Emails with File Attachment (mail)===

You can use the '''~~~~mail''' command in Matrix to send email messages<~~/span~~br> ~~is a command-line~~ to other email ~~client for Unix and Unix-like operating systems~~accounts via the Internet.''

~~Reference: https://en.wikipedia.org/wiki/Mail_(Unix)~~

[[Image:mail-diagram.png|thumb|right|~~250px~~400px|~~The~~ Using the '''mail''' command ~~allows users~~ with '''redirection''' to send ~~and receive~~ email ~~messages. (Image licensed under [https://creativecommons.org/licenses/by-sa/3~~ with file attachment.~~0/ cc])~~]]

'''Sending a Simple Email Message:'''

:#Type: '''mail username@hostname''' and press '''ENTER'''

:#Enter '''subject line''' and press '''ENTER'''

:#Type the '''body of the message''' and then when finished, press '''ctrl+d''' to send message

'''Sending an Email Message with a File Attachment:'''

[[Image:mail-diagram-2.png|thumb|right|275px|Viewing email with file attachment in '''Seneca email account'''.]]

:#Type: '''mail username@hostname -a filepathname''' and press '''ENTER'''

:#Enter '''subject line''' and press '''ENTER'''

'''Alternative Method of Sending an Email Message with a File Attachment:'''

:#Type: '''mail -s "~~your~~ subject line" username@hostname < ~~filenamepathname~~filepathname'''

:#Press '''ENTER''' to send '''NOTE:''' You would have to use this method since you have used '''stdin''' redirection to attach the file’s so you can’t input the subject line from the terminal!

=INVESTIGATION 1: ~~USING~~ FILE TRANSFER (SECURE COPY)= '''ATTENTION''': This online tutorial will be required to be completed by '''Friday in week 8 by midnight''' to obtain a grade of '''2%''' towards this course [[Image:cmd.png|thumb|right|350px|Make certain to '''open a command-line terminal''' and '''NOT''' a graphic SSH application for this tutorial!.]]The '''SSH''' package on your ''home computer'' and on the ''Matrix Linux server'' contain a '''suite''' (i.e. collection) of secure utilities including '''ssh''' and '''scp'''.

~~The '''SSH''' package on your ''home computer'' and on the ''Matrix Linux server'' contain a '''suite''' (i.e. collection) of secure utilities including '''ssh''' and '''scp'''.~~

In this ~~section~~investigation, you will learn how to use the '''scp''' command to '''securely copy files ''' between your computer~~ ~~and your Matrix Linux server. This methods is useful because it can be performed in the~~ ~~''MS-Windows'', ''MacOSx'', and ''Unix/Linux'' operating systems. You will also learn how to issue the '''ssh''' command to run ~~a command~~ commands on your '''remote''' Matrix server while remaining on your '''local ''' computer.

</td>

</tr>

</table~~><br~~> <ol><li value="3">~~After logging into your Matrix account, issue the following Linux commands~~ '''NOTE:''' Make certain to ~~create the following directory: ~~open a '''command-line terminal''' and <~~span style="color:blue;font-weight:bold;font-family:courier;"~~u>~~mkdir ~/remote~~NOT</~~span~~u>a graphical SSH application for this tutorial. </li><li>~~Change~~ After logging into your Matrix account, issue to the ~~~/remote directory and~~ '''pwd''' command to confirm ~~that~~ you ~~have changed to that~~ are in your home directory. </li><li>~~Use a text editor~~ Issue the following Linux command to create ~~a text file called~~ the following directory:<bbr>~~myfile.txt~~mkdir ~/remote</bspan> </li><li>~~Enter~~ Change to the ~~following two lines displayed below in your editing session:~~~/remote directory and confirm that you have changed to that directory. <~~span style="font-family:courier;font-weight:bold;"~~/li>~~This is my file~~<brli>~~It is~~ Use a text editor to create a ~~small~~ text filecalled <~~/span~~b>~~ </li><li>Save~~myfile.txt ~~editing changes to your ''myfile.txt'' file and exit your text editor.~~ </li><li>~~Let's run a shell script to check that you created~~ Enter the ~~correct directories~~following two lines displayed below in your editing session: ~~and that you created the~~ <bspan style="font-family:courier;font-weight:bold;">~~myfile.txt~~This is my file</bbr> It is a small file ~~(with correct file contents) in the ~/from directory<br~~~~before using the ''scp'' Linux command.~~ </li></li>~~Enter the following command:~~ <~~span style="color:blue;font-weight:bold;font-family:courier;"~~b>~~bash /home/murray.saul/scripts/week6-check-1~~Save</~~span~~b>editing changes to your ''myfile.txt'' file and exit your text editor. </li><li>~~If you encounter errors, make corrections and then re-~~Let's run ~~the checking~~ a shell script ~~until you receive~~<br/b>~~a congratulations message, and proceed~~ to check that you created the ~~next step.~~<brb>remotedirectory and that you created the ~~NOTE:~~myfile.txt ~~We will now learn to transfer files between your ~~file (~~local~~with correct file contents) ~~home computer~~in that directory.</bbr> ~~and your~~ <bbr>~~(remote) Matrix Linux server<~~</~~b>. <br~~li></li>Enter the following command: <~~li>'''Exit your Matrix ssh session'''.~~span style="color:blue;font-weight:bold;font-family:courier;">~uli101/week6-check-1 <~~span style="color:blue;"~~/li>~~'''ATTENTION:''' You are~~ <uli>~~REQUIRED to open a terminal on your~~ If you encounter errors, make corrections and then re-run the checking script until you receive<ubr>~~local (Windows/MacOSx/Linux) computer~~a congratulations message, and proceed to the next step. ~~Do '''NOT''' use the ''ssh'' command to connect to your Matrix account.~~ <brb>NOTE:</lib> We will now learn to transfer files between your <liu>local~~The~~ home computer~~mkdir~~and your ~~command works with~~ <iu>~~MS Windows/UNIX~~remote Matrix Linux~~/MacOSx computers~~server</ib>. ~~Issue the following command on your~~ <ubr>~~local~~</~~u> computer to create a directory called <b~~li>~~local~~</bol>[[Image: ~~~~mkdir local~~'''remain'''</~~span~~u>in your '''local''' computer's command terminal for the remainder of this ''INVESTIGATION'' and ''INVESTIGATION 2'']]<brol><~~br></~~livalue="12">'''Exit your Matrix ssh session''' but '''<liu>~~The cd~~remain</bu> ''' in the ''command ~~works with~~ terminal''<ibr>~~MS Windows/UNIX/Linux/MacOSx computers~~on your '''local''' computer..</ibr>. ~~Issue the following command on your local computer to change to the local directory: <span~~ '''ATTENTION:''' You are required to ~~cd local~~'''remain'''</~~span><br~~u> in your '''local''' computer's command terminal for the remainder of this ''INVESTIGATION'' and ''INVESTIGATION 2''. </li><li>~~If you are using~~ The mkdir command works with MS Windows ~~on your local computer, issue the~~ /UNIX/Linux/MacOSx computers<~~span style="color:blue;font-weight:bold;font-family:courier;"~~/i>~~dir~~.<~~/span~~br> Issue the following command ~~to confirm you are~~on your <bru>local computer to create a directory called ~~in the ''~~local~~'' directory; otherwise, use the~~ : ~~ls -ld~~mkdir local ~~command.~~ </li> <li>~~If you are in~~ The cd command works with MS Windows~~, open the NotePad~~/UNIX/Linux/MacOSx computers</~~span~~i> ~~application to create a text file~~. Issue the following command on your local computer to change to the ~~NOTE:~~local ~~if you are using a Graphical Linux or MacOSx OS, then use a text editor like~~ directory: cd local<b/span>vi</bbr> .</li><li>~~Enter a few lines of text, and if~~ If you are using ~~'''Notepad'''~~MS Windows on your local computer, ~~then click on~~ issue the <~~b>File</b~~span style="color:blue;font-weight:bold;font-family:courier;"> ~~menu and select save as~~dir</bspan>command to confirm you are ~~(save as~~ in the ~~filename other.txt in your ~~''local~~~~ '' directory~~) and then~~ ; otherwise, use the <bspan style="color:blue;font-weight:bold;font-family:courier;">~~exit~~pwd</bspan> command. ~~the~~ <ibr>~~Notepad~~</ili> ~~text editor.~~<brli>~~ Otherwise~~If you are in MS Windows, ~~if using another text editor, save your editing session and exit the text editor. </li><li>If your OS is MS Windows issue~~ open the '''GRAPHICAL''' ~~dir~~NotePad ~~Windows command~~ application to ~~view the contents of your current directory<~~create a text file (~~otherwise~~Otherwise, ~~issue~~ use the <~~span style="color:blue;font-family:courier;font-weight:bold;"~~b>lsnano</~~span~~b> ~~command for other operating systems~~or vi text editor). ~~We will now use the scp command to copy the~~ <u/li>~~local~~</uli> ~~file called '~~Enter a few lines of text, and if using '''~~other.txt~~Notepad''' ~~to your home directory~~ , then click on ~~your~~ the <ub>~~remote~~File</ub> ~~Matrix Linux server.~~menu and select <brb>~~ </li><li>Issue the following Linux command to copy the other.txt~~save as ~~file from your local machine to your remote Matrix server~~ (~~replace yoursenecaid is~~ save as the filename <uspan style="color:blue;font-weight:bold;font-family:courier;">~~YOUR~~other.txt</~~u> Seneca ID and '''ADD A COLON : TO THE END OF THE COMMAND'''):<br~~span>in your ~~scp other.txt yoursenecaid@matrix.senecacollege.ca:~~local directory) and then exit</~~span~~b>the <bri>Notepad<br/i>text editor.<~~/li~~br><libr>~~When prompted, enter your Matrix~~ ''~~'password~~'NOTE:'''if using another text editor, save your editing session and exit the text editor. <b/li>~~TIP:~~</bli> ~~You can issue~~ If your OS is MS Windows issue the ~~ssh command, followed by a command that will be run on your remote computer,~~<~~br>but displayed on your local computer <b~~span style="color:blue;font-family:courier;font-weight:bold;">~~without~~dir</uspan>Windows command to view the contents of your current directory</bbr> ~~having to establish a continuous connection to your remote Matrix server.~~(otherwise, issue the <~~br> </li><li>Issue the following command (using your matrix username)~~span style="color:blue;font-family: ~~~~ssh yoursenecaid@matrix.senecacollege.ca~~ ls ~~-l other.txt<~~command for other operating systems). ~~</li><li>When prompted,~~ We will use the '''~~enter your password~~scp''' ~~and press~~ command to copy the local file called '''~~ENTER~~other.txt'''to your home directory on your remote Matrix Linux server. ~~Do you see detailed information regarding~~ </li><li>Issue the following Linux command to copy the ~~file called~~ other.txt?file from your local machine to your remote Matrix server ~~That command was run remotely on your Matrix server as confirmation that you securely copied that file~~(replace yoursenecaid is <~~br>to the home directory of the Matrix server. <br~~u>YOUR</liu>~~<li>Use the~~ Seneca ID and '''~~Notepad~~ADD A COLON : TO THE END OF THE COMMAND''' ~~application (or vi for other OS types~~) ~~to create a text file called '''mytextfile~~: scp other.txt~~'''<br~~yoursenecaid@matrix.senecacollege.ca:~~and save in the '''local''' directory of your computer.~~ </li><li>~~Issue the following Linux command to copy the mytextfile~~When prompted, enter your Matrix '''password'''.~~txt file from your local machine to your remote Matrix server~~ ~~(replace yoursenecaid is YOUR Seneca ID and DO NOT INCLUDE THE : at the end of~~ [[Image:scp-diagram-2.png|thumb|right|350px|You can issue the ssh command ~~so see what happens):~~, followed by a '''command''' that will be run on your '''remote''' computer, but display<~~span style="color:blue;font-weight:bold;font-family:courier;">scp mytextfile.txt yoursenecaid@matrix.senecacollege.ca<~~/~~span~~u>command output on your '''local''' computer.]] <~~br>Did you notice anything different? <br~~b>TIP:</lib>~~<li>Issue~~ You can issue the ~~following~~ ssh command, followed by a command ~~(using~~ that will be run on your remote computer, but display on your ~~matrix username):~~ local computer <~~span style="color:blue;font-weight:bold;font-family:courier;">ssh yoursenecaid@matrix.senecacollege.ca ls -l mytextfile.txt~~u>without</~~span~~u><br/b> having to establish a continuous connection to your remote Matrix server. </li><li>~~When prompted, enter~~ Issue the following command (using your ~~password and press ENTER.~~matrix username): <brspan style="color:blue;font-weight:bold;font-family:courier;">ssh yoursenecaid@matrix.senecacollege.ca ls -l other.txt ~~Do you see the file? That is because the COLON was NOT added to the end of the command!~~ <b/li><li>~~Therefore~~When prompted, ~~you MUST remember to include the COLON : at the end of the hostname, or it will NOT properly remotely copy the file!~~'''enter your password''' and press '''ENTER'''.</bbr> Do you see detailed information <brb>other.txt</lib>file? (look at bottom)<libr>~~Issue the following~~ That command ~~to copy~~ was run remotely on your Matrix server as confirmation that you securely copied that ~~same~~ file to the ~~~/remote~~ home directory in of the Matrix:server. <~~span style="color:blue;font-weight:bold;font-family:courier;">scp other~~br>Let's copy the file called '''myfile.txt ~~yoursenecaid@matrix.senecacollege.ca:~~''' in the '''~/remote''' directory that you created earlier in your Matrix account to your local</~~span~~b>directory on your home computer. </li><li>Issue the following Linux command ~~to confirm that it was remotely copied to your~~ (replace yoursenecaid is YOUR Seneca ID). The period "." as '''~~~/remote~~second argument''' ~~directory in Matrix:~~represents your current directory on your local computer): ~~ssh~~ scp yoursenecaid@matrix.senecacollege.ca ~~ls -l~~ :remote/~~home/yoursenecaid/remote~~myfile.txt . ~~Do you see the output for the detailed file listing of output.txt~~</bli>?<brli>~~What does this indicate?~~Issue the <brspan style="color:blue;font-weight:bold;font-family:courier;">dir<br/span>or <~~li>Issue the following~~ span style="color:blue;font-weight:bold;font-family:courier;">ls command ~~to copy~~ (depending on the ~~'''other~~OS of your local computer) to confirmed your properly copied that file from Matrix.~~txt~~ </li><li>Use the '''Notepad' ~~file to the ~/remote directory in Matrix renaming it is~~ ''~~'different.txt''': ~~application (or vi for other OS types) to create a text file called ~~scp other.txt yoursenecaid@matrix.senecacollege.ca:remote/different~~mytextfile.txt, type some text and then save in the local directory of your computer. <~~br></li><~~li>Issue the ~~following~~ dir or ls command (depending on your OS) to confirm that ~~the~~ your newly-created file ~~was remotely copied to~~ exists in your ~~'''~~~local directory. </~~remote~~li><li>We are going to intentionally make a ''' ~~directory in Matrix with a different filename:~~<bru>mistake<~~span style="color:blue;font-weight:bold;font-family:courier;"~~/u>~~ssh yoursenecaid@matrix.senecacollege.ca ls -l /home/yoursenecaid/remote/different~~''' with the '''scp''' command.~~txt~~ Issue the following Linux command to copy the <brb>~~What does this indicate?~~mytextfile.txt<br/b>~~ Let's issue a checking script remotely to see that you properly copied that~~ file from your~~ ~~local ~~computer~~ machine to your remote ~~Linux~~ Matrix server ~~to both your~~ <bbr>(replace yoursenecaid is ~~home~~YOUR</bu> ~~directory~~ Seneca ID and DO <bu>~~~/remote~~NOT</bu> ~~directory. </li><li>Issue~~ INCLUDE THE : at the end of the ~~following~~command so see what happens): ~~ssh~~ scp mytextfile.txt yoursenecaid@matrix.senecacollege.ca ~~bash /home/murray.saul/scripts/week6-check-2~~ ~~ If you encounter errors, re-run the scp commands~~ Did you notice anything different (i.e. no password)? </li><li>Issue the following command (using your matrix username): ssh yoursenecaid@matrix.senecacollege.ca ls -l mytextfile.txt </li><li>When prompted, enter your password and press ENTER. The file mytextfile.txt does NOT appear in your home directory on your Matrix server! Note that the COLON was NOT added to the end of the command! Therefore, you MUST remember to include the COLON : at the end of the hostname, or it will NOT remotely copy the file! </li><li>Issue the following command to properly copy that same file to your Matrix server: scp mytextfile.txt yoursenecaid@matrix.senecacollege.ca: </li><li>Issue the following command to confirm that it was remotely copied to your home directory in Matrix: ssh yoursenecaid@matrix.senecacollege.ca ls -l /home/yoursenecaid/mytextfile.txt Do you see the output for the detailed file listing of mytextfile.txt? What does this indicate? <li>Issue the following command to copy the '''other.txt''' file on your local computer to the '''~/remote''' directory in Matrix renaming it as '''different.txt''': scp other.txt yoursenecaid@matrix.senecacollege.ca:remote/different.txt </li><li>Issue the following command to confirm that the file was remotely copied to your '''~/remote''' directory in Matrix with a different filename: ssh yoursenecaid@matrix.senecacollege.ca ls -l /home/yoursenecaid/remote/different.txt Were you able to properly copy this file? Let's issue a checking script remotely to see that you properly copied that file from your local computer to your remote Linux server to both your home directory and ~/remote directory. </li><li>Issue the following: ssh yoursenecaid@matrix.senecacollege.ca ~uli101/week6-check-2 If you encounter errors, re-run the scp commands to correct and re-run the above command until you receive a congratulations message. </li><li>Remain in the terminal on your local computer and proceed to ~~correct and re-run the above command until you receive a congratulations message. </li><li>Remain in the terminal on your local computer for the~~ ''INVESTIGATION 2''. </ol> :'''NOTE:''' It would be possible to use the '''scp''' command to copy files from the Matrix server to your Windows computer, but this would require obtaining your computer's IP address and your Windows username, so we will not demonstrate this in our tutorial.

:In the next investigation, you will use the '''sftp''' Linux command to transfer (i.e. copy) files between ~~servers~~your local computer and the Matrix server.

<!-- RESIDUAL FROM LESS EFFECTIVE METHOD OF COPYING FILES BETWEEN SERVERS

# '''Save''' editing changes to this startup file and exit your text editor. -->

=INVESTIGATION 2: ~~USING~~ FILE TRANSFER (SECURE FTP ) = The '''SSH''' package on your ''home computer'' and on the ''Matrix Linux server'' contain a '''suite''' (i.e. collection)of secure utilities including '''ssh''' and '''sftp'''.

~~The '''SSH''' package on your ''home computer'' and on the ''Matrix Linux server'' contain a '''suite''' (i.e. collection) of secure utilities including '''ssh''' and '''sftp'''.~~

In this ~~section~~investigation, you will learn how to use the '''sftp''' command to '''transfer ''' files between Unix/Linux servers.~~ ~~This methods is useful because it can be performed in the ''MS-Windows'', ''MacOSx'', and ''Unix/Linux'' operating systems. You will also learn how to issue the '''ssh''' command to run commands on your '''remote''' Matrix server while remaining on your '''local''' computer.

~~=== Using the sftp Command (Command Line) ===~~

=== Command Line Terminal (CLI) === Let's look at using the '''sftp''' command on your '''local''' machine.

'''Perform the Following Steps:'''

[[Image:cmd.png|thumb|right|275px|Make certain to remain in the command-line terminal in your '''local''' computer.]]# Make certain that you are in a command terminal on your local computer (i.e. do '''NOT''' in log into your Matrix account). # Issue a command (~~Windows or Linux~~depending on your OS) to confirm that you are located in the '''local''' directory in your home computer. # If you are in MS Windows, open the NotePad application to create a text file~~. ~~ (otherwise: use another text editor like ~~NOTE:~~vi ~~if you are using a Graphical Linux~~ or ~~MacOSx OS, then use a text editor like~~ vinano) .# Enter a few lines of text, and then click on the File menu and select save as (save as the filename <bspan style="color:blue;font-weight:bold;font-family:courier;">thefile.txt</bspan> in your <bspan style="color:blue;font-weight:bold;font-family:courier;">local</bspan> directory) and then exit the Notepad text editor. If you using another OS, then save-as using the same filename and directory location for the text editor you are using. # If your OS is MS Windows issue the dir Windows command to view the contents of your current directory (otherwise, issue the ls command for other operating systems). '''Note:''' the relative pathname symbols "'''.'''" and "'''..'''" work for the ''Windows''/''MacOSx''/''Unix''/''Linux'' operating systems. # Issue the following command to move to the '''parent ''' directory: cd .. # If your OS is MS Windows issue the dir Windows command to view the contents of ~~your current~~ that parent directorythat you changed to (otherwise, issue the ls command for other operating systems). # Issue the following command to start an '''sftp ''' session (note: yoursenecaid is YOUR Seneca ID): sftp yoursenecaid@matrix.senecacollege.ca '''NOTE:''' You may be required to enter '''yes''' to have the public key shared. [[Image:sftp-commands.png|thumb|right|350px|Common '''sftp''' commands to manage the transfer of files between computers.]]# You should be in the '''sftp command prompt''' where you are expected to issue '''sftp commands'''.~~ ~~Please take a moment to view common local and remote ''sftp commands'' on the right-side table.

# Issue the following ''sftp command'': pwd What is the pathname? Which server does this represent: local or remote?

# Issue the following ''sftp command'': lpwd What is the pathname? Which server does this represent: local or remote?

# Issue the following ''sftp command'' to change to the '''remote2''' directory on your ''remote'' server: cd remote2

# Issue the '''pwd''' ''sftp command'' to confirm that you have changed to the ''remote2'' directory on your remote server.

# Issue the following sftp command to change to the '''local''' directory on your local ~~server~~computer: lcd local # Issue the '''lpwd''' ''sftp command'' to confirm that you have changed to the ''local'' directory on your local ~~server~~computer.

# Issue the following ''sftp command'' to transfer the file called '''thefile.txt''' to the '''~/remote2''' directory on your remote server: put thefile.txt

# Issue the '''ls''' sftp command to confirmed that you transferred~~/copied~~ the filecalled: '''thefile.txt''' Let's create another directory on your local ~~server~~ computer called '''local2''' so we can learn to download a file from your remote directory. # Issue the following ''sftp command'' ~~(without an argument)~~ to change to the '''parent ''' directoryon your local computer: lcd .. # Issue the '''lpwd''' ''sftp command'' to confirm that your current working directory on your local ~~server~~ computer is your home directory. # Issue the following ''sftp command'' to create the following directory on your local ~~server~~computer: lmkdir local2 # Issue the following ''sftp command'' to change to the '''local2''' directory on your local ~~server~~computer: lcd local2 # Issue the '''lpwd''' ''sftp command'' to confirm you have changed to the '''local2''' directory on your local ~~server~~computer. Let's learn to download a file from your remote server to your local ~~server~~computer.

# Issue the following '''sftp command''' to transfer your '''thefile.txt''' file from the '''remote2''' directory on your remote server to your local computer: get thefile.txt

# Issue the ~~'''~~lls~~''' '~~ ''sftp command''' to confirm that you transferred~~/copied~~ the file: '''thefile.txt on ''' to your local ~~server~~computer.

# Issue the following ''sftp command'' to exit the sftp utlilty: exit

~~# Issue the '''ssh''' command to login to your Matrix server account. ~~# Issue the following Linux command to remotely run a checking script to ensure you created the correct directories and properly transferred those created files: ssh yoursenecaid@matrix.senecacollege.ca ~~bash /home/murray.saul/scripts~~~uli101/week6-check-3 # If you encounter errors, make corrections and then re-run the checking script until you receive a congratulations message. '''FYI:''' To run a checking program to check if you created the '''local''' and '''local2''' directories in MS Windows would require running a local-based script (like '''PowerShell'''). Since this is a Unix/Linux based course, we don't have a PowerShell script, so we will ignore ~~that~~ checking ~~step~~for files transferred to your local computer.~~ ~~

<!-- OLDER CONTENT

# '''Save''' editing changes to the text file and exit your text editor.

# Change back to your '''home''' directory and confirm that you are located in your ''home'' directory. Let's run a '''shell script''' to check to make certain that you created the correct directories and that you created the '''myfile.txt''' file (with correct file contents) in the '''~/local''' directory before learning to use the ''sftp'' Linux command.

# Issue the following Linux command to run a checking script: ~~bash /home/murray.saul/scripts~~~uli101/week6-check-3

# Issue the following Linux command to start an sftp session (note: yoursenecaid is YOUR Seneca ID): sftp yoursenecaid@matrix.senecacollege.ca '''NOTE:''' You may be required to enter '''yes''' to have the public key shared. You are now in the '''sftp command prompt''' where you are expected to issue '''sftp commands'''. Please refer to the table of ''sftp commands'' in the '''KEY CONCEPTS''' section for reference.

# Issue the following ''sftp command'': pwd What is the pathname? Which server does this represent: local or remote?

# Issue the following ''sftp command'' to change to the '''remote''' directory on your ''remote'' server: cd remote

# Issue the '''pwd''' ''sftp command'' to confirm that you have changed to the ''remote2'' directory on your remote server.

# Issue the following sftp command to change to the '''local''' directory on your local ~~server~~computer: lcd local # Issue the '''pwd''' ''sftp command'' to confirm that you have changed to the ''local'' directory on your local ~~server~~computer.

# Issue the following ''sftp command'' to transfer your '''~/local/thefile.txt''' file to the '''~/remote''' directory on your remote server: put thefile.txt

# Issue the '''ls''' sftp command to confirmed that you transferred/copied the file: '''thefile.txt''' Let's create another directory on your local ~~server~~ computer called '''local2''' so we can learn to download a file from your remote directory.

# Issue the following ''sftp command'' (without an argument) to change to your '''home''' directory: lcd ~

# Issue the '''lpwd''' ''sftp command'' to confirm that your current working directory on your local ~~server~~ computer is your home directory. # Issue the following ''sftp command'' to create the following directory on your local ~~server~~computer: lmkdir local2 # Issue the following ''sftp command'' to change to the '''local2''' directory on your local ~~server~~computer: lcd local2 # Issue the '''lpwd''' ''sftp command'' to confirm you have changed to the ''local2'' directory on your local ~~server~~computer. Let's learn to download a file from your remote server to your local ~~server~~computer. # Issue the following '''sftp command''' to transfer your '''thefile.txt''' file from your remote directory on your local ~~server~~computer: get thefile.txt # Issue the '''lls''' '''sftp command''' to confirm that you transferred/copied the file: thefile.txt on your local ~~server~~computer.

# Issue the following ''sftp command'' to exit the sftp utlilty: exit

# Issue the '''ssh''' command to login to your Matrix server account.

# Issue the following Linux command to run a checking script to ensure you created the CORRECT directories, created and copied the correct files: ssh yoursenecaid@matrix.senecacollege.ca ~~bash /home/murray.saul/scripts~~~uli101/week6-check-3

# If you encounter errors, make corrections and then re-run the checking script until you receive a congratulations message.

~~# '''Logout''' of your Matrix account and '''close''' the command terminal window. ~~

~~-->~~ :Although it is important to learn how to use '''command-line sftp ~~and~~ ''' which is considered coverage for quizzes, midterm and final exam, there are '''graphical sftp applications''' available that are considered "user-friendly". The next ~~section~~ investigation will show you how ~~you can use the graphical SFTP Secure Client~~ to transfer files between your local computer and your ~~remote~~ Matrix ~~Linux~~ servergraphically (assuming your local computer is running MS Windows).

=== ~~Using~~ Graphical Application (Secure Shell ~~sftp Application in MS Windows (Graphical~~) ===[[Image:graphical-sftp-application.png|thumb|right|200px|'''SSH Secure Shell Client''' has a graphical application to transfer files between computers.]]If you installed the graphical Secure Shell application in [https://wiki.cdot.senecacollege.ca/wiki/Tutorial_1:_Using_Your_Matrix_Server_Account#CONNECTING_TO_YOUR_MATRIX_ACCOUNT_FROM_A_GRAPHICAL_WINDOWS_APPLICATION TUTORIAL 1 INVESTIGATION 1], you can run a '''graphical ''' application from your computer desktopto transfer files between your computer and your Matrix account.

Let's run the '''Secure Shell SFTP application ''' to transfer files between computers. This ~~section~~ investigation assumes that your computer is a '''Windows''' machine. If soyou local computer is '''NOT''' a ''Windows'' machine, you can skip this ~~section~~investigation.

'''Perform the Following Steps:'''

# ~~Open~~ On your local computer, open the NotePad application to create a text file. ~~NOTE: if you are using a Graphical Linux or MacOSx OS, then use a text editor like vi .~~# Enter a few lines of text, and then click on the File menu and select save as (save as the filename <bspan style="color:blue;font-weight:bold;font-family:courier;">yourfile.txt</bspan> in your <bspan style="color:blue;font-weight:bold;font-family:courier;">local</bspan> directory) and then exit the Notepad text editor. <table align="right"><tr valign="top"><td>[[Image:graphical-sftp-icon.png|thumb|right|110px|Double Click on SFTP to launch graphical application.]]</td><td>[[Image:sftp-connect.png|thumb|right|200px|Using Quick Connect to login to your Matrix Linux server.]]</td></table># In your local computer's command terminal, make certain that you are in the '''local''' directory, and if not, change to that directory. # Issue the dir command for the '''local''' directory to confirm that you created the file called '''yourfile.txt''' # On your Windows desktop, point and '''double-click ''' on the '''SSH Secure file Transfer''' application icon. # The main Secure Shell SFTP application window should appear. '''FYI:''' This application shows files on your home computer (on the left-side) and files on your remote Matrix computer on the right-side. You will ~~occur~~NOT see files for your Matrix server since you have NOT logged into the Matrix server. # Click on the '''Quick Connect''' buttonlocated in the Secure SFTP application window. '''NOTE:''' The Connect dialog box allows the user to specify the '''server name''' and your '''account name''' to allow you to connect to the server.

# Click on the textbox labelled '''Hostname''' and type the text: matrix.senecacollege.ca

# Click on the textbox labelled '''User Name''' and type your Seneca username (i.e. same as your Seneca userid).

# After entering the ''hostname'' and ''username'', click the '''Connect''' button.

# Enter your Seneca password when prompted.

# When you correctly connect to your Matrix account, you should see '''folders ''' in your remote server~~ ~~(i.e. Matrix server). [[Image:graphical-sftp-application.png|thumb|right|250px|'''Click''' and '''drag''' file(s) to transfer between computers.]]# There are two sub-windows to represent your local computer on the left and the remote (Matrix) server on the right. # In the left (local computer) window, ~~navigate to~~ point and '''double-click''' on your Windows profile name (i.e. ''username'') and then locate and '''double-click''' on the '''local''' directory. # In the right (remote Matrix server) window, navigate to the '''remote2''' directory and '''double-click''' to move to that directory. # In the left window, click and drag the '''yourfile.txt''' file to the right window. # ~~Confirm~~ Check to see that the '''yourfile.txt''' file appears in the right window to confirm that the file ~~was~~ has been transferredto your Matrix server. '''NOTE:''' You can select multiple files by using ''SHIFT-CLICK'' or ''CTRL-CLICK'' methods and then click and drag file selections between computers. # Take a few moments to ~~see~~ noter other buttons for both local and remote windows to '''refresh the view''', '''delete file(s)''', '''navigate up to parent directory''', etc. # Click the '''File''' menu, and select '''Disconnect''' ~~button~~ and ~~exit~~ then click '''OK''' to disconnect your sftp connection. # Now that you have disconnected, '''close''' the ~~Secure SFTP~~ sftp applicationwindow. # Return to your command terminal on your local computer (do '''NOT''' connect to Matrix!). # Issue the following Linux command to run a checking script to confirm that you transferred the most recently-created textfile to the '''remote2''' directory in Matrix: ssh yoursenecaid@matrix.senecacollege.ca ~uli101/week6-check-4 # When prompted, enter your password. # If you encounter errors, make corrections and then re-run the checking script until you receive a congratulations message.

-->

:In the next investigation, you will learn an alternative way to transfer a file to another computer server by sending an '''e-mail message with an attached file'''.~~ ~~

=INVESTIGATION 3: ~~USING THE MAIL COMMAND TO SEND~~ FILE ~~ATTACHMENTS~~ TRANSFER (EMAIL) =

~~Your~~ The '''Matrix''' server is also an '''email server''' that can allow you to '''send''' ~~and '''receive''' text-based~~ emails messages to other email ~~messages~~accounts.

In this ~~section~~investigation, you will learn how to '''transfer ''' a file from your Matrix server to another computer ~~system~~by sending ~~by sending~~ an '''email message ''' with a '''file attachment'''.

'''Perform the Following Steps:'''

# Make certain that you ~~are logged into~~ connect and login to your '''Matrix''' ~~account~~ server and confirm that you are located in your '''home''' directory. # Issue the following Linux command(using your Seneca-ID): mail yoursenecaid@myseneca.ca

# When prompted, enter the '''subject line''': Test Message and press ENTER

# In the email message '''BODY''' section, type the following text displayed below(and press '''ENTER'''): This is a test email message # Press ctrl-d to send your email message. Did any output display ~~after you sent this email message~~? ~~If so, what~~ What you do think it '''EOT''' stands for? # Launch a '''web-browser''', login into your '''Seneca email ''' account and check for new email messages. Did you receive the email message that you sent from your Matrix server? If you did NOT receive an e-mail message, check the '''JUNK''' or '''CLUTTER''' folders. If you still did not receive an email message, return to your terminal and re-issue the '''mail''' command making certain that you pressed ctrl-d instead of pressing '''ctrl-c''' # Return to your terminal (i.e. Linux Bash shell ) and issue the following Linux command: mail -a ~/~~local~~remote/~~thefile~~myfile.txt yoursenecaid@myseneca.ca

# When prompted, enter the subject line: Test Message with Attachment and press ENTER

# In the email message '''BODY''' section, type the following text displayed below(and press '''ENTER'''): This is a test email message with a file attachment

# Press ctrl-d to send your message.

# Switch to your Seneca email and check ~~your Seneca~~ for new email ~~for~~ messages. ~~Did you receive that email message?~~ ~~# Check your email to see if~~ Did you ~~received your~~ receive that email message~~. If you did, what do you notice~~? Does the email contain a file attachment? # Return to your Linux Bash shell and issue the following Linux command: mail yoursenecaid@myseneca.ca < ~/~~local~~remote/~~thefile~~myfile.txt What happened? Were you prompted for subject and could you enter text in email body? Did you see a file attachment as a separate file, or just text? # Check your email to see if you received your email message. If you did, what do you noticeregarding the subject line? You should have noticed that there was '''NO''' customized '''subject line''', since you redirected '''standard input''' (''stdin '') from the file,so there was no way ~~thus there was no ability~~ for the user to send a subject line. You can use the '''-s''' option, followed by text (in quotes) to specify a '''subject line'''. # Return to your Linux Bash shell and issue the following Linux command: mail -s "email with attachment" yoursenecaid@myseneca.ca < ~/~~local~~remote/~~thefile~~myfile.txt

# Check your email to see if you received your email message. If you did, what do you notice this time?

# After completing this INVESTIGATION, perform the LINUX PRACTICE QUESTIONS at the end of the tutorial.

simulate a quiz:

https://~~ict~~wiki.cdot.senecacollege.ca/~~~murray.saul~~uli101/~~uli101~~files/uli101_week6_practice.docx

Your instructor may take-up these questions during class. It is up to the student to attend classes in order to obtain the answers to the following questions. Your instructor will NOT provide these answers in any other form (eg. e-mail, etc).

# Write a Linux command to send the attached file '''message.txt''' to the email address '''murray.saul@senecacollege.ca''' with the subject line: '''Important Message'''

# Create a '''table''' listing each Linux command, useful options and command purpose for the following Linux commands: '''scp''' , '''sftp''' , '''mail'''.

# Create a '''table''' listing each '''sftp command'''and it's purpose. _________________________________________________________________________________ Author: Murray Saul License: LGPL version 3Link: https://www.gnu.org/licenses/lgpl.html _________________________________________________________________________________

[[Category:ULI101]]

Andrew

Bureaucrats, Administrators

1,234

edits

CDOT Wiki β

Changes

Tutorial6: File Transfer / Sending Email Messages

CDOT Wiki ^β