Difference between revisions of "OPS435 Python Lab 4"

From CDOT Wiki
Jump to: navigation, search
(PART 1 - Tuples)
 
(239 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 +
<font color='red'>
 +
'''** DO NOT USE - TO BE UPDATED FOR CENTOS 8.0 **'''
 +
</font>
 
= OBJECTIVES =
 
= OBJECTIVES =
  
:This lab will provide you will additional scripting tools to help us write even more effective Python scripts to be applied to practical application involving VM management and deployment in future labs.
+
:The '''first investigation''' in this lab will focus on '''Data Structures'''. Each data structure has its own advantages and limitations. This lab will emphasize the most important differences between them.  
  
:The '''first investigation''' in this lab will focus on '''Data Structures'''. In Wikipedia (http://searchsqlserver.techtarget.com/definition/data-structure)<br>''"A data structure is defined as a specialized format for organizing and storing data.  Any data structure is designed to organize data to suit a specific purpose so that it can be accessed and worked with in appropriate ways."''
+
:The '''second investigation''' will focus on strings. You have been using and storing strings since our first class, however in this lab we will dive into the more complex nature of string manipulation. Finally, this lab will cover how to use a variety of regular expression functions for searching and input validation.
 
 
:Each data structure has its own advantages and limitations. This lab will emphasize the most important differences as they relate to Python scripting.
 
 
 
:The '''second investigation''' will focus closely on strings. You have been using and storing strings since our first class, however in this lab we will dive into the more complex nature of string manipulation. Finally, this lab will cover how to use a variety of different regular expression functions, for searching and input validation.
 
  
 
=== PYTHON REFERENCE ===
 
=== PYTHON REFERENCE ===
  
:As you develop your Python scripting skills, you may start to be "overwhelmed" with the volume of information that you have absorbed over these labs. One way to help, is to write what you have learned in your labs into your lab logbook. Also, in programming, it is important to use online references in order to obtain information regarding Python scripting techniques and tools.
+
:As you develop your Python scripting skills, you may start to be "overwhelmed" with the volume of information that you have absorbed over these labs. One way to help is to learn to use online references effectively in order to obtain information regarding Python scripting techniques and tools.
  
 
:Below is a table with links to useful online Python reference sites (by category). You may find these references useful when performing assignments, etc.
 
:Below is a table with links to useful online Python reference sites (by category). You may find these references useful when performing assignments, etc.
Line 24: Line 23:
  
 
|-  style="background-color:white;border:none;"
 
|-  style="background-color:white;border:none;"
| style="border: 2px solid black;" valign="top"|  [https://docs.python.org/3/tutorial/datastructures.html#tuples-and-sequences Tuples]<br>  [https://docs.python.org/3/tutorial/datastructures.html#sets Sets]
+
| style="border: 2px solid black;" valign="top"|   
| style="border: 2px solid black;" |  [https://docs.python.org/3/tutorial/introduction.html#lists Lists]<br>[https://docs.python.org/3/tutorial/datastructures.html#more-on-lists More on Lists]<br>[https://docs.python.org/3/tutorial/datastructures.html#list-comprehensions List Comprehensions]
+
:*[https://docs.python.org/3/tutorial/datastructures.html#tuples-and-sequences Tuples]
| style="border: 2px solid black;" valign="top"|  [https://docs.python.org/3/tutorial/introduction.html#strings Strings]<br>[https://docs.python.org/3/library/string.html String Comparisons]
+
:*[https://docs.python.org/3/tutorial/datastructures.html#sets Sets]
| style="border: 2px solid black;" valign="top"|  [https://docs.python.org/3/library/re.html Regular Expression Operations]<br>[https://docs.python.org/3/howto/regex.html Regular Expressions (HOWTO)]
+
| style="border: 2px solid black;" |   
| style="border: 2px solid black;" valign="top"|  [https://docs.python.org/3/tutorial/datastructures.html#dictionaries Dictionaries]
+
:*[https://docs.python.org/3/tutorial/introduction.html#lists Lists]
 +
:*[https://docs.python.org/3/tutorial/datastructures.html#more-on-lists More on Lists]
 +
:*[https://docs.python.org/3/tutorial/datastructures.html#list-comprehensions List Comprehensions]
 +
| style="border: 2px solid black;" valign="top"|   
 +
:*[https://docs.python.org/3/tutorial/introduction.html#strings Strings]
 +
:*[https://docs.python.org/3/library/string.html String Comparisons]
 +
| style="border: 2px solid black;" valign="top"|   
 +
:*[https://docs.python.org/3/library/re.html Regular Expression Operations]
 +
:*[https://docs.python.org/3/howto/regex.html Regular Expressions (HOWTO)]
 +
| style="border: 2px solid black;" valign="top"|   
 +
:*[https://docs.python.org/3/tutorial/datastructures.html#dictionaries Dictionaries]
  
 
|}
 
|}
 
<br><br>
 
  
 
= INVESTIGATION 1: DATA STRUCTURES =
 
= INVESTIGATION 1: DATA STRUCTURES =
  
:In this investigation, you will learn several tools when using data structures in Python scripting.
+
:In this investigation, you will learn several data structures commonly used in Python scripting. These tools include '''lists''', '''tuples''', '''sets''', and '''dictionaries'''.
:These tools include '''tuples''', '''sets''', '''dictionaries''', and more '''advanced list functions'''.
 
 
   
 
   
 
== PART 1 - Tuples ==
 
== PART 1 - Tuples ==
  
:Many often confuse a '''tuple''' with a '''list''' (which you learned about in a previous lab). A '''tuple''' is a type of list whose values cannot be changes. In fact, the structure of a tuple cannot be changed (like adding, removing list elements).  
+
:Many often confuse a '''tuple''' with a '''list''' (which you learned about in a previous lab). A '''tuple''' is a type of list whose values cannot be changed. In fact, nothing in a tuple can be changed after it's created (like adding, removing list elements).  
  
 
:There are many advantages to using tuples when creating Python scripts:
 
:There are many advantages to using tuples when creating Python scripts:
  
::*'''Data protection''' (eg. values are are NOT allowed to change like income tax rate, social insurance number, etc)
+
::*'''Data protection''' (eg. values are are NOT allowed to change so you won't modify them accidentally)
::*The data structure in a tuple cannot be changed (eg. '''structure cannot be corrupted''')
 
 
::*Tuples can be used as '''keys in data dictionaries''' (which are NOT allowed to change)
 
::*Tuples can be used as '''keys in data dictionaries''' (which are NOT allowed to change)
 
::*Tuples allow for '''faster access''' than lists
 
::*Tuples allow for '''faster access''' than lists
  
:Term to indicate that a data structure cannot be changed is called '''immutable''' (as opposed to ''"mutable"'' which means the data structure can be changed).
+
:The term to indicate that a data structure cannot be changed is called '''immutable''' (as opposed to ''"mutable"'' which means the data structure can be changed).
  
 
:'''Perform the Following Steps:'''
 
:'''Perform the Following Steps:'''
:#Launch your ipython3 shell:<source>
+
:#Let's create two tuples in a temporary Python file, so we can learn how to use them and learn how they differ from lists.<br><br>Note: '''tuples are defined by using parenthesis ( )''' as opposed to '''lists which are defined by using square brackets [ ]'''<source lang="python">
ipython3
 
</source>Let's create two tuples, so we can learn how to use them and learn how they differ from lists.<br><br>Note: '''tuples are defined by using parenthesis ( )''' as opposed to '''lists are defined by using square brackets [ ]'''<br><br>
 
:#Issue the following:<source>
 
 
t1 = ('Prime', 'Ix', 'Secundus', 'Caladan')
 
t1 = ('Prime', 'Ix', 'Secundus', 'Caladan')
 
t2 = (1, 2, 3, 4, 5, 6)
 
t2 = (1, 2, 3, 4, 5, 6)
 
</source>
 
</source>
:#Values from a tuple can be retrieved in the same way as a list. For example, issue the following:<source>
+
:#Values from a tuple can be retrieved in the same way as a list. For example:<source lang="python">
t1[0]
+
print(t1[0])
t2[2:4]
+
print(t2[2:4])
 
</source>
 
</source>
:#You can also check to see whether a value exists inside a tuple or not. To demonstrate, issue the following:<source>
+
:#You can also check to see whether a value exists inside a tuple or not. To demonstrate try:<source lang="python">
'Ix' in t1
+
print('Ix' in t1)
'Geidi' in t1
+
print('Geidi' in t1)
</source>Let's now see how a tuple differs from a list. We will now create a list and note the difference between them.<br><br>
+
</source>Let's now see how a tuple differs from a list. We will now create a list and note the difference between them:<source lang="python">
:#Issue the following to create a list:<source>
 
 
list2 = [ 'uli101', 'ops235', 'ops335', 'ops435', 'ops535', 'ops635' ]
 
list2 = [ 'uli101', 'ops235', 'ops335', 'ops435', 'ops535', 'ops635' ]
 
</source>
 
</source>
:#See if you can change the value of your list by issuing the following:<source>
+
:#See if you can change the value of your list:<source lang="python">
 
list2[0]= 'ica100'
 
list2[0]= 'ica100'
list2[0]
+
print(list2[0])
 
print(list2)
 
print(list2)
</source>.You should have been successful in changing the value of your list.<br><br>
+
</source>You should have been successful in changing the value of your list.<br><br>
:#Now, try changing a tuple value by issuing the following:<source>
+
:#Now, try changing the value of your previously-created tuple:<source lang="python">
 
t2[1] = 10
 
t2[1] = 10
 
</source>Did it work? Once created the tuple values will not be able to change.<br><br>If you would like a tuple with different values than the tuple you currently have, then you must create a new one.<br><br>
 
</source>Did it work? Once created the tuple values will not be able to change.<br><br>If you would like a tuple with different values than the tuple you currently have, then you must create a new one.<br><br>
:#To create a new tuple, issue the following:<source>
+
:#The following creates a new tuple (t3) with a contents from a slice of the t2 tuple. Slicing works the same way for tuples as for lists:<source lang="python">
 
t3 = t2[2:3]
 
t3 = t2[2:3]
 
</source>
 
</source>
:#You can use most of the basic operations with tuples as you did with lists.<br><br>
+
:#Also, as with lists, you can use for loops to iterate the values of tuples:<source lang="python">
:#To demonstrate, issue the following:<source>
 
len(t1)    # list the length of the tuple
 
t1 * 3      # repetition
 
t1 + t2    # concatenation, remember this is creating a new tuple, not modifying
 
</source>
 
:#Also, as with lists, you can use loops with tuples. Issue the following to demonstrate:<source>
 
 
for item in t1:
 
for item in t1:
 
     print('item: ' + item)
 
     print('item: ' + item)
Line 94: Line 89:
  
 
== PART 2 - Sets ==
 
== PART 2 - Sets ==
:Sets are another very similar structure to lists, they can also be modified and changed, unlike the tuple. But sets have two unique characteristics, they are unordered, and they cannot have duplicate values. The unordered part provides a added performance from hashing the values, but also means we cannot pull out a specific value at a spefici position. Any duplicate entries will immediately be deleted. Sets however are great tools for doing comparisons, finding differences in multiple sets, or finding similarities. The best part about sets are, they are fast!
 
  
:'''Perform the Following Steps:'''
+
:So far, you have been exposed to two structures that are used to contain data: ''lists'' and ''tuples''. You can modify the values within a list as well as modify the structure of a list (i.e. add and remove elements), whereby you cannot with a tuple.
:#Start the ipython3 shell:<source>
+
 
ipython3
+
:In this section, you will learn about '''sets'''. A set has similar characteristics as a list, but there are two major differing characteristics:
</source>
+
 
:#Create a couple sets to work with.<source>
+
::*Sets are '''un-ordered'''
 +
::*Sets '''cannot contain duplicate values'''
 +
 
 +
:Since new duplicate entries will be automatically removed when using sets, they are very useful for performing tasks such as '''comparisons''': '''finding similarities or differences in multiple sets'''.
 +
 
 +
:#Create some sets to work with in a temporary Python file:<source lang="python">
 
s1 = {'Prime', 'Ix', 'Secundus', 'Caladan'}
 
s1 = {'Prime', 'Ix', 'Secundus', 'Caladan'}
 
s2 = {1, 2, 3, 4, 5}
 
s2 = {1, 2, 3, 4, 5}
 
s3 = {4, 5, 6, 7, 8}
 
s3 = {4, 5, 6, 7, 8}
 +
</source>Note: '''Sets are defined by using braces { }''' as opposed to tuples which use parenthesis ( ), or lists which use square brackets [ ]'''<br /><br />
 +
:#Try to access a set through the index:<source lang="python">
 +
print(s1[0])
 +
</source>This should have caused an '''error'''. You cannot access data inside a set this way because the elements inside are '''unordered'''. Instead, you should use the '''in''' method to check to see whether a value is contained in the set:<source lang="python">
 +
print('Ix' in s1)
 +
print('Geidi' in s1)
 +
</source><br>'''Sets can be combined''', but it is important to note that any '''duplicate values (shared among sets) will be deleted'''.<br><br>
 +
:#Print the contents of the sets and note the values that are common:<source lang="python">
 +
print(s2)
 +
print(s3)
 
</source>
 
</source>
:#First, access a set through the index.<source>
+
:#This is how you get a set containing only UNIQUE values (no duplicates) from both sets:<source>
s1[0]
+
print(s2 | s3)        # returns a set containing all values from both sets
</source>
+
print(s2.union(s3))    # same as s2 | s3
:#This should have created an error, this is not how to access data inside a set because they are unordered. Instead check to see if a value is inside.<source>
+
</source>Notice that both methods above have the same result, which one you choose depends purely on your style.<br><br>Instead of combining sets, we can display '''values that are common to both sets'''. This is known in mathematical terms as an '''intersection''' between the lists:<source lang="python">
'Ix' in s1
+
print(s2 & s3)            # returns a set containing all values that s2 and s3 share
'Geidi' in s1
+
print(s2.intersection(s3)) # same as s2 & s3
 
</source>
 
</source>
:#Sets can be combined together, any duplicates that the 2 sets share, will be deleted. Take a close look at which items are shared between the sets.<source>
+
:#Sets can also have their values compared against other sets. First find out what items are in '''s2''' but not in '''s3'''. This is also called a '''difference''':<source lang="python">
s2
+
print(s2)
s3
+
print(s3)
s2 | s3         # returns a set containing all values from both sets
+
print(s2 - s3)            # returns a set containing all values in s2 that are not found in s3
s2.union(s3)   # same as s2 | s3
+
print(s2.difference(s3)# same as s2 - s3
 
</source>
 
</source>
:#Instead of combining sets, we can find out what values are in both sets. This is a intersection between the lists.<source>
+
:#In order to see <u>every</u> difference between both sets, you need to find the '''symmetric difference'''. This will return a set that shows all numbers that both sets do not share together:<source lang="python">
s2
+
print(s2 ^ s3)                     # returns a set containing all values that both sets DO NOT share
s3
+
print(s2.symmetric_difference(s3)) # same as s2 ^ s3
s2 & s3            # returns a set containing all values that s2 and s3 share
+
</source>Note: the '''set()''' function can convert lists into sets, and the '''list()''' function can convert sets into lists. The operations in this section can only be applied to sets, so if you need to perform a union, intersection, or difference between lists, you need to convert them to sets first. For example:<source lang="python">
s2.intersection(s3) # same as s2 & s3
 
</source>
 
:#Sets can have their values compared against other sets. First find out what items are in '''s2''' but not in '''s3'''. This is also called a difference. But notice that it only shows values that '''s2''' contains, specifically values that '''s3''' doesn't have. So this isn't really the true difference between the sets.<source>
 
s2
 
s3
 
s2 - s3            # returns a set containing all values in s2 that are not found s3
 
s2.difference(s3)  # same as s2 - s3
 
</source>
 
:#In order to see every difference between both sets, find the symmetric difference. This will return a set that shows all numbers that both sets do not share together.<source>
 
s2
 
s3
 
s2 ^ s3                    # returns a set containing all values that both sets DO NOT share
 
s2.symmetric_difference(s3) # same as s2 ^ s3
 
</source>
 
:#These powerful features can be useful and efficient, try applying them to lists. Lists cannot perform these operations on them, instead we have to convert the lists into sets. Perform the comparision then convert the list back to a set. There are two problems with doing this: First, sets are unordered so if the list order is important this will cause problems and remove order, second, sets cannot contain duplicate values, if the list contains any duplicate values they will be deleted. However, if the list does not have any of the above requirements this is a great solution to some problems.<source>
 
 
l2 = [1, 2, 3, 4, 5]
 
l2 = [1, 2, 3, 4, 5]
 
l3 = [4, 5, 6, 7, 8]
 
l3 = [4, 5, 6, 7, 8]
new_list = list(set(l2).intersection(set(l3)))  # set() can make lists into sets. list() can make sets into lists
+
temporary_set = set(l2).intersection(set(l3))
new_list
+
new_list = list(temporary_set)  # '''set()''' can make lists into sets. '''list()''' can make sets into lists.
 +
print(new_list)
 
</source>
 
</source>
  
'''Create a Python Script Demonstrating Comparing Sets'''
+
=== Create a Python Script Demonstrating Comparing Sets ===
 
:'''Perform the Following Instructions'''
 
:'''Perform the Following Instructions'''
::#Create the '''~/ops435/lab4/lab4a.py''' script. The purpose of this script will be to demonstrate the different way of comparing sets. There will be three functions, each returning a different set comparison.  
+
:#Create the '''~/ops435/lab4/lab4a.py''' script. The purpose of this script will be to demonstrate the different way of comparing sets. There will be three functions, each returning a different set comparison.  
::#Use this template to get started:<source>
+
:#Use the following template to get started:<source lang="python">
 
#!/usr/bin/env python3
 
#!/usr/bin/env python3
  
def join_sets(set1, set2):
+
def join_sets(s1, s2):
     # join_sets will return a set that has every value from both set1 and set2 inside it
+
     # join_sets will return a set that contains every value from both s1 and s2
  
def match_sets(set1, set2):
+
def match_sets(s1, s2):
     # match_sets will return a set that contains all values found in both set1 and set2
+
     # match_sets will return a set that contains all values found in both s1 and s2
  
def diff_sets(set1, set2):
+
def diff_sets(s1, s2):
 
     # diff_sets will return a set that contains all different values which are not shared between the sets
 
     # diff_sets will return a set that contains all different values which are not shared between the sets
  
Line 169: Line 164:
 
</source>
 
</source>
  
:::*The match_sets() function should return a set that contains all values found in both sets
+
::*The join_sets() function should return a set that contains all values from both sets
:::*The diff_sets() function should return a set that contains all values which are not shared between both sets
+
::*The match_sets() function should return a set that contains all values found in both sets
:::*The join_sets() function should return a set that contains all values from both sets
+
::*The diff_sets() function should return a set that contains all values which are not shared between both sets
:::*All three functions should accept '''two arguments''' both are sets
+
::*All three functions should accept '''two arguments''' both are sets
:::*The script should show the exact output as the samples
+
::*The script should show the exact output as the samples
:::*The script should contain no errors
+
::*The script should contain no errors
::::'''Sample Run 1:'''<source>
+
 
run lab4a.py
+
:::'''Sample Run 1:'''<source>
 +
./lab4a.py
 
set1:  {1, 2, 3, 4, 5, 6, 7, 8, 9}
 
set1:  {1, 2, 3, 4, 5, 6, 7, 8, 9}
 
set2:  {5, 6, 7, 8, 9, 10, 11, 12, 13, 14}
 
set2:  {5, 6, 7, 8, 9, 10, 11, 12, 13, 14}
Line 183: Line 179:
 
diff:  {1, 2, 3, 4, 10, 11, 12, 13, 14}
 
diff:  {1, 2, 3, 4, 10, 11, 12, 13, 14}
 
</source>
 
</source>
::::'''Sample Run 2(with import):'''<source>
+
:::'''Sample Run 2 (with import):'''<source>
 
import lab4a
 
import lab4a
 
set1 = {1,2,3,4,5}
 
set1 = {1,2,3,4,5}
 
set2 = {2,1,0,-1,-2}
 
set2 = {2,1,0,-1,-2}
lab4a.join_sets(set1,set2)
+
print(lab4a.join_sets(set1,set2))
{-2, -1, 0, 1, 2, 3, 4, 5}
+
# Will output {-2, -1, 0, 1, 2, 3, 4, 5}
lab4a.match_sets(set1,set2)
+
print(lab4a.match_sets(set1,set2))
{1, 2}
+
# Will output {1, 2}
lab4a.diff_sets(set1,set2)
+
print(lab4a.diff_sets(set1,set2))
{-2, -1, 0, 3, 4, 5}
+
# Will output {-2, -1, 0, 3, 4, 5}
 
</source>
 
</source>
:::3. Exit the ipython3 shell, download the checking script and check your work. Enter the following commands from the bash shell.<source>
+
<ol><li value='3' style="margin-left:25px;">Download the checking script and check your work. Enter the following commands from the bash shell:<source lang="bash">
 
cd ~/ops435/lab4/
 
cd ~/ops435/lab4/
 
pwd #confirm that you are in the right directory
 
pwd #confirm that you are in the right directory
ls CheckLab4.py || wget matrix.senecac.on.ca/~acoatley-willis/CheckLab4.py
+
ls CheckLab4.py || wget https://raw.githubusercontent.com/Seneca-CDOT/ops435/master/LabCheckScripts/CheckLab4.py
 
python3 ./CheckLab4.py -f -v lab4a
 
python3 ./CheckLab4.py -f -v lab4a
</source>
+
</source></li>
:::4. Before proceeding, make certain that you identify any and all errors in lab4a.py. When the checking script tells you everything is OK before proceeding to the next step.
+
<li style="margin-left:25px;">Before proceeding, make certain that you identify all errors in lab4a.py. When the checking script tells you everything is OK - proceed to the next step.</li></ol>
  
'''Create a Python Script Demonstrating Comparing Lists'''
+
=== Create a Python Script Demonstrating Comparing Lists ===
 
:'''Perform the Following Instructions'''
 
:'''Perform the Following Instructions'''
::#Create the '''~/ops435/lab4/lab4b.py''' script. The purpose of this script will be to improve the previous script to perform the same joins, matches, and diffs, but this time on lists.  
+
:#Create the '''~/ops435/lab4/lab4b.py''' script. The purpose of this script will be to improve the previous script to perform the same joins, matches, and diffs, but this time on lists.  
::#Use the following as a template:<source>
+
:#Use the following as a template:<source lang="python">
 
#!/usr/bin/env python3
 
#!/usr/bin/env python3
  
def join_lists(list1, list2):
+
def join_lists(l1, l2):
     # join_lists will return a list that contains every value from both list1 and list2 inside it
+
     # join_lists will return a list that contains every value from both l1 and l2
  
def match_lists(list1, list2):
+
def match_lists(l1, l2):
     # match_lists will return a list that contains all values found in both list1 and list2
+
     # match_lists will return a list that contains all values found in both l1 and l2
  
def diff_lists(list1, list2):
+
def diff_lists(l1, l2):
 
     # diff_lists will return a list that contains all different values, which are not shared between the lists
 
     # diff_lists will return a list that contains all different values, which are not shared between the lists
  
Line 226: Line 222:
 
     print('diff: ', diff_lists(list1, list2))
 
     print('diff: ', diff_lists(list1, list2))
 
</source>
 
</source>
:::*The match_lists() function should return a list that contains all values found in both lists
+
::*The match_lists() function should return a list that contains all values found in both lists
:::*The diff_lists() function should return a list that contains all values which are not shared between both lists
+
::*The diff_lists() function should return a list that contains all values which are not shared between both lists
:::*The join_lists() function should return a list that contains all values from both sets
+
::*The join_lists() function should return a list that contains all values from both lists
:::*All three functions should accept '''two arguments''' both are lists
+
::*All three functions should accept '''two arguments''' both are lists
:::*The script should show the exact output as the samples
+
::*The script should show the exact output as the samples
:::*The script should contain no errors
+
::*The script should contain no errors
::::'''Sample Run 1:'''<source>
+
:::'''Sample Run 1:'''<source>
run lab4b.py
+
./lab4b.py
 
list1:  [1, 2, 3, 4, 5, 6, 7, 8, 9]
 
list1:  [1, 2, 3, 4, 5, 6, 7, 8, 9]
 
list2:  [5, 6, 7, 8, 9, 10, 11, 12, 13, 14]
 
list2:  [5, 6, 7, 8, 9, 10, 11, 12, 13, 14]
 
join:  [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14]
 
join:  [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14]
match:  [8, 9, 5, 6, 7]
+
match:  [5, 6, 7, 8, 9]
 
diff:  [1, 2, 3, 4, 10, 11, 12, 13, 14]
 
diff:  [1, 2, 3, 4, 10, 11, 12, 13, 14]
 
</source>
 
</source>
::::'''Sample Run 2(with import):'''<source>
+
 
 +
:::'''Sample Run 2 (with import) under interactive python shell:'''<source>
 
import lab4b
 
import lab4b
 
list1 = [1,2,3,4,5]
 
list1 = [1,2,3,4,5]
 
list2 = [2,1,0,-1,-2]
 
list2 = [2,1,0,-1,-2]
join_lists(list1,list2)
+
print(lab4b.join_lists(list1,list2)))
[0, 1, 2, 3, 4, 5, -2, -1]
+
# Will output [0, 1, 2, 3, 4, 5, -2, -1]
match_lists(list1,list2)                                                                                                                
+
print(lab4b.match_lists(list1,list2))                                                                                                               
[8, 9, 5, 6, 7]
+
# Will output [1, 2]
diff_lists(list1,list2)                                                                                                                  
+
print(lab4b.diff_lists(list1,list2))                                                                                                                 
[1, 2, 3, 4, 10, 11, 12, 13, 14]
+
# Will output [0, 3, 4, 5, -2, -1]
 
</source>
 
</source>
:::3. Exit the ipython3 shell, download the checking script and check your work. Enter the following commands from the bash shell.<source>
+
::3. Download the checking script and check your work. Enter the following commands from the bash shell.<source lang="bash">
 
cd ~/ops435/lab4/
 
cd ~/ops435/lab4/
 
pwd #confirm that you are in the right directory
 
pwd #confirm that you are in the right directory
Line 257: Line 254:
 
python3 ./CheckLab4.py -f -v lab4b
 
python3 ./CheckLab4.py -f -v lab4b
 
</source>
 
</source>
:::4. Before proceeding, make certain that you identify any and all errors in lab4b.py. When the checking script tells you everything is OK before proceeding to the next step.
+
::4. Before proceeding, make certain that you identify all errors in lab4b.py. When the checking script tells you everything is OK - proceed to the next step.
  
 
== PART 3 - Dictionaries ==
 
== PART 3 - Dictionaries ==
:In Python a Dictionary is a set of key-value pairs. Dictionaries are unordered, like sets, however any value can be retrieved from a dictionary if you know the key. This section will go over how to create, access, and change dictionaries, providing a new tool to store and manipulate data with.
 
  
:'''Perform the Following Steps:'''
+
::In Python, a '''dictionary''' is a set of key-value pairs. Dictionaries are '''unordered''', like sets, however any value can be retrieved from a dictionary if you know the key. This section will go over how to create, access, and change dictionaries, giving you a new powerful tool to store and manipulate data.
::#Start the ipython3 shell:<source>
+
 
ipython3
+
::'''Perform the Following Steps:'''
</source>
+
::#Let's begin by creating a new dictionary in a temporary Python file:<source lang="python">
::#Start by creating a new dictionary to practice with:<source>
 
 
dict_york = {'Address': '70 The Pond Rd', 'City': 'Toronto', 'Postal Code': 'M3J3M6'}
 
dict_york = {'Address': '70 The Pond Rd', 'City': 'Toronto', 'Postal Code': 'M3J3M6'}
</source>
+
</source>You should note that the syntax to define a dictionary is similar to defining sets (i.e. using '''{}'''), but unlike sets dictionaries use '''<code>key:value</code>''' pairs within the dictionary, each ''key:value'' pair is separated by commas.
::#The syntax here is to use '''{}''' to create a dictionary and placing key:value pairs inside separated by commas.
+
::#All the values in a dictionary can be retrieved by using the '''dictionary.values()''' function. This particular function provides a '''list''' containing all values:<source lang="python">
::#Take a close look at all the available functions available to dictionary objects<source>
+
print(dict_york.values())
dir(dict_york)
+
</source>All keys to access the ''key:pair'' values within a dictionary can be retrieved using the '''dictionary.keys()''' function:<source lang="python">
help(dict_york)
 
</source>
 
::#All values can be viewed by using the dictionary.values() function. This function provides a '''list''' containing all values<source>
 
help(dict_york.values)
 
dict_york.values()
 
</source>
 
::#All keys can be viewed by using the dictionary.keys() function. This function provides a '''list''' containing all keys<source>
 
help(dict_york.keys)
 
 
dict_york.keys()
 
dict_york.keys()
 +
</source>We can retrieve <u>individual</u> values from a dictionary by providing the key associated with the value:<source lang="python">
 +
print(dict_york['Address'])
 +
print(dict_york['Postal Code'])
 
</source>
 
</source>
::#We can retrieve individual values from a dictionary by provide the key associated with the value<source>
+
::#Dictionary keys can be any '''immutable''' values (i.e. not permitted for value to be changed). Types of values include: '''strings''', '''numbers''', and '''tuples'''.
dict_york['Address']
+
::#Try adding a new key and value to the dictionary:<source lang="python">
dict_york['Postal Code']
 
</source>
 
::#Dictionary keys can be any immutable values, such as: strings, numbers, and tuples. Trying adding a couple new keys and values to the dictionary<source>
 
 
dict_york['Country'] = 'Canada'
 
dict_york['Country'] = 'Canada'
dict_york
+
print(dict_york)
dict_york.values()
+
print(dict_york.values())
dict_york.keys()
+
print(dict_york.keys())
 
</source>
 
</source>
::#Study the output and add another key:value pair<source>
+
::#Let's change the province value to BC:<source lang="python">
 
dict_york['Province'] = 'BC'
 
dict_york['Province'] = 'BC'
dict_york
+
print(dict_york)
dict_york.values()
+
print(dict_york.values())
dict_york.keys()
+
print(dict_york.keys())
</source>
+
</source>'''WARNING: Dictionary keys must be unique'''. Attempting to add a key that already exists in the dictionary will <u>overwrite</u> the existing value for that key! For example:<source lang="python">
::#Dictionary keys must be unique. Attempting to add a key that already exists in the dictionary will overwrite the existing value for that key<source>
 
 
dict_york['Province'] = 'ON'
 
dict_york['Province'] = 'ON'
dict_york
+
print(dict_york)
dict_york.values()
+
print(dict_york.values())
dict_york.keys()
+
print(dict_york.keys())
</source>
+
</source>You should notice that value for the 'Province' key has been changed back to 'ON'.<br><br>The lists that contain the values and keys of the dictionary are not <u>real</u> python lists - they are "views of the dictionary" and therefore are <u>immutable</u>. You could change these views into usable lists by using the '''list()''' function:<source lang="python">
::#These lists that contain the values and keys of the dictionary are not real python lists, they are view of the dictionary
 
::#However we can change these from views into usable lists by using the list() function, the index can be used to access individual values<source>
 
 
list_of_keys = list(dict_york.keys())
 
list_of_keys = list(dict_york.keys())
list_of_keys[0]
+
print(list_of_keys[0])
</source>
 
::#Lists can be changed into sets if we would like to perform comparisons with another set<source>
 
set_of_keys = set(dict_york.keys())
 
set_of_values = set(dict_york.values())
 
set_of_keys | set_of_values
 
 
</source>
 
</source>
::#The lists can be iterated over in a for loop<source>
+
::#Lists can be used with '''for loops''':<source lang="python">
 
list_of_keys = list(dict_york.keys())
 
list_of_keys = list(dict_york.keys())
 
for key in list_of_keys:
 
for key in list_of_keys:
 
     print(key)
 
     print(key)
for value in dict_york.values()
+
for value in dict_york.values():
 
     print(value)
 
     print(value)
 
</source>
 
</source>
::#The values and keys can be looped over using the index as well
+
 
::#The range() function provides a list of numbers in a range.
+
=== Create a Python Script for Managing Dictionaries ===
::#The len() provides a the number of items in a list. Used together len() and range() create a list of usable indexes for a specific list<source>
 
list_of_keys = list(dict_york.keys())
 
list_of_values = list(dict_york.values())
 
list_of_indexes = range(0, len(dict_york.keys()))
 
list_of_indexes
 
list_of_keys[0]
 
list_of_values[0]
 
</source>
 
::#Using this this list of indexes we are able to pair the keys and values of two separate lists<source>
 
list_of_keys = list(dict_york.keys())
 
list_of_values = list(dict_york.values())
 
for index in range(0, len(list_of_keys)):
 
    print(list_of_keys[index] + '--->' + list_of_values[index])
 
</source>
 
::#Looping using indexes is not the best way to loop through a dictionary. A new dictionary could be created using this method, but this is '''not good'''<source>
 
list_of_keys = list(dict_york.keys())
 
list_of_values = list(dict_york.values())
 
new_dictionary = {}
 
for index in range(0, len(list_of_keys)):
 
    new_dictionary[list_of_keys[index]] = list_of_values[index]
 
</source>
 
::#The above method uses a lot of memory and loops. The best method to create a dictionary from two lists is to use the zip() function<source>
 
list_of_keys = list(dict_york.keys())
 
list_of_values = list(dict_york.values())
 
new_dictionary = dict(zip(list_of_keys, list_of_values))
 
</source>
 
::#Loop through the keys in a dictionary also provides a easy way to get the value for each key at the same time<source>
 
for key in dict_york.keys():
 
    print(key + '--->' + dict_york[key])
 
</source>
 
::#Even better than the above, both key and value can be extracted in a single for loop using a special object<source>
 
for key, value in dict_york.items():
 
    print(key + ' | ' + value)
 
</source>
 
'''Create a Python Script for Managing Dictionaries'''
 
 
:'''Perform the Following Instructions'''
 
:'''Perform the Following Instructions'''
 
::#Create the '''~/ops435/lab4/lab4c.py''' script. The purpose of this script will be to create dictionaries, extract data from dictionaries, and to make comparisons between dictionaries.  
 
::#Create the '''~/ops435/lab4/lab4c.py''' script. The purpose of this script will be to create dictionaries, extract data from dictionaries, and to make comparisons between dictionaries.  
::#Use the following as a template:<source>
+
::#Use the following as a template:<source lang="python">
 
#!/usr/bin/env python3
 
#!/usr/bin/env python3
  
Line 371: Line 315:
  
 
def create_dictionary(keys, values):
 
def create_dictionary(keys, values):
     # Place code here
+
     # Place code here - refer to function specifics in section below
  
def split_dictionary(dictionary):
 
    # Place code here
 
     
 
 
def shared_values(dict1, dict2):
 
def shared_values(dict1, dict2):
     # Place code here
+
     # Place code here - refer to function specifics in section below
 +
 
  
 
if __name__ == '__main__':
 
if __name__ == '__main__':
 
     york = create_dictionary(list_keys, list_values)
 
     york = create_dictionary(list_keys, list_values)
 
     print('York: ', york)
 
     print('York: ', york)
    keys, values = split_dictionary(dict_newnham)
 
    print('Newnham Keys: ', keys)
 
    print('Newnham Values: ', values)
 
    keys, values = split_dictionary(york)
 
    print('York Keys: ', keys)
 
    print('York Values: ', values)
 
 
     common = shared_values(dict_york, dict_newnham)
 
     common = shared_values(dict_york, dict_newnham)
 
     print('Shared Values', common)
 
     print('Shared Values', common)
 
</source>
 
</source>
  
:::*The script should contain '''three''' functions
+
:::*The script should contain '''two''' functions:
:::*create_dictionary() accepts two lists as arguments keys and values, combines these lists together to create a dictionary
+
:::::'''create_dictionary()'''<ol><li>'''accepts''' two lists as arguments keys and values, '''combines''' these lists together to '''create''' a dictionary<br>('''Tip:''' use a while loop to access elements in both the keys and values lists at the same time)</li><li>'''returns a dictionary''' that has the keys and associated values from the lists</li></ol>
:::*create_dictionary() '''returns a dictionary''' that has the keys and associated values from the lists
+
:::::'''shared_values()''' <ol><li>'''accepts''' two dictionaries as arguments and '''finds''' all values that are shared between the two dictionaries<br>('''Tip:''' generate sets containing only values for each dictionary, then use a function mentioned in a previous section to store the values that are common to <u>both</u> lists)</li><li>'''returns a set''' containing '''ONLY values''' found in '''BOTH dictionaries'''</li></ol>
:::*split_dictionary() accepts a single dictionary as a argument and splits the dictionary into two lists, keys and values
 
:::*split_dictionary() '''returns two lists''': return keys, values
 
:::*shared_values() accepts two dictionaries as arguments finds all values that are shared between the two dictionaries
 
:::*shared_values() '''returns a set''' containing ONLY values found in BOTH dictionaries
 
 
:::*make sure the functions have the correct number of arguments required
 
:::*make sure the functions have the correct number of arguments required
 
:::*The script should show the exact output as the samples
 
:::*The script should show the exact output as the samples
 
:::*The script should contain no errors
 
:::*The script should contain no errors
 
::::'''Sample Run 1:'''<source>
 
::::'''Sample Run 1:'''<source>
run lab4c.py
+
./lab4c.py
 
York:  {'Country': 'Canada', 'Postal Code': 'M3J3M6', 'Address': '70 The Pond Rd', 'Province': 'ON', 'City': 'Toronto'}
 
York:  {'Country': 'Canada', 'Postal Code': 'M3J3M6', 'Address': '70 The Pond Rd', 'Province': 'ON', 'City': 'Toronto'}
Newnham Keys:  ['Country', 'Postal Code', 'Address', 'Province', 'City']
 
Newnham Values:  ['Canada', 'M2J2X5', '1750 Finch Ave E', 'ON', 'Toronto']
 
York Keys:  ['Country', 'Postal Code', 'Address', 'Province', 'City']
 
York Values:  ['Canada', 'M3J3M6', '70 The Pond Rd', 'ON', 'Toronto']
 
 
Shared Values {'Canada', 'ON', 'Toronto'}
 
Shared Values {'Canada', 'ON', 'Toronto'}
 
</source>
 
</source>
::::'''Sample Run 2(with import):'''<source>
+
::::'''Sample Run 2 (with import):'''<source>
 
import lab4c
 
import lab4c
 
dict_york = {'Address': '70 The Pond Rd', 'City': 'Toronto', 'Country': 'Canada', 'Postal Code': 'M3J3M6', 'Province': 'ON'}
 
dict_york = {'Address': '70 The Pond Rd', 'City': 'Toronto', 'Country': 'Canada', 'Postal Code': 'M3J3M6', 'Province': 'ON'}
Line 418: Line 346:
 
list_values = ['70 The Pond Rd', 'Toronto', 'Canada', 'M3J3M6', 'ON']
 
list_values = ['70 The Pond Rd', 'Toronto', 'Canada', 'M3J3M6', 'ON']
  
york = create_dictionary(list_keys, list_values)
+
york = lab4c.create_dictionary(list_keys, list_values)
 
 
york
 
{'Address': '70 The Pond Rd',
 
'City': 'Toronto',
 
'Country': 'Canada',
 
'Postal Code': 'M3J3M6',
 
'Province': 'ON'}
 
 
 
keys, values = split_dictionary(dict_newnham)
 
 
 
keys
 
['Country', 'Postal Code', 'Address', 'Province', 'City']
 
 
 
values
 
['Canada', 'M2J2X5', '1750 Finch Ave E', 'ON', 'Toronto']
 
 
 
keys, values = split_dictionary(york)
 
 
 
keys
 
['Country', 'Postal Code', 'Address', 'Province', 'City']
 
  
values
+
print(york)
['Canada', 'M3J3M6', '70 The Pond Rd', 'ON', 'Toronto']
+
# Will print: {'Address': '70 The Pond Rd',
 +
              'City': 'Toronto',
 +
              'Country': 'Canada',
 +
              'Postal Code': 'M3J3M6',
 +
              'Province': 'ON'}
  
common = shared_values(dict_york, dict_newnham)
+
common = lab4c.shared_values(dict_york, dict_newnham)
  
common
+
print(common)
{'Canada', 'ON', 'Toronto'}
+
# Will print: {'Canada', 'ON', 'Toronto'}
 
</source>
 
</source>
:::3. Exit the ipython3 shell, download the checking script and check your work. Enter the following commands from the bash shell.<source>
+
:::3. Download the checking script and check your work. Enter the following commands from the bash shell.<source lang="bash">
 
cd ~/ops435/lab4/
 
cd ~/ops435/lab4/
 
pwd #confirm that you are in the right directory
 
pwd #confirm that you are in the right directory
ls CheckLab4.py || wget matrix.senecac.on.ca/~acoatley-willis/CheckLab4.py
+
ls CheckLab4.py || wget https://raw.githubusercontent.com/Seneca-CDOT/ops435/master/LabCheckScripts/CheckLab4.py
 
python3 ./CheckLab4.py -f -v lab4c
 
python3 ./CheckLab4.py -f -v lab4c
 
</source>
 
</source>
:::4. Before proceeding, make certain that you identify any and all errors in lab4c.py. When the checking script tells you everything is OK before proceeding to the next step.
+
:::4. Before proceeding, make certain that you identify all errors in lab4c.py. When the checking script tells you everything is OK proceed to the next step.
  
 +
= INVESTIGATION 2: STRINGS =
 +
:Strings are basically a list of characters (bits of text). This section will investigate strings in more detail such as '''cutting strings into sub-strings''', '''joining strings''', '''formatting strings''', '''searching through strings''', and '''matching strings against patterns'''.<br><br>Strings are '''immutable''' data objects - this means that once a string is created, it <u>cannot</u> be modified. In order to make a change inside a string, you would first make a copy of the part of the string (i.e. sub-string) for manipulation.
  
== PART 4 - List Comprehension ==
+
== PART 1 - Strings and Substrings ==
:We've already covered lists to a degree. Lets move into more advanced functions to use and generate lists. This is a very common practice in Python, understanding how to generate, manipulate, and apply functions to items inside a list can be incredibly useful. List comprehension is a way to build new lists from existing list and to do it faster than simply looping over lists.
+
:This first part will explain basic concepts of using strings, printing strings, and manipulating sub-strings.
  
:'''Perform the Following Steps'''
+
:'''Perform the Following Steps:'''
 
+
:#Create some strings in a temporary Python file:<source lang="python">
:#Lets start with creating a list and applying some function to each item in the list. The below will print out the square of each item.<source>
+
course_name = 'Open System Automation'
l1 = [1, 2, 3, 4, 5]
+
course_code = 'OPS435'
for item in l1:
+
course_number = 435
    print(item ** 2)
+
</source>Strings can contain any '''characters''' inside them, whether they are '''letters''', '''numbers''', or '''symbols'''.
 +
:#Strings can also be '''concatenated''' (i.e. "combined together") by using the '''+''' sign, just make sure string are only concatenating strings with strings (no lists, no numbers, no dictionaries, etc.):<source lang="python">
 +
print(course_name)
 +
print(course_code)
 +
print(str(course_number))
 +
print(course_name + ' ' + course_code + ' ' + str(course_number))
 +
</source>When using the '''print()''' function, you can display '''special characters'''. One such special character is the  is the newline character (denoted by the symbol:  '''\n'''). This allows you to separate content between new lines or empty lines:<source lang="python">
 +
print('Line 1\nLine 2\nLine 3\n')
 +
</source>
 +
:#Strings have many built-in functions that we can use to manipulate text. [https://docs.python.org/3/library/stdtypes.html#string-methods Here's a list].
 +
:#Lets try out several different functions:<source lang="python">
 +
print(course_name.lower())        # Returns a string in lower-case letters
 +
print(course_name.upper())        # Returns a string in upper-case letters
 +
print(course_name.swapcase())      # Returns a string with upper-case and lower-case letters swapped
 +
print(course_name.title())        # Returns a string with upper-case first letter of each word, lowercase for remaining text
 +
print(course_name.capitalize())    # Returns a string with upper-case first letter only, lowercase for remaining text
 +
</source>
 +
:#These values can be saved inside new strings and then reused:<source lang="python">
 +
lower_name = course_name.lower()    # Save returned string lower-case string inside new string variable
 +
print(lower_name)
 +
</source>
 +
:#If a string contains many values separated by a single character, such as a space, the string can be split on those values and create a list of values<source>
 +
lower_name.split(' ')      # Provide the split() function with a character to split on
 +
</source>The above example will return a list of strings, which we can access just like all of lists. <br><br>
 +
:#Let's practice more string manipulation:<source lang="python">
 +
list_of_strings = lower_name.split(' ')    # Split string on spaces and store the list in a variable
 +
print(list_of_strings)                      # Display list
 +
print(list_of_strings[0])                  # Display first item in list
 +
</source>Since lists are actually a list of '''strings''', you should be able to use any function that works with a string on a list:<source lang="python">
 +
list_of_strings[0].upper()          # Use the function after the index to affect a single string within a list
 +
first_word = list_of_strings[0]
 +
print(first_word)
 +
</source>The '''index''' that is used to access <u>items</u> within a list, can also be used to access <u>characters</u> within a string. For practice, let's  create a new string, and start accessing the strings index:<source>
 +
course_name = 'Open System Automation'
 +
course_code = 'OPS435'
 +
course_number = 435
 +
print(course_code[0])                          # Print the first character in course_code
 +
print(course_code[2])                          # Print the third character in course_code
 +
print(course_code[-1])                        # Print the last character in course_code
 +
print(str(course_number)[0])                  # Turn the integer into a string, return first character in that string, and print it
 +
print(course_code[0] + course_code[1] + course_code[2])
 +
</source>
 +
:#You can use a technique that uses index numbers of a string to '''cut-out''' or '''"parse"''' smaller portions of text within a string. This term is referred to as a '''substring'''. We can use this to create a new string or display only a small portion of it:<source lang="python">
 +
print(course_name[0:4])                # Print the first four characters (values of index numbers 0,1,2, and 3)
 +
first_word = course_name[0:4]          # Save this substring for later use
 +
print(course_code[0:3])                # Print the first three characters (values of index numbers 0,1,and 2)
 +
</source>
 +
:# The index allows a few '''extra functions''' using the same parsing technique:<source lang="python">
 +
course_name = 'Open System Automation'
 +
print(course_name[12:])                        # Print the substring '12' index until end of string
 +
print(course_name[5:])                        # Print the substring '5' index until end of string
 +
print(course_name[-1])                        # Print the last character
 +
</source>With '''negative indices''', '''-1''' would represent the '''last''' character, '''-2''' index would represent the '''second last''' character, etc.:<source lang="python">
 +
course_name = 'Open System Automation'
 +
print(course_name[-1])
 +
print(course_name[-2])
 
</source>
 
</source>
:#To store these squares for later use, create a new list and append the squares to it. This will generate a new list that contains squared values in the same positions of the first list. This is using an existing list to create a new list.<source>
+
:# Practice some of the skills that you have learned in this section:<source>
l1 = [1, 2, 3, 4, 5]
+
course_name = 'Open System Automation'
l2 = []
+
print(course_name[-10:])                            # Return the last ten characters
for item in l1:
+
print(course_name[-10:-6])                          # Try and figure out what this is returning
    l2.append(item ** 2)
+
print(course_name[0:4] + course_name[-10:-6])      # Combine substrings together
l1
+
substring = course_name[0:4] + course_name[-10:-6]  # Save the combined substring as a new string for later
l2
+
print(substring)
 
</source>
 
</source>
:#Move the squaring of numbers out into it's own separate function. While the squaring example is a simple function, this example could include a more complex function that does more processing on each item in the list.<source>
+
:# The real power found in substrings goes beyond just manually writing index values and getting back words. The next part of this investigation will cover how to search through a string for a specific word, letter, number, and return the index to that search result.
def square(number):
+
 
    return number ** 2
+
'''Create a Python Script Demostrating Substrings'''
 +
:'''Perform the Following Instructions'''
 +
:#Create the '''~/ops435/lab4/lab4d.py''' script. The purpose of this script is to demonstrate creating and manipulating strings. There will be four functions each will return a single string.
 +
:#Use the following template to get started:<source>
 +
#!/usr/bin/env python3
 +
# Strings 1
  
l1 = [1, 2, 3, 4, 5]
+
str1 = 'Hello World!!'
l2 = []
+
str2 = 'Seneca College'
for item in l1:
 
    l2.append(square(item))
 
  
l1
+
num1 = 1500
l2
+
num2 = 1.50
</source>
+
 
:#The map function can be used to apply a function on each item in a list. This is exactly what happened above, however it gives much better syntax, removes the loop, including the variable that was created inside the loop. This will make the script a little more efficient while performing the same task.<source>
+
def first_five():
def square(number):
+
    # Place code here - refer to function specifics in section below
     return number ** 2
+
 
 +
def last_seven():
 +
    # Place code here - refer to function specifics in section below
 +
 
 +
def middle_number():
 +
     # Place code here - refer to function specifics in section below
  
l1 = [1,2,3,4,5]
+
def first_three_last_three():
l2 = list(map(square, l1))
+
    # Place code here - refer to function specifics in section below
  
l1
 
l2
 
</source>
 
:#The above map function requires a function, and a list. This meant that before map() could be used a function needed to be defined earlier in the script. This entire process can be avoided through the use of anonymous functions. This is the ability to create a simple function without defining it, and pass it off for use. Below we will use lambda, which will return a function, and we can use that function immediately. The function takes 1 argument x, and it will perform a single operation on x, square it.<source>
 
square = lambda x: x ** 2
 
l1 = [1,2,3,4,5]
 
l2 = list(map(square, l1))
 
  
l1
+
if __name__ == '__main__':
l2
+
    print(first_five(str1))
 +
    print(first_five(str2))
 +
    print(last_seven(str1))
 +
    print(last_seven(str2))
 +
    print(middle_number(num1))
 +
    print(middle_number(num2))
 +
    print(first_three_last_three(str1, str2))
 +
    print(first_three_last_three(str2, str1))
 
</source>
 
</source>
:#The above code is actually not particularly good, the whole purpose of using lambda here is we were avoiding the function definition and just quickly returning a function. However this does break down exactly what lambda does, it returns a function for use. Fix this by removing the square function and just use the return function from lambda. Now remember what map requires? map's first argument is a function, and map's second argument is a list. Here lambda will return a function and provide it as the first argument.<source>
 
l1 = [1,2,3,4,5]
 
l2 = list(map(lambda x: x ** 2, l1))
 
  
l1
+
::*The script should contain '''four''' functions (use your own argument names):
l2
+
::::'''first_five()''':<ol><li>Accepts a single string argument</li><li>Returns a string that contains the first five characters of the argument given</li></ol>
 +
::::'''last_seven()''':<ol><li>Accepts a single string argument</li><li>Returns a string that contains the last seven characters of the argument given</li></ol>
 +
::::'''middle_number()''':<ol><li>Accepts a integer as a argument</li><li>Returns a string containing the second and third characters in the number</li></ol>
 +
::::'''first_three_last_three()''':<ol><li>Accepts two string arguments</li><li>Returns a single string that starts with the first three characters of argument1 and ends with the last three characters of argument2</li></ol>
 +
::*Example: first_three_last_three('abcdefg', '1234567') returns single string 'abc567'
 +
:::'''Sample Run 1'''<source>
 +
./lab4d.py
 +
Hello
 +
Senec
 +
World!!
 +
College
 +
50
 +
.5
 +
Helege
 +
Send!!
 
</source>
 
</source>
:#Using the list comprehensions above our code will be faster and more efficient than using multiple variables and loops.
+
:::'''Sample Run 2 (with import)'''<source>
 +
import lab4d
  
= INVESTIGATION 2: STRINGS =
+
str1 = 'Hello World!!'
:Strings are in their most basic form a list of characters, or a bit of text. Strings store text so that we can use them later. In this section we will cover more than just displaying that text to the screen. Here, we will go over cutting strings into sub-strings, joining strings together, searching through strings, and matching strings against patterns.
+
str2 = 'Seneca College'
 +
num1 = 1500
 +
num2 = 1.50
  
== PART 1 - String Basics ==
+
print(lab4d.first_five(str1))
<!--
+
# Will output 'Hello'
:We can concatenate strings using the plus sign. Combining strings together to create a brand new string, strings are immutable just like tuples. This means everytime you change a string, you are actually creating a new string.
+
print(lab4d.first_five(str2))
<source>
+
# Will output 'Senec'
str1 = 'Paul'
+
print(lab4d.last_seven(str1))
str2 = 'Atreides'
+
# Will output 'World!!'
str3 = str1 + ' ' + str2
+
print(lab4d.last_seven(str2))
str3
+
# Will output 'College'
 +
print(lab4d.middle_number(num1))
 +
# Will output '50'
 +
print(lab4d.middle_number(num2))
 +
# Will output '.5'
 +
print(lab4d.first_three_last_three(str1, str2))
 +
# Will output 'Helege'
 +
print(lab4d.first_three_last_three(str2, str1))
 +
# Will output 'Send!!'
 
</source>
 
</source>
 
+
::3. Download the checking script and check your work. Enter the following commands from the bash shell.<source>
Repetition is also a useful tool that can be used with strings. Repetition repeats the string over and over a specific amount of times. This is useful anytime you would manually be typing the same thing over again.
+
cd ~/ops435/lab4/
<source>
+
pwd #confirm that you are in the right directory
str1 = 'Paul'
+
ls CheckLab4.py || wget https://raw.githubusercontent.com/Seneca-CDOT/ops435/master/LabCheckScripts/CheckLab4.py
str2 = 'Atreides'
+
python3 ./CheckLab4.py -f -v lab4d
str3 = str1 + ' ' + str2 + ' ' + 'I'
 
str3
 
str3 = str1 + ' ' + str2 + ' ' + 'I'*3
 
str3
 
 
</source>
 
</source>
-->
+
::4. Before proceeding, make certain that you identify all errors in lab4d.py. When the checking script tells you everything is OK - proceed to the next step.
== PART 1 - String Manipulation ==
 
 
 
== PART 1 - Regular Expressions ==
 
  
 
= LAB 4 SIGN-OFF (SHOW INSTRUCTOR) =
 
= LAB 4 SIGN-OFF (SHOW INSTRUCTOR) =
Line 547: Line 539:
 
:'''Have Ready to Show Your Instructor:'''
 
:'''Have Ready to Show Your Instructor:'''
  
::<span style="color:green;font-size:1.5em;">&#x2713;</span> x
+
::<span style="color:green;font-size:1.5em;">&#x2713;</span> Output of: <code>./CheckLab4.py -f -v</code>
::<span style="color:green;font-size:1.5em;">&#x2713;</span> x
+
::<span style="color:green;font-size:1.5em;">&#x2713;</span> Output of: <code>cat lab4a.py lab4b.py lab4c.py lab4d.py</code>
::<span style="color:green;font-size:1.5em;">&#x2713;</span> Lab4 logbook notes completed
+
 
 +
= LAB REVIEW =
  
= Practice For Quizzes, Tests, Midterm &amp; Final Exam =
+
# What is the purpose of a '''tuple'''? How does a tuple differ from a list?
 +
# How do you define elements within a tuple?
 +
# Write Python code to confirm if the string ''''OPS435'''' exists within the tuple called '''courses'''.
 +
# What is the purpose of a '''set'''? How do sets differ from lists or tuples?
 +
# How do you define elements within a set?
 +
# Assuming you have defined two sets called '''set1''' and '''set2'''. Write Python code to:<ol type="a"><li>Return a set containing all values of both sets</li><li>Returns a set containing all values in set1 that are not found in set2</li><li>Return a set containing all values that both sets DO NOT share</li></ol>
 +
# What is the purpose of a dictionary?
 +
# How do you define elements within a dictionary?
 +
# Write Python commands to display for a dictionary called '''my_dictionary''' the dictionary key called '''my_key''' and a dictionary value for that key?
 +
# What is the purpose for the '''range()''', '''len()''', '''append()''', and '''map()''' functions for a dictionary?
 +
# List and briefly explain the following functions (methods) that can be used with strings:<br>'''lower()''' , '''upper()''' , '''swapcase()''' , '''title()''' , '''captilize()''' , '''split()'''
 +
# Assume you issued the following command in your ipython3 shell:<br>'''course_name = 'Programming with Python''''<br>What will be the output for each of the following Python commands?<ol type="a"><li>'''course_name[3:11]'''</li><li>'''course_name[10:]'''</li><li>'''course_name[-1]</li></ol>
  
# x
+
[[Category:OPS435-Python]]
# x
 
# x
 

Latest revision as of 09:26, 21 January 2020

** DO NOT USE - TO BE UPDATED FOR CENTOS 8.0 **

OBJECTIVES

The first investigation in this lab will focus on Data Structures. Each data structure has its own advantages and limitations. This lab will emphasize the most important differences between them.
The second investigation will focus on strings. You have been using and storing strings since our first class, however in this lab we will dive into the more complex nature of string manipulation. Finally, this lab will cover how to use a variety of regular expression functions for searching and input validation.

PYTHON REFERENCE

As you develop your Python scripting skills, you may start to be "overwhelmed" with the volume of information that you have absorbed over these labs. One way to help is to learn to use online references effectively in order to obtain information regarding Python scripting techniques and tools.
Below is a table with links to useful online Python reference sites (by category). You may find these references useful when performing assignments, etc.
Data Structures Lists & List Comprehension Strings Regular Expressions Miscellaneous

INVESTIGATION 1: DATA STRUCTURES

In this investigation, you will learn several data structures commonly used in Python scripting. These tools include lists, tuples, sets, and dictionaries.

PART 1 - Tuples

Many often confuse a tuple with a list (which you learned about in a previous lab). A tuple is a type of list whose values cannot be changed. In fact, nothing in a tuple can be changed after it's created (like adding, removing list elements).
There are many advantages to using tuples when creating Python scripts:
  • Data protection (eg. values are are NOT allowed to change so you won't modify them accidentally)
  • Tuples can be used as keys in data dictionaries (which are NOT allowed to change)
  • Tuples allow for faster access than lists
The term to indicate that a data structure cannot be changed is called immutable (as opposed to "mutable" which means the data structure can be changed).
Perform the Following Steps:
  1. Let's create two tuples in a temporary Python file, so we can learn how to use them and learn how they differ from lists.

    Note: tuples are defined by using parenthesis ( ) as opposed to lists which are defined by using square brackets [ ]
    t1 = ('Prime', 'Ix', 'Secundus', 'Caladan')
    t2 = (1, 2, 3, 4, 5, 6)
  2. Values from a tuple can be retrieved in the same way as a list. For example:
    print(t1[0])
    print(t2[2:4])
  3. You can also check to see whether a value exists inside a tuple or not. To demonstrate try:
    print('Ix' in t1)
    print('Geidi' in t1)
    Let's now see how a tuple differs from a list. We will now create a list and note the difference between them:
    list2 = [ 'uli101', 'ops235', 'ops335', 'ops435', 'ops535', 'ops635' ]
  4. See if you can change the value of your list:
    list2[0]= 'ica100'
    print(list2[0])
    print(list2)
    You should have been successful in changing the value of your list.

  5. Now, try changing the value of your previously-created tuple:
    t2[1] = 10
    Did it work? Once created the tuple values will not be able to change.

    If you would like a tuple with different values than the tuple you currently have, then you must create a new one.

  6. The following creates a new tuple (t3) with a contents from a slice of the t2 tuple. Slicing works the same way for tuples as for lists:
    t3 = t2[2:3]
  7. Also, as with lists, you can use for loops to iterate the values of tuples:
    for item in t1:
        print('item: ' + item)

PART 2 - Sets

So far, you have been exposed to two structures that are used to contain data: lists and tuples. You can modify the values within a list as well as modify the structure of a list (i.e. add and remove elements), whereby you cannot with a tuple.
In this section, you will learn about sets. A set has similar characteristics as a list, but there are two major differing characteristics:
  • Sets are un-ordered
  • Sets cannot contain duplicate values
Since new duplicate entries will be automatically removed when using sets, they are very useful for performing tasks such as comparisons: finding similarities or differences in multiple sets.
  1. Create some sets to work with in a temporary Python file:
    s1 = {'Prime', 'Ix', 'Secundus', 'Caladan'}
    s2 = {1, 2, 3, 4, 5}
    s3 = {4, 5, 6, 7, 8}
    Note: Sets are defined by using braces { } as opposed to tuples which use parenthesis ( ), or lists which use square brackets [ ]

  2. Try to access a set through the index:
    print(s1[0])
    This should have caused an error. You cannot access data inside a set this way because the elements inside are unordered. Instead, you should use the in method to check to see whether a value is contained in the set:
    print('Ix' in s1)
    print('Geidi' in s1)

    Sets can be combined, but it is important to note that any duplicate values (shared among sets) will be deleted.

  3. Print the contents of the sets and note the values that are common:
    print(s2)
    print(s3)
  4. This is how you get a set containing only UNIQUE values (no duplicates) from both sets:
    print(s2 | s3)         # returns a set containing all values from both sets
    print(s2.union(s3))    # same as s2 | s3
    Notice that both methods above have the same result, which one you choose depends purely on your style.

    Instead of combining sets, we can display values that are common to both sets. This is known in mathematical terms as an intersection between the lists:
    print(s2 & s3)             # returns a set containing all values that s2 and s3 share
    print(s2.intersection(s3)) # same as s2 & s3
  5. Sets can also have their values compared against other sets. First find out what items are in s2 but not in s3. This is also called a difference:
    print(s2)
    print(s3)
    print(s2 - s3)             # returns a set containing all values in s2 that are not found in s3
    print(s2.difference(s3))   # same as s2 - s3
  6. In order to see every difference between both sets, you need to find the symmetric difference. This will return a set that shows all numbers that both sets do not share together:
    print(s2 ^ s3)                     # returns a set containing all values that both sets DO NOT share
    print(s2.symmetric_difference(s3)) # same as s2 ^ s3
    Note: the set() function can convert lists into sets, and the list() function can convert sets into lists. The operations in this section can only be applied to sets, so if you need to perform a union, intersection, or difference between lists, you need to convert them to sets first. For example:
    l2 = [1, 2, 3, 4, 5]
    l3 = [4, 5, 6, 7, 8]
    temporary_set = set(l2).intersection(set(l3))
    new_list = list(temporary_set)  # '''set()''' can make lists into sets. '''list()''' can make sets into lists.
    print(new_list)

Create a Python Script Demonstrating Comparing Sets

Perform the Following Instructions
  1. Create the ~/ops435/lab4/lab4a.py script. The purpose of this script will be to demonstrate the different way of comparing sets. There will be three functions, each returning a different set comparison.
  2. Use the following template to get started:
    #!/usr/bin/env python3
    
    def join_sets(s1, s2):
        # join_sets will return a set that contains every value from both s1 and s2
    
    def match_sets(s1, s2):
        # match_sets will return a set that contains all values found in both s1 and s2
    
    def diff_sets(s1, s2):
        # diff_sets will return a set that contains all different values which are not shared between the sets
    
    if __name__ == '__main__':
        set1 = set(range(1,10))
        set2 = set(range(5,15))
        print('set1: ', set1)
        print('set2: ', set2)
        print('join: ', join_sets(set1, set2))
        print('match: ', match_sets(set1, set2))
        print('diff: ', diff_sets(set1, set2))
  • The join_sets() function should return a set that contains all values from both sets
  • The match_sets() function should return a set that contains all values found in both sets
  • The diff_sets() function should return a set that contains all values which are not shared between both sets
  • All three functions should accept two arguments both are sets
  • The script should show the exact output as the samples
  • The script should contain no errors
Sample Run 1:
./lab4a.py
set1:  {1, 2, 3, 4, 5, 6, 7, 8, 9}
set2:  {5, 6, 7, 8, 9, 10, 11, 12, 13, 14}
join:  {1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}
match:  {8, 9, 5, 6, 7}
diff:  {1, 2, 3, 4, 10, 11, 12, 13, 14}
Sample Run 2 (with import):
import lab4a
set1 = {1,2,3,4,5}
set2 = {2,1,0,-1,-2}
print(lab4a.join_sets(set1,set2))
# Will output {-2, -1, 0, 1, 2, 3, 4, 5}
print(lab4a.match_sets(set1,set2))
# Will output {1, 2}
print(lab4a.diff_sets(set1,set2))
# Will output {-2, -1, 0, 3, 4, 5}
  1. Download the checking script and check your work. Enter the following commands from the bash shell:
    cd ~/ops435/lab4/
    pwd #confirm that you are in the right directory
    ls CheckLab4.py || wget https://raw.githubusercontent.com/Seneca-CDOT/ops435/master/LabCheckScripts/CheckLab4.py
    python3 ./CheckLab4.py -f -v lab4a
  2. Before proceeding, make certain that you identify all errors in lab4a.py. When the checking script tells you everything is OK - proceed to the next step.

Create a Python Script Demonstrating Comparing Lists

Perform the Following Instructions
  1. Create the ~/ops435/lab4/lab4b.py script. The purpose of this script will be to improve the previous script to perform the same joins, matches, and diffs, but this time on lists.
  2. Use the following as a template:
    #!/usr/bin/env python3
    
    def join_lists(l1, l2):
        # join_lists will return a list that contains every value from both l1 and l2
    
    def match_lists(l1, l2):
        # match_lists will return a list that contains all values found in both l1 and l2
    
    def diff_lists(l1, l2):
        # diff_lists will return a list that contains all different values, which are not shared between the lists
    
    if __name__ == '__main__':
        list1 = list(range(1,10))
        list2 = list(range(5,15))
        print('list1: ', list1)
        print('list2: ', list2)
        print('join: ', join_lists(list1, list2))
        print('match: ', match_lists(list1, list2))
        print('diff: ', diff_lists(list1, list2))
  • The match_lists() function should return a list that contains all values found in both lists
  • The diff_lists() function should return a list that contains all values which are not shared between both lists
  • The join_lists() function should return a list that contains all values from both lists
  • All three functions should accept two arguments both are lists
  • The script should show the exact output as the samples
  • The script should contain no errors
Sample Run 1:
./lab4b.py
list1:  [1, 2, 3, 4, 5, 6, 7, 8, 9]
list2:  [5, 6, 7, 8, 9, 10, 11, 12, 13, 14]
join:  [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14]
match:  [5, 6, 7, 8, 9]
diff:  [1, 2, 3, 4, 10, 11, 12, 13, 14]
Sample Run 2 (with import) under interactive python shell:
import lab4b
list1 = [1,2,3,4,5]
list2 = [2,1,0,-1,-2]
print(lab4b.join_lists(list1,list2)))
# Will output [0, 1, 2, 3, 4, 5, -2, -1]
print(lab4b.match_lists(list1,list2))                                                                                                                 
# Will output [1, 2]
print(lab4b.diff_lists(list1,list2))                                                                                                                  
# Will output [0, 3, 4, 5, -2, -1]
3. Download the checking script and check your work. Enter the following commands from the bash shell.
cd ~/ops435/lab4/
pwd #confirm that you are in the right directory
ls CheckLab4.py || wget matrix.senecac.on.ca/~acoatley-willis/CheckLab4.py
python3 ./CheckLab4.py -f -v lab4b
4. Before proceeding, make certain that you identify all errors in lab4b.py. When the checking script tells you everything is OK - proceed to the next step.

PART 3 - Dictionaries

In Python, a dictionary is a set of key-value pairs. Dictionaries are unordered, like sets, however any value can be retrieved from a dictionary if you know the key. This section will go over how to create, access, and change dictionaries, giving you a new powerful tool to store and manipulate data.
Perform the Following Steps:
  1. Let's begin by creating a new dictionary in a temporary Python file:
    dict_york = {'Address': '70 The Pond Rd', 'City': 'Toronto', 'Postal Code': 'M3J3M6'}
    You should note that the syntax to define a dictionary is similar to defining sets (i.e. using {}), but unlike sets dictionaries use key:value pairs within the dictionary, each key:value pair is separated by commas.
  2. All the values in a dictionary can be retrieved by using the dictionary.values() function. This particular function provides a list containing all values:
    print(dict_york.values())
    All keys to access the key:pair values within a dictionary can be retrieved using the dictionary.keys() function:
    dict_york.keys()
    We can retrieve individual values from a dictionary by providing the key associated with the value:
    print(dict_york['Address'])
    print(dict_york['Postal Code'])
  3. Dictionary keys can be any immutable values (i.e. not permitted for value to be changed). Types of values include: strings, numbers, and tuples.
  4. Try adding a new key and value to the dictionary:
    dict_york['Country'] = 'Canada'
    print(dict_york)
    print(dict_york.values())
    print(dict_york.keys())
  5. Let's change the province value to BC:
    dict_york['Province'] = 'BC'
    print(dict_york)
    print(dict_york.values())
    print(dict_york.keys())
    WARNING: Dictionary keys must be unique. Attempting to add a key that already exists in the dictionary will overwrite the existing value for that key! For example:
    dict_york['Province'] = 'ON'
    print(dict_york)
    print(dict_york.values())
    print(dict_york.keys())
    You should notice that value for the 'Province' key has been changed back to 'ON'.

    The lists that contain the values and keys of the dictionary are not real python lists - they are "views of the dictionary" and therefore are immutable. You could change these views into usable lists by using the list() function:
    list_of_keys = list(dict_york.keys())
    print(list_of_keys[0])
  6. Lists can be used with for loops:
    list_of_keys = list(dict_york.keys())
    for key in list_of_keys:
        print(key)
    for value in dict_york.values():
        print(value)

Create a Python Script for Managing Dictionaries

Perform the Following Instructions
  1. Create the ~/ops435/lab4/lab4c.py script. The purpose of this script will be to create dictionaries, extract data from dictionaries, and to make comparisons between dictionaries.
  2. Use the following as a template:
    #!/usr/bin/env python3
    
    # Dictionaries
    dict_york = {'Address': '70 The Pond Rd', 'City': 'Toronto', 'Country': 'Canada', 'Postal Code': 'M3J3M6', 'Province': 'ON'}
    dict_newnham = {'Address': '1750 Finch Ave E', 'City': 'Toronto', 'Country': 'Canada', 'Postal Code': 'M2J2X5', 'Province': 'ON'}
    # Lists
    list_keys = ['Address', 'City', 'Country', 'Postal Code', 'Province']
    list_values = ['70 The Pond Rd', 'Toronto', 'Canada', 'M3J3M6', 'ON']
    
    def create_dictionary(keys, values):
        # Place code here - refer to function specifics in section below
    
    def shared_values(dict1, dict2):
        # Place code here - refer to function specifics in section below
    
    
    if __name__ == '__main__':
        york = create_dictionary(list_keys, list_values)
        print('York: ', york)
        common = shared_values(dict_york, dict_newnham)
        print('Shared Values', common)
  • The script should contain two functions:
create_dictionary()
  1. accepts two lists as arguments keys and values, combines these lists together to create a dictionary
    (Tip: use a while loop to access elements in both the keys and values lists at the same time)
  2. returns a dictionary that has the keys and associated values from the lists
shared_values()
  1. accepts two dictionaries as arguments and finds all values that are shared between the two dictionaries
    (Tip: generate sets containing only values for each dictionary, then use a function mentioned in a previous section to store the values that are common to both lists)
  2. returns a set containing ONLY values found in BOTH dictionaries
  • make sure the functions have the correct number of arguments required
  • The script should show the exact output as the samples
  • The script should contain no errors
Sample Run 1:
./lab4c.py
York:  {'Country': 'Canada', 'Postal Code': 'M3J3M6', 'Address': '70 The Pond Rd', 'Province': 'ON', 'City': 'Toronto'}
Shared Values {'Canada', 'ON', 'Toronto'}
Sample Run 2 (with import):
import lab4c
dict_york = {'Address': '70 The Pond Rd', 'City': 'Toronto', 'Country': 'Canada', 'Postal Code': 'M3J3M6', 'Province': 'ON'}
dict_newnham = {'Address': '1750 Finch Ave E', 'City': 'Toronto', 'Country': 'Canada', 'Postal Code': 'M2J2X5', 'Province': 'ON'}
list_keys = ['Address', 'City', 'Country', 'Postal Code', 'Province']
list_values = ['70 The Pond Rd', 'Toronto', 'Canada', 'M3J3M6', 'ON']

york = lab4c.create_dictionary(list_keys, list_values)

print(york)
# Will print: {'Address': '70 The Pond Rd',
               'City': 'Toronto',
               'Country': 'Canada',
               'Postal Code': 'M3J3M6',
               'Province': 'ON'}

common = lab4c.shared_values(dict_york, dict_newnham)

print(common)
# Will print: {'Canada', 'ON', 'Toronto'}
3. Download the checking script and check your work. Enter the following commands from the bash shell.
cd ~/ops435/lab4/
pwd #confirm that you are in the right directory
ls CheckLab4.py || wget https://raw.githubusercontent.com/Seneca-CDOT/ops435/master/LabCheckScripts/CheckLab4.py
python3 ./CheckLab4.py -f -v lab4c
4. Before proceeding, make certain that you identify all errors in lab4c.py. When the checking script tells you everything is OK proceed to the next step.

INVESTIGATION 2: STRINGS

Strings are basically a list of characters (bits of text). This section will investigate strings in more detail such as cutting strings into sub-strings, joining strings, formatting strings, searching through strings, and matching strings against patterns.

Strings are immutable data objects - this means that once a string is created, it cannot be modified. In order to make a change inside a string, you would first make a copy of the part of the string (i.e. sub-string) for manipulation.

PART 1 - Strings and Substrings

This first part will explain basic concepts of using strings, printing strings, and manipulating sub-strings.
Perform the Following Steps:
  1. Create some strings in a temporary Python file:
    course_name = 'Open System Automation'
    course_code = 'OPS435'
    course_number = 435
    Strings can contain any characters inside them, whether they are letters, numbers, or symbols.
  2. Strings can also be concatenated (i.e. "combined together") by using the + sign, just make sure string are only concatenating strings with strings (no lists, no numbers, no dictionaries, etc.):
    print(course_name)
    print(course_code)
    print(str(course_number))
    print(course_name + ' ' + course_code + ' ' + str(course_number))
    When using the print() function, you can display special characters. One such special character is the is the newline character (denoted by the symbol: \n). This allows you to separate content between new lines or empty lines:
    print('Line 1\nLine 2\nLine 3\n')
  3. Strings have many built-in functions that we can use to manipulate text. Here's a list.
  4. Lets try out several different functions:
    print(course_name.lower())         # Returns a string in lower-case letters
    print(course_name.upper())         # Returns a string in upper-case letters
    print(course_name.swapcase())      # Returns a string with upper-case and lower-case letters swapped
    print(course_name.title())         # Returns a string with upper-case first letter of each word, lowercase for remaining text
    print(course_name.capitalize())    # Returns a string with upper-case first letter only, lowercase for remaining text
  5. These values can be saved inside new strings and then reused:
    lower_name = course_name.lower()    # Save returned string lower-case string inside new string variable
    print(lower_name)
  6. If a string contains many values separated by a single character, such as a space, the string can be split on those values and create a list of values
    lower_name.split(' ')       # Provide the split() function with a character to split on
    The above example will return a list of strings, which we can access just like all of lists.

  7. Let's practice more string manipulation:
    list_of_strings = lower_name.split(' ')     # Split string on spaces and store the list in a variable
    print(list_of_strings)                      # Display list
    print(list_of_strings[0])                   # Display first item in list
    Since lists are actually a list of strings, you should be able to use any function that works with a string on a list:
    list_of_strings[0].upper()           # Use the function after the index to affect a single string within a list
    first_word = list_of_strings[0]
    print(first_word)
    The index that is used to access items within a list, can also be used to access characters within a string. For practice, let's create a new string, and start accessing the strings index:
    course_name = 'Open System Automation'
    course_code = 'OPS435'
    course_number = 435
    print(course_code[0])                          # Print the first character in course_code
    print(course_code[2])                          # Print the third character in course_code
    print(course_code[-1])                         # Print the last character in course_code
    print(str(course_number)[0])                   # Turn the integer into a string, return first character in that string, and print it
    print(course_code[0] + course_code[1] + course_code[2])
  8. You can use a technique that uses index numbers of a string to cut-out or "parse" smaller portions of text within a string. This term is referred to as a substring. We can use this to create a new string or display only a small portion of it:
    print(course_name[0:4])                 # Print the first four characters (values of index numbers 0,1,2, and 3) 
    first_word = course_name[0:4]           # Save this substring for later use
    print(course_code[0:3])                 # Print the first three characters (values of index numbers 0,1,and 2)
  9. The index allows a few extra functions using the same parsing technique:
    course_name = 'Open System Automation'
    print(course_name[12:])                        # Print the substring '12' index until end of string
    print(course_name[5:])                         # Print the substring '5' index until end of string
    print(course_name[-1])                         # Print the last character
    With negative indices, -1 would represent the last character, -2 index would represent the second last character, etc.:
    course_name = 'Open System Automation'
    print(course_name[-1])
    print(course_name[-2])
  10. Practice some of the skills that you have learned in this section:
    course_name = 'Open System Automation'
    print(course_name[-10:])                            # Return the last ten characters
    print(course_name[-10:-6])                          # Try and figure out what this is returning 
    print(course_name[0:4] + course_name[-10:-6])       # Combine substrings together
    substring = course_name[0:4] + course_name[-10:-6]  # Save the combined substring as a new string for later
    print(substring)
  11. The real power found in substrings goes beyond just manually writing index values and getting back words. The next part of this investigation will cover how to search through a string for a specific word, letter, number, and return the index to that search result.

Create a Python Script Demostrating Substrings

Perform the Following Instructions
  1. Create the ~/ops435/lab4/lab4d.py script. The purpose of this script is to demonstrate creating and manipulating strings. There will be four functions each will return a single string.
  2. Use the following template to get started:
    #!/usr/bin/env python3
    # Strings 1
    
    str1 = 'Hello World!!'
    str2 = 'Seneca College'
    
    num1 = 1500
    num2 = 1.50
    
    def first_five():
        # Place code here - refer to function specifics in section below
    
    def last_seven():
        # Place code here - refer to function specifics in section below
    
    def middle_number():
        # Place code here - refer to function specifics in section below
    
    def first_three_last_three():
        # Place code here - refer to function specifics in section below
    
    
    if __name__ == '__main__':
        print(first_five(str1))
        print(first_five(str2))
        print(last_seven(str1))
        print(last_seven(str2))
        print(middle_number(num1))
        print(middle_number(num2))
        print(first_three_last_three(str1, str2))
        print(first_three_last_three(str2, str1))
  • The script should contain four functions (use your own argument names):
first_five():
  1. Accepts a single string argument
  2. Returns a string that contains the first five characters of the argument given
last_seven():
  1. Accepts a single string argument
  2. Returns a string that contains the last seven characters of the argument given
middle_number():
  1. Accepts a integer as a argument
  2. Returns a string containing the second and third characters in the number
first_three_last_three():
  1. Accepts two string arguments
  2. Returns a single string that starts with the first three characters of argument1 and ends with the last three characters of argument2
  • Example: first_three_last_three('abcdefg', '1234567') returns single string 'abc567'
Sample Run 1
./lab4d.py 
Hello
Senec
World!!
College
50
.5
Helege
Send!!
Sample Run 2 (with import)
import lab4d

str1 = 'Hello World!!'
str2 = 'Seneca College'
num1 = 1500
num2 = 1.50

print(lab4d.first_five(str1))
# Will output 'Hello'
print(lab4d.first_five(str2))
# Will output 'Senec'
print(lab4d.last_seven(str1))
# Will output 'World!!'
print(lab4d.last_seven(str2))
# Will output 'College'
print(lab4d.middle_number(num1))
# Will output '50'
print(lab4d.middle_number(num2))
# Will output '.5'
print(lab4d.first_three_last_three(str1, str2))
# Will output 'Helege'
print(lab4d.first_three_last_three(str2, str1))
# Will output 'Send!!'
3. Download the checking script and check your work. Enter the following commands from the bash shell.
cd ~/ops435/lab4/
pwd #confirm that you are in the right directory
ls CheckLab4.py || wget https://raw.githubusercontent.com/Seneca-CDOT/ops435/master/LabCheckScripts/CheckLab4.py
python3 ./CheckLab4.py -f -v lab4d
4. Before proceeding, make certain that you identify all errors in lab4d.py. When the checking script tells you everything is OK - proceed to the next step.

LAB 4 SIGN-OFF (SHOW INSTRUCTOR)

Students should be prepared with all required commands (system information) displayed in a terminal (or multiple terminals) prior to calling the instructor for signoff.


Have Ready to Show Your Instructor:
Output of: ./CheckLab4.py -f -v
Output of: cat lab4a.py lab4b.py lab4c.py lab4d.py

LAB REVIEW

  1. What is the purpose of a tuple? How does a tuple differ from a list?
  2. How do you define elements within a tuple?
  3. Write Python code to confirm if the string 'OPS435' exists within the tuple called courses.
  4. What is the purpose of a set? How do sets differ from lists or tuples?
  5. How do you define elements within a set?
  6. Assuming you have defined two sets called set1 and set2. Write Python code to:
    1. Return a set containing all values of both sets
    2. Returns a set containing all values in set1 that are not found in set2
    3. Return a set containing all values that both sets DO NOT share
  7. What is the purpose of a dictionary?
  8. How do you define elements within a dictionary?
  9. Write Python commands to display for a dictionary called my_dictionary the dictionary key called my_key and a dictionary value for that key?
  10. What is the purpose for the range(), len(), append(), and map() functions for a dictionary?
  11. List and briefly explain the following functions (methods) that can be used with strings:
    lower() , upper() , swapcase() , title() , captilize() , split()
  12. Assume you issued the following command in your ipython3 shell:
    course_name = 'Programming with Python'
    What will be the output for each of the following Python commands?
    1. course_name[3:11]
    2. course_name[10:]
    3. course_name[-1]