Changes

Tutorial9: Regular Expressions

59 bytes removed, 21:23, 30 October 2021

m

→‎INVESTIGATION 2: EXTENDED REGULAR EXPRESSIONS

=INVESTIGATION 1: SIMPLE & COMPLEX REGULAR EXPRESSIONS=

'''ATTENTION''': Depending on your ULI101 ~~instruction~~instructor, you may be required to complete this tutorial for '''marks ''' in ~~the~~ this course. Please refer to your instructor's course notes ~~in terms of marked assigned to the~~ and lecture notes regarding evaluation for this course. The due date for successfully completing this tutorial (i.e. '''tutorial 9''') is by '''Friday by midnight''' next week (i.e. '''Week 9'''). If your instructor has NOT assigned marks for completing this tutorial, you can perform it for '''practice ~~purposes~~'''.

In this investigation, you will learn how to use the '''grep''' command with '''simple and complex regular expressions''' to help search for ''patterns'' contained in text files.

# Issue the following Linux pipeline command to display only '''signed''' integers: grep "^[+-][0-9][0-9]*$" numbers1.dat | tee signed.txt What did you notice? Positive and negative numbers display, not '''unsigned''' numbers. [[Image:regexps-8.png|thumb|right|300px|Simultaneous '''anchoring''' of regular expressions using '''character class''' and '''zero or more occurrences''' to display '''signed''' and '''unsigned''' integers.]]

# Issue the following Linux pipeline command to display '''signed''' or '''unsigned integers''': grep "^[+-]*[0-9][0-9]*$" numbers1.dat | tee all.txt Did this command work?

# Issue the following command to check that you created those hard links: ~~bash /home/murray.saul/myscripts~~~uli101/week9-check-1 If you encounter errors, then view the feedback to make corrections, and then re-run the checking script. If you receive a congratulation message that there are no errors, then proceed with this tutorial. You can also use the '''grep''' command using ''regular expression'' as a '''filter''' in pipeline commands.

# Issue the following Linux pipeline command: ls | grep "[0-9].*dat$" What did this pipeline display?

# Issue the following Linux pipeline command: ls | grep "[a-z].*txt$" What did this pipeline display?

# View the contents of the '''numbers2.dat''' file using the '''more''' command and quickly view the contents of this file. You should notice ''valid'' and ''invalid'' numbers contained in this file. When finished, exit the more command. [[Image:eregexps-1.png|thumb|right|300px|'''Weakness''' of '''complex''' regular expressions that do not '''limit''' the number of '''positive''' or '''negative''' signs.]]

# Issue the following Linux command to display '''signed''' or '''unsigned integers''': grep "^[+-]*[0-9][0-9]*$" numbers2.dat You should notice '''multiple''' '''+''' or '''-''' '''signs''' appear prior to some numbers. This occurs since you are searching or one or MORE occurrences of a + or - sign. Using '''extended regular expression''' symbols to specify '''minimum''' and '''maximum''' repetitions: '''{min,max}''' can solve that problem.

# Issue the following Linux command (using extended regular expression symbols) to display '''signed''' or '''unsigned integers''': grep "^[+-]{0.,1}[0-9]{1,}$" numbers2.dat '''NOTE: No output will be displayed! Why?''' This is due to the fact that the '''grep command was NOT issued correctly to use extended regular expression symbols'''. You would need to issue either '''grep -E''', or just issue the '''egrep''' command. The egrep command works with '''all''' regular expression symbols, and should be used in the future instead of the older grep command. We will use '''pipeline commands''' to both display stdout to the screen and save to files for confirmation of running these pipeline commands when run a '''checking-script''' later in this investigation.

# Issue the following Linux pipeline command using '''egrep''' instead of ''grep'': egrep "^[+-]{0,1}[0-9]{1,}$" numbers2.dat | tee better-number1.txt [[Image:eregexps-2.png|thumb|right|300px|Using '''extended''' regular expression symbols (such as '''repetition''') to refine matches of ''signed'' and ''unsigned'' integers.]]You should have noticed that the command worked correctly this time because you used the '''egrep''' command. '''NOTE:''' With extended regular expressions, the '''?''' symbol can be used to represent the '''{0,1}''' repetition symbols and the '''+''' symbol can be used to represent the '''{1,}''' repetition symbols

# Issue the following Linux pipeline command using the repetition shortcuts "+" and "?": egrep "^[+-]?[0-9]+$" numbers2.dat | tee better-number2.txt You should have seen the '''same results''', but less typing was required.

# Issue the following Linux pipeline command to display '''signed''', '''unsigned''', '''whole''', and '''decimal''' numbers: egrep "^[+-]{0,1}[0-9]{1,}[.]{0,1}[0-9]*$" numbers2.dat | tee better-number3.txt Were all signed and unsigned intergers and decimal numbers displayed?

# Issue the follwoing command to check that you correctly issued those ''Linux pipeline commands'': ~~bash /home/murray.saul/myscripts~~~uli101/week9-check-2 If you encounter errors, then view the feedback to make corrections, and then re-run the checking script. If you receive a congratulation message that there are no errors, then proceed with this tutorial. You can also use extended regular expression symbols for '''grouping'''. For example, you can search for repetitions of GROUPS of characters (like a word) as opposed to just a single character or a GROUP of numbers as opposed to a single digit.

# Issue the following linux pipeline command to download another data file called '''words.dat''': wget <nowiki>https://ict.senecacollege.ca/~murray.saul/uli101/words.dat</nowiki>

# View the contents of the '''words.dat''' file using the '''more''' command and quickly view the contents of this file. Within this file, you should notice some lines that contain repetitions of words. When finished, exit the more command.

# Reissue the previous pipeline command with the word the followed by a '''space''' within the brackets: egrep -i "(the ){2,}" words.dat | tee word-search2.txt [[Image:eregexps-3.png|thumb|right|330px|Using '''extended''' regular expression symbols (such as '''grouping''') to refine matches of repetition of '''words''' (as opposed to ''characters'').]]The "|" (or) symbol (same symbol as "pipe") can be used within the grouping symbols to allow matching of additional groups of characters. Again, it is important to follow the character groupings with the space character

# Issue the following linux pipeline command to search for '''two or more occurrences''' of the word "'''the '''" or '''two or more occurrences''' of the word "'''and '''": egrep -i "(the |and ){2,}" words.dat | tee word-search3.txt

# Issue the following Linux command to check that you correctly issued those ''Linux pipeline commands'' using the '''tee''' command to create those text files: ~~bash /home/murray.saul/myscripts~~~uli101/week9-check-3 If you encounter errors, then view the feedback to make corrections, and then re-run the checking script. If you receive a congratulation message that there are no errors, then proceed with this tutorial. Let's issue a Linux '''pipeline''' command using the '''egrep''' command as a '''filter''' using both '''complex''' and '''extended''' regular expressions.

# Issue the following Linux pipeline command: ls | egrep "[a-z]{1,}.*[0-9]" What did this Linux pipeline command display?

: The '''grep''' and '''egrep''' Linux commands are NOT the only Linux commands that use regular expressions. In the next investigation, you will apply regular expressions to a number of Linux commands that you already learned in this course.

Ahadalioglu

572

edits

Changes

Tutorial9: Regular Expressions

Navigation menu

Personal tools

Namespaces

Variants

Views

More

Search

Navigation

get involved with CDOT

courses

course projects

links

Tools