Difference between revisions of "OPS235 Lab 6 - CentOS7 - SSD"

From CDOT Wiki
Jump to: navigation, search
Line 259: Line 259:
 
<br><br>
 
<br><br>
 
<ol><li value="7">Give this shell script execute permissions and run this shell script. What do you notice from the report that the shell script generated?</li><li>The the wget command to download, set permissions and run the following script to see the usefulness of arrays: '''URL'''</li></ol>
 
<ol><li value="7">Give this shell script execute permissions and run this shell script. What do you notice from the report that the shell script generated?</li><li>The the wget command to download, set permissions and run the following script to see the usefulness of arrays: '''URL'''</li></ol>
 
 
=== Part 3: Network Connectivity &amp; Network Service Troubleshooting Utilities===
 
 
Troubleshooting network problems is an extremely important and frequent task that a Linux/Unix system administrator performs on a daily basis! Since network services (such as file-server, print-servers, web-servers, and email-servers) depend on network connectivity, as Linux/Unix sysadmin must be able to quickly and effectively pin-point sources of network problems in order to resolve them.
 
 
Network service problems may not be entirely related to a "broken" network connection, but a service that is not running or not running correctly. The following table lists the most common listing of utilities to assist with detection of network connectivity or network service problems to help correct the problem.
 
  
 
{| width="40%" align="right" cellpadding="10"
 
{| width="40%" align="right" cellpadding="10"
Line 296: Line 289:
 
</table>
 
</table>
 
|}
 
|}
 +
=== Part 3: Network Connectivity &amp; Network Service Troubleshooting Utilities===
  
 +
Troubleshooting network problems is an extremely important and frequent task that a Linux/Unix system administrator performs on a daily basis! Since network services (such as file-server, print-servers, web-servers, and email-servers) depend on network connectivity, as Linux/Unix sysadmin must be able to quickly and effectively pin-point sources of network problems in order to resolve them.
  
 +
Network service problems may not be entirely related to a "broken" network connection, but a service that is not running or not running correctly. The following table lists the most common listing of utilities to assist with detection of network connectivity or network service problems to help correct the problem.
  
  

Revision as of 05:31, 16 June 2016

LAB PREPARATION

Setting up networks is an essential operation for a system administrator. Maintaining network connectivity and securing the network are also essential operations for a system administrator. In this lab, we will configure a Virtual Private Network using static IP addresses (eg. wired workstation connections). We will learn how to setup a DHCP network (eg. for notebook, table and smartphones) in lab 8.

Purpose / Objectives of Lab 6

In this lab, you will learn the basics of networking by using your Virtual Machines and your c7host machine. You will first set up a virtual private network among those machines. In addition, you will learn to set up network names (to associate with server's IP Addresses), associate network services with port numbers for troubleshooting purposes, and setup firewall policies via the iptables command.

Main Objectives

  1. Configure a private (virtual) network for your VMs and your c7host machine
  2. Configure network interfaces for your Virtual Machines using both graphical and command-line utilities.
  3. Use local hostname resolution to resolve simple server names with their corresponding IP Addresses
  4. Backup more recent files (eg. incremental backup) using the find command and a date/time-stamp file
  5. Use common networking utilities to associate network services with port numbers for troubleshooting purposes
  6. Gain initial exposure to the iptables command used to configure and maintain a firewall for protection and troubleshooting
  7. Configure iptables to allow/disallow/forward different types of network traffic


Minimum Required Materials
Linux Command Reference
Solid State Drive
USB key
(for backups)
Lab6 Log Book


Networking Utilities

ifconfig
system-config-network
route
ping
arp
netstat
iptables

Additional Utilities

find
tail
cp

INVESTIGATION 1: CONFIGURING A VIRTUAL PRIVATE NETWORK (VPN)

For the remainder of this course, we will focus on networking involving our VMs and our c7host machine. This lab will focus on setting up a virtual private network (VPN), connecting our VMs and c7host machine to the VPN, and configuring our VPN to make more convenient to use, troubleshoot and protect. Lab 7 will focus more on configuring SSH and making access to the VPN more secure. Finally, lab 8 will focus on configuring the network for fixed workstations, mobile devices, or both at the same time.

There are several reasons for creating VPNs. The main reason is to safely connect servers together (i.e. to safely limit but allow share information among computer network users). This allows for a secure connection of computers yet controlling access to and monitoring (protecting) access to permitted users (discussed in more depth in lab7).


This diagram shows the current network configuration of your c7host machine in relation to your Virtual Machines. In this section, you will be learning to change the default network settings for both your c7host machine and VMs to belong to a virtual network using fixed IP Addresses.

Part 1: Configuring a Private Network (Via Virtual Machine Manager)

If we are going to setup a private network, we must do 2 major operations: First, define a new private network in the Virtual Manager application; and second, configure each of our VMs to connect to this new private network. In Part 1, we will be perform the first operation. In parts 2, 3, and 4, we will be performing the second operation for all VMS (graphical and command-line).

Perform the following steps:

  1. Perform this section in your c7host machine.

    NOTE: Before configuring our network we want to turn off dynamic network configuration for our Virtual Machines by turning off the "default" virtual network. We will then define our virtual private network. Follow the steps in order to perform these operations.

  2. Make certain that ALL virtual machines are powered off.
  3. In the Virtual Machine Manager dialog box, Select Edit-> Connection Details.
  4. In the c7host Connection Details dialog box, select the Virtual Networks tab
  5. Disable the default configuration from starting at boot by deselecting Autostart (on boot) check-box and click the Apply button.
  6. Then Stop the default network configuration by clicking on the stop button at the bottom left-side of the dialog box.
  7. Click the add button (the button resembles a "plus sign") to add a new network configuration.
  8. Give your new network a name (i.e. network1) then click the Forward button.
  9. In the next screen, enter in the new network IP address space:
    192.168.235.0/24
  10. Disable DHCP4 by deselecting the check box and click the Forward button twice (accepting the defaults).
  11. Enable Network Forwarding by Selecting Forwarding to physical network, the destination should be Any physical device and the mode should be NAT
  12. Proceed with changes, and click Finish.
  1. We will now reconfigure each of our VMs to use our new virtual network network1
    1. Let's start with our centos1 VM. Double-click on your centos1 VM, but instead of running the VM, click on the view menu, and select: Details
      (Note: the Virtual Machine window will appear - do not start virtual machine)
    2. In the left pane of the Virtual Machine window, select NIC: and note that this NIC is on the "default" virtual network
    3. Change it to Virtual Network network1: NAT (i.e. the VPN that you just created) and click the Apply button.
  2. Repeat the same steps for your centos2 and centos3 VMs!


File:Network dialog.png
Although the private network has been setup via the Virtual Machine Manager, each virtual machine requires to change its own network setting individually (either graphically or by command line).

Part 2: Configuring Network For centos1 & centos2 VMs

In this section, we will be using a graphical tool to connect our centos1 and centos2 VMs to our private network.

Perform the following steps:

  1. On your c7host machine, run ifconfig and make note of the IP address assigned to the virbr1 (i.e. "Virtual Bridge) interface. This will be the default gateway and DNS server for your VMs.
  2. Start your centos1 VM and login.
  3. Within your centos1 VM, click Applications menu, then select System Tools, and then Settings.
  4. In the Settings Dialog Box, click on the Network icon.
  5. For the Wired connection, click the settings button (The icon appears as a gear located at the bottom right-hand corner of the dialog box).
  6. Select the IPv4 tab. Change Address from Automatic (DHCP) to Manual.
  7. Edit the existing wired connection, using the information displayed below:
  8. In the IPv4 Settings tab change the method from "Automatic (DHCP)" to "Manual".
  9. In the Addresses section, enter the following information:
    IP Address: 192.168.235.11
    Subnet Mask: 255.255.255.0
    Default Gateway: The IP address of virbr1 on your centos host.
  10. Click on the DNS' field and add The IP address (virbr1 on your centos host) as the primary DNS server.
  11. When finished, check your settings, and then click the Apply button.
  12. Open a terminal and issue the ifconfig command to confirm the IP ADDRESS settings change.
  13. Verify that centos1VM is now connected to the VPN by issuing the following command from your c7host machine:
    ping 192.168.235.11
  14. Switch to your centos2 VM.
  15. Run the network configuration tool and enter the following static configuration for your centos2 VM:
    • IP Address: 192.168.235.12
    • Subnetmask: 255.255.255.0
    • Default Gateway: 192.168.235.1
    • DNS Server: 192.168.235.1
  16. Save and exit the network configuration tool.
  17. You may have to restart the network using the correct command.
  18. Verify the configuration by pinging the other VMs and c7host using their IP addresses.


File:Network-config.png
Although you can use the ifconfig command to temporarily create a static IP address connection to a network, you need to add the network settings in the /etc/sysconfig/network-scripts directory to automatically connect to the network upon Linux system boot-up.

Part 3: Configuring VM Network Setup via Command Line (centos3)

Our centos3 VM is a text-based only system, thus we cannot use a graphical tool to configure centos3 to connect to our private network. Therefore we will learn how to perform this task by using command-line tools.

Perform the following steps:

  1. Leave your centos1 and centos2 VM running, but start your centos3 VM, login, and su to root.
  2. Use the command ifconfig to list active interfaces, you should see one with a name of eth0 or a similar name.
  3. To configure your card with a static address use the following command:
    ifconfig eth0 192.168.235.13 netmask 255.255.255.0
  4. To configure a default gateway for that interface enter the command:
    route add default gw 192.168.235.1
  5. To configure a DNS server for this VM, edit the file /etc/resolv.conf. Change the nameserver line to read:
    nameserver 192.168.235.1
  6. Save your editing session.
  7. Confirm your settings work by doing the following (you might need to do the steps 3 and 4 a few times before it works; keep checking with the commands below and wait a bit before each attempt):
    ifconfig
    route -n
    ping (your other VM's and c7host)
    ssh ( to your Seneca's Matrix account to test your DNS)
  8. Restart the centos3 VM, or just wait a few minutes.
  9. Login and test your configuration again. What happened?
  10. While we can configure network settings from the command line those settings are not persistent. To configure persistent network configurations we need to edit the configuration files.
  11. Change to the /etc/sysconfig/network-scripts directory
    This diagram should show the newer network configuration of your c7host machine in relation to your Virtual Machines.
  12. List the contents of this directory. You should see 2 different types of files, network config scripts and network configuration files.
  13. Look for the configuration file for your original interface, it should be named ifcfg-eth0
  14. Edit the new file for you interface and give it the following settings (or create a brand new file, might be easier than editing the old one):
    DEVICE="eth0"
    IPADDR="192.168.235.13"
    NETMASK="255.255.255.0"
    GATEWAY="192.168.235.1"
    HWADDR="52:54:00:3f:5c:fa" <-- DO NOT COPY THIS VALUE! Use MAC address for YOUR interface using: ifconfig eth0
    DNS1="192.168.235.1"
    BOOTPROTO="static"
    ONBOOT="yes"
    NM_CONTROLLED="yes"
    IPV6INIT="no"
  15. Save the file and then restart the network connection by issuing the commands: ifdown eth0 and then ifup eth0
  16. Verify your configuration as you did before.
  17. Restart the centos3 VM.
  18. Login and attempt to ssh to your matrix account to verify the settings.

Answer INVESTIGATION 1 observations / questions in your lab log book.


INVESTIGATION 2: MANAGING YOUR NEWLY-CREATED NETWORK

Connecting a private network is an important task, but a system administrator also needs to manage the network to make it convenient to use, make it safer from unauthorized access, and troubleshoot network connectivity problems.

This investigation will expose you to useful "tweaks" and utilities to help accomplish this task. Lab 7 requires that you understand these concepts and have a good general understanding how to use these troubleshooting utilities (like netstat and iptables).

Note.png
Hosts files vs. the Domain Name System
On large public networks like the Internet or even large private networks we use a network service called Domain Name System (DNS) to resolve the human friendly hostnames like centos.org to the numeric addresses used by the IP protocol. On smaller networks we can use the /etc/hosts on each system to resolve names to addresses.

Part 1: Using /etc/host File for Local Hostname Resolution

After setting up a private network, it can be hard to try to remember IP addresses. In this section, we will setup your network to associate easy-to-remember server names with IP ADDRESSES.

Perform the following steps:

  1. Complete this investigation on all of your VMs and the c7host machine.
  2. Use the hostname and ifconfig commands on your c7host machine and all of your 3 VM's to gather the information needed to configure the /etc/hosts file on all of your Linux systems.
  3. Edit the /etc/hosts file on each of the virtual machines and host machine. Add the following contents to the bottom of the /etc/hosts file:

    192.168.235.1 c7host
    192.168.235.11 centos1
    192.168.235.12 centos2
    192.168.235.13 centos3

  4. Confirm that each host can ping all three of the other hosts by name.
Idea.png
Bash Shell Scripting Tips:

Arrays

  • Incredibly useful tool that works like a "storage container" of variables. Arrays have names like variables, but are numbered for quick storage and access of related elements. Indices are I.D. numbers for array access. The first index starts at zero instead of 1.

  • Instead of using index numbers, you can use I.D. names: this is referred to as an Associative Array.

  • Examples:

    for((x=0; x<5; x++)) # Example of a regular array
    do
      read -p "Enter item #$((x+1)): " item[xx]
    done
    for((y=0; y<5; y++))
    do
      echo ${item[y]}
    done

    set a b c # Example of an "Associative Array"
    for x
    do
      read -p "Enter item $x: " item["$x"]
      echo item[$x] is: ${item["$x"]}
    done

Working with Temporary Files

  • When creating temporary files, it is important NOT to store on a user's account (to avoid overwriting their existing files). Instead, temporary files can be created in the /tmp directory.

  • The $$ variable can be used as the filename extension which assigns the current PID of the shell script running to make the filename unique, and allow easy removal at the end of the shell script by deleting ALL files in the /tmp directory with the extension: .$$

  • Example:

    ls -lR > /tmp/temp-file.$$
    grep secret /tmp/temp-file.$$
    rm /tmp.$$

Part 2: Using Arrays to Collect VM Network Information

We finish shell scripting by using arrays by reading and storing networking information for each VM (centos1, centos2, and centos3) to be stored in a report in your c7host machine. We will use the ssh command in order to grab the network information (one VM at a time), and store the network setup into an Associative array in our c7host machine.

If you do not entirely understand the script that you will enter, just realize that we are using these "special storage variables" in order to make this work.

Perform the following steps:

  1. Perform this section in your c7host machine.
  2. Open a shell terminal and login as root.
  3. Change to the /root/bin directory.
  4. Using a text editor, create a Bash shell script called network-info.bash and enter the following content below:


#!/bin/bash

# Author: *** INSERT YOUR NAME ***
# Date: *** CURRENT DATE ***
#
# Purpose: Creates system info report
#
# USAGE: ./myreport.bash

if [ $USER != "root" ] # only runs if logged in as root
then
 echo "You must be logged in as root." >&2
 exit 1
fi

  1. We will now use an Associative Array along with the ssh command in order to get and store networking configuration from the centos1, centos2, and centos3 VMs. Add the following content to your shell script editing session:


set centos1 centos2 centos3
for x
do
 read -p "Enter regular username for \"$x\" server: " userName[$x]
 ssh ${userName[$x]}@$x "cat /etc/network/interfaces" > /tmp/network-$x.$$

 index=0 # load each line into an array for VM
 while read line
 do<br<    $x[$index]="$line"
   index=$(($index+1))
 done < /tmp/network-$x.$$
done

  1. Finally, we will use a loop to printout the results of the data (stored in the Associative Arrays) in a report file called: /root/network-info.txt The command at the end is a trick to remove all temporary files that have the same extension as the current PID number, therefore, it is unique. Add the following content to your shell script editing session:


for x
do
 echo "Network Information for: \"$x\":" > /root/network-info.txt
 printf '%s\n' "${$x[@]}" | tail -n +2 > /root/network-info.txt
 echo > /root/network-info.txt
done

rm /tmp/*.$$


  1. Give this shell script execute permissions and run this shell script. What do you notice from the report that the shell script generated?
  2. The the wget command to download, set permissions and run the following script to see the usefulness of arrays: URL
Common Network Troubleshooting Tools
Purpose Command(s)
Network Connectivity ping localhost
ping IPADDR
arp -n
ifconfig
Network Service Status netstat -nautp
netstat -nautp
netstat -nautp
Firewall Status
(packet filtering)
iptables -L
iptables -F
iptables

Part 3: Network Connectivity & Network Service Troubleshooting Utilities

Troubleshooting network problems is an extremely important and frequent task that a Linux/Unix system administrator performs on a daily basis! Since network services (such as file-server, print-servers, web-servers, and email-servers) depend on network connectivity, as Linux/Unix sysadmin must be able to quickly and effectively pin-point sources of network problems in order to resolve them.

Network service problems may not be entirely related to a "broken" network connection, but a service that is not running or not running correctly. The following table lists the most common listing of utilities to assist with detection of network connectivity or network service problems to help correct the problem.


Perform the following steps:

  1. Perform this section on your c7host machine.
  2. x


File:Iptable-chains.png
When using iptables packets must pass-through "a chain of policy rules" in order to handle packets. If a packet matches a rule, then an action is taken (some examples include: ACCEPT, DROP, REJECT, or LOG); otherwise, the packet will be directed to the default policy chain.

Using Firewalls in Linux (iptables)

Since Linux servers may be connected to the Internet, it is very important to run a firewall to control what comes into the computer system, what goes out of the computer system, and what may be forwarded to another computer. A utility called iptables can be used to set the firewall rules on a Linux server.

Basically, there is a list (chain) of policy rules that packets must pass-through in order to handle packets. If a packet matches a rule, then an action is taken (some examples include: ACCEPT, DROP, REJECT, or LOG). If the packet passes through the chain of rules without a match, then the packet is directed to the default policy chain (for example: ACCEPT, REJECT, or DROP).

You can create your own customized chains (which you will learn in OPS335 course) but to keep thing simple, we only deal with 3 common predefined chains:

  • INPUT: Packets coming into current Linux server
  • OUTPUT: Packets leaving current Linux server
  • FORWARD: Packets being routed between Linux servers

Perform the following steps:

  1. Issue the following command to list the existing iptables policy rules: iptables -L.
  2. Were there already iptables policy rules that already existed by default?
  3. Issue the following command to reset the iptables policy rules: iptables -F.
  4. Issue a command to list the existing iptables policy rules to verify they have been reset.


Setting Default Policy and Policy Exceptions with iptables

x

Perform the following steps:

  1. x


Backing up iptables Rules

x

Perform the following steps:

  1. x


Making iptables Policies Persistent

x

Perform the following steps:

  1. Make a backup of the file /etc/sysconfig/iptables by issuing the command:
    iptables-save > /etc/sysconfig/iptables.bk
  2. To make the iptables rules persistent (i.e. keeps rules when system restarts), you issue the command:
    iptables-save > /etc/sysconfig/iptables
  3. Verify that the file /etc/sysconfig/iptables exists.
  4. Restart your iptables service and test your configuration.


Answer INVESTIGATION 2 observations / questions in your lab log book.


LAB 6 SIGN-OFF (SHOW INSTRUCTOR)

Important.png
Time for a new backup!
If you have successfully completed this lab, make a new backup of your virtual machines as well as your host machine.

Perform the Following Steps:

  1. Switch to your c7host VM.
  2. Issue the Linux command: wget http://matrix.senecac.on.ca/~murray.saul/ops235/lab5-check.bash
  3. Give the lab6-check.bash file execute permissions (for the file owner).
  4. Run the shell script and if any warnings, make fixes and re-run shell script until you receive "congratulations" message.
  5. Arrange proof of the following on the screen:
    centos2 VM:
    • ssh from centos2 to c7host VM.
    All VMs:
    • ifconfig information
    • Contents of /etc/hosts file
    c7host machine
    • arp cache information
    • A list of your iptables rules
    • Output from running the network-info.bash shell script
    • Output from running the lab6-check.bash script with all OK messages
    Lab6 log-book filled out.

Practice For Quizzes, Tests, Midterm & Final Exam

  1. What is a port?
  2. What command will set your IP configuration to 192.168.55.22/255.255.255.0 ?
  3. What file contains the systems iptables rules?
  4. What is the difference between UDP and TCP?
  5. What port number is used for DHCP servers?
  6. What is the function of the file /etc/services ?
  7. What is the function of the file /etc/hosts ?
  8. What is the purpose of the file /etc/sysconfig/network-scripts/ifcfg-eth0 ?
  9. What tool is used to show you a list of current TCP connections?