Difference between revisions of "Fedora Arm Secondary Architecture/Storage performance"

From CDOT Wiki
Jump to: navigation, search
(Goal)
 
(47 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[Category:Fedora ARM Secondary Architecture]]
+
[[Category:Fedora ARM Secondary Architecture]][[Category:Winter 2010 SBR600]]
 +
= Goal =
  
There are a couple of steps you must perform to be able to use the NFS share on hong kong.
+
To test the performance of various storage solutions for the [[Fedora ARM Secondary Architecture/ARM hardware|ARM hardware]] devices.
  
1. Edit your "/etc/fstab" and change the following lines file system to "auto" from "nfs"
+
= Performance Results =
"/dev/root              /                      nfs    defaults        1 1"
 
  
2. Use yum to install "rpcbind" and "nfs-utils" and make sure that the "rpcbind" and "nfs" services are started at boot.
+
===USB PATA===
  
3. Create a folder where you would like to mount the NFS share. In these examples i will be using "/nfsshare" as the mounting point.
+
Version 1.03e      ——Sequential Output—— –Sequential Input- –Random-
 +
 +
-Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks–
 +
 +
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
 +
 +
fedora-arm      2G  5768  96 28790  24 12380  11  5936  96 25991  10 121.0  0
 +
 +
——Sequential Create—— ——–Random Create——–
 +
 +
-Create– –Read— -Delete– -Create– –Read— -Delete–
 +
 +
files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
 +
 +
16 12640  97 +++++ +++ 22387  99 10765  82 +++++ +++ 21615 100
 +
 +
fedora-arm,2G,5768,96,28790,24,12380,11,5936,96,25991,10,121.0,0,16,12640,97,+++++,+++,22387,99,10765,82,+++++,+++,21615,100
  
4. Run the command "mount 192.168.122.1:/var/www/html/yum/arm_built /nfsshare" to test that you can successfully mount the share. Where ever I use this directory, replace it with the mount point of your choice
+
 +
===NFS===
 +
 +
Version 1.03e      ——Sequential Output—— –Sequential Input- –Random-
 +
 +
-Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks–
 +
 +
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
 +
 +
fedora-arm      2G  5605  92 43362  16 20478  53  5619  98 51789  85  1201  35
 +
 +
——Sequential Create—— ——–Random Create——–
 +
 +
-Create– –Read— -Delete– -Create– –Read— -Delete–
 +
 +
files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
 +
 +
16    50  0  3480  27    55  1    49  0  3948  26    53  0
 +
 +
fedora-arm,2G,5605,92,43362,16,20478,53,5619,98,51789,85,1200.7,35,16,50,0,3480,27,55,1,49,0,3948,26,53,0
 +
  
5. If it mounts correctly it will give no output. Run the "mount" command to check that it has been successful.
+
===iSCSI===
  
6. Add the following line to "/etc/fstab" to auto mount the share every time the VM boots.
+
Version 1.03e      ------Sequential Output------ --Sequential Input- --Random-
 +
 +
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
 +
 +
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
 +
 +
fedora-arm      2G  4923  82 31503  30  1827  3  5537  96 59147  84  2514  44
 +
 +
------Sequential Create------ --------Random Create--------
 +
 +
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
 +
 +
files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
 +
 +
16 11785  92 +++++ +++ 21841  99 12533  98 +++++ +++ 21201 100
 +
 +
fedora-arm,2G,4923,82,31503,30,1827,3,5537,96,59147,84,2514.5,44,16,11785,92,+++++,+++,21841,99,12533,98,+++++,+++,21201,100
  
"192.168.122.1:/var/www/html/yum/arm_built /nfsshare nfs defaults 0 0"
+
==Summary==
  
7. Reboot your vm to make sure the nfs share is properly mounted at boot. To restart your vm log into hongkong as root and run the following commands. As an example i will use arm-001-002, replace this with your VM.
+
=== Write ===
  
#virsh destory arm-001-002
+
{| border="1" cellspacing="0" width="50%"
#virsh start arm-001-002
+
 
 +
|-
 +
 
 +
!
 +
 
 +
!Transfer Speed
 +
 
 +
!Percentage Increase
 +
 
 +
!CPU Usage
 +
 
 +
!Percentage Increase
 +
 
 +
|-
 +
|align="center"|PATA
 +
|align="center"|28,790 KB/s
 +
|align="center"|0%
 +
|align="center"|24%
 +
|align="center"|0%
 +
|-
 +
 
 +
|-
 +
|align="center"|NFS
 +
|align="center"|43,363 KB/s
 +
|align="center"|50%
 +
|align="center"|16%
 +
|align="center"|-50%
 +
|-
 +
 
 +
|-
 +
|align="center"|iSCSI
 +
|align="center"|31,503 KB/s
 +
|align="center"|9%
 +
|align="center"|30%
 +
|align="center"|25%
 +
|-
 +
|}
 +
 
 +
=== Read ===
 +
 
 +
{| border="1" cellspacing="0" width="50%"
 +
 
 +
|-
 +
 
 +
!
 +
 
 +
!Transfer Speed
 +
 
 +
!Percentage Increase
 +
 
 +
!CPU Usage
 +
 
 +
!Percentage Increase
 +
 
 +
|-
 +
|align="center"|PATA
 +
|align="center"|25,991 KB/s
 +
|align="center"|0%
 +
|align="center"|10%
 +
|align="center"|0%
 +
|-
 +
 
 +
|-
 +
|align="center"|NFS
 +
|align="center"|51,789 KB/s
 +
|align="center"|99%
 +
|align="center"|85%
 +
|align="center"|850%
 +
|-
 +
|-
 +
|align="center"|iSCSI
 +
|align="center"|59,147 KB/s
 +
|align="center"|127%
 +
|align="center"|84%
 +
|align="center"|840%
 +
|-
 +
|}
 +
 
 +
= iSCSI =
 +
 
 +
== Initiator config ==
 +
 
 +
Host is OpenRD
 +
 
 +
# Install the iscsi-initiator-utils package.
 +
# Placed "InitiatorName=iqn.2000-10.ca.on.senecac.hongkong" in /etc/iscsi/initiatorname.iscsi
 +
# Start the iscsi and iscsid services.
 +
# Discover the remote targets: iscsiadm -m discovery -t sendtargets -p hongkong:3260
 +
# List the targets: iscsiadm -m node -- the remote target(s) should be shown.
 +
# Login to the targets: iscsiadm -m node -l
 +
# You will now have an additional scsi disk device. Use this as one element of a RAID-1 array, using local storage (an LV or a looped-back file) as the other element.
 +
# Mount the new RAID-1 array and create a filesystem on it. Place some files there.
 +
# Unmount the filesystem, stop the array, log out of the iSCSI disk (iscsiadm -m node -u).
 +
# Verify that the filesystem can be locally read on the machine hosting the target.
 +
 
 +
== PATA/USB Config ==
 +
 
 +
* PATA drive connected via USB
 +
* Device is /dev/sda1 if no other storage is connected
 +
 
 +
== Target Config ==
 +
 
 +
* Host is HongKong
 +
* IQN is "InitiatorName=iqn.2000-10.ca.on.senecac.hongkong"
 +
* Target is "target0" which is connected to the LV HongKong/arm1iscsi, size 100GB
 +
 
 +
== Results ==
 +
 
 +
See [[Fedora ARM Secondary Architecture/iSCSI]] for note on problems encountered using iSCSI.

Latest revision as of 15:13, 17 April 2010

Goal

To test the performance of various storage solutions for the ARM hardware devices.

Performance Results

USB PATA

Version 1.03e       ——Sequential Output—— –Sequential Input- –Random-

-Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks–

Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP

fedora-arm       2G  5768  96 28790  24 12380  11  5936  96 25991  10 121.0   0

——Sequential Create—— ——–Random Create——–

-Create– –Read— -Delete– -Create– –Read— -Delete–

files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP

16 12640  97 +++++ +++ 22387  99 10765  82 +++++ +++ 21615 100

fedora-arm,2G,5768,96,28790,24,12380,11,5936,96,25991,10,121.0,0,16,12640,97,+++++,+++,22387,99,10765,82,+++++,+++,21615,100


NFS

Version 1.03e       ——Sequential Output—— –Sequential Input- –Random-

-Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks–

Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP

fedora-arm       2G  5605  92 43362  16 20478  53  5619  98 51789  85  1201  35

——Sequential Create—— ——–Random Create——–

-Create– –Read— -Delete– -Create– –Read— -Delete–

files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP

16    50   0  3480  27    55   1    49   0  3948  26    53   0

fedora-arm,2G,5605,92,43362,16,20478,53,5619,98,51789,85,1200.7,35,16,50,0,3480,27,55,1,49,0,3948,26,53,0

iSCSI

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-

-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--

Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP

fedora-arm       2G  4923  82 31503  30  1827   3  5537  96 59147  84  2514  44

------Sequential Create------ --------Random Create--------

-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--

files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP

16 11785  92 +++++ +++ 21841  99 12533  98 +++++ +++ 21201 100

fedora-arm,2G,4923,82,31503,30,1827,3,5537,96,59147,84,2514.5,44,16,11785,92,+++++,+++,21841,99,12533,98,+++++,+++,21201,100

Summary

Write

Transfer Speed Percentage Increase CPU Usage Percentage Increase
PATA 28,790 KB/s 0% 24% 0%
NFS 43,363 KB/s 50% 16% -50%
iSCSI 31,503 KB/s 9% 30% 25%

Read

Transfer Speed Percentage Increase CPU Usage Percentage Increase
PATA 25,991 KB/s 0% 10% 0%
NFS 51,789 KB/s 99% 85% 850%
iSCSI 59,147 KB/s 127% 84% 840%

iSCSI

Initiator config

Host is OpenRD

  1. Install the iscsi-initiator-utils package.
  2. Placed "InitiatorName=iqn.2000-10.ca.on.senecac.hongkong" in /etc/iscsi/initiatorname.iscsi
  3. Start the iscsi and iscsid services.
  4. Discover the remote targets: iscsiadm -m discovery -t sendtargets -p hongkong:3260
  5. List the targets: iscsiadm -m node -- the remote target(s) should be shown.
  6. Login to the targets: iscsiadm -m node -l
  7. You will now have an additional scsi disk device. Use this as one element of a RAID-1 array, using local storage (an LV or a looped-back file) as the other element.
  8. Mount the new RAID-1 array and create a filesystem on it. Place some files there.
  9. Unmount the filesystem, stop the array, log out of the iSCSI disk (iscsiadm -m node -u).
  10. Verify that the filesystem can be locally read on the machine hosting the target.

PATA/USB Config

  • PATA drive connected via USB
  • Device is /dev/sda1 if no other storage is connected

Target Config

  • Host is HongKong
  • IQN is "InitiatorName=iqn.2000-10.ca.on.senecac.hongkong"
  • Target is "target0" which is connected to the LV HongKong/arm1iscsi, size 100GB

Results

See Fedora ARM Secondary Architecture/iSCSI for note on problems encountered using iSCSI.