Title -- Include your project name, your name, and your e-mail addressStorage PerformanceBy: David Chisholm (dmchisho@learn.senecac.on.ca) ===Pictures===http://www.paladinretrieval.net/hard%20drive.jpg =Introduction -- State the problem which you set out = In order to solve (feature have our '''Koji''' Build Farm run as efficiently as possible we needed to find out which form of data storage would be added, program the fastest overall. The candidates were: * '''PATA:''' Hard Drive connected via USB.* '''NFS:''' Share from HongKong.* '''iSCSI:''' Network connection to HongKong. ===What results are we interested in?=== There are 3 main results that we are interested in when rating storage performance. *'''Read:''' The amount of data that can be read from the storage medium per second.*'''Write:''' The amount of data that can be writtento the storage medium per second.*'''Access:''' Time required for a computer to process data from the processor and then retrieve the required data from a storage medium. ===Cost=== Since '''NFS''' and '''iSCSI''' are both network storage solutions they have no cost in themselves, bug but rely on network storage on a remote server. This price is simply the cost of the drives that will be installed in the remote storage server. A USB connected PATA or SATA drive requires both a hard drive and a '''PATA/SATA''' to be solved'''USB''' interface such as an external drive enclosure. * '''NFS:''' Free (Uses existing storage)* '''iSCSI:''' Free (Uses existing storage)* '''USB PATA:''' ~$100 CAD ===Pictures===http://david-chisholm.no-ip.org/networkdiagram.jpg =Approach = ===How did we conduct our testing?=== *Benchmark using a linux untiliy called '''Bonnie++''' written by Russell Coker.*The Benchmark was run 3 times on each medium, the results were then averaged together.*The command used is as follows: bonnie++ -d <location> -s 2048 - u root ===Pictures===http://david-chisholm.no-ip.org/bonnie.jpg =Process= ===What was your approach the process we used to solving the problemchoose our benchmarking solution?===Process -- What happened The goal was to find a storage solution that would result in the best build times while you worked on using the most efficient use of the problem? You had multiple iterations -- storage resources available to us. The main issue encountered was finding a repeatable benchmarking solution what happened at each milestone? Did you go down would give the desired results while being able to test all 3 of our storage mediums. Common Linux tools such as the wrong path '''DD''' and '''HDPARM''' commands are capable of doing disk benchmarking, but will only work for physical devices and have not network networked ones, making them useless tests for our purposes. The solution was '''Bonnie++''', a Linux command line utility which gives an extensive amount amount of storage performance information while also having the ability to start over? What barriers did you encounter?test all of our storage systems. ===Pictures=== Discovery http://www.business-strategy-innovation.com/uploaded_images/Innovation-Process- 799858.jpg =Discovery= ===What did you we discover and learn during the process -- about ?=== We discovered that finding a viable benchmarking solution is harder then it sounds. Raw data will not always correspond with real results as it comes down to the application using those resources. This is evident in the technologymock tests using '''NFS''' vs '''USB PATA''' where '''USB PATA''' performed faster even though its benchmark results were lower using '''Bonnie++'''. ===Pictures=== http://thumbs.dreamstime.com/thumb_122/1171633495w0G6A0.jpg =Issues= ===USB PATA===*Works without issue. ===NFS===*Works, but results in longer build times than USB PATA even though it benchmarked at higher speeds. ===iSCSI===*Seems to work at first, but only to a point.*We can login to an initiator, however, under heavy load the open source processtarget receives invalid opcodes, causing the communityconnection to fail.*Experimenting with a alignment value of 3 did not clear the issue.*Using the exact same target with a F12 x86_64 initiator is successful, issue seems to be '''ARM''' related. ===Pictures=== http://exportabel.files.wordpress.com/2009/10/train_wreck_at_montparnasse_1895.jpg =Bonnie++ Results= ==Write==<table border="1" cellspacing="1" width="0"> <tr><th></th><th>Transfer Speed</th><th>Percentage Increase</th><th>CPU Usage</th></tr> <tr><td align="center">PATA</td><td align="center">28,790 KB/s</td><td align="center">0%</td><td align="center">24%</td> </tr><tr><td align="center">NFS</td><td align="center">43,363 KB/s</td><td align="center">50%</td><td align="center">16%</td></tr> <tr><td align="center">iSCSI</td><td align="center">31,503 KB/s</td><td align="center">9%</td><td align="center">30%</td></tr> </table> ==Read==<table border="1" cellspacing="1" width="0%"> <tr><th></th><th>Transfer Speed</th><th>Percentage Increase</th><th>CPU Usage</th></tr> <tr><td align="center">PATA</td><td align="center">25,991 KB/s</td><td align="center">0%</td><td align="center">10%</td></tr> <tr><td align="center">NFS</td><td align="center">51, yourself and your abilities789 KB/s</td><td align="center">99%</td><td align="center">85%</td> </tr><tr><td align="center">iSCSI</td><td align="center">59, collaboration?147 KB/s</td><td align="center">127%</td><td align="center">84%</td></tr> </table> ==Access==<table border="1" cellspacing="1" width="0%"> <tr><th></th><th>Access (per second)</th><th>Percentage Increase</th><th>CPU Usage</th> </tr> <tr><td align="center">PATA</td><td align="center">121</td><td align="center">0%</td><td align="center">0%</td> </tr> <tr><td align="center">NFS</td><td align="center">1201</td><td align="center">1000%</td><td align="center">35%</td> </tr> <tr><td align="center">iSCSI</td><td align="center">2514</td><td align="center">2077%</td><td align="center">44%</td> </tr> </table> =Links=* Access Time - http://en.wikipedia.org/wiki/Access_time* cDOT iSCSI - http://zenit.senecac.on.ca/wiki/index.php/Fedora_ARM_Secondary_Architecture/iSCSI* Pictures**http://www.business-strategy-innovation.com/uploaded_images/Innovation-Process-799858.jpg**http://david-chisholm.no-ip.org/networkdiagram.jpg**http://www.paladinretrieval.net/hard%20drive.jpgResults **http://david-chisholm.no- What did you end up with? Did you solve the problem?ip.org/bonnie.jpg**http://thumbs.dreamstime.com/thumb_122/1171633495w0G6A0.jpg**http://exportabel.files.wordpress.com/2009/10/train_wreck_at_montparnasse_1895.jpg