1
edit
Changes
→What results are we interested in?
Storage Performance
By: David Chisholm (dmchisho@learn.senecac.on.ca)
===Pictures===
http://www.paladinretrieval.net/hard%20drive.jpg
=Introduction=
In order to have our '''Koji ''' Build Farm run as efficiently as possible we needed to find out which form of data storage would be the fastest overall. The candidates were: * '''PATA:''' Hard Drive connected via USB.* '''NFS:''' Share from HongKong.* '''iSCSI:''' Network connection to HongKong. ===What results are we interested in?=== There are 3 main results that we are interested in when rating storage performance.
* PATA Hard Drive connected via USB'''Read:''' The amount of data that can be read from the storage medium per second.* NFS share from HongKong'''Write:''' The amount of data that can be written to the storage medium per second.* iSCSI network connection '''Access:''' Time required for a computer to HongKongprocess data from the processor and then retrieve the required data from a storage medium.
===Pictures===
=Approach=
*Benchmark using a linux untiliy called '''Bonnie++''' written by Russell Coker.*The Benchmark was run 3 times on each medium, the results were then averaged together.*The command used is as follows:
bonnie++ -d <location> -s 2048 -u root
===Pictures===
http://david-chisholm.no-ip.org/bonnie.jpg
=Process=
The main issue encountered goal was finding to find a repeatable benchmarking storage solution what that would give result in the desired results best build times while being able to test all 3 using the most efficient use of our the storage mediums. Common Linux tools such as the DD and HDPARM commands are capable of doing disk benchmarking, but will only work for physical devices and not network networked ones, making them useless tests for our purposesresources available to us.
The main issue encountered was finding a repeatable benchmarking solution what would give the desired results while being able to test all 3 of our storage mediums. Common Linux tools such as the '''DD''' and '''HDPARM''' commands are capable of doing disk benchmarking, but will only work for physical devices and not network networked ones, making them useless tests for our purposes. The solution was '''Bonnie++''', a Linux command line utility which gives an extensive amount amount of storage performance information while also having the ability to test all of our storage systems. ===Pictures=== http://www.business-strategy-innovation.com/uploaded_images/Innovation-Process-799858.jpg
=Discovery=
===What did we discover during the process?=== We discovered that finding a viable benchmarking solution is harder then it sounds. Raw data will not always correspond with real results as it comes down to the application using those resources. This is evident in the mock tests using '''NFS ''' vs '''USB PATA ''' where '''USB PATA ''' performed faster even though its benchmark results were lower using '''Bonnie++'''. ===Pictures=== http://thumbs.dreamstime.com/thumb_122/1171633495w0G6A0.jpg
=Issues=
===USB PATA works ===*Works without issue. ===NFS===*Works, but results in longer build times than USB PATA even though it benchmarked at higher speeds.
=Bonnie++ Results=
* Access Time - http://en.wikipedia.org/wiki/Access_time
* cDOT iSCSI - http://zenit.senecac.on.ca/wiki/index.php/Fedora_ARM_Secondary_Architecture/iSCSI
* Pictures
**http://www.business-strategy-innovation.com/uploaded_images/Innovation-Process-799858.jpg
**http://david-chisholm.no-ip.org/networkdiagram.jpg
**http://www.paladinretrieval.net/hard%20drive.jpg
**http://david-chisholm.no-ip.org/bonnie.jpg
**http://thumbs.dreamstime.com/thumb_122/1171633495w0G6A0.jpg
**http://exportabel.files.wordpress.com/2009/10/train_wreck_at_montparnasse_1895.jpg