Difference between revisions of "User:Chris Tyler/Fedora ARM Infra Redesign"

From CDOT Wiki
Jump to: navigation, search
(Created page with '{{Chris Tyler Draft}} = Design Meeting 2011-12-01 = It is apparent that the Fedora ARM build farm infrastructure needs to be upgraded to increase storage throughput, IOPS, and n…')
 
(→‎Scenarios for Quotation)
 
(3 intermediate revisions by the same user not shown)
Line 32: Line 32:
 
* Ireland
 
* Ireland
 
** Hardware:
 
** Hardware:
−
*** Intel Q660 Quad (?)
+
*** Intel Q6600 Quad (?)
 
*** 8 GB RAM
 
*** 8 GB RAM
 
*** 2 x 2TB disk
 
*** 2 x 2TB disk
 
** Hosting:
 
** Hosting:
 
**# Sigul signing server (in VMs)
 
**# Sigul signing server (in VMs)
−
 
  
 
== Recommended Reallocation ==
 
== Recommended Reallocation ==
Line 69: Line 68:
 
** Storage:
 
** Storage:
 
*** 4 x 2TB disk in RAID 0+1
 
*** 4 x 2TB disk in RAID 0+1
−
*** '''OR''' 2 x 2TB disk in RAID 0+1, plus 1 RevoDrive 3 x2 <nowiki>[MaxIOPS]</nowiki> 960G, with plans to add another RevoDrive in 2012, plus possibly some of the 1TB drives taken from Australia for local backup of the SSD (possibly RAID 1 with writemostly)
+
*** '''OR''' 2 x 2TB disk in RAID 1, plus 1 RevoDrive 3 x2 <nowiki>[MaxIOPS]</nowiki> 960G, with plans to add another RevoDrive in 2012, plus possibly some of the 1TB drives taken from Australia for local backup of the SSD (possibly RAID 1 with writemostly)
 
** Hosting:
 
** Hosting:
 
**# NFS export of /mnt/koji
 
**# NFS export of /mnt/koji
Line 78: Line 77:
 
** Move koji-web to a separate host (Japan? OpenRD?)
 
** Move koji-web to a separate host (Japan? OpenRD?)
 
** Add additional createrepo builders (Japan? NewZealand?)
 
** Add additional createrepo builders (Japan? NewZealand?)
−
** Move NFS activity to guruplugs
+
** Move NFS activity to guruplugs (they're weak builders, but have good disk I/O (eSATA), could use multiple NFS servers with each supplying scratch space to one group of v7 builders)
−
 
 
  
 
== Scenarios for Quotation ==
 
== Scenarios for Quotation ==
Line 114: Line 112:
 
** 5 Workstation NICs
 
** 5 Workstation NICs
 
** Serial USB adapters
 
** Serial USB adapters
 +
 +
== Hardware Order ==
 +
 +
* 6 x 2TB disk
 +
* 3 x Intel 600G SATA SSD
 +
* 7 x PCIe NIC
 +
* 5 x USB serial adapters
 +
 +
== Hardware Shipment ==
 +
 +
* All except 3 of the 2TB disks are going to ship on Friday Dec 9 (checking on whether they're shipping or arriving on that date)
 +
* Remaining 3 drives expected later in December (data to be confirmed)

Latest revision as of 14:13, 8 December 2011

Important.png
This is a draft only!
It is still under construction and content may change. Do not rely on this information.

Design Meeting 2011-12-01

It is apparent that the Fedora ARM build farm infrastructure needs to be upgraded to increase storage throughput, IOPS, and network utilization.

Current Arrangement

  • HongKong
    • Hardware:
      • Intel Core i7 Quad
      • 4 x 2TB disk
      • 2 x 128GB SATA SSD
      • 12 GB RAM
    • Hosting:
      1. Koji Web
      2. Koji Hub
      3. NFS export of /mnt/koji
      4. Kojid for createrepo channel
      5. DHCP & NAT for builders


  • Australia
    • Hardware:
      • Intel Q660 Quad
      • 2 x 1TB disk
      • 8 GB RAM
    • Hosting:
      1. NFS export for builder scratch space


  • Ireland
    • Hardware:
      • Intel Q6600 Quad (?)
      • 8 GB RAM
      • 2 x 2TB disk
    • Hosting:
      1. Sigul signing server (in VMs)

Recommended Reallocation

  • HongKong
    • Storage:
      • 4 x 2 TB in RAID 0+1
    • Hosting:
      1. Koji Web
      2. Koji Hub


  • Australia
    • Storage:
      • 4 x 2TB in RAID 0+1
      • Consider expansion to 8 drives
    • Hosting:
      1. NFS export for builder scratch space


  • Ireland
    • Storage:
      • 2 x 128GB SATA SSD
      • 2 x 2TB disk in RAID-1
    • Hosting:
      1. Postgresql DB


  • Chile (move from Raspi cubicle)
    • Storage:
      • 4 x 2TB disk in RAID 0+1
      • OR 2 x 2TB disk in RAID 1, plus 1 RevoDrive 3 x2 [MaxIOPS] 960G, with plans to add another RevoDrive in 2012, plus possibly some of the 1TB drives taken from Australia for local backup of the SSD (possibly RAID 1 with writemostly)
    • Hosting:
      1. NFS export of /mnt/koji
      2. kojid for createrepo


  • Possible Future Directions
    • Move koji-web to a separate host (Japan? OpenRD?)
    • Add additional createrepo builders (Japan? NewZealand?)
    • Move NFS activity to guruplugs (they're weak builders, but have good disk I/O (eSATA), could use multiple NFS servers with each supplying scratch space to one group of v7 builders)

Scenarios for Quotation

Bold indicates most likely scenarios


  • Scenario 1
    • 6 x 2TB disk (4 for Australia, 2 for Chile)
    • 2 x NIC


  • Scenario 2
    • 16 x 2TB disk (8 Australia, 6 Chile, 2 spares)
    • Multi-port SATA cards for Australia, Chile
    • 2 x NIC


  • Scenario 2.5
    • 6 x 2TB disk (4 Austrlia, 2 Chile)
    • 1 x RevoDisk 3 x2 960GB (Chile)
    • 2 x NIC


  • Scenario 3
    • 10 x 2 TB disk (8 Australia, 2 Chile)
    • Multi-port SATA card for Australia
    • 2 x RevoDisk 3 x2 960GB (Chile)
    • 2 x NIC


  • All cases add:
    • 5 Workstation NICs
    • Serial USB adapters

Hardware Order

  • 6 x 2TB disk
  • 3 x Intel 600G SATA SSD
  • 7 x PCIe NIC
  • 5 x USB serial adapters

Hardware Shipment

  • All except 3 of the 2TB disks are going to ship on Friday Dec 9 (checking on whether they're shipping or arriving on that date)
  • Remaining 3 drives expected later in December (data to be confirmed)
Retrieved from "https://wiki.cdot.senecapolytechnic.ca/w/index.php?title=User:Chris_Tyler/Fedora_ARM_Infra_Redesign&oldid=75691"