Warehouse-scale Design Reaches Retail Colocation High Density, Modern And Green PROJECT TEAM: Sean Holzknecht, President & Co-Founder Colovore Peter Harrison, CTO & Co-Founder Colovore Dave Smith, Principal Ecom Engineering Inc. Steve Emert, P.E., Director Mission Critical Engineering, Rosendin Electric Mehrdad Alipour, P.E., Mechanical Engineer at Therma Scott Thayer, Engineering Project Manager at Therma
Inspiration To address the major pain points of IT staffs operating in retail colocation facilities, you have to start over. Colovore started with power density! 20kW / Rack No more half full server racks Contiguous space to grow Handle modern server power loads of 0.5kW 1.0kW / RU Save money in the process
Project at a Glance 2,230 m 2 (24,000 ft 2 ) Silicon Valley data center 9 MW, delivering up to 7.4 MW of UPS power Up to 5 modular phases of expansion Scalable to 20kW / cabinet Rear door heat exchangers (RDHX) on cabinets No facility fan loss re-circulating air Reclaimed cooling tower water Efficient IGBT UPSs w/ ECO MODE Multi-tiered, flexible design for dual and single corded utility or protected power Non-disruptive modular expansion PUE of 1.10 to 1.25 Silicon Valley Power Energy Efficiency Rebate Award
Focus on UPS Efficiency The biggest losses in typical data center electrical distribution systems occur in the Uninterruptable Power Systems (UPSs). As these losses can exceed all of the others combined, we focused on finding UPSs with the lowest possible power losses. UPS Technology Efficiency Transformer Based ~92% Transformer-less IGBT ~95% Transformer-less IGBT (With ECO Mode) ~99% Eco Mode Power
ECO Mode Efficiency Advantage Source: Green Grid Forum 2012
ECO Mode Cost Advantage Source: Green Grid Forum 2012
Modular Electrical Rollout Up to 5 N+1 UPS Systems
Final Electrical Design Summary 1,200 kw phase 1 build at N + 1 redundancy 1,200 kw of utility supported Power Distribution Units (PDUs) Future expansion allows 2N redundancy Incremental expansion at 1800 kw N+1 redundancy for rapid deployment Flexible Redundant power distribution topology 20kW to every server cabinet Modular Infrastructure is added on demand Phased expansions taking the total IT capacity to 7.4MW Expansion construction with no impact on data center operation
Focus on Cooling Efficiency 12.5 kw / cabinet without the aid of a refrigeration system year round. Up to 20 kw / cabinet wall-to-wall by inrow coolers to meet seasonal demand. Cooling Technology CRAC Cooling Legacy facilities, 1990s early 2000s Free Air Cooling Late 2000s RDHX Colovore PUE ~2.00 ~1.20 to 1.50 ~1.10 to 1.25
Transferable Cooling Technology The system works based on wet bulb temperature of the air. The case by case design alternatives are presented below for the situation that the cooling is solely provided by RDHX: Wet bulb temperature < 70 F, the cabinets load:12.5 KW (meet the ASHRAE TC9.9 criteria recommended temperature condition for class A1 to A4) Wet bulb temperature < 75 F, the cabinets load:12.5 KW (Meets the ASHRAE TC9.9 criteria allowed temperature condition for class A1 to A4) Wet bulb temperature < 80 F, the cabinets load: 10 KW (Meets the ASHRAE TC9.9 criteria allowed temperature condition for class A1) Wet bulb temperature < 80 F, the cabinets load: 12.5 KW (Meets the ASHRAE TC9.9 criteria allowed temperature condition for class A2,A3 & A4)
Mechanical Design Elements Raised access floor used to deliver tempered water to each cabinet No under-floor cooling air plenum Upward compatibility to future technologies such as water to the chip
Final Mechanical Design Summary Evaporative cooling towers at N + 1 redundancy Redundant water to water heat exchangers and pumps Rear door heat exchangers on every cabinet Flexible Only cabinets with load are cooled Cool up to 20kW in every cabinet Modular In-row coolers deployable on demand Master planned to full build-out of 7.4MW load Expansion construction with no impact on data center operation
Conclusion Colovore data center s best in class design combines best available electrical and mechanical technologies : High density solutions Modular Scalable Deployable on demand over a broad, global geography Built from globally available infrastructure. Phase 1 was completed in December, 2013.
Special Thanks This project would not have been successful without: Mitch Sadler: San Jose Construction Les Pelio, Dennis Harker, Jon Shank: Pelio and Associates Photography : Pascal Prophete, Operations Manager, Colovore