Deploying High Power at the Rack Presented by: David Wood, Director Power Business PIS 14 April 30, 2013
Agenda Industry trends & challenges Introduction to 400V Other considerations, e.g. 480V Summary and benefits
Industry trends & challenges High power demands from high density Big Data, Cloud infrastructure Blade servers, storage, and high density networking fabrics New generations of traditional servers, e.g. HP Gen 8 New generation of Low Energy Servers Containers and modular Increasing need for changes due to variety of demand Need to consider both medium density (5-10 kw/rack) and high density (15-30 kw/rack) equipment Power requirements for a variety of equipment and deployments, e.g. single/three phase, rack power (kw), and physical receptacles
Power Density Trends: Extreme Low Energy Servers
Lack of power capacity = downtime Hitting capacity thresholds introduces RISK Average cost of data center downtime = $5,600/minute. Average reported incident length: 90 minutes Average cost of a single downtime event: $505,500. UPS failure proved to be most costly root cause Studies by Ponemon Institute Published article in Data Center Knowledge
Higher power at the rack Higher current, 30A to 60A 3 phase 24x208x1.73 = 8.6kW 40x208x1.73 = 14.4kW 48x208x1.73 = 17.3kW Higher voltage, trend towards 400V 3 phase to the rack 24x400x1.73 = 16.6kW 48x400x1.73 = 33.2kW We re seeing more requests for 40+KW ipdu 63*400*1.73 = 43.6kW Design zones in the data center 5kW racks + 17+kW racks Calculations assume pf = 1
400V topology vs. Traditional Improved transmission efficiency By eliminating unnecessary voltage transformations, 400V power reduces energy costs by approximately 2-3% vs. 208V distribution; and approximately 4-5% vs. 120V distribution Source: greengrid.org
North America: 208V vs. 400V Intelligent PDUs Power density review 30A 30A 30A 60A Phase Single phase Three phase Delta Three phase Wye Input Voltage 208V 208V 400V 208V Output Voltage Apparent power 1U servers supported* 2u servers supported* Blade chassis supported* 208V 208V 230V 208V Three phase Delta 5.0 kw 8.6 kw 16.6 kw 17.3kW 24 41 80 83 24 41 80 83 1 1-2 3-4 3-4 *HP Proliant GL 360G6 1U server, 206 watts at 80% load on SPECpower_ssj2008 HP Proliant GL 380G6 2U server, 208 watts at 80% load on SPECpower_ssj2008 HP Proliant C7000, ProLiant BL2x220c G6, 4860 watts at 80% load on SPECpower_ssj2008
EU and AP: 230V vs. 400V Intelligent PDUs Power density review 32A 16A 32A 63A Phase Single phase Three phase Wye Three phase Wye Input Voltage 230V 400V 400V 400V Output Voltage Apparent power 1U servers supported* 2u servers supported* Blade chassis supported* 230V 230V 230V 230V Three phase Wye 7.4 kw 11.1 kw 22.1 kw 43.6 kw 35 53 107 83 35 53 106 83 1 2 4 8-9 *HP Proliant GL 360G6 1U server, 206 watts at 80% load on SPECpower_ssj2008 *HP Proliant GL 380G6 2U server, 208 watts at 80% load on SPECpower_ssj2008 *HP Proliant C7000, ProLiant BL2x220c G6, 4860 watts at 80% load on SPECpower_ssj2008
Compare 208V vs.400v input cord 400V for similar power: Less copper Less weight Less space Less cost 400V 30A WYE 208V 60A Delta Source: General Cable SOOW cable specification
208V vs. 400V plug assessment 30A 400V 3 phase Wye: HUBBELL HBL2821 AC Plug NEMA L22-30 Male 16.6kW Plug Price $32.00 Receptacle Price $41.00 60A 208V 3 phase Delta: Mennekes ME460P9W IEC309 460P9W Pin & Sleeve 17.3kW Plug Price $166.00 Receptacle Price $216.00 $73.00 $382.00 11 Price source: www.stayonline.com
Single-pole vs. double-pole breakers Some vendors may use double pole breakers, others single pole Situation: North America 30A 400V 3 phase WYE. Some use 3 double pole breakers, we use 6 single pole One is cheaper, one is more expensive One is more limiting, one is less limiting One is less reliable, one is more reliable L1 24A Pole 1 Pole 2 20A 12A L1 24A 24A Pole 1 Pole 1 20A 20A L2 Pole 1 L2 24A Pole 1 20A Pole 2 24A Pole 1 20A L3 Pole 1 L3 24A Pole 1 20A Pole 2 24A Pole 1 20A 12
Why and when 3 pole? Blade applications can require 36kVA E.g. up to 5 x HP C7000 blade chassis in a single rack Note: HP C7000 has 6 power supplies per chassis, 3 per side A-side PDU and blade power supplies (same applies to B-side not shown) Isolate any faults to a single blade chassis Eliminate potential for cascading failure
Multi-inlets scenario 2 PDUs each with 2 input cords to deliver twice as much power Easier to install than 4 PDUs Less expensive because each PDU has one controller
Other considerations - What about 480V/277V? 15 Issue: Majority of servers don t have power supplies that support 277V. Max typically 250V Issue: Industry C13 and C19 s don t support 277V Facebook / OpenCompute pushing it to improve efficiency Additional savings BUT everything is basically CUSTOM Custom triplet racks Custom servers and power supply Custom battery/ups Rack pdu 480/277 Custom s, Tyco 3-pin Mate-N-Loc
Example 480V/277V components Facebook / OpenCompute receptacle and power supply HUBBELL HBL4760 AC Receptacle NEMA L7-15 Female Black 277 Volt 15 Amp 16 Net-Net: technically feasible, but requires scale & additional expense to improve efficiency by 1-2% more than 400-415V 3 phase systems.
Benefits of 400V 3 phase Intelligent Rack PDUs Achieve higher power densities at the rack and increased capacities More efficient power distribution resulting from reduced electrical transmission losses Improved sustainability through lower copper utilization Save costs from lower amperage plugs whips with less copper, lower weight fewer cable runs in the plenum reduced pole positions at the panels resulting less equipment expense, e.g. floor PDUs/RPPs less power distribution losses
The Commercial Raritan s easy-to-use integrated solution: PX high-power PDUs with plug-and-play sensors temperature, humidity, airflow, air pressure used with Power IQ can 1) deliver high power and 2) monitor before and after cooling. Just have basic PDUs? Raritan s EMX (and PX) supports sensors and Wi-Fi networking so you don t even need expensive Ethernet drops. Raritan has a broad portfolio of high-power intelligent PDUs,, sensors and energy management software. Come see us at booth # 835
Resources Raritan white paper Deploying High Power to IT Equipment Racks http://www.raritan.com/resources/white-papers/powermanagement/high-power-white-paper.pdf Raritan Blog How to Calculate Current on a 3-Phase, 208V Rack PDU (Power Strip) http://blog.raritan.com/2011/03/how-to-calculate-current-on-a-3- phase-208v-rack-pdu-power-strip/
QUESTIONS David Wood Director, Power Business Raritan, Inc. david.wood@raritan.com 732-764-8886 Ext. 1739 www.raritan.com Raritan, Inc. - Proprietary and Confidential