Intelligent Power Distribution in the Data Center

Transcription

1 Rack Power Intelligent Power Distribution in the Data Center

2 Agenda Data Centre Power UPS Power Distribution Rack Mount PDU s UPS Power problems Configuration Capacity Power Distribution Types of Distribution Pros and Cons Efficiency

3 Agenda Cont Power Density in Cabinet Single vs. Three Phase 120V vs. 208V vs. 400V High Density Applications (Blades, Switches) Temperature Inside Cabinets Importance of PDU Design Dimensions, Flexibility, Venting, Interface Location Cord Retention, Obstruction Alternate Designs Power Monitoring Software and Interface How to save money with intelligent PDUs Out of the box software Integration to BMS and UPS Software (PDU doesn t dictate what software to use) PDU level and outlet level information, PUE Level 2 / 3, Accuracy Switched PDUs turn off servers, turn off outlets

4 Power Components in the Data Center UPS Floor Mount PDU Distribution Rack Mount PDU

5 What is a UPS? An uninterruptible power supply / source (UPS) or battery/flywheel backup, is an electrical apparatus that provides emergency power to a load when the input power source, typically mains power, fails. A UPS is typically used to protect computers, data centers, telecommunication equipment or other electrical equipment where an unexpected power disruption could cause injuries, fatalities, serious business disruption or data loss.

6 Most Important UPS Features High Efficiency Service/Warranty Battery Management Scalable Design Redundancy Options Remote Monitoring Reduced Footprint and Weight

7 9 Electrical Power Disturbances

8 Voltage/Capacity 120V Single Phase 300VA - 3kVA 240V Single Phase 1500VA - 18kVA 208V Three Phase 5kVA - 225kVA 480V Three Phase 30kVA - 1MW 600V Three Phase 30kVA - 1MW

9 UPS Style Three basic UPS models 1) Off-line UPS 2) Line Interactive UPS 3) Double Online Conversion

10 UPS Power Solutions (3) (5)Line- (9)True Off-line Interactive On-Line Power Failure Power Sag YES YES YES YES YES YES Power Surges Undervoltage Overvoltage YES NO NO YES YES YES YES YES YES Electrical Line Noise Frequency Variation NO NO NO NO YES YES Switching Transient Harmonic Distortion NO NO NO NO YES YES CLEAN POWER?????? YES

11 OFF-LINE UPS NORMAL MODE Utility Power Surge Suppression EMI/RFI Filters Battery Charger Inverter UPS Load Outlets Battery Power flows through the UPS Battery & Inverter are OFF-LINE

12 LINE-INTERACTIVE UPS Utility Power NORMAL MODE BUCK Surge Suppression EMI/RFI Fillters NORMAL BOOST Battery Charger Inverter UPS Load Outlets Battery Power flows through the UPS Battery & Inverter are OFF LINE

13 ON-LINE UPS DOUBLE CONVERSION NORMAL MODE Utility Power Bypass Surge Suppression EMI/RFI Filters Rectifier DC Link Inverter Output To Load UPS Load Outlets Battery Power is converted to DC and reinverted to AC Continuous Clean, Filtered, Regulated power to the load

14 What is Distribution? How power gets from the UPS to the critical load Consists of: Floor mount PDU Breaker outputs to individual cabinets Rack/Cabinet mount PDU s

15 Floor Distribution Traditional style power whips from a panel board, run overhead or under floor to the cabinets. Benefits power can be routed to exactly where it is needed. Cons Expensive Long cable runs Limited flexibility (adds moves changes)

16 Floor Mount PDU/RPP Close coupled system usually end of row distribution PDU transforms voltage from 600, 480 to 208/120V Usable distribution voltage to the cabinet Built in panel boards for distribution to a specific area in the DC RPP End of row distribution panel Usable distribution voltage to the cabinet Built in panel boards for distribution to a specific area in the DC Benefits Shorter cable runs, to cabinets Moderate flexibility Cons Expensive, need an electrician for adds moves changes

17 Overhead Power Busway: Pros / PROS Lower voltage drop per feet (improved efficiency) 40% fewer man hours to install vs. cabling Does not require panelboards Feed directly from large floor PDUs ( kVA) Delivers high density power (400A 3phase) Cleaner look, doesn t block cooling, better appearance Most beneficial for relocation, pods, containerized solutions Cons CONS More expensive material upfront Requires plenty of space above racks for installation (not always available) Becomes costly if too many turn components are used (i.e. tees, crosses, elbows) Monitoring can be challenging, but vendors are becoming creative and relying more on PDU Once a vendor is chosen, system is not compatible with other busway in the market (commitment t to single vendor)

18 WHAT IS A PDU SUPPOSED TO DO? Power servers reliably (last piece of the chain) Provide accurate / easy to understand dmonitoring i information Assist with capacity planning, load balancing and PUE Work effectively under high density loads WHAT IS NOT SUPPOSED TO DO? Obstruct air flow and equipment access Fail under high temperature environment Difficult to install and configure

19 Where is all this power going to? Lower power density racks (< 5kW) can be powered by Single Phase PDUs For load densities > 5kW, customers should be looking at Three Phase power to cabinets Three Phase power is a must to power Blades, provide long term room for growth and allow for virtualization 415V can dramatically increase power density

20 Choosing the Right Voltage 120/208V Three Phase Most available power (up to 28kW) 120V Single Phase Limited at 20A 30A impractical & expensive Widely available and preferred by small business 230V Single Phase Higher power capacity (up to 5kW) Less current draw Lower losses More efficient More security since requires 208V equipment Locking input plugs Most servers accept V Single 3PH circuit reduces cabling costs Metered PDUs facilitate load balancing Lower number of circuits it improves airflow Provides scalability for growth without bringing gdown power Support 120V & 208V Allows for Blades, Virtualization and Cloud Computing

21 Maximizing Panel and Busway Power Usage with Three Phase 30A PDUs 3PH 30A PDUs Best tbalance between power capacity and number of circuits 98% power capacity from a 400A feed 93% usage of poles or power drops available Delivers 8.7kW Meets the need for most server racks (up to 2 Blades) Does NOT require exotic cooling solutions Lower cabling costs Local breakers provide additional protection

22 400/415V PDU Increase Data Center efficiency and deliver more power Reduce power losses and number of transformations Proven power distribution worldwide Becoming a new standard in many Data Centers 208V Three Phase 415V Three Phase 30A (kw) Output Voltage 208V 240V Input Connection Line to Line Line to Neutral Input Plug L15 / L21 / IEC L22 / IEC Efficiency Gains None 6-8%

23 Powering Blade Servers / Switches 2 PDUs per cabinet Min 12 C19s or L6-20s per PDU Each Blade requires 4-6 outlets each Load Balancing is a must since each outlet can have a different power requirement 4 Blades = >20kW A 5-6kW per chassis 6 power supplies (3+3 redundancy ) B

24 Overall Approach PDUs designed to support Blade Servers and Switches, i.e. Cisco Catalyst 6500 and Nexus 7000 Vertical and Horizontal PDUs can be used Low / Mid / High Power Densities, depending on: Style of server/switch Number of servers/switches Propose 2 PDUs per rack or cabinet offering for redundancy Locking C19 and C13s are used to replace L6-20

25 Recommendation 60-80A 208V Three Phase PDU (up to 4 blades/switches) Input cord or Terminal Block 6 x 20A circuit Breakers 2-3 outlets per Breaker Local and Remote load monitoring Horizontals or Verticals Depends on type of cabinet, air constraints and mounting preference

26 Sample PDUs for Blades/Switches 2U Horizontals 0U Verticals Inputs 30A Single Phase 30A and 60A Three Phase Outputs L6-30 Locking C13 and C19s Functionality Local and Remote Monitoring i Form Horizontal OR Vertical

27 PDU DESIGN Keys to a good PDU design Low profile Flexible mounting Interface location and accessibility Cord retention features High temperature operation Outlet distribution and density Input cord flexibility Chassis consistency Custom Designs

28 Branch Breaker Area 2.8 Low Profile UL489 Breaker Doghouse Molded to Number of Breakers Clearly Labeled & Defined Reduce Obstruction Inside Cabinet

29 Cord Retention Feature Cord Retention Mechanism Individual outlet retention system Eliminates need for cable bar Built-in anchors on the PDU Locking tethers attach to PDU anchor points Tie wraps are required to attach tethers to plugs Tethers can be removed and reused

30 Locking C19 / C13 Outlets Release Button - Same electrical property as standard C13/C19 outlets - No special input cord needed - Built-in button must be pressed to release cord - Prevents accidental OR intentional cord removal - Alternative to locking NEMA L6-20 outlets and other cable retention options - Saves installation time and provides cord security in high density cabinets

31 Higher Operational Temperature Venting System Improve convection cooling and airflow through vents positioned at the end and sides of the PDU Allows for higher temp environments (65C or 149F) Reduces failure due to component overheating Increasing server exhaust temperature(45-50c) Containment solutions generate more heat Hot aisle containment Vertical Exhaust Duct

32 C20 Input & Input Cord Retention IEC C20 is an international input for PDUs which gives the customer the flexibility to plug in multiple power cords from V Power Cords 110V Nema: 5-15, 5-20, L5-15, L V Nema: 6-15, 6-20, L6-15, L V IEC: C20, IEC 16A 240V (others): German, British, Italian plugs Double Cord Retention system is provided to keep input cords from coming loose

33 Alternative Designs Hardwired Terminal Block inputs Permanent connection Cost savings by not having to purchase mating connectors Dual Input PDU 2 PDUs in 1 redundancy Space saving Horizontals 1U or 2U designs Customers that cannot install vertical units Half Height Mount up to 4 PDUs in cabinet Obstruct t only part of the cabinet

34 Power Monitoring Software and Interface How to save money with intelligent PDUs Informed capacity decisions Load balancing of phases / breakers Reduce risks of overloading and outages Daisy chaining Out of the box software Integration ti to BMS and UPS Software PDU usually doesn t dictate what software to be used PDU level and outlet level information for most accurate PUE calculation Switched PDUs turn off servers, turn off outlets, save power, increase security

35 PDU Local Interface Features Status LED Ethernet Port PDU Linking Ports Reset Large LCD Display Easy to Navigate Soft Buttons Environmental Sensor Port Digital Local Display Ports US o t USB Port Serial Communication Port Power, Amps, Voltage, PF Per Breaker or Phase IP Setup Buttons for Easy On-screen Menu Navigation Temp/Humidity Sensors Ethernet & Serial Communication Ports IP Consolidation Feature Connect up to 20 PDUs USB Port FW update & Data Download Rotates 180º to be viewed from either direction

36 Product Metering Benefits Avoid outlet / breaker overloading Avoid tripping breakers at PDU or upstream Make informed capacity planning decisions Balance loads across breakers or phases Efficiently utilize power resources Measure IT equipment power consumption to save power and money Calculate Green Grid s PUE Level 2 and Level 3 Drive green data center initiatives

37 IP Consolidation Setup, Control and Monitor multiple l PDUs in your data center with a Single IP Port PDU Linking Feature allows you to reduce the number of IP connections in your data center, thus saving you time and money Link up to 30 PDUs Only Master PDU requires network connection Linked units are connected through h serial RS485 Auto PDU detection PDU cloning feature

38 Why link multiple PDUs? Save Money Deploy fewer IP addresses Reduce installation time IN OUT Reduce Ethernet cable length Enjoy the following features Outlet grouping across multiple PDUs (A/B) Unified access to all linked PDUs Be able to clone settings from one PDU to another Manage every PDU in the chain from a single screen

39 PDU Outlet Power Control Remotely Control Individual Outlets On/Off, Cycle Via https or SNMP Local status LED Group Outlets from Single or Multiple PDUs Control and Manage all of them as ONE Sequence Outlets t In rush current mitigation on power up Outlet Level Scheduling Shut Off outlets to increase security or reduce power usage

40 Accuracy & Billing Billing Grade Data Centers can report and charge customers based on power consumption PDU must have: +/- 1% Accuracy Real Time Metering Outlet Level Monitoring

41 Built-in Web Interface Single Monitoring Interface HTTP / SNMP v2/v3 IP v4 / v6 Firmware Upgrade Alarm Settings PDU / Outlet / Temperature Outlet Grouping Data Logging & Exporting Notification Admin and User Levels Radius / LDAP Authentication

42 PUE Accuracy Categories IT Energy Measurement Location Definition of IT Energy Definition of Total Energy PUE Category 0 PUE Category 1 PUE Category 2 PUE Category 3 UPS output UPS output Floor PDU output Peak IT electric demand Peak Total Electric demand (kw) IT equipment input (Rack PDU output) IT annual energy IT annual energy IT annual energy Total annual energy (kwh) Total annual energy (kwh) Total annual energy (kwh) Accuracy Level Basic Intermediate High Highest The closer to loads, the more accurate PUE calculations become Energy (kwh) is also more accurate than Power (kw) alone Annual measurement vs. peak demand increases accuracy

43 Main Takeaways Understand d power density and redundancy d with three phase and high voltage PDUs Importance of PDU design installation time, equipment / air obstruction and increase mounting flexibility How to save money and improve power monitoring and control with intelligent PDUs.

44 Thank You! Questions?