1 Smart Solutions Reference Guide Solutions For Business-Critical Continuity 1100kW Tier 3 With High Density Design Intelligent, Integrated Infrastructure for the Data Center Reference Guide: 1100kW Tier 3 With High Density The SmartDesign from Emerson Network Power uses a perimeter/room-based approach to deliver efficiency, availability, capacity and control, that allows you to be prepared for what s next. Our approach helps to create, maintain and grow data centers that meet customer challenges through innovative systems, industry-best practices and local data center specialists who fully understand how to solve these problems. This sample reference scenario, 1100kW Tier 3 With High Density, illustrates one possible example of how the SmartDesign approach can be used to create a high-performance IT infrastructure. To find out more about the SmartDesign approach and view more Reference Scenarios, visit SmartSolutionsDesigns.com SmartDesign Approach: Lower energy bills by $122,000/yr Generate PUE of 1.19 Save 38% in OPEX Lower TCO by 21% over base Reduce rack count by 65% Common Data Center Challenges: Limited availability and capacity Insufficient and inefficient cooling capabilities Piecemeal infrastructure that is difficult to manage Space constraints Energy inefficiencies Budgetary constraints Complexities that limit growth Save 60% in floor space Provide high Tier 3 availability Obtain over 97% UPS efficiency Improve flexibility and scalability Leverage density of 20kW/rack SmartDesign Benefits: Proven power solutions that deliver efficiency, scalability and reliability Precision cooling that controls the temperature, humidity and airflow Effective monitoring and control Efficient space utilization Improved PUE Lower TCO Flexible and scalable configurations
2 Data Center Design Overview Efficiency. Availability. Capacity. One Approach. This innovative reference design uses efficient refrigerantbased rear door heat exchangers and chilled water economization alongside a highly efficient tier 3 power configuration to deliver high capacity within a smaller space. The design blends efficiency, availability and scalability to deliver an optimized infrastructure. Use this design approach when: Climate allows for economization Data center floor space is to be minimized Tier 3 availability is desired Benefits of this application: Free cooling saves energy Higher density improves efficiency Dual bus reduces downtime Design Summary This data center integrates power and cooling in a Tier 2 mechanical and a Tier 3 electrical configuration to support a 1.1MW load. (2) Liebert CW 114kW base cooling (56) Liebert XDR rear door heat exchangers (56) DCF Optimized Racks (8) Liebert XDP refrigerant pumping units (2) Liebert NXL1100kVA/1100kW UPS 2N Dual Bus configuration (12) Liebert PPC PDU (12) Liebert FDC PDU (2) Liebert TVSS (2) ASCO ATS (112) Liebert MPX rack PDU Liebert Nform, Avocent Data Center Planner This design delivers: Operating/energy savings Lower data center footprint More efficient rack utilization Free cooling using fluid economization Simplified scalability High capacity, high efficiency UPS Protected dual bus architecture Operational DCIM control and factory local service 2
3 Data Center Overview Premium Base Minimum Mech. Redundancy 20%, Electrical Tier 4 This SmartDesign Miniumum Mech. Redundancy 35%, Electrical Tier 3 Cost Savings (vs. Base) Cost Advantage Building Costs Engineering/Contracting, Building, Ceiling/Floor, Lights, Fire Suppression $6,500,000 $5,100,000 $1,400,000 22% Infrastructure Racks & Install $450,000 $118,000 $332,000 74% Mechanicals & Install $1,600,000 $2,400,000 -$800,000-50% Electricals & Install $10,200,000 $7,400,000 $2,800,000 27% Total CapEx $18,750,000 $15,018,000 $3,732,000 20% Infrastructure Energy Costs $313,000 $147,000 $122,000 45% Water Usage $23,500 $23,500 $0 0% Total Annual Energy Cost $292,500 $170,500 $122,000 42% 5 Year OpEx $1,462,500 $852,500 $610,000 42% 5 Year TCO $20,212,500 $15,870,500 $4,342,000 21% * Using Columbus, OH weather table, base utilizes (14) Liebert CW 084, (4) Liebert 750kVA without Eco-mode energy optimization. Utility costs of $.08/kw-h electric, $1.99 per k gallon water. Total power efficiency of 89% for base, 94% average for this SmartDesign (1.5% loss of PDU, 1.5% loss for lighting). SmartSolutionsDesigns.com 3
4 Applied Cooling Approach Efficient Refrigerant-Based Heat Exchangers and Chilled Water Economization Shown below is a sample SmartDesign cooling scenario using our innovative refrigerant high density systems along with base chilled water cooling with economization in a 1.1MW data center. This facility uses a water cooled centrifugal chiller system with series fluid side economizer. Using this design a customer only needs 56 IT racks at 20 kw per rack. There is a 36 inch raised floor with space above dropped ceiling used as return air pathway. The precision cooling units use (2) Liebert CW 114 with Liebert icom and EC fans, and the Liebert XD system with (56) of the Liebert XDR attached to the racks and (8) Liebert XDP pumping units. Hot aisle, cold aisle arrangement is optional. * Liebert systems identified are repeated in the gallery on the left. This cooling approach includes: Water-cooled centrifugal chiller system Base humidification 36-inch raised floor Space above dropped ceiling utilized as a return-air pathway Service, support and data center design expertise from Emerson Network Power Total RF Data Center Footprint Room Perimeter Total Racks 56 kw per Rack Total kw 69x ft lf kw 1100kW Gallery Footprint (2) 495 ft 2 Precision Cooling AC Power Racks and Integrated Cabinets Liebert XDR EC Fans Liebert icom Liebert CW 114 Liebert XDP This innovative data center packs tremendous computing power into a very efficient space for remarkable savings. The layout shown is one representation. Another option when working with Liebert XDRs is to arrange in a cascading aisle configuration. Naturally, air movement is front to back and returned to the cooling unit(s) via a pathway. 4
5 Applied Cooling Equipment and Best Practices Let s Compare: Premium Conventional This SmartDesign Capacity 1.1MW 1.1MW Dimensions sq ft Total 6,603 DC 4,819 Total 2,691 DC 1,701 Racks 7kW per Rack 20kW per Rack Raised Floor Chiller Plant Dual 300T Water cooled centrifugal 48F EWT, 60F LWT, 85F RAT SD: 25hp CW pumps, 20hp cond pumps, 40 hp tower fans Dual 300T Water cooled centrifugal 48F EWT, 60F LWT, 85F RAT VFD: 25hp CW pumps, 20hp cond pumps, 40 hp tower fans Economizer Series fluid Series fluid AC Liebert CW 084 kw standard fan/motor (2) Liebert CW 114 kw, EC plugs fans in floor (56) Liebert XDR, (8) Liebert XDP Airflow Ceiling return pathway Ceiling return pathway Containment None None * Images not to scale Equipment Overview Technologies Benefits Best Practices Overview: Liebert CW 114 kw Chilled water pre-packaged systems. Dedicated systems allow for easier scalability and redundancy. Proven, reliable operation provides humidity control and air filtration. Highly manageable and serviceable. Efficient components. Maximize the return temperature at the cooling units to improve capacity and efficiency Liebert icom Controls Advanced controls ensure superb efficiency through teamwork, seperate fan and capacity control, unit rotation and more. Match cooling capacity and airflow with IT loads EC Fans Improved airflow performance and efficiency. Energy savings of 20-30% over traditional designs. Liebert XDR Fanless heat exchanger provides outstanding energy savings - no added floor space - higher computing density saves energy and data center space - uses only server fans to move air over the coils - no cooling fans required - use with or without hot aisle/cold aisle layout. Utilize cooling designs that reduce component power Liebert XDP Intelligent isolating pumping interface between the building chilled water system and the pumped refrigerant circuit. Fluid Economizer Incorporated into the chiller plant heat rejection loop to cool the fluid during appropriate times reducing pump operations. Enhance data center operations with management and control systems For even greater improvements, you could raise the chiller temp 2-3 F above 48 F SmartSolutionsDesigns.com 5
6 SWBD, 4000A, 480V, 3Ø, 4W+G ISOLATION N LOAD 2000A 2000A 2000A 1600A 4000A UPS BYPASS 1100KVA UPS MODULE A CB1 BFB BATTERY STRING #B2 CB2 SS 3000 KVA 13,200V / 480V DIST SWBD, 2000A MBB 2000A TVSS FPC A1 4000A 1600A FPC A3 FDC A2 FDC A2 FDC A2 FDC A2 BYPASS E 2500 KVA GENERATOR A SWBD, 1600A, 480V, 3Ø, 4W+G 150A 150A 150A 150A FPC A5 FDC A1 FDC A1 FDC A1 FDC A1 FDC A3 FDC A3 FDC A3 FDC A3 FDC A5 FDC A5 FDC A5 FDC A5 FPC A2 FPC A4 FPC A6 FDC A4 FDC A4 FDC A4 FDC A4 FDC A6 FDC A6 FDC A6 FDC A6 E N SS Applied Power Approach Tier 3, Efficient, 2N Power with Two-Stage Distribution The power approach utilized in this scenario supports a Tier 3, 1.1 MW data center. Both the UPS and electrical distribution configurations are optimized for maximum efficiency, availability and capacity. Electrical Power Design: Our Tier kW operation utilizes (2) separate utility transformers and (2) separate main utility switchgear modules. The UPS system consists of (2) Liebert NXL 1100kVA/1100kW UPS 2N Dual Bus configuration. Backup power generation provided by two (2)2.5MW Generators in (2N) configuration. Electrical Distribution Design: Design distribution to consist of six (6) pairs of 225kVA Liebert PPCs in a dual bus configuration. They in turn will receive power from a UPS distribution panel board. Each Liebert PPC powers a Liebert FDC, which then deliver power to the racks via the Liebert MPX PDU. Close up of Bus A of an A/B Bus Power System in a Tier 3 Architecture 3000 KVA 13,200V / 480V 2500 KVA GENERATOR 1 ISOLATION BYPASS 4000A TVSS 4000A N E LOAD SWBD, 4000A, 480V, 3Ø, 4W+G 2000A 2000A 2000A 1600A 4000A UPS BYPASS 1600A SWBD, 1600A, 480V, 3Ø, 4W+G 1100KVA UPS MODULE A DIST SWBD, 2000A 150A 150A 150A 150A CB1 BFB SS MBB 2000A CB2 BATTERY STRING #B2 FPC A1 FPC A3 FPC A5 FDC A1 FDC A1 FDC A1 FDC A1 FDC A3 FDC A3 FDC A3 FDC A3 FDC A5 FDC A5 FDC A5 FDC A5 FPC A2 FPC A4 FPC A6 One-Line Snapshot of Both A/B Buses FDC A2 FDC A2 FDC A2 FDC A2 FDC A4 FDC A4 FDC A4 FDC A4 FDC A6 FDC A6 FDC A6 FDC A6 6
7 Applied Power Equipment Equipment Overview Technologies Liebert NXL1100kVA/ 1100kW UPS 2N Dual Bus configuration Liebert FPC/PPC Liebert FDC Liebert MPX Rack PDU Liebert TVSS ASCO ATS Infrastructure Management Benefits Robust and efficient double conversion UPS. Resilient stack-up performance Protects from all electrical conditions. Efficiency rivals transformerfree systems. Power factor rated at near unity. Reliable and flexible isolated power conditioning and distribution process significant power to many circuits. Flexible, fast, in row power distribution for high capacity connections to the racks. Intelligent rack power distribution creates a very smart, scalable and flexible system. Hot swappable modules, receptacle level control and management. Single or three phase. Flexible mounting. Facility-wide and Panel Mount versions remove electrical surges in the power stream. Reliable switches for critical performance. Albér Battery Monitoring: Identifies issues in batteries and extends product lifespan. Liebert Nform: Distributed monitoring and alarm management of critical devices. Increase availability. Best Practices Overview: Obtain the power system designed to match your needs for availability and efficiency (tiers, redundancy, voltages, distribution) Leverage the optimum design for electrical scalability and modularity to meet current and future needs Enhance data center operations with management and control systems Rely on local service and support to ensure proper designs, maintenance and assessments Equipment Room (2) 1,446 ft 2 Avocent DCP: Data center planner manages assets, capacities and room/rack layouts. Supporting Data Center PDUs in gallery Liebert CW 114 Cooling Unit Liebert NXL UPS Batteries Switchgear Liebert PPC/PDU SmartSolutionsDesigns.com 7
8 Power Approach Benefits Energy Efficient UPS Power 100% 96% 92% 88% Typical Load Liebert NXL 1100kVA/1100kW UPS 84% Intelligent EcoMode AC-AC (UPS Dual Conversion) 80% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Reduce or eliminate downtime costs of $507,000/event. Creating, maintaining and expanding data centers with Emerson Network Power With Emerson Network Power and the SmartDesign approach, there s virtually no limit to what you can solve and how you can design the optimal data center. PDU Efficiency Curve Liebert PPC/FPC 0% 20% 30% 40% 50% 75% 100% Efficiency through performance based TCO. The SmartDesign approach helps data centers save money while still ensuring mission-critical availability. Using the innovative equipment and industry-best practices that this approach offers, you can avoid the costly expenses associated with system failures and down times. Did you know? Average data centers experience 5.12 power outages every two years Outage duration averages 106 minutes System recovery is estimated at 3 times the duration of the outage (318 on average) This means that on average, each unplanned outage costs $507,000*. *Read the Ponemon white paper on costs of downtime at Emerson Network Power. The global leader in enabling Business-Critical Continuity. AC Power Embedded Computing Infrastructure Management & Monitoring Connectivity Embedded Power Outside Plant DC Power Industrial Power Power Switching & Controls For more examples of the high-efficiency and highcapacity data centers that the SmartDesign approach can create, maintain and grow, visit our website. Contact a local data center specialist to discuss your situation. They can assist you with technical advice, configuration development and energy analysis to support your unique design needs. The SmartDesign Approach Efficient Economical Simplified Controllable To see more Reference Scenarios, visit today. While every precaution has been taken to ensure accuracy and completeness in this literature, Liebert Corporation assumes no responsibility, and disclaims all liability for damages resulting from use of this information or for any errors or omissions Liebert Corporation. All rights reserved throughout the world. Specifications subject to change without notice. All names referred to are trademarks or registered trademarks of their respective owners. Liebert is a registered trademark of the Liebert Corporation. SL-11505C (R01-14) EmersonNetworkPower.com Precision Cooling Racks & Integrated Cabinets Services Business-Critical Continuity, Emerson Network Power and the Emerson Network Power logo are trademarks and service marks of Emerson Electric Co Emerson Electric Co.