How To Power And Cool A Data Center

Transcription

1 Architecting the Green Data Center Viktor Hagen Field Business Development Data Center & High Performance Computing 1

2 Where we are Today Environmental sustainability is a major global trend for the 21st century Corporations are adopting standards and implementing initiatives to improve the environmental performance of their operations Green DC and CCRE can provide Environmental benefits to owners and operators of Corporate and commercial real estate, that also reduces cost and risk 2

3 Power Consumption Mitigation What does Green Mean to You? Political Blue State, Red State Green Party Regulatory Compliance? Health Trader Joe s Whole Foods Walmart Social Hybrid s Bottled Water Technology Blades Scalable UPS Fuel Cells Economics Cost Centers Selective Accounting YOU? Control Influence 3

4 Growth Projections what are the experts saying? 2008, 50% of today s data centers will have insufficient power and cooling capacity to meet the demands of high-density equipment Through 2009, energy costs will emerge as the second-highest operating cost (behind labor) in 70% of DC facilities WW 2011, power demand for high-density equipment will level off or decline 2011, in-rack and in-row cooling will be the predominant cooling strategy for highdensity equipment 2011, in chasis cooling technologies will be adopted in 15% the servers Source: Gartner; Meeting the DC power and cooling challenge 4

5 Where does the Power Go? Losses in power generate heat CRAC 50% Power Supplied in the DC Server/Storage 26% Conversion 11% Network 10% Lighting 3% Each watt consumed by IT infrastructure carries a burden factor of 1.8 to 2.5 for power consumption associated with cooling, conversion/distribution and lighting* Source: APC 5

6 Cooling Supply or Distribution? Current designs being specified to cool up to 30kW per rack Supply? Distribution? Cisco Partner tested at 30KW and were able to cool in a normal server rack Tested different configurations and had very different cooling airflow results Targeted cooling utilizing modular hot/cold segregation essential to future-proof designs 6

7 Cooling Strategies by Rack Density Infrastructure Examples Cooling Options Consider In- row cooling or liquid-cooled racks Power per Rack (kw) RU Dual Core Servers s Hi Perf Blade Servers Fully ducted exhaust into hot aisle to prevent recirculation More than 2 tiles needed per rack. Consider Spot Cooling Vent rack exhausts, install closed cabinets and blanks to prevent recirculation 7

8 Enabling Hot Aisle/Cold Aisle Designs with High Density 6509 and 9513 Chassis Example: Panduit Cabinet 45RU (32 W x 40 D x 84 H) Up to 20kW/cabinet heat rejection capability s or s per Rack Front to back airflow into Hot Aisles Integrated Cable Management Modular design to support future air handlers or spot cooling Part # CN4-1 and CN4-2 for MDS 9513 and # CN4-3 for the Catalyst 6509E 8

9 Calculating Efficiency and Operating Costs 1MW for 1 Year = $ 486,618 KW = KVA x Power Factor Operating cost of a 1000 KW UPS system, having a 90% efficiency, at $0.10 per KWH, for one year at 50% load level Operating cost = 1000 KW x (1/.90 Efficiency at load level) x 8760 x $ 0.10 x load level 9

10 Affording the Next-Gen Data Center Legacy Server High-Density Server Power per Server 2-3 kw per rack > 20 kw per rack Power per Floor Space W/ft² W/ft² Cooling Needs chilled airflow cfm 3,000 cfm Source: Gartner ,000 ft² Annual Operating Expense = $800k Legacy DC designed to accommodate 2-3kW per Rack 800kW +33% Annual Operating Expense = $4.6M* Racks Introducing 1/3 high-density infrastructure into a legacy facility is cost prohibitive *Peripheral DC costs considered Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. 10

11 Data Center Zoning Allows for a mixed environment of high density/low density Allows for targeted availability, service levels, cooling and UPS run-time Aligns well to virtualized environments Presentation_ID Power & Cooling Power & Cooling 20kW Per Rack 5kW Per Rack 2006 Cisco Systems, Inc. All rights reserved. 11

12 Data Center Evolution Best Practices Consolidation Reduce Operating Expense Can Strain Power Grids, HVAC Systems, and Control Planes Also an Opportunity to Audit Power and Cooling Design Power & Cooling Reduce Component Count Increases Density Assessment Needed to Determine OPEX for site Assessment may be Needed to Audit Existing CPI Choose Efficient Components (Systems) Balance Density/Space Assess new Technology Targeted, Incremental Changes for Efficiency Virtualize to Increase Utilization Share Practices Evolving to Green 12

13 Where Cisco has Impact 13

14 Cisco ACE with FWSM Reduces Power by 85% Component/Conversion Point Reduction Design Efficiency Incremental Power Required (W) Performance Requirement 14,000 12,000 11,400 11,300 13, Gbps load balancing 10,000 8, Gbps Firewall 6, Virtual Contexts 4,000 1,820 High availability 2, SLBs 4 Firewalls 20 SLBs 2 Firewalls 20 SLBs 2 Firewalls 2 ACE 8 FWSM 85% power reduction with virtualized, integrated modules ~ 11kW Rack space saved by using virtualized, integrated modules ~30RU Additional savings from reduced cabling, port consumption and support costs 14

15 Reduce Power Consumption Through Service Density Design Efficiency Support for 200 contexts Example: 10 Servers per SLB/FW Context ACE Module = 220W Incremental for SSL Termination + SLB FWSModule = 172W Incremental for FireWalling ACE + FWSM Handle 200 SLB/FW Contexts 392W Incremental Total Catalyst

16 Appliance Model Repeats itself 700Watts at a time Design Inefficiency Example: 10 Servers per SLB/FW Context/Group 1) FW Appliance = 700W Incremental 2) SLB Appliance = 300W Incremental 3) App Firewall Appliance = 400W Incremental 700 Watts Incremental with each new Server Group (Items 2 and 3) 16

17 Appliance Model Repeats itself 700Watts at a time Example: 10 Servers per SLB/FW Context/Group Design Efficiency Design Inefficiency 392 Watts Incremental One Time Supports 200 Groups 700 Watts Incremental with EACH new Server Group 17

18 Appliance Model Deployed in Redundant Config Repeats itself 1400Watts at a time Example: 10 Servers per SLB/FW Context/Group Design Efficiency Design Inefficiency Redundant Configuration 800 Watts Incremental One Time Supports 200 Server Groups 1400 Watts Incremental with EACH new Server Group (x N) 18

19 Reduce Power Consumption Through Service Density Design Efficiency Support for 200 contexts Reduce complexity Increase manageability Reduce latency Eliminate single points of failure The ACE and FWSM deployed in a Catalyst 6500 provide these services within the network fabric, eliminating the appliances and their associated load 19

20 MDS SAN Fabric Virtualization is More Power Efficient than the Competition Legacy Solution SAN Island 1 (LSAN) Primary SAN Router Tape Library SAN Island 2 (LSAN) SAN Island 3 (LSAN) Backup SAN Router 3 x Other s Storage Switches Cisco MDS Solution VSAN 1 Tape Library VSAN 2 VSAN 3 MDS 9513 VSANs with Inter-VSAN Routing 20

21 Cisco MDS is more Power Efficient than the closest Competitor Apples to Apples Devices Required Stranded (wasted) Ports and Slots Max. Number of Isolated SANs Available Routing Bandwidth between SANs Power per Host Port Power Breakdown Other s Solution watts 2 routers (600w each) 3 Storage Directors: 5 Yes - 90 ports plus 9 slots 3 Up to 5x4G ISLs: 20G 2 100w each 3 32-port 90w each 2 16-port 90w each 3 Chassis with 100w each Design Efficiency Cisco MDS Solution Backplane BW: 48G / slot 3.23 watts 1 Cisco MDS 9513: 2 48-port 130w each 2 12-port 92w each 2 88w each 2 44w each 1 Chassis with 223w 1 None 256 Total Power Required 3450 Watts 931 Watts 21

22 Cisco s Virtualization Solutions Industry Leading Results Design Efficiency Common Physical Fabric Step1: Build a network solution using Virtual Fabrics MS Marketing SAN Sales SAN MS Step2 :Storage Virtualization Increase disk utilization to ~70% MS HR SAN Tape SAN Consolidate usable space in the actual Storage devices Taking a tape subsystem offline can save $3,800 in power and cooling per year Greater power savings and reduced footprint 22

23 CCRE and Sustainability Financial and Strategic Value The environmental benefits also create financial and strategic value through Lower Operating Costs Reduced Financial Risk Reduced Legal & Regulatory Risk Reduced Risk to Brand-Equity 23

24 Common Questions what are the variables? Name Plate or Average Operating Consumption? DC versus AC Power? How to calculate data center efficiency? How to measure at the systems level? Why should IT care? Cooling supply versus air distribution What is the networks role and where is it going? Where to learn more? Source: Gartner; Meeting the DC power and cooling challenge 24

25 In Closing Cisco s virtualization solutions slow the growth of power demand through increased utilization while reducing component count Cisco s next-generation products and solutions will further reduce power consumption at the systems level Cisco is focused on environmental concerns from executive direction to individual product design Cisco s CA group provides services for Power and Cooling auditing as a Network Readiness Assessment to assist with facilities support planning 25

26 What Can Be Done To Reduce Power Consumed by Network Services? Action Consolidate Networks Avoid Gateways and Consolidate Functions Virtualized Network Elements View Power Requirements Holistically Benefit/Implication Fewer Networks = Less Cost Reduce Storage Power Draw Specialized appliances are not power efficient due to redundant internal cooling, switching and power conversion elements 1 Network or Network Element per customer is power and space inefficient Consider technologies such as MPLS to enable future virtualization Prioritize efforts based upon reducing overall power consumption 26