Architecting the Green Data Center Viktor Hagen Field Business Development Data Center & High Performance Computing 1
Where we are Today Environmental sustainability is a major global trend for the 21st century Corporations are adopting standards and implementing initiatives to improve the environmental performance of their operations Green DC and CCRE can provide Environmental benefits to owners and operators of Corporate and commercial real estate, that also reduces cost and risk 2
Power Consumption Mitigation What does Green Mean to You? Political Blue State, Red State Green Party Regulatory Compliance? Health Trader Joe s Whole Foods Walmart Social Hybrid s Bottled Water Technology Blades Scalable UPS Fuel Cells Economics Cost Centers Selective Accounting YOU? Control Influence 3
Growth Projections what are the experts saying? 2008, 50% of today s data centers will have insufficient power and cooling capacity to meet the demands of high-density equipment Through 2009, energy costs will emerge as the second-highest operating cost (behind labor) in 70% of DC facilities WW 2011, power demand for high-density equipment will level off or decline 2011, in-rack and in-row cooling will be the predominant cooling strategy for highdensity equipment 2011, in chasis cooling technologies will be adopted in 15% the servers Source: Gartner; Meeting the DC power and cooling challenge 4
Where does the Power Go? Losses in power generate heat CRAC 50% Power Supplied in the DC Server/Storage 26% Conversion 11% Network 10% Lighting 3% Each watt consumed by IT infrastructure carries a burden factor of 1.8 to 2.5 for power consumption associated with cooling, conversion/distribution and lighting* Source: APC 5
Cooling Supply or Distribution? Current designs being specified to cool up to 30kW per rack Supply? Distribution? Cisco Partner tested at 30KW and were able to cool in a normal server rack Tested different configurations and had very different cooling airflow results Targeted cooling utilizing modular hot/cold segregation essential to future-proof designs 6
Cooling Strategies by Rack Density 25 20 Infrastructure Examples Cooling Options Consider In- row cooling or liquid-cooled racks Power per Rack (kw) 15 10 5 0 21 2RU Dual Core Servers 2 6509 s Hi Perf Blade Servers Fully ducted exhaust into hot aisle to prevent recirculation More than 2 tiles needed per rack. Consider Spot Cooling Vent rack exhausts, install closed cabinets and blanks to prevent recirculation 7
Enabling Hot Aisle/Cold Aisle Designs with High Density 6509 and 9513 Chassis Example: Panduit Cabinet 45RU (32 W x 40 D x 84 H) Up to 20kW/cabinet heat rejection capability 3 6509 s or 3 9513 s per Rack Front to back airflow into Hot Aisles Integrated Cable Management Modular design to support future air handlers or spot cooling Part # CN4-1 and CN4-2 for MDS 9513 and # CN4-3 for the Catalyst 6509E 8
Calculating Efficiency and Operating Costs 1MW for 1 Year = $ 486,618 KW = KVA x Power Factor Operating cost of a 1000 KW UPS system, having a 90% efficiency, at $0.10 per KWH, for one year at 50% load level Operating cost = 1000 KW x (1/.90 Efficiency at load level) x 8760 x $ 0.10 x load level 9
Affording the Next-Gen Data Center Legacy Server High-Density Server Power per Server 2-3 kw per rack > 20 kw per rack Power per Floor Space 30-40 W/ft² 700-800 W/ft² Cooling Needs chilled airflow 200-300 cfm 3,000 cfm Source: Gartner 2006 20,000 ft² Annual Operating Expense = $800k Legacy DC designed to accommodate 2-3kW per Rack 800kW +33% Annual Operating Expense = $4.6M* 100-200 Racks Introducing 1/3 high-density infrastructure into a legacy facility is cost prohibitive *Peripheral DC costs considered Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. 10
Data Center Zoning Allows for a mixed environment of high density/low density Allows for targeted availability, service levels, cooling and UPS run-time Aligns well to virtualized environments Presentation_ID Power & Cooling Power & Cooling 20kW Per Rack 5kW Per Rack 2006 Cisco Systems, Inc. All rights reserved. 11
Data Center Evolution Best Practices Consolidation Reduce Operating Expense Can Strain Power Grids, HVAC Systems, and Control Planes Also an Opportunity to Audit Power and Cooling Design Power & Cooling Reduce Component Count Increases Density Assessment Needed to Determine OPEX for site Assessment may be Needed to Audit Existing CPI Choose Efficient Components (Systems) Balance Density/Space Assess new Technology Targeted, Incremental Changes for Efficiency Virtualize to Increase Utilization Share Practices Evolving to Green 12
Where Cisco has Impact 13
Cisco ACE with FWSM Reduces Power by 85% Component/Conversion Point Reduction Design Efficiency Incremental Power Required (W) Performance Requirement 14,000 12,000 11,400 11,300 13,300 10 Gbps load balancing 10,000 8,000 20 Gbps Firewall 6,000 10 Virtual Contexts 4,000 1,820 High availability 2,000 0 20 SLBs 4 Firewalls 20 SLBs 2 Firewalls 20 SLBs 2 Firewalls 2 ACE 8 FWSM 85% power reduction with virtualized, integrated modules ~ 11kW Rack space saved by using virtualized, integrated modules ~30RU Additional savings from reduced cabling, port consumption and support costs 14
Reduce Power Consumption Through Service Density Design Efficiency Support for 200 contexts Example: 10 Servers per SLB/FW Context ACE Module = 220W Incremental for SSL Termination + SLB FWSModule = 172W Incremental for FireWalling ACE + FWSM Handle 200 SLB/FW Contexts 392W Incremental Total Catalyst 6500 15
Appliance Model Repeats itself 700Watts at a time Design Inefficiency Example: 10 Servers per SLB/FW Context/Group 1) FW Appliance = 700W Incremental 2) SLB Appliance = 300W Incremental 3) App Firewall Appliance = 400W Incremental 700 Watts Incremental with each new Server Group (Items 2 and 3) 16
Appliance Model Repeats itself 700Watts at a time Example: 10 Servers per SLB/FW Context/Group Design Efficiency Design Inefficiency 392 Watts Incremental One Time Supports 200 Groups 700 Watts Incremental with EACH new Server Group 17
Appliance Model Deployed in Redundant Config Repeats itself 1400Watts at a time Example: 10 Servers per SLB/FW Context/Group Design Efficiency Design Inefficiency Redundant Configuration 800 Watts Incremental One Time Supports 200 Server Groups 1400 Watts Incremental with EACH new Server Group (x N) 18
Reduce Power Consumption Through Service Density Design Efficiency Support for 200 contexts Reduce complexity Increase manageability Reduce latency Eliminate single points of failure The ACE and FWSM deployed in a Catalyst 6500 provide these services within the network fabric, eliminating the appliances and their associated load 19
MDS SAN Fabric Virtualization is More Power Efficient than the Competition Legacy Solution SAN Island 1 (LSAN) Primary SAN Router Tape Library SAN Island 2 (LSAN) SAN Island 3 (LSAN) Backup SAN Router 3 x Other s Storage Switches Cisco MDS Solution VSAN 1 Tape Library VSAN 2 VSAN 3 MDS 9513 VSANs with Inter-VSAN Routing 20
Cisco MDS is more Power Efficient than the closest Competitor Apples to Apples Devices Required Stranded (wasted) Ports and Slots Max. Number of Isolated SANs Available Routing Bandwidth between SANs Power per Host Port Power Breakdown Other s Solution 11.98 watts 2 routers (600w each) 3 Storage Directors: 5 Yes - 90 ports plus 9 slots 3 Up to 5x4G ISLs: 20G 2 CPs @ 100w each 3 32-port modules @ 90w each 2 16-port modules @ 90w each 3 Chassis with fans @ 100w each Design Efficiency Cisco MDS Solution Backplane BW: 48G / slot 3.23 watts 1 Cisco MDS 9513: 2 48-port modules @ 130w each 2 12-port modules @ 92w each 2 Sup-2 @ 88w each 2 Crossbars @ 44w each 1 Chassis with fans @ 223w 1 None 256 Total Power Required 3450 Watts 931 Watts 21
Cisco s Virtualization Solutions Industry Leading Results Design Efficiency Common Physical Fabric Step1: Build a network solution using Virtual Fabrics MS Marketing SAN Sales SAN MS Step2 :Storage Virtualization Increase disk utilization to ~70% MS HR SAN Tape SAN Consolidate usable space in the actual Storage devices Taking a tape subsystem offline can save $3,800 in power and cooling per year Greater power savings and reduced footprint 22
CCRE and Sustainability Financial and Strategic Value The environmental benefits also create financial and strategic value through Lower Operating Costs Reduced Financial Risk Reduced Legal & Regulatory Risk Reduced Risk to Brand-Equity 23
Common Questions what are the variables? Name Plate or Average Operating Consumption? DC versus AC Power? How to calculate data center efficiency? How to measure at the systems level? Why should IT care? Cooling supply versus air distribution What is the networks role and where is it going? Where to learn more? Source: Gartner; Meeting the DC power and cooling challenge 24
In Closing Cisco s virtualization solutions slow the growth of power demand through increased utilization while reducing component count Cisco s next-generation products and solutions will further reduce power consumption at the systems level Cisco is focused on environmental concerns from executive direction to individual product design Cisco s CA group provides services for Power and Cooling auditing as a Network Readiness Assessment to assist with facilities support planning 25
What Can Be Done To Reduce Power Consumed by Network Services? Action Consolidate Networks Avoid Gateways and Consolidate Functions Virtualized Network Elements View Power Requirements Holistically Benefit/Implication Fewer Networks = Less Cost Reduce Storage Power Draw Specialized appliances are not power efficient due to redundant internal cooling, switching and power conversion elements 1 Network or Network Element per customer is power and space inefficient Consider technologies such as MPLS to enable future virtualization Prioritize efforts based upon reducing overall power consumption 26