Bret W. Lehman, PE GTS Site and Facilities Services March 25, 2011 A Blueprint for a Smarter Data Center Data Center Services helps you respond to change 2011 IBM Corporation
Change is accelerating IT demand Cost pressures Need for flexibility 82M 20% Servers installed by 2013 650% Storage growth by 2012 <30% Server workloads have been virtualized Disk storage is used effectively 75% 2-3% Of CIO s anticipate a strongly centralized infrastructure in 5 years Increase forecast for IT spending 70 Of every $1 is spent on maintaining existing environment 71% Of data centers are > 7 years old 5-60% Of IT workloads may be cloud-enabled 2 2011 IBM Corporation
Analytics-based approach provides insight for action Future Proof Rationalize the Portfolio Flexible Design Double IT capacity or Reduce OpEx by 50% Defer 40-50% of capital and operating expenses Integrated Management Determine the next focus area Model outcomes before you implement Justify expenditure Leverage automation Use discovery tools to gain insights to prioritize your actions Evaluate alternatives to predict outcomes and reduce risk Provide the TCO and FTE impacts to drive return on investment Execute faster and with less dependency on critical staff by infusing intelligence into tools 3 2011 IBM Corporation
Future proof IBM Lexington leveraged IT and data center infrastructure analytics to avoid $50M and gained 8x IT capacity Establish baseline energy use 20x more servers than needed White paper: Extend the life of an existing data center http://www935.ibm.com/services/us/cio/outs ourcing/ case_studies.html 10x increase in asset utilization Diagnose 8x growth in IT capacity 2x growth in number of servers Consolidate & Virtualize Best Practices Improved Operations Compute Resources 10% improvement from less over cooling Visibility, Automation, Control Right size infrastructure to virtualized IT workloads 15-20% power savings from actual usage Virtualization Log Jam Storage Explosion Application Rationalization Server Virtualization Services Storage Optimization Middleware Strategy Services and Design Services 4 2011 IBM Corporation
Future proof Server Virtualization Analytics cut transformation time in half and provide 6-18 month ROI for complex Wintel environments Challenge 10-30% virtualization success Majority is non-critical, infrastructure workloads Not able to tackle more complex virtualizations Benefits 50% reduced transformation costs 40-80% reduction in time to virtualize 6-18 months ROI on complex Wintel environments Up to 220% increase in instances managed per FTE Use Fit for virtualization analytics to profile workload into 6 scenarios Use Virtualization Fast Path prescriptive actions and finely tuned migration factory dedicated resources for rapid implementation 5 2011 IBM Corporation
Before Meetings to reach consensus Storage experts engaged at each step Most expensive storage tier requested After Increase utilization to >50% Free 50% of architects time 10-20% tier 1 storage reduction Policies, not people, drive decisions DEFINE ONCE USE OFTEN User input requested Define standard data types (15-20) Database Space Transaction Logs Archive Logs Database Binaries Size Availability Performance Enter data type needed Email Space/ Store Email Logs Email Archive Operational Recovery Disaster Recovery Shared File Space Static File Space Active File Space User Home Directories Voice Video Backup Exports Define key performance indicators Storage Backup/ Recovery Network Archive Future proof Intelligent Storage Service Catalog automates storage requests so the right resources are used for the right task at the right time Data Security Compliance Architect to infrastructure Disaster Recovery System App Binaries App Logs OS Migration Archive Disposal Business Continuity Services Storage provisioned 6 2011 IBM Corporation
Rationalize IBM s data center strategy uses tools to address complex decisions to balance the business requirements with objective analysis Enable growth New business and acquisition plans Virtualization and cloud adoption plans How many and where are assets needed Ensure availability Cost of outages Vulnerabilities Resiliency level Data replication techniques Improve efficiency In-source or out-source Lease or own Shift spending to new application development 7 2011 IBM Corporation
kva A Blueprint for a Smarter Data Center Resiliency Value $M (capex + opex + risk) 16 14 12 10 8 6 4 2 0 0 Physical Infrastructure Capacity Analysis Primary Data Center UPS Resiliency Rationalization Resiliency Value ($) to Outages per Year 100 200 300 400 500 600 700 800 900 Rationalize Our data center strategy analytics model outcomes and justify expenditures to reduce operating costs by 50% 1200 1000 800 600 400 200 0 2011 2013 2015 2017 2019 Single Site Twin Sites On Campus 8 2011 IBM Corporation Exposure ($ Thousands) Per Hour Twin Sites In Region Twin Sites Out of Region $ (Millions) 30 25 20 15 Cash Flow Analysis 1 2 3 4 5 Year Current budget is growing 6 percent per year. Retrofitting existing facilities yields an immediate budget savings of 12 percent. Performing end-of-life consolidations spreads out the costs, but only saves 4 percent over the five years. Consolidating to a new data center has the highest up-front costs, but reduces the annual budget by 33 percent.
Rationalize Analytics for logical dependency mapping applies mathematical modeling to identify application & server dependencies for relocation Deliver seamless transition Discover ~100% of the assets & dependencies in 50% less time; fix unsupported environments Reduce Risk Move dependent applications and equipment together Example: 27 servers 9 2011 IBM Corporation
Flexible Design IBM has designed over 480 modular data centers in the last 3 years to be responsive to change Scalable modular data center Enterprise modular data center Portable modular data center High density zone 15-25% lower TCO than traditional data centers Defer 40-50% of capex and opex cost Fully functional data center 35% lower cost than site retrofit We design to provide Capacity before you need it so it is ready when you need it Maximize flexibility for future technology and computing models Provide insight to make capital and operating trade-off decisions Interconnect IT, data centers and buildings for operations management excellence 10 Watch a video at :http://www-03.ibm.com/systems/data/flash/dynamicinfrastructure/datacenterdesignsolutions/ 2011 IBM Corporation
Flexible Design Modular data centers can defer 40-50% of the lifecycle costs to provide flexibility for the future Data center capital costs Focus on the 60% costs from mechanical and electrical systems Data Center operating costs Can be 3 to 5 times the capital costs Fees 24% Fit-Up Costs 9% Shell 7% Mechanical 20% Instrumentation & Controls 4% Power 36% Cumulative Cost of Operations ($Millions) $250 $200 $150 $100 $50 0 Energy Cost Staffing Bldg. Maint. & Mgmt. R E Tax Total Capex Cost Reduced Opex Costs 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Year 11 Source: IBM Estimates 2011 IBM Corporation
Data center design lifecycle cost analytics help clarify trade-offs between capital and operating costs over the life of the facility Example: 20,000 square foot data center, Computer room air conditioners Capital Costs Capital costs for Computer Room Air Conditioners can vary by 5x Flexible Design Operational Costs Operational cost for Computer Room Air Conditioners can vary by 140% $2 1.5 $3 2.5 2 Under-floor Cooling Combined Systems Close Coupled Close Coupled, RDHX $ Millions 1.5 $ Millions 1.5 1.5 0 Under-floor Cooling Combined Systems Close Coupled Cooling 0 1 2 3 4 5 6 7 8 9 10 Year Although highly efficient, close coupled cooling doesn't always provide the lowest TCO Rear door heat exchanger is the lowest cost solution to support high density equipment Raised floor cooling is cost effective for low density environment 12 2011 IBM Corporation Source: IBM Estimates
Maximize capacity and flexibility for technology and computing model adoption Business challenge: Server power density trends 1 : 20x Flexible Design Raleigh site challenge: Expected IT kw/rack power density 40 35% 30% 30 25% Kilowatts/rack 20 10 20% 15% 10% 5% 0% h 0 5 10 15 20 25 30 35 0 2000 2002 2004 2006 2008 2010 2012 2014 Source: Page 4, Figure 1.3, Best Practices for Datacom Facility Energy Efficiency Second Ed. (c) 2009. Solution Create a demand model which plans for rack density changes over time 32 kw rack equates to 1600 w/sf peak verses 100 w/sf average on data center floor Design for air cooling as primary but provide liquid cooling without disrupting operations Modularity creates agility 1. ASHRAE Publication: Datacomm Equipment Power and Cooling Applications, 2005, page 24 13 2011 IBM Corporation
Flexible Design Modular design allows for expansion of power and cooling density with minimal disruption to operations Electrical and Mechanical system sized to meet future capacity needs. Provisioned for potential water cooling. Modular UPS design and chiller plant design. Electrical switchgear sized to grow. Electrical distribution scalable per module Any to any connectivity between chillers, water side economizers, and pumps. 5 to 10% initial cost increase DC life expectancy Meeting future high density IT requirement Adapt Opex and Capex to business needs Meet growth requirement without down time; match spending to growth Improved service with lower risk for minimal cost" Piping for water cooling Modular design future CRAC capacity 14 2011 IBM Corporation Electrical switch gear sized to grow
Flexible Design Meet SLA agreements with cost-effective high availability Employ N+1 generators for standby for critical workloads. Provide chilled water storage for lower cost backup. Wet cell battery capacity provides 15 minutes of ride-through power Select variable drive and efficient chillers. A cost effective solution to resiliency Added resiliency to high density Added resiliency with operation in mind Improved energy and resiliency Chilled water storage N+1 Generators Adopt free cooling Reduce energy and increase availability for maintenance Wet cell batteries 15 2011 IBM Corporation
No regrets design decisions with 1-3 yr payback Based on cost of $0.10 kilowatt hour Flexible Design Employ premium efficiency motors. Provide Variable Frequency Drives (VFD) on pumps and motors. Use plug fans and EC motors on CRACs. Less than 1 year Less than 2 years Less than 3 years Variable Frequency Pump High Efficiency Chillers Select higher efficiency chillers. Adopt free cooling, check your climate zone for available the number of hours per year. Less than 3 years 1,000 hours with less than 5 years Free cooling - Water side economizer 16 2011 IBM Corporation
Integrated Management Raleigh integrates IT, data center & building management to improve availability, capacity planning & energy management Alerting to business impacts IT and Facilities metrics and dashboards Optimal asset placement Optimize energy with thermal mapping IBM Tivoli Monitoring ITM for Energy Management, TBSM, Netcool Active Energy Manager, Director OSISoft PI IBM Asset Lifecycle Management Key data, facility requirements IBM MMT Thermal measurement, modelling, spatial planning IT Server data; Asset data DATA CENTER BUILDING Room sensors; CRACs; PDUs Siemens BMS; SquareD 17 2011 IBM Corporation
Integration allows for improved asset purchase & placement decisions to help meet service level objectives throughout lifecycle Do I have the capacity to install new servers? Where can I locate the new servers? Integrated Management How to run at higher ASHRAE standards yet avoid hot spots? IT & Facilities Dashboard Asset Planning Information Thermal Analysis for Placement Real-time data for visibility to how much system capacity is available at all times. Improve visibility to power and cooling utilization for planning of new equipment. Include data center and facility assets in the service model. Collection and integration of assets and metered data with CAD layout to select optimal location in the service model. Reduced time and cost to deploy new IT equipment. Continuous feedback on utilization of critical systems. Analyze what if scenarios with Measurement and Management Technology (MMT) CFD modeling. Operate at higher ASHRAE temperatures (72-80 o F); reduce energy costs & maintain availability. Use IBM asset management to keep model content up to date. 18 2011 IBM Corporation
Instrumentation and interconnectivity allows for dynamic adjustment of the physical infrastructure to changes in IT workload DATA CENTER BUILDING Integrated Management Utility Integrated tools BMS Switchgear Generator CRAC Chiller VFD IT Temperature PDU VFD VFD Pressure BMS Pumps VFD Increase in IT Workload Integrated tools enable optimal placement of additional IT workload in the data center. Temperature sensors provide visibility to changes due to increased IT workload. Interconnectivity between IT and physical infrastructure communicates need for additional cooling. Physical Infrastructure Design of facilities infrastructure equipment with variable speed drives provides on demand cooling. Use of variable speed drives in chiller plant automatically responds to the increased cooling requirement with just the right amount of additional capacity. Cooling Tower 19 2011 IBM Corporation
Summary of IBM Raleigh Leadership Data Center Design / Build 9,300 sq m raised floor Economies of scale 18,600 sq m site High availability design point Support liquid cooled IT equipment Up to 15MW of IT power Operate IT Related Cloud computing support for public and private clouds Energy efficient of DCiE 66% to 71% High virtualization utilization Best practices equipment layout with hot / cold aisle configuration Continuously self-regulating energy efficient data center with integrated IT, facilities and building automation systems Real-time CFD monitoring and control for IT equipment placement Cooling Free cooling for 44% of the calendar year with water-side economizer Variable speed drives on chilled water pumping, chillers and air handlers Variable speed motors on CRAC s Increased set point to 10 o C chilled water supply Electrical Facilities Related Modular power density up to 32 kilowatts per rack High efficiency components for UPS, PDU Support for high density zones Other building systems Energy Efficient Lighting High R Value Insulation Green LEED Certification Objective Pursuing LEED Gold 95% original building shell reused 80% original materials recycled 20% new materials from recycled products Harvesting rainwater Energy Management Programs Government Incentives of $ 750,000 Renewable Energy Certificates 20 2011 IBM Corporation
RTP Building 301 Floor Plan Loading Dock Cooling Towers & Thermal Storage Tanks Chillers & Pumps 60,000 square-foot white space Phase 3: 40,000 square-foot white space Electrical Spine Customer Viewing Area High Density Area 21 2011 IBM Corporation
Integrated Management Tivoli Live monitoring services drastically reduced the time to isolate and diagnose a critical system problem for a mid-market client Business challenge Rapidly growing IT environment Escalating costs, recurring downtimes and lost productivity Technical talent required to solve problems Existing solutions are not effective Possible Incident Avoidance Alert 7 am, proactive repair time Mean time to recovery Shortened MTTR Notice threshold issue at 11 am, becoming Severity 1 Benefits 30% reduction in Severity 1 incidents 17% application availability improvement 88% reduction in alerts to operators by using automation 22 2011 IBM Corporation
Integrated Management Data center integrated monitoring and management analytics help you improve availability, capacity planning and energy efficiency Description Enhances their visibility to manage IT and facilities operations for mid-size clients Includes sensors, software and services Provide end-to-end implementation Benefits Correlate IT and facilities events Improve planning to support technology implementations Save up to 10% of total power and cooling capacity Reduce staffing requirements Typically deployed in a few days 23 2011 IBM Corporation
Leverage IBM s experience to help Overall: www.ibm.com/dynamicinfrastructure For CIOs: www.ibm.com/cio For facilities managers: www.ibm.com/services/siteandfacilities Bret W. Lehman, PE IBM GTS Site and Facilities Services bwlehman@us.ibm.com 24 2011 IBM Corporation
Research Triangle Park, NC For more information about the RTP Leadership Data Center (including photos and videos of the facility): http://www.ibm.com/services/us/cio/smarterdc/ 2011 IBM Corporation