Speaker: John Peterson Time: April 4, 2014, 9:45-10:45 a.m. Venue: Crystal 1-2 Data Center Design and Commissioning
High enterprise relevancy for addressing space, power, and cooling, as well as costs and skills for environments Large and enterprise-scale data center growth of 11% and 7% respectively, 2011 16 Data Center Trends Critical facilities design Design alterations based on density improvements In 2016, the same floor space will be able to house 22% more equipment than in 2011 More efficient data center design through modularity adoption Critical facilities strategy Optimized Critical facilities implementation According to the 2012 Uptime Institute survey, 80% of respondents have built a new data center or upgraded an existing facility within the past five years, and 30% of respondents ran out of data center capacity at one of their sites in 2012 2 An alarming inaccuracy for data center operators managing the thermal conditions at the room level, not the rack inlet level Available Between 2011 16 more than 11,000 new data centers will be constructed globally When building a new data center, around half of the respondents are interested in pursuing some kind of green certification, with the leading option being the U.S. Green Building Council s LEED program Critical facilities energy Critical facilities assurance A poorly designed data center may reduce IT and business agility Periodic refurbishment costs to upgrade and replace aging equipment, such as chillers and battery systems, driving TCO decisions
Forward-thinking companies have realized that to run data centers efficiently, and to extend their lives indefinitely, it is not logical to treat data center facilities and IT assets separately, because without one the other can t operate. David J. Cappuccino, Gartner, Inc. August 2011 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Aiming for the data center of the future Modular and elastic Shared resource pools Right sourcing Policy-based Fully automated Green Business-centric Integrated Real-time monitoring & control Fully service-oriented Efficient and effective Mature standardized processes Fully available and resilient Self-regulating
IT to Facilities: Why can t facilities fix my air problem?
Facilities to IT: Why don t you just do this?
How inefficiency can cost business Business impact related to cooling issues Server or system downtime Increased operational costs Data center outage Inability to add capacity Fail to support business growth Loss of revenue Lowered customer satisfaction
The data center lifecycle IT failure rates and facility longevity
CFD Analysis
Energy Audit & Optimization Report Recirculation-Impact of Blanking Panels
Outside Air Economizer & Humidity
Power To IT House power Misc. power IT power In Mech. power Main power PUE (Power Usage Effectiveness) CUE (Carbon Usage Effectiveness);WUE (Water Usage Effectiveness) ERE(Energy Reuse Effectiveness); ERF(Energy Reuse Factor) Fuel Emergency generator Utility transforme r Total data center energy House energy Total Direct Water Consumption CO 2 NO x CUE WUE Main service Total data center energy House panels District steam District chilled water Natural gas Fuel PP-Gen service Generato r block Heaters & lighting Data center Lighting panel Lighting, Exit lights, BMS, EPMS & security Misc. support PUE = UPS STS PDUs RPPs IT-critical load Mech. support Mech. Swgear Data center CRAC units, AHUs, Chillers & Dry coolers Total data center energy from all fuels (kwh) Total IT energy (kwh) ERF ERE 13 16 April 2014
Cooling and Power Systems Affect PUE Two system design concepts compared Max PUE = 1.63 Average PUE = 1.56 Annual Energy = 49 million kwh Difference is 5 million kwh ($500,000 at $0.10/kWH) Facilities Max PUE = 1.45 Average PUE = 1.41 Annual Energy = 44 million kwh 14 16 April 2014
Indoor Temperature and Moisture Levels ASHRAE recommendations at computer equipment air intakes MAXIMUM 80 F dry-bulb 67 F wet-bulb 60 F dew point MINIMUM 65 F dry-bulb 53 F wet-bulb 43 F dew point 15
Climate Zone Optimization
HVAC-CRAH data & measurements
HVAC System Power Measurements
Air Management measurements & analysis
Air Management measurements & analysis
COOLIN G SYSTEMS CRAC FANS HUM / DEHUM FUEL OTHER MECH IT UPS LOSSES GEN PRE- HEATER LIGHTS OTHER ELEC kw Energy Audit & Optimization Report CRAC/CRAH fan power optimization Data Centre Average Power Consumption 600 500 400 300 200 100 0 Too many CRAHs/Turn CRACs off! Controlled on return air! Low air temp & %RH set points! Controls fighting! Common issues Fixed speed fans, no VFDs! Old fan motors with low efficiency! Dual filters!
Energy Audit & Optimization Report Identification of overcooling & hot spots <59F 59-68F 68-77F 77-90F 90-104F >104F 45 40 35 30 25 20 15 10 5 0 Overcooling Hot Spots <15 15-20 20-25 25-32.2 32.2-40 >40
Energy Audit & Optimization Report Optimizing Air Management Recirculation: results in hot spots and wastes fan energy Consider return air plenum and ductwork for the CRAC units Remove obstructions under the floor that restrict cold air to supply the server inlets Ensure as best as possible the adequate supply of cold air to the server inlets Ensure air velocities and flows from floor grilles are sufficient to reach the top of cabinet servers Fit blanking plates in cabinets where servers are not installed Close gaps between cabinets (where warm air can make its way to the server inlet) Avoid installing highly loaded servers at the end of cabinet row or at the top where recirculation is easier Consider means to physically isolate the supply (cold) and return (hot) air streams Return air Recirculated air (if servers need more air than supplied) Server CRAC Supply air
Energy Audit & Optimization Report Optimizing Air Management Bypass: Starves servers from air and wastes fan energy Locate floor air grills so that they supply the inlet of servers, i.e. remove floor air grills from hot aisles and other useless areas Return air Ensure air velocities from floor grilles are not too high and overshoot the cabinet height Seal air gaps in the raised floor CRAC units turned off are a source of air bypass (consider air isolation with dampers) Server Bypass Floor tiles and racks badly located/o riented CRAC High exit velocity
Energy Audit & Optimization Report Optimizing Air Management Negative flow: Venturi flow Return air Negative flow if high underfloor air velocity Server CRAC
Energy Audit & Optimization Report Air Management Metrics-Practical Applications OPPORTUNITY BP Legacy D C, particularly if not well managed, tend to have high levels of both bypass and recirculation flow rates. Cold aisle hot aisle arrangements can address the main problems of recirculation. However, particularly at low loads, there will be high levels of bypass air, unless the CRAC units have some type of variable air-flow control.
CRAC 1 CRAC 2 Energy Audit & Optimization Report Perforated Tiles Locations Poor location and unnecessary
-15-10 -5 0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 105 110 115 120 DRY BULB TEMPERATURE - F Implementing ASHRAE conditions ASHRAE recommended & allowable ranges R ASHRAE PSYCHROMETRIC CHART NO.1 NORMAL TEMPERATURE BAROMETRIC PRESSURE: 29.073 INCHES OF MERCURY Copyright 1992 AMERICAN SOCIETY OF HEATING, REFRIGERATING AND AIR-CONDITIONING ENGINEERS, INC. 794 FEET R 80 75 75 WET BULB TEMPERATURE - F 70 70 65 60 65 Weather Data Location: SAN_ANTONIO, TEXAS, USA 55 90% 60 Weather Hours 11 to 1 22 to 12 33 to 23 44 to 34 55 to 45 66 to 56 77 to 67 88 to 78 99 to 89-15 -10-5 0 0 5 5 10 10 15 15 20 25 20 30 25 35 30 45 40 35 45 40 Class A3 50 50 80% Class A2 70% 60% 50% 40% 30% 20% 55 Recommended Class A1 10% RELATIVE HUMIDITY Class A4 28
Implementing ASHRAE conditions ASHRAE recommended & allowable ranges 29
Case study: HVAC system upgrades & Air Side Econ. The Client The Implemented Solution Networking provider IT/Communication industry 5,000 SF raised floor Perceived UTI Tier 3 Data Center San Francisco bay area SAT reset control from 61 to 74 F Hot/cold aisle rack layout, over head cooling. High eff 483 Ton WCC (CH-1), NPLV 0.405. VFD PCHWP-1- premium efficiency motor. VFD CWP-1-premium efficiency motor. VFD CT-1- premium efficiency motor. VFD WC CRAH-17 to CAH-24-prem eff motor ASE motorized damper intake hoods, VFD, premium efficiency motors. The Metrics Annual energy Savings 1,658,922 kwh Demand reduction 111 kw Carbon reduction 498 Metric Tons PUE improvement 10% The Financials Annual energy cost savings $165,892 Total incentives-pg&e $232,249.14 SPB 4.4 years NPV +28k IRR 12%
Case study-air management via hot aisle containment The Client The Implemented Solution National Company Communication industry 10,000 SF raised floor Perceived UTI-Tier 2 Data Center San Francisco bay area The Metrics Annual energy Savings 525,600 kwh Demand reduction 58 kw Annual Carbon reduction 158 Metric Tons PUE improvement 4% The Financials Annual energy cost savings $57,816 Total incentives-pg&e $46,216 SPB 3.8 years NPV +35k IRR 16%
Thank you Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Speaker: Raja Natarajan Time: April 4, 2014, 9:45-10:45 a.m. Venue: Crystal 1-2 Data Center Design and Commissioning
The Commissioning Process
The Process Define Owners Project Requirements Building Due Diligence Identify Performance Outcomes Lessons Learned Review Clients Brief Draft Commissioning Plan
The Process Commissionability & Maintainability Single Points of Failure Elimination 1:10:100 Potential Cost Savings Avoid Blind Value Engineering Thought for the Facility Manager
The Process Clear & Concise Tender Instructions Give the contractor a fighting chance Avoid unnecessary variations Identify on and offsite requirements
The Process Built for Commissioning Early Installation Fault Identification Logical Integration into Construction Schedule Clear identification of approved processes Off-Site Factory Tests
The Process Task Tracking and Verification All tasks identified and tracked Proactive support not bullying Aim to minimize repeat testing Witness verification
Testing of Major Equipment Mechanical Chillers, CRAC Units Electrical UPS, STS, Generators Fire Protection Systems Gaseous suppression systems, Pre-action Systems BMS & Controls
The Process Provide absolute confidence Demonstrate of performance and integration Fire and Life Safety Secure Power and Cooling Documented Audit Trail Trained to Operate
Heat Load Tests (HLT) To demonstrate the performance of the cooling system using a substitute load to simulate actual conditions To monitor/record the effects of simulated failures and changeover of system operation on the cooling system All testing of individual equipment to be complete prior to HLT
Integrated Systems Tests (IST) Failure conditions are simulated to ensure systems react in a manner to which they are designed Used to verify the correct integrated operation of the Data Center in various cause and effect modes of failure
Tests conducted during IST Electrical Simulate failure of Main Utility Power and demostrate operation of generator Simulate failure of generator power and demonstrate battery operation of UPS system Simulate failure of UPS System and demonstrate operation of STS System
Tests conducted during IST Mechanical Simulate failure of Chiller / Chillers and demonstrate capability of chiller control system Simulate failure of CRAC units and demonstrate capability of CRAC control system Carry out simulation of fire alarms and effect on data center
The Process Adjust to Suit Observe use Tune to suit Educate to avoid override
The Process Continuous Commissioning Defect Resolution Seasonal Adjustment Fit for purpose Transitional Commissioning
Commissioning Management Process Copyright: BSRIA
Energy Efficiency of Data Centers Due to technological advances, demand for data center space throughout the developed world will remain high. Amount of electricity consumed will be exceptionally high due to the high power demands of data centers It is important to monitor and improve the energy efficiencies of the data centers
Recent Government Developments Early appointment of Commissioning Agent to discuss and agree strategies to optimize energy efficiencies within data center Proper sealing of the data center environment Optimizing air flow Increasing cooling system efficiencies System of monitoring and tracking of energy efficiency parameters
Improving Energy Efficiency through Commissioning Management Effective commissioning has been shown to improve the operating efficiency and environmental performance of a building over its life cycle. Commissioning is growing in importance due to the growing complexity of buildings Continuous commissioning has been proven to save energy and costs throughout the life of the building
Thank You Raja Natarajan Commissioning Manager Commtech Asia raja@commtechasia.com Mobile (852) 98152939 Tel (852) 2523 4411 11A, W Square, 318 Hennessey Road, Wanchai, Hong Kong