Elements of Energy Efficiency in Data Centre Cooling Architecture

Elements of Energy Efficiency in Data Centre Cooling Architecture Energy Efficient Data Center Cooling 1 STULZ Group of Companies Turnover 2006 Plastics Technology 400 Mio A/C Technology 200 Mio Total Employees 600 Mio Plastics Technology 2.100 A/C Technology 1.200 Total 3.300 A/C Technology Manufacturer and Distributor of Air Conditioning Products, Systems Engineering, Service and Object Management. STULZ GmbH, Germany (P) STULZ Pty Ltd., Australia STULZ-ATS (Shanghai), China (P) STULZ France S.A.R.L., France STULZ UK Ltd., Great Britain STULZ CHSPL Pvt. Ltd., India (P) STULZ SpA, Italy (P) STULZ Groep B.V., Netherlands STULZ Ltd., New Zealand STULZ Polska Sp. z o.o., Poland STULZ España S.A., Spain STULZ-ATS Inc., USA (P) (P): Production Site Plastics Technology Development and Production of Technical Plastic Components for automotive industry. MONTAPLAST GmbH, Germany MONTAPLAST of North America, Inc. MONTAPLAST Automotive System (SIP) Co.,LTD Energy Efficient Data Center Cooling 2 1

STULZ International Production Sites»STULZ»Air Technology Systems,»Frederick/MD, USA»STULZ S.p.A.»Valeggio sul Mincio(VR),»Italy»STULZ GmbH»Hamburg, Germany»STULZ»Air Technology Systems»(Shanghai), China»STULZ CHSPL (India)»Pvt. Ltd., India Energy Efficient Data Center Cooling 3 Headquarter Find STULZ... Germany Production Sites Germany Italy USA India and its qualified and professional partners worldwide. China Energy Efficient Data Center Cooling 4 2

Why Energy Efficient Cooling? Energy Efficient Data Center Cooling 5 Source: Lawrence Berkeley National Lab; Data centre energy benchmark case studies Energy Efficient Data Center Cooling 6 3

Energy Flow through the Data Centre Energy Efficient Data Center Cooling 7 again: Why energy efficient cooling? Save operating cost throughout the data centre's lifetime Get more IT capacity out of your data centre at a given available power by reducing power use of secondary physical infrastructure Energy Efficient Data Center Cooling 8 4

Elements influencing the Efficiency The Rack The Raised Floor The CRAC unit The Room Forced Air Cooling InRow Cooling Dynamic Free Cooling Energy Efficient Data Center Cooling 9 Elements influencing the Data Centre Cooling Efficiency Free Cooling Air Distribution Refrigerant Charge Filter Status Installed Options Ambient Conditions (Location) Room Temperature Room Humidity Raised Floor Height Perforated Tile Quantity Redundancy Level Pump Technology Pipe Sizing Refrigerant Dimensions Fan Technology Drycooler Size Filter Surface Water Temperatures Part Load Behaviour Heat Exchanger Surface Perforated Tile Opening Factor Leakage Airflow Rate Energy Efficient Data Center Cooling 10 5

Elements influencing the Efficiency The Rack The Raised Floor The CRAC unit The Room Forced Air Cooling InRow Cooling Dynamic Free Cooling Energy Efficient Data Center Cooling 11 Blanking plates in the rack separation of cold and hot aisle in the rack Source: HP informs: How to Meet 24 by Forever Demands of Your Data Center Prevent internal hot air recirculation by sealing the front of cabinets with blanking plates, including empty areas in the equipment mounting surface, between the mounting rails, and the edges of the cabinets (if necessary). Energy Efficient Data Center Cooling 12 6

Elements influencing the Efficiency The Rack The Raised Floor The CRAC unit The Room Forced Air Cooling InRow Cooling Dynamic Free Cooling Energy Efficient Data Center Cooling 13 Raised floor for decades of cables??? Energy Efficient Data Center Cooling 14 7

Raised floor For supply air (and cables/pipes) Energy Efficient Data Center Cooling 15 Leakage Airflow - to be avoided Energy Efficient Data Center Cooling 16 8

Air Cooling A matter of Raised Floor Design - Free raised floor height - the more, the better - Leakage Airflow - close all unwanted openings - Cabling or Air - if used for both, define space for each - Tile open area and number of tiles - less is more Energy Efficient Data Center Cooling 17 Elements influencing the Efficiency The Rack The Raised Floor The CRAC unit The Room Forced Air Cooling InRow Cooling Dynamic Free Cooling Energy Efficient Data Center Cooling 18 9

System Selection Major Influence on CAPEX and OPEX A G GE CW ACW GCW CW2 : Direct expansion - air cooled : Direct expansion - water cooled : Direct expansion - water cooled AND freecooling (Standard version) : Chilled water : Dualfluid - Direct expansion - aircooled and chilled water : Dualfluid - Direct expansion - watercooled and chilled water : Dual chilled water Energy Efficient Data Center Cooling 19 Influence of the fan technology on the power consumption Annual energy costs fan only [8.500m³/h at 350Pa] Energy costs [Euro/Year] 2.200 2.100 2.000 1.900 1.800 1.700 1.600 1.500 1.400 1.300 1.200-20% -28% -10% Centrifugal Plug fan STULZ EC fan Energy cost savings with EC fan compared to ordinary fans Energy Efficient Data Center Cooling 20 10

Design of the CRAC unit: Build in Energy Efficiency Low power consumption by means of State of the art fan technology EC-Fans Low Air Resistance Heat Exchanger Low Air Resistance Filter with increased surface Enlarged Casing Free of charge reheat with optional refrigerant reheat Control of external Ultrasonic Humidifier...but an acceptable footprint is still achieved! Energy Efficient Data Center Cooling 21 Stand-by Managment Sample: 3x ASD1500CW At 24 C/50% with 7/12 C water incl. 1/3 standby capacity Standby Airflow: 2x 29.000 m³/h Fan absorbed power: 2x 8,0 = 16,0 kw Lpa,2m = 2x 59,7dBA = 62,7dBA Airflow: 3x 19.000 m³/h Fan absorbed power: 3x 2,3 = 6,9 kw Lpa,2m = 3x 50,8dBA = 55,6dBA 2x 112,1 = 224,2 kw net sensible 3x 75,1 = 225,3 kw net sensible Benefits: + Considerable energy savings + Reduced noise levels => Energy savings: 9,1 kw x 8760h x 0,13 = 10.363 /year @ 0,13 /kwh => Noise reduction: -7,1 dba Energy Efficient Data Center Cooling 22 11

Elements influencing the Efficiency The Rack The Raised Floor The CRAC unit The Room Forced Air Cooling InRow Cooling Dynamic Free Cooling Energy Efficient Data Center Cooling 23 Room Efficiency Best Room Efficiency will be reached, if each m³ of cold air leaving the CRAC unit, passing the data centre and reaching the return air of the CRAC unit, takes only once the design amount of heat from the IT equipment. Means: No leakage airflow, no recirculating air, no bypass air. Energy Efficient Data Center Cooling 24 12

How much Air Volume? Low air volume Right air volume High air volume Source: Intel Energy Efficient Data Center Cooling 25 How to guide the Air through the Room. Energy Efficient Data Center Cooling 26 13

Air Cooling A matter of a Defined Air Path (1/3) Cold Supply Air: Directly into the Room Warm Return Air: Through the Room Part of the raised floor must be closed (hot aisle) Increase of cooling capacity/efficiency due to better defined air path Still risk of air short circuit (top of Racks, end of rows) Usable in combination with non-19 -stand alone equipment 1 tile/rack, 600cfm/tile, 120cfm/kW => 5kW/rack can be removed SOURCE: ASHRAE - Datacom Equipment Power Trends and Cooling Applications Energy Efficient Data Center Cooling 27 Air Cooling A matter of a Defined Air Path (2/3) Cold Supply Air: Directly into the Room Warm Return Air: Through duct and false ceiling Whole raised floor can be used for perforated tiles No need for front to front layout Increased cold air supply to the room / rack front area possible Usable in combination with non-19 -stand alone equipment 2 tile/rack, 600cfm/tile, 120cfm/kW => 10kW/rack can be removed SOURCE: ASHRAE - Datacom Equipment Power Trends and Cooling Applications Energy Efficient Data Center Cooling 28 14

Air Cooling A matter of a Defined Air Path (3/3) Cold Supply Air: Directly into the Rack Warm Return Air: Through duct and false ceiling No need for perforated tiles No need for front to front layout Usable in combination with non-19 -stand alone equipment High Delta T Cooling (20 C) with Blade Servers poss ible e.g. 2000cfm/rack, 100cfm/kW => 20kW/rack can be removed SOURCE: ASHRAE - Datacom Equipment Power Trends and Cooling Applications Energy Efficient Data Center Cooling 29 Elements influencing the Efficiency The Rack The Raised Floor The CRAC unit The Room Forced Air Cooling InRow Cooling Dynamic Free Cooling Energy Efficient Data Center Cooling 30 15

Air Cooling A matter of a Defined Air Path Air Distribution Unit ADU» Conditioned Room Air Is: Pulled in from underneath raised floor Delivered from bottom to top of rack by dual fans Drawn in by the IT equipment» Provides Cooler Air to the Rack Provides better cooling for IT equipment reducing heat related failures. Extends the life of equipment in the rack Energy Efficient Data Center Cooling 31 Air Cooling A matter of a Defined Air Path Air Removal Unit ARU» Hot air scavenging systems Collect hot air at the point of generation Route directly to CRAC Snap-on retrofit 2,000 CFM airflow Variable speed: as needed Dual Path Power and N+1 Flexible, Movable Hard floor or raised floor» Applications Rack density needs to increase» Limit: 12.5 kw per rack for servers Up to 23 kw per rack for blades Energy Efficient Data Center Cooling 32 16

Air Cooling A matter of a Defined Air Path Energy Efficient Data Center Cooling 33 Air Cooling A matter of a Defined Air Path Energy Efficient Data Center Cooling 34 17

Elements influencing the Efficiency The Rack The Raised Floor The CRAC unit The Room Forced Air Cooling InRow Cooling Dynamic Free Cooling Energy Efficient Data Center Cooling 35 APC InRow Cooling System IT Racks Cooling Front View Energy Efficient Data Center Cooling 36 18

»InRow Cooling APC InRow Cooling System Close coupled heat source and heat removal Raised floor not required for air distribution Energy Efficient Data Center Cooling 37 APC InRow Cooling with Hot Aisle Containment System (HACS) Energy Efficient Data Center Cooling 38 19

APC InRow Cooling with Hot Aisle Containment System (HACS) Energy Efficient Data Center Cooling 39 Secure Chilled Water Supply Chiller mounted indoors Condenser / Drycooler CyberAir Air Conditioning Unit CyberCool CSI Indoor Chiller Energy Efficient Data Center Cooling 40 20

Secure Chilled Water Supply Chiller mounted outdoors CyberCool CSO Chiller mounted outside CyberAir Air Conditioning Unit CyberCool CPI System Transfer / Pump Station Energy Efficient Data Center Cooling 41 Secure Chilled Water Supply for existing Chilled Water Sources CyberCool CPI System Transfer / Pump Station Energy Efficient Data Center Cooling 42 21

Elements influencing the Efficiency The Rack The Raised Floor The CRAC unit The Room Forced Air Cooling InRow Cooling Dynamic Free Cooling Energy Efficient Data Center Cooling 43 CyberAir with DFC lowers TCO TCO Total Cost of Ownership Amortisation CyberAir 2 Extra Investment CyberAir 2 Basic Investment Ordinary Climate Control Running Time Lower Opex Higher Capex Energy Efficient Data Center Cooling 44 22

Hybrid Climate Control System»Automatic selection of energy efficient cooling mode depending on outdoor temperature and thermal load»compressor operation or Free Cooling in four modes»electronic Expansion Valve: increased COP compressor cooling in MIX mode»dynamic component control ( pump, fan unit, expansion valve, fan dry cooler and water valves)»dynamic water temperature in order to get the maximum energy saving Energy Consumption FC Free Cooling EFC Extended Free Cooling High efficient MIX mode Compressor & Free Cooling DX Compressor Cooling Energy Efficient Data Center Cooling 45 Regions for Free Cooling Energy Efficient Data Center Cooling 46 23

System Design The Location / The Temperature Profile MIX & Free Cooling Compressor Energy Efficient Data Center Cooling 47 System Design 1 Use of Dynamic Free Cooling System CapEx: +75% OpEx: -30% 10year savings: 814 k Energy Efficient Data Center Cooling 48 24

Annual Operating Hours Percentage per Mode Energy Efficient Data Center Cooling 49 Various possibilities to analyse/optimise Energy Efficient Data Center Cooling 50 25

System Design 2 Chilled Water w/o and w/ Free Cooling CapEx: +11% OpEx: -3.3% 10year savings: 103 k Energy Efficient Data Center Cooling 51 System Design 3 Chilled Water Temperature UP CapEx: -6% (!!) OpEx: -29% 10year savings: 1.811 k Energy Efficient Data Center Cooling 52 26

System Design 3 Chilled Water Temperature UP Energy Efficient Data Center Cooling 53 System Design 4 without vs. with Standby Management CapEx: +0% OpEx: -10% 10year savings: 110 k Energy Efficient Data Center Cooling 54 27

System Design 4 without vs. with Standby Management Energy Efficient Data Center Cooling 55 Return Air temperature Room temperature Return Air 24 C I M P O R T A N T!!! 21 C Return Air Room Depending on heat load the return air temp. is at least 2-3K higher than room temperature Supply Air 16 C Energy Efficient Data Center Cooling 56 28

System Design 5 Influence of Return Air Temperature CapEx: -<1% OpEx: -39% 10year savings: 1.130 k Energy Efficient Data Center Cooling 57 System Design 5 Influence of Return Air Temperature Energy Efficient Data Center Cooling 58 29

...thank you for your attention Energy Efficient Data Center Cooling 59 30