Engineers Ireland Cost of Data Centre Operation/Ownership. 14 th March, 2013 Robert Bath Digital Realty

Transcription

1 Engineers Ireland Cost of Data Centre Operation/Ownership 14 th March, 2013 Robert Bath Digital Realty

2 Total Cost of Operation (TCO) Rental TCO - 10 Year Lease Term Power Cooling Connectivity Costs 26% Rental Costs 46% Connectivity Corporation Tax Power Costs 28% 1 1

3 Rental Design (return on capital calculation) Geography (inner city/ring roads) Wholesale/Colocation Campus vs. Single Facility footprint (de-centralised system enhances flexibility for future adaptation) 2 2

4 Power Pricing Structure Per unit kwh s used (MID revenue/energy grade metering) Inclusion of all other charges (Settlement, Standing, Climate Charge Levy) Pro-rata Full circuit complement (colocation) Load Aggregation across sites Bulk buying potential Contract type Fixed contract (flat rate helps with market volatility) Index contract (variable rate usually cheaper) Legislative change & impact on pricing (Germany/Japan, Green Agenda) Demand Response (Generation reserve margin) Onsite substation Capacity (economies of scale) Serving voltage level (distribution losses, utility management of the network increases with each step-down in T&D voltage associated cost uplift at lower distribution levels, saturated voltage levels) Annualised power costs Over the term of lease Contrasting cooling systems and associated impact on power costs 3 3

5 Financial Impact * Capacity utilisation consistent with that reflected on following graph (PUE vs. Capacity Utilisation) - PUE 1.12 Indirect Low Energy (Total Power Costs over the 10 year term - 5,022,865) - PUE 1.6 Traditional Chilled Water (Total Power Costs over the 10 year term 7,827,235) 4 4

6 PUE vs. Capacity Utilisation (Based on 10 year lease) * Each increment in Capacity Utilisation reflects the uplift in capacity in each of the 10 years of the lease term 5 5

7 Financial Impact Total Cost of Operation (TCO) Analysis based on: Operating hours 8760 (24/7/365) 720kW datacentre operating through the load spectrum 0.10/kWh Electrical Power Cost Power Saving When comparing a traditional 1.60 PUE against 1.12 PUE the differential in energy operating costs equates to c. 280,000/annum, or over 2.8million over the 10 year lease term (Power costs are 7.8M for the traditional and 5M for the low energy PUE over the 10 year term) This equates to a 32/kW/month saving or 130/rack/month (based on 180 racks/hall) Water Costs Very low water consumption in Dublin only limited peak temperature duration, and still target of 24 degrees supply can be maintained Key Observation: The savings in annual operating cost alone, could significantly influence the overall the real estate cost 6 6

8 Cooling Solution Chilled Water Open and closed architecture With elevated chilled water temperatures (18-25 C flow/return) and enclosed hot/cold aisle containment substantial improvement in annualised PUE can be realised. Direct expansion (DX) Typically used as a top-up or alternative to a primary system in large purpose built facilities. High OPEX in full DX. Low Energy In-direct outside air incorporating contained aisle solution in Dublin - target PUE = 1.12, 100% free-cooling for 8760 hours - NO mechanical refrigeration required to support the IT load. Direct outside air incorporating contained aisle solution in Dublin - target PUE = 1.16, typically DX required on closed cycle necessitating capacity uplift on all supporting electrical infrastructure 7 7

9 Proposed Design Solution Cooling Efficiency References: The Green Grid, 2007, The Green Grid Data Center Power Efficiency Metrics: PUE and DCiE, Technical Committee White Paper, Environmental Protection Agency, ENERGY STAR Program, 2007, Report to Congress on Server and Data Energy Efficiency. Excool Systems energy usage is 3.5kW per 100kW system load for London based DC If other support systems (UPS, lighting etc) kept to 6.5% PUE =

10 Cooling - Architecture Cold Aisle Containment System (CACS) 9 9

11 Cooling Architecture CACS & HACS Cooling systems can be set to higher supply temperatures (saving energy & increasing cooling capacity) Elimination of hot spots (uniform IT inlet temperature) Economiser mode hours increase (increase set-point temperature larger number of hours that cooling can turn off compressors save energy) Humidification/dehumidification costs reduced (saves energy and water) By eliminating mixing between hot and cold air the supply air temperature can be increased allowing the cooling system to operate above the dew point temperature (i.e. no need to remove humidity from the air (if no humidity removed not adding humidity)

12 Cooling Architecture TCO (Contrasting Open, CACS & HACS) * Source APC (Schneider Electric) - TCO Comparison between cooling technologies with and without containment 11 11

13 Cooling - Architecture Hot Aisle Containment System (HACS) * HACS requires that the hot air exiting the racks is ducted to the inlets of the CRAC units. This is usually done by using the ceiling plenum as the return plenum

14 Cooling Architecture HACS The higher allowable hot aisle temperature (based on OSHA, ISO 7243) is the key efficiency differentiator between HACS and CACS since it allows the cooling system to operate more efficiently. APC White Paper 153 (Impact of Hot and Cold Aisle Containment on Data Center Temperature and Efficiency) shows that HACS can save up to 43% in the annual cooling system energy cost corresponding to 15% reduction in the annualized PUE compared to CACS while holding the uncontained data center area to 24 C. OSHA (Occupational Safety and Health Administration) regulations met for HACS work for two reasons: 1) workers are not permanently stationed in the hot aisle (they are in the case of CACS) 2) most routine work takes place at the front of IT racks. OSHA allows for a work / rest regimen of 25% work / 75% rest in the HACS hot aisle which allows for a maximum WBGT6 of 90 F/32.2 C. i.e. the HACS hot-aisle temperature can get as high 117 F/47 C

15 Connectivity Costs (Initial CAPEX, Annual recurring) Services Bundle Ethernet (point to point where do I need to get back to? cost/distance relationship) MPLS IP Transit (Tier 1 Carriers) Fibre Channel Dark Fibre Public peering opportunity (Inex, LINX etc.) Open Access Carriers Latency Ultra low latency connections (up to 10 times the MRC of a standard DWDM circuit) Geography Distance to core/metro fibre network European serving base (inter-metro rates) Diversity of routing 14 14

16 Connectivity - Geography 15 15

17 Connectivity Hybernia Atlantic carries circa 25% of all Global IP Traffic (65% of which qualifies as wholesale/online companies and the remaining 35% Enterprise/Finance) 16 16

18 All QUESTION & ANSWER 17 17

19 18