Data Centre Energy Efficiency The Toronto Hydro Story

Transcription

1 Data Centre Energy Efficiency The Toronto Hydro Story

2 Data Center Efficiency Opportunity via Build and Relocation Initiative Objective: Build a new Data Center at one of our existing facilities with a focus on minimal downtime for maintenance of any one component within the new Data Center design. Then migrate systems from one of our Data Centers to the newly built Data Center. Opportunity: Introduce newer more efficient technologies to the design of the new Data Center to save on operating costs. Efficiency Technologies Implemented: Ultra Efficient Computer Room Air Conditioning (CRAC) units Multi-zoned adjustable airflow floor tiles Cold Air Containment Curtains Minimized loss 400/230V Power Distribution Design Ultra High Efficiency Uninterruptible Power Supply (UPS) units

3 Data Center High Level Design Data Center Design: Generators = N+1 (w/ additional hitching post for temporary units) Power Distribution = 2N (w/ tie breakers at each level of switching gear) UPS = 2N+1 Cooling = N+1 Cold air plenum (Raised Floor) = 2 Hot air plenum = None (open to concrete slab above) Data Center Components: Generators = 2 x 1.5MW (w/ additional hitching post for 1 or 2 temporary units) Power Distribution = 1 (ATS & Switch Gear A) + 1 (ATS & Switch Gear B) UPS Units = 1 x 550kVA (UPS Room A) + 1 x 550kVA (UPS Room B) CRAC Units (Raised Floor Area)= 5+1 x 35ton CRAC Units (UPS Rooms A)* =1+1 x 24ton CRAC Units (UPS Rooms B)* =1+1 x 24ton * UPS Rooms A & B are shared by additional UPS units that service loads outside of the Data Center

4 Ultra Efficient Computer Room Air Conditioning (CRAC) units Emerson Liebert DSE System Components

5 Ultra Efficient Computer Room Air Conditioning (CRAC) units Emerson Liebert DSE Summer and High Ambient Temperature Example

6 Ultra Efficient Computer Room Air Conditioning (CRAC) units Emerson Liebert DSE Nighttime and Cooler Ambient Temperature Example

7 Ultra Efficient Computer Room Air Conditioning (CRAC) units Emerson Liebert DSE Cold Weather Operation Example

8 Multi-zoned adjustable airflow floor tiles Perforated tile sites on top of damper unit Angled toward the rack high volume 68% open area perforated floor tile providing 2,594 H2O Multi-zone Opposed Blade Damper with 3 zone manually adjustable dampening to provide cooling to the bottom, center, and/or top of the rack. NOTE: Manual dampening unit can be replaced with powered automatic dampening units at a future date

9 Cold Air Containment Curtains Above is an illustration of a cold air containment system using cold air containment curtains. In this illustration there is both a cold and hot air plenum and the cold air containment curtains go all the way to the meet the bottom of the hot air plenum.

10 Cold Air Containment Curtains In our aisles that have rows facing each other, we only needed to use curtains on the ends, since our racks had cable manager extensions In our aisles that have rows facing the open room, we used curtains to enclose the perforated tiles. We did not require curtains above our racks due to cable manager extensions on the racks.

11 Minimized loss 400/230V Power Distribution Design Traditional 208/120V Setups: Alternative 400/230V Setup: Additional benefit of the 400/230V configuration included the standardization of a single model rack PDU with the following specs that meet our server, storage, converged, and hyper-converged infrastructure: Metered, ZeroU, 23.0kW, 240V, (30) C13 & (12) C19 NOTE: kept a redundant 208/120V panel for a handful of legacy devices, and just in case.

12 Ultra High Efficiency Uninterruptible Power Supply (UPS) units Eaton - Energy Saver System (ESS)» ESS Efficiency - 99% across the complete operating range» 85% reduction in losses compared to legacy transformer-based UPS» Continuous power tracking and proprietary DSP algorithms combined with transformer-free topology ensures critical loads are always protected power system fault detection technology allows for a warp speed detection and correction of disturbances well below 2 ms adaptive algorithm turns off the static switch before the inverter and avoids backfeeding the input in 600 micro seconds

13 Ultra High Efficiency Uninterruptible Power Supply (UPS) units Eaton Variable Module Management System (VMMS) Example With Same Load Applied To Different Multi-UPS Configurations * * * * * * * In ready state, the UPM rectifies DC-link, generates logic level PWM signals, and filters EMI and lightning spikes.

14 System Efficiency % Ultra High Efficiency Uninterruptible Power Supply (UPS) units Eaton Variable Module Management System (VMMS) 9395 VMMS System Efficiency Curves (Typical) 100% 95% 90% 85% 80% Efficiency - VMMS Disabled Efficiency - VMMS Enabled 75% 70% System Load %

15 Ultra High Efficiency Uninterruptible Power Supply (UPS) units Dual feed use case with Eaton ESS and VMMS ESS on A 50% of Load ESS 99% Efficiency A Data Centre with Dual Corded Servers Single or Dual Source X VMMS > 93% Efficiency 50% of Load B VMMS on B > 3% efficiency improvement over existing double conversion only approach ESS 99% efficiency for 50 % of the system load VMMS >93% efficiency for 50% of the system load Double Conversion backup for 100% of system load For dual source no need for down stream static switch

16 Toronto Hydro Power Savings realized with the contribution of Data Center efficiency Technologies 5800 Yonge (28th Apr Reading) 500 Comm (3rd Feb Reading) Change Data Center kw (IT + UPS Elec Loads) * Data Center kw (Lighting + Mech Loads) * Data Center kw (Total) * *Disclaimer: These numbers also include a number of additional items that may have contributed to the reduction in power including, virtualization of systems, newer more efficient servers and storage, better rack and row layout differences. Conversely, the comparison of other aspects of the two Data Centers may counter if not significantly affect the numbers in a more beneficial way, with greater savings if they were equal. This includes the fact that the number of CRAC units have doubled along with their sizes from the old Data Center to the new. Also the size of the Data Center raised floor has increased by over 1,000 Sq. Ft from the old to the new. That said, these numbers should only be used as a guide as to the potential savings that can be achieved by Power Distribution and Mechanical Systems efficiency technologies.

17 Monitoring to understanding where savings can be achieved In addition to the Generators, UPS, and CRAC units, Toronto Hydro also monitors and captures metrics for the following items for resiliency and efficiency analysis: Raised Floor Area RPP-PDU Breakers Remote Power Panels (RPP) Power Distribution Utility Side Meter Temperature & Humidity Sensors Rack Power Distribution Units (PDU) Main Distribution Panels ATS Switch Board Breakers

18 Summary Efficiency Technologies Implemented: Ultra Efficient Computer Room Air Conditioning (CRAC) units Significant Savings, may be cost prohibitive unless replacing units due to age Total Cost of Ownership (TCO) calculation would be required Multi-zoned adjustable airflow floor tiles Possible to retrofit existing raised floor Total Cost of Ownership (TCO) calculation would be required Cold Air Containment Curtains Possible to retrofit existing environments Cost is relatively low compared to other technologies Minimized loss 400/230V Power Distribution Design Cost prohibitive unless building a new Data Center Ultra High Efficiency Uninterruptible Power Supply (UPS) units Good savings, cost may be prohibitive unless replacing units due to age Total Cost of Ownership (TCO) calculation would be required Monitoring to understand where savings can be achieved: Implementation of base DCIM monitoring aggregation worth the cost to identify areas to save energy

19 Future Efficiency Technologies: Servers Submerged in Mineral Oil

20 Questions?