Data Centre Testing and Commissioning

Transcription

1 Data Centre Testing and Commissioning

2 What is Testing and Commissioning? Commissioning provides a systematic and rigorous set of tests tailored to suit the specific design. It is a process designed to validate performance, and to discover and correct problems Commissioning is not a duplication of what a contractor does

3 Why undertake Testing and Commissioning? Core business -> IT Systems -> Data Centre Significant investment in Data Centres Thorough commissioning reduces risk Establishes a baseline for performance Benchmarks a number of operational and maintenance conditions PUE (Power Usage Effectiveness) Test procedures

4 Isn t Test and Commissioning performed by installers / suppliers? Complete testing of the original design and engineering specification is rarely undertaken Validate infrastructure and operating systems Disjointed work by trades Brown field sites provide challenges

5 Successful Testing and Commissioning Steps 1/2 Contractual requirements Appoint a Test and commissioning expert Review specifications Review test reports

6 Successful Testing and Commissioning Steps 2/2 Review contractor tests/commissioning Review external reports Conduct independent commissioning Regression test where required

7 Who to use? Qualified test and commissioning agent Experienced in the DC field Use a third party Independent and Unbiased Early Involvement

8 Major Infrastructure Systems and Components 1/2 Electrical distribution system Generators UPS & batteries Cabinet PDU s Lightning protection Earthing and grounding Cooling infrastructure

9 Major Infrastructure Systems and Components 2/2 HVAC systems Floor drains Fire detection/suppression Control systems Security systems Building infrastructure BMS

10 Tips for Effective Commissioning Conduct the right level of testing Multi-system testing scenarios Integrated critical support system tests Documented test script Document results / outcomes Pass or fail Deficiencies, corrective actions, regression test

11 Some basic but important advice Ensure equipment / controls are correctly set prior to undertaking commissioning Recalibrate sensors and equipment prior to conducting commissioning Ensure that ongoing monitoring / routine testing is conducted Don t rely on the warranty period for issues to be rectified Don t save issues to the last few months of the warranty period

12 Some basic but important advice Don t test something you cannot measure

13 meet the DATA CENTRE expermelbourne 2012 Case Study University of Canberra - DC2 Interesting outcomes as a result of performing integrated testing procedures.

14 Day 1: 24 each (N+1)+1 modular UPS Diesel Generator N+1 CRAC s + Duty/Stand Chillers

15 Gaseous Fire Suppression (Inergen) Infrastructure Monitoring System (IMS) Cold Aisle Containment (CAC) Primary / Secondary CW Loops 2500 Lt Chilled Water buffer tank

16 Older testing methods includes Many small heaters Large load banks Provides heat load only Electrical systems aren t adequately tested Cooling systems aren t tested realistic perameters Traditional testing

17 New Testing Methods What is a Server Simulator? A simple device containing Fans and a Heating element Rack mounted and closely simulate the power and air usage of IT equipment Why use a Server Simulator Realistic dispersion of heat through out the DC Flexibility to allow different testing parameters / scenarios Utilises and tests rack power distribution system Ability to performance test cooling / mechanical plant Realistic electrical system tests Distribution / Switch Boards / Breakers / PDUs

18 Simulating Load At The Rack Level In Cabinet heat simulators allow Realistic distribution of power and heat Load or soak testing for the entire electrical system EXAMPLE: Over heating switch board tripped circuit breaker Cooling systems are able to be tested to design limits Cooling systems can be accurately adjusted to suit the installation

19 Ability to develop effective airflow Air flow needs to be effective before it is considered efficient Server Simulators were used to find an airflow pattern for the load Trend the temperatures during different CRAC unit configurations This allows for systematic adjustment of settings resulting in more effective air flow patterns Proven capability to support 8.5kW per rack used trending to support this Impact on PUE - 20% reduction

20 Temperature ( o C) Finding the limits of your system Chiller Failure Test :21:36 PM 3:50:24 PM 4:19:12 PM 4:48:00 PM 5:16:48 PM 5:45:36 PM 6:14:24 PM 6:43:12 PM Time (HH:MM:SS) Chilled Water Temperature Cold Aisle Temperature Chilled water supply is shut off Secondary pumps and CRAC units continue to run Again trending allows us to validate the buffer tank capability by monitoring temps The result - 30 mins additional run time before parameters were out of range (27degrees) Is this long enough? What is the SOP?

21 UPS Failures During Commissioning 25 UPS Minutes Remaining on Battery Minutes Remaining 5 0 2:26:53 PM 2:29:46 PM 2:32:38 PM 2:35:31 PM 2:38:24 PM 2:41:17 PM 2:44:10 PM 2:47:02 PM 2:49:55 PM Performing autonomy time testing can reveal both design and installation issues Bad batteries Faulty UPS modules Loose connections

22 Fine tuning the control system Chiller A fails After 5 minutes Chiller B came online and took a further 6 minutes to reach full load Change control settings start standby chiller immediately upon duty failure Result zero impact to cold aisle supply temperatures and Chiller B fullly operational in half the time

23 Understanding the impact of design restrictions such as Generator Canopies Data for acoustic canopies / enclosures can be limited Restrictions to airflow can effect output capacity Additional attention should be paid to ensure your generator will stay cool on hot days this is when they are likely to be required Contingency factors may need to increase resulting in a larger generator

24 Does the design achieve expected PUE? Trending PUE during commissioning will give the only indication as to the efficiency of the design until design load is reached which can be many years away This offers great visibility for future deployments

25 Gaseous Fire suppression It can be difficult to achieve adequate sealing in brown-field sites Passing Room Integrity Testing is mandatory Leaks occur through every penetration they add up quickly Ceiling Tiles / Lights Cable Penetrations Doors Fire systems are a significant investment and they need to work when required

26 Acoustic Properties Don t under estimate additional work required to combat noise levels of external plant

27 Monitoring / Trending

28 Questions?