Building a data center C R Srinivasan Tata Communications
Introduction Data Center as defined by TIA 942 A building or a portion of a building whose primary function is to house a computer room and its support areas Two Types Private managed by internal IT, at the customer premises or co-located in a 3 rd party data center Public - located in a 3 rd party data center (MTDC)
HOW TO WORK OUT WHAT YOU NEED?
What do you need? High level considerations build versus buy Core to your business? Private size, scale & control Build viability upwards of 20 MW at least Public (MTDC) time to market, capex & scalability Colo market offers options, retail & wholesale Security, controls Consider ROI, liquidity & other financial metrics
What do you need?.. Purpose of the data center Primary/Secondary Proximity Network & Application performance Building a cloud data center? Consolidation? Choices are the same Private, Public & Hybrid Increased energy demands Scalable, repeatable (modular) It is still a normal data center
How to approach a build/buy? Gather Information IT Facilities Get Help Form a core team Professional help Know what you are buying Understand the offerings Choose the right one
Load Load Load Every requirement is different Web Hosting Web Hosting 25 20 15 10 5 0 Time 20 18 16 14 12 10 8 6 4 2 0 Manufacturing Manufacturing 20 18 16 14 12 10 8 6 4 2 0 IT Services IT Services Time Time
Gather information Gather information on : IT needs Application accessibility, latency, availability Impact on people, processes & procedures Data sensitivity & controls Connectivity Facility needs Space, power, cooling Proximity Controls Access, fire, security, etc.,
Get help Private build Core team with IT & facility staff Translate requirements correctly both ways Get a set of professionals to assist M&E, architecture, civil/structure, environmental design, quality, etc., Documentation Stick to standards Understand trade-off s Tier levels, redundancies & capacities
Know what you are buying 3 rd party facilities Location Proximity Access & Connectivity Physical security Operations & service assurance Efficiencies (PUE) Lifecycle strategies (preventive & predictive) SLA s Financial stability
There is more to it.. IT Technologies Applications Cloud Virtualization Databases Windows, Unix, Linux, x86, RISC, Mainframes BMS Modular Containment Field-upgradable Clean power Routers Customers Monitoring, Correlation & Security Systems Operating systems Switches End User Business & Infrastructure Applications People & Processes Databases IT Operations Middle tier apps Servers Storage Backup devices Data Networks Carrier Access Structured Cabling Fire Protection Monitoring & Controls Cabinets Power Cooling Physical Security Logical Standards ITIL ISO/IEC 27000 SSAE 16 COBIT TIA 932 BICSI 002 Data center Tiers Facilities Geographical location & other considerations Physical
Some trends World economy will continue to be unpredictable Utility computing, pay for use, just in time More applications & hence services will move to cloud move to public infrastructure Capacity addition will be more gradual Supply side may not see spikes Cost pressure will continue Drives efficiency PUE, WUE, CUE Improved form factor, better & cheaper hardware Pressure on per sq.ft. power density
DATA CENTER STANDARDS
Data center standards - TIA TIA 942 Telecommunications Industry Association Standards for Data Centers Commonly referred to Acts as a standard reference for planning of data centers Provides both telecommunications & facilities design guidelines. Provides an objective way to compare data center facilities by way of tiers Tier 1 to Tier 4 (no redundancy to fault tolerance)
Data center standards -BICSI BICSI 002 (ANSI/BICSI 002-2011) BICSI Building Industry Consulting Service International Provides a standard reference of common terminology & design practice More like a how to best practices manual Provides both mandatory & desirable criteria Complimentary to other standards
Data Center Standards Uptime Institute Uptime Institute s recent standard Goes beyond design Emphasis on operational sustainability Long term data center performance
Some metrics that you will hear PUE Power Usage Effectiveness (total facility power/it equipment power) DCIE Data Center Infrastructure Efficiency (inverse of PUE) CADE Corporate Average Data Center Efficiency Has four components Facility Asset Utilization Facility Energy Efficiency IT Asset Utilization IT Energy Efficiency
DESIGN BEST PRACTICES & CASE STUDY
Best practices Suggestions Hot & Cold Isles Use blanking plates Eliminate gaps in rows Deploy power efficient platforms Do not oversize power /cooling infrastructure Seal cable cutouts Air flow management, free air cooling Match airflows to high/low density areas Benefits Lower DC temperatures Better System Reliability Better uptime Extends life of the data center Increased reliability for IT services Lower TCO Better PUE Increased capacity
One of our large builds Located in Tai Sing, Singapore Up to 66,000 sq. ft. IDC space Tier 3+ specifications Average of 160 w/sq. ft. power density Carrier-diverse facility Colocation & managed IT infra services TCL network services, managed services Colocation services 99.99% minimum Phase 1 launched in June 2010
Data center design highlights Tier III+ data center, Phase 1 = ~ 22,000 sq ft data center space Ultimate = 3 floors (~ 66,000 sq ft) data center space Power 2N power redundancy HT supply from 2 substations (planned) 2 x 15 MVA Day 1, scalable to 2 x 30 MVA Dynamic UPS Able to serve up to 6 KVA per rack on average (160 w/sqft, 3.12 MW per floor at 100% UPS load) Design PUE of 1.619 at full load Cooling N+20% redundancy (at 160 w/sqft) w/ dual power supply Air-cooled system, backed by genset Able to cool up to 6 KVA per rack Raised floor Max point load 5.8 KN, distribution loading of 15 KN/sqm Clear height of approximately 12 ft. (excluding raised floor) Fire protection Pre-action sprinkler & smoke detector N2 w/ VESDA Security systems CCTV, card access Monitoring systems 24x7 on-site support & management
Green features 1. DRUPS reduce losses, no need for toxic battery disposal & replacement 2. Maximum cooling design efficiency for IDC, use of efficient variable chillers 3. Contiguous data center floors efficiencies for cabling and power supply 4. Air-cooled chillers eliminate need for water storage facilities and consumption 5. Use of N2 fire suppression (as opposed to FM200) 6. Maximum plot to building usage ratio 7. PUE of 1.619 at full load 8. Green certification LEED Gold and BCA Green Mark Gold
Q&A
THANK YOU