Data Center Design Considerations Walter P. Herring, RCDD/LAN/OSP Senior Systems Specialist Bala Consulting Engineers, Inc.
Data Center Design: Overall Expectations Need: Prime vs. Redundant vs. Mirrored New vs. Existing Reliability (Tiers) Scalability Power Density Cost
Tier Definitions Tier I Tier II Tier III Tier IV Number of Delivery Paths only 1 only 1 1 Active 2 Active 1 Passive Redundant Components N N+1 N+1 2(N+1) Support space raised floor ratio 20% 30% 80-90% 100% Initial watts/s.f. 23-30 40-50 40-60 50-80 Ultimate watts/s.f. 20-30 40-50 100-150 150+ Raised floor height 12 18 30-36 30-36 Floor loading pounds/s.f. 85 100 150 150+ Utility Voltage 208,480 208,480 12-15kV 12-15kV Months to implement 3 3-6 15-20 15-20 Year first deployed 1965 1970 1985 1995 Construction $/s.f raised floor $450 $600 $900 $1,100+ Annual IT downtime due to site 28.8 hrs 22.0 hrs 1.6 hrs 0.4 hrs Site Availability 99.671% 99.749% 99.982% 99.995% The Uptime Institute 2001
Due Diligence/Risk Assessment Evaluate Systems Services Available Structure Floor to Floor Height Cable Plant Carriers Threats - Weather - HAZMATS - Nuclear Power - Traffic
Data Center Design Considerations IT Architecture CA Data Center Electrical Engineering Safety Systems Mechanical Engineering
Information Technology (IT) Redundancy Service Configuration Conveyance Cable Plant?
Information Technology (IT) Redundancy How many levels? What kind of redundancy? -Cable -Sheath - Route - Hardware/Software - Dual Processors - Dual Equipment
Information Technology (IT) Service Protection Dual/Multiple Incoming Multiple LEC, CLEC
Information Technology (IT) Configuration Due Diligence - Identify Skill/User Sets (PBX, NT, UNIX, SAN, WAN, Vendor) - Space planning, Schematic Design - Provide for Expansion - Space Allocation
Information Technology
Information Technology (IT) Configuration Due Diligence Floor Plan -Central Patch -Segregate Copper UTP/ Optical Fiber Networks
Information Technology (IT) Cable Plant Copper UTP - Performance level of UTP - Color Scheme/ANSI/TIA/EIA - Fill Ratio
Information Technology (IT) Cable Plant Copper UTP Optical Fiber - 50/125, 62.5/125-10 Gig - sm/mm - Connector Type
Information Technology (IT) Cable Plant Copper UTP Optical Fiber Plug & Play Pros - Multiple Mfg. - Scalability - Multiple Connector - High Density - Limit Field Connectorization Cons - Quality Control - Lead Times - Installation
Information Technology (IT) Cable Plant Copper UTP Optical Fiber Plug & Play Multi-Pair -RJ 21x - Multi-pair for Voice tie 110/66 to Patch Panel - Consolidation Beneath Raised Floor - Limit on Performance
Information Technology (IT) Conveyance Ladder Rack/Cable Tray Above Rack - Pros/Cons Pros - Flexibility - Robust Design = Multiple Levels Cons - Routing of Different Medium - Aesthetics
Information Technology (IT) Conveyance Ladder Rack/Cable Tray Above Rack Below Floor Pros/Cons Pros: - Flexibility - Aesthetically Pleasing Cons: -Air Flow - Robust Design = Multiple Paths/Bays - Coordination Intensive - Capacity
Architecture Layout Room Integrity/ Rating Verticality Accessibility Floor Load Location
Architecture Floor Loading
Electrical Engineering Watts/S.F. Utility Generation Distribution UPS Multi- Cord
Electrical Engineering Watts/S.F. Servers & DASD 100W/ft 2 150W/ft 2 200W/ft 2 2000 2002 2005 The Uptime Institute
Electrical Engineering Distribution
Mechanical Engineering Heat Extraction Hot/Cold Aisle System Type Static Pressure Load/Watt Density Floor Height
Mechanical Engineering Heat Extraction
Mechanical Engineering Hot Aisle/Cold Aisle Return Air Ducts 95 F± Return Air Ducts 95 F± Suspended Ceiling Plenum Cooling Coil Fan Air Extraction Fans Hot Aisle Cold Aisle Perf Floor Tile Air Extraction Fans 55 F± 55 F± Raised Floor Plenum
Safety Systems Personnel Site Monitoring Suppression Protection Detection Security
Safety Systems
Contract Administration Coordination Migration Licenses Record Drawings Commissioning IST
Contract Administration Migration/Coordination Coordination of Passive/Active Components - Delivery of Equipment - Assembly Phased Migration Plan - Skill/User Set Priority - Milestones
Contract Administration IST/ Commissioning Close-Out Documents Commissioning Reports Post-Occupancy Report Corrective Actions Site Reports Test Execution Coordinate Commissioning Activities Review & Approval of Documents Develop Pre- Functional Checklists Develop Test Procedures Commissioning Plan Commissioning Specification Design Intent Report