BICSI 002 / TIA 942 / Uptime Which Data Center Standard Should I Follow Phil Isaak, PE, P.Eng., RCDD, DCDC President, Master Instructor Isaak Technologies Inc.
Standards Who are these People Standards Distribution & Grounding Network Standards Protocols IT Hardware Manufacturers Media Standards Cabling Manufacturers Design & Installation Standards End Users, Contractors, Consultants, Manufacturers
Uptime TIA BICSI Uptime Institute (2010) Data Center Site Infrastructure Tier Standard: Topology 12 pages For Profit Privately Held NOT a Standard ANSI/TIA 942 A (2012) Telecommunications Infrastructure Standard for Data Centers 118 pages Open Industry Standard NOT Vendor Neutral ANSI/BICSI 002 2011 Data Center Design and Implementation Best Practices 392 pages Open Industry Standard Vendor Neutral
ANSI Certified Standard Requirements Openness: Participation shall be open to all persons who are directly and materially affected by the activity in question. Lack of Dominance: The standards development process shall not be dominated by any single interest category, individual or organization. Balance: Participants from diverse interest categories shall be sought with the objective of achieving balance.
BICSI Subject Matter Experts More than 150 subject matter experts from around the world participated in developing the standard. Perspectives: Data Center Managers Data Center Operators Consultants Contractors Risk Assessors Manufacturers Commissioning Agents Expertise: Facility Engineers/Architects IT Engineers/Architects System Administrators Telecommunications Security Fire Protection Project Managers
Design Guide vs Benchmarking ANSI/BICSI 002 2011 Provides a reference of common terminology and design practices a framework for determining the recommended facility and technology redundancy to meet the operational requirements, achieve IT objectives and to develop optimum design & implementation solutions Uptime Tiers Only data center benchmarking system developed by and for data center owners, not a checklist, design menu, or cookbook Source: Uptime Institute: Tier Classification System & Operational Sustainability presented by Dana Smith, Director of Development, Uptime Institute at BICSI Andino 2012
Uptime Benchmarks Uptime Institute Tier I Tier II Tier III Tier IV Scheduled Outages / Year 2 x 12hrs 1 x 12hrs None None Ave Failures / Year (4hrs / failure) 1.2 1.0 1.0 1.0 Ave Annual Downtime Hours 28.8 22 1.6 0.8 Availability 99.67% 99.75% 99.98% 99.99% ** Basis is on top 10% of sites as determined by Uptime Institute Benchmarking **
Comparing the Standards TIA 942 A chapters (normative) Data center design overview Data center cabling system infrastructure Data center telecommunications spaces & related topologies Data center cabling systems Data center cabling pathways Data center redundancy TIA 942 A annexes (informative) Cabling design considerations Access provider information Coordination of equipment plans with other engineers Data center space considerations Data center site selection and building design considerations Data center infrastructure tiers Data center design examples
Comparing the Standards BICSI 002 sections Space planning Site selection Architectural Structural Electrical systems Fire protection BICSI 002 annexes Design process Reliability and availability Security Building automation systems Telecommunications Information technology Commissioning Data center maintenance
Comprehensive Data Center Standard ANSI/BICSI 002 2011
Methodology to Define Reliability Define Operational Requirements Annual Planned Downtime Operational Level > 400 hrs 0 100 400 hrs 1 50 99 hrs 2 0 49 hrs 3 0 hrs 4
Methodology to Define Reliability Define Operational Requirements Define Availability Requirements Minutes Number of 9 s > 5,000 > 99% 500 5,000 99% 99.9% 50 500 99.9% 99.99% 5 50 99.99% 99.999% 0.5 5 99.999% 99.9999%
Methodology to Define Reliability Define Operational Requirements Define Availability Requirements Define Impact of Downtime Description Local in scope, affecting only a single function or operation, resulting in a minor disruption or delay in achieving non critical organizational objectives. Local in scope, affecting only a single site, or resulting in a minor disruption or delay in achieving key organizational objectives. Regional in scope, affecting a portion of the enterprise or resulting in a moderate disruption or delay in achieving key organizational objectives. Multiregional in scope, affecting a major portion of the enterprise or resulting in a major disruption or delay in achieving key organizational objectives. Affecting the quality of service delivery across the entire enterprise, or resulting in a significant disruption or delay in achieving key organizational objectives. Classification Isolated Minor Major Severe Catastrophic
Methodology to Define Reliability Define Operational Requirements Define Availability Requirements Define Impact of Downtime Recommended Performance Identified Class 0 Class 1 Class 2 Class 3 Class 4
Class 0/1 Single Path Alternate Source Transfer Utility N Chiller, Pumps & Condenser Electrical Distribution Static Bypass UPS Maint. Bypass Carrier Piping and valve redundancy not required. N CRAH Modules PDU Critical Non-Critical Edge Edge Internet Core Aggregation RPP A A 1 Access Switch Server 1 Large Frame Processing Server n A POU NAS Disk Array Disk Array A PSU B PSU 2013 Isaak Technologies Inc.
Class 2 Redundant Components Alternate Source Alternate Source Transfer Utility Electrical Distribution N+1 Chillers, Pumps & Condensers Static Bypass UPS UPS Carrier Piping and valve redundancy not required outside computer room. PDU Critical Maint. Bypass Non-Critical Edge Edge Internet Refer to Chiller Piping and Valve Redundancy section for computer room recommendations N CRAH Modules Core RPP A Aggregation +1 CRAH Module More than N+1 redundancy is recommended as the number of modules to meet N increases A 1 A 2 Access Switch Server 1 Server n NAS Disk Array Large Frame Processing A POU B POU Disk Array A PSU B PSU 2013 Isaak Technologies Inc.
Class 3 Concurrent Maintainability Utility Alternate Source Alternate Source Electrical Distribution Electrical Distribution Static Bypass UPS UPS N+1 Chillers, Pumps & Condensers Output Distribution Switchboard Maint. Bypass Alternate Switchboard Carrier 1 Carrier 1 Carrier 2 Carrier 2 Piping and valve redundancy not required, but recommended, outside computer room. PDU Switchboard Switchboard PDU Edge1 Edge1 Internet Edge2 Internet Edge2 Critical Fans/Pumps Core1 Core2 Non-Critical Critical Non-Critical Aggregation1 Aggregation2 N CRAH Modules PDU A1 RPP A1 PDU B1 RPP B1 Access Switch 1 Server 1 Server n Access Switch 2 Large Frame Processing NAS Disk Array Refer to Chiller Piping and Valve Redundancy section for computer room recommendations RPP A1 1 RPP A1 2 RPP B1 1 RPP B1 2 SAN Switch1 SAN Switch2 +1 CRAH Module More than N+1 redundancy is recommended as the number of modules to meet N increases STS A STS B A B Disk Array1 Disk Array n POU POU A PSU B PSU 2013 Isaak Technologies Inc.
Class 4 Fault Tolerant Utility Alternate Source Alternate Source Utility Alternate Source Alternate Source Electrical Distribution Electrical Distribution N+2 Chillers, Pumps & Condensers Static Bypass UPS UPS Maint. Bypass Static Bypass UPS UPS Maint. Bypass Piping and valve redundancy required outside computer room. Output Distribution Switchboard Output Distribution Switchboard Carrier 1 PDU Critical Fans/Pumps PDU Edge1 Carrier 1 Carrier 2 Edge1 Edge2 Internet Internet Carrier 2 Edge2 N CRAH Modules Non-Critical Critical Non-Critical Core1 Core2 Refer to Chiller Piping and Valve Redundancy section for computer room recommendations Aggregation1 Aggregation2 PDU A1 PDU A2 PDU B1 PDU B2 RPP 1 Panel A Panel B RPP 2 Panel A Panel B Access Switch 1 Server 1 Server n Access Switch 2 Large Frame Processing NAS Disk Array +2 CRAH Module More than N+2 redundancy is recommended as the number of modules to meet N increases RPP 1A 1 RPP 1B 1 STS A RPP 2A 1 RPP 2B 1 SAN Switch1 SAN Switch2 STS B A B POU POU Disk Array1 Disk Array n A PSU B PSU 2013 Isaak Technologies Inc.
End to End Reliability Applications Systems Network Cabling Infrastructure Facility Applications Data Processing & Storage Systems Network Cabling Infrastructure Facility
DC125 Data Center Design Course 4 Day Course In Depth Review of Standard Prepare for DCDC Exam Data Center Design Consultant Contact FiberOpto Asia Pte Ltd for course dates and locations available in South East Asia
BICSI Data Center Documents ANSI/BICSI 002 2011 Data Center Design and Implementation Best Practices BICSI International Standards Supplemental Information 001 Methodology for Selecting Data Center Design Class Utilizing Performance Criteria Available from BICSI www.bicsi.org/standards