How To Plan A Data Center Network



Similar documents
10 Gigabit Ethernet over copper: Unshielded, unprotected?

Network Design. Yiannos Mylonas

AMP NETCONNECT Data Center Cabling Solutions

White Paper. Cat. 6A vs. Cat. 6 A. What s the Difference and Why Should I Care?

White Paper. Power over Ethernet Plus Update and Cabling Considerations

Cat. 6 A EL Incredibly fast Get more

Data Center. Pre-terminated. Patch Panel System. Cabling Systems Simplified. Patch Panels. 10G + Gigabit. Patch Cords. Plug & Play Installation

Innovation. Volition Network Solutions. Leading the way in Network Migration through Innovative Connectivity Solutions. 3M Telecommunications

Technical Information

HIGHSPEED ETHERNET THE NEED FOR SPEED. Jim Duran, Product Manager - Americas WHITE PAPER. Molex Premise Networks

Obsolete Fiber Technology? Not in my Data Center!

Specifying an IT Cabling System

Table of Contents. Fiber Trunking 2. Copper Trunking 5. H-Series Enclosures 6. H-Series Mods/Adapter Panels 7. RSD Enclosures 8

Mixed High-Speed Ethernet Operations over Different Categories of Bundled UTP Cable

White Paper: 10 Gigabit Ethernet over Twisted Pair Copper Systems

Top of Rack: An Analysis of a Cabling Architecture in the Data Center

Security & Surveillance Cabling Systems

Accelerating Light. Copper Cabling Solutions. Category 6A

The Optical Fiber Ribbon Solution for the 10G to 40/100G Migration

SHEET 1 COMMUNICATION NETWORKS COMPUTER AND TELEPHONE SYSTEMS

Implementing Fast Ethernet

Session 2; Cabling Technology in the Data Centre Media Choices; Copper Twisted Pair

Structured and Point to Point Network Cabling for Industrial Automation

R&Mfreenet Advanced Cat 6 A Unshielded Connection Module

Migration Strategy for 40G and 100G Ethernet over Multimode Fiber

Network Topologies. Network Topologies

Networks. The two main network types are: Peer networks

Presenters Brett Weiss, Gabe Martinez, Brian Kroeger.

Data Centre Cabling. 20 August 2015 Stefan Naude RCDD The SIEMON Company

KVM Cable Length Best Practices Guide

Issues Affecting the Design and Choice of Cabling Infrastructures within Data Centres

DATA CENTER NETWORK INFRASTRUCTURE. Cable and Connectivity for the Most Demanding Networks. BerkTekLevitonTechnologies.com

Optimizing Infrastructure Support For Storage Area Networks

ADC s Data Center Optical Distribution Frame: The Data Center s Main Cross-Connect WHITE PAPER

Ethernet Patch Cord Wiring

Data Center.

Data Center Design for 40/100G

Zone Distribution in the Data Center

New Technology Developments and How They Impact Your Structured Wiring Choices

Chapter 4 Connecting to the Internet through an ISP

Navigating the Pros and Cons of Structured Cabling vs. Top of Rack in the Data Center

Migration to 40/100G in the Data Center with OM3 and OM4 Optical Connectivity

AMP NETCONNECT CABLING SYSTEMS FOR DATA CENTERS & STORAGE AREA NETWORKS (SANS) High-density, High Speed Optical Fiber and Copper Solutions

Data Center Architecture with Panduit, Intel, and Cisco

Data Communications Competence Center

SummitStack in the Data Center

Using High Availability Technologies Lesson 12

Data Centre Design ready for your future

Increase your network s security by making the right premise cabling decisions

Managing High-Density Fiber in the Data Center: Three Real-World Case Studies

Technology Solution Guide. Deploying Omnitron PoE Media Converters with Aruba Access Points and AirMesh Routers

Data Centre & Enterprise Solutions. RapidNet

with Component Rating A Simple Perspective

InstaPATCH Cu Cabling Solutions for Data Centers

Things You Must Know About Gigabit Ethernet 1. Understanding Gigabit Ethernet

The Evolution of Copper Cabling Systems from Cat5 to Cat5e to Cat6 Copper Cabling Standards and Technical Aspects

Chapter 9A. Network Definition. The Uses of a Network. Network Basics

Data Center Cabling Design Trends

How to Choose the Right Cable Category

Data Center Topology Guide

Testing 10 Gb/s Performance of Category 6 and 6A Structured Copper Cabling Systems within the Unified Physical Infrastructure SM (UPI)

Structured Cabling, Earthing & Equipotential Bonding

How To Get 40G Over Copper (Wired) And 40G On Coaxian (Wireless) Cable (Wired Coaxian) (Wired Cable) (Wireline) (Powerline) And 50G Over Coaxian Cable (Wire Coaxian

Redundant Gigabit Backbone Adds Speed and Reliability to Industrial Networks

ANSI/TIA/EIA A, Commercial Building Telecommunications Cabling Standard.

The Need for Low-Loss Multifiber Connectivity

Networking 101 (Networking Basics) Presentation to UCHUG - 1/03/07 G. Skalka

Planning for 10Gbps Ethernet over UTP Questions to Ask When Planning the Cabling Plant WHITE PAPER

Arista and Leviton Technology in the Data Center

Network Engineers Everywhere:

The High Cost of a Low-Cost Cable Certification Tester

Smart Cabling: Constructing a cost effective reliable and upgradeable cable infrastructure for your data centre/enterprise network

Addressing Scaling Challenges in the Data Center

Commercial Cable Installation Philadelphia PA

Running 1000BASE-T Gigabit Ethernet over Copper Cabling 30 March 1999 Colin Mick/The Mick Group with Bruce Tolley/3Com and Willem Wery/Intel

CATEGORY 8: UNDERSTANDING THE NEW CATEGORY OF PERFORMANCE FOR BALANCED TWISTED PAIR CABLE

in other campus buildings and at remote campus locations. This outage would include Internet access at the main campus.

Data Center Network Infrastructure The Smart Choice For Your Data Center

ANSI/TIA-942 Telecommunications Infrastructure Standards for Data Centers

How To Increase Network Performance With Segmentation

Corning Cable Systems Optical Cabling Solutions for Brocade

TIA-942 Data Centre Standards Overview WHITE PAPER

HP Multimode OM3 LC/LC Optical Cables Overview. Models HP 50 m Multimode OM3 LC/LC Optical Cable

Dat Da a t Cen t Cen er t St andar St d andar s d R o R undup o BICSI, TIA, CENELEC CENELE, ISO Steve Kepekci, RCDD

Physical Infrastructure trends and evolving certification requirements for Datacenters Ravi Doddavaram

High density Fiber Optic connections in the Data Center. Phil Ward Datacenter Product Market Manager. HUBER+SUHNER AG

Local Area Networks (LAN)

Auspex Support for Cisco Fast EtherChannel TM

Upgrading Path to High Speed Fiber Optic Networks

ADC KRONE s Data Centre Optical Distribution Frame: The Data Centre s Main Cross-Connect WHITE PAPER

Future Proofing with Category 7 and 7A Cabling for 25 and 40GBASE-T Carries High Levels of Risk

SIEMON Data Center Solutions.

Data Center Optimization: Component Choice. Innovative Design. Enabling Infrastructure

Category 8 Cable Transmission Measurements Comparative Study between 4-port single wire measurements and 2-port balun measurements

HP ProCurve High-Speed Transceivers Installation Guide

Network/Multimedia Cables

High Speed Ethernet. Dr. Sanjay P. Ahuja, Ph.D. Professor School of Computing, UNF

40GBASE-T Advantages and Use Cases

Considerations for choosing top-of-rack in today's fat-tree switch fabric configurations

Transcription:

White Paper Influence of Cabling Systems on the Availability of Data Centers

Influence of Cabling Systems on the Availability of Data Centers TABLE OF CONTENTS 1. Economic Success Factors for Data Centers...3 1.1. Objective: No failures - in spite of many challenges...3 1.2. Infrastructure and human error - the greatest failure risks...4 1.3. Consequences of failures: Cost...5 2. Standards for Data Center Infrastructure...6 2.1. Clear structures help avoid errors...6 2.2. Priorities facilitate economic planning and production...7 3. Main Cabling Requirements...8 3.1. High performance and adaptability for long periods of time...8 3.2. The next generation: 10 Gigabit Ethernet via fiber optics and copper...9 3.3. The Significance of shielding, grounding and potential equalization...12 4. Planning Basics and Criteria for Product Selection...14 4.1. Future reliable planning of data center networks...14 4.2. Planning maximum reliability for backbone and storage area...15 4.3. Allowing for flexibility and scalability for switch and server racks...17 4.4. Choosing consistent security solutions...18 4.5. Aiming for quality assurance across the entire added value chain...19 5. Conclusions...20 6. Sources and Additional Information...20 Copyright 2007 Reichle & De-Massari AG (R&M). All rights reserved. Dissemination and reproduction of this publication or parts hereof, for any purpose and in any form whatsoever, are prohibited without the express written approval of Reichle & De Massari AG. Information contained in this publication may be altered without prior notice. This document was produced with the greatest possible care; it presents the state of the art at the time of preparation. The right to make technical changes is reserved. White Paper Datacenter Cabling v4.0 de Manfred Schmid 2

Highly Available Data Centers Require Innovative, Reliable Cabling Systems Today, the availability and reliability of data centers is vital for the entire market development. Stock exchanges, company processes, commerce, traffic and many other services rely on the smooth operation of data centers. The data volumes to be processed are constantly increasing and require performance maximization in data centers. At the same time, operators must keep operational costs under control, increase profitability and eliminate error sources, which might result in failures. Statistics show, that the largest portion of failures in data centers can be attributed to a passive infrastructure or human mistakes. Thus, this must be addressed at the infrastructure planning and cabling stages in order to increase availability. The current standards with their high quality requirements Application: Data center, Enterprise Cabling Technology Copper and fiber optic cabling, 10 Gigabit Ethernet Format: Subjects Objective Target group: Author: White Paper Network and cabling in data centers, failure risks, security, availability, standards, flexibility, scalability, 10 Gigabit Ethernet, grounding, potential equalization, CC planning Basic cabling system information and decision making criteria for planning and operating highly available and secure data centers. Planners, managers and operators of data centers Manfred Schmid Published: May 2007 form the basis for this. Reichle & De-Massari provides even more extensive possibilities with the R&Mfreenet cabling system. Modular system design assists data centers in the quick, flexible and profitable adjustment to current market and operating requirements. Complete quality, Swiss precision and innovative solutions guarantee transmission security and high availability as well as stability with regard to operational costs. This White Paper provides information from the point of view of profitability regarding current standards, planning criteria and specific passive infrastructure and cabling systems requirements demanded by highly available data centers trimmed for maximum performance. 1. Economic Success Factors for Data Centers 1.1. Objective: No failures - in spite of many challenges Services in data centers (CC) are becoming more important as they are increasingly critical for business. The number of IT services increases to the same extent as the quantity of data to be processed. More and more these services must be available at any time. Result: It is becoming more difficult for data centers to perform even planned maintenance work. The availability at any time is not only demanded by companies and the B2B market, but increasingly by the public at large and the communications applications based on computers. Requirements are escalating further based on the desire by CC operators to lower operational costs without a loss in performance. Expansions, conversions and moves must be handled without impairing availability. Upgrades make great demands on the running operations. The multitude of various generations of active network components often presents even greater problems, since the individual devices have different performance features. Through growing standardization of components and organization, the data centers have adjusted to these requirements. Modular systems, such as Blade Server - supplemented with Remote Management and Server Clustering - help operators to cut down on or outsource personnel. White Paper Datacenter Cabling v4.0 de Manfred Schmid 3

Picture 1: Data centers are rapidly exposed to increasing and versatile requirements. Chart: EMC All these measures might help in lowering operational costs. However, they can interfere with the availability of a data center as the probability of human errors, which are difficult to analyze, are increasing at the same time, i.e. the consequences of errors and manipulations can quickly become much more extensive. The important objective of high availability is confronted by these challenges and risks. 1.2. Infrastructure and human error - the greatest failure risks Various studies unrelated to one another show that only 7% of data loss is caused by computer viruses, whereas 44% are caused by hardware failure and 32% by human error. Other studies demonstrate that 59% of network problems can be directly attributed to the physical infrastructure and connectors. In other words: The majority of failures are caused by simple hardware problems and a large portion can be traced back to human error during installation, maintenance and operation. It will never be possible to completely eliminate errors caused by people. However, errors, omissions and mistakes can be reduced through good process cycles and organizational as well as technical measures. For example, professional coherent cabling management is an integral part of this process. Clear identification of the individual cables is helpful to prevent errors and keep the access to connecting devices clear. Just as important as correct identification is the right end-to-end connection and cable insulation. In addition, meaningful security features can lower risks in patch cord management. The quality of the installation plays an increasingly important role. Even the smallest installation errors affect data transmissions - particularly in network operations with Gigabit Ethernet and 10 Gigabit Ethernet. The error tolerance of modern networks in data centers is dropping drastically. Gigabit Ethernet became the standard for server connections only a few years ago. The desire for still higher data rates is now becoming felt. The standards for 10 Gigabit Ethernet have already been formulated. However, 10 Gigabit Ethernet is a sensitive high frequency application with correspondingly strict requirements for the cabling system and active components. Simultaneously, quick troubleshooting becomes more difficult because defective data White Paper Datacenter Cabling v4.0 de Manfred Schmid 4

packages can get lost in the enormous overall data volume, and thus it is possible that network problems remain undetected. 1.3. Consequences of failures: Cost Behind all the above-mentioned observations and risk considerations is a very serious factor, which is directly linked to the increasing data volumes and the need for high availability: the cost factor. In many cases, if a data center or a single data transmission fails, entrepreneurs, users or customers immediately incur enormous additional costs. Compared to usual LAN applications, the consequential costs are extremely high. This is another reason why a good quality cabling system in data centers, which helps prevent errors and failures, becomes increasingly important. The following chart gives an overview on hourly expenses for network failures in various applications. Ø hourly expenses in U.S. $ Stock exchange $10'000'000 Credit cards E-commerce Airline Reservation $1'000'000 $100'000 $10'000 $1'000 $100 $6'450'000 $2'600'000 $113'750 $89'500 $28'250 Mail services $10 $1 Source : Contingency Planning Research Picture 2: Typical applications based on data center operations and the hourly expenses in network failures. Source: Contingency Planning Research White Paper Datacenter Cabling v4.0 de Manfred Schmid 5

2. Standards for Data Center Infrastructure 2.1. Clear structures help avoid errors Criteria that will later add to transmission security and high availability in the running operations will be taken into consideration in planning and designing right at the beginning of the value added chain. Cabling must meet various standards in order to cover the specific requirements of data centers. TIA 942 and EN 50173-5 provide the basis for qualified topology planning. TIA 942 has already been approved. EN 50173-5 is to be finalized shortly. Both standardization committees paid special attention to the question of high availability when developing these standards. TIA 942 defines the structures and layout of data centers and shows which functions should be made available in which rooms. The subdivision into Core Networking (main distribution and backbone) and Server/Access (horizontal zone distribution) is clear. It helps to avoid errors in advance. Experienced data center managers are familiar with these standards. The advantage is that for the most part, they are based on practical experience. Data centers that observe these standards satisfy today's operational requirements as well as compatibility requirements for future applications and technologies. Reliability and error prevention are thus incorporated from the beginning. Clear, uniform structures help reduce errors and misunderstandings. These structures facilitate the work for the personnel - particularly if they only work temporarily in the data center. Picture 3: Well-defined, clear structures are a feature of a data center planned by qualified experts. These structures are standardized with TIA 942. Chart: R&M White Paper Datacenter Cabling v4.0 de Manfred Schmid 6

2.2. Priorities facilitate economic planning and production Standardization does not mean that everything must be on a single, absolute, and hence expensive level. On the contrary. The standardization committees always consider cost effectiveness and allow for the appropriate flexibility. Thus, the physical infrastructure of a data center can be divided into various priority levels. Priority is based on the importance of the various IT services and the various availability requirements. Vital criteria are topology, redundancy, supply and various additional availability factors. TIA 942 defines four levels (Tier I-IV) and determines which availability level they must provide. Main Requirements TIER I TIER II TIER III TIER IV Power and Cooling path Common Common 1 ac / 1 pa 2 active Redundant Component N N+1 N+1 2 (N+1) Redundant back bone path No No Yes Yes Redundant horizontal cabling No No No opt. Raised Floor 12 18 30-36 30-36 UPS / Generator Option Yes Yes Double Maintenance Shut down Shut down No No Impact of Error Disruption Disruption Disruption No Month to implement 3 3 to 6 15 to 20 15 to 20 Relative Construction cost 1 1.5 2 2.5 Site availability 99.671% 99.749% 99.982 % 99.995 % Picture 4: The four availability levels according to TIA 942. By using this tier model, the data center operator can clearly select and define the requirements of the IT services provided. It facilities establishing a budget for their implementation and selecting appropriate installation products. The model also serves for the risk and cost/benefit analysis customary in the sector. The tier model highlights the cost differences between the various tiers. They are so big that for most data centers it would not be economical to produce exclusively at the highest availability level. Every company and every data center customer allows different tolerance levels for failures and, therefore, requires individual availability levels. Standardizations add in meeting another requirement effectively: Offering IT services through a server pool. Currently, applications increasingly migrate to the "3 Tier Web Service". This service model intends to drastically improve the availability of IT services through the staggered availability of server pools. By distributing server pools in the data center or across several sites, consequences of failures or crashes can be greatly reduced. Many risks can be avoided in advance if planning is based on the clear layout and modular design of all the data center areas. White Paper Datacenter Cabling v4.0 de Manfred Schmid 7

3. Main Cabling Requirements 3.1. High performance and adaptability for long periods of time Servers, switches and storage units can only function if ventilation, cooling, power supply and network cabling are available. A data center designer must pay attention to all aspects and make sure that the capacities are sufficient for future expansions and that major reorganizations are possible. A data center is never static. The cabling infrastructure must meet the most diverse requirements in order to be appropriate for a modern data center. Initially, high performance is required. The cabling system must be able to support the increasing transmission rate. However, the capability to support high data rates is irrelevant if the system is unreliable. With Gigabit Ethernet, and in particular in a network operation with 10 Gigabit Ethernet, interference sensitivity increases enormously in comparison to external influences. Therefore, installation work must be carried out extremely carefully in order to make a durable and reliable system available. It depends greatly on the installer s expertise whether the appropriate requirements are met. He must not make any mistakes. Cabling systems that are uncomplicated, convenient and logical to handle contribute to error prevention in the installation. Furthermore, it must be guaranteed that the installation will remain in good condition for many years. The cabling system must also be flexible in order to support recurring additions, moves and changes both on a small and a large scale. A modular approach is the best choice since it makes changes easy and keeps the error risk to a minimum. To eliminate sources of error it is important to comply with the standards. Cabling systems that adhere to the relevant standards or exceed them, minimize the probability that human error will lead to major breakdowns. The flexibility requirement ensures that the performance compression of active components is being supported. Rooms in data centers are expensive and difficult to enlarge once the building has been completed. Therefore, the cabling system must be in a position to reach and connect compact groups of active components. At the same time, handling at the patch panel must remain transparent in order to avoid errors with the quick plug-in and plug-out of patch cords. A high quality cabling system is designed from the beginning to add to the performance compression and to provide optimal usability at the same time. The quality concern applies to the entire value added chain of a cabling system from the production to the installation to the operation and maintenance. Picture 5: Patch pannels in data center source for human errors. Photo: R&M White Paper Datacenter Cabling v4.0 de Manfred Schmid 8

A fundamental cabling system requirement is that the performance of the IT applications must be guaranteed both now and in the future. The cabling infrastructure of a data center must support several generations of switch and server technologies. Therefore, a sufficient performance reserve is of extreme importance. Picture 6: The modular R&Mfreenet cabling system with the three product lines Classic, Star and Vision, covers all the long-term flexibility and performance requirements. Chart: R&M At this point we would like to refer to the modular R&Mfreenet cabling system. It obviously meets the standards and in addition provides flexibility and performance, which data centers require both now and in the future. Every carefully developed detail contributes to preventing undesired network interruptions in particular those that are caused by human error. In addition, it is particularly easy to install. 3.2. The next generation: 10 Gigabit Ethernet via fiber optics and copper The increasing data volume that data centers and enterprise networks have to handle requires a larger bandwidth and greater transmission performance. 10 Gigabit Ethernet via fiber optics was standardized in the IEEE 802.3ae in 2002 and well established in the backbone of data centers. The VISION components in the R&Nfreenet cabling system allow 10 Gigabit Ethernet via fiber optics. It consists of various cable types, which were developed for different applications and locations. In the WAN area of the entrance hall a singlemode OS1 optical fiber will be used according to IEC 11801 2nd edition or OS2 (cited in ISO/IEC 24702 corresponding to the B1.3 optical fiber in IEC 60793-2-50). The multimode optical fiber established itself as the standard in the backbone area and R&M s solution for this area of operation is OM3. OM3 is appropriate for the backbone area as well as for Storage Area Networks (SAN). It White Paper Datacenter Cabling v4.0 de Manfred Schmid 9

provides maximum performance over a distance of 300 meters and is suitable for redundant networks as specified in TIA 942 in Tier III and IV. In data centers where horizontal cabling as well as backbone areas should be usable for 10 GbE copper cabling is often preferred as it is more cost effective and sturdier in handling. The standard for 10 Gigabit Ethernet via twisted copper cabling IEEE 802.3an exists since June 2006. Technically the 10GBASE-T signal is far more acute and thus has greater interference sensitivity than its predecessors. This not only means that the signal is influenced by crosstalk between the wires of a single cable (Near End Cross Talk or NEXT) but also that in wiring bundles Near End Cross Talk between the cables (Alien Near End Cross Talk or ANEXT) must be taken into account. ANEXT can be as bad as NEXT in some situations and the cables must be strongly shielded to eliminate it. The effects of ANEXT are difficult to predict. It does not occur in all situations, as an active cable bundle must lie together for a long distance in order to provoke relevant ANEXT. The effect might not be symmetrical. Cables in the center of the bundle are probably affected more strongly that those at the outside. Frequently, it is unclear how a cable in a bundle can be identified. This can be the cause of temporary network problems that are difficult to detect. Critical situations might only occur if a series of servers with 10 Gigabit Ethernet is in the network. Therefore, some data centers have changed to a purely fiber optic infrastructure. Others evaluate the possibility of using mixed copper and fiber optic accesses for individual server racks. Both solutions have disadvantages. Fiber optic installations are more expensive and more difficult to change than copper cabling. Therefore, fiber optic cabling is more appropriate for static areas in the data center e.g. in the backbone area, where usually few changes are made. In a symbiosis of fiber optics and copper the most smooth and efficient combination possible is crucial. The R&Mfreenet cabling system von Reichle & De-Massari is compatible with 10 Gigabit Ethernet in both worlds fiber optics and copper and allows the combination on one platform thanks to modularity. R&M has developed two solutions for 10 GbE via copper a shielded and an unshielded solution, combined in the STAR Real 10 range of the R&Mfreenet cabling system. Picture 7: Independent certification important proof for the performance of a cabling system. White Paper Datacenter Cabling v4.0 de Manfred Schmid 10

The Cat. 6 components of this series fulfill the transmission requirements for 10 GbE as stipulated in IEEE 802.3an in 4 connector configurations and 100 meter horizontal twisted pair copper cabling. The standard specifies an interruption-free transmission at 500 MHz. Independent laboratories have tested and certified the Cat. 6 channels from R&M up to a transmission frequency of 600 MHz. Every individual Cat. 6 STP module contains a 360 shield, thus providing all-round protection against interference from neighboring modules. The STAR Real 10 series includes certified, highly flexible patch cords, which allow quick administration of servers and switches as well as a secure and reliable end-to-end data connection. Picture 8: Cat. 6 UTP and Cat. 6 STP module, Cat. 6 S/FTP and Cat. 6 U/FTP cable (from left to right) from the STAR Real 10 range: Reliable data transmission for 10 Gigabit Ethernet network. Photos: R&M R&M, based on its many years of experience with shielded wires developed the WARP technology (Wave Reduction Patterns), which is included in the STAR Real 10 UTP range. A foil conductor surrounds the cables and absorbs external interference. The foil segments in the UTP cable are separated from one another to avoid circulating current. They are sufficiently short to avoid antenna effects, but arranged sufficiently tightly to suppress ANEXT. WARP installation cables exceed the ANEXT values specified in the current standards, nevertheless, they can be easily terminated and planned for just like the usual UTP cables. Snap-on WARP housings for the connector modules together with optimized patch cords ensure that the protection function is effective on the entire connection link. The shielded and unshielded STAR Real 10 components thus allow a future-reliable installation for highspeed transmissions. Five different 4 connector configurations were certified independently from one another in order to demonstrate the 10GBASE-T performance and thus facilitate the interruption-free operation for current and future IT applications. White Paper Datacenter Cabling v4.0 de Manfred Schmid 11

3.3. The Significance of shielding, grounding and potential equalization Data centers are electromagnetically charged environments. Power supply, cooling units, etc. cause various interference signals. As mentioned above, a network operated with 10 Gigabit Ethernet via copper becomes sensitive to such interference based on the low signal level. Therefore, a comprehensive shielding often dismissed in the past with nice to have is an absolute necessity in modern data centers. Included in this are the grounding and/or potential equalization factors. The grounding networks must be developed first in planning a data center. Grounding must be planned based on EN 50174-2 If this is properly done, an excellent and effective shield can be established provided there is a reliable shield termination on the data connection. Picture 9: Grounding and/or potential equalization is a prerequisite for effective shielding. Star, tree, hybrid and mesh topologies are possible (according to EN 50174-2). In addition, provisions must be made for an effective and reliable shielding connection. The connection impedance plays another important role against electromagnetic interference within the scope of protection provisions. White Paper Datacenter Cabling v4.0 de Manfred Schmid 12

Reichle & De-Massari equips the Cat. 6 connectors with a shield termination, which guarantees a low, stable transfer impedance along the entire connection link. A long and stable termination shaft in form of a bayonet connects module and cable shield and assures a virtual 360 contact. The connectors have solid shield contacts. Picture 10: A stable bayonet with 360 shield contact guarantees low transfer impedance at the shield connection (marked in red on the left side of the chart). Chart and photo: R&M Picture 11: Solid shield contact in the module. Photo: R&M White Paper Datacenter Cabling v4.0 de Manfred Schmid 13

4. Planning Basics and Criteria for Product Selection 4.1. Future reliable planning of data center networks The aspects discussed above, such as cost effectiveness, availability, standards, modularity, performance, shielding, etc., are crucial criteria for the planning of a data center infrastructure. In addition, the quantity and capacity requirements of the cables must be defined in order to present the desired flexibility from the beginning. Additionally, the quantity and size of servers, switches, network connections, etc. must be estimated. Redundancy aspects must also be taken into consideration. Redundant connections are principally guided via separate cable tracks so that a connection can always be maintained in an emergency. The planner must also take into account the power supply and cooling requirements for every equipment rack. He must make sure that the data, power and cooling channels in the ground do not overlap. In addition, the number of separate management signaling cables and KVM connections as well as the density of the copper and fiber optic ports on every rack must be considered. Future developments must be predicted and included in the planning. IT applications on individual racks or entire areas of the data center may change. This possibility must be allowed for. Particularly for horizontal cabling supplying switch and server racks, this means that racks, patch cords and even cable bundles must be configured as modularly as possible. This makes it easier to replace or convert smaller sections if necessary. Future reliability through proper planning also implies designing a cable system that is compatible with several generations of active components. Reserves must be made available to be prepared for an expansion of the data center or to facilitate port compression. This not only applies to the high-speed or SAN connections but also to the remote control of servers (KVM) and separate control cables, which must be planned with growth in mind. White Paper Datacenter Cabling v4.0 de Manfred Schmid 14

Main Distribution Equipment Distribution Storage Switch Rack Server Rack SAN Rack OM3 LC, SC, ST, FC Kat6 RJ45 OM3 LC, SC, ST, FC Backbone Horizontal Cabling SAN Picture 12: The typical data center topology and cabling requirements. Source: R&M 4.2. Planning maximum reliability for backbone and storage area In the planning of backbone cabling it is particularly important to aim for long-term, maximum reliability. Typically, the backbone is less exposed to constant changes. Although it must be assumed that the data rates and capacities will also increase, it will, however, be less common that backbone links will be added or changed after completion of the data center. It must be emphasized once more: Maximum reliability in the backbone as well as in the storage area is of utmost importance as the consequences of an interruption would be enormous. In the case of additions, moves or changes, backbone and SAN links must not be exposed to risks of interruption under any circumstances. Today, OM3 multimode fiber optics is the choice in most cases for the configuration of a backbone. Singlemode fiber optics might be necessary for distances of over 300 meters for example in data centers planning in their layout long distances between the connection points of telecommunications providers in the entrance area, the telecommunications room and/or the main distribution node in the computer room. Proper termination of the fiber optic cables minimizes subsequent modification expenditure. Usually, fiber optic connectors in LC design are used, as this connection option is widely used for active components. In some cases it will be wise to use other connectors. In contrast, the E-2000 connector is used for long backbone links, because, among other things, it provides excellent vibration protection. White Paper Datacenter Cabling v4.0 de Manfred Schmid 15

Pre-terminated fiber optic cable bundles are generally recommended for backbone and SAN cabling. Thus, planning and installation can be more efficiently structured and installation errors can be avoided. On site splicing and curing are thus eliminated. R&M provides appropriate system solutions, which are supplied with the desired length, fibers and connectors (LC, E-2000, SC-RJ or SC) and/or panel connectors. The cable bundles are carefully terminated and are already tested and labeled. They are equipped with conduits guaranteeing tensile strength to reduce the risk of fiber damage during installation. Furthermore it is guaranteed that all the fibers in the bundle comply with the standard. For zone and main distribution racks, R&M provides compact racks for quick installation. They can accommodate spliced and pre-terminated cables as well as all connectors. They facilitate qualified cable handling, which prevents optical fiber damage from the outset. Picture 14: Solution for efficient installation of reliable backbones: pre-terminated cable bundles with LC, SC or E2000 with compatible 19 rack. Photo: R&M Today, SC-RJ connectors are preferred within server racks as they have the same size as RJ45 connectors for copper cabling and thus symbiosis becomes possible on one platform (picture 13). This simplifies management tasks and supports cost effectiveness and investment protection. In the R&Mfreenet cabling system, the VISION range fulfills the backbone cabling requirements. Because the backbone is a static network element, it is scarcely changed once it has been installed except in an overall capacity expansion of the data center. Therefore, performance and long-term stability are main requirements after platform density. In addition to performance and density, the VISION range offers the possibility of termination ex factory. Thus, installation times can be shortened and additional error sources can be avoided. Picture 13: SC-RJ in symbiosis with RJ45. Photo: R&M White Paper Datacenter Cabling v4.0 de Manfred Schmid 16

4.3. Allowing for flexibility and scalability for switch and server racks The productive data center zone, the server and switch racks, depend on increased flexibility and easy scalability. Expansions, moves and changes must be handled efficiently and in an uncomplicated manner. Quick response time is a competitive factor in data centers. Cabling must resist many influences in this area. It must survive several hardware generations without performance loss, and must be application independent and easy to administrate. Good cables alone are relatively useless if the connection system does not support an efficient and secure installation process. To avoid mistakes during the running operation, patch cords and patch panels should provide a good overview of cable connections. R&M has also created a mature high-quality system for this problem. Clear overview, distinct allocation, easy management, flexibility and modular design are the features of the solution. Various elements contribute to the elimination of typical error sources in the running operation right from the beginning. The global patch panel is a good example (picture 15). It provides flexibility: RJ45-, SC-RJ- and LSH-Ports (E-2000 ) can be made available on the same panel, thus facilitating uncomplicated migration. As an alternative to the 24 port panel standard, this 60 port solution provides a greater level of modularity. Thus a single patch panel can be used for all connections (remote KVM, LAN or SAN) to a server rack. The total space used is smaller than in a higher density, but less flexible solution. The larger surface allows clear labeling of the ports an error preventing factor in patching. Picture 15: Global patch panel with compatibel fiber platform (SC-RJ or E2000) flexibility, scalability and efficiency in the rack. Photo: R&M White Paper Datacenter Cabling v4.0 de Manfred Schmid 17

4.4. Choosing consistent security solutions The security of data center networks can be easily influenced at the cabling level and be so planned and designed that it can be adapted to increasing requirements at any time. As mentioned above, transparency, clarity, simplicity and usability play an important role. The cost-benefit ratio must also be taken into account with the product selection. Frequently, a simple but consistent mechanical solution is more effective than an expensive active component or complex software solution. Reichle & De-Massari systematically continues with the modularity principle in the security area. Color coding is a vital element. Usually, colored patch cords are used in data centers. The colors must identify various types of IT services. The method is effective, but inefficient because various types of cables must be kept in stock. In addition, it cannot always be assured that the right colors are being used particularly after major failures or drawn-out modifications. If a color coded cable is interchanged, the IT service will be impaired. Chain reactions to the point of total failure are possible. R&M s security solution is based on colored markings on patch cord ends. They are simply snapped on or replaced. The cable itself does not have to be unplugged or removed. Attachable color coding can also be used on the patch panels. Thus, a clear allocation of connections is established. In addition, this system reduces the costs for patch cord storage. Color charts and mechanical coding or locking solutions are features of the independent R&M security system, which is offered in addition to the cabling systems. This system guarantees that the cables are not connected with the wrong ports or that a cable whether copper or optical fiber always remains in place. The connector can only be opened with a special key. Together, visual and mechanical coding and locking solutions provide an enormous improvement in passive data center security. Picture 16: Simple but consistent, effective and cost effective security solutions from attachable color codes (left) to the lock on the patch cord (right). Photos: R&M White Paper Datacenter Cabling v4.0 de Manfred Schmid 18

4.5. Aiming for quality assurance across the entire added value chain In order to completely prevent failures, high quality is required along the entire added value chain that does not relate only to the product itself. Planning, installation and the running operation itself must be of the maximum quality. If only one part does not comply, the objective of a perfect operation cannot be reached. Reichle & De-Massari guarantees that the required quality is sustainably understood and implemented at the users sites via a partner program. Based on this assessment program, organizations that select R&M as supplier can be assured that they will be fully supported by all those involved and that a high-quality, reliable network will be configured. The program includes regular training sessions, long-term warranties and repeat certification programs in order to guarantee that all involved persons meet the standards. In interaction with the high-quality products and proactive efforts for an uncompromising quality assurance at R&M, the availability, security and profitability of network installations are thus consistently improving. Picture 17: R&M partners attend an assessment program. The certificate attests that the holder masters the proper installation of the R&Mfreenet cabling system and thus a reliable network operation is guaranteed right from the first installation step. Photo: R&M White Paper Datacenter Cabling v4.0 de Manfred Schmid 19

5. Conclusions Data centers are confronted with increasing performance and availability requirements. Data center management must plan for future growth in demand and at the same time must continuously work to reduce the probability of failures and human error. Nowadays, with appropriate planning and the use of meaningful innovations the necessary measures can already be taken, risks lowered and profitability improved at the level of cabling or passive infrastructure. Cabling systems and data center solutions from R&M enable future-reliable data communication. They are flexible and provide numerous options for high-quality copper and fiber optic cabling. Network expansions can be implemented with a minimum of downtime without the costs and inconveniences that occur in the installation or replacement of cables. The R&Mfreenet cabling system complies with all important standards. The manufacturer, R&M, is actively involved in the development of cabling standards. This closeness to the standardization process guarantees that R&M solutions work reliably with any installed device, regardless of how fast the data transfer must be or how complex the design of the data center is. However, performance and standardization are only one part in the whole picture. The modularity principle runs through all R&M solutions. It guarantees the necessary flexibility of a cabling system. Modularity not only saves money, time and space, but it even makes it possible to structure patch panels based on information technology functions and applications. Previously, they could only be designed according to cable types. Thus, data centers can guarantee continuous processes even with a variety of device types and data rates. In conclusion it can be said that R&M s cabling solutions improve the cost effectiveness of data centers, increase availability and simplify management. The R&M solutions guarantee that IT applications are not impaired in the data center in the case of additions, moves and changes as they can be continuously operated without interruption. Simplified management also means that every detail in the product development particularly user-friendliness is considered. Consequently this means that less strictly monitored suppliers and outside personnel can work in the data center without endangering the security level. Where R&M security solutions are used, personnel can quickly and reliably install or upgrade devices without having to worry about possible service failures. Through the innovative coding system patch cord storage, costs can be reduced and high network security can be attained with relatively minor expenditures in the running operation even in a major emergency. The result is a cabling solution that takes into account all the business aspects important for the development of today s data centers. 6. Sources and Additional Information - Overview brochure: R&M Enterprise Cabling and Qualified Partner Program - TIA 942, ISO/IEC 11801, EN 50173-5 (Draft) among others. For more information on R&M products and solutions visit the Internet at: www.rdm.com # White Paper Datacenter Cabling v4.0 de Manfred Schmid 20