Designing the Data Center

Transcription

1 Designing the Data Center Asef Baddar, RCDD May -, 00

2 Talking points What are Data Centers? Why Data Centers? The components of the Data Center Approaching the Data Center design Breakdown of the components Nuggets of information from TIA- Forward looking designs for Data Centers

3 What is a Data Center? A place to locate computer, storage and networking devices safely and securely A place that provides un-interruptible power needed to power a Company s mission critical devices A place that provides a temperature controlled environment for equipment to operate properly A place that provides connectivity to other devices inside and outside the data center

4 Components of the Data Center Physical space Raised flooring Electrical Standby Power Cooling Fire Suppression Physical security Physical access Cabling

5 Why Data Centers?

6 Why are Data Centers Important? Wiring Closet Passive connectivity Pass-through Cross-connect CEO s, CFO s, CIO s and other senior mgmt don t spend much time and focus on closets Data Center Critical Applications ERP CRM SCM Back office ecommerce Critical Computing Systems Servers Storage Networking

7 Why are Data Centers Important? 0-0% of all IT dollars are spent in the data center! Because that s where the money is! Willie Sutton

8 The Approach

9 The Approach to designing a Data Center KISS Keep it simple sir Flexibility equipment changes Scalability K sq.ft. or M sq.ft. Modularity logical and master plan for equipment Standardize consistency and uniformity The Human Factor promote good habits Don t lose your sanity! Oops will happen.

10 What is tiering? Tier Basic Tier Redundant Components Tier Concurrently Maintainable Tier Fault Tolerant

11 Tiering look

12 What is N? N = Maximum capacity needs N+ = Max. plus extra device(s) N+ = Max. plus extra device(s) N= = Max. plus extra device(s) N* (N) = doubles need N* (N) = triples need Balance Need versus cost and complexity of redundant systems

13 Tiering for availability Level of availability Percent Downtime per year Six nines. seconds Five nines. minutes and seconds Four nines. minutes and seconds Three nines. hours and minutes Two nines days, hours and 0 minutes Downtime affects productivity and business functions

14 Flexibility Data Centers are not static use products that can be easily changed or moved Cabinets that can accept various equipment Panels that accept copper or fiber Outlets that can be changed with a cord

15 vertical Scalability 0

16 Modularity

17 Standardize

18 The Human Factor

19 Hope for the best and plan for the worst

20 Understanding the components

21 Physical space Data Center selection should consider: Seismic areas use earthquake resistant technologies Ice storms ensure backup generators can run for extended periods Hurricanes shelter against high winds Tornadoes no windows Flooding build on elevated ground Landslides have retention walls Fires install fire resistant walls and suppression systems

22 Physical space continued Polluted air limit outside air or use high filtration air systems EMI build away from sources of EMI Vibration stay away from railroads, airports, major thoroughfares Political climate labor issues and materials delay Flight paths distribute servers Service provider can you get enough bandwidth

23 Raised flooring Floor height for plenum is average Ensure there is enough ceiling height for heat exhaust Weight bearing capacity should be rated with same strength as sub-floor Sub-floor shall be sealed to prevent concrete dust ESD floors shall have static control No perforated tiles in main pathways heavy equipment being transported over them can break them Ramps should have a in incline, be in width and have landings on both ends or square for maneuvering equipment

24 Electrical Electrical specification should consider: Separate power sources building system power feed shall be isolated from server equipment power feed Bypass have maintenance bypass options for normal maintenance without taking down equipment Pre-wire cabinet locations adds more upfront cost but less disruptive PDU loads do not load circuits more than 0 percent Use whips flexibility for moving power

25 Electrical continued Receptacles limit to per circuit Heavy guage wire 0 AWG is better than AWG Run six 0 AWG wires phase conductors, neutral, equipment ground and isolated ground Labeling label the circuit and location in circuit panel Convenience outlets do not tie into equipment power feed

26 Standby power Standby power should be specified with the following considerations: Sizing of UPS Use peak load and not operating load Uptime should be a minimum of 0 minutes at full load with generator backup or hours without a generator backup Generators should be designed into your Data Center if uptime will be critical for extended outages in the area Battery room ensure adequate ventilation Monitoring lights utilize color coded domes and wire the lights into the various backup systems for instant visual clues such as red for UPS and blue for generator

27 Heat is destructive to electronics For every degrees above ambient temp. (F-F) reduces equipment life by ½ Intel

28 Cooling Specifying cooling should consider: Fans balance air flow with noise Ton of cooling melting of,000 pounds of ice in hours ton =, 000 BTUs watt =. BTUs Perforated tile can displace approximately KW of heat Ideal temperature degrees is ideal Ideal static pressure in. water column

29 Cooling continued Containing pressure seal all tile cutouts, walls and doors Ideal humidity 0 percent plus or minus 0% Air handlers have a buffer space around air handlers Cabinets use solid side doors and install blanking panels on cold side intake to increase pressure Air change design for 0 air changes per hour Chilled water pipes insulate them to prevent condensation

30 Overhead discharge

31 Hot and cold aisle discharge

32 Hot and cold aisles Front Power bank HOT tile can output KW BTU s Front

33 Cooling needs chart Watts/sq.ft BTUs/sq.ft. DC size (sq.ft.) Total BTUs Tons of cooling # of air handlers ,000,0, ,000,, ,000,0, ,000,, ,000,, ,000,, ,000,0,000. -

34 Fire Suppression Fire suppression specification needs to address: Gases Inergen (IG-) removes oxygen from the air and ozone friendly Argonite (IG-) reduces oxygen in the air and ozone friendly FM-00 or HFC- absorbs heat energy and ozone friendly FE or HFC- absorbs heat energy and not ozone friendly Sprinklers has a threshold rating of degrees on the bulbs and you should utilize a dry system in the server room Smoke and heat detection allows a proactive approach Handheld extinguishers use Class C which is CO or dry foam

35 Physical security Physical security specification needs to address: Door controls use badge access or combination door locks Cages additional physical security of sensitive equipment Locking cabinets key or combination but be aware of cooling implications CCTV place at entrances into DC and at sensitive equipment Access Policies have a policy on how access is granted

36 Physical space Physical space specification needs to address: Aisle size for main thoroughfare Door size shall be a minimum of ft wide and ft high, without doorsill, hinged to open outward (code permitting) or slide side-toside, or be removable. Doors shall be fitted with a lock and have either no center post or a removable center post to facilitate access for large equipment The minimum ceiling height shall be. m (. ft) from the finished floor to any obstruction such as sprinklers, lighting fixtures, or cameras. Cooling requirements or racks/cabinets taller than ft may dictate higher ceiling heights. A minimum of in clearance shall be maintained from water sprinkler heads.

37 Cabling

38 TIA Telecommunications Infrastructure Standard for Data Centers What kind of information can I find in the document? Scope Definition Design Overview Cabling system overview Cabling system infrastructure Telecommunications spaces and Related Topologies DC cabling systems DC cabling pathways DC redundancy Multiple Annexes

39 Cabling Topologies Direct Connect Distributed

40 THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY Sample Application SD SD SD SD SD SD SD SD WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX 0 STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0

41 THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY Patch Cord into Server Sample Application SD SD SD SD SD SD SD SD WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET

42 Switch STAT Power Power Supply Supply Catalyst 00 SERI Zone Distribution Area FA N US STATUS PHONE STATUS PHONE STATUS PHONE STATUS PHONE STATUS PHONE STATUS PHONE STATUS PHONE THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY THE SIEMON COMPANY -Port Patch Panels Servers Patch Cord into Switch Patch Cord into Server Horizontal Cabling ES SD SD SD SD SD SD SD SD WS-X-GE-TX WS-X-GE-TX P O R T 0 0/00/000 BASE-T ETHERNET SWITCHING MODULE WS-X-GE-TX P O R T 0 0/00/000 BASE-T ETHERNET SWITCHING MODULE STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX STATUS P O R T 0/00/000 BASE-T SWITCHING MODULE PHONE ETHERNET 0 WS-X-GE-TX WS-X-GE-TX P O R T 0 0/00/000 BASE-T ETHERNET SWITCHING MODULE P O R T 0 WS-X-GE-TX 0/00/000 BASE-T ETHERNET SWITCHING MODULE P O R T 0 WS-X-GE-TX 0/00/000 BASE-T ETHERNET SWITCHING MODULE P O R T 0 WS-X-GE-TX 0/00/000 BASE-T ETHERNET SWITCHING MODULE P O R T 0/00/000 BASE-T ETHERNET SWITCHING MODULE 0

43 Data Center topology

44 Sample of Panel Identifiers on Rack

45 design guidelines In addition to satisfying today s telecommunication requirements, the horizontal cabling should be planned to reduce ongoing maintenance and relocation. It should also accommodate future equipment and service changes. Consideration should be given to accommodating a diversity of user applications in order to reduce or eliminate the probability of requiring changes to the horizontal cabling as equipment needs evolve. Change your equipment and not your cabling!!! Minimum of Category is recommended. Minimum of Laser Optimized 0 micron is recommended.

46 design guidelines continued For copper cabling, in order to reduce the effect of multiple connections in close proximity on NEXT loss and return loss, the horizontal distribution area termination should be located at least m (0 ft) from the main distribution area termination. *NOT necessary! Overhead cable trays should be suspended from the ceiling ohm cable (type, ) is allowed for application specific applications such as DS- Use a minimum of wide vertical management on both sides of racks and a minimum of 0 wide vertical between racks

47 design guideline continued Power strips shall be labeled with the PDU/panel identifier and circuit breaker number. Racks that are supported by the access floor shall be bolted to the cement slab or a metal channel secured to the slab by threaded rods that penetrate through the floor tiles. Sharp edges on the top of the threaded rods shall be covered using domed nuts or other method. Exposed threads under the access floor should be covered using split tubing or other method. Power strips with indicators but no on/off switch or breaker reset button should be used to minimize accidental shut-off.

48 Forward looking design

49 Overhead conveyance or under floor?

50 Utilize pre-terminated Category A systems Great for quick network deployment Excellent Channel to Channel characteristics Ideal for data center Server Row designs Lifetime System Warranty No field testing required at all 00% performance tested at factory to TIA CATA UTP or STP cables secured in braided sleeve Jack-to-Jack or Jack-to-Open configurations

51 Utilize pre-terminated MTP design Consider OM fiber or better Great for quick network deployment Cabling harness can be changed for new equipment Excellent Channel to Channel characteristics Ideal for data center connector low loss channels Lifetime System Warranty No field testing required at all 00% performance tested at Factory MTP - SC Duplex MTP - LC Duplex

52 Switch or Server Cabinet Options x CATA UTP ports in U Minimizes server or switch cabinet rack space panel options Standard Flat Angled Recessed Angled

53 Server Cabinet Panel Option VertiGO Patch Panel x CATA ports Consumes zero rack space Provides easy access to servers Improves airflow Improves cable management

54 Never worry about wiring cabinets again Reduces cabling/congestion inside of cabinet Allows for copper and/or fiber connectivity Supports 0G connectivity No need to wait on cabinets for your data center projects!!

55 Summary Simplify Build it for scalability Build it using modularity Changes to your design can impact other areas Remove the oops factor by planning

56 Thanks you for your time!