Data Center Design & Enterprise Networking
|
|
|
- Lauren Goodman
- 9 years ago
- Views:
Transcription
1 Data Center Design & Enterprise Networking By Christian Mahood Thesis submitted in partial fulfillment of the requirements for the degree of Master of Science in Networking & Systems Administration Rochester Institute of Technology B. Thomas Golisano College of Computing and Information Sciences February 25 th, 2009
2 Rochester Institute of Technology B. Thomas Golisano College of Computing and Information Sciences Master of Science in Networking and Systems Administration Thesis Approval Form Student Name: Christian Mahood Thesis Title: Data Center Design & Enterprise Networking Thesis Committee Name Signature Date Luther Troell Chair Charlie Border Committee Member Sylvia Perez-Hardy Committee Member
3 Thesis Reproduction Permission Form Rochester Institute of Technology B. Thomas Golisano College of Computing and Information Sciences Master of Science in Networking & Systems Administration Data Center Design & Enterprise Networking I, Christian Mahood, hereby grant permission to the Wallace Library of the Rochester Institute of Technology to reproduce my thesis in whole or in part. Any reproduction must not be for commercial use or profit. Date: Signature of Author:
4 Abstract: Today s enterprise networks and data centers have become very complex and have completely integrated themselves into every facet of their represented organization. Organizations require Internet facing services and applications to be available at any part of the day or night. These organizations have realized that with centralized computing and highly available components, their technological presence with customers can be greatly enhanced. The creation of an infrastructure supporting such high availability takes numerous components and resources to function optimally. When an organization makes the decision to design a data center, they utilize resources to provide insight into what components to deploy. Much of this information is based off of recommendations made by third party vendors or limited past experiences. This research provides a course offering as a solution to help provide students with the information to design and comprehend the major components within a modern data center. The information included in the course offering has been compared with industry accepted standards and various other resources to provide reliable and accurate information. Course topics have been architected around eight major topics. These topics covered are network design, electrical systems, HVAC (Heating, Ventilation, and Air Conditioning) systems, security, management, redundancy, disaster recovery and site planning. The information contained within the lectures has been compiled from multiple sources to provide a single location for information. Furthermore, the course offering will utilize class discussions, case study analysis and activities to re-enforce key points. Providing such a course for students to learn about data center components will provide organizations with the ability to rely less on outside information and design scalable data centers that can provide years of growth.
5 TableofContents 1Introduction Problem Importance...3 2Reviewofcurrentresearch Background ResearchDesignandMethodology AssumptionsandLimitations ResearchMethodology TestSystemDesign Results CourseTextbook TopicDesign TopicExpansion NetworkDesign Electrical HVACSystems Security DisasterRecovery Tools Conclusion FutureWork CourseSyllabus CourseICCForm CourseLectureSlides Week2Slides Week3Slides Week4Slides Week5Slides Week7Slides MidtermExamExampleQuestions MidtermExamExampleQuestions References:... 93
6 Table of Figures Figure Figure Figure Figure
7 1 Introduction Organizationalnetworkshavebecomevastandcomplex.Manycompaniesthroughoutthe worldhavedatacentersthathaveevolvedfromsingleroomswithinlargercompany operationcentersintoenormousstandalonebuildingsthathousethousandsupon thousandsofservers.thereisnolongeranotionthatadatacenterbelongsonlytothelarge organizationsoftheworldassmallerandsmallerbusinessesarebeginningtorelyonthe centralizationandbenefitsofrunningadatacenterthatcanassistwiththeiroverall efficiency.datacentersrangeinvaryingsizeandcapabilitiestodayandalsoarecomprised withvaryingcomponents.thereareanumberofdifferentpieceswithinadatacenterthat mustmeshtogetherseamlesslyforperformancetobeoptimal.inorderforanorganization toimplementandbuildadatacenter,heavyplanningisinvolvedtounderstandtheneedsof theorganizationandtodeterminethefullscaleoftheendresult.someorganizationsmay payparticularattentiontofinancialsideofthedatacenter,whileotherorganizationsmay payattentiontooverallspacethatcanbeachieved.thisparticularneedwillvaryfrom organizationtoorganization,howevertherearemultiplekeyareasthatmustbeaddressed todesignafunctionaldatacenter. Thisresearchaimstoprovideasolutionforacademicinstitutionstoprovidestudentswitha locationtolearnaboutdatacenterdesignandnetworking.byprovidinginformationabout datacenterdesignandnetworking,studentswillbeabletoutilizeexperiencesand informationfromtheclassinfuturecareersfororganizationsthatwishtoreconfigure,plan orretrofitenvironmentsforusageasadatacenter. 1.1 Problem Datacentersrequirealargeamountofplanning,interactionwithdifferentresourcesanda largeunderstandingofdifferentareasofexpertisetoimplementfromstarttofinish.thereis 1
8 alargeamountofcostandtimededicationtounderstandalltypesoftechnologyand componentsthatmustbeimplementedwithinadatacenter.thereisinformationavailable acrossmanydifferentplatforms(theinternet,books,articles,etc,)howevertherelacksa resourcethatcanhelpstudentsunderstandthecomponentsandtheimportanceofdesign intheplanningofadatacenter.thedevelopmentofacourseofferingthatcoversthese topicswillallowstudentstoshareexperiencesthattheyhaveencounteredandalsowill allowstudentstocollaborativelylearndifferentfundamentalstogetherthroughdiscussion. Thereisampledataavailableinlibraries,theInternet,variousbooks,andmagazinearticles thatcanassistintheplanningandimplementationofadatacenterforanorganization. Manyoftheseresourcesaredifficulttoobtain,containinformationonasinglepieceofthe infrastructure,lackcomprehensiveinformationinonesourceanddonotprovideadequate recommendationsbasedonexperiences.theinformationcanbedifficulttoobtaindueto financialinvestmentandalsocantakelongamountsoftimetocorrelate.thelargeamounts ofdatamakeitdifficultforausertodecipherexactlywhatcomponentsarecriticalandvital tothesuccessoftheproject.itisimportanttodesignthedatacenterforcurrent organizationalneeds,yetplanforthegrowthofthedatacentertomeettheneedsofthe organizationsforthenexttentotwentyyears. Acourseofferingthatcompoundstheinformationandallowsindividualstudentexperiences tobesharedisoneapproachtodecreasetheneedforvariousdifferentexternalresources. Thisresearchhasnotfocusedonthebenefitstocentralizationofinformationinregardsofa datacenter,butpresentsasolutiontoassiststudentscomprehendandunderstandthe necessarycomponentswithinadatacenterandtakesalargestepofgatheringthe informationoutofthepicture.manysourcesdiscusshowtocreateadatacenter surroundingcurrentorganizationalneeds.adatacenteristhendesignedsurroundingthese needs, howeverwithintwotothreeyearstheorganizationcouldrealizethatithasrunout ofspaceandneedstodeterminetheircourseofactionyetagain.howcouldtheresponsible personthengobacktotheorganizationandaskagainforhundredsofthousandsofdollars 2
9 foryetanotherdatacenter?thoughtfulplanningandestimationthroughoutthedesign processcouldhavemitigatedthisbyunderstandingscalabilityconcepts. 1.2 Importance Planningthroughouttheentireprojectofadatacenterisimportantasitallowsforthe correctestimationandscopeofthevariouscomponentssupportingthedatacenter.the infrastructureofthedatacentercanallowflexibilitiesinthesystemcomponentsinstalledin thedatacenterifplannedcorrectly.thevariouscomponentsfromelectrical,andheating, ventilationandairconditioning(hvac)systemsinstalledinadatacenterareusually modifiedtoprovidehighercapacitiesandmanyorganizationscouldutilizetheskillslearned inancourseofferingtoprovideconsciousdecisionsduringprojectssurroundingtheirdata centers.thisresearchwillbenefitanyorganizationthatislookingtobuild,retrofit,ormodify adatacenter.itwillalsobenefitanyinstitutionlookingtoimplementsuchacoursetoassist studentsinunderstandingdatacenterdesignandmajorcomponents. 2 Review of current research Researchregardingthecomponentsofadatacenterandtheirimportancehasbeencovered inindustryandacademialedresearch.thereisanimportanceunderstoodthatthedata centeritselfprovidesmanyopportunitiesanduniquefeaturesthatothertypesofcomputing donotfeature.highlypoweredcondensedserverclustersandhighavailabilityhardware makethedatacenteracriticalcomponenttotoday sorganizationalsuccess.howcanthese typesofenvironmentsbeplannedcorrectlyforfullscalability?furthermore,howdoallof thesecomponentsworktogetherinafashionthatcanbemanagedsuccessfully?inthis section,priorresearchispresentedaboutdatacentercriticality,poorsiteplanning,network components,managementandlastlyscalabilityimportance. 3
10 (Alger,2005)focusedontheneedforadministratorstorealizeandfullyunderstandthe criticaltieofadatacentertothebusinessitsupports.thepurposeofhispublicationwasto informadministratorsandexecutivesoftheplanninginvolvedwithadatacenter.theother focusofthepublicationwastoaddressthemagnitudeofcomponentsthatgointoadata centerandhowtochoosethebestsolutionfortheneedsofthebusiness,orcustomer.his researchwasqualitativeregardingthecomponentsandincludedquantitativemethods involvingdesigninganalysis.thebookwaswrittenpullingtheexperiencefromtheauthor andthosefromtheciscoinfrastructureteamtogiveadministrators,professionalsand executivesabetterunderstandingofadatacenter.thebookstructuresitselfintothekey areasofthedatacenter;thesite,thespace,theelectricalsystem,thenetwork,theairand temperatureofthesite,andthemanagementofthedatacenter.theresultsofthe publicationaremultipledifferentviewsandopinionsaboutthedesignandimplementation ofthedatacenterandtheavailableoptionstothecustomerallinasinglepublication.this publicationisuniqueinthatitcombinesalmostallaspectsofthedatacentertogetherinan analysistothedepththatallkeypointsarecovered.thetechnicalflawofthispublication wasthatitdoesnotcoverthedepthnecessaryindatacentersfornetworkingsegregation andflowlayout. Anothersimilarpublication(Snevely,2002)discussesthoroughlyaboutthelackof constructionplanningwhenapproachingadatacenter.themainfocusofhisresearchwas toprovidethoseinterestedinplanningtheconstructionorre constructionofadatacenter andevenasminuteasreconfiguringorretrofittinganexistinginfrastructurewiringcloset. HisattemptwasnottocovertheallaspectsofthedesignofaDataCenter,buttoprovide resourcestohelpassistthedesignofadatacenterbasedoffoftheneedsandrequirements ofthedatacenterforconstructionalpurposes.hisresearchincludedqualitativemethodsof constructionanddesignfrompreviouscasestudies,experienceanddocuments.the materialcoveredinsidethebookrangesfromexteriorspacedesignsdowntothewiring insideadatacenterrackandevenincludestrashcontrolmethods.robextensivelycovers andstressestheimportanceofplanninginadatacenter.eachsectionwithinthebook 4
11 coversatleastonetiporkeypointtomakenote.thebookalsocoversindepththeneedto followlocalandfederalbuildingcodeinregardstotheconstructionandimplementationof componentsindatacenters.thisisauniquefeaturethatshouldbetakennoteduring planningstages.theconclusionthatsnevelymadeduringhisbookwasthatwhilethe planningofdatacenteriscomplicated,ifdonecorrectlythedatacentercanprovidea scalableandmodularenvironmentforanysizeandcapabilityneededbythecustomer.the otherresultofthebookisapublicationthatcanprovidequickreferencefordesign requirementsandtips.thedifferenceinthispublicationincomparisontootherworksisthat whileitdidnotcomprehensivelycoverservercomponents,ornetworkcomponentsitdid coverthemajorityoftheenvironmentalcomponentsnecessarytodatacenterdesignand shouldlookedatasavalidresourceforstudents. (Berktowitz,1999)presentedanin depthanalysisofenterprisenetworkingandcomponents ofenterprisenetworks.inparticular,thispublicationfocusedfullyonenterprisenetworking ratherthannetworkingingeneral.theauthorrecognizedaproblemwithnetworking cookbooks thatclaimtoteacheverything,butlackthefollow throughofexplainingthe whatandwhy ofnetworking.inthispublication,particularlychapterssevenandeight,the authordistinguishedthedifferentlayersofthenetwork.itisauniquepublicationthattakes directlyintoconsiderationtheflowofthenetwork,theperformance,andmostnotable,the implementationofnetworksegmentation.theresultofthissectionwasacomparison betweenthedifferenttechnologiesavailableandtherecognitionofcostintheequation duringplanninganddesignstages.theauthoralsorecognizedthevastarrayofdifferent technologiesavailabletothecustomeranddiscussestheneedtounderstandthebusiness customer sneedspriortodesigningthenetworkportionofthedatacenter.thispublication directlyaddressedtheneedforenterprisenetworkdesignandwentintogreatdetailabout thistopic.thepublicationdoesnotaddressanyintegrationorcasestudiesofdatacenter integrationandalsodoesnotmentionotherportionsofnetworkinginthedatacenterother thanlayers2andlayer3oftheosimodelcommonlyreferredtoinnetworking.whilethe 5
12 studyisusefulforasingleimportantcomponentwithinthedatacenter,itdoesnotpresent anyinsightintotheintegrationofanyothercomponentsrelevanttoadatacenter. AgroupatCarnegieMellonUniversity(Sun,2007)focusedonmanagementofDataCenters. TheyfoundthatmonitoringisacrucialcomponenttoaDataCenter sfunctionalityand maintenance,yettherewerenotcomprehensivesolutionstoaddressmanagement.the teamatcarnegiemellonthendevelopedanalgorithmthatwillassistinthemanagementof thedatacenterwithlessofanimpactontheadministrator.thepurposeofthisresearch wastointroducetothearenaofmonitoringanothertoolthatprovidedadaptiveandreliable resultsforthedatacenter.theirresearchusedmixedmethodstotakeexistingknowledge aboutthesnmpprotocolandmanagementsoftware,whilenewmethodswereproposed basedupontheseexistingmethods.thealgorithmwastestedonalargeclusteratcarnegie Mellontotestfunctionalityandscalability.TheirimplementationutilizedSNMP,whichis oneofthemostubiquitousprotocolsavailableformonitoringpurposes.thefocusoftheir algorithmwastoassistinandfurtherenhancetheconfigurationportionofmonitoring,the reasoningalgorithmusedtodetermineifaneventisanomalous,andthestorageofthe historicaldata.theresultsoftheirstudyincludedresultsthatwerenotonlypositive,but exceededwhattheyfeltweretheirgoalsintheproject.theirresearchwasrelevanttothe topicofthisthesisinthatmanagementandmonitoringarecrucialaspectstoadatacenter. Al Fares,Loukissas,andVahdat(Al Fares,2008)discussedthoroughlytheneedforScalable interconnectivityinclusters,economicavailability,andbackwardscompatibilitywithlegacy protocolsandsystems.theirprojectaddressedaconcernforconnectivityinhierarchical networkswherebandwidthiscrucialandexpensive.thepurposeoftheprojectwasforthe teamtointroducetheproblemtothenetworkcommunityandproposeaneconomic solutionthatutilizedexistingequipmenttosatisfybandwidthneeds.theirsolutionwasa technologycalledfat tree,whichsegregatesthenetworkinto Pods andtwo levelrouting thatallowslookupsformulti pathrouting.theprojectimplementednewcodeontoexisting routersandswitchesthathelpedandallowedthemtoperformthetwo levelroutingand 6
13 lookups.theimplementationandtestingofthistechnologywassuccessful,howevernot ideal.thecore switchinglayercanbecomecongestedduetocollisionandroutingdecisions madebytheroutersdownstream.theotherresultthatwasnotoptimalwasthenumberof cablesrequiredtocreateameshtopologyforthenetwork.thisprojectvisitsaunique problemthatoccursindatacenters.theneedforscalablebandwidthforinterconnectivity isstillnotascapableastheclustersandtechnologythatisavailableforusage. (Sharma,2008)addressedtheimportanceofcooling,power,andcomputinginaDataCenter withtherecentchangestoserverequipmentanddesign.sharma,shih,bashandpatel describethechangesinserverhardwareandthatithasbecomemoreandmoredenseand powerfuloverthelastdecade.thishascreatedahigherlevelofnecessaryresources availablefortheseserverstooperatesuccessfullyandefficiently.toaddressthisissue,the groupfromhewlett PackardproposedacontrolenginetocreateaDataCenterthatcan throttleandchangeitsrequirementsforcooling,powerandcomputing.theauthorsalso discusshowthissolutionvariesfromtraditionaldatacentermethodologyinthateachgiven areainadatacenterissegmentedfromothersviacontrolengines.thethreeareas(power, Cooling,andComputing)canbethrottledupordownbasedoffalgorithmsthattheauthors havespecified.ifahigherdemandisnecessaryforonesection,otherscanthrottledownto allowresourcestobedistributedtotheotherworkloadareasinthedatacenter.theyalso discussedthatthethreeneededtobemanagedasanensembleandnotseparateentitiesfor benefitstobeobtained.theoutcomeofthisprojectwastherealizationthatenergy consumptionandflowswillcontinuetobecriticalindatacentersandthatthemanagement ofthesecommoditieswillbecomemoreandmoreofafocusduringthedesignofthedata Center. 7
14 3 Background Inpastimplementations,manydifferentgroupsfromdifferentexpertiseandbackgrounds havedesignedthevariouscomponentsindatacenters.eachdifferentgrouphadanichein theirrespectivefieldandcompletedtheirinstallationbasedoffofinformationthatwas providedtothembytheprojectmanagerorleadoftheproject.serverrequirementsinthe pastweremuchdifferentthanthatofserversandequipmenttoday.theequipmentwas morebulky,andmostsystemsdidnotresideinrackcabinetsoftoday sstandards.most systemscalledmainframeshadentirecomputerroomsbuiltaroundthemrequiringhigh amountsofpowerandhvacsystemsforoperation.theirfunctionwastoprovidehighly processorintensivecalculationsforanorganization.theyalsoallowedforhighdatatransfer andmulti clientconnectionasthedevelopmentofthesesystemsprogressedthroughthe years.someofthemostwellknownofthesesystemswerebuiltandinstalledbyibm (Mainframe.)Thecomponentswerenotasdemandingincomparisontotoday sdatacenter ascomputingpowerwasneitherhighlycondensednorscalable,butthepowerandhvac requirementsofthesemainframeswereuniqueandrequiredspecialdesignsfor implementation.computershaveadvancedconsiderablysincethepeakofthemainframein the1980 sandmanysystemshavebeenreplacedforserversystemswithinthesamerooms ordatacentersthatoncehousedtheselargemainframes(mainframe.) Asthedemandfortheclient serverbasedarchitecture,theinternetandindividual computershasgrownexponentiallyinthepasttwodecades,theneedtodeploysystemshas alsoincreased.whilethesenewersystemsdonothavethefullcomputingpowerthat comparablemainframeshave,theirfootprint,technologicalflexibilityandlowerindividual costcreatesalargedemandthusmoreandmoreserverswereimplementedinshort amountsoftime(diminico.)withfurthertechnologicaladvancetheseserversnowcanbe placedinracksthatcanhouseasmanyas50serversperrack.theirfootprintcondensesthe heatoutputandelectricalintake.withthismanysystemsinasinglerack,onecanclearlysee thechangesandstressthatinfrastructuresnowplaceonthesameenvironmentalsupportof 8
15 thesedatacentersthatwereoriginallydesignedformainframeusage.becauseofthese changes,manyorganizationschoosetoredesign,rebuiltorstartfreshwiththeirdata centers. Asenvironmentsarere built,ithasbecomeanorganization sabilitytoplanforthescalable futureofitsinfrastructure.fromtheexperiencecompanieshavegainedfromconversionof mainframetoserverclustersandimplementations,itcanbeexpectedthatthetrendof higherpowerinasmallerlocationwillcontinue.thiscreatesuniquerequirementsfor electricityandhvacsystem,whicharethetwomostcriticalenvironmentalfactorsinadata center(alger.)planningforthesetwosystemsmustprovideadequatescalabilityforatento fifteenyearperiodinregardstoanorganizationalgrowthoutlook. Inthepastdatacenterimplementationsindividualsresearchcomponentsduringtheproject. Componentsareresearchedonaneedtoknowbasisandsolutionsareprovidedbythese individualsorbyspecializedthirdpartycontractors.individualswiththeunderstandingofall facetsofthedatacenterarehardtofindandcanchargehighratestouseforconsultation. Informationforindividualsororganizationstocompleteaprojectofthisnaturehastypically beendispersedinmultiplelocationswithinbooks,internetarticlesandpersonal experiences.havingthisinformationavailableisalargetoolthatcangreatlyassistinthe planningofthedatacenter.havingtheinformationavailable,inonelocationand understoodbyanemployeeorgroupofemployeeswithinanorganizationcanonlyassist withtheplanningandallowforabetterprojectoutcome.thisisanimportantpieceinadata centerprojectandisafocusofthisresearch. 9
16 4 Research Design and Methodology Inthissection,anapproachtoacourseofferingfeaturingdatacenterdesignandenterprise networkingispresented.theapproachthattheresearchfollowedwasbasedonthe compilationofvariousinformationsourcestoprovidecoverageofcrucialdatacenter componentsincoursepresentations.alsopresentedistheconfigurationofatestsystemto showstudentsvarioustoolstoutilizeformanagement.section4.1providesassumptions andlimitationsforthediscussedportionsofresearch.theremainingsections4.2and4.3 discusstheapproach,andexplanationoftheresearchandtestsystem.insection5,the deliverableresultsarepresented. 4.1 Assumptions and Limitations Thisresearchdoesnotintendtospecifythatthetopicscoveredbythespecifiedcourseare theonlysolutionavailabletoorganizationsorcustomers.thereforeitisassumedthatthe researchwillbeappliedgenerallytoorganizationsasawaytoensurethatallcrucial componentsarecoveredandtoprovideassistancewhereweaknessesinaspecifictopicmay exist. Itisalsoassumedthatwhilebrandnamesmaybeutilizedwithinthematerialofthecourse, therearenorecommendationsimpliedbythisresearch.thestudentororganizationshould decideequipmenttypesbasedoffofinternalpartnershipsandvendorsandalsowhich equipmentfitstheirprojectorenvironmentoptimally. Itcanalsobeassumedthatbyhavinginformationinasinglelocationbeingthecourse,less timewouldbespentresearchingandpollinginformationfromdifferentresources.itisalso assumedthatbyutilizinglesstimeperformingresearchtounderstandtopicfundamentals, 10
17 theindividualcanthenspendmoretimelearningintricatedetailsandsolutionstoachievea bettersolutionforthatdatacenter. Anotherassumptionforthisresearchisthatthefundamentalsofbasicnetworking technologieswillbepriorcovered.coveragesuchasthetcp/ipprotocols,basiccomputer networking,interconnectivityandbasicadministrationresponsibilitieswillnotbecoveredby thisresearch,butwillbenecessarytounderstandsometopicsoutlined. Therearevastdifferencesinorganizationsandcustomerneedsthatwillnotbemetbyall aspectsofthisresearch.manysolutionscomprisedwithcomponentswillfitafew customers needs;howeveroverallnotallsolutionsprovidetheanswertoalldatacenter projects.crucialcomponentsinrelationtothedatacenterwillbecovered,andbasedoffof thesecomponentsafunctionaldatacentercanbeachieved. Theidealcourseofferingregardingdatacenterdesignandnetworkingcoverseachfacetof thedatacenterfromtheoutsidebrickandmortartotheindividualpatchcableconnectinga serveruptoapatchpanelwithinarack.therearemanyreasonsthatacourseshouldcover allofthesedifferenttopics.thefirstandforemostreasonisthatwithinadatacenter,all componentsmeshtogethertocreateafullsolutionthatisaimedatprovidingandprotecting digitalinformation.eachdifferentpartofthedatacenterplaysakeyroleinaccomplishing thattask.ifonecomponentisarchitectedorimplementedinawaythatdoesnotsuitthe datacentercorrectly,itcouldcompromisetheintegrityandreliabilityofthatdigital information.anotherreasonthatcomprehensivecoverageisimportantisthatwithoutthe fullunderstandingofhowcomponentswork,anorganizationmaybeunabletocreatea scalabledesignthatwillfitthegrowthandfinancialneedsiftheorganizationoveraperiod ofyears.whilethisresearchwillcoveralargeamountofinformation,itwillnotencompass thefulldatacenterprojectfromstarttofinishasoutlinedabove.theprojectwillfollowa setofdeliverablesthatisshowninfigure1below.thesedeliverableswillbediscussedinthe resultssection,butothertopicsinrelationtothecoursewillnotbediscussedforresearch 11
18 timeconsiderations.thesedeliverablesarespecifictotheritenvironmentanddonot outlinegeneraldeliverablesforallcoursedevelopment. Deliverables Comprehensivelistofcoursetopics ICCform Textbookchoice ListofCasestudies LectureSlidesfor½ofcourse(5weeks) Figure1 4.2 Research Methodology Tocompileinformationthatwillserveagoodbasisforacourseofferingfordatacenter designandnetworking,coverageofkeycomponentsneedstobecoveredtooffer informationthatstudentscanutilizeasabaselinefortheirunderstanding.thissectionwill explaintheprocedurestodeterminethesekeyareasfortheresearch. Thecoursewillbedesignedaroundbuildinguponthecoreservicethatitwillprovidewhich isdata.thenetworkisthefirstcomponentthatshouldbethoughtofduringthedesignof thedatacenter.whilethephysicalspecificationsofthedatacenterareindeedimportant, withoutanetworkdesign,theremainderofthelayoutmustbemadepriortothe understandingofthedatarequirements.thephysicalconsiderations,whichincludethesite, theelectricalsystems,hvacsystems,physicalsecurity,firesuppressionsystemsand flooring,shouldbedesignedandimplementedutilizingspecificspecialiststhatunderstand minutedetailsandspecificationsofthosecomponents.duringthecourse,keypointswillbe re enforcedtoprovidealevelofunderstandingsurroundingthesedifferentareasof complexinfrastructuredeterminedduringthecoursedevelopment. 12
19 Itcanbeseenintheparagraphabovethatthereisanimmenseamountofdatatobe compiledtofullycompleteaprojectofthisscale.section1makesthestatementthatthere isalotofinformationavailableregardingthesetopics,andlikewisefulfillingthesolutionof centralizingthoseresourcesforstudentswillbeastrongfocusoftheresearch. Astherearemanydifferentcomponentsthatareimplementedintoadatacenter,alltopic coveragewillbecompiledusingthesamedefinedmethods.consistencyfortopiccoverage depthwillalsobeutilizedtoensurethatinformationisportrayedallowingenoughtimein thecourseforadequatecoverage.topicdecisionswillbebasedoffofthecoursetextbook offerings,andindustrystandardcomparisons.thetelecommunicationsindustry Association s(tia)documenttia 942isanIndustrystandardforDatacenterdesign.Its topicswillbereviewedasasourceagainstthetextbookforcoursetopics.eachtopicwillbe researchedforitsbackground,differenttypesoftechnology,andimplementationintoadata center,componenthardeningforreliabilityandredundancyandexamplesofthegiven component.thisinformationwillbecompiledfromvarioussourcesprovidingacceptable informationbasedoncomparisonswithothersources,thecoursetextandindustry standards.providingadequatecoverageofeachtopiciscrucial,buttoextendthatcoverage toshowhowthecomponenttiesintothefullschemeofthedatacenterprovidesamore realisticapproach.thementionedstepswillbeutilizedforeachcomponentandwillthus provideequalunderstandingwhetherthecomponentisthemostcriticaloraddseaseof managementtothedatacenter. Toprovideabetterunderstandingforthecourseandforstudentstoreferenceinformation outsideoftheclassroom,acoursetextbookisnecessary.searchesonlineandthroughlibrary databaseswillbeutilizedtolookforasolutionthatprovidesthebestcoverageandinsight intoalloftheresourcesmentionedabove.thetextbookwillbecomparedtoothersources fromresearchandbasedonthebestcomparisonthebookwillbechosen.topicstobe concernedwitharedepthofknowledgeportrayedinthesource,numberoftopicscovered, relevancetodatacenters,casestudypresenceorpersonalinsight,anddateofcoverage. 13
20 4.3 Test System Design Todiscussandprovideinsightofdifferenttoolsutilizedincertainlecturepresentations,aset ofsystemswillbecreatedwithtoolsinstalledfordemo.thetoolsinstalledontothedemo systemsaretoolsthatarecommonlyutilizedbydatacenteradministratorstoprovideease ofdutiesonadailybasis.toolsassistadministratorsdailywithoperations,monitoring,and recordkeepingofassets,events,andlogicaldataensuringthatreproductionofsystemsand designscanbecompletedintheeventoflossordisaster.thesetoolsarealsocommonly utilizedtoproviderecordkeepingandchangemanagementofthenumeroussystemsthat arehousedwithinthedatacenter.toprovideexamplesofthesetoolsduringlectures,a systemcomprisedofwindowsxpandanotherpartitionwithadistributionoflinuxcalled CentOS5willbeutilized.ThesesystemswillbebuiltonaVMwareworkstationplatformto allowfortransparentusageduringlectures.avirtualplatformallowsforsoftwaretoolsto remaininstalledwhilechangesaremadetothesystemthatmayjeopardizetheir functionality.quickreversioniscapablewhichprovideseasyfixestomodelsoftwareduring classes. 14
21 5 Results Forthisresearch,informationwascompiledandcentralizedtoprovideresourcesfor studentstounderstanddatacentercomponents,designstepsandnetworking.the informationwillalsoallowstudentstounderstandcommonserviceswithinthedatacenter environmentsuchasreplacinganddesigningrackstobeutilizedco existentwithother systems.studentswillbeabletodesignnetworkingcomponentsfromthelowestrack cabinetwithinthenetworkhierarchyuptotheserviceproviderlevel.toprovideadequate understandingofmaterialscovered,asetofdeliverableswassetforthintheproposalofthis projectandisprovidedinfigure1.thesedeliverableswillbediscussedwithinthisresults section.thecourseproposedtextbookwasthefirstdeliverablediscussedtoprovidea locationforstudentstoreferencematerial.thisdeliverableisdiscussedinsection5.1and providesthetextbookchosenfromtworeputablesources.acomprehensivetopiclistwas alsocreatedtoprovideahighleveloverviewofwhatwouldbecoveredinthiscourse.this topiclistwillbecoveredinsection5.2andalsocanbefoundinappendix8.1underthe coursetopicssection.aselectionoffivelecturepresentationsispresentedtoprovide contentcoverageandmaterialexpansioninrelationtothecourseobjectivesandtopics. Thesepresentationsarecoveredinsection5.3andalsoareshownintheirentiretyin appendix8.3.theremaindersofthedeliverablesoutlinedincludehalfofthemidtermand finalexam,whichisincludedinappendix8.4and8.5.alsoincludedisthedepartmentalicc form,whichhasbeencompletedandprovidedasappendix Course Textbook ThecoursetextbookwaschosentobeBuildtheBestDataCenterFacilityforyourBusiness bydouglasalger.thebookbydouglasalgerwascomparedtoenterprisedatacenterdesign andmethodologywrittenbyrobsnevely.bothofthesebookscoverthemajorityofdata Centerdesignandnetworking,butAlger sbookcoversbetterin depthmosttopicsandalso 15
22 injectspersonalexperienceintoeverychapterofthebook.snevely sbookpertainsmoreto theup frontinformationanddoesprovideabetterinsightintonationalbuilding,fireand electricalcodes.informationfromrobsnevely sbookwillbeutilizedintothelecturesand willbeprovidedasanoptionalreferenceasthebookhasbeenreleasedasafreepublication fromsuncorporation(snevely.) Anotherdifferencebetweenthetwobooksistheusageofdiagrams,mathematical calculationformulasandcomparisonsbetweentechnologies.theseareallimportantfactors whenbuildinganddesigningadatacenter.theorganizationorcustomerneedsto determinethecorrectmaterialsandsizesthatwilloptimallyfittheirdatacenter.differences betweenproductsmeancostsavingsorincreases,whichultimatelyaffectsthebudgetofthe datacenter.instillingtheabilitytoperformthecalculationsanddesignspermitsfaster designtimesandalsoallowsforverificationofbidsestimatedbythird partycontractors. Thisisanimportantcost savingsapproachtoensurethatthesolutionisgearedexactly towardstheorganizationalrequirementsandgoalsoftheproject.itmaybefoundthata solutionrecommendedorputinplansisnotadequatefortheenvironmentorinopposite cases,ismuchtoolargefortheenvironmentfortheorganization sgrowthscale. Diagramsutilizedinthecoursetextbookallowsforstudentstovisualizeconceptsthatare beingdescribedwithinthechapters.agivenexamplewouldbeexistentinthedescriptionof airhandlerplacement.whilereadingabouttheplacementofanairhandlerperpendicularto rowsofserverracksprovidesmaybeaninsightastudentmaynothavepreviouslyknown,it doesmaynotdepictaclearunderstanding.placingadiagramthenrepresentsanexampleof theairhandlerandallowsdifferenttypesoflearnerstounderstandthesameconcepts visually.alger sbookutilizesdiagramsmoreeffectivelyforconceptsandmaterialsthat shouldbeunderstood.thisprovidesabetterplatformforstudentstounderstandthebasic conceptsandcomponentsfordatacenterdesignandnetworking. 16
23 5.2 Topic Design Thecoursetopicsweredesignedbasedoffofthecoursetextbookandcomparisonswiththe TIA 942standard.Whiletherearemultipledifferenttopicsandcomponentsthatmakeupa datacenter,majorsectionsofthedatacenterwillbecoveredtoprovidethefeasibilityto supportabasicdatacenter.thetopicsthatarediscussedindepthinboththeindustry standardandthebookareshowninfigure2below.thesetopicswerethemostprevalent topicsinthetwosourcesandhavebeenreviewedbymanyinindustry.togetherthese topicsprovideover80%oftheinfrastructurepresentinadatacenter.thetopics themselvescontainsub topicsthatallowsforabetterbreakdownofexplanation.thesesubtopicscanbefoundinappendix8.1. Withthetopicsdetermined,overallcourseobjectivescouldbegintobesetforth.While manyofthesearegeneralized,theypresentthegoalsthatstudentsshouldbelooking towardsattheverybeginningofthecourse.attheendofthecourse,studentsshouldbe abletofulfillthecourseobjectivesoutlinedinfigure3below.thesecourseobjectiveswill aimtoassiststudentsinunderstandingandfocusingonkeycoursematerialofthecourse. Theyalsoservedtoprovideguidanceduringtheresearchperiodsofthisprojectto determinewhatpiecesofmaterialwererelativetothecoursedevelopment. Cabling/Networking HVAC Electrical Redundancy Management SiteDesign Security DisasterRecovery Figure2 Identifyandunderstanddifferententerprisenetworkfundamentals. Understandthefundamentalprocessesandproceduresofplanning,anddesigninga complexdatacenterand/orenterprisenetwork. Defineresourceneedsofadatacenterandnetworkneeds. 17
24 Describethedifferentcomponentsinanenterprisedatacenterandprovide recommendationstoothersaboutthesecomponents. Design,plan,manageandimplemententerprisedatacentercomponents. Compareexistingsolutionstodeterminewhatwillfulfillthedefinedneedsofthe customerororganization. Understandhierarchicalnetworksandtheirimportanceinscalableandsuccessfuldata centersandenterprisescenarios. Writecleardocumentationthatallowsbettermanagementofimplementedsolutions. Figure3 18
25 5.3 Topic Expansion Thetopicsthatwerechosenwerethendevelopedintocourselectures.Theselecturesare presentedinawaythatrampsthestudent sunderstandingofcomponentsfromthe individualcomponentuptotheirfullintegrationinadatacenter.asoutlinedinsection4, thebackgroundofthecomponentiscoveredofeachtopicandthenthedifferentoptionsof thetechnologyarepresented.afterthecomponentisdiscussedasitself,thecomponentis thendiscussedasitsintegrationtothedatacenterandwhyitisimportanttothedata center.waysforthecomponenttobemeshedintoahighavailabilityorredundancystate arediscussedandthensecurityimplicationsinregardstothecomponent.highavailabilityor redundancyistheabilityforagivencomponenttoremainonline,stable,andavailablewhen it sotherhalforanotherportionofthecomponenthasfailedorisdownformaintenance. Thistermiscommonlyusedwithindatacentersbecauseofthedemandforservicestobe available24hoursaday.manycomponentsarethusdesignedtoprovidesomeformof redundancyorhighavailability.thisisafeaturethatisdiscussedwithineachofthetopics fromfigure1above.tofinalizeeachcomponent,examplesordiagramsarereferencedto showthecomponentinanactualsetting.somecomponentswillbediscussedwithrelation tocasestudiesandstoriestoassistwithkeypoints Network Design Coveringthedifferenttypesofnetworkingthatoccurswithinthedatacenterandhowto designanetworktobeutilizedinadatacenterwasthefocusofthislecture.byfarthedata networkisthemostcriticalcomponentforserviceoffering,transfersbetweendifferent systemsandforstorage.whilethereasonswillbediscussedlaterinthissection,thedata networkprovidestheabilityforserverstoperformworkandalsotoprovideresults,data, andservicestoendcustomersand/orothersystems.datacentersusenetworking componentssimilartoothertypesofnetworkingenvironments;howeverthedifferencelies inthehardwaredevicesthatinterconnectsystemsandthewaythatthenetworkhierarchyis designed.therearealsotypesofnetworksthatarepredominantlylocatedinthedata 19
26 center,whichprovideuniqueabilitiestoothersystems.thesetypesofnetworksare referredtoasstorageareanetworks.theremainderofthissectionwilldiscussthislecture anditscomponents. Oneofthemostimportanttopicstobediscussedwithinthislectureisthenetworkhierarchy thatisusedwithinthedatacenter.thethreetiersthatarefocusedonarethe edgelayer, the distributionlayer, andthe hostoraccesslayer (Oppenheimer.)Theselayersprovide meanstosegregatetrafficflowandtoallowresourcestobeprovidedinahighavailability mode.discussedwillbethedifferentprotocolsutilizedatthedifferenthierarchiesofthe design. TheedgelayerofthenetworkprovidesthefirstlayeredaccessfromtheInternetservice providertotheinternalnetworkofthedatacenter.thislayerisutilizedwithprotocolssuch asbordergatewayprotocol(bgp)andenhancedinternalgatewayprotocol(eigrp)to providefailovertoleranceandalsotoprovidethebasicserviceofroutingtrafficonthe Internetamongdifferentautonomoussystems(Snevely.)Thelayeralsoprovidesthe locationwherethemajorityofthedatacenter sroutersarelocated.theyusuallyprovide aggregationfrommultiplevendorsandcouldprovideahigherlinkspeedtoproviders. Thedistributionlayerallowsnetworktraffictobetransferredtodifferentsub networks, customers,andin houserequirementsandtoprovidedifferenttypesofnetworkresource allocations(kerr.)thedistributionlayerisalsotheprimarylayerwheretrafficfiltering occurs.thisactsasawaytokeepcertaintrafficfrompollutingthenetworkbandwidthand alsohelpstolimitbroadcastandmulticastdomains.thedistributionlayerutilizesamixture ofroutersandswitchestosegregatedifferenttypesofnetworktraffic,whileallowinglower branchesofthehierarchydifferentaccesslevelstotheinternetoredgelayerservices.the distributionlayerisalsoconsideredthegatewaylayerasdifferentrouterscommunicate withinthislayerutilizingprotocolssuchasospf(openshortestpathfirst)orrip(routing InformationProtocol)tocommunicatenetworkinformation.Hostswithintheaccesslayer 20
27 utilizegatewaysinthedistributionlayertoaccessresourcesbasedontheirclassification. Thelecturecoversthislayeranddenotesdifferenthardwaretypesanddiagramstoshow howconnectionscouldexist. Thehostandaccesslayeristhethirdandlowestlayerwithinthenetworkhierarchy.This layerprovidesdifferentnetworkingcomponentssuchasswitching,hubs,firewalls,and occasionalrouters.theprimaryfocusofthislayeristoprovidetheconnectionfromtheend device,intothedatacenternetwork.attheaccesslayer,separatenetworksmaybefound thatdonotconnectsystemstothedistributionlayerandedgelayer.thesenetworksmay providestoragefeatures,andtransportfrombackendsystemstosystemsthatconnectto theaccesslayer.thesenetworktypesserveastheremainderofthelectureforthatclass period. StorageAreaNetworks(SAN)andprivatenetworksmakeupthemajorityofothernetworks withintheaccesslayerofthenetworkhierarchy.sannetworksprovidestoragesolutions overtraditionalnetworkingmediums.thesestoragesolutionstypicallyaresharedstorage thatcanallowmultiplesystemstoaccessthesamestorageatthesametime.systemscan accessthesestoragecollectionsovertraditionalhardware(networkinterfacecards,fiber Cards,HostBusAdapters),whichallowsforlowercostimplementationandredundancy.This topicwillbediscussedinaseparatelectureinfurtherdetail,butthenetworkportionofthe technologyshouldbearchitectedinawaythatprovidesmultiple(2ormore)connectionsto thesystemforredundancyandhighavailability.privatenetworksprovidedatatransfers acrossbackendsystemstofront endsystemswithoututilizinglimitedbandwidth.these networksusuallyareimplementedtoprovidebettersegmentationandcanalsobeutilized formanagementpurposes(alger.) Thefinalportionofthiscomponentistodiscusstheneedfornetworkredundancy. Redundancywithinthedatanetworkcanoccurinmanydifferentways.Itcanoccuronthe hostlevelwithmultipleportconnectionstoswitchesorhubs,oritcouldbeastransparent 21
28 asrunningmultiplerouterswithintheedgelayerutilizingthehsrpprotocol.althoughthe HSRP(HotStandbyRouterProtocol)isaCiscoproprietaryprotocol,itcanbeutilizedwith differenthardwarevendorsandsystemsandcanprovidetransparentrouterredundancy withinthenetwork.redundancyincreasestheoverallavailabilityofthenetworkto customersandserversthemselves.theoverallgoalistocontinueserviceintheeventone serviceprovider,onecable,ornetworkportfails.therearedifferentrequirementsfor availabilityofthenetworkindifferentdatacentertiers.thesetierswillbediscussedwithin depthduringthelectureandwillprovidestudentswiththeunderstandingthatwhatever datacentertheirorganizationfunctionstheyshouldbeawareofnetworkavailability Electrical Electricalinfrastructureandconfigurationisalsoacrucialcomponentofadatacenterasit providesthenetworkhardware,servers,hvacsystems,andlightswiththenecessaryenergy tofunction.thislecturefocusesonthediscerningofdifferentelectricalspecificationsaswell astheinfrastructurethatisnecessarytoprovideaconsistent,reliableandscalableelectrical infrastructureforthedatacenter.itwaschosenasakeytopicbecauseofitsimportancein theoveralldesignofthedatacenterandbecauseitisusuallynotfocuseduponby individualswithnetworkingbackground.thegoalofthelectureandthistopicistoprovide studentswiththeabilitytoanalyzeinformationpresentedtothemaboutelectricaldesignin thedatacenterandtobeabletocalculateneedsforpowerrequirements.overallthemost criticaltopicregardinganelectricalinfrastructureistheredundancyandstandbypower offering.thisisnottheonlysectionofelectricalinfrastructurethatiscovered;howeveritis themostcrucialtoprovidinghighavailabilitywithinthedatacenter.similartoredundancy inthedatanetwork,electricalredundancyfocusesonprovidingmultiplecircuitriesthatcan servesystemsanddevicesintheeventofafailedcircuit,electricalproviderorstandby system.thisbecomesanimportanttopicwhendiscussingdifferenttypesofelectrical power.thereisalargedebatesurroundingalternatinganddirectcurrentelectricalpower andbecomesforefrontduringthediscussionofstandbyandredundantpower.thereisa 22
29 lossofelectricalpowerbetweenacanddcpowerduringconversionwithinuninterruptable powersupplies(ups). Voltageselectionbecomesadebateinmanydatacenterenvironments.Manyexperts believethatdirectcurrentisabettersolutionthanthattoac(rasumussen.)thislecturewill coverthedifferencesinbothtypesofelectricalpowerandwilloutlinethebenefitsand drawbackstoboth.theclasswillultimatelybeabletodecidewhichtechnologyisbetterfor thedatacenter.aslidewithinthelectureshowsthecomparisonofthesetwotechnologies andthedifferentfinancialimplicationsforeithertechnology.althoughpreferenceisafactor inthedecisionprocess,costtotheorganizationorindividualusuallyisthewinningfactor. Thissectionwillprovideuniquediscussionandwillreflectuponpersonalimplementations fromstudents,andthebook. Anothertopiccoveredinthislectureistheabilitytoforecastandprovideadequate electricityforthedatacenter.therearemanytoolstoutilizeforthisandmanytoolsranging fromgovernmentprovidedtoolstoindividualproprietortoolswouldbediscussed.manyof thesetoolsutilizekilovoltamperageasthemetrictodetermineneed,asitallowsforan industrystandardtodevelopsolutions.theabilityforanorganizationtounderstandtheir requirementsandforecastneedscanattributetoascalableinfrastructurethatwillprovide longevityinreturnsfrompurchasedequipment.scalableinfrastructurealsolowerscost overallbycreatingmeansforanorganizationtoaddcapacitieswithlittleoverheadcosts.an exampleofscalabilitycoveredinthelecturesistheadditionofcircuitpanelsthatleaveroom forextracircuitstobeallocatedforrackspace,networkdevices,andhvacsystems.whips aredefinedascablingthatisrunfromcircuitpanelstotheendsystemforconnectiontothe electricalsystems.thesewhipsusuallyarecomprisedofasingleordualcircuitthatdoesnot shareitselectricalloadwithothersystems.thisusuallyconsumeselectricalcircuitsatafast ratebecauseofdedicationtoindividualsystems.theabilitytoforecastandimplementthe capabilitytocontinuesupportingsinglecircuitwhipswhilemaintaininghealthyelectrical 23
30 loadsconstitutesgoodforecastingfromadesignstandpoint.examplessuchastheseare coveredwithinthelecturestoprovidebetterinsightfortheimportanceofscalability. Thelastsectionthatisimportantforelectricalsystemswithinadatacenteristheabilityto sustainpowerintheeventofpowersourcefailure.therearemanydifferenttypesof solutionsthatcanprovideadatacenterwithmeansofelectricityintheeventofan extendedoutage.someofthesesolutionsproposeutilizingbatterysystemstoensurecritical systemsremainonlineduringtheoutage.thesesystemsprovidealimitedextensionof electricity,asbatterycapacitiesaregenerallynotasextensiveasothersolutions.ensuring thatthereisatleastathirty minutewindowforadministratorstoprovidetriagetosystems isagoodmeasurementtoscopebatteryimplementation.anothersolutionforbackup electricityisforagenerator.thesegeneratorsusuallycanprovideelectricalmeansforadata centertoallowsystemtoremainonlineforhoursandevendays.manyofthesystemsutilize typicalfossilfuelsasdiesel,naturalgasorgasolinetogenerateelectricity.thesesystems shouldhaveagreementswithfuelprovidersintheareatoguaranteeprovisionsintimesof outages(tia 942.) Manydatacentersuseacombinationoftheabovesolutionstoprovideafullyredundant systemthatcanallowthedatacentertoremainindependentofthirdpartelectrical providers.whetherthesystemisbatteryorgenerator,itshouldbescaledlargeenoughto powertheentiredatacenterintheeventofanoutage.thisassiststoensurethedata center sslatocustomersandincometotheorganizationisnotlostduetodowntime. Thesetopicswillbefullycoveredwithinthislecture,andtheabilityforstudentstoreflecton experienceswilladdtothediscussionofelectricalimportance HVAC Systems Thislecturewilldiscusstheimportanceofheating,ventilationandairconditioning(HVAC)as itrelatestothedatacenterenvironment.ensuringthattheserversandotherequipmentof thedatacenterfunctioninaconstanttemperaturewithcorrectamountsofhumidityisa 24
31 keycomponent.fluctuationswithintheenvironmentcancauseequipmentfailuresandin certainscenarioscausedamagetodata.becausethisisatopicthatisalsonotcoveredin depthinmanyoftheothertypesofclassestakenclassicallybyindividualsofnetworking background,thistopicwaschosenasafocusforalecture.thegoalistoprovidestudents withthecapabilitytomakeconsciousdecisionswithintheirdesignplansandtoalsohave theabilitytocriticallyanalyzedesignsproposedbythirdpartyproviders.thebiggest componentwithinthehvacsystemofadatacenteristhecoolingcomponentsasbynature computersgenerateheat.handinhandwiththehvacsystemisthewaythatthedata centerhandlesairflow.thisishandledwiththeinstallationofoverheadorunderfloorair plenums,whichprovidesupplyandreturnairtothehvacsystems.theseplenumsarethe areawithinthedatacenterwhereairflowandpressureoccurstoprovidetheairflow necessarytoregulatetheenvironmenttemperature. Inpastgenerationsofhardware,temperaturecontrolwasveryimportantintheoperationof thedevices.ifthedevicebecametoowarm,stabilityofthedevicewascompromised (Sharma.)Thesedeviceshavesincebeenrevisedandimprovedtooperateintemperatures thatarewarmerandcanallowthesystemstoremainstable.ithasbeenestablishedin industrythattemperatureswithintherangesof64degreesto81degreesfahrenheitare acceptabletemperatures(tia 942.)Thisismainlytoprovidecomfortabletemperaturesfor employeestoperformworkwithinthedatacenterandisnotlimitedbecauseofdevices. Asmentionedearlier,themostimportantfacetoftheHVACsystemisthecoolingsystem (Alger.)Therearemanytechnologiesthathavebeencreatedtoensurethatsystemscan remaincool.thesesystemsdiscussedthoroughlyinthelectureslidesinappendix8.3.3will assiststudentsrealizethatnotonlyaretheredifferenttechnologiesavailable,butthat certaintechnologieswillworkbetterinvariousgeographicallocations.different technologieswillalsoofferdifferentlevelsofredundancytoprovidecontinuouscooling capabilitiestothedatacenter.somesystemsaswillbediscussed,providecoolingtothe datacenterthatisfreeandprovidesmonthsworthofcostfreeenvironmenttemperature 25
32 regulation.thispresentslargecostsavingstotheorganizationforutilitybillsandpresents uniquedecisionstobedeterminedbythedesigner. RedundancywithintheHVACsystemprovidestheabilitytocontinuallyprovideenvironment regulationintheeventofsystemmaintenanceorsystemfailures.manysystemscannow utilizethesamecoolingtowersorcoolingsystemswhilemaintainingseveralbackend systems.thisallowsforfailoverwhilestillprovidingthesamelevelofservicetothe environment. Asdiscussedearlier,theredifferentdesignstodelivercoolingtothesystemswithinthedata center.oneofthesedesignswhichisunderfloorplenumwithreturnairaboveutilizesthe fanpowerofmanyserverstomoveairfromthegrounduptothereturnductsintheceiling. Thesedifferentapproachestodelivertheairarediscussedindepthwithinthelectureslides andprovideexamplesofwhatcanhappenifairisnotdistributedcorrectlyorevenly throughoutthedatacenter.tomitigatemanyoftheproblemswithhvacsystems,the lecturealsocoversdifferenttoolsutilizedbydatacenterstolocatepocketsofmismanaged airandthenmitigatetheproblembychangingairflowdesignswithintheplenum.thermal designprovidesthebestwayforsystemstoreceivecooledair;howevertheenddesign dependsonthefacilitythatisprovided.therearebenefitsanddrawbackstooverheador underfloordesigningeneral,butgiventherightscenario,bothsystemdesignscanbe beneficial. 26
33 5.3.4 Security Securityprovidesprotectiontoallsystemsthatsupportandexistwithinthedatacenter. Therearemanytypesofsecuritywithinthedatacenterrangingfromphysicalsecurityofthe premisestopersonnelsafetyandaccess.itwasdeterminedthatbecausethereissuchavast amountofdatasurroundingthistopic,thatitwouldbeagoodfocustocoverinalecture aboutitsintegrationintothedatacenter.thetopicwasalsochosenbecauseitinherently tiesbackintotheinfrastructuresystemofthedata,whichassistsinitsmanagementofthe datacenter.thegoalofthelectureisprovideinsightintothecrucialsystemssurrounding security. Physicalsecurityisthemostprevalentfeatureofadatacenter.Inmanyways,datacenters presentthemselvesassecurelocationsbyensuringhighqualitylockingmechanismsarein place,hightechnologyaccessvalidationsystemsareputinplaceandsurveillancesystems areprovidedtodetermaliciousactivityaroundandinternallytothedatacenter.different technologieswillbepresentedassolutionstothestudentsandbenefitsofthosesolutions willbeoutlined. Heatandwaterpreventionisanotherkeytopicdefinedbysecurityofthedatacenter. Withoutthesetwopreventionmechanisms,thedatacentercouldbevulnerabletofiresand flooding.thesetwohazardspresentuniquechallengestoovercomeinadatacentersetting. Typicallyfirepreventionsystemsareimplementedbyusingwatersprinklersystemstodouse fireswhentheyaredetected.withthelargeamountofelectricalcomponentswithinthe datacenter,itisdifficulttousewater,asalossofdataisalargerisk.alternatively,watercan presentchallengesbecauseitcouldshortcircuitelectricalcomponentsunderraisedflooring withoutnoise,orwarning.therearemanysolutionsthatareavailabletopreventbothof thesehazards.therearemanysolutionstopreventfiresthatarepresentedinthelecture slidesinappendix8.3.4.inverselysystemslikeawaterdetectionsystemareavailableto preventwaterdamagetoflooringsystemsandelectricalcomponents(alger207.)toensure 27
34 thatthesesystemsareworkingcorrectly,continuoussamplingmustbecompletedtoprotect thedatacenter. Thelasttopiccoveredwithinthesecuritylecturewillbetodiscusspersonnelsafetyitems. Therearemanydifferentitemswithinthissectionthatpertaindirectlytothedatacenter. Thebiggestofthesesectionsistoprovidepolicymanagementandenforcement.Thesetwo managementitemsprovideastructuralsensetoenforceruleandprovideinformationto othersofhowthedatacenterfunctions.thisisimportantforthirdpartyprovidersto understandwhentheyenterthefacilityandperformservicesforthedatacenter.ifpolicies arenotimplementedandenforced,controlandregulationofresourcesisnotfeasible.these differentpolicyitemsareincludedwithinthislectureandwillprovidethestudentswiththe abilitytosafeguardthedatacenterandthosewhoworkdailywithinthefacility. Anothersectiontobecoveredistheadherencetolocal,stateandfederalbuilding,fireand electricalcodes.thesecodesareimplementedtoprotectindividualswhomworkinthese facilitiesandtoensurethatdevicesandinfrastructureareinstalledwithmaterialswhose integritywillmatchstressputonthem.thisinformationwascompiledfromthenationalfire protectionassociation(nfpa),nfpa70(snevely.)thiscodeisalargereferenceforthose workingwithdatacentercomponentsandelectricalcomponents.thegoalofthissectionis toprovidestudentswithresourcestolocatecurrentcodesandregulationsasmanyfacetsof thedatacenterarestillundercodedevelopment Disaster Recovery Thelastlecturewithinthedeliverablesisalecturesurroundingdisasterrecoveryofthedata center.whilethistopicisonethathopefullyorganizationsneverhavetoutilize,itis imperativethatpreventionmechanismsbeutilizedandputinplacetodefendagainstdata loss.becausethistopicisauniquetopicinrelationtoadatacenter,itwasincludedasahigh focustopictobringawarenesstostudentsofitsimportanceindatacenteroperation.the goalofthislectureistoprovidestudentswiththeabilitytodesign,implementandmanage 28
35 disasterrecoveryinfrastructuresthatcanbeutilizedintheeventofaccidentaldatalossor disaster. Theprimaryfocusofthelectureistocoverthedifferentsolutionspertainingtobackup systemsinthedatacenter.solutionssuchasonsitetapebackupsandoff sitestorage solutionswillbediscussedprovidingthebenefitsanddrawbackstobothsituations. Solutionscomprisedofremovablemediaotherthanthatoftapesystemswillalsobe discussedandhowtheyfitintothedatacentertoday.off sitestoragesolutionswillbe discussedinrelationtotherotationalperiodsinwhichmediashouldbestoredoff site. Discussionstodeterminewhatsolutionsstudentshavetestedwillbeengagedtopromote informationsharing. Anotherimportantsituationthatshouldbenotedwithindisasterrecoverysystemsisthe wayfordatacenterstotestanddevisetestprocedurestoensurethatthesystems implementedworkinthewaysthatarespecified.manysystemscanbeimplementedwithin thedatacentertopreventdisasterfromoccurring,howeverifthesesystemsdonotfunction thewaythattheyweredevised,theyprovidethedatacenterwithnobenefit.toassistwith thesetestprocedures,documentationshouldbestoredinsecurelocationsoncontacts, emergencypersonnelcontactsandguidelinesonhowtorestorethefunctionalityofthedata centerintheeventoftotalcatastrophe.thelecturecoversdifferentfacetsofthedata centershouldprovideproceduresanddocumentationfortoensurethatstudentscanthen documentandprovidemeaningfulpreventiontoanydisasterthatcouldoccurwithinthe datacenter. 29
36 5.3.6 Tools Throughoutthecoursemiscellaneoustoolswillbepresentedtothestudentstoshowthe vastcapabilitiesthattheycanprovidefordailyadministrativefunctionsandthedesigningof adatacenter.thesetoolsprovidetherobustabilitytoforecastentiredatacenterpower requirementstothesimplicityofmanagingipaddressreservationsandsubnetinformation. AnexampleofsomeofthetoolsutilizedwithinthecourseisshowninFigure4.Thetoolswill bedemoedonavirtualsystemdiscussedinsection4.3.thetoolsthatwillbeshownalsoare opensourcetoolsorfreewareandcanbedistributedtoprovidefuturereference.the impactofthetoolsfortheadministratoristhattheywillshortenandsimplifymanagement tasks.anexampleofthesetoolsisthepowercalculatorspreadsheetthatisdistributedby thegovernmenttoassistwithcalculatingenergyneeds.ratherthantakeinventoryofall systemsmanually,thischecklisthelpstoestimateandforecastfutureneeds.thisprovides aneasierwaytoobtainquotesfromvendorsandwillcuttimetodevelopsolutionswithin theplanningstagesofthedatacenter. RackTables PassSafe Nagios DellRackCalculator ClockingIt.com SharePoint IPPlan LinkandSpeed TestingTools Figure4 30
37 6 Conclusion Datacentersprovidehugeamountsofrevenuefororganizationsandhostvastamountsof datathatiscriticalfororganizationstofunction.theirdesignandimplementationisan importantfeaturefororganizationsthusthisresearchisimportant.theproblemof providingacourseofferingforstudentssurroundingdatacenterdesignandnetworkingcan besolvedbyusingsolutionspresentedbythisresearch.studentsandorganizationsthat employstudentswithnetworkingbackgroundcanbenefitfromthiscourseofferingbecause itpresentsinformationthatallowsthemtodesignandmakedecisionsbasedoffoftheirown requirements.informationisplacedwithineasyaccessandprovidespersonalinsightthat canbeofassistancewhenconfrontedwithtechnologyorrequirementsthatmaynotbe clear.further,theresearchcoverstheneedtounderstandallfacetsofthedatacenter. Whileunderstandingsinglesystemsisanimportantskillsettohave,understandingthe integrationofmultiplecomponentstogetherallowstheindividualtohavebetterinsightof howthedatacentermeshestogethertoprovideservices.allfacetsofthedatacentermust meshtogethertoprovidetheworkingdatacenter.ifonesystemfails,theintegrityofthe datacenterisnolongeroptimal.thisiswhyredundancyisastressedimplementationwithin thedatacenter.withouttheredundancy,serviceswouldnotbeashighlyavailableasmany hostedserviceshavebecometoday.focusingontheredundancyandsolidimplementation ofdatanetworks,electricalinfrastructure,hvacsystems,andsecuritywillprovidethe meansforanorganizationorstudenttodesignandprovidesolutionsforacustomizeddata center. 31
38 7 Future Work Ithasbecomeatrendinrecentyearstoutilizevirtualcomponentstoprovideabetter scalableinfrastructurewithbetterserviceprovisioning.infutureresearch,attentionshould befocusedontheintegrationofthesevirtualenvironmentsintothedatacenter.ifthenew environmentcouldsupportandpresentvirtualredundancyaswellasphysicalredundancy,it thenwouldpresentann+1redundancythatcouldgreatlypreventfailuresandbolsterhigh availability.virtualtechnologymayalsobeabletotakeadvantageofthemultiplecore processingtechnologiesthusallowingforhighercondensationofresourcesintoasinglerack location.thiswillpresentnewscenariosfordatacenteradministratorstoovercome,asthe concentrationofresourceswillrequirenewelectrical,hvac,andnetworkresources.one couldassumethatvirtualtechnologywouldlowerthestrainondatacenterresources,but theconversionofagingsystemstonewerconcentratedsystemsmayactuallyincreasethe requirementsondata,electricalandhvac.furthermore,itcouldbeusefultodetermine howprimarilynetworkresourceswillbeimpactedastheserequirementswillbeeasily condensedintosystemstoprovidededicatedlinkstovirtualmachinesandtheclusteringof networkresourcesonsingleresources. Anewtypeofmodulardatacentersisaimingtoprovidemobilesolutionstofulfillcustomer needs.thesetypesofdatacentersincorporateallnecessarycomponentsofthedatacenter intoonelocationtoprovidevendorswiththeabilityofbuildingadatacenterinacontainer andthenshippingthatcontainertoalocationthatprovidesmodularconnectivity.thistopic couldbeutilizedinfutureexperimentstodeterminethetypesofinfrastructurerequiredto implementsuchadesignandtoalsotheimplicationitwouldhaveonthetopicsspecifiedby thisresearch(hamilton.) 32
39 8 Appendices 8.1 Course Syllabus CourseSyllabus EnterpriseNetworking 200CourseSyllabus REMINDER: The information presented in this syllabus is subject to expansion, change, or modification during the quarter Instructor: Name Office:Bldg.70 address: Office Hours: M:Orbyappointment. CourseTextandMaterials RequiredTextbook: DouglasAlger,BuildtheBestDataCenterFacilityforyourBusiness.CiscoPress,2005. ISBN: OptionalMaterials: RobSnevely,EnterpriseDataCenterDesignandMethodology.SunPress,2002 ISBN: ImportantRITDeadlines Last day of add/drop is March 16th. Last day to withdraw with a grade of W is May 1st The deadline for withdrawing from a course with a W grade is the end of the 8 th week of the quarter. Forms may be obtained from your department office and need your instructor s signature. NOTE: The department policy states that a student has one quarter to challenge any grade. After that, grades cannot be challenged. CourseDescription Thiscoursewillprovidestudentswiththeknowledgeandunderstandingtoapplydesign 33
40 techniquesandlogicalsegmentationtolarge scaleenterprisenetworks.theoreticalconcepts oflarge scalenetworkswillbediscussedandstudentswillcreatedesignsbasedonthistheory. Casestudieswillbeutilizedtohelpunderstanddifferentcomponentsandtheirimportancein theoverallscheme.thiscoursewillprovidestudentswiththeknowledgeneededtoapply availabletoolsformodelingnetworkfunctionalitytodeterminetheimpactofnetwork infrastructuremodification,devicereconfiguration,andtheimpactofnewapplicationrollouts. Design/casestudyprojectrequired. CourseObjectives General Attheendofthiscourse,studentswillbeabletoeffectivelyuseandimplementtoolsneeded forthemanagement,designandcreationofenterprisescalenetworksanddatacenters. Studentswilldevelopprocedurestoensurethattheintegrityofthenetworkisusableatthe requiredlevels. Specifically: 1.Identifyandunderstanddifferententerprisenetworkfundamentals 2.Understandthefundamentalprocessesandproceduresofplanning,and designingacomplexdatacenterand/orenterprisenetwork. 3.Defineresourceneedsofadatacenterandnetworkneeds. 4.Describethedifferentcomponentsinanenterprisedatacenterandprovide recommendationstoothersaboutthesecomponents. 5.Design,plan,manageandimplemententerprisedatacentercomponents. 6.Compareexistingsolutionstodeterminewhatwillfulfillthedefinedneedsofthe customerororganization. 7.Understandhierarchicalnetworksandtheirimportanceinscalableand successfuldatacentersandenterprisescenarios. 8.Writecleardocumentationthatallowsbettermanagementofimplementedsolutions. CourseOrganization MyCourses The course is organized by using RIT's mycourses platform. You are required to have a DCE account to access mycourses at mycourses.rit.edu. The mycourses is not only used by faculty to organize, create and manage the course activities and course materials, but also by students to communicate with peers and instructors, access the course content, assignments, course grades, group discussion and feedback. mycourses drop boxes are used for the submissions of homework, projects and exams. The instructor will NOT make use of the FirstClass mail and conferencing system. Please check mycourses announcement area at least twice a week. CourseCommunication 34
41 Course communication relies heavily on the content area and the discussion area of mycourses. Course syllabus, outline, lectures, assignments and exams will be posted at the content area. The weekly discussion topics will be posted in the discussion area. Students are highly encouraged to participate in the discussions by posting your comments and/or questions related to that week s material to that area. TheinclasslecturesarescheduledonMondaybetween6:00PM 7:50PMforstudentswho enrollin Theseinclasslectureswillberecordedduringclassandpostedin MyCoursescontent area.however,istronglyencouragestudentsfromsection90toattend theselectureseitheronsiteorremotelyviaconnect.rit.eduduringthelecturetimeforlive interaction.theurlforattendingtheconnectconferenceswillbepostedeveryweekin MyCoursespriortothelectures.ThecoursemayalsoutilizeateleconferenceusingAdobe Connect spremiereglobalservicesespeciallyfortheonlinestudents.theexacttimeofthe phoneconferencesalongwiththeinstructionsfordialinginwillbedeterminedand announcedwhentheclassprogresses. WrittenExams Theonlinewrittenexamswillincludemultiple choicequestions,shortanswers,casestudy analysisandothercontentformatasappropriate.theexamsaredesignedtobeopenbook, opennotesandopenreferences.studentsarerequiredtofinishtheirexamsindependently andinthetimeframegiven. IndividualHomeworkandAssignments Theinstructorthroughoutthequarterwillassignindividualhomeworkandlabs.These assignmentsaretobecompletedindependentlyunlessnoteddifferentlybytheassignment. GroupProjects/Presentations Studentsmaybeassignedtogroupstoworkonthegroupprojectassignmentsthroughoutthe quarter.thegroupmaymeetanddiscussproblems/issuesusingthediscussionareaand/or chatfunctionofmycourses.studentsarerequiredtopresenttheirgroupreportslivethrough theclassroomorthroughconnect.rit.edu.eachmemberofthegroupisrequiredtoparticipate inthegroupeventsactively.peerevaluationswillbeadministeredthroughouttheprojects.if thereisaproblemthatappearsonthegroupevaluationswhereamemberisnotcooperating ordoingtheirfairshare,thenthatperson sgradeonthatportionoftheprojectwillbesubject toreductionatthediscretionofyourinstructor.somakesurethatyouareinvolvedandin contactwithyourothergroupmembers. Course Topics 1. Principles of Enterprise Networks and Data centers 2. Networking Design 2.1 Cabling design and types 2.2 Network Hierarchy Edge Distribution 35
42 2.2.3 Host/Access 2.3 Network redundancy and fault tolerance 2.4 Storage Area Networks 2.5 High Availability Time systems EIGRP IGP BGP 3. Physical Design Considerations 3.1 Power v/120v Electrical Segmentation 3.2 Cooling HVAC systems 3.3 Flooring Raised Ground Weight Factors 3.4 Air/Thermal Design Hot/Cold Design Hot/Hot Design Air Sampling 4. Disaster Planning / Recovery 4.1 Backup systems Onsite storage Tape and Disk Backup systems Removable media Offsite storage Long-term storage solutions Test procedures Policy development Redundancy Electrical Data Multiple ISP Protocols (BGP, ebgp) Storage Storage Area Networks 5. Security 5.1 Physical Security Surveillance Safeguard systems Access control systems 5.2 Heat/Water Prevention Fire Suppression HVAC/Air Quality control Water/Moisture prevention 5.3 Personnel Safety Policy management & enforcement Fire codes Building codes Access control management 6. Management 6.1 Remote Management 36
43 6.1.1 Nagios or Network Monitoring Microsoft Operations Manager/System Center Operations Manager SMS and Alerting 6.2 Onsite Management Organizational Tools Rack Tables IP Plan / Spreadsheets Server and environment monitoring Service health monitors 6.3 Scalability Growth capacity planning Cost Recovery modeling 7. Future Technologies Grading Thegradingscaleusedalongwiththegradingcriteriaisasfollows: Component Weight Discussions 10 FinalExam 25 Midtermexam 25 FinalPresentation 25 Assignments 15 Range Grad e >=90.0% A >=80.0%&< B 90% >=70.0%&< C 80.0% >=60.0%&< D 70.0% <60.0% F TentativeCourseSchedule Week Topics/Exams AssignedReading Activities 1 2 Introduction to Data Centers and Enterprise Networks - Network Design - Segmentation - Capacity Planning 3 Physical Design Considerations - Site planning Textbook:Chapter1,2 &7 Lecturenotesand online material/articles Text book: Chapter 3,4 Notes, Tools, Slides MyCourses:Introduction Assignment1(Week2) MyCoursesDiscussion #1 4 Physical Design Considerations - Components 5 Security - Physical & Environmental Text book: Chapters 5 &6 Text book: Chapter 13,14 Notes, Tools, Slides MyCourses Discussion #2 Assignment 1 Due Midterm Exam 37
44 6 Security/Disaster Recovery - Personnel - Onsite Systems 7 Disaster Recovery - Proactive vs. Reactive 8 Management RemoteandOnsite Management 9 Management/Future Technologies 10 StudentTopics Presentations Notes, Tools, Slides Assignment 2 MyCourses: Discussion #3 Text book: Chapter 8, 9 Slidesandonline Textbook:Chapters 10,11,15 OnlineArticles Text book: Chapter FinalExam MyCourses:Discussion #4 MyCourses:Discussion #5 Assignment2Due(end ofweek9) ReviewforfinalExam Cheating Policy: Please review the departmental policy on cheating as described at Student Responsibilities: Please review the general student responsibilities as outlined at 38
45 8.2 Course ICC Form B. Thomas Golisano College of Computing and Information Sciences Department of Networking, Security, and System Administration REVISED COURSE: Title: Enterprise Networking Date: 2/25/2009 Credit Hours: 4 Prerequisite(s): N/A Co-requisite(s): N/A Course proposed by: Chris Mahood 2.0 Course information: Contact hours Maximum students/section Classroom 2 12 Lab Active Learning/Active Learning Extended Other (specify DL) Online delivery 12 Quarter(s) offered Fall X Winter X Spring X Summer Students required to offer this course: None Students who might elect to take the course: Matriculated students in the M.S. in Networking, Security & Systems Administration. 3.0 Goals of the course: Today s large organizations heavily rely on data services, high availability, reliability and scalability to deliver products and services to their customers. As the online audience continues to grow, more of these organizations are realizing that they must convert existing offerings into digital and online services to enhance their profits and exposure. The challenge many of these organizations face is that they either do not have an existing infrastructure that can host the services necessary, or their existing infrastructures can not accommodate the growth in technology. In the past, many organizations retrofitted rooms within their existing infrastructures to accommodate servers and network equipment. These rooms were usually 39
46 small and held a few computers or servers. These challenges have been met by enterprise data centers that are wholly owned, built and designed by organizations, or met by enterprise data centers that are owned by third party companies whom rent space to other organizations. Data centers present a unique difference in the way that resources or networks are traditionally allocated. This course will explore the numerous facets of a data center along with the important design steps necessary to provide a smooth and reliable operation. At the end of this course, students will be able to describe multiple different technologies used within a data center and will also be capable of designing hierarchical networks that can interact with multiple systems. This course will consist of a combination of lectures, discussions, case study analysis, and a field trip to a dynamic collocation datacenter. 4.0 Course description: This course will provide students with the knowledge and understanding to apply design techniques and logical segmentation to large-scale enterprise networks and data centers. Theoretical concepts of large-scale networks will be discussed and students will create designs based on this theory. Case studies will be utilized to help understand different components and their importance in the overall scheme of a data center and enterprise network. This course will provide students with the knowledge needed to apply available tools for designing an effective enterprise network that may be implemented in a data center. The course will also present different technologies available currently for usage in a datacenter as well as some emerging technologies aimed towards the enterprise. Design/case study project required. Class 4, Credit Possible resources (texts, references, computer packages, etc.) 5.1 Douglas, Alger. Build the Best Data Center Facility for your Business. Cisco Press, ISBN: Snevely, Rob. Enterprise Data Center Design and Methodology. Sun Microsystems Press, ISBN: Topics (outline) 6.1 Principles of Enterprise Networks and Data centers 6.2 Networking Design Cabling design and types Network Hierarchy Network redundancy and fault tolerance Storage Area Networks High Availability 6.3 Physical Design Considerations Power Cooling Flooring 40
47 6.3.4 Air/Thermal Design 6.4 Disaster Planning / Recovery Backup systems 6.5 Security Physical Security Heat/Water Prevention Personnel Safety 6.6 Management Remote Management Onsite Management Scalability 6.7 Future & Emerging Technologies 7.0 Intended learning outcomes and associated assessment methods of those outcomes 7.1 Identify and understand different enterprise network fundamentals 7.2 Understand the fundamental processes and procedures of planning, and designing a complex data center and/or enterprise network. 7.3 Define resource needs of a data center and network needs. 7.4 Describe the different components in an enterprise data center and provide recommendations to others about these components. 7.5 Compare existing solutions to determine what will fulfill the defined needs of the customer or organization. 7.6 Fully understand hierarchical networks and their importance in scalable and successful data centers or enterprise scenarios. 8.0 Program outcomes supported by this course 8.1 Program Objective 1: Design, deploy, and manage data center environments to meet the goals of an organization or customer. 8.2 Program Objective 2: Communicate and document clear information that can be used throughout an enterprise organization. 9.0 Other relevant information None 10.0 Supplemental information None 41
48 Approvals: Date Date 42
49 8.3 Course Lecture Slides Week 2 Slides 43
50 44
51 45
52 46
53 47
54 48
55 49
56 50
57 51
58 8.3.2 Week 3 Slides 52
59 53
60 54
61 55
62 56
63 57
64 58
65 59
66 8.3.3 Week 4 Slides 60
67 61
68 62
69 63
70 64
71 65
72 66
73 67
74 68
75 69
76 70
77 8.3.4 Week 5 Slides 71
78 72
79 73
80 74
81 75
82 76
83 77
84 78
85 79
86 8.3.5 Week 7 Slides 80
87 81
88 82
89 83
90 84
91 85
92 86
93 87
94 88
95 8.4 Midterm Exam Example Questions Data Center Design and Networking Midterm Exam Questions 1. Please describe the hierarchy commonly referred to in data center network design. Explain activities that occur at those layers, their function and types of devices that exist at these layers. 2. This type of cabling design provides a hierarchy of cabling: a. Cat 5e b. Distributed c. Aggregation d. Direct e. None of the above 3. provides the ability for systems to remain online while another portion of the network may be failed. 4. This type of fiber optic cable provides faster data transmission speeds over longer distances. a. Multimode b. Single mode c. Mega mode d. Dual pair 5. Scenario: The organization you work for has purchased new switches for the data center that run only on DC power. Your existing switches utilize AC power and you do not have any DC power available within the data center. Provide a solution to utilize these switches within the data center and provide justification for your answer. 6. Name and explain two benefits to utilizing DC power within the data center. 7. Name and explain two benefits to utilizing AC power within the data center. 89
96 8. Scenario: The organization that you are designing a data center for is comparing raised floor versus flat floor installation. The maximum height of the raised floor that they could install would be 17 inches due to building code. Based off of this information please provide a recommendation for raised flooring or flat flooring. Discuss reasons for your choice and reasons why the other choice was not made. 9. Ensure that UPS devices or PDUs are not utilized above percent 10. Which of the following cooling technologies would benefit a data center in Rochester the best? a. Air Cooled b. Water Cooled c. Glycol d. Fan Based e. None of the above 11. Normal humidity operating range is from 20% to % humidity 12. An air is an enclosed space utilized in data centers to provide airflow. 90
97 8.5 Midterm Exam Example Questions Data Center Design and Networking Final Exam Questions 1. Scenario: You are consulting for an organization where the finalization of security designs is occurring for a new data center and the organization is looking to you to provide recommendations on physical security. The organization is a web hosting organization that processes credit card payments through a series of e-commerce sites. The organization would like to implement a maximum of three (3) different physical security technology solutions to provide access control over not only the data center in general, but to the server room as well. Please provide three different recommendations of physical security to protect the payment card systems and justify the reasons to recommending these systems. 2. What is usually the most susceptible location to physical break-ins of a data center: a. Back door b. Front door c. Loading dock d. Roof access e. None of the above 3. prevent someone from propping a door open and allowing free access to a server room or maintenance room. 4. This tool can be utilized to check air flow patterns and where hot pockets are forming within the data center. a. Radar gun b. Manometer c. Multimeter d. Bilometer 5. Scenario: In the data center you work within, your building monitoring system continually warns of smoke particles in the environment, however all systems have been tested to be clean. This occurs frequently when other employees are located within the server room or maintenance is being performed. Discuss what steps should be taken to remedy this situation. Justify your answers. 91
98 6. Name two techniques to prevent water damage to the data center. 7. Which of the following organizations provides a standard for the protection of computer equipment? a. National Electrical Contractors Association b. Institute of Electrical and Electronics Engineers c. National Fire Protection Association d. Telecommunications Industry Association e. Electronics Industries Alliance f. None of the above g. All of the above 8. This protocol can provide redundancy and failover capabilities at the edge layer a. OSPF b. RIP c. BGP d. IGP e. None of the above 9. This type of tape library system has historically provided the most interior space with the least footprint in the data center a. Helical b. Linear c. Tower d. Hexagon e. None of the above 10. Scenario: A data center is being implemented in New York City, NY. The organization also owns an existing data center located in Seattle, WA. The organization wants to create a site replication solution to provide critical files and data base backups to the existing data center in Seattle. Explain two different solutions that the organization may utilize to connect and transfer files of these types to the remote location and how they can easily replicate their data center at this location. You can assume that their topology at both locations will be identical and that no configuration of systems will be necessary. 92
99 9 References: "80PlusProgram."The80PLUSProgram.13Jan.2009< "AC,DCandElectricSignals."ElectronicsClub.Ed.JohnHewes.4June Jan.2009 < Al Fares,Mohammad,AlexanderLoukissas,andAminVahdat."AScalable, CommodityDataCenterNetworkArchitecture."Thesis.AScalable,CommodityData CenterNetworkArchitectureACM(2008): Alger,Douglas.BuildtheBestDataCenterFacilityforYourBusiness.NewYork: CiscoPress,2005. Arregoces,Mauricio,andMaurizioPortolani.DataCenterFundamentals.NewYork: CiscoP,2003. Berkowitz,HowardC."DefininganArchitecture."DesigningRoutingandSwitching ArchitecturesforEnterpriseNetworks.ByHowardC.Berkowitz.GrandRapids: NewRiders,1998. Blazek,Michele,HuiminChong,WoonsienLoh,andJonathanG.Koomey.DataCenters Revistited:AssessmentoftheEnergyImpactofRetrofitsandTechnologyTrendsina High DensityComputingFacility.Thesis.ASCE,2004.JournalofInfrastructureSystems, Caldwell,Chris."PowerSupplies:MakingtheLeaptoHigherEfficiency."Presentationto APEC.Texas,Austin.4Feb Creswell,JohnW.ResearchDesign.ThousandOaks:SAGEPublications,2003. DataCenterEnergyBenchmarkingCaseStudy.Oakland:LawrenceBerkelyNational Laboratory,2007. "DataCenterSecurity."ePaymentsNetwork.20Jan Jan.2009 < DiMinico,Chris."TelecommunicationsInfrastructureStandardforDataCenters." TelecommunicationsInfrastructureStandardforDataCenters.25Jan.2009.IEEE. Dunlop,Jodi."DataCenterCaseStudiesFocusofASHRAEBook."ASHRAE.7May2008. ASHRAE.20Jan.2009< 93
100 Hamilton,JamesR.AnArchitectureforModularDataCenters.Thesis.Microsoft,2008. Redmond:MicrosoftCorporation,2008.IEEE.13Jan.2009 < Kerr,Devon.NetworkHierarchy. Kovacs,Brian.DataCenterOutsourcingCaseStudy.Rep.Carmel,IN:NFrame,2004. "MainframeHistory."MainframeHistory.IBM.4Feb.2009< 03.ibm.com/ibm/history/exhibits/mainframe/mainframe_intro.html>. Mitchell,RobertL."CaseStudy:WellsFargo'sFreeDataCenterCoolingSystem."Computer World.5Nov Feb.2009 < icleid=299301&pagenumber=2>. Patrizio,Andy."CleanYourDatacenter,CutYourElectricBill."InternetNews.29Jan Feb.2009< Rasmussen,Neil.ACvs.DCPowerDistributionforDataCeters.Publication.American PowerConversion,2007. Oppenheimer,Priscilla.Top downnetworkdesign.newyork:ciscop,2004.googlebooks. Google.12Jan.2009 < ayer+hierarchical&source=web&ots=hklxubviep&sig=m8h96f9fk_9rblmtnb4swzvvce&hl=en&ei=q5qpsfw4nj6dtweqxtgdcw&sa=x&oi=book_result&resnum=2&ct =result#ppa143,m1>. Sharma,RatneshK.,RockyShih,CullenBash,andChandrakantPatel."OnBuilding NextGenerationDataCenters."ACM(2008). Snevely,Rob.EnterpriseDataCenterDesignandMethodology.UpperSaddleRiver: PrenticeHallPTR,2002. Sun,Jimeng,EvanHoke,JohnD.Strunk,GregoryR.Ganger,andChristos Faloutsos."IntelligentSystemMonitoringonLargeClusters."Thesis.IntelligentSystem MonitoringonLargeClustersACM(2007): TIA 942DataCenterStandardsOverview.Publication.Minneapolis:ADC,2006. "WhatisNetworkCabling."WhatisNetworkCabling.14May2008.Universityof SouthernFlorida.12Jan.2009< 94