Send in the Clouds: High Performance Oracle 11g in the Amazon Cloud. Jeremiah Wilton

Transcription

1 Page1 Technical Whitepaper SendintheClouds: HighPerformanceOracle11gintheAmazonCloud JeremiahWilton IfIdidn tknowbetter,iwouldthinkfromlarryellison spublicstatementsthatheisunawarethat Oracleisdeeplyinvolvedincloudcomputing,andthatOracletechnologyisnowwidelydeployed in thecloud. Chancesare,Ellisondoesknowthis,butismerelygiving(bombastic)voicetoaparticular sentimentwidelyheldamongtechnologyprofessionals.thecloudbuzzwordhaspermeatedevery cornerofit,largelyatthehandsofcluelessbutindustriousmarketingandprorganizations.as everyindustryfromconventionalhostingtoworkforceoutsourcingattemptstoappropriatetheterm cloud asitsown,webystandersaresubjectedtomountingconfusion.afterovertwoyearsin commonusage,iperceivenowidespreadimprovementinunderstandingofwhat cloudcomputing reallymeans. Becauseofdiffusemeaningandwidespreadmisappropriation,theterm cloudcomputing fitsneatly intoalonglineageoftechnologybuzzwordsthathaveemergedasstand insforcommonsenseand plaguedimplementersofrealfunctioningtechnologysolutionsfordecades.cloudcomputinginvites disdaininpartbecausesomanyofusarejadedbyilm,soa, grid, etc. Because cloud meanssomethingverydifferenttosalesforce.comthanitmeanstoamazon.com,not tomentiongoogle,microsoftandsun,iwillbeginbyattemptingtoprovideagrandunification definitionforcloudcomputing. CloudComputing:Asetofmethodsfordeliveringovernetworksmanagedcomputing resourcesthatcanbeincrementallyprovisionedbasedondemand,remotelymanagedviaa uniformwebapi,andbilledbasedonresourceusagetoavoidcapitalcosts. Granted,thatdefinitionislackingindetailorspecifics,preciselybecausetherearesomany variationsonthecloudthemebythevariousproviders.thesevariationsgenerallyfallintothree cloudcategories:saas,softwareasaservice;paas,platformasaservice;iaas,infrastructureasa service,andbloohp, buylotsofourhardware,please. ThebestexampleofSAASisGoogleApps.Theyprovideprivatehosted ,calendarandother servicesforclientcompanies.eachcompany sdataisprivate.googleappsisessentiallyaremote servicethatreplaceshardwareandsoftwareinfrastructurethatistraditionallyself hostedandselfmanaged.salesforcecrmisanotherpopularsaasproductthatallowsbusinesscontact managementwithinanorganization.saasisintendedtoreplaceyourlocallymanagedandhosted enterpriseserviceswithremotelyhostedservicesthatcostlessandfunctionbetter. PAASprovidershostadevelopmentplatformforbuildingandrunningapplicationsforyour enterpriseorforthegeneralpublic.theseservicesusuallysupportoneortwoprogramming languagesandhavebellsandwhistleslikedatabaseservicesandcachingtomakethedeveloped applicationsfunctionbetter.paasisalsodominatedbysalesforce(force.com)andgoogle(apps Engine). IAASisthemostflexibleCloudoption.Essentially,IAASprovidersleaseyouCPUtimeandspaceto runavirtualhostontheirinfrastructure.linux,windowsandotherhostscanbebroughtupand downondemand,andwithinthetermsofservice,youcanrunanythingyouwantonthehosts. Amazon.com(AmazonWebServices)isthehandsdownleaderinIAAS. BLOOHPisavarietyofcloudcomputinginwhichyoupurchase,installandrunyourownmassive computecloudconsistingofhundredsorthousandsofserverswithinyourownhostingfacilities. Sun scloudstrategyisessentiallybloohp based.ontheonehand,youcanprovisionresourcesfor youapplicationsondemandfromalargepoolofcomputepower.ontheotherhand,youarepaying fortheentirepoolofcomputepoweratalltimes.forlargeenterprises,agrid/bloohpapproach

2 SendInTheClouds JeremiahWilton maymakesense,sinceitallowssharingofresourcesbetweendivisions. Physicalinfrastructureiscumbersometoscale Traditionally,todeployanapplication,youhavetoinvestinaninitialinfrastructurethatyoubelieve willaccommodatetheapplication sloadanddemands.astheapplicationscalesup,youmonitorfor capacity.eventually,ifyoucorrectlypredictthefuture,youupgradeorpurchasenewinfrastructure toaccommodatetheapplication sincreasingdemandbeforetheexistinginfrastructureexceeds availablecapacity.itdoesn talwaysworkout,though.itiscommonforinfrastructuretorunoutof capacitybeforeyouinvestthecapitalandworkrequiredforanewexpandedsystem.(figure1) Infrastructure investment Demand Capacity Demand exceeds capacity Demand Time Figure1:ScalingofPhysicalInfrastructure CloudInfrastructurescalesincrementally InacloudlikeAWS,scalingrequiresnoneoftheplanningandeconomicoutlayofphysical infrastructure.newapplicationscanbedeployedoninfrastructurewithminimalcapacityand minimalcost.asdemandincreases,youcanmanually(orautomaticallywithec2autoscaling) deployhostandi/oresourcesjustaheadofanapplication sdemand.youneverreachthepointof runningfordaysorweeksundercapacity,becauseonthecloudthereisnoleadtimetodeploynew infrastructure.onaws,youcanscaleyourinfrastructureincrementally,andpayasyougoforonly whatyouuse(figure2). Demand Capacity Demand Time Figure2:Scalingofcloudinfrastructure Page2

3 SendInTheClouds JeremiahWilton Page3 Gettingdowntobusiness:OracleonAmazon scloud AmazonWebServices(AWS)istheumbrellanameforallcloud relatedtechnologiesamazonoffers. Amazon spremiercloudofferingisiaas.amazon snameforthisproductistheelasticcompute Cloud,orEC2.EC2allowsyoutoprovisionarunningLinuxorWindowsserver.Hostsareavailablein avarietyofmemoryandcpuscales,fromsmalltoverylarge.amazonreferstothesevirtualhostsas instances.thereareawiderangeofavailability,scaling,automationandmanagementfeaturesthat allowec2tobeusedforawiderangeofpurposes. EC2istheflagshipofferingofAmazonWebServices,buttheyoffermanyotherservicesaswell.The SimpleStorageService(S3)isanHTTP basedfilestoragesystemforusersbothinsideandoutside thecloud.thesimplequeueservice(sqs)providesasynchronousmessagingtotiecomponentsofan infrastructurelooselytosupportapplicationdataflow.simpledbisanon relationaldatabaseservice forpersistentindexingofnon complexdata.therelationaldatabaseservice(rds)isamysqlbasedcomplexdatastorageservice.together,theseandamazon smanyothercloudservices providearichtoolkitforbuildinginexpensive,flexibleapplicationsandserviceonarobustplatform. YoucanrunvirtuallyanythingonanEC2instance,andOracleisnoexception.Intheremainderof thisdocument,wewillwalkthroughthestepstoprepareanec2instancetorunoracle,anddiscuss issuesofperformance,configurationandotherpracticalconcerns. WhatcanIuseitfor? Amazon sec2iscommonlydeployedforbothproduction,testanddevelopmentpurposes.for dev/test,theadvantagesareclear:developersanddevelopmentgroupscanrapidlydeploy environmentsondemand,payonlywhiletheyusethem,andtearthemdownwhentheyarefinished. Productionuseisalsocommon.ManyFacebookandiPhoneapplicationserver sidecomponentsare backedandhostedbyec2. InmyclassesfortheUniversityofWashingtonandBlueGecko,mystudentsmaintainEC2instances runningoraclefortheirownresearchandstudypurposes,forthedurationoftheclass.ec2allows themtopayonlyfortimetheyspendworkingontheirclassprojects.incomparison,itwouldbe moreexpensiveandlaborintensivetoprovideeverystudentwitha64 bitenterpriselinuxhostor VMthattheywouldhavetorelinquishattheendofclass. CaveatEmptor ForOracleDBAsusedtoworkingwithbaremetalhosts,orevenself hostedvirtualmachines,there aresomeimportantconsiderationswhenrunningoracleonec2thatdon tapplytomoretraditional platforms.i/operformanceischiefamongthese.ec2instancescommunicatewiththeirpersistent storagevolumesviaatcpnetwork.thelatencyandthroughputisusuallywellwithinacceptable timingsformostneeds.butforsystemswithveryintensivei/orequirements,thoroughtestingof EC2 scapabilitiesisessential.inthispaperiwillquantifythei/ocapabilitiesofec2atthetimeof writing,butamazonisconstantlyimprovingtheirplatformandaddingfeatures.available performanceinsixmonthsislikelytobebetterthandocumentedhere. AnotherseriousconsiderationisyourownInternetconnection.Ifyouareconsideringdeploying servicesonthecloudthatyoucurrentlyhostlocally,yourinternetconnectionbecomesasinglepoint offailurebetweenyourusersandyourapplication.evenifyoupurchasemultipleredundant Internetconnectionsfromdifferentproviders,theymaywellusethesamelocalbackbone. Finally,AWSisnotfree.Althoughitischeaperthanbuyingnewhardwareforatemporaryneed,it maybemoreexpensiveovertimethanyourownpurchasedhardware.however,themany availability,securityandscalingfeaturesbuiltintoec2makeithardtocomparetoaparticularselfhostedhardwaresolution. DoesOracleSupporttheirsoftwareonEC2?

4 SendInTheClouds JeremiahWilton Yes.OraclesupportsOraclesoftwarerunningonavarietyofvirtualizationplatforms,including AmazonEC2andVMware.AccordingtoOracle swebsite, OraclefullysupportsdeployingOracle Database,Middleware,andEnterpriseManagerproductsontheAmazonEC2platform.However,it maybenotedthatamazonec2isavirtualizedenvironmentandusesavirtualizationenginethatis notsupportedbyoracle.userswillthereforebedirectedtoamazonforanyvirtualization related issues. 1 AGuidedTourofAmazonWebServices BeforewecandiscusshowtodeployOracleonEC2,youneedasolidunderstandingofhowAmazon s cloudresourceswork,andwhatresourcesareavailable.awshasavarietyofoptionsandfeatures. Instances:TheHeartofEC2 AnEC2instanceisavirtualhostrunningWindows,Linuxoroneoftheothersupported operatingsystemsonaws.youchooseaninstancetypebasedonyourrequirements.the biggertheinstanceyouprovision,themoreitcostsperunittime(seetable1).amazon measurescpupoweroftheirinstancesusingec2computeunits(ecu).accordingto Amazon swebsite,oneecu providestheequivalentcpucapacityofa GHz2007 Opteronor2007Xeonprocessor. Table1:EC2InstanceTypes 2 Instance Type CPU RAM Storage Platform I/O $/hour(useast) Linux/Windows m1.small 1ECU 1.7GB 160GB 32 bit Moderate $0.085/$0.12 m1.large 4ECU 7.5GB 850GB 64 bit High $0.34/$0.48 m1.xlarge 8ECU 15GB 1690GB 64 bit High $0.68/$0.96 c1.medium 5ECU 1.7GB 350GB 32 bit Moderate $0.17/$0.29 c1.xlarge 20ECU 7GB 1690GB 64 bit High $0.68/$1.16 m2.2xlarge 13ECU 34.2GB 850GB 64 bit High $1.20/$1.44 m2.4xlarge 26ECU 68.4GB 1690GB 64 bit High $2.40/$2.88 AWSRegions:US East,EU West,US West(NorthernCalifornia) AnEC2regionistheapproximategeographicareawhereAmazon sdatacenterssupporting AWSarelocated.YoucanrunanEC2instanceinanyoftheregionsthatAmazonprovides.US EastandEU Westaretheregionswiththegreatestcapacityinearly2010.TheUS Westregion haslimitedcapabilitiesanddifferentpricingthanus East.Theideaistodeployservicesas closeaspossibleintermsofnetworktopographytoyourusers.withineachregion,amazon providesmultipleavailabilityzones,soyouarenotconfinedtoasinglegeographicpointof failurewithinaregion.availabilityzonesareroughlyanalogoustodatacenters.ifyoudeploy aninstancesintwodifferentavailabilityzones,theywillbeinphysicallyseparatefacilities. AmazonMachineImage(AMI):YourBootableOperatingSystem YoucanuseoneofAmazon samis,oneofthosesubmittedbymembersofthecommunity,or onethatyoubuildyourself.amazonprovidesallthetoolsneededtopackupyourfavoriteo/s configuration,uploadittoaws,andbootitonec2.formostpurposes,youcanfindasuitable O/SfromamongthosealreadypubliclyavailableonEC2.OraclehasevencontributedAMIs fororacleenterpriselinuxwithoraclesoftware,includingseveralversionsofthedatabase, pre installed. Security Bydefault,AmazonallowsnonetworkingresswhatsoeverfromthepublicInternettoEC2 1Fromhttp:// 2Fromhttp://aws.amazon.comaccessedJan.6, Page4

5 SendInTheClouds JeremiahWilton Page5 instances.inordertoenableaninstancetobeabletoprovideaservice,oreventoallow connectionsviassh,youmustassociateanec2securitygroupwiththeinstance.thesecurity groupdefineswhichportswillallownetworkingress,andallowsthattoberestrictedbyip addressoripaddressrange. EvenwiththeSSHportdefinedinasecuritygroup,youneedtosetupakeypairfor authenticationbetweenyourlocalterminalandtheec2instancesyoucreate.amazon providesakeypairgeneratingservicethatautomaticallysetsupthekeyontheec2instance whenitstarts. ControlFreak AmazonprovidesawealthofinterfacesformanagingthevariousservicesthatcompriseAWS.The mostpopularinterfaceforec2managementtasks,suchasstartingandstoppingec2instances,isthe web basedawsmanagementconsoleathttps://console.aws.amazon.com/ec2.withthisweb based console,youcanstartandstopinstances,allocatestorage,andmanageallaspectsofyourec2 resources.anotherpopulartoolformanagingawsresourcesisafirefoxextensioncalledelasticfox. Amazonbuiltthistool,anditencapsulatesmanyofthesamefeaturesoftheManagementConsole. ThereareusecasesforwhichaGUItoolisnotappropriate.ForAWSmanagementtasksthatmustbe scripted,logged,orshared,amazonprovidesasetofcommand linetoolsthatruninunix,linuxand DOS/Windowsenvironments.ThesetoolsallowcompleteuseofallfeaturesofAWS. AllofthesetoolsthatmanageAWSservicesdothesamethingfromAmazon spointofview.they simplymakehttprequestsandparsetheresponse.theapithatthesetoolsspeakisavailabletous fordevelopingourownsoftwareaswell.amazonevenprovidesjava,rubyandperllibrariesthat makeitsimpletobuildawsapicallsintosoftware. Whataboutsecurity? Doyoureallyexpectmetoputmypreciousdatainthisbigpublicbucket? Inaword,yes.You alreadypityourpreciousdatainabigpublicbucketwhenyouoff sitebackuptapes.many companiesoutsourcehostingtohostingcompanies,andtrustthosecompaniestoprovidephysical andnetworksecurity. Amazonisnodifferent.InEC2,thehypervisormaintainsexclusivecomputingenvironments.To date,nobodyhasdemonstratedavulnerabilityonec2thatallowsunauthorizedaccesstoanother user scloudresources.amazonhasproducedasas70typeiireportcoveringthecloud infrastructure. Intheend,mostsecuritypracticesareuptothecustomer.Ifyouopenupyourpermissions,ports andfirewalltotheworld,thentheworldcangetin.ifyoudesignyourapplications,databasesand hostsforsecuritywithinthecloud,thentheywillbesecure.forinstance,youcouldrunadatabase hostwithnoingressonanyport,andawebserverwithingressonports80(http)and22(ssh).to administerthedatabasehost,youwouldfirsthavetosshtothewebserverhost,thensshtothe databasehost,authenticatingoneachtologin. Advancedsecurity:VirtualPrivateCloud ForcompaniesthatdonotwanttheirapplicationstohaveanyexposuretotheInternet,Amazon offersaservicecalledvirtualprivatecloud(vpc).withvpc,youcreateasecurevpnbetweenyour ownnetworkandsubnetswithinec2containingyourinstancesexclusively.alldatatransferinand outisoverasecure,encryptedvpn.withvpc,yourec2instancesappearashostsonyourown internalnetwork(figure3).

6 SendInTheClouds JeremiahWilton Page6 Figure3:VirtualPrivateCloud OK,I mreadytorunoracleonec2:whatdoido? ThefirstthingyouneedtorunOracleonAWSisarunningoperatingsystemonEC2.Youcanusean Amazonmachineimage(AMI)fromAmazon,oneofthecommunity contributedamis,oronethat youbuildyourselffromyourownexistingcomputer.sincewewanttorunoracle,wearefortunate thatoraclecorp.hasbuildaseriesofamisthatrunoracleenterpriselinuxandavarietyoforacle productsinstalled. Hands ontask:findasuitableami YoucanuseyourexistingAmazon.comretailaccounttoprovisionAWSresources.Youdohaveto additionallyregisteryouraccountforthoseawsservicesthatyouwanttouse.togetstartedusing EC2,youhavetoregisteryouraccountforEC2athttp://aws.amazon.com.Youalsoneedavalid creditcardassociatedwithyouramazonretailaccount. YouwillalsoneedtodownloadandenabletheEC2APItoolstoyourWindows,Linux,UnixorMac computertocompletethetasksinthispaper.thesetoolsareavailablefromhttp://aws.amazon.com. PleasefollowAmazon sdocumentationforinstallingandconfiguringtheapitools. BeginbysearchingAmazon samisforthosethatcontainthestring oracle. $ec2 describe images all grep ioracle Thiscommandreturnsover40results,soyoumaywanttonarrowdowntheresultsbyarchitecture andversion.oraclehasalsobuiltamisforamazon spowerfulenterprise class64 bithosts,but assumingwewanttojustexperimentwithasmall32 bitsystem,wecannarrowitdowntotwo: $ec2 describe images all grep ioracle grep11107 grepi386 IMAGEami 47c5252e oracle corporation/database ami/32 bit/oracle_11107_ee_32bit image.manifest.xml availablepublici386machineaki c5e703acari c2e703ab instance store IMAGEami 3dc62654 oracle corporation/database ami/32 bit/oracle_11107_se_se1_32bit image.manifest.xml availablepublici386machineaki c5e703acari c2e703ac instance store InthiscasewecanseetherearetwoAMIsfor32 bitoelwith pre installed.oneisfor StandardEdition(SE),andoneforEnterpriseEdition(EE).Forthistask,wewillchooseEE,orami 47c5252e.

7 SendInTheClouds JeremiahWilton Hands ontask:setupexternalaccesstoyourec2instances Bydefault,AmazonEC2instancesareprotectedfromintrusionbyclosingallinboundIPportsto traffic.however,ifyouhopeevertologintoyourinstance,youwillatleastneedtoopenupaport forsshaccess.exceptionstothe noingress rulearemanagedusinganec2securitygroup.you canstartanec2instancewithmultiplesecuritygroups,soitmakessensetocreatesecuritygroups foreachexternally accessedfunctionyoumightwanttoadd.forinstance,youcouldhaveone securitygroupforremoteaccess,anotherforhttpandhttps,andyetanotherfortheoracle listener.below,wecreateasecuritygroupforremoteaccesscalledremote,andspecifysshandvnc accessisallowedfromonlyone(my)ipaddressontheinternet.toallowaccessfromanyipaddress ontheinternet,simplyspecify /0forthecidr. $ec2 add groupremote d'remotehostmanagement' GROUPremoteRemoteHostManagement $ec2 authorizeremote Ptcp p22 s /0 GROUPremote PERMISSIONremoteALLOWStcp2222FROMCIDR /0 $ec2 authorizeremote Ptcp p s /0 GROUPremote PERMISSION remoteallowstcp fromcidr /0 Fororganizationsandapplicationswithsecurityrequirementsbeyondthatprovidedbytheingress port exceptionstrategyofsecuritygroups,amazonprovidesthevirtualprivatecloud(vpc).this serviceallowsenterprisestoallocateanawsaccountforwhichallresourcesareaccessibleonlyvia adedicatedvpntunnelfromthecustomer sownsite.usingvpc,ec2instancesaresecureand isolatedfromtheoutsideworld(andfromotherec2customers),appearingasasubnetofthe customer sinternalnetwork. Assuming,however,thatyouwillSSHintoyourEC2instance,youwillneedsomewaytoauthenticate withthehost.amazonprovidesaslickservicethatcreatesanrsakeypairforssh.ithandsyoua privatekey,andinstallsthepublickeyin~root/.ssh/onanewly createdec2instance.this providesasecurewayfortheownertologin.tocreateakeypairandprocureyourprivatekey: $ec2 add keypairmykeypair KEYPAIRmykeypair31:31:ad:21:c7:34:4a:47:83:76:8f:44:56:d2:35:9d:9f:cd:c1:6f BEGINRSAPRIVATEKEY MIIEowIBAAKCAQEAwUm7hnR3PwU4pQID3D92QO0/Gxxez2TRi/AKQHYNPnFYjlnF42N9llaOBYBy ElXm9EK+bUeyUKTIs8ChcNdv7ghMQFUvGq39d8duHMQFCfo6lIderrgdNN9cyGlTF5N6 ENDRSAPRIVATEKEY Theoutputofthiscommand(everythingbetweenandincludingtheBEGINandENDlines)shouldbe copiedtoapublickeyfilethatyoukeepinasafeplace.mostunix/linuxsshclientswillrequireyou tochangetopermissionsto600(ownerread/writeonly).ifyouareusingmicrosoftwindowswith PuTTYasyourSSHclient,youwillneedtousePuTTYGentoconverttheSSHkeytoaPuTTY style.ppkfile. Hands ontask:startupandconnecttoanec2instance Withalltheprerequisitesoutoftheway,youarefinallyreadytostartupyourEC2instance. Referringbacktotable1,andassumingwearestillonlyplanningtoexperimentonasmall32 bit system,wewillspecifym1.smallforourinstancetype. $ec2 run instancesami 47c5252e n1 gremote kmykeypair tm1.small RESERVATIONr b021b3d remote INSTANCEi d05453b8ami 47c5252ependingmykeypair0m1.small T00:22: us east 1daki c5e703acari c2e703ab Page7

8 SendInTheClouds JeremiahWilton Page8 monitoring disabledinstance store Thestatuspendingmeansthattheinstanceiscurrentlystartingup.Afterafewminutes,youcan checktheinstancetoseeifitisup: $ec2 describe instancesi d05453b8 RESERVATIONr b021b3d remote INSTANCEi d05453b8ami 47c5252eec compute 1.amazonaws.com ip ec2.internalrunningmykeypair0m1.small T00:22: us east 1daki c5e703acari c2e703ab monitoring disabled instance store Whenthestatuschangestorunning,theinstanceisreadyforyoutologin.NotetheexternalDNS namethatisprovidedtoyouintheprecedingcommand.thiswillbetheaddresstowhichyoussh usingthekeypairyousetupearlier: $ssh iid compute 1.amazonaws.com Lastlogin:ThuAug2714:14:232009from ============================================================================= OracleDatabase11gRelease1( )EnterpriseEdition32bitAMI ============================================================================= TermsofUse Useofthismachinerequiresacceptanceofthefollowinglicenseagreements Doyouaccept?[y/n]:y Wouldyouliketocreateadatabasenow[y n]:n :[/root]$ Nowyouhaveavirtualhost(instance)readyandrunningonAmazonEC2.However,aswe discussedearlier,weneedtoaddresstheissueofpersistentstoragebeforewecangoaheadand createadatabase. StorageoptionsonAWS AsIhavementioned,thevolumesyouseeontheinstancejustcreatedaboveareephemeral.That meansthatiftheinstancemustbeterminatedforanyreason,thatstoragewillbewipedout. Additionally,theephemeralstorageonEC2cannotbetunedinanymeaningfulwayforperformance ordurability.forpersistentstorage,amazonprovidesthesimplestorageservice(s3),andelastic BlockStorage(EBS). Theperformanceofstorageisprobablycitedmostoftenasthelimitingfactorpreventingcustomers frommigratingoracleservicestoec2.byandlarge,however,itappearsthatmanyunderestimate I/OperformancefordatabasesonEC2.ItistruethatAmazon spersistentstorageoptionshave throughputandlatencylimitations,buttheyarefarlessseverethangenerallypresumed. S3inanutshell TheSimpleStorageServiceisnotforstoringOracledatafiles.Itisageneralizednon filesystem storagesolution.filesareplacedons3andretrievedviahttp.s3isavailablenotonlytoec2 instances,buttoanyhostontheinternet.itiscommonlyusedasaplacetobackupfiles,andas storageformediathatuserswanttosharewithothersovertheweb. S3isextremelydurable.InadditiontothestorageprotectionswithineachofAmazon sdatacenters, S3dataisreplicatedtoatleastthreedatacenterswithinageographicregion.Thatmeansthatdata youstoreons3isautomaticallyprotectedfromsitefailuresanddisasters. Anumberofthird partysoftwarecompanieshavebuiltbackuputilitiestobackupyourpersonal datatos3.followingtheirlead,oraclehaswrittenanrmanmmlfors3,calledtheoraclesecure

9 SendInTheClouds JeremiahWilton Page9 Backup(OSB)CloudModule.ThisMMLallowsOracledatabasesbothonandofftheAmazonCloudto backupdirectlytos3usingrecoverymanager stapeinterface.forcertaindeployments,s3could easilytaketheplaceofvaultedtape.s3offerssuperiortimetorecoveryandgeographicprotection comparedtotapevaultingservicesatasmallfractionofthecost. EBS:PersistentdiskstorageforEC2 IncontrasttoS3,whichisavailablefromanywhereontheInternetandisnotperformance oriented, Amazon selasticblockstorage(ebs)provideshigh performancestoragevolumesfrom1gupto1t thatareavailableonlytoec2instances.thesevolumescanbeusedforunix/linuxorwindows,and presentthemselvesasdevices,muchlikeascsidevicewould.thatmeansthatyoucanpartitionebs volumes,formatthemasfilesystems,stripeandmirrorthemwithavolumemanager,orassignthem tooracleasm. DiskI/OperformanceconcernsareoftencitedasachiefreasonthatAmazonEC2cannotbeaviable infrastructureplatformforproductionoracleservices.indeed,diskperformance,shouldbea seriousconsideration,astherearehardlimitsoni/operformanceofindividualebsvolumes,andto EBSoverallfromanEC2instance.Nevertheless,eventheworstobservedI/OperformanceofEBS exceedstherequirementsofmostoftheoracleservicesihaveseendeployedoverthepasttenyears. InTestsusingOracle sorioni/otestingtoolinq32009,imeasuredrandom8kreadssimulating stripingacrossten1gebsvolumesat600iops.inq12010,withthesameconfiguration,i measuredsustainedperformanceofover3500iops.youshouldrelyonyourowntestingforyour purposes,butthisgivesyousomeideaoftherangeofperformancenumbers. OneofthebestwaystousealloftheavailableEBSI/OresourcesistostripeOracledataacross multipleebsvolumes.thiscanbeachievedwithsoftwareraid,avolumemanager,orideally,asm. Usingperformancedataonyourowncandidatesystems,youcaneasilydetermineiftheycould operatewithinthelimitationsofec2andebs si/ocapabilities.theawrview DBA_HIST_IOSTAT_FILETYPEretainsdataonvarioustypesofI/Orequestsfordatafilesandredologs. ComparingthepeakvaluesforthesenumberstoyourownORIONtestscantellyouifEC2willbeafit foraparticularoracleservice. Hands ontask:createandattachebsvolumes Ifyoureferbacktotheinstancewecreatedinthepastexercise,youwillseethatAmazoncreatedit intheus east 1davailabilityzone.ThatmeansthatwhenweuseEBStocreatedisksforthis instance,theytoomustbecreatedintheus east 1dzone.ToachieveRAID likestripingfor improvedperformance,wewillcreatefive20gvolumesforstripingdata. $ec2 create volume s20 zus east 1d VOLUMEvol 31de205820us east 1dcreating T00:22: VOLUMEvol 2835c94120us east 1dcreating T00:22: VOLUMEvol f7c23d9e20us east 1dcreating T00:23: VOLUMEvol 2a35c94320us east 1dcreating T00:23: VOLUMEvol 2c35c94520us east 1dcreating T00:23: Thenextstepistoattachthenewly createdvolumestotheinstancewecreatedbefore.wespecify Linux stylescsidevicenames.thesedeviceswillbecomevisibletotheoperatingsystemofourec2 instanceafterweattachthevolumes. $ec2 attach volumevol 31de2058 ii d05453b8 d/dev/sdh ATTACHMENTvol 31de2058i d05453b8/dev/sdhattaching T00:24: $ec2 attach volumevol 2835c941 ii d05453b8 d/dev/sdi ATTACHMENTvol 2835c941i d05453b8/dev/sdiattaching T00:24: $ec2 attach volumevol f7c23d9e ii d05453b8 d/dev/sdj ATTACHMENTvol f7c23d9ei d05453b8/dev/sdjattaching T00:24: $ec2 attach volumevol 2a35c943 ii d05453b8 d/dev/sdk ATTACHMENTvol 2a35c943i d05453b8/dev/sdkattaching T00:24:

10 SendInTheClouds JeremiahWilton Page10 $ec2 attach volumevol 2c35c945 ii d05453b8 d/dev/sdl ATTACHMENTvol 2c35c945i d05453b8/dev/sdlattaching T00:24: ForeachofthecreateddevicestobeusablebyASMlib,youwillhavetouseautilitylikefdiskto partitionthem.typically,youwouldmakeeachoneasingleprimarypartitionofthefullsizeofthe volume.toaddthedevicesasasmlibdisks,youwouldusethe /etc/init.d/oracleasm createdisk command. AtthispointsettingupASMandcreatingadatabasearethesameontheEC2platformastheywould beonanyarchitecture.therefore,idonotcoverthestepstodothatindetailhere. O/SPersistence OneoftheaspectsofEC2thatmostbothersnewusersisthefactthatbydefault,changestotheO/S environmentdonotpersist.afterahostisshutdown,youmustcreateanewinstancefromanami, andattachthepersistentebsstoragetogetyourdatabaseback.asyoucaneasilyimagine,thelossof the/etc/oratabfileandanypackageadditionsorotherchangesyoumighthavemadewouldbe annoying. Youcouldre bundletheamieverytimeyoumakeachange,butthatistediousandlabor intensive. UsersthatwanttheirO/Senvironmenttopersistliketherootdisksinatraditionally hostedmachine canbootfromebs.amazon snew bootfromebs featureallowsyoutopersisto/schangestoan EBSvolumethatisautomaticallysnapshottedtoS3oninstancetermination.TheAMIthatyouuse mustbecreatedwiththisfeatureenabled.thismeansthattheoraclelinuxamisavailableinq1 2010mustbere bundledinordertobootfromebs.also,thisfeatureisnotavailablewithan AmazonVirtualPrivateCloud(VPC)account. Thereareotherapproachesthatareeveneasiertoachievepersistence.Forinstance,youcouldmove ORACLE_BASE,includingallOraclesoftwareandinventorytoanEBSvolume,andsimplyuse symboliclinksfromtheephemeralstoragetopointtothepersistentfilesonebs. Backups OnEC2,thereisnotapelibrary.Naturally,evenonarobustandhighlyavailableplatformlikeEC2, enterprisesdemandareliablebackupsolution.oracleandamazonhaveprovidedthatinaproduct calledtheoraclesecurebackup(osb)cloudmodule.justasnetbackupandnetworkerprovidean RMANmediamanagementlibrary(MML)fortapedrives,theOSBCloudmoduleprovidesanMMLfor AmazonS3.YoucanusethissoftwaretobackupbothEC2Oracledatabases,aswellasthosehosted outsidetheamazoncloud,inyourowndatacenter. BecauseS3isoff site,alwayson lineandgeographicallyredundant,itprovidesacompelling alternativetophysicaloff sitetapevaultingservices.at$0.15/gb,thecostofs3maybe considerablylowerthanthatoftapevaultingservices. Aseriousconcernforvaultingfromtraditionally hosteddatabasestos3shouldbethethroughput andreliabilityoftheinternetconnection.thiscanaffectthetimelinessofbackups,aswellasthe timetorecovery. AnS3 baseddatabasevaultingstrategydovetailsnicelywithanec2 baseddisasterrecovery solution.noinstanceorstorageneedbeallocatedonawsuntilafteradisaster.atthatpoint,thes3 basedrmanbackupsmayberestoredtoanewec2instanceandebsstorage.thissavesthecostof constantlyrunningastandbydatabaseonec2. Summary AmazonWebServicesprovideasuiteofservicesthatallowOracletobedeployedreliablyandwith impressiveperformanceandavailabilitycharacteristicsinaninexpensiveinfrastructure.cloud computingholdsthepromiseofgettingnon ITcompaniesoutofthebusinessofwastingtheir resourcesoncostlyitinfrastructure.dependingontheusecase,amazonec2mayprovideequalor

11 SendInTheClouds JeremiahWilton betterperformance,availabilityandcostwhencomparedtotraditionalhostingsolutions. Aswithalltechnologies,thespecificrequirementsofanyapplicationorservicemustberigorously testedagainstaws,justasitwouldbeforinternally hostedinfrastructure. Page11