|
|
- Deborah Walton
- 8 years ago
- Views:
Transcription
1 MulticastGroupCommunicationasaBasefora Load-BalancingReplicatedDataService 2BasserDept.ofCS,MadsenF09,UniversityofSydney,NSW2006,Australia. 1MITLCS,545TechnologySquare,NE43-365,Cambridge,MA02139,USA. RogerKhazan1,AlanFekete2,andNancyLynch1 Abstract.Wegivearigorousaccountofanalgorithmthatprovides sequentiallyconsistentreplicateddataontopoftheviewsynchronous groupcommunicationservicepreviouslyspeciedbyfekete,lynchand ityview,butrotatestheworkofqueriesamongthememberstoequalize Shvartsman.Thealgorithmperformsupdatesatallmembersofamajor- 1Introduction theload.thealgorithmispresentedandveriedusingi/oautomata. Multicastgroupcommunicationservicesareimportantbuildingblocksforfaulttolerantapplicationsthatrequirereliableandorderedcommunicationamong andshvartsmanrecentlygaveasimpleautomatonspecicationvsforaviewsynchronousgroupcommunicationserviceanddemonstrateditspowerbyusincallychanginggroupsandprovidestrongintra-groupmulticastprimitives.ttateconsensusonwhatpropertiestheseservicesshouldexhibit,fekete,lynch remedytheexistinglackofgoodspecicationsfortheseservicesandtofacili- multipleparties.theseservicesmanagetheirclientsascollectionsofdynami- balancesqueriesandguaranteessequentialconsistency. ittosupportatotally-orderedbroadcastapplicationto[14,13].inthispaper, weusevstosupportasecondapplication:areplicateddataservicethatload involvingomission,crashingordelay,butnotbyzantinefailures.thefailures aconsistentandtransparentfashionandenablestheclientstoupdateand connected,andsubjecttoprocessorandcommunicationfailuresandrecoveries querythisobject.weassumetheunderlyingnetworkisasynchronous,strongly- Theservicemaintainsadataobjectreplicatedataxedsetofserversin preservingcorrectnessandmaintainingliveness. andrecoveriesmaycausethenetworkoritscomponentstopartitionandmerge. updateoperationsmustbeprocessedinthesameordereverywhere.toavoid Thebiggestchallengefortheserviceistocopewithnetworkpartitioningwhile inconsistencies,thealgorithmallowsupdatestooccuronlyinprimarycom- ponents.followingthecommonlyuseddenition,primarycomponentsarede- nedasthosecontainingamajority(ormoregenerallyaquorum)ofallservers. Weassumethatexecutedupdatescannotbeundone,whichimpliesthat Nonemptyintersectionofanytwomajorities(quorums)guaranteestheexistence ofatmostoneprimaryatagiventimeandallowsforthenecessaryowofinformationbetweenconsecutiveprimaries.ourserviceguaranteesprocessingof
2 updaterequestswheneverthereisastableprimarycomponent,regardlessofthe pastnetworkperturbations. nents,andisguaranteedprovidedtheclient'scomponenteventuallystabilizes. monlyoccurringsituationswhenqueriestakeapproximatelythesameamount Theserviceusesaround-robinload-balancingstrategytodistributequeriesto eachserverevenlywithineachcomponent.thisstrategymakessenseincom- Ontheotherhand,processingofqueriesisnotrestrictedtoprimarycompo- oftime,whichissignicant.eachqueryisprocessedwithrespecttoadatastate thatisatleastasadvancedasthelaststatewitnessedbythequery'sclient.the serviceisarrangedinsuchawaythattheserversarealwaysabletoprocessthe nicationlayer.theservers'layerissymmetric:allserversrunidenticalstate- machines.thecommunicationlayerconsistsoftwoparts,agroupcommuni- cationservicesatisfyingvs,andacollectionofindividualchannelsproviding Architecturally,theserviceconsistsoftheservers'layerandthecommu- assignedqueries,thatistheyarenotblockedbymissingupdateinformation. reliablereorderingpoint-to-pointcommunicationbetweenallpairsofservers. Theserversusethegroupcommunicationservicetodisseminateupdateand queryrequeststothemembersoftheirgroupsandrelyonthepropertiesofthis RelatedWork usedtosendtheresultsofprocessedqueriesdirectlytotheoriginalservers. servicetoenforcetheformationofidenticalsequencesofupdaterequestsatall serversandtoschedulequeryrequestscorrectly.thepoint-to-pointchannelsare Groupcommunication.Agoodoverviewoftherationalandusefulnessofgroup thoughthereisnoconsensusonwhatpropertiestheseservicesshouldprovide, nicationservicesareisis[5],transis[10],totem[25],newtop[12],relacs[3] thespecicorderinganddeliverypropertiesoftheirmulticastprimitives.even andhorus[27].dierentservicesdierinthewaytheymanagegroupsandin communicationservicesisgivenin[4].examplesofimplementedgroupcommu- rangeofdierentformalisms[3,6,8,11,15,24,26].fekete,lynch,andshvarts- descriptionsoftheirbehavior.manyspecicationshavebeenproposedusinga atypicalrequirementistodelivermessagesintotalorderandwithinaview. manrecentlypresentedthevsspecicationforapartitionablegroupcommu- nicationservice.pleasereferto[14]foradetaileddescriptionandcomparisonof Tobemostuseful,groupcommunicationserviceshavetocomewithprecise VSwithotherspecications. sentedaspecicationforgroupcommunicationservicethatprovidesadynamic anddolev[7]haveusedthesamestyletospecifyavirtuallysynchronousfifo groupcommunicationserviceandtomodelanadaptivetotally-orderedgroup communicationservice.deprisco,fekete,lynchandshvartsman[9]havepre- SeveralpapershavesinceextendedtheVSspecication.Chockler,Huleihel, ingalloperationsinthesamesequenceatallcopies.thedetailsofdoingthis municationservicesisformaintainingcoherentreplicateddatathroughapply- notionofprimaryview. ReplicationandLoadBalancing.Themostpopularapplicationofgroupcom-
3 Melliar-Smith,Moser,andVaysburd[18,2,1,19,16,17]. inpartitionablesystemshavebeenstudiedbyamir,dolev,friedman,keidar, aremadebyclients,andtasksaresentdirectlytotheassignedservers.inthe secondstyle,tasksaremulticasttoallserversinthegroup;eachserverthen balancingalgorithms.intherst,moretraditional,style,schedulingdecisions ideallysuitedforfault-tolerantload-balancing.hesuggeststwostylesofload- Inhisrecentbook[4,p.329],Birmanpointsoutthatprocessgroupsare appliesadeterministicruletodecideonwhethertoaccepteachparticulartask. isassignedtotheserverwhoserankwithinthisgroupis(imodn).thisstrategyreliesonthefactthatallserversreceiverequestsinthesameorder,anman[4,p.329].accordingtothisstrategy,queryrequestsaresenttotheservers Inthispaper,weusearound-robinstrategyoriginallysuggestedbyBir- usingtotally-orderedmulticast;theithrequestdeliveredinagroupofnservers membershipchanges. Weextendthisstrategywithafail-overpolicythatreissuesrequestswhengroup SequentialConsistency.Therearemanydierentwaysinwhichacollectionof guaranteesauniformdistributionofrequestsamongtheserversofeachgroup. tinguishabletoeachindividualclient.amuchstrongercoherencepropertyis inalworkindeningthesepreciselyislamport'sconceptofsequentialconsis- tency[21].asystemprovidessequentialconsistencywhenforeveryexecution replicasmayprovidetheappearanceofasingleshareddataobject.thesem- ofthesystem,thereisanexecutionwithasinglesharedobjectthatisindistemfromonewithasinglesharedobject.thealgorithmofthispaperprovides atomicity,whereauniversalobservercan'tdistinguishtheexecutionofthesys- Contributionsofthispaper anintermediateconditionwheretheupdatesareatomic,butqueriesmaysee Thispaperpresentsanewalgorithmforprovidingreplicateddataontopof resultsthatarenotasup-to-dateasthosepreviouslyseenbyotherclients. apartitionablegroupcommunicationsystem,inwhichtheworkofprocessing algorithmisbasedonpreviousideas(theload-balancingprocessingofqueriesis queriesisrotatedamongthegroupreplicasinaround-robinfashion.whilethe thattheserversalwayshavesucientlyadvancedstatestoprocessthequeries. showhowqueriescanbeprocessedinminoritypartitions,andhowtoensure ofapreviouslypublishedaccountofawaytointegratethese.inparticular,we takenfrom[4]andtheupdateprocessingrelatesto[18,2,1,19])weareunaware generateuniquelabels).theproofin[14]usesthepropertyofagreedmessage asense,thetoapplicationisanonymous,sinceanodeusesitsidentityonlyto canusesomeofthestrongerpropertiesofvs.previouswork[14]veriedto, anapplicationinwhichallnodeswithinaviewprocessmessagesidentically(in Anotherimportantadvanceinthisworkisthatitshowshowaverication sequence,butitdoesnotpayattentiontotheidenticalviewofmembershipat theydecidewhichmemberwillrespondtoaquery. allrecipients.incontrast,thispaper'sload-balancingalgorithm(andthusthe proof)usesthefactthatdierentrecipientshavethesamemembershipsetwhen
4 nology.section3presentsaformalspecicationforclients'viewofthereplicated service.section4containsanintermediatespecicationfortheservice,thepurposeofwhichistosimplifytheproofofcorrectness.section5presentsani/o Therestofthepaperisorganizedasfollows.Section2introducesbasictermi- automatonfortheserver'sstate-machineandoutlinestheproofofcorrectness. 2MathematicalFoundations disjointunions(+),whichdiersfromtheusualsetunion([)inthateachelementisimplicitlytaggedwithwhatcomponentitcomesfrom.forsimplicity,wtions(!),andpartialfunctions(,!).somewhatnon-standardisouruseof Weusestandardandself-explanatorynotationonsets,sequences,totalfunc- denesageneralrequesttype.furthermore,ifreq2request,anduandqarethe \matchingconstructs."thus,forexample,ifupdateandqueryaretherespectivetypesforupdateandqueryrequests,thentyperequest=update+query establishedvariableconventionsforupdateandquerytypes,then\req usevariablenameconventionstoavoidmoreformal\injectionfunctions"and automatonisasimplestate-machineinwhichthetransitionsareassociated andtuttle[23](withoutfairness),alsodescribedinchapter8of[22].ani/o and\req=q"arebothvalidstatements. ThemodelingisdoneintheframeworkoftheI/OautomatonmodelofLynch u" withnamedactions,whichcanbeeitherinput,output,orinternal.therst twoareexternallyvisible,andthelasttwoarelocallycontrolled.i/oautomata denedbyitssignature(input,outputandinternalactions),setofstates,set areinput-enabled,i.e.,theycannotcontroltheirinputactions.anautomatonis ofstartstates,andastate-transitionrelation(across-productbetweenstates, capturedbythesetoftracesgeneratedbyitsexecutions.executionfragments tionfragmentthatbeginswithastartstate.thesubsequenceofanexecution consistingofalltheexternalactionsiscalledatrace.theexternalbehavioris andactionsconsistentwiththetransitionrelation.anexecutionisanexecu- actions,andstates).anexecutionfragmentisanalternatingsequenceofstates canbeconcatenated.compatiblei/oautomatacanbecomposedtoyielda ofanautomatonasinternal. complexsystemfromindividualcomponents.thecompositionidentiesactions thathaveintheirsignatures.thehidingoperationreclassiesoutputactions automataperformsastepinvolvingaction,sodoallcomponentautomata withthesamenameindierentcomponentautomata.whenanycomponent Toprovethatoneautomatonimplementsanotherinthesenseoftraceinclusion, executionsequence.arenementmappingisasingle-valuedsimulationrelation. ofthatautomaton.theyareusuallyprovedbyinductiononthelengthofthe itissucienttopresentarenementmappingfromthersttothesecond.a Invariantsofanautomatonarepropertiesthataretrueinallreachablestates functionisprovedtobearenementmappingbycarryingoutasimulation actionintoasingleatomicpieceofcode. proof,whichusuallyreliesoninvariants(seechapter8of[22]). whichgroupstogetherallthetransitionsthatinvolveeachparticulartypeof Wedescribethetransitionrelationinaprecondition-eectstyle(asin[22]),
5 ass:dbs.likewise,ifviewisastatevariableofaserverp,thenitsinstanceina dbsisastatevariableofanautomaton,thenitsinstanceinastatesisexpressed statetisexpressedast[p]:vieworasp:viewiftisclearfromthediscussion. Toaccesscomponentsofcompoundobjectsweusethedotnotation.Thus,if 3ServiceSpecicationS isgiveninfigure1.theautomatonsappearsinfigure2. mationonbasicandderivedtypes,alongwithaconventionforvariableusage, Inthissection,weformallyspecifyourreplicateddataservicebygivingacen- Fig.1Typeinformation tralizedi/oautomatonsthatdenesitsallowedbehavior.thecompleteinfor- rdbdb cvartype C Description oquupdate:db!db a Request=Update+QueryRequestisadisjointunionofUpdateandQuerytypes. Output=Answer+fokgOutputisadisjointunionofAnswerandfokgtypes. Query:DB!Answer Queriesarefunctionsfromdatabasestatestoanswers. Updatesarefunctionsfromdatabasestatestodatabasestates. Databasetypewithadistinguishedinitialvaluedb0. FinitesetofclientIDs.(c:procreferstotheserverofc). Answertypeforqueries.Answersforupdatesarefokg. ofoutputvalueotoaclientc. oftheformrequest(r)c,representingthesubmissionofrequestrbyaclientc;s client-serverarchitecture:clients'requestsaredeliveredtosviainputactions repliestoitsclientsviaactionsoftheformreply(o)c,representingthedelivery Theinterfacebetweentheserviceanditsblockingclientsistypicalofa thereplicatedsystem,thiswouldimplythatprocessingofqueryrequestswould vice),thenspecicationswouldincludeastatevariabledboftypedband wouldapplyupdateandqueryrequeststothelatestvalueofthisvariable.in havetoberestrictedtotheprimarycomponentsofthenetwork. Ifourserviceweretosatisfyatomicity(i.e.,behaveasanon-replicatedser- thatisatleastasadvancedasthelastonewitnessedbythequeries'client.for thispurpose,smaintainsahistorydbsofdatabasestatesandkeepsanindex beprocessedwithrespecttothelatestvalueofdb,onlywithrespecttothevalue service,wegiveaslightlyweakerspecication,whichdoesnotrequirequeriesto Inordertoeliminatethisrestrictionandthusincreasetheavailabilityofthe last(c)tothelateststateseenbyeachclientc. clientasanon-replicatedone,andthus,satisessequentialconsistency.note that,sincetheatomicityhasbeenrelaxedonlyforqueries,theserviceisactually strongerthantheweakestoneallowedbysequentialconsistency. Eventhoughourserviceisnotatomic,itstillappearstoeachparticular whereeachccmodelsanondeterministicblockingclientc(seefigure3);real formally,weclosesbycomposingitwiththeautomatonenv=qc2c(cc), because,asani/oautomaton,itisinput-enabled.toexpressthisassumption theygetrepliesfortheircurrentones)cannotbeexpressedwithinautomatons Theassumptionthatclientsblock(i.e.,donotsubmitanynewrequestsuntil blockingclientscanbeshowntoimplementthisautomaton.intheclosedautomatons,therequestactionsareforcedtoalternatewiththereplyactions,
6 Output: reply(o)c;o2output;c2c Fig.2SpecicationS Signature: Input: request(r)c;r2request;c2c Internal: map2c,!(request+output),initially?.buerfortheclients'pendingrequestsorreplies. State: dbs2seq0db,initiallydb0.sequenceofdatabasestates.indexingfrom0tojdbsj 1. query(c;q;l);c2c;q2query;l2n update(c;u);c2c;u2update last2c!n,initiallyf!0g.indexofthelastdbstatewitnessedbyid. update(c;u) Transitions: request(r)c E:dbs Pre:u=map(c) E:map(c) r reply(o)c Pre:map(c)=o last(c) dbs+u(dbs[jdbsj 1]) ok query(c;q;l) E:map(c) Pre:q=map(c) E:map(c) last(c)ljdbsj 1 lq(dbs[l])? whichmodelstheassumedbehavior.intherestofthepaper,weconsiderthe Fig.3ClientSpecicationCc Signature: Input: closedversionsofthepresentedautomata,denotingthemwithabar(e.g.,s). State:busy2Bool,initiallyfalse.Statusag.Keepstrackofwhetherthereisapendingrequest. reply(o)c;o2output Transitions: request(r)c Output: Pre:busy=false request(r)c;r2request true reply(o)c 4IntermediateSpecicationDE:busy centralizeddatabase,anditsetsclient-specicvariables,map(c)andlast(c),to theirnewvalues.inadistributedsetting,thesetwotasksaregenerallyaccomplishedbytwoseparatetransitions.tosimplifytherenementmappingbetween ActionupdateofspecicationSaccomplishestwologicaltasks:Itupdatesthe Fig.4IntermediateSpecicationD (seefigure4),inwhichthesetasksareseparated.disformedbysplitting theimplementationandthespecication,weintroduceanintermediatelayerd Transitions:SameasinS,exceptupdateismodiedandserviceisdened. update(c;u) Signature:SameasinS,withtheadditionofaninternalactionservice(c);c2C. State: E:dbs Pre:u=map(c) delay(c) c62dom(delay) dbs+u(dbs[jdbsj 1]) SameasinS,withtheadditionofastatevariabledelay2C,!N,initially?. service(c) E:map(c) Pre:c2dom(delay) eachupdateactionofsintotwo,updateandservice.therstoneextends last(c) delay(c) delay(c) ok?
7 to\ok"andusesinformationstoredindelaytosetlast(c)toitsvalue. dbswithanewdatabasestate,butinsteadofsettingmap(c)to\ok"andlast(c) Lemma1ThefollowingfunctionDS()isarenementfromDtoSwithrespect databasestatewitnessedbyc)indelaybuer.thesecondactionsetsmap(c) toitsnewvalueasins,itsavesthisvalue(i.e.,theindextothemostrecent toreachablestatesofdands.1 DS(d:D)!S s:last s:map s:dbs s:busyc = overlay(d:last;d:delay) overlay(d:map;fhc;okijc2dom(d:delay)g) d:dbs TransitionsofDsimulatetransitionsofSwiththesameactions,exceptforthose dence,themappingandtheproofarestraightforward.thelemmaimpliesthat thatinvolveservice;thesesimulateemptytransitions.giventhiscorrespon- d:busycforallc2c aboutimplementationtandspecicationd,whichbytransitivityofthe\implements"relationimpliesthattimplementssinthesenseoftraceinclusion. 5ImplementationT Thegurebelowdepictsthemajorcomponentsofthesystemandtheirinteractions.SetPrepresentsthesetofservers.Eachserverp2Prunsanidentical state-machinevstodpandservestheclientswhosec:proc=p. request(r)cp gpsnd(m)preply(r)cp gprcv(m)q;p VStoDp request(r) safe(m)q;p c0pnewview(v)p reply(r)c0prequest(r)cqreply(r)cqrequest(r)c0qreply(r)c0q PTP VSgpsnd(m)qgprcv(m)p;qVStoDq safe(m)p;qnewview(v)q icationvs[14,seeappendixa]andacollectionptpofreliablereordering servers'layeri=qp2p(vstodp)withthegroup-communicationservicespec- point-to-pointchannelsbetweenanypairofservers[22,pages ],withall theoutputactionsofthiscompositionhidden,exceptfortheservers'replies. TheI/OautomatonTfortheserviceimplementationisacompositionofthe DimplementsSinthesenseoftraceinclusion.Later,weprovethesameresult 1Givenf;g:X,!Y,overlay(f;g)isasgoverdom(g)andasfelsewhere. T=hideout(IVSPTP) freply(o)cg IVSPTP:
8 ure5.thei/ocodeforthevstodpstatemachineisgiveninfigures6and7. 5.1TheServer'sState-MachineVStoDp Fig.5AdditionalTypeDeclaration VarType Theadditionaltypeandvariable-nameconventioninformationappearsinFig- vgmm=cupdate+ xqp(p) V=GP(P) hg;<g;g0i X=G(CUpdate)NExpertiseinformationforexchangeprocess.Fields:xl,us,su. CQueryN+Xorexpertiseinformationforexchangeprocess. Anelementofthissetiscalledaview.Fields:idandset. Fixedsetofquorums.ForanyQ2QandQ02Q,Q\Q06=;. Totally-orderedsetofviewidswiththesmallestelement. MessagessentviaVS:Eitherupdaterequests,queryrequests, Description pktpkt=canswerngpacketssentviaptp.(nisindexofthewitnesseddbstate.) one.wealsodistinguishwhetherornottheserverisamemberofaprimaryview, tioninalreadyestablishedview,whilerecoveryactivity inanewlyforming modebeingnormal,orrecovery,markedbymodebeingeitherexpertisebroadcast orexpertisecollection.normalactivityisassociatedwiththeserver'sparticipa- Theactivityoftheserver'sstate-machinecanbeeithernormal,markedby whichisdenedasthatwhosememberscompriseaquorum(view:set2q). Fig.6Implementation(VStoDp):SignatureandStateVariables Signature: Input: request(r)c;r2request;c2c;c:proc=p gprcv(m)p0;p;m2m;p02p safe(m)p0;p;m2m;p02p newview(v)p;v2v ptprcv(pkt)p0;p;pkt2pkt;p02p Internal: Output: query(c;q;l);c2c;u2update ptpsnd(pkt)p;p0;pkt2pkt;p02p gpsnd(m)p;m2m update(c;u);c2c;u2update reply(o)c;o2output;c2c;c:proc=p map2cj(c:proc=p),!request+output,buerthatmapsclientstotheirrequestsorreplies. last2cj(c:proc=p)!n, State: db2db,initiallydb0. pending2p(cj(c:proc=p)),initially;. initiallycj(c:proc=p)!0. initially?. Indexofthelastdbstateseenbyeachclient. Setofclientswhoserequestsarebeingprocessed. Localreplica.Nextstatedependsoncurrentandaction. updates2(cupdate),initially[]. lastupdate2n,initially0. Sequenceofupdates.Indexingfrom1.Fields:candu. mode2fnormal;expertisebroadcast; queries2c,!(query+answer)n,queryrequestsoranswers,pairedwiththeirlast(c). querycounter2n,initially0. view2v,initiallyv0=hg0;pi. safetoupdate2n,initially0. initially?. Currentviewofp.Fields:idandset. Indexofthelastexecutedelementinupdates. Indexofthelast\safetoupdate"elementinupdates. expertcounter12n,initially0. expertiselevel2g,initiallyg0. expertisecollectiong,initiallynormal. Numberofqueriesreceivedwithincurrentview. expertcounter22n,initially0. expertisemax2x,initiallyhg0;[];0i. Cumulativeexpertisecollectedduringrecovery. Modesofoperation.Thelasttwoareforrecovery. Thehighestprimaryviewidthatpknowsof. Numberofexpertisemessagesreceivedsofar. Thefactthatserversofthesameviewreceivequeryrequestsinthesameorder gprcv(c;q;l)p0;p,query(c;q;l)p,ptpsnd(c;a;l;g)p;p0,andptprcv(c;a;l;g)p0;p. Processingofqueryrequestsishandledbyactionsofthetypegpsnd(c;q;l)p, Numberofexpertisemessagesreceivedsofarassafe. requestsuniformlyamongtheserversofoneview. guaranteesthattheschedulingfunctionofgprcv(c;q;l)p0;pdistributesquery
9 Fig.7ImplementationVStoDp:Transitions Transitions: request(r)c gpsnd(c;q;l)p E:map(c) Pre:mode=normal E:pending q=map(c)^c62pending l=last(c) r reply(o)c gprcv(c;q;l)p0;p E:querycounter if(rank(p;view:set)= thenqueries(c) querycountermodjview:setj) pending[c query(c;q;l) Pre:hq;li2queries(c) querycounter+1 gpsnd(c;u)p Pre:map(c)=o E:map(c)? ptpsnd(c;a;l;g)p;p0 E:queries(c) lastupdatel hq(db);lastupdatei hq;li safe(c;u)p0;p gprcv(c;u)p0;p E:pending Pre:mode=normal^view:set2Q u=map(c)^c62pending pending[c ptprcv(c;a;l;g)p0;p E:queries(c) E:if(g=view:id^c:proc=p)then Pre:c2dom(queries)^c:proc=p0 update(c;u) E:safetoupdate E:updates updates+hc;ui ha;li2queries(c) E:lastupdate Pre:lastupdate<safetoupdate hc;ui=updates[lastupdate+1] safetoupdate+1 map(c) last(c) pending lapending c? gprcv(x)p0;p db u(db) newview(v)p E:expertisemax if(c:proc=p)then pending pending c E:queries expertcounter1 pending expertisemax safetoupdate maxflast(c)jc2c^c:proc=pg?;querycounter pending fcj(9q:hc;qi2map)g expertisemax0 max safetoupdate; 0;expertcounter2 0 if(expertcounter1=jview:setj)then map(c) last(c) ok lastupdate maxx(expertisemax;x) expertisemax:xl expertcounter1+1 gpsnd(x)p Pre:mode=expertisebroadcast x=hexpertiselevel;updates;safetoupdatei view vexpertisebroadcast 0safe(x)p0;p updates expertisemax:us E:expertcounter2 if(view:set2q)then safetoupdate expertiselevel expertisemax:su if(expertcounter2=jview:setj)then expertcounter2+1 view:id E:mode expertisecollection if(view:set2q)then safetoupdate fcjc2pending^ c62updates[(lastupdate+1):: pending jexpertisemax:usj onlywhenthecurrentstateofthelocaldatabaseisatleastasadvancedasthe Servicingofeachquerybyabackgroundthreadquery(c;q;l)pisallowed mode normal safetoupdate]:cg servicethequeriesthatareassignedtothem. laststatewitnessedbyitsclient.thisconditioniscapturedbylastupdatel. Thenon-trivialpartofthisprotocolisthattheserviceactuallyguaranteesthat theserversalwayshavethesucientlyadvanceddatabasestatestobeableto gprcv(c;u)p0;p,safe(c;u)p0;p,andupdate(c;u).eachservermaintainsasequenceupdatesofupdaterequests,thepurposeofwhichistoenforcetheorderin recoveryprocedure,inwhichitmovesitsownpendingqueriesforreprocessing anderasesanyinformationpertainingtothequeriesofothers. Whenaserverlearnsofitsnewview,itexecutesasimplequery-related eachtimeanupdaterequestisdeliveredviaagprcvaction.thesequencehastwo whichupdatesareappliedtothelocaldatabasereplica.thesequenceisextended Processingofupdaterequestsishandledbyactionsofthetypegpsnd(c;u)p,
10 safetoexecuteandthosethathavealreadybeenexecuted.thesafeprexis calledsafeanddone,thatmarkrespectivelythoseupdaterequeststhatare distinguishedprexesupdates[1::safetoupdate]andupdates[1::lastupdate], serversareconsistent(i.e.,givenanytwo,oneisaprexofanother).sincedone prexesmarkthoseupdaterequeststhathavebeenappliedtodatabasereplica, view.2theserviceguaranteesthatatalltimessafeanddoneprexesofall extendedtocoveracertainupdaterequestonupdatessequencewhentheserver thispropertyimpliesmutualconsistencyofdatabasereplicas. learnsthattherequesthasbeendeliveredtoallothermembersofthatserver's safe(x)p0;p.thequery-relatedpartofthisactivitywasdescribedabove.for ishandledbyactionsofthetypenewview(v)p,gpsnd(x)p,gprcv(x)p0;p,and thatthestatesofalltheserversofthisviewareconsistentwiththeirandother theupdate-relatedpart,theserverhastocollaboratewithothersonensuring Whenaserverlearnsofitsnewview,itstartsarecoveryactivitythat servers'pastexecutionhistoriesandaresuitablefortheirsubsequentnormal activity. keepstrackofthisinformationinitsstatevariableexpertiselevel.twoother viewofwhichtheserverknows.thisknowledgemayhavecomedirectlyfrom personalparticipationinthatview,orindirectlyfromanotherserver.theserver comparedtothoseofothers.themostimportantcriterionisthelatestprimary Forthispurpose,eachserverhastobeabletotellhowadvanceditsstateis criteriaaretheserver'supdatessequenceanditssafeprex.thevaluesofthese ofexpertiseelementsisdenedasthefollowingtriple Denition1Thecumulativeexpertise,maxX(X),ofasetorasequence,X, threevariablescomprisetheserver'sexpertise. maxx(x)=max<gfx:xljx2xg; 2Someoftheoptimisticprotocols,suchas[16,17],executerequestsassoonasthey max<jjfx:usj(x2x)^(x:xl2max<gfx:xljx2xg)g; aredeliveredbyatotalordermulticast(abcastofhorus),butmayresultin inconsistentreplicas,inwhichcasetheyhavetoundoactionsandrollthereplicas' max<nfx:sujx2xg: statesback.ontheotherhand,pessimisticprotocols,whichimplementstrictmutual consistencyamongreplicas,requireadditionalinformationbeforetheyareableto totalordermulticastwithsafedelivery,i.e.,amessagedeliveredtoonememberis executedonlywhenaservercollectsamajorityofacknowledgments,whichhaveto andmoserin[1,2]eliminatetheneedforend-to-endacknowledgmentsbyusing bemulticastbyeachserveronceitreceivestherequest.amir,dolev,melliar-smith, executeadeliveredrequest.thepessimisticversionin[17]allowsforarequesttobe guaranteedtobedeliveredtoanyothermemberofthesameviewprovideditdoes notcrash.aspointedoutin[14,13],\asimple'coordinatedattack'argument(asin Chapter5of[22])showsthatinapartitionablesystem,thisnotionofsafedelivery thosebasedonvs,whichseparatesmessagedeliveryandsafenoticationevents. Asaresult,protocolsbasedonthismulticastprimitivearemorecomplicatedthan isincompatiblewithhavingallrecipientsinexactlythesameviewasthesender."
11 completedwithadeliveryofthelastexpertisemessageviaactiongprcv(x)p0;p. ofotherserverscannotcauseinconsistencyamongreplicas.therststepis cumulativeexpertise(seedef.1).noticethatadoptingcumulativeexpertise aimsatadvancingeveryone'sexpertisetothehighestoneknowntothem their Asarststep,theserver'scollaborationwithothersduringrecoveryactivity propagationofupdaterequeststopreviouslyinaccessiblereplicas.second,it ensuresthefutureabilityofserverstoprocessthequeriesassignedtothem. Inadditiontoadvancingtheirexpertise,theserversofprimaryviewshave Advancingtheserver'sexpertiseachievestwopurposes.First,itensuresthe oncetheserverofaprimaryviewlearnsthatallexpertisemessageshavebeen identicalupdatessequences,theentirecontentofwhichissafeandcontainsas prexesthesafeprexesofallotherserversinthesystem.forthispurpose, normalactivity,whichsubsumesthattheyhavetostartnormalactivitywith toensuretheirabilitytoprocessnewupdaterequestsoncetheyresumetheir deliveredtoallserversofthisview,itextendsitssafeprextocovertheentire updatessequenceadoptedduringtheexchangeprocess. subsequentprimaryviewshavehigheridentiers. primaryviewswillcontainintheirupdatessequences.attainmentofthisbehaviordependsontheintersectionpropertyofprimaryviewsandthefactthat Theresultantsafeprexactsasanewbasethatallserversofthefuture thisbasebackforreprocessing.afterthisstep,theservermayresumeitsnormal viewestablishesthebase,itmovesallpendingupdaterequeststhatarenotin areresubmittedbytheiroriginalservers.therefore,onceaserverofaprimary thatarenotincludedinthebasewillneverndawaytoasafeprexunlessthey Theestablishedbaseworksasadivider:partiallyprocessedupdaterequests 5.2RenementMappingfromTtoD activity,whichenablesittoprocessnewupdateandqueryrequests. reply(o)caresimulatedwhenttakesthecorrespondingactions.actionsof AutomatonDhasvetypesofactions.Actionsofthetypesrequest(r)cand update(c;u)poftasleadingwhent[p]:lastupdate=max}ft[}]:lastupdateg, thetypequery(c)aresimulatedwhentexecutesptprcv(c;a;l;g)p0;pwith latedundercertainconditionswhentexecutesupdate(c;u)p.wedeneactions thatarejustnativesimulateservice(c),thatarebothleadingandnativesimulate\update(c),service(c)",andthatareneithersimulateemptytransitions. g=p:view:id.thelasttwotypes,update(c)andservice(c),arebothsimu- andasnativewhenc:proc=p.actionsthatarejustleadingsimulateupdate(c), Lemma2ThefollowingfunctionisarenementfromTtoDwithrespectto reachablestatesoftandd.3 TransitionsofTwithanyotheractionssimulateemptytransitionsofD. 3Ifsis\f1;f2;:::;fn"witheachfi:A!A,andifa2A,thenscan(s)= =\f1;(f2f1);:::;(fn:::f2f1)"andmap(s;a)=\f1(a);f2(a);:::;fn(a)".
12 TD(t:T)!D= lett:done=t[}]:updates[1::t[}]:lastupdate],where}2pisanysuchthat last map dbs Sp2Pt[p]:last Sp2Pt[p]:map db0+map(scan(t:done);db0) t[}]:lastupdate=maxp2pft[p]:lastupdateg delay busyc fht:done[i]:c;iij1ijt:donej^t[t:done[i]:c:proc]:lastupdate<ig arethesame.t:doneisaderivedvariablethatdenotesthelongestsequence serversareconsistent.inparticular,allsequenceswhichhavemaximumlength Aninvariantwillshowthatsequencesofprocessedrequestsatdierent t:busyc forallc2c ofupdaterequestsprocessedinthesystem.thissequencecorrespondstoall quests).witheachcinthisdomainweassociateitspositioninsequencet:done. dened.domainoftd(t):delayconsistsofidsofupdaterequeststhathavebeen modicationsdonetothedatabaseofd,whichexplainsthewaytd(t):dbsis explainsthewayd:delayisdened. Thispositioncorrespondstothelastdatabasestatewitnessedbyclientc,which processedsomewhere(i.e.,int:done)butnotattheirnativelocations(i.e.,the lastupdateattheirnativelocationshavenotyetsurpassedtheseupdatere- theirdoneprexesarethesame: I2Foranytwoserversp1andp22P,ifthelengthsoftheirdoneprexesarethesame,then Fig.8InvariantsusedintheproofthatTD()isarenementmapping(Lemma2) I1Foreachserverp2P,p:lastupdatep:safetoupdatejp:updatesj. c:proc:lastupdate<ip:safetoupdate,thenhc;ui2c:proc:mapandc2c:proc:pending. tionisstillreectedinitsnativemapandpendingbuers:ifhc;ui=p:updates[i]and I3Anyupdaterequestthatissafesomewherebuthasnotbeenexecutedatitsnativeloca- p1:lastupdate=p2:lastupdate)p1:updates[1::p1:lastupdate]=p2:updates[1::p2:lastupdate]: I4Atmostoneunexecutedupdaterequestpereachclientcanappearatthatclient'sserver:For anyclientc2c,thereexistsatmostoneindexi2nsuchthati>c:proc:lastupdateand Moreover,ifp:view:id=gthen I5ForallPTPpacketshc;a;l;gionain-transitp0;pchannel,itfollowsthatc:proc=p. c=c:proc:updates[i]:c. (a)c2dom(p:map)^p:map(c)2query (b)c2p:pending (d)lp:last(c) TheproofofLemma2isstraightforwardgiventhevetop-levelinvariantsin (c)a=p:map(c)(compose(p:updates[1::l])(db0)) (e)lmax}f}:lastupdateg withunsafeportionsofupdatessequences(becausethelatterbecometheformer tohavepropertiesonlyaboutsafeprexes weneedinvariantsthatdealalso approach[20]:oneofthefundamentalinvariantsstatesthatsafeprexesof updatessequencesatallserversareconsistent.toprovethisfact,itisnotenough Figure8.Toprovetheseinvariantsassertionallywehavedevelopedaninteresting ofdierentserversdependontheservers'expertiselevel,whichmayhavecome duringanexecution).invariantsthatrelatesafeprexesandupdatessequences
13 towhichthereplicationpartofthealgorithmoperates.therecursivenatureof ofservers'expertiseinearlierviews.inasense,itpresentsthelawaccording toaserverdirectlyfromtheparticipationinaprimaryview,orindirectlyfrom recursivelythehighestexpertiseachievedbyeachserverineachviewinterms thisfunctionmakesproofsbyinductioneasy:provinganinductivestepinvolves someoneelse.inourproof,wehaveinventedaderivedfunctionxthatexpresses 6FutureWork unwindingonlyonerecursivestepofthederivedfunctionx. goodbehavioroftheunderlyingnetwork.inparticular,weareplanningtocomparetheresponsetimeofthisalgorithmwithotherswhichsharequeryload dierently,forexamplebasedonrecentrun-timeloadreportswhicharedisseminatedbymulticastmanceandfault-toleranceproperties,statedconditionallytoholdinperiodsof Thispaperhasdealtwithsafetyproperties;futureworkwillconsiderperfor- messagecommunicationintothegroupcommunicationlayer. References dynamically,usingaservicesuchastheonein[9],andintegratingtheunicast Otherpossibleextensionstothisworkinvolvedeterminingprimaryviews 1.Y.Amir.ReplicationusingGroupCommunicationoveraPartitionedNetwork. 3.O.Babaoglu,R.Davoli,L.Giachini,andP.Sabattini.Theinherentcostofstrongpartialview-synchronouscommunication.LNCS,972:72{86,1995. usinggroupcommunication.technicalreport94-20,thehebrewuniversityof 2.Y.Amir,D.Dolev,P.Melliar-Smith,andL.Moser.Robustandecientreplication Jerusalem,Israel,1994. PhDthesis,TheHebrewUniversityofJerusalem,Israel, K.P.Birman.BuildingSecureandReliableNetworkApplications.ManningPublicationsCo.,Greenwich,CT, K.P.BirmanandR.vanRenesse,editors.ReliableDistributedComputingwith 6.T.D.Chandra,V.Hadzilacos,S.Toueg,andB.Charron-Bost.Ontheimpossibility theisistoolkit.ieeecomputersocietypress, G.V.Chockler,N.Huleihel,andD.Dolev.Anadaptivetotallyorderedmulticastprotocolthattoleratespartitions.InProceedingsofthe17hAnnualACM PrinciplesofDistributedComputing,pages322{330,NewYork,USA,May1996. ofgroupmembership.inproceedingsofthe15thannualacmsymposiumon SymposiumonPrinciplesofDistributedComputing,pages237{246, R.DePrisco,A.Fekete,N.Lynch,andA.Shvartsman.Adynamicview-oriented 8.F.Cristian.Group,majority,andstrictagreementintimedasynchronousdistributedsystems.InProceedingsoftheTwenty-SixthInternationalSymposiumon onprinciplesofdistributedcomputing,pages227{236,1998. groupcommunicationservice.inproceedingsofthe17hannualacmsymposium Fault-TolerantComputing,pages178{189,Washington,June25{27,1996.IEEE. 11.D.Dolev,D.Malki,andR.Strong.Aframeworkforpartitionablemembership 10.D.DolevandD.Malki.TheTransisapproachtohighavailabilityclustercommunication.CommunicationsoftheACM,39(4):64{70,Apr service.technicalreporttr94-6,departmentofcomputerscience,hebrewuniversity,1994.
14 12.P.D.Ezhilchelvan,R.A.Mac^edo,andS.K.Shrivastava.Newtop:Afault-tolerant 13.A.Fekete,N.Lynch,andA.Shvartsman.Specifyingandusingapartionablegroup groupcommunicationprotocol.inproceedingsofthe15thinternationalconference 14.A.Fekete,N.Lynch,andA.Shvartsman.Specifyingandusingapartionablegroup ondistributedcomputingsystems(icdcs'95),pages296{306,losalamitos,ca, USA,May30{June2,1995.IEEEComputerSocietyPress. communicationservice.extendedversion, 15.R.FriedmanandR.vanRenesse.StrongandweakvirtualsynchronyinHorus. communicationservice.inproceedingsofthesixteenthannualacmsymposium onprinciplesofdistributedcomputing,pages53{62,santabarbara,california, Aug.21{24,1997. TechnicalReportTR ,CornellUniversity,ComputerScienceDepartment, 17.R.FriedmanandA.Vaysburd.High-performancereplicateddistributedobjects 16.R.FriedmanandA.Vaysburd.Implementingreplicatedstatemachinesoverpartitionablenetworks.TechnicalReportTR ,CornellUniversity,Computer Aug.24,1995. Science,Apr.17, I.Keidar.Ahighlyavailableparadigmforconsistentobjectreplication.Master's ComputerScience,July16,1997. inpartitionableenvironments.technicalreporttr ,cornelluniversity, 19.I.KeidarandD.Dolev.Ecientmessageorderingindynamicnetworks.InProceedingsofthe15thAnnualACMSymposiumonPrinciplesofDistributedComputing, pages68{76,newyork,usa,may1996. thesis,instituteofcomputerscience,thehebrewuniversityofjerusalem,israel, 20.R.I.Khazan.Groupcommunicationasabaseforaload-balancingreplicated 21.L.Lamport.Howtomakeamultiprocessorcomputerthatcorrectlyexecutes 22.N.A.Lynch.DistributedAlgorithms.MorganKaufmannseriesindatamanagementsystems.MorganKaufmannPublishers,LosAltos,CA94022,USA,1996. dataservice.master'sthesis,departmentofelectricalengineeringandcomputer Science,MassachusettsInstituteofTechnology,Cambridge,MA02139,May1998. multiprocessprograms.ieeetransactionsoncomputers,c-28(9):690{691, L.E.Moser,Y.Amir,P.M.Melliar-Smith,andD.A.Agarwal.Extendedvirtualsynchrony.InProceedingsofthe14thInternationalConferenceonDistributed 23.N.A.LynchandM.R.Tuttle.Anintroductiontoinput/outputautomata. CWIQuarterly,2(3):219{246,1989.AlsoavailableasMITTechnicalMemo MIT/LCS/TM-373. ComputingSystems,pages56{65,LosAlamitos,CA,USA,June1994.IEEEComputerSocietyPress. 26.A.M.Ricciardi,A.Schiper,andK.P.Birman.Understandingpartitionsand 25.L.E.Moser,P.M.Melliar-Smith,D.A.Agarwal,R.K.Budhia,andC.A.Lingley-Papadopoulos.Totem:Afault-tolerantmulticastgroupcommunicationsystem. 27.R.vanRenesse,K.P.Birman,andS.Maeis.Horus:Aexiblegroupcommunicationsystem.CommunicationsoftheACM,39(4):76{83,Apr the\nopartition"assumption.technicalreporttr ,cornelluniversity, ComputerScienceDepartment,June1993. CommunicationsoftheACM,39(4):54{63,Apr.1996.
15 ATheVSSpecication TheVSspecicationof[14,13]isreprintedinFigure9.Mdenotesamessage alphabetandhg;<g;g0iisatotally-orderedsetofviewidentierswithan initialviewidentier.anelementofthesetv=gp(p)iscalledaview.if visaview,wewritev:idandv:settodenoteitscomponents. Fig.9VS-machine Signature: Input: gpsnd(m)p,m2m,p2p Output: gprcv(m)p;qhiddeng,m2m,p;q2p,g2g safe(m)p;qhiddenv,m2m,p;q2p,v2views newview(v)p,v2views,p2p,p2v:set Internal: createview(v),v2views vs-order(m;p;g),m2m,p2p,g2g State: createdv,initiallyfhg0;pig foreachp2p: currentviewid[p]2g,initiallyg0 foreachg2g: queue[g],anitesequenceofmp, initiallyempty foreachp2p,g2g: pending[p;g],anitesequenceofm, initiallyempty next[p;g]2n>0,initially1 nextsafe[p;g]2n>0,initially1 Transitions: createview(v) Pre:v:id>max(g:9S;hg;Si2created) E:created created[fvg newview(v)p Pre:v2created v:id>currentviewid[p] E:currentviewid[p] v:id gpsnd(m)p E:appendmtopending[p;currentviewid[p]] vs-order(m;p;g) Pre:misheadofpending[p;g] E:removeheadofpending[p;g] appendhm;pitoqueue[g] gprcv(m)p;q;hiddeng Pre:g=currentviewid[q] queue[g](next[q;g])=hm;pi E:next[q;g] next[q;g]+1 safe(m)p;q;hiddeng,s Pre:g=currentviewid[q] hg;si2created queue[g](nextsafe[q;g])=hm;pi forallr2s: next[r;g]>nextsafe[q;g] E:nextsafe[q;g] nextsafe[q;g]+1 VSspeciesapartitionableserviceinwhich,atanymomentoftime,every clienthaspreciseknowledgeofitscurrentview.vsdoesnotrequireclients tolearnabouteveryviewofwhichtheyaremembers,nordoesitplaceany consistencyrestrictionsonthemembershipofconcurrentviewsheldbydierent clients.itsonlyview-relatedrequirementisthatviewsarepresentedtoeach clientaccordingtothetotalorderonviewidentiers.vsprovidesamulticast servicethatimposesatotalorderonmessagessubmittedwithineachview,and deliversthemaccordingtothisorder,withnoomissions,andstrictlywithina view.inotherwords,thesequenceofmessagesreceivedbyeachclientwhileina certainviewisaprexofthetotalorderonmessagesassociatedwiththatview. Separatelyfromthemulticastservice,VSprovidesa\safe"noticationoncea messagehasbeendeliveredtoallmembersoftheview.
( ) = ( ) = {,,, } β ( ), < 1 ( ) + ( ) = ( ) + ( )
{ } ( ) = ( ) = {,,, } ( ) β ( ), < 1 ( ) + ( ) = ( ) + ( ) max, ( ) [ ( )] + ( ) [ ( )], [ ( )] [ ( )] = =, ( ) = ( ) = 0 ( ) = ( ) ( ) ( ) =, ( ), ( ) =, ( ), ( ). ln ( ) = ln ( ). + 1 ( ) = ( ) Ω[ (
More informationPerformance Monitoring Tool
Performance Monitoring Tool Do you have a transaction system, such as web servers, a data warehouse, transaction system using IMS, CICS, Amtrix, Tuxedo, etc. on which you have based your business? Do you
More informationImplementing Web Applications in MLPQ System. I. Designing web applications in MLPQ System
Implementing Web Applications in MLPQ System Shasha Wu (shwu@cse.unl.edu) I. Designing web applications in MLPQ System 1. Designing Infrastructure. Browser Web Service Constraint DB TCP/ IP H T M L TCP/IP
More informationThis is a training module for Maximo Asset Management V7.1. In this module, you learn to use the E-Signature user authentication feature.
This is a training module for Maximo Asset Management V7.1. In this module, you learn to use the E-Signature user authentication feature. Page 1 of 16 When you complete this module, you can perform these
More informationRelease 1984. Service Request 83299 UCRP Supplemental Assessment. Error Report 2374 PPP500 Error. Test Plan. July 25, 2011 Prepared by Sreelekha Sen
Release 1984 Service Request 83299 UCRP Supplemental Assessment Error Report 2374 PPP500 Error Prepared by Sreelekha Sen Information Resources & Communications Office of the President University of California
More informationROYAL REHAB COLLEGE AND THE ENTOURAGE EDUCATION GROUP. UPDATED SCHEDULE OF VET UNITS OF STUDY AND VET TUITION FEES Course Aug 1/2015
UPDATED SCHEDULE OF UNITS OF STUDY AND TUITION FEES Course Aug 1/2015 Course Name: Delivery Mode: BSB50215 Diploma of Business Online DBTEU01 01/08/2015 19/08/2015 31/10/2015 0.25 $4245 $3265 DBTEU02 01/11/2015
More informationSIMATIC S7-300, CPU 315-2DP CPU WITH MPI INTERFACE INTEGRATED 24 V DC POWER SUPPLY 128 KBYTE WORKING MEMORY 2
6ES7315-2AG10-0AB0 Page 1 Product data sheet 6ES7315-2AG10-0AB0 SIMATIC S7-300, CPU 315-2DP CPU WITH MPI INTERFACE INTEGRATED 24 V DC POWER SUPPLY 128 KBYTE WORKING MEMORY 2. INTERFACE DP-MASTER/SLAVE
More informationAGraphDrawingandTranslationServiceon StinaBridgeman,AshimGargandRobertoTamassia DepartmentofComputerScience thewww*
AGraphDrawingandTranslationServiceon StinaBridgeman,AshimGargandRobertoTamassia DepartmentofComputerScience thewww* Abstract.Bothpractitionersandresearcherscantakebetteradvantageofthelatestdevelopmentsingraphdrawingifimplementationsof
More informationSupported Platforms and Software Requirements Effective on 7 May.2014. HULFT-DataMagic for Windows Ver.2.2.0
Supported Platforms and Software Requirements Effective on 7 May.2014 for Ver.2.2.0 for Ver.2 English Edition Code conversion option for English Edition Database connectivity option (DB2) for English Edition
More informationApplications & Tools. Configuration of Messages and Alarms in WinCC (TIA Portal) WinCC (TIA Portal) Application description December 2012
Cover Configuration of Messages and Alarms in WinCC (TIA Portal) WinCC (TIA Portal) Application description December 2012 Applications & Tools Answers for industry. Siemens Industry Online Support This
More informationCDX Fuels Programs Registration User Guide for Responsible Corporate Officers. Version 3.02
CDX Fuels Programs Registration User Guide for Responsible Corporate Officers Version 3.02 CDX Fuels Programs Registration User Guide for Responsible Corporate Officers Version 3.02 Compliance Division
More informationVerify Needed Root Certificates Exist in Java Trust Store for Datawire JavaAPI
Verify Needed Root Certificates Exist in Java Trust Store for Datawire JavaAPI Purpose This document illustrates the steps to check and import (if necessary) the needed root CA certificates in JDK s trust
More informationThis is a training module for Maximo Asset Management V7.1. It demonstrates how to use the E-Audit function.
This is a training module for Maximo Asset Management V7.1. It demonstrates how to use the E-Audit function. Page 1 of 14 This module covers these topics: - Enabling audit for a Maximo database table -
More informationFROM DB TO DB. Manual. Page 1 of 7. Manual. Tel & Fax: +39 0984 494277 E-mail: info@altiliagroup.com Web: www.altilagroup.com
Page 1 of 7 FROM DB TO DB Sede opertiva: Piazza Vermicelli 87036 Rende (CS), Italy Page 2 of 7 TABLE OF CONTENTS 1 APP documentation... 3 1.1 HOW IT WORKS... 3 1.2 Input data... 4 1.3 Output data... 5
More informationOutline. Clouds of Clouds lessons learned from n years of research Miguel Correia
Dependability and Security with Clouds of Clouds lessons learned from n years of research Miguel Correia WORKSHOP ON DEPENDABILITY AND INTEROPERABILITY IN HETEROGENEOUS CLOUDS (DIHC13) August 27 th 2013,
More informationInfodata Systems Limited
Creation / Amendment of Email template for confirmations In most cases new confirmation email templates will be created based on existing templates, as those have already been formatted and include your
More informationInstalling Globodox Web Client on Windows 7 (64 bit)
Notes: Supported Editions - Windows 7 Professional, Windows 7 Enterprise, and Windows 7 Ultimate. Make sure that the Globodox Desktop Client is installed. Make sure it is not running. Please click on Allow
More information2Proofbymathematicalinductionplaysacrucialroleinthevericationofprogramtrans-
SubmissiontoJ.FunctionalProgrammingSpecialIssueonTheoremProving&FunctionalProgramming AutomaticVericationofFunctionswith DepartmentofComputing&ElectricalEngineering, AccumulatingParameters UniversityofEdinburgh,80SouthBridge,
More informationKIPUS, ONE OF THE LEADING BRANDS IN THE CAR AUDIO WORLD, IS GETTING FULFILL THE DESIRES AND DREAMS OF OUR FANS.
KIPUS, ONE OF THE LEADING BRANDS IN THE CAR AUDIO WORLD, IS GETTING FULFILL THE DESIRES AND DREAMS OF OUR FANS. AMPLIFIERS NITRO SERIES 04 AMPLIFIERS CARBONO SERIES 06 MZ SERIES - AUDIO CONTROL 08 SUBWOOFERS
More informationASA 8.x: Renew and Install the SSL Certificate with ASDM
ASA 8.x: Renew and Install the SSL Certificate with ASDM Document ID: 107956 Contents Introduction Prerequisites Requirements Components Used Conventions Procedure Verify Troubleshoot How to copy SSL certificates
More informationSciTools Understand Flavor for Structure 101g
SciTools Understand Flavor for Structure 101g By Marcio Marchini (marcio@betterdeveloper.net ) 2014/10/10 1) WHAT IS THE UNDERSTAND FLAVOR FOR STRUCTURE101G? 1 2) WHY VARIOUS FLAVORS, AND NOT JUST ONE?
More informationDistributed Databases
Distributed Databases Chapter 1: Introduction Johann Gamper Syllabus Data Independence and Distributed Data Processing Definition of Distributed databases Promises of Distributed Databases Technical Problems
More informationIEEE802.3 4P Task Force Channel Pair To Pair Resistance Imbalance. (End to End System Imbalance) Ad Hoc
IEEE802.3 4P Task Force Channel Pair To Pair Resistance Imbalance (End to End System Imbalance) Ad Hoc Meeting #1: Rev_000 Monday February 17, 2014 March 2014 Beijing China Yair Darshan Microsemi ydarshan@microsemi.com
More information1.1 Connection. 1.1.1 Direct COM port connection. 1. Half duplex RS232 spy cable without handshaking
POS function Marchen POS-DVR surveillance system is a professional surveillance integrated with POS system. By bringing video and POS transaction data together, the POS-DVR surveillance system provides
More informationCity of Virginia Beach Mandatory Specification Contractor Performance Evaluation
City of Virginia Beach Mandatory Specification Contractor Performance Evaluation Section I General Project Information Must be completed in its entirety. Name of Firm: Name of Prime: Prime Phone: Name
More informationQUICK REFERENCE GUIDE
QUICK REFERENCE GUIDE Signing Contracts within SWIFT External Revised Apr. 26, 2013; Jan. 10, 2013 Introduction After a Contract Document is approved by the state, it is routed to the Vendor Contact for
More informationSingle-phase (220...240 V) voltage monitoring: Undervoltage Overvoltage Window mode (overvoltage + undervoltage) Voltage fault memory selectable
Features 70.11 70.31 70.41 Electronic voltage monitoring relays for single and three-phase applications Multifunctional types, providing the flexibility of monitoring Undervoltage, Overvoltage, Window
More informationReinforcing Cyber Security -- Taiwan s Roadmap. 張 善 政 S-C (Simon) Chang 行 政 院 副 院 長 Vice Premier Aug. 26 th, 2015
More information
However,duetoboththescaleandthecomplexityoftheInternet,itisunlikelythatameasure-
Part1:AServer-BasedMeasurementInfrastructure NetworkPerformanceMeasurementandAnalysis Y.ThomasHou (ConceptPaper) AsInternettraccontinuestogrowexponentially,itisessentialforboththeusersandserviceproviders
More informationInstalling Globodox Web Client on Windows Server 2012
Installing Globodox Web Client on Windows Server 2012 Make sure that the Globodox Desktop Client is installed. Make sure it is not running. Note: Please click on Allow or Continue for all required UAC
More informationEnd-to-end Protection of Web Services. Tracking. Hao Chen and Benjamin Davis UC Davis. Web services are highly attractive targets
End-to-end Protection of Web Services with Information Flow Tracking Hao Chen and Benjamin Davis UC Davis MURI Final Review Briefing June 13, 2012 Helix MURI Project -- http://helix.cs.virginia.edu Web
More informationTechnical Note P/N 300-011-099 REV A02 May 07, 2010
EMC NetWorker Microsoft Exchange 2010 Backup and Recovery Support with EMC NetWorker Technical Note P/N 300-011-099 REV A02 May 07, 2010 This technical note describes the backup and recovery procedure
More informationUPS / FedEx Package Shipping Field Mapping Guide
First create an SYSTEM ODBC Data Base Connection to your MAX DB. You can name it whatever you want, MAXSHIP for example. You will need to provide a user name and password that will have read/write access
More informationLarger, active workgroups (or workgroups with large databases) must use one of the full editions of SQL Server.
Installing ManagePro 12.1 in Shared Database (Workgroup) Mode Overview 1 ManagePro 12.1 can be operated in Workgroup (also known as remote client ) mode where it accesses a shared SQL database in a LAN
More informationprogramsitproduces.finally,weshowhowtoproduceecient,optimizingprogramgeneratorsby
TopicsinOnlinePartialEvaluation TechnicalReport:CSL-TR-93-563 (alsofusememo93-14) March,1993 ErikRuf DepartmentsofElectricalEngineering&ComputerScience ComputerSystemsLaboratory Partialevaluationisaperformanceoptimizationtechniqueforcomputerprograms.Whenaprogram
More informationEVAL-UFDC-1/UFDC-1M-16
Evaluation Board for Universal Frequency-to- Digital Converters UFDC-1 and UFDC-1M-16 EVAL-UFDC-1/UFDC-1M-16 FEATURES Full-Featured Evaluation Board for the Universal Frequency-to-Digital Converters UFDC-1
More informationElectronic Signature Instructions
Electronic Signature Instructions Please complete ALL of the fields on the form. When you are finished, click in the Signed By field at the bottom of the page. It is important that you complete all of
More informationPayPal PRO Sandbox Testing
PayPal PRO Sandbox Testing Updated June 2014 2014 GoPrint Systems, Inc., All rights reserved. PayPal Pro Configuration Guide 1 PayPal Pro Test Mode (Sandbox) Overview The PayPal test account, referred
More informationSIGNiX: Digital Signature Service
SIGNiX: Digital Signature Service Accessing and Signing your Documents University Information Technology Services Training, Outreach, Learning Technologies, and Video Production Copyright 2014 KSU Department
More informationHow to search for a draft travel & subsistence claim
How to search for a draft travel & subsistence claim Background Sometimes you may have been entering a travel & susbsistence claim, saved it in Draft mode, and logged off to return to edit the claim at
More informationBlackBerry Enterprise Server Resource Kit
BlackBerry Enterprise Server Resource Kit BlackBerry Analysis, Monitoring, and Troubleshooting Tools Version: 5.0 Service Pack: 3 Administration Guide Published: 2011-06-20 SWD-1701690-0620052958-001 Contents
More informationIntegrated SSL Scanning
Software Version 9.0 Copyright Copyright 1996-2008. Finjan Software Inc. and its affiliates and subsidiaries ( Finjan ). All rights reserved. All text and figures included in this publication are the exclusive
More informationINF-USB2 and SI-USB Quick Start Guide
INF-USB2 and SI-USB Quick Start Guide Please follow these instructions carefully. DO NOT connect the INF-USB2 or SI-USB module to your computer before running the setup program. After running Setup and
More informationSetting up a database for multi-user access
BioNumerics Tutorial: Setting up a database for multi-user access 1 Aims There are several situations in which multiple users in the same local area network (LAN) may wish to work with a shared BioNumerics
More informationSAH2217 Enhanced ATHEROS GPS Module with ultra high sensitivity and antenna open/short detection/protection
SAH2217 Enhanced ATHEROS GPS Module with ultra high sensitivity and antenna open/short detection/protection 20F-8, No.107, Sec 1,Jhongshan Rd. Sinjhuang City, Taipei County 242, Taiwan Phone: +886-2-8522-7628
More informationSkilled Nursing Facility Coinsurance Part A Deductible Part B. Part B Excess (100%) Foreign Travel Emergency. Foreign Travel Emergency
Montana OLD SURETY LIFE INSURANCE COMPANY 2014 ( effective 01/01/2014 ) Outline of Medicare Supplement Coverage Benefit Plans A and F Only are being offered by the company at this time. These charts show
More informationHigh-Stability Time Adjustment with Real-Time Clock Module
High-Stability Time Adjustment with Real-Time Clock Module An explanation of an Epson real-time clock module with sub-second time adjustment function [Preface] In recent years, it has become simple to
More informationAn Expert Auditing System for Airline Passenger Tickets
From: IAAI-91 Proceedings. Copyright 1991, AAAI (www.aaai.org). All rights reserved. An Expert Auditing System for Airline Passenger Tickets Andrew J. Valles and Joseph A. VanLoy The passenger revenue
More informationTesting Installed Cabling - we know not what we do! Mike Gilmore FIA Technical Director
Testing Installed Cabling - we know not what we do! Mike Gilmore FIA Technical irector Mike Gilmore tandards Activities Member: IO/IEC JTC1 C25 WG3: Generic Cabling IO/IEC JTC1 C25 Project Team: OHO Convenor:
More informationAMP Superannuation Savings Trust Register of significant event notifications
AMP Superannuation Savings Trust Register of significant event notifications This register provides a summary of significant event and material change notifications issued to members of the AMP Superannuation
More informationMIRRORING: START TO FINISH. Ryan Adams Blog - http://ryanjadams.com Twitter - @ryanjadams
MIRRORING: START TO FINISH Ryan Adams Blog - http://ryanjadams.com Twitter - @ryanjadams About Me http://www.ryanjadams.com @ryanjadams Objectives Define Mirroring Describe how mirroring fits into HA and
More informationTech Sheet NOISEMOD.3PC HELP DOCUMENTATION
NOISEMOD.3PC HELP DOCUMENTATION What is NOISEMOD.3PC? is a Geopak application that generates a Mn/DOT specific ASCII file. This ASCII file is used to input data into Mn/DOT s Stamina noise model program.
More informationChanging the time on your system
Changing the time on your system Twice a year the clocks change between British Summer Time and Greenwich Mean Time. Your telephone system clock may need to be changed at these times. You can find instructions
More informationPre Sales Communications
Pre Sales Communications OmniVista 4760 from R4.1 & OmniPCX Enterprise R7.1 IP Protocols and Ports All rights reserved 2006, Alcatel Table of contents 1. Objectives...3 2. IP protocols...3 2.1. Global
More informationBest Approaches to Database Auditing: Strengths and Weaknesses. henry.parnell@lumigent.com
Best Approaches to Database Auditing: Strengths and Weaknesses henry.parnell@lumigent.com Agenda Why are audit records of Database Operations required in some cases? And why is collecting them difficult?
More informationExchange Granular Restore Instructional User Guide
Exchange Granular Restore Instructional User Guide www.backup-assist.ca Contents 1. Exchange Granular Restore overview... 2 2. Creating an Exchange backup... 3 3. Exchange Granular Restore... 6 Step 1
More informationPIN CONFIGURATION FEATURES ORDERING INFORMATION ABSOLUTE MAXIMUM RATINGS. D, F, N Packages
DESCRIPTION The µa71 is a high performance operational amplifier with high open-loop gain, internal compensation, high common mode range and exceptional temperature stability. The µa71 is short-circuit-protected
More informationThe completely Ethernet-based. protocol enables several imode devices to be linked, using easily-sourced. cables and components.
WHAT IS imode? Outline imode is proprietary technology, conceived to re-think the state of the art in the world of loudspeaker system control. Devices using this technology have a single on-board DSP that
More informationBROADCAST Trasmettitori / Transmitters DBH3 GAP FILLER
INTRODUCTION The equipment described here below is a TRANSMITTER that allows to receive a signal coming from satellite, to demodulate it to have the ASI format, to present it into DVB-H standard by a DVB-H
More informationINDUSTRIAL INSTRUMENTATION
INDUSTRIAL INSTRUMENTATION Table of contents. Table of contents.... 2 Explanation of production screen.... 3 Wiring connection for Flex-MF model Flex.... 4 Wiring connection for Flex-MF model Flex-2100....
More informationAPC series overview. Copyright 2014 Deliberant LLC
APC series overview APC series - overview Deliberant s APC series product line includes a comprehensive variety of devices to meet the most demanding of applications. All the products utilize unlicensed
More informationUAE eservices User Manual
UAE eservices User Manual www.moieserv.ae October 2006 Version 1.0 Table of Contents Introduction.3 What is UAE eservices.4 What are the requirements?.4 Methods of Payments.4 How to install/ Installation
More informationDocument Control SOP. Document No: SOP_0103 Prepared by: David Brown. Version: 10
1.0 Commercial in Confidence 16-Aug-2006 1 of 6 Document Control SOP Document No: SOP_0103 Prepared by: David Brown Date: 16-Aug-2006 Version: 10 1.0 Commercial in Confidence 16-Aug-2006 2 of 6 Document
More informationXMailer Reference Guide
XMailer Reference Guide Version 7.00 Wizcon Systems SAS Information in this document is subject to change without notice. SyTech assumes no responsibility for any errors or omissions that may be in this
More informationGRNet. Advanced Network Services Tool
GRNet Advanced Network Services Tool (and Topology Database) TF-NGN, Paris, July 2005 Aggelos Varvitsiotis, GRnet (avarvit@grnet.gr) Vangelis Haniotakis, UoC (haniotak@uoc.gr) Dimitris Primpas, CTI (primpas@cti.gr)
More informationElectronic Signature Capture
Electronic Signature Capture Contents Configuration Store... 1 Configuration Work Station... 2 Configuration Customized Workflow... 8 Customizing the Fill Regular Rx Workflow... 9 Capturing Electronic
More informationGeorgia Tech s Luminis IV Beta Testing
SUNGARD SUMMIT 2007 sungardsummit.com 1 Georgia Tech s Luminis IV Beta Testing Presented by: Steve Goeke Georgia Tech March 22, 2007 A Community of Learning Agenda Portal Environment and Architecture To
More informationComplete I-9 Form (Electronic)
Workday Job Aid February 14, 2014 Complete I-9 Form (Electronic) Purpose of the Form I-9 is to establish US employment eligibility. The Form I-9 must be complete each time you hire any person to perform
More informationExchange Granular Restore User Guide
User Guide Contents 1. overview... 2 2. Backup considerations... 3 Exchange VM Detection... 3 VSS Application backups... 3 Restore vs. Recovery... 3 Backup user identity... 3 3. Creating an Exchange backup...
More informationIntegrated SSL Scanning
Version 9.2 SSL Enhancements Copyright 1996-2008. Finjan Software Inc. and its affiliates and subsidiaries ( Finjan ). All rights reserved. All text and figures included in this publication are the exclusive
More informationHow to configure your Acrobat Signature Appearance
How to configure your Acrobat Signature Appearance An Acrobat Signature Appearance for use within SpeediSign is created within Adobe Acrobat Professional. This signature appearance is then called within
More informationMTA Course: 10753 Windows Operating System Fundamentals Topic: Understand backup and recovery methods File name: 10753_WindowsOS_SA_6.
STUDENT ACTIVITY 6.1: UNDERSTAND BACKUP AND RECOVERY METHODS MTA Course: 10753 Windows Operating System Fundamentals Topic: Understand backup and recovery methods File name: 10753_WindowsOS_SA_6.1 Lesson
More informationExchange Granular Restore. User Guide
User Guide Contents 1. overview... 2 2. Backup considerations... 3 Backup user identity... 3 Exchange VM Detection... 3 Restore vs. Recovery... 3 3. Creating an Exchange backup... 4 4.... 7 Step 1 - Locate
More informationGoals. Accelerating adoption & exchange of EHRs project. Evaluation Indicators 2010 2011 2012 EMR adoption (Hospitals) 20% (100 hospitals)
12 th International HL7 Interoperability Conference Development of an interoperability infrastructure for exchange of electronic health records among hospitals in Taiwan Chien-Tsai Liu Professor, Graduate
More informationInstallation and Administration Guide
Installation and Administration Guide BlackBerry Enterprise Transporter for BlackBerry Enterprise Service 12 Version 12.0 Published: 2014-11-06 SWD-20141106165936643 Contents What is BES12?... 6 Key features
More informationCase 2:08-cv-02463-ABC-E Document 1-4 Filed 04/15/2008 Page 1 of 138. Exhibit 8
Case 2:08-cv-02463-ABC-E Document 1-4 Filed 04/15/2008 Page 1 of 138 Exhibit 8 Case 2:08-cv-02463-ABC-E Document 1-4 Filed 04/15/2008 Page 2 of 138 Domain Name: CELLULARVERISON.COM Updated Date: 12-dec-2007
More informationBest gateway technologies
10 Best gateway technologies .................. Discovery Telecom DTT o o o Discovery Telecom2 automatically immediately The USSD command format:
More informationHOW TO PROCESS A NON-PAYROLL EXPENDITURE ADJUSETMENT REQUEST (NPEAR)
HOW TO PROCESS A NON-PAYROLL EXPENDITURE ADJUSETMENT REQUEST (NPEAR) Revised December 13, 2013 PURPOSE and USES of the NPEAR SYSTEM: The Non-Payroll Expenditure Adjustment Request (Non-PEAR or NPEAR) is
More informationDigital I/O: OUTPUT: Basic, Count, Count+, Smart+
Digital I/O: OUTPUT: Basic, Count, Count+, Smart+ The digital I/O option port in the 4-Series provides us with 4 optically isolated inputs and 4 optically isolated outputs. All power is supplied externally.
More informationHands-on CUDA exercises
Hands-on CUDA exercises CUDA Exercises We have provided skeletons and solutions for 6 hands-on CUDA exercises In each exercise (except for #5), you have to implement the missing portions of the code Finished
More informationWeb application for detailed realtime database transaction monitoring
Web application for detailed realtime database transaction monitoring for CMS condition data ICCMSE 2009 The 7th International Conference of Computational Methods for Science and Engineering Friday October
More information3. From the Merchant Administration drop down select VCS Interfacing (page1)
VCS INTEGRATION PROCEDURE 1. Log into VCS Admin Login / Virtual Terminal 2. Select Merchant Administration 3. From the Merchant Administration drop down select VCS Interfacing (page1) Set the fields to
More informationUHC-iEnroll Offline Software Frequently Asked Questions
UHC-iEnroll Offline Software Frequently Asked Questions Q. How do I know if I am picking the right application from the drop down my paper form doesn t look like this? Please contact the Producer Help
More informationIPSLA Y1731 On-Demand and Concurrent Operations
IPSLA Y1731 On-Demand and Concurrent Operations This module describes how to configure the IPSLA Y1731 SLM Feature Enhancements feature for enabling real-time Ethernet service troubleshooting for users
More informationStatistical Data analysis With Excel For HSMG.632 students
1 Statistical Data analysis With Excel For HSMG.632 students Dialog Boxes Descriptive Statistics with Excel To find a single descriptive value of a data set such as mean, median, mode or the standard deviation,
More informationStreamline Paperwork with e-signatures
presented by a la mode Course Highlights Create an electronic document using SureDocs Lite Upload existing documents to your XSite Prepare a PDF document for e-signature E-sign a document on your XSite
More informationS7-1500/S7-1500F Technical Data
Standard CPUs CPU 1511-1 PN CPU 1513-1 PN CPU 1515-2 PN Type Standard CPU Standard CPU Standard CPU Dimensions 35 x 147 x 129 mm 35 x 147 x 129 mm 70 x 147 x 129 mm Spare part availability after 10 years
More informationDifferential Charge Amplifier
Electronics Differential Type 58A... The differential charge amplifier is used for signal conversion of piezoelectric sensors with differential output. Executions Aluminum die-cast enclosure (IP64) Plastic
More informationTours Reporting System (Divisional) English version
Tours Reporting System (Divisional) English version MODA Manuals Author: Sepehr Ebadi Borna Version 1.5 (26-June-2015) Table of Contents Chapter 1 Reporting System...2-3 Chapter 2 View Tour s details...
More informationMicrosoft SQL Server 2005 How to Create and Restore Database (GRANTH3) Manually
Introduction Microsoft SQL Server 2005 How to Create and Restore Database (GRANTH3) Manually To use the e-granthalaya Software for automation of your library, you need to install the database management
More informationTrademark e-filing 2013
2013 1. Login facility is available on the home page. User has to register for logging in. If a user is already registered he can log in using the User ID and Password or Digital signature. How to Register:
More informationMastering Exchange 2000 and Active Directory with Tivoli. Bruno Friess
Mastering Exchange 2000 and Active Directory with Tivoli Bruno Friess Exchange 2000 Overview STORE.EE MTA xapi MAPI DB DBDB IS Active Directory Forest Communication Layer SMTP POP3 IMAP IIS No Exchange
More informationOnline Change of Major: Student Instructions
Table of Contents Accessing the Online Change of Major Request through myucf...1 Replacing my current Major, Track, Minor, or Certificate or Changing to a Restricted Major....2-8 Adding a Minor, Certificate,
More informationConfiguration of an SQL server as an index data base for quarantines in
Configuration of an SQL server as an index data base for quarantines in Avira AntiVir Exchange Support August 2009 www.avira.com Errors in design and contents cannot be excluded Avira GmbH Content INTRODUCTION...
More informationH11S 04 (CFACC9) Use systems and technology during customer contact in a contact centre
Overview What this standard is about Contact centres use a variety of systems and technology to handle contacts with customers. Using that technology is one of the main skills for handling a full range
More informationController Automation, Model II+
Controller Automation Page 2 of 2 Automation with the RADAK II+ power controller II+ I/O Points: Inputs 5 Programmable Digital inputs 2 Dedicated digital inputs (Channel select and External SCR control
More informationWordPress Security Scan Configuration
WordPress Security Scan Configuration To configure the - WordPress Security Scan - plugin in your WordPress driven Blog, login to WordPress as administrator, by simply entering the url_of_your_website/wp-admin
More information16-700 / 16-701 / 16-702 / 16-703 Audio distribution system A44/A88 pc software
Audio distribution system A44/A88 pc software 1. System requirements 2. Installing the software 3. Connection with the pc 4. Use of the software in standard mode 4.1. Connection 4.2. Adjusting the audio
More informationPlacing and Initiating a Planned Orderset
Page 1 of 11 Placing and Initiating a Planned Orderset There are two different types of orderset statuses: Planned Pending and Initiated Pending Planned Pending status is used when you wish to write orders
More information