An Effective Resource Management for Cloud Services using Clustering Schemes

Transcription

1 Avanc Scinc an Tchnlgy Lttrs Vl.43 (Multimia, pp An Effctiv Rsurc Managmnt fr lu Srvics using lustring Schms Jin-Mk Kim 1, Jng-Kyung Mn 2, Bng-Hwa Hng 3 1,2 Divisin f Infrmatin Tchnlgy Eucatin, Sunmn Univrsity 3 Dpartmnt f Infrmatin & Tlcmmunicatin, Kyungh ybr Univrsity { 1 calf0425, 2 mnjk}@sunmn.ac.kr, 3 [email protected] Abstract. Ggl prps clu cmputing cncpt in last An th intrsts f clu srvic ar rising rapily. Accring t Gartnr grup's invstigatin, vlpmnt viw f clu srvic is vry hpful. Hwvr, Skptical sight is prsnt. If thy n't supprt immigratin an managmnt schms f xistnt IT rsurcs thn can't guarant hpful futur abut clu srvic. Thrfr, w ar ging t prps th way - (AERMS2: An Efficint Rsurc Managmnt fr lu Srvics using lustring Schms) - that can manag IT rsurcs ffctivly using xistnt clustring mth fr clu srvic in this papr. AERMS2 uss clustring cncpt an xisting IT rsurcs cmps a clustr grup. An act lik singl cmputr that cmps a clustring an is n virtualiz t slv usr's rqust. W st tw clustr grups in this rsarch. First clustr grup cmpss bcaus hav iffrnt harwar spcificatin an mak us f 5 cmputrs that hav high harwar spcificatin. Scn clustr grup cmpss by 5 cmputrs that hav qual harwar spcificatin an harwar spcificatin is lwr. W prps a scnari xprimnt using Hap that is clu cmputing simulatr t shw fficincy. Whn manag IT rsurcs using AERMS2 that w was prps, xistnt IT rsurcs r-usability is high. Prcss tim was shrt mr than ubl whn cmps clustring t cmputr grups which hav qual harwar spcificatin an us ur schm against f gnral clu srvic. Kywrs: Rsurc managmnt, lu srvic, lustring Schm, Hap, 1 Jin-Mk Kim is a First authr. 2 Jng-Kyung Mn is rrspning authr. ISS: ASTL pyright 2013 SERS

2 Avanc Scinc an Tchnlgy Lttrs Vl.43 (Multimia 1 Intructin Th clu cmputing is main tpic f IT inustry btwn th rcntly 2 ~ 3 yar. It is rciving many intrsts s much that ar slct sris 2 yars in wrl tns IT stratgy achivmnt accring t Gartnr Grup's xamins. Th clu cmputing is prps by Ggl's a rsarchr in It is knwn as that is bgun in ffrt that wish t intgrat cncpt f xistnt gri cmputing, clustr cmputing, virtualizatin cmputing, intgratin cmputing tc. frm srvic prvir's viwpint[1,3]. In this way, it must b cr businss by 3 gvrnmnt bis that is knwlg cnmics partmnt, bracast cmmunicatin. Bcaus th intrst abut latst clu cmputing is rising. S, thy mak "Ttal gvrnmnt clu activatin all-ut plan" in mstic. An stablishing jintly an try t arriv t wrl markt shar 10 until Hwvr, ppl wh hav skptical sight against xist clu cmputing xist silvr lining. Thy ar ciing that thy ar nt mr in ffrt that clu cmputing wishs t intgrat xistnt varius kins cmputing tchnlgis frm srvic prvir's viwpint. An ar pssibl thugh smth intgratin fr ncssarily xistnt IT rsurcs an authritativnss abut clu srvic [2]. S, w wish t xamin abut tw prblms that shul b slv ncssarily t prvi clu srvic in tratis that s hrupn, an prps ffctiv clu srvic rsurc managmnt mth t tak avantag f clustr cmputing tchnlgy that can slv this. An w xprimntaliz t that thrugh sm simulatin scnaris using Hap simulatr. It can act in Apach wb srvr t shw fasibility. mpsitin f this tratis is as fllwing. W xplain curtly abut lu cmputing, clustr cmputing, Hap in rlat rsarch in chaptr 2. An xplain abut AERMS2's charactristic an actin surruning an xprimnt scnari that wish t prps in tratis that s in chaptr 3. An in chaptr 4, w xamin abut prprity fr xprimnt scnari fr AERMS2. Finally, chaptr 5 scrib cnclusin an futur wrks. 2 Rlat wrks 2.1 lu cmputing lu cmputing that prps by Ggl's a rsarchr. It intgrats IT rsurcs that xist in xisting in ggraphical, systmatic imnsin, an it is basis purps that wish t ffr an ffr wrk that usr wants cnvnintly t srvic cncpt t usr. T mak this, intgrat xisting IT rsurcs in ggraphical, systmatic imnsin bfrhan. lu cmputing cncpt isplay in figur 1. S that w can intgrat applicatin prgrams as wll as thing that bin intgrating systms that is away ggraphically as is apparing in figur 1 simply by n an imprv 11 pyright 2013 SERS

3 Avanc Scinc an Tchnlgy Lttrs Vl.43(Multimia f rsurcs usability an intgratin ability. Thrfr, cncpt f clustring is rquir ncssarily t xplain nxt sctin2.2 [4, 5]. lu (lu systm f ata lu Braban P Smart ip Fig. 1. ncpt f lu cmputing 2.2. lustring lustring is rsarch fr intgrat cmputr harwar rsurcs xist in ntwrk grup. An it can ffr supr cmputing systm that can ffr mr xcllnt prfrmanc. In Exampl, Eucalyptus xplains that hw can cnstructs clustring xisting IT rsurcs in clustring rsarch. pyright 2013 SERS 12

4 Avanc Scinc an Tchnlgy Lttrs Vl.43 (Multimia L Public ntw rk Priva t ntw Priva t ntw Fig. 2. ncpt f lustring n Eucalyptus It cnncts xistnt IT rsurcs by ntwrk prtcl such as TP/IP. Figur 2 is isplaying cncpt f clustring n Eucalyptus. In 2009 t xampl abut clustr cmputing rth arlina cllg's Frank. Mullr prfssr shw xampl that bin vic 8 that is PS3 that it is knwn as gam murning an ffr first scintific clustr. Thus intical cmputr vic r similar vics bin that wish t ffr high cmputing pwr. H shw that can crat lustring, an ffr mr suprir Prfrmanc than singl P thrugh cnncting 8 f PS3. W knwn usabl pssibility t harwar rsurc that prfrmanc is nw by is lw an cnnct an clustring t ntwrk ing up vics that is nt us thrugh this Hap[7] It is rsarch abut simulatr that can prvi clu srvic that is bas n wb srvic by n uring Apach prjct [8, 9]. This i t intruc clustr cmputing cncpt an prvi clu srvic aftr cnnct lctrnic cmputing systms that hav qual r rsmbling prfrmanc that xist in xisting using TP/IP cmmunicatin prtcl. lustr cmpsitin way that Hap supprts is 3 typs as fllwing. This is singl cmpsitin way, imaginatin brakup way, an prfctin brakup way. Singl 13 pyright 2013 SERS

5 Avanc Scinc an Tchnlgy Lttrs Vl.43(Multimia cmpsitin way mans clustr that is cnsist f cmputr rsurcs that hav qual spcificatin. Aftr imaginatin brakup way xcuts Java imaginatin machin by scn, it is mth t bin varius harwar rsurcs by clustr. Finally, prfctin brakup way is mth t bin varius kin cmputr rsurcs by clustr. Hap Distribut Fil Systm is rprsntativ prfctin brakup way clustr mth. This is isplaying in figur 3. ata lint 1. Rqust crat 2. Data m inf 4. mplt 3. Sn ata 5. Sav fil inf am Rplicatin Data Data Data Data Fig. 3. Hap Distribut Fil Systm 3 AERMS2 W n t ncssarily xisting IT rsurcs an frm clustr t prvi clu srvic. S w prps abut AERMS2 (Effctiv Rsurc Managmnt mth fr lu srvics using lustr cmputing) that apply clustring tchniqus t prvi clu srvic that can manag xistnt IT rsurcs ffctivly. pyright 2013 SERS 14

6 Avanc Scinc an Tchnlgy Lttrs Vl.43 (Multimia 3.1 mps f AERMS2 mps f AERMS2 in this papr, it wishs t us clustring mth. W ar ging t us Hap that is prps in Apach prjct. An this tratis slct ing t prvi clu srvic ffctivly using prfctin istributin way. Bcaus f mst clu srvic n prfctin istributin way actually. Figur 4 shw AERMS2 cmpsitins that w wr prps. M Public lu ntwrk Privat lu Managr Privat lu Managr Fig. 4. Structur f AERMS2 Intrlink 5 xistnt cmputrs by sub-ntwrk thrugh ntwrk t apply lustring tchniqus with xistnt Hap in AERMS2 that w prps. First, harwar spcificatin f n intrlinks thr 5 cmputrs an crat privat clustr ach thr. An anthr clustr cmps t crat privat clustr by 5 cmputrs that hav ability is lw an similar harwar spcificatin. 15 pyright 2013 SERS

7 Avanc Scinc an Tchnlgy Lttrs Vl.43(Multimia 3.2. Prcur f AERMS2 AERMS2 that w prps ar alik n clustr grup an thr n clustr grup's prcur. But, spcificatin f ach cmputr that cmps clustr iffrs. Thrfr, w ivi in tw cass an xamin abut prcur. Lt's xamin abut prcur frm clustr grup that hav qual harwar spcificatin by first. Each 5 cmputrs ar bing th all IBM cmpatibls, an hav harwar spcificatin abut Dual-cr 2 GB an mmry vlum ar 2GB. Figur 5 shws abut thy hav a qual harwar spcificatin clustring what ing prcur. Ray Srvic Rqust Stan by Fin t Stan by vic prcss Finish an rsurc rlas Fig. 5. Prcur f qual H/W spc. Harwar spcificatin f cmputrs that first clustr grup cmpss is lw. An it can prcss srvic by cpratin if harwar spcificatin is lacking fr usr rqusts. An It can hav a arly latncy tim that chck t availability f ach cmput ar ray situatin. Thrfr, lay tim happn prcss wrk at first tim. Othr n clustr grup has sam prcur. Figur 6 shw this prcur. If usr's srvic rqust happns, ask availability an prcss wrk in suitabl P hrupn pyright 2013 SERS 16

8 Avanc Scinc an Tchnlgy Lttrs Vl.43 (Multimia whthr harwar spcificatin is big r suitabl frm P1 that cmps clustr t P5. In cas nt fin suitabl P within clustr grup n usr's srvic rqust achiving itt prcss rpatly, rturn an cmps s that achiv rqust fr srvic prcssing again fr th first tim. Srvic Rqust R ay Satisfy =< P 1 Y s prc ss Satisfy =< P 2 Finish an rsurc rlas Y s prc ss Satisfy =< P 5 Y s Finish an rsurc rlas Fig. 6. Prcur f iffrnt H/W spc. prc ss Finish an rsurc rlas In th cas f scn lustring mth, it is n arly latncy tim fr srvic prcssing. Hwvr, in cas thr is n P that can prcss srvic that usr rquirs, spit rmainr Ps ar il stat, thr is cas that must wait lng tim. 17 pyright 2013 SERS

9 Avanc Scinc an Tchnlgy Lttrs Vl.43(Multimia 4 Prfrmanc xprimnts 4.1 Exprimnt nvirnmnt W cmps xprimnt nvirnmnt as fllwing fr prfrmanc assssmnt abut AERMS2 that w prps in this rsarch. Each ntwrk grup was link t ntwrk that is cnsist f Ethrnt that can supprt 100 Mbps. 10 ach cmputrs install sam Linux Ubuntu 10.x vrsin that is pn Oprating Systm. Divi ach tn s cmputr by 5 an cmps by tw sub-ntwrks. Figur 7 shw ur xprimnt nvirnmnt. lustr Managr Public lu twrk 100Mb ps Ethrn sr U nnr LaRu Subntwrk 1 Subntwrk 2 Fig. 7. Exprimnt nvirnmnt On clustr grup crats ntwrk grup which hav iffrnt harwar spcificatin, an thr n clustr grup crat ntwrk grup which hav qual harwar spcificatin. pyright 2013 SERS 18

10 Avanc Scinc an Tchnlgy Lttrs Vl.43 (Multimia W cnstruct ntwrk nvirnmnt similar t actuality t hightn authritativnss f an xprimnt. an gnrat traffic f 16 MB t ntwrk using ntwrk la ccurrnc sftwar f LaRunnr. An a tstr cmputr t pruc ach usr rqust an a usr cmputr that ffr rspns srvic in rply, an masur rspns tim abut this tim usr's srvic rqust n. lustr managr that manag clustr grup prpars an la rlvant algrithm in ++ s that AERMS2 that prps accring t ach sub-ntwrk may act smthly. 4.2 Rsult f xprimnts W xprimnt an scrib prfrmanc assssmnt abut an xprimnt accring t fllwing simulatin scnari. First, w masur prcss tim abut ata prcssing thrugh simulatin t cnfirm AERMS2's fficincy. Aftr transmit 100 GB ata 400 tims t sub-ntwrk1 that cmps lustring by cmputrs that hav qual harwar spcificatin rlvant srvic rqust srvic in pssibl P fil pn an aftr ra, t str ata that ra t har-isk. An masur tim that tak t transmit nxt str ata cpy by tst P again. Usr this fr tst srvic rqust t lustr Managr transmit an aftr prcss livring this t sub-ntwrk1 that hav qual harwar spcificatin prcssing rsult t rspn cst tim masur. Tabl 1 isplay xprimnt rsult that is avrag tim f 400 tims rsult. Rspns H/W spcificatin tim P1 420 ms PU: Intl Dual r 2.x GHz P2 418 ms M/M : 2GB blw P3 421 ms P4 416 ms P5 419 ms Scn, w us in first prfrmanc assssmnt t sub-ntwrk2 that cmputr harwar Spcificatin is iffrnt clustr grup. Tabl 2 shws xprimnt rsult t nvirnmnt f iffrnt cmputr harwar spcificatin. Rspns H/W spcificatin tim P1 468 ms Dual cr 2GHz, 1GB M/M P2 482 ms Dual cr 1.6GHz, 1GB M/M P3 415 ms Dual cr 2.4GHz, 2GB M/M 19 pyright 2013 SERS

11 Avanc Scinc an Tchnlgy Lttrs Vl.43(Multimia P4 210 ms Qua cr 2.6GHz, 4GB M/M P5 216 ms Qua cr 2.4GHz, 4GB M/M W isplay xprimnt rsult abut iffrnt tw clustring in qual ntwrk nvirnmnt. Rsult f first xprimnt can knw that similar xprimnt rsult appars bcaus us lustring grup which is cnsist f cmputrs that hav qual harwar spcificatin. Rsult f tw tims xprimnts can knw that prcss tim is lay mr bcaus cmps clustr grup by cmputrs that w hav harwar spcificatin that iffr an achiv an xprimnt aftr cnfirm availability whthr clustr managr can prcss an xprimnt abut ach cmputr. W can knw that it isplays littl mr g xprimnt rsult that crat clustr grup by cmputrs that hav qual spcificatin in this xprimnt. Sub-ntwrk 1 than sub-ntwrk2 harwar spcificatin if aytim yils avrag f whl rspns tim in spit f that inclu P f cas abut ubl prfrably 1.2 tims nar fast thing knw can. It can knw mr ffctiv thing that cmps lustring by cmputrs that rspns tim has similar spcificatin t prvi fast lu srvic thrugh this. This xprimnt winls t ra ata f big capacity inartificially an rspns aftr rcr it was a simpl xprimnt that masur spnt tim. If xcut an aitinal xprimnt raying littl mr varius xprimnt scnari t shw fficincy fr systm that prps hraftr, is thught t gt bttr stuy fining. 5 nclusin Th intrst f clu srvic is cay rawly. Bcaus this is th bst slutin that clu srvic can slv prblm abut grn IT tchnlgy, ashs fr physical vics r-us prblm slving, intgratin f systm units tc. Hwvr, many ifficultis fllw t prvi prfct clu srvic. Existnt varius kins an varius physical vics r-us is vry ifficult. Thrfr, cmputrs that w hav xistnt varius harwar spcificatin in tratis that s abut hw ffctivly ashs - us can that afflict. D up cmputrs that hav thr harwar spcificatin by clustr an ashs up cmputrs that hav similar spcificatin whn us - an it knw that rspns tim can b arly mr than th thr thrugh an xprimnt that us. W install Ubuntu 10.x vrsin by LIUX Oprating Systm fr an xprimnt. An w install Hap that is clustring simulatr in LIUX Oprating Systm nvirnmnt. An w mbi clustr managr fr AERMS2 wh w prps in this rsarch using ++. W cmps sub - ntwrk1 an sub - ntwrk2 that hav thr clustr cmpsitin t rcgniz whthr AERMS2 that prps acts ffctivly. An achiv an xprimnt accring t intical xprimnt scnari t ach sub-ntwrk an masur rspns tim. pyright 2013 SERS 20

12 Avanc Scinc an Tchnlgy Lttrs Vl.43 (Multimia Rsult that achiv an xprimnt, clustr grup which cmps sub-ntwrk that hav qual harwar spcificatin cul knw that hav arly rspns tim nar abut 1.2 tims. Hwvr, it may b ifficult that cmps clustr by cmputrs that hav qual harwar spcificatin vryby actually. Thrfr, it is thught t b ffctiv that cmps clustr by small sub-ntwrk by cmputrs that hav similar harwar spcificatin rfrncing rsult f this xprimnt. An w hav a plan t t xcut an xprimnt abut tth in aitin hraftr. Rfrncs 1. Matt Prigg, "nfssin f a lu Skptic", Infrwrl, hristphr Barnatt, "lu mputing: A Brif Gui t lu mputing, J.Dan an S.Ghmawat, "Mapruc: Simplifi Data Prcssing n Larg lustrs", mmunicatins f th AM, P. Barhan, B. Dragvic, K. Frasr, S. Han, T. Harris, A. HO, R. ugbaur, I. Pratt, an A. Warfil, "Xn an th art f virtualizatin", Prcing f th 19th AM Sympsium n Oprating Systms Principls, J. has, D. Irwin, L. Grit, J. Mr, an S. Sprnkl, "Dynamic virtual clustrs in a gri sit managr", High Prfrmanc Distribut mputing, Prcings. 12th IEEE Intrnatinal Sympsium n, pags , M. Mctt, D. Gupta, A. Vahat, an G. M. Vlkr, Ushr: An Extnsibl Framwrk fr Managing lustrs f Virtual Machins", In Prcing f th 211st Larg Installatin Systm Aministratin nfrnc (LISA), Hap, " IBM Blu lu prjct, " Amazn Elastic mput lu, Eucalyptus Public lu (EP), cs.ucsb.u/wiki/eucalyptuspubliclu/, pyright 2013 SERS