'& &% The 3 rd Cracow Grid Workhop. October 2003 Centro Comunicaciones CIC RedIRI. panish NREN Distributed ystems Architecture and ecurity Group Dpto. de Arquitectura de Computadores y Automática Universidad Complutense de Madrid A Grid cheduling Algorithm Considering Dynamic Interconnecting Network Antonio Fuentes, Eduardo Huedo, Ruben. Moreno, Ignacio Martín Llorente!#" Antonio Fuentes antonio.fuentes@rediris.es,-+.+ /0 & )*+( "$ -)3 )4 ) 12 ( :9 87 6 56
OutLine 1. Motivation. 2. Applications and Framework. 3. Environment of the experiment. 4. Resources election Algorithm. 5. Example of Resource election. 6. Conclutions. 7. Future.
Motivation 1. The network is not only for Grid considering interconnecting Network. Need use dynamic bandwidth. Why? Computing. 2. Need election resources strategy 1. Evaluation the transfer costs O IN KM A GLKI < C < I HJI GF CED @BA? > ;=< O I> UG D GA T A PRF QI G< D P AI < H? `O ^_ []\ WYX Z HGI VF PDKI D< F P AN T P MI H I HJI < G ;=< O de Z a_cbx HJI GVF PDKI D< F P AN T P MI HJI N HJI < G ;=< O ex _\ f W b ` _ b VF PDKI D< F P AN T P MI HJI N HJI < G ;=<
l qp r qm r r r Applications and FrameWork GridWay FrameWork i ˆ q Ž ŠŒ ˆ ƒ ki q ~m m} ur{ xxuzy r mh lnw i qp urv tsr qp lnmo kj gbhi lo h k k~ wp l q o imqm m m hi šš œ œ šš k q lmo žph l w i s Ÿs ž s p k o mh k m~ ~hp l žk m lm~ s sy ž t p k o h p k~ mo lo mh j lph pq omḧ o s Ÿr ž p k o ki žk~ p q o ªp««im lm h qp k uy s ž s p k o
Aplications and Framework Iperf Measure Bandwidth between hosts. Point to Point. Network Weather ervice 1. Distributed Resource Performance Forecasting ervice for Metacomputing. 2. Provide accurate forecasts of dynamically changing performance characteristics. N P erver Ē ± F erver erver Client
º¼» º¼» º¹ µ µ  Á½ Á½ ÁÀ ÊÉÈ ÊÉÈ Environment of the experiment. IRIGrid RedIRI Local Network N GII IRIGrid M 2Gbit/s The panish Thematic Network on Grids in the framework of e- cience Initiatives º¹ ² ³ ÁÀ ½ ¾ 1Gbit/s N NW Nameerver ÍÇÎÏÐ Ñ#Ò ÅËÌ Ã#Ä ÅÇÆ ÓÓÎÈÎÈ ËÈÄÊ ÖÅÖÉ ÔÕ Ô#Õ M NW Memory NW ensor Dacya Group GRII Host.Globus 2.4
ö ö èè aa bg f bg f dd 7 ; 7 E ÞÝ8 ØÝ..,à,à æ- æ- çàl çàl KK æ- æ-,',' GG 7 ; 8 7 E 7 ; W ïîíì R ØÝØ[ _ ; 8Ý ÚØÞÝ Û Resources election Algorithm ø ø û þ üû þÿ üúý ùúû ù øø é ö!#" ù ø é ö,à+( *(ç ) äã( $å&%' øø ø cö cö bb ø a `` ëdëd e b f b f ë e 9Û =Û 9Þ :<; Ý> 8 67#8 5 4ó3òõ ïîíì2 /ô01òó ò B @C?6A@ ØÞÝÜ ØÚÛ 7Ü D97ØÞ ëë èéê èéê $å&%ã ä% å, àà IàJ HåHà F%à, 77ØÚ 9Û DÛ 9ON MÜ Ý 9Û =Û 9Þ :<; Ý> 8 POQ ;8 > ëë èéêê èéêê V?R TUÛ ; 8 C ëë èéêê èéêê ØÞÝÜ ÙØÚÛ åæç åçæç % %à % %à,',' XàY I(ç åçæç ää ßáà âàã Rank Calculation ]UØ 7#8ÞÜ VØ\ Ø 9VØ ZÝ TÚ ØÝ [ Û ôò óòðñ õ ëë èéêê èéêê ^Ø 78 7Ú @ VDÛ Ú V9Ú 9N 7Ø D8 Ý 8 Þ Ý Ø Þ Û ]OQ Ü =ÝØÚÛ 9Ú 7Û UVVØÝ ÝØ Network Measurements
Œ Ÿ Ÿ œ œ œ œ Ÿ Ÿ Ÿ Ÿ œ š œ š Å Â ï ë î ê éè Ò Ø Ð Ñ à Í Experimental TestBed. RedIRI-UCM Š Œ Ž Š Š z { xi yu mjo iuv w rt n r&s oo npo q mi l hji k aquila Pentim III 700Mhz Linux 2.4 128M dacya.ucm.es cygnus Pentium IV 2.5Ghz Linux 2.4 512M dacya.ucm.es cepheus Pentium III 600Mhz Linux 2.4 256M dacya.ucm.es hydrus Pentium IV 2.5Ghz Linux 2.4 512M dacya.ucm.es aristoteles Pentium III 1.4Ghz Linux 2.4 1G rediris.es platon Pentium III 1.4Ghz Linux 2.4 1G rediris.es heraclito Celeron 700Mhz Linux 2.4 256M rediris.es ˆ ƒ }~ CPU intensive artificial WorkLoad. Initially, the job submision from cygnus ««œ œ ««ª O Ÿ ž Õ Ã¹Ä ÀµÁ ¼½¾ ½ º» ¹ ²³µ #± ìð è ìí æç ãåä á¹â ÝÞµß ÒÛÜ Û ÙÚ Ø ÖÕ Ó Ò&ÓÔ Î¹Ï ÊËµÌ Ǣ È#ÉÇ
m dl c c 6. 6,- - XY "## Y] ""# X] +" "* \Y ") X\ (" [Y "' X[ "& ZY "% XZ "$ Y "# X " UN TRI Q MR Q MN OPI Results Example. 4 Jobs Running. þÿûýü ú ö ùø ñóò ô#õ dkj hia d1ef ca g b ^`_a nop qrstuv wt xx / <=>?@ABCD EB FF :; 6178-4 9 4 5 304 /102.,-. VWI Q KL JGHI! JID AID TID DM M GM TIME ETIME CPUTIME XFRTIME EXIT TEMPLATE HOT 0 0 0 zomb done -- 13:55:13 13:55:47 00:12 00:22 0 job_template cygnus.dacya.ucm.es 1 0 1 zomb done -- 13:55:13 13:55:48 00:12 00:23 0 job_template hydrus.dacya.ucm.es 2 0 2 zomb done -- 13:55:13 13:56:02 00:23 00:26 0 job_template aquila.dacya.ucm.es 3 0 3 zomb done -- 13:55:13 13:56:03 00:24 00:26 0 job_template 90seg cepheus.dacya.ucm.es JID AID TID DM M GM TIME ETIME CPUTIME XFRTIME EXIT TEMPLATE HOT 0 0 0 zomb done -- 13:56:49 13:57:23 00:12 00:22 0 job_template cygnus.dacya.ucm.es 1 0 1 zomb done -- 13:56:49 13:57:23 00:12 00:22 0 job_template hydrus.dacya.ucm.es 2 0 2 zomb done -- 13:56:49 13:58:36 00:22 01:25 0 job_template 187seg aristoteles.rediris.es 3 0 3 zomb done -- 13:56:49 13:58:25 00:22 01:14 0 job_template platon.rediris.es
Ÿ Š ˆ «² ³ Ÿ Ÿ º¼ Conclusion and Future Work z ~ y{z } ž Ÿ œ š ŒŽ Ÿ ƒ ± ª«ž Ÿ Ÿ Ÿ Ÿ œ ²µ ½»º ¹ 1. Extension experiment at all IRIGrid Resources. 2. Integration of Migrations Jobs. 3. Integration of Dynamic Reservation of bandwidth. Traffic Prioritiy.
¾ À ¾