Grid PARISTIC - Bordeaux

Transcription

1 Grid 5000 a large scale and highly reconfigurable Grid experimental testbed Franck Cappello,, Michel Daydé, Frédéric Desprez,, Emmanuel Jeannot, Yvon Jégou, Stéphane Lantéri, Nouredine Melab, Raymond Namyst, Brigitte Plateau, Pascale Primet,, Thierry Priol, Olivier Richard, Dany Vandrome fci@lri.fr fr PARISTIC - Bordeaux

2 PARISTIC - Bordeaux

3 ! "##" $ "%" &'( ) *+,-.! - " $ -" &'( /) 0,- *+,.! $ 1 &-( ) *-1. $, &,( 0) "-2. $ 3# &4#( ) 54-6.! 7 $ 28 &#( -9) 0,2".!,:; $ 0-2 &( ") 0,- *. $ *1 &( "8/) -+,.! 4 $ 0"-, &3( ),.! $ "350 &( ) *"<. $ 20 &( ) 2.! 1 $ 1- &-( '8),-#*. $ #1*-0 &2( ) 0,-00=1. Thierry Priol! $ 2 &( "8/) -. $ 3,013 &>( 2) 4*3. $ 2* &( =) *'3.! $ 3520=> &( 2) *1=0. # $ &( *) -. #? $ &@#( ") *3. #3 $ = &'( ) -. # $ # &*( ) *3. # * $ ""- &(?)?". #? $ = &2( A),. # 0 $ 2 &@( 2),-#*. # 2! 19 $ #20,1 &*( 9) 5 '. $ 2 &=( ),. $ *3" &4(?),%"B. $ &'( ),.! - $ 0 &( -) *3. $ % &@#*( "/) -+,-. $ * &>( ) 2. PARISTIC - Bordeaux

4 '"< &%%#%<. %<. DG IST - F2 "9 - $ ) $ 09! " # $ # DG IST - F3 $ $ # # :; # 0,1,(-*.+%/ ())*+ % & '& PARISTIC - Bordeaux

5 0 ' C &. 5 ) 2") D : C : ;) C #,:; ) 3-) :) ) 9) D &. 9 :; E =: E D C - E PARISTIC - Bordeaux

6 F "%" 9 F "%" C * ) ; : F "%" C -) ") ' ) -9) *?) ) 2 ) ) ") ) ) ) ) ( =: E!'!-!,:;!( PARISTIC - Bordeaux

7 ) : C G. 1 &) ) ) ( ". 0 1' 2+3' 4 # 5' ' %. - 9: PARISTIC - Bordeaux

8 0 1! - -%! :! 3! - )!"! -! &:.) 0- &@.! 2#) 2#9;) 2#! 1?;!! -! - 9: 43!2)! 0) 9) 4/ ),:; & G. : ; %. PARISTIC - Bordeaux

9 D H %B) : C & F.!! # 6 1'! 7 D,* ; -1 -!8-))) - % # "*9, 19 &. PARISTIC - Bordeaux

10 1 " G.? : F "%" &;.! I 9! & %< "5 GA "5.! 9 0,10 &' ( 0(,(.! 0,10 9 :;! +: %. 5! +:C! ") -9) ' 1) -!,:;! = )6! "!! "%" ) ; PARISTIC - Bordeaux

11 2!8-))) PARISTIC - Bordeaux

12 ! "##" $ "%" &'( ) *+,-.! - " $ -" &'( /) 0,- *+,.! $ 1 &-( ) *-1. $, &,( 0) "-2. $ 3# &4#( ) 54-6.! 7 $ 28 &#( -9) 0,2".!,:; $ 0-2 &( ") 0,- *. $ *1 &( "8/) -+,.! 4 $ 0"-, &3( ),.! $ "350 &( ) *"<. $ 20 &( ) 2.! 1 $ 1- &-( '8),-#*. $ #1*-0 &2( ) 0,-00=1. Thierry Priol! $ 2 &( "8/) -. $ 3,013 &>( 2) 4*3. $ 2* &( =) *'3.! $ 3520=> &( 2) *1=0. # $ &( *) -. #? $ &@#( ") *3. #3 $ = &'( ) -. # $ # &*( ) *3. # * $ ""- &(?)?". #? $ = &2( A),. # 0 $ 2 &@( 2),-#*. # 2! 19 $ #20,1 &*( 9) 5 '. $ 2 &=( ),. $ *3" &4(?),%"B. $ &'( ),.! - $ 0 &( -) *3. $ % &@#*( "/) -+,-. $ * &>( ) 2. PARISTIC - Bordeaux

13 C 9!,:; $ 0 & :. $ = & 1". $ = -,:; 0! 2: + 3- $ $ ' $ $ $ ; +"%"! " $ &@) 9. $ #" $ #2" $! $ 2# & +'. $ * 9 &0) # ) / ) ') $ 2 ) 9 B C++:::((+(+C0 PARISTIC - Bordeaux

14 C 6 C! " $ 0 ) )! -9 $ &"5) ) ) :;. $ $,9! '# $ 1 7 &.) &. $ ' : ;( PARISTIC - Bordeaux

15 C 0 "%" : ; " 0 "%" 2: 3 -,:; 9 PARISTIC - Bordeaux

16 0 :;: * +? ( E G 9 & (. ( 9 9 &. 1 J 0( 3A E 0 PARISTIC - Bordeaux

17 2!8-))) PARISTIC - Bordeaux

18 1 &%%' &%% $%%% &%% 0,10 $" ($%" &%% &%% &%% &%% &%% PARISTIC - Bordeaux

19 - today - K ' ( ' ' : ' &-L. =: -+: ' - " Switch Proto to Grid 5000 " " ' 0 L -L 3 L, L PARISTIC - Bordeaux

20 " " F, " 9! )%%* )%%- )%%& 1 )%%, )%%+ B 0 9 " G% "5 % #." PARISTIC - Bordeaux

21 Grid C! 0! : :! + :! ; PARISTIC - Bordeaux

22 - C MPLS (level 2) Routing. % 9&G. Grid5000 site Router RENATER Router RENATER 8 VLANs per site G5k site Router RENATER G5k site RENATER *9 Switch/router labo Switch Grid J ( Routeur RENATER *9( Grid5000 site DiffServ (IP Premium) 5 *? ; &< ;./ 9.6 :1 6; < $91 : / " / I M 4*, &G 4*,. ' PARISTIC - Bordeaux

23 G5k site Users/ (ssh loggin + password) *?+': 5 - J + LDAP /home/site1/user /site2/user /site G5k site admin/ (ssh loggin + password) rsync (directory) + LDAP /home/site1/user /site2/user /site ':+ rsync (directory) /tmp/user Cluster LDAP + G5k site rsync (directory) + LDAP G5k site Cluster A) A single account for every user B) Every site manages the account of its users. C) Every site runs a LDAP server containing the same tree D) the local administrator has read-write access to its user accounts. E) other account are periodically synchronized from remote servers and are read-only. PARISTIC - Bordeaux

24 A) In every cluster, OAR controls the local resource for B) OAR provides priority scheduling by queues, advance reservations, backfilling and resource match making. 0 - J -C 3 *?+': Users G5k site G5k site OAR OAR Users C) In Grid mode, broker submits a reservation to every local OAR, in a round robin sequence. If one reservation is refused, all previously accepted reservations are canceled. OAR-Grid Broker OAR G5k site *9,:; ':+ D) A specific queue allows user reconfiguring the nodes. Rights are granted on all related nodes accordingly. After the experiment the rights are revoked Cluster Site 3 G 9 &. Cluster PARISTIC - Bordeaux

25 Users/ admin *9,:; Kdeploy2 *?+': Kadeploy2 G5k site (ssh loggin + password) 1) Prepare the software images to distribute and replicate them on related sites G5k site Controler: (Boot server + dhcp) ':+ 2) Register the software images In the Kadeploy database 3) All related nodes are rebooted in a deployment OS, preparing the local disc 4) System kernels and distributions are downloaded on the local disk from a boot server in a pipeline mode 5) Postinstallation scripts set node specific information (Keys for authentication, etc.) Kadeploy2 G5k site Cluster Site 3 G 9 &. Cluster 6) All related nodes are rebooted from the local disc, using a network loaded bootloader PARISTIC - Bordeaux

26 2 % 9&G. 1.!1/ Router RENATER MPLS Router RENATER 7 VLANs per site Grid5000 site G5k site Router RENATER RENATER *9 Switch Grid G5k site Routeur RENATER *9( Grid5000 site Switch/router labo 5 *? ':+ &,-) *"),'-) +) 9) =") *?. '# & 9.! =$19 " / ' PARISTIC - Bordeaux

27 Grid 5000 * - 9? 1 3 PARISTIC - Bordeaux

28 9 : PARISTIC - Bordeaux

29 PARISTIC - Bordeaux

30 PARISTIC - Bordeaux

31 PARISTIC - Bordeaux

32 ( ( PARISTIC - Bordeaux

33 :9 PARISTIC - Bordeaux

34 2 9' > PARISTIC - Bordeaux

35 3 )&% PARISTIC - Bordeaux

36 "!7 " $2: ; $ C 9 ) ) ) ;) (!%,:; 9 PARISTIC - Bordeaux

37 01 1*-0! +?%. +? %>/ $ 19 # $ ': " " ' $ C 9 ) )! %:?.% :?7/ 0 C 9 9 " 9 ) :) 99)!!8-))) > $ $ 01 9 ; $ 0 : 1*-0 $ 4/: 4/01! 0<< '<+?% 0<<&&& '<< PARISTIC - Bordeaux

38 N:; &39 G#GL GL %.!-! "1 &,#6 ':.( 1 9 : 9 ") " ) 9 " ( 1,#6 &L. : : 9,#7 9), 9 9 9) 1 ': &B. G< "5 C G% 9 J 9 &000) 0-),. J B "5 ( PARISTIC - Bordeaux

39 2 PARISTIC - Bordeaux

40 2 Grid 5000 G5k site Kdeploy2 Objective: Boot to Boot time < 10 minutes Kadeploy2 G5k site G5k site *?+': Kadeploy2 *9,:; ':+ Controler: (Boot server + dhcp) Cluster Site 3 G 9 &. Cluster PARISTIC - Bordeaux

41 &G time (sec) A " ( # nodes first check preinstall transfert last check ( A 9 PARISTIC - Bordeaux

42 T=30 s: deployement sequence is launched T=50 s: all nodes are rebooting T=160 s: all nodes rebooted and prepare the disc T=200 s: Second boot order T=320 s: Site2 machines rebooted with user OS T=450 s: Site1 machines rebooted with user OS # nodes T=0 s: all nodes run an OS time (sec) T=800 s: User experiment completed deploying deployed deploying_site1 deployed_site1 deploying_site2 deployed_site2 PARISTIC - Bordeaux

43 2 9 PARISTIC - Bordeaux

44 = Grid 5000? DAS2: 400 CPUs exp. Grid! = O! : $ 9 B(% ; $ "?-J2! " $ 2" &2"=#2) 2"=#%.) "42) " $ "! " $ ) ' KK+I+I VU UvA Leiden Delft Utrecht #nodes % &%%. C Memory (GB) Local disks (GB) File server (GB) * 36 6 * 36 6 * 36 2 * 18 2 * 18 PARISTIC - Bordeaux

45 "*9 9 " 0 " :; " : # "*9 PARISTIC - Bordeaux # 4 # # # # 4

46 * 8 F " &=") ""-) ) (. 3 D; &) "" &N:;). "8 9 ' & &. &,),-#@-1) -;) (. " 5- &87 8,),-'+,. PARISTIC - Bordeaux

47 ! 9 9! : %C $ I 9 I ') $ 9 % "5) $ 9 %) 1? ) $ 9 G 1? ) $ 9 M 9+ &. 9: $ 9 PG 1 + $ 9 Q+3-+2:++R! %! : 9 %<! PARISTIC - Bordeaux

48 650-13,-E PARISTIC - Bordeaux

49 PARISTIC - Bordeaux

50 C 9 1% 39 C 1 ; 1% 1) Design the virtual Grid: a) Select one node to run the GT2 services. b) Select another node to run the cluster front end (batch scheduler, user accounts, etc.) G5k site *9,:; *?+': G5k site ':+ C F 3 Cluster Cluster 9 % Grid Front node Cluster front end G5k site GT2 Gate Keeper C Certificate Globus MDS F Globus GSIFTP Cluster PARISTIC - Bordeaux

51 C 9 1% 39 C 1 ; 1% G5k site 2) Construct the software images for: a) The Grid front end (with GT2 services) b) The cluster front end (with batch scheduler) c) The cluster nodes 3) Reserve the nodes using OAR-Grid 4) Deploy the 3 images using Kadeploy Kdeploy2 *9,:; G5k site *?+': Kdeploy2 ':+ C F 3 Cluster Cluster 9 % Kdeploy2 Grid Front node Cluster front end G5k site GT2 Gate Keeper C Certificate Globus MDS F Globus GSIFTP Cluster PARISTIC - Bordeaux

52 C 9 1% 39 C 1 ; 1% 5) Run the GT2 virtual Grid *?+': G5k site G5k site GT2 Gate Keeper C Certificate F Grid Front node Cluster front end Globus MDS Globus GSIFTP ':+ G5k site *9,:; C F 3 Cluster Cluster PARISTIC - Bordeaux