Towards PaaS and Clouds Our experience with BonjourGrid and PastryGrid

Size: px
Start display at page:

Download "Towards PaaS and Clouds Our experience with BonjourGrid and PastryGrid"

Transcription

1 Towards PaaS and Clouds Our experience with BonjourGrid and PastryGrid AOC Team Christophe Cérin 1 1 Université de Paris XIII, CNRS UMR 7030, France Bi-lateral China-France workshop 1 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

2 Table of contents 2 / Objectives 2 Desktop Grids History and Challenges BonjourGrid PastryGrid 3 Towards PaaS and Clouds PaaSoordinated (under reviewing) The coordination and data exchange layer Technologies (ex.) 4 Conclusion 2 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

3 Objectives 3 / Motivate research projets in Grids & Clouds ; 2. Starting from recent advances in Desktop Grid Middleware: BonjourGrid (orchestration of multiple instances of DG middleware) and PastryGrid (fully distributed execution of applications) Joint works with UTIC lab., Tunisia (Heithem Abbes and Mohamed Jemni) 3. Before keeping innovative ideas to reuse in Cloud Architectures / Systems: decentralized architectures and services; large scale systems (FT); interoperability of services (the client is not a prisonner, or if it is, he can choose his prison(s)!) 3 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

4 Desktop Grid Architectures 4 / 134 Desktop Grid ")*&+',#--)*.#'*/+,!#$#%(0,1$&(2)'(0!"!"#$%&'()&*#+,"%(+%-#(!"#$%&'()"*+&%,-($",$.%" 3&(2)'( "//$4*+#'/$1 3&(/2$.&,5*(.0!#$#%&'&$(!" 9(%":&'';<6= 3 /0#0'1$-(2."+&%,-($",$.%" 45"%+3+6*7(#+(#$"%8&," 6>>'(,&$(0#?,-"*.'"% =&5@+3+A&$&+3+<"$+ B?+3+?&#*C0D E%0$0,0'5 Key Points Federation of thousand of nodes; Internet as the communication layer: no trust! Volatility; local IP; Firewall! "#$%&!'()*+,-!-)(./ 0 4 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

5 Desktop Grid Architectures 5 / 134 Desktop Grid ")*&+', #--)*.#'*/+,!#$#%(0,1 $&(2)'(0!"#$%&'("%')*#+,-"#-.*"!"#$%&'()"*+&%,-($",$.%" /01'($+$&0203*&$&+45#$6 7#$"%+#8*"+,8409 "//$4*+#'/$1 5.6&42)&$,78#(9(:!#$#%&'&$( 3&(2)'(!" :8#8';$-(<."+&%,-($",$.%" ;#'#,<#+#=&$ 5.6&42)&$,78#(9(:! I(%"J&''3D?B "#$%&!'()*+,-!-)(./ & = >0"%+=+?*4(#+(#$"%@&,"?11'(,&$(8# A,-"*.'"% B&02+=+C&$&+=+D"$+ EA+=+A&#*F8G H%8$8,8'0 Future Generation (in 2006) Distributed Architecture Architecture with modularity: every component is configurable : scheduler, storage, transport protocole Direct communications between peers; Security; Applications coming from any sciences (e-science applications) 5 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

6 In search of distributed architecture 6 / 134 First line: publish/subscribe system to notify and coordinate services and multiple DG without a central broker BonjourGrid; Second line: approach based on structured overlay network to discover (on the fly) the next node executing the next task PastryGrid; (main contributions of Heithem Abbes in his PhD) 6 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

7 Main objectives of BonjourGrid 7 / 134 Count on existing distributed tools for services discovering (publish/subscribe paradigm); 7 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

8 Main objectives of BonjourGrid 8 / 134 Count on existing distributed tools for services discovering (publish/subscribe paradigm); Design and implement a platform able to manage multiple instances of DG middleware; 8 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

9 Main objectives of BonjourGrid 9 / 134 Count on existing distributed tools for services discovering (publish/subscribe paradigm); Design and implement a platform able to manage multiple instances of DG middleware; Reduce as much as possible the use of any central element; 9 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

10 10 / 134 Main objectives of BonjourGrid Count on existing distributed tools for services discovering (publish/subscribe paradigm); Design and implement a platform able to manage multiple instances of DG middleware; Reduce as much as possible the use of any central element; Create a coordinator, on the fly, without any system administrator intervention; From a vision with a single coordinator towards a vision with multiple coordinators. 10 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

11 11 / 134 Main objectives of BonjourGrid Count on existing distributed tools for services discovering (publish/subscribe paradigm); Design and implement a platform able to manage multiple instances of DG middleware; Reduce as much as possible the use of any central element; Create a coordinator, on the fly, without any system administrator intervention; From a vision with a single coordinator towards a vision with multiple coordinators. Each coordinator searches, in a concurrent way, participants (idle machines) 11 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

12 12 / 134 How BonjourGrid works 12 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

13 13 / 134 How BonjourGrid works 13 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

14 14 / 134 How BonjourGrid works 14 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

15 15 / 134 How BonjourGrid works 15 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

16 16 / 134 How BonjourGrid works 16 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

17 17 / 134 How BonjourGrid works 17 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

18 18 / 134 How BonjourGrid works 18 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

19 19 / 134 How BonjourGrid works 19 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

20 20 / 134 How BonjourGrid works 20 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

21 21 / 134 How BonjourGrid works 21 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

22 22 / 134 How BonjourGrid works 22 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

23 23 / 134 How BonjourGrid works 23 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

24 24 / 134 How BonjourGrid works 24 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

25 25 / 134 How BonjourGrid works 25 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

26 26 / 134 How BonjourGrid works 26 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

27 27 / 134 BonjourGrid vision The user requests for computation; 27 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

28 28 / 134 BonjourGrid vision The user requests for computation; The user provides the control flow graph, binaries, input data; 28 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

29 29 / 134 BonjourGrid vision The user requests for computation; The user provides the control flow graph, binaries, input data; The user deploys locally a coordinator and requests for participants; We support XtremWeb, Condor, Boinc. 29 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

30 30 / 134 BonjourGrid vision The user requests for computation; The user provides the control flow graph, binaries, input data; The user deploys locally a coordinator and requests for participants; We support XtremWeb, Condor, Boinc. The coordinator selects a set of machines (criteria: RAM, CPU, costs... ) 30 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

31 31 / 134 BonjourGrid vision The user requests for computation; The user provides the control flow graph, binaries, input data; The user deploys locally a coordinator and requests for participants; We support XtremWeb, Condor, Boinc. The coordinator selects a set of machines (criteria: RAM, CPU, costs... ) Upon completion, the coordinator returns to the idle state, slaves are freed and the coordination protocol: 31 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

32 32 / 134 BonjourGrid vision The user requests for computation; The user provides the control flow graph, binaries, input data; The user deploys locally a coordinator and requests for participants; We support XtremWeb, Condor, Boinc. The coordinator selects a set of machines (criteria: RAM, CPU, costs... ) Upon completion, the coordinator returns to the idle state, slaves are freed and the coordination protocol: manages and controls resources, services and computing elements; does not depend on any specific machine nor any central element. 32 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

33 33 / 134 BonjourGrid vision The user requests for computation; The user provides the control flow graph, binaries, input data; The user deploys locally a coordinator and requests for participants; We support XtremWeb, Condor, Boinc. The coordinator selects a set of machines (criteria: RAM, CPU, costs... ) Upon completion, the coordinator returns to the idle state, slaves are freed and the coordination protocol: manages and controls resources, services and computing elements; does not depend on any specific machine nor any central element. 33 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

34 34 / 134 The protocol for resources discovering Based on Bonjour from Apple; 34 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

35 35 / 134 The protocol for resources discovering Based on Bonjour from Apple; A publish/subscribe system is easy to use (toolbox = publish(), subscribe(), browse()) 35 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

36 36 / 134 The protocol for resources discovering Based on Bonjour from Apple; A publish/subscribe system is easy to use (toolbox = publish(), subscribe(), browse()) Bonjour is dedicated to LAN (wide area Bonjour? We need some experiments) 36 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

37 37 / 134 The protocol for resources discovering Based on Bonjour from Apple; A publish/subscribe system is easy to use (toolbox = publish(), subscribe(), browse()) Bonjour is dedicated to LAN (wide area Bonjour? We need some experiments) Concerning the Wide Area implementation: we can also think about Apache Kandula ( or even cisco Jabber protocol ( 37 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

38 The protocol for resources discovering 38 / 134 Based on Bonjour from Apple; A publish/subscribe system is easy to use (toolbox = publish(), subscribe(), browse()) Bonjour is dedicated to LAN (wide area Bonjour? We need some experiments) Concerning the Wide Area implementation: we can also think about Apache Kandula ( or even cisco Jabber protocol ( Extensible Messaging and Presence Protocol (XMPP) (formerly named Jabber) is an open, XML-based protocol originally aimed at near-real-time, extensible instant messaging (IM) and presence information, but now expanded into the broader realm of message-oriented middleware 38 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

39 The protocol for resources discovering 39 / 134 Based on Bonjour from Apple; A publish/subscribe system is easy to use (toolbox = publish(), subscribe(), browse()) Bonjour is dedicated to LAN (wide area Bonjour? We need some experiments) Concerning the Wide Area implementation: we can also think about Apache Kandula ( or even cisco Jabber protocol ( Extensible Messaging and Presence Protocol (XMPP) (formerly named Jabber) is an open, XML-based protocol originally aimed at near-real-time, extensible instant messaging (IM) and presence information, but now expanded into the broader realm of message-oriented middleware The current protocol has been developed/specified with ad-hoc methods we need to consolidate the trust (ongoing project to verify it, based on Colored Petri Nets) 39 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

40 40 / 134 Fault Tolerance with BonjourGrid Intrinsic property of any large scale system; 40 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

41 41 / 134 Fault Tolerance with BonjourGrid Intrinsic property of any large scale system; We assume that any coordinator is responsible for its FT (it manages the volatility of attached slaves) 41 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

42 42 / 134 Fault Tolerance with BonjourGrid Intrinsic property of any large scale system; We assume that any coordinator is responsible for its FT (it manages the volatility of attached slaves) Our solution: tolerate the failure of coordinators 42 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

43 43 / 134 Fault Tolerance with BonjourGrid Intrinsic property of any large scale system; We assume that any coordinator is responsible for its FT (it manages the volatility of attached slaves) Our solution: tolerate the failure of coordinators For any application we create and manage dynamically copies of the coordinator; We manage k copies; based on passive replication. When a service disappears: we added a special status flag to distinguish between end of the application / failure slaves can redirect the communication to a copy. 43 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

44 44 / 134 Intensive Experiments BonjourGrid has been tested intensively: stressed scenario to more relaxing scenario 44 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

45 45 / 134 Intensive Experiments BonjourGrid has been tested intensively: stressed scenario to more relaxing scenario in terms of #coordinator versus #nodes in terms of using virtual machines to reach 1000 nodes; in terms of comparing Boinc, Condor, XtremWeb over our protocol; in terms of robustness in supporting FT; 45 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

46 46 / 134 Intensive Experiments BonjourGrid has been tested intensively: stressed scenario to more relaxing scenario in terms of #coordinator versus #nodes in terms of using virtual machines to reach 1000 nodes; in terms of comparing Boinc, Condor, XtremWeb over our protocol; in terms of robustness in supporting FT; Example Condor: 130 applications (2 to 128 // tasks), 200 nodes, application task: 1s to 500s. Result: with BonjourGrid, 35% of applications generate a delay of about 30s. 46 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

47 47 / 134 Experiments: one example 47 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

48 48 / 134 PastryGrid s overview Main objectives Fully distributed execution of task graph; 48 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

49 49 / 134 PastryGrid s overview Main objectives Fully distributed execution of task graph; Distributed resource management; 49 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

50 50 / 134 PastryGrid s overview Main objectives Fully distributed execution of task graph; Distributed resource management; Distributed coordination; 50 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

51 51 / 134 PastryGrid s overview Main objectives Fully distributed execution of task graph; Distributed resource management; Distributed coordination; Dynamically creation of an execution environment; 51 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

52 52 / 134 PastryGrid s overview Main objectives Fully distributed execution of task graph; Distributed resource management; Distributed coordination; Dynamically creation of an execution environment; No central element; 52 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

53 53 / 134 PastryGrid s overview Main objectives Fully distributed execution of task graph; Distributed resource management; Distributed coordination; Dynamically creation of an execution environment; No central element; PastryGrid vs BonjourGrid New computing platform vs multiple instances of DG middleware 53 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

54 54 / 134 PastryGrid s overview Main objectives Fully distributed execution of task graph; Distributed resource management; Distributed coordination; Dynamically creation of an execution environment; No central element; PastryGrid vs BonjourGrid New computing platform vs multiple instances of DG middleware Contains its own approach for application distribution vs you count on a DG middleware 54 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

55 55 / 134 PastryGrid s Terminology Task terminology Friend tasks: T 2, T 3 share the same successor (T 6 ) 55 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

56 56 / 134 PastryGrid s Terminology Task terminology Friend tasks: T 2, T 3 share the same successor (T 6 ) Shared tasks T 6 : has n > 1 ancestors (T 2, T 3 ) 56 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

57 57 / 134 PastryGrid s Terminology Task terminology Friend tasks: T 2, T 3 share the same successor (T 6 ) Shared tasks T 6 : has n > 1 ancestors (T 2, T 3 ) Isolated tasks T 4, T 5 : have a single ancestor 57 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

58 58 / 134 PastryGrid s Terminology Task terminology Friend tasks: T 2, T 3 share the same successor (T 6 ) Shared tasks T 6 : has n > 1 ancestors (T 2, T 3 ) Isolated tasks T 4, T 5 : have a single ancestor 58 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

59 59 / 134 PastryGrid s Terminology Task terminology Friend tasks: T 2, T 3 share the same successor (T 6 ) Shared tasks T 6 : has n > 1 ancestors (T 2, T 3 ) Isolated tasks T 4, T 5 : have a single ancestor Example 59 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

60 60 / 134 PastryGrid components Addressing scheme to identify applications and users (based on haching application name + submission date + user name DHT (Pastry)) 60 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

61 61 / 134 PastryGrid components Addressing scheme to identify applications and users (based on haching application name + submission date + user name DHT (Pastry)) Protocol of resource discovering; No dedicated nodes for the search of the next node to use on the fly! Optimization: the machine that terminates the last starts the search. 61 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

62 62 / 134 PastryGrid components Addressing scheme to identify applications and users (based on haching application name + submission date + user name DHT (Pastry)) Protocol of resource discovering; No dedicated nodes for the search of the next node to use on the fly! Optimization: the machine that terminates the last starts the search. Rendez-vous concept (RDV); Objectives: localisation of a node without IP; task coordination; data recovery; 62 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

63 63 / 134 PastryGrid components Addressing scheme to identify applications and users (based on haching application name + submission date + user name DHT (Pastry)) Protocol of resource discovering; No dedicated nodes for the search of the next node to use on the fly! Optimization: the machine that terminates the last starts the search. Rendez-vous concept (RDV); Objectives: localisation of a node without IP; task coordination; data recovery; coordination protocol between machines participating in the application. 63 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

64 64 / 134 PastryGrid components Addressing scheme to identify applications and users (based on haching application name + submission date + user name DHT (Pastry)) Protocol of resource discovering; No dedicated nodes for the search of the next node to use on the fly! Optimization: the machine that terminates the last starts the search. Rendez-vous concept (RDV); Objectives: localisation of a node without IP; task coordination; data recovery; coordination protocol between machines participating in the application. 64 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

65 65 / 134 RDV Concept Coordinator Known at the beginning; 65 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

66 66 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; 66 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

67 67 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; 67 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

68 68 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; Centralized resource management; 68 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

69 69 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; Centralized resource management; Management of all applications (overload) 69 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

70 70 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; Centralized resource management; Management of all applications (overload) RDV Unknown; 70 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

71 71 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; Centralized resource management; Management of all applications (overload) RDV Unknown; Variable; 71 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

72 72 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; Centralized resource management; Management of all applications (overload) RDV Unknown; Variable; Failure: may still run; 72 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

73 73 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; Centralized resource management; Management of all applications (overload) RDV Unknown; Variable; Failure: may still run; Distributed data management; 73 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

74 74 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; Centralized resource management; Management of all applications (overload) RDV Unknown; Variable; Failure: may still run; Distributed data management; RDV for each application (limited overload) 74 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

75 75 / 134 RDV Concept Coordinator Known at the beginning; Central element on a decicated place; Failure: the system crashes; Centralized resource management; Management of all applications (overload) RDV Unknown; Variable; Failure: may still run; Distributed data management; RDV for each application (limited overload) 75 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

76 76 / 134 How PastryGrid works 76 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

77 77 / 134 How PastryGrid works 77 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

78 78 / 134 How PastryGrid works 78 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

79 79 / 134 How PastryGrid works 79 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

80 80 / 134 How PastryGrid works 80 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

81 81 / 134 How PastryGrid works 81 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

82 82 / 134 How PastryGrid works 82 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

83 83 / 134 How PastryGrid works 83 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

84 84 / 134 How PastryGrid works 84 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

85 85 / 134 How PastryGrid works 85 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

86 86 / 134 How PastryGrid works 86 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

87 87 / 134 How PastryGrid works 87 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

88 88 / 134 How PastryGrid works 88 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

89 89 / 134 How PastryGrid works 89 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

90 90 / 134 How PastryGrid works 90 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

91 91 / 134 Fault Tolerance in PastryGrid (brief overview) Active replication based on Past (maintaining of k copies of the node states) ; update copies when a modification occurs on a source node; automatically creation of a copy (to maintain k) 91 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

92 92 / 134 Fault Tolerance in PastryGrid (brief overview) Active replication based on Past (maintaining of k copies of the node states) ; update copies when a modification occurs on a source node; automatically creation of a copy (to maintain k) If we adopt such approach node explosion; 92 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

93 93 / 134 Fault Tolerance in PastryGrid (brief overview) Active replication based on Past (maintaining of k copies of the node states) ; update copies when a modification occurs on a source node; automatically creation of a copy (to maintain k) If we adopt such approach node explosion; A new component has been added: FTC (Fault Tolerant Component) node Supervises tasks that are running; 93 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

94 94 / 134 Fault Tolerance in PastryGrid (brief overview) Active replication based on Past (maintaining of k copies of the node states) ; update copies when a modification occurs on a source node; automatically creation of a copy (to maintain k) If we adopt such approach node explosion; A new component has been added: FTC (Fault Tolerant Component) node Supervises tasks that are running; A FCT component for each application; It contacts the RDV to decide the tasks to supervise; 94 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

95 95 / 134 Fault Tolerance in PastryGrid (brief overview) Active replication based on Past (maintaining of k copies of the node states) ; update copies when a modification occurs on a source node; automatically creation of a copy (to maintain k) If we adopt such approach node explosion; A new component has been added: FTC (Fault Tolerant Component) node Supervises tasks that are running; A FCT component for each application; It contacts the RDV to decide the tasks to supervise; k copies of the FCT and k copies of the RDV per application. In fact you have 3 types of nodes: computing nodes, FCT nodes and RDV nodes to manage; 95 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

96 96 / 134 Fault Tolerance in PastryGrid (brief overview) Active replication based on Past (maintaining of k copies of the node states) ; update copies when a modification occurs on a source node; automatically creation of a copy (to maintain k) If we adopt such approach node explosion; A new component has been added: FTC (Fault Tolerant Component) node Supervises tasks that are running; A FCT component for each application; It contacts the RDV to decide the tasks to supervise; k copies of the FCT and k copies of the RDV per application. In fact you have 3 types of nodes: computing nodes, FCT nodes and RDV nodes to manage; 96 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

97 97 / 134 PastryGrid Validation The FT part Intensive experiments have been conducted (each machine has a probability P to fail for X seconds): P = 20%, 40%, 80% ; 100 applications (2 to 128 // tasks) ; on 200 nodes 97 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

98 98 / 134 PastryGrid Validation The FT part Intensive experiments have been conducted (each machine has a probability P to fail for X seconds): P = 20%, 40%, 80% ; 100 applications (2 to 128 // tasks) ; on 200 nodes Main observations: In all cases, PastryGrid terminates; The recovery time depends on the node type; The delay varies from 4:53s to 7:16:41s... but it works! The number of delayed applications varies from 44 to Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

99 99 / 134 Towards PaaS and Clouds The new context: Platform as a Service and Cloud Outsourcing of software resources (Google word/spreadsheet online) and hardware resources (Amazon EC2); 99 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

100 100 / 134 Towards PaaS and Clouds The new context: Platform as a Service and Cloud Outsourcing of software resources (Google word/spreadsheet online) and hardware resources (Amazon EC2); A variant: Platform as a Service (PaaS) where users also inherit from a complete development infrastructure (based on Javascript for the future?); 100 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

101 101 / 134 Towards PaaS and Clouds The new context: Platform as a Service and Cloud Outsourcing of software resources (Google word/spreadsheet online) and hardware resources (Amazon EC2); A variant: Platform as a Service (PaaS) where users also inherit from a complete development infrastructure (based on Javascript for the future?); No hosting problem for the user; 101 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

102 102 / 134 Towards PaaS and Clouds The new context: Platform as a Service and Cloud Outsourcing of software resources (Google word/spreadsheet online) and hardware resources (Amazon EC2); A variant: Platform as a Service (PaaS) where users also inherit from a complete development infrastructure (based on Javascript for the future?); No hosting problem for the user; No update problem for the user (he always uses the last release); 102 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

103 103 / 134 Towards PaaS and Clouds The new context: Platform as a Service and Cloud Outsourcing of software resources (Google word/spreadsheet online) and hardware resources (Amazon EC2); A variant: Platform as a Service (PaaS) where users also inherit from a complete development infrastructure (based on Javascript for the future?); No hosting problem for the user; No update problem for the user (he always uses the last release); No maintenance, no local storage. 103 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

104 104 / 134 Towards PaaS and Clouds The new context: Platform as a Service and Cloud Outsourcing of software resources (Google word/spreadsheet online) and hardware resources (Amazon EC2); A variant: Platform as a Service (PaaS) where users also inherit from a complete development infrastructure (based on Javascript for the future?); No hosting problem for the user; No update problem for the user (he always uses the last release); No maintenance, no local storage. We have started an initiative for defining and designing a general purpose PaaS based on distributed protocols for coordination and data exchange. 104 Christophe Cérin, Heithem Abbes Sous thème grille Équipe AOC

The design of BonjourGrid, a decentralized system for the coordination of multiple instances of Desktop Grid middleware

The design of BonjourGrid, a decentralized system for the coordination of multiple instances of Desktop Grid middleware The design of BonjourGrid, a decentralized system for the coordination of multiple instances of Desktop Grid middleware Christophe Cérin 1 http://www.lipn.fr/~cerin/ 1 Université de Paris XIII, CNRS UMR

More information

How To Understand Cloud Computing

How To Understand Cloud Computing Overview of Cloud Computing (ENCS 691K Chapter 1) Roch Glitho, PhD Associate Professor and Canada Research Chair My URL - http://users.encs.concordia.ca/~glitho/ Overview of Cloud Computing Towards a definition

More information

Distributed Systems Lecture 1 1

Distributed Systems Lecture 1 1 Distributed Systems Lecture 1 1 Distributed Systems Lecturer: Therese Berg therese.berg@it.uu.se. Recommended text book: Distributed Systems Concepts and Design, Coulouris, Dollimore and Kindberg. Addison

More information

Cloud Computing Architecture: A Survey

Cloud Computing Architecture: A Survey Cloud Computing Architecture: A Survey Abstract Now a day s Cloud computing is a complex and very rapidly evolving and emerging area that affects IT infrastructure, network services, data management and

More information

Cloud Computing. Cloud computing:

Cloud Computing. Cloud computing: Cloud computing: Cloud Computing A model of data processing in which high scalability IT solutions are delivered to multiple users: as a service, on a mass scale, on the Internet. Network services offering:

More information

System Models for Distributed and Cloud Computing

System Models for Distributed and Cloud Computing System Models for Distributed and Cloud Computing Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Classification of Distributed Computing Systems

More information

Architectural Implications of Cloud Computing

Architectural Implications of Cloud Computing Architectural Implications of Cloud Computing Grace Lewis Research, Technology and Systems Solutions (RTSS) Program Lewis is a senior member of the technical staff at the SEI in the Research, Technology,

More information

Data Centers and Cloud Computing. Data Centers

Data Centers and Cloud Computing. Data Centers Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet

More information

Data Centers and Cloud Computing

Data Centers and Cloud Computing Data Centers and Cloud Computing CS377 Guest Lecture Tian Guo 1 Data Centers and Cloud Computing Intro. to Data centers Virtualization Basics Intro. to Cloud Computing Case Study: Amazon EC2 2 Data Centers

More information

SlapOS: a Multi-purpose Distributed Cloud Operating System Based on an ERP Billing Model

SlapOS: a Multi-purpose Distributed Cloud Operating System Based on an ERP Billing Model SlapOS: a Multi-purpose Distributed Cloud Operating System Based on an ERP Billing Model Jean-Paul Smets-Solanes, Christophe Cérin and Romain Courteaud Nexedi SA, 270 boulevard Clémenceau, 59700 Marcq-en-Baroeul,

More information

Cloud Computing. Chapter 1 Introducing Cloud Computing

Cloud Computing. Chapter 1 Introducing Cloud Computing Cloud Computing Chapter 1 Introducing Cloud Computing Learning Objectives Understand the abstract nature of cloud computing. Describe evolutionary factors of computing that led to the cloud. Describe virtualization

More information

ERP and E-Business Application Deployment in Open Source Distributed Cloud Systems

ERP and E-Business Application Deployment in Open Source Distributed Cloud Systems Database Systems Journal vol. III, no.3/2012 3 ERP and E-Business Application Deployment in Open Source Distributed Cloud Systems George SUCIU 1, Traian-Lucian MILITARU 2,3, Gyorgy TODORAN 3 1, 2 Faculty

More information

Outline. What is cloud computing? History Cloud service models Cloud deployment forms Advantages/disadvantages

Outline. What is cloud computing? History Cloud service models Cloud deployment forms Advantages/disadvantages Ivan Zapevalov 2 Outline What is cloud computing? History Cloud service models Cloud deployment forms Advantages/disadvantages 3 What is cloud computing? 4 What is cloud computing? Cloud computing is the

More information

Dependability in Web Services

Dependability in Web Services Dependability in Web Services Christian Mikalsen chrismi@ifi.uio.no INF5360, Spring 2008 1 Agenda Introduction to Web Services. Extensible Web Services Architecture for Notification in Large- Scale Systems.

More information

Georgiana Macariu, Dana Petcu, CiprianCraciun, Silviu Panica, Marian Neagul eaustria Research Institute Timisoara, Romania

Georgiana Macariu, Dana Petcu, CiprianCraciun, Silviu Panica, Marian Neagul eaustria Research Institute Timisoara, Romania Open source API and platform for heterogeneous Cloud computing environments Georgiana Macariu, Dana Petcu, CiprianCraciun, Silviu Panica, Marian Neagul eaustria Research Institute Timisoara, Romania Problem

More information

Plug-and-play Virtual Appliance Clusters Running Hadoop. Dr. Renato Figueiredo ACIS Lab - University of Florida

Plug-and-play Virtual Appliance Clusters Running Hadoop. Dr. Renato Figueiredo ACIS Lab - University of Florida Plug-and-play Virtual Appliance Clusters Running Hadoop Dr. Renato Figueiredo ACIS Lab - University of Florida Advanced Computing and Information Systems laboratory Introduction You have so far learned

More information

TECHNOLOGY GUIDE THREE. Emerging Types of Enterprise Computing

TECHNOLOGY GUIDE THREE. Emerging Types of Enterprise Computing TECHNOLOGY GUIDE THREE Emerging Types of Enterprise Computing TECHNOLOGY GU IDE OUTLINE TG3.1 Introduction TG3.2 Server Farms TG3.3 Virtualization TG3.4 Grid Computing TG3.5 Utility Computing TG3.6 Cloud

More information

CLOUD COMPUTING. When It's smarter to rent than to buy

CLOUD COMPUTING. When It's smarter to rent than to buy CLOUD COMPUTING When It's smarter to rent than to buy Is it new concept? Nothing new In 1990 s, WWW itself Grid Technologies- Scientific applications Online banking websites More convenience Not to visit

More information

A Study of Infrastructure Clouds

A Study of Infrastructure Clouds A Study of Infrastructure Clouds Pothamsetty Nagaraju 1, K.R.R.M.Rao 2 1 Pursuing M.Tech(CSE), Nalanda Institute of Engineering & Technology,Siddharth Nagar, Sattenapalli, Guntur., Affiliated to JNTUK,

More information

Cloud Computing with Red Hat Solutions. Sivaram Shunmugam Red Hat Asia Pacific Pte Ltd. sivaram@redhat.com

Cloud Computing with Red Hat Solutions. Sivaram Shunmugam Red Hat Asia Pacific Pte Ltd. sivaram@redhat.com Cloud Computing with Red Hat Solutions Sivaram Shunmugam Red Hat Asia Pacific Pte Ltd sivaram@redhat.com Linux Automation Details Red Hat's Linux Automation strategy for next-generation IT infrastructure

More information

Cloud Computing. Chapter 1 Introducing Cloud Computing

Cloud Computing. Chapter 1 Introducing Cloud Computing Cloud Computing Chapter 1 Introducing Cloud Computing Learning Objectives Understand the abstract nature of cloud computing. Describe evolutionary factors of computing that led to the cloud. Describe virtualization

More information

Cloud Computing 159.735. Submitted By : Fahim Ilyas (08497461) Submitted To : Martin Johnson Submitted On: 31 st May, 2009

Cloud Computing 159.735. Submitted By : Fahim Ilyas (08497461) Submitted To : Martin Johnson Submitted On: 31 st May, 2009 Cloud Computing 159.735 Submitted By : Fahim Ilyas (08497461) Submitted To : Martin Johnson Submitted On: 31 st May, 2009 Table of Contents Introduction... 3 What is Cloud Computing?... 3 Key Characteristics...

More information

The Cisco Powered Network Cloud: An Exciting Managed Services Opportunity

The Cisco Powered Network Cloud: An Exciting Managed Services Opportunity . White Paper The Cisco Powered Network Cloud: An Exciting Managed Services Opportunity The cloud computing phenomenon is generating a lot of interest worldwide because of its potential to offer services

More information

University of Messina, Italy

University of Messina, Italy University of Messina, Italy IEEE MoCS 2011 Kerkyra - Greece June 28, 2011 Dr. Massimo Villari mvillari@unime.it Cross Cloud Federation Federated Cloud Scenario Cloud Middleware Model: the Stack The CLEVER

More information

Oracle Applications and Cloud Computing - Future Direction

Oracle Applications and Cloud Computing - Future Direction Oracle Applications and Cloud Computing - Future Direction February 26, 2010 03:00 PM 03:40 PM Presented By Subash Krishnaswamy skrishna@astcorporation.com Vijay Tirumalai vtirumalai@astcorporation.com

More information

Distributed Systems Architectures

Distributed Systems Architectures Software Engineering Distributed Systems Architectures Based on Software Engineering, 7 th Edition by Ian Sommerville Objectives To explain the advantages and disadvantages of different distributed systems

More information

CLEVER: a CLoud-Enabled Virtual EnviRonment

CLEVER: a CLoud-Enabled Virtual EnviRonment CLEVER: a CLoud-Enabled Virtual EnviRonment Francesco Tusa Maurizio Paone Massimo Villari Antonio Puliafito {ftusa,mpaone,mvillari,apuliafito}@unime.it Università degli Studi di Messina, Dipartimento di

More information

Cloud Computing & Service Oriented Architecture An Overview

Cloud Computing & Service Oriented Architecture An Overview Cloud Computing & Service Oriented Architecture An Overview Sumantra Sarkar Georgia State University Robinson College of Business November 29 & 30, 2010 MBA 8125 Fall 2010 Agenda Cloud Computing Definition

More information

Stackato PaaS Architecture: How it works and why.

Stackato PaaS Architecture: How it works and why. Stackato PaaS Architecture: How it works and why. White Paper Published in 2012 Stackato PaaS Architecture: How it works and why. Stackato is software for creating a private Platform-as-a-Service (PaaS).

More information

Classic Grid Architecture

Classic Grid Architecture Peer-to to-peer Grids Classic Grid Architecture Resources Database Database Netsolve Collaboration Composition Content Access Computing Security Middle Tier Brokers Service Providers Middle Tier becomes

More information

What Is It? Business Architecture Research Challenges Bibliography. Cloud Computing. Research Challenges Overview. Carlos Eduardo Moreira dos Santos

What Is It? Business Architecture Research Challenges Bibliography. Cloud Computing. Research Challenges Overview. Carlos Eduardo Moreira dos Santos Research Challenges Overview May 3, 2010 Table of Contents I 1 What Is It? Related Technologies Grid Computing Virtualization Utility Computing Autonomic Computing Is It New? Definition 2 Business Business

More information

SaaS & Cloud Application Development & Delivery

SaaS & Cloud Application Development & Delivery SaaS & Cloud Application Development & Delivery A Whitepaper by Ekartha, Inc. by Gurpreet Singh, Ekartha Inc. Raj Sethi, Ekartha Inc. Ekartha, Inc. 63 Cutter Mill Road Great Neck, N.Y. 11021 Tel.: (516)

More information

SOA and Cloud in practice - An Example Case Study

SOA and Cloud in practice - An Example Case Study SOA and Cloud in practice - An Example Case Study 2 nd RECOCAPE Event "Emerging Software Technologies: Trends & Challenges Nov. 14 th 2012 ITIDA, Smart Village, Giza, Egypt Agenda What is SOA? What is

More information

Oracle Database Cloud

Oracle Database Cloud Oracle Database Cloud Shakeeb Rahman Database Cloud Service Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may

More information

WELCOME TO Open Source Enterprise Architecture

WELCOME TO Open Source Enterprise Architecture WELCOME TO Open Source Enterprise Architecture WELCOME TO An overview of Open Source Enterprise Architecture In the integration domain Who we are Fredrik Hilmersson Petter Nordlander Why Open Source Integration

More information

Cost-Benefit Analysis of Cloud Computing versus Desktop Grids

Cost-Benefit Analysis of Cloud Computing versus Desktop Grids Cost-Benefit Analysis of Cloud Computing versus Desktop Grids Derrick Kondo, Bahman Javadi, Paul Malécot, Franck Cappello INRIA, France David P. Anderson UC Berkeley, USA Cloud Background Vision Hide complexity

More information

Chapter 2: Cloud Basics Chapter 3: Cloud Architecture

Chapter 2: Cloud Basics Chapter 3: Cloud Architecture Chapter 2: Cloud Basics Chapter 3: Cloud Architecture Service provider s job is supplying abstraction layer Users and developers are isolated from complexity of IT technology: Virtualization Service-oriented

More information

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2 DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing Slide 1 Slide 3 A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet.

More information

Distribution transparency. Degree of transparency. Openness of distributed systems

Distribution transparency. Degree of transparency. Openness of distributed systems Distributed Systems Principles and Paradigms Maarten van Steen VU Amsterdam, Dept. Computer Science steen@cs.vu.nl Chapter 01: Version: August 27, 2012 1 / 28 Distributed System: Definition A distributed

More information

Cloud Computing: Computing as a Service. Prof. Daivashala Deshmukh Maharashtra Institute of Technology, Aurangabad

Cloud Computing: Computing as a Service. Prof. Daivashala Deshmukh Maharashtra Institute of Technology, Aurangabad Cloud Computing: Computing as a Service Prof. Daivashala Deshmukh Maharashtra Institute of Technology, Aurangabad Abstract: Computing as a utility. is a dream that dates from the beginning from the computer

More information

CHAPTER 1 INTRODUCTION

CHAPTER 1 INTRODUCTION 1 CHAPTER 1 INTRODUCTION Internet has revolutionized the world. There seems to be no limit to the imagination of how computers can be used to help mankind. Enterprises are typically comprised of hundreds

More information

JXTA TM : Beyond P2P File Sharing the Emergence of Knowledge Addressable Networks

JXTA TM : Beyond P2P File Sharing the Emergence of Knowledge Addressable Networks JXTA TM : Beyond P2P File Sharing the Emergence of Knowledge Addressable Networks Bernard Traversat tra@jxta.org JXTA Chief Architect Sun Microsystems 2005 JavaOne SM Conference Session 7208 Extended and

More information

An Introduction to Private Cloud

An Introduction to Private Cloud An Introduction to Private Cloud As the word cloud computing becomes more ubiquitous these days, several questions can be raised ranging from basic question like the definitions of a cloud and cloud computing

More information

Investor Newsletter. Storage Made Easy Cloud Appliance High Availability Options WHAT IS THE CLOUD APPLIANCE?

Investor Newsletter. Storage Made Easy Cloud Appliance High Availability Options WHAT IS THE CLOUD APPLIANCE? Investor Newsletter Storage Made Easy Cloud Appliance High Availability Options WHAT IS THE CLOUD APPLIANCE? The SME Cloud Appliance is a software platform that enables companies to enhance their existing

More information

Networks and Services

Networks and Services Networks and Services Dr. Mohamed Abdelwahab Saleh IET-Networks, GUC Fall 2015 TOC 1 Infrastructure as a Service 2 Platform as a Service 3 Software as a Service Infrastructure as a Service Definition Infrastructure

More information

Managing Large Imagery Databases via the Web

Managing Large Imagery Databases via the Web 'Photogrammetric Week 01' D. Fritsch & R. Spiller, Eds. Wichmann Verlag, Heidelberg 2001. Meyer 309 Managing Large Imagery Databases via the Web UWE MEYER, Dortmund ABSTRACT The terramapserver system is

More information

IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures

IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Introduction

More information

High Performance Computing Cloud Computing. Dr. Rami YARED

High Performance Computing Cloud Computing. Dr. Rami YARED High Performance Computing Cloud Computing Dr. Rami YARED Outline High Performance Computing Parallel Computing Cloud Computing Definitions Advantages and drawbacks Cloud Computing vs Grid Computing Outline

More information

IBM 000-281 EXAM QUESTIONS & ANSWERS

IBM 000-281 EXAM QUESTIONS & ANSWERS IBM 000-281 EXAM QUESTIONS & ANSWERS Number: 000-281 Passing Score: 800 Time Limit: 120 min File Version: 58.8 http://www.gratisexam.com/ IBM 000-281 EXAM QUESTIONS & ANSWERS Exam Name: Foundations of

More information

Designing a Windows Server 2008 Applications Infrastructure

Designing a Windows Server 2008 Applications Infrastructure Designing a Windows Server 2008 Applications Infrastructure Course 6437A : Three days; Instructor-Led Introduction This three day course will prepare IT professionals for the role of Enterprise Administrator.

More information

Data Centers and Cloud Computing. Data Centers. MGHPCC Data Center. Inside a Data Center

Data Centers and Cloud Computing. Data Centers. MGHPCC Data Center. Inside a Data Center Data Centers and Cloud Computing Intro. to Data centers Virtualization Basics Intro. to Cloud Computing Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises

More information

SSM6437 DESIGNING A WINDOWS SERVER 2008 APPLICATIONS INFRASTRUCTURE

SSM6437 DESIGNING A WINDOWS SERVER 2008 APPLICATIONS INFRASTRUCTURE SSM6437 DESIGNING A WINDOWS SERVER 2008 APPLICATIONS INFRASTRUCTURE Duration 5 Days Course Outline Module 1: Designing IIS Web Farms The students will learn the process of designing IIS Web Farms with

More information

yvette@yvetteagostini.it yvette@yvetteagostini.it

yvette@yvetteagostini.it yvette@yvetteagostini.it 1 The following is merely a collection of notes taken during works, study and just-for-fun activities No copyright infringements intended: all sources are duly listed at the end of the document This work

More information

Efficient Cloud Management for Parallel Data Processing In Private Cloud

Efficient Cloud Management for Parallel Data Processing In Private Cloud 2012 International Conference on Information and Network Technology (ICINT 2012) IPCSIT vol. 37 (2012) (2012) IACSIT Press, Singapore Efficient Cloud Management for Parallel Data Processing In Private

More information

Future of Cloud Computing. Irena Bojanova, Ph.D. UMUC, NIST

Future of Cloud Computing. Irena Bojanova, Ph.D. UMUC, NIST Future of Cloud Computing Irena Bojanova, Ph.D. UMUC, NIST No Longer On The Horizon Essential Characteristics On-demand Self-Service Broad Network Access Resource Pooling Rapid Elasticity Measured Service

More information

Global Innovations in Cloud Computing Services and Deployment

Global Innovations in Cloud Computing Services and Deployment Global Innovations in Cloud Computing Services and Deployment Fathima Rifaa.P 1 Department of ECE, Excel College of Technology, Affiliated to Anna University, Pallakkapalayam India 1 ABSTRACT: Cloud computing

More information

Data Centers and Cloud Computing. Data Centers

Data Centers and Cloud Computing. Data Centers Data Centers and Cloud Computing Intro. to Data centers Virtualization Basics Intro. to Cloud Computing 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises

More information

CLOUD COMPUTING. Dana Petcu West University of Timisoara http://web.info.uvt.ro/~petcu

CLOUD COMPUTING. Dana Petcu West University of Timisoara http://web.info.uvt.ro/~petcu CLOUD COMPUTING Dana Petcu West University of Timisoara http://web.info.uvt.ro/~petcu TRENDY 2 WHY COINED CLOUD? Ask 10 professionals what cloud computing is, and you ll get 10 different answers CC is

More information

Vortex White Paper. Simplifying Real-time Information Integration in Industrial Internet of Things (IIoT) Control Systems

Vortex White Paper. Simplifying Real-time Information Integration in Industrial Internet of Things (IIoT) Control Systems Vortex White Paper Simplifying Real-time Information Integration in Industrial Internet of Things (IIoT) Control Systems Version 1.0 February 2015 Andrew Foster, Product Marketing Manager, PrismTech Vortex

More information

6437A: Designing a Windows Server 2008 Applications Infrastructure (3 Days)

6437A: Designing a Windows Server 2008 Applications Infrastructure (3 Days) www.peaksolutions.com 6437A: Designing a Windows Server 2008 Applications Infrastructure (3 Days) Introduction This course will prepare IT professionals for the role of Enterprise Administrator. Students

More information

CHECKLIST FOR THE CLOUD ADOPTION IN THE PUBLIC SECTOR

CHECKLIST FOR THE CLOUD ADOPTION IN THE PUBLIC SECTOR CHECKLIST FOR THE CLOUD ADOPTION IN THE PUBLIC SECTOR [4] CHECKLIST FOR THE CLOUD ADOPTION IN THE PUBLIC SECTOR 1. Introduction Although the use of cloud services can offer significant benefits for public

More information

Virtualization for Cloud Computing

Virtualization for Cloud Computing Virtualization for Cloud Computing Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF CLOUD COMPUTING On demand provision of computational resources

More information

Adapting Distributed Hash Tables for Mobile Ad Hoc Networks

Adapting Distributed Hash Tables for Mobile Ad Hoc Networks University of Tübingen Chair for Computer Networks and Internet Adapting Distributed Hash Tables for Mobile Ad Hoc Networks Tobias Heer, Stefan Götz, Simon Rieche, Klaus Wehrle Protocol Engineering and

More information

White Paper : Virtualization and Cloud Computing 2012. Virtualization and Cloud Computing: The primary solution to the future of Testing

White Paper : Virtualization and Cloud Computing 2012. Virtualization and Cloud Computing: The primary solution to the future of Testing Virtualization and Cloud Computing: The primary solution to the future of Testing By Reema Majumdar September, 2012 1 Overview The only certainty for businesses now is change. While there are more and

More information

Introduction to Virtualization. Paul A. Strassmann George Mason University October 29, 2008, 7:20 to 10:00 PM

Introduction to Virtualization. Paul A. Strassmann George Mason University October 29, 2008, 7:20 to 10:00 PM Introduction to Virtualization Paul A. Strassmann George Mason University October 29, 2008, 7:20 to 10:00 PM 1 Data Center Transformation 2 Scope of Virtualization Services 3 Virtualization Evolution 4

More information

A closer look at HP LoadRunner software

A closer look at HP LoadRunner software Technical white paper A closer look at HP LoadRunner software Table of contents Sizing up the system 2 The limits of manual testing 2 A new take on testing: the HP LoadRunner solution 3 The HP LoadRunner

More information

Elastic Private Clouds

Elastic Private Clouds White Paper Elastic Private Clouds Agile, Efficient and Under Your Control 1 Introduction Most businesses want to spend less time and money building and managing IT infrastructure to focus resources on

More information

NoSQL Data Base Basics

NoSQL Data Base Basics NoSQL Data Base Basics Course Notes in Transparency Format Cloud Computing MIRI (CLC-MIRI) UPC Master in Innovation & Research in Informatics Spring- 2013 Jordi Torres, UPC - BSC www.jorditorres.eu HDFS

More information

PROPOSAL To Develop an Enterprise Scale Disease Modeling Web Portal For Ascel Bio Updated March 2015

PROPOSAL To Develop an Enterprise Scale Disease Modeling Web Portal For Ascel Bio Updated March 2015 Enterprise Scale Disease Modeling Web Portal PROPOSAL To Develop an Enterprise Scale Disease Modeling Web Portal For Ascel Bio Updated March 2015 i Last Updated: 5/8/2015 4:13 PM3/5/2015 10:00 AM Enterprise

More information

Transform Your Business and Protect Your Cisco Nexus Investment While Adopting Cisco Application Centric Infrastructure

Transform Your Business and Protect Your Cisco Nexus Investment While Adopting Cisco Application Centric Infrastructure White Paper Transform Your Business and Protect Your Cisco Nexus Investment While Adopting Cisco Application Centric Infrastructure What You Will Learn The new Cisco Application Centric Infrastructure

More information

Virtualization, SDN and NFV

Virtualization, SDN and NFV Virtualization, SDN and NFV HOW DO THEY FIT TOGETHER? Traditional networks lack the flexibility to keep pace with dynamic computing and storage needs of today s data centers. In order to implement changes,

More information

Open Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud)

Open Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud) Open Cloud System (Integration of Eucalyptus, Hadoop and into deployment of University Private Cloud) Thinn Thu Naing University of Computer Studies, Yangon 25 th October 2011 Open Cloud System University

More information

Cloud Infrastructure Licensing, Packaging and Pricing

Cloud Infrastructure Licensing, Packaging and Pricing Cloud Infrastructure Licensing, Packaging and Pricing ware, August 2011 2009 ware Inc. All rights reserved On July 12 2011 ware is Introducing a Major Upgrade of the Entire Cloud Infrastructure Stack vcloud

More information

DATA SECURITY MODEL FOR CLOUD COMPUTING

DATA SECURITY MODEL FOR CLOUD COMPUTING DATA SECURITY MODEL FOR CLOUD COMPUTING POOJA DHAWAN Assistant Professor, Deptt of Computer Application and Science Hindu Girls College, Jagadhri 135 001 poojadhawan786@gmail.com ABSTRACT Cloud Computing

More information

The Private Cloud Your Controlled Access Infrastructure

The Private Cloud Your Controlled Access Infrastructure White Paper: Private Clouds The ongoing debate on the differences between a Public and Private Cloud are broad and often loud. The bottom line is that it s really about how the resource, or computing power,

More information

White Paper. Cloud Native Advantage: Multi-Tenant, Shared Container PaaS. http://wso2.com Version 1.1 (June 19, 2012)

White Paper. Cloud Native Advantage: Multi-Tenant, Shared Container PaaS. http://wso2.com Version 1.1 (June 19, 2012) Cloud Native Advantage: Multi-Tenant, Shared Container PaaS Version 1.1 (June 19, 2012) Table of Contents PaaS Container Partitioning Strategies... 03 Container Tenancy... 04 Multi-tenant Shared Container...

More information

Designing a Windows Server 2008 Applications Infrastructure

Designing a Windows Server 2008 Applications Infrastructure Designing a Windows Server 2008 Applications Infrastructure MOC6437 About this Course This three-day course will prepare IT professionals for the role of Enterprise Administrator. Students will learn how

More information

LOGO Resource Management for Cloud Computing

LOGO Resource Management for Cloud Computing LOGO Resource Management for Cloud Computing Supervisor : Dr. Pham Tran Vu Presenters : Nguyen Viet Hung - 11070451 Tran Le Vinh - 11070487 Date : April 16, 2012 Contents Introduction to Cloud Computing

More information

Cost-Benefit Analysis of Cloud Computing versus Desktop Grids. By : Paritosh Heera( MT2011099)

Cost-Benefit Analysis of Cloud Computing versus Desktop Grids. By : Paritosh Heera( MT2011099) Cost-Benefit Analysis of Cloud Computing versus Desktop Grids By : Paritosh Heera( MT2011099) Abstract and Introduction 2 computing environment mainly for scientific applications i.e cloud and VC Ground

More information

Unleash the IaaS Cloud About VMware vcloud Director and more VMUG.BE June 1 st 2012

Unleash the IaaS Cloud About VMware vcloud Director and more VMUG.BE June 1 st 2012 Unleash the IaaS Cloud About VMware vcloud Director and more VMUG.BE June 1 st 2012 2 Who? Viktor van den Berg Consultant @ PQR Former Dutch VMUG Leader Blogger at www.viktorious.nl Twitter @viktoriousss

More information

Distributed Systems and Recent Innovations: Challenges and Benefits

Distributed Systems and Recent Innovations: Challenges and Benefits Distributed Systems and Recent Innovations: Challenges and Benefits 1. Introduction Krishna Nadiminti, Marcos Dias de Assunção, and Rajkumar Buyya Grid Computing and Distributed Systems Laboratory Department

More information

Availability of Services in the Era of Cloud Computing

Availability of Services in the Era of Cloud Computing Availability of Services in the Era of Cloud Computing Sanjay P. Ahuja 1 & Sindhu Mani 1 1 School of Computing, University of North Florida, Jacksonville, America Correspondence: Sanjay P. Ahuja, School

More information

Cloud computing - Architecting in the cloud

Cloud computing - Architecting in the cloud Cloud computing - Architecting in the cloud anna.ruokonen@tut.fi 1 Outline Cloud computing What is? Levels of cloud computing: IaaS, PaaS, SaaS Moving to the cloud? Architecting in the cloud Best practices

More information

Cloud Computing Workload Benchmark Report

Cloud Computing Workload Benchmark Report Cloud Computing Workload Benchmark Report Workload Benchmark Testing Results Between ProfitBricks and Amazon EC2 AWS: Apache Benchmark, nginx Benchmark, SysBench, pgbench, Postmark October 2014 TABLE OF

More information

Cloud Computing. Summary

Cloud Computing. Summary Cloud Computing Lecture 1 2011-2012 https://fenix.ist.utl.pt/disciplinas/cn Summary Teaching Staff. Rooms and Schedule. Goals. Context. Syllabus. Reading Material. Assessment and Grading. Important Dates.

More information

Hadoop in the Hybrid Cloud

Hadoop in the Hybrid Cloud Presented by Hortonworks and Microsoft Introduction An increasing number of enterprises are either currently using or are planning to use cloud deployment models to expand their IT infrastructure. Big

More information

Security & Trust in the Cloud

Security & Trust in the Cloud Security & Trust in the Cloud Ray Trygstad Director of Information Technology, IIT School of Applied Technology Associate Director, Information Technology & Management Degree Programs Cloud Computing Primer

More information

70-646 R3: Windows Server 2008 Administration. Course Overview. Course Outline. Course Length: 4 Day

70-646 R3: Windows Server 2008 Administration. Course Overview. Course Outline. Course Length: 4 Day 70-646 R3: Windows Server 2008 Administration Course Length: 4 Day Course Overview This course will prepare the student for Exam 70-646: Pro: Windows Server 2008, Server Administrator. Topics covered include

More information

Cloud Computing and Amazon Web Services

Cloud Computing and Amazon Web Services Cloud Computing and Amazon Web Services Gary A. McGilvary edinburgh data.intensive research 1 OUTLINE 1. An Overview of Cloud Computing 2. Amazon Web Services 3. Amazon EC2 Tutorial 4. Conclusions 2 CLOUD

More information

Test Run Analysis Interpretation (AI) Made Easy with OpenLoad

Test Run Analysis Interpretation (AI) Made Easy with OpenLoad Test Run Analysis Interpretation (AI) Made Easy with OpenLoad OpenDemand Systems, Inc. Abstract / Executive Summary As Web applications and services become more complex, it becomes increasingly difficult

More information

Hadoop IST 734 SS CHUNG

Hadoop IST 734 SS CHUNG Hadoop IST 734 SS CHUNG Introduction What is Big Data?? Bulk Amount Unstructured Lots of Applications which need to handle huge amount of data (in terms of 500+ TB per day) If a regular machine need to

More information

LinuxWorld Conference & Expo Server Farms and XML Web Services

LinuxWorld Conference & Expo Server Farms and XML Web Services LinuxWorld Conference & Expo Server Farms and XML Web Services Jorgen Thelin, CapeConnect Chief Architect PJ Murray, Product Manager Cape Clear Software Objectives What aspects must a developer be aware

More information

A Brief Analysis on Architecture and Reliability of Cloud Based Data Storage

A Brief Analysis on Architecture and Reliability of Cloud Based Data Storage Volume 2, No.4, July August 2013 International Journal of Information Systems and Computer Sciences ISSN 2319 7595 Tejaswini S L Jayanthy et al., Available International Online Journal at http://warse.org/pdfs/ijiscs03242013.pdf

More information

Cloud Computing. Chapter 1 Introducing Cloud Computing

Cloud Computing. Chapter 1 Introducing Cloud Computing Cloud Computing Chapter 1 Introducing Cloud Computing Learning Objectives Understand the abstract nature of cloud computing. Describe evolutionary factors of computing that led to the cloud. Describe virtualization

More information

4/6/2009 CLOUD COMPUTING : PART I WHY IS CLOUD COMPUTING DISTINCT? INTRODUCTION: CONTINUE A PERSPECTIVE STUDY

4/6/2009 CLOUD COMPUTING : PART I WHY IS CLOUD COMPUTING DISTINCT? INTRODUCTION: CONTINUE A PERSPECTIVE STUDY CLOUD COMPUTING : A PERSPECTIVE STUDY PART I BACKGROUND AND CONCEPTS Guannang Wang YingFeng Wang Qi Li INTRODUCTION: Coined in late of 2007 Currently emerges as a hot topic due to its abilities to offer

More information

Tamanna Roy Rayat & Bahra Institute of Engineering & Technology, Punjab, India talk2tamanna@gmail.com

Tamanna Roy Rayat & Bahra Institute of Engineering & Technology, Punjab, India talk2tamanna@gmail.com IJCSIT, Volume 1, Issue 5 (October, 2014) e-issn: 1694-2329 p-issn: 1694-2345 A STUDY OF CLOUD COMPUTING MODELS AND ITS FUTURE Tamanna Roy Rayat & Bahra Institute of Engineering & Technology, Punjab, India

More information

CompatibleOne Open Source Cloud Broker Architecture Overview

CompatibleOne Open Source Cloud Broker Architecture Overview CompatibleOne Open Source Cloud Broker Architecture Overview WHITE PAPER October 2012 Table of Contents Abstract 2 Background 2 Disclaimer 2 Introduction 2 Section A: CompatibleOne: Open Standards and

More information

The Aspect Unified IP Five 9s Environment

The Aspect Unified IP Five 9s Environment Technical Overview The Aspect Unified IP Five 9s Environment Technical Overview Aspect Unified IP 7 is a next-generation customer contact solution that enables companies to interact with consumers through

More information

High Availability and Clustering

High Availability and Clustering High Availability and Clustering AdvOSS-HA is a software application that enables High Availability and Clustering; a critical requirement for any carrier grade solution. It implements multiple redundancy

More information