Project Title Lab Title Project supervisors Project members

Transcription

1 Dubna, Russia 2016 Project Title Introduction to grid and cloud technologies. Practical usage of EMI and OpenNebula middleware Lab Title Laboratory of Information Technologies (LIT). Project supervisors 1. A. Nechaevskyi, 2. V. Korenkov Project members 1. Mr. Mostafa Rabea - Fayoum University 2. Mr. Ahmed Elaraby South Valley University 3. Mr. Ayman Taha - Cairo University 4. Mr. Ahmed Hafez Zewil University

2 Outline Introduction Grid Computing Cloud Computing Experimental Data Analytic Techniques Conclusions and Future Cooperation Slide 2

3 Introduction Nowadays it's impossible to imagine natural science research without computer assistance. Scientists have a need to simulate complex processes, handle experimental data of store huge amounts of information. Many areas like high energy physics contemporary demands to the computational resources are really high and are continuously growing. Slide 3

4 Introduction Distributed computing and Grid technologies are now in use in many areas of science: - biology, medicine, climate research, earth sciences, quantum chemistry, space science, etc.. -Technologies are applied for many commercial applications (e.g. drugs discovery, engineering industry, aircrafts designing, movie industry, financial calculations, cryptography studies). Slide 4

5 Grid Computing What is Grid Computing? How Grid Computing Works? Grid Architecture Advantages of Grid Computing Major business areas for grid computing Slide 5

6 What is Grid Computing? Grid computing or the use of a computational grid is applying the resources of many computers in a net work to a single problem at the same time. Usually to a scientific or technical problem that requires a great number of computer processing cycles or access to large amounts of data. Slide 6

7 How Grid computing works? In general, a grid computing system requires: At least one computer, usually a server, which handles all the administrative duties for the System A network of computers running special grid computing network software. A collection of computer software called middleware Slide 7

8 Grid Architecture Slide 8

9 Working of layers Fabric. The lowest layer job is used to make a common interface on all possible kinds of resources available. Access by higher layers is granted via standardized processes. Resource and connectivity protocols: The connectivity layer defines the basic communication- and authentication protocols which are needed by the grid. While the communication protocols allow the exchange of files between different resources connected by the first layer, the authentication protocols allow to communicate confidentially and to ensure the identity of the two partners. Collective services: The purpose of this layer is the coordination of multiple resources. Access to these resources doesn t happen directly but merely via the underlying protocols and interfaces. User applications: To this layer belong all those applications which are operating in the environment of a virtual organization. Jobs of the lower layers get called by applications and can use resources transparently. Slide 9

10 Advantages of Grid Computing Business benefits Improve efficiency by improving computational capabilities Bring together not only IT resources but also people. Create flexible, resilient operational infrastructures Address rapid fluctuations in customer demands Technology benefits Federate data and distribute it globally. Support large multi-disciplinary collaboration across organizations and business. Enable recovery and failure Ability to run large-scale applications comprising thousands of computes, for wide range of applications. Reduces signal latency the delay that builds up as data are transmitted over the Internet. Slide 10

11 Outline Introduction Grid Computing Cloud Computing Experimental Data Analytic Techniques Conclusions and Future Cooperation Slide 11

12 Cloud Computing? Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over a network (typically the Internet). The general overview of cloud computing. Slide 12

13 Cloud Computing Cont.. Cloud computing is an emerging IT technology that is being used increasingly in industry, government and academia. Cloud computing services to help your organization run more cost effectively and efficiently. The use of cloud computing has increased rapidly in many organizations. Cloud computing provides many benefits in terms of low cost and accessibility of data. Slide 13

14 Cloud Computing Cont.. A widely adopted definition of cloud computing comes from the U.S. National Institute of Standards and Technology (NIST) as " a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or cloud provider interaction" Slide 14

15 Cloud Computing Cont.. This cloud model is composed of five essential characteristics, three service models, and four deployment models [NIST] Slide 15

16 Five essential characteristics of cloud computing 1. On-demand self-service 2. Broad network access 3. Rapid elasticity 4. Measured service 5. Resource pooling Slide 16

17 Five essential characteristics of cloud computing 1. On-demand self-service A consumer can unilaterally provision computing capabilities, such as server time and network storage, as needed automatically without requiring human interaction with each service provider. A cloud service provider publishes a service catalogue, which contains information about all cloud services available to consumers. The service catalogue includes information about service attributes, prices, and request processes. Slide 17

18 Five essential characteristics of cloud computing 2. Broad network access Resources are available via the network and can be accessed by multiple devices, including: smart phones, tablets, laptops, desktops, and workstations. Slide 18

19 Five essential characteristics of cloud computing 3. Rapid elasticity Capabilities can be elastically provisioned and released, in some cases automatically, to scale rapidly outward and inward commensurate with demand. Consumers can leverage rapid elasticity of the cloud when they have a fluctuation in their IT resource requirements. For example, an organization might require doubling the number of web and application servers for a specific duration to accomplish a specific task Slide 19

20 Five essential characteristics of cloud computing 4. Measured service Cloud systems automatically control and optimize resource use by leveraging a metering capability at some level of abstraction appropriate to the type of service. For example, storage, processing, bandwidth, and active user accounts. Resource usage can be monitored, controlled, and reported, providing transparency for both the provider and consumer of the utilized service. Slide 20

21 Five essential characteristics of cloud computing 5. Resource pooling The provider s computing resources are pooled to serve multiple consumers using a multitenant model, with different physical and virtual resources dynamically assigned and reassigned according to consumer demand. Examples of resources include storage, processing, memory, and network bandwidth. Slide 21

22 Cloud Computing Cont.. Three Cloud Service Models 1. Infrastructure-as-a-Service (IaaS). 2. Platform-as-a-Service (PaaS). 3. Software-as-a-Service (SaaS). Slide 22

23 Three Cloud Service Models 1. Infrastructure-as-a-Service (IaaS). The capability provided to the consumer is to provision processing, storage, networks, and other fundamental computing resources. Slide 23

24 Three Cloud Service Models Cont.. The consumer is able to deploy and run arbitrary software, which can include operating systems and applications. The consumer does not manage or control the underlying cloud infrastructure but has control over operating systems and deployed applications Security provisions beyond the basic infrastructure are carried out mainly by the cloud consumer. For Example : Amazon Elastic Compute Cloud (Amazon EC2), Amazon Simple Storage Service (Amazon S3) and Sun s Cloud Services Slide 24

25 1. Infrastructure-as-a-Service (IaaS). IaaS benefits Pay as you go Dynamic Scaling Reduces TCO (Total Cost of Ownership) Slide 25

26 Three Cloud Service Models Cont 2. Platform-as-a-Service (PaaS). The capability provided to the consumer is to deploy onto the cloud infrastructure consumer created or acquired applications created using programming languages, libraries, services, and tools supported by the provider. Slide 26

27 Three Cloud Service Models Cont. The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, or storage, but has control over the deployed applications and possibly configuration settings for the application-hosting environment The consumer is able to deploy and run arbitrary software, which can include operating systems and applications. Security provisions are split between the cloud provider and the cloud consumer.. For Example : Google App Engine and Microsoft Windows Azure Platform Slide 27

28 1. Platform-as-a-Service (PaaS). PaaS benefits Reduced Complexity Lower Costs Higher Computing Efficiency Slide 28

29 Three Cloud Service Models Cont. 3. Software as a service (SaaS). The capability provided to the consumer is to use the provider s applications running on a cloud infrastructure. The applications are accessible from various client devices through either a thin client interface, such as a web browser (example,web-based ), or a program interface. Slide 29

30 Three Cloud Service Models Cont The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, storage, or even individual application capabilities, with the possible exception of limited user-specific application configuration. In a SaaS model, as shown in figure 5, applications, such as Customer Relationship Management (CRM), , and Instant Messaging (IM), are offered as a service by the cloud service providers. Security provisions are carried out mainly by the cloud provider [10]. For Example : EMC Mozy and Salesforce.com is a provider of SaaS-based CRM applications, such as Sales Cloud and Service Cloud Slide 30

31 3. Software as a service (SaaS). SaaS benefits Affordable Zero Infrastructure Seamless Upgrades Guaranteed Levels of Service Backups and Data Recovery Work Anywhere Slide 31

32 Three Cloud Service Models IaaS, PaaS and SaaS. Slide 32

33 Cloud computing Four Deployment Models of Cloud Computing 1. Public Cloud Model. 2. Private Cloud Model. 3. Community Cloud Model. 4. Hybrid Cloud Model. Slide 33

34 Four Deployment Models of Cloud Computing 1. Public Cloud : can be accessed by any subscriber with an internet connection and access to the cloud space It may be owned, managed, and operated by a business, academic, or government organization, or some combination of them. Public cloud model Slide 34

35 1. Public Cloud An advantage of the public cloud is its low capital cost with enormous scalability. However, for consumers, these benefits come with certain risks: no control over the resources in the cloud, the security of confidential data, network performance, and interoperability issues. Popular public cloud service providers are Amazon, Google, and Salesforce.com. Figure in the page shows a public cloud that provides cloud services to organizations and individuals. Back Slide 35

36 2. Private Cloud : A private cloud is established for a specific group or organization and limits access to just that group. Private cloud model Slide 36

37 2. Private Cloud It may be owned, managed, and operated by the organization, a third party, or some combination of them, and it may exist on or off premises. Following are two variations to the private cloud model On-premise private cloud: The on premise private cloud, also known as internal cloud, is hosted by an organization within its own data centers. Externally hosted private cloud: This type of private cloud is hosted external to an organization and is managed by a third-party organization. Slide 37

38 3. Community Cloud: A community cloud is shared among two or more organizations that have similar cloud requirements. Community cloud model Slide 38

39 3. Community Cloud: It may be owned, managed, and operated by one or more of the organizations in the community, a third party, or some combination of them, and it may exist on or off premises. In a community cloud, the costs spread over to fewer consumers than a public cloud. Hence, this option is more expensive but might offer a higher level of privacy, security, and compliance. Back Slide 39

40 Outline Introduction Grid Computing Cloud Computing Experimental Data Analytic Techniques Conclusions and Future Cooperation Slide 42

41 Outline Introduction Grid Computing Cloud Computing Experimental Data Analytic Techniques Conclusions and Future Cooperation Slide 55

42 Slide 57