An Overview of the Open Cloud Consor4um

Size: px
Start display at page:

Download "An Overview of the Open Cloud Consor4um"

Transcription

1 An Overview of the Open Cloud Consor4um Robert Grossman Open Cloud Consor4um OMG Cloud Compu4ng Interoperability Workshop March 23, 2009

2 This talk represents my personal opinions and does not necessarily represent a consensus posi4on of the Open Cloud Consor4um or posi4ons of any of its members. 2

3 Part 1. Introduc4on 3

4 What is a Cloud? Clouds provide on demand resources or services over a network, ojen the Internet, with the scale and reliability of a data center. No standard defini4on. Cloud architectures are not new. What is new: Scale Ease of use Pricing model. 4

5 Varie4es of Clouds Architectural Model Compu4ng Instances vs Compu4ng Services Economic Model Elas4c, usage based pricing, lease/own, Management Model Private vs Public; Single vs Mul4ple Tenant; Programming Model Queue Service, MPI, MapReduce, Distributed UDF Computing instances vs computing services Elastic, usagebased pricing or not Private internal vs public external All combinations occur. 5

6 Instances, Services & Frameworks many instances single instance Amazon s EC2 Hadoop DFS & MapReduce Amazon s SQS Azure Services Amazon s S3 Google AppEngine VMWare Vmotion Microsoft Azure This table contains some examples but is not inclusive of the various offerings available. instance service framework operating system 6

7 OCC s Current Focus many instances single instance Amazon s EC2 Hadoop DFS & MapReduce Amazon s SQS Azure Services Google AppEngine VMWare Vmotion Microsoft Azure Amazon s Complementary to most other S3 current standardization efforts. instance service framework operating system 7

8 Architectural Model On demand resources & services over a network at the scale of a data center On demand compu&ng instances IaaS: Amazon EC2, S3, etc.; Eucalyptus supports many Web 2.0 applica4ons/users On demand compu&ng services for data intensive compu&ng GFS/MapReduce/Bigtable, Hadoop, Sector, Manage and compute with large data (say 10 TB) 8

9 Delivering On Demand Compu4ng Instances App App App App App App App App Table based Data (BigTable) Services Rela4onal Data Services (Pig, etc.) App App Cloud Compute Services (MapReduce & Generaliza4ons) App App Cloud Storage Services On demand compu4ng instances can be delivered using data center scale on demand compu4ng services 9

10 1. Supports the development of standards. 2. Supports reference implementa4ons for cloud compu4ng, preferably open source. 3. Manages a testbed for cloud compu4ng called the Open Cloud Testbed. 4. Supports the development of benchmarks. 5. Sponsors workshops and other events related to cloud compu4ng. 10

11 Organiza4on OCC is a consor4um operated by a not for profit. OCC is member driven. OCC is oriented to companies and organiza4ons, not individuals. Members set up working groups (WG). Current WG: Standards and interoperability for clouds that provide on demand compu4ng services Informa4on sharing and security working group Wide area clouds and networking working group Strongly encourages reference implementa4ons, open source if possible 11

12 Part 2. Some Roles the USG Might Play in Cloud Standards 12

13 USG & Internet (CACM 1996) USG supported short term projects, not long term programs. NSF & DARPA provided only seed funding. Emphasis on focused projects with concrete goals. Projects provided leadership. Projects established open, vendor neutral standards. Coopera4on between USG, universi4es & industry. Rela4vely few, high competent people were involved & they had complete autonomy. Extracted from: Seeding Networks: the Federal Role, Larry Press, CACM

14 Some Roles the USG Might Choose Purchase cloud services for end users from cloud service providers. Build data centers and provide private cloud services for internal USG consump4on (GOGO, GOCO, COCO); i.e. purchase cloud infrastructure. Encourage standards by adding clauses to contracts to support open standards. Support some short term projects with concrete goals. 14

15 Some Possible USG Drivers Improve produc4vity get a new desktop instance in 20 minutes Go green Reduce power & environmental impact Disaster recovery Preserve USG informa4on Informa4on sharing Health care, homeland defense, 15

16 Risks of Ac4ng Too Early Appropriate standards and designs are yet understood. Bad decision can skew the market in the wrong direc4on. 16

17 Part 3: Standards & Interoperability WG Train gauge in China is 1435 mm Train gauge in Russia is 1520 mm Change of gauge at Ussuriisk (near Vladivostok) at the Chinese Russian border How can a cloud application move from one cloud storage service to another? 17

18 Clouds for Data Intensive Compu4ng App App App App App Table based Data (BigTable) Services Rela4onal Data Services (Pig, etc.) App App Cloud Compute Services (MapReduce & Generaliza4ons) App App Cloud Storage Services 18

19 vs On Demand Compu4ng Instances App App App

20 Ini4al Focus of OCC Interoperability WG TBD Hbase Hive Casandra Pig, SQL+MR varia4ons, DryadLINQ(?),... Hadoop MapReduce Sector UDF/MR ThriJ TBD Hadoop HDFS Sector DFS KFS 20

21 Part 4. Informa4on Sharing & Security Working Group How can two HIPAA compliant clouds run by two different organiza4ons share data? How can two different USG clouds run by two different organiza4ons share data? 21

22 Informa4on Sharing & Security Mediator (Media4on Policies with alerts, audit trail & provenance) Cross Policy Services / Applica4ons Interface Policy P2 Services / Applica4ons Authoriza4ons Security Users Data Interface Policy P1 Services / Applica4ons Authoriza4ons Security Users Data Interface Policy P1 Services / Applica4ons S e r v i c e s / A p li c a ti o n s Authoriza4ons Users Security Data

23 Both Technical and Policy Issues Several Organiza&ons or Authori&es One Organiza&on or Authority????????? One Cloud Several Clouds 23

24 Driving Project Develop standards for sharing informa4on between two HIPAA compliant clouds. Goal: Replace fax, which is used ojen today to exchange informa4on between two different HIPAA environments. 24

25 Part 5. Open Cloud Testbed For reference implementa&ons For interoperability studies For benchmarks and other experimental studies 25

26 Open Cloud Testbed Phase 1 (2008) Phase 1 4 racks 120 Nodes 480 Cores 10+ Gb/s CENIC C-Wave MREN Dragon Hadoop Sector/Sphere ThriJ Eucalyptus 26

27 Open Cloud Testbed Phase 2 (2009) Phase 2 6 loca4ons 8 racks 256 Nodes 1024 Cores 10+ Gb/s + shared resources 27

28 Open Cloud Testbed

29 Part 6. Benchmarks To help inform purchase decisions To help inform the design of cloud applica4ons To help inform cloud architecture decisions 29

30 MalGen MalGen generates synthe4c data with realis4c distribu4ons. MalStone A & B stylized computa4ons that can be used as benchmarks for architectures, sojware and systems for cloud compu4ng. 30

31 Part 7. OCC Sponsored Events 31

32 Cloud Compu4ng & Its Applica4ons 08 CCA 09 being planned now. 32

33 Please Work With the OCC To learn more about the Open Cloud Consor4um Join one of our working groups. 33

An Overview of the Open Cloud Consortium

An Overview of the Open Cloud Consortium www.opencloudconsortium.org An Overview of the Open Cloud Consortium Robert Grossman Open Cloud Consortium OMG Cloud Computing Interoperability Workshop July 13, 2009 This talk represents my personal opinions

More information

Distributed Data Parallel Computing: The Sector Perspective on Big Data

Distributed Data Parallel Computing: The Sector Perspective on Big Data Distributed Data Parallel Computing: The Sector Perspective on Big Data Robert Grossman July 25, 2010 Laboratory for Advanced Computing University of Illinois at Chicago Open Data Group Institute for Genomics

More information

Information Quality in the Cloud, What IT Managers Need to Know

Information Quality in the Cloud, What IT Managers Need to Know Information Quality in the Cloud, What IT Managers Need to Know BIOGRAPHY Robert Grossman Founder and Managing Partner Open Data Group Robert Grossman is the Managing Partner of Open Data Group, which

More information

The Open Cloud Testbed: A Wide Area Testbed for Cloud Computing Utilizing High Performance Network Services

The Open Cloud Testbed: A Wide Area Testbed for Cloud Computing Utilizing High Performance Network Services The Open Cloud Testbed: A Wide Area Testbed for Cloud Computing Utilizing High Performance Network Services Robert Grossman 1, 2, Yunhong Gu 1, Michal Sabala 1, Collin Bennett 2, Jonathan Seidman 2 and

More information

Cloud Compu)ng in Educa)on and Research

Cloud Compu)ng in Educa)on and Research Cloud Compu)ng in Educa)on and Research Dr. Wajdi Loua) Sfax University, Tunisia ESPRIT - December 2014 04/12/14 1 Outline Challenges in Educa)on and Research SaaS, PaaS and IaaS for Educa)on and Research

More information

Cloud Courses Description

Cloud Courses Description Cloud Courses Description Cloud 101: Fundamental Cloud Computing and Architecture Cloud Computing Concepts and Models. Fundamental Cloud Architecture. Virtualization Basics. Cloud platforms: IaaS, PaaS,

More information

Interna'onal Standards Ac'vi'es on Cloud Security EVA KUIPER, CISA CISSP EVA.KUIPER@HP.COM HP ENTERPRISE SECURITY SERVICES

Interna'onal Standards Ac'vi'es on Cloud Security EVA KUIPER, CISA CISSP EVA.KUIPER@HP.COM HP ENTERPRISE SECURITY SERVICES Interna'onal Standards Ac'vi'es on Cloud Security EVA KUIPER, CISA CISSP EVA.KUIPER@HP.COM HP ENTERPRISE SECURITY SERVICES Agenda Importance of Common Cloud Standards Outline current work undertaken Define

More information

Cloud Computing. Lecture 24 Cloud Platform Comparison 2014-2015

Cloud Computing. Lecture 24 Cloud Platform Comparison 2014-2015 Cloud Computing Lecture 24 Cloud Platform Comparison 2014-2015 1 Up until now Introduction, Definition of Cloud Computing Pre-Cloud Large Scale Computing: Grid Computing Content Distribution Networks Cycle-Sharing

More information

Cloud Computing Training

Cloud Computing Training Cloud Computing Training TechAge Labs Pvt. Ltd. Address : C-46, GF, Sector 2, Noida Phone 1 : 0120-4540894 Phone 2 : 0120-6495333 TechAge Labs 2014 version 1.0 Cloud Computing Training Cloud Computing

More information

Linux Clusters Ins.tute: Turning HPC cluster into a Big Data Cluster. A Partnership for an Advanced Compu@ng Environment (PACE) OIT/ART, Georgia Tech

Linux Clusters Ins.tute: Turning HPC cluster into a Big Data Cluster. A Partnership for an Advanced Compu@ng Environment (PACE) OIT/ART, Georgia Tech Linux Clusters Ins.tute: Turning HPC cluster into a Big Data Cluster Fang (Cherry) Liu, PhD fang.liu@oit.gatech.edu A Partnership for an Advanced Compu@ng Environment (PACE) OIT/ART, Georgia Tech Targets

More information

Cloud Courses Description

Cloud Courses Description Courses Description 101: Fundamental Computing and Architecture Computing Concepts and Models. Data center architecture. Fundamental Architecture. Virtualization Basics. platforms: IaaS, PaaS, SaaS. deployment

More information

Generalized Architecture for Dynamic Infrastructure Services

Generalized Architecture for Dynamic Infrastructure Services Generalized Architecture for Dynamic Infrastructure Services On behalf of GEYSERS Consor3um (presented by Pascale Vicat Blanc, GEYSERS Dissemina3on WPL) GLIF 2010, CERN, France 14 th october 2010 Grant

More information

Cloud Compu?ng & Big Data in Higher Educa?on and Research: African Academic Experience

Cloud Compu?ng & Big Data in Higher Educa?on and Research: African Academic Experience 3 rd SG13 Regional Workshop for Africa on ITU- T Standardiza?on Challenges for Developing Countries Working for a Connected Africa (Livingstone, Zambia, 23-24 February 2015) Cloud Compu?ng & Big Data in

More information

Cloud Compu)ng. Yeow Wei CHOONG Anne LAURENT

Cloud Compu)ng. Yeow Wei CHOONG Anne LAURENT Cloud Compu)ng Yeow Wei CHOONG Anne LAURENT h-p://www.b- eye- network.com/blogs/eckerson/archives/cloud_compu)ng/ 2011 h-p://www.forbes.com/sites/tjmccue/2014/01/29/cloud- compu)ng- united- states- businesses-

More information

Open Cirrus: Towards an Open Source Cloud Stack

Open Cirrus: Towards an Open Source Cloud Stack Open Cirrus: Towards an Open Source Cloud Stack Karlsruhe Institute of Technology (KIT) HPC2010, Cetraro, June 2010 Marcel Kunze KIT University of the State of Baden-Württemberg and National Laboratory

More information

Enabling Technologies. Cloud Compu-ng Models. Plahorm- as- a- Service. So?ware- as- a- Service. Infrastructure- as- a- Service

Enabling Technologies. Cloud Compu-ng Models. Plahorm- as- a- Service. So?ware- as- a- Service. Infrastructure- as- a- Service Next up Cloud Compu-ng Warehouse scale computers How to build/program data centers Google so?ware stack GFS BigTable Sawzall Chubby Map/reduce What is cloud compu-ng Illusion of infinite compu-ng resources

More information

Cloud Compu)ng. Adam Belloum Ins)tute of Informa)cs University of Amsterdam a.s.z.belloum@uva.nl

Cloud Compu)ng. Adam Belloum Ins)tute of Informa)cs University of Amsterdam a.s.z.belloum@uva.nl Cloud Compu)ng Adam Belloum Ins)tute of Informa)cs University of Amsterdam a.s.z.belloum@uva.nl High Performance compu)ng Curriculum, Jan 2015 hgp://www.hpc.uva.nl/ UvA- SURFsara What is Cloud Compu)ng?

More information

Open Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud)

Open Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud) Open Cloud System (Integration of Eucalyptus, Hadoop and into deployment of University Private Cloud) Thinn Thu Naing University of Computer Studies, Yangon 25 th October 2011 Open Cloud System University

More information

Hunk & Elas=c MapReduce: Big Data Analy=cs on AWS

Hunk & Elas=c MapReduce: Big Data Analy=cs on AWS Copyright 2014 Splunk Inc. Hunk & Elas=c MapReduce: Big Data Analy=cs on AWS Dritan Bi=ncka BD Solu=ons Architecture Disclaimer During the course of this presenta=on, we may make forward looking statements

More information

Certified Cloud Computing Professional VS-1067

Certified Cloud Computing Professional VS-1067 Certified Cloud Computing Professional VS-1067 Certified Cloud Computing Professional Certification Code VS-1067 Vskills Cloud Computing Professional assesses the candidate for a company s cloud computing

More information

On the Varieties of Clouds for Data Intensive Computing

On the Varieties of Clouds for Data Intensive Computing On the Varieties of Clouds for Data Intensive Computing Robert L. Grossman University of Illinois at Chicago and Open Data Group Yunhong Gu University of Illinois at Chicago Abstract By a cloud we mean

More information

Data Management in the Cloud: Limitations and Opportunities. Annies Ductan

Data Management in the Cloud: Limitations and Opportunities. Annies Ductan Data Management in the Cloud: Limitations and Opportunities Annies Ductan Discussion Outline: Introduc)on Overview Vision of Cloud Compu8ng Managing Data in The Cloud Cloud Characteris8cs Data Management

More information

The Development of Cloud Interoperability

The Development of Cloud Interoperability NSC- JST Workshop The Development of Cloud Interoperability Weicheng Huang Na7onal Center for High- performance Compu7ng Na7onal Applied Research Laboratories 1 Outline Where are we? Our experiences before

More information

Cloud Computing: Making the right choices

Cloud Computing: Making the right choices Cloud Computing: Making the right choices Kalpak Shah Clogeny Technologies Pvt Ltd 1 About Me Kalpak Shah Founder & CEO, Clogeny Technologies Passionate about economics and technology evolving through

More information

Hadoop Introduction. Olivier Renault Solution Engineer - Hortonworks

Hadoop Introduction. Olivier Renault Solution Engineer - Hortonworks Hadoop Introduction Olivier Renault Solution Engineer - Hortonworks Hortonworks A Brief History of Apache Hadoop Apache Project Established Yahoo! begins to Operate at scale Hortonworks Data Platform 2013

More information

Dr Markus Hagenbuchner markus@uow.edu.au CSCI319. Introduction to Cloud Computing

Dr Markus Hagenbuchner markus@uow.edu.au CSCI319. Introduction to Cloud Computing Dr Markus Hagenbuchner markus@uow.edu.au CSCI319 Introduction to Cloud Computing CSCI319 Chapter 1 Page: 1 of 10 Content and Objectives 1. Introduce to cloud computing 2. Develop and understanding to how

More information

The Role of Nutanix in the Public /Private / Hybrid Cloud Spectrum

The Role of Nutanix in the Public /Private / Hybrid Cloud Spectrum The Role of Nutanix in the Public /Private / Hybrid Cloud Spectrum Chris Howard Vice President, Nutanix Federal Phil Ditzel Senior SE Public Cloud Let s start with the definition NIST s Defini-on: A model

More information

What is Analytic Infrastructure and Why Should You Care?

What is Analytic Infrastructure and Why Should You Care? What is Analytic Infrastructure and Why Should You Care? Robert L Grossman University of Illinois at Chicago and Open Data Group grossman@uic.edu ABSTRACT We define analytic infrastructure to be the services,

More information

Cloud Application Development (SE808, School of Software, Sun Yat-Sen University) Yabo (Arber) Xu

Cloud Application Development (SE808, School of Software, Sun Yat-Sen University) Yabo (Arber) Xu Lecture 1 Introduction to Cloud Computing Cloud Application Development (SE808, School of Software, Sun Yat-Sen University) Yabo (Arber) Xu Outline What is cloud computing? How it evolves? What are the

More information

A.Prof. Dr. Markus Hagenbuchner markus@uow.edu.au. CSCI319 A Brief Introduction to Cloud Computing. CSCI319 Page: 1

A.Prof. Dr. Markus Hagenbuchner markus@uow.edu.au. CSCI319 A Brief Introduction to Cloud Computing. CSCI319 Page: 1 A.Prof. Dr. Markus Hagenbuchner markus@uow.edu.au CSCI319 A Brief Introduction to Cloud Computing CSCI319 Page: 1 Content and Objectives 1. Introduce to cloud computing 2. Develop and understanding to

More information

10- High Performance Compu5ng

10- High Performance Compu5ng 10- High Performance Compu5ng (Herramientas Computacionales Avanzadas para la Inves6gación Aplicada) Rafael Palacios, Fernando de Cuadra MRE Contents Implemen8ng computa8onal tools 1. High Performance

More information

Big Data. The Big Picture. Our flexible and efficient Big Data solu9ons open the door to new opportuni9es and new business areas

Big Data. The Big Picture. Our flexible and efficient Big Data solu9ons open the door to new opportuni9es and new business areas Big Data The Big Picture Our flexible and efficient Big Data solu9ons open the door to new opportuni9es and new business areas What is Big Data? Big Data gets its name because that s what it is data that

More information

Cloud Computing ECPE 293A. Introduc1on

Cloud Computing ECPE 293A. Introduc1on Cloud Computing ECPE 293A Introduc1on 2 3 Introductions Introduce yourself Name Undergrad major Interests Hardware which area? SoAware which area? 4 = Looking at pictures of clouds with computers 5 Cloud

More information

Return on Experience on Cloud Compu2ng Issues a stairway to clouds. Experts Workshop Nov. 21st, 2013

Return on Experience on Cloud Compu2ng Issues a stairway to clouds. Experts Workshop Nov. 21st, 2013 Return on Experience on Cloud Compu2ng Issues a stairway to clouds Experts Workshop Agenda InGeoCloudS SoCware Stack InGeoCloudS Elas2city and Scalability Elas2c File Server Elas2c Database Server Elas2c

More information

Streamlining the move to the cloud. Key tips for selecting the right cloud tools and preparing your infrastructure for migration

Streamlining the move to the cloud. Key tips for selecting the right cloud tools and preparing your infrastructure for migration Streamlining the move to the cloud Key tips for selecting the right cloud tools and preparing your infrastructure for migration When planning for a, you must (1) carefully evaluate various cloud tools

More information

6.S897 Large-Scale Systems

6.S897 Large-Scale Systems 6.S897 Large-Scale Systems Instructor: Matei Zaharia" Fall 2015, TR 2:30-4, 34-301 bit.ly/6-s897 Outline What this course is about" " Logistics" " Datacenter environment What this Course is About Large-scale

More information

Cloud Computing Trends

Cloud Computing Trends UT DALLAS Erik Jonsson School of Engineering & Computer Science Cloud Computing Trends What is cloud computing? Cloud computing refers to the apps and services delivered over the internet. Software delivered

More information

Public Cloud Offerings and Private Cloud Options. Week 2 Lecture 4. M. Ali Babar

Public Cloud Offerings and Private Cloud Options. Week 2 Lecture 4. M. Ali Babar Public Cloud Offerings and Private Cloud Options Week 2 Lecture 4 M. Ali Babar Lecture Outline Public and private clouds Some key public cloud providers (More details in the lab) Private clouds Main Aspects

More information

Cloud Computing and Amazon Web Services. CJUG March, 2009 Tom Malaher

Cloud Computing and Amazon Web Services. CJUG March, 2009 Tom Malaher Cloud Computing and Amazon Web Services CJUG March, 2009 Tom Malaher Agenda What is Cloud Computing? Amazon Web Services (AWS) Other Offerings Composing AWS Services Use Cases Ecosystem Reality Check Pros&Cons

More information

Cloud Computing and Big Data What Technical Writers Need to Know

Cloud Computing and Big Data What Technical Writers Need to Know Cloud Computing and Big Data What Technical Writers Need to Know Greg Olson, Senior Director Black Duck Software For the Society of Technical Writers Berkeley Chapter Black Duck 2014 Agenda Introduction

More information

Open source Google-style large scale data analysis with Hadoop

Open source Google-style large scale data analysis with Hadoop Open source Google-style large scale data analysis with Hadoop Ioannis Konstantinou Email: ikons@cslab.ece.ntua.gr Web: http://www.cslab.ntua.gr/~ikons Computing Systems Laboratory School of Electrical

More information

BIG DATA TRENDS AND TECHNOLOGIES

BIG DATA TRENDS AND TECHNOLOGIES BIG DATA TRENDS AND TECHNOLOGIES THE WORLD OF DATA IS CHANGING Cloud WHAT IS BIG DATA? Big data are datasets that grow so large that they become awkward to work with using onhand database management tools.

More information

Users VM A A A. Application. Compute/Storage/Network. VM Virtual Machine. On-Premises Data Center

Users VM A A A. Application. Compute/Storage/Network. VM Virtual Machine. On-Premises Data Center Users A A A VM VM VM A A A Application Compute/Storage/Network On-Premises Data Center VM Virtual Machine On-Premises Service Provider Users A A A Applications Compute/Storage/Network The main focus of

More information

Cloud Computing Now and the Future Development of the IaaS

Cloud Computing Now and the Future Development of the IaaS 2010 Cloud Computing Now and the Future Development of the IaaS Quanta Computer Division: CCASD Title: Project Manager Name: Chad Lin Agenda: What is Cloud Computing? Public, Private and Hybrid Cloud.

More information

It s All About Cloud Key Concepts, Players, Platforms And Technologies

It s All About Cloud Key Concepts, Players, Platforms And Technologies It s All About Cloud Key Concepts, Players, Platforms And Technologies 3-day seminar Description Cloud computing has gained a lot of attention in recent years. It has mostly been used for non business

More information

White Paper on CLOUD COMPUTING

White Paper on CLOUD COMPUTING White Paper on CLOUD COMPUTING INDEX 1. Introduction 2. Features of Cloud Computing 3. Benefits of Cloud computing 4. Service models of Cloud Computing 5. Deployment models of Cloud Computing 6. Examples

More information

What Is It? Business Architecture Research Challenges Bibliography. Cloud Computing. Research Challenges Overview. Carlos Eduardo Moreira dos Santos

What Is It? Business Architecture Research Challenges Bibliography. Cloud Computing. Research Challenges Overview. Carlos Eduardo Moreira dos Santos Research Challenges Overview May 3, 2010 Table of Contents I 1 What Is It? Related Technologies Grid Computing Virtualization Utility Computing Autonomic Computing Is It New? Definition 2 Business Business

More information

NCTA Cloud Architecture

NCTA Cloud Architecture NCTA Cloud Architecture Course Specifications Course Number: 093019 Course Length: 5 days Course Description Target Student: This course is designed for system administrators who wish to plan, design,

More information

A Survey on Cloud Storage Systems

A Survey on Cloud Storage Systems A Survey on Cloud Storage Systems Team : Xiaoming Xiaogang Adarsh Abhijeet Pranav Motivations No Taxonomy Detailed Survey for users Starting point for researchers Taxonomy Category Definition Example Instance

More information

Summary of Cloud Compu.ng (CC) from the paper Abovce the Clouds: A Berkeley View of Cloud Compu.ng (Feb. 2009)

Summary of Cloud Compu.ng (CC) from the paper Abovce the Clouds: A Berkeley View of Cloud Compu.ng (Feb. 2009) Summary of Cloud Compu.ng (CC) from the paper Abovce the Clouds: A Berkeley View of Cloud Compu.ng (Feb. 2009) Defini.ons (I) Cloud Compu)ng refers to both the applica)ons delivered as services over the

More information

Cloud Management: Solutions Assessment and Market Outlook 2015

Cloud Management: Solutions Assessment and Market Outlook 2015 Brochure More information from http://www.researchandmarkets.com/reports/3069769/ Cloud Management: Solutions Assessment and Market Outlook 2015 Description: The Cloud Management ecosystem is rapidly transforming

More information

Big Data Realities Hadoop in the Enterprise Architecture

Big Data Realities Hadoop in the Enterprise Architecture Big Data Realities Hadoop in the Enterprise Architecture Paul Phillips Director, EMEA, Hortonworks pphillips@hortonworks.com +44 (0)777 444 3857 Hortonworks Inc. 2012 Page 1 Agenda The Growth of Enterprise

More information

ITG Software Engineering

ITG Software Engineering Introduction to Apache Hadoop Course ID: Page 1 Last Updated 12/15/2014 Introduction to Apache Hadoop Course Overview: This 5 day course introduces the student to the Hadoop architecture, file system,

More information

Cloud computing. Examples

Cloud computing. Examples Cloud computing Cloud computing Web Systems and Algorithms Cloud Computing Chris Brooks Department of Computer Science University of San Francisco What is cloud computing? What separates it from: grid

More information

Ins+tuto Superior Técnico Technical University of Lisbon. Big Data. Bruno Lopes Catarina Moreira João Pinho

Ins+tuto Superior Técnico Technical University of Lisbon. Big Data. Bruno Lopes Catarina Moreira João Pinho Ins+tuto Superior Técnico Technical University of Lisbon Big Data Bruno Lopes Catarina Moreira João Pinho Mo#va#on 2 220 PetaBytes Of data that people create every day! 2 Mo#va#on 90 % of Data UNSTRUCTURED

More information

Update on the Cloud Demonstration Project

Update on the Cloud Demonstration Project Update on the Cloud Demonstration Project Khalil Yazdi and Steven Wallace Spring Member Meeting April 19, 2011 Project Par4cipants BACKGROUND Eleven Universi1es: Caltech, Carnegie Mellon, George Mason,

More information

Big Data and Industrial Internet

Big Data and Industrial Internet Big Data and Industrial Internet Keijo Heljanko Department of Computer Science and Helsinki Institute for Information Technology HIIT School of Science, Aalto University keijo.heljanko@aalto.fi 16.6-2015

More information

From classical web mapping publica2on to INSPIRE service architecture in the Cloud InGeoCloudS BRGM, Pierre LAGARDE

From classical web mapping publica2on to INSPIRE service architecture in the Cloud InGeoCloudS BRGM, Pierre LAGARDE From classical web mapping publica2on to INSPIRE service architecture in the Cloud InGeoCloudS BRGM, Pierre LAGARDE The classical approach of the environmental data dissemina3on 2 The classical approach

More information

Cloud Compu)ng: Overview & challenges. Aminata A. Garba

Cloud Compu)ng: Overview & challenges. Aminata A. Garba Cloud Compu)ng: Overview & challenges Aminata A. Garba Outline I. Introduc*on II. Virtualiza*on III. Resources Op*miza*on VI. Challenges 2 A Historical Note 1960, the idea of organizing computa)on as a

More information

The Cloud as a Computing Platform: Options for the Enterprise

The Cloud as a Computing Platform: Options for the Enterprise The Cloud as a Computing Platform: Options for the Enterprise Anthony Lewandowski, Ph.D. Solutions Architect Implicate Order Consulting Group LLC 571-606-4734 alewandowski@implicateorderllc.com The origins

More information

A Tutorial Introduc/on to Big Data. Hands On Data Analy/cs over EMR. Robert Grossman University of Chicago Open Data Group

A Tutorial Introduc/on to Big Data. Hands On Data Analy/cs over EMR. Robert Grossman University of Chicago Open Data Group A Tutorial Introduc/on to Big Data Hands On Data Analy/cs over EMR Robert Grossman University of Chicago Open Data Group Collin BenneE Open Data Group November 12, 2012 1 Amazon AWS Elas/c MapReduce allows

More information

Future @ Cloud: Cloud Computing meets Smart Ecosystems

Future @ Cloud: Cloud Computing meets Smart Ecosystems Future @ Cloud: Cloud Computing meets Smart Ecosystems Joerg Doerr, Fraunhofer IESE, Kaiserslautern, Germany Joerg.Doerr@iese.fraunhofer.de Fraunhofer-Institute for Experimental Software Engineering (IESE)

More information

Cloud computing doesn t yet have a

Cloud computing doesn t yet have a The Case for Cloud Computing Robert L. Grossman University of Illinois at Chicago and Open Data Group To understand clouds and cloud computing, we must first understand the two different types of clouds.

More information

Update on the Cloud Demonstration Project

Update on the Cloud Demonstration Project Update on the Cloud Demonstration Project Steven Wallace Joint Techs Summer 2011 13- July- 2011 Project Par4cipants BACKGROUND Twelve Universi,es: Caltech, Carnegie Mellon,Cornell George Mason, Indiana

More information

Monitis Project Proposals for AUA. September 2014, Yerevan, Armenia

Monitis Project Proposals for AUA. September 2014, Yerevan, Armenia Monitis Project Proposals for AUA September 2014, Yerevan, Armenia Distributed Log Collecting and Analysing Platform Project Specifications Category: Big Data and NoSQL Software Requirements: Apache Hadoop

More information

Architectural Implications of Cloud Computing

Architectural Implications of Cloud Computing Architectural Implications of Cloud Computing Grace Lewis Research, Technology and Systems Solutions (RTSS) Program Lewis is a senior member of the technical staff at the SEI in the Research, Technology,

More information

A Very Brief Introduction To Cloud Computing. Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman

A Very Brief Introduction To Cloud Computing. Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman A Very Brief Introduction To Cloud Computing Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman What is The Cloud Cloud computing refers to logical computational resources accessible via a computer

More information

Department of Computer Science University of Cyprus EPL646 Advanced Topics in Databases. Lecture 14

Department of Computer Science University of Cyprus EPL646 Advanced Topics in Databases. Lecture 14 Department of Computer Science University of Cyprus EPL646 Advanced Topics in Databases Lecture 14 Big Data Management IV: Big-data Infrastructures (Background, IO, From NFS to HFDS) Chapter 14-15: Abideboul

More information

Data Center Evolu.on and the Cloud. Paul A. Strassmann George Mason University November 5, 2008, 7:20 to 10:00 PM

Data Center Evolu.on and the Cloud. Paul A. Strassmann George Mason University November 5, 2008, 7:20 to 10:00 PM Data Center Evolu.on and the Cloud Paul A. Strassmann George Mason University November 5, 2008, 7:20 to 10:00 PM 1 Hardware Evolu.on 2 Where is hardware going? x86 con(nues to move upstream Massive compute

More information

Role of Cloud Computing in Big Data Analytics Using MapReduce Component of Hadoop

Role of Cloud Computing in Big Data Analytics Using MapReduce Component of Hadoop Role of Cloud Computing in Big Data Analytics Using MapReduce Component of Hadoop Kanchan A. Khedikar Department of Computer Science & Engineering Walchand Institute of Technoloy, Solapur, Maharashtra,

More information

What is Cloud Computing? Tackling the Challenges of Big Data. Tackling The Challenges of Big Data. Matei Zaharia. Matei Zaharia. Big Data Collection

What is Cloud Computing? Tackling the Challenges of Big Data. Tackling The Challenges of Big Data. Matei Zaharia. Matei Zaharia. Big Data Collection Introduction What is Cloud Computing? Cloud computing means computing resources available on demand Resources can include storage, compute cycles, or software built on top (e.g. database as a service)

More information

Cloud Computing @ JPL Science Data Systems

Cloud Computing @ JPL Science Data Systems Cloud Computing @ JPL Science Data Systems Emily Law, GSAW 2011 Outline Science Data Systems (SDS) Space & Earth SDSs SDS Common Architecture Components Key Components using Cloud Computing Use Case 1:

More information

Analysis and Research of Cloud Computing System to Comparison of Several Cloud Computing Platforms

Analysis and Research of Cloud Computing System to Comparison of Several Cloud Computing Platforms Volume 1, Issue 1 ISSN: 2320-5288 International Journal of Engineering Technology & Management Research Journal homepage: www.ijetmr.org Analysis and Research of Cloud Computing System to Comparison of

More information

Cloud Services Brokerage: Technology and Market Assessment 2014-2019

Cloud Services Brokerage: Technology and Market Assessment 2014-2019 Cloud Services Brokerage: Technology and Market Assessment 2014-2019 Phone: +44 20 8123 2220 Fax: +44 207 900 3970 office@marketpublishers.com Cloud Services Brokerage: Technology and Market Assessment

More information

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies Lecture 8 Cloud Programming & Software Environments Part 1 of 2 Spring 2013 A Specialty Course for Purdue University s M.S. in Technology

More information

Data Management in the Cloud

Data Management in the Cloud Data Management in the Cloud Introduc)on (Lecture 1) Do one thing every day that scares you. Eleanor Roosevelt 1 Data Management in the Cloud LOGISTICS AND ORGANIZATION 2 Kris)n TuCe FAB 115-09 Personnel

More information

Mining of Massive Datasets Jure Leskovec, Anand Rajaraman, Jeff Ullman Stanford University http://www.mmds.org

Mining of Massive Datasets Jure Leskovec, Anand Rajaraman, Jeff Ullman Stanford University http://www.mmds.org Note to other teachers and users of these slides: We would be delighted if you found this our material useful in giving your own lectures. Feel free to use these slides verbatim, or to modify them to fit

More information

Open source large scale distributed data management with Google s MapReduce and Bigtable

Open source large scale distributed data management with Google s MapReduce and Bigtable Open source large scale distributed data management with Google s MapReduce and Bigtable Ioannis Konstantinou Email: ikons@cslab.ece.ntua.gr Web: http://www.cslab.ntua.gr/~ikons Computing Systems Laboratory

More information

Magellan A Test Bed to Explore Cloud Computing for Science Shane Canon and Lavanya Ramakrishnan Cray XE6 Training February 8, 2011

Magellan A Test Bed to Explore Cloud Computing for Science Shane Canon and Lavanya Ramakrishnan Cray XE6 Training February 8, 2011 Magellan A Test Bed to Explore Cloud Computing for Science Shane Canon and Lavanya Ramakrishnan Cray XE6 Training February 8, 2011 Magellan Exploring Cloud Computing Co-located at two DOE-SC Facilities

More information

Cloud, and Digital Iden1ty Management (DIM) Exis1ng DIMs and their Limita1ons Our Goals World of Group Signatures SPICE!

Cloud, and Digital Iden1ty Management (DIM) Exis1ng DIMs and their Limita1ons Our Goals World of Group Signatures SPICE! Cloud, and Digital Iden1ty Management (DIM) Exis1ng DIMs and their Limita1ons Our Goals World of Group Signatures SPICE! Simple Showcase 2 Cloud compu1ng has been envisioned as the next- genera1on architecture

More information

Cloud Computing Summary and Preparation for Examination

Cloud Computing Summary and Preparation for Examination Basics of Cloud Computing Lecture 8 Cloud Computing Summary and Preparation for Examination Satish Srirama Outline Quick recap of what we have learnt as part of this course How to prepare for the examination

More information

Networked Virtual Spaces and Clouds. Magda El Zarki UC Irvine

Networked Virtual Spaces and Clouds. Magda El Zarki UC Irvine Networked Virtual Spaces and Clouds Magda El Zarki UC Irvine Outline Introduc6on to Networked Virtual Environments (NVE) Networked Virtual Environment Architectures Quality of Experience Clouds and real

More information

Cloud Computing 159.735. Submitted By : Fahim Ilyas (08497461) Submitted To : Martin Johnson Submitted On: 31 st May, 2009

Cloud Computing 159.735. Submitted By : Fahim Ilyas (08497461) Submitted To : Martin Johnson Submitted On: 31 st May, 2009 Cloud Computing 159.735 Submitted By : Fahim Ilyas (08497461) Submitted To : Martin Johnson Submitted On: 31 st May, 2009 Table of Contents Introduction... 3 What is Cloud Computing?... 3 Key Characteristics...

More information

Accelerating Enterprise Big Data Success. Tim Stevens, VP of Business and Corporate Development Cloudera

Accelerating Enterprise Big Data Success. Tim Stevens, VP of Business and Corporate Development Cloudera Accelerating Enterprise Big Data Success Tim Stevens, VP of Business and Corporate Development Cloudera 1 Big Opportunity: Extract value from data Revenue Growth x = 50 Billion 35 ZB Cost Savings Margin

More information

OTM in the Cloud. Ryan Haney

OTM in the Cloud. Ryan Haney OTM in the Cloud Ryan Haney The Cloud The Cloud is a set of services and technologies that delivers real-time and ondemand computing resources Software as a Service (SaaS) delivers preconfigured applications,

More information

CLOUD COMPUTING. Dana Petcu West University of Timisoara http://web.info.uvt.ro/~petcu

CLOUD COMPUTING. Dana Petcu West University of Timisoara http://web.info.uvt.ro/~petcu CLOUD COMPUTING Dana Petcu West University of Timisoara http://web.info.uvt.ro/~petcu TRENDY 2 WHY COINED CLOUD? Ask 10 professionals what cloud computing is, and you ll get 10 different answers CC is

More information

SUMMIT. November 2010

SUMMIT. November 2010 SUMMIT November 2010 Why Summit? Comprehensive Summit provides a unified approach to IT enterprise management following a prescriptive, ITIL based framework Rapid Deployment Summit is developed for and

More information

Electronic Records Storage Options and Overview

Electronic Records Storage Options and Overview Electronic Records Storage Options and Overview www.archives.nysed.gov Objectives Understand the options for electronic records storage, including cloud-based storage Evaluate the options best suited for

More information

TECHNOLOGY TRANSFER PRESENTS MAX DOLGICER IT S ALL ABOUT CLOUD CONCEPTS, STRATEGIES, ARCHITECTURES, PLAYERS, AND TECHNOLOGIES

TECHNOLOGY TRANSFER PRESENTS MAX DOLGICER IT S ALL ABOUT CLOUD CONCEPTS, STRATEGIES, ARCHITECTURES, PLAYERS, AND TECHNOLOGIES TECHNOLOGY TRANSFER PRESENTS MAX DOLGICER IT S ALL ABOUT CLOUD CONCEPTS, STRATEGIES, ARCHITECTURES, PLAYERS, AND TECHNOLOGIES APRIL 2-4, 2014 RESIDENZA DI RIPETTA - VIA DI RIPETTA, 231 ROME (ITALY) info@technologytransfer.it

More information

Ø Teaching Evaluations. q Open March 3 through 16. Ø Final Exam. q Thursday, March 19, 4-7PM. Ø 2 flavors: q Public Cloud, available to public

Ø Teaching Evaluations. q Open March 3 through 16. Ø Final Exam. q Thursday, March 19, 4-7PM. Ø 2 flavors: q Public Cloud, available to public Announcements TIM 50 Teaching Evaluations Open March 3 through 16 Final Exam Thursday, March 19, 4-7PM Lecture 19 20 March 12, 2015 Cloud Computing Cloud Computing: refers to both applications delivered

More information

You should have a working knowledge of the Microsoft Windows platform. A basic knowledge of programming is helpful but not required.

You should have a working knowledge of the Microsoft Windows platform. A basic knowledge of programming is helpful but not required. What is this course about? This course is an overview of Big Data tools and technologies. It establishes a strong working knowledge of the concepts, techniques, and products associated with Big Data. Attendees

More information

MapReduce, Hadoop and Amazon AWS

MapReduce, Hadoop and Amazon AWS MapReduce, Hadoop and Amazon AWS Yasser Ganjisaffar http://www.ics.uci.edu/~yganjisa February 2011 What is Hadoop? A software framework that supports data-intensive distributed applications. It enables

More information

Best Prac?ces for Building and Deploying Predic?ve Models Over Big Data

Best Prac?ces for Building and Deploying Predic?ve Models Over Big Data Best Prac?ces for Building and Deploying Predic?ve Models Over Big Data Robert Grossman Open Data Group & Univ. of Chicago Collin Benne= Open Data Group October 23, 2012 1. Introduc?on 2. Building Predic?ve

More information

Putchong Uthayopas, Kasetsart University

Putchong Uthayopas, Kasetsart University Putchong Uthayopas, Kasetsart University Introduction Cloud Computing Explained Cloud Application and Services Moving to the Cloud Trends and Technology Legend: Cluster computing, Grid computing, Cloud

More information

A R o a d t o y o u r C l o u d. Professional Service. C R M a n d C l o u d C o n s u l t i n g

A R o a d t o y o u r C l o u d. Professional Service. C R M a n d C l o u d C o n s u l t i n g RM-C A R o a d t o y o u r C l o u d Professional Service C R M a n d C l o u d C o n s u l t i n g CRM-C Highlights! A Unique Cloud CRM Consulting service firm! Specializing in cloud CRM and Office Collaboration

More information

Behind the scene III Cloud computing

Behind the scene III Cloud computing Behind the scene III Cloud computing Athens, 15.11.2014 M. Dolenc / R. Klinc Why we do it? Engineering in the cloud is a combina3on of cloud based services and rich interac3ve applica3ons allowing engineers

More information

Interagency Advisory Board Meeting Agenda, Wednesday, September 26, 2012

Interagency Advisory Board Meeting Agenda, Wednesday, September 26, 2012 Interagency Advisory Board Meeting Agenda, Wednesday, September 26, 2012 1. Opening Remarks 2. Enabling the Mobile Government Workforce with PIV Credentials in a BYOD Future (Neville Pattinson, Gemalto)

More information

OpenStack @ Cisco. Daneyon Hansen 3/28/2012. 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confiden+al 1

OpenStack @ Cisco. Daneyon Hansen 3/28/2012. 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confiden+al 1 OpenStack @ Cisco Daneyon Hansen 3/28/2012 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confiden+al 1 Customer value is moving up into sogware and web services Virtualiza+on and internet

More information

Big Business, Big Data, Industrialized Workload

Big Business, Big Data, Industrialized Workload Big Business, Big Data, Industrialized Workload Big Data Big Data 4 Billion 600TB London - NYC 1 Billion by 2020 100 Million Giga Bytes Copyright 3/20/2014 BMC Software, Inc 2 Copyright 3/20/2014 BMC Software,

More information

Big Data and Clouds: Challenges and Opportuni5es

Big Data and Clouds: Challenges and Opportuni5es Big Data and Clouds: Challenges and Opportuni5es NIST January 15 2013 Geoffrey Fox gcf@indiana.edu h"p://www.infomall.org h"p://www.futuregrid.org School of Informa;cs and Compu;ng Digital Science Center

More information