Dutch HPC Cloud: flexible HPC for high productivity in science & business

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Dutch HPC Cloud: flexible HPC for high productivity in science & business"

Transcription

1 Dutch HPC Cloud: flexible HPC for high productivity in science & business Dr. Axel Berg SARA national HPC & e-science Support Center, Amsterdam, NL April 17, th PRACE Executive Industrial Seminar, Bologna, Italy

2 Good business opportunity in HPC John West, Director for DoD HPC Modernization Program, discussing The Missing Middle at the 26th Annual HPCC Conference (March , Newport, RI, USA). He postulated on how, given this unalloyed good that is HPC, how come everybody isn t using it? Council on Competitiveness: missing middle refers to: the group of HPC users between low-end, mostly workstation-bound HPC users, and the kind of high-end HPC typically performed at national labs and some universities. The problem is that transitioning from desktop HPC to server-based HPC is filled with roadblocks, especially for commercial users looking to make the leap to small clusters.

3 Large opportunity for HPC in science & business John West, Director for DoD HPC Modernization Program, discussing The Missing Middle at the 26th Annual HPCC Conference (March , Newport, RI, USA). He postulated on how, given this unalloyed good that is HPC, how come everybody isn t using it? Council on Competitiveness: missing middle refers to: the group of HPC users between low-end, mostly workstation-bound HPC users, and the kind of high-end HPC typically performed at national labs and some universities. The problem is that transitioning from desktop HPC to server-based HPC is filled with roadblocks, especially for commercial users looking to make the leap to small clusters.

4 Many hurdles for the use of HPC by the missing middle (science & business) > Increasing hardware complexity (including divergent technologies like CPUs and GPUs) > Fixed software (OS) environments > Software portability and usability > Software scaling > Software licensing > Security and trust > Cultural hurdles > Lack of expertise > Etc.

5 High potential for use of HPC by industry 1. Direct use of the HPC infrastructure (the visible part of the iceberg) 5-10 companies 1 2. Indirect use of the HPC infrastructure (under water part of iceberg) more than 85 use cases in NL where industry & SMEs used the HPC infrastructure through collaboration with academia 3. Potential users (the ocean) SMEs, design & engineering, life sciences, energy, etc. Long list (>200) of identified potential NL companies that could benefit from HPC for simulation and data mining 2 3

6 Dutch TopSector Approach Industry, SMEs Government Science

7 Infrastructure Innovation with Impact > 34 M value program called Infrastructure Innovation with Impact ( ) > 7 M funded by Ministry of Economic Affairs, Agriculture & Innovation > Objective: > Providing competitive advantage with the national ICTinfrastructure for Research. > Technology transfer from science to business in this area is crucial for knowledge economy in the Netherlands. Investments in keeping the national e- infrastructure at the competitive level Access to and support for the integrated e- infrastructure for industry and SMEs

8 Access to and support for the national e- infrastructure for industry and SMEs Development, promotion and implementation of an access and support program for industry and SME s Deployment of software for business applications on the e-infrastructure Deployment of HPC Cloud services for industry and SME s Development and deployment of advanced data services for industry Best practices and business models on use of the e- infrastructure and technology transfer

9 The sun is shining behind the clouds

10 Great opportunity for HPC Clouds in science and business

11 Major drivers for HPC Cloud Why can t I just scale up the application that runs on my workstation? It is too complicated and takes too much effort to port my application to your supercomputer, not to speak about your grid My workflow is not suited for such static environment I want to choose my own operating system My application does not run on your Linux ;-( I want to use the Cloud, it is fancy and cool!

12 Major drivers for HPC Cloud > Scaling up applications and work loads (elastic): - from work station level to HPC level - enabling the scale up of complex workflows > Flexibility of the user environment: - addressing mismatches between user s environment and fixed HPC environment - adapting the HPC environment to the application, rather than adapting the application to the HPC environment

13 Infrastructure Innovation cycle > Rapid prototyping and Proof-of-Concept in pilots with concrete use cases (small nr. of users) > Pre-production with limited number of users > Production for larger user community

14 HPC Cloud Innovation roadmap Started 2009, Q3: Proof-of-Concept phase Small testbed, 50 cores Evaluated different Open Source Cloud Toolkits and Virtualization products Chosen: OpenNebula and KVM 5 external user groups Started 2010, Q2: Pre-production Phase (Claudia) Medium sized testbed, 128 cores, 100 Tbyte storage 60 external users Since 2011, Q3: Production Phase (Calligo) 608 cores, 400 TB storage more than 30 project running from the start

15 Dutch HPC Cloud

16 Our definition of Cloud Cloud Computing: Self Service Dynamically Scalable Computing Facilities Cloud computing is not about new technology, it is about new uses of technology

17 Virtual Private (HPC) Cluster > Take hardware stack optimized for HPC usage 32 cores/256 GB memory per node Multiple fast 10GE interconnect Large and well-connected storage > Provide Secure environment and networking Each VPC its own VLAN FireWalled access Centrally provided network scans > Enable User to configure Virtual Private HPC Clusters Define cluster of Virtual Machines Self Service GUI Public IP possible (subject to security scan) Do not restrict OS types

18 Self Service GUI & Collaboration Portal Developed at SARA Open Source, available at

19 Dutch HPC Cloud service > Work loads: - enabling scale up of work loads from small specialized clusters - significantly scale up work loads from workstations - enabling and scale up complex work flows > High User Productivity > Advantages: - dynamic, flexible and elastic self-service - define your own working environment - define your own Virtual Private HPC cluster > HPC Cloud service platform at SARA - 19 nodes with 32 Intel Xeon E7 cores (608 cores total), 256GB memory (4,75TB total), 40Gbps network (4x10GE non-blocking) - 400TB Shared storage (ISCSI,NFS,CIFS,CDMI...) - Software: OpenNebula KVM > Integrated in the Dutch e-science grid BiG Grid

20 Dutch HPC Cloud service Based on an HPC platform o Infrastructure based on High Performance Compute, Storage and Networking o No over-provisioning of resources (overhead is 5% max.) o Applications with different requirements can co-exist on same physical host and in same virtual cluster o Self Service as a guiding principle o IAAS: user access to Virtual Private HPC Clusters o PAAS: various standard platform images available o SAAS: software as a service o Network, Storage and Compute under control of the user osupport, expertise and tools available o Support for installation configuration and best practices o Collaboration portal to share virtual machine images and user experiences

21 HPC cloud offering High Performance Platform Virtualized Everything Software, Services Support HPC Cloud Offering Fast CPU, High Memory, Large Storage and High Bandwidth Virtual Private Clusters and Networking Resource Deployment portal, Collaboration Portal User in control Powerful Flexible Versatile HPC Cloud

22 HPC Cloud Calligo

23 SARA HPC ecosystem

24 HPC Cloud in the HPC pyramid PRACE Tier-0 Centers Tier-1 National e- infrastructure Regional/topical resources (Tier-2 size)

25 HPC Cloud in the HPC pyramid PRACE Tier-0 Centers Tier-1 National e- infrastructure Regional/topical resources (Tier-2 size)

26 Why not using Amazon EC2? Do if you can! Full daily support Customer relation and intimacy Expert community support Community collaboration and sharing support Data-intensive computing High Performance Known service provider (trust)

27 Major concerns of cloud services?

28 Legislation

29 HPC Cloud Security & Trust Security and trust are of major importance Protect Firewall the outside from the cloud users the cloud users from the outside the cloud users from each other fine-grained access rules ( closed port policy) non-standard ports open on request only and between limited network ranges Scanning of new virtual templates Port scanning catches initial problems, but once the VM is live... catches well-known problems State-full Package Inspection random sample based

30 Transcriptomics PSEs Han Rauwerda, MAD, Swammerdam Institute for Life Sciences, University of Amsterdam, NL

31 Example NMR Protein structure validation Jurgen Doreleijers, CMBI, NBIC, NL

32 Example NMR Protein structure validation Jurgen Doreleijers, CMBI, NBIC, NL

33 Example Transcriptomics PSEs Han Rauwerda, MAD, Swammerdam Institute for Life Sciences, University of Amsterdam, NL

34 CLARIN: dynamic web services deployment Marc Kemps Snijders, Meertens Institute, Royal Academy of Sciences, NL

35 CLARIN: dynamic web services deployment Marc Kemps Snijders, Meertens Institute, Royal Academy of Sciences, NL

36 GALAXY, web-based genome analysis platform Mattias de Hollander, Netherlands Institute of Ecology, NL

37 GALAXY, web-based genome analysis platform Mattias de Hollander, Netherlands Institute of Ecology, NL

38 Urban Flood

39 Urban Flood

40 Diversity in Applications Type Examples Requirements Compute Intensive Data intensive Communication intensive Monte Carlo simulations and parameter optimizations, etc Signal/Image processing in Astronomy, Remote Sensing, Medical Imaging, DNA matching, Pattern matching, etc Particle Physics, MPI, etc CPU Cycles I/O to data (SAN File Servers) Fast interconnect network Memory intensive DNA assembly, etc Large (Shared) RAM Continuous services Databases, webservers, webservices Dynamically scalable

41 Big Data in the Cloud SARA > SARA s open source Apache Hadoop providing access to a distributed file system along with a framework for running map reduce jobs over the data. > Data is replicated to each node, running jobs in parallel on a distributed system. > As the data increases, new nodes are added at runtime. Scale out, not up > No more do-it-yourself parallelism (it's hard!), but rather linearly scalable data parallelism: Separating the what from the how Move processing to the data Process data sequentially, avoid random reads Seamless scalability

42 SARA (Timeline) 2009: Piloting Hadoop on Cloud 2010: Test cluster available for scientists 6 machines * 4 cores / 24 TB storage / 16GB RAM 2012: Production cluster available 2012: Production cluster available (March) 72 machines * 8 cores / 8 TB storage / 64GB RAM Integration with Kerberos for secure multi-tenancy

43 Big Data DevOps Programming algorithms Domain knowledge

44 What are our scientists doing? Information Retrieval Natural Language Processing Machine Learning Econometrics Bioinformatics Computational Ecology / Eco-informatics

45 Concluding remarks Great opportunity for HPC in science and business ( missing middle ), many potential users/applications could take advantage of HPC but do currently not HPC Cloud service with Virtual Private Compute Clusters offers just the selfservice flexibility combined with High Performance to adapt the computing environment to the application: overcomes many hurdles and could serve many of the missing middle. High productivity! HPC Cloud is complementary to other services like supercomputers (Tier-0 and Tier-1), standard capacity clusters and grids: HPC Cloud service is part of the of the whole HPC eco-system HPC Cloud is complementary to commercial cloud offerings like Amazon EC2 with respect to basic support, expert community support, customer intimacy, and community collaboration and sharing possibilities There is great interest and many concrete examples from science and business (simulation as well as Big Data analysis): enabler and stepping stone for larger and wider HPC usage

46 To finish with Cloud is a Promise Rain is Fulfillment! Questions and more info: Axel Berg

HPC Cloud. Focus on your research. Floris Sluiter Project leader SARA

HPC Cloud. Focus on your research. Floris Sluiter Project leader SARA HPC Cloud Focus on your research Floris Sluiter Project leader SARA Why an HPC Cloud? Christophe Blanchet, IDB - Infrastructure Distributing Biology: Big task to port them all to your favorite architecture

More information

SURFsara HPC Cloud Workshop

SURFsara HPC Cloud Workshop SURFsara HPC Cloud Workshop doc.hpccloud.surfsara.nl UvA workshop 2016-01-25 UvA HPC Course Jan 2016 Anatoli Danezi, Markus van Dijk cloud-support@surfsara.nl Agenda Introduction and Overview (current

More information

SURFsara HPC Cloud Workshop

SURFsara HPC Cloud Workshop SURFsara HPC Cloud Workshop www.cloud.sara.nl Tutorial 2014-06-11 UvA HPC and Big Data Course June 2014 Anatoli Danezi, Markus van Dijk cloud-support@surfsara.nl Agenda Introduction and Overview (current

More information

Cloud Computing: a gift from the skies How Cloud Computing can help recovering from the recession

Cloud Computing: a gift from the skies How Cloud Computing can help recovering from the recession Cloud Computing: a gift from the skies How Cloud Computing can help recovering from the recession Dr. ir. Anwar Osseyran SARA-BiG Grid High Performance Cloud Computing Day Amsterdam, October 4 2011 Trade

More information

Cloud Computing. Adam Barker

Cloud Computing. Adam Barker Cloud Computing Adam Barker 1 Overview Introduction to Cloud computing Enabling technologies Different types of cloud: IaaS, PaaS and SaaS Cloud terminology Interacting with a cloud: management consoles

More information

Cloud Computing. Alex Crawford Ben Johnstone

Cloud Computing. Alex Crawford Ben Johnstone Cloud Computing Alex Crawford Ben Johnstone Overview What is cloud computing? Amazon EC2 Performance Conclusions What is the Cloud? A large cluster of machines o Economies of scale [1] Customers use a

More information

Cloud Computing and Amazon Web Services

Cloud Computing and Amazon Web Services Cloud Computing and Amazon Web Services Gary A. McGilvary edinburgh data.intensive research 1 OUTLINE 1. An Overview of Cloud Computing 2. Amazon Web Services 3. Amazon EC2 Tutorial 4. Conclusions 2 CLOUD

More information

wu.cloud: Insights Gained from Operating a Private Cloud System

wu.cloud: Insights Gained from Operating a Private Cloud System wu.cloud: Insights Gained from Operating a Private Cloud System Stefan Theußl, Institute for Statistics and Mathematics WU Wirtschaftsuniversität Wien March 23, 2011 1 / 14 Introduction In statistics we

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

Scientific and Technical Applications as a Service in the Cloud

Scientific and Technical Applications as a Service in the Cloud Scientific and Technical Applications as a Service in the Cloud University of Bern, 28.11.2011 adapted version Wibke Sudholt CloudBroker GmbH Technoparkstrasse 1, CH-8005 Zurich, Switzerland Phone: +41

More information

Amazon EC2 Product Details Page 1 of 5

Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Functionality Amazon EC2 presents a true virtual computing environment, allowing you to use web service interfaces to launch instances with a variety of

More information

Emerging Technology for the Next Decade

Emerging Technology for the Next Decade Emerging Technology for the Next Decade Cloud Computing Keynote Presented by Charles Liang, President & CEO Super Micro Computer, Inc. What is Cloud Computing? Cloud computing is Internet-based computing,

More information

OpenNebula Leading Innovation in Cloud Computing Management

OpenNebula Leading Innovation in Cloud Computing Management OW2 Annual Conference 2010 Paris, November 24th, 2010 OpenNebula Leading Innovation in Cloud Computing Management Ignacio M. Llorente DSA-Research.org Distributed Systems Architecture Research Group Universidad

More information

Amazon Web Services. Elastic Compute Cloud (EC2) and more...

Amazon Web Services. Elastic Compute Cloud (EC2) and more... Amazon Web Services Elastic Compute Cloud (EC2) and more... I don t work for Amazon I do however, have a small research grant from Amazon (in AWS$) Portions of this presentation are reproduced from slides

More information

Open Source Cloud Software Made in Switzerland. Michael Eichenberger CEO stepping stone GmbH Open Cloud Day 19th of June 2012

Open Source Cloud Software Made in Switzerland. Michael Eichenberger CEO stepping stone GmbH Open Cloud Day 19th of June 2012 Open Source Cloud Software Made in Switzerland Michael Eichenberger CEO stepping stone GmbH Open Cloud Day 19th of June 2012 Agenda About us Why our own Cloud solution? Technology Distinctive Features

More information

Cloud Computing through Virtualization and HPC technologies

Cloud Computing through Virtualization and HPC technologies Cloud Computing through Virtualization and HPC technologies William Lu, Ph.D. 1 Agenda Cloud Computing & HPC A Case of HPC Implementation Application Performance in VM Summary 2 Cloud Computing & HPC HPC

More information

Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases

Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases NASA Ames NASA Advanced Supercomputing (NAS) Division California, May 24th, 2012 Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases Ignacio M. Llorente Project Director OpenNebula Project.

More information

How can new technologies can be of service to astronomy? Community effort

How can new technologies can be of service to astronomy? Community effort 1 Astronomy must develop new computational model Integration and processing of data will be done increasingly on distributed facilities rather than desktops Wonderful opportunity for the next generation!

More information

Cloud Computing. Chapter 1 Introducing Cloud Computing

Cloud Computing. Chapter 1 Introducing Cloud Computing Cloud Computing Chapter 1 Introducing Cloud Computing Learning Objectives Understand the abstract nature of cloud computing. Describe evolutionary factors of computing that led to the cloud. Describe virtualization

More information

Performance Evaluation of Amazon EC2 for NASA HPC Applications!

Performance Evaluation of Amazon EC2 for NASA HPC Applications! National Aeronautics and Space Administration Performance Evaluation of Amazon EC2 for NASA HPC Applications! Piyush Mehrotra!! J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Lazanoff,! S. Saini, R. Biswas!

More information

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud February 25, 2014 1 Agenda v Mapping clients needs to cloud technologies v Addressing your pain

More information

Cloud Computing. Chapter 1 Introducing Cloud Computing

Cloud Computing. Chapter 1 Introducing Cloud Computing Cloud Computing Chapter 1 Introducing Cloud Computing Learning Objectives Understand the abstract nature of cloud computing. Describe evolutionary factors of computing that led to the cloud. Describe virtualization

More information

Enabling multi-cloud resources at CERN within the Helix Nebula project. D. Giordano (CERN IT-SDC) HEPiX Spring 2014 Workshop 23 May 2014

Enabling multi-cloud resources at CERN within the Helix Nebula project. D. Giordano (CERN IT-SDC) HEPiX Spring 2014 Workshop 23 May 2014 Enabling multi-cloud resources at CERN within the Helix Nebula project D. Giordano (CERN IT-) HEPiX Spring 2014 Workshop This document produced by Members of the Helix Nebula consortium is licensed under

More information

High Performance Applications over the Cloud: Gains and Losses

High Performance Applications over the Cloud: Gains and Losses High Performance Applications over the Cloud: Gains and Losses Dr. Leila Ismail Faculty of Information Technology United Arab Emirates University leila@uaeu.ac.ae http://citweb.uaeu.ac.ae/citweb/profile/leila

More information

Cloud Computing & Hosting Solutions

Cloud Computing & Hosting Solutions Cloud Computing & Hosting Solutions SANTA FE COLLEGE CTS2356: NETWORK ADMIN DANIEL EAKINS 4/15/2012 1 Cloud Computing & Hosting Solutions ABSTRACT For this week s topic we will discuss about Cloud computing

More information

Cloud Federation to Elastically Increase MapReduce Processing Resources

Cloud Federation to Elastically Increase MapReduce Processing Resources Cloud Federation to Elastically Increase MapReduce Processing Resources A.Panarello, A.Celesti, M. Villari, M. Fazio and A. Puliafito {apanarello,acelesti, mfazio, mvillari, apuliafito}@unime.it DICIEAMA,

More information

Cloud Computing Now and the Future Development of the IaaS

Cloud Computing Now and the Future Development of the IaaS 2010 Cloud Computing Now and the Future Development of the IaaS Quanta Computer Division: CCASD Title: Project Manager Name: Chad Lin Agenda: What is Cloud Computing? Public, Private and Hybrid Cloud.

More information

PRIVATE CLOUD. November 6, 2013 Kay Metsker & Dan Mercer

PRIVATE CLOUD. November 6, 2013 Kay Metsker & Dan Mercer PRIVATE CLOUD November 6, 2013 Kay Metsker & Dan Mercer Agenda Deployment Milestones Service Strategy Service Benefits Feature Comparison Future Features Feature Set Matrix Consumption Models Financial

More information

Benefits and Uses of Private Cloud based on Next-generation Technology that Supersedes Virtualization

Benefits and Uses of Private Cloud based on Next-generation Technology that Supersedes Virtualization Hitachi Review Vol. 65 (2016), No. 1 775 Featured Articles Benefits and Uses of Private Cloud based on Next-generation Technology that Supersedes Virtualization Norihiro Hayakawa Yasufumi Sato Hiroyuki

More information

Neptune. A Domain Specific Language for Deploying HPC Software on Cloud Platforms. Chris Bunch Navraj Chohan Chandra Krintz Khawaja Shams

Neptune. A Domain Specific Language for Deploying HPC Software on Cloud Platforms. Chris Bunch Navraj Chohan Chandra Krintz Khawaja Shams Neptune A Domain Specific Language for Deploying HPC Software on Cloud Platforms Chris Bunch Navraj Chohan Chandra Krintz Khawaja Shams ScienceCloud 2011 @ San Jose, CA June 8, 2011 Cloud Computing Three

More information

Introduction to grid technologies, parallel and cloud computing. Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber

Introduction to grid technologies, parallel and cloud computing. Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber Introduction to grid technologies, parallel and cloud computing Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber OUTLINES Grid Computing Parallel programming technologies (MPI- Open MP-Cuda )

More information

Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed

Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed Sébastien Badia, Alexandra Carpen-Amarie, Adrien Lèbre, Lucas Nussbaum Grid 5000 S. Badia, A. Carpen-Amarie, A. Lèbre, L. Nussbaum

More information

Cornell University Center for Advanced Computing

Cornell University Center for Advanced Computing Cornell University Center for Advanced Computing David A. Lifka - lifka@cac.cornell.edu Director - Cornell University Center for Advanced Computing (CAC) Director Research Computing - Weill Cornell Medical

More information

OpenNebula Open Souce Solution for DC Virtualization

OpenNebula Open Souce Solution for DC Virtualization 13 th LSM 2012 7 th -12 th July, Geneva OpenNebula Open Souce Solution for DC Virtualization Constantino Vázquez Blanco OpenNebula.org What is OpenNebula? Multi-tenancy, Elasticity and Automatic Provision

More information

Cloud computing. Intelligent Services for Energy-Efficient Design and Life Cycle Simulation. as used by the ISES project

Cloud computing. Intelligent Services for Energy-Efficient Design and Life Cycle Simulation. as used by the ISES project Intelligent Services for Energy-Efficient Design and Life Cycle Simulation Project number: 288819 Call identifier: FP7-ICT-2011-7 Project coordinator: Technische Universität Dresden, Germany Website: ises.eu-project.info

More information

Big Data and Cloud Computing for GHRSST

Big Data and Cloud Computing for GHRSST Big Data and Cloud Computing for GHRSST Jean-Francois Piollé (jfpiolle@ifremer.fr) Frédéric Paul, Olivier Archer CERSAT / Institut Français de Recherche pour l Exploitation de la Mer Facing data deluge

More information

OpenNebula Open Souce Solution for DC Virtualization. C12G Labs. Online Webinar

OpenNebula Open Souce Solution for DC Virtualization. C12G Labs. Online Webinar OpenNebula Open Souce Solution for DC Virtualization C12G Labs Online Webinar What is OpenNebula? Multi-tenancy, Elasticity and Automatic Provision on Virtualized Environments I m using virtualization/cloud,

More information

Cloud Computing from an Institutional Perspective

Cloud Computing from an Institutional Perspective 15th April 2010 e-infranet Workshop Louvain, Belgium Next Generation Data Center Summit Cloud Computing from an Institutional Perspective Distributed Systems Architecture Research Group Universidad Complutense

More information

OpenNebula Open Souce Solution for DC Virtualization

OpenNebula Open Souce Solution for DC Virtualization OSDC 2012 25 th April, Nürnberg OpenNebula Open Souce Solution for DC Virtualization Constantino Vázquez Blanco OpenNebula.org What is OpenNebula? Multi-tenancy, Elasticity and Automatic Provision on Virtualized

More information

Unleash the IaaS Cloud About VMware vcloud Director and more VMUG.BE June 1 st 2012

Unleash the IaaS Cloud About VMware vcloud Director and more VMUG.BE June 1 st 2012 Unleash the IaaS Cloud About VMware vcloud Director and more VMUG.BE June 1 st 2012 2 Who? Viktor van den Berg Consultant @ PQR Former Dutch VMUG Leader Blogger at www.viktorious.nl Twitter @viktoriousss

More information

Viswanath Nandigam Sriram Krishnan Chaitan Baru

Viswanath Nandigam Sriram Krishnan Chaitan Baru Viswanath Nandigam Sriram Krishnan Chaitan Baru Traditional Database Implementations for large-scale spatial data Data Partitioning Spatial Extensions Pros and Cons Cloud Computing Introduction Relevance

More information

Technology and Cost Considerations for Cloud Deployment: Amazon Elastic Compute Cloud (EC2) Case Study

Technology and Cost Considerations for Cloud Deployment: Amazon Elastic Compute Cloud (EC2) Case Study Creating Value Delivering Solutions Technology and Cost Considerations for Cloud Deployment: Amazon Elastic Compute Cloud (EC2) Case Study Chris Zajac, NJDOT Bud Luo, Ph.D., Michael Baker Jr., Inc. Overview

More information

GTC Presentation March 19, 2013. Copyright 2012 Penguin Computing, Inc. All rights reserved

GTC Presentation March 19, 2013. Copyright 2012 Penguin Computing, Inc. All rights reserved GTC Presentation March 19, 2013 Copyright 2012 Penguin Computing, Inc. All rights reserved Session S3552 Room 113 S3552 - Using Tesla GPUs, Reality Server and Penguin Computing's Cloud for Visualizing

More information

Cloud Computing for HPC

Cloud Computing for HPC Cloud Computing for HPC Extending Clusters to Clouds Solution Briefing TORONTO 10/25/2011 Company Background 2 Platform Computing, Inc. Platform Clusters, Grids, Clouds Computing The leader in cluster,

More information

PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN

PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN 1 PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN Introduction What is cluster computing? Classification of Cluster Computing Technologies: Beowulf cluster Construction

More information

High Performance Computing (HPC)

High Performance Computing (HPC) High Performance Computing (HPC) High Performance Computing (HPC) White Paper Attn: Name, Title Phone: xxx.xxx.xxxx Fax: xxx.xxx.xxxx 1.0 OVERVIEW When heterogeneous enterprise environments are involved,

More information

Enterprise Cloud Solutions

Enterprise Cloud Solutions IT(O) IT Outsourcing Options Enterprise Cloud Solutions CloudAgile Select Partner PDF v2.2 9/11/12 Cloud Computing with Latisys With the Latisys Cloud, your Enterprise can: Achieve unprecedented control,

More information

Design and Building of IaaS Clouds

Design and Building of IaaS Clouds 21th May 2010 CloudViews 2010 Porto, Portugal Next Generation Data Center Summit Design and Building of IaaS Clouds Distributed Systems Architecture Research Group Universidad Complutense de Madrid This

More information

High Performance Computing in CST STUDIO SUITE

High Performance Computing in CST STUDIO SUITE High Performance Computing in CST STUDIO SUITE Felix Wolfheimer GPU Computing Performance Speedup 18 16 14 12 10 8 6 4 2 0 Promo offer for EUC participants: 25% discount for K40 cards Speedup of Solver

More information

Building a Private Cloud with Eucalyptus

Building a Private Cloud with Eucalyptus Building a Private Cloud with Eucalyptus 5th IEEE International Conference on e-science Oxford December 9th 2009 Christian Baun, Marcel Kunze KIT The cooperation of Forschungszentrum Karlsruhe GmbH und

More information

Using Cloud Services for Test Environments A case study of the use of Amazon EC2

Using Cloud Services for Test Environments A case study of the use of Amazon EC2 Using Cloud Services for Test Environments A case study of the use of Amazon EC2 Lee Hawkins (Quality Architect) Quest Software, Melbourne Copyright 2010 Quest Software We are gathered here today to talk

More information

Open Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud)

Open Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud) Open Cloud System (Integration of Eucalyptus, Hadoop and into deployment of University Private Cloud) Thinn Thu Naing University of Computer Studies, Yangon 25 th October 2011 Open Cloud System University

More information

Automating Big Data Benchmarking for Different Architectures with ALOJA

Automating Big Data Benchmarking for Different Architectures with ALOJA www.bsc.es Jan 2016 Automating Big Data Benchmarking for Different Architectures with ALOJA Nicolas Poggi, Postdoc Researcher Agenda 1. Intro on Hadoop performance 1. Current scenario and problematic 2.

More information

Cloud Models and Platforms

Cloud Models and Platforms Cloud Models and Platforms Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF A Working Definition of Cloud Computing Cloud computing is a model

More information

Grid Computing Vs. Cloud Computing

Grid Computing Vs. Cloud Computing International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 6 (2013), pp. 577-582 International Research Publications House http://www. irphouse.com /ijict.htm Grid

More information

HPC performance applications on Virtual Clusters

HPC performance applications on Virtual Clusters Panagiotis Kritikakos EPCC, School of Physics & Astronomy, University of Edinburgh, Scotland - UK pkritika@epcc.ed.ac.uk 4 th IC-SCCE, Athens 7 th July 2010 This work investigates the performance of (Java)

More information

Cloud Computing and Amazon Web Services. CJUG March, 2009 Tom Malaher

Cloud Computing and Amazon Web Services. CJUG March, 2009 Tom Malaher Cloud Computing and Amazon Web Services CJUG March, 2009 Tom Malaher Agenda What is Cloud Computing? Amazon Web Services (AWS) Other Offerings Composing AWS Services Use Cases Ecosystem Reality Check Pros&Cons

More information

PRIMERGY server-based High Performance Computing solutions

PRIMERGY server-based High Performance Computing solutions PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating

More information

Business applications:

Business applications: Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Business applications: the COMETA approach Prof. Antonio Puliafito University of Messina Open Grid Forum (OGF25) Catania, 2-6.03.2009 www.consorzio-cometa.it

More information

Grid and Cloud Computing at LRZ Dr. Helmut Heller, Group Leader Distributed Resources Group

Grid and Cloud Computing at LRZ Dr. Helmut Heller, Group Leader Distributed Resources Group Grid and Cloud Computing at LRZ Dr. Helmut Heller, Group Leader Distributed Resources Group Overview Grid: http://www.grid.lrz.de What is Grid computing? Advantages of Grid computing (why you should use

More information

Elastic Cloud Computing in the Open Cirrus Testbed implemented via Eucalyptus

Elastic Cloud Computing in the Open Cirrus Testbed implemented via Eucalyptus Elastic Cloud Computing in the Open Cirrus Testbed implemented via Eucalyptus International Symposium on Grid Computing 2009 (Taipei) Christian Baun The cooperation of and Universität Karlsruhe (TH) Agenda

More information

Amazon Cloud Performance Compared. David Adams

Amazon Cloud Performance Compared. David Adams Amazon Cloud Performance Compared David Adams Amazon EC2 performance comparison How does EC2 compare to traditional supercomputer for scientific applications? "Performance Analysis of High Performance

More information

OpenNebula Cloud Case Studies for Research and Industry

OpenNebula Cloud Case Studies for Research and Industry Des grilles aux Clouds Ecole Normale Supérieure de Lyon December 13th, 2010 OpenNebula Cloud Case Studies for Research and Industry Ignacio M. Llorente DSA-Research.org Distributed Systems Architecture

More information

3.1 IaaS Definition. IaaS: Infrastructure as a Service

3.1 IaaS Definition. IaaS: Infrastructure as a Service 1 3.1 IaaS Definition IaaS: Infrastructure as a Service Through the internet, provide IT server, storage, computing power and other infrastructure capacity to the end users and the service fee based on

More information

OpenNebula Cloud Innovation and Case Studies for Telecom

OpenNebula Cloud Innovation and Case Studies for Telecom Telecom Cloud Standards Information Day Hyatt Regency, Santa Clara, CA, USA 6-7 December, 2010 OpenNebula Cloud Innovation and Case Studies for Telecom Constantino Vázquez Blanco DSA-Research.org Distributed

More information

Pedraforca: ARM + GPU prototype

Pedraforca: ARM + GPU prototype www.bsc.es Pedraforca: ARM + GPU prototype Filippo Mantovani Workshop on exascale and PRACE prototypes Barcelona, 20 May 2014 Overview Goals: Test the performance, scalability, and energy efficiency of

More information

Consolidated Technology Services PRIVATE CLOUD SERVICE. March 2014

Consolidated Technology Services PRIVATE CLOUD SERVICE. March 2014 Consolidated Technology Services PRIVATE CLOUD SERVICE March 2014 Topics Service Strategy Features and Benefits Service Options Rates Deployment Strategy Next Steps 2 Private Cloud Service Strategy Transform

More information

Sistemi Operativi e Reti. Cloud Computing

Sistemi Operativi e Reti. Cloud Computing 1 Sistemi Operativi e Reti Cloud Computing Facoltà di Scienze Matematiche Fisiche e Naturali Corso di Laurea Magistrale in Informatica Osvaldo Gervasi ogervasi@computer.org 2 Introduction Technologies

More information

Boas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, 2015. 20014 IBM Corporation

Boas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, 2015. 20014 IBM Corporation Boas Betzler Cloud IBM Distinguished Computing Engineer for a Smarter Planet Globally Distributed IaaS Platform Examples AWS and SoftLayer November 9, 2015 20014 IBM Corporation Building Data Centers The

More information

Write a technical report Present your results Write a workshop/conference paper (optional) Could be a real system, simulation and/or theoretical

Write a technical report Present your results Write a workshop/conference paper (optional) Could be a real system, simulation and/or theoretical Identify a problem Review approaches to the problem Propose a novel approach to the problem Define, design, prototype an implementation to evaluate your approach Could be a real system, simulation and/or

More information

Private cloud computing advances

Private cloud computing advances Building robust private cloud services infrastructures By Brian Gautreau and Gong Wang Private clouds optimize utilization and management of IT resources to heighten availability. Microsoft Private Cloud

More information

SUSE Cloud 2.0. Pete Chadwick. Douglas Jarvis. Senior Product Manager pchadwick@suse.com. Product Marketing Manager djarvis@suse.

SUSE Cloud 2.0. Pete Chadwick. Douglas Jarvis. Senior Product Manager pchadwick@suse.com. Product Marketing Manager djarvis@suse. SUSE Cloud 2.0 Pete Chadwick Douglas Jarvis Senior Product Manager pchadwick@suse.com Product Marketing Manager djarvis@suse.com SUSE Cloud SUSE Cloud is an open source software solution based on OpenStack

More information

Solution for private cloud computing

Solution for private cloud computing The CC1 system Solution for private cloud computing 1 Outline What is CC1? Features Technical details Use cases By scientist By HEP experiment System requirements and installation How to get it? 2 What

More information

Microsoft Private Cloud Fast Track

Microsoft Private Cloud Fast Track Microsoft Private Cloud Fast Track Microsoft Private Cloud Fast Track is a reference architecture designed to help build private clouds by combining Microsoft software with Nutanix technology to decrease

More information

Visualization @ SUN. Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems

Visualization @ SUN. Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems Visualization @ SUN Shared Visualization 1.1 Software Scalable Visualization 1.1 Solutions Linda Fellingham, Ph. D Manager, Visualization and Graphics Sun Microsystems The Data Tsunami Visualization is

More information

Building Success on Acquia Cloud:

Building Success on Acquia Cloud: Building Success on Acquia Cloud: 10 Layers of PaaS TECHNICAL Guide Table of Contents Executive Summary.... 3 Introducing the 10 Layers of PaaS... 4 The Foundation: Five Layers of PaaS Infrastructure...

More information

CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS. Review Business and Technology Series www.cumulux.com

CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS. Review Business and Technology Series www.cumulux.com ` CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS Review Business and Technology Series www.cumulux.com Table of Contents Cloud Computing Model...2 Impact on IT Management and

More information

Assignment # 1 (Cloud Computing Security)

Assignment # 1 (Cloud Computing Security) Assignment # 1 (Cloud Computing Security) Group Members: Abdullah Abid Zeeshan Qaiser M. Umar Hayat Table of Contents Windows Azure Introduction... 4 Windows Azure Services... 4 1. Compute... 4 a) Virtual

More information

Simplifying Big Data Deployments in Cloud Environments with Mellanox Interconnects and QualiSystems Orchestration Solutions

Simplifying Big Data Deployments in Cloud Environments with Mellanox Interconnects and QualiSystems Orchestration Solutions Simplifying Big Data Deployments in Cloud Environments with Mellanox Interconnects and QualiSystems Orchestration Solutions 64% of organizations were investing or planning to invest on Big Data technology

More information

IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures

IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Introduction

More information

Comparison of Open Source Cloud System for Small and Medium Sized Enterprises

Comparison of Open Source Cloud System for Small and Medium Sized Enterprises , pp.276-282 http://dx.doi.org/10.14257/astl.2014.51.63 Comparison of Open Source Cloud System for Small and Medium Sized Enterprises Yasuo Uchida 1, Seigo Matsuno 1, Makoto Sakamoto 2 1 Ube National College

More information

OpenNebula Cloud Case Studies

OpenNebula Cloud Case Studies ISC Cloud 2010 Frankfurt, Germany October 29th, 2010 OpenNebula Cloud Case Studies Ignacio M. Llorente DSA-Research.org Distributed Systems Architecture Research Group Universidad Complutense de Madrid

More information

Network performance in virtual infrastructures

Network performance in virtual infrastructures Network performance in virtual infrastructures A closer look at Amazon EC2 Alexandru-Dorin GIURGIU University of Amsterdam System and Network Engineering Master 03 February 2010 Coordinators: Paola Grosso

More information

Managing the Real Cost of On-Demand Enterprise Cloud Services with Chargeback Models

Managing the Real Cost of On-Demand Enterprise Cloud Services with Chargeback Models Managing the Real Cost of On-Demand Enterprise Cloud Services with Chargeback Models A Guide to Cloud Computing Costs, Server Costs, Pricing Plans, and Chargeback Implementation and Systems Introduction

More information

RemoteApp Publishing on AWS

RemoteApp Publishing on AWS RemoteApp Publishing on AWS WWW.CORPINFO.COM Kevin Epstein & Stephen Garden Santa Monica, California November 2014 TABLE OF CONTENTS TABLE OF CONTENTS... 2 ABSTRACT... 3 INTRODUCTION... 3 WHAT WE LL COVER...

More information

Scaling up to Production

Scaling up to Production 1 Scaling up to Production Overview Productionize then Scale Building Production Systems Scaling Production Systems Use Case: Scaling a Production Galaxy Instance Infrastructure Advice 2 PRODUCTIONIZE

More information

Public cloud services for the Greek research and academic community

Public cloud services for the Greek research and academic community Public cloud services for the Greek research and academic community The ~okeanos IaaS Cloud Vangelis Floros SUCRE Workshop, 16-17 Apr 2013, Poznan GRNET is... The Greek research and technology network

More information

Enabling Technologies for Cloud Computing

Enabling Technologies for Cloud Computing 3th June 2010 1 st European Summit on the Future Internet Luxembourg Next Generation Data Center Summit Enabling Technologies for Cloud Computing Distributed Systems Architecture Research Group Universidad

More information

Agenda. Begining Research Project. Our problems. λ The End is not near...

Agenda. Begining Research Project. Our problems. λ The End is not near... About me... Davor Guttierrez Company 3 Gen d.o.o. 33 employes Located in Ljubljana - Slovenia IBM Mainframe, Virtualization (RHEL, OracleVM, ) Oracle Application Servers Oracle Databases Jboss, Weblogic,

More information

Study of virtual data centers for cost savings and management

Study of virtual data centers for cost savings and management 1 Study of virtual data centers for cost savings and management María Virtudes López López School of Industrial Engineering and Information Technology Master s Degree in Cybernetics Research León, Spain

More information

Manjrasoft Market Oriented Cloud Computing Platform

Manjrasoft Market Oriented Cloud Computing Platform Manjrasoft Market Oriented Cloud Computing Platform Aneka Aneka is a market oriented Cloud development and management platform with rapid application development and workload distribution capabilities.

More information

Auto-Scaling Model for Cloud Computing System

Auto-Scaling Model for Cloud Computing System Auto-Scaling Model for Cloud Computing System Che-Lun Hung 1*, Yu-Chen Hu 2 and Kuan-Ching Li 3 1 Dept. of Computer Science & Communication Engineering, Providence University 2 Dept. of Computer Science

More information

Performance measurement of a private Cloud in the OpenCirrus Testbed

Performance measurement of a private Cloud in the OpenCirrus Testbed Performance measurement of a private Cloud in the OpenCirrus Testbed 4th Workshop on Virtualization in High-Performance Cloud Computing (VHPC '09) Euro-Par 2009 Delft August 25th 2009 Christian Baun KIT

More information

White Paper on CLOUD COMPUTING

White Paper on CLOUD COMPUTING White Paper on CLOUD COMPUTING INDEX 1. Introduction 2. Features of Cloud Computing 3. Benefits of Cloud computing 4. Service models of Cloud Computing 5. Deployment models of Cloud Computing 6. Examples

More information

IS PRIVATE CLOUD A UNICORN?

IS PRIVATE CLOUD A UNICORN? IS PRIVATE CLOUD A UNICORN? With all of the discussion, adoption, and expansion of cloud offerings there is a constant debate that continues to rear its head: Public vs. Private or more bluntly Is there

More information

Pivot3 Desktop Virtualization Appliances. vstac VDI Technology Overview

Pivot3 Desktop Virtualization Appliances. vstac VDI Technology Overview Pivot3 Desktop Virtualization Appliances vstac VDI Technology Overview February 2012 Pivot3 Desktop Virtualization Technology Overview Table of Contents Executive Summary... 3 The Pivot3 VDI Appliance...

More information

Introduction to Engineering Using Robotics Experiments Lecture 18 Cloud Computing

Introduction to Engineering Using Robotics Experiments Lecture 18 Cloud Computing Introduction to Engineering Using Robotics Experiments Lecture 18 Cloud Computing Yinong Chen 2 Big Data Big Data Technologies Cloud Computing Service and Web-Based Computing Applications Industry Control

More information

for my computation? Stefano Cozzini Which infrastructure Which infrastructure Democrito and SISSA/eLAB - Trieste

for my computation? Stefano Cozzini Which infrastructure Which infrastructure Democrito and SISSA/eLAB - Trieste Which infrastructure Which infrastructure for my computation? Stefano Cozzini Democrito and SISSA/eLAB - Trieste Agenda Introduction:! E-infrastructure and computing infrastructures! What is available

More information

A Very Brief Introduction To Cloud Computing. Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman

A Very Brief Introduction To Cloud Computing. Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman A Very Brief Introduction To Cloud Computing Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman What is The Cloud Cloud computing refers to logical computational resources accessible via a computer

More information