CSC Yearly Team Meeting 2013 Edition. vendredi 18 octobre 13

Similar documents
CSC Yearly Team Meeting

A Holistic Model of the Energy-Efficiency of Hypervisors

Performance Evaluation of the XDEM framework on the OpenStack Cloud Computing Middleware

Transforming the UL into a Big Data University. Current status and planned evolutions

A Holistic Model of the Performance and the Energy-Efficiency of Hypervisors in an HPC Environment

Infrastructure as a Service (IaaS)

Two-Level Cooperation in Autonomic Cloud Resource Management

Integration of Virtualized Workernodes in Batch Queueing Systems The ViBatch Concept

An Experimental Study of Load Balancing of OpenNebula Open-Source Cloud Computing Platform

The Green Index: A Metric for Evaluating System-Wide Energy Efficiency in HPC Systems

Cloud Computing through Virtualization and HPC technologies

Elastic VM for Rapid and Optimum Virtualized

SierraVMI Sizing Guide

OpenNebula Leading Innovation in Cloud Computing Management

Key words: cloud computing, cluster computing, virtualization, hypervisor, performance evaluation

CoolEmAll - Tools for realising an energy efficient data centre

PES. Batch virtualization and Cloud computing. Part 1: Batch virtualization. Batch virtualization and Cloud computing

SURFsara HPC Cloud Workshop

IOS110. Virtualization 5/27/2014 1

OpenNebula An Innovative Open Source Toolkit for Building Cloud Solutions

GUEST OPERATING SYSTEM BASED PERFORMANCE COMPARISON OF VMWARE AND XEN HYPERVISOR

Secure Private Cloud Architecture for Mobile Infrastructure as a Service

SR-IOV In High Performance Computing

Introduction to Cloud Computing

Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases

Getting Started Hacking on OpenNebula

GTC Presentation March 19, Copyright 2012 Penguin Computing, Inc. All rights reserved

How To Compare Amazon Ec2 To A Supercomputer For Scientific Applications

Sistemi Operativi e Reti. Cloud Computing

Solution for private cloud computing

Elastic Management of Cluster based Services in the Cloud

An Energy-aware Multi-start Local Search Metaheuristic for Scheduling VMs within the OpenNebula Cloud Distribution

How To Build A Cloud Stack For A University Project

Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed

VON/K: A Fast Virtual Overlay Network Embedded in KVM Hypervisor for High Performance Computing

Program Grid and HPC5+ workshop

Fusion Service Schedule Virtual Data Centre ( VDC ) Version FUS-VDC-7.1

Eucalyptus: An Open-source Infrastructure for Cloud Computing. Rich Wolski Eucalyptus Systems Inc.

Basics of Virtualisation

Solution for private cloud computing

Intro to Virtualization

The OpenNebula Standard-based Open -source Toolkit to Build Cloud Infrastructures

Eucalyptus: An Open-source Infrastructure for Cloud Computing. Rich Wolski Eucalyptus Systems Inc.

Life sciences big data e-infrastructure concepts

Building a Top500-class Supercomputing Cluster at LNS-BUAP

SURFsara HPC Cloud Workshop

International Symposium on Grid Computing 2009 April 23th, Academia Sinica, Taipei, Taiwan

Workshop on Parallel and Distributed Scientific and Engineering Computing, Shanghai, 25 May 2012

Virtual Machines.

Comparing Open Source Private Cloud (IaaS) Platforms

Virtualization Infrastructure at Karlsruhe

HPC Cloud Computing with OpenNebula

Auto-Scaling Model for Cloud Computing System

Enabling Technologies for Distributed Computing

Cloud and Virtualization to Support Grid Infrastructures

Masters Project Proposal

Introducing EEMBC Cloud and Big Data Server Benchmarks

AMD SEAMICRO OPENSTACK BLUEPRINTS CLOUD- IN- A- BOX OCTOBER 2013

HPC and Big Data. EPCC The University of Edinburgh. Adrian Jackson Technical Architect

Experimental Investigation Decentralized IaaS Cloud Architecture Open Stack with CDT

CRIBI. Calcolo Scientifico e Bioinformatica oggi Università di Padova 13 gennaio 2012

Heterogeneous Workload Consolidation for Efficient Management of Data Centers in Cloud Computing

Automating Big Data Benchmarking for Different Architectures with ALOJA

Integration of Cloud Computing and Cloud Storage

Cloud Computing. Alex Crawford Ben Johnstone

Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes. Anthony Kenisky, VP of North America Sales

Comparing Ganeti to other Private Cloud Platforms. Lance Albertson

Scientific Computing Data Management Visions

RUNNING vtvax FOR WINDOWS

Virtual Machine Management with OpenNebula in the RESERVOIR project

Efficient Load Balancing using VM Migration by QEMU-KVM

Intel Cloud Builder Guide to Cloud Design and Deployment on Intel Platforms

Enabling Technologies for Distributed and Cloud Computing

Emerging Technology for the Next Decade

International Journal of Computer & Organization Trends Volume20 Number1 May 2015

Efficient Cloud Management for Parallel Data Processing In Private Cloud

System Models for Distributed and Cloud Computing

Cloud Computing PES. (and virtualization at CERN) Cloud Computing. GridKa School 2011, Karlsruhe. Disclaimer: largely personal view of things

Data Centers and Cloud Computing

Fabien Hermenier. 2bis rue Bon Secours Nantes.

RED HAT ENTERPRISE VIRTUALIZATION & CLOUD COMPUTING

Denis Caromel, CEO Ac.veEon. Orchestrate and Accelerate Applica.ons. Open Source Cloud Solu.ons Hybrid Cloud: Private with Burst Capacity

Performance Evaluation of Private Clouds Eucalyptus versus CloudStack

FIA Athens 2014 ~OKEANOS: A LARGE EUROPEAN PUBLIC CLOUD BASED ON SYNNEFO. VANGELIS KOUKIS, TECHNICAL LEAD, ~OKEANOS

Cloud on TEIN Part I: OpenStack Cloud Deployment. Vasinee Siripoonya Electronic Government Agency of Thailand Kasidit Chanchio Thammasat University

Integration of Virtualized Worker Nodes in Standard-Batch-Systems CHEP 2009 Prague Oliver Oberst

Data Mining with Hadoop at TACC

Networks and/in data centers! Dr. Paola Grosso! System and Network Engineering (SNE) research group! UvA!

Making a Smooth Transition to a Hybrid Cloud with Microsoft Cloud OS

The OpenNebula Cloud Platform for Data Center Virtualization

Migration of Virtual Machines for Better Performance in Cloud Computing Environment

Full and Para Virtualization

Dynamic Extension of a Virtualized Cluster by using Cloud Resources CHEP 2012

Boas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, IBM Corporation

Sun in HPC. Update for IDC HPC User Forum Tucson, AZ, Sept 2008

Cloud Computing mit mathematischen Anwendungen

Current Status of FEFS for the K computer

Google. Iustin Pop, <iustin@google.com> Google Switzerland. Sponsored by:

Intel Cloud Builder Guide to Cloud Design and Deployment on Intel Xeon Processor-based Platforms

Beyond the Hypervisor

Transcription:

CSC Yearly Team Meeting 2013 Edition October 18th, 2013 Dr. Sébastien Varrette

Short CV 33 years old, married (2004), 2 children (Adrien 2007, Chloé 2010) 2003: Computer Science Master s degrees Telecom department ENSIMAG, Grenoble, France Cryptology, Security and Information Coding, UJF/INPG, Grenoble, France 2007: Joint PhD in computer science (UL/INPG) Security in Large Scale Distributed Systems: Authentication and Result Checking. Supervision: J.-L. Roch (INPG) / F. Leprévost (UL) In Teambouvry since 2007 (permanent position) Research associate UL HPC Manager with Pascal Supervision: [PhD.] Ben, Jakub [HPC sysadmins: me, Hya & Fotis] [Student Assistant] Valentin 2

System Administration Gforge http://gforge.uni.lu 256 hosted projects 340 registered users Collaboration tool svn, git, www Etherpad, Jabber, StackEdit http://im.csc.uni.lu http://hpc.uni.lu/stackedit Server/VMs managed 132 servers (107 VMs) 291 computing nodes 3

UL HPC Platform http://hpc.uni.lu No more Chuck Norris facts... 4

UL HPC Platform http://hpc.uni.lu 2 geographical sites 3 admins 4 clusters: 291 nodes, 2944 cores (27.36 TFlops) 1042 TB (raw storage, incl. backup) NFS + Lustre > 4M Hardware investment so far Open-Source software stack Debian, SSH, OpenLDAP, Puppet, FAI... 5

UL HPC Platform http://hpc.uni.lu 6

UL HPC Platform: 2013 achievements Continuous acquisition/integration of new HW/services servers, storage, nodes, interconnect (IB/10GbE)... XCS portal / Visualization nodes (remote direct 3D rendering) Research/Evaluation of cutting-edge HPC HW ARM-based high density [un]stable enclosures [EE-LSDS 13] M. Jarus, S. Varrette, A. Oleksiak, and P. Bouvry. Performance Evaluation and Energy Efficiency of High-Density HPC Platforms Based on Intel, AMD and ARM Processors. In Proc. of the Intl. Conf. on Energy Efficiency in Large Scale Distributed Systems (EE-LSDS 13), volume 8046 of LNCS, Vienna, Austria, Apr 2013. [CGC 13] [Poster] V. Delplace, P. Manneback, F. Pinel, S. Varrette and P. Bouvry. 0.1 Comparing the Performance and Power Usage of GPU and ARM Clusters for Map- 0.01 Reduce. In CGC 13. Karlsruhe, Oct. 2013 PpW LOGSCALE 100000 10000 1000 100 10 1 Intel Core i7 AMD G T40N Atom N2600 Intel Xeon E7 ARM Cortex A9 OSU Lat. OSU Bw. HPL HPL Full CoreMark Fhourstones Whetstones Linpack Green Graph500 entry (14th) [credits: Xav] http://green.graph500.org/lists.php 7

Research: IT Security [with Ben] Nature-inspired Source Code obfuscation shadobf: MOEA PIPS-based C obfuscator jshadobf: MOEA PIPS-based JavaScript obfuscator [NSS 13] B. Bertholon, S. Varrette, and P. Bouvry. JShadObf: A JavaScript Obfuscator based on Multi-objective Optimization Algorithms. In Proc. of the IEEE Intl. Conf. on Network and System Security (NSS 2013), volume 7873 of LNCS, pages 336 349, Madrid, Spain, June 2013. Springer Verlag. [NIDISC 13] B. Bertholon, S. Varrette, and S. Martinez. ShadObf: A C-source Obfuscator based on Multi-objective Optimization Algorithms. In Proc. of the 16th Intl. Workshop on Nature Inspired Distributed Computing (NIDISC 2013), part of the 27th IEEE/ACM Intl. Parallel and Distributed Processing Symposium (IPDPS 2013), Boston (Massachusetts), USA, May 20 24 2013. [COMPAS 13] S. Martinez, S. Varrette, and B. Bertholon. Optimisation d obfuscation de code source au moyen d algorithmes évolutionnaires multi-objectifs. [Poster] - ComPAS 13, Jan 2013. TPM-based protection of IaaS platforms cf TSI 12 and CLOUD 11 Incoming: FNR Proof-of-Concept Grant 8

Research: IT Security [with Jakub, Juan-Lu] Follow up on cheater impact... Without cheaters ;) Convergence analysis of peas over Small-World networks Started as a collaboration with Juan-Lu Extension in progress... - With cheaters and counter-measures [CEC 13] J. Muszynski, S. Varrette, and P. Bouvry. Expected Running Time of Parallel Evolutionary Algorithms on Unimodal Pseudo-Boolean Functions over Small-World Networks. In Proc. of the IEEE Congress on Evolutionary Computation (CEC 2013), Cancu ń, Mexico, June 2013 9

Research: Perf./Energy-Eff. of HPC systems Overhead of Virtualization Layer on HPC Workloads Q: does HPC workloads suits Cloud? Evaluation on Xen, KVM and VMware Hypervisors. [with Valentin,Mateusz,Xav] Benchmarks: HPL, HPCC, Graph500, Bonnie++, IOZone... Validation on Grid 5000 [SBAC-PAD 13] S. Varrette, M. Guzek, V. Plugaru, X. Besseron, and P. Bouvry. HPC Performance and Energy-Efficiency of Xen, KVM and VMware Hypervisors. In Proc. of the 25th Symposium on Computer Architecture and High Performance Computing (SBAC-PAD 2013), Porto de Galinhas, Brazil, Oct. 2013. [EE-LSDS 13] M. Guzek, S. Varrette, V. Plugaru, J. E. Sanchez, and P. Bouvry. A Holistic Model of the Performance and the Energy- Efficiency of Hypervisors in an HPC Environment. In Proc. of the Intl. Conf. on Energy Efficiency in Large Scale Distributed Systems (EE- LSDS 13), volume 8046 of LNCS, Vienna, Austria, Apr 2013. Hardware approaches: cf. ARM evaluation [with Fred] MAS for Energy-efficient computing [with Greg, Mateusz, Xav] Software approach to build greener code 10

Conclusion Incoming events ACIIDS 14 (April 2014, Bangkok) Session EAs for Cloud Computing Systems NIDISC 14 (May 2014, Phoenix) Nature Inspired Distributed Computing META 14 (Oct 2014, Marrakech) Session Metaheuristics and cloud computing Incoming AFR Postdoc Joseph Emeras RJMS / HPC workload analysis Decision in Dec. 2013, Starting date: march 2013. 11