Évaluer et diminuer la consommation d énergie des applications scientifiques : quelles possibilités?
|
|
- Diane Conley
- 8 years ago
- Views:
Transcription
1 Évaluer et diminuer la consommation d énergie des applications scientifiques : quelles possibilités? Jean-Marc Pierson Equipe SEPIA IRIT Institut de Recherche en Informatique de Toulouse UPS UniversitéToulouse 3 Paul Sabatier Journées SUCCESS - 13 Novembre 2013 pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 1 / : 30que
2 Outline 1 CloudMIP 2 Context 3 Power consumption on CloudMIP 4 Introduction Motivation 5 HPC Applications Characterization 6 HPC Applications Phases Results analysis: processor s only optimization Results analysis: processor, disk and network optimization 7 Energy Consumption Tools State of the art Energy Consumption Library: eclib Data Monitoring Tool: ectop 8 Words to take home pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 2 / : 30que
3 Facts, resources: Funded by France Grilles, installed in Who : Pr Jean-Marc Pierson (manager), Dr François Thiebolt (system), DTSI Network team, Where : hosted at the Paul Sabatier University s Data Center (along with Grid5000-Toulouse and GridMIP platforms), Fluids consumption annual cost (est.) : between 4keuros and 10keuros. Hardware, OS: 2 x Dell M1000e chassis each filled with 16 blades. 256 physical cores, 1TB RAM, 15To Disk System : Scientific Linux 6.4 x86_64, VM provisioning system : OpenNebula 4.2 with KVM hypervisor, Monitoring : Zabbix ( combines Nagios and Ganglia capabilities. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 3 / : 30que
4 More details The front-end node : The monitoring system : cloudmip.univ-tlse3.fr/zabbix 32 blades (8 2.4Ghz, 32GB ram, 2 x 146GB SAS 15ktpm RAID0), means up to 256 Amazon EC2 M1 instance (1 physical dedicated CPU and 4GB ram) OpenNebula 4.2 (KVM) with Qcow2 delta images to speedup deployment (a hundred of VMs in just a few seconds) 1s resolution power and thermal monitoring of each node (Zabbix), A 24TB, 700MB/s NFS server shared with Grid5000 and GridMIP, Ways for the users to gain access to their VMs from the Internet : ssh, vpn, spice display forwarding, 1000 ports on the front-end node dedicated to routing, 60 dedicated public IPs with dynamic routing. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 4 / : 30que
5 Global picture (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 5 / : 30que
6 Green IT ICT consumes a lot : Estimated to 4-5% of global consumption of electricity (930 TWh per year) Annual growth between 5 to 10% Data Centers themselves account for 2% of the global electrical consumption Reminder: 1 nuclear reactor is producing about 900 MWe. (7 TWh per year) pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 6 / : 30que
7 What is it all about? UNIVAC I (UNIVersal Automatic Computer) machine in the 1950 s was consuming 125 kw for 1905 operations per second. Tianhe-2 machine: 33.8 Petaflops at a cost of kw. (1898 Mflops / Watt). The Greenest supercomputer (Green500 list): 3208 Mflops / watt (installed at CINECA, Eurora, funded by PRACE 2) pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 7 / : 30que
8 Power consumption on CloudMIP 248 VM started: > onetemplate instantiate SL64 -m 248 Leads to 8 VMs on each of the nodes pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 8 / : 30que
9 Stress: > pdsh -w wn[1..32] openssl speed -multi 8 Power consumption is 6.6kw pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 9 / : 30que
10 Introduction Motivation Why measuring, monitoring, estimating power consumed by applications? (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 10 / : 30que
11 Introduction Motivation Why measuring, monitoring, estimating power consumed by applications? 1 Make applications users energy-aware CO2 labels. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 10 / : 30que
12 Introduction Motivation Why measuring, monitoring, estimating power consumed by applications? 1 Make applications users energy-aware CO2 labels. 2 Make applications developers energy aware applications become energy-friendly pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 10 / : 30que
13 Introduction Motivation Why measuring, monitoring, estimating power consumed by applications? 1 Make applications users energy-aware CO2 labels. 2 Make applications developers energy aware applications become energy-friendly 3 Make the operating system energy-friendly: the OS can optimize its behavior according to the profiles of applications pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 10 / : 30que
14 Introduction Motivation Why measuring, monitoring, estimating power consumed by applications? 1 Make applications users energy-aware CO2 labels. 2 Make applications developers energy aware applications become energy-friendly 3 Make the operating system energy-friendly: the OS can optimize its behavior according to the profiles of applications 4 Make the middleware energy-aware and energy-friendly: energy-aware: it can redistribute costs to individual users (e.g. in commercial Clouds) energy-friendly: it can optimize dynamically the placement and scheduling of applications on machines pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 10 / : 30que
15 Introduction Motivation Power consumption on a node is application dependent. And applications are time dependent. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 11 / : 30que
16 Introduction Motivation Power consumption on a node is application dependent. And applications are time dependent. 1 Resource Management of servers Workload classes highly differ (services, Clouds, HPC,...) Workload differ over time-periods (burst, night-and-day, batch,...) App Monitor App Profiler Near-optimal Resource Manager Energy Efficiency pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 11 / : 30que
17 Introduction Motivation Power consumption on a node is application dependent. And applications are time dependent. 1 Resource Management of servers Workload classes highly differ (services, Clouds, HPC,...) Workload differ over time-periods (burst, night-and-day, batch,...) App Monitor App Profiler Near-optimal Resource Manager Energy Efficiency 2 Software development Power consumption of a same functionality varies according to Libraries Coding patterns Compilers Computer Architecture pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 11 / : 30que
18 Existing Approaches to Energy Consumption Estimation Three possibilities for evaluating energy of an application Monitor the power with (internal or external) power meters, then distribute shares to each process / application based on their resources consumption (CPU, memory, disk, network,...) ; Monitor the usage of resources at the hardware and operating system level (e.g. hardware performance counters, CPU load,...), then use mathematical models to estimate power consumption share for each process / application ; Instrument the code of the application, then relate it to actual measures or modeled estimates. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 12 / : 30que
19 The Energy Consumption Tools Pack 3 Energy consumption library (libec) Power sensors and estimators Core library used in ectools Data Acquisition tool (ecdaq) Collect data during benchmark execution Create new power estimators Data Monitoring tool (ectop/ganglia plugin) 1 Lightweight monitor of power estimators and sensors Monitor power consumption of application Compare power estimators in any environment Energy profiler (valgreen) 2 Software development 1 Cupertino, L. F., Da Costa, G., Sayah, A., and Pierson, J.-M. Energy Consumption Library. In Energy Efficiency in Large Scale Distributed Systems (EE-LSDS 2013), April 2013, Springer LNCS 2 Cupertino, L. F., DaCosta, G., Sayah, A., and Pierson, J.-M. Valgreen: an Application Energy Profiler. SCSE March Available under GPL3 licence. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 13 / : 30que
20 Energy Consumption Library Application Power Estimators MinMax CPU Inverse CPU P pid = (P max P min ) P pid = P PM tpid cpu t cpu t pid cpu t cpu + t idl + P min PR t P pid = any formula combining software and hardware sensors library is easily extensible BUT in general, Power model should be auto-adaptive (parameterized statically, using heuristics or approached with machine learning), workload dependent, Power model: linear regression, neural networks, genetic programming pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 14 / : 30que
21 Data Monitoring Tool: ectop ectop command line tool (a-like top, and extensible), based on libec. It exists also in HTML format, with pan view, accumulated values,... Lightweight tool: 3 Kb of memory, 0.3% (unsorted columns) to 2% of CPU (when sorted/sum bar/html) Open source software. Deliverable 5.2 of the CoolEmAll project - October Leandro Fontoura-Cupertino Tested on RECS platform, Grid5000 and CloudMIP pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 15 / : 30que
22 Neural networks results High accuracy of the power estimation, compared to actual measurements with precise and reactive power meters. Power Model: Neural Network 115 Target Output Power (W) x 10 2 R = MAPE=0.49% Error (W) pierson@irit.fr (IRIT) 115 Output ~= 0.98*Target Target Évaluer et diminuer la consommation d énergie des applications scientifiques 16 / :30que
23 Power Sampling Frequency Experiment Power (W) Model ACPI Time (s) Figure: Comparison between ACPI power meter and the linear model The power model is reacting must faster than the ACPI power meter. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 17 / : 30que
24 Following the consumption of VMs VM are processes, hence we can follow their consumption. Example on CloudMIP 9 Power Monitoring of VMs running on the same PM Power (W) VM1 VM Time (s) pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 18 / : 30que
25 Compiler Optimization Experiment O0 O1 O2 O Energy (J) Squared matrix A size Figure: Energy dissipated to solve a linear system of equations using lapack pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 19 / : 30que
26 HPC Application characterization Knowing how much an application consumes is useful, knowing which application is better! and even better: application is not important, its behavior is! Two different apps can have the same energy profile System changes can have the same impact on them Run-time detection Behavioral pattern Extract information Fine grained : performance counters, system values Coarse grained : network, disk, power consumption Georges Da Costa, Jean-Marc Pierson. Characterizing applications from power consumption: A case study for HPC benchmarks. In: Int Conference on ICT as Key Technology for the Fight against Global Warming (ICT-GLOW 2011), Toulouse, Springer. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 20 / : 30que
27 Finding patterns, NPB example, CG 1.2e+08 1e+08 Number of bytes sent per second 8e+07 6e+07 4e+07 2e time (s) pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 21 / : 30que
28 Finding patterns, NPB example, FT 1.2e+08 1e+08 Number of bytes sent per second 8e+07 6e+07 4e+07 2e time (s) pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 22 / : 30que
29 Finding patterns, NPB example, SP 1.2e+08 1e+08 Number of bytes sent per second 8e+07 6e+07 4e+07 2e time (s) pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 23 / : 30que
30 NPB example of HPC Application characterization (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 24 / : 30que
31 Detecting phases in applications Define a DNA-like structure for an application (or the system) based on combination of letters describing the application runtime Each letter represents monitored values over a time interval : represented by an integer along with its duration. Example: Idle(17692,21)(12988,41)Idle E (Joules) ( ) or IS ( ) or EP Time (seconds) Figure: Dividing NAS benchmarks IS and EP ran successively into two regions using their power usage, performance counters and sensors Ghislain Landry Tsafack, Laurent Lefèvre, Jean-Marc Pierson, Patricia Stolf, Georges Da Costa. DNA-inspired Scheme for Building the Energy Profile of HPC Systems. In: E2DC Workshop, Energy 2012 Conference, Madrid, May 2012 pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 25 / : 30que
32 Deciding: Acting according to the phases detected With each phase we attribute a system state minimizing energy while keeping performances When an application run, we predict the phase and trigger the related leverages to reduce energy Experiments: 25 nodes cluster of Intel Xeon X3440 set up on Grid5000 Linux kernel runs on each node, where sensors are collected each second high computation level corresponds to 2.53Ghz in CPU frequency, medium and low to 2 GHz and 1.2GHz respectively network interconnect speed scaled between 1GB and 10MB active and sleep states for the disk Consider two real-life applications (100 processes) Advance Research Weather Research Forecasting (WRF-AWR) Molecular Dynamics Simulation (MDS) Ghislain Landry Tsafack, Laurent Lefèvre, Jean-Marc Pierson, Patricia Stolf, Georges Da Costa. Beyond CPU Frequency Scaling for a Fine-grained Energy Control of HPC Systems. In: SBAC-PAD Conference, New-York, October pierson@irit.fr 2012 (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 26 / : 30que
33 Results analysis: performance (energy and execution time) Comparison to Linux on-demand and performance governors In this experiment, only the CPU frequency is changed as a function of the phase. 100 % performance managed on-demand Normalized energy consumption 80 % 60 % 40 % 20 % Normalized execution time 100 % 80 % 60 % 40 % 20 % 0 % MDS WRF-ARW (a) Energy performance (b) Performance (execution time) Figure: Phase tracking and partial recognition guided CPU optimization results. 0 % MDS WRF-ARW pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 27 / : 30que
34 Energy performance: processor, disk and network In this experiment, CPU frequency is changed, network speed is adjusted, and disk is turn on/off as a function of the phase. 100 % performance managed on-demand 100 % Normalized energy consumption 80 % 60 % 40 % 20 % Normalized execution time 80 % 60 % 40 % 20 % 0 % MDS WRF-ARW (a) Energy performance 0 % MDS WRF-ARW (b) Performance (execution time) Figure: Phase tracking and partial recognition guided processor, disk and network interconnect optimization results: the chart shows average energy consumed by each application under different configurations. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 28 / : 30que
35 Words to take home Tools exist to provide feedback on power consumption of applications, with a good accuracy (< 5% error) These tools need to be accepted by developers for optimizing codes, choosing libraries,... They could be used by final users for choosing software suites (ecolabel). They can be used for autonomic actions on the system without users noticing it, also in the HPC world. pierson@irit.fr (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 29 / : 30que
36 Credits: Application Energy Profiling were done with Landry Tsafack, Georges Da Costa, Laurent Lefevre, Patricia Stolf Energy Consumption Tools Pack works were done with Leandro Fontoura Cupertino, Georges Da Costa, and Amal Sayah Questions? Jean-Marc Pierson (IRIT) Évaluer et diminuer la consommation d énergie des applications scientifiques 30 / :30que
Energy efficiency and Cloud Computing Works in SEPIA Team
Energy efficiency and Cloud Computing Works in SEPIA Team Jean-Marc Pierson SEPIA Team Distributed systems, Cloud, HPC IRIT Institut de Recherche en Informatique de Toulouse UPS UniversitéToulouse 3 Paul
More informationExploiting Performance Counters to Predict and Improve Energy Performance of HPC Systems
Exploiting Performance Counters to Predict and Improve Energy Performance of HPC Systems Ghislain Landry Tsafack Chetsa, Laurent Lefèvre, Jean-Marc Pierson, Patricia Stolf, Georges Da Costa To cite this
More informationA Holistic Model of the Energy-Efficiency of Hypervisors
A Holistic Model of the -Efficiency of Hypervisors in an HPC Environment Mateusz Guzek,Sebastien Varrette, Valentin Plugaru, Johnatan E. Pecero and Pascal Bouvry SnT & CSC, University of Luxembourg, Luxembourg
More informationHigh Performance Computing in CST STUDIO SUITE
High Performance Computing in CST STUDIO SUITE Felix Wolfheimer GPU Computing Performance Speedup 18 16 14 12 10 8 6 4 2 0 Promo offer for EUC participants: 25% discount for K40 cards Speedup of Solver
More informationEnabling Technologies for Distributed and Cloud Computing
Enabling Technologies for Distributed and Cloud Computing Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Multi-core CPUs and Multithreading
More informationWorkshop on Parallel and Distributed Scientific and Engineering Computing, Shanghai, 25 May 2012
Scientific Application Performance on HPC, Private and Public Cloud Resources: A Case Study Using Climate, Cardiac Model Codes and the NPB Benchmark Suite Peter Strazdins (Research School of Computer Science),
More informationEnabling Technologies for Distributed Computing
Enabling Technologies for Distributed Computing Dr. Sanjay P. Ahuja, Ph.D. Fidelity National Financial Distinguished Professor of CIS School of Computing, UNF Multi-core CPUs and Multithreading Technologies
More informationBuilding a Top500-class Supercomputing Cluster at LNS-BUAP
Building a Top500-class Supercomputing Cluster at LNS-BUAP Dr. José Luis Ricardo Chávez Dr. Humberto Salazar Ibargüen Dr. Enrique Varela Carlos Laboratorio Nacional de Supercómputo Benemérita Universidad
More informationCloud Computing through Virtualization and HPC technologies
Cloud Computing through Virtualization and HPC technologies William Lu, Ph.D. 1 Agenda Cloud Computing & HPC A Case of HPC Implementation Application Performance in VM Summary 2 Cloud Computing & HPC HPC
More informationbenchmarking Amazon EC2 for high-performance scientific computing
Edward Walker benchmarking Amazon EC2 for high-performance scientific computing Edward Walker is a Research Scientist with the Texas Advanced Computing Center at the University of Texas at Austin. He received
More informationSolution for private cloud computing
The CC1 system Solution for private cloud computing 1 Outline What is CC1? Features Technical details Use cases By scientist By HEP experiment System requirements and installation How to get it? 2 What
More informationPES. Batch virtualization and Cloud computing. Part 1: Batch virtualization. Batch virtualization and Cloud computing
Batch virtualization and Cloud computing Batch virtualization and Cloud computing Part 1: Batch virtualization Tony Cass, Sebastien Goasguen, Belmiro Moreira, Ewan Roche, Ulrich Schwickerath, Romain Wartel
More informationAn Energy-aware Multi-start Local Search Metaheuristic for Scheduling VMs within the OpenNebula Cloud Distribution
An Energy-aware Multi-start Local Search Metaheuristic for Scheduling VMs within the OpenNebula Cloud Distribution Y. Kessaci, N. Melab et E-G. Talbi Dolphin Project Team, Université Lille 1, LIFL-CNRS,
More informationSolution for private cloud computing
The CC1 system Solution for private cloud computing 1 Outline What is CC1? Features Technical details System requirements and installation How to get it? 2 What is CC1? The CC1 system is a complete solution
More informationSystem Requirements Table of contents
Table of contents 1 Introduction... 2 2 Knoa Agent... 2 2.1 System Requirements...2 2.2 Environment Requirements...4 3 Knoa Server Architecture...4 3.1 Knoa Server Components... 4 3.2 Server Hardware Setup...5
More informationDell Virtualization Solution for Microsoft SQL Server 2012 using PowerEdge R820
Dell Virtualization Solution for Microsoft SQL Server 2012 using PowerEdge R820 This white paper discusses the SQL server workload consolidation capabilities of Dell PowerEdge R820 using Virtualization.
More informationDynamic Resource allocation in Cloud
Dynamic Resource allocation in Cloud ABSTRACT: Cloud computing allows business customers to scale up and down their resource usage based on needs. Many of the touted gains in the cloud model come from
More informationPower Efficiency Comparison: Cisco UCS 5108 Blade Server Chassis and Dell PowerEdge M1000e Blade Enclosure
White Paper Power Efficiency Comparison: Cisco UCS 5108 Blade Server Chassis and Dell PowerEdge M1000e Blade Enclosure White Paper March 2014 2014 Cisco and/or its affiliates. All rights reserved. This
More informationPerformance Evaluation of Amazon EC2 for NASA HPC Applications!
National Aeronautics and Space Administration Performance Evaluation of Amazon EC2 for NASA HPC Applications! Piyush Mehrotra!! J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Lazanoff,! S. Saini, R. Biswas!
More informationKashif Iqbal - PhD Kashif.iqbal@ichec.ie
HPC/HTC vs. Cloud Benchmarking An empirical evalua.on of the performance and cost implica.ons Kashif Iqbal - PhD Kashif.iqbal@ichec.ie ICHEC, NUI Galway, Ireland With acknowledgment to Michele MicheloDo
More informationPOSIX and Object Distributed Storage Systems
1 POSIX and Object Distributed Storage Systems Performance Comparison Studies With Real-Life Scenarios in an Experimental Data Taking Context Leveraging OpenStack Swift & Ceph by Michael Poat, Dr. Jerome
More informationPower Efficiency Comparison: Cisco UCS 5108 Blade Server Chassis and IBM FlexSystem Enterprise Chassis
White Paper Power Efficiency Comparison: Cisco UCS 5108 Blade Server Chassis and IBM FlexSystem Enterprise Chassis White Paper March 2014 2014 Cisco and/or its affiliates. All rights reserved. This document
More informationSolve your IT energy crisis WITH An energy SMArT SoluTIon FroM Dell
Solve your IT energy crisis WITH AN ENERGY SMART SOLUTION FROM DELL overcome DATA center energy challenges IT managers share a common and pressing problem: how to reduce energy consumption and cost without
More informationEnvironments, Services and Network Management for Green Clouds
Environments, Services and Network Management for Green Clouds Carlos Becker Westphall Networks and Management Laboratory Federal University of Santa Catarina MARCH 3RD, REUNION ISLAND IARIA GLOBENET 2012
More informationCoolEmAll - Tools for realising an energy efficient data centre
CoolEmAll - Tools for realising an energy efficient data centre Wolfgang Christmann christmann informationstechnik + medien GmbH & Co. KG www.christmann.info 1 Outline CoolEmAll project RECS system towards
More informationIntro to Virtualization
Cloud@Ceid Seminars Intro to Virtualization Christos Alexakos Computer Engineer, MSc, PhD C. Sysadmin at Pattern Recognition Lab 1 st Seminar 19/3/2014 Contents What is virtualization How it works Hypervisor
More informationPerformance Analysis of a Numerical Weather Prediction Application in Microsoft Azure
Performance Analysis of a Numerical Weather Prediction Application in Microsoft Azure Emmanuell D Carreño, Eduardo Roloff, Jimmy V. Sanchez, and Philippe O. A. Navaux WSPPD 2015 - XIII Workshop de Processamento
More informationCloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms
CloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms Rodrigo N. Calheiros, Rajiv Ranjan, Anton Beloglazov, César A. F. De Rose,
More informationSelf-organization of applications and systems to optimize resources usage in virtualized data centers
Ecole des Mines de Nantes Self-organization of applications and systems to optimize resources usage in virtualized data centers Teratec 06/28 2012 Jean- Marc Menaud Ascola team EMNantes-INRIA, LINA Motivations
More informationCoolEmAll - Models and Tools for Optimization of Data Center Energy-efficiency
CoolEmAll - Models and Tools for Optimization of Data Center Energy-efficiency Micha vor dem Berge, Wolfgang Christmann Christmann Informationstechnik + Medien Ilsede, Germany Email: [Micha.vordemBerge,Wolfgang]@christmann.info
More informationHP reference configuration for entry-level SAS Grid Manager solutions
HP reference configuration for entry-level SAS Grid Manager solutions Up to 864 simultaneous SAS jobs and more than 3 GB/s I/O throughput Technical white paper Table of contents Executive summary... 2
More informationData center modeling, and energy efficient server management
Data center modeling, and energy efficient server management Satoshi Itoh National Institute of Advanced Industrial Science and Technology (AIST) 1 Contents Virtualization Energy-saving scenario Data Center
More informationSR-IOV: Performance Benefits for Virtualized Interconnects!
SR-IOV: Performance Benefits for Virtualized Interconnects! Glenn K. Lockwood! Mahidhar Tatineni! Rick Wagner!! July 15, XSEDE14, Atlanta! Background! High Performance Computing (HPC) reaching beyond traditional
More informationWhite Paper. Recording Server Virtualization
White Paper Recording Server Virtualization Prepared by: Mike Sherwood, Senior Solutions Engineer Milestone Systems 23 March 2011 Table of Contents Introduction... 3 Target audience and white paper purpose...
More informationPerformance Characteristics of VMFS and RDM VMware ESX Server 3.0.1
Performance Study Performance Characteristics of and RDM VMware ESX Server 3.0.1 VMware ESX Server offers three choices for managing disk access in a virtual machine VMware Virtual Machine File System
More informationElastic Management of Cluster based Services in the Cloud
First Workshop on Automated Control for Datacenters and Clouds (ACDC09) June 19th, Barcelona, Spain Elastic Management of Cluster based Services in the Cloud Rafael Moreno Vozmediano, Ruben S. Montero,
More informationIaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures
IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Introduction
More informationAgenda. HPC Software Stack. HPC Post-Processing Visualization. Case Study National Scientific Center. European HPC Benchmark Center Montpellier PSSC
HPC Architecture End to End Alexandre Chauvin Agenda HPC Software Stack Visualization National Scientific Center 2 Agenda HPC Software Stack Alexandre Chauvin Typical HPC Software Stack Externes LAN Typical
More informationData Sharing Options for Scientific Workflows on Amazon EC2
Data Sharing Options for Scientific Workflows on Amazon EC2 Gideon Juve, Ewa Deelman, Karan Vahi, Gaurang Mehta, Benjamin P. Berman, Bruce Berriman, Phil Maechling Francesco Allertsen Vrije Universiteit
More informationDELL. Virtual Desktop Infrastructure Study END-TO-END COMPUTING. Dell Enterprise Solutions Engineering
DELL Virtual Desktop Infrastructure Study END-TO-END COMPUTING Dell Enterprise Solutions Engineering 1 THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL
More informationIBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud
IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud February 25, 2014 1 Agenda v Mapping clients needs to cloud technologies v Addressing your pain
More informationSURFsara HPC Cloud Workshop
SURFsara HPC Cloud Workshop doc.hpccloud.surfsara.nl UvA workshop 2016-01-25 UvA HPC Course Jan 2016 Anatoli Danezi, Markus van Dijk cloud-support@surfsara.nl Agenda Introduction and Overview (current
More informationOGF25/EGEE User Forum Catania, Italy 2 March 2009
OGF25/EGEE User Forum Catania, Italy 2 March 2009 Constantino Vázquez Blanco Javier Fontán Muiños Raúl Sampedro Distributed Systems Architecture Research Group Universidad Complutense de Madrid 1/31 Outline
More informationDeploying Business Virtual Appliances on Open Source Cloud Computing
International Journal of Computer Science and Telecommunications [Volume 3, Issue 4, April 2012] 26 ISSN 2047-3338 Deploying Business Virtual Appliances on Open Source Cloud Computing Tran Van Lang 1 and
More informationCloud Management: Knowing is Half The Battle
Cloud Management: Knowing is Half The Battle Raouf BOUTABA David R. Cheriton School of Computer Science University of Waterloo Joint work with Qi Zhang, Faten Zhani (University of Waterloo) and Joseph
More informationA Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems
A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems Anton Beloglazov, Rajkumar Buyya, Young Choon Lee, and Albert Zomaya Present by Leping Wang 1/25/2012 Outline Background
More informationHPSA Agent Characterization
HPSA Agent Characterization Product HP Server Automation (SA) Functional Area Managed Server Agent Release 9.0 Page 1 HPSA Agent Characterization Quick Links High-Level Agent Characterization Summary...
More informationStACC: St Andrews Cloud Computing Co laboratory. A Performance Comparison of Clouds. Amazon EC2 and Ubuntu Enterprise Cloud
StACC: St Andrews Cloud Computing Co laboratory A Performance Comparison of Clouds Amazon EC2 and Ubuntu Enterprise Cloud Jonathan S Ward StACC (pronounced like 'stack') is a research collaboration launched
More informationTwo-Level Cooperation in Autonomic Cloud Resource Management
Two-Level Cooperation in Autonomic Cloud Resource Management Giang Son Tran, Laurent Broto, and Daniel Hagimont ENSEEIHT University of Toulouse, Toulouse, France Email: {giang.tran, laurent.broto, daniel.hagimont}@enseeiht.fr
More informationEnergy-Efficient Application-Aware Online Provisioning for Virtualized Clouds and Data Centers
Energy-Efficient Application-Aware Online Provisioning for Virtualized Clouds and Data Centers I. Rodero, J. Jaramillo, A. Quiroz, M. Parashar NSF Center for Autonomic Computing Rutgers, The State University
More informationWhite Paper on Consolidation Ratios for VDI implementations
White Paper on Consolidation Ratios for VDI implementations Executive Summary TecDem have produced this white paper on consolidation ratios to back up the return on investment calculations and savings
More informationMulticore Parallel Computing with OpenMP
Multicore Parallel Computing with OpenMP Tan Chee Chiang (SVU/Academic Computing, Computer Centre) 1. OpenMP Programming The death of OpenMP was anticipated when cluster systems rapidly replaced large
More informationEcole des Mines de Nantes. Journée Thématique Emergente "aspects énergétiques du calcul"
Ecole des Mines de Nantes Entropy Journée Thématique Emergente "aspects énergétiques du calcul" Fabien Hermenier, Adrien Lèbre, Jean Marc Menaud menaud@mines-nantes.fr Outline Motivation Entropy project
More informationLCMON Network Traffic Analysis
LCMON Network Traffic Analysis Adam Black Centre for Advanced Internet Architectures, Technical Report 79A Swinburne University of Technology Melbourne, Australia adamblack@swin.edu.au Abstract The Swinburne
More informationTowards Energy-efficient Cloud Computing
Towards Energy-efficient Cloud Computing Michael Maurer Distributed Systems Group TU Vienna, Austria maurer@infosys.tuwien.ac.at http://www.infosys.tuwien.ac.at/staff/maurer/ Distributed Systems Group
More informationAn Introduction to Virtualization and Cloud Technologies to Support Grid Computing
New Paradigms: Clouds, Virtualization and Co. EGEE08, Istanbul, September 25, 2008 An Introduction to Virtualization and Cloud Technologies to Support Grid Computing Distributed Systems Architecture Research
More informationDepartment of Computer Science Better than Native: Using Virtualization to Improve Compute Node Performance
Better than Native: Using Virtualization to Improve Compute Node Performance Brian Kocoloski Jack Lange Department of Computer Science University of Pittsburgh 6/29/2012 1 Linux is becoming the dominant
More informationMicrosoft Dynamics NAV 2013 R2 Sizing Guidelines for On-Premises Single Tenant Deployments
Microsoft Dynamics NAV 2013 R2 Sizing Guidelines for On-Premises Single Tenant Deployments July 2014 White Paper Page 1 Contents 3 Sizing Recommendations Summary 3 Workloads used in the tests 3 Transactional
More informationManaging Capacity Using VMware vcenter CapacityIQ TECHNICAL WHITE PAPER
Managing Capacity Using VMware vcenter CapacityIQ TECHNICAL WHITE PAPER Table of Contents Capacity Management Overview.... 3 CapacityIQ Information Collection.... 3 CapacityIQ Performance Metrics.... 4
More informationACANO SOLUTION VIRTUALIZED DEPLOYMENTS. White Paper. Simon Evans, Acano Chief Scientist
ACANO SOLUTION VIRTUALIZED DEPLOYMENTS White Paper Simon Evans, Acano Chief Scientist Updated April 2015 CONTENTS Introduction... 3 Host Requirements... 5 Sizing a VM... 6 Call Bridge VM... 7 Acano Edge
More information2010 Parallels. All Rights Reserved. 2
Delivering Extraordinary Density for Cloud Service Providers Parallels Shared Hosting NG Service Module and Intel Xeon 5500 Processor Series-Based Servers Abstract: The goal of this paper is to provide
More informationA Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources
A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources Davide Salomoni 1, Daniele Andreotti 1, Luca Cestari 2, Guido Potena 2, Peter Solagna 3 1 INFN-CNAF, Bologna, Italy 2 University
More informationNeptune. A Domain Specific Language for Deploying HPC Software on Cloud Platforms. Chris Bunch Navraj Chohan Chandra Krintz Khawaja Shams
Neptune A Domain Specific Language for Deploying HPC Software on Cloud Platforms Chris Bunch Navraj Chohan Chandra Krintz Khawaja Shams ScienceCloud 2011 @ San Jose, CA June 8, 2011 Cloud Computing Three
More informationDell Reference Configuration for Hortonworks Data Platform
Dell Reference Configuration for Hortonworks Data Platform A Quick Reference Configuration Guide Armando Acosta Hadoop Product Manager Dell Revolutionary Cloud and Big Data Group Kris Applegate Solution
More informationPower and Energy aware job scheduling techniques
Power and Energy aware job scheduling techniques Yiannis Georgiou R&D Software Architect 02-07-2015 Top500 HPC supercomputers 2 From Top500 November 2014 list IT Energy Consumption 3 http://www.greenpeace.org/international/global/international/publications/climate/2012/
More informationBuilding an energy proportional datacenter with an heterogeneous set of machines
Building an energy proportional datacenter with an heterogeneous set of machines Violaine V ILLEBONNET Laurent L EFEVRE Inria Avalon E NS Lyon Jean-Marc P IERSON, Georges D A C OSTA, Patricia S TOLF I
More informationTechnical Investigation of Computational Resource Interdependencies
Technical Investigation of Computational Resource Interdependencies By Lars-Eric Windhab Table of Contents 1. Introduction and Motivation... 2 2. Problem to be solved... 2 3. Discussion of design choices...
More informationCloud Computing. Alex Crawford Ben Johnstone
Cloud Computing Alex Crawford Ben Johnstone Overview What is cloud computing? Amazon EC2 Performance Conclusions What is the Cloud? A large cluster of machines o Economies of scale [1] Customers use a
More informationHeterogeneous Workload Consolidation for Efficient Management of Data Centers in Cloud Computing
Heterogeneous Workload Consolidation for Efficient Management of Data Centers in Cloud Computing Deep Mann ME (Software Engineering) Computer Science and Engineering Department Thapar University Patiala-147004
More informationCloud computing. Intelligent Services for Energy-Efficient Design and Life Cycle Simulation. as used by the ISES project
Intelligent Services for Energy-Efficient Design and Life Cycle Simulation Project number: 288819 Call identifier: FP7-ICT-2011-7 Project coordinator: Technische Universität Dresden, Germany Website: ises.eu-project.info
More informationInternational Journal of Computer & Organization Trends Volume20 Number1 May 2015
Performance Analysis of Various Guest Operating Systems on Ubuntu 14.04 Prof. (Dr.) Viabhakar Pathak 1, Pramod Kumar Ram 2 1 Computer Science and Engineering, Arya College of Engineering, Jaipur, India.
More informationAlphaTrust PRONTO - Hardware Requirements
AlphaTrust PRONTO - Hardware Requirements 1 / 9 Table of contents Server System and Hardware Requirements... 3 System Requirements for PRONTO Enterprise Platform Software... 5 System Requirements for Web
More informationAccelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software
WHITEPAPER Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software SanDisk ZetaScale software unlocks the full benefits of flash for In-Memory Compute and NoSQL applications
More informationVocera Voice 4.3 and 4.4 Server Sizing Matrix
Vocera Voice 4.3 and 4.4 Server Sizing Matrix Vocera Server Recommended Configuration Guidelines Maximum Simultaneous Users 450 5,000 Sites Single Site or Multiple Sites Requires Multiple Sites Entities
More informationPerformance characterization report for Microsoft Hyper-V R2 on HP StorageWorks P4500 SAN storage
Performance characterization report for Microsoft Hyper-V R2 on HP StorageWorks P4500 SAN storage Technical white paper Table of contents Executive summary... 2 Introduction... 2 Test methodology... 3
More informationAbstract: Motivation: Description of proposal:
Efficient power utilization of a cluster using scheduler queues Kalyana Chadalvada, Shivaraj Nidoni, Toby Sebastian HPCC, Global Solutions Engineering Bangalore Development Centre, DELL Inc. {kalyana_chadalavada;shivaraj_nidoni;toby_sebastian}@dell.com
More informationBoas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, 2015. 20014 IBM Corporation
Boas Betzler Cloud IBM Distinguished Computing Engineer for a Smarter Planet Globally Distributed IaaS Platform Examples AWS and SoftLayer November 9, 2015 20014 IBM Corporation Building Data Centers The
More informationHigh-Performance Nested Virtualization With Hitachi Logical Partitioning Feature
High-Performance Nested Virtualization With Hitachi Logical Partitioning Feature olutions Enabled by New Intel Virtualization Technology Extension in the Intel Xeon Processor E5 v3 Family By Hitachi Data
More informationCloud and Virtualization to Support Grid Infrastructures
ESAC GRID Workshop '08 ESAC, Villafranca del Castillo, Spain 11-12 December 2008 Cloud and Virtualization to Support Grid Infrastructures Distributed Systems Architecture Research Group Universidad Complutense
More informationPRIMERGY server-based High Performance Computing solutions
PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating
More informationGUEST OPERATING SYSTEM BASED PERFORMANCE COMPARISON OF VMWARE AND XEN HYPERVISOR
GUEST OPERATING SYSTEM BASED PERFORMANCE COMPARISON OF VMWARE AND XEN HYPERVISOR ANKIT KUMAR, SAVITA SHIWANI 1 M. Tech Scholar, Software Engineering, Suresh Gyan Vihar University, Rajasthan, India, Email:
More informationVM Management for Green Data Centres with the OpenNebula Virtual Infrastructure Engine
OGF-EU: Using IT to reduce Carbon Emissions and Delivering the Potential of Energy Efficient Computing OGF25, Catania, Italy 5 March 2009 VM Management for Green Data Centres with the OpenNebula Virtual
More informationwu.cloud: Insights Gained from Operating a Private Cloud System
wu.cloud: Insights Gained from Operating a Private Cloud System Stefan Theußl, Institute for Statistics and Mathematics WU Wirtschaftsuniversität Wien March 23, 2011 1 / 14 Introduction In statistics we
More informationVirtualised MikroTik
Virtualised MikroTik MikroTik in a Virtualised Hardware Environment Speaker: Tom Smyth CTO Wireless Connect Ltd. Event: MUM Krackow Feb 2008 http://wirelessconnect.eu/ Copyright 2008 1 Objectives Understand
More informationENERGY EFFICIENT VIRTUAL MACHINE ASSIGNMENT BASED ON ENERGY CONSUMPTION AND RESOURCE UTILIZATION IN CLOUD NETWORK
International Journal of Computer Engineering & Technology (IJCET) Volume 7, Issue 1, Jan-Feb 2016, pp. 45-53, Article ID: IJCET_07_01_006 Available online at http://www.iaeme.com/ijcet/issues.asp?jtype=ijcet&vtype=7&itype=1
More informationSURFsara HPC Cloud Workshop
SURFsara HPC Cloud Workshop www.cloud.sara.nl Tutorial 2014-06-11 UvA HPC and Big Data Course June 2014 Anatoli Danezi, Markus van Dijk cloud-support@surfsara.nl Agenda Introduction and Overview (current
More informationEnabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed
Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed Sébastien Badia, Alexandra Carpen-Amarie, Adrien Lèbre, Lucas Nussbaum Grid 5000 S. Badia, A. Carpen-Amarie, A. Lèbre, L. Nussbaum
More informationA Cloud WHERE PHYSICAL ARE TOGETHER AT LAST
A Cloud WHERE PHYSICAL AND VIRTUAL STORAGE ARE TOGETHER AT LAST Not all Cloud solutions are the same so how do you know which one is right for your business now and in the future? NTT Communications ICT
More informationFlauncher and DVMS Deploying and Scheduling Thousands of Virtual Machines on Hundreds of Nodes Distributed Geographically
Flauncher and Deploying and Scheduling Thousands of Virtual Machines on Hundreds of Nodes Distributed Geographically Daniel Balouek, Adrien Lèbre, Flavien Quesnel To cite this version: Daniel Balouek,
More informationJUROPA Linux Cluster An Overview. 19 May 2014 Ulrich Detert
Mitglied der Helmholtz-Gemeinschaft JUROPA Linux Cluster An Overview 19 May 2014 Ulrich Detert JuRoPA JuRoPA Jülich Research on Petaflop Architectures Bull, Sun, ParTec, Intel, Mellanox, Novell, FZJ JUROPA
More informationGenetic Algorithms for Energy Efficient Virtualized Data Centers
Genetic Algorithms for Energy Efficient Virtualized Data Centers 6th International DMTF Academic Alliance Workshop on Systems and Virtualization Management: Standards and the Cloud Helmut Hlavacs, Thomas
More informationEnergy-aware job scheduler for highperformance
Energy-aware job scheduler for highperformance computing 7.9.2011 Olli Mämmelä (VTT), Mikko Majanen (VTT), Robert Basmadjian (University of Passau), Hermann De Meer (University of Passau), André Giesler
More informationData Center Specific Thermal and Energy Saving Techniques
Data Center Specific Thermal and Energy Saving Techniques Tausif Muzaffar and Xiao Qin Department of Computer Science and Software Engineering Auburn University 1 Big Data 2 Data Centers In 2013, there
More informationWhen Does Colocation Become Competitive With The Public Cloud? WHITE PAPER SEPTEMBER 2014
When Does Colocation Become Competitive With The Public Cloud? WHITE PAPER SEPTEMBER 2014 Table of Contents Executive Summary... 2 Case Study: Amazon Ec2 Vs In-House Private Cloud... 3 Aim... 3 Participants...
More informationCluster Scalability of ANSYS FLUENT 12 for a Large Aerodynamics Case on the Darwin Supercomputer
Cluster Scalability of ANSYS FLUENT 12 for a Large Aerodynamics Case on the Darwin Supercomputer Stan Posey, MSc and Bill Loewe, PhD Panasas Inc., Fremont, CA, USA Paul Calleja, PhD University of Cambridge,
More informationThis is an author-deposited version published in : http://oatao.univ-toulouse.fr/ Eprints ID : 12902
Open Archive TOULOUSE Archive Ouverte (OATAO) OATAO is an open access repository that collects the work of Toulouse researchers and makes it freely available over the web where possible. This is an author-deposited
More informationScaling Objectivity Database Performance with Panasas Scale-Out NAS Storage
White Paper Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage A Benchmark Report August 211 Background Objectivity/DB uses a powerful distributed processing architecture to manage
More informationIntel Cloud Builders: Nightly Batch File
Cloud Builders: Nightly Batch File This is a blueprint for a Nightly Batch File process doing many large transactions of Extract/Transform/Load (ETL) data processing, based on a Enterprise Virtualization
More informationDatacenter Operating Systems
Datacenter Operating Systems CSE451 Simon Peter With thanks to Timothy Roscoe (ETH Zurich) Autumn 2015 This Lecture What s a datacenter Why datacenters Types of datacenters Hyperscale datacenters Major
More informationWhen Does Colocation Become Competitive With The Public Cloud?
When Does Colocation Become Competitive With The Public Cloud? PLEXXI WHITE PAPER Affinity Networking for Data Centers and Clouds Table of Contents EXECUTIVE SUMMARY... 2 CASE STUDY: AMAZON EC2 vs IN-HOUSE
More information