An Energy-Aware Design and Reporting Tool for On-Demand Service Infrastructures



Similar documents
Managing the Real Cost of On-Demand Enterprise Cloud Services with Chargeback Models

Performance Management for Cloudbased STC 2012

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2

CS 695 Topics in Virtualization and Cloud Computing. Introduction

Above the clouds: A Berkeley View of Cloud Computing

Auto-Scaling Model for Cloud Computing System

Cloud Computing. Chapter 8 Virtualization

Performance Management for Cloud-based Applications STC 2012

Cloud Management: Knowing is Half The Battle

Bernie Velivis President, Performax Inc

Datasheet Fujitsu Cloud Infrastructure Management Software V1

Topics. Images courtesy of Majd F. Sakr or from Wikipedia unless otherwise noted.

CloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms

7/15/2011. Monitoring and Managing VDI. Monitoring a VDI Deployment. Veeam Monitor. Veeam Monitor

Computer Science. About PaaS Security. Donghoon Kim Henry E. Schaffer Mladen A. Vouk

Energy: electricity, electric grids, nuclear, green... Transportation: roads, airplanes, helicopters, space exploration

An Oracle White Paper August Oracle VM 3: Application-Driven Virtualization

Cloud/SaaS enablement of existing applications

How To Create A Concurrent Cloud Computing System

Towards a New Model for the Infrastructure Grid

Best Practices on monitoring Solaris Global/Local Zones using IBM Tivoli Monitoring

A Cloud Test Bed for China Railway Enterprise Data Center

Capacity Planning 2.0

Stratusphere Solutions

Analysis on Virtualization Technologies in Cloud

Cloud and Virtualization to Support Grid Infrastructures

Two-Level Cooperation in Autonomic Cloud Resource Management

STeP-IN SUMMIT June 18 21, 2013 at Bangalore, INDIA. Performance Testing of an IAAS Cloud Software (A CloudStack Use Case)

Green Cloud Computing: Balancing and Minimization of Energy Consumption

An Energy-aware Multi-start Local Search Metaheuristic for Scheduling VMs within the OpenNebula Cloud Distribution

Paul Brebner, Senior Researcher, NICTA,

ASCETiC Whitepaper. Motivation. ASCETiC Toolbox Business Goals. Approach

Security and Billing for Azure Pack. Presented by 5nine Software and Cloud Cruiser

IOS110. Virtualization 5/27/2014 1

CHAPTER 8 CLOUD COMPUTING

CS 695 Topics in Virtualization and Cloud Computing and Storage Systems. Introduction

locuz.com A comprehensive orchestration tool for setting up private and hybrid clouds

Cloud Management Platform

Billing for OpenStack Cloud Services

Building and Managing

VMware vcloud Architecture Toolkit Public VMware vcloud Service Definition

Data Centers and Cloud Computing

Open Source Cloud Computing Management with OpenNebula

This presentation covers virtual application shared services supplied with IBM Workload Deployer version 3.1.

Resource Utilization of Middleware Components in Embedded Systems

New resource provision paradigms for Grid Infrastructures: Virtualization and Cloud

Service Oriented Platform

Data Center Specific Thermal and Energy Saving Techniques

Adatbázis tesztkörnyezetek kialakítása. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Networks and Services

GUIDELINE. on SERVER CONSOLIDATION and VIRTUALISATION. National Computer Board, 7th Floor Stratton Court, La Poudriere Street, Port Louis

Cloud Computing Architecture: A Survey

THROUGHPUTER. Parallel Program Development and Execution Platform as a Service

Multifaceted Resource Management for Dealing with Heterogeneous Workloads in Virtualized Data Centers

HP Virtualization Performance Viewer

Virtual Computing and VMWare. Module 4

Characterizing Task Usage Shapes in Google s Compute Clusters

Virtualization Technologies (ENCS 691K Chapter 3)

Sistemi Operativi e Reti. Cloud Computing

Defining and Improving IT Utilisation Efficiency through Holistic Data Centre Monitoring

IBM Spectrum Protect in the Cloud

Planning, Provisioning and Deploying Enterprise Clouds with Oracle Enterprise Manager 12c Kevin Patterson, Principal Sales Consultant, Enterprise

Virtualization and IaaS management

VDI Optimization Real World Learnings. Russ Fellows, Evaluator Group

Private Cloud for WebSphere Virtual Enterprise Application Hosting

Monitoring Cloud Applications. Amit Pathak

EMC IT AUTOMATES ENTERPRISE PLATFORM AS A SERVICE

GUEST OPERATING SYSTEM BASED PERFORMANCE COMPARISON OF VMWARE AND XEN HYPERVISOR

Big Data Management in the Clouds and HPC Systems

Dynamic Resource Management in Cloud Environment

Consolidated Technology Services PRIVATE CLOUD SERVICE. March 2014

Consumption IT. Michael Shepherd Business Development Manager. Cisco Public Sector May 1 st 2014

Capacity Estimation for Linux Workloads

The OpenNebula Standard-based Open -source Toolkit to Build Cloud Infrastructures

Running Oracle Databases in a z Systems Cloud environment

Oracle Solutions on Top of VMware vsphere 4. Saša Hederić VMware Adriatic

CLOUD COMPUTING. When It's smarter to rent than to buy

Virtualizing Exchange

Write a technical report Present your results Write a workshop/conference paper (optional) Could be a real system, simulation and/or theoretical

Manjrasoft Market Oriented Cloud Computing Platform

Private Cloud Database Consolidation with Exadata. Nitin Vengurlekar Technical Director/Cloud Evangelist

Commercial Software Licensing

The Green Cloud: How Cloud Computing Can Reduce Datacenter Power Consumption. Anne M. Holler Senior Staff Engineer, Resource Management Team, VMware

How To Manage Energy At An Energy Efficient Cost

Energy Management in a Cloud Computing Environment

Parallels Virtuozzo Containers

Realize the Full Potential of Virtualized Java Applications

Cloud Computing, Virtualization & Green IT

Dell Virtualization Solution for Microsoft SQL Server 2012 using PowerEdge R820

Microkernels, virtualization, exokernels. Tutorial 1 CSC469

Cloud Computing with Red Hat Solutions. Sivaram Shunmugam Red Hat Asia Pacific Pte Ltd.

Private Cloud Using Service Catalog

CloudCmp:Comparing Cloud Providers. Raja Abhinay Moparthi

Cloudscaling: The Power of Infrastructure as a Service. James O Neil First National Technology Solutions

Evaluation Methodology of Converged Cloud Environments

How To Understand The History Of Innovation In The United States

OW2 Meeting Towards Building a Cloud Platform for Service Oriented Software Development

Virtual Machine Monitors. Dr. Marc E. Fiuczynski Research Scholar Princeton University

OpenNebula An Innovative Open Source Toolkit for Building Cloud Solutions

A Brief Overview. Delivering Windows Azure Services on Windows Server. Enabling Service Providers

Transcription:

An Energy-Aware Design and Reporting Tool for On-Demand Service Infrastructures Miguel Gómez, David Perales and Emilio J. Torres E2GC2 Workshop. IEEE/ACM GRID 2009. Oct 13 th, 2009

Outline 01 Introduction and background - Problem statement - Main goals - State of the art in design and chargeback tools 02 Energy-aware infrastructure architecture composition 03 Service energy chargeback and runtime visualization 04 Wrap up 2

01 Problem statement Resource wasting in traditional infrastructures Many service architecture design decisions have a great impact in power consumption Infrastructure architecture Resource allocation Performance or availability requirements Users are seldom confronted with information on Resource utilization levels Energy-related impact of their architecture decisions Instant or periodic service power consumption Inefficient utilization of computing resources due to infrastructure user behavior Overperforming architectures Resource overprovisioning 3

01 Problem statement Resource wasting in cloud-oriented infrastructures Cloud infrastructure users reproduce the traditional behavior User/service power consumption is more difficult to single out Complete isolation from physical resources Systems are shared both concurrently and over time No incentives for energy-saving No energy-oriented infrastructure statistics No energy-related charges or discounts 4

01 Energy-aware design and reporting tools Main goals Energy-aware infrastructure architecture design tools Expose the energy impact of design decisions Show the influence of energy in operating expenditures Service-level energy chargeback tools Report and expose service/user energy consumption Turn energy/power into a billable parameter Expected impact Raise energy awareness among infrastructure users Promote a rational usage of computing resources 5

01 Energy chargeback tools Background Hardware-level solutions Monitor and track server power consumption with no need of external monitoring equipment Embedded thermal and power sensors Standard management protocols (IPMI, WBEM, etc.) Virtualization-level solutions Host and guest resource monitoring Per-host energy chargeback models Service-level solutions Resource usage accounting and chargeback tools Power is considered a fixed infrastructure cost No support in IaaS management APIs or dashboards 6

01 Energy-aware design tools Background Hardware-level solutions Power and thermal infrastructure CAD Virtualization-level solutions Power profiling, prediction and capping for well known workloads Service-level solutions Cloud simulators for resource scheduling and allocation policy selection for a given workload No support in IaaS management APIs or dashboards 7

Outline 01 Introduction and background 02 Energy-aware infrastructure architecture composition - The BODIes infrastructure services model - Infrastructure architecture composition - Energy-aware comparison and selection 03 Service energy chargeback and runtime visualization 04 Wrap up 8

02 Business-Oriented Dynamic Infrastructures (BODIes) Infrastructure services model Enhanced IaaS for service providers Commoditize the deployment of service infrastructure architectures Service providers only deploy their value-added logic Infrastructure Component Sized Virtual Machine + Full SW stack (OS, middleware, etc.) Building Block Set of Infrastructure Components tested and certified to work well in combination Scalability rules Dedicated or fixed infrastructure Variable or on-demand infrastructure (optional) 9

02 Energy-aware architecture design Infrastructure architecture composition in BODIes 10

02 Energy-aware architecture design Energy cost details 11

02 Energy-aware architecture design Infrastructure architecture comparison and selection 12

Outline 01 Introduction and background 02 Energy-aware infrastructure architecture composition 03 Service energy chargeback and runtime visualization - Direct power consumption vs. power overhead - Virtual Machine power attribution - Service-level energy chargeback 04 Wrap up 13

04 Service-level energy chargeback Direct power consumption vs. power overhead P o = n i= 1 P idle i + ( P P ) i idle i CPUi CPU i m j = 1 CPU vm ij P (W) Pidle (W) P Pidle (W) CPU (MHz) CPUvm (MHz) Pd (W) Po (W) Host 1 356,25 150,00 206,25 5500 5250 196,88 159,38 Host 2 228,75 150,00 78,75 2100 2000 75,00 153,75 Total 585,00 300,00 285,00 7600 7250 271,88 313,13 14

04 Service-level energy chargeback Virtual machine power consumption P o ij = P o n m k = 1l= 1 Max( CPU vm ij Max( CPU, RES vm kl vm ij, RES ) vm kl ) P d ij = ( P P ) i idle i CPU CPU i vm ij CPU (MHz) RES (MHz) Pd (W) Po (W) P (W) VM11 2500 3500 93,75 132,84 226,59 VM12 2750 0 103,13 104,38 207,50 VM22 2000 0 75,00 75,91 150,91 Total 7250 3500 271,88 313,13 585,00 15

04 Service energy consumption visualization BODIes infrastructure usage summary report 16

Outline 01 Introduction and background 02 Energy-aware infrastructure architecture composition 03 Service energy chargeback and runtime visualization 04 Wrap up - Conclusions - Future work - Questions? 17

05 Conclusions Infrastructure user behavior has great impact on energy consumption Service architecture design Resource allocation Performance/availability requirements Awareness and incentives are powerful energy saving tools Promote resource saving and energy-responsible design Energy consumption estimations and cost quotations Easy comparison and selection across alternatives Avoid resource wasting by matching infrastructure resource requests to the actual service demands Turn energy consumption into an IaaS billable parameter Allow users to consult their current and past energy consumption and associated costs 18

05 Future work Enhance the CPU-based energy chargeback model with further parameters (e.g., memory usage, disk and network I/O, etc.) Applicable to design-time estimations and runtime chargeback Extend the energy consumption monitoring framework to storage and communications equipment Enhance the dynamic infrastructure management system to take power optimization into consideration 19

05 Questions? Miguel Gómez Rodríguez Telefónica I+D Emilio Vargas, 6 28043 Madrid (Spain) e-mail: miguelg@tid.es 20

2008 Telefónica Investigación y Desarrollo, S.A. Unipersonal