Paying to Save: Reducing Cost of Colocation Data Center via Rewards
|
|
|
- Agatha Ellis
- 10 years ago
- Views:
Transcription
1 Paying to Save: Reducing Cost of Colocation Data Center via Rewards Mohammad A. Islam, Hasan Mahmud, Shaolei Ren, Xiaorui Wang* Florida International University *The Ohio State University Supported in part by NSF CNS and CNS
2 Data center Google's data center in Mayes County, Oklahoma 2
3 Data centers are power-hungry 91 billion kwh; 50% increase by 2020 U.S. data centers in 2013 Power entire Washington; $10+ billion Source: Natural Resources Defense Council Workload Time Many energy-saving techniques 3
4 Bad news Most of the existing approaches cannot be applied in many large data centers 4
5 What are data centers? 5
6 What are data centers? Data centers 6
7 Multi-tenant colocation data center Multiple tenants house their own servers in one shared space and manage their equipment independently Data center operator is mainly responsible for facility management (e.g., power distribution, cooling) CoreSite s One Wilshire (Photo: CoreSite) 7
8 Who are using colocations? Almost all industry sectors Including top-brand websites, e.g., Wikipedia, Twitter Many clouds Our Internet According to Cisco, 55% Internet traffic will be handled by CDN providers, e.g., Akamai, by 2018 (up from 33% in 2013) 8
9 37.3% Estimated % of Electricity Usage by U.S. Data Center Segment in 2011 (excluding small server closets/rooms) 1.9% 7.8% 37.3% 53.0% In-House Enterprise (for internal business) Multi-Tenant Colocation (e.g., Equinix) Hyper-Scale Cloud Computing (e.g., Google) High-Performance Computing (e.g., DOE) There re over 1,200 colocation data centers in the U.S., and according to IDC 14, many enterprise data centers are migrating to colocations! Source: Natural Resources Defense Council, Scaling up energy efficiency across the data center industry: Evaluating key drivers and barriers, Issue Paper, Aug
10 What s the problem with colocation data centers? 10
11 Cost, cost, and cost! Electricity cost: Table: Guide to where costs go in an owner-operated data center. 11 Source: A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev.
12 Cost, cost, and cost! Electricity cost: 40% of TCO Table: Guide to where costs go in an owner-operated data center. Let s reduce the electricity cost (OpEx)! 12 Source: A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev.
13 A major barrier for reducing OpEx A commonly used pricing model Power Subscriptions Split incentive Colocation operator desires energy saving Tenants manage servers but have no incentive for energy saving Promotional pricing in Verizon Terremark s Miami data center 13
14 Pricing tenants energy usage is not good (enough) Uncoordinated power management High peak power demand charge up to 40% of total electricity bill 14
15 Pricing tenants energy usage is not good (enough) Uncoordinated power management High peak power demand charge up to 40% of total electricity bill Fail to follow the renewables Saving energy at an appropriate time! 15
16 RECO Pay tenants for not using energy at appropriate times 16
17 Challenges We need to dynamically set rewards online Time-varying cooling efficiency Tenants unknown responses Prediction Peak demand charge, often $10+ per kw, is typically determined as the maximum power (e.g., over 15-min interval) over a billing cycle Set higher rewards during peak demand periods, but when is peak demand period? Online feedback 17
18 RECO Track the peak power demand online Set a higher reward only when the expected power usage exceeds the tracked peak Online input Minimize energy cost + reward (plus peak demand charge only when necessary) Reward ( $/kwh ) Update peak power usage Power usage 18
19 Case study 19
20 How to evaluate RECO? Scaled-down prototype system 5 Dell PowerEdge servers, each having 6 VMs Tenant #1: Web workloads based on key-value stores (e.g., Facebook), with a SLA of 95% delay not exceeding 500ms Tenant #2: Hadoop workloads (e.g., data analytics), with a maximum deadline of 15 minutes Workload trace: Gmail & MSR Power management AutoScale, which is being used in Facebook s production system Our prototype system housed in FIU-SCIS data center 20
21 Settings 192 time slots, each 15 minutes Located in San Francisco, CA, cost pro-rated based on PG&E rate schedule E-20 for industry customers Benchmarks BASELINE: power-based pricing without rewards EPR: energy-based pricing (i.e., reward tenants based on electricity price) 21
22 RECO saves operator s OpEx 10+% cost saving! 22
23 Tenants receive rewards for free Tenants 1 & 2 save 3.5% and 6.5%, respectively Without violating SLA Results further confirmed by simulations RECO is win-win! 23
24 Some messages Multi-tenant colocation data center is a very common and critical infrastructure for our Internet 37.3% energy of all data centers Electricity cost is nearly 40% of operator s TCO RECO, an early step to reduce OpEx 24
25 Our work v.s. others Majority of existing research 1.9% 7.8% 37.3% 53.0% In-House Enterprise (for internal business) Multi-Tenant Colocation (e.g., Equinix) Hyper-Scale Cloud Computing (e.g., Google) High-Performance Computing (e.g., DOE) RECO 25
26 We re not alone 26
27 Photo by Shaolei Ren at Chicago O Hare International Airport in May,
A Truthful Incentive Mechanism for Emergency Demand Response in Colocation Data Centers. Linquan Zhang, Shaolei Ren Chuan Wu and Zongpeng Li
A Truthful Incentive Mechanism for Emergency Demand Response in Colocation Data Centers Linquan Zhang, Shaolei Ren Chuan Wu and Zongpeng Li 1 Demand vs Supply in Power Industry? Ideal: Supply = Demand
Data centers & energy: Did we get it backwards? Adam Wierman, Caltech
Data centers & energy: Did we get it backwards? Adam Wierman, Caltech The typical story about energy & data centers: The typical story about energy & data centers: Sustainable data centers Remember: The
Online Resource Management for Data Center with Energy Capping
Online Resource Management for Data Center with Energy Capping Hasan Mahmud and Shaolei Ren Florida International University 1 A massive data center Facebook's data center in Prineville, OR 2 Three pieces
Today: Data Centers & Cloud Computing" Data Centers"
Today: Data Centers & Cloud Computing" Data Centers Cloud Computing Lecture 25, page 1 Data Centers" Large server and storage farms Used by enterprises to run server applications Used by Internet companies
Cloud Computing Trends
UT DALLAS Erik Jonsson School of Engineering & Computer Science Cloud Computing Trends What is cloud computing? Cloud computing refers to the apps and services delivered over the internet. Software delivered
Capping Server Cost and Energy Use with Hybrid Cloud Computing
Capping Server Cost and Energy Use with Hybrid Cloud Computing Richard Gimarc Amy Spellmann Mark Preston CA Technologies Uptime Institute RS Performance Connecticut Computer Measurement Group Friday, June
25.2. Cloud computing, Sakari Luukkainen
1 Agenda 14.1. Introduction, Sakari Luukkainen 21.1. Theoretical frameworks, Sakari Luukkainen 28.1. Business model design, Sakari Luukkainen 4.2. ICT in business process, Sakari Luukkainen 11.2. STOF
Virtualization of the MS Exchange Server Environment
MS Exchange Server Acceleration Maximizing Users in a Virtualized Environment with Flash-Powered Consolidation Allon Cohen, PhD OCZ Technology Group Introduction Microsoft (MS) Exchange Server is one of
MS Exchange Server Acceleration
White Paper MS Exchange Server Acceleration Using virtualization to dramatically maximize user experience for Microsoft Exchange Server Allon Cohen, PhD Scott Harlin OCZ Storage Solutions, Inc. A Toshiba
Leveraging Renewable Energy in Data Centers: Present and Future
Leveraging Renewable Energy in Data Centers: Present and Future Ricardo Bianchini Department of Computer Science Collaborators: Josep L. Berral, Inigo Goiri, Jordi Guitart, Md. Haque, William Katsak, Kien
Predictable Data Centers
Predictable Data Centers Thomas Karagiannis Hitesh Ballani, Paolo Costa, Fahad Dogar, Keon Jang, Greg O Shea, Eno Thereska, and Ant Rowstron Systems & Networking Microsoft Research, Cambridge http://research.microsoft.com/datacenters/
Mobile cloud business
1 Mobile cloud business Sakari Luukkainen 2 Introduction term "cloud" was first used as a metaphor for the Internet, based on the cloud drawing used to depict the Internet as an abstraction of the underlying
Enabling the Future of Networks, Enterprises & Clouds Steve Smith, CEO
Enabling the Future of Networks, Enterprises & Clouds Steve Smith, CEO PTC 14 January 21 The cloud is the paradigm shift for the next decade Interconnection is more critical than ever We enable networks,
Datacenter Clarity LC for colocation owners and tenants. The Data Center Infrastructure Management (DCIM) solution from Siemens. siemens.
Datacenter Clarity LC for colocation owners and tenants The Data Center Infrastructure (DCIM) solution from Siemens siemens.com/dcim Increased efficiency through Datacenter Clarity LC As organizations
CARRIER-NEUTRAL COLOCATION 2009 DATACENTER REPORT BY JASON SCHAFER APRIL 2009 2009 TIER1 RESEARCH & THE 451 GROUP DATACENTER
CARRIER-NEUTRAL COLOCATION 2009 DATACENTER REPORT BY JASON SCHAFER APRIL 2009 2009 TIER1 RESEARCH & THE 451 GROUP DATACENTER REPORT SNAPSHOT TITLE Carrier-Neutral Colocation 2009 ANALYST Jason Schafer,
Emerging Technology for the Next Decade
Emerging Technology for the Next Decade Cloud Computing Keynote Presented by Charles Liang, President & CEO Super Micro Computer, Inc. What is Cloud Computing? Cloud computing is Internet-based computing,
Lecture 24: WSC, Datacenters. Topics: network-on-chip wrap-up, warehouse-scale computing and datacenters (Sections 6.1-6.7)
Lecture 24: WSC, Datacenters Topics: network-on-chip wrap-up, warehouse-scale computing and datacenters (Sections 6.1-6.7) 1 Topology Examples Grid Torus Hypercube Criteria 64 nodes Performance Bisection
Oracle Database 12c. Andy Mendelsohn. Senior Vice President, Oracle Database Server Technologies
Oracle Database 12c Andy Mendelsohn Senior Vice President, Oracle Database Server Technologies 1 Safe Harbor Statement "Safe Harbor" Statement: Statements in this presentation relating to Oracle's future
Demand Response in Data Centers Feasibility and Proof of Concept Demonstration
Demand Response in Data Centers Feasibility and Proof of Concept Demonstration Jay Madden, SCE; Mukesh Khattar, EPRI; Henry Wong, Intel; Chris Battista, Calit2 CalPlug Workshop Series #7 University of
BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES
BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES Relational vs. Non-Relational Architecture Relational Non-Relational Rational Predictable Traditional Agile Flexible Modern 2 Agenda Big Data
Data Center Content Delivery Network
BM 465E Distributed Systems Lecture 4 Networking (cont.) Mehmet Demirci Today Overlay networks Data centers Content delivery networks Overlay Network A virtual network built on top of another network Overlay
Don't outsource IT! Bring your own Cloud with SDN
Don't outsource IT! Bring your own Cloud with SDN Education Session 19 Herman Chao Systems Engineering Manager, Cisco State of CA Government May 2015 Agenda Industry Need and Trends The Network Challenge
Cooling Small Server Rooms Can Be. - Jim Magallanes Computer Room Uptime: www.cruptime.com Uptime Racks: www.uptimeracks.com
Cooling Small Server Rooms Can Be Inexpensive, Efficient and Easy - Jim Magallanes Computer Room Uptime: www.cruptime.com Uptime Racks: www.uptimeracks.com Server Rooms Description & Heat Problem Trends
Virtualizing Apache Hadoop. June, 2012
June, 2012 Table of Contents EXECUTIVE SUMMARY... 3 INTRODUCTION... 3 VIRTUALIZING APACHE HADOOP... 4 INTRODUCTION TO VSPHERE TM... 4 USE CASES AND ADVANTAGES OF VIRTUALIZING HADOOP... 4 MYTHS ABOUT RUNNING
The Answer Is Blowing in the Wind: Analysis of Powering Internet Data Centers with Wind Energy
The Answer Is Blowing in the Wind: Analysis of Powering Internet Data Centers with Wind Energy Yan Gao Accenture Technology Labs Zheng Zeng Apple Inc. Xue Liu McGill University P. R. Kumar Texas A&M University
Cloud-based Services: To Move or Not To Move. Seminar Internet Economics Cristian Anastasiu & Taya Goubran
Cloud-based Services: To Move or Not To Move Seminar Internet Economics Cristian Anastasiu & Taya Goubran Agenda Motivation What is Cloud Computing Cloud Service Market Dimensions and Factors of the Cloud
Capping the Brown Energy Consumption of Internet Services at Low Cost
Capping the Brown Energy Consumption of Internet Services at Low Cost Kien T. Le Ricardo Bianchini Thu D. Nguyen Rutgers University Ozlem Bilgir Margaret Martonosi Princeton University Energy Consumption
Infrastructure as a Service (IaaS)
Infrastructure as a Service (IaaS) DLT Solutions LLC May 2011 Contact Information DLT Cloud Advisory Group 1-855-CLOUD01 (256-8301) [email protected] dl www.dlt.com/cloud Your Hosts Van Ristau Chief Technology
How To Store Data On A Server Or Hard Drive (For A Cloud)
Introducing 365 Cloud Storage Local Enterprise Cloud Storage SERVICE AVAILABILITY: SEPTEMBER 23, 2014 What we do 365 Data Centers provides secure and reliable colocation services that offer an easier way
Learn. Connect. Explore.
Learn. Connect. Explore. Protect your business using Microsoft Azure Backup Service Aashish Ramdas Program Manager II Backup and Archival Team 3 Key Takeaways for this session Microsoft provides: Scalable,
Vodafone Cloud & Hosting Services. Gary Goodenough 13 th November 2015
Vodafone Cloud & Hosting Services Gary Goodenough 13 th November 2015 1 So, you ll all know Vodafone for these 2 But, we also do this and this 3 4 Market trends and customer challenges Your World/ Our
Joint Power Optimization of Data Center Network and Servers with Correlation Analysis
Joint Power Optimization of Data Center Network and Servers with Correlation Analysis Kuangyu Zheng, Xiaodong Wang, Li Li, and Xiaorui Wang The Ohio State University, USA {zheng.722, wang.357, li.2251,
Data Center Colocation Build vs. Buy
Data Center Colocation Build vs. Buy Comparing the total cost of ownership of building your own data center vs. buying third-party colocation services Executive Summary As businesses grow, the need for
Last time. Data Center as a Computer. Today. Data Center Construction (and management)
Last time Data Center Construction (and management) Johan Tordsson Department of Computing Science 1. Common (Web) application architectures N-tier applications Load Balancers Application Servers Databases
COST VS. ROI Is There Value to Virtualization and Cloud Computing?
Windstream WHITE PAPER COST VS. ROI Is There Value to Virtualization and Cloud Computing? Featured Author: Rob Carter Director of Windstream Hosted Solutions Product Marketing 2 COST VS. ROI IS THERE VALUE
Operating Systems. Cloud Computing and Data Centers
Operating ystems Fall 2014 Cloud Computing and Data Centers Myungjin Lee [email protected] 2 Google data center locations 3 A closer look 4 Inside data center 5 A datacenter has 50-250 containers A
Cloud IaaS Migration Roadmap
Cloud IaaS Migration Roadmap A framework for migrating an existing onpremise infrastructure to a public cloud provider Richard Weiss November 3rd 2015 Richard Weiss Principal Consultant, Pythian Group
Build Your Competitive Edge in Big Data with Cisco. Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015
Build Your Competitive Edge in Big Data with Cisco Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015 Big Data Trends Increasingly Everything will be Connected to Everything Massive
USE OF CLOUD COMPUTING BY SMALL AND MEDIUM ENTERPRISES
1 USE OF CLOUD COMPUTING BY SMALL AND MEDIUM ENTERPRISES Introduction Small and Medium Enterprises (SMEs) are the drivers of a nation s economy SMEs are leading the way for entering new global markets
Green Cloud Computing 班 級 : 資 管 碩 一 組 員 :710029011 黃 宗 緯 710029021 朱 雅 甜
Green Cloud Computing 班 級 : 資 管 碩 一 組 員 :710029011 黃 宗 緯 710029021 朱 雅 甜 Outline Introduction Proposed Schemes VM configuration VM Live Migration Comparison 2 Introduction (1/2) In 2006, the power consumption
White Paper. Advanced Server Network Virtualization (NV) Acceleration for VXLAN
White Paper Advanced Server Network Virtualization (NV) Acceleration for VXLAN August 2012 Overview In today's cloud-scale networks, multiple organizations share the same physical infrastructure. Utilizing
Who moved my cloud? Part I: Introduction to Private, Public and Hybrid clouds and smooth migration
Who moved my cloud? Part I: Introduction to Private, Public and Hybrid clouds and smooth migration Part I of an ebook series of cloud infrastructure and platform fundamentals not to be avoided when preparing
ZS Executive Summary
ZS Executive Summary Diamonds in the Rough: ZS Research on SMB Cloud Channel Preferences Three things tech vendors need to know of channel partners in defining cloud service programs for SMBs John DeSarbo
Achieving a High-Performance Virtual Network Infrastructure with PLUMgrid IO Visor & Mellanox ConnectX -3 Pro
Achieving a High-Performance Virtual Network Infrastructure with PLUMgrid IO Visor & Mellanox ConnectX -3 Pro Whitepaper What s wrong with today s clouds? Compute and storage virtualization has enabled
Cloud Technologies for SMBs
Cloud Technologies for SMBs How to Cut Costs, Improve Productivity, Provide Automated Disaster Recovery, and Be Free to Work Anywhere Presented by Cloud Technologies for SMBs 1 About ArcSource 2 The Cloud:
The Open Cloud Near-Term Infrastructure Trends in Cloud Computing
The Open Cloud Near-Term Infrastructure Trends in Cloud Computing Markus Leberecht BELNET Networking Conference 25-Oct-2012 1 Growth & IT Challenges Drive Need for Cloud Computing IT Pros Growth IT Challenges
OpenStack Private Cloud
CatN Cloud Hosting OpenStack Private Cloud [email protected] Tel: 0844 816 2222 www.catn.com Our private cloud, built using OpenStack, offers all the flexibility and agility of public cloud in a locked
Global Data Center Colocation and Managed Hosting Services Market 2015-2019
Brochure More information from http://www.researchandmarkets.com/reports/3063721/ Global Data Center Colocation and Managed Hosting Services Market 2015-2019 Description: About Colocation and Managed Hosting
SOFTWARE DEFINED NETWORKING: INDUSTRY INVOLVEMENT
BROCADE SOFTWARE DEFINED NETWORKING: INDUSTRY INVOLVEMENT Rajesh Dhople Brocade Communications Systems, Inc. [email protected] 2012 Brocade Communications Systems, Inc. 1 Why can t you do these things
Profit Maximization and Power Management of Green Data Centers Supporting Multiple SLAs
Profit Maximization and Power Management of Green Data Centers Supporting Multiple SLAs Mahdi Ghamkhari and Hamed Mohsenian-Rad Department of Electrical Engineering University of California at Riverside,
Cloud Infrastructure as a Service Market Update, 2015. United States
Cloud Infrastructure as a Service Market Update, 2015 United States March 2015 Contents Section Slide Numbers Executive Summary 5 Market Overview 7 Definitions & Study Scope 8-10 Market Drivers 12-14 Market
When Does Colocation Become Competitive With The Public Cloud? WHITE PAPER SEPTEMBER 2014
When Does Colocation Become Competitive With The Public Cloud? WHITE PAPER SEPTEMBER 2014 Table of Contents Executive Summary... 2 Case Study: Amazon Ec2 Vs In-House Private Cloud... 3 Aim... 3 Participants...
Impact of workload and renewable prediction on the value of geographical workload management. Arizona State University
Impact of workload and renewable prediction on the value of geographical workload management Zahra Abbasi, Madhurima Pore, and Sandeep Gupta Arizona State University Funded in parts by NSF CNS grants and
StruxureWare TM Data Center Operation for Co-location
StruxureWare TM Data Center Operation for Co-location End to end data center infrastructure management software for monitoring and control of power, cooling, security and energy usage from the building
When Does Colocation Become Competitive With The Public Cloud?
When Does Colocation Become Competitive With The Public Cloud? PLEXXI WHITE PAPER Affinity Networking for Data Centers and Clouds Table of Contents EXECUTIVE SUMMARY... 2 CASE STUDY: AMAZON EC2 vs IN-HOUSE
Data Center Network Evolution: Increase the Value of IT in Your Organization
White Paper Data Center Network Evolution: Increase the Value of IT in Your Organization What You Will Learn New operating demands and technology trends are changing the role of IT and introducing new
The Flash Transformed Data Center & the Unlimited Future of Flash John Scaramuzzo Sr. Vice President & General Manager, Enterprise Storage Solutions
The Flash Transformed Data Center & the Unlimited Future of Flash John Scaramuzzo Sr. Vice President & General Manager, Enterprise Storage Solutions Flash Memory Summit 5-7 August 2014 1 Forward-Looking
Enterprise Cloud Services from Dimension Data. KB Rajendran Head IDC & Cloud Services
Enterprise Cloud Services from Dimension Data KB Rajendran Head IDC & Cloud Services The changing role of IT What changes with this shift in focus? This matters less Skills required Investment approach
Outlook. Corporate Research and Technologies, Munich, Germany. 20 th May 2010
Computing Architecture Computing Introduction Computing Architecture Software Architecture for Outlook Corporate Research and Technologies, Munich, Germany Gerald Kaefer * 4 th Generation Datacenter IEEE
Microsoft Private Cloud
Microsoft Private Cloud Lorenz Wolf, Solution Specialist Datacenter, Microsoft SoftwareOne @ Au Premier Zürich - 22.03.2011 What is PRIVATE CLOUD Private Public Public Cloud Private Cloud shared resources.
Executive Summary. Metro Capacity
Executive Summary The worldwide colocation data center market continues to grow at a steady rate in 2015. While key Asian markets and some secondary markets have outpaced global average growth rates in
