Active Resource Provision in Cloud Computing Through Virtualization



Similar documents
Allocation of Resources Dynamically in Data Centre for Cloud Environment

A Novel Method for Resource Allocation in Cloud Computing Using Virtual Machines

Migration of Virtual Machines for Better Performance in Cloud Computing Environment

Dynamic memory Allocation using ballooning and virtualization in cloud computing

Avoiding Overload Using Virtual Machine in Cloud Data Centre

Effective Resource Allocation For Dynamic Workload In Virtual Machines Using Cloud Computing

Balancing Server in Public Cloud Using AJAS Algorithm

IMPLEMENTATION OF VIRTUAL MACHINES FOR DISTRIBUTION OF DATA RESOURCES

Dynamic Resource allocation in Cloud

AN APPROACH TOWARDS DISTRIBUTION OF DATA RESOURCES FOR CLOUD COMPUTING ENVIRONMENT

INCREASING SERVER UTILIZATION AND ACHIEVING GREEN COMPUTING IN CLOUD

Enhancing the Scalability of Virtual Machines in Cloud

Virtualization Technology using Virtual Machines for Cloud Computing

Efficient and Enhanced Load Balancing Algorithms in Cloud Computing

An Approach for Dynamic Resource Allocation Using Virtualization technology for Cloud Computing

Resource Allocation Using Virtual Machines and Practical Outsourcing for Cloud Computing Environment

Virtualization Technology to Allocate Data Centre Resources Dynamically Based on Application Demands in Cloud Computing

Virtualization Technology to Allocate Data Centre Resources Dynamically Based on Application Demands in Cloud Computing

A review of Virtualization Technology to Allocate Data Centre Resources Dynamically Based on Application Demands in Cloud Computing

Energetic Resource Allocation Using Virtual Products for Cloud Computing Environment 1 P.Subhani, 2 V.Kesav Kumar,

Dynamic Resource Management Using Skewness and Load Prediction Algorithm for Cloud Computing

Efficient Resources Allocation and Reduce Energy Using Virtual Machines for Cloud Environment

Dynamic resource management for energy saving in the cloud computing environment

Energy Constrained Resource Scheduling for Cloud Environment

RESOURCE MANAGEMENT IN CLOUD COMPUTING ENVIRONMENT

Energy Conscious Virtual Machine Migration by Job Shop Scheduling Algorithm

A Survey Paper: Cloud Computing and Virtual Machine Migration

Energetic Resource Allocation Framework Using Virtualization in Cloud

How To Allocate Resources On A Virtual Machine

Infrastructure as a Service (IaaS)

VM Based Resource Management for Cloud Computing Services

Black-box and Gray-box Strategies for Virtual Machine Migration

Enhancing the Performance of Live Migration of Virtual Machine s with WSClock Replacement Algorithm

Dynamic Resource Allocation using Virtual Machines for Cloud Computing Environment

Survey on Dynamic Resource Allocation Strategy in Cloud Computing Environment

Allocation of Datacenter Resources Based on Demands Using Virtualization Technology in Cloud

Group Based Load Balancing Algorithm in Cloud Computing Virtualization

Real Time Elastic Cloud Managment for Limited Resources

Keywords Distributed Computing, On Demand Resources, Cloud Computing, Virtualization, Server Consolidation, Load Balancing

Dynamic Creation and Placement of Virtual Machine Using CloudSim

A System for Dynamic Resource Allocation Using Virtualization technology and supports green computing in cloud computing environment

Xen Live Migration. Networks and Distributed Systems Seminar, 24 April Matúš Harvan Xen Live Migration 1

A Dynamic Resource Management with Energy Saving Mechanism for Supporting Cloud Computing

Dynamic Virtual Machine Scheduling for Resource Sharing In the Cloud Environment

Virtualization for Future Internet

Dynamic Resource management with VM layer and Resource prediction algorithms in Cloud Architecture

Dynamic Load Balancing of Virtual Machines using QEMU-KVM

Elastic Load Balancing in Cloud Storage

Automation, Manageability, Architecture, Virtualization, data center, virtual machine, placement

PHYSICAL SERVER AND VIRTUAL SERVER: THE PERFORMANCE TRADE-OFFS

A Review of Load Balancing Algorithms for Cloud Computing

A Load Balancing Algorithm based on the Variation Trend of Entropy in Homogeneous Cluster

IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures

Performance Isolation of a Misbehaving Virtual Machine with Xen, VMware and Solaris Containers

Virtualization benefits in High Performance Computing Applications

Performance Comparison of VMware and Xen Hypervisor on Guest OS

Aaron J. Elmore, Carlo Curino, Divyakant Agrawal, Amr El Abbadi. cs.ucsb.edu microsoft.com

USING VIRTUAL MACHINE REPLICATION FOR DYNAMIC CONFIGURATION OF MULTI-TIER INTERNET SERVICES

International Journal of Advancements in Research & Technology, Volume 3, Issue 8, August ISSN

Live Migration of Multiple Virtual Machines with Resource Reservation in Cloud Computing Environments

PARALLEL OPTIMIZED LIVE VM MIGRATION

ADAPTIVE LOAD BALANCING ALGORITHM USING MODIFIED RESOURCE ALLOCATION STRATEGIES ON INFRASTRUCTURE AS A SERVICE CLOUD SYSTEMS

Cost Effective Automated Scaling of Web Applications for Multi Cloud Services

Towards Unobtrusive VM Live Migration for Cloud Computing Platforms

Database Systems on Virtual Machines: How Much do You Lose?

Minimization of Energy Consumption Based on Various Techniques in Green Cloud Computing

Payment minimization and Error-tolerant Resource Allocation for Cloud System Using equally spread current execution load

Load Balancing in the Cloud Computing Using Virtual Machine Migration: A Review

International Journal of Computer Science Trends and Technology (IJCST) Volume 3 Issue 3, May-June 2015

Comparison of PBRR Scheduling Algorithm with Round Robin and Heuristic Priority Scheduling Algorithm in Virtual Cloud Environment

Virtualization for Cloud Computing

Efficient DNS based Load Balancing for Bursty Web Application Traffic

A Heuristic Location Selection Strategy of Virtual Machine Based on the Residual Load Factor

Multi-dimensional Affinity Aware VM Placement Algorithm in Cloud Computing

Experimental Investigation Decentralized IaaS Cloud Architecture Open Stack with CDT

A Middleware Strategy to Survive Compute Peak Loads in Cloud

Models For Modeling and Measuring the Performance of a Xen Virtual Server

Improved metrics collection and correlation for the CERN cloud storage test framework

Green Cloud Computing 班 級 : 資 管 碩 一 組 員 : 黃 宗 緯 朱 雅 甜

Is Virtualization Killing SSI Research?

INVESTIGATION ON ENERGY UTILIZATION IN CLOUD DATA CENTERS

Dynamic Virtual Cluster reconfiguration for efficient IaaS provisioning

CHAPTER 1 INTRODUCTION

Dynamic load management of virtual machines in a cloud architectures

Two-Level Cooperation in Autonomic Cloud Resource Management

A Migration of Virtual Machine to Remote System

GUEST OPERATING SYSTEM BASED PERFORMANCE COMPARISON OF VMWARE AND XEN HYPERVISOR

Monitoring IBM HMC Server. eg Enterprise v6

Synchronization of Data and Resources in Distributed, Cooperative Virtual Data Centers

Keywords: Dynamic Load Balancing, Process Migration, Load Indices, Threshold Level, Response Time, Process Age.

Resource Scalability for Efficient Parallel Processing in Cloud

Iaas for Private and Public Cloud using Openstack

SLAPv: A Service Level Agreement Enforcer for Virtual Networks

Grid Computing Approach for Dynamic Load Balancing

A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems

ABSTRACT. KEYWORDS: Cloud Computing, Load Balancing, Scheduling Algorithms, FCFS, Group-Based Scheduling Algorithm

Capacity and Performance Overhead in Dynamic Resource Allocation to Virtual Containers

SmartCloud Monitoring - Capacity Planning ROI Case Study

Power Management in Cloud Computing using Green Algorithm. -Kushal Mehta COP 6087 University of Central Florida

Transcription:

IN(nline): 2320-9801 IN (Print): 2320-9798 International Journal of Innovative esearch in Computer and Communication ngineering (n I 3297: 2007 Certified rganization) ol.2, pecial Issue 4, eptember 2014 ctive esource Provision in Cloud Computing hrough irtualization K.obhanadri 1,.evathi 2 PG tudent, C, JNU University, irupati, India 1 ssistant Professor, C, JNU University, irupati, India 2 BC: Cloud Computing is an emerging technology which provides effective services to the clients. It permits clients to scale up and down their resources usage depending upon their needs Because of this, under provision and over provision problems may occur. o overcome this migration of service utilization ur Paper focuses on overcoming this problem by distributing the resource to multiple clients through virtualization technology to enhance their returns. By using virtualization, it allocates datacenter resources dynamically based on applications demands and this technology also supports green technology by optimizing the number of servers in use. We present a new approach called kewness, to calculate the unevenness in the ulti-tier resource utilization of a server. By optimizing kewness, we can join different types of workloads adequately and we can improve the whole consumption of server resources. KYWD: Cloud computing, over provision, under provision, virtualization, green computing, skewness. 1. INDUCIN any of the organizations show interest on cloud, because with low cost we can access resources from cloud in a flexible and secure manner. Cloud shares their resource to multiple users. Cost of resources varies significantly depending on configuration for using them. Hence efficient management of resources is of prime interest to both Cloud Providers and Cloud Users. he success of any cloud management software critically depends on the flexibility, scale and efficiency with which it can utilize the underlying hardware resources while providing necessary performance isolation. uccessful resource management solution for cloud environments needs to provide a rich set of resource controls for better isolation. Here dynamic resource allocation and load balancing is the challenging task to provide effective service to clients. Due to peak demands for a resource in the server, resource is over utilized by clients through virtualization. his may degrade the performance of the server. In under utilization usage of resource is very poor when compare to over utilization, for this we are migrate client processing from to other. irtual machine monitors (s) provide a mechanism for mapping virtual achines () to physical resources in Physical achine (P). But mapping is hidden from the cloud. Cloud provider should ensure that physical machine have sufficient resource to meet client need. When an application is running on mapping between s and Ps is done by migration technology. However policy issue remains in every aspect to decide the mapping adaptively so that the demands of were met and the number of P used is minimized. hough it is a challenging one when the resource need of is heterogeneous due to the different set of applications their need might vary with time as the workloads goes ups and down. he capacity of P can also be Heterogeneous because multiple generations of hardware coexist in a datacenter. Here we have two main goals to provide dynamic resource allocation 1. ptimize burdens: P should provide all the necessary resources required to process applications on s. It satisfies needs based on its capacity. 2. Green Computing: optimize unnecessary usage of Ps to save the energy he work discussed below in our Paper makes discussions of how to overcome these two problems in cloud. First we have to share the work to servers in a balanced way depending upon their capacity. By sharing server we can perform their task effectively to optimize load on it. Next, we have to optimize the usage of resource then only we can give flexible and effective service to clients, for this usage of resource onitor is necessary. By monitoring, we came to know underutilization and overutilization of resources in P through s. o to calculate the usage of resource we introduce a new approach called kewness. With the help of previously used resource logs, we have to forecast periodically for future resource needs. client can demand for highly resource provision. t the time there may be a Copyright to IJICC www.ijircce.com 248

IN(nline): 2320-9801 IN (Print): 2320-9798 International Journal of Innovative esearch in Computer and Communication ngineering (n I 3297: 2007 Certified rganization) ol.2, pecial Issue 4, eptember 2014 chance for insufficient resource, while providing that service to the intended client, resource as well as memory forecasting is necessary. For this we design resource forecasting algorithm. II. Y IW he rchitecture represented in Fig. 1, ach P runs with xen hypervisor Processor with domain 0 and one or more domain U in this system. In each domain U n no. of resource are there to provide service to clients. ll P s are connected to backend databases for storing information s. haring of P s resources to s is cheduler Predictor Hotspot Coldspot igration ist 0 U U U Usher C 0 U H N W U WUU B Xen Hypervisor U D K P U H Xen Hypervisor P P maintained by Usher center controller (Usher C). ach processing on usher local node anager (N) in domain 0 which gathers the resource usage information like CPU and network in each monitoring the action performing in xen. emory usage in is largely hidden to hypervisor. hortage of memory is indicated by swap activities. scheduler gathers the usage of resources information frequently from all P s; send it to Usher Center Control to schedule the. Predictor in scheduler predicts the feature resource needs by resource forecasting algorithm. emory and CPU allocations are changing in xen, when a new demands came for processing N has to satisfy those requests by adjusting the old one. Hotspot solver in cheduler identifies the usage of resources from P. If its usage is high then we can call it as Hot threshold. scheduler migrate those to reduce the burden on P. If the uses resources averagely from P s it is below the Green Computing hreshold or Cold hreshold. We are shut downing P s to save the energy those are in under utilization list. igrate all the listed to Usher C for execution. P D N U Fig. 1: ystem rchitecture W C P2 U D N 0 U H N W U I Xen Hypervisor U U G Copyright to IJICC www.ijircce.com 249

IN(nline): 2320-9801 IN (Print): 2320-9798 International Journal of Innovative esearch in Computer and Communication ngineering (n I 3297: 2007 Certified rganization) ol.2, pecial Issue 4, eptember 2014 III. FCING FUU UC BY CCUIN mart service maintenance has some parameter like efficiency, security and flexibility. We have to take care by monitoring and analyze the service periodically then only we can provide effective services to clients. Depending upon demands we require some changes in to maintain it as effective service and demand for that service increases. Based on previous usage history we can adapt some services and make changes in hardware also. Here our main aim to utilize present resource in effectively by monitoring usage. his is possible by necessary calculation. For this we proposed exponentially weighted moving average (W) in CP. (t) = α * (t - 1) + (1 - α) * (t), 0 α 1. Where (t): stimate load at time t. (t): bserved load at time t. Forecast the CPU weights on DN server by using the W formula. We compute the weights periodically to reduce burden and estimate next weight on it. We show the CPU utilization in a graphical representation to adjust the weights on it. In Fig. 2a show the results for α = 0.7. Dot represents the observed value and curve represents the Predicted value in the Graph. Curve cuts the middle of the dots which indicates a quite precise prediction. his is also verified by table 1. edian errors are computed based on observed value: (t) (t) / (t). ven though it seems that it is suitable, but it was not getting resource usage fluctuation details. Unfortunately when α is between 0 and 1, the predicted value is always between historic value and observed one. o we required small changes to speed up we set α value as negative (-1 α 0). We have to balance the observed (t) and estimated (t) loads on time being. For example if observed resource usage is going down. Here we can to decrease the estimated load in some situations. Based on the situation we have to take precaution to maintain the server. For this we have two parameters α and α to balance the server. We can call this as Fast Up and low down (FUD) algorithm. We can see in fig 2b show the effectiveness of the FUD algorithm for α = -0.2 and α = 0.7 these values are obtained by doing experiment on online application. We keep a window W recently observed value and take (t) as hight. We take W=8 and increase the percentage of resource demand to peak usage that is 90% th show in the Fig. 2c. Below Fig.2, CPU load prediction for the DN server at our university. W is the measurement window Fig. 2 (a) W α = 0.7, W = 1 Copyright to IJICC www.ijircce.com 250

IN(nline): 2320-9801 IN (Print): 2320-9798 International Journal of Innovative esearch in Computer and Communication ngineering (n I 3297: 2007 Certified rganization) ol.2, pecial Issue 4, eptember 2014 Fig. 2 (b) FUD: α = - 0.2, α = 0.7, W = 1 Fig. 2 (c) FUD: α = - 0.2, α = 0.7, W = 8 ewma (0.7) W = 1 fusd (-0.2, 0.7) W = 1 fusd(-0.2, 0.7) W = 8 edian 5.6% 9.4% 3.3% error High error 56% 77% 58% ow error 44% 23% 41% able 1: oad Prediction lgorithms I. KWN GIH kewness can count underutilization and overutilization of multiple resources on a server. et n be the no of resources, r i be the i th resource usage and p be the server. Where kewness (p) = is the average usage of all resource for server p. we apply this calculation specifically on inconsistent servers to know the resource usage whether the resource is overutilization or underutilization. igrate the workloads which is overly utilizes the resource from one server to another server. If the resources are underutilized from a server then we can joins some more workloads to improve the overall utilization of server resources smartly. Copyright to IJICC www.ijircce.com 251

IN(nline): 2320-9801 IN (Print): 2320-9798 International Journal of Innovative esearch in Computer and Communication ngineering (n I 3297: 2007 Certified rganization) ol.2, pecial Issue 4, eptember 2014 Fig. 3, Comparison of P and FUD 4.1 Hot and Cold pots We have explained previously about Hotspot and cold spot in section 2. Depending on the oad we are defining temperature of a server. If the utilization of resources in server is high then it is in hot threshold. his shows the server is highly busy with overload on it. By reducing burden on server, it performs its tasks nicely. We are diverting some s to another P s which is suitable to fulfill their requirements. p is the temperature of hotspot. emperature (p) = Where is the set of overloaded resources in server p and r t is the hot threshold for resource r. if the temperature is zero then the server is in cold spot. if temperature is one server is in hot spot. If the utilization of resource is below average to its actual capacity then it is in cold threshold. Potentiality of server is wastage due to the server running idly, so it was not satisfying the green computing threshold, to save the energy we are show downing it. he utilization of all resources from server which satisfies the green computing threshold but not in risk stage then we can call it as warm threshold. 4.2 Hot pot Improvement Here our aim to remove hot spots in a server to provide smooth accesses flexibility to client. client has authority to customize their service within his long run. While providing these services, server has to allocate high level of resources to satisfy their needs based on their demands. t this time server is busy (server temperature is high or Hot spot) while supplying those resources and give high priority for new demands, while providing these service a problem may arises for already using the same resource going down. vercome this problem by migrating s to another server s. With the help of kewness we are collecting the list of s which are over utilizing the resources from server, similarly for remaining servers. migration which depends on highest priority in hot spot list that is in descending order. esponsibility of server has to check before migrate the from one server (source server) to another server (Destination server). ource server has to check whether the destination server is suitable, if it provides all his resource or not and after accepting this it does not go to hotspot. While seeing all these a aspect then we are migrating the to another server. In this way we are optimizing the server temperature as low as possible. 4.3 Green Computing he main intension of Green computing algorithm is to utilize the maximum level of resources on server and also it optimize the number of active servers running with less weight it does not sacrifice its performance now or in future. ur aim is to optimize the server resources by migrating s to another suitable server which are underutilized its resources. By doing this we can save the server s energy. o avoid this green computing algorithm request s periodically to get the information of underutilized resources which satisfies green computing threshold from all servers in cloud also known as cold spot. By collect this information we are migrating the s in ascending order based on memory size. Copyright to IJICC www.ijircce.com 252

IN(nline): 2320-9801 IN (Print): 2320-9798 International Journal of Innovative esearch in Computer and Communication ngineering (n I 3297: 2007 Certified rganization) ol.2, pecial Issue 4, eptember 2014. CNCUIN We have presented an approach for implementation and evaluation of a resource management system for cloud computing services. We have also shown in our paper of how we can multiplex virtual resource allocation to physical resource allocation effectively based on the fluctuating demand. We also make use the skewness metric to determine different resource characteristics appropriately so that the capacities of servers are well utilized. We can apply our algorithm to achieve both overload avoidance and green computing for systems which support multi-resource constraints. FNC [1] Zhen Xiao, enior ember, I, Weijia ong, and Qi Chen, Dynamic esource llocation Using irtual achines for Cloud Computing nvironment,. 24, N. 6, JUN 2013 [2]. iegele, et It ise: pecial eport on Corporate I, he conomist, vol. 389, pp. 3-16, ct. 2008. [3] P. Barham, B. Dragovic, K. Fraser,. Hand,. Harris,. Ho,. Neugebauer, I. Pratt, and. Warfield, Xen and the rt of irtualization, Proc. C ymp. perating ystems Principles (P 03), ct. 2003. [4] mazon elastic compute cloud (mazon C2), http://aws. amazon.com/ec2/, 2012. [5] C. Clark, K. Fraser,. Hand, J.G. Hansen,. Jul, C. impach, I. Pratt, and. Warfield, ive igration of irtual achines, Proc. ymp. Networked ystems Design and Implementation (NDI 05), ay 2005. [6]. Nelson, B.-H. im, and G. Hutchins, Fast ransparent igration for irtual achines, Proc. UNIX nn. echnical Conf., 2005. [7]. cnett, D. Gupta,. ahdat, and G.. oelker, Usher: n xtensible Framework for anaging Clusters of irtual achines, Proc. arge Installation ystem dministration Conf. (I 07), Nov. 2007. [8]. Wood, P. henoy,. enkataramani, and. Yousif, Black-Box and Gray-Box trategies for irtual achine igration, Proc. ymp. Networked ystems Design and Implementation (NDI 07), pr. 2007. [9] C.. Waldspurger, emory esource anagement in ware X erver, Proc. ymp. perating ystems Design and Implementation (DI 02), ug. 2002. Copyright to IJICC www.ijircce.com 253