Dynamic Resource management with VM layer and Resource prediction algorithms in Cloud Architecture



Similar documents
Enhancing the Scalability of Virtual Machines in Cloud

INCREASING SERVER UTILIZATION AND ACHIEVING GREEN COMPUTING IN CLOUD

A Novel Method for Resource Allocation in Cloud Computing Using Virtual Machines

Energetic Resource Allocation Framework Using Virtualization in Cloud

Migration of Virtual Machines for Better Performance in Cloud Computing Environment

Performance Management for Cloudbased STC 2012

Infrastructure as a Service (IaaS)

Avoiding Overload Using Virtual Machine in Cloud Data Centre

Exploring Resource Provisioning Cost Models in Cloud Computing

INTERNATIONAL JOURNAL OF COMPUTER ENGINEERING & TECHNOLOGY (IJCET) LOAD BALANCING SERVER AVAILABILITY ISSUE

Virtualization Technology using Virtual Machines for Cloud Computing

IMPLEMENTATION OF VIRTUAL MACHINES FOR DISTRIBUTION OF DATA RESOURCES

Cloud deployment model and cost analysis in Multicloud

Allocation of Datacenter Resources Based on Demands Using Virtualization Technology in Cloud

Auto-Scaling Model for Cloud Computing System

Dynamic memory Allocation using ballooning and virtualization in cloud computing

Virtualization Technology to Allocate Data Centre Resources Dynamically Based on Application Demands in Cloud Computing

Securing Cloud using Third Party Threaded IDS

Keywords Distributed Computing, On Demand Resources, Cloud Computing, Virtualization, Server Consolidation, Load Balancing

21/09/11. Introduction to Cloud Computing. First: do not be scared! Request for contributors. ToDO list. Revision history

A Study on Service Oriented Network Virtualization convergence of Cloud Computing

Heterogeneous Workload Consolidation for Efficient Management of Data Centers in Cloud Computing

Survey on Models to Investigate Data Center Performance and QoS in Cloud Computing Infrastructure

Energy Conscious Virtual Machine Migration by Job Shop Scheduling Algorithm

Efficient Resources Allocation and Reduce Energy Using Virtual Machines for Cloud Environment

Emerging Technology for the Next Decade

Grid Computing Vs. Cloud Computing

Keywords: Cloudsim, MIPS, Gridlet, Virtual machine, Data center, Simulation, SaaS, PaaS, IaaS, VM. Introduction

Effective Load Balancing For Dynamic Resource Allocation in Cloud Computing.

Effective Resource Allocation For Dynamic Workload In Virtual Machines Using Cloud Computing

Allocation of Resources Dynamically in Data Centre for Cloud Environment

A Survey Paper: Cloud Computing and Virtual Machine Migration

ENHANCING MINIMAL VIRTUAL MACHINE MIGRATION IN CLOUD ENVIRONMENT

Service and Data Security for Multi Cloud Environment

A Comparative Study of Load Balancing Algorithms in Cloud Computing

RESOURCE MANAGEMENT IN CLOUD COMPUTING ENVIRONMENT

Lecture 7: Data Center Networks"

A Novel Switch Mechanism for Load Balancing in Public Cloud

A Novel Approach for Efficient Load Balancing in Cloud Computing Environment by Using Partitioning

CLOUD COMPUTING. DAV University, Jalandhar, Punjab, India. DAV University, Jalandhar, Punjab, India

Data Centers and Cloud Computing. Data Centers

Cost Effective Automated Scaling of Web Applications for Multi Cloud Services

A Secure Strategy using Weighted Active Monitoring Load Balancing Algorithm for Maintaining Privacy in Multi-Cloud Environments

Figure 1. The cloud scales: Amazon EC2 growth [2].

A Study on Analysis and Implementation of a Cloud Computing Framework for Multimedia Convergence Services

Multilevel Communication Aware Approach for Load Balancing

Advanced Load Balancing Mechanism on Mixed Batch and Transactional Workloads

EFFICIENT JOB SCHEDULING OF VIRTUAL MACHINES IN CLOUD COMPUTING

Optimal Service Pricing for a Cloud Cache

Efficient and Enhanced Load Balancing Algorithms in Cloud Computing

Balancing Server in Public Cloud Using AJAS Algorithm

An Approach for Dynamic Resource Allocation Using Virtualization technology for Cloud Computing

Security Model for VM in Cloud

Dynamic Resource allocation in Cloud

CHAPTER 8 CLOUD COMPUTING

Cloud computing: the state of the art and challenges. Jānis Kampars Riga Technical University

CLOUD COMPUTING. When It's smarter to rent than to buy

Performance Management for Cloud-based Applications STC 2012

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2

Black-box and Gray-box Strategies for Virtual Machine Migration

Proof of Retrivability: A Third Party Auditor Using Cloud Computing

AEIJST - June Vol 3 - Issue 6 ISSN Cloud Broker. * Prasanna Kumar ** Shalini N M *** Sowmya R **** V Ashalatha

Load Balancing in the Cloud Computing Using Virtual Machine Migration: A Review

Enhancing the Performance of Live Migration of Virtual Machine s with WSClock Replacement Algorithm

CLOUD COMPUTING SECURITY CONCERNS

FLAWLESS DISPENSATION PRICING FOR A CLOUD CACHE

Multi-dimensional Affinity Aware VM Placement Algorithm in Cloud Computing

Group Based Load Balancing Algorithm in Cloud Computing Virtualization

International Journal of Scientific & Engineering Research, Volume 6, Issue 5, May ISSN

Service allocation in Cloud Environment: A Migration Approach

CLEVER: a CLoud-Enabled Virtual EnviRonment

A Survey on Resource Provisioning in Cloud

Multi Tiered Security and Privacy- Enhancing Multi-cloud Environment

Testing Network Virtualization For Data Center and Cloud VERYX TECHNOLOGIES

How To Understand Cloud Computing

Selective dependable storage services for providing security in cloud computing

Cloud Computing Architecture: A Survey

An Architecture Model of Sensor Information System Based on Cloud Computing

International Journal of Advance Research in Computer Science and Management Studies

Load Balancing and Maintaining the Qos on Cloud Partitioning For the Public Cloud

Role of Cloud Computing in Education

PERFORMANCE ANALYSIS OF PaaS CLOUD COMPUTING SYSTEM

How To Understand Cloud Computing

Data Centers and Cloud Computing

Optimizing Data Center Networks for Cloud Computing

Cloud Infrastructure Pattern

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

OCRP Implementation to Optimize Resource Provisioning Cost in Cloud Computing

INCREASING THE CLOUD PERFORMANCE WITH LOCAL AUTHENTICATION

Environments, Services and Network Management for Green Clouds

Dynamic Resource Management Using Skewness and Load Prediction Algorithm for Cloud Computing

Task Placement in a Cloud with Case-based Reasoning

ENERGY EFFICIENT VIRTUAL MACHINE ASSIGNMENT BASED ON ENERGY CONSUMPTION AND RESOURCE UTILIZATION IN CLOUD NETWORK

Sla Aware Load Balancing Algorithm Using Join-Idle Queue for Virtual Machines in Cloud Computing

International Journal of Computer Science Trends and Technology (IJCST) Volume 2 Issue 4, July-Aug 2014

Chapter 19 Cloud Computing for Multimedia Services

Energy: electricity, electric grids, nuclear, green... Transportation: roads, airplanes, helicopters, space exploration

Affinity Aware VM Colocation Mechanism for Cloud

A Study on the Cloud Computing Architecture, Service Models, Applications and Challenging Issues

Transcription:

Dynamic Resource management with VM layer and Resource prediction algorithms in Cloud Architecture 1 Shaik Fayaz, 2 Dr.V.N.Srinivasu, 3 Tata Venkateswarlu #1 M.Tech (CSE) from P.N.C & Vijai Institute of Engineering And Technology, Repudi, Guntur. #2 HOD of CSE Dept. in P.N.C & Vijai Institute of Engineering And Technology, Repudi, Guntur. #3 Assistant Professor in P.N.C & Vijai Institute of Engineering And Technology, Repudi, Guntur. Abstract: Cloud computing became an emerging computation technology to offer reliable services in the form of IaaS, SaaS and PaaS. Today business entrepreneurs are updating their infrastructure to adopt for cloud environment to have the miscellaneous advantages of cloud computing architecture. Resource management is an important aspect of cloud to enhance the scalability and efficiency in terms of resource utilization of cloud. As on multiple advancements were introduced in the area of cloud resource management to achieve the efficiency. This paper introduces dynamic resource management through virtual systems is an extreme process in the area of resource allocation and management. We proposed an updated skewness algorithm to predicate, allocate and reclaim the resources dynamically using virtualization concept. Experiments on our approach are demonstrating high availability and efficient utilization of cloud resources. Keywords: Cloud Computing, Resource management, virtual systems, updated skewness algorithm. 1. Introduction Cloud computing is typically defined as a type of computing that relies on sharing computing resources rather than having local servers or personal devices to handle applications. Based on the available features and nature of cloud environment we can assess that this is combination of distributed computing, parallel processing and grid computing. In cloud computing, the word cloud is used as a metaphor for "the Internet," so the phrase cloud 204 www.ijdcst.com computing means "a type of Internet-based computing," where different services - such as IaaS, PaaS and SaaS are delivered to an organization's computers and devices through the Internet. In Cloud computing, computing infrastructure and services should always be available on computing servers (which are distributed among all continents) such that companies are able to access their business services and applications anywhere in the world whenever they need as shown in Figure1. Cloud computing delivers the above mentioned infrastructure, platform and software (applications) as services that are made available to consumers in a pay-per-use basis. Several providers have cloud computing solutions available, where a pool of virtualized and dynamically scalable computing power, storage, platforms, and services are delivered on demand to clients over the Internet on a pay as you go basis. This is implemented using virtualization technology where clients are just a credit card payment away from scaling their rented virtual machines (VMs) dynamically to include as many machines as they need. Network performance and resource availability is the prominent bottleneck for any cloud architecture of today.

Figure.1. Basic Cloud Architecture Cloud resource allocation and management is an evolving part of many cloud data center management issues such as virtual machine deployment in data centers, network virtualization, and multi-path network routing etc. Majority of Business customers interested towards cloud computing and they started their app migration with cloud environment to promote their business operations to end client with low investments and high availability. Due to this increased adoption, Resource Management in Cloud (RMC) becomes an important research aspect in this area. Earlier approaches [1, 3] were used evenness procedure in resource distribution to allocate the available resources among the running applications. This approach may leads to resource over flow due to high amount of resource allocation than required and resource underflow due to less amount of resource allocation than required. Always resource needs for a running application changes from time to time depends on number of live clients. To avoid the above problems this paper introduces dynamic resource management through virtual systems is an extreme process in the area of resource allocation and management. We proposed an updated skewness algorithm to allocate and reclaim the resources dynamically using virtualization concept. Experiments on our approach are demonstrating high availability and efficient utilization of cloud resources. 2. Related work 205 www.ijdcst.com 2.1) Resource allocation: However, despite the recent and notable growth of the Cloud Computing market, there are several key issues open with the process of resource allocation. In cloud computing, Resource Allocation (RA) is the process of assigning available resources to the needed cloud applications over the internet. Resource allocation starves services if the allocation is not managed precisely. A large portion of the work in resource allocation in cloud computing mainly focused on the cost-effectiveness and easy maintenance of the systems. Increasing demand for cloud migration enforces the efficient resource management in cloud computing [1 and 2]. Static resource allocation and dynamic resource allocation were the two important methodologies in this area for resource management. In static resource allocation method [3], all systems will share the available resources (CPU time, Memory, Registers and Network bandwidth etc.) equally without having any priorities. Later dynamic resource management introduced unevenness procedure to distribute physical resources among virtual servers of cloud environment. This approach will be automatically refreshed eventually to update the allocated resources of server based on the workload. In order to predict the hot spot and cold spots [7, 9] this method will determine the threshold from periodic evaluations of workload. CPU and Network resources are monitored by scheduling algorithms and memory resources are by swap activities in this area. 2.2) Virtual Machine (VM): A system which can automatically scale its infrastructure resources is designed in [2 and 4]. The system composed of a virtual network of virtual machines capable of live migration across multi- domain physical infrastructure. By using dynamic availability of infrastructure resources and dynamic application demand, a virtual computation environment is able to automatically relocate itself across the infrastructure and scale its resources. But the above work considers only the non-preempt able scheduling policy [5]. Virtualization allows on-demand remapping of virtual resources over physical resources and thus enables the adaptation of systems to dynamic workloads. This remapping primitive is defined as migration and allows workload transfers among

different physical machines without interrupting their execution. Currently, migration is manually triggered by network managers to load balance data centers [6]. This reallocation scheme is inefficient because of its high reaction time, which is inadequate to dynamic workload environments like clouds. 3. Dynamic resource allocation with updated skewness algorithm Recent cloud architectures are facing resource management problem, due to unexpected requirement of huge resources (CPU time, memory, networks etc.) in an asynchronous manner. Current dynamic resource allocation methodologies [5, 8] are having the capability to map virtual system resources with physical systems dynamically depends on work load. This process will adjust the available resources with the help of hotspot and cold spot migration [8] among the physical machines. Dynamic resource allocation may fail under some circumstances, when suddenly there is an unexpected huge resource requirement for a physical machine. To address the above problem, in this paper we introduced dynamic resource management through virtual systems is an extreme process in the area of resource allocation and management. We proposed an updated skewness algorithm to allocate and reclaim the resources dynamically using virtualization concept. This algorithm is an extension to dynamic resource allocation and management architecture as shown below figure 2. 3.1) Management layer: This layer is the conjunction between cloud layer and the VM layer and having collection of modules like VM Manager, Resource prediction unit, load management resource grid and job scheduler module etc. Secured communication relevant to all aspects is implemented in this layer along with https like secured protocols [9]. This layer contains the high speed wired and wireless network components to support high speed commutation among clouds. This layer is the backbone for this architecture because intra cloud communication is highly demanded in this implementation for resource, process sharing and management. Figure 2. Dynamic resource allocation strategy through VM layer 206 www.ijdcst.com

3.2) VM layer: This layer is a list of virtual machine groups where each group is a set of virtual machines for physical system mapping. In this layer we proposed a separate virtual machine group for single cloud architecture to achieve the operational feasibility. Each VM is a virtual representation of a cloud physical machine at VM Layer level. This is the prominent way to perform mapping between logical resources usage with physical requirements. Every VM is having the OS part for virtual process management and the data part for data manipulations. Virtual machines are always available to resource grid module for monitoring and resource mapping. 3.3) Job Scheduler: This module has to schedule the programs as per workload manager instructions in a concurrent way. Job scheduler will make the CPU time utilization efficiently to overcome bottleneck problems due to network congestion, I/O delays from user. This job scheduler uses the dynamic task scheduling algorithms [8] for job scheduling and implements the multi-tasking with parallel programming. 3.4) Resource grid: Resource grid is a logical module to manage the resource pool and resource allocation strategies. Resource pool is a collection of Databases, server resources, processing resources, main memory resources and Storage areas of IaaS. As per the job scheduler requirements VM manager make available the resources to allocate for process execution. Resource grid follows the dynamic resource allocation procedure to manage the resources of multiple clouds among distributed processing environments of cloud architecture. 3.5) Resource prediction: we are introducing the naïve concept is time bounded resource prediction for future. After analyzing many existing resource allocation methodologies we observed that resource allocation requirements are changing from time to time, here the time stands for hour to hour and day to day. Henceforth predicting resource requirements for future will be a time bound operation to support the green computing policy specifications. To avoid the complexity of time bounded prediction we are analyzing from hour to day. While considering accuracy and effectiveness in resource prediction the time bounded prediction is having the high scalability. 4. Updated Skewness Algorithm This updated skewness algorithm outputs the allocation strategy for dynamic resource management. This algorithm identifies the resource overflow and underflow problems at every resource pool level and plays a vital role in the process of allocation, de allocation and transformation of resources in resource grid. This algorithm takes the present load, allocated resource, growth rate and sentiment analysis report as input to suggest either resource allocation or de allocation as shown below: Updated Skewness Algorithm: Begin Input: present load, allocated resources, growth rate Output: resource overflow or underflow indicator step 1: Map the process execution with VM pool & consider a VM for analysis. step 2: Examine the current resource load (C) vs allocated resources (A) step 3: Extract the recent past growth rate of the process from VM manager. step 4: cross check sentiment analysis against present executing process and save the results (R). step 5: assess the future requirements (F) based on growth rate. step 6: if ((F&&R) > (A&&C)) End Indicate Underflow; Else indicate Overflow; 5. Conclusion In this paper we concentrated on the cloud issues like elasticity, availability, resource management and resource distribution of cloud architecture. To overcome the above issues, we presented dynamic resource allocation with updated skewness algorithm 207 www.ijdcst.com

for efficient resource management in cloud environment. This approach is an extension to dynamic resource allocation and management architecture. This logical extension managed the resources efficiently by managing the resource pool, achieved the security by distributing the data among multiple clouds and elasticity by sharing the resources depends on workload among all cloud environments. 6. References 1) Atsuo Inomata, TaikiMorikawa, Minoru Ikebe, Sk.Md. Mizanur Rahman: Proposal and Evaluation of Dynamin Resource Allocation Method Based on the Load Of VMs on IaaS (IEEE,2010),978-1-4244-8704-2/11. 2) C. Tang, M. Steinder, M. Spreitzer, and G. Pacifici, A scalable application placement controller for enterprise data centers, in Proc. Of the International World Wide Web Conference (WWW 07), May 2007. 3) A. Celesti, F. Tusa, M. Villari, and A. Puliafito, How to enhance cloud architectures to enable cross-federation, in 2010 IEEE 3rd International Conference on Cloud Computing (CLOUD). Los Alamitos, CA, USA: IEEE Computer Society, 2010, pp. 337 345. 4) N. Santos, K. P. Gummadi, and R. Rodrigues. Towards trusted cloud computing. In Hot Topics in Cloud Computing (HotCloud 09). USENIX Association, 2009. 5) N. Bobroff, A. Kochut, and K. Beaty, Dynamic placement of virtual machines for managing sla violations, in Proc. of the IFIP/IEEE International Symposium on Integrated Network Management (IM 07), 2007. 6) 2. J. S. Chase, D. C. Anderson, P. N. Thakar, A. M. Vahdat, and R. P. Doyle, Managing energy and server resources in hosting centers, in Proc. Of the ACM Symposium on Operating System Principles (SOSP 01), Oct. 2001. 7) 3. M. Jensen, J. Schwenk, N. Gruschka, and L. Lo Iacono, On Technical Security Issues in Cloud Computing, Proc. IEEE Int l Conf. Cloud Computing (CLOUD-II),2009. 8) M. Nelson, B.-H. Lim, and G. Hutchins, Fast transparent migration for virtual machines, in Proc. of the USENIX Annual Technical Conference,2005. 9) A.Singh,M.Korupolu and D. Mohapatra Server-storage virtualization inte-gration and load balancing in data centers, in Proc. of the ACM/IEEE conference on Supercomputing, 2008 208 www.ijdcst.com