Improvement of computational abilities in computing environments with virtualization technologies



Similar documents
Storage database in cloud processing

Distributed dcache-based storage system of UB RAS

Dynamic Load Balancing of Virtual Machines using QEMU-KVM

Virtualization benefits in High Performance Computing Applications

The Review of Virtualization in an Isolated Computer Environment

Consolidation Technology in the Cloud Data Processing

GUEST OPERATING SYSTEM BASED PERFORMANCE COMPARISON OF VMWARE AND XEN HYPERVISOR

Virtualization for Cloud Computing

Distributed and Cloud Computing

COS 318: Operating Systems. Virtual Machine Monitors

Basics of Virtualisation

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies. Virtualization of Clusters and Data Centers

Virtualization. Pradipta De

Enabling Technologies for Distributed Computing

Enabling Technologies for Distributed and Cloud Computing

Virtual Machine Monitors. Dr. Marc E. Fiuczynski Research Scholar Princeton University

Virtualization with Windows

Distributed Systems. Virtualization. Paul Krzyzanowski

managing the risks of virtualization

IaaS Cloud Architectures: Virtualized Data Centers to Federated Cloud Infrastructures

Cloud and Virtualization to Support Grid Infrastructures

IOS110. Virtualization 5/27/2014 1

Virtualization and the U2 Databases

Network Performance Comparison of Multiple Virtual Machines

Full and Para Virtualization

Virtualization Technologies and Blackboard: The Future of Blackboard Software on Multi-Core Technologies

Computational task tracking complex in the scientific project informational support system

9/26/2011. What is Virtualization? What are the different types of virtualization.

Virtualizare sub Linux: avantaje si pericole. Dragos Manac

An automated system for program parameters fine tuning in the cloud

CLOUD COMPUTING. DAV University, Jalandhar, Punjab, India. DAV University, Jalandhar, Punjab, India

An Introduction to Virtualization and Cloud Technologies to Support Grid Computing

Cloud Computing #6 - Virtualization

x86 ISA Modifications to support Virtual Machines

Virtualization. Dr. Yingwu Zhu

Chapter 14 Virtual Machines

Efficient Load Balancing using VM Migration by QEMU-KVM

Running Parameter Sweep applications on Everest cloud platform

MODULE 3 VIRTUALIZED DATA CENTER COMPUTE

Is Virtualization Killing SSI Research?

Virtualization. Jukka K. Nurminen

Virtualization. Types of Interfaces

The Art of Virtualization with Free Software

Virtual Machines.

Virtual Machine Security

Computing in High- Energy-Physics: How Virtualization meets the Grid

The Key Technology Research of Virtual Laboratory based On Cloud Computing Ling Zhang

nanohub.org An Overview of Virtualization Techniques

Making a Smooth Transition to a Hybrid Cloud with Microsoft Cloud OS

Lecture 2 Cloud Computing & Virtualization. Cloud Application Development (SE808, School of Software, Sun Yat-Sen University) Yabo (Arber) Xu

SURVEY ON VIRTUALIZATION VULNERABILITIES

COM 444 Cloud Computing

Cloud Computing through Virtualization and HPC technologies

The Xen of Virtualization

International Journal of Computer Science Trends and Technology (IJCST) Volume 3 Issue 3, May-June 2015

Intro to Virtualization

A quantitative comparison between xen and kvm

Virtual Machines and Security Paola Stone Martinez East Carolina University November, 2013.

Microkernels, virtualization, exokernels. Tutorial 1 CSC469

Cloud Server. Parallels. Key Features and Benefits. White Paper.

Migration of Virtual Machines for Better Performance in Cloud Computing Environment

Regional SEE-GRID-SCI Training for Site Administrators Institute of Physics Belgrade March 5-6, 2009

A Dynamic Resource Management with Energy Saving Mechanism for Supporting Cloud Computing

Analysis on Virtualization Technologies in Cloud

High Performance Computing and Virtualization

Keywords Distributed Computing, On Demand Resources, Cloud Computing, Virtualization, Server Consolidation, Load Balancing

Virtual Hosting & Virtual Machines

HBA Virtualization Technologies for Windows OS Environments

Answering the Requirements of Flash-Based SSDs in the Virtualized Data Center

Week Overview. Installing Linux Linux on your Desktop Virtualization Basic Linux system administration

Efficient Cloud Management for Parallel Data Processing In Private Cloud

Multi-core Programming System Overview

Jukka Ylitalo Tik TKK, April 24, 2006

VIRTUALIZATION 101. Brainstorm Conference 2013 PRESENTER INTRODUCTIONS

CA Cloud Overview Benefits of the Hyper-V Cloud

Satish Mohan. Head Engineering. AMD Developer Conference, Bangalore

Secure Virtualization Technology

Cisco Application-Centric Infrastructure (ACI) and Linux Containers

Linux/Open Source and Cloud computing Wim Coekaerts Senior Vice President, Linux and Virtualization Engineering

Hypervisors. Introduction. Introduction. Introduction. Introduction. Introduction. Credits:

Managed Hosting is a managed service provided by MN.IT. It is structured to help customers meet:

Virtualizing Exchange

USING VIRTUAL MACHINE REPLICATION FOR DYNAMIC CONFIGURATION OF MULTI-TIER INTERNET SERVICES

Best Practices for Virtualised SharePoint

STREAM FRBC

Cloud Computing CS

Autonomic Data Replication in Cloud Environment

The Benefits of Virtualizing

HPC performance applications on Virtual Clusters

Transcription:

КОМПЬЮТЕРНЫЕ ИССЛЕДОВАНИЯ И МОДЕЛИРОВАНИЕ 2015 Т. 7 3 С. 499 504 СЕКЦИОННЫЕ ДОКЛАДЫ УДК: 004.75 Improvement of computational abilities in computing environments with virtualization technologies А. V. Bogdanov 1,a, Kyaw Zaya 2,b, Pyae Sone Ko Ko 2,c 1 Institute for High-performance computing and the integrated systems, St. Petersburg, 199397, Russia 2 St.Petersburg State Marine Technical University, 3 Lotsmanskaya Str., St. Petersburg, 190008 Russia E-mail: a bogdanov@csa.ru, b kyawzaya4436@gmail.com, c pyaesonekoko@gmail.com Received December 4, 2014 In this paper, we illustrates the ways to improve abilities of the computing environments by using virtualization, single system image (SSI) and hypervisor technologies collaboration for goal to improve computational abilities. Recently cloud computing as a new service concept has become popular to provide various services to user such as multi-media sharing, online office software, game and online storage. The cloud computing is bringing together multiple computers and servers in a single environment designed to address certain types of tasks, such as scientific problems or complex calculations. By using virtualization technologies, cloud computing environment is able to virtualize and share resources among different applications with the objective for better server utilization, better load balancing and effectiveness. Keywords: virtualization, hypervisor, shared memory system, single system image Усовершенствование вычислительных возможностей в вычислительной среде с помощью технологий виртуализации А. В. Богданов, Кьяв Зайя, Пуае Сон Ko Ko 1 Института высокопроизводительных вычислений и Информационных Систем, Россия, 199397, г. Санкт-Петербург 2 Санкт-Петербургский государственный морской технический университет, Россия, 190008, г. Санкт-Петербург, ул. Лоцманская, д. 3 В этой работе мы показываем способы увеличения возможностей вычислительных сред с помощью виртуализации, единого системного образа (SSI) и коллаборации технологий гипервизора с целью улучшения вычислительных возможностей. В последнее время облачные вычисления как новое сервисное понятие, стали популярными для обеспечения различных сервисов для пользователя типа разделения мультимедиа, офисное on-line программное обеспечение, игры и on-line хранилища. Облачные вычисления объединяют множество компьютеров и серверов в единую среду, разработанную для обращения к определённым типам задач, таких как научные задачи или сложные вычисления. С помощью технологий виртуализации среда облачных вычислений способна виртуализировать и разделять ресурсы между различными приложениями с целью лучшего использования сервера, лучшего балансирования загрузки и эффективности. Ключевые слова: виртуализация, гипервизор, система разделяемой памяти, единый системный образ Citation: Computer Research and Modeling, 2015, vol. 7, no. 3, pp. 499 504. 2014 Александр Владимирович Богданов, Кьяв Зайя, Пуае Сон Ko Ko

500 А. V. Bogdanov, Kyaw Zaya, Pyae Sone Ko Ko Introduction Now a day new technologies allow us to create relatively cheap multi-machine systems with shared computing resource, simplicity to manage heterogeneous resources and control large amount data transfer among them. Such systems provide relatively low computational cost, highly scalable, have high levels of reliability are proven tools for designing, debugging and performance analysis of parallel programs. The new approach is to combine virtualization technology with single system image. Since few years, virtual machines were offered enhanced resource management, using features such as live migration. SSI supports easier programming and administration for cluster environment. After evaluating different configurations, we show that combining the approaches allows us to better decisions challenges such as flexibility for the use of available resources and simplicity of use. In other terms, virtual machines add a level of management flexibility between the hardware and applications, while SSI provides an abstraction of distributed resources. Simultaneous use of both technologies could improve the overall platform resources, productivity and efficiency of the cluster running applications. Advantage of cloud computing is the ability to virtualize and share resources among different applications in order to ensure better utilization of the server [Al-Kiswany et al., 2011] [Nagarajan et al., 2007]. Cloud computing, a large distributed system that uses distributed resources to provide services to end-users through the implementation of several technologies. Virtualization technologies which are heavily relied on by the Cloud Computing environments provide the ability to transfer virtual machines (VM) between the physical systems using the technique of live migration mainly for improving the efficiency [Sabahi, 2012]. Dynamic server consolidation through live migration is an efficient way in cloud computing environments. Hypervisor A hypervisor, also known as a virtual machine monitor (VMM), is computer hardware platform virtualization software that allows several operating systems to share a single hardware host. Each operating system appears to have the host s processor, memory and resources to itself. The hypervisor is controlling the host processor and resources, distributing what is needed to each operating system in turn and ensuring that the guest operating systems or virtual machines are unable to disrupt each other [Yong, Network ]. In a virtual environment, the virtual machine monitor (VMM) is the master control program with the maximum privilege level, and the VMM manages one or more operating systems. Hypervisors are classified into two types: Native hypervisors: Software systems that run directly on the host s software as a hardware control and guest operating system monitor. A guest operating system thus runs on another level above the hypervisor. This is the classic implementation of virtual machine architectures. Host hypervisors: Software applications that run within a conventional operating system environment. Considering the hypervisor layer being a distinct software layer, guest operating systems thus run at the third level above the hardware. Virtualization Virtualization enables the consolidation and pooling of resources so that they can be distributed across a variety of applications to compensate for the limited resources and reduce growing business needs. Virtualization provides a logical abstraction of physical computing resources and creates computing environments that are not limited to the physical configuration or implementation. Virtualization Methods Operating System-Based Virtualization Virtualization is enabled by a host operating system that supports multiple isolated and virtualized guest OS s on a single physical server with the characteristic that all are on the same operating КОМПЬЮТЕРНЫЕ ИССЛЕДОВАНИЯ И МОДЕЛИРОВАНИЕ

Improvement of computational abilities in computing environments 501 system kernel with exclusive control over the hardware infrastructure. The host operating system can view and has control over the Virtual Machines [Sabahi, 2012] [Litty, 2005]. Fig. 1. Hypervisor (Virtual Machine Monitor) Fig. 2. Operation System-Based Virtualization Application-based virtualization An application-based virtualization is hosted on top of the hosting operating system. This virtualization application then emulates each VM containing its own guest operating system and related applications [Sabahi, 2012]. Fig. 3. Application-Based Virtualization Hypervisor-based virtualization The hypervisor is available at the boot time of machine in order to control the sharing of system resources across multiple VMs. Some of these VMs are privileged partitions which manage the virtu- 2015, Т. 7, 3, С. 499 504

502 А. V. Bogdanov, Kyaw Zaya, Pyae Sone Ko Ko alization platform and hosted Virtual Machines. In this architecture, the privileged partitions view and control the Virtual Machines. This approach establishes the most controllable environment and can utilize additional security tools such as intrusion detection systems [Sabahi, 2012; Litty, 2005]. Fig.4. Hypervisor-Based Virtualization Single System Image SSI means that all the distributed resources are organized to a uniform unit for users, users can not be aware of the existence of every node that makes up of the computer system. SSI includes some attributes such as single memory space, single process space, single I/O space, single log on point, single file system, single loads management, and so on. The key attributes of SSI are single memory space and single process space [Rajkumar Buyya, 2001; Yong, Network ]. The SSI of a cluster can be implemented on the hardware level, the under-ware level, the middleware level and the application level. Fig.5. Integration of Single System Image and Virtualization Live Migration Transfers applications on a guest OS to any other healthy node and also provide the premigration mechanism where all the states are transferred before the application starts executing on the КОМПЬЮТЕРНЫЕ ИССЛЕДОВАНИЯ И МОДЕЛИРОВАНИЕ

Improvement of computational abilities in computing environments 503 new healthy node. The sequence in which the live migration occurs is explained below [Desai, 2012; Nagarajan et al., 2007]: (a) Pre Migration: Whenever the migration is initiated, host inquires for available resources and if found, it will reserve them for the process. (b) Pre Copy: All the pages are sent to the new node while the guest OS still continues the execution of the application. The changes made during this time are sent as dirty bits so that they can be identified on the new node. Analyzing performance After all configurations, we analyzed the performance of our virtual distributed computing environment. We manage heterogeneous resources, create a virtual computing clusters under the control of a hypervisor and combine computing resources into a single computing system, which shown in figure 5. Without virtualization technologies computing environment inability to control computer processes and dynamic load balancing between nodes to improve performance during execution of parallel and multi-threaded applications. Time In Seconds 6 5 4 3 2 1 Crystal OpenFoam (IcoFoam) NPB(LU) 0 1 2 4 8 Number Of VMs Fig. 6. Performance Testing On Virtual Computing Environment Conclusion Virtualization, that is increasingly attractive for commercial systems, as implemented by a small hypervisor that runs below the usual OS layer, has the same potential to benefit HPC applications in the dimensions of flexible OS variety, productivity, performance, reliability, availability, security and simplicity. Combination of virtualization and single system image allows processes to more easily migrate between nodes in the cluster for better load balancing and effectiveness of the computing environment [Mergen et al., 2003]. References Al-Kiswany S., Subhraveti D., Sarkar P. and Ripeanu M. VMFlock: Virtual machine co-migration for the cloud. In HPDC'11 (San Jose, USA, June 2011). 2015, Т. 7, 3, С. 499 504

504 А. V. Bogdanov, Kyaw Zaya, Pyae Sone Ko Ko Desai M. Department of Computer Science, University of Southern California Los Angeles, CA. High Performance Computing and Virtualization, 2012. Litty L. "Hypervisor-based Intrusion Detection," M.S. thesis, Dept. Computer Science, University of Toronto, 2005. Mergen M. F., Uhlig V., Krieger O., Xenidis J. Virtualization for high performance. 2003. Nagarajan A. B., Mueller F., Engelmann Ch., Scott S. L. Proactive fault tolerance for HPC with Xen virtualization. ICS 2007: 23-32. Rajkumar Buyya T. C. Single system image (ssi), the International Journal of High Performance Computing Applications, vol. 15, pp. 124 135, 2001. Sabahi F. Secure Virtualization for Cloud Environment Using Hypervisor-based Technology, 2012. Yong L. Network Center of Nanchang University, Single System Image with Virtualization Technology for Cluster Computing Environment, Nanchang 330031, China. КОМПЬЮТЕРНЫЕ ИССЛЕДОВАНИЯ И МОДЕЛИРОВАНИЕ