Determining Overhead, Variance & Isola>on Metrics in Virtualiza>on for IaaS Cloud

Transcription

1 Determining Overhead, Variance & Isola>on Metrics in Virtualiza>on for IaaS Cloud Bukhary Ikhwan Ismail Devendran Jagadisan Mohammad Fairus Khalid MIMOS BERHAD

2 Contents 1. Introduc>on 2. Tes>ng Methodologies 3. Setup & Tools 4. Results 5. Discussion 6. Summary 29 MIMOS Berhad. All Rights Reserved.!

3 Introduc>on What is IaaS Commodity base resources User self service consumable resource Consist of Resources (Storage/Compute/Network) Management SoTware IaaS Nature Distributed / Inter- related Virtualiza>on - KVM

4 Objec>ve Understanding of behavior of VM in KVM hypervisor Benchmark the performance of VM Overhead / Isola>on / Variances Determine the performance factor Understanding design decision

5 Methodologies Benchmark VM s Processor, Memory, Storage and Network. Guest OS Behavior (Micro Level) Overhead Virtualiza>on Overhead Variance The Effects of more VM resides in a single physical Isola>on or Fairness Obeserva>on of VM in isolated container. Applica>on Specific Behavior (Macro Level) Overhead/variance/Isola>on of Java & MySQL

6 Setup & tools Benchmark tools Open source / free Results can be comparable with others Specific tool for each components CPU - 7Zipcompression Memory - RAMSpeed Storage IOZone /TIObench Network Netperf Applica>on Scimark/SQLite

7 Setup & tools libraries KVM 85 KMOD-KVM Libvirt-.6.5 QEMU-KVM 1.6. Network Setup NIC capacity 1Gbps Switch 1Gbps Head node - NAT/forwarding

8 Setup & tools Table 1: Host System Specification Processor 4 Cores Intel Xeon CPU 1.99GHz Mainboard DellPrecision WorkSta>on T54 Chipset Intel 54 Chipset Hub Memory 2 x 496 MB 667MHz Disk 75GBHitachi HDS7217 Graphics nvidia Quadro FX 17, OS CentOS bit Kernel Kernel: el5 (x86_64) File System EXT3 Host Processor QEMU Virtual 7.97GHz Mainboard Unknown Chipset Unknown Memory 512MB Disk 12GB GEMU Hard disk Graphics Nil OS Fedora release 1 (Cambridge) (Eucalyptus Image) Kernel Kernel: generic (x86_64) File System ext3 Guess VM

9 Results - Overhead 8 6 Processor MIPS 4 Host Guest 2 Memory MB/s Host Guest int Add int Copy int Scale

10 Results - Overhead Storage MB/s GB Write host guest 4GB Read

11 Results - Overhead Mb/s 1, between hosts TCP_STREAM Network Throughput between guest in single host UDP_STREAM between guests across node 15, Network Latency TPS 1, 5, 1,623 3,692 2,866 - Between hosts between guests in single host between guests across node

12 Results Overhead Applica>ons Java Sun Flower Rendering Time Seconds SQLite Host Guest Time Seconds Host Guest

13 Results Variance & Fairness CPU Variance MIPS guest 2 guest 4 guest CPU Fairness MIPS st guest 2nd guest 3rd guest 4th guest

14 Results Variance & Fairness 25 2 Memory Variance MB/s Guest 2 Guests 4 Guests int Add int Copy int Scale Memory Fairness MB/s int Add int Copy int Scale instance 1 instance 2 instance 3 instance 4

15 Results Variance & Fairness MB/s Iozone Disk Variance GB Write 4GB Read 1 Guest 2 Guest MB/s Iozone Disk Fairness st Guest 2nd Guest 4GB Write 4GB Read

16 Results Variance & Fairness Tiobench Disk Variance Microseconds (Hundreds) Guest 2 Guest 64MB Write 64MB Read 256MB Write 256MB Read Tiobench Disk Fairness Microseconds (Hundreds) st Guest 2nd Guest 64MB Write 64MB Read 256MB Write 256MB Read

17 Results Variance & Fairness Java Variance Rendering >me SQLite Variance Guest 2 Guests 4 Guests Time to complete Guest 2 Guests 4 Guests

18 Results Variance & Fairness Network Throughput Variance Mbps to 1 guest within 1 to 1 guest on diff 1 node node to 2 guests within 1 node 2 to 2 guests on diff node 4 to 4 guests on diff node TCP_STREAM UDP_STREAM TPS 4, 3, 2, 1, - 3,692 1 to 1 guest within node Network Latency Variance 2,866 2,754 2,87 2,65 1 to 1 guest on diff node 2 to 2 guests within node 2 to 2 guests on diff node 4 to 4 guests on diff node

19 Results Variance & Fairness Mbps Mbps Network TCP Fairness Network UDP Fairness Series1 Series2 Series3 Series4 Series1 Series2 Series3 Series4

20 Discussion ELEMENTS OVERHEAD VARIANCE FAIRNESS CPU 1% GOOD 2% GOOD 4% GOOD Memory 5% GOOD 7% BAD 5% GOOD Iozone Write 46% FAIR 46% FAIR 17% GOOD Iozone Read 72% BAD 98% BAD 5% GOOD Tiobench Write 187% V.BAD 35% FAIR 87% BAD Tiobench Read 657% V.BAD 12% V.BAD 24% V.BAD Java 1% GOOD 21% GOOD 2% GOOD Sql 11% GOOD 26% GOOD 23% GOOD Net Tcp - N/A 49% FAIR 39% FAIR Net Udp N/A 39% FAIR 8% GOOD Network Latency N/A 32% GOOD 79% BAD

21 Discussion CPU Good results for all metrics. Memory Shows bad variance. Disk disk I/O bonleneck. High overhead very bad distribu>on of variance and fairness. Tiobench it gives fluctuate results. Disk performs bener in Para- virtualiza>on Applica>on Applica>on specific benchmark result, does not reflect bad CPU, memory and storage performance.

22 Discussion Overhead CPU & Memory gives low overhead Provisioning decision based on Bare Metal Vs. Virtualiza>on Applica>on specific scenarios (Grid/Rendering/Web) Variance More load (VM s) affects overall performance Fairness/Isola>on Behavioral understanding of KVM hypervisor

23 Summary What we gain? KVM specific behavior Important role of VM scheduling Storage plays important role Future Work Different benchmarking methodology Focus on values anain from tes>ng Determine performance improvements weight age (%) Hardware choice SoTware stacks (virtualiza>on/libraries) Host OS (Kernel&TCP parameters tweaking /OS choices Different I/O Scheduler

24 Summary Hypervisor specific results KVM (Vir>o devices) Investment on hardware or sotware stack? Which area contribute to increase the performance and larger capacity? Variance & isola>on issues, makes scheduling policy a crucial component.

25 THANK YOU