Self-Adapting Load Balancing for DNS



Similar documents
Balancing Network. Jörg Jung. University of Potsdam Institute for Computer Science Operating Systems and Distributed Systems.

TheImpactofWeightsonthe Performance of Server Load Balancing(SLB) Systems

Benchmarking the Availability and Fault Tolerance of Cassandra

Optimization of Cluster Web Server Scheduling from Site Access Statistics

ENUM in everyday practice is it a dream or an opportunity?

CS423 Spring 2015 MP4: Dynamic Load Balancer Due April 27 th at 9:00 am 2015

Development of Software Dispatcher Based. for Heterogeneous. Cluster Based Web Systems

SERVER CLUSTERING TECHNOLOGY & CONCEPT

Performance Evaluation of Linux Bridge

Performance Evaluation of VMXNET3 Virtual Network Device VMware vsphere 4 build

Benchmarking the Performance of XenDesktop Virtual DeskTop Infrastructure (VDI) Platform

Lecture 3: Scaling by Load Balancing 1. Comments on reviews i. 2. Topic 1: Scalability a. QUESTION: What are problems? i. These papers look at

Cloud Performance Benchmark Series

HyLARD: A Hybrid Locality-Aware Request Distribution Policy in Cluster-based Web Servers

Performance Analysis of IPv4 v/s IPv6 in Virtual Environment Using UBUNTU

NoSQL Performance Test In-Memory Performance Comparison of SequoiaDB, Cassandra, and MongoDB

How To Balance A Web Server With Remaining Capacity

1. Comments on reviews a. Need to avoid just summarizing web page asks you for:

Server Traffic Management. Jeff Chase Duke University, Department of Computer Science CPS 212: Distributed Information Systems

.NET 3.0 vs. IBM WebSphere 6.1 Benchmark Results

A Study on the Scalability of Hybrid LS-DYNA on Multicore Architectures

Exploring Oracle E-Business Suite Load Balancing Options. Venkat Perumal IT Convergence

Packet Capture in 10-Gigabit Ethernet Environments Using Contemporary Commodity Hardware

Performance Tuning and Optimizing SQL Databases 2016

Testing DNS Performance limits the Final Chapter

Quantifying the Performance Degradation of IPv6 for TCP in Windows and Linux Networking

Comparison of Web Server Architectures: a Measurement Study

Monitoring high-speed networks using ntop. Luca Deri

USING VIRTUAL MACHINE REPLICATION FOR DYNAMIC CONFIGURATION OF MULTI-TIER INTERNET SERVICES

CPU Benchmarks Over 600,000 CPUs Benchmarked

Improving the Database Logging Performance of the Snort Network Intrusion Detection Sensor

EWeb: Highly Scalable Client Transparent Fault Tolerant System for Cloud based Web Applications

How To Test For Performance And Scalability On A Server With A Multi-Core Computer (For A Large Server)

D1.2 Network Load Balancing

Performance Comparison of Server Load Distribution with FTP and HTTP

One Server Per City: C Using TCP for Very Large SIP Servers. Kumiko Ono Henning Schulzrinne {kumiko, hgs}@cs.columbia.edu

SIDN Server Measurements

IOmark Suite. Benchmarking Storage with Applica4on Workloads August, Evaluator Group, Inc.

Dynamic Load Balancing of Virtual Machines using QEMU-KVM

Computing in High- Energy-Physics: How Virtualization meets the Grid

LOAD BALANCING TECHNIQUES FOR RELEASE 11i AND RELEASE 12 E-BUSINESS ENVIRONMENTS

Scalability Factors of JMeter In Performance Testing Projects

Ensure that the server where you install the Primary Server software meets the following requirements: Item Requirements Additional Details

Datacenter Operating Systems

An Oracle White Paper March Load Testing Best Practices for Oracle E- Business Suite using Oracle Application Testing Suite

Performance Assessment of High Availability Clustered Computing using LVS-NAT

dnstap: high speed DNS logging without packet capture Robert Edmonds Farsight Security, Inc.

Heavy and Lightweight Dynamic Network Services : Challenges and Experiments for Designing Intelligent Solutions in Evolvable Next Generation Networks

Zeus Traffic Manager VA Performance on vsphere 4

System Requirements Table of contents

Real-Time Analysis of CDN in an Academic Institute: A Simulation Study

GRIDCENTRIC VMS TECHNOLOGY VDI PERFORMANCE STUDY

Netfilter Performance Testing

Tyche: An efficient Ethernet-based protocol for converged networked storage

ZEN LOAD BALANCER EE v3.04 DATASHEET The Load Balancing made easy

Where IT perceptions are reality. Test Report. OCe14000 Performance. Featuring Emulex OCe14102 Network Adapters Emulex XE100 Offload Engine

Open Source in Network Administration: the ntop Project

CLOUD API DOCUMENTATION v2.0. Get list of cloud servers in account

Multicast-based Distributed LVS (MD-LVS) for improving. scalability and availability

Scalable Linux Clusters with LVS

A Low Cost Two-Tier Architecture Model For High Availability Clusters Application Load Balancing

IOS110. Virtualization 5/27/2014 1

HPC performance applications on Virtual Clusters

Enabling Technologies for Distributed Computing

Understanding Slow Start

ZEN LOAD BALANCER EE v3.02 DATASHEET The Load Balancing made easy

Ahsay Online Backup Suite v5.0. Whitepaper Backup speed

Developing Higher Density Solutions with Dialogic Host Media Processing Software

Run-time Resource Management in SOA Virtualized Environments. Danilo Ardagna, Raffaela Mirandola, Marco Trubian, Li Zhang

Revisiting Software Zero-Copy for Web-caching Applications with Twin Memory Allocation

Real Time Performance of a Security Hardened RedHawk Linux System During Denial of Service Attacks

ProMoX: A Protocol Stack Monitoring Framework

Integration of Virtualized Workernodes in Batch Queueing Systems The ViBatch Concept

STRESS TESTING OF HOST IDENTITY PROTOCOL (HIP) IMPLEMENTATIONS

Virtual machine interface. Operating system. Physical machine interface

Virtuoso and Database Scalability

PassMark - CPU Mark Multiple CPU Systems - Updated 17th of July 2012

Figure 1. The cloud scales: Amazon EC2 growth [2].

1000Mbps Ethernet Performance Test Report

Cloud Computing through Virtualization and HPC technologies

SIP Infrastructure Performance Testing

Experimental Evaluation of Horizontal and Vertical Scalability of Cluster-Based Application Servers for Transactional Workloads

LBPerf: An Open Toolkit to Empirically Evaluate the Quality of Service of Middleware Load Balancing Services

Scalable Internet Services and Load Balancing

High Performance Cluster Support for NLB on Window

Efficient load balancing system in SIP Servers ABSTRACT:


Multilevel Communication Aware Approach for Load Balancing

Maximizing Hadoop Performance and Storage Capacity with AltraHD TM

Dell Fabric Manager Installation Guide 1.0.0

Genetic Algorithms for Energy Efficient Virtualized Data Centers

Riverbed Stingray Traffic Manager VA Performance on vsphere 4 WHITE PAPER

Main Memory Data Warehouses

Practical Load Balancing

Transcription:

Self-Adapting Load Balancing for DNS Jo rg Jung, Simon Kiertscher, Sebastian Menski, and Bettina Schnor University of Potsdam Institute of Computer Science Operating Systems and Distributed Systems

Before we start University of Potsdam, Simon Kiertscher 2

Outline 1. Introduction 2. Credit based SLB 3. Implementation 4. Measurements and Evaluation 5. Conclusion and Future Work University of Potsdam, Simon Kiertscher 3

Introduction Dispatcher based Server Load Balancing (SLB): scalable, flexible, and fault tolerance services University of Potsdam, Simon Kiertscher 4

Motivation Sophisticated algorithms are required for heterogeneous workloads and heterogeneous back end servers No weights to determine/tune Self-adapting credit based SLB for better performance Measurements show the advantages of credit based SLB for TCP services like HTTP [Jung et al. 2014] contribution: Efficient implementation for UDP services like DNS required, using a suited credit metric Measurements to compare traditional and credit based SLB algorithms: WRR vs. DPR University of Potsdam, Simon Kiertscher 5

Credit based SLB introduced in [Jung et al. 2014]: Application independent metrics are used to calculate credits Back end server push credits to the LB Linux environments Credits represent the free capacity of the UDP receive queue / TCP backlog queue (in number of UDP requests or TCP connections) University of Potsdam, Simon Kiertscher 6

receive queue vs backlog queue University of Potsdam, Simon Kiertscher 7

Credit Metric: UDP Receive Queue UDP receive queue as credit metric implicitly reflects the current load on the back end servers: A filled receive queue indicates a busy application With a full queue the application if fully engaged and might not respond to requests University of Potsdam, Simon Kiertscher 8

Implementation - Overview of salbnet University of Potsdam, Simon Kiertscher 9

Implementation Using salbnet libnethook for recvmsg() system call interception get size of the received message (payload) transparent for UDP applications, like DNS server (BIND) UDP packet size and required space in memory needs to be predicted Find out free capacity Experimentally determined for Linux kernel Proof of concept prototype: dependent on specific kernel version University of Potsdam, Simon Kiertscher 10

Measurements and Evaluation Measurements in Internet Service Provider (ISP) like SLB environment using BIND instances Heterogeneous hardware and homogenous software versions WRR vs. DPR 3 heterogeneous back end servers require weights for traditional WRR algorithm Determined in beforehand measurements [Zinke and Schnor 2013] University of Potsdam, Simon Kiertscher 11

Environment: Setup University of Potsdam, Simon Kiertscher 12

Environment: Hardware Hostname CPU LVS and IB4 Dual 1.8 GHz AMD Opteron 244 IB6 2.8 GHZ Intel Pentium 4 IB8 1.86 GHz Dual Core Intel Xeon 3040 All machines have 4 GByte memory and GBit links Client (load generator) runs with 12 GByte memory University of Potsdam, Simon Kiertscher 13

Benchmark: servload [Zinke et al. 2012] Existing DNS benchmarks like queryperf or DNSPerf and ResPerf are not able to replay queries In contrast benchmark servload tries to replay real user sessions Factor feature replicates real user sessions Support for DNS protocol added to servload University of Potsdam, Simon Kiertscher 14

Environment: Software 3 BIND DNS servers v9.3.6 LVS LB with ipvsadmin v1.24 Client with servload v0.5.1 OS LB and Servers: CentOS Linux 5.7 with kernel 2.6.18 OS Client: Debian Linux with kernel 2.6.26 Monitoring: SNMPv1 requests once a minute from LB (in addition to the credits) University of Potsdam, Simon Kiertscher 15

Workload: Increased DNS Traces Number of requests from five minutes of a trace from the 29 th September 2011 from DNS servers running haiti.cs.uni-potsdam.de Factor Requests Sessions Mean req/s Max req/s 1 22,594 33 75.31 204 400 9,037,600 13,200 30,125 81,600 800 18,075,200 26,400 60,250 163,200 1,600 36,150,400 52,800 120,501 326,400 University of Potsdam, Simon Kiertscher 16

Results: (First) Response Time Method F 400 F 800 F 1600 WRR 4.05 ms 4.33 ms 4.24 ms DPR 0.64 ms 0.62 ms 0.60 ms University of Potsdam, Simon Kiertscher 17

Results: (Request) Errors Method F 400 F 800 F 1600 WRR 1273 (0.01%) 2038 (0.01%) 2910 (0.01%) DPR 343 (0.00%) 759 (0.00%) 1612 (0.00%) University of Potsdam, Simon Kiertscher 18

Conclusions and Future Work Credit based SLB extended to support UDP services servload benchmark extended to work with DNS Previous TCP (HTTP) measurements are confirmed DPR outperforms traditional WRR with already tuned weights by 15% (FRT) and 25%-50% (error rate) salbnet scales Next: transition from proof concept to mature solution University of Potsdam, Simon Kiertscher 21

Thank you for your attention! Any questions? Contact: jozinke@cs.uni-potsdam.de www.cs.uni-potsdam.de 22

References queryperf is part of the BIND distribution available from: [ISC 2014] ISC. BIND Internet Systems Consortium, May 2014. URL http:// www.isc.org/downloads/bind/. Accessed May 2014. DNSPerf and ResPerf are available from: [Nominum 2014] Nominum. Measurement Tools Nominum, February 2014. URL http://www.nominum.com/support/measurement-tools/. Accessed May 2014. [Zinke et al. 2012] Jo rg Zinke, Jan Habenschuß, and Bettina Schnor. servload: Generating Representative Workloads for Web Server Benchmarking. In Proceedings of the 15th International Symposium on Performance Evaluation of Computer and Telecommunication Systems, pp. 82 89. SPECTS 2012. IEEE Communications Society. Society for Modeling & Simulation International (SCS), Genoa, Italy, July 2012. [Zinke and Schnor 2013] Jo rg Zinke and Bettina Schnor. The Impact of Weights on the Performance of Server Load Balancing Systems. In Proceedings of the 16th Internation- al Symposium on Performance Evaluation of Computer and Telecommunication Systems, pp. 541 548. SPECTS 2013. IEEE Communications Society. Society for Modeling & Simulation International (SCS), Toronto, Canada, July 2013. [Jung et al. 2014] Jo rg Jung, Bettina Schnor, and Sebastian Menski. salbnet: A Self-Adapting Load Balancing Network. In Proceedings of the 12th IASTED International Conference on Parallel and Distributed Computing and Networks, pp. 249 257. PDCN 2014. ACTA Press. IASTED, Innsbruck, Austria, February 2014. University of Potsdam, Simon Kiertscher 23