1 Server Load Balancing made easy & affordable Detlef Lilje KEMP Technologies
2 Why would I need a Load Balancer? Business Processes depend highly on IT OrganizaHons rely on IT availability and performance slow or unavailable ApplicaHons - are expensive - cause negahve image (external and internal) - threaten your organizahon, thus need to be avoided
3 High Availability so what to do? make your IT fast and reliable. But - - isn t this super complex? Doesn t that cost a fortune, is too expensive for us? - > not anymore!
4 Anywhere in the World of Client/Server ApplicaHons......we are facing 2 major challenges.
5 Challenge: Availability Error! Single Server
6 Server Load Balancing Idea: Use more than one Server Put a dispatcher in front of the Servers
7 SoluHon: Server Load Balancing Service ok! Virtual Service
8 Challenge: Performance Overload! Single Server
9 SoluHon: Server Load Balancing Service ok! Virtual Service
10 Server Load Balancing Whenever one Server is not enough. ü Performance / Capacity ü Robustness / Availability
11 Server Load Balancing The original challenge was: Make it smart and reliable! ü SoluHons exist (F5, Netscaler, Radware,...) But the real- life challenge is: Make it easy and affordable, too!
12 Server Load Balancing Thus we developed the KEMP LoadMaster
13 Server Load Balancing Example: F5 LTM3600 vs. KEMP LoadMaster 5300 KEMP with ü Less than ½ the price ü MUCH beder performance!
15 What can be Load Balanced? Web Servers All things HTTP/S - incl. Proxies, Firewalls etc. Microsoi Sharepoint Just Websites (Full support, even with Kerberos authenhcahon) Fairly simple (IMAP, POP, SMTP w/ or w/o SSL) Incl. AnH Spam SoluHons Microsoi Exchange 2010 CerHfied and Used by Microsoi NLB not an ophon! hdp://technet.microsoi.com/en- us/library/ff aspx#ophons
16 What can be Load Balanced? Microsoi Lync Server (OCS) New: MS CerHficaHon for all KEMP LoadMasters! MS "DNS Load Balancing" does not replace this (Edge Role, HTTP/S) Thin Client SoluHons Incl. Microsoi Remote Desktop Services (a.k.a. Terminal Services) Extensive KEMP support especially for RDP Other Services Database, FTP, DNS, LDAP,... As well as proprietary protocols Basically all TCP/UDP based Client/Server applicahons (Technical limits: Unknown L7 persistance criteria)
17 Load Balancing Core Tasks Scheduling: Define how much each Server gets used ü Uneven distribuhon may be desired ü Different strategies to determine the current usage Session Persistence: Send Returning Client to same Server ü Based on quality L7 criteria HTTP Headers, RDP token,... (Source IP is not good enough!) Health Checking: Do not use faulty Servers ü As reliable as possible - ApplicaHon Level / Scriptable
18 Summary "ApplicaHon Level" funchonality is key for quality Server Load Balancing
19 LoadMaster Flexibility and Convenience AdenHon to the details (even for edge cases) ü Not Available behavior: Go to addihonal server, redirect,... ü MulHple or all TCP ports per IP address ü Freedom of Topology MulHple NICs, VLANs, Trunking, Bonding ü...
20 SSL Offloading / SSL AcceleraHon Encrypted Traffic can be load balanced, sure. Or can be decrypted on the LoadMaster ü Performance boost through SSL AcceleraHon Hardware, saves CPU on the servers (even more on 2048/4096 bit!) ü Access to ApplicaHon Level - > Beder Quality ü Single point of maintenance (CerHficate renewal, ) HTTPS and all other TCP (POP3/SSL, LDAPS, ) Even if the Server does not know about SSL! OpHonal Re- EncrypHon between LoadMaster and Server SSL Performance is measured in TransacHons per Second (TPS). Which translates into NEW connechons per second at 1k key size.
21 ApplicaHon Front- End Features ApplicaHon Delivery Controller: Load Balancing + ApplicaHon Front End Services ü SSL Offloading / SSL AcceleraHon ü Reverse Proxy Caching ü Content RouHng ü Compression ü Intrusion PrevenHon (IPS, Snort ruleset compahble)
22 LoadMaster High Availability If availability maders, the LoadMaster must not be a Single Point of Failure either! Thus it almost always gets deployed in pairs. ü No extra license fee - just use two units (same model) ü Easy Setup - 2nd LoadMaster learns from 1st ü AcHve / Hot Standby for maximum robustness ü AutomaHc sync of configurahon changes and session tables
23 LoadMaster Hardware Same FuncHon, different Performance and Ports - No hidden costs, no extra licensing! - ü Up to 9,300 SSL TPS (at 1k keys) ü Up to 110,000 HTTP requests/sec ü Up to 60Mio concurrent connechons ü Up to 8.8Gbps throughput ü 1Gbps and 10Gbps interfaces ü No moving parts (HDDs, )
24 LoadMaster Model Matrix Feature LM LM LM LM Gigabit LAN Interfaces x GbE 2x10GbE (SFP+) Servers/Virtual Clusters (VIPs) 1000/ / / /1000 Max. L4 Throughput <1Gbps 1.7Gbps 3.4Gbps 8.8Gbps SSL TPS (i.e. new connecuons per sec.) 200 1,000 3,000 9,300 Concurrent ConnecUons 1,000,000 2,000,000 4,000,000 60,000,000 Requests/Second (HTTP) 25,000 69,000 77, ,000 Form Factor 1U 1U 1U 1U Power Supply Single Single Single Redundant (Hot Swap) For AcHve/Hot- Standby configurahon, order quanhty 2 (two), HA License at No Extra Cost
25 New: LoadMaster 5300 LoadMaster 5300 ü 8x GbE and 2x 10G (SFP+) ü 8.8 Gbps ü 9300 SSL TPS ü 110,000 Request per sec HTTP ü 60,000,000 conc. conn. L4 ü 400,000 conc. conn. L7 ü 1U, Redundant Power (Hot- Swap) And Price is way below of what you would expect!
26 VirtualizaHon Can I Load Balance Virtualized Servers, too? Yes, absolutely. This is a common use case. Don t VMware & Co. do some Load Balancing anyway? Yes - but only on the OS level. Server Load Balancing can do much more, because it operates on the ApplicaHon Level. Then why not go the next step and virtualize the Load Balancer itself?
27 VirtualizaHon VLM - the Virtual Load Master ü Runs in virtualized environments (Currently: VMware, Hyper- V - next: Xen) ü Provides full LoadMaster funchonality ü Performance only limited by host pla orm (SSL: max TPS) ü Great for teshng, too! VLM- 100 (max. 100 SSL TPS, 100 Mbps) VLM (max SSL TPS, unlimited bandwidth) Actual performance depends on underlying pla4orm
28 MulH- Site Load Balancing What if One enhre Data Center (or ISP uplink) goes down? What if You want to distribute users across mulhple sites?
29 MulH- Site Load Balancing LM- GEO: The GEO LoadMaster ü Access distribuhon across two or more Data Centers ü Sites can be achve/achve or achve/passive (Site Failover) ü Five Policies for access distribuhon ü Commercial- grade Source- IP based LocaHon DetecHon
30 MulH- Site Load Balancing
31 MulH- Site Load Balancing LM- GEO needs to be deployed redundant Available virtualized, too...then called VLM- GEO
32 Conclusion..make it EASY and AFFORDABLE? Easy to configure and maintain: ü HA Cluster is up and running in less than 1 hour ü ApplicaHon Services are configured within minutes ü Typical effort for an Exchange 2010 related deployment: 2-3 hours, incl. TesHng ü Firmware Update on Cluster: less than 5 minutes Affordable: ü LM HA Cluster (good for Users): just EUR ü Including 1 year of Support, Soiware Updates, HW replacement
33 EvaluaHon OpHons Buy & Try VLM ü EvaluaHon Hardware ü KEMP EvaluaHon Units (make sure to schedule up- front)
34 Why KEMP ü Rich Featureset ü Highly AdracHve Pricing ü Ease of Use ü Wide- Spread, Rock- Solid ü Thousands of Users in the Nordics and all over the world
35 KEMP Technologies Founded in 2000, Based in New York European HQ in Limerick, Ireland Nordic Sales Team in Hannover, Germany KEMP Partners in every country LanTeam KEMPCenter Partner in Sweden, many references
36 Thank you for adending! QuesUons? Get your individual Live Demo & Free Trial SW visit the KEMP Booth D.01b Find more at Also take a look at /.de / And contact us any Hme at
Appliance Administration Manual v6.21 This document covers all required administration information for Loadbalancer.org appliances Copyright 2014 Loadbalancer.org, Inc. Table of Contents Section A Introduction...7
Barracuda Load Balancer Administrator s Guide Version 2.3 Barracuda Networks Inc. 3175 S. Winchester Blvd. Campbell, CA 95008 http://www.barracuda.com Copyright Notice Copyright 2004-2008, Barracuda Networks
UNIVERSITY OF OSLO Department of Informatics Performance Measurement of Web Services Linux Virtual Server Muhammad Ashfaq Oslo University College May 19, 2009 Performance Measurement of Web Services Linux
INTRODUCTION TO LINUX CLUSTERING DOCUMENT RELEASE 1.1 Copyright 2008 Jethro Carr This document may be freely distributed provided that it is not modified and that full credit is given to the original author.
Linux on IBM Netfinity Servers A Collection of Papers Introduces Linux high availability solutions Describes systems and network management tools Explores interoperability of Linux solutions Jonathan Follows
An Oracle Technical White Paper May 2011 Oracle Optimized Solution for Enterprise Cloud Infrastructure Introduction... 1 Overview of the Oracle Optimized Solution for Enterprise Cloud Infrastructure...
With hundreds of Help Desk software packages available, how do you choose the best one for your company? When conducting an Internet search, how do you wade through the overwhelming results? The answer
Best Practices for Securing Privileged Accounts 2015 Hitachi ID Systems, Inc. All rights reserved. Contents 1 Introduction 1 2 Risk management 2 2.1 Baseline risks............................................
Microsoft System Center 2012 R2 Why Microsoft? For Virtualizing & Managing SharePoint July 2014 v1.0 2014 Microsoft Corporation. All rights reserved. This document is provided as-is. Information and views
Loadbalancer.org Appliance Setup v5.9 This document covers the basic steps required to setup the Loadbalancer.org appliances. Please pay careful attention to the section on the ARP problem for your real
Linux Virtual Server Administration 5.0 Linux Virtual Server (LVS) for Red Hat Enterprise Linux 5.0 ISBN: N/A Publication date: Linux Virtual Server Administration Building a Linux Virtual Server (LVS)
10 Things Your Next Firewall Must Do Introduction Without question, your network is more complex than ever before. Your employees are accessing any application they want, using work or personal devices.
Purpose-Built Load Balancing The Advantages of Coyote Point Equalizer over Software-based Solutions Abstract Coyote Point Equalizer appliances deliver traffic management solutions that provide high availability,
PeopleSoft Red Paper Series Securing Your PeopleSoft Application Environment July 2010 Including: How to Plan for Security How to Secure Customized System Exposing PeopleSoft outside the Firewall Securing
Red Hat Enterprise Linux 7 Load Balancer Administration Load Balancer Add-on for Red Hat Enterprise Linux Red Hat Engineering Content Services Red Hat Enterprise Linux 7 Load Balancer Administration Load
Best Practices for Architecting Your Hosted Systems for 100% Application Availability Overview Business Continuity is not something that is implemented at the time of a disaster. Business Continuity refers
How AWS Pricing Works May 2015 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction...
HIGH AVAILABILITY IN CLOUD AND DEDICATED INFRASTRUCTURE AVI FREEDMAN / CHIEF TECHNOLOGY OFFICER a white paper by FOREWORD Even the most robustly architected systems fail from time to time. Fortunately,
Relational Database Management Systems in the Cloud: Microsoft SQL Server 2008 R2 Miles Ward July 2011 Page 1 of 22 Table of Contents Introduction... 3 Relational Databases on Amazon EC2... 3 AWS vs. Your
VMware AlwaysOn Point of Care Solution Reference Implementation Case Study for European Healthcare Provider Including Architecture for 25,000 End Users in a Multi-Datacenter Implementation TECHNICAL WHITE
Guide to Selecting a New IP Business Phone System A guide to identifying, selecting, purchasing and installing a new IP business phone system. By Trevor Jones, Director of Marketing & Product Development,