1 An overview of Drupal infrastructure and plans for future growth prepared by Kieran Lal and Gerhard Killesreiter for the Drupal Association
2 Drupal.org Old Infrastructure Problems: Web servers not efficiently used RAM upgrades needed Database Bottleneck Will not scale 250% /year Performance, failures cause downtime, availability problems Firewall uses round robin division of load. Does not check if web server died. Not efficient use of web serving capacity. -web Drupal 2 -web Drupal 3 - CVS/Mail Load is not evenly distributed across servers. Not using maximum RAM capacity of servers. Drupal DB - database Database is bottleneck in architecture. Need more RAM for MySQL. Could use second db slave for back-ups, high availability failover.
3 Drupal.org old infrastructure services Problems: Web servers not efficiently used Database Bottleneck Performance, failures cause downtime, availability problems Firewall Round Robin DNS alternates queries between D1 & D2 Firewall uses round robin division of load. Does not check if web server died. Not efficient use of web serving capacity. Rsync php drupal.org,.be Drupal 2 Rsync php drupal.org,.be groups.d.o, scratch.d.o Drupal 3 CVS Mail FTP PHP Load is not evenly distributed across servers. Not using maximum RAM capacity of servers. Drupal DB NFS server Database is bottleneck in architecture. Need more RAM for MySQL. Could use second db slave for back-ups, high availability failover.
4 Drupal.org Old Infrastructure Hardware Dell's purchased in fundraising drive Drupal Database SUN FIRE V20Z RAM: 2GB Processor: 2 x AMD Opteron Donated by Sun Microsystems
5 Drupal.org Infrastructure Improvements: Load Balancers Web server caches RAM for Web & DB Database Slave Managed Mail server Load Balancer1 Load Balancer2 Load balancers provide higher availability and more efficient use of hardware, hardware growth. Web1 Web 2 Web 3 Three web nodes allow for more web page serving capacity, more memory sharing, re-use of old DB server RAM Upgrades Web Server Drupal DB Drupal DB MySQL Master DrupalDB2 MySQL Slave More powerful DB server allows for more data growth, faster searching. Master-slave allows for higher availability if we have a hardware failure. Read only database could help scale. OSUOSL Mail Server Using professional managed mail server reduces volunteer admin overhead, frees up server resources
6 Drupal.org new infrastructure services Improvements: Load balancers more efficient, HA Drupal DBs HA, data integrity Load Balancer 1 Linux Virtual Server High Availability Firewall Load Balancer 2 Linux Virtual Server High Availabiity Load balancers evenly distribute work load and can survive a hardware failure. Drupal 2 Drupal 3 CVS FTP Load is distributed evenly. More Drupal web properties can be supported. Drupal DB1 MySQL master NFS server Drupal DB2 MySQL slave MySQL backups Database replication allows for High Availability, hardware failure, backups, less downtime for maintenance. OSUOSL Mail Mail Professionally managed mail reduces service needed to be run. Free's hardware for web serving.
7 Drupal.org new infrastructure hardware Load Balancer 1 Unknown server RAM: Storage: Processor: Load Balancer 2 Unknown server RAM: Storage: Processor: Load balancers donated by OSUOSL Drupal 2 Drupal 3 Dell's purchased in fundraising drive Drupal Database Master SUN FIRE V20Z RAM: 2GB Donated by Sun Microsystems Processor: 2 x AMD Opteron Drupal Database Slave HP unknown RAM: Storage: Processor: Loaned by OSUOSL Mail services to be donated by OSUOSL
8 Drupal.org future infrastructure Improvements: Memory Cache Read Only DBs CVS Server Development Server Load Balancer1 Load Balancer2 High Availability and efficient web serving Load to Web Network Web1 Web 2 Web 3 Web N Web N +1 Load balancers allow horizontal web server scaling to alive web servers. Cache may reduced load on web servers serving pages from memory. Memcache allows memory pooling so more content can be served from memory. Web to DB Network Drupal DB SunFire VZ40 MySQL Master DrupalDB2 MySQL Slave DrupalDB N MySQL Slave DrupalDB N+1 MySQL Slave Most web requests just want information and don't need to update* or delete information. By directing read only requests to read only databases we can scale databases horizontally. CVS & Tools Server Development Server OSUOSL Mail Server * Authenticated users require a session update which could be moved to memory with memcache
9 Drupal.org new infrastructure services Improvements: Load balancers more efficient, HA Drupal DBs HA, data integrity Load Balancer 1 Linux Virtual Server High Availability Firewall Load Balancer 2 Linux Virtual Server High Availabiity Load balancers evenly distribute work load and can survive a hardware failure. MemCache Pool* Drupal 2 MemCache Pool* Drupal 3 MemCache Pool* Drupal N MemCache Pool* Load is distributed evenly. More Drupal web properties can be supported. Drupal DB1 MySQL master NFS server Drupal DB2 MySQL slave MySQL backups Drupal DB3 MySQL slave MySQL read only* Drupal DBN MySQL slave MySQL read only* Database replication allows for High Availability, hardware failure, backups, less downtime for maintenance. Drupal Development Virtual DLAMP instances Unit Testing Performance Testing Security devel services Logging/Analytics Drupal CVS Drupal Distributions Drupal Tools OSUOSL Mail Mail Dedicated hardware for unit, developer, security, performance testing. CVS server free's D3 for web serving. *In order to scale databases horizontally with read only nodes, authenticated sessions must be moved to MemCache
10 Drupal infrastructure future hardware Drupal Association fundraising is necessary and coordination with OSUOSL Additional Web Servers more servers can pool more RAM for Memcache pool Software development, software solutions, and virtualization services may make future hardware growth unnecessary Additional Databases slaves Remote MySQL database slave Dedicated CVS Server Dedicated Development Server
Web Application Hosting Cloud Architecture Executive Overview This paper describes vendor neutral best practices for hosting web applications using cloud computing. The architectural elements described
WebGUI Load Balancing WebGUI User Conference October 5, 2005 Presented by: Len Kranendonk firstname.lastname@example.org Course Contents Introduction Example: The Royal Netherlands Football Association Scaling WebGUI
by Stratus Technologies, The Availability Company October, 2007 B E N E F I T F RO M VMware Infrastructure 3 and Stratus Continuous Availability: Going Beyond High Availability for Business-Critical Virtualization
Best Practices Guide McAfee epolicy Orchestrator for use with epolicy Orchestrator versions 4.5.0 and 4.0.0 COPYRIGHT Copyright 2011 McAfee, Inc. All Rights Reserved. No part of this publication may be
Boost user and IT efficiency by deploying collaborative applications on a security-rich, easy-to-administer platform IBM Lotus Domino 6.5.1 Highlights Provides flexibility by letting Maximizes server availability
GamCo Managed Dedicated Virtual Hosting Business growth in the number of users, application and data has left many organisations with sprawling servers, storage and supporting infrastructure crammed into
ZingMe Practice For Building Scalable PHP Website By Chau Nguyen Nhat Thanh ZingMe Technical Manager Web Technical - VNG Agenda About ZingMe Scaling PHP application Scalability definition Scaling up vs
The Definitive Guide To tm Building Highly Scalable Enterprise File Serving Solutions Chris Wolf Chapter 5: Building High-Performance, Scalable, and Resilient Linux File-Serving Solutions...87 Challenges
HIGH AVAILABILITY IN CLOUD AND DEDICATED INFRASTRUCTURE AVI FREEDMAN / CHIEF TECHNOLOGY OFFICER a white paper by FOREWORD Even the most robustly architected systems fail from time to time. Fortunately,
city cloud - the leading kvm based iaas in europe How City Network created one of the leading IaaS in Europe using KVM and op5 Author: Özgür Bal - City Network Andreas Månsson - op5 AB 2014 Content Executive
Service Agreement Dedicated Hosting Between Customer details Company name Street Number Box Postal code Locatlity Country VAT RLP locality Hereinafter referred to as the Customer And Telenet details Telenet
Purpose-Built Load Balancing The Advantages of Coyote Point Equalizer over Software-based Solutions Abstract Coyote Point Equalizer appliances deliver traffic management solutions that provide high availability,
Hyper-V Hosting Guidance: Using and Licensing Microsoft Server Products in Hyper-V Virtual Hosting Scenarios Microsoft Hosting Guidance Monday, January 18, 2010 Version 3.0 The information contained in
Applying Linux High-Availability and Load Balancing Servers for Video-on-Demand (VOD) Systems Chao-Tung Yang 1, Ko-Tzu Wang 1, Kuan-Ching Li 2, and Liang-Teh Lee 3 1 High Performance Computing Laboratory,
Introduction By leveraging the inherent benefits of a virtualization based platform, a Microsoft Exchange Server 2007 deployment on VMware Infrastructure 3 offers a variety of availability and recovery
UNIVERSITY OF OSLO Department of Informatics Performance Measurement of Web Services Linux Virtual Server Muhammad Ashfaq Oslo University College May 19, 2009 Performance Measurement of Web Services Linux
Delivering Extraordinary Density for Cloud Service Providers Parallels Shared Hosting NG Service Module and Intel Xeon 5500 Processor Series-Based Servers Abstract: The goal of this paper is to provide
An Oracle Technical White Paper May 2011 Oracle Optimized Solution for Enterprise Cloud Infrastructure Introduction... 1 Overview of the Oracle Optimized Solution for Enterprise Cloud Infrastructure...
ManageEngine IT360 (Division of ZOHO Corporation) ) www.manageengine.com/it360 ManageEngine IT360 Professional Edition Installation Guide [email@example.com] [This document is a guideline for installing
WHITE PAPER Affordable, Scalable, Reliable OLTP in a Cloud and Big Data World: IBM DB2 purescale Sponsored by: IBM Carl W. Olofson December 2014 IN THIS WHITE PAPER This white paper discusses the concept
ware vcloud Implementation Example Public vcloud Service Provider TECHNICAL WHITE PAPER Document Title Table of Contents 1. Purpose and Overview... 4 1.1 Executive Summary... 4 1.2 Business Requirements...
Building HA Linux Cluster A tutorial for IEEE Cluster Conference 2001 Ibrahim.Haddad@Ericsson.com Ericsson Research Corporate Unit 2001-05-14 1 Ericsson Canada Purpose of the tutorial 1. Share our experience
Kingston Communications Virtualisation Platforms The KC Managed Server is architected to provide a dedicated server based on the hugely successful VMWare platform. By using the Enterprise version of VMware
Managed Workplace 2012 Setup Guide On Premise See All. Manage All. Service All. www.levelplatforms.com TABLE OF CONTENTS Welcome... vii About this Document... viii Where To Get More Help... viii Contact