Applying the Benefits of Cloud and Clustering to your Shared Hosting Platform Igor Seletskiy CEO, CloudLinux
Reliability No single point of failure Hardware independence Elasticity Growing Shrinking Scalability Scaling beyond single server
Bill Gates was using Cloud Computing in the 8 th grade! When he was in the eighth grade, the Mothers Club at Bill s school used proceeds from the Lakeside School's rummage sale to buy an ASR-33 teletype terminal and a block of computer time on a General Electric computer for the school's students. -Source: wikipedia Dates back to MULTICS 1965 It had numerous features intended to result in high availability so that it would produce a computing utility similar to the telephone and electricity services. Modular hardware structure and software architecture were used to achieve this. The system could grow in size by simply adding more of the appropriate resource computing power, main memory, disk storage, etc.
Use Cloud VM instead of dedicated servers Benefit from reliable infrastructure SAN ability to move to new hardware instantly Grow your servers as needed
SAN IO performance Single point of failure FSCK is still here Hypervisor issues Hypervisor System Failure Risks
IO performance is mixed at best The performance can change dramatically as time passes Diagnosing IO issues on production server will be challenging BlogBench read test Source: cloudharmony.com
Cloud VM is more expensive then a dedicated server Extra hardware expense Licensing costs Management costs
Limit usage by individual user Prevent resource usage spikes Improve stability Use only what is needed Majority of shared hosting companies use only 15%-30% of their server resources
Host with Provider Amazon AWS, GoGrid, VPS.net, hundreds of other Low start up cost No advanced expertise needed Higher long term costs Deploy Your Own OnApp, Citrix, Parallels, OpenStack, VMware, Significant investment in hardware SAN is costly & not trivial to maintain Achieve additional offering
Turn-key, HW-agnostic solutions and packages Self-service provisioning, administration Simple, yet capable UI API accessibility for programmatic control Elastic scalability Use-based pricing Publicly accessible, multitenant architecture
Xen & KVM support High Availability Automatic failover SAN Customer Isolation Module Templates, API Control Panel HostBill, WHMCS, Ubersmith
True Industry standard Compatibility among clouds 89 companies & growing Open Source Supports multiple hypervizors Hyper-V Xen KVM VMWare Object Store
Memory Management de-duplication Compression vstorage VMFS Clustered File System Better IO Direct driver model PV guest SCSI drivers Network traffic shaping
Softlayer OnApp, VMware, Parallels Private or public clouds GNAX VMWare Private or public clouds VPS.net OnApp Public cloud only
Holy Grail? Combine multiple servers into one Possible, yes - practical, no Research mostly Network/memory latency OpenSSI.org Kerrighed.org XtreemOS.eu
Fault tolerance No single point of failure Easy upgrades Scalability Simplified backups
Complexity Software failures Configuration issues Human Errors Monitoring Shared storage Roll your own solution Expensive
NFS Time tested, well known GlusterFS FUSE based (slow) new Lustre highly scalable used in high performance optimized for 1MB+ files well Supported XtreemFS FUSE based (slow) Used by XtreemOS
NGINX HTTP and reverse proxy server Supports caching Simple load balancing & fault tolerance Live configuration updates Varnish Cache State of the art web accelerator Sophisticated caching Load balancing VCL Varnish Configuration Language
Multiplatform SSL Tunneling Proxy No need to restart Apache Varnish doesn t support SSL
MPM Worker or Event Serving PHP FCGID fast/memory hungry suphp slow/easy to maintain DSO fast/insecure MPM ITK mixed speed/insecure Virtual Host Standard vhost configurations mod_vhost_alias (no ssl) Custom module
No single point of failure Replication Synchronization Rolling restarts NDB storage engine NDB!= InnoDB Foreign keys Large Row Support Join Performance
FTP Shared storage DB or plain config driven Mail MailDir, shared storage Postfix, Qmail DNS Bind DLZ Outsource / Anycast
Very high density 10,000-15,000 web sites per server Site isolation via CloudLinux Part of POA NFS Clustered MySQL This service module is an ideal solution for service providers who have a large number of hosted, shared websites and want to reduce their operating costs.
Apache or LiteSpeed, IIS Auto-scale capability MySQL master/slave NFS API
Part of NodeWorx Load balance servers Add/Remove nodes
Based on Redhat Cluster Suite Works with cpanel Automatic config propagation Automatic reconfiguration on service failure Requires InfiniBand or 10GE between nodes
Domino Effect One site can take down multiple servers Monitoring is reactive Site isolation is crucial Mini-clusters (3-6 servers per cluster) CloudLinux can prevent issue before they happen. Resource isolation is real time CloudLinux delivers exact metrics
Lightweight CPU/Concurrent Connection/Memory limits Transparent to administrator No need to setup per customer limits Easy to monitor resources usage on per user bases
# lvetop _ ID EP PNO TNO CPU MEM I/O maximpym 0 0 0 3% 552 0 entroise 0 0 0 0% 656 0 austrntr 0 0 0 0% 364 0 nguye021 1 2 2 0% 0 0 # lveps _ -p ID EP PNO PID TNO TID CPU MEM I/O lykbla21 1 2 --- 2 --- 1035 39972 0 --- --- 641306 --- 641306 0 33236 N/A --- --- 641287 --- 641287 0 21100 N/A austrntr 1 1 --- 1 --- 53085 42304 0 --- --- 639415 --- 639415 0 21248 N/A # lveinfo _ --display-user --period=20m ID acpu mcpu lcpu aep mep lep amem mmem lmem MemF MepF Southkra 1 24 25 0 1 20 72K 444K 1G 0 0 thefrtro 0 16 25 0 3 20 2M 91M 1G 0 0 duelisto 0 7 25 0 2 20 827K 48M 1G 0 0 austrntr 0 7 25 0 1 20 701K 20M 1G 0 0 floraxd2 0 9 25 0 2 20 147K 34M 1G 0 0 adobemul 0 2 25 0 0 20 1K 336K 1G 0 0 aggretra 0 5 25 0 0 20 62K 5M 1G 0 0 forlobis 0 2 25 0 1 20 120K 30M 1G 0 0 nguye021 0 6 25 0 2 20 9M 86M 1G 0 0 albursib 0 2 25 0 1 20 109K 27M 1G 0 0
Linux Distribution based on RHEL source RPMs Binary compatible with RHEL 5.x/6.x and CentOS 5.x/6.x Made for Shared Hosting Companies Focus on Stability and Security 24/7 Commercial Support Affordable for Companies of any Size CloudLinux delivered patches for several local exploits days before RHEL and CentOS
100+ Dedicated Server providers 500+ Shared Hosting Companies Nearly 5000 Servers are running CloudLinux
Most Customers Deploy CloudLinux To Existing Production Servers
Efficiency Stability Profits Better Control Increased density Less outages and downtime Less time spent finding resource hogs and suspending customers More stable servers means better performance No more resource hogs Better Security Lower costs to run and manage your business Lower support costs Reduces costs for hardware
CloudLinux is the only server operating system designed to address the specific challenges of a shared hosting environment. CloudLinux Lightweight Virtual Environment (LVE) allows sysadmins, precise, account level control over the resources available to each hosted site. Memory, CPU usage, and Concurrent Connection limits can be adjusted and monitored for each customer.