How Docker Helped to Scale a Developer SaaS Platform. Mayur Suresh Shah, Sr. Product Manager, WaveMaker Inc.

Transcription

1 How Docker Helped to Scale a Developer SaaS Platform Mayur Suresh Shah, Sr. Product Manager, WaveMaker Inc.

2 Agenda Introduction Containers and Docker Multi User Developer SaaS platform Enterprise Requirement Our Considerations Docker Optimizations Benefits

3 Introduction Our goal was to develop a Platformthat allows Developersto collaborate in real time and create modern responsive web applications. The Platform should be always accessible via a Web Interface. The platform will potentially need to scaleto support thousands of concurrent developers at once. The platform will need developers to build, test, runand deploy applications.

4 No Comprises Developers Full Fledged Platform Build, Test, Run and Deploy Apps Application Lifecycle Management DEV, STAGE, PROD Faster setup, provisioning and deployment Platform Application Portability with Dependencies Easy Management Developer Isolation (Data, State and App)

5 CONTAINERIZATION AND DOCKER

6 What is Docker? Open-Sourceproject that automates the deployment of applications inside software containers, by providing an additional layer of abstraction and automation of operatingsystem-level virtualization on Linux. Uses cgroups and namespaces in the Linux kernel to create lightweight virtualized OS environments True Portability

7 Container Portability

8 Docker means greater Resource Utilization and Efficiency Virtual Machines Containers Source: Docker (

9 MULTI USER DEVELOPER PLATFORM NEEDS?

10 Developer Platform Requirements Multi User Browser Based Developer Sandbox Develop & Deploy Unified Experience Fast Provisioning Application Stack

11 Docker Benefits Application Stack Management Docker Packages, Images, Pre-Defined Stacks Portability DEV, STAGE, DEPLOY Application Stacks and Custom App Lightweight and Efficient faster provisioning and smaller size for easier portability Seconds to create, bundle and deploy Application Stacks Better Resource Utilization Minimize CPU, Disk, Memory

12 BY THE WAY, WE HAD ENTERPRISE REQUIREMENTS TO BE MET

13 Developer Platform Additional Enterprise Requirements Load Balancing Backup Restore Multi-Tenant Service Discovery Data Isolation

14 AND WHAT ABOUT OUR PRIORITIES AS A SAAS VENDOR

15 And Most Importantly We Needed to Minimize Cost Smooth DevOps Always ON

16 ENHANCEMENTS ON TOP OF DOCKER TO MEET ENTERPRISE REQUIREMENTS

17 Developer Sandbox AWS Instance Developer Developer Provision container for each Developer with similar app environment

18 Isolation Intercepts App Request Cloud Platform Developer App Requests Developer Dispatches request to Container allocated to individual Developer

19 Container Provisioning Compose images with required software packages V5.6 IMAGE REGISTRY Docker Image App-Stack Libraries Provisioning algorithm for allocation and freeing unused container resources Containers IMAGE A OS V7.0 IMAGE B Provisioning v1.7 DOCKER FILE DevOps Use standard shell commands to install package versions and dependencies Packaging Can be On-Premise Infrastructure (eg. VMWare) or Public Cloud Instances 19

20 Understanding Docker Images Installed components using dockerfile Series of AUFS layers are created for every change to Base Image Push changes to Docker Registry Pulled from Docker Public Registry Host VM s Linux Kernel (Ubuntu, CentOS etc.) Dockerfile makes it easy for developers to declaratively specify app environment 20

21 Effective Utilization CPU & Memory used by Container is reclaimed Hibernation A snapshot of Container is taken and saved to Storage Passivation X Developer Storage Server Activation Restore the Container back to running state Passivation saves entire application state and configuration to storage for later usage

22 On-Demand Activation Returning User Platform Load Balancer Intercepts App Request Restore Virtual Server s state along with application data from Storage Activation App Request Dispatches request to restored backend node Storage Server 22

23 True Portability using Volume Layer Move & swap containers App Data resides in an attached device/volume Container Platform Stack Host VM Container Platform Stack Host VM Failed VM & Container Portable containers enable seamless Platform Stack upgrades separating Application data from Stack & libraries Reduced user data footprint allowing to move data easily for backups or recovery Containers resurrected quickly in the event of Host VM failures

24 Backups & Recovery Recovery and restore in the event of failure App A App B Automatic snapshots and backups Application data is stored in separate volumes to facilitate easier operations

25 Deployment Architecture USER CONTAINERS Backups Manager Passivatio n Server VCS Server Studio DB Log Analyzer Cloud Mgr Cloud DB Monitoring Studio Mgr EDN Mgr Access Ctrl Login Launchpad Devportal PLATFORM CONTAINERS S3 Platform LB App LB App LB Cloudfront

26 Benefits We Gained

27 Cost Benefit Using Docker Hibernation $$$$$ 80% reduced costs $$$$$ No Docker Optimizations With Docker Optimizations

28 How we transformed DEVELOPERS from 125+ countries

29