Jenkins World Tour 2015 Santa Clara, CA, September 2-3

Transcription

1 1 Jenkins World Tour 2015 Santa Clara, CA, September 2-3

2 Continuous Delivery with Container Ecosystem Platform Equinix - Overview CAD Current Industry - Opportunities Monolithic to Micro Service Continuous Delivery with Containers Demo Q&A Presenters: Ramchandra Koty Kalidas Ganesan Venkat Rangasamy Prepared By: Global SAE, Global IT Confidential 2015 Equinix Inc. Equinix.com 2

3 Platform Equinix Overview Experience as Global Market Maker 17+ years Data Center Operational Excellence Global Innovator & Thought Leader Interconnection / Peering exchanges Global Portals based on multiple patents Supporting Key Communities of Interest Network, cloud, content, financial services, and enterprise ecosystems 3 Confidential 2015 Equinix Inc. Equinix.com 3

4 Equinix Software Capabilities Product Ecosystem Continuous Delivery Ecosystem Cloud Web App APIs Mobile Apps Data Science Big Data & Analytics Digital Marketing Infrastructure Ecosystem Technology Ecosystem Microservices Open Source Contribution & more Confidential 2015 Equinix Inc. Equinix.com 4

5 How a Continuous Delivery Process can be Visualized? Source: Confidential 2015 Equinix Inc. Equinix.com 5

6 Equinix CAD Team (CADBees) is platform enabler that provides tools & frameworks to accelerate application delivery, automate Dev-2-Deploy cycles & foster Dev collaboration Business Objectives Success Factors Enable Agile & Self-Service Application Development Continuous Delivery Continuous Integration Application Accelerators (Dev-2-Deploy) E-2-E Automation of Dev-2-Deploy processes Intelligence in Business as usual Integrate Dev Tools for high developer productivity Continuous Innovation Configuration Management Continuous Delivery Support for Mobile, Cloud & Big Data Platforms Continuous Application Delivery (CAD) Platform Continuous Integration Automated Environment Orchestration Dev Plugins & Adapters Artifacts Management Custom Monitoring Application Monitoring Tools Standard Monitoring Software Code & Configurations Code Administration Code & Configuration Deployments Quality of Services Centralized Code Governance Runbook Execution Agility Practices in Dev Confidential 2015 Equinix Inc. Equinix.com 6

7 Current Industry Trends Cloud Containers Micro-services Confidential 2015 Equinix Inc. Equinix.com 7

8 Current Industry Trends nodjs nodjs nodjs Play Play Play Angular JS Angular JS Angular JS Redis Redis Redis nodjs nodjs Tomcat + Cloud Private Cloud = Public Cloud Globalize your workload On-Demand and rapid Elasticity Cloud bursting Confidential 2015 Equinix Inc. Equinix.com 8

9 Current Industry Trends App Source Code Pull the Source code in target machine Compile make install Source Code (Application) App Artifacts + App Artifacts Compile the Source code in Build Box Pull the App artifacts from target machine Install Sys Utils / App Runtime Containers Source Code (Sys Utils / App Runtime) Binaries (Sys Utils / App Runtime) = Pull the Source code in target machine & Compile it Install rpm / bin package Install via yum (package manger ) to handle the dependencies OS templates Install all the s/w and create template Create a cookbook make the server to level what we want (Phoenix Servers) Use packers to move OS image to different Hypervisors Docker OS templates Docker OS + utilities + App Runtime + App artifacts Changes are versioned Immutable Servers Easy to share Confidential 2015 Equinix Inc. Equinix.com 9

10 Current Industry Trends Monolithic application puts all its functionality into single deployable application Microservice architecture puts each elements of functionality into separate service Key Highlights Small, easy to understand code base Loosely coupled service with bounded contexts (Modularity) Each micro-service can be deployed independently. Suitable to implement and support multiple versions of APIs Micro-services Scaling can be individual modules level Monolithic / Layered Microservices Ability to use a different technology stack (polyglot) Microservices + Containers a convergence of perfectly matched technical approaches to building scalable systems Confidential 2015 Equinix Inc. Equinix.com 10

11 Let s Deep Dive Confidential 2015 Equinix Inc. Equinix.com 11

12 Cloud: Multi-Cloud Application Deployment Equinix Equinix PROTOTYPE Steps Provision Cloud Exchange Ports Setup User Access Build Docker Container for the App Ship the Container to the required Cloud Environments Move App specific Docker Containers to Multi-Cloud leveraging Cloud Exchange Validate the Multi-Cloud Deployment Confidential 2015 Equinix Inc. Equinix.com 12

13 Containerization in Equinix - Build, Ship, Run App Container Repo Redis nodjs Pull Image 4 My Application nodjs Play Key Highlights Cloud Native readiness Changes are versioned B U I L D nodjs Build Box Push Image Build Image 2 3 D E P L O Y 5 Redis nodjs App runtime Internal Execution unit Eliminate inconsistencies between development, test, production environments ( Immutable) Faster Env setup CLI + REST API Significantly improves the speed & reliability of continuous deployment Base Image 1 Configuration Change Major Tools/ Approaches lmctfy RunC Jetpack OCP AppC Confidential 2015 Equinix Inc. Equinix.com 13

14 External Systems Microservice Orchestrator Microservices in Equinix NSP Portal CSP Enterprise Microservice Management Capabilities (Discovery, Config, Routing, etc.) Workflow Manager and Execution Engine API Developers Equinix SDN Key Highlights Simple design focused on one business capability Can be developed independently by different teams Published integration model Granular independent components Smart endpoints and dumb pipes Utilize HW and OS resources to maximum Challenges Cloud aware services Tagging and Branching strategy Continuous deployment New Micro-service CI/CD onboarding Micro-service endpoints management Confidential 2015 Equinix Inc. Equinix.com 14

15 Equinix What we learned from Monolithic App Deployments NO more single Artifact Number of artifacts are increased due to micro-services architecture NO centralized Release Repository Keeping records of different artifact promotion is cumbersome. NO Artifact Rollback from strategy Not having option to deploy the PROD Artifact in the lower environment NO Single Jenkins job / Pipeline Most of the time Micro-services code are resides in multiple code repo. With the default option of Jenkins, we can t go with single Jenkins job to build and deploy it NO Service Decommission (Self-serviceable) Micros-services can co-exist with multiple version. Some time, later we need to decommission the services manually NO Second Line Service Deployment There is no Blue-Green line deployment to have minimized Production deployment downtime window. & Yes, we need all the above mentioned features to empower and govern the overall Micro-services CI & CD Platform Confidential 2015 Equinix Inc. Equinix.com 15

16 Equinix Build & Deployment Approach Approach ( Deployment Job will take the artifact from Nexus Artifactory) Build - Job INT - Job Production- job Workspace Workspace Workspace Same Build job for all Micro-services Store Artifacts in centralized Release Execution Log Execution Log Execution Log Repo Predictable Storage growth to store Artifactory Artifacts Blue-Green line deployment INT (3) QA (3) PRODUCTION (Never) Zero downtime Deployment Decommission Tools Confidential 2015 Equinix Inc. Equinix.com 16

17 CI/CD Equinix Step by Step Guide to Deploy an Application via Docker 1. How to Build a Docker Image Take the Base RHEL 7.0 image from RedHat Install needed utilities ( wget, tar) Install App Components Inject startup scripts Push to Internal Docker Registry + 2. App Artifact 1. Docker Image 3. App Containers 2. Building Application Artifact Check-out the code from SVN/Github Build the Artifact using Build Tool Bundle Along with SSI / properties 3. Running an App Container Pull the latest Docker (App) Image Run the Docker container with Jenkins Job ID to pull the artifact Bundle Pass the SSI specific Values Expose the App Port to Host Image Mount the Log Volume Allocate the shared CPU / Memory Start Container Same Steps will be followed for all Environment. No Release Specific Images Confidential 2015 Equinix Inc. Equinix.com 17

18 Other Industry demands in CAD Space Security o Authentication o Permission management o Role Management o Accountability of Actions performed o Auditable Action Self- serviceable o Employ the Resources for better tasks o Cut down the wait time for regular Work o More Automation, less human mistake Operational Analytics o Ecosystem Current State in terms of release o Usage Metrics o Deviation metrics User Experience o CSS Skinning (Branding) o Keep the information what they want o Simple outside; complex inside Confidential 2015 Equinix Inc. Equinix.com 18

19 Jenkins Equinix CAD Branding CSS Skinning done to Jenkins to look like Equinix portals Authentication / Authorization Used JIRA crowd plugin to integrate the user authentication /authorization. Multiple Git Repository Support Default Jenkins support One Repo, Customized to support multiple repositories Configuration history and Audit Used job configuration history, Audit 2 database, Audit Trial Plugins Dynamic Parameter Choice Support Used Uno Choice Plugin Jenkins Build Status Used Green Ball Plugin to Show the success build status in Green in color Hidden input filed Used JavaScript to hide the input fields Jenkins Build Name Override the Build Name to identify what micro service/ tag got built/deployed Jenkins Pipeline This Help us to visualize and enforce the SDLC. And helps in avoiding direct deployment to production. Groovy scripts Used in system integration ( like get the artifact version from Nexus) Confidential 2015 Equinix Inc. Equinix.com 19

20 Jenkins Equinix Continuous Integration & Continuous Delivery Build Integration QA & UAT Production Self-Serviceable Enforces Deployment process Auditable User Notification Nightly Integration Build Code Analysis Test Coverage Code Coverage Scheduled job Enforces Code Quality Results / report published to DEV team User Notification Confidential 2015 Equinix Inc. Equinix.com 20

21 Demo Confidential 2015 Equinix Inc. Equinix.com 21

22 Thanks to our Sponsors! #jenkinsconf Footer

23 Reach out to us Ramchandra Koty Kalidas Ganesan Venkat Rangasamy Confidential 2015 Equinix Inc. Equinix.com 27