Data Center Automation with YADT Berlin 23.05.2013 Schlomo Schapiro Systems Architect, Open Source Evangelist License: http://creativecommons.org/licenses/by-nc-nd/3.0/
www.immobilienscout24.de >2 billion PI per month 2 data center with ~1400 VM total of ~600 employees ~30 crossfunctional IT teams ~160 in IT 15 years in business part of Deutsche Telekom Slide 2 Data Center Automation with YADT Schlomo Schapiro
Slide 3 Data Center Automation with YADT Schlomo Schapiro
Systems Management with YADT Slide 4 Data Center Automation with YADT Schlomo Schapiro
The Big Picture Continuous Delivery Platform Business Decision To Go Live All Humans are on the Same Side Config Deploy Test Systems- Management Automation Scale Out Data Centers Slide 5 Data Center Automation with YADT Schlomo Schapiro
1st task: Reduce Systemic Complexity File Management Systems Management Slide 6 Data Center Automation with YADT Schlomo Schapiro
File Management with RPM & YUM Slide 7 Data Center Automation with YADT Schlomo Schapiro
File Management with RPM & YUM Libraries Applications Configuration Operating System 100 % Slide 8 Data Center Automation with YADT Schlomo Schapiro
File Management with RPM & YUM Configuration DEV Application YUM Repos QA Infrastructure PROD Slide 9 Data Center Automation with YADT Schlomo Schapiro
File Management with RPM & YUM Configuration DEV Application YUM Repos QA Infrastructure Interface PROD Slide 10 Data Center Automation with YADT Schlomo Schapiro
Configuration Pre-built Config Content Configuration DEV Application YUM Repos QA Infrastructure PROD Slide 11 Data Center Automation with YADT Schlomo Schapiro
Configuration Pre-built Config Content SVN YUM Repo commit config file build config RPM RPMs with static content Slide 12 Data Center Automation with YADT Schlomo Schapiro
Configuration Pre-built Config Content SVN YUM Repo commit config file build config RPM Templating Variables Overlaying RPMs with static content Slide 13 Data Center Automation with YADT Schlomo Schapiro
Configuration Pre-built Config Content SVN YUM Repo commit config file build config RPM Templating Variables Overlaying we use 1 RPM per host RPMs with static content Slide 14 Data Center Automation with YADT Schlomo Schapiro
Configuration Pre-built Config Content SVN YUM Repo commit config file build config RPM Shared responsability Ops, Dev, QA... Templating Variables Overlaying we use 1 RPM per host RPMs with static content Slide 15 Data Center Automation with YADT Schlomo Schapiro
Application Continuous Release Delivery Configuration DEV Application YUM Repos QA Infrastructure PROD Slide 16 Data Center Automation with YADT Schlomo Schapiro
Application Package Promotion Pipeline DEV Pre-PROD PROD YUM Repo YUM Repo YUM Repo Comitted Repo Tested Repo Released Repo Slide 17 Data Center Automation with YADT Schlomo Schapiro
Application Package Promotion Pipeline Deploy & Test Deploy & Test Deploy & Test DEV Pre-PROD PROD CI YUM Repo Comitted Repo Autopromote release if tests OK YUM Repo Tested Repo Business decision to Go Live with tested versions YUM Repo Released Repo Slide 18 Data Center Automation with YADT Schlomo Schapiro
File Management through many YUM repositories Configuration DEV Application YUM YUMRepo YUM YUMRepo Repo Repo QA Infrastructure PROD Slide 19 Data Center Automation with YADT Schlomo Schapiro
Systems Management with YADT Slide 20 Data Center Automation with YADT Schlomo Schapiro
YADT Unified Dependency Tree Load Balancer HTTPD Tomcat Web Server App Server Slide 21 Data Center Automation with YADT Schlomo Schapiro
YADT Unified Dependency Tree config webapp init script tomcat HTTPD init script httpd Tomcat Slide 22 Data Center Automation with YADT Schlomo Schapiro
YADT Large Scale System Management HTTPD config Tomcat Web Server httpd tomcat webapp Java App config App Server app Slide 23 Data Center Automation with YADT Schlomo Schapiro
YADT Large Scale System Management LB: www.immobilienscout24.de HTTPD config HTTPD config Tomcat httpd Tomcat httpd webapp webapp Web Server tomcat Web Server tomcat Java App config Java App config App Server app App Server app Slide 24 Data Center Automation with YADT Schlomo Schapiro
YADT Large Scale System Management 1st chunk LB: www.immobilienscout24.de HTTPD config HTTPD config Tomcat httpd Tomcat httpd webapp webapp Web Server tomcat Web Server tomcat Java App config Java App config App Server app App Server app Slide 25 Data Center Automation with YADT Schlomo Schapiro
YADT Large Scale System Management 1st chunk LB: www.immobilienscout24.de 2nd chunk HTTPD config HTTPD config Tomcat httpd Tomcat httpd webapp webapp Web Server tomcat Web Server tomcat Java App config Java App config App Server app App Server app Slide 26 Data Center Automation with YADT Schlomo Schapiro
Systems Management with YADT Reduce Systemic Complexity Keep It Simple Slide 27 Data Center Automation with YADT Schlomo Schapiro
Automation is our Continuous Delivery Platform Business Decision To Go Live All Humans are on the Same Side Config Deploy Test Systems- Management Automation Scale Out Data Centers Slide 28 Data Center Automation with YADT Schlomo Schapiro
DevOps We build it together as one team. We understand it completely. And it is fully automated. Slide 29 Data Center Automation with YADT Schlomo Schapiro
www.yadt-project.org Stand 7.1C145 Slide 30 Data Center Automation with YADT Schlomo Schapiro
Slide 31 Data Center Automation with YADT Schlomo Schapiro go.schapiro.org/slides
Thank you very much! Please contact me for further questions and discussions. Kontakt: Immobilien Scout GmbH Andreasstraße 10 10243 Berlin Fon: +49 30 243 01-1229 Email: schlomo.schapiro@immobilienscout24.de URL: www.immobilienscout24.de All images are either public domain, used in appropriate context or taken from openclipart.org Slide 32 Data Center Automation with YADT Schlomo Schapiro