APM & DEVOPS CHALLENGES & ENABLERS M. Hanin, Hannover, 26.03.15
AGENDA APM & DEVOPS LINK & KEY QUESTIONS APM WHAT YOU NEED TO KNOW? DEVOPS WHAT YOU NEED TO KNOW? REAL LIFE APM & DEVOPS SUMMARY 2
AGENDA APM & DEVOPS LINK & KEY QUESTIONS APM WHAT YOU NEED TO KNOW? DEVOPS WHAT YOU NEED TO KNOW? REAL LIFE APM REAL LIFE DEVOPS SUMMARY 3
APM & DEVOPS SIMPLIFIED Source: NewRelic APM simplified is about monitoring performance from the end user perspective down to the code level DevOps simplified is about improving the collaboration between Dev & Ops through culture, automation, and continous feedback 4
AGENDA APM & DEVOPS LINK & KEY QUESTIONS APM WHAT YOU NEED TO KNOW? DEVOPS WHAT YOU NEED TO KNOW? REAL LIFE APM & DEVOPS SUMMARY 5
WHY APM? INCREASING COMPLEXITY, DYNAMICS & BUSINESS IMPACT OF MODERN APPS 5 Drivers to adopt APM Application Architecture Complexity mainframe, web, JEE, SOA, mobile System Infrastructure Complexity HW, ESX, OS, JVM, App. Server Dynamic load and usage patterns Web, mobile, cloud High Delivery Rate Agile, DevOps Application Economy e-commerce, marketing, CRM 6
WHAT S APM THE SOLUTION TO MASTER COMPLEXITY IN THEORY! 5-DIMENSIONAL INDUSTRY STANDARD FOR APM 1. END-USER EXPERIENCE MONITORING ACTIVE, REAL USER MONITORING 2. USER-DEFINED TRANSACTION PROFILING TRACING, LOGGING 3. APPLICATION COMPONENT DISCOVERY AND MODELING AUTOMATIC, MANUAL 4. APPLICATION COMPONENT DEEP-DIVE MONITORING BCI, AOP, SQL TRACING 5. APM DATABASE CAPABILITIES PMDB, PERFORMANCE DWH, BI Source: Gartner, Feb. 2010 - Magic Quadrant for Application Performance Monitoring 7
WHAT S APM? THE SOLUTION TO MASTER COMPLEXITY IN THEORY! 5 MAIN REASONS HINDERING LARGE ADOPTION OF APM OPS ARE STILL STRUGGLING WITH EVENT MGMT AND SERVICE MODELING APM ROLL-OUT IN LARGE ORGANIZATION REQUIRES MATURE CONFIGURATION AND DEPLOYMENT MGMT ADOPTION APM MEANS INTRODUCING NEW TECHNOLOGIES AND ADMINISTRATION COSTS TO THE ALREADY EXPENSIVE OPS/MONITORING APM REQUIRES ANOTHER SKILLS SET FOR OPS APM ROLL-OUT REQUIRES A CLOSE COLLABORATION BETWEEN APPS/DEV AND OPS 8
WHAT S APM? PERFORMANCE ENGINEERING MORE THAN MONITORING APPLICATION PERFORMANCE IN OPS END-TO-END PERFORMANCE SCENARIO DRIVEN REQUIREMENT MODELLING APPLICATION-CENTRIC MEASUREMENT & MONITORING LIFE-CYCLE INTEGRATION & CONTINUITY ENGINEERING: PROVEN, ADAPTIVE AND RE-USABLE WORKFLOWS, TECHNIQUES AND TEMPLATES 1. BUILD / INTEGRATION PHASE 2. PRE-PRODUCTION / ACCEPTANCE PHASE 3. PRODUCTION / OPERATING PHASE APEP, adhoc 2002 9
WHAT S APM? HOW TO INTEGRATE APM, TESTING AND CI? CONTINUOUS PERFORMANCE ENGINEERING Continuous Performance Engineering combines: Continuous Integration (CI) & Code QA Performance Testing Continuous Integration & code QA Load & Performance Testing Application Performance Management Application Performance Monitoring Performance Engineering is the practice of proactively assuring application performance across the whole life cycle based on dedicated roles, workflows, tools and artifacts for Development performance QA, Performance testing and APM Continuous Performance Engineering is an optimized implementation of PE which maximizes reuse, and/or automation of Continuous Integration, code QA, Performance Testing and APM technologies, workflows and artifacts through the application life cycle 10
AGENDA APM & DEVOPS LINK & KEY QUESTIONS APM WHAT YOU NEED TO KNOW? DEVOPS WHAT YOU NEED TO KNOW? REAL LIFE APM & DEVOPS SUMMARY 11
WHY DEVOPS? INCREASING NEED FOR FREQUENT AND HIGH QUALITY RELEASES BUSINESS IS REQUIRING INCREASED IT SERVICE DELIVERY AGILITY CONTINUOUS INJECTION OF NEW FEATURES WHILE KEEPING HIGH QUALITY AND PERFORMANCE EARLY DETECTION OF QUALITY ISSUES SMALLER CHANGE SCOPE TO REDUCE COMPLEXITY LESS TIME & RESOURCES TO FIX ISSUES 12
WHAT S DEVOPS THE NEW PHILOSOPHY FOR COLLABORATION BETWEEN DEV & OPS IN THEORY! 5-DIMENSIONAL APPROACH 1. CULTURE 2. AUTOMATION 3. LEAN 4. MEASUREMENTS 5. SHARING Source: NewRelic 13
WHAT S DEVOPS THE NEW PHILOSOPHY FOR COLLABORATION BETWEEN DEV & OPS IN THEORY! 5 REASONS HINDERING THE ADOPTION OF DEVOPS 1. GOALS TRADE-OFF DEV VS.OPS: CHANGES VS. STABILITY 2. INCONGRUENT PROCESSES & TOOLS 3. CONTINUOUS DOES NOT INLUDE QA AND OPERATIONS 4. APPLICATION VS. INFRASTRUCTURE FOCUS 5. DIFFERENT SKILLS SET AND REFERENCES MODELS 14
AGENDA APM & DEVOPS LINK & KEY QUESTIONS APM WHAT YOU NEED TO KNOW? DEVOPS WHAT YOU NEED TO KNOW? REAL LIFE APM & DEVOPS SUMMARY 15
REAL LIFE APM DASHBOARDS (1) 16
REAL LIFE APM DASHBOARDS (2) 17
REAL LIFE APM & DEVOPS THE DEVOPS LIFECYCLE - A RAPID RELEASE CYCLE WITH A STRONG FEEDBACK LOOP 10 STEPS BEST PRACTICES/TOOLING 1. CHECK IN CODE 2. BUILD THE APP 3. QA & TEST 4. STORE ARTIFACTS 5. DEPLOY AND RELEASE 6. CONFIGURE ENVIRONMENT 7. UPDATE DATABASES 8. UPDATE APPS 9. PUSH TO USERS 10. APPLICATION MONITORING 1. SVN/GIT 2. MAVEN/ANT 3. CONT. INTEGRATION 4. SONAR, JUNIT 5. VIRTUAL SERVICES 6. SELENIUM 7. CONT. APM/PE 8. CONTINUOUS DEPLOYMENT 9. APM 10. ANALYTICS Source: NewRelic 18
REAL LIFE APM & DEVOPS UNIFIED MONITORING ARCHITECTURE PATTERNS TO EMBED APM INTO OPS MONITORING 19
REAL LIFE APM & DEVOPS CONTINUOUS QA FACTORY PATTERNS TO EMBED QA & APM INTO DEV BUILD & CI 20
AGENDA APM & DEVOPS LINK & KEY QUESTIONS APM WHAT YOU NEED TO KNOW? DEVOPS WHAT YOU NEED TO KNOW? REAL LIFE APM & DEVOPS SUMMARY 21
SUMMARY (1) APM, NG MONITORING & QA ENABLERS FOR REAL DEVOPS A PRE-ESTABLISHED APM DISCIPLINE MAKES THE ADOPTION OF DEVOPS EASIER. APM SOLUTIONS NEED TO PROVIDE DEVOPSE-NABLING CAPABILITIES PERFORMANCE & APM ENGINEERS CAN FORM THE INITIAL KERNEL OF A DEVOPS TEAM APM INITIATIVE FOR DEV NG QA & TEST SCOPE : EMBED APM INTO CI & QA LOOP PATTERN: CONTINUOUS QA FACTORY WHICH INTEGRATES APM, QA AND DEPLOYMENT AUTOMATION APM INITIATIVE FOR OPS NG MONITORING SCOPE: EMBED APM INTO INFRASTRUCTURE MONITORING PATTERN: UNIFIED MONITORING ARCHITECTURE WHICH INTEGRATES APM AND INFRASTRUCTURE MONITORING 22
SUMMARY (2) DEEP-DIVE INTO APM & DEVOPS Session 1 (10:00 bis 11:00 Uhr): DevOps - state of the art and trends Dr. Nabil Ouerhani, Haute Ecole Arc Ingénierie, Neuchâtel, Suisse Session 2 (11:15 bis 12:15 Uhr): How to break IT organisations silos with APM? Karsten Flott, Technology Engineer, Appdynamics Mittagspause (12:15 bis 13:30 Uhr) Special Session 3 (13:30 bis 15:30 Uhr): DevOps on System z - it's not just a Dream! Einführung Rene Meyer, IBM Rational IT Specialist Beispielprojekt der UBS Marcel Daeppen, UBS CTO and Head of Application Technology on Mainframes DevOps on System z Community Thomas Pohl, IBM System z Firmware Development Session 4 (16:00 bis 17:00 Uhr): Etablierung einer APM Disziplin Ein Erfahrungsbericht Fabio Attili, Project Manager APM@Helvetia, Helvetia Basel 23
Q/A SESSION