Industry Perspec.ve: DevOps - What it Means for the Average Business

Transcription

1 Accelerating Product and Service Innovation Industry Perspec.ve: DevOps - What it Means for the Average Business Michael Elder, IBM Senior Technical Staff Member mdelder@us.ibm.com hhp://linkedin.com/in/mdelder

2 Outline The Context The Challenge The Journey towards DevOps The Impact of Software Defined Environments 2

3 The Context

4 What does it mean to be average? The median market cap of companies traded on the NYSE is $1.9 Bln According to US Census data more than 50% of employer firms have 4 or fewer employees (2007) Companies with 5K or more employees only make up about 0.03% of all employer firms (but account for about 1/3 of all employees) (2007) But regardless of market cap or company size, all businesses are competing under a very different set of market conditions than we knew even 5 or 10 years ago 4

5 The next billion dollar idea starts with a single developer That developer starts with a single line of code 5

6 All businesses must think and act a bit (or a lot) like entrepreneurs 1. Entrepreneurs are everywhere. In garages and large organizations, there are people focused on the creation of a new product or service under conditions of extreme uncertainty. Hence, these principles apply to organizations of all sizes. 2. Entrepreneurship is management. To quote Eric Ries, a "startup is an institution, not just a product" so it requires a new kind of management which can deal with extreme uncertainty. 3. Validated learning. We must be able to run meaningful experiments and collect hard data about what works and doesn't work. Iteration is key here, and that feeds into the next principle. 4. Build-Measure-Learn. As we learn, we must be willing to either pivot and change our approach drastically or persevere if we believe we're on the right path and iterate as our users provide their feedback. 5. Innovation accounting. We must establish the metrics and processes by which we measure progress and demonstrate improvement. It also means that we hold people responsible for outcomes. Source: Ries, Eric ( ). The Lean Startup 6

7 A SoNware Driven World Evolving market and customer expectations Changing the pace of innovation Smarter, faster, and higher quality Empowered developers Better software for an enhanced customer experience 7

8 Demands on IT have increased drama.cally Optimization Innovation Next Generation of Hybrid Architectures Innovation drives need for continuous IT optimization New economics of IT fuels investments in innovation Don t be afraid to make mistakes, just be afraid of not learning from them. Thomas Edison 8

9 SoNware Defined Environments require open communi.es to enable choice OpenPOWER Foundation Client value: Interoperability, agility, and flexibility through a common cloud compu.ng stack Client value: Unified, open, interoperable SDN plavorm to create an ecosystem of automated network services Client value: Enables broader innova.on in the industry for advanced data center technology Client value: Enables vendor flexibility for applica.on and workload portability Client value: Provide cloud users freedom of choice, flexibility, and openness as they have with tradi.onal IT Havana released 4Q2013 Developed rich support for IBM Server and Storage plajorms Launched Hydrogen version on Feb 4, 2014 Contributed OpenDOVE based on SDN- VE Formalized in December 2013 Since then, have brought on 3 addimonal PlaMnum members and 4 Silver members IBM is a founding member & plamnum sponsor IBM is a leader in code contribumons 460+ organizamons parmcipate IBM founding sponsor 9 9

10 The Challenge

11 11

12 With only Agile Development improvements Agile Dev" Functional Testing Acceptance Testing Production Operator Setup (weeks) deploy CI builds are piling up Test and Ops teams have increased pressures to keep up with increased loads but continue to use waterfall approaches and traditional tools. 12

13 Delivery challenges with applica.on deployment Complex manual processes for deploying infrastructure lack repeatability and speed Failures due to inconsistent development and production environments Long and complex lifecycle for managing infrastructure Managing large number of configurations for deploying to Hybrid Cloud Env. Request Public Provision VM Deploy Database Deploy App Server Private Develop Public,! Deploy Private!! Market test Workloads!! Cloud Bursting! How do we ensure that we deploy What we want, When we want, Where we want! 13

14 The Journey towards DevOps

15 DevOps Enterprise capability for con.nuous sonware delivery that enables clients to seize market opportuni.es and reduce.me to customer feedback People Process Technology Develop/Test Accelerate software delivery Balance speed, cost, quality and risk Steer Deploy Reduce time to customer feedback Operate 15

16 DevOps Delivers Real Business Outcomes Accelerate software delivery for faster time to value Balance speed, cost, quality and risk for increased capacity to innovate Reduce time to feedback for improved customer experience Sped from concept to prototype in 1 week, in-market in 3 months Reduced app release time by 99%, while avoiding $2.3M/year in costs Delivered new mobile experience, increased renewals 30% 16

17 DevOps is a Journey not a destination P e o p l e P r o c e s s Technology 17

18 High performing teams adopt DevOps Reference: 2013 State of DevOps Report by PuppetLabs 18

19 Examples of DevOps and Con.nuous Delivery

20 What does DevOps mean to me? Increase the opera&onal awareness of your so/ware earlier in the development process. How do you do that? Architecture Automated TesMng Automated Deployments ProducMon- Like Environments Automated Release PromoMon Process Version control of all sowware, automamon, and configuramon Why do this? Because faster feedback loops enable rapid evolu&on of ideas and therefore faster iteramons of your sowware 20

21 What are the characteristics of teams who practice DevOps? Cool factor.. seen as pushing to the next big thing in our industry Be]er communicamon between those who create and those who operate (same people in some cases) Reduced fear of breaking the build/deployment/environment Fail small before you fail all Heavy focus on experimentamon and learning Improve the speed of your feedback loop to enable rapid evolumon of ideas 21

22 Intuitive and Scalable Model Driven Deployment Composite Applications Re-usable Workflows The Where Environment Management SIT The How PROD The What Components Deployment Automation IBM Corporation 22

23 Implemen.ng a DevOps toolchain SCM Asset Repository Unit testing Test Automation Test Stubbing Environment Configuration Build / CI Server Delivery Pipeline Automated Monitoring 23

24 About your philosophy Produc.on like environments Fully automated deployments Accelerated delivery cycles Build Measure - Learn Culture of con.nual experimenta.on and learning Success is not delivering a feature; success is learning how to solve the customer s problem. 24

25 The Impact of Software Defined Environments

26 Client Challenges: Speed delivery while balancing quality, risk & cost Line-of-business Takes too long to introduce or make changes to mobile apps and services Operations Rapid app releases impact system stability and compliance >70% of budgets devoted to maintenance and operations Systems of Interaction Systems of Engagement Systems of Record CRM HR >45% of customers experience production delays 4-6 weeks to deliver even minor application changes to customers Continuous client experience Cloud-based Services DB ERP Partner value chain >50% of outsourced projects fail to meet objectives Development/Test Speed mismatch between faster moving front office and slower moving back office systems, delaying time to obtain feedback Suppliers Delivery in the context of agile 26

27 Major shins have driven the need for SoNware Defined Environments Major Shifts Past Present Speed of Business IT Supply Economic Pressure Open Technologies Fast pace was relative to largely manual processes Limited access to relatively expensive IT resources Innovation was funded by growing IT budgets Limited to few areas of the IT environment Fast pace is relative to experiences like instant movies from Netflix Easy access to virtually unlimited low cost resources (i.e. via Cloud) Innovation is funded by a shift to more cost efficient IT Available in all areas of IT environment Consumption of IT is driving providers to find ways to transform how they deliver resources in a Software Defined (programmatic) way. 27 IBM Confidential 27

28 DevOps Manages Risk Differently The adop.on of DevOps => increased velocity of applica.on delivery Application Changes Puts pressure on the infrastructure to respond more quickly SoNware Defined Environments enable you to capture infrastructure as a sonware ar.fact Infrastructure Changes IBM Corporation 28

29 A change Application is a change." Changes" " " Infrastructure Changes" 29

30 DevOps and Cloud adop.on Automating for faster delivery with DevOps and Cloud UrbanCode Deploy Manual Tradi0onal On- Premises Applications Data Mid Config Middleware O/S Virtualization UrbanCode Deploy (available with UCDP) UrbanCode Deploy w/ Pa<erns (provisioning & deployment only) Infrastructure as a Service Applications Data Mid Config Middleware O/S Virtualization IBM DevOps Services IBM PaFerns PureApplica0on System Pla;orm as a Service Applications Data Mid Config Middleware O/S Virtualization IBM Bluemix Servers Storage Networking Servers Storage Networking SmartCloud Orchestrator So@Layer Servers Storage Networking Customiza0on; higher costs; slower 0me to value Standardiza0on; lower costs; faster 0me to value 30

31 OpenStack OpenStack is a global collabora.on of developers & cloud compu.ng technologists working to produce an ubiquitous Infrastructure as a Service (IaaS) open source cloud compu.ng plavorm for public & private clouds. Platinum Sponsors Gold Sponsors Compute (core) Provision and manage large networks of virtual machines" Storage (core) Provision and manage block-based and object storage" Network (core) Provision and manage network connectivity" Dashboard (core) Enables administrators and users to access & provision cloudbased resources through a self-service portal." IBM CONFIDENTIAL Heat (core) orchestrates multiple composite cloud applications using templates" Ceilometer (shared service) Collect monitoring, metering, and other measurements Identity (shared service) Unified authentication across all OpenStack projects and integrates with existing authentication systems." Identity (shared service) Unified authentication across all OpenStack projects and integrates with existing authentication systems." 31

32 Faster and consistent applica.on environment deployments with full- stack blueprints Environment! Developers/ Testers Describe software defined resources (Compute, Network, Storage) alongside middleware and applications! Apps Application Integrators Design Environment Blueprint Middleware Config Middleware OS Config Hardware Deploy Platforms Specialists Automate environment deployment using blueprints! Compute, Network, and Storage 32

33 About version control All of your source code is likely already version controlled All of your automa.on scripts, configura.on files, tests, etc should also version controlled Your deployment process should track versions of ar.facts from your build process, but also versions all changes to configura.on proper.es and automa.on processes 33

34 IBM Bluemix Run Your Apps The developer can chose any language runtime or bring their own. Just upload your code and go. DevOps Development, monitoring, deployment and logging tools allow the developer to run the entire application APIs and Services A catalog of open source, IBM and third party APIs services allow a developer to stitch together an application in minutes. Cloud Integration Build hybrid environments. Connect to onpremises systems of record plus other public and private clouds. Expose your own APIs to your developers.! Extend SaaS Apps Drop in SaaS App SDKs and extend to new use cases (e.g,. Mobile, Analytics, Web) 34 34

35 DevOps Services: Delivery pipelines as a Service Everything can be a service in the Cloud Developer Create & edit Build Publish build Dev as a Service Build as a Service Deploy as a Service Deploy & test Running Application (Dev Space) Deploy Running Application (test) Running Application (Test Space) Promote Running Application (Prod Space) Test Monitor Test as a Service Monitoring as a Service 35

36 IBM DevOps Services for Bluemix Tools in the cloud for the cloud Web IDE Agile Planning Delivery Pipeline 36

37 About your architecture Architecture should support DevOps principles such as staged roll out, opera.onal insights, and scriptability Each resource provides some very prac.cal advice for building systems which are focused on reliability and feedback loops Release It!: Design and Deploy Produc.on- Ready SoNware Experiment!: Website conversion rate op.miza.on with A/B and mul.variate tes.ng

38 Moving from monolithic applica.ons to micro- services Monolithic app Micro services Scaling Scaling 38

39 Proper.es of a micro- service architecture Compartmentalized business capability Cross- func.onal teams Communica.on via API ONLY!! Use messaging to remove peer- to- peer dependencies REST communica.on Decentralized data Design for failure Pluggable architecture Enables con.nuous delivery 39

40 About automated deployments Visibility and automated control of your applicamon deployment process Manage applica.on components and versions Manage configura.ons across all environments Offer secure self- service capabili.es Increase transparency Ensure governance and compliancy hhps://developer.ibm.com/urbancode/ 40

41 Application environments The Where Define where components are deployed and capture configuration settings per deployment environment for an application 41

42 Deployment Processes The How Deploy Application - Orchestrate deployment of many components - Represents deploy-time dependencies Deploy Component - Create a fully automated workflow to be executed on target servers 42

43 Putting it all together Continuous Delivery On build completion, the latest artifacts are published to UrbanCode Deploy and deployed to a development or SIT environment. Before any deployments to production, manual approvals are required. After deployment, automated tests are started. If they pass, we mark the tested versions as such. The exact combination of component versions which passed tests is captured in a snapshot. 43

44 The Finale

45 Businesses Today Need to Embrace New Opportuni.es and Workloads Cloud Mobile 80% of new applications will include cloud delivery or deployment 95% of mobile traffic is data Big Data & Analytics 2,500 petabytes of big data are being generated every day Social 500 million Tweets a day; 7 million apps and websites integrated with Facebook Today s Business 45

46 "Success is not delivering a feature; success is learning how to solve the customer s problem. - Mark Cook 46

47 Copyright IBM Corporation All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others. 47