Continuous???? Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Transcription

1 ???? 1 Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

2 Application Delivery is Accelerating Surge in # of releases per app per year per app per app per app What customers expect Functionality now Accessed through multiple devices 30x Application Releases 2 Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

3 Slow time to market Long application release cycles Poor predictability Lack of end to end visibility Poor user experience Low application quality High costs Poor resource utilization, rework cycles

4 Evolution in Testing Demanding a shift-left approach Current challenges Agile and DevOps challenge testing processes Lack of proven agile testing approach and testing expertise within agile teams Applying test automation to agile projects Lack of right tools to build reusable test sets Open Source and Integration Tools Agile & Dev/Ops prefer open source Good Enough test automation Open integration in dev ecosystem is very important Mobile Devices change definition of quality Mobile is everywhere Mobile development is Agile development on steroids User experience is EVERYTHING make it critical to shift-left Improve development efficiency - Reduce the test burden - Accelerate application delivery 4 Copyright Copyright Hewlett-Packard Development Company, Company, L.P. L.P. The The information contained contained herein herein is is subject subject to to change change without without notice. notice.

5 Traditional Testing Focus is placed at the end of the software development cycle Traditional test automation is mostly based on the front end Unit Testing API / Service Testing User Interface Testing but results in a focus at the end of the software development cycle 5 Copyright Copyright Hewlett-Packard Development Company, Company, L.P. L.P. The The information contained contained herein herein is is subject subject to to change change without without notice. notice.

6 Agile Testing Agile and DevOps moves focus to the left Agile s focus on continuous testing and continuous delivery causes testing to shift left, occurring much earlier in the development lifecycle Unit Automation Service or Middle Tier Automation User Interface Testing because of it, developers become more influential even in quality assurance efforts 6 Copyright Copyright Hewlett-Packard Development Company, Company, L.P. L.P. The The information contained contained herein herein is is subject subject to to change change without without notice. notice.

7 Everything Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

8 Domain Commit CI Process Source Control Development Build Report Testing Test 16 Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

9 Tools Landscape Commit CI Process Source Control Development Build Report Testing HP Testing Test Tools 17 Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

10 High velocity innovation, multiple constraints One way flow Rapidly increasing WIP Isolated build and integration processes Manual Testing increases latency or drives limited test coverage High # defects Poor confidence in test data fosters release aversion driving more WIP InfoSec & compliance engaged late driving vulnerabilities & re-work patch in production leads to snowflake systems Business demands Planning App Development App Testing Release decision App release Deployed App Poor user experience Lack of effective customer insight and high latency drives kitchen sink requirements Waiting time for build and test environments drives desk-side builds Manual and error prone app deployments Error prone manual hand-offs and processes Locally optimized teams, measures and tools drives escalating WIP, lack of end-to-end visibility and trust

11 Removing the constraints Optional subtitle 19 HP Confidential October 14, 2015 #TakingFlight Technology Briefing Series

12 High velocity innovation Increase automation Automate everything you can Accelerate routine tasks Ensure repeatability Reduce errors

13 High velocity innovation Reduce latency integration and testing builds API driven testing Testing virtualization delivery and deployment security from dev thru prod

14 High velocity innovation Increase visibility assessment: Monitor and measure everything Constant feedback loops Prioritize business, security and dev planning Improve and iterate Visibility across teams

15 High velocity innovation, continuous delivery Rapidly increasing WIP Isolated build and integration processes Manual Testing increases latency or drives limited test coverage One way flow assessment High # defects Poor confidence in test data fosters release aversion driving more WIP InfoSec & compliance engaged late driving vulnerabilities & re-work patch in production leads to snowflake systems Business demands Planning Integration & Testing App Development Delivery & App Testing Deployment Operations Release decision App release Deployed App Poor user experience Lack of effective customer insight and high latency drives kitchen sink requirements Waiting time for build and test environments drives desk-side builds assessment Manual and error prone app deployments Error prone manual hand-offs and processes Locally optimized teams, measures and tools drives escalating WIP, lack of end-to-end visibility and trust

16 integration and testing Rapidly increasing WIP Isolated build and integration processes Manual Testing increases latency or drives limited test coverage One way flow assessment High # defects Poor confidence in test data fosters release aversion driving more WIP InfoSec & compliance engaged late driving vulnerabilities & re-work patch in production leads to snowflake systems Business demands Planning Integration integration & Testing testing App Development Delivery delivery & App Testing Deployment deployment Operations operations Release decision App release Deployed App Poor user experience Lack of effective customer insight and high latency drives kitchen sink requirements Waiting time for build and test environments drives desk-side builds assessment Manual and error prone app deployments Automate test Intelligent testing Automate test Network and Automated execution from Error prone manual infrastructure hand-offs and processes service vulnerability and Locally CI systems optimized teams, measures and tools drives deployment escalating WIP, lack virtualization of end-to-end visibility static analysis and trust

17 integration and testing HP ALM and AGM: Developers Automate test infrastructure deployment Automate test execution Intelligent testing Network and service virtualization IDE + HP ALI Dev Implement requirements defined in HP ALM HP DevInspect s Security Assistant scans as code is written within IDE Req/Tasks/Defects HP ALM and HP AGM ALI Reports Check-in Check-out Builds SCM System Source code is stored in SCM Build System Integration

18 integration and testing Automated testing: Automate test infrastructure deployment Automate test execution Intelligent testing Network and service virtualization Manage Test resources (ALM) Trigger lab deployment from CI including mobile devices Summarize test results in ALM/AGM Virtualize services and infrastructure Integration with Jenkins: Automate test scheduling, execute tests and view results as part of the build plan

19 integration and testing HP LeanFT: Automate test infrastructure deployment Automate test execution Intelligent testing Network and service virtualization Scripted functional testing Visual Studio / Eclipse (C# or Java) Nunit/Junit UFT Object Recognition Small footprint Purpose built for test-driven development (TDD), Agile Testing, natural CI integration and Dev/Ops

20 integration and testing Load and performance testing Automate test infrastructure deployment Automate test execution Intelligent testing Network and service virtualization Add LoadRunner APIs to unit tests in Visual Studio or Eclipse Execute unit tests using the LoadRunner Engine Verify output within the IDE Create LoadRunner scenario from the IDE StormRunner Load: Cloud based load testing from 1 to over 1m Vus

21 integration and testing HP Service Virtualization: Automate test infrastructure deployment Automate test execution Intelligent testing Network and service virtualization Quickly learn and configure virtual services. Simulate services, and system components as needed Eliminate delays or availability of services or components (Dev, Test) Integrated to DevOps Tool Chain Open APIs, Jenkins, Release and Lab Automation

22 integration and testing Network virtualization: Automate test infrastructure deployment Automate test execution Intelligent testing Network and service virtualization Discover and capture network conditions from real-world Recreate network conditions in Dev, Test and Ops environments Analysis with code level automated optimization recommendations Integrated to DevOps Tool Chain Open APIs, Vendor Neutral, Automated Results.

23 integration and testing HP Fortify Application Security Testing Static Analysis Fortify SCA Automate test infrastructure deployment Dynamic Analysis WebInspect Automate test execution Application Protection HP Application Defender Intelligent testing Source Code Mgt. System Static Analysis Via Build Integration Dynamic Testing in QA or Production Real-time Protection of Running Application Hackers & Actual Attacks Vulnerability Management Remediation IDE Plug-ins (Eclipse, Visual Studio, etc.) Correlate Target Vulnerabilities with Common Guidance and Scoring Fortify on Demand Normalization (Scoring, Guidance) Software Security Center Defects, Metrics and KPIs Used to Measure Risk Application Lifecycle Developers (onshore or offshore) Correlation (Static, Dynamic, Runtime) Vulnerabilit y Database Development, Project and Management Stakeholders Threat Intelligence Rules Management

24 delivery and deployment Rapidly increasing WIP Isolated build and integration processes Manual Testing increases latency or drives limited test coverage One way flow assessment High # defects Poor confidence in test data fosters release aversion driving more WIP InfoSec & compliance engaged late driving vulnerabilities & re-work patch in production leads to snowflake systems Business demands Planning Integration integration & Testing testing App Development Delivery delivery & App Testing Deployment deployment Operations operations Release decision App release Deployed App Poor user experience Lack of effective customer insight and high latency drives kitchen sink requirements Waiting time for build and test environments drives desk-side builds assessment Manual and error prone app deployments Fail forward Infrastructure Declarative based Pipeline vulnerability Error prone manual hand-offs and processes as code topology models management Locally optimized teams, measures protection and tools drives escalating WIP, lack of end-to-end visibility and trust

25 delivery and deployment HP Codar: Declarative based topology models Pipeline management Infrastructure as code Fail forward With protection Model Based Deployments Infrastructure as Code Increased visibility Pipeline Management Quick time to automate Topology App Designs Integrated to DevOps Tool Chain Open APIs & Jenkins integ.

26 delivery and deployment Service Virtualization Declarative based topology models Pipeline management Infrastructure as code Fail forward With protection Quickly learn and configure virtual services. Simulate services, and system components as needed Eliminate delays or availability of services or components (Dev, Test) Integrated to DevOps Tool Chain Open APIs, Jenkins, Release and Lab Automation

27 delivery and deployment Service Virtualization HP Application Defender Declarative based topology models Pipeline management Infrastructure as code Fail forward With protection Identify threats in real-time Stop attacks from inside the application Pinpoint vulnerabilities for efficient remediation Protect vulnerabilities in production

28 operations Rapidly increasing WIP Isolated build and integration processes Manual Testing increases latency or drives limited test coverage One way flow assessment High # defects Poor confidence in test data fosters release aversion driving more WIP InfoSec & compliance engaged late driving vulnerabilities & re-work patch in production leads to snowflake systems Business demands Planning Integration integration & Testing testing App Development Delivery delivery & App Testing Deployment deployment Operations operations Release decision App release Deployed App Poor user experience Lack of effective customer insight and high latency drives kitchen sink requirements Waiting time for build and test environments drives desk-side builds assessment Manual and error prone app deployments Dynamic, hybrid Security, Monitoring infrastructure Error prone manual compliance hand-offs and processes and logging Locally optimized teams, measures and tools drives and patching escalating WIP, lack of end-to-end as a visibility service and trust

29 assessment assessment Business demands Integration integration & Testing testing Delivery delivery & Deployment deployment Operations operations assessment Shift-left monitoring Measuring user experience Portfolio investment planning Threat and risk monitoring Application release prioritization

30 assessment HP AppPulse: Left shift monitoring Measuring user experience Portfolio planning App release prioritization Analyze & prioritize crashes that need to be fixed Fix performance of user actions considering popular user flows Share reports and collaborate with mobile development teams Know where users exited your mobile app. Percentage of battery consumed per minute of use

31 Insights Monetize Real Time Quality Automation Deliver amazing apps with confidence.