Accenture Application Testing Services Australia and New Zealand. Embedding quality into the application lifecycle

Transcription

1 Accenture Application Testing Services Australia and New Zealand Embedding quality into the application lifecycle

2 Quality applications power the high performance business Today s testing challenge: Balancing quality, speed and cost IT budgets continue to be limited. Technology too is getting more complex. Add in the new realities social, mobility, analytics and cloud that are fundamentally changing the way companies do business, opening new avenues to customers, markets and growth at an unprecedented rate. The business demands the highest level of application availability and stability. Development turnaround times are getting shorter, and many large enterprises are adopting DevOps and Agile practices and methodologies. Testing teams are under intense pressure to quickly and thoroughly test applications to support a wide variety of end user devices, such as laptops, tablets and phones, without sacrificing quality and speed of delivery. IT executives globally are looking for new ways to improve application quality and speed and lower cost while managing their digital transformation. This is especially true when they spend as much as 10 to 12 percent of the annual IT budget fixing core application problems. 1 Accenture s approach: Radically improve productivity and manage complexity with intelligence Our clients come to Accenture because we help them rise to these challenges. Accenture thinks differently about application testing more innovatively and holistically. Instead of testing for quality at the end, we focus on it throughout the application lifecycle. In other words, we adopt a quality in, quality out mindset to cope with shrinking budgets and increasing technology complexity. Our decades of experience delivering leading, end-to-end application testing services have taught us that, by adopting industrialised processes and infusing intelligence into delivery, costs can be reduced and application reliability improved. And we go one step further. We work with you to improve testing productivity through predictive analytics, automation and industry specialisation while also driving higher quality across your application lifecycle. In many cases, we also assume the day-to-day responsibility for your testing operations. Accenture Application Testing Services offers an intelligent approach to testing strategy and execution to help you unlock the potential of your business and reduce the cost of poor quality to less than five percent of the IT spend. 31,000+ professionals clients served globally 80% of professionals aligned to an industry Three decades of testing experience 10+ years in digital testing 30+ delivery centers 2

3 Testing delivers business results Accenture Application Testing Services can help improve your company s financial position through cost reductions, accelerated speedto-market and productivity improvements with an end-to-end testing strategy. We conduct comprehensive quality improvement activities in each phase of the application lifecycle from plan, analyse and design to build, test, deploy and run across both Agile and waterfall based delivery models. Shift left We complete these critical but often missed series of activities by adopting a shift left approach to help improve upstream aspects of the testing process related to requirements, release and software configuration management. Only then do we focus on validating the design, functionality and performance of the application using innovative tools, automation and standardised testing processes to help improve productivity and reduce costs. As a final step, we help you operate your testing capability with a stronger focus on quality at a lower cost. Benefits Accenture Application Testing Services can help you deliver benefits such as: Up to 50 percent reduction in test operations costs percent productivity improvements Up to 90 percent reduction in critical defects reaching production Figure 1: Accenture End-to-End Quality Model Plan Plan review QA estimates QA team Test activity roles & responsibilities Test strategy development Analyse Requirements development and/or review Change control participation Test condition development Test cycle development Test approach development Testing cycle control Design Design review Test script development (initial) Capacity Planning System performance KPI identification Post-deployment validation Improved application and environment stability Up to 90 percent automation penetration depending on business process complexity Greater staffing flexibility with a global delivery model Up to 15 percent savings when using 1: many testing solution factories Test model development Test environment and data requirements Build Code peer review Test script development (completion) Test-driven design Applied Statistics/Pairs Testing Test environment build Test data build Software configuration management - version control Service virtualisation Early performance testing Test Test script execution (all stages) Metrics and reporting Test closure User acceptance test facilitation Performance test Software configuration management - builds/ migrations Up to 45 percent reduction in test delivery cost when leveraging cloud-based services Up to 50 percent accelerated speed-tomarket when using an Agile delivery model Deploy Operational readiness test facilitation Performance management and monitoring Post-deployment validation Operate the organisation Run Metrics trends and risk review Continuous improvement and innovation initiatives Knowledge repository and resource proficiency management Calculate cost of poor quality Update automation plans and test scripts Optimise regression test packs Project Management Release management/end-to-end governance, metrics and reporting 3

4 How we deliver breakthrough quality, speed and automation We bring together comprehensive testing services, industrialised delivery, industry and technology capabilities and intelligent tools to drive quality, speed and automation. Comprehensive services Accenture offers the entire breadth and depth of testing strategy and execution services from core to specialised to digital transformation across a broad array of applications, delivered under flexible business arrangements. Our services include: Figure 2: Accenture Application Testing Services Core services Assessment and Strategy Automation Performance Engineering and Testing Testing/Quality Centre of Excellence *The specialised services list is not exhaustive. Applications SAP, Oracle, Microsoft, Java, Workday, Salesforce.com, Mainframe, Industry-specific Emerging technologies Analytics, Cloud, Mobility, Digital Business Models Capacity, Managed services, Transformation, Output-based Assessment and Strategy Based on the patent-pending Accenture Test Maturity Diagnostics aligned to the Testing Maturity Model (TMMi), we assist you with end-to-end testing assessment processes from planning through final recommendations. We help assess your organisations current quality maturity levels and develop a roadmap to improve it over time. Specialised services* Domain-led functional Regression Security User experience SOA DW/BI Virtualisation Test data management Environment management Agile Digital testing Cloud-based testing Delivery Metrics Measuring the Quality, Cycle Time, Cost and Maturity of not only testing but the entire IT Delivery Cycle is something that we often see companies overlook or pay little attention to. In our experience, those companies that invest in making sure there is consistency and accuracy of data and leveraging this to dynamically report on a set of key metrics is absolutely critical in not only measuring current progress but also demonstrating how investments in more mature development methods has realised true business benefits. In support of this we have developed the Accenture Test Metrics Framework (TMAF) that provides out-of-the-box metrics definitions, suggested target levels and physical dashboards. We have also taken this a step further through the development of delivery maturity models, questionnaires, frameworks and business case models to enable companies to kickstart delivery maturity transformation programs. These frameworks are very focussed on transition to Agile and Continuous Delivery operating models. Automation We offer a robust set of intelligent tools and assets to consistently support the entire spectrum of automation-related testing activities and drive reduced costs and improved speed and quality. Performance Engineering and Testing We help conduct a wide range of performance testing and performance engineering services to diagnose and improve the code and architecture that impacts application performance. Testing Centre of Excellence We can help you manage or set up a dedicated Testing Centre of Excellence either at the enterprise level or within specific business units, thereby enabling delivery of standardised and industrialised testing services that effectively combines our people, processes, tools and reusable assets. For organisations looking for digital transformation we offer: Testing as a Service 2 We deliver an elastic, on-demand suite of testing tools and environments built on the Accenture Cloud Platform that can be provisioned dynamically and repeatedly to enable consistent testing practices. 4

5 Industry and Technology The majority of Accenture s testing professionals focus on functional test delivery while also developing industry vertical specialisation. More than 80 percent of our testing professionals are specialised across 40 industries. In addition, a number of our testing team members specialise in various technology platforms, including SAP, Oracle, Workday, Salesforce.com and industry-specific applications among others. Industry and technology specialisation allows Accenture to provide more focused testing services for industry applications and functionality, such as manual and automated testing scripts for health, property and casualty insurance claims, with higher quality and speed. A deep understanding of the industry context also improves our end-to-end focus on quality and productivity, and makes service transitions smooth and less risky. Additionally, our professionals complete comprehensive industry and testing certification programs including International Software Testing Qualifications Board (ISTQB), Certified Quality Software Analyst (CQSA) and other common testing certifications. We have a global testing training and certification program Accenture Technology Academy (ATA) Tester and Test Designer Certifications developed in collaboration with the Massachusetts Institute of Technology (MIT) Professional Education. Furthermore, Accenture also certifies our testing practitioners internally through our global Test Architecture Certification rating people in increasing levels of testing experience, skills and maturity form Test Architect to Senior Test Architect and finally Master Test Architect. Industrialised Delivery Accenture delivers application testing services through our Global Testing Centre of Excellence Network of more than 30 centres located in 17 countries. As part of our Global Delivery Network these centres combine skilled people, industrialised processes and reusable, intelligent assets to offer cost-efficient and consistent access to extensive, industry leading capabilities on a 24/7 basis. The centres operate at scale and provide you strategic options across specialised skills, time zones, commutability, and especially language and culture. In each centre, our testing professionals focus on providing integrated service delivery and use a successfully demonstrated approach focusing on testing maturity to help establish, maintain and improve operational excellence of your testing organisation. Given our emphasis on quality, our Global Delivery Network is ISO and Capability Maturity Model Integration-certified, and has other relevant industry certifications as well. You can either leverage the existing centres or we can help you set up and run your dedicated Testing Centre of Excellence. In this scenario, we leverage our Test Metrics Framework to drive transparency across the applications lifecycle and serve as the basis for service level agreements. We also use dashboards and tools to measure various aspects of the testing and delivery process, including how quality and productivity are improving in each testing effort. As part of our Global Delivery Network these centres combine skilled people, industrialised processes and reusable, intelligent assets to offer cost-efficient and consistent access to extensive, industry leading capabilities on a 24/7 basis. 5

6 Figure 3: Assessment and Strategy: Accenture Test Assessment Framework (Testing Maturity Model) Assessment Results Ratings Ratings Scale Initial Defined Integrated Managed Optimised Assessment Scope Low Med High Low Med High Low Med High Low Med High Low Med High Methodology Test Strategy Test Lifecycle Environment & Tools Organisation & Communication Approach & Planning Design & Preparation Execution & Reporting Performance Testing Estimation Test Metrics Test Project Management Client C should Assess process to minimise defects and turnaround Understand why there are so many defects coming out of Build and Fix Foster developers and test analysts working together, in person or via a phone call, to solve defects Look at practicality of creating a triage team, that sits within Product Test as first level of defect investigation. Required to have System Analysis skills Client B should Look at automating the regression test suite which will reduce the end to end time frame of test execution. Client A should look at a Test Management Tool Introduce an integrated test management tool that captures all stages and steps within the testing lifecycle per release. Recommendation is the Rational toolset due to the Accenture alliance which will support cost efficiency. Training of resources will have to be considered. Test Disciplines Defect Management & Prevention Test Automation Test Data Management Requirements Management Configuration Management Large Discount Retailer (top 40 in the Fortune 500) Projects view 6

7 Accenture Digital Testing Organisations across industries continue to embrace digital to transform their business and operation. While they are focused on complex Digital transformations, technology firms such as Apple, Google and Microsoft continue to disrupt the Digital eco-system with innovation and new product development. Organisations need to consider the following while defining their digital test strategy: 1. Exponential growth of connected products with new features that make the Digital eco-system more complex. 2. Need of scalable Test environment and infrastructure. 3. Newer digital channels and customer s expectation of a seamless digital experience across channels. Figure 4: Digital Test Services Compatibility Inter Operability Functional Mobile Delivery Tele market Smart TV Context Security Web Employee 4. Increased security threats due to infinite bytes of data exchange. 5. Shortened test cycles due to faster development and deployment of digital products. 6. Increased CAPEX and OPEX that impacts the Return on Investment (ROI). Accenture s Unified Digital Testing Framework for Digital comes equipped with Cross Industry Enablers to help our clients address testing challenges and deliver a comprehensive Digital Testing Solution. Accenture s Digital Test Labs for Applications, IoT Devices and Connected Home products have been leveraged for product testing and global deployment. The test labs comprise of Brochures Notification/ Alert Mobility Customer Analytics Partner Interactive OMNI-CHANNEL Presentation Store KIOSK Social Content Accenture Unified Digital Testing Framework POS Conformance Security Performance Industry standard tools, Test Infrastructure, Home grown innovative assets and Accenture s Test Methodologies and can be easily scaled up/down and operated on a pay-per-use business model. Accenture s Digital Crowd Test Platform is a crowd sourced functional and usability testing solution for testing and deployment of mobile applications globally. Accenture s automated Digital Security Test Platform, built on a cloud SaaS platform, identifies security and privacy vulnerabilities during the app development life-cycle and reduces the chances of vulnerabilities in production, which otherwise would impact the time and cost of recovery. Security test scan reports have helped application X-Industry Enablers Services Digital App Test Lab IOT Test Lab Digital Home Test Lab Platforms Digital Crowd Test Platform Security Test Platform Accenture Omni Channel Testing Platform Products Digital Optimization Device Test Analytics development teams with detailed information on security threats and loopholes along with remediation recommendations. Accenture Omni Channel Testing Platform (AOCTP) is an innovative test framework developed by Accenture for accelerated Digital Channel testing during Digital Transformation and Omni Channel deployment by our Clients. Key features of AOCTP listed below: - Automated test engine with comprehensive reusable Omni channel use-cases that validate seamless integration across digital and legacy channels. - Business Intelligence Testing to validate web analytics and determine targeted offers and loyalty programs and consumer buying patterns. Digital Optimisation: Digital Optimisation lab dedicated for optimising web / mobile implementation across industries. The lab offers a best of breed solution which is a perfect blend of top rated industry tools, Accenture s intuitive optimisation strategy and unique asset library. Accenture Device Field Testing and Analytics Platform provides automated Device Performance testing and simulated voice, messaging, data and video sequences. The platform can be easily integrated with the GSMA TS11v12.1 and other field test specifications. The analytics engine of the platform correlates the test results and logs synchronised with the server and displays a simple and intuitive dashboard for faster field campaigns. It also provides analytical data to isolate the root cause of network and performance issues on the device. 7

8 Security Testing Eighty-six percent of all applications have at least one serious vulnerability, and most of the time, the application contains more than one (source: WhiteHat 2015 Website Security Statistics Report ).³ Increasing demand for content over the internet has increased the risk exposure of sensitive and confidential data. With the businesses extending beyond the enterprise into cloud, mobility and social media the threat organisations face today is enormous, and requires robust security testing embedded into the application lifecycle. Figure 5: Security Testing for Application Mobile Application Security Testing Web Applications Discovery and Perimeter Security In-Depth Web Application Security Testing Packaged Application Security Testing Infrastructure Security Testing Native mobile application static or binary source code scan and review; and Mobile backend web application dynamic vulnerability assessment Discovery of known and unknown web applications and application perimeter security posture analysis Web application vulnerability assessment focused on custom applications, combining dynamic security scanning with source code review and penetration testing Source code review of customised parts of commercial-off-the shelf applications (i.e. ABAP code in SAP); binary code analysis of 3rd party software products Internal and external infrastructure vulnerability assessment and penetration testing Figure 6: Security Testing included in Accenture Delivery Model Accenture Delivery Model Plan Analyse Design Design Build Test / Exec Deployment Deploy Applications Requirements Review Analysis Review Design Review Source Code Review Vulnerability Scanning Penetration Test Sec. Risk Assessment Servers and Infrastructure Components Architecture and Design Review Vulnerability Scanning Configuration Assessment Penetration Test Vulnerability Management Human Behaviour and Enterprise Functions TVM Capability Implementation TVM Capability Operation Social Engineering Service Name TVM Assessments Service Name TVM Capability Operation Service Name TVM Capability Implementation 8

9 Accenture provides comprehensive Security Testing services that includes discovery of vulnerabilities and remediation support for mobile platforms and application (including source code), cloud based web applications, network, and backend infrastructure and application. Built on a cloud SaaS Platform, the security test services are embedded within every phase of our delivery methodology from planning and analysis through to production. In addition to the security testing services, Accenture also provides a full suite of security strategy development and assessment services addressing each component during the solution development lifecycle. Figure 7: Accenture s Digital Security Testing Strategy Digital Security Strategy A comprehensive program and strategy to embed security controls and testing throughout the enterprise s digital development lifecycle Device Security functionality Control connectivity Secure remote connections Disposal and wipe Synchronisation/Backup Ability to update Physical Access Tracking/Management Device Governance Digital Security Strategy Users & Identity Governance Define processes and policies (ownership, connectivity, applications, privacy, audit/wipe) Support/Training Identify preferred suppliers/ service level for business Users & Identity Roles and authorisation levels and authentication Evaluation/monitoring of usage patterns Program awareness and education Network Secure remote connectivity Monitoring and Testing Wireless networking Use of untrusted and/or public networks Network Data Application Applications SDLC development Testing Distribution/provisioning Access Control Secure connection to backend systems and data (Ex; Cloud) Monitoring/Management Data Classification Authentication Secure connection Strong Encryption Data loss prevention Secure storage Audit and forensics 9

10 10

11 The next testing frontier: Quality Centres of Excellence Companies who are already conducting testing offshore and automating testing to improve productivity may be asking, what is next? Accenture is breaking new ground in application testing by taking a strategic and methodical approach to improving quality upstream in each phase of the application lifecycle a strategic concept we call Quality Centre of Excellence. A Quality Centre of Excellence creates transparency through an end-to-end view of defects, addressing them where they were injected, not where they were detected. Quality Centres of Excellence focus on incorporating measures and visibility into the application lifecycle, and providing insights into where to drive targeted improvements. A Quality Centre of Excellence identifies root causes and reduces defects earlier in the cycle significantly improving the quality of code sent to testing. Quality code also makes the testing turnaround time even shorter, which translates into improved speed-to-market. Innovation and Intelligence Accenture continually strives to be ahead of the curve in application testing. As part of our commitment to quality and productivity in every phase of the application lifecycle, our people collaborate to develop trendsetting testing and end-to-end quality related innovations. We help you achieve your stated IT objectives by offering proprietary, innovative and intelligent testing assets and tools. Accenture Intelligent Tools for Test Operations We use our next generation suite of productivity tools that augment and automate test preparation, execution and management to drive improved quality, efficiency and effectiveness of your test organisation. The tools drive intelligence into the testing lifecycle for modular script reuse, test execution prioritisation, automatic script assignment and defect management. The tools enable savings of percent across various phases of testing; percent during test preparation through reuse of modular scripts. Accenture Intelligent Tools for Test Analytics Accenture Scenario Predictor leverages statistical techniques to analyse and proactively manage key parameters that can influence the project schedule, effort and defect leakage. Accenture Performance Analytics helps to improve the speed and quality of decision making through root cause analysis based on process variations, performance baselines and augmented visual analytics to identify improvement opportunities. Accenture Testing as a Service (Taas) Accenture Testing as a Service gives you the opportunity to test-drive our unique testing solutions in real time, providing you an on-demand, scalable and costeffective model. It provides provisioning and management of test environments, data and tools to enable a significant reduction in the test delivery cost through integrated templates, accelerators, methodology, and a flexible, pay-per-use model. The solution enables build up and tear down of test environments on an ad hoc basis without requiring the purchase of expensive infrastructure and reducing provisioning time. It also provides testing tool hosting that we manage as a broader managed service (including access to HP, IBM & CA products amongst others). Accenture Testing Accelerator for SAP The tool enables intelligent automation without scripting and knowledge of application modules to reduce the test planning and execution effort. It scans the implemented SAP system to provide insight and leverages the relationship matrix to link the configuration and technical objects to test scripts thereby enabling impact analysis and refresh of the scripts. Its diagnostics capability helps determine test scope and process variations based on actual SAP application usage. Applied Statistics Testing Accenture leverages design tools to incorporate applied statistics based testing into Accenture Delivery Methods for Testing, our industrialised testing approach. Applied statistics-based testing is a method for conducting more rigorous, up-front testing planning to optimise test coverage and quality while minimising test effort. The method drives significant productivity improvements by determining the combinations of features and data permutations to be tested and helps improve the quality and cost of poor quality by finding problems early in the lifecycle when they are least expensive to fix. Our relationship with Hexawise also enables us to leverage the product at no cost in our engagements. Accenture Test Repository The global repository stores Accenture s proprietary testing assets, including our standardised and reusable testing industry packs which facilitate acceleration of test plan development in specific industries. The asset enables savings of percent in test preparation, industry specialisation, efficient knowledge transition and lower cost to serve due to faster ramp-up, productivity gains and improved quality. Accenture Requirements Engineering Suite The asset is a bundle of tools that accelerate requirements gathering and maintenance and automate requirements quality validation. It provides an automated review of documented requirements in order to validate the level of detail, accuracy (from a language perspective) and testability and generates reports to provide different views of the requirements. Accenture Automation Integrator This innovative asset automates the regression test phase, allowing extensive reuse of test cases for end-to-end application even across different technologies and an estimated saving of percent of the test phase effort. The asset reduces the effort for test script creation and maintenance and ensures higher quality of delivery through faster and complete regression test. 11

12 Accenture Test Case Designer The tool automatically generates test cases from requirements to improve test design productivity. It reduces effort by up to 50 percent and enables test coverage accuracy of more than 90 percent. Accenture Quality Assistant The tool helps to measure, track and improve application quality using analytical methods to generate the cost of defects and their source. Third party tools We have formed strategic alliances with HP, IBM, SAP, Microsoft, Oracle, Worksoft, TOSCA, SOASTA and also maintain strong relationships with a number of major testing tool suite vendors such as Computer Associates, DeviceAnywhere, Grid Tools, Perfecto Mobile, Experitest and Crittercism and Worksoft in order to quickly assemble an appropriate solution for you. Accenture has been HP s Partner of the Year for five of the last 10 years. Additionally, our arrangement with IBM Rational enables use of their Application Lifecycle Management tools at no cost to you (with some caveats). Strategic Testing Models and Approaches Output Based Testing The aim of Output Based Testing is to reduce the cost to serve through higher productivity, shared costs, and shared leading test practices to offer fixed pricing for low level outcomes. Output Based Testing is a means to define and deliver testing by the artefacts of the processes that yield quality measurements. This means testing needs to be discretely defined and predictable. We rely on measuring quality through a focus on delivering test outcomes based on productivity targets with a flexible and scalable workforce that manages to a queue for testing services. Our commercial pricing is based on the purchase of units and unit blocks, more specifically: Cost to client is based on delivered outputs Our approach is based on the definition and use of discrete test factory services from an Accenture Test Factory Model Our solution leverages a unit based test factory service menu based on our experience with testing at similar clients Units are redeemed for test outcomes/ outputs such as test results, test cases, and test metric reports Risk Based Testing Risk-Based Testing helps fulfil the mandate to maximise quality where it matters most to the business in order to minimise risk at time of deployment. We do this by: Evaluating and improving the quality of requirements Improve both test effectiveness and efficiency Monitoring and reporting progress in reducing risk Adjusting risk reduction actions (e.g. test scope) based upon the effectiveness of prior actions or additional knowledge Gain consensus on high risk requirements. Accenture s approach is via: A targeted effort using early risk analysis to underscore the concerns and objectives of senior management and align the rest of the development lifecycle including the activities of testing organisations behind this A structured method and process guiding test managers in focusing their test activities on areas that lead to the greatest reduction of solution delivery risk Use of frameworks and tools (risk based and statistical tools) to systematically and dynamically assess testing risk and coverage Value Based Testing Testing services and engagement models have matured from a primary focus on labour arbitrage cost reduction to a combined focus on operational efficiency and gain share. Accenture has a major focus on shifting testing engagement models and maturity, taking the next major step from offshoring, labour cost arbitrage, basic automation to a focus on overall cost of testing ownership and managing to committed productivity and cost reductions via Value Based and Gain Share engagement models. Units can be purchased individually or in bulk at discounted rates 12

13 The Evolution of Testing Services Testing services and engagement models have matured from a primary focus on labour arbitrage cost reduction to a combined focus on operational efficiency and gain share. Fully onsite High cost model Resource Based <1990 Managed Capacity Model Blended price reduction Significant cost reduction through resource arbitration 2000 Predictable Quality Improved Quality 2010 through Industrialised Processes T&M only Managed Service Output Based Model Risk Transfer via unit based pricing model Increased flexibility through optimised demand management Productivity gains via rigorous output based operating model Unit / T&M Based Unit Based model: Provides flexibility and predictability. Provider commits to agreed timeline and costs upfront. Managed service (Output based) model moves more responsibility and ownership to provider, thereby reducing effort / cost for client. Outcome Based Model >2015 Based on outcome / performance Outcome Based model focusses only on the final outcome and performance and not individually at each operational service components. 13

14 Delivering in the Digital Age New Delivery Approaches Current technology trends (like Social, Digital and Cloud) have increased the demand for faster delivery and shorter time to market. In response to this, methods and practices inspired by Lean principles have gained popularity. As such, Agile methods and DevOps practices have become the new norm for delivery. Accenture Delivery Methods include guidance for leveraging these practices in the context of project delivery. For example, testing is included in each sprint and is highly automated so that a working increment can be showcased at the end of each sprint. Collaboration and Automation at the core of delivery Accenture defines DevOps as: Optimising Development and Operations to enable the realisation of business goals through rapid feedback and flexible IT. The transformational nature of this change towards new delivery models require more than just purchasing tools or implementing certain techniques, it requires changes across the operating model of the organisation. Accenture has defined 10 principles for DevOps delivery, 5 are technical practices and 5 are organisational practices testing is impacted by all of them. To achieve continuous delivery of value, testing has become a first class citizen that is embedded in every activity. Gone are the days of testing groups being a separate silo to development. Quality is everyone s business in the new delivery model. This changes the responsibilities of the testing groups towards a more strategic and more technical group of experts an Agile Testing Centre of Excellence. We are operating many of our engagements leveraging Software Development Engineer in Test (SDET) functions and roles especially within Agile-based Digital Delivery Teams. Furthermore, as an extension to the TMMi Assessment, Accenture leverages a DevOps Assessment Framework to assess, measure, score and define a roadmap to enterprise Continuous Delivery. Our experience ranges from Agile and DevOps practices on targeted areas of the business through to increasingly complex mapping of how to approach mixed delivery models across both Waterfall and Agile within the organisation. Machine Learning and Touchless Automation Given limited time and resources, determining what to test is one of the biggest challenges facing the quality and testing industry today. Current risk-based-testing approaches are unable to scale up because either they are heuristics based or too rule centric. This is resulting in over-engineering of testing leading to excessive cycle time and cost that is not commensurate with increased production quality. Testing needs to be more defect targeted through deployment of techniques like usage modelling and failure modelling, multi-layer automation by taking advantage of data mining and machine learning technologies. Accenture is partnering with several private and academic bodies including MIT to develop what we believe will change the way testing is conducted industrywide. We want to deploy new age and disruptive methodologies, tools and techniques to reduce time-to-go-live and cost of testing by over 50% and have already trialled the techniques at target companies globally.⁴ Figure 8: A combination of a number of components will lead to Agility at Scale Strong source control Zero-touch build and deploy Test early and often Automate everything (in pipelines) Elastic supply of cloud resources Continuous Improvement Cohesive teams with shared objectives Lean principles and continuous delivery of value Embrace failure, recover automatically, degrade gracefully Experiment without regret Fine-grained service architecture (API-first) 14

15 Why Accenture? Complex Delivery Continuous Delivery and DevOps practices have been part of the Accenture methodology for over 15 years. Through our heritage of High Performance Delivery, Accenture has been delivering complex programs using automation across digital and packaged enterprise applications. Agile in the Real World Accenture is a gold partner of the Scaled Agile Framework (SAFe). Accenture combines SAFe with our experience from real-world delivery in large organisations to tailer an Agile delivery approach that works in the context of our clients. This tailoring is what makes Accenture Agile projects successful. As a Service Capabilities Based on the Accenture Cloud platform Accenture offers Testing as a Service and a DevOps Platform as a Service for our clients. These services allow us to stand-up tools preconfigured with leading practices to accelerate the benefits gained from modern development methods. Cloud Platform Accenture Cloud Platform gives you the power and flexibility to manage your organisation s production or test workloads simply and securely across both private and public clouds on demand, at speed and from a single point. 15

16 Our Experience in Australia and New Zealand Extensive industry experience In ANZ, Accenture s testing portfolio consists of a comprehensive list of clients across a variety of industries, including communications, media and technology, financial services, products, resources, and health and public services. Our focus is on engaging long term partnerships with our clients, adhering to our message of a holistic, end-to-end quality strategy as a way to drive cost savings through quality and productivity improvements, and reduce testing costs whilst increasing breadth of testing. Accenture has a dedicated pool of senior resources with extensive testing experience in ANZ who are ready to provide services in test governance, strategic direction and program test management. We are capable of ramping up onshore and offshore test teams in a short period of time, either in partnership with client teams, or in a fully outsourced or managed service model, at the same time leveraging our extensive global TCoE network for support and experience. Our experience in ANZ ranges from conducting numerous testing strategy and maturity assessments including definition of TCoE and IT Delivery Operating Models right through to fully managed testing services. We have the breadth and depth of experience and knowledge, drawing upon our local and global resources, to consult on targeted initiatives including (but not limited to) delivery metrics, test strategy, test automation, Continuous Delivery practice establishment, Agile Coach placement services right through to fully managed and outcomebased testing centres. We ve performed these functions at scale for some of the largest companies in Australia and globally and understand the associated organisational and commercial realities of moving to the next level of enterprise delivery and testing maturity. 16

17 17

18 Client case studies A communications leader saves $45 million and dramatically improves application quality with an intelligent test factory This communications industry leader sought to take its application testing services to the next level. Accenture helped consolidate testing suppliers from five to two and establish an intelligent test factory that will save the company $45M over four years using an output-based commercial model. These dramatic savings are delivered through a greater than 95 percent offshore solution, a rapid transition of 550 FTEs in four months, and extensive automation supported by advanced tools such as the patent-pending Accenture Intelligent Tools for Test Operations. A large telecom service provider was able to cut production defect rates in half with the help of Accenture s testing solution This large telecom service provider wanted to reduce application development and maintenance costs and enhance application performance by streamlining its quality assurance and testing processes. Accenture set up a Testing Center of Excellence (TCoE) leveraging its global delivery capability to help the client drastically reduce production defect count by approximately 97 percent, transition from a waterfall to an Agile development model and improve quality by implementing test automation frameworks, leveraging Accenture Intelligent Tools. A leading bank significantly improves speed-to-market with testing automation solution Following a series of large acquisitions, this leading bank needed to ensure seamless service to its existing and acquired customers while radically simplifying its application portfolio. Accenture helped the bank achieve these goals and enabled faster time to market for new application releases by establishing a Testing Centre of Excellence to automate the testing efforts for more than 300 applications used by the consumer banking division, including mobile and online banking applications. The automated testing efforts reduced the risk of migration, and ensured error-free applications 98 percent of the time. 18

19 Analyst recognition Accenture Named Undisputed Number One in Innovation in HfS Report on Application Testing Services Accenture has established itself amongst the Leaders in independent testing services through meaningful investments in building capabilities across the testing services portfolio (testing CoEs, proprietary solutions, delivery workforce, etc.). Legacy strengths in consulting and system integration has helped Accenture position itself strongly in the testing strategy, assessment space. 5 Largely due to its software testing relevance and to the overall dynamics of Accenture, Accenture Application Testing Services is well positioned to beat the market. Accenture s IP and tools strategy and breadth of accelerators is comprehensive. One of its main benefits is to expand from test execution purely to include test design. Accenture Application Testing Services strategy is to further enhance its IP and tools, focusing on industry-specific test repositories, test execution tools, and test design and QA accelerators. One of the specificities of Accenture is focus on bringing automation and accelerators early in the SDLC. 6 HfS 7 Research positions Accenture as an innovative global service provider, focused on business transformation and evolving toward predictive testing. In August 2015 HfS Research published its HfS Blueprint Report: Application Testing Services, placing Accenture firmly in its Winners Circle for both innovation and execution and naming Accenture as the undisputed number one in testing innovation. According to HfS Research, Accenture added a strong narrative focused on business transformation and evolving towards predictive analytics, underpinned by significant R&D in machine learning and cognitive computing, coverage of the emerging digital spectrum and deep vertical and industrialisation capabilities. (footnote link to article) 19

20 References 1 Accenture High Performance IT research 2 Testing as a Service (TaaS) 3 WhiteHat 2015 Website Security Statistics Report. Read here. 4 HFS Research: Accenture pushes envelope testing services artificial intelligence. Read here. 5 Accenture Technology Vision Copyright NelsonHall: Outsourcing Vendor Profile of Accenture Software Testing March HfS Research is the leading independent analyst authority and community for the global business services and outsourcing industry. Download the Accenture excerpt. Contacts To learn more about how Accenture ANZ can help your organisation reduce testing costs and improve productivity while embedding quality into the application development life-cycle, contact: John Pickering Asia Pacific Testing Practice Lead john.m.pickering@accenture.com About Accenture Accenture is a leading global professional services company, providing a broad range of services and solutions in strategy, consulting, digital, technology and operations. Combining unmatched experience and specialised skills across more than 40 industries and all business functions underpinned by the world s largest delivery network Accenture works at the intersection of business and technology to help clients improve their performance and create sustainable value for their stakeholders. With approximately 373,000 people serving clients in more than 120 countries, Accenture drives innovation to improve the way the world works and lives. Visit us at on Follow us on facebook.com/accentureaustralia twitter.com/accenture_aust youtube.com/accentureaustralia linkedin.com/company/ accenture_australia Copyright 2016 Accenture All rights reserved. Accenture, its logo, and High Performance Delivered are trademarks of Accenture