Max Parker IBM Rational Quality Management Specialist. Focus on: Testing and Virtualisation in a complex world

Transcription

1 Max Parker IBM Rational Quality Management Specialist Focus on: Testing and Virtualisation in a complex world

2 Max Parker, IBM Rational Quality Management Specialist IBM Software, Rational May 30, 2014 IBM Software - Rational Test Workbench Focus on : Testing and Virtualisation in complex world.

3 What is driving the need for a change? Increasing Cost of Quality Increasing Development Complexity Balancing Quality and Speed Testing costs Other costs Public Cloud Routing Web/ Service Collaboration Internet Third-party Services Portals Data Warehouse Directory Identity File systems Mainframe Content Providers Archives Private Cloud Enterprise Service Bus Heterogeneous Environments EJB Business Partners Shared Services Messaging Services Traditional Testing 12% The projected increase in wages for India IT workforce in 2012 a $5-30 million The typical investment to build a single test lab for a Fortune 500 company. Most have dozens b a The Times of India, salary increase for India Inc in 2012, Feb 21, b IBM customer reference. c NIST, Planning Report The Economic Impacts of Inadequate Infrastructure for Software Testing, May % The average amount of time testing teams spend on setting up test environments, instead of testing c

4 Complexity. Made Simple! Multiple layers of technology Multiple vendor platforms Complex transactions Complex dependencies Multiple stakeholders

5

6

7

8 Integration Testing 8

9 Blockers of early end to end testing Some of the services we need are still unavailable! We re still waiting for them to deploy! The test environment refresh takes 3 weeks!! Can we begin some testing before everything is available? It is too expensive to setup a live message feed for test!

10

11 Service Virtualisation

12 Software and Systems Engineering Rational Supported Technologies Messaging Protocols SOA, ESB, Others Message Formats ActiveMQ (SMTP, IMAP) Files FTP/S HTTP/S WebSphere MQ Java RMI JMS SAP IDoc, BAPI, RFC Software AG s IB & IS Sonic MQ TCP/IP TIBCO Rendezvous, Smart Sockets & EMS CICS TG IMS Connect CentraSite Oracle Fusion SCA Domain Software AG IS, Broker, BPMS WebSphere Application Server WebSphere Message Broker WebSphere MQ Websphere SI Bus Sonic ESB System z (CICS and IMS) TIBCO ActiveMatrix UDDI Web Services WebSphere RR WSDL BPM Databases Log Files.Net Objects Bytes COBOL Copybook ebxml ASC X12 UN/EDIFACT DFDL Fixed Width Java Objects MIME SOAP Software AG Broker Docs SWIFT CHIPS FedWire TIBCO ActiveEnterprise XML (DTD, XSD, WSDL) ISO8583 Custom

13 Requirements The Old World Unit Tests Big Bang Sys Tests U AT Multiple defects introduced at once More unknowables greater risk Expensive! Performance O AT

14 Requirements Unit Tests The New World Big Bang Accelerated testing Reduced costs Lowered risk Integration Tests Sys Tests Sys Tests U AT O AT Performance

15 No need to modify application code Simplifies management of Stub execution Enables simple versioning of stubs Variety of tools to enable creation of virtual service eg recording Enables traceability over where stubs are running Removes delays caused by late delivery of external interfaces Frees projects from external constraints eg databases, app servers Provides audit of who ran stubs and when Speeds up development of stubs for testers and developers Stubs can be reused and embellished to support different test cycles Removes the need for costly 3 rd party interface leasing Allows control over datasets being used across an environment Let s developers get on with developing code not stubs Enables erroneous data to be played back into systems Puts testers back in control and removes dependency on other teams Easily simulate +1 changes to interfaces and environments Enables multi interface, complex and stateful simulation easily Limits risk and lowers integration issues when going into production

16 Where does Rational Integration Tester fit? Rational HP Ant/Jenkins Governance CmdLine Rational Integration Tester TCP/ UDP.NET Software AG (IS/IB/BPMS) Web Services TIBCO (RV/EMS/SS) IBM MQ JMS Custom

17 Rational and HP Integration!! Link requirements to test assets!! Execute tests from test management dashboard!! Leverage existing reporting structures!! Raise defects directly into defect tracking system; RTC, HP QC, JIRA etc!! Embed deeplinks into defects 2012 IBM Corporation

18 Continuous Delivery Execute test assets in headless mode! Regression test new code quickly! Nightly test cycles! Build/Deploy/Test/Report Virtualise Integrate into new or existing process! Command line execution! ANT task integration with Jenkins, CruiseControl, Bamboo, etc! Native integrations RTC, RQM, HP QC etc 2012 IBM Corporation

19 The future of testing: IBM Rational solutions!! IBM Rational Test Workbench!Enable functional, performance and integration testing throughout your project lifecycle.!with a scriptless, wizard-driven test authoring environment and support for more than 70 technologies and protocols,!! IBM Rational Performance Test Server!Save time and effort by reusing your functional integration tests for performance testing!combine your tests to model real-world scenarios and assess the impact of load on your integrated infrastructure.!! IBM Rational Test Virtualization Server!Model real system behavior to eliminate test dependencies and simulate production,!accelerate testing and reduce the setup and infrastructure costs of traditional testing environments. QA Test Workbench Test Servers DEV Functional Testing Integration Testing Performance Testing Regression Testing Load Agents Virtualization Agents Test Lab Infrastructure

20 Case study Banking industry, ~120 interfaces KPIs after adopting Service Virtulisation and Agile Development Average cost of project Average Duration of Project Months Average Consultants on Projects Average Production Incidents after 'Go Live' Total Projects Completed year on year Power (Average cost of project) Linear (Total Projects Completed year on year) k K 60K IBM Corporation

21 Rational Integration Tester a major contributor 97 % Test coverage Test cases generating test scenarios. " Before: 4 week regression test. After: 1 hour regression test. 10k saving per week." Manual testing errors eradicated! Impact Analysis prior to development. Embrace change rather than fear it." Service Virtualization saves costs of environments" 2012 IBM Corporation

22