Automation and Virtualization, the pillars of Continuous Testing

Transcription

1 HP Software: Apps meet Ops 2015 Automation and Virtualization, the pillars of Continuous Testing Jerry Saelemakers/ April 2 nd, 2015

2 Today s business initiatives demand a balance between velocity and quality Need for Velocity Proliferation of Tools Analytics Agile Access Anywhere Composite Applications Visibility Shift Left Demand for Quality 30x increase in application releases Enterprise 20/20 Research, % of consumers will delete a mobile app if they encounter a bug APMdigest, Feb 5,

3 The need for speed changes everything Developer Agile Development Agile Development, weekly drops The new QA is extensively automated and executed by a continuous integration process --Forrester Research Tester Dev/test lab Shift left, test continuously Provision environments at agile speed But what get s in the way? 3

4 Enabling velocity and quality Automation Virtualization Collaboration Analytics & Insight 4

5 Continuous Testing is more critical than ever Improve development efficiency Reduce the test burden Accelerate application delivery 5

6 The ideal Agile picture: continuous testing A relentless assault on project risk Sprint 1 Sprint 2 1 Sprint 3 Sprint 4 Sprint 5 6 ET C1 ET C1 ET C1 ET C1 ET C1 CI CI C2 CI C2 CI C2 CI C2 Regression 1 G2 Regression 2 G2 C3 Regression B1 3 Longevity testing (independent of sprint cycles) G2 C3 B1 Regression 4

7 The s+1 rule of test automation Automation never lags by more than one sprint C G B Component (non-gui) GUI element Business process Stable Sprint 1 Sprint 2 1 Sprint 3 Sprint 4 Sprint 5 C1 C1 C1 C1 C1 C2 C2 C2 C2 G2 G2 G2 C3 C3 B1 B1 7

8 UI UI Layer Layer f HP Unified Functional Testing Test automation for GUI Search Product List Purchase Product Shopping Cart Features (GUI testing) Modern GUI testing new UI aligned with modern dev IDEs New features- scripts editing, coding, MDI, checkpoints, auto completion Graphical UI - Canvas Workflows support thanks to integration to QC / ALM Support 8 latest technologies Qt apps, Flex, more than 20 new versions Problem it Solves Automation takes time, complicated Automation requires advanced coding skills Automation requires coding skills Automation requires repeatable actions New advanced technologies introduced to the market Benefits Automation made easier Learning automation made easier, takes less time, less technical Graphical UI with drag & drop capabilities Shortcuts, sharing and reuse Keep up with modern technologies

9 HP Unified Functional Testing Test automation for API Services UI Layer Layer Features (API testing) GUI +API testing end-to-end Biz process and integration testing Graphical test flow view API test actions--workflows JSON-based REST services SAP IDOCS and RFCs Problem it Solves Different tools to test services Different tools, different IDEs, skill set Modular, comprehensive tests New API technologies Repeatable tests for SAP Benefits Test earlier -- services and components Lower costs of composite app tests, lower learning curve Sharing and reuse, less maintenance Supports the most popular new APIs Accelerate accurate SAP tests 9

10 Unified Functional Testing What s new The gold standard in Agile test automation Record and Playback tests on Chrome Browser Chrome 32 and 64 bit support Fast Chrome release updates via the Chrome Web Store Web Extensibility Support including: New V12.02 SiebelOpenUI 10

11 HP UFT with Subversion (SVN) Directly work from your UFT with SVN as your asset repository Commit Changes directly to the source control Easily Resolve versions conflict Run a different comparison Utilizing Jenkins environment with the UFT Tests Integrates UFT with CI/CD environments Extends continuous testing capabilities for Agile teams New V

12 HP Testing solutions to shift left Support Continuous Integration How? UFT smoke & regressions tests run in nightly builds Pre-built integration Jenkins & Hudson Auto-scheduling of build if ALM used Includes integration to the CI systems reports Why? Dramatically improve quality - automation without huge manual investment Keep pace w/ dev, find issues early 12

13 13

14 Creating a New Testing Job ALM Configuration 14

15 Solving for multiple app layers Service virtualization eliminates dependencies C G B Component (non-gui) GUI element Business process Stable Sprint 1 Sprint 2 1 Sprint 3 Sprint 4 Sprint 5 C1 C1 C1 C1 C1 C2 C2 C2 C2 G2 G2 G2 C3 C3 B1 B1 15 External components

16 Simulated, Virtual reality helps to minimize the risk Virtualize across application development and test Users (Virtual Users) Application Dependencies (Virtual Services) Web services Legacy systems Data services Network Characteristics NV Network characteristics SV 16 PC UFT LR User behavior and load Constrained services/ application components

17 Virtual services are always available for dev & test How? Create virtual services of most Composite app types: Web Services, Rest, JMS, ERP apps, Legacy middleware Extensible for other transports and message types Manage virtual services via web Integrate to HP ALM/QC End to end testing with integration to UFT/ST/LR/PC Store, run, report Functionality Performance Security HP Application Lifecycle Management Web browser Mobile App API State, profiles, metrics Composite Application SOAP REST MQ JDBC RFC CICS Data Perf. Config Simulation Store, find, deploy 17 Test Automation Application Under Test Service Virtualization

18 HP Service Virtualization Designer and Runtime Easy to use SV Designer Desktop IDE with ALM/QC Integrations Modeling and Config. of Virtual Services Embedded SV Runtime Scalable SV Server Shared and Scalable SV Runtime SV Web Based Management Interface Accessible over programmable API Integrated with ALM/QC repository 18

19 Virtual Service Definition and Modeling Virtual Service Control Functional Models Performance Models Virtual Service States VS Configuration Embedded Simulation Runtime 19

20 Functional Model Simulation Rules with Priorities Scripting Vertical Data Views External Service Calls Rule Detail Data Driving Stateful Conversations Condition Functions Condition and Action Functions Service Operations Synchronous/ Asynchronous Multi-response 20

21 Performance Model Performance Throttles Performance Parameters Service Operations Dynamic Performance Definitions 21

22 Service Virtualization Server and Management Interface Virtual Service Administration Virtual Service and Access Control SV Server Metrics Integrated with ALM Repository Shared Virtual Service Infrastructure Scalable and Secured Simulation Runtime Web Based Virtual Service Management and Dashboard Unified view and VS Management across multiple SV Server Nodes Parameterized filtering and search Bulk operations on multiple Virtual Services Virtual Service Detail with Control of State and Profiles Users/groups/roles and ACL management Decoupled Consumption from VS archives and ALM/QC Integrated with Enterprise Identity System 22

23 Virtual Services with UFT and LoadRunner Virtualization Control Test Reports in ALM Virtualization Control Control the flow Deploy to SV Server Add, Delete, Refresh Virtual Services from ALM/File Change Virtual Service Profiles Virtual Services Real-time Performance 23

24 Taking into account the network Characteristics Integrated HP Network Virtualization & HP Service Virtualization Define and Control network parameters with SV Virtual Services New Network Model definitions Integrated to Shunra Global Library for quick network parameters import REST LDAP MQ Pay-pertransaction Third Party Single sign on Virtualized! Mainframe Web browser Mobile App Composite Application Application services SOAP JDBC JMS MQ REST CICS Data Perf. Config Simulation JDBC SOAP Under construction Existing database Web service and Legacy application 24 Application Under Test Network Virtualization Service Virtualization Existing Infrastructure

25 HP SERVICE VIRTUALIZATION 25

26 Service Virtualization brings big ROI 50-90% Reduced wait time We can start testing earlier without waiting the end to end systems to be ready. Now we can do efficient resource management, predict schedule and launch apps in a timely manner. Test and Release Manager, TTNET 5x Decreased effort to test The effort for the creation of mocks/stubs is substantially reduced (factor 5) and you might need less test systems that s the foundation a strong business case. QA Director, EWE 26

27 HP s complete solution Ready for continuous testing 27

28 HP Software: Apps meet Ops 2015 Thank you