Performance Testing + Service Virtualization: The one-two punch for applications that rock

Transcription

2 June Las Vegas, Nevada Save $300. Use code Vivit. Win 2014 conference pass. Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

7 Question #1 How much do you know about Service Virtualization? I have no idea Just heard about and want to learn how that helps Some knowledge, have try already Expert level 7

8 Question #2 What are your current challenges for performance testing? No test environment, not enough resources to test Complex platform, composite applications Time on scripting Correlation Test data preparation 8

9 Performance Testing with Service Virtualization: The one-two punch for applications that rocks Ferhan Kilical, WW Sr. Product Marketing Manager Mirek Novotny, Product Manager Silvia Siqueira, WW Sr. Product Marketing Manager March 2013 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

10 Applications have become compositions, representing business processes Shopping Process Each of these steps are interconnected software components, also called services Search Buy Pay Ship Track Product Customer Profiles Payment Shipping Components can run anywhere in-house or in the cloud Managed Cloud Traditional Public Cloud Track package 10

11 Speed, change and complexity stymies delivery Hybrid and Cloud composite applications bring three challenges 1. It takes too long to develop and deliver applications 2. It s too costly and risky to use cloud sourced and third party services 3. It s too difficult to test all scenarios too many defects leak to production 11

12 Challenges of a real distributed environment! No Availability Limited Access Dependency on third party REST Third Party LDAP Single sign on MQ Mainframe Web browser JDBC Existing database Mobile App Composite Application Application services SOAP JMS Web service and Legacy application Application Under Test Existing Infrastructure 12

13 Service Virtualization becomes a key answer Keep developing and testing moving forward with virtualized services Virtualize for always available services Virtualize data scenarios Make available for Dev and Test Share services-- lower infrastructure costs REST MQ/CIC S Pay-per-transaction Third Party Mainframe Web browser Mobile App API SOAP REST JDBC MQ RFC CICS Data Perf. Config Composite Simulatio Applicationn RFC/IDO C JDBC SOAP Under construction SAP System Existing database Web service and Legacy application 13 Application Under Test Service Virtualization Existing Infrastructure

14 Modern Applications and Performance Test In distributed environments Software components not ready yet Speed and performance test is a major issue Components/services with limited access Dependency on third party costs Data too difficult to source Security and compliance restrict access REST CICS RFC/IDO C Pay-per-transaction Third Party Mainframe Existing SAP Web browser JDBC Existing database Mobile App Composite Application SOAP JMS Under Web service and constructionlegacy application Application Under Test Existing Infrastructure 14

15 How do you test performance characteristics? Virtual users AUT Configuration SLA Load generators Monitors 3 rd Party services? PayPal API SLA Loadrunner controller SLA Equifax Credit Report 2.0s ->0.5s 15

16 Virtualize to Allow Testing of Performance Characteristics Virtual users AUT Configuration SV Virtualized SLA Load generators Monitors 3 rd Party services Loadrunner controller Monitor response time and throughput Control performance profiles 0.5x SLA PayPal API Equifax Credit Report 16

17 Mobile Apps? Virtualize services and network to deliver high quality faster The complete user experience with Network and Service Virtualization Load Testing: Multi-user and multilocation with Performance Center / LoadRunner Real-World Network Conditions & Performance App. server App. server Backend Monitoring: Sitescope and Diagnostics Device-Side Functionality / Response Services & Systems Service Virtualization 17

18 Complete HP Test Automation Platform Agile Application Delivery with HP Service Virtualization HP Application Lifecycle Management store, run, report state, profiles, metrics store, find, deploy Functionality Performance Security Web UI Mobile App API Composite Application SOAP REST MQ JDBC RFC CICS Data Perf. Config Simulatio n Test Automation Application Under Test Service Virtualization 18

19 We can start testing earlier without waiting the end to end systems to be ready. Now we can do efficient resource management, predict schedule and launch apps in a timely manner. Test and Release Manager, TTNET Speeding up release cycles by eliminating testing delays for unlimited testing TTNET is the largest internet service provider in Turkey with more than six million customers providing internet services, IPTV, Voice over IP and mobile phone Challenge services Deploy more than 200 apps per year. Major delays in testing and were never able to complete test on time. Test had a lot of down time. Test blocking issues were: Dependency on third party services, authorization issues, services not available during working hours, development was always behind. Solution Virtualize 3 rd party endpoints to validate coding changes Multiple development teams started using Service Virtualization to eliminate dependencies Modify performance factors of the virtualize service to ensure upstream calls Deploy virtual services as shared resource Results Reduced test wait time 100%. On average saved 5-8 days/month. 95% of test cases are available through use of HP Service Virtualization. Increased test cycles and test coverage 45% Less defects in Production. 19

20 Benefits of service virtualization for performance testing Start performance testing early Reduce cost No wait time for performance test No late-night performance testing schedules Improve performance testing analysis and prediction 20

21 Service Virtualisation ROI 21 24% Faster Time to Market 50% Increase in Service Availability 22% Fewer Production Defects Source: voke Research 75% Reduced Wait Times 23% Decreased Software Cycles 58% Shorter Test Cycle Times 45% Increased Test Coverage

22 HP Service Virtualization Overview

23 HP Service Virtualization 23 Designer Authoring of virtual services Virtual services are stored on file system Embedded server included Server Runtime for virtual services Agents connecting to application environment (HTTP, JMS, CICS )

24 Virtual Service Designer Virtual Service Control Data Model Performance Model Virtual Service States Configuration 24

25 Wizard based Virtual Service creation Dialog Based Wizards Pre-Set Starting Points 25

26 Functional Model Stateful Conversations Service Operations Functions Rule Detail Simulation Rules 26

27 Performance Model Performance Throttles Performance Parameters Service Operations 27

28 Virtual Services within Functional and Load testing Virtualization Control Virtualization Control Virtual Environment Profiles Virtual Services Realtime Performance 28

29 HP Service Virtualization Demo

30 UC: Load test application for various backend SLAs Challenges: How to change backend SLA? Multiple depending systems 3 rd Party and Production Systems Cannot replicate in lab environment SOAP MQ Exchange Rates Third Party Approval Service UI Claim Processing JMS Loadrunner? Member Accounts 30 Test Automation Application Under Test Existing Infrastructure

31 UC: Load test application for various backend SLAs Solution: HP Service Virtualization 1. Virtualize depending systems 2. Create data model by learning 3. Model desired SLA conditions 4. Execute test and collect metrics Loadrunner UI profiles, metrics Claim Processing SOAP SOAP MQ MQ JMS JMS Data Perf. Config Exchange Rates Third Party Approval Service Member SimulatioAccounts n Simulate Custom SLA 31 Test Automation Application Under Test Service Existing Infrastructure Virtualization

32 Question #3 How can Service Virtualization accelerate your performance testing? Easier the preparation of your test environment Re-use of scripts Reduce time to test Cost savings on resources Fasten the performance testing results 32

33 Q&A 3

34 Thank you! 3

35 Your Performance, Our Passion! Got questions? For more information go to: hp.com/go/sv hp.com/go/loadrunner 35