Krishna Markande, Principal Architect Sridhar Murthy, Senior Architect. Unleashing the Potential of Cloud for Performance Testing

Transcription

1 Krishna Markande, Principal Architect Sridhar Murthy, Senior Architect Unleashing the Potential of Cloud for Performance Testing 1

2 Agenda Software testing and Performance testing overview Leveraging cloud infrastructure for performance testing Cloud Based Load Simulation Platform Sample case study Q&A 2

3 Software Testing An Overview Functional Testing End to end transactions Test for all the links and forms used in the webpage Usability Testing Test for navigation Content checking Interface Testing Compatibility Testing Performance testing Web Server and Application server Interface Application server and database server interactions Browser and Operating system compatibility Mobile browsing and Printing options Web load testing Web stress testing Ready to Go Live Security Testing Check all transactions, security breach attempts Accessibility Test Accessibility compliance 508c testing 3

4 Performance Testing - Legacy Way Infrastructure provisioned within own data centers/lab or Partner data centers /Lab Test infrastructure from own data centers Test infrastructure from external test labs Challenges / Limitations: Infrastructure needed for a prolong duration throughout performance testing phase -> Cost Considerable effort and time are spent in procurement, setup and configuration -> Time Scale of the test infrastructure and spread of test data center is limited -> Quality of Testing Needed: Improved Test Quality Overall Testing Cost + Optimization + Faster setup and Testing 4

5 Results Leveraging cloud infrastructure and platform for testing Improved Test Quality Test Infrastructure Spread across Geos Theoretically unlimited scale and elasticity Real-time reporting Overall Testing Cost Optimization Pay per use On demand provisioning de-provisioning Easy of setup and deployment Faster setup and Testing Faster provisioning and setup Supporting tools and automation No dependencies from partner 5

6 Performance Testing Enterprise Needs Rolling out to Global users and need more realtime testing? Want to cut down Time to Market? Global Users Increasing number of systems deployed - servicing global market or users High user-base necessitates a strong and near-real time load testing exercise to identify performance issues Competition Faster time to market / Faster Rollout More closer user simulations reducing beta test duration Reduced test cycles Want to Optimize test infrastructure cost? Infrastructure cost and lead time Reduce test infrastructure cost Reduce lead time for acquiring test infrastructure Why Cloud Based Load Simulation? 6

7 Solution for Near real-time Load test and Unlimited Load Cloud Based Load Simulation Platform - Approach Solution Business Value Leverage Cloud - Leverages Cloud Infrastructure ; Public or Private - Can generate unlimited on-demand Load - Load generation from Multiple Geographies 1 2 Near Production Test (from multiple data center and no extrapolation needed) Reduced Testing Cost (auto provisioning and pay per use, automated setup ) Leverage Current Investment - Add specific plug-ins for additional Cloud Infrastructure and Test tools - Leverage same test scripts and skillsets 3 Quicker Time to Market (Reduce Beta test with near real-time testing) Apply in Multiple Scenarios - Leverage for testing cloud hosted, on-premise and for intranet based applications - In load testing, benchmarking and certification 4 5 Real-time Reporting (fine grained, Consolidated reports, client side metrics) Simplicity (Abstracted complexity and easy to use by a Tester) 7

8 Cloud Based Load Simulation Platform - Components Compute Service: Provides on demand compute instances with different instance sizes for test server setup Storage Service: Provides storage mechanism for the testserver template,configuration data, reports etc Queuing Service: Offers a reliable, scalable and easy retrieval of test job and other data. Platform: Coordinates the load testing tool, test job and test results as they orchestrated through the compute, storage, and Queuing processes. Platform interlinks all the core components and provides a mechanism to implement elasticity 8

9 Cloud Based Load Simulation Platform - Sample Reports 1 Average duration of a Session per User 1 2 Provision Load test Infrastructure Configure Load Test Cluster 2 3 Throughput Percentage of failed Sessions Average Response Time per Request Failure Vs Passed Region Monitor and Analyze Test Results Execute Load test 6 Failure Vs Passed Region-2 7 CPU Usage VM1 8 CPU Usage VM Add additional Custom reports using templates or additional plug-ins 9

10 Cloud Based Load Simulation Solution Applying in Reality Problem Statement Simulate the Load generation for real-time production scenario for synchronization Service Simulate Users from Distributed locations/geography. Analyze inputs for Capacity planning Perform Storage server/services benchmarking Solution Overview Business Value Reduced Time To Market (TTM) about 3-4 weeks and reduced development/test cost & effort about 60% by using framework and plug-ins Reduced Infrastructure cost about 40% cost saving compared to on premise Accurate capacity planning inputs for server side infra. High load simulation using multiple Cluster/Grid servers from Cloud Infrastructure. Used both Amazon EC2, and Microsoft Azure, for better granularity and bench marking Concurrent User load ranging up to 2million user with a total users of 20milion, using up to 600VMs concurrently Data volume ranging up to 80TB-100TB per hour Test Duration for various ranges, like 1 hour duration for regular load testing to 1 week for stress testing Test reporting using Standard Reporting and extensible custom reporting templates for specific needs. 10

11 THANK YOU The contents of this document are proprietary and confidential to Infosys Limited and may not be disclosed in whole or in part at any time, to any third party without the prior written consent of Infosys Limited Infosys Limited. All rights reserved. Copyright in the whole and any part of this document belongs to Infosys Limited. This work may not be used, sold, transferred, adapted, abridged, copied or reproduced in whole or in part, in any manner or form, or in any media, without the prior written consent of Infosys Limited.