Performance Testing of a Large Wealth Management Product

Size: px
Start display at page:

Download "Performance Testing of a Large Wealth Management Product"

Transcription

1 Performance Testing of a Large Wealth Management Product Meherphani Nori & Global Head Quality Assurance Krishna Kankipati & Vice President Mohan Pujari & Product Specialist Broadridge Financial Solutions (India) Private Limited

2 Abstract Performance testing is one of the non-functional testing types used to determine how a system performs in terms of responsiveness and stability under a particular work load. Often times before deploying an application in Production Performance testing is used to validate non-functional attributes of a system such as response time, scalability and resource usage. Financial Services industry has applications especially in certain functional areas that need to adhere to certain non-functional attributes in addition to having the required functional accuracy. This is more true in case of web based applications that are accessed by end customers as an unaddressed delay in response times as an example may lead to customer dissatisfaction. This paper discusses how one of the products in the Wealth Management space that had extremely stringent Performance requirements that included: Response time End of day batch processing limitations With preset SLA s and was tested for Performance. It details how the QA team went through the process of Performance testing the application, followed by tuning and retesting ultimately resulting in satisfied SLA s and client go-live.

3 INTRODUCTION As mentioned earlier, Performance testing is one of the non-functional testing types used to determine how a system performs in terms of responsiveness and stability under a particular work load. Various performance testing types are: Load Test: This is used to determine if a system can withstand the anticipated user loads. When the load placed on the system is raised beyond normal usage patterns in order to test the system s response at unusually high or peak loads, it is known as stress testing. Stress testing is usually done to identify the upper limits at which the system will break. Load testing helps to identify the maximum operating capacity of an application as well as any bottlenecks that might interfere with its operating capacity. Endurance Test: This is used to make sure the application can handle the expected workload over a long period of time. These tests are especially useful when trying to track down memory leaks or corruption. Spike Test: This is used to test the application reaction to sudden large spikes in the load generated by users. These tests are perfect for indicating whether system has the capability of handling unexpected loads of connections and users. Capacity Testing: This is used to determine how many users and/or transactions a given system will support and still meet performance goals When an application needs to be tested for performance which may include all or some of the above, the first step is to understand the performance requirements that the system should meet. Once these are clearly agreed then a tool that helps in performance testing needs to be leveraged and the application tested to measure performance. A number of tools are available in the market including open source that can be used for Performance testing. Some of the tools are: Load Runner, Webload, Rational Performance Tester, Visual Studio Team system, Neoload, Testing Anywhere, Appvance, WAPT, Httperf, Loadster, LoadUI, Apache Jmeter, LoadImpact, Open STA, Qengine and Loadstrom. Of the above LoadUI, Apache meter, LoadImpact, Open STA, Qengine and Loadstrom are open source. While different tools mentioned above offer unique benefits and a user should make an appropriate choice determined by the cost as well as the objective, it may be noted that as to how a tool can be chosen is not discussed in this paper. It is important to note that in addition to the above tools, a tool is also needed to monitor and measure performance test metrics. Some of the monitoring tools are: Gemfire Pulse, Pivotal VRP, Microsoft System center 2012 (SCOM) and CA Introscope.

4 PERFORMANCE TESTING METHODOLOGY This section discusses the Performance testing methodology that may be used when testing an application for Performance. Different steps in the process are mentioned with some detail as to what is involved at each step. Identifying Performance Requirements: When the business requirements are documented it is important to understand the performance requirements of the new application that is to be built. This should involve a series of interviews with the business users so that accurate SLA s are captured. It is important that Performance Test Engineers are involved in these discussions which many times are not done. Some of the important performance test requirements that need to be captured during this phase are: Transactions Per Second Transactions Rates: Peak and Average Maximum number of users Maximum number of concurrent users Throughput (Amount of Data Sent and Received per Screen) Data Volumes Workload Input & Hardware and Software configurations Response Times This data can also be used by the architects that would need to determine the architecture of the system that will be built as they will be involved in fine tuning along with the developers when performance testing is done. It is important that the culmination of the above exercise is to have an agreed acceptance performance test criteria with the customer. Tools and Environment: Selecting the tools and deciding on the environment is an important step. While on many occasions the environment is not given priority, it should be accorded top priority as it takes time to set this up and the environment set up is done by an independent department and generally not the QA team. Care should be taken that the test environment matches the production. Any differences should be understood including the impact on the testing and test results. Selecting the right tools for testing is a non-trivial process and one should take help from a knowledgeable experts/organization especially when not well versed with performance testing Performance Test Strategy: This is the most critical step in the testing process. The performance test strategy should detail the approach the testing team will take in using the selected tools in testing the application to ensure the Performance requirements are met. Following should be kept in mind while drafting the performance test strategy: Application Architecture/Design and Technology Platform Workload distribution to be used to exercise the application servers

5 User patterns to be modelled to include user Think times & Pacing Data management issues Tests to be performed Performance testing schedules Performance metrics to be collected Performance acceptance criteria Performance exit criteria Test Design and Test Execution: During the test design phase the following activities are carried out: Designing test scenarios and Generation of Test data Once the above are done, the performance test scenarios are executed. Each load test is executed as defined in planning phase such as user ramp-up rate, test duration and maximum user load simulated etc. While tests are in progress monitoring tools will collect the general system and application level metrics. To ensure the accuracy of the metrics collected, each test is repeated multiple times and average values of metrics should be captured from successful runs. These test results will be used to analyze the results/identify the bottlenecks & Memory issues if any. Few things to be kept in mind while executing tests are: Reboot all Load Generators, Application Servers, DB Servers and Web Servers before the test Don t run any Virtual users on the load testing tool machine (Controller in case of load runner) Make sure there is plenty of free disk space on Controller and Load Generator machines. Ensure that no other unnecessary applications and processes are running Analysis of Performance Test Results and Reporting: Performance test results are analyzed based on Performance under various loads, Transactions per second (TPS), Database throughput, Network latency, Think Time, etc. Based on the results analysis, a comprehensive Test Result report to all stakeholders that contains information & graphs, response times with user load, metrics related to App/Web/DB servers should be provided. The following Key Performance Test reports/graphs can be generated during the Test Result Analysis & Reporting phase

6 Application related graphs/metrics System related graphs/metrics Transaction response times Transactions per second Transaction performance summary Running Virtual users Hits per second http responses per second Throughput Error statistics by description Maximum number of connections Average Transaction response time Processor usage Memory usage Disk I/O rate Network Latency Committed bytes Available Mbytes Context switches/sec Pages/sec Pager faults Processor Queue length Table 1 Key Performance Test Report Graph Types Apart from counters mentioned in above table, Web/App/Database performance counters should also be included. It is recommended that the following data should be part of every test reporting: Response Times Transaction Performance Summary Number of Virtual Users Throughput Resource Utilizations (CPU & Memory) Network Utilization and Network latency Application specific counters When testing a specific application for performance while tweaking of the above process is possible, it is important to note that the following mistakes should be avoided: Not having Performance Goals Ignoring Performance measurement during design phase Performance testing is not conducted until Application is completely developed Focus on Single User Load Test Incorrect Extrapolation

7 CASE STUDY Above approach was used in testing a retail Wealth management Product that was built. This was large size application where the effort to build was more than 80 person years. The key performance requirements included a sub-second response time and End of Day (EOD) batch 5 times faster than that of the old system. An additional challenge was that this system was built using latest technologies like Green Plum and Gem Fire so studying the behavior/bottlenecks was being done by the team for the first time. In the rest of this section the key facets of the methodology detailed in section 3 will be discussed. 1. Identifying Performance Requirements: The QA team used a questionnaire to elicit the requirements. This questionnaire was circulated to key stakeholders to capture performance needs of the application/product. The key questions included identifying the protocols used in communication between the user desktop and server, user locations and number of users in each location, number of concurrent users, key business flows, details of test and production environment. 2. Based on the work carried out by the team it was decided to use Load runner, CA Introscope, Gemfire Pulse monitoring tool and Pivotal VRP. 3. Post the study of the requirements, key business flows, performance needs and tools selected a performance strategy was written. The strategy included the following standalone tests to be executed after loading the application database with 12.7 million accounts having 3.07 billion transactions: a. Load testing of User Interface, Web services b. Testing of extracts c. Testing of EOD batch process d. Endurance testing of web services In addition to the above standalone tests the following tests were also performed a. Combination of EOD batch and Web services b. Combination of User Interface and Web services load test c. Combination of extracts, web services and User Interface test 4. Test scenarios were developed to validate both stability and performance of User interface, extracts, batch loads and Web services. These were used to measure against the SLA s documented and feedback shared with the architecture/development team for tuning before another series of tests can be executed

8 5. Performance test results and Reporting: This section provides what is measured and the graphs and other reports used in the study Response Time Graph: This is used to check if the developed application is meeting the SLA s against response time. Response time is the time taken by the client from connecting to the application server under test until receiving the last byte of the response. In other words, it is the duration of the start of connection to the end of the response. 90 percentile values were considered in measurement. The below graph indicates webservice response times in 90 percentile. The team compared the response time with provided SLA s. The below graph shows the three webservice responses have exceeded SLAs. This was reported to the appropriate teams for correction. References & Appendix Graph 1 Response Times After fine-tuning of the code, QA team repeated the tests. Graph below indicates the webservice response times SLA s are met.

9 Graph 2 Response Times Virtual Users Graph: These graphs are used to understand if the application can withstand the load that it will be subjected to. In order to do this virtual users are created and load test is performed. During load test scenario execution, Virtual users generate data as if they perform transactions. Virtual user graphs can be leveraged to study the response. Below scenario have 50 concurrent virtual users. It can be seen that 26 started immediately followed by another 24 after 2 seconds. This helped us understand that a user load of 50 concurrent users can be taken by the application.

10 Virtual User Details Graph: (Active Users vs Elapsed Time) R a m p - U p R a m p - D o w n Graph 3 Virtual Users Throughput Graph: Throughput is the number of transactions produced over time during a test. Throughput is measured in bytes and represents the amount of data that Virtual users received from the server at any given second. It s also expressed as the amount of capacity that a website or application can handle. This graph shows the amount of data that went through the application when it was handled by 50 concurrent users Graph 4 Throughput

11 Transaction Summary Graph: This graph indicates the number of transactions that passed/failed during user action as detailed in the test scripts. QA team studied the failed transactions to identify the bottlenecks/errors in the application if any. Graph 5 Transaction Summary Errors Graph: Virtual users may not be able to complete all transactions successfully during load test scenario execution. Error graphs allow viewing information about the transactions that failed, stopped, or ended in errors. This graph displays the number of errors that occurred during the scenario execution, grouped by error description.

12 Error Statistics (by Description) Graph All the above graphs are analyzed and discrepancies reported. In the above graph a Gemfire Cache error was noticed as Out Of Memory issue. The below graphs captured from Pulse Monitoring Tool during the load test execution, show 44 JVMs were down and memory usage increased significantly.

13 Before Tuning Figure 1 Gemfire Cluster-1 Memory view After Tuning: As given below no JVMs were down and no Out Of Memory issue. Figure 2 Gemfire Cluster-1 Memory view

14 CPU Utilization: The application contains 48 segment servers and 2 master servers in the Database Architecture. While EOD Batch process was running one of the Green Plum segment server CPU utilization reached 100% and this was identified as an issue. Figure 3 GP Database Server CPU Utilization Below graph is post tuning and verifies that no Green Plum segment servers have reached 100% CPU utilization. Figure 4 GP Database Server CPU Utilization

15 CONCLUSION This paper discussed how a large product built in the Wealth Management space using latest technologies was tested for performance. The methodology used, tools and results have been presented. Subsequent user tests have been extremely satisfactory and the client migrated on to this platform in a shorter time window than was planned which is an ample demonstration of the results used in passing the system for user testing and acceptance.

16 Author Biography Meherphani Nori, Global Head Quality Assurance, Broadridge Financial Solutions has a Master s degree from the Indian Institute of Technology, Kanpur and Diploma in Finance. In his experience of about 23 years, he has played varied roles involving strategy, application development, quality assurance and execution. During his role in India Market Strategy was instrumental in signing first client for Broadridge in India. In the Year 2012 was awarded IT Professional of the Year by the Hyderabad Management Association (HMA) a premier association of Management Professionals in the state of Andhra Pradesh. Prior to Broadridge, was with Tata Consultancy Services playing key roles in their IT Consultancy and Account Management groups. Krishna Kankipati, Vice President, Broadridge Financial Solutions has Master s degree from IIT Mumbai has extensive experience in managing the offshore project teams to assure high quality of software being delivered to leading Broker-Dealers of US market. In his current role Krishna heads the Quality Assurance department covering all the products offered by Broadridge to US Equity, Fixed Income Securities Processing & wealth Management domain. Mohan Pujari Product Specialist has studied MCA (Master of Computer Applications). In his 12 years of experience in the field of testing he has worked in Performance Testing, Functional testing & Test Automation. His areas of expertise in Performance testing are monitoring & tuning of Web applications. He also has expertise in Load Runner and JMeter, Sitescope, Introscope, MoreVRP & Pulse tools. In test automation he has expertise in designing test automation frameworks suitable on various business models.

17 THANK YOU!

Comparative Study of Load Testing Tools

Comparative Study of Load Testing Tools Comparative Study of Load Testing Tools Sandeep Bhatti, Raj Kumari Student (ME), Department of Information Technology, University Institute of Engineering & Technology, Punjab University, Chandigarh (U.T.),

More information

Performance Test Process

Performance Test Process A white Success The performance testing helped the client identify and resolve performance bottlenecks which otherwise crippled the business. The ability to support 500 concurrent users was a performance

More information

Performance Testing. Why is important? An introduction. Why is important? Delivering Excellence in Software Engineering

Performance Testing. Why is important? An introduction. Why is important? Delivering Excellence in Software Engineering Delivering Excellence in Software Engineering Performance Testing An introduction. Why is important? Why is important? 2 1 https://www.youtube.com/watch?v=8y8vqjqbqdc 3 4 2 Introduction Why is important?

More information

Application Performance Testing Basics

Application Performance Testing Basics Application Performance Testing Basics ABSTRACT Todays the web is playing a critical role in all the business domains such as entertainment, finance, healthcare etc. It is much important to ensure hassle-free

More information

How Performance Testing Impacts Customer s Business?

How Performance Testing Impacts Customer s Business? WHITEPAPER How Performance Testing Impacts Customer s Business? Performance testing is an extremely important element before any software product is launched in the market. A well-tested software product

More information

Performance Testing Process

Performance Testing Process Delivering Excellence in Software Engineering Performance Testing An introduction. 1 2 3 4 5 6 Introduction Performance Testing Process Performance Test Types Tools JMeter Questions 2 1 Introduction This

More information

Performance Testing: Roles, Activities, and QA Inclusion

Performance Testing: Roles, Activities, and QA Inclusion : Roles, Activities, and QA Inclusion Michael Lawler NueVista Group 1 Today s Agenda Outline the components of a performance test and considerations Discuss various roles, tasks, and activities Review

More information

Case Study - I. Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008.

Case Study - I. Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008. Case Study - I Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008 Challenges The scalability of the database servers to execute batch processes under

More information

Performance Testing Percy Pari Salas

Performance Testing Percy Pari Salas Performance Testing Percy Pari Salas Presented by : Percy Pari Salas Agenda What is performance testing? Types of performance testing What does performance testing measure? Where does performance testing

More information

Performance Testing. Slow data transfer rate may be inherent in hardware but can also result from software-related problems, such as:

Performance Testing. Slow data transfer rate may be inherent in hardware but can also result from software-related problems, such as: Performance Testing Definition: Performance Testing Performance testing is the process of determining the speed or effectiveness of a computer, network, software program or device. This process can involve

More information

Performance Testing Process A Whitepaper

Performance Testing Process A Whitepaper Process A Whitepaper Copyright 2006. Technologies Pvt. Ltd. All Rights Reserved. is a registered trademark of, Inc. All other trademarks are owned by the respective owners. Proprietary Table of Contents

More information

Bringing Value to the Organization with Performance Testing

Bringing Value to the Organization with Performance Testing Bringing Value to the Organization with Performance Testing Michael Lawler NueVista Group 1 Today s Agenda Explore the benefits of a properly performed performance test Understand the basic elements of

More information

Performance Testing of Java Enterprise Systems

Performance Testing of Java Enterprise Systems Performance Testing of Java Enterprise Systems Katerina Antonova, Plamen Koychev Musala Soft Why Performance Testing? Recent studies by leading USA consultancy companies showed that over 80% of large corporations

More information

Web Performance Testing: Methodologies, Tools and Challenges

Web Performance Testing: Methodologies, Tools and Challenges Web Performance Testing: Methodologies, Tools and Challenges Vinayak Hegde 1, Pallavi M S 2 1 Assistant.Professor, Dept. of Computer Science, Amrita Vishwa Vidyapeetham, Mysore Campus, India 2 Lecturer,

More information

Enterprise Performance Testing. Karuna Karnati and Ajay Kumar. Accenture Delivery Center for Technology in India

Enterprise Performance Testing. Karuna Karnati and Ajay Kumar. Accenture Delivery Center for Technology in India Enterprise Performance Testing Karuna Karnati and Ajay Kumar Accenture Delivery Center for Technology in India Accenture, its logo, and High Performance Delivered are trademarks of Accenture. Enterprise

More information

White paper: Unlocking the potential of load testing to maximise ROI and reduce risk.

White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. Executive Summary Load testing can be used in a range of business scenarios to deliver numerous benefits. At its core,

More information

Levels of Software Testing. Functional Testing

Levels of Software Testing. Functional Testing Levels of Software Testing There are different levels during the process of Testing. In this chapter a brief description is provided about these levels. Levels of testing include the different methodologies

More information

MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM?

MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM? MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM? Ashutosh Shinde Performance Architect ashutosh_shinde@hotmail.com Validating if the workload generated by the load generating tools is applied

More information

Recommendations for Performance Benchmarking

Recommendations for Performance Benchmarking Recommendations for Performance Benchmarking Shikhar Puri Abstract Performance benchmarking of applications is increasingly becoming essential before deployment. This paper covers recommendations and best

More information

PERFORMANCE TESTING. New Batches Info. We are ready to serve Latest Testing Trends, Are you ready to learn.?? START DATE : TIMINGS : DURATION :

PERFORMANCE TESTING. New Batches Info. We are ready to serve Latest Testing Trends, Are you ready to learn.?? START DATE : TIMINGS : DURATION : PERFORMANCE TESTING We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info START DATE : TIMINGS : DURATION : TYPE OF BATCH : FEE : FACULTY NAME : LAB TIMINGS : Performance

More information

Mobile Performance Testing Approaches and Challenges

Mobile Performance Testing Approaches and Challenges NOUS INFOSYSTEMS LEVERAGING INTELLECT Mobile Performance Testing Approaches and Challenges ABSTRACT Mobile devices are playing a key role in daily business functions as mobile devices are adopted by most

More information

Global Delivery Centre:

Global Delivery Centre: Performance Testing Global Delivery Centre: 401-408, A-Wing, Pride Silicon Plaza, S.B. Road, Shivaji Nagar, Pune -411006, Maharashtra, INDIA Email: info@nitorinfotech.com Tel: +91-20-41020202 Introduction

More information

Web Application s Performance Testing

Web Application s Performance Testing Web Application s Performance Testing B. Election Reddy (07305054) Guided by N. L. Sarda April 13, 2008 1 Contents 1 Introduction 4 2 Objectives 4 3 Performance Indicators 5 4 Types of Performance Testing

More information

TRACE PERFORMANCE TESTING APPROACH. Overview. Approach. Flow. Attributes

TRACE PERFORMANCE TESTING APPROACH. Overview. Approach. Flow. Attributes TRACE PERFORMANCE TESTING APPROACH Overview Approach Flow Attributes INTRODUCTION Software Testing Testing is not just finding out the defects. Testing is not just seeing the requirements are satisfied.

More information

Table of Contents INTRODUCTION... 3. Prerequisites... 3 Audience... 3 Report Metrics... 3

Table of Contents INTRODUCTION... 3. Prerequisites... 3 Audience... 3 Report Metrics... 3 Table of Contents INTRODUCTION... 3 Prerequisites... 3 Audience... 3 Report Metrics... 3 IS MY TEST CONFIGURATION (DURATION / ITERATIONS SETTING ) APPROPRIATE?... 4 Request / Response Status Summary...

More information

Web Application Testing. Web Performance Testing

Web Application Testing. Web Performance Testing Web Application Testing Web Performance Testing Objectives of Performance Testing Evaluate runtime compliance to performance requirements Check different properties such as throughput (bits/sec, packets/sec)

More information

Performance Test Summary Report Skills Development Management System. December 2014

Performance Test Summary Report Skills Development Management System. December 2014 Performance Test Summary Report Skills Development Management System December 2014 Performance Test report submitted to National Skill Development Corporation Version Date Name Summary of Changes 1.0 22/12/2014

More information

Performance And Scalability In Oracle9i And SQL Server 2000

Performance And Scalability In Oracle9i And SQL Server 2000 Performance And Scalability In Oracle9i And SQL Server 2000 Presented By : Phathisile Sibanda Supervisor : John Ebden 1 Presentation Overview Project Objectives Motivation -Why performance & Scalability

More information

Martin Spier, Expedia & Rex Black, J9

Martin Spier, Expedia & Rex Black, J9 Martin Spier, Expedia & Rex Black, J9 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Leveraging HP Performance Center Martin

More information

Introducing Performance Engineering by means of Tools and Practical Exercises

Introducing Performance Engineering by means of Tools and Practical Exercises Introducing Performance Engineering by means of Tools and Practical Exercises Alexander Ufimtsev, Trevor Parsons, Lucian M. Patcas, John Murphy and Liam Murphy Performance Engineering Laboratory, School

More information

Business Application Services Testing

Business Application Services Testing Business Application Services Testing Curriculum Structure Course name Duration(days) Express 2 Testing Concept and methodologies 3 Introduction to Performance Testing 3 Web Testing 2 QTP 5 SQL 5 Load

More information

Successful Factors for Performance Testing Projects. NaveenKumar Namachivayam - Founder - QAInsights

Successful Factors for Performance Testing Projects. NaveenKumar Namachivayam - Founder - QAInsights Successful Factors for Performance Testing Projects NaveenKumar Namachivayam - Founder - QAInsights Contents Introduction... 2 Planning... 3 Staffing... 5 Test Environments... 7 Support... 8 Intuitive

More information

Open Source and Commercial Performance Testing Tools

Open Source and Commercial Performance Testing Tools Open Source and Commercial Performance Testing Tools Palla Vinod Kumar Accenture Delivery Center for Technology in India Accenture, its logo, and High Performance Delivered are trademarks of Accenture.

More information

Sensitivity Analysis and Patterns Implementation on Load Testing Software Systems

Sensitivity Analysis and Patterns Implementation on Load Testing Software Systems Sensitivity Analysis and Patterns Implementation on Load Testing Software Systems Alexandra Nagy*, George Sebastian Chiş Babeş-Bolyai University, Faculty of Economics and Business Administration, Computer

More information

Load Testing on Web Application using Automated Testing Tool: Load Complete

Load Testing on Web Application using Automated Testing Tool: Load Complete Load Testing on Web Application using Automated Testing Tool: Load Complete Neha Thakur, Dr. K.L. Bansal Research Scholar, Department of Computer Science, Himachal Pradesh University, Shimla, India Professor,

More information

EQUELLA Whitepaper. Performance Testing. Carl Hoffmann Senior Technical Consultant

EQUELLA Whitepaper. Performance Testing. Carl Hoffmann Senior Technical Consultant EQUELLA Whitepaper Performance Testing Carl Hoffmann Senior Technical Consultant Contents 1 EQUELLA Performance Testing 3 1.1 Introduction 3 1.2 Overview of performance testing 3 2 Why do performance testing?

More information

Informatica Data Director Performance

Informatica Data Director Performance Informatica Data Director Performance 2011 Informatica Abstract A variety of performance and stress tests are run on the Informatica Data Director to ensure performance and scalability for a wide variety

More information

WHAT WE NEED TO START THE PERFORMANCE TESTING?

WHAT WE NEED TO START THE PERFORMANCE TESTING? ABSTRACT Crystal clear requirements before starting an activity are always helpful in achieving the desired goals. Achieving desired results are quite difficult when there is vague or incomplete information

More information

Performance and Load Testing. >>>>>>>>>>>>>>>>>>>>>> www.softwaretestinggenius.com <<<<<<<<<<<<<<<<<<<<<<

Performance and Load Testing. >>>>>>>>>>>>>>>>>>>>>> www.softwaretestinggenius.com <<<<<<<<<<<<<<<<<<<<<< Performance and Load Testing Part 1 Performance & Load Testing Basics Performance & Load Testing Basics Introduction to Performance Testing Difference between Performance, Load and Stress Testing Why Performance

More information

ArcGIS for Server Performance and Scalability-Testing and Monitoring Tools. Amr Wahba awahba@esri.com

ArcGIS for Server Performance and Scalability-Testing and Monitoring Tools. Amr Wahba awahba@esri.com ArcGIS for Server Performance and Scalability-Testing and Monitoring Tools Amr Wahba awahba@esri.com Introductions Who are we? - ESRI Dubai Office Target audience - GIS administrators - DBAs - Architects

More information

A closer look at HP LoadRunner software

A closer look at HP LoadRunner software Technical white paper A closer look at HP LoadRunner software Table of contents Sizing up the system 2 The limits of manual testing 2 A new take on testing: the HP LoadRunner solution 3 The HP LoadRunner

More information

Performance TesTing expertise in case studies a Q & ing T es T

Performance TesTing expertise in case studies a Q & ing T es T testing & QA Performance Testing Expertise in Case Studies Case 1 ELEKS team has developed a custom test framework designed to accommodate numerous types of testing and measurements: Accuracy testing during

More information

10 Best Practices for Application Performance Testing

10 Best Practices for Application Performance Testing Business white paper 10 Best Practices for Application Performance Testing Leveraging Agile Performance Testing for Web and Mobile Applications 10 Best Practices for Application Performance Testing Table

More information

Summer Internship 2013 Group No.4-Enhancement of JMeter Week 1-Report-1 27/5/2013 Naman Choudhary

Summer Internship 2013 Group No.4-Enhancement of JMeter Week 1-Report-1 27/5/2013 Naman Choudhary Summer Internship 2013 Group No.4-Enhancement of JMeter Week 1-Report-1 27/5/2013 Naman Choudhary For the first week I was given two papers to study. The first one was Web Service Testing Tools: A Comparative

More information

Databases Going Virtual? Identifying the Best Database Servers for Virtualization

Databases Going Virtual? Identifying the Best Database Servers for Virtualization Identifying the Best Database Servers for Virtualization By Confio Software Confio Software 4772 Walnut Street, Suite 100 Boulder, CO 80301 www.confio.com Many companies are turning to virtualization in

More information

Performance Analysis of webmethods Integrations using Apache JMeter Information Guide for JMeter Adoption

Performance Analysis of webmethods Integrations using Apache JMeter Information Guide for JMeter Adoption TORRY HARRIS BUSINESS SOLUTIONS Performance Analysis of webmethods Integrations using Apache JMeter Information Guide for JMeter Adoption Ganapathi Nanjappa 4/28/2010 2010 Torry Harris Business Solutions.

More information

Avoiding Performance Bottlenecks in Hyper-V

Avoiding Performance Bottlenecks in Hyper-V Avoiding Performance Bottlenecks in Hyper-V Identify and eliminate capacity related performance bottlenecks in Hyper-V while placing new VMs for optimal density and performance Whitepaper by Chris Chesley

More information

Performance Modeling for Web based J2EE and.net Applications

Performance Modeling for Web based J2EE and.net Applications Performance Modeling for Web based J2EE and.net Applications Shankar Kambhampaty, and Venkata Srinivas Modali Abstract When architecting an application, key nonfunctional requirements such as performance,

More information

Strong experience in drafting Test Plan, Test Strategy, Test Estimation, Test Cases, Requirement Matrix, Audit and Test Results documents

Strong experience in drafting Test Plan, Test Strategy, Test Estimation, Test Cases, Requirement Matrix, Audit and Test Results documents 1 KIRAN BADI MOBILE : 6462013101 EMAIL: KIRAN_BADI@HOTMAIL.COM PROFESSIONAL SUMMARY 9+ Years as a Performance Engineer and around 3 years as J2EE Developers with total 12 + years of IT Experiences.5 +

More information

Mohammed Khan SUMMARY

Mohammed Khan SUMMARY Mohammed Khan E-mail: Mohammedrkhn@gmail.com Phone: 347-878-1170 SUMMARY Over 5 years of diversified experience as a. Experience includes requirement analysis, manual testing and automation and quality

More information

27 th March 2015 Istanbul, Turkey. Performance Testing Best Practice

27 th March 2015 Istanbul, Turkey. Performance Testing Best Practice 27 th March 2015 Istanbul, Turkey Performance Testing Best Practice Your Host.. Ian Molyneaux Leads the Intechnica performance team More years in IT than I care to remember Author of The Art of Application

More information

Bernie Velivis President, Performax Inc

Bernie Velivis President, Performax Inc Performax provides software load testing and performance engineering services to help our clients build, market, and deploy highly scalable applications. Bernie Velivis President, Performax Inc Load ing

More information

Best Practices for Web Application Load Testing

Best Practices for Web Application Load Testing Best Practices for Web Application Load Testing This paper presents load testing best practices based on 20 years of work with customers and partners. They will help you make a quick start on the road

More information

Windows 2003 Performance Monitor. System Monitor. Adding a counter

Windows 2003 Performance Monitor. System Monitor. Adding a counter Windows 2003 Performance Monitor The performance monitor, or system monitor, is a utility used to track a range of processes and give a real time graphical display of the results, on a Windows 2003 system.

More information

Microsoft Dynamics NAV 2013 R2 Sizing Guidelines for On-Premises Single Tenant Deployments

Microsoft Dynamics NAV 2013 R2 Sizing Guidelines for On-Premises Single Tenant Deployments Microsoft Dynamics NAV 2013 R2 Sizing Guidelines for On-Premises Single Tenant Deployments July 2014 White Paper Page 1 Contents 3 Sizing Recommendations Summary 3 Workloads used in the tests 3 Transactional

More information

Copyright www.agileload.com 1

Copyright www.agileload.com 1 Copyright www.agileload.com 1 INTRODUCTION Performance testing is a complex activity where dozens of factors contribute to its success and effective usage of all those factors is necessary to get the accurate

More information

Testing Big data is one of the biggest

Testing Big data is one of the biggest Infosys Labs Briefings VOL 11 NO 1 2013 Big Data: Testing Approach to Overcome Quality Challenges By Mahesh Gudipati, Shanthi Rao, Naju D. Mohan and Naveen Kumar Gajja Validate data quality by employing

More information

Rapid Bottleneck Identification

Rapid Bottleneck Identification Rapid Bottleneck Identification TM A Better Way to Load Test WHITEPAPER You re getting ready to launch or upgrade a critical Web application. Quality is crucial, but time is short. How can you make the

More information

Case Study: Load Testing and Tuning to Improve SharePoint Website Performance

Case Study: Load Testing and Tuning to Improve SharePoint Website Performance Case Study: Load Testing and Tuning to Improve SharePoint Website Performance Abstract: Initial load tests revealed that the capacity of a customized Microsoft Office SharePoint Server (MOSS) website cluster

More information

Noelle A. Stimely Senior Performance Test Engineer. University of California, San Francisco noelle.stimely@ucsf.edu

Noelle A. Stimely Senior Performance Test Engineer. University of California, San Francisco noelle.stimely@ucsf.edu Noelle A. Stimely Senior Performance Test Engineer University of California, San Francisco noelle.stimely@ucsf.edu Who am I? Senior Oracle Database Administrator for over 13 years Senior Performance Test

More information

Performance Testing. What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing

Performance Testing. What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing Performance Testing What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing What is Performance Testing l The primary goal of Performance

More information

Performance Analysis of Web based Applications on Single and Multi Core Servers

Performance Analysis of Web based Applications on Single and Multi Core Servers Performance Analysis of Web based Applications on Single and Multi Core Servers Gitika Khare, Diptikant Pathy, Alpana Rajan, Alok Jain, Anil Rawat Raja Ramanna Centre for Advanced Technology Department

More information

Performance Testing of.net Web Application for Email Campaign Management

Performance Testing of.net Web Application for Email Campaign Management 1 Performance Testing of.net Web Application for Email Campaign Management Abstract Its Netherlands based company specializing in personalized and interactive communication related applications which provides

More information

Performance Testing and Optimization in Web-Service Based Applications

Performance Testing and Optimization in Web-Service Based Applications Performance Testing and Optimization in Web-Service Based Applications Mesfin Mulugeta mesfin.mulugeta@blackboard.com Sr. Software Performance Engineer Goals of the Presentation Brief introduction to software

More information

PERFORMANCE TESTING MANUAL. Submitted By

PERFORMANCE TESTING MANUAL. Submitted By PERFORMANCE TESTING MANUAL Submitted By Table of contents Introduction What is Performance Testing? Purpose of Performance Testing Performance Testing Sub-Genres Load Testing Stress Testing Volume Testing

More information

Siebel & Portal Performance Testing and Tuning GCP - IT Performance Practice

Siebel & Portal Performance Testing and Tuning GCP - IT Performance Practice & Portal Performance Testing and Tuning GCP - IT Performance Practice By Zubair Syed (zubair.syed@tcs.com) April 2014 Copyright 2012 Tata Consultancy Services Limited Overview A large insurance company

More information

Case Study. Case Study. Performance Testing For Student Application. US-based For-profit University (Higher Education) 1 2014 Compunnel Software Group

Case Study. Case Study. Performance Testing For Student Application. US-based For-profit University (Higher Education) 1 2014 Compunnel Software Group Performance Testing For Student Application US-based For-profit University (Higher Education) 1 2014 Compunnel Software Group Compunnel s Performance Testing Solution Delivers Impressive Student Experience

More information

Capacity Planning for Microsoft SharePoint Technologies

Capacity Planning for Microsoft SharePoint Technologies Capacity Planning for Microsoft SharePoint Technologies Capacity Planning The process of evaluating a technology against the needs of an organization, and making an educated decision about the configuration

More information

ArcGIS for Server Performance and Scalability: Testing Methodologies. Andrew Sakowicz, asakowicz@esri.com Frank Pizzi, fpizzi@esri.

ArcGIS for Server Performance and Scalability: Testing Methodologies. Andrew Sakowicz, asakowicz@esri.com Frank Pizzi, fpizzi@esri. ArcGIS for Server Performance and Scalability: Testing Methodologies Andrew Sakowicz, asakowicz@esri.com Frank Pizzi, fpizzi@esri.com Introductions Target audience - GIS, DB, System administrators - Testers

More information

Estimate Performance and Capacity Requirements for Workflow in SharePoint Server 2010

Estimate Performance and Capacity Requirements for Workflow in SharePoint Server 2010 Estimate Performance and Capacity Requirements for Workflow in SharePoint Server 2010 This document is provided as-is. Information and views expressed in this document, including URL and other Internet

More information

Performance White Paper

Performance White Paper Sitecore Experience Platform 8.1 Performance White Paper Rev: March 11, 2016 Sitecore Experience Platform 8.1 Performance White Paper Sitecore Experience Platform 8.1 Table of contents Table of contents...

More information

Capacity Planning. Capacity Planning Process

Capacity Planning. Capacity Planning Process Process, page 1 Getting Started, page 2 Collected Data Categorization, page 3 Capacity Utilization, page 6 Process Figure 1: Process You should make changes to an existing Unified ICM/Unified CCE deployment

More information

Load Testing Tools. Animesh Das

Load Testing Tools. Animesh Das Load Testing Tools Animesh Das Last Updated: May 20, 2014 text CONTENTS Contents 1 Introduction 1 2 Tools available for Load Testing of Databases 1 2.1 IO subsystem testing tools....................................

More information

Developing a Load Testing Strategy

Developing a Load Testing Strategy Developing a Load Testing Strategy Michele Ruel St.George Bank CMGA 2005 Page 1 Overview... 3 What is load testing?... 4 Scalability Test... 4 Sustainability/Soak Test... 4 Comparison Test... 4 Worst Case...

More information

Keywords: Load testing, testing tools, test script, Open-source Software, web applications.

Keywords: Load testing, testing tools, test script, Open-source Software, web applications. Volume 3, Issue 5, May 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com A Comparative Analysis

More information

Microsoft Private Cloud

Microsoft Private Cloud Microsoft Private Cloud Lorenz Wolf, Solution Specialist Datacenter, Microsoft SoftwareOne @ Au Premier Zürich - 22.03.2011 What is PRIVATE CLOUD Private Public Public Cloud Private Cloud shared resources.

More information

STeP-IN SUMMIT 2014. June 2014 at Bangalore, Hyderabad, Pune - INDIA. Performance testing Hadoop based big data analytics solutions

STeP-IN SUMMIT 2014. June 2014 at Bangalore, Hyderabad, Pune - INDIA. Performance testing Hadoop based big data analytics solutions 11 th International Conference on Software Testing June 2014 at Bangalore, Hyderabad, Pune - INDIA Performance testing Hadoop based big data analytics solutions by Mustufa Batterywala, Performance Architect,

More information

SP Apps 1.1.4 Performance test Test report. 2012/10 Mai Au

SP Apps 1.1.4 Performance test Test report. 2012/10 Mai Au SP Apps 1.1.4 Performance test Test report 2012/10 Mai Au SP Apps 1.1.0 Performance test... 1 Test report... 1 1. Purpose... 3 2. Performance criteria... 3 3. Environments used for performance testing...

More information

Load Testing Analysis Services Gerhard Brückl

Load Testing Analysis Services Gerhard Brückl Load Testing Analysis Services Gerhard Brückl About Me Gerhard Brückl Working with Microsoft BI since 2006 Mainly focused on Analytics and Reporting Analysis Services / Reporting Services Power BI / O365

More information

Krishna Markande, Principal Architect Sridhar Murthy, Senior Architect. Unleashing the Potential of Cloud for Performance Testing

Krishna Markande, Principal Architect Sridhar Murthy, Senior Architect. Unleashing the Potential of Cloud for Performance Testing Krishna Markande, Principal Architect Sridhar Murthy, Senior Architect Unleashing the Potential of Cloud for Performance Testing 1 Agenda Software testing and Performance testing overview Leveraging cloud

More information

Whitepaper Performance Testing and Monitoring of Mobile Applications

Whitepaper Performance Testing and Monitoring of Mobile Applications M eux Test Whitepaper Performance Testing and Monitoring of Mobile Applications Abstract The testing of a mobile application does not stop when the application passes all functional tests. Testing the

More information

HOW TO EVALUATE AND SELECT TOOL A HIGH-END LOAD TESTING. Marquis Harding Reality Test P R E S E N T A T I O N. Presentation. Bio

HOW TO EVALUATE AND SELECT TOOL A HIGH-END LOAD TESTING. Marquis Harding Reality Test P R E S E N T A T I O N. Presentation. Bio Presentation P R E S E N T A T I O N Bio E6 Thursday, March 8, 2001 11:30 AM HOW TO EVALUATE AND SELECT A HIGH-END LOAD TESTING TOOL Marquis Harding Reality Test International Conference On Software Test

More information

Performance Testing Tools: A Comparative Analysis

Performance Testing Tools: A Comparative Analysis Performance Testing Tools: A Comparative Analysis Shagun Bhardwaj Research Scholar Computer Science department Himachal Pradesh University Shimla Dr. Aman Kumar Sharma Associate Professor Computer Science

More information

Tableau Server 7.0 scalability

Tableau Server 7.0 scalability Tableau Server 7.0 scalability February 2012 p2 Executive summary In January 2012, we performed scalability tests on Tableau Server to help our customers plan for large deployments. We tested three different

More information

Virtual desktops made easy

Virtual desktops made easy Product test: DataCore Virtual Desktop Server 2.0 Virtual desktops made easy Dr. Götz Güttich The Virtual Desktop Server 2.0 allows administrators to launch and maintain virtual desktops with relatively

More information

ArcGIS Enterprise Systems: Designing, Testing and Monitoring

ArcGIS Enterprise Systems: Designing, Testing and Monitoring Federal GIS Conference February 9 10, 2015 Washington, DC ArcGIS Enterprise Systems: Designing, Testing and Monitoring Jim VanOstenbridge, jvanostenbridge@esri.com> Martin Hamann, MHamann@esri.com Andrew

More information

Agile Performance Testing

Agile Performance Testing Agile Performance Testing Cesario Ramos Independent Consultant AgiliX Agile Development Consulting Overview Why Agile performance testing? Nature of performance testing Agile performance testing Why Agile

More information

Tools for Testing Software Architectures. Learning Objectives. Context

Tools for Testing Software Architectures. Learning Objectives. Context Tools for Testing Software Architectures Wolfgang Emmerich Professor of Distributed Computing University College London http://sse.cs.ucl.ac.uk Learning Objectives To discuss tools to validate software

More information

Rapid Bottleneck Identification A Better Way to do Load Testing. An Oracle White Paper June 2009

Rapid Bottleneck Identification A Better Way to do Load Testing. An Oracle White Paper June 2009 Rapid Bottleneck Identification A Better Way to do Load Testing An Oracle White Paper June 2009 Rapid Bottleneck Identification A Better Way to do Load Testing. RBI combines a comprehensive understanding

More information

W21. Performance Testing: Step On It. Nadine Pelicaen. P r e s e n t a t i o n

W21. Performance Testing: Step On It. Nadine Pelicaen. P r e s e n t a t i o n Performance Testing: Step On It Nadine Pelicaen International Conference On Software Testing, Analysis & Review November 19-23 Stockholm, Sweden P r e s e n t a t i o n W21 Friday 23rd November, 2001 Wednesday

More information

Maintaining Non-Stop Services with Multi Layer Monitoring

Maintaining Non-Stop Services with Multi Layer Monitoring Maintaining Non-Stop Services with Multi Layer Monitoring Lahav Savir System Architect and CEO of Emind Systems lahavs@emindsys.com www.emindsys.com The approach Non-stop applications can t leave on their

More information

Application. Performance Testing

Application. Performance Testing Application Performance Testing www.mohandespishegan.com شرکت مهندش پیشگان آزمون افسار یاش Performance Testing March 2015 1 TOC Software performance engineering Performance testing terminology Performance

More information

Effective Testing & Quality Assurance in Data Migration Projects. Agile & Accountable Methodology

Effective Testing & Quality Assurance in Data Migration Projects. Agile & Accountable Methodology contents AUT H O R : S W A T I J I N D A L Effective Testing & Quality Assurance in Data Migration Projects Agile & Accountable Methodology Executive Summary... 2 Risks Involved in Data Migration Process...

More information

Taking the First Steps in. Web Load Testing. Telerik

Taking the First Steps in. Web Load Testing. Telerik Taking the First Steps in Web Load Testing Telerik An Introduction Software load testing is generally understood to consist of exercising an application with multiple users to determine its behavior characteristics.

More information

Holistic Performance Analysis of J2EE Applications

Holistic Performance Analysis of J2EE Applications Holistic Performance Analysis of J2EE Applications By Madhu Tanikella In order to identify and resolve performance problems of enterprise Java Applications and reduce the time-to-market, performance analysis

More information

Scalability Results. Select the right hardware configuration for your organization to optimize performance

Scalability Results. Select the right hardware configuration for your organization to optimize performance Scalability Results Select the right hardware configuration for your organization to optimize performance Table of Contents Introduction... 1 Scalability... 2 Definition... 2 CPU and Memory Usage... 2

More information

An Oracle White Paper March 2013. Load Testing Best Practices for Oracle E- Business Suite using Oracle Application Testing Suite

An Oracle White Paper March 2013. Load Testing Best Practices for Oracle E- Business Suite using Oracle Application Testing Suite An Oracle White Paper March 2013 Load Testing Best Practices for Oracle E- Business Suite using Oracle Application Testing Suite Executive Overview... 1 Introduction... 1 Oracle Load Testing Setup... 2

More information

Tableau Server Scalability Explained

Tableau Server Scalability Explained Tableau Server Scalability Explained Author: Neelesh Kamkolkar Tableau Software July 2013 p2 Executive Summary In March 2013, we ran scalability tests to understand the scalability of Tableau 8.0. We wanted

More information