Performance Testing: A guide to successful Real World Performance Testing November 2013

Size: px
Start display at page:

Download "Performance Testing: A guide to successful Real World Performance Testing November 2013"

Transcription

1 Performance Testing: A guide to successful Real World Performance Testing November 2013 Mohit Verma Performance Engineering Evangelist Tufts Health Plan

2 Abstract In this paper, we present benefits of performance testing, forms of performance testing, key success factors and provide a framework to build a business case for Performance Testing and Application Performance Monitoring. It will be beneficial for beginner Performance Engineers and help close gaps for existing engineers by illustrating some best practices and guidelines for Successful Performance testing, and building a Performance Testing Center of Excellence Performance and Capacity, Nov

3 Agenda About us Market State Why Performance Test? Technical Environment Performance Testing Performance Testing Benefits Performance Testing CSFs Performance Testing Synergies Questions? Performance and Capacity, Nov

4 About us: Founded in 1979 as a not-for-profit health maintenance organization, Tufts Health Plan is one of the nation s most highly rated health plans. The company is distinguished for providing an outstanding member experience and access to quality care. Tufts Health Plan offers a broad array of health care coverage options to individuals and employer groups. Through diverse product offerings, the plan covers members regionally and across the country. Our applications typically support: Health Care Providers (Hospitals, Physician Practices, ACO s, etc) Employers Members Brokers Employees Performance and Capacity, Nov

5 Market State Forrester recently reported that among companies with revenue of more than $1 billion, nearly 85% reported experiencing incidents of significant application performance degradation. Respondents identified the application architecture and deployment as being of primary importance to the root cause of application performance problems. Performance and Capacity, Nov

6 Example 1: Amazon.com June 29 th Outage* Amazon.com experienced a widespread outage in the AM that lasted, at least for many customers, more than three hours and displayed blank or partial pages instead of product listings. By mid-afternoon, Amazon's home page was devoid of any product photographs and showed only a list of categories on the left of the screen. Searching for items often didn't work, and customers' shopping carts and saved item lists were temporarily displayed as empty. At an annual revenue of nearly $27 billion, Amazon faces a potential loss of an average of $51,400 a minute when it's site is offline. Amazon shares closed down 7.8 percent, a sharper fall than the Nasdaq index. A post on an Amazon seller community form at 12:47 p.m. PDT said: "We are currently experiencing an issue that is impacting customers' ability to place orders on the Amazon.com website." A followup announcement an hour later said the problem had not been resolved. Performance and Capacity, Nov

7 Example 2: Dell.com gave shoppers the lowest high broadband access time among large web retailers according to Gomez. Retailer High Low Dial Up Broadband Broadband Dell.com ColdwaterCreek.com Williams-Sonoma.com QVC.com Amazon.com OfficeDepot.com Scholastic.com CDW.com Netflix.com Staples.com Performance and Capacity, Nov

8 Example 3: Thursday Jan 31 st, 2013 The gateway page of Amazon.com was offline to some customers for approximately 49 minutes. Other pages of the site were accessible and AWS was not impacted, a spokesperson told TechCrunch in an . Visits to the site at the time of the outage were bringing up 503 errors, which sometimes are linked to DDoS attacks or other kinds of overloads. 503 errors can also be linked to maintenance issues. Site outages are never good things but feel particularly shaky when they are linked to e-commerce sites or other places where user data is stored. Performance and Capacity, Nov

9 Monitoring Dashboard AWS Performance and Capacity, Nov

10 Why Performance Test? Software Engineers often build Software components/products not being aware of the target load or environment requirements or service level agreements Complexity and highly distributed nature of the various hardware and web hosting servers offers challenges on optimal configuration of applications Globalization of users offers additional complexity Virtualization of Business Critical Applications demands Performance Testing Mobility complicates end-users perceptions due to a myriad number of devices which require acceptable performance Recommendation Performance Test Proactively and Early in the Software Development LifeCycle Performance and Capacity, Nov

11 Technical Environment N-tier Diagram - Simple Performance and Capacity, Nov

12 Typical Technical Environment Technologies used (Complex and Diverse Environment) Web Application Servers: Weblogic, WebSphere, JBOSS, Aqualogic Infrastructure Security: CA SiteMinder, IBM Tivoli Access Manager Web Server: Apache, IIS,IHS Middleware: Tibco BusinessWorks and BusinessConnect Reporting: Siebel, Lawson, Actuate, Cognos, Hyperion Midrange/Mainframe/Legacy: HP/IBM/AS400 Performance and Capacity, Nov

13 Performance Testing What is performance testing? Performance Testing Load Sociability Stress Endurance Testing which measures application performance under user load Testing which measures system performance under user load of all system variables in the deployment environment Testing to stress the application/system to find its limits Testing to validate system stability Performance and Capacity, Nov

14 Performance Testing Key variables measured: End User Response Time (includes Web 2.0 metrics when needed) Resource utilization (CPU, Memory, Disk, etc) Network utilization & latency Throughput (bytes/sec, hits/sec) Performance and Capacity, Nov

15 Performance Testing Benefits Measure response time for applications and enforce SLAs Improve end-user experience Proactive load/stress testing of mission critical applications would enable us to benchmark applications as per concurrent user support, response times, etc Capacity Planning save Costs( $$ ) by sizing production/non-production environments more accurately Help build proven scalable applications Failover Capabilities* Performance and Capacity, Nov

16 Performance Testing: Critical Success Factors Understand the Drivers and Triggers for Performance testing (NFR) Build or identify Production Workload model Well Defined Success criteria - SLAs Identify Business Critical Workflows of application Identify/Create Test Data Build Test Environment that models production Support of all teams Performance Testing is a TEAM Effort!! Workflow Automation Tool (Load Test Tool) Load Generation environment Performance Test Analysis/Reporting Need Management that values Performance Testing Keep control of the Performance Test Environment Never let Development teams run the Performance Test for you Performance and Capacity, Nov

17 Successful Performance Test LifeCycle SUCCESSFUL PERFORMANCE TEST LIFECYCLE Performance Test Triggers/ Requirements NO Performance Test Required ANALYTICS Production Report identifying transactional throughput of business transactions - Test Scripts, Test Data Perf Report: No Performance Testing Required YES Existing Application/ System YES Model Existing Production Workload Build Accurate Test Scenarios (Load, Stress & Sociability) NO Based on Triggers/Requirements Identify Issue, Make Tweaks(software, configuration or hardware) NO Define Test Success Criteria/ Script Workflows Performance Test Plan YES - SIGNOFF Are Results Acceptable? Execute Test Scenario Performance Test Environment Prod vs Test Report Any Differences Perf Report with results and any Exceptions Performance Test Result Report LOAD TEST TOOL - LOADRUNNER/ HOMEGROWN Performance and Capacity, Nov

18 Performance Testing CSFs: Drivers and Triggers SLA Change Hardware change (upgrade/downgrade, Virtualization) Application Software Upgrade (New features/enhancements) Infrastructure Software Upgrade/Patch (Security, Database, Systems, etc) Compliance Patch (DOD) Java/.Net version upgrade Unexpected growth in number of users Database retention policy change Typically, the non-functional requirements (NFRs) should dictate the need for performance testing Performance and Capacity, Nov

19 Performance Testing CSFs: Production Workload Model What is the existing usage of the application/system? Transaction Throughput (hour, day) Number of concurrent users for the average hour/peak hour Most used transactions Performance and Capacity, Nov

20 Performance Testing CSFs: Well-Defined Success Criteria How do we know if the test was a success Document SLA s (response time, CPU/Memory usage thresholds) Meets customer goals Performance and Capacity, Nov

21 Performance Testing CSFs: Define Business Critical Workflows Identify Business Critical Workflows of application Use the 80/20 rule (Pareto s Principle): 20% of the transactions cause 80% of the defects in production. Performance Testing is not typically a full regression test- 20% of the total test cases provides you 80% coverage. Include resource-intensive transactions (CPU, database, memory, network) Include highly used transactions Performance and Capacity, Nov

22 Performance Testing CSFs: Test Data Identification Performance Testing is data-driven testing Choose your test data carefully in consultation with production workload models or business analysts Represent boundary value conditions (example large result sets) Represent required security roles when creating test ids Test with a production-sized database Test with same data setup at least 2 times for consistency Test with a randomized data setup at least once Performance and Capacity, Nov

23 Performance Testing CSFs: Test Environment Considerations* Develop and Enforce Test readiness checklist Pristine Performance Test Environment Monitoring tools setup Historical data is mandatory Locked down environment (including disabling virus scans) Production sized in all respects, if possible Document and communicate any deviations from production to stakeholders If environment is shared? Disable builds and deployment during test times Build and Communicate Test Schedule Communicate, communicate, communicate Shutdown environments not needed Monitor, monitor, monitor Performance and Capacity, Nov

24 Performance Testing CSFs: Team Support needed Performance testing is a TEAM effort! Developers DBAs Network Engineers System Engineers Business (involve them to run UAT during performance testing execution) Performance Engineers typically do the first/second line of analysis Root cause analysis tool may eliminate a total team effort Performance and Capacity, Nov

25 Performance Testing CSFs: Load Test Tool For efficient performance testing need automation tool (industry standard or Open Source): Quick scripting, Correlation & Replay of scripts Building Test Models/scenarios Executing Test Scenarios Analysis Monitoring Home grown tools may suffice where technology platform is not as varied or for proprietary applications Performance and Capacity, Nov

26 Performance Testing CSFs: Load Generation Environment Mimic production if possible Firewalls Several Network locations or use WAN emulator Performance and Capacity, Nov

27 Performance Testing CSFs: Performance Test tools HP Loadrunner & Performance Center Microfocus SilkPerformer NeoLoad RadView - WebLoad MicroFocus QALoad IBM Rational Performance Tester Performance and Capacity, Nov

28 Load/Performance Test Tool Benefits Identify and resolve performance bottlenecks quickly Repeatable tests can be scripted and run quickly Real world user scenarios can be modeled by the tools Helps improve the quality and stability of applications Provides server monitoring capability for non-production environments Provides co-related performance analysis reports with drill-down capability Integrates with existing production monitoring tools Performance and Capacity, Nov

29 Performance Testing CSFs: Performance Test Analysis/Reporting Tool Analysis module provide: Real Time monitoring graphs Transaction Response Time Reports User Ramp-up graphs Transaction Response Summary graphs Drill-Down for Root cause analysis Correlating Graphs and results Performance and Capacity, Nov

30 Performance Testing Analysis/Reporting Sample Report Performance and Capacity, Nov

31 Performance Testing Analysis/Reporting Performance Test Reports Error Rate graph Performance and Capacity, Nov

32 Performance Testing Analysis/Reporting Non-Compliant SLA Report (MP_Login) Performance and Capacity, Nov

33 Performance Testing Analysis/Reporting SLA Report after enhancements Performance and Capacity, Nov

34 Front End Analysis - Tools Performance and Capacity, Nov

35 Front End Analysis Tools (2) Performance and Capacity, Nov

36 Front End Analysis Tools (3) Performance and Capacity, Nov

37 Root Cause Analysis- Server Side Tools Performance and Capacity, Nov

38 Performance Testing Synergies Performance Testing and Application Performance Management (APM) go hand in hand Performance Testing proactively identifies and resolves issues before production metrics captured during performance testing can help build and monitor production systems more accurately Performance Testing Scripts can be reused for synthetic transaction monitoring in production for SLA enforcement Performance Testing Tools can be used for Root Cause Analysis and to replicate production issues Performance and Capacity, Nov

39 Application Performance Testing/Monitoring Magic Quadrant Performance and Capacity, Nov

40 Conclusion Performance Testing/Engineering is critical to Application success Building in-house competencies or outsourcing/cloud bases testing is possible today Successfully identifying your CSFs is imperative APM and PT/PE go hand and hand and provide immense benefit to organizations Performance and Capacity, Nov

41 Questions/Discussion? Performance and Capacity, Nov

42 References Dynatrace Software n-performance-management.html Google Page Speed https://developers.google.com/speed/pagesp eed HP Performance Engineering Solutions Performance and Capacity, Nov

43 Performance and Capacity, Nov

44 Performance and Capacity, Nov

45 Performance and Capacity, Nov

46 Performance and Capacity, Nov

47 Performance and Capacity, Nov

48 v Performance and Capacity, Nov

Performance Testing: Roles, Activities, and QA Inclusion

Performance Testing: Roles, Activities, and QA Inclusion : Roles, Activities, and QA Inclusion Michael Lawler NueVista Group 1 Today s Agenda Outline the components of a performance test and considerations Discuss various roles, tasks, and activities Review

More information

Bringing Value to the Organization with Performance Testing

Bringing Value to the Organization with Performance Testing Bringing Value to the Organization with Performance Testing Michael Lawler NueVista Group 1 Today s Agenda Explore the benefits of a properly performed performance test Understand the basic elements of

More information

Successful Factors for Performance Testing Projects. NaveenKumar Namachivayam - Founder - QAInsights

Successful Factors for Performance Testing Projects. NaveenKumar Namachivayam - Founder - QAInsights Successful Factors for Performance Testing Projects NaveenKumar Namachivayam - Founder - QAInsights Contents Introduction... 2 Planning... 3 Staffing... 5 Test Environments... 7 Support... 8 Intuitive

More information

Why Test ITSM Applications for Performance? Webinar

Why Test ITSM Applications for Performance? Webinar Why Test ITSM Applications for Performance? Webinar Agenda What is performance testing? Why test ITSM for performance Testing? What are the ITSM modules that need performance testing? What are the use

More information

Best Practices for Web Application Load Testing

Best Practices for Web Application Load Testing Best Practices for Web Application Load Testing This paper presents load testing best practices based on 20 years of work with customers and partners. They will help you make a quick start on the road

More information

Cost effective methods of test environment management. Prabhu Meruga Director - Solution Engineering 16 th July SCQAA Irvine, CA

Cost effective methods of test environment management. Prabhu Meruga Director - Solution Engineering 16 th July SCQAA Irvine, CA Cost effective methods of test environment management Prabhu Meruga Director - Solution Engineering 16 th July SCQAA Irvine, CA 2013 Agenda Basic complexity Dynamic needs for test environments Traditional

More information

Performance Testing of Java Enterprise Systems

Performance Testing of Java Enterprise Systems Performance Testing of Java Enterprise Systems Katerina Antonova, Plamen Koychev Musala Soft Why Performance Testing? Recent studies by leading USA consultancy companies showed that over 80% of large corporations

More information

Load and Performance Load Testing. RadView Software October 2015 www.radview.com

Load and Performance Load Testing. RadView Software October 2015 www.radview.com Load and Performance Load Testing RadView Software October 2015 www.radview.com Contents Introduction... 3 Key Components and Architecture... 4 Creating Load Tests... 5 Mobile Load Testing... 9 Test Execution...

More information

Mobile Performance Testing Approaches and Challenges

Mobile Performance Testing Approaches and Challenges NOUS INFOSYSTEMS LEVERAGING INTELLECT Mobile Performance Testing Approaches and Challenges ABSTRACT Mobile devices are playing a key role in daily business functions as mobile devices are adopted by most

More information

Performance Testing. Slow data transfer rate may be inherent in hardware but can also result from software-related problems, such as:

Performance Testing. Slow data transfer rate may be inherent in hardware but can also result from software-related problems, such as: Performance Testing Definition: Performance Testing Performance testing is the process of determining the speed or effectiveness of a computer, network, software program or device. This process can involve

More information

Bernie Velivis President, Performax Inc

Bernie Velivis President, Performax Inc Performax provides software load testing and performance engineering services to help our clients build, market, and deploy highly scalable applications. Bernie Velivis President, Performax Inc Load ing

More information

Performance Engineering and Global Software Development

Performance Engineering and Global Software Development Engineering and Global Software Development Sohel Aziz, Gaurav Caprihan, Kingshuk Dasgupta, and Stephen Lane Abstract The need to achieve system performance in a way that reduces risk and improves cost-effectiveness

More information

Performance Testing. What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing

Performance Testing. What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing Performance Testing What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing What is Performance Testing l The primary goal of Performance

More information

Performance Engineering and Global Software Development

Performance Engineering and Global Software Development Engineering and Global Software Development Sohel Aziz, Gaurav Caprihan, Kingshuk Dasgupta, and Stephen Lane The need to achieve system performance in a way that reduces risk and improves cost-effectiveness

More information

Monitoring Best Practices for COMMERCE

Monitoring Best Practices for COMMERCE Monitoring Best Practices for COMMERCE OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems

More information

Performance Testing of a Large Wealth Management Product

Performance Testing of a Large Wealth Management Product Performance Testing of a Large Wealth Management Product Meherphani Nori & Global Head Quality Assurance Krishna Kankipati & Vice President Mohan Pujari & Product Specialist Broadridge Financial Solutions

More information

Case Study - I. Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008.

Case Study - I. Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008. Case Study - I Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008 Challenges The scalability of the database servers to execute batch processes under

More information

Performance Test Summary Report Skills Development Management System. December 2014

Performance Test Summary Report Skills Development Management System. December 2014 Performance Test Summary Report Skills Development Management System December 2014 Performance Test report submitted to National Skill Development Corporation Version Date Name Summary of Changes 1.0 22/12/2014

More information

SOFTWARE PERFORMANCE TESTING SERVICE

SOFTWARE PERFORMANCE TESTING SERVICE SOFTWARE PERFORMANCE TESTING SERVICE Service Definition GTS s performance testing services allows customers to reduce the risk of poor application performance. This is done by performance testing applications

More information

Application Performance Testing Basics

Application Performance Testing Basics Application Performance Testing Basics ABSTRACT Todays the web is playing a critical role in all the business domains such as entertainment, finance, healthcare etc. It is much important to ensure hassle-free

More information

WHAT WE NEED TO START THE PERFORMANCE TESTING?

WHAT WE NEED TO START THE PERFORMANCE TESTING? ABSTRACT Crystal clear requirements before starting an activity are always helpful in achieving the desired goals. Achieving desired results are quite difficult when there is vague or incomplete information

More information

Performance Testing Why and How? Sudheer Parpatakam

Performance Testing Why and How? Sudheer Parpatakam Performance Testing Why and How? Sudheer Parpatakam 2007 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice 2 Agenda Why Performance Testing?

More information

Performance Test Process

Performance Test Process A white Success The performance testing helped the client identify and resolve performance bottlenecks which otherwise crippled the business. The ability to support 500 concurrent users was a performance

More information

Real Application Testing. Fred Louis Oracle Enterprise Architect

Real Application Testing. Fred Louis Oracle Enterprise Architect Real Application Testing Fred Louis Oracle Enterprise Architect The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated

More information

FROM APM EXPERTS FOR EVERYONE: Application Performance Management With Open Source Tooling. Java Forum Stuttgart 2016 Alexander Wert

FROM APM EXPERTS FOR EVERYONE: Application Performance Management With Open Source Tooling. Java Forum Stuttgart 2016 Alexander Wert FROM APM EXPERTS FOR EVERYONE: Application Performance Management With Open Source Tooling Java Forum Stuttgart 2016 Alexander Wert Why is performance important? User Experience Response Time Limit Perception

More information

Service Virtualization:

Service Virtualization: Service Virtualization: Reduce the time and cost to develop and test modern, composite applications Business white paper Table of contents Why you need service virtualization 3 The challenges of composite

More information

Using WebLOAD to Monitor Your Production Environment

Using WebLOAD to Monitor Your Production Environment Using WebLOAD to Monitor Your Production Environment Your pre launch performance test scripts can be reused for post launch monitoring to verify application performance. This reuse can save time, money

More information

Martin Spier, Expedia & Rex Black, J9

Martin Spier, Expedia & Rex Black, J9 Martin Spier, Expedia & Rex Black, J9 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Leveraging HP Performance Center Martin

More information

Noelle A. Stimely Senior Performance Test Engineer. University of California, San Francisco noelle.stimely@ucsf.edu

Noelle A. Stimely Senior Performance Test Engineer. University of California, San Francisco noelle.stimely@ucsf.edu Noelle A. Stimely Senior Performance Test Engineer University of California, San Francisco noelle.stimely@ucsf.edu Who am I? Senior Oracle Database Administrator for over 13 years Senior Performance Test

More information

Performance Testing Process A Whitepaper

Performance Testing Process A Whitepaper Process A Whitepaper Copyright 2006. Technologies Pvt. Ltd. All Rights Reserved. is a registered trademark of, Inc. All other trademarks are owned by the respective owners. Proprietary Table of Contents

More information

Siebel & Portal Performance Testing and Tuning GCP - IT Performance Practice

Siebel & Portal Performance Testing and Tuning GCP - IT Performance Practice & Portal Performance Testing and Tuning GCP - IT Performance Practice By Zubair Syed (zubair.syed@tcs.com) April 2014 Copyright 2012 Tata Consultancy Services Limited Overview A large insurance company

More information

Business Application Services Testing

Business Application Services Testing Business Application Services Testing Curriculum Structure Course name Duration(days) Express 2 Testing Concept and methodologies 3 Introduction to Performance Testing 3 Web Testing 2 QTP 5 SQL 5 Load

More information

Performance Prediction, Sizing and Capacity Planning for Distributed E-Commerce Applications

Performance Prediction, Sizing and Capacity Planning for Distributed E-Commerce Applications Performance Prediction, Sizing and Capacity Planning for Distributed E-Commerce Applications by Samuel D. Kounev (skounev@ito.tu-darmstadt.de) Information Technology Transfer Office Abstract Modern e-commerce

More information

Performance Management from black-art to process

Performance Management from black-art to process Performance Management from black-art to process peter.holditch@dynatrace.com What needs to be measured? CPU utilisation I/O Rate TPM level transaction stats What needs to be measured???? Remember how

More information

Mike Chyi, Micro Focus Solution Consultant May 12, 2010

Mike Chyi, Micro Focus Solution Consultant May 12, 2010 Mike Chyi, Micro Focus Solution Consultant May 12, 2010 Agenda Load Testing Overview, Best Practice: Performance Testing with Diagnostics Demo (?), Q&A Load Testing Overview What is load testing? Type

More information

Levels of Software Testing. Functional Testing

Levels of Software Testing. Functional Testing Levels of Software Testing There are different levels during the process of Testing. In this chapter a brief description is provided about these levels. Levels of testing include the different methodologies

More information

Choosing A Load Testing Strategy Why and How to Optimize Application Performance

Choosing A Load Testing Strategy Why and How to Optimize Application Performance Choosing A Load Testing Strategy Why and How to Optimize Application Performance What Is Load Testing? Systematic exposure of an application to real world, expected usage conditions before deployment Analyzes

More information

Open Source and Commercial Performance Testing Tools

Open Source and Commercial Performance Testing Tools Open Source and Commercial Performance Testing Tools Palla Vinod Kumar Accenture Delivery Center for Technology in India Accenture, its logo, and High Performance Delivered are trademarks of Accenture.

More information

A closer look at HP LoadRunner software

A closer look at HP LoadRunner software Technical white paper A closer look at HP LoadRunner software Table of contents Sizing up the system 2 The limits of manual testing 2 A new take on testing: the HP LoadRunner solution 3 The HP LoadRunner

More information

Performance Testing. Checklist Packet. Everything you need to trigger thoughts, discussions and actions in the projects you are working on

Performance Testing. Checklist Packet. Everything you need to trigger thoughts, discussions and actions in the projects you are working on Performance Testing Checklist Packet Everything you need to trigger thoughts, discussions and actions in the projects you are working on Performance Testing Checklist: People & Processes within Performance

More information

Performance and Load Testing. >>>>>>>>>>>>>>>>>>>>>> www.softwaretestinggenius.com <<<<<<<<<<<<<<<<<<<<<<

Performance and Load Testing. >>>>>>>>>>>>>>>>>>>>>> www.softwaretestinggenius.com <<<<<<<<<<<<<<<<<<<<<< Performance and Load Testing Part 1 Performance & Load Testing Basics Performance & Load Testing Basics Introduction to Performance Testing Difference between Performance, Load and Stress Testing Why Performance

More information

Performance Testing Percy Pari Salas

Performance Testing Percy Pari Salas Performance Testing Percy Pari Salas Presented by : Percy Pari Salas Agenda What is performance testing? Types of performance testing What does performance testing measure? Where does performance testing

More information

PERFORMANCE TESTING. New Batches Info. We are ready to serve Latest Testing Trends, Are you ready to learn.?? START DATE : TIMINGS : DURATION :

PERFORMANCE TESTING. New Batches Info. We are ready to serve Latest Testing Trends, Are you ready to learn.?? START DATE : TIMINGS : DURATION : PERFORMANCE TESTING We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info START DATE : TIMINGS : DURATION : TYPE OF BATCH : FEE : FACULTY NAME : LAB TIMINGS : Performance

More information

White paper: Unlocking the potential of load testing to maximise ROI and reduce risk.

White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. Executive Summary Load testing can be used in a range of business scenarios to deliver numerous benefits. At its core,

More information

Web Application Testing. Web Performance Testing

Web Application Testing. Web Performance Testing Web Application Testing Web Performance Testing Objectives of Performance Testing Evaluate runtime compliance to performance requirements Check different properties such as throughput (bits/sec, packets/sec)

More information

Monitoring Best Practices for

Monitoring Best Practices for Monitoring Best Practices for OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems like Magento,

More information

Application. Performance Testing

Application. Performance Testing Application Performance Testing www.mohandespishegan.com شرکت مهندش پیشگان آزمون افسار یاش Performance Testing March 2015 1 TOC Software performance engineering Performance testing terminology Performance

More information

Best Practices for Managing Virtualized Environments

Best Practices for Managing Virtualized Environments WHITE PAPER Introduction... 2 Reduce Tool and Process Sprawl... 2 Control Virtual Server Sprawl... 3 Effectively Manage Network Stress... 4 Reliably Deliver Application Services... 5 Comprehensively Manage

More information

CloudBees Continuous Integration and Test with Appvance Enterprise 7.0.1. August 28, 2013 Frank Cohen, fcohen@appvance.com, (408) 364-5508

CloudBees Continuous Integration and Test with Appvance Enterprise 7.0.1. August 28, 2013 Frank Cohen, fcohen@appvance.com, (408) 364-5508 CloudBees Continuous Integration and Test with Appvance Enterprise 7.0.1 August 28, 2013 Frank Cohen, fcohen@appvance.com, (408) 364-5508 The Missing Agile CI Results Database Extends CloudBees Jenkins

More information

Getting Started with End-to-End Application Performance Management

Getting Started with End-to-End Application Performance Management Getting Started with End-to-End Application Performance Management Tom Quinn CA Technologies August 15, 2013 Session Number 14043 Agenda Overview of APM Why you want to adopt Cross Platform APM The APM

More information

Application Testing Suite Overview

<Insert Picture Here> Application Testing Suite Overview Application Testing Suite Overview Agenda Ats Overview OpenScript Functional Testing OpenScript Load Testing Forms/Siebel Modules Installation of Ats Oracle Load Tester Oracle Test

More information

Virtual Desktop Infrastructure Optimization with SysTrack Monitoring Tools and Login VSI Testing Tools

Virtual Desktop Infrastructure Optimization with SysTrack Monitoring Tools and Login VSI Testing Tools A Software White Paper December 2013 Virtual Desktop Infrastructure Optimization with SysTrack Monitoring Tools and Login VSI Testing Tools A Joint White Paper from Login VSI and Software 2 Virtual Desktop

More information

Proactive Performance Management for Enterprise Databases

Proactive Performance Management for Enterprise Databases Proactive Performance Management for Enterprise Databases Abstract DBAs today need to do more than react to performance issues; they must be proactive in their database management activities. Proactive

More information

TESTING FOR PEAK PERFORMANCE:

TESTING FOR PEAK PERFORMANCE: Leading the Evolution WHITE PAPER TESTING FOR PEAK PERFORMANCE: How Cloud-based testing ensures that your applications can handle peak demand The business challenge of unavailable applications Thousands

More information

Simplify and Automate IT

Simplify and Automate IT Simplify and Automate IT The current state of IT INCIDENT SERVICE LEVEL DATA SERVICE REQUEST ASSET RELEASE CONFIGURATION GOVERNANCE AND COMPLIANCE EVENT AND IMPACT ENTERPRISE SCHEDULING DASHBOARDS CAPACITY

More information

Learning More About Load Testing

Learning More About Load Testing Welcome to this introduction to application performance testing and the LoadRunner load testing solution. This document provides a short overview of LoadRunner s features, and includes the following sections:

More information

Enterprise Application Performance Monitoring with JENNIFER

Enterprise Application Performance Monitoring with JENNIFER JENNIFER Tech Note Enterprise Application Performance Monitoring with JENNIFER Date: 2009-03-30 Autor: S.J. Kim 1 / 11 http://www.jennifersoft.com In this article, I would like to discuss about the Enterprise

More information

Solution Offering. Infosys RADIEN CASPER. Capacity Assessment and Performance Engineering Framework (CASPER)

Solution Offering. Infosys RADIEN CASPER. Capacity Assessment and Performance Engineering Framework (CASPER) Solution Offering Infosys RADIEN CASPER Capacity Assessment and Engineering Framework (CASPER) Enterprises recognize the importance of performance as a key contributor to the success of any application,

More information

27 th March 2015 Istanbul, Turkey. Performance Testing Best Practice

27 th March 2015 Istanbul, Turkey. Performance Testing Best Practice 27 th March 2015 Istanbul, Turkey Performance Testing Best Practice Your Host.. Ian Molyneaux Leads the Intechnica performance team More years in IT than I care to remember Author of The Art of Application

More information

HP Business Availability Center software. Manage and optimize the health of business services and applications

HP Business Availability Center software. Manage and optimize the health of business services and applications software Manage and optimize the health of business services and applications Today, IT organizations are under growing pressure to optimize the availability and performance of key business services. This

More information

Test Run Analysis Interpretation (AI) Made Easy with OpenLoad

Test Run Analysis Interpretation (AI) Made Easy with OpenLoad Test Run Analysis Interpretation (AI) Made Easy with OpenLoad OpenDemand Systems, Inc. Abstract / Executive Summary As Web applications and services become more complex, it becomes increasingly difficult

More information

Guideline for stresstest Page 1 of 6. Stress test

Guideline for stresstest Page 1 of 6. Stress test Guideline for stresstest Page 1 of 6 Stress test Objective: Show unacceptable problems with high parallel load. Crash, wrong processing, slow processing. Test Procedure: Run test cases with maximum number

More information

Project 2 Performance Testing

Project 2 Performance Testing Project 2 Performance Testing Group # 1 Group Members : Tahmina Binte Mnasur ID # 062292044 Samia Jafrin ID # 063604044 Performance Testing Performance testing is the process of determining the speed or

More information

The top 10 misconceptions about performance and availability monitoring

The top 10 misconceptions about performance and availability monitoring The top 10 misconceptions about performance and availability monitoring Table of contents Introduction................................................................ 3 The top 10 misconceptions about

More information

Service Catalog. it s Managed Plan Service Catalog

Service Catalog. it s Managed Plan Service Catalog Service Catalog it s Managed Plan Service Catalog 6/18/2012 Document Contents Contents Document Contents... 2 Overview... 3 Purpose... 3 Product Description... 3 Plan Overview... 3 Tracking... 3 What is

More information

White Paper. Proving Scalability: A Critical Element of System Evaluation. Jointly Presented by NextGen Healthcare & HP

White Paper. Proving Scalability: A Critical Element of System Evaluation. Jointly Presented by NextGen Healthcare & HP White Paper Proving Scalability: A Critical Element of System Evaluation Jointly Presented by NextGen Healthcare & HP NextGen Healthcare Information Systems, Inc. www.nextgen.com A Successful Load Test

More information

Uptime Infrastructure Monitor Whitepaper THE TRUTH ABOUT AGENT VS. AGENTLESS MONITORING. A Short Guide to Choosing the Right Monitoring Solution.

Uptime Infrastructure Monitor Whitepaper THE TRUTH ABOUT AGENT VS. AGENTLESS MONITORING. A Short Guide to Choosing the Right Monitoring Solution. Uptime Infrastructure Monitor Whitepaper THE TRUTH ABOUT AGENT VS. AGENTLESS MONITORING A Short Guide to Choosing the Right Monitoring Solution. When selecting an enterprise-level IT monitoring solution,

More information

Load and Performance Testing

Load and Performance Testing Blaise Internet 4.8.4 Load and Performance Testing Lane Masterton Assistant Statistician Technology Services Division Australian Bureau of Statistics Content 1. Purpose 2. Test Targets 3. Approach 4. Solution

More information

TRACE PERFORMANCE TESTING APPROACH. Overview. Approach. Flow. Attributes

TRACE PERFORMANCE TESTING APPROACH. Overview. Approach. Flow. Attributes TRACE PERFORMANCE TESTING APPROACH Overview Approach Flow Attributes INTRODUCTION Software Testing Testing is not just finding out the defects. Testing is not just seeing the requirements are satisfied.

More information

Whitepaper Performance Testing and Monitoring of Mobile Applications

Whitepaper Performance Testing and Monitoring of Mobile Applications M eux Test Whitepaper Performance Testing and Monitoring of Mobile Applications Abstract The testing of a mobile application does not stop when the application passes all functional tests. Testing the

More information

Liferay Portal Performance. Benchmark Study of Liferay Portal Enterprise Edition

Liferay Portal Performance. Benchmark Study of Liferay Portal Enterprise Edition Liferay Portal Performance Benchmark Study of Liferay Portal Enterprise Edition Table of Contents Executive Summary... 3 Test Scenarios... 4 Benchmark Configuration and Methodology... 5 Environment Configuration...

More information

Performance Management for Cloudbased STC 2012

Performance Management for Cloudbased STC 2012 Performance Management for Cloudbased Applications STC 2012 1 Agenda Context Problem Statement Cloud Architecture Need for Performance in Cloud Performance Challenges in Cloud Generic IaaS / PaaS / SaaS

More information

white paper TESTING FOR PEAK PERFORMANCE How cloud-based testing ensures that your applications can handle peak demand

white paper TESTING FOR PEAK PERFORMANCE How cloud-based testing ensures that your applications can handle peak demand white paper TESTING FOR PEAK PERFORMANCE How cloud-based testing ensures that your applications can handle peak demand THE BUSINESS CHALLENGE OF UNAVAILABLE APPLICATIONS Thousands or even millions of customers,

More information

White Paper. Fundamentals of Performance Testing

White Paper. Fundamentals of Performance Testing etri White Paper Fundamentals of Performance Testing The Increasing Need for Proper Performance Testing due to Increasing Software Complexity in the Enterprise There have been two significant changes in

More information

SOA management challenges. After completing this topic, you should be able to: Explain the challenges of managing an SOA environment

SOA management challenges. After completing this topic, you should be able to: Explain the challenges of managing an SOA environment Managing SOA Course materials may not be reproduced in whole or in part without the prior written permission of IBM. 4.0.3 4.0.3 Unit objectives After completing this unit, you should be able to: Explain

More information

Accelerating Web-Based SQL Server Applications with SafePeak Plug and Play Dynamic Database Caching

Accelerating Web-Based SQL Server Applications with SafePeak Plug and Play Dynamic Database Caching Accelerating Web-Based SQL Server Applications with SafePeak Plug and Play Dynamic Database Caching A SafePeak Whitepaper February 2014 www.safepeak.com Copyright. SafePeak Technologies 2014 Contents Objective...

More information

SuperAgent and Siebel

SuperAgent and Siebel SuperAgent and Siebel Executive summary Siebel Systems provides a comprehensive family of multichannel ebusiness applications services, all within a single architecture. The Siebel architecture is an n-tier

More information

TASSQ Dinner Meeting Performance & Automation Testing of Cloud Solutions. March 31 st 2015

TASSQ Dinner Meeting Performance & Automation Testing of Cloud Solutions. March 31 st 2015 TASSQ Dinner Meeting Performance & Automation Testing of Cloud Solutions March 31 st 2015 Brief History Of Cloud Computing Even though the cloud has only just recently hit its stride and began to expand

More information

Copyright www.agileload.com 1

Copyright www.agileload.com 1 Copyright www.agileload.com 1 INTRODUCTION Performance testing is a complex activity where dozens of factors contribute to its success and effective usage of all those factors is necessary to get the accurate

More information

Informatica Data Director Performance

Informatica Data Director Performance Informatica Data Director Performance 2011 Informatica Abstract A variety of performance and stress tests are run on the Informatica Data Director to ensure performance and scalability for a wide variety

More information

Testing Big data is one of the biggest

Testing Big data is one of the biggest Infosys Labs Briefings VOL 11 NO 1 2013 Big Data: Testing Approach to Overcome Quality Challenges By Mahesh Gudipati, Shanthi Rao, Naju D. Mohan and Naveen Kumar Gajja Validate data quality by employing

More information

G DATA TechPaper #0275. G DATA Network Monitoring

G DATA TechPaper #0275. G DATA Network Monitoring G DATA TechPaper #0275 G DATA Network Monitoring G DATA Software AG Application Development May 2016 Contents Introduction... 3 1. The benefits of network monitoring... 3 1.1. Availability... 3 1.2. Migration

More information

White Paper: Assessing Performance & Response Time Requirements

White Paper: Assessing Performance & Response Time Requirements White Paper: Assessing Performance & Response Time Requirements Mark Houghtlin IBM Cloud Advisory Services & Application Performance Optimization Consulting Practice Agenda Workload Transformation Analysis

More information

The Top 10 Reasons Why You Need Synthetic Monitoring

The Top 10 Reasons Why You Need Synthetic Monitoring WHITE PAPER: WEB PERFORMANCE MANAGEMENT The Top 10 Reasons Why You Need Synthetic Monitoring A complete view of the application delivery chain (ADC) is required to optimize the performance and availability

More information

Sanovi DRM for Oracle Database

Sanovi DRM for Oracle Database Application Defined Continuity Sanovi DRM for Oracle Database White Paper Copyright@2012, Sanovi Technologies Table of Contents Executive Summary 3 Introduction 3 Audience 3 Oracle Protection Overview

More information

Operational excellence for Oracle applications

Operational excellence for Oracle applications Operational excellence for Oracle applications Sebastiaan Vingerhoed, specialist region EE&CIS October 20th, 2010 HROUG Agenda Welcome & Introduction Application Life Cycle Automate

More information

Stephen Miles. Transform IT assets to Drive Business Service Innovation. CA Expo Hong Kong. Vice President - Service Assurance Asia Pacific & Japan

Stephen Miles. Transform IT assets to Drive Business Service Innovation. CA Expo Hong Kong. Vice President - Service Assurance Asia Pacific & Japan Stephen Miles Vice President - Service Assurance Asia Pacific & Japan CA Expo Hong Kong 21 September, 2012 Transform IT assets to Drive Business Service Innovation The age of innovation has arrived CLOUD

More information

Position Description

Position Description Position Description Position Title: Group/Division/Team: WebCenter / UCM Technical Support Business Technology Services Group / IT Operations Division Date: December 2011 Reports To: Roles Reporting To

More information

Demystifying the Cloud A Practitioner s Perspective. Prakat Solutions

Demystifying the Cloud A Practitioner s Perspective. Prakat Solutions Demystifying the Cloud A Practitioner s Perspective Prakat Solutions Contents Introductions Impacts of Cloud Adoption Other Side of the Cloud Key Business Drivers Testing, Continuous Integration and Production

More information

Benefits of Automated security and Performance Testing of SAP HCM applications

Benefits of Automated security and Performance Testing of SAP HCM applications Benefits of Automated security and Performance Testing of SAP HCM applications Case Study from Infosys Abhinav.G Independent Validation Solutions Infosys Technologies Limited Houston, USA Chandrashekar.S

More information

Why Performance Matters. Cloud Testing with SOASTA CloudTest. Hexaware Introduction. Best Practices for Performance Testing in Production.

Why Performance Matters. Cloud Testing with SOASTA CloudTest. Hexaware Introduction. Best Practices for Performance Testing in Production. Performance Testing in Production Using the Cloud to your advantage Presented by: Rob Holcomb VP Performance Engineering SOASTA Chris Cho Director, BTO Division Hexaware Technologies 1 Agenda Why Performance

More information

Java Application Diagnostic Expert

<Insert Picture Here> Java Application Diagnostic Expert Java Application Diagnostic Expert Agenda 1. Enterprise Manager 2. Challenges 3. Java Application Diagnostics Expert (JADE) 4. Feature-Benefit Summary 5. Features Overview Diagnostic

More information

Getting Things Done: Practical Web/e-Commerce Application Stress Testing

Getting Things Done: Practical Web/e-Commerce Application Stress Testing Getting Things Done: Practical Web/e-Commerce Application Stress Testing Robert Sabourin President Montreal, Canada rsabourin@amibug.com Slide 1 Practical Web/e-Commerce Application Stress Testing Overview:

More information

HP APPLICATION PERFORMANCE MONITORING

HP APPLICATION PERFORMANCE MONITORING HP APPLICATION PERFORMANCE MONITORING mr. sci Tomislav Kanižaj Teritorry Sales Manager HP Software March 2011 2010 Hewlett-Packard Development Company, L.P. The information contained 1 herein is subject

More information

Identify and control performance and capacity risks. Introduction... 2

Identify and control performance and capacity risks. Introduction... 2 Application performance testing in VMware environments Identify and control performance and capacity risks Table of contents Introduction... 2 Performance and capacity planning techniques... 2 Rough sizing

More information

Aternity Virtual Desktop Monitoring. Complete Visibility Ensures Successful VDI Outcomes

Aternity Virtual Desktop Monitoring. Complete Visibility Ensures Successful VDI Outcomes Aternity Virtual Desktop Monitoring Complete Visibility Ensures Successful VDI Outcomes Realizing the Benefits of VDI Requires Illuminating Four Performance Blind Spots Without comprehensive visibility

More information

Choosing the Right Cloud Provider for Your Business

Choosing the Right Cloud Provider for Your Business Choosing the Right Cloud Provider for Your Business Abstract As cloud computing becomes an increasingly important part of any IT organization s delivery model, assessing and selecting the right cloud provider

More information

CA Unified Infrastructure Management: The IT Monitoring Solution for the Digital Enterprise

CA Unified Infrastructure Management: The IT Monitoring Solution for the Digital Enterprise The Power & Payback Of Unified Monitoring CA Unified Infrastructure Management: The IT Monitoring Solution for the Digital Enterprise (Formerly known as CA Nimsoft Monitor) The Power & Payback Of Unified

More information

Application-Oriented Monitoring in a Cloud Component World

Application-Oriented Monitoring in a Cloud Component World White Paper Application-Oriented Monitoring in a Cloud Component World Author: Tom Lubinski Publication Date: February 2011 Abstract: Answering the question, how is my critical software application really

More information

Measuring end-to-end application performance in an on-demand world. Shajeer Mohammed Enterprise Architect

Measuring end-to-end application performance in an on-demand world. Shajeer Mohammed Enterprise Architect Measuring end-to-end application performance in an on-demand world Shajeer Mohammed Enterprise Architect Agenda 1 Introduction to CA 2 Application Performance Management and its Need 3 How CA Solutions

More information