1 Mike Chyi, Micro Focus Solution Consultant May 12, 2010
2 Agenda Load Testing Overview, Best Practice: Performance Testing with Diagnostics Demo (?), Q&A
3 Load Testing Overview What is load testing? Type of load testing, Load testing architecture (lab, cloud), Web Load Testing (other environment), How to pick tools (criteria)? Best Practices.
4 Load Testing Overview What is load testing? Type of load testing, Load testing architecture (lab, cloud), Web Load Testing (other environment), How to pick tools (criteria)? Best Practices.
5 Load Testing Generic term for testing applications (whole infrastructures) under load to ensure that they work and deliver acceptable response times and throughput Catch all" term for the many different types of tests that can be performed: Load, Performance, Stress, Volume, Negative, Scalability, Endurance, etc. Performance tests emulate user activity and analyzes the effect of the real-world user environment on an application
6 Purpose of Load Testing? Put simply, Load Testing ensures that your application works under real-world loads before your customers find that it doesn't! Test Drive
7 Why is Performance Testing Important? Increase uptime of mission-critical systems Avoid project failures by predicting application behavior under large user loads Measure and monitor performance of your business infrastructure Protect IT investments by predicting scalability and performance Performance testing is the only way to verify the scalability of components working together without going into production!
8 Load Testing Overview What is load testing? Type of load testing, Load testing architecture (lab, cloud), Web Load Testing (other environment), How to pick tools (criteria)? Best Practices.
9 Types of Performance Testing Load - focuses on replicating expected user activity levels, both in terms of number of users and the volume of traffic Stress focuses on worst case scenarios that could potentially happen in production environments today or in the future Negative similar to stress testing, negative testing is performed to take applications to their breaking point to learn the limits of the system/application or environment
10 Load Testing Overview What is load testing? Type of load testing, Load testing architecture (lab, cloud), Web Load Testing (other environment), How to pick tools (criteria)? Best Practices.
11 Load Generation & Monitoring Controller Load Generator System Under Test (SUT) 200 vu s 500 vu s 300 vu s Test Scripts Server Monitoring
12 Micro Focus Solution - Cloud Approach and Value Easily consumable high volume load testing Easier to get machines, deploy agents, run tests and collect results Simplification of load testing scripting Test from global points of presence Capture last mile performance Mature tool set Cloud flexibility (Elasticity) Load Test Tooling Enterprise Test Agents Internet Facing Application Internal Application Using the cloud to provide flexible testing solution 12
13 Workflow of using SilkPerformer with Enterprise Cloud Service SilkPerformer works seamlessly in the cloud Create Agent Instances needed for Load-Test Full monitoring capabilities thru probes placed in the intranet Easy Root Cause Analysis of internet related problems and bottlenecks
14 Load Testing Overview What is load testing? Type of load testing, Load testing architecture (lab, cloud), Web Load Testing (other environment), How to pick tools (criteria)? Best Practices.
15 Web Load Testing (most popular) Classic: Capture traffic at HTTP, HTTP/S level Rich Internet Application (RIA), Ajax: Asynchronous, classic record / playback does not work (based on synchronous protocol). Need a new approach, SilkPerformer introduce Browser Driven record / playback technology SilkPerformer 2010.
17 Load Testing Overview What is load testing? Type of load testing, Load testing architecture (lab, cloud), Web Load Testing (other environment), How to pick tools (criteria)? Best Practices.
18 How to pick tools (criteria)? Product Maturity Proven Easy of Use, scripting, data-driven, modification, debugging, logging, workload creation, correlation, reporting, etc. True End-User Emulation, Accurate Measurement, Comprehensive Report,
19 Load Testing Overview What is load testing? Type of load testing, Load testing architecture (lab, cloud), Web Load Testing (other environment), How to pick tools (criteria)? Best Practices.
20 Best Practices: Load Testing Process 1. Establish performance test objectives, 2. Prepare test environment (SUT), 3. Define use cases (test scenarios), 4. Create, modify, and baseline your scripts, 5. Execute Performance test (controlled, repeatable) 6. Monitor, diagnose the impact of load on servers/databases, 7. Analyze results, 8. Tune system, 9. Restore database, 10. Repeat, 11. Deploy mission critical application with confidence. (you can sleep better!)
21 Performance Test Scripts Short and sweet, Normally only a handful of scripts needed (not functional test), 80/20 Rule means that the most common activities use a limited subset of the application functionality Data driven, to emulate real-life user actions, avoid caching, and exercise the backend database, Start simple, login smoke test, Non-destructive, vs. Destructive (add, mod, delete scripts), Create reusable modules (rules, functions), Run a couple of GUI-user scripts to visualize the user scenarios, also provide true end-to-end response times.
22 Useful Performance Matrix Response Time (percentile 90, 85, 80) Acceptable response time for end user to be productive Concurrency / Scalability / Workload distribution Maximum number of concurrent users that must be supported. Throughput Minimum transaction throughput per (?) Network Footprint Maximum allowable bandwidth utilization Server Impact Maximum server metric(s) tolerance, CPU, memory, run queues.
23 Root-cause analysis/diagnosis capability to pin-point performance problems TrueLog On Error Shows exactly what happened until the error occured Front-end diagnostics (VU persp.) Response time break-down Method-level diagnostics Diagnose issues from problem page 3 clicks to root cause,
24 Poor Application Performance Shown above are the application response time and the number of running users. Note how the response time increases as more users are added to the system!
25 Compare Timing Files compare multiple test runs, allowing testers to easily perceive changes in application behavior (from green to blue)
26 Question: Why are there still performance issues in production after numerous load testing cycles?
27 Too Late in the test cycle No performance requirement, Baked in performance requirement early Load test early once the application is functional ready Load test with diagnostics, flush out concurrency issues, coding issues early in the life cycle, eliminate rework later.
28 The Solution: SilkePerformer: Load Test with Root Cause Analysis. 30 days trial download (10 Vu)
29 Load Testing and Root Cause Analysis Virtual Users DBMS Web Servers Application Servers JDBC-ODBC Mainframe URL JSP-ASP Method Web Service Method MQ Identify load related failures by driving anticipated production user load Correlate performance relationships between all application components Pinpoint root cause of performance bottlenecks
Bringing Value to the Organization with Performance Testing Michael Lawler NueVista Group 1 Today s Agenda Explore the benefits of a properly performed performance test Understand the basic elements of
IBM RATIONAL PERFORMANCE TESTER Today, a major portion of newly developed enterprise applications is based on Internet connectivity of a geographically distributed work force that all need on-line access
Technical white paper A closer look at HP LoadRunner software Table of contents Sizing up the system 2 The limits of manual testing 2 A new take on testing: the HP LoadRunner solution 3 The HP LoadRunner
Silk Performer LOAD TESTING The key to keeping business applications running 2 Load testing Executive Summary Every business depends on applications to automate its core business processes. These applications
Automate performance testing to predict system behaviour and improve application performance Business white paper Table of contents Executive summary... 3 What is performance testing?... 4 Why automate
Performance Testing Percy Pari Salas Presented by : Percy Pari Salas Agenda What is performance testing? Types of performance testing What does performance testing measure? Where does performance testing
TESTING AND OPTIMIZING WEB APPLICATION S PERFORMANCE AQA CASE STUDY 2 Intro to Load Testing Copyright 2009 TEST4LOAD Software Load Test Experts What is Load Testing? Load testing generally refers to the
Case Study - I Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008 Challenges The scalability of the database servers to execute batch processes under
Technical White Paper: WEb Load Testing To perform as intended, today s mission-critical applications rely on highly available, stable and trusted software services. Load testing ensures that those criteria
Performance Testing Definition: Performance Testing Performance testing is the process of determining the speed or effectiveness of a computer, network, software program or device. This process can involve
Automate performance testing to predict system behavior and improve application performance White paper Table of contents Abstract.........................................................................3
Business white paper Load factor: performance testing for Web applications Table of contents 3 A look at load testing 3 In the pursuit of predictability 4 Put your apps through the paces 5 Traits of an
What Is Specific in Load Testing? Testing of multi-user applications under realistic and stress loads is really the only way to ensure appropriate performance and reliability in production. Load testing
Process A Whitepaper Copyright 2006. Technologies Pvt. Ltd. All Rights Reserved. is a registered trademark of, Inc. All other trademarks are owned by the respective owners. Proprietary Table of Contents
Load Testing 2.0 for Web 2.0 Simplifying performance validation for Rich Internet Applications White paper Table of contents Executive summary............................................2 Web 2.0: delivering
Testing & Assuring Mobile End User Experience Before Production Neotys Agenda Introduction The challenges Best practices NeoLoad mobile capabilities Mobile devices are used more and more At Home In 2014,
IBM SAP International Competence Center Load testing SAP ABAP Web Dynpro applications with IBM Rational Performance Tester Ease of use, excellent technical support from the IBM Rational team and, of course,
Content of 6 Months Software Testing Training at EH1-Infotech Module 1: Introduction to Software Testing Basics of S/W testing Module 2: SQA Basics Testing introduction and terminology Verification and
Presentation P R E S E N T A T I O N Bio E6 Thursday, March 8, 2001 11:30 AM HOW TO EVALUATE AND SELECT A HIGH-END LOAD TESTING TOOL Marquis Harding Reality Test International Conference On Software Test
Test Run Analysis Interpretation (AI) Made Easy with OpenLoad OpenDemand Systems, Inc. Abstract / Executive Summary As Web applications and services become more complex, it becomes increasingly difficult
Choosing A Load Testing Strategy Why and How to Optimize Application Performance What Is Load Testing? Systematic exposure of an application to real world, expected usage conditions before deployment Analyzes
Closing The Application Performance Visibility Gap Inherent To Citrix Environments WHITE PAPER: DYNATRACE FOR CITRIX XENAPP/XENDESKTOP Many companies have invested in Citrix XenApp and XenDesktop environments
Martin Spier, Expedia & Rex Black, J9 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Leveraging HP Performance Center Martin
PorposalPPP Q: Gomez is standlone web application testing tool? Gomez provides an on demand platform that you can use for both testing and monitoring your Web applications from the outside in across your
Mobile Application Performance Management Technical Customer Facing Deck November, 2013 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without
Performance Testing IBM * Infrastructures MQTester TM for LoadRunner from CommerceQuest Inc. 2001 CommerceQuest Inc. All rights reserved. The information contained herein is the proprietary property of
Performance and Load Testing For ArcGIS based systems Ian Sims and John Meza OVERVIEW What is Performance and Load Testing What is the objective Acceptance Testing Ongoing Development Areyoutheclient Want
Transaction Monitoring Version 8.1.3 for AIX, Linux, and Windows Reference IBM Note Before using this information and the product it supports, read the information in Notices. This edition applies to V8.1.3
Oracle Data Masking Bruce Elton Master Principal Sales Consultant Information Security 1 2012 Oracle Corporation Oracle Data Masking Comprehensive and Extensible Mask Library Mask formats for common sensitive
An introduction to load testing for Web applications Business white paper Table of contents Introduction...3 Grow your business through online exposure...3 Application performance testing prior to going
testing & QA Performance Testing Expertise in Case Studies Case 1 ELEKS team has developed a custom test framework designed to accommodate numerous types of testing and measurements: Accuracy testing during
Web Application s Performance Testing B. Election Reddy (07305054) Guided by N. L. Sarda April 13, 2008 1 Contents 1 Introduction 4 2 Objectives 4 3 Performance Indicators 5 4 Types of Performance Testing
Web Load Testing Tutorial SilkPerformer 2009 Borland Software Corporation 8310 N Capital of Texas Hwy Bldg 2, Ste 100 Austin, TX 78731 http://www.borland.com Borland Software Corporation may have patents
Accelerate Testing Cycles With Collaborative Performance Testing Sachin Dhamdhere 2005 Empirix, Inc. Agenda Introduction Tools Don t Collaborate Typical vs. Collaborative Test Execution Some Collaborative
Performance Testing in Production Using the Cloud to your advantage Presented by: Rob Holcomb VP Performance Engineering SOASTA Chris Cho Director, BTO Division Hexaware Technologies 1 Agenda Why Performance
Application Performance Testing Basics ABSTRACT Todays the web is playing a critical role in all the business domains such as entertainment, finance, healthcare etc. It is much important to ensure hassle-free
An Oracle White Paper March 2013 Load Testing Best Practices for Oracle E- Business Suite using Oracle Application Testing Suite Executive Overview... 1 Introduction... 1 Oracle Load Testing Setup... 2
white paper TESTING FOR PEAK PERFORMANCE How cloud-based testing ensures that your applications can handle peak demand THE BUSINESS CHALLENGE OF UNAVAILABLE APPLICATIONS Thousands or even millions of customers,
SOFTWARE PERFORMANCE TESTING SERVICE Service Definition GTS s performance testing services allows customers to reduce the risk of poor application performance. This is done by performance testing applications
Leading the Evolution WHITE PAPER TESTING FOR PEAK PERFORMANCE: How Cloud-based testing ensures that your applications can handle peak demand The business challenge of unavailable applications Thousands
Performance Workload Design The goal of this paper is to show the basic principles involved in designing a workload for performance and scalability testing. We will understand how to achieve these principles
Process of Performance Testing a Banking Application The Need One of the largest banks in India offers Online and Mobile Banking application to its customers. Several online services are hassle-free services
End User Monitoring with Enterprise Manager Nadu Bharadwaj Principal Product Manager Agenda Why should we monitor end users? Oracle s Application Performance Management Solutions Oracle s End User Monitoring
www.agileload.com There is no second thought about the exponential increase in importance and usage of mobile applications. Simultaneously better user experience will remain most important factor to attract
Next Generation Siebel Monitoring: A Real World Customer Experience An Oracle White Paper June 2010 Next Generation Siebel Monitoring: A Real World Customer Experience Table of Contents Introduction...
& Portal Performance Testing and Tuning GCP - IT Performance Practice By Zubair Syed (firstname.lastname@example.org) April 2014 Copyright 2012 Tata Consultancy Services Limited Overview A large insurance company
Performance Testing of Java Enterprise Systems Katerina Antonova, Plamen Koychev Musala Soft Why Performance Testing? Recent studies by leading USA consultancy companies showed that over 80% of large corporations
PERFORMANCE TESTING We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info START DATE : TIMINGS : DURATION : TYPE OF BATCH : FEE : FACULTY NAME : LAB TIMINGS : Performance
Wipro & Experitest Co-webinar: Perfect Your Mobile App with Load Testing and Test Automation June 2015 Speakers Guy Arieli CTO Experitest Sudheer Mohan Director - Mobility Certification & Automation Wipro
QUALITYMATE FOR LOAD TESTING QualityMate suite of tools enables organizations to industrialize the software development process providing support for different process activities like Requirements Management,
ALM 271 From End-User Experience Monitoring to Management Dashboards and Reporting Stefan Lahr, SAP Active Global Support September, 2011 Disclaimer This presentation outlines our general product direction
Performance Tuning and Optimizing SQL Databases 2016 http://www.homnick.com email@example.com +1.561.988.0567 Boca Raton, Fl USA About this course This four-day instructor-led course provides students
Performance Testing What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing What is Performance Testing l The primary goal of Performance
ABSTRACT Crystal clear requirements before starting an activity are always helpful in achieving the desired goals. Achieving desired results are quite difficult when there is vague or incomplete information
Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability Table of contents Introduction.......................................................2 Step 1:
White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. Executive Summary Load testing can be used in a range of business scenarios to deliver numerous benefits. At its core,
Estimate Performance and Capacity Requirements for Workflow in SharePoint Server 2010 This document is provided as-is. Information and views expressed in this document, including URL and other Internet
Zend and IBM: Bringing the power of PHP applications to the enterprise A high-performance PHP platform that helps enterprises improve and accelerate web and mobile application development Highlights: Leverages
Addressing Mobile Load Testing Challenges A Neotys White Paper Contents Introduction... 3 Mobile load testing basics... 3 Recording mobile load testing scenarios... 4 Recording tests for native apps...
Performance testing Web 2.0 Stuart Moncrieff, Performance Test Consultant JDS 2009 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice What is
Performance And Scalability In Oracle9i And SQL Server 2000 Presented By : Phathisile Sibanda Supervisor : John Ebden 1 Presentation Overview Project Objectives Motivation -Why performance & Scalability
27 th March 2015 Istanbul, Turkey Performance Testing Best Practice Your Host.. Ian Molyneaux Leads the Intechnica performance team More years in IT than I care to remember Author of The Art of Application
Application and Web Load Testing Datasheet Plan Create Load Analyse Respond Product Overview JAR:load is an innovative web load testing solution delivered from the Cloud* for optimising the performance
Mobile application performance management Xavier Chevalier Solution Consultant Benelux March, 2014 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to
Comparative Study of Load Testing Tools Sandeep Bhatti, Raj Kumari Student (ME), Department of Information Technology, University Institute of Engineering & Technology, Punjab University, Chandigarh (U.T.),
Web Load Stress Testing Overview A Web load stress test is a diagnostic tool that helps predict how a website will respond to various traffic levels. This test can answer critical questions such as: How
HP End User Management software Enables real-time visibility into application performance and availability Solution brief Figure 1 HP End User Management lets you proactively identify application performance
Open Source and Commercial Performance Testing Tools Palla Vinod Kumar Accenture Delivery Center for Technology in India Accenture, its logo, and High Performance Delivered are trademarks of Accenture.
Planning, Provisioning and Deploying Enterprise Clouds with Oracle Enterprise Manager 12c Kevin Patterson, Principal Sales Consultant, Enterprise Manager Oracle NIST Definition of Cloud Computing Cloud
Ce document a été téléchargé depuis le site de Precilog. - Services de test SOA, - Intégration de solutions de test. 01 39 20 13 55 firstname.lastname@example.org www.precilog.com End to End Process Testing & Validation:
Cisco Wide Area Application Services Optimizes Application Delivery from the Cloud What You Will Learn The adoption of cloud-based computing and applications promises to improve the agility, efficiency,