27 th March 2015 Istanbul, Turkey. Performance Testing Best Practice

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "27 th March 2015 Istanbul, Turkey. Performance Testing Best Practice"

Transcription

1 27 th March 2015 Istanbul, Turkey Performance Testing Best Practice

2 Your Host.. Ian Molyneaux Leads the Intechnica performance team More years in IT than I care to remember Author of The Art of Application Performance Testing TestIstanbul 2015

3 27 th March 2015 Istanbul, Turkey Why Performance Matters

4 A knowledge gap

5 System complexity DATA CENTER INTERNAL USERS INTERNET CUSTOMERS Storage DB Servers Mainframe Middleware Servers Web Servers App Servers Load Balancers Network Major ISP Third- party/ Cloud Services Local ISP Content Delivery Networks Mobile Carriers

6

7 So what represents good performance? Unacceptable (10s) > Compe33ve advantage Tolerable (7s) > Average (6s)> Good (3s) > Excellence (Uneconomic) (1s)>

8 27 th March 2015 Istanbul, Turkey Performance Testing

9 What is performance testing? Testing to ensure that your application works under real-world loads before you release it to production. Works? - staying available and performant under conditions of peak load. Performant? - providing a good end user experience. The problem is defining what good means. It really comes down to the end users perception of performance.

10 Good performance definition refined.. A well-performing application is one that lets the end user carry out a given task without undue perceived delay or irritation. Performance really is in the eye of the beholder.

11 Important.. Performance testing is distinct from any other form of software testing. It is very much its own discipline.

12 27 th March 2015 Istanbul, Turkey Performance Testing Scope

13 Performance Testing helps identify EUE CAPACITY EUE NETWORK ISSUES CODE QUALITY CONFIG ISSUES CONTENTION EUE (No) SQL PERFORMANCE 13

14 Testing response time Local users Remote users Mobile users In reality this is server response time Plus the impact of latency

15 Testing response time Last-mile Service Providers Cloud Providers Content Delivery Networks Affiliates

16 Understand the technology Affiliates..

17 Testing capacity Finding the upper limits of Availability Acceptable response time

18 End to End The ability to remain available and performant As a complete integrated deployment In the presence of other applications and services

19 Soak testing Performance and availability over an extended duration No memory leaks No configuration hard-stops No disk space issues

20 Testing different configurations The What if? Useful for optimizing deployment Load balancing choices Web, App and DB configuration settings

21 Testing Disaster Recovery Don t forget your DR environment Hopefully you have one! Understand DR performance compared to production Failover testing under load

22 As part of procurement Try before you buy! Performance evaluation of potential suppliers Particularly relevant in a SaaS world

23 BAU Production Benchmarking Periodic non-destructive performance evaluation and benchmarking of live deployments Detecting performance and capacity regressions Performance impact of configuration changes Canary approach

24 27 th March 2015 Istanbul, Turkey Performance Testing Foundations

25 Built on 6 pillars Business knowledge Technical knowledge People Tooling Environments Process

26 27 th March 2015 Istanbul, Turkey Business Knowledge

27 Why are we performance testing? Pre-existing performance issues? Concern about an upcoming peak event? A desire to improve the quality of delivery? Fear of the unknown?

28 Understand the application What does the application do? Get familiar with the functionality Get familiar with the terminology Was it written in-house or is it a package? Is this a new release or a pre-existing application? Understand the size and distribution of end-user community

29 Understand the performance targets Typically.. Availability Concurrency Response time Consider.. How have they been derived? Are they realistic? Are they achievable?

30 Availability The application has to remain available under peak load. It cannot be seen to fail.

31 Concurrency Two types.. Application Automation Impacted by.. Session persistence Capacity constraints

32 Response time The end user experience.. From the perspective of the end user Service consumption Service SLA s Impacted by.. Performance by design Code quality Capacity constraints Design decisions Async rules!

33 Bad design

34 Use cases Selecting functionality to render as scripts Also called user journeys or transactions The building blocks of (performance) test scenarios Ideally represent high volume, high load activity Unusual to have more than 10

35 Use cases Several different types.. UI driven Service driven API driven Batch driven Device driven

36 Use cases Critical to get these correct.. Sub-divide into logical timings e.g. Login, Search, Add to Basket, Logout Organise into iterative and non-iterative steps e.g. Init, Body, End

37 Use cases

38 Load model Derived from.. Business intelligence data Application usage profile Web server logs Performance targets Use cases Test data

39 Load model input

40 Virtual user distribution

41 Load injection profile

42 Together represent performance test scenarios Virtual user distribution Load injection profile

43 27 th March 2015 Istanbul, Turkey Technical Knowledge

44 Understand the technology Application architecture Tech-stack Integrations Service consumption, internal and external Hosting infrastructure Servers Network

45 Determine the technical requirement Tooling options Automation effort and cost Instrumentation effort and cost Monitoring Tech-stack KPI s Hosting infrastructure KPI s

46 KPI s, a many layered approach.. Application Level Rendering Time TTFB Application Level Cache Performance HTTP Errors Application Level Connection Pool Use Garbage Collection Application Level SQL Query Performance Full Table Scans Business Level Response Time Availability Conversions Service Level Response Time Availability O/S Level CPU Loading Available Memory I/O Performance Free Disk Space Page File Usage APM Level Method Performance Business Transaction O/S Level CPU Loading Available Memory I/O Performance Free Disk Space Page File Usage APM Level Database Calls Service Calls O/S Level CPU Loading Available Memory I/O Performance Free Disk Space Page File Usage

47 The first deliverable Statement of Work Performance KPI s Tooling options Load Model Test Plan Time-scales Aim to achieve consensus and agreement on expectation

48 27 th March 2015 Istanbul, Turkey People

49 People The right people are essential to effective performance testing. Experienced performance testers are a rare commodity to be nurtured.

50 People They should ideally have.. Background knowledge of application design and deployment. An understanding of application architectures. Understand the importance of accurate requirement capture. The ability to use tooling and implement process.

51 People Promote a culture of performance Raise awareness of performance in IT Consider performance at project start. Test in Dev, QA and Production Be a performance warrior

52 27 th March 2015 Istanbul, Turkey (Automation) Tooling

53 The case for automation You cannot performance test effectively without automation.

54 Automation enables Scalability Consistency Correlation Repeatability

55 Tooling components Most automated performance testing tools have the following components.. Workbench for script recording Load injector to generate application traffic Controller to manage and execute tests Monitors to capture non-application KPI s Analysis to triage test results

56 Tooling components Load Web Server Tier Load Metrics Test Scenarios Load Test Controller App Server Tier Load Load Injectors Database Cluster

57 Tooling choice.. Performance Test Delivery JMeter Facilita Forecast Neotys Neoload Borland Silk Performer HP LoadRunner dynatrace APMaaS APM dynatrace Appdynamics New Relic Correlsense Sharepath HP Diagnostics Windows O/S and Application Monitoring Windows Performance Monitor Solar Winds Linux / Unix kernel tools

58 27 th March 2015 Istanbul, Turkey Tech-Stack Challenges

59 Tech-stack challenges Most modern performance testing requirements involve web Good support for Websockets, Async and similar current tech However you may also come across the following.. Thin-client Citrix, MSTC SAPGUI Oracle ebusiness BMC Remedy IT Service Management

60 Tech-stack challenges Tech-stack requirements other than web.. Tooling choice Non-web support is typically not OpenSource Licensing considerations other than performance tooling i.e Does the client have enough Citrix licenses? Specialist domain knowledge

61 27 th March 2015 Istanbul, Turkey Environments

62 Environments As close as practical to production in terms of.. Horizontal and Vertical scale Service consumption Data volume and quality Software Build, Deploy and Configuration Exclusive access during performance test execution Roll-back strategy

63 Environments Appropriate Instrumentation Application KPI s Infrastructure KPI s Appropriate monitoring Baked into performance test tooling Leverage existing tooling investments

64 27 th March 2015 Istanbul, Turkey Process

65 Process Make sure you follow a consistent approach.. Scoping Design Execution and Analysis Closure

66 Process Scoping.. NFR Capture Six Pillars approach Delivers a Statement of Work

67 Process Design.. Based on Statement of Work and Load Model Validate test environment Create scripts from use cases Create performance test scenarios Configure environment monitoring Ensure you are ready to execute

68 Process Execution and Analysis.. Generally an iterative process A lot of watchful waiting Feedback is critical Highly vulnerable to scope creep

69 Analysis - Concurrency versus response time

70 Analysis - Concurrency versus errors

71 Analysis - Concurrency versus hit rate

72 Process Closure Creation of engagement report Must report against performance targets and goals Clarity is key Workshop results with the client Follow up with quality review

73 27 th March 2015 Istanbul, Turkey Take Away

74 Built on six pillars Business knowledge Technical knowledge People Tooling Environments Process

75 Call to action Performance testing is a tactical deliverable but should be part of a strategic process Test early, test often, test effectively Be a performance warrior

76 27 th March 2015 Istanbul, Turkey Thank you Q & A

Monitoring Remedy with BMC Solutions

Monitoring Remedy with BMC Solutions Monitoring Remedy with BMC Solutions Overview How does BMC Software monitor Remedy with our own solutions? The challenge is many fold with a solution like Remedy and this does not only apply to Remedy,

More information

Performance Testing Percy Pari Salas

Performance Testing Percy Pari Salas Performance Testing Percy Pari Salas Presented by : Percy Pari Salas Agenda What is performance testing? Types of performance testing What does performance testing measure? Where does performance testing

More information

Performance Testing of Java Enterprise Systems

Performance Testing of Java Enterprise Systems Performance Testing of Java Enterprise Systems Katerina Antonova, Plamen Koychev Musala Soft Why Performance Testing? Recent studies by leading USA consultancy companies showed that over 80% of large corporations

More information

Performance Management from black-art to process

Performance Management from black-art to process Performance Management from black-art to process peter.holditch@dynatrace.com What needs to be measured? CPU utilisation I/O Rate TPM level transaction stats What needs to be measured???? Remember how

More information

Performance Testing: Roles, Activities, and QA Inclusion

Performance Testing: Roles, Activities, and QA Inclusion : Roles, Activities, and QA Inclusion Michael Lawler NueVista Group 1 Today s Agenda Outline the components of a performance test and considerations Discuss various roles, tasks, and activities Review

More information

TASSQ Dinner Meeting Performance & Automation Testing of Cloud Solutions. March 31 st 2015

TASSQ Dinner Meeting Performance & Automation Testing of Cloud Solutions. March 31 st 2015 TASSQ Dinner Meeting Performance & Automation Testing of Cloud Solutions March 31 st 2015 Brief History Of Cloud Computing Even though the cloud has only just recently hit its stride and began to expand

More information

Case Study - I. Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008.

Case Study - I. Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008. Case Study - I Industry: Social Networking Website Technology : J2EE AJAX, Spring, MySQL, Weblogic, Windows Server 2008 Challenges The scalability of the database servers to execute batch processes under

More information

Performance Testing. What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing

Performance Testing. What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing Performance Testing What is performance testing? Why is performance testing necessary? Performance Testing Methodology EPM Performance Testing What is Performance Testing l The primary goal of Performance

More information

EXECUTIVE SUMMARY CONTENTS. 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix. 1.

EXECUTIVE SUMMARY CONTENTS. 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix. 1. CONTENTS 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix EXECUTIVE SUMMARY Tenzing Managed IT services has recently partnered with Amazon Web Services

More information

Performance Testing. Why is important? An introduction. Why is important? Delivering Excellence in Software Engineering

Performance Testing. Why is important? An introduction. Why is important? Delivering Excellence in Software Engineering Delivering Excellence in Software Engineering Performance Testing An introduction. Why is important? Why is important? 2 1 https://www.youtube.com/watch?v=8y8vqjqbqdc 3 4 2 Introduction Why is important?

More information

Performance Testing Process

Performance Testing Process Delivering Excellence in Software Engineering Performance Testing An introduction. 1 2 3 4 5 6 Introduction Performance Testing Process Performance Test Types Tools JMeter Questions 2 1 Introduction This

More information

Testing & Assuring Mobile End User Experience Before Production. Neotys

Testing & Assuring Mobile End User Experience Before Production. Neotys Testing & Assuring Mobile End User Experience Before Production Neotys Agenda Introduction The challenges Best practices NeoLoad mobile capabilities Mobile devices are used more and more At Home In 2014,

More information

Mobile Application Performance

Mobile Application Performance Mobile Application Performance Tips & Tricks to Significantly Boost App Performance Ray Bennett Director, Microstrategy - Mobile Service Line 11km/s (7mps) Escape Velocity Performance Definition What is

More information

Monitoring Best Practices for COMMERCE

Monitoring Best Practices for COMMERCE Monitoring Best Practices for COMMERCE OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems

More information

White paper: Unlocking the potential of load testing to maximise ROI and reduce risk.

White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. Executive Summary Load testing can be used in a range of business scenarios to deliver numerous benefits. At its core,

More information

10 Best Practices for Application Performance Testing

10 Best Practices for Application Performance Testing Business white paper 10 Best Practices for Application Performance Testing Leveraging Agile Performance Testing for Web and Mobile Applications 10 Best Practices for Application Performance Testing Table

More information

Holistic Performance Analysis of J2EE Applications

Holistic Performance Analysis of J2EE Applications Holistic Performance Analysis of J2EE Applications By Madhu Tanikella In order to identify and resolve performance problems of enterprise Java Applications and reduce the time-to-market, performance analysis

More information

Mainframe to AIX: Performance Assurance Case Study. Copyright 1202Performance [Performance Engineering]

Mainframe to AIX: Performance Assurance Case Study. Copyright 1202Performance [Performance Engineering] Mainframe to AIX: Performance Assurance Case Study Agenda Why Hardware Sizing Early Performance Testing Performance Modelling Application Performance Monitoring Performance Testing Go-Live Weekend Background

More information

Bernie Velivis President, Performax Inc

Bernie Velivis President, Performax Inc Performax provides software load testing and performance engineering services to help our clients build, market, and deploy highly scalable applications. Bernie Velivis President, Performax Inc Load ing

More information

Noelle A. Stimely Senior Performance Test Engineer. University of California, San Francisco noelle.stimely@ucsf.edu

Noelle A. Stimely Senior Performance Test Engineer. University of California, San Francisco noelle.stimely@ucsf.edu Noelle A. Stimely Senior Performance Test Engineer University of California, San Francisco noelle.stimely@ucsf.edu Who am I? Senior Oracle Database Administrator for over 13 years Senior Performance Test

More information

Performance Testing. Slow data transfer rate may be inherent in hardware but can also result from software-related problems, such as:

Performance Testing. Slow data transfer rate may be inherent in hardware but can also result from software-related problems, such as: Performance Testing Definition: Performance Testing Performance testing is the process of determining the speed or effectiveness of a computer, network, software program or device. This process can involve

More information

Mobile Testing: Actual Results from Nationwide Insurance How we could have tested the same application with the latest tools available

Mobile Testing: Actual Results from Nationwide Insurance How we could have tested the same application with the latest tools available Contents Introductions Petar Puskarich Todd DeCapua Mobile Testing: Introduction / How To Testing our latest mobile application with limited tools and procedures Mobile Testing: Actual Results from Nationwide

More information

Mobile Performance Testing Approaches and Challenges

Mobile Performance Testing Approaches and Challenges NOUS INFOSYSTEMS LEVERAGING INTELLECT Mobile Performance Testing Approaches and Challenges ABSTRACT Mobile devices are playing a key role in daily business functions as mobile devices are adopted by most

More information

Exploring Oracle E-Business Suite Load Balancing Options. Venkat Perumal IT Convergence

Exploring Oracle E-Business Suite Load Balancing Options. Venkat Perumal IT Convergence Exploring Oracle E-Business Suite Load Balancing Options Venkat Perumal IT Convergence Objectives Overview of 11i load balancing techniques Load balancing architecture Scenarios to implement Load Balancing

More information

Strong experience in drafting Test Plan, Test Strategy, Test Estimation, Test Cases, Requirement Matrix, Audit and Test Results documents

Strong experience in drafting Test Plan, Test Strategy, Test Estimation, Test Cases, Requirement Matrix, Audit and Test Results documents 1 KIRAN BADI MOBILE : 6462013101 EMAIL: KIRAN_BADI@HOTMAIL.COM PROFESSIONAL SUMMARY 9+ Years as a Performance Engineer and around 3 years as J2EE Developers with total 12 + years of IT Experiences.5 +

More information

Best Practices for Web Application Load Testing

Best Practices for Web Application Load Testing Best Practices for Web Application Load Testing This paper presents load testing best practices based on 20 years of work with customers and partners. They will help you make a quick start on the road

More information

Application. Performance Testing

Application. Performance Testing Application Performance Testing www.mohandespishegan.com شرکت مهندش پیشگان آزمون افسار یاش Performance Testing March 2015 1 TOC Software performance engineering Performance testing terminology Performance

More information

Performance Management for Cloudbased STC 2012

Performance Management for Cloudbased STC 2012 Performance Management for Cloudbased Applications STC 2012 1 Agenda Context Problem Statement Cloud Architecture Need for Performance in Cloud Performance Challenges in Cloud Generic IaaS / PaaS / SaaS

More information

Process of Performance Testing a Banking Application

Process of Performance Testing a Banking Application Process of Performance Testing a Banking Application The Need One of the largest banks in India offers Online and Mobile Banking application to its customers. Several online services are hassle-free services

More information

MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM?

MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM? MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM? Ashutosh Shinde Performance Architect ashutosh_shinde@hotmail.com Validating if the workload generated by the load generating tools is applied

More information

Informatica Data Director Performance

Informatica Data Director Performance Informatica Data Director Performance 2011 Informatica Abstract A variety of performance and stress tests are run on the Informatica Data Director to ensure performance and scalability for a wide variety

More information

Cognos8 Deployment Best Practices for Performance/Scalability. Barnaby Cole Practice Lead, Technical Services

Cognos8 Deployment Best Practices for Performance/Scalability. Barnaby Cole Practice Lead, Technical Services Cognos8 Deployment Best Practices for Performance/Scalability Barnaby Cole Practice Lead, Technical Services Agenda > Cognos 8 Architecture Overview > Cognos 8 Components > Load Balancing > Deployment

More information

Mike Chyi, Micro Focus Solution Consultant May 12, 2010

Mike Chyi, Micro Focus Solution Consultant May 12, 2010 Mike Chyi, Micro Focus Solution Consultant May 12, 2010 Agenda Load Testing Overview, Best Practice: Performance Testing with Diagnostics Demo (?), Q&A Load Testing Overview What is load testing? Type

More information

What Is Specific in Load Testing?

What Is Specific in Load Testing? What Is Specific in Load Testing? Testing of multi-user applications under realistic and stress loads is really the only way to ensure appropriate performance and reliability in production. Load testing

More information

Bringing Value to the Organization with Performance Testing

Bringing Value to the Organization with Performance Testing Bringing Value to the Organization with Performance Testing Michael Lawler NueVista Group 1 Today s Agenda Explore the benefits of a properly performed performance test Understand the basic elements of

More information

Performance Testing of a Large Wealth Management Product

Performance Testing of a Large Wealth Management Product Performance Testing of a Large Wealth Management Product Meherphani Nori & Global Head Quality Assurance Krishna Kankipati & Vice President Mohan Pujari & Product Specialist Broadridge Financial Solutions

More information

Winning the J2EE Performance Game Presented to: JAVA User Group-Minnesota

Winning the J2EE Performance Game Presented to: JAVA User Group-Minnesota Winning the J2EE Performance Game Presented to: JAVA User Group-Minnesota Michelle Pregler Ball Emerging Markets Account Executive Shahrukh Niazi Sr.System Consultant Java Solutions Quest Background Agenda

More information

Test Run Analysis Interpretation (AI) Made Easy with OpenLoad

Test Run Analysis Interpretation (AI) Made Easy with OpenLoad Test Run Analysis Interpretation (AI) Made Easy with OpenLoad OpenDemand Systems, Inc. Abstract / Executive Summary As Web applications and services become more complex, it becomes increasingly difficult

More information

Q: What is the difference between the other load testing tools which enables the wan emulation, location based load testing and Gomez load testing?

Q: What is the difference between the other load testing tools which enables the wan emulation, location based load testing and Gomez load testing? PorposalPPP Q: Gomez is standlone web application testing tool? Gomez provides an on demand platform that you can use for both testing and monitoring your Web applications from the outside in across your

More information

Big Data Analytics - Accelerated. stream-horizon.com

Big Data Analytics - Accelerated. stream-horizon.com Big Data Analytics - Accelerated stream-horizon.com Legacy ETL platforms & conventional Data Integration approach Unable to meet latency & data throughput demands of Big Data integration challenges Based

More information

Performance Testing for Managers. Presented by Stuart Moncrieff at SIGiST Melbourne on June 15 th, 2011

Performance Testing for Managers. Presented by Stuart Moncrieff at SIGiST Melbourne on June 15 th, 2011 Performance Testing for Managers Presented by Stuart Moncrieff at SIGiST Melbourne on June 15 th, 2011 What will be covered? Performance Testing as it applies to: Large multi-user enterprise IT applications

More information

Best Practices for Performance Testing Mobile Apps

Best Practices for Performance Testing Mobile Apps Best Practices for Performance Testing Mobile Apps Lee Barnes, CTO Utopia Solutions Apology I don t believe in best practices I do believe in guidelines and better approaches for a given situation Key

More information

Cloud/SaaS enablement of existing applications

Cloud/SaaS enablement of existing applications Cloud/SaaS enablement of existing applications GigaSpaces: Nati Shalom, CTO & Founder About GigaSpaces Technologies Enabling applications to run a distributed cluster as if it was a single machine 75+

More information

Insight into Performance Testing J2EE Applications Sep 2008

Insight into Performance Testing J2EE Applications Sep 2008 Insight into Performance Testing J2EE Applications Sep 2008 Presented by Chandrasekar Thodla 2008, Cognizant Technology Solutions. All Rights Reserved. The information contained herein is subject to change

More information

System Requirements Table of contents

System Requirements Table of contents Table of contents 1 Introduction... 2 2 Knoa Agent... 2 2.1 System Requirements...2 2.2 Environment Requirements...4 3 Knoa Server Architecture...4 3.1 Knoa Server Components... 4 3.2 Server Hardware Setup...5

More information

Specialist Cloud Services Lot 4 Cloud EDRM Consultancy Services

Specialist Cloud Services Lot 4 Cloud EDRM Consultancy Services Specialist Cloud Services Lot 4 Cloud EDRM Consultancy Services Page 1 1 Contents 1 Contents... 2 2 Transcend360 Introduction... 3 3 Service overview... 4 3.1 Service introduction... 4 3.2 Service description...

More information

Cloud Based Application Architectures using Smart Computing

Cloud Based Application Architectures using Smart Computing Cloud Based Application Architectures using Smart Computing How to Use this Guide Joyent Smart Technology represents a sophisticated evolution in cloud computing infrastructure. Most cloud computing products

More information

HP OO 10.X - SiteScope Monitoring Templates

HP OO 10.X - SiteScope Monitoring Templates HP OO Community Guides HP OO 10.X - SiteScope Monitoring Templates As with any application continuous automated monitoring is key. Monitoring is important in order to quickly identify potential issues,

More information

Load Testing Tools. Animesh Das

Load Testing Tools. Animesh Das Load Testing Tools Animesh Das Last Updated: May 20, 2014 text CONTENTS Contents 1 Introduction 1 2 Tools available for Load Testing of Databases 1 2.1 IO subsystem testing tools....................................

More information

The Evolution of Load Testing. Why Gomez 360 o Web Load Testing Is a

The Evolution of Load Testing. Why Gomez 360 o Web Load Testing Is a Technical White Paper: WEb Load Testing To perform as intended, today s mission-critical applications rely on highly available, stable and trusted software services. Load testing ensures that those criteria

More information

Getting Things Done: Practical Web/e-Commerce Application Stress Testing

Getting Things Done: Practical Web/e-Commerce Application Stress Testing Getting Things Done: Practical Web/e-Commerce Application Stress Testing Robert Sabourin President Montreal, Canada rsabourin@amibug.com Slide 1 Practical Web/e-Commerce Application Stress Testing Overview:

More information

Application Performance Management: New Challenges Demand a New Approach

Application Performance Management: New Challenges Demand a New Approach Application Performance Management: New Challenges Demand a New Approach Introduction Historically IT management has focused on individual technology domains; e.g., LAN, WAN, servers, firewalls, operating

More information

Application Performance Testing Basics

Application Performance Testing Basics Application Performance Testing Basics ABSTRACT Todays the web is playing a critical role in all the business domains such as entertainment, finance, healthcare etc. It is much important to ensure hassle-free

More information

Monitoring HP OO 10. Overview. Available Tools. HP OO Community Guides

Monitoring HP OO 10. Overview. Available Tools. HP OO Community Guides HP OO Community Guides Monitoring HP OO 10 This document describes the specifications of components we want to monitor, and the means to monitor them, in order to achieve effective monitoring of HP Operations

More information

Recommendations for Performance Benchmarking

Recommendations for Performance Benchmarking Recommendations for Performance Benchmarking Shikhar Puri Abstract Performance benchmarking of applications is increasingly becoming essential before deployment. This paper covers recommendations and best

More information

WINDOWS SERVER MONITORING

WINDOWS SERVER MONITORING WINDOWS SERVER Server uptime, all of the time CNS Windows Server Monitoring provides organizations with the ability to monitor the health and availability of their Windows server infrastructure. Through

More information

PERFORMANCE TESTING. New Batches Info. We are ready to serve Latest Testing Trends, Are you ready to learn.?? START DATE : TIMINGS : DURATION :

PERFORMANCE TESTING. New Batches Info. We are ready to serve Latest Testing Trends, Are you ready to learn.?? START DATE : TIMINGS : DURATION : PERFORMANCE TESTING We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info START DATE : TIMINGS : DURATION : TYPE OF BATCH : FEE : FACULTY NAME : LAB TIMINGS : Performance

More information

Rapid Bottleneck Identification

Rapid Bottleneck Identification Rapid Bottleneck Identification TM A Better Way to Load Test WHITEPAPER You re getting ready to launch or upgrade a critical Web application. Quality is crucial, but time is short. How can you make the

More information

Mark Bennett. Search and the Virtual Machine

Mark Bennett. Search and the Virtual Machine Mark Bennett Search and the Virtual Machine Agenda Intro / Business Drivers What to do with Search + Virtual What Makes Search Fast (or Slow!) Virtual Platforms Test Results Trends / Wrap Up / Q & A Business

More information

Martin Spier, Expedia & Rex Black, J9

Martin Spier, Expedia & Rex Black, J9 Martin Spier, Expedia & Rex Black, J9 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Leveraging HP Performance Center Martin

More information

Software Quality Analysis with Cloud Challenges and Approaches. Progress Software, Hyderabad, India

Software Quality Analysis with Cloud Challenges and Approaches. Progress Software, Hyderabad, India Software Quality Analysis with Cloud Challenges and Approaches Dr Ganesh Iyer, PhD, Santhosh Kumar Soma, Kiran Kumar Angara, Principal QA Engineer Senior QA Engineer QA Engineer, Progress Software, Hyderabad,

More information

Why Alerts Suck and Monitoring Solutions need to become Smarter

Why Alerts Suck and Monitoring Solutions need to become Smarter An AppDynamics Business White Paper HOW MUCH REVENUE DOES IT GENERATE? Why Alerts Suck and Monitoring Solutions need to become Smarter I have yet to meet anyone in Dev or Ops who likes alerts. I ve also

More information

MONITORING A WEBCENTER CONTENT DEPLOYMENT WITH ENTERPRISE MANAGER

MONITORING A WEBCENTER CONTENT DEPLOYMENT WITH ENTERPRISE MANAGER MONITORING A WEBCENTER CONTENT DEPLOYMENT WITH ENTERPRISE MANAGER Andrew Bennett, TEAM Informatics, Inc. Why We Monitor During any software implementation there comes a time where a question is raised

More information

Mohammed Khan SUMMARY

Mohammed Khan SUMMARY Mohammed Khan E-mail: Mohammedrkhn@gmail.com Phone: 347-878-1170 SUMMARY Over 5 years of diversified experience as a. Experience includes requirement analysis, manual testing and automation and quality

More information

Levels of Software Testing. Functional Testing

Levels of Software Testing. Functional Testing Levels of Software Testing There are different levels during the process of Testing. In this chapter a brief description is provided about these levels. Levels of testing include the different methodologies

More information

Monitoring Best Practices for

Monitoring Best Practices for Monitoring Best Practices for OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems like Magento,

More information

Performance TesTing expertise in case studies a Q & ing T es T

Performance TesTing expertise in case studies a Q & ing T es T testing & QA Performance Testing Expertise in Case Studies Case 1 ELEKS team has developed a custom test framework designed to accommodate numerous types of testing and measurements: Accuracy testing during

More information

A closer look at HP LoadRunner software

A closer look at HP LoadRunner software Technical white paper A closer look at HP LoadRunner software Table of contents Sizing up the system 2 The limits of manual testing 2 A new take on testing: the HP LoadRunner solution 3 The HP LoadRunner

More information

Load/Stress Test Plan

Load/Stress Test Plan WileyPLUS E5 Load/Stress Test Plan Version 1.1 Author: Cris J. Holdorph Unicon, Inc. 1 Audit Trail: Date Version Name Comment April 2, 2008 1.0 Cris J. Holdorph Initial Revision April 9, 2008 1.1 Cris

More information

Virtual Desktop Infrastructure Optimization with SysTrack Monitoring Tools and Login VSI Testing Tools

Virtual Desktop Infrastructure Optimization with SysTrack Monitoring Tools and Login VSI Testing Tools A Software White Paper December 2013 Virtual Desktop Infrastructure Optimization with SysTrack Monitoring Tools and Login VSI Testing Tools A Joint White Paper from Login VSI and Software 2 Virtual Desktop

More information

An Oracle White Paper July 2011. Oracle Primavera Contract Management, Business Intelligence Publisher Edition-Sizing Guide

An Oracle White Paper July 2011. Oracle Primavera Contract Management, Business Intelligence Publisher Edition-Sizing Guide Oracle Primavera Contract Management, Business Intelligence Publisher Edition-Sizing Guide An Oracle White Paper July 2011 1 Disclaimer The following is intended to outline our general product direction.

More information

Silk Performer LOAD TESTING. The key to keeping business applications running

Silk Performer LOAD TESTING. The key to keeping business applications running Silk Performer LOAD TESTING The key to keeping business applications running 2 Load testing Executive Summary Every business depends on applications to automate its core business processes. These applications

More information

Cloud-based Managed Services for SAP. Service Catalogue

Cloud-based Managed Services for SAP. Service Catalogue Cloud-based Managed Services for SAP Service Catalogue Version 1.8 Date: 28.07.2015 TABLE OF CONTENTS Introduction... 4 Managed Services out of the Cloud... 4 Cloud-based Flexibility, Efficiency and Scalability...

More information

An Oracle Benchmarking Study February 2011. Oracle Insurance Insbridge Enterprise Rating: Performance Assessment

An Oracle Benchmarking Study February 2011. Oracle Insurance Insbridge Enterprise Rating: Performance Assessment An Oracle Benchmarking Study February 2011 Oracle Insurance Insbridge Enterprise Rating: Performance Assessment Executive Overview... 1 RateManager Testing... 2 Test Environment... 2 Test Scenarios...

More information

Rackspace Cloud Databases and Container-based Virtualization

Rackspace Cloud Databases and Container-based Virtualization Rackspace Cloud Databases and Container-based Virtualization August 2012 J.R. Arredondo @jrarredondo Page 1 of 6 INTRODUCTION When Rackspace set out to build the Cloud Databases product, we asked many

More information

Hardware/Software Guidelines

Hardware/Software Guidelines There are many things to consider when preparing for a TRAVERSE v11 installation. The number of users, application modules and transactional volume are only a few. Reliable performance of the system is

More information

MIMIC Simulator helps testing of Business Service Management Products

MIMIC Simulator helps testing of Business Service Management Products Technical white paper from FireScope and Gambit Communications MIMIC Simulator helps testing of Business Service Management Products By Ryan Counts, FireScope, Inc. & Pankaj Shah, Gambit Communications

More information

Building a Mobile App Security Risk Management Program. Copyright 2012, Security Risk Advisors, Inc. All Rights Reserved

Building a Mobile App Security Risk Management Program. Copyright 2012, Security Risk Advisors, Inc. All Rights Reserved Building a Mobile App Security Risk Management Program Your Presenters Who Are We? Chris Salerno, Consultant, Security Risk Advisors Lead consultant for mobile, network, web application penetration testing

More information

Regression & Load Testing BI EE 11g

Regression & Load Testing BI EE 11g Regression & Load Testing BI EE 11g Venkatakrishnan J Who Am I? Venkatakrishnan Janakiraman Over 8+ Years of Oracle BI & EPM experience Managing Director (India), Rittman Mead India Blog at http://www.rittmanmead.com/blog

More information

DATABASE ADMINISTRATION (DBA) SERVICES

DATABASE ADMINISTRATION (DBA) SERVICES DATABASE ADMINISTRATION (DBA) SERVICES Expert, Cost-effective DBA Services As An Extension of Your IT Staff Connectria s Database Administration Services allow you to free your staff and resources to focus

More information

Java Monitoring. Stuff You Can Get For Free (And Stuff You Can t) Paul Jasek Sales Engineer

Java Monitoring. Stuff You Can Get For Free (And Stuff You Can t) Paul Jasek Sales Engineer Java Monitoring Stuff You Can Get For Free (And Stuff You Can t) Paul Jasek Sales Engineer A Bit About Me Current: Past: Pre-Sales Engineer (1997 present) WaveMaker Wily Persistence GemStone Application

More information

Looking Ahead The Path to Moving Security into the Cloud

Looking Ahead The Path to Moving Security into the Cloud Looking Ahead The Path to Moving Security into the Cloud Gerhard Eschelbeck Sophos Session ID: SPO2-107 Session Classification: Intermediate Agenda The Changing Threat Landscape Evolution of Application

More information

Automating Security Testing. Mark Fallon Senior Release Manager Oracle

Automating Security Testing. Mark Fallon Senior Release Manager Oracle Automating Security Testing Mark Fallon Senior Release Manager Oracle Some Ground Rules There are no silver bullets You can not test security into a product Testing however, can help discover a large percentage

More information

EQUELLA Whitepaper. Performance Testing. Carl Hoffmann Senior Technical Consultant

EQUELLA Whitepaper. Performance Testing. Carl Hoffmann Senior Technical Consultant EQUELLA Whitepaper Performance Testing Carl Hoffmann Senior Technical Consultant Contents 1 EQUELLA Performance Testing 3 1.1 Introduction 3 1.2 Overview of performance testing 3 2 Why do performance testing?

More information

Performance Test Summary Report Skills Development Management System. December 2014

Performance Test Summary Report Skills Development Management System. December 2014 Performance Test Summary Report Skills Development Management System December 2014 Performance Test report submitted to National Skill Development Corporation Version Date Name Summary of Changes 1.0 22/12/2014

More information

http://support.oracle.com/

http://support.oracle.com/ Oracle Primavera Contract Management 14.0 Sizing Guide October 2012 Legal Notices Oracle Primavera Oracle Primavera Contract Management 14.0 Sizing Guide Copyright 1997, 2012, Oracle and/or its affiliates.

More information

Serving 4 million page requests an hour with Magento Enterprise

Serving 4 million page requests an hour with Magento Enterprise 1 Serving 4 million page requests an hour with Magento Enterprise Introduction In order to better understand Magento Enterprise s capacity to serve the needs of some of our larger clients, Session Digital

More information

Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton

Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton Session 5: Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton Agenda HP ALM Solution Review HP Cloud Potential Cloud Portal HP ALM Solutions in a virtual environment

More information

Scalability and BMC Remedy Action Request System TECHNICAL WHITE PAPER

Scalability and BMC Remedy Action Request System TECHNICAL WHITE PAPER Scalability and BMC Remedy Action Request System TECHNICAL WHITE PAPER Table of contents INTRODUCTION...1 BMC REMEDY AR SYSTEM ARCHITECTURE...2 BMC REMEDY AR SYSTEM TIER DEFINITIONS...2 > Client Tier...

More information

An Oracle White Paper Released Sept 2008

An Oracle White Paper Released Sept 2008 Performance and Scalability Benchmark: Siebel CRM Release 8.0 Industry Applications on HP BL460c/BL680c Servers running Microsoft Windows Server 2008 Enterprise Edition and SQL Server 2008 (x64) An Oracle

More information

Product Overview. UNIFIED COMPUTING Managed Hosting Compute

Product Overview. UNIFIED COMPUTING Managed Hosting Compute Product Overview Interoute provide our clients with a diverse range of compute options delivered from our 10 carrier-class data centre facilities. Leveraging our extensive and diverse next generation IP

More information

Contents Introduction... 5 Deployment Considerations... 9 Deployment Architectures... 11

Contents Introduction... 5 Deployment Considerations... 9 Deployment Architectures... 11 Oracle Primavera Contract Management 14.1 Sizing Guide July 2014 Contents Introduction... 5 Contract Management Database Server... 5 Requirements of the Contract Management Web and Application Servers...

More information

Performance and Load Testing. >>>>>>>>>>>>>>>>>>>>>> www.softwaretestinggenius.com <<<<<<<<<<<<<<<<<<<<<<

Performance and Load Testing. >>>>>>>>>>>>>>>>>>>>>> www.softwaretestinggenius.com <<<<<<<<<<<<<<<<<<<<<< Performance and Load Testing Part 1 Performance & Load Testing Basics Performance & Load Testing Basics Introduction to Performance Testing Difference between Performance, Load and Stress Testing Why Performance

More information

Load/Performance Test Plan

Load/Performance Test Plan [Project_name_here] Load/Performance Test Plan Version [Version_number] Author: [Your_name_here] [Your_Company_name] [Street_name_1] [Street_name_2] [City_Zip_Country] [Phone_number] [URL] Audit Trail:

More information

Performance And Scalability In Oracle9i And SQL Server 2000

Performance And Scalability In Oracle9i And SQL Server 2000 Performance And Scalability In Oracle9i And SQL Server 2000 Presented By : Phathisile Sibanda Supervisor : John Ebden 1 Presentation Overview Project Objectives Motivation -Why performance & Scalability

More information

Migrating Production HPC to AWS

Migrating Production HPC to AWS Migrating Production HPC to AWS A Story of Early Adoption & Lessons Learned Lewis Foti Mentation Solutions Common Computing Service (CCS) The Common Computing Service (CCS) is the HPC (grid computing)

More information

Clarity in the Cloud. Defining cloud services and the strategic impact on businesses.

Clarity in the Cloud. Defining cloud services and the strategic impact on businesses. Clarity in the Cloud Defining cloud services and the strategic impact on businesses. Table of Contents Executive Summary... 3 Cloud Services... 4 Clarity within the Cloud... 4 Public Cloud Solution...

More information

BeBanjo Infrastructure and Security Overview

BeBanjo Infrastructure and Security Overview BeBanjo Infrastructure and Security Overview Can you trust Software-as-a-Service (SaaS) to run your business? Is your data safe in the cloud? At BeBanjo, we firmly believe that SaaS delivers great benefits

More information

Xaas: Anything and everything as a service

Xaas: Anything and everything as a service Xaas: Anything and everything as a service www.version1.com/expo15 Cloud Enabling the Enterprise - Focus on cloud for Traditional Enterprises - Understanding Cloud Adoption Barriers - Case Studies to illustrate

More information

Ben Prusinski Session 3: 11/15/2012 14:30 to 15:30 Location: Diablo

Ben Prusinski Session 3: 11/15/2012 14:30 to 15:30 Location: Diablo Ben Prusinski Session 3: 11/15/2012 14:30 to 15:30 Location: Diablo About the Speaker- Ben Prusinski Oracle ACE Director, OCP, Beta tester, Author, Underwater Photographer Avid scuba diver and student

More information