1 Business white paper 10 Best Practices for Application Performance Testing Leveraging Agile Performance Testing for Web and Mobile Applications
2 10 Best Practices for Application Performance Testing Table of contents 2 Introduction 2 Ten Performance Testing Best Practices 4 Ten Additional Considerations for Mobile Applications 6 Five Common Mistakes to Avoid 6 Conclusion 7 About Orasi Introduction: What is Performance Testing? Software application performance testing is a somewhat vague and subjective phrase that many people find difficult to define. For instance, what exactly is good performance? How do you determine if something is fast, and what makes an application slow? The problem is that these are subjective terms that vary between applications, users, and devices. If your goal is to build a fast web application, or you re dealing with users complaining that your mobile app is slow, testing for this may prove challenging. The fact is that proper performance testing will help determine if a system meets certain acceptable criteria for both responsiveness and robustness while under reasonable load. Although responsiveness varies it could be the reaction time to user input or the amount of latency between server request/response cycles it s typically something that can be measured directly. Robustness also varies by system, but it typically translates into a measurement of stability, scalability, and overall system reliability. Instead of dealing with the subjective, a successful approach to performance testing involves precise plans and well-thought-out goals. Start by defining test plans that include load testing, stress testing, endurance testing, availability testing, configuration testing, and isolation testing. Couple these plans with precise metrics in terms of goals, acceptable measurements, thresholds, and a plan to deal with performance issues for the best results. This should include measurements such as average response time over predefined timeframes, graphs of standard deviation, absolute timings, average latency, and request/response outliers, among others. Let s take a look at a more complete performance-testing blueprint for success. Ten Performance Testing Best Practices Orasi and HP collaborated to develop these top ten best practices for application performance testing. They serve as guidelines for performance testing traditional software i.e. web applications but they apply to others, including mobile apps. For specific mobile performance
3 testing best practices, see the sidebar Additional Considerations for Mobile Apps. Let s look at the top performance testing best practices now. Take a DevOps approach to application performance testing, where developers, IT operations, and testers work as a team to build, deploy, tune and configure applicable systems, and execute performance tests. 1. Test Early and Often Performance testing is often an afterthought, performed in haste late in the development cycle, or only in response to user complaints. Instead, take an agile approach using iterativebased testing throughout the entire development lifecycle. The agile methodology has become popular due to the advantages of frequent iteration, the involvement of all stakeholders, and the continuous course of corrections it provides. The advantages compound when you take a continuous testing approach, involving more than development, which takes us to the second and related performance testing best practice. 2. Take a DevOps Approach Soon after the lean movement inspired agile, IT organizations saw the need to unify development and IT operations activities. The result is the DevOps approach, where developers and IT work together to define, build, and deploy software as a team. Just as agile organizations often embrace a continuous, test-driven development process, DevOps should include developers, IT operations, and testers working together to build, deploy, tune and configure applicable systems, and execute performance tests against the end-product as a team. 3. Consider Users, Not Just Servers Performance tests often focus on the results of servers and clusters running software. Don t forget that real people use software, and that performance tests should measure the human element as well. For instance, measuring the performance of clustered servers may return satisfactory results, but users on a single overloaded or troubled server may experience an unsatisfactory result. Instead, tests should include the per-user experience of performance, and user interface timings should be captured systematically in conjunction with server metrics. To illustrate, if only one percent of one million request/response cycles are latent, ten thousand people an alarming number will have experienced poor performance with your application. Driving your performance testing from the single user point of view helps you understand what each user of your system will experience before it s an issue. 4. Understand Performance Test Definitions It s crucial to have a common definition for the types of performance tests that should be executed against your applications, such as: Single User Tests. Testing with one active user yields the best possible performance, and response times can be used for baseline measurements. Load Tests. Understand the behavior of the system under average load, including the expected number of concurrent users performing a specific number of transactions within an average hour. Perform common tests with added system load, additional concurrent users, and so on. Measure system capacity, and know the true maximum load of the system while it still meets performance goals. Peak Load Tests. Understand system behavior under the heaviest usage anticipated for concurrent number of users and transaction rates. Endurance (Soak) Tests. Determine the longevity of components, and if the system can sustain average to peak load over a predefined duration. Memory utilization should be monitored to detect potential leaks. The testing will also ensure that throughput and response times after sustained activity continue to meet performance goals. Stress Tests. Understand the upper limits of capacity within the system by purposely pushing it to its breaking point. This helps determine the system s robustness in terms of extreme load and helps identify both potential scalability issues and breaking points. High Availability Tests. Validate how the system behaves during a failure condition while under load. There are many operational use cases that should be included, such as: Seamless failover of network equipment, hardware, application servers, and databases Rolling server restarts Loss of a server within a cluster
4 Ten Additional Considerations for Mobile Applications The following is a set of best practices specific to performance testing mobile applications: 1. Consider network quality. Latency tends to be higher on mobile networks, connection quality is more unpredictable, and connections come and go. 2. Consider geography. Users in certain regions of the country will experience different response times and affect your back-end infrastructure differently. 3. Consider entire mobile product families. Performance and available resources differ even within product families (i.e. Apple ios). For instance, with ios, iphone 4, iphone 4S, iphone 5, and iphone 5S are all in use, and Android is even more fragmented. 4. Don t focus on specific devices. Define deviceagnostic tests. 5. Expect more concurrent users. People tend to use their mobile devices more often, and for short bursts of activity. Instant mobile access has the capability to create a load singularity that would not exist in normal desktop applications/sites. Special test cases should be developed to test these areas. continued Seamless addition and removal of nodes Seamless patch or upgrade of software and firmware where applicable System functionality and performance during a server failover before it happens in production The impact of network bandwidth variation, such as during a communications link failure Configuration/Tuning Tests. Assess the effect of changing system parameters or software versions. A reasonable goal is to maintain 80 percent to 85 percent optimal performance during, for example, an application server upgrade. Isolation Tests. Measure the performance of typical silo components, such as serviceoriented architecture (SOA) systems, user interfaces, and legacy systems. Include virtualization-based testing for web services, REST services, message-oriented middleware solutions, and others, where the actual systems need not be included in the tests. 5. Build a Complete Performance Model Measuring your application s performance includes understanding your system s capacity. This includes planning what the steady state will be in terms of concurrent users, simultaneous requests, average user sessions, and server utilization during peak periods of the day. Additionally, you should define performance goals, such as maximum response times, system scalability, user satisfaction marks, acceptable performance metrics, and maximum capacity for all of these metrics. It s crucial to define related thresholds that will alert you to potential performance issues as you pass those thresholds. Multiple thresholds need to be defined with increasing levels of risk. The associated levels of alerts can be used not only to define a response to a potentially escalating performance problem, but also help you work with DevOps to further tune the environment and refine your production system monitoring. True to the agile approach, capacity planning and measurement creates a feedback loop that improves both your application s performance and your monitoring and measurement of that performance. An effective planning processing includes the definition of success criteria, such as: Key Performance Indicators (KPI), including average latency, request/response times, and server utilization Business Process Completion Rate, including transactions per second, and system throughput load profiles for average, peak, and spike tests Hardware metrics, including CPU usage, memory usage, and network traffic
5 6. Include Performance Testing in Development Unit Tests Waiting until a system is mostly built or complete to run performance tests can make it harder to isolate where problems exist. It s often more costly to correct performance issues later in the development process, and more risky to make changes if functional testing has already been completed. Ten Additional Considerations for Mobile Applications continued 6. High user expectations. Mobile users expect to get responses immediately, and if not they might move on to another application or site. 7. Use emulation in performance tests. It may not be feasible to wait for mobile software to be installed on actual devices for testing, and it may not be feasible to test the demands of multiple actual devices. Consider how device emulators fit into your manual and automated testing. 8. Always test end-to-end. A mobile app is only as good as its back-end server response time plus its own processing time. 9. Isolate timings. The performance break down is more complex. Measure the following: a. Content request time b. Content delivery time c. Render time d. User gesture response e. General UI responsiveness 10. Capacity testing. Test low-memory and outof-storage conditions. As a result, developers should include performance testing as part of their unit tests, in addition to dedicated performance testing. There s a significant difference in the testing approaches, as unit testing often focuses on sections of code, not just application functionality or the integrated system. This means developers will be intimately involved with the performance of their code throughout the development process, and everyone will have a leg up on knowing how to monitor individual components for issues in production. 7. Define Baselines for Important System Functions In most cases, QA systems don t match production systems. Having baseline performance measurements of each system can give you reasonable goals for each environment used for testing. They specifically provide an important starting point for response time goals where there are no previous metrics, without having to guess or base them on other applications. Baseline performance tests and measurements, such as single-user login time, the request/ response time for individual screens and so on, should occur with no system load. 8. Perform Modular and System Performance Tests Modern applications are composed of many individual complex systems, including databases, application servers, web services, legacy systems, and so on. All of these systems need to be performance tested individually and together. This helps expose the weak links, learn which systems adversely affect others, and understand which systems to isolate for further performance tuning. 9. Measure Averages, but Include Outliers When testing performance, you need to know average response time, but this measurement can be misleading by itself. For example, if you strictly measure the average response time for your application at less than five seconds, and this is within target, your related performance tests will pass. However, some of those responses may have been at or well beyond five seconds, leading to a poor experience for those affected users. Be sure to include other metrics such as 90th percentile or standard deviation to get a better view of system performance. KPIs can be measured by looking at the average and standard deviations. For example, set a performance goal at the average response time plus one standard deviation beyond it (see Figure 1). In many systems, this improved measurement affects the pass/fail criteria of the test, matching the actual user experience more accurately. Transactions with a high standard deviation can be tuned to reduce system response time variability and improve overall user experience. Figure 1. Measuring standard deviation shows averages and outliers % 2.1% 0.1% 0.1% 13.6% 13.6% -3σ 34.1% 34.1% -2σ -1σ μ 1σ 2σ 3σ
6 10. Consistently Report and Analyze the Results Performance test design and execution are important, but test reports are important as well. Reports communicate the results of your application s behavior to everyone within your organization, and can even serve as bragging rights for project owners and developers. Analyzing and reporting results consistently also helps to define attack plans for fixes. Remember to consider your audience, since reports for developers should differ from reports sent to project owners, managers, corporate executives, and even customers if applicable. With each report, note obvious software changes made (enhancements, bug fixes, and so on) as well as any other changes tested (third-party software upgrades, changes to environment, hardware, and so on). Five Common Mistakes to Avoid In addition to following a set of best practices for performance testing, there are common mistakes to avoid. These include: Not allowing enough time. Build time into the schedule up front. Throwing software over the wall. Keep developers involved by including performance in unit testing efforts. Using a QA system that differs greatly from production in terms of size, configuration, and/or underlying hardware. Insufficient software tuning. Failing to define a troubleshooting plan. This includes having known responses to performance issues, and production run books for error or failover situations. Conclusion The best practices for performance testing include proper definition and planning, scheduling time upfront, remaining agile in your approach, testing early and often, getting as much of the organization involved as possible, testing all components together and separately endto-end, considering failure scenarios, measuring thoroughly, and reporting results properly. Additionally, remember to avoid throwing software over the wall to a separate testing organization, and ensure that your QA platforms match production as closely as possible. As with any profession, your efforts are only as good as the tools you use. Be sure to include a mix of manual and automated testing across all systems. Orasi and HP offer performance testing tools and services to help you get started and continually refine your testing process as you move forward.
7 For more information, contact Orasi today About Orasi Orasi is a leading provider of software, support, training, and consulting services using market-leading test management, test automation, enterprise testing, environment hosting, and mobile testing technology. For over 12 years, Orasi has consistently helped customers successfully implement and integrate software testing environments to reduce the cost and risk of software failures. Orasi offers proven solutions for the installation, implementation, configuration, and use of performance testing technologies and best practices. An HP Software Platinum Partner and authorized Support partner, Orasi resells HP s test management and automation solutions, is a leading provider of software testing services, and offers mobile testing, application security, and cloud-based testing and monitoring solutions. Orasi was HP Software s US Solution Partner of the Year in 2011 and 2013, and was Support Partner of the Year for 2009, 2011, and Sign up for updates Share with colleagues Rate this document Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Trademark acknowledgements if needed. This is an HP Indigo digital print.
Service Virtualization: Reduce the time and cost to develop and test modern, composite applications Business white paper Table of contents Why you need service virtualization 3 The challenges of composite
Performance Testing Definition: Performance Testing Performance testing is the process of determining the speed or effectiveness of a computer, network, software program or device. This process can involve
Performance testing in Agile environments Deliver quality software in less time Business white paper Table of contents Executive summary... 2 Why Agile? And, why now?... 2 Incorporating performance testing
Business white paper Seven best practices for business-ready applications Table of contents 3 Executive summary 3 Introduction 3 Enterprise-level best practices 5 Project-level best practices 7 Build better
Rapid Bottleneck Identification A Better Way to do Load Testing An Oracle White Paper June 2009 Rapid Bottleneck Identification A Better Way to do Load Testing. RBI combines a comprehensive understanding
Technical white paper A closer look at HP LoadRunner software Table of contents Sizing up the system 2 The limits of manual testing 2 A new take on testing: the HP LoadRunner solution 3 The HP LoadRunner
Service Virtualization A faster, more efficient and less costly way to develop and test enterprise-class applications As cloud and mobile computing gain rapid acceptance, IT departments are expected to
An Oracle White Paper February 2010 Rapid Bottleneck Identification - A Better Way to do Load Testing Introduction You re ready to launch a critical Web application. Ensuring good application performance
Technical white paper Automated testing and continuous integration Build and test your software at the same time Table of contents Introduction 2 Who should read this document? 2 Build managers 2 Developers
Data sheet HP Intelligent Management Center Standard Software Platform Key features Highly flexible and scalable deployment Powerful administration control Rich resource management Detailed performance
Business white paper Four steps to better application management and deployment Table of contents 3 Executive summary 3 The challenges of manually managing application operations 4 How complexity plays
the limits of your infrastructure. How to get the most out of virtualization Business white paper Table of contents Executive summary...4 The benefits of virtualization?...4 How people and processes add
SAP Mobile Platform SAP Mobile Platform Cloud Performance and Scalability Table of Contents 4 Performance Test Configurations The Test Plans 7 Performance Test Results Single-User Test Results Multiuser
HP End User Management software Enables real-time visibility into application performance and availability Solution brief Figure 1 HP End User Management lets you proactively identify application performance
Maximize virtual desktop ROI without risking service levels HP 3PAR storage technologies for desktop virtualization Solution brief Desktop virtualization pushes the cost, efficiency, and management benefits
Business white paper Performance testing for mobile applications Will your mobile application fail your users? Table of contents 3 Introduction 3 The mobile application wave 4 A new set of challenges 5
Business white paper Best practices for implementing automated functional testing solutions Table of contents Contents 3 Introduction 3 Functional testing versus unit testing 4 The pros and cons of manual
HP CLOUDSYSTEM A single platform for private, public, and hybrid clouds Simply the most complete cloud system for enterprises and service providers Solution brief It s a fact of life: cloud computing is
Data sheet HP Intelligent Management Center Basic WLAN Manager Software Platform Key features Intuitive, easy-to-use interface Unified wired and wireless network management Range of topology management
White paper Private cloud computing Increase agility and reduce cost Increasing agility and reducing cost with cloud computing Table of contents 2 A time of big IT trends 3 As if IT needed more challenges
Oracle Grid Computing Achieved Service-oriented HP Adaptive Infrastructure offerings for Oracle Grid Computing and SOA Technology for better business outcomes Evolution of the next generation data center
Data sheet HP Intelligent Management Center Standard Software Platform Key features Highly flexible and scalable deployment Powerful administration control Rich resource management Detailed performance
Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability Table of contents Introduction.......................................................2 Step 1:
Automate performance testing to predict system behaviour and improve application performance Business white paper Table of contents Executive summary... 3 What is performance testing?... 4 Why automate
Technical white paper Bridge Development and Operations for faster delivery of applications HP Continuous Delivery Automation software Table of contents Application lifecycle in the current business scenario
Technical white paper Enterprise Business Service Management Key steps and components of a successful solution Table of contents Executive Summary... 2 Setting the goal establishing an IT initiative...
HP Private Cloud Solutions Get on the fast track to on-demand shared services delivery Solution brief Quickly moving toward the cloud More and more organizations are realizing the benefits of a dramatically
Data sheet HP Intelligent Management Center Enterprise Software Platform Key features Highly flexible, scalable deployment models Powerful administration control Rich resource management Detailed performance
Technical white paper Getting started with API testing Test all layers of your composite applications, not just the GUI Table of contents Executive summary... 3 Introduction... 3 Who should read this document?...
Agile and the cloud: why automating application deployment matters Business white paper Executive summary Agile development methodologies and the cloud computing model have increased the pace of deployment
HP Application Security Center Web application security across the application lifecycle Solution brief HP Application Security Center helps security professionals, quality assurance (QA) specialists and
Taming Microsoft Environments with HP SiteScope Exchange and Active Directory Solution Templates Quick and economical troubleshooting and performance management for Microsoft environments Business white
Rapid Bottleneck Identification TM A Better Way to Load Test WHITEPAPER You re getting ready to launch or upgrade a critical Web application. Quality is crucial, but time is short. How can you make the
HP OpenView Service Desk Process Insight 2.10 software Data sheet HP OpenView Service Desk Process Insight software provides real-time visibility into the ITIL processes managed by your HP OpenView Service
Data sheet HP Vertica OnDemand Enterprise-class Big Data analytics in the cloud Enterprise-class Big Data analytics for any size organization Vertica OnDemand Organizations today are experiencing a greater
Business white paper Manage projects effectively HP Project and Portfolio Management Center and HP Agile Manager Table of contents 3 Executive summary 3 The HP Solution Invest in what matters most then
Application performance testing in VMware environments Identify and control performance and capacity risks Table of contents Introduction... 2 Performance and capacity planning techniques... 2 Rough sizing
HP OpenView Smart Plug-in for Microsoft Exchange Data sheet Email is no longer just a productivity application - it is a company s lifeline. When email slows down or stops altogether, the business loses
SOFTWARE PERFORMANCE TESTING SERVICE Service Definition GTS s performance testing services allows customers to reduce the risk of poor application performance. This is done by performance testing applications
HP OpenView Smart Plug-in for Active Directory Data sheet As the primary enterprise directory service in Windows environments, the criticality of monitoring and maintaining Microsoft Active Directory cannot
HP SiteScope For the Windows, Solaris, and Linux operating systems Software Version: 11.23 HP Vertica Solution Template Best Practices Document Release Date: December 2013 Software Release Date: December
Application Performance Testing Basics ABSTRACT Todays the web is playing a critical role in all the business domains such as entertainment, finance, healthcare etc. It is much important to ensure hassle-free
HYBRID APPLICATION PERFORMANCE TESTING Managing the performance of today s mobile, web and cloud applications requires a proactive, multi-faceted approach to performance testing. This paper is sponsored
HP Software Professional Services Increase the value of IT with HP s end-to-end consulting Brochure Our IT Service Management project with HP has an 18-month payback and now has given us a better understanding
Mobile Application Testing Whitepaper Author: Scott Aziz Date: June 1, 2012 This whitepaper outlines the critical areas of testing needed to certify mobile enterprise applications Best practices from UST
ABSTRACT Crystal clear requirements before starting an activity are always helpful in achieving the desired goals. Achieving desired results are quite difficult when there is vague or incomplete information
NOUS INFOSYSTEMS LEVERAGING INTELLECT Mobile Performance Testing Approaches and Challenges ABSTRACT Mobile devices are playing a key role in daily business functions as mobile devices are adopted by most
Proactive Performance Management for Enterprise Databases Abstract DBAs today need to do more than react to performance issues; they must be proactive in their database management activities. Proactive
Integration Maturity Model Capability #5: Infrastructure and Operations How improving integration supplies greater agility, cost savings, and revenue opportunity TAKE THE INTEGRATION MATURITY SELFASSESSMENT
HP Serviceguard Cluster Configuration for Partitioned Systems July 2005 Abstract...2 Partition configurations...3 Serviceguard design assumptions...4 Hardware redundancy...4 Cluster membership protocol...4
Technical white paper Protect Microsoft Exchange databases, achieve long-term data retention HP StoreOnce Backup systems, HP StoreOnce Catalyst, and Symantec NetBackup OpenStorage Table of contents Introduction...
Brochure Update your Windows HP Technology Services for Microsoft End of Support (EOS) and Microsoft Migrations Stabilize and secure your infrastructure Microsoft will end support for Windows Server 2003/R2
APPLICATION PERFORMANCE MONITORING PRACTICAL WAYS TO MONITOR THE END USER EXPERIENCE WHITE PAPER Performance of key applications is a critical item to monitor in many IT environments where users depend
HP Client Manager 6.1 Introduction... 2 New Features in HPCM 6.1... 4 Understanding how HPCM works... 6 Extensive reporting capability... 7 HPCM in operation... 7 Client inventory... 7 Health monitoring...
HP Client Manager 6.2 Introduction... 2 New Features in HPCM 6.2... 4 Understanding how HPCM works... 5 Extensive reporting capability... 5 HPCM in operation... 6 Client inventory... 6 Health monitoring...
Data sheet HP Intelligent Management Center Enterprise Software Platform Key features Highly flexible and scalable deployment options Powerful administration control Rich resource management Detailed performance
An Oracle White Paper November 2010 Oracle Real Application Clusters One Node: The Always On Single-Instance Database Executive Summary... 1 Oracle Real Application Clusters One Node Overview... 1 Always
HP SiteScope software When you can see availability and performance, you can improve it. Improve the availability and performance of your IT environment HP SiteScope software helps you to agentlessly monitor
SAP Brief SAP Extensions SAP Service Virtualization by HP Objectives Faster Development Through Virtualization Remove the obstacles that slow down application delivery Remove the obstacles that slow down
SOLUTION BRIEF Service Assurance Solutions from CA Technologies for VCE Vblock Systems can you improve service quality and availability while optimizing operations on VCE Vblock Systems? agility made possible
Automated testing for Mobility New age applications require New age Mobility solutions Executive Summary Today, mobile phone has transformed from its former role as a mere medium of communication to that
HP Client Automation software Starter and Standard Editions Data sheet Managing client devices effectively and efficiently is a mission-critical function for today s businesses. However, that challenge
For your network: HP Network Support Combined with Cisco Services The primary goal of this service is to maintain reliable network performance and availability, and thereby protect your network investment.
HP CLOUDSYSTEM An integrated platform for private, public, and hybrid clouds The industry s most complete cloud system for enterprises and service providers Solution brief It s a fact of life: cloud computing
SCALEnow. HP Cloud Services Enablement portfolio for communications service providers: Compute Services Solution brief HP Cloud Services Enablement (HP CSE) for infrastructure as a service (IaaS) enables
Solution brief HP solutions for IT service management Integration, automation, and the power of self-service IT Make IT indispensable to the business. Turn IT staff into efficient, cost-cutting rock stars.
Managed Desktop Services End-user workplace management solutions for your distributed-client computing environment HP Services Managing your distributed-client computing environment If your IT organization
WHITE PAPER Five Steps to Better Application Monitoring and Troubleshooting There is no doubt that application monitoring and troubleshooting will evolve with the shift to modern applications. The only
HP and Business Objects Transforming information into intelligence 1 Empowering your organization Intelligence: the ability to acquire and apply knowledge. For businesses today, gaining intelligence means
Test Run Analysis Interpretation (AI) Made Easy with OpenLoad OpenDemand Systems, Inc. Abstract / Executive Summary As Web applications and services become more complex, it becomes increasingly difficult
SAP database backup and restore solutions for HP StorageWorks Enterprise Virtual Array using HP Data Protector 6.1 software Table of contents Executive summary... 2 Solution overview... 2 Objectives...
OpenDemand Systems, Inc. Load Testing and Monitoring Web Applications in a Windows Environment Introduction An often overlooked step in the development and deployment of Web applications on the Windows
Reconciliation and best practices in a configuration management system White paper Table of contents Introduction... 3 A reconciliation analogy: automobile manufacturing assembly... 3 Conflict resolution...
Process, page 1 Getting Started, page 2 Collected Data Categorization, page 3 Capacity Utilization, page 6 Process Figure 1: Process You should make changes to an existing Unified ICM/Unified CCE deployment
101-301 Guide to Mobile Testing Perfecto Mobile & Toronto Association of System and Software Eran Kinsbruner & Joe Larizza 2014 What To Do? Great News Your first Mobile Project has arrived! You have been
Course Outline HP Project and Portfolio Management 9.3 Adoption Readiness Tool (ART) HP PROJECT, PORTFOLIO, AND PROGRAM MANAGEMENT (PPM) 9.3 Course Description This PPM 9.3 learning solution offers end
HP Universal CMDB Software Version: 10.22 Data Flow Management Best Practices Document Release Date: December 2015 Software Release Date: December 2015 Legal Notices Warranty The only warranties for HP
HP OpenView Application Readiness Program Data sheet The HP OpenView Application Readiness Program enables implementation partners (HP consulting, value-added resellers and system integrators) to leverage
hp storage february 2003 technical white paper empowering business agility with hp network storage services: defining an adaptive storage reference architecture table of contents introduction 2 evolution
ProCurve Mobility Manager 1.0, a plug-in module for the ProCurve Manager Plus platform, provides a simple yet powerful tool to centrally configure, update, monitor, and troubleshoot ProCurve access points.
Technical white paper Using HP StoreOnce Backup Systems for NDMP backups with Symantec NetBackup Table of contents Executive summary... 2 Introduction... 2 What is NDMP?... 2 Technology overview... 3 HP
Leverage Vblock Systems for Esri's ArcGIS System Table of Contents www.vce.com LEVERAGE VBLOCK SYSTEMS FOR Esri s ArcGIS SYSTEM August 2012 1 Contents Executive summary...3 The challenge...3 The solution...3
SAP Brief SAP Customer Relationship Management SAP Contact Center Objectives Use Your Contact Center to Build a Better Customer Experience Engage your customers across all points of contact Engage your
8 Common Myths About Performance Testing in Production Don t Let These Misconceptions Keep You From Production Testing White Paper Table of Contents Myth #1: Production testing = live testing... 1 Myth
Performance Prediction, Sizing and Capacity Planning for Distributed E-Commerce Applications by Samuel D. Kounev (email@example.com) Information Technology Transfer Office Abstract Modern e-commerce