Identifying Application Performance Risk

Size: px
Start display at page:

Download "Identifying Application Performance Risk"

Transcription

1 Identifying Application Performance Risk Performance Engineering COLLABORATIVE WHITEPAPER SERIES

2 COLLABORATIVE WHITE PAPER SERIES: Identifying Application Performance Risk Under what conditions will an application require a performance test? Not all applications require performance testing, and the same application may not require repeated performance testing for every release. The selection process for performance testing frequency must consider user population, application type, technology, changes to features and function, and how nonfunctional requirements are monitored in the software development life cycle (SDLC). I. Introduction A typical enterprise has thousands of applications. In a business unit, there can be several hundred applications. As the business continues to evolve and change, so will the applications evolve and change to support the business needs. The changes made to the application may increase the risk to performance, scalability, or stability. Depending on the business s tolerance for disruption, these changes may require some level of performance and scalability testing to verify the application can still process the accepted business volumes while staying within service level agreements. These application changes are typically scheduled on a release calendar. Customer facing applications should be considered critical to the business, while internal facing applications may be less critical. However, what if the internal application is supporting the executive level of the company and provides key information for decision-making? Some enterprises believe inherently that performance and scalability testing are required, while others may leave the decision to the business units. Enabling the enterprise for performance engineering requires an investment. This investment is considered to be an indirect investment, as it may not be immediately linked to a revenue generating process. The value of the investment in performance engineering can be quantified. For example, when performance engineering recommends design changes allowing a revenuegenerating website to process more orders, the return on investment is clear. In a large enterprise, performance engineering resources are often in short supply, and budgets are generally under constant pressure. This leads IT and business decisionmakers to ask certain questions, such as: What guidelines can you use to help allocate these resources across the project portfolio? How can you make sure you have not missed an application that required performance testing, and how can you make sure you re not testing the wrong applications? Are you sure the results from performance are accurate and allow management to make informed decisions? 2

3 II. What factors should you consider when selecting an application for performance testing? Not all applications require performance testing, and the same application may not require repeated performance testing for every release. The risk factors you should use to evaluate your application include:. User population The people who use your application are critical to the decision. Questions may include: Who are the users of your applications, how many concurrent users are there, and is the number of users increasing? Are the users purchasing products or services from your business? Are they external or internal users? How easy is to for your user base to switch to a competitor if you website is not performing well? How is the application accessed? Access types may include browsers (both desktop and mobile), call center applications (both client server, legacy, and web), and even internal voice recognition (IVR) clients. The amount of transactions for each access type and application must be considered when defining the workload for the user population. 2. Application type The application type itself can dominate the risk factors. For instance, questions to ask may include: Is the application an online retail website? Is there both a desktop and mobile website/mobile app? Typically a revenue generating website requires a performance test for every release. Is the application a key component in the enterprise architecture that other applications use? If so, this is deemed a critical application and may require performance testing for every release. Is the application a batch process with a strict window of processing? How critical is this application to the business, and how is it rated? 3. Application technology The state of the application technology stack can be a significant risk factor. Generally, the technology platform does not change from release to release. If the underlying technology is stable and is well known to the application development team, a performance test might not be required. However, if a new technology is being introduced or replacing one of the tiers, there may be a great risk and thus testing is required. Likewise, a significant upgrade to a vendor product could warrant performance testing. It is important to consider the scope and impact of changes to any key components. 4. Application features and functions The amount of modified code or new code in an application can create new performance risks. Understanding the impact of the changes is critical to determining if performance testing is required. Potential analysis questions may include: How has the new or modified business feature changed the behavior of the application? Were the changes extensive and across the client, application services, and database? What percentage of the code was impacted by the new or modified services? 5. Software development process Analysts may consider questions such as: Does the SDLC track non-functional requirements during the lifecycle? How are those non-functional requirements communicated from the requirements, design, development, testing and deployment teams? Have key business transactions or services been identified with stringent response time requirements, or strict throughput requirements? What architectural risk analysis, prototyping, or other types of testing have been done throughout the lifecycle that may mitigate the need for formal performance and scalability testing efforts? 6. Production issues with the last release Recent history can be an indicator for the future. If the application went into production and the last release had performance, scalability, or stability issues, then it may require a closer look at the application to determine if the issues have been truly mitigated. Otherwise, performance testing is required. Similarly, resource utilization patterns and trends may be used to assess the need for further risk mitigation. 3

4 COLLABORATIVE WHITE PAPER SERIES: Identifying Application Performance Risk 7. The schedule of performance tests Applications will undergo performance testing at different times during their lifetime. The application can be tested before it is ever released into production; performance testing can be scheduled for every major release; or performance testing can be scheduled based on the extent of the application s changes. III. Risk factors elaborated. User population The key information to capture is: How many people use the application on average and during peak time? Who uses this application? What is the behavior of the users workload? In an analysis, we may ask: What would be the business impact if this application exhibited performance problems? Is your business in a highly competitive market, where dissatisfied users can switch to you competitor? For instance, if the response time doubled or tripled from normal, how would the user experience degrade, and what would be the financial impact of service calls and shopping cart abandonment? How long would this condition be tolerated and under what conditions would it be tolerated? The matrices shown below may be used to identify and assess potential performance engineering risks, using a simple -2-3 scoring system: User Population Characteristics Figure : Figure title Business internal: Senior management or board level, enterprise-wide Business external Consumers Average number of concurrent users Peak number of concurrent users relative to normal business load based on month-end or periodic event that occurs regularly Rate of user population growth Flash or sudden spikes in concurrent users, above and beyond your current peaking factor: Based on a new business model of broadcasting messages to your client base telling them to all come to your website Currently a novelty event for many businesses, not accounted for in the system design Eventually folded into the traditional peaking factor 2 2 : Thousands 2: Hundreds Risk Level : requires a performance check 2: depends on other extenuating factors 3: does not require a performance test : Application peak TPS is more than five times the typical TPS for the business : If population growth doubles in less than nine months : A significant increase is expected due to the business winning a new contract or large client 3: No user population growth : Upcoming flash or spike events will add to existing application workload 4

5 If you have a large number of consumers that is growing, you would require performance and scalability testing. For example, flash events are a key risk area because they are occurring more frequently for businesses on application platforms that were neither designed nor tested for sudden workload bursts. 2. Application type Most businesses will rate their applications based on criticality to the business. The rating is typically for availability and recovery time. Ratings can range from high availability (almost no down time) rated A, to minutes of down time rated B, to hours rated C, to days rated D. These ratings factor into your selection criteria. Should a C rated application be performance tested? Under specific conditions it should; for instance, it is a major application upgrade or if it is chronically slow for the users to the point that it is interfering with their workflow and productivity. Application Characteristics Online website retailing (may include both desktop browser website and mobile website/app) Financial transactions (brokerage, 40K, etc.) Corporate support Customer portal: This is where the customer can maintain their account information, view their history of transactions, or check the status of an order Business portal: This is where the business partner can maintain their account information, view their history of transactions, or check the status of an order. It could be for an insurance agency with a large number of independent agents Business intelligence and analytics: Large volumes of data analysis, tight reporting deadlines or regulatory filings Date hub or integration hub: A key component where many applications are dependent upon Informational or marketing: User experience is important if this is for consumers Batch processing: Constrained processing windows Risk Level : requires a performance check 2: depends on other extenuating factors 3: does not require a performance test : Enterprise-wide use 2 or 3: Group-wide : Open enrollment is a key business process that occurs once per year : Most customer facing systems require some level of performance testing, the enduser response time is critical to how your customers view your business : The business partner is responsible for driving revenue to your business 2: The business partner provides a service to your business that is part of a workflow : Service level penalties if late : First mover advantage, business, competitive edge 2 or 3: Weekly, monthly, quarterly reporting 2 2 or 3 Rating depends on extent of penalties for violating SLA s Document management 5 : Timeliness of documents is critically important, e.g. news agency or day-trading investment advisor 2 or 3: Otherwise

6 volumes of data analysis, tight reporting deadlines or regulatory filings competitive edge 2 or 3: Weekly, monthly, quarterly reporting COLLABORATIVE WHITE PAPER Date SERIES: hub or integration hub: A key Identifying Application component Performance where Riskmany applications are dependent upon Informational or marketing: User experience is important if this is for consumers Batch processing: Constrained processing windows Document management Imaging systems: These are typically scanning systems that are used in mail order processing applications, or where signature is required. They are part of an essential workflow A core Enterprise-wide component, used by many other applications 2 2 or 3 Rating depends on extent of penalties for violating SLA s : Timeliness of documents is critically important, e.g. news agency or day-trading investment advisor 2 or 3: Otherwise : Part of a time critical workflow. The documents must be scanned quickly and made available quickly or 2 3. Application technology When you are using unfamiliar technologies, you need proactive performance management. In general, the application technology stack does not change for every release. Nevertheless, it is important to consider the cumulative effect of small changes over time with respect to online features and batch processes. Technology Characteristics Risk Level : requires a performance check 2: depends on other extenuating factors 3: does not require a performance test Well-known and stable technology stack Accessed via more than one client presentation tier (i.e., classic browser website, mobile website, web app) New technology for a key component: For instance replacing the WebSphere application server with Jboss, or replacing a C++ batch process with Java batch process Significant technology upgrade: For instance, upgrading the WebSphere application server, upgrading the Database to a new major release. The key here is to identify impact and determine the proper level of testing Significant application upgrade: This is typically for a third party vendor who made significant architecture changes, particularly if the new version of the application has not been demonstrated at full business volume New component added to the application: The application has new component that will become part of most of the key business transactions 3 or 2: It is critical to understand the number of transactions that use this component and the nature of the transactions 6

7 4. Application features and functions This section considers the magnitude of the changes made to the application for this release cycle. The goal is to assess the risk the new change poses to the performance, stability, and scalability of the application. Where new database tables were added or existing ones modified, did this impact the database partitioning scheme? On the application server, were new services introduced, or existing ones modified? Will this impact the application server s scalability profile? Did the web client change to introduce asynchronous web server requests? How will this impact the transaction arrival rate to the web server and application servers? Has this application experienced performance or stability issues in the recent past? Is there a history of performance issues after a new release? Is the application sensitive to a sudden increase in user load or transactions per second? Under what conditions does this occur? Impact Risk Level : requires a performance check 2: depends on other extenuating factors 3: does not require a performance test Web client Web Server Application server Database server or 2: Introducing asynchronous Web server requests : New plug-ins or new connections to application servers : Services added or changed with suspected performance impact : Impact to database partitioning scheme /2: New tables added to high volume transaction : New requirements for keeping and accessing historical information All tiers impacted by change Percentage of overall code changes or new code developed. For instance, if there are 00,000 lines of code, what percentage was modified? Batch processing where new jobs were introduced, was the concurrency model impacted? Reporting server : More than 5% 2: 5%-to 5% : Concurrency model impacted : New tools providing ad hoc and wider or deeper queries 7

8 COLLABORATIVE WHITE PAPER SERIES: Identifying Application Performance Risk 5. Software development process The software development process should identify non-functional requirements, such as performance, scalability, maintainability, usability, and others. During the requirements phase, any key business use cases that have response time requirements must be identified and tracked through the process. Also, key business use cases for batch process throughput should be identified. In general, activities that support performance engineering should be conducted throughout the entire lifecycle, and they should be defined in a standards document so that assessment of performance risk can be understood. Coordinated Performance tests: The performance team will lay out a plan to coordinate the goals and test cases for performance in architecture proof-of-concepts (POCs), unit testing, functional quality assurance (QA), and performance testing. The development/build phase has a unit testing activity, the functional QA testing phase will have a performance test activity, and the performance testing process will require the outcome of those two activities. Early in the lifecycle, an architectural POC may be required, and it should include a set of performance, stability, and scalability tests. The performance team can unify the strategy of introducing performance testing into the other testing activities. The performance team can introduce micro performance tests into the other phases of the SDLC where they already have testing activities, for architecture/design, development, and QA. 6. Recent release and production issues The recent past can be an indicator of the future. If performance, scalability, or stability issues arose from the last release of the application, performance testing is needed on the next release. In some instances, the application development team may have a poor track record for managing application performance, resulting in frequent performance issues. The performance team must see the application performance management reports from the production operations team. This will allow them to determine the nature of the production issues related to performance. It will allow them to build a historical profile for the production behavior of the application. This linkage of the performance team to the operations team provides a feedback loop to the performance team. This information will allow the team to adjust the performance test scenarios based on changing workloads and new or modified business functions. 7. The schedule of performance tests Applications will undergo performance testing at different times during their lifetime. The application can be tested before it is ever released into production; performance testing can be scheduled for every major release; or performance testing can be scheduled based on the extent of the application s changes. a. Project-based schedule: Project-based performance tests can be driven by the nature of the change to the application and technical architecture, rather than by the profile of the user population. This approach is appropriate if the user population is not growing, but the technology is changing. If the application uses a vendor product as a key part of the workflow, and the vendor has introduced a new major release, the level of risk may be high. Before agreeing to forgo in-house performance testing, the application owners must be more than satisfied that the vendor had done proper performance testing. Once the new version has been verified not to harm the response time or throughput, the performance test project is over. Oftentimes, the application is custom-developed by the IT organization for the business. The custom-developed application may be in need of technology upgrade or replacement. This would require a project-based approach to performance testing, possibly coupled with a releasebased approach to the schedule. The custom-developed application may be scheduled for iterative deployment across different release cycles. The risk of the new technology or upgrade must be understood. What did the vendor or IT development team change? You must understand how the changes impact the users workflow. You must measure the before and 8

9 after performance of the system. In order to do a proper comparison, you must understand the key business transactions response times and the batch process throughput of the existing version. b. Release-based schedule Release-based tests are recurring and are scheduled for every release. Since the application has been deemed critical, it requires a baseline test, performance validation, or performance characterization for every release. The type of test may change from release to release due to the nature of the change. The test scenarios can change based on observations from the production environment. Likewise, a changing production workload or changing user behavior will require the performance test cases to change. The performance team must have a link to the production application-monitoring and capacity-planning team. The user population could be increasing, and the business may have introduced new features or functions that have changed since the last baseline test. c. Production support schedule Production support test cases are required to help triage production issues. When issues arise due to performance, scalability, or stability, the root-cause must be found, and one or more solutions must be defined. These tests are disruptive to the planned performance testing schedule and environment. Oftentimes, the performance team has the only properly sized environment to reproduce the production issue. Release and configuration management become critical in this situation. You need mature processes to be able to suspend the current performance testing schedule and execute on the production issues. These test cases are created on-demand and adjusted as new information is uncovered. The tests are created to either locate the root-cause or to help define a solution. IV. Conclusion This approach will allow you to allocate the right resources to the right projects and applications. Performance engineering and performance testing should not be done in isolation or behind closed doors. The selection process and the risks must be visible, and there must be communication between the performance team and the business, ultimately to answer the questions of why are we testing? and what are we getting from those tests? Establish a transparent selection process, as some application owners budget for performance testing and others do not. This selection process will allow you to work with the applications owners who do not budget for performance testing, providing them a structured process for identifying risks to the business as a basis for selecting the applications to include in performance testing. Is the current vendor telling your business they must upgrade? Often software products are selected by the business because they provide a set of key business functions, while little attention is paid to the non-functional requirements of the business. This process will allow you to assess the risk introduced by a vendor solution, either during the selection process or with an established vendor who wants you to upgrade to the new version. This approach provides the criteria for defining the performance risk or scalability risk the application may or may not present to the business. For instance, you should always be looking out for business initiatives that introduce a new extreme workload, such as a new marketing campaign that will encourage customers to login to see the new product. Then in response, you must design and execute a scalability test to verify the behavior of the application under the anticipated flash-type workload. Most importantly, this approach provides visibility into the performance testing risk-based selection process. This approach allows you to communicate the risk to business and other key stakeholders by showing the connection between the business risk and the testing plan to reduce that risk. Now that you have identified the applications that should be performance tested, what types of tests should you be designing and executing? See the next white paper from Collaborative Consulting on the different categories of performance tests. 9

10 COLLABORATIVE WHITE PAPER SERIES: Identifying Application Performance Risk Collaborative Consulting is a leading information technology services firm dedicated to helping our clients achieve business advantage through the use of strategy and technology. We deliver a comprehensive set of solutions across multiple industries, with a focus on business process and program management, information management, software solutions, and software performance and quality. We also have a set of offerings specific to the life sciences and financial services industries. Our unique model offers both onsite management and IT consulting as well as U.S.-based remote solution delivery. To learn more about Collaborative, please visit our website at us at sales@collaborative.com, or contact us at Copyright 204 Collaborative Consulting, LLC. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. WP.24.06

Consequences of Poorly Performing Software Systems

Consequences of Poorly Performing Software Systems Consequences of Poorly Performing Software Systems COLLABORATIVE WHITEPAPER SERIES Poorly performing software systems can have significant consequences to an organization, well beyond the costs of fixing

More information

Proactive Performance Management for Enterprise Databases

Proactive Performance Management for Enterprise Databases Proactive Performance Management for Enterprise Databases Abstract DBAs today need to do more than react to performance issues; they must be proactive in their database management activities. Proactive

More information

Migrating Within the Cloud, SaaS to SaaS

Migrating Within the Cloud, SaaS to SaaS Migrating Within the Cloud, SaaS to SaaS A Real World Experience COLLABORATIVE WHITEPAPER SERIES COLLABORATIVE WHITE PAPER SERIES: Migrating Within the Cloud, SaaS to SaaS How do you know when a technology

More information

iworks healthcare Managed IT services

iworks healthcare Managed IT services iworks healthcare Managed IT services SunGard s iworks HEALTHCARE: Managed IT Services Organizations around the globe face an array of critical issues in today s business environment. Economic conditions

More information

Migrating Applications to the Cloud: Assessing Performance and Response Time Requirements

Migrating Applications to the Cloud: Assessing Performance and Response Time Requirements Migrating Applications to the Cloud: Assessing Performance and Response Time Requirements October, 2014 Contents Acknowledgements... 3 Considerations and Motivations... 4 Migration Roadmap... 6 Step 1

More information

Monitoring Best Practices for COMMERCE

Monitoring Best Practices for COMMERCE Monitoring Best Practices for COMMERCE OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems

More information

Monitoring Best Practices for

Monitoring Best Practices for Monitoring Best Practices for OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems like Magento,

More information

Openbravo Services for Partners

Openbravo Services for Partners Openbravo for Partners A pure channel organization devoted to Partner success # Devoted to Partner Success Openbravo for Partners are especially designed to accelerate partners practice towards business

More information

WHAT WE NEED TO START THE PERFORMANCE TESTING?

WHAT WE NEED TO START THE PERFORMANCE TESTING? ABSTRACT Crystal clear requirements before starting an activity are always helpful in achieving the desired goals. Achieving desired results are quite difficult when there is vague or incomplete information

More information

Application Performance Testing Basics

Application Performance Testing Basics Application Performance Testing Basics ABSTRACT Todays the web is playing a critical role in all the business domains such as entertainment, finance, healthcare etc. It is much important to ensure hassle-free

More information

Increasing Business Efficiency and Agility for ATGbased. Systems. the business challenge: upgrading the development pipeline

Increasing Business Efficiency and Agility for ATGbased. Systems. the business challenge: upgrading the development pipeline Increasing Business Efficiency and Agility for ATGbased ecommerce Systems This case study follows a Tier 1 retailer migrating to an ATG-based ecommerce platform and upgrading its software development process

More information

Cisco Unified Communications and Collaboration technology is changing the way we go about the business of the University.

Cisco Unified Communications and Collaboration technology is changing the way we go about the business of the University. Data Sheet Cisco Optimization s Optimize Your Solution using Cisco Expertise and Leading Practices Optimizing Your Business Architecture Today, enabling business innovation and agility is about being able

More information

Master the Might of the Hybrid Cloud

Master the Might of the Hybrid Cloud Reach for the Sky Master the Might of the Hybrid Cloud WHITE PAPER As an IT decision maker at a global enterprise, you face unique challenges in managing a complex infrastructure with varied resources

More information

The Top 10 Reasons Why You Need Synthetic Monitoring

The Top 10 Reasons Why You Need Synthetic Monitoring WHITE PAPER: WEB PERFORMANCE MANAGEMENT The Top 10 Reasons Why You Need Synthetic Monitoring A complete view of the application delivery chain (ADC) is required to optimize the performance and availability

More information

White Paper. How to Achieve Best-in-Class Performance Monitoring for Distributed Java Applications

White Paper. How to Achieve Best-in-Class Performance Monitoring for Distributed Java Applications White Paper How to Achieve Best-in-Class Performance Monitoring for Distributed Java Applications July / 2012 Introduction Critical Java business applications have been deployed for some time. However,

More information

Ready, Set, Go! or Slow?

Ready, Set, Go! or Slow? Leveraging the Cloud for On-Demand Performance Testing COLLABORATIVE WHITEPAPER SERIES New user behaviors that businesses are introducing to their web sites are driving more volume than ever before. Product

More information

How To Test For Elulla

How To Test For Elulla EQUELLA Whitepaper Performance Testing Carl Hoffmann Senior Technical Consultant Contents 1 EQUELLA Performance Testing 3 1.1 Introduction 3 1.2 Overview of performance testing 3 2 Why do performance testing?

More information

From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development

From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development Introduction Today s developers are under constant pressure to launch killer apps and release enhancements as

More information

Business Transformation for Application Providers

Business Transformation for Application Providers E SB DE CIS IO N GUID E Business Transformation for Application Providers 10 Questions to Ask Before Selecting an Enterprise Service Bus 10 Questions to Ask Before Selecting an Enterprise Service Bus InterSystems

More information

Oracle s Primavera P6 Enterprise Project Portfolio Management

Oracle s Primavera P6 Enterprise Project Portfolio Management Oracle s Primavera P6 Enterprise Project Portfolio Management Oracle s Primavera P6 Enterprise Project Portfolio Management is the most powerful, robust and easy-to-use solution for prioritizing, planning,

More information

4 Steps to Surviving Big Data

4 Steps to Surviving Big Data 4 Steps to Surviving Big Data As big data projects slam network performance, network managers must be ready for the challenges they bring. There s No Doubt that Big Data is a Big Deal to Companies Today

More information

Business Intelligence & Data Warehouse Consulting

Business Intelligence & Data Warehouse Consulting Transforming Raw Data into Business Results In the rapid pace of today's business environment, businesses must be able to adapt to changing customer needs and quickly refocus resources to meet market demand.

More information

TIBCO Live Datamart: Push-Based Real-Time Analytics

TIBCO Live Datamart: Push-Based Real-Time Analytics TIBCO Live Datamart: Push-Based Real-Time Analytics ABSTRACT TIBCO Live Datamart is a new approach to real-time analytics and data warehousing for environments where large volumes of data require a management

More information

Crossing the DevOps Chasm

Crossing the DevOps Chasm SOLUTION BRIEF Application Delivery Solutions from CA Technologies Crossing the DevOps Chasm Can improved collaboration and automation between Development and IT Operations deliver business value more

More information

I D C M A R K E T S P O T L I G H T. P r i va t e a n d H yb r i d C l o u d s E n a b l e New L e ve l s o f B u s i n e s s and IT Collaboration

I D C M A R K E T S P O T L I G H T. P r i va t e a n d H yb r i d C l o u d s E n a b l e New L e ve l s o f B u s i n e s s and IT Collaboration I D C M A R K E T S P O T L I G H T P r i va t e a n d H yb r i d C l o u d s E n a b l e New L e ve l s o f B u s i n e s s and IT Collaboration September 2013 Adapted from IDC Maturity Model: Cloud A

More information

An Oracle White Paper June, 2013. Enterprise Manager 12c Cloud Control Application Performance Management

An Oracle White Paper June, 2013. Enterprise Manager 12c Cloud Control Application Performance Management An Oracle White Paper June, 2013 Enterprise Manager 12c Cloud Control Executive Overview... 2 Introduction... 2 Business Application Performance Monitoring... 3 Business Application... 4 User Experience

More information

Building a Converged Infrastructure with Self-Service Automation

Building a Converged Infrastructure with Self-Service Automation Building a Converged Infrastructure with Self-Service Automation Private, Community, and Enterprise Cloud Scenarios Prepared for: 2012 Neovise, LLC. All Rights Reserved. Case Study Report Introduction:

More information

Cisco Data Center Optimization Services

Cisco Data Center Optimization Services Cisco Data Center Optimization Services Evolve your data center solutions to support business growth, deliver nextgeneration services, and maintain competitive advantage with Cisco Data Center Optimization

More information

IBM Tivoli Netcool network management solutions for enterprise

IBM Tivoli Netcool network management solutions for enterprise IBM Netcool network management solutions for enterprise The big picture view that focuses on optimizing complex enterprise environments Highlights Enhance network functions in support of business goals

More information

CONSULTING SERVICES Managed IT services

CONSULTING SERVICES Managed IT services CONSULTING SERVICES Managed IT services CONSULTING SERVICES Organizations around the globe face an array of critical issues in today s business environment. Economic conditions are requiring significant

More information

White Paper. Fundamentals of Performance Testing

White Paper. Fundamentals of Performance Testing etri White Paper Fundamentals of Performance Testing The Increasing Need for Proper Performance Testing due to Increasing Software Complexity in the Enterprise There have been two significant changes in

More information

SharePoint as a Business Application, Not Just a Collaboration Tool

SharePoint as a Business Application, Not Just a Collaboration Tool SharePoint as a Business Application, Not Just a Collaboration Tool Products, Projects, Services and Work in One System Published March, 2013 http://epmlive.com Contents Introduction...2 Common Uses of

More information

White paper: Unlocking the potential of load testing to maximise ROI and reduce risk.

White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. Executive Summary Load testing can be used in a range of business scenarios to deliver numerous benefits. At its core,

More information

Data Center Performance Insurance

Data Center Performance Insurance Data Center Performance Insurance How NFS Caching Guarantees Rapid Response Times During Peak Workloads November 2010 2 Saving Millions By Making It Easier And Faster Every year slow data centers and application

More information

Monitoring Best Practices for

Monitoring Best Practices for Monitoring Best Practices for OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems like Magento,

More information

5 Steps to Choosing the Right BPM Suite

5 Steps to Choosing the Right BPM Suite 5 Steps to Choosing the Right BPM Suite BPM Suites can deliver significant business benefits and a fast ROI but only if you choose the right one By Laura Mooney, Metastorm Copyright 2009, Metastorm Inc.

More information

Building an Excellent Relationship with your Cloud-Based Contact Center Infrastructure Vendor. April 2014

Building an Excellent Relationship with your Cloud-Based Contact Center Infrastructure Vendor. April 2014 Building an Excellent Relationship with your Cloud-Based Contact Center Infrastructure Vendor April 2014 Sponsored by: - 1 - DMG Consulting LLC Table of Contents Introduction... 1 Cloud-Based Contact Center

More information

BUSINESS IMPACT OF POOR WEB PERFORMANCE

BUSINESS IMPACT OF POOR WEB PERFORMANCE WHITE PAPER: WEB PERFORMANCE TESTING Everyone wants more traffic to their web site, right? More web traffic surely means more revenue, more conversions and reduced costs. But what happens if your web site

More information

Field Service in the Cloud: Solving the 5 Biggest Challenges of Field Service Delivery

Field Service in the Cloud: Solving the 5 Biggest Challenges of Field Service Delivery Field Service in the Cloud: Solving the 5 Biggest Challenges of Field Service Delivery The ServiceMax Whitepaper Executive Summary The time has come for field service organizations to also reap the benefits

More information

Top five lessons learned from enterprise hybrid cloud projects

Top five lessons learned from enterprise hybrid cloud projects Top five lessons learned from enterprise hybrid cloud projects Top performer highlights More than half of top performers give users access to selfservice provisioning across both private and public cloud

More information

Five steps to improving the customer service experience

Five steps to improving the customer service experience Five steps to improving the customer service experience Metrics, tips, and tools for utilizing customer feedback An Ovum White Paper Sponsored by Publication Date: January 2012 INTRODUCTION As the use

More information

ORACLE FINANCIAL SERVICES ANALYTICAL APPLICATIONS INFRASTRUCTURE

ORACLE FINANCIAL SERVICES ANALYTICAL APPLICATIONS INFRASTRUCTURE ORACLE FINANCIAL SERVICES ANALYTICAL APPLICATIONS INFRASTRUCTURE KEY FEATURES Rich and comprehensive business metadata allows business users to interact with financial services data model to configure

More information

Scaling Healthcare Applications to Meet Rising Challenges of Healthcare IT

Scaling Healthcare Applications to Meet Rising Challenges of Healthcare IT Scaling Healthcare Applications to Meet Rising Challenges of Healthcare IT December 2013 Copyright 2013 GigaSpaces. All Rights Reserved. Healthcare IT has entered the era of Big Data. Are your applications

More information

Predictive analytics with System z

Predictive analytics with System z Predictive analytics with System z Faster, broader, more cost effective access to critical insights Highlights Optimizes high-velocity decisions that can consistently generate real business results Integrates

More information

ElegantJ BI. White Paper. The Enterprise Option Reporting Tools vs. Business Intelligence

ElegantJ BI. White Paper. The Enterprise Option Reporting Tools vs. Business Intelligence ElegantJ BI White Paper The Enterprise Option Integrated Business Intelligence and Reporting for Performance Management, Operational Business Intelligence and Data Management www.elegantjbi.com ELEGANTJ

More information

Cloud Lifecycle Management

Cloud Lifecycle Management Cloud Lifecycle Managing Cloud Services from Request to Retirement SOLUTION WHITE PAPER Table of Contents EXECUTIVE SUMMARY............................................... 1 CLOUD LIFECYCLE MANAGEMENT........................................

More information

Red Hat Enterprise Linux: The ideal platform for running your Oracle database

Red Hat Enterprise Linux: The ideal platform for running your Oracle database Red Hat Enterprise Linux: The ideal platform for running your Oracle database 2 Introduction 2 Scalability 2 Availability 3 Reliability 4 Manageability 5 Red Hat subscriptions 6 Conclusion www.redhat.com

More information

Tools for Testing Software Architectures. Learning Objectives. Context

Tools for Testing Software Architectures. Learning Objectives. Context Tools for Testing Software Architectures Wolfgang Emmerich Professor of Distributed Computing University College London http://sse.cs.ucl.ac.uk Learning Objectives To discuss tools to validate software

More information

Cloud Infrastructure Services for Service Providers VERYX TECHNOLOGIES

Cloud Infrastructure Services for Service Providers VERYX TECHNOLOGIES Cloud Infrastructure Services for Service Providers VERYX TECHNOLOGIES Meeting the 7 Challenges in Testing and Performance Management Introduction With advent of the cloud paradigm, organizations are transitioning

More information

WHITE PAPER. iet ITSM Enables Enhanced Service Management

WHITE PAPER. iet ITSM Enables Enhanced Service Management iet ITSM Enables Enhanced Service Management iet ITSM Enables Enhanced Service Management Need for IT Service Management The focus within the vast majority of large and medium-size companies has shifted

More information

Open Source Business Rules Management System Enables Active Decisions

Open Source Business Rules Management System Enables Active Decisions JBoss Enterprise BRMS Open Source Business Rules Management System Enables Active Decisions What is it? JBoss Enterprise BRMS provides an open source business rules management system that enables active

More information

CS 389 Software Engineering. Lecture 2 Chapter 2 Software Processes. Adapted from: Chap 1. Sommerville 9 th ed. Chap 1. Pressman 6 th ed.

CS 389 Software Engineering. Lecture 2 Chapter 2 Software Processes. Adapted from: Chap 1. Sommerville 9 th ed. Chap 1. Pressman 6 th ed. CS 389 Software Engineering Lecture 2 Chapter 2 Software Processes Adapted from: Chap 1. Sommerville 9 th ed. Chap 1. Pressman 6 th ed. Topics covered Software process models Process activities Coping

More information

End-to-End E-Clinical Coverage with Oracle Health Sciences InForm GTM

End-to-End E-Clinical Coverage with Oracle Health Sciences InForm GTM End-to-End E-Clinical Coverage with InForm GTM A Complete Solution for Global Clinical Trials The broad market acceptance of electronic data capture (EDC) technology, coupled with an industry moving toward

More information

Weight on That Business Report

Weight on That Business Report COLLABORATIVE WHITEPAPER SERIES A critical phase of any performance engineering project is the key performance indicator (KPI) definition phase. A business analyst works with key stakeholders to determine

More information

White Paper: Assessing Performance & Response Time Requirements

White Paper: Assessing Performance & Response Time Requirements White Paper: Assessing Performance & Response Time Requirements Mark Houghtlin IBM Cloud Advisory Services & Application Performance Optimization Consulting Practice Agenda Workload Transformation Analysis

More information

Remote Management Services Portfolio Overview

Remote Management Services Portfolio Overview Enterprise environments today have various technologies and concerns in their network environment; from telephony, Internet, video, compute, and infrastructure, to regulatory and security management. On

More information

IPT 2015 Sales & Use Tax Symposium Indian Wells, CA. Tax Accrual Data Analytics Dashboards to Minimize Risk

IPT 2015 Sales & Use Tax Symposium Indian Wells, CA. Tax Accrual Data Analytics Dashboards to Minimize Risk IPT 2015 Sales & Use Tax Symposium Indian Wells, CA Tax Accrual Data Analytics Dashboards to Minimize Risk Presenters Holly Hamby Weatherford IT Director Tax Holly.Hamby@weatherford.com Les Jackson Deloitte

More information

Evolv Technology & Support Delivers Platform Updates & Customer Support Insights

Evolv Technology & Support Delivers Platform Updates & Customer Support Insights Ahead of the Change, Ahead of the Curve Evolv Technology & Support Delivers Platform Updates & Customer Support Insights Craig Lovell VP of Product Development Sandrine Moreau VP of Customer Support Agenda

More information

Building Your CRM Short List: What You Need to Know Before You Buy

Building Your CRM Short List: What You Need to Know Before You Buy Building Your CRM Short List: What You Need to Know Before You Buy Nov. 28, 2007 Moderator: Matt Villano, senior contributing editor, Campus Technology Introduction Agenda Building your CRM shortlist:

More information

Performance Test Process

Performance Test Process A white Success The performance testing helped the client identify and resolve performance bottlenecks which otherwise crippled the business. The ability to support 500 concurrent users was a performance

More information

ORACLE HYPERION PLANNING

ORACLE HYPERION PLANNING ORACLE HYPERION PLANNING ENTERPRISE WIDE PLANNING, BUDGETING, AND FORECASTING KEY FEATURES Hybrid data model facilitates planning, analysis and commentary Flexible workflow capabilities Reliability with

More information

Automation, Efficiency and Scalability in Securities Back Office Processing An implementer's view

Automation, Efficiency and Scalability in Securities Back Office Processing An implementer's view Automation, Efficiency and Scalability in Securities Back Office Processing An implementer's view Arnab Debnath CEO, Anshinsoft Corp. Presentation Outline Perspective on back office automation (STP) Modular,

More information

North American Electric Reliability Corporation (NERC) Cyber Security Standard

North American Electric Reliability Corporation (NERC) Cyber Security Standard North American Electric Reliability Corporation (NERC) Cyber Security Standard Symantec Managed Security Services Support for CIP Compliance Overviewview The North American Electric Reliability Corporation

More information

Enhancing Business Performance Through Innovative Technology Solutions

Enhancing Business Performance Through Innovative Technology Solutions Enhancing Business Performance Through Innovative Technology Solutions Contact Center = Customer Experience FIELD SERVICE Customer Service BACK OFFICE CONTACT CENTER BRANCH OFFICE Help Desk HR Finance

More information

The Production Cloud

The Production Cloud The Production Cloud The cloud is not just for backup storage, development projects and other low-risk applications. In this document, we look at the characteristics of a public cloud environment that

More information

An enterprise- grade cloud management platform that enables on- demand, self- service IT operating models for Global 2000 enterprises

An enterprise- grade cloud management platform that enables on- demand, self- service IT operating models for Global 2000 enterprises agility PLATFORM Product Whitepaper An enterprise- grade cloud management platform that enables on- demand, self- service IT operating models for Global 2000 enterprises ServiceMesh 233 Wilshire Blvd,

More information

An Oracle White Paper February 2010. Rapid Bottleneck Identification - A Better Way to do Load Testing

An Oracle White Paper February 2010. Rapid Bottleneck Identification - A Better Way to do Load Testing An Oracle White Paper February 2010 Rapid Bottleneck Identification - A Better Way to do Load Testing Introduction You re ready to launch a critical Web application. Ensuring good application performance

More information

HP Service Manager software

HP Service Manager software HP Service Manager software The HP next generation IT Service Management solution is the industry leading consolidated IT service desk. Brochure HP Service Manager: Setting the standard for IT Service

More information

Service Virtualization:

Service Virtualization: Service Virtualization: Reduce the time and cost to develop and test modern, composite applications Business white paper Table of contents Why you need service virtualization 3 The challenges of composite

More information

Building an AWS-Compatible Hybrid Cloud with OpenStack

Building an AWS-Compatible Hybrid Cloud with OpenStack Building an AWS-Compatible Hybrid Cloud with OpenStack AWS is Transforming IT Amazon Web Services (AWS) commands a significant lead in the public cloud services market, with revenue estimated to grow from

More information

Application Performance Management

Application Performance Management Application Performance Management Intelligence for an Optimized WAN xo.com Application Performance Management Intelligence for an Optimized WAN Contents Abstract 3 Introduction 3 Business Drivers for

More information

Sytorus Information Security Assessment Overview

Sytorus Information Security Assessment Overview Sytorus Information Assessment Overview Contents Contents 2 Section 1: Our Understanding of the challenge 3 1 The Challenge 4 Section 2: IT-CMF 5 2 The IT-CMF 6 Section 3: Information Management (ISM)

More information

OPTIMIZING PERFORMANCE IN AMAZON EC2 INTRODUCTION: LEVERAGING THE PUBLIC CLOUD OPPORTUNITY WITH AMAZON EC2. www.boundary.com

OPTIMIZING PERFORMANCE IN AMAZON EC2 INTRODUCTION: LEVERAGING THE PUBLIC CLOUD OPPORTUNITY WITH AMAZON EC2. www.boundary.com OPTIMIZING PERFORMANCE IN AMAZON EC2 While the business decision to migrate to Amazon public cloud services can be an easy one, tracking and managing performance in these environments isn t so clear cut.

More information

Customers award top satisfaction scores to IBM System x x86 servers. August 2014 TBR T EC H N O LO G Y B U S I N ES S R ES EAR C H, I N C.

Customers award top satisfaction scores to IBM System x x86 servers. August 2014 TBR T EC H N O LO G Y B U S I N ES S R ES EAR C H, I N C. Customers award top satisfaction scores to IBM System x x86 servers August 2014 TBR T EC H N O LO G Y B U S I N ES S R ES EAR C H, I N C. IBM System x satisfaction scores surpass those of competing vendors

More information

Business Support System (BSS) Service Offering

Business Support System (BSS) Service Offering Business Support System (BSS) Service Offering Focus Areas Social CRM Service Creation Telco 2.0 BSS Technologies and Solutions BSS Focus Areas Data Management BSS Business Areas BSS Processes and Systems

More information

EMC IT AUTOMATES ENTERPRISE PLATFORM AS A SERVICE

EMC IT AUTOMATES ENTERPRISE PLATFORM AS A SERVICE EMC IT AUTOMATES ENTERPRISE PLATFORM AS A SERVICE Self-service portal delivers ready-to-use development platform in less than one hour Application developers order from online catalog with just a few clicks

More information

Stephen Miles. Transform IT assets to Drive Business Service Innovation. CA Expo Hong Kong. Vice President - Service Assurance Asia Pacific & Japan

Stephen Miles. Transform IT assets to Drive Business Service Innovation. CA Expo Hong Kong. Vice President - Service Assurance Asia Pacific & Japan Stephen Miles Vice President - Service Assurance Asia Pacific & Japan CA Expo Hong Kong 21 September, 2012 Transform IT assets to Drive Business Service Innovation The age of innovation has arrived CLOUD

More information

Aligning Quality Management Processes to Compliance Goals

Aligning Quality Management Processes to Compliance Goals Aligning Quality Management Processes to Compliance Goals MetricStream.com Smart Consulting Group Joint Webinar February 23 rd 2012 Nigel J. Smart, Ph.D. Smart Consulting Group 20 E. Market Street West

More information

Oracle Hyperion Planning

Oracle Hyperion Planning Oracle Hyperion Planning Oracle Hyperion Planning is an agile planning solution that supports enterprise wide planning, budgeting, and forecasting using desktop, mobile and Microsoft Office interfaces.

More information

10 Best Practices for Application Performance Testing

10 Best Practices for Application Performance Testing Business white paper 10 Best Practices for Application Performance Testing Leveraging Agile Performance Testing for Web and Mobile Applications 10 Best Practices for Application Performance Testing Table

More information

Tableau Server Scalability Explained

Tableau Server Scalability Explained Tableau Server Scalability Explained Author: Neelesh Kamkolkar Tableau Software July 2013 p2 Executive Summary In March 2013, we ran scalability tests to understand the scalability of Tableau 8.0. We wanted

More information

Accelerate Your Enterprise Private Cloud Initiative

Accelerate Your Enterprise Private Cloud Initiative Cisco Cloud Comprehensive, enterprise cloud enablement services help you realize a secure, agile, and highly automated infrastructure-as-a-service (IaaS) environment for cost-effective, rapid IT service

More information

<risk> Enterprise Risk Management

<risk> Enterprise Risk Management Global Resources... Local Knowledge is vital in supporting business continuity across diverse and challenging environments and operating models. By consolidating risk management activities into a single,

More information

Manufacturing Strategies that Win: Executive View of the Cloud Executive Brief

Manufacturing Strategies that Win: Executive View of the Cloud Executive Brief Technology Evaluation Centers Executive Summary To date, manufacturers have been slow to embrace cloud computing. But the proven success of cloud-based solutions, coupled with the promise of a less expensive

More information

IT as a Service Emerges as a New Management Paradigm in the Software-Defined Datacenter Era

IT as a Service Emerges as a New Management Paradigm in the Software-Defined Datacenter Era Customer Needs and Strategies IT as a Service Emerges as a New Management Paradigm in the Software-Defined Datacenter Era Mary Johnston Turner IDC OPINION IT as a service (ITaaS) represents a fundamentally

More information

SOLUTION WHITE PAPER. Building a flexible, intelligent cloud

SOLUTION WHITE PAPER. Building a flexible, intelligent cloud SOLUTION WHITE PAPER Building a flexible, intelligent cloud Table of Contents Executive summary 1 Building a hybrid cloud 2 Provision complete cloud services 3 Service catalog 3 The user portal 4 Multi-tier

More information

Lombardi Whitepaper: Why You (Probably) Cannot Afford to Use IBM for BPM. Why You (Probably) Cannot Afford to Use IBM for BPM

Lombardi Whitepaper: Why You (Probably) Cannot Afford to Use IBM for BPM. Why You (Probably) Cannot Afford to Use IBM for BPM Why You (Probably) Cannot Afford to Use IBM for BPM 1 Why You (Probably) Cannot Afford to Use IBM for BPM You have a project that seems like a good fit for Business Process Management (BPM). And you re

More information

Automate performance testing to predict system behaviour and improve application performance. Business white paper

Automate performance testing to predict system behaviour and improve application performance. Business white paper Automate performance testing to predict system behaviour and improve application performance Business white paper Table of contents Executive summary... 3 What is performance testing?... 4 Why automate

More information

EMC PERSPECTIVE. The Private Cloud for Healthcare Enables Coordinated Patient Care

EMC PERSPECTIVE. The Private Cloud for Healthcare Enables Coordinated Patient Care EMC PERSPECTIVE The Private Cloud for Healthcare Enables Coordinated Patient Care Table of Contents A paradigm shift for Healthcare IT...................................................... 3 Cloud computing

More information

Software development for the on demand enterprise. Building your business with the IBM Software Development Platform

Software development for the on demand enterprise. Building your business with the IBM Software Development Platform Software development for the on demand enterprise Building your business with the IBM Software Development Platform An on demand business is an enterprise whose business processes integrated end-to-end

More information

Making the Most of Your Enterprise Reporting Investment 10 Tips to Avoid Costly Mistakes

Making the Most of Your Enterprise Reporting Investment 10 Tips to Avoid Costly Mistakes Making the Most of Your Enterprise Reporting Investment 10 Tips to Avoid Costly Mistakes Making the Most of Your Enterprise Reporting Investment 10 Tips to Avoid Costly Mistakes Charts, graphs, tables,

More information

Payment Card Industry Data Security Standard

Payment Card Industry Data Security Standard Symantec Managed Security Services support for IT compliance Solution Overview: Symantec Managed Services Overviewview The (PCI DSS) was developed to facilitate the broad adoption of consistent data security

More information

Commercial Software Licensing

Commercial Software Licensing Commercial Software Licensing CHAPTER 4: Prepared by DoD ESI January 2013 Chapter Overview Publishers generally create one or more of three major types of software products: Applications software for transactions,

More information

Rapid Bottleneck Identification A Better Way to do Load Testing. An Oracle White Paper June 2009

Rapid Bottleneck Identification A Better Way to do Load Testing. An Oracle White Paper June 2009 Rapid Bottleneck Identification A Better Way to do Load Testing An Oracle White Paper June 2009 Rapid Bottleneck Identification A Better Way to do Load Testing. RBI combines a comprehensive understanding

More information

JBoss EntErprisE BrMs www.jboss.com

JBoss EntErprisE BrMs www.jboss.com JBoss Enterprise BRMS Open Source Business Rules Management System Enables Active Decisions What is it? JBoss Enterprise BRMS provides an open source business rules management system that enables active

More information

Elastic Application Platform for Market Data Real-Time Analytics. for E-Commerce

Elastic Application Platform for Market Data Real-Time Analytics. for E-Commerce Elastic Application Platform for Market Data Real-Time Analytics Can you deliver real-time pricing, on high-speed market data, for real-time critical for E-Commerce decisions? Market Data Analytics applications

More information

Optimos Enterprise Helpdesk Automation Solution Case Study

Optimos Enterprise Helpdesk Automation Solution Case Study Optimos Enterprise Helpdesk Automation Solution Case Study IT Help Central National Science Foundation Optimos Incorporated 4455 Brookfield Corporate Drive Chantilly, VA 20151 Telephone: (703) 488-6900

More information

Moving to the Cloud Eric Tamblyn, VP Global Product Innovations

Moving to the Cloud Eric Tamblyn, VP Global Product Innovations Moving to the Cloud Eric Tamblyn, VP Global Product Innovations G-Force Seattle-2012 1 What is a Cloud Solution? A Network or web-based service End-user flexibility to choose Applications & features Usage

More information

Introduction. Software Development and Change Management Recommendations

Introduction. Software Development and Change Management Recommendations Introduction This document was created by a joint working group of the Futures Industry Association ( FIA ) Principal Traders Group and the FIA European Principal Traders Association (collectively FIA

More information