Identifying Application Performance Risk
|
|
- Norman Morton
- 8 years ago
- Views:
Transcription
1 Identifying Application Performance Risk Performance Engineering COLLABORATIVE WHITEPAPER SERIES
2 COLLABORATIVE WHITE PAPER SERIES: Identifying Application Performance Risk Under what conditions will an application require a performance test? Not all applications require performance testing, and the same application may not require repeated performance testing for every release. The selection process for performance testing frequency must consider user population, application type, technology, changes to features and function, and how nonfunctional requirements are monitored in the software development life cycle (SDLC). I. Introduction A typical enterprise has thousands of applications. In a business unit, there can be several hundred applications. As the business continues to evolve and change, so will the applications evolve and change to support the business needs. The changes made to the application may increase the risk to performance, scalability, or stability. Depending on the business s tolerance for disruption, these changes may require some level of performance and scalability testing to verify the application can still process the accepted business volumes while staying within service level agreements. These application changes are typically scheduled on a release calendar. Customer facing applications should be considered critical to the business, while internal facing applications may be less critical. However, what if the internal application is supporting the executive level of the company and provides key information for decision-making? Some enterprises believe inherently that performance and scalability testing are required, while others may leave the decision to the business units. Enabling the enterprise for performance engineering requires an investment. This investment is considered to be an indirect investment, as it may not be immediately linked to a revenue generating process. The value of the investment in performance engineering can be quantified. For example, when performance engineering recommends design changes allowing a revenuegenerating website to process more orders, the return on investment is clear. In a large enterprise, performance engineering resources are often in short supply, and budgets are generally under constant pressure. This leads IT and business decisionmakers to ask certain questions, such as: What guidelines can you use to help allocate these resources across the project portfolio? How can you make sure you have not missed an application that required performance testing, and how can you make sure you re not testing the wrong applications? Are you sure the results from performance are accurate and allow management to make informed decisions? 2
3 II. What factors should you consider when selecting an application for performance testing? Not all applications require performance testing, and the same application may not require repeated performance testing for every release. The risk factors you should use to evaluate your application include:. User population The people who use your application are critical to the decision. Questions may include: Who are the users of your applications, how many concurrent users are there, and is the number of users increasing? Are the users purchasing products or services from your business? Are they external or internal users? How easy is to for your user base to switch to a competitor if you website is not performing well? How is the application accessed? Access types may include browsers (both desktop and mobile), call center applications (both client server, legacy, and web), and even internal voice recognition (IVR) clients. The amount of transactions for each access type and application must be considered when defining the workload for the user population. 2. Application type The application type itself can dominate the risk factors. For instance, questions to ask may include: Is the application an online retail website? Is there both a desktop and mobile website/mobile app? Typically a revenue generating website requires a performance test for every release. Is the application a key component in the enterprise architecture that other applications use? If so, this is deemed a critical application and may require performance testing for every release. Is the application a batch process with a strict window of processing? How critical is this application to the business, and how is it rated? 3. Application technology The state of the application technology stack can be a significant risk factor. Generally, the technology platform does not change from release to release. If the underlying technology is stable and is well known to the application development team, a performance test might not be required. However, if a new technology is being introduced or replacing one of the tiers, there may be a great risk and thus testing is required. Likewise, a significant upgrade to a vendor product could warrant performance testing. It is important to consider the scope and impact of changes to any key components. 4. Application features and functions The amount of modified code or new code in an application can create new performance risks. Understanding the impact of the changes is critical to determining if performance testing is required. Potential analysis questions may include: How has the new or modified business feature changed the behavior of the application? Were the changes extensive and across the client, application services, and database? What percentage of the code was impacted by the new or modified services? 5. Software development process Analysts may consider questions such as: Does the SDLC track non-functional requirements during the lifecycle? How are those non-functional requirements communicated from the requirements, design, development, testing and deployment teams? Have key business transactions or services been identified with stringent response time requirements, or strict throughput requirements? What architectural risk analysis, prototyping, or other types of testing have been done throughout the lifecycle that may mitigate the need for formal performance and scalability testing efforts? 6. Production issues with the last release Recent history can be an indicator for the future. If the application went into production and the last release had performance, scalability, or stability issues, then it may require a closer look at the application to determine if the issues have been truly mitigated. Otherwise, performance testing is required. Similarly, resource utilization patterns and trends may be used to assess the need for further risk mitigation. 3
4 COLLABORATIVE WHITE PAPER SERIES: Identifying Application Performance Risk 7. The schedule of performance tests Applications will undergo performance testing at different times during their lifetime. The application can be tested before it is ever released into production; performance testing can be scheduled for every major release; or performance testing can be scheduled based on the extent of the application s changes. III. Risk factors elaborated. User population The key information to capture is: How many people use the application on average and during peak time? Who uses this application? What is the behavior of the users workload? In an analysis, we may ask: What would be the business impact if this application exhibited performance problems? Is your business in a highly competitive market, where dissatisfied users can switch to you competitor? For instance, if the response time doubled or tripled from normal, how would the user experience degrade, and what would be the financial impact of service calls and shopping cart abandonment? How long would this condition be tolerated and under what conditions would it be tolerated? The matrices shown below may be used to identify and assess potential performance engineering risks, using a simple -2-3 scoring system: User Population Characteristics Figure : Figure title Business internal: Senior management or board level, enterprise-wide Business external Consumers Average number of concurrent users Peak number of concurrent users relative to normal business load based on month-end or periodic event that occurs regularly Rate of user population growth Flash or sudden spikes in concurrent users, above and beyond your current peaking factor: Based on a new business model of broadcasting messages to your client base telling them to all come to your website Currently a novelty event for many businesses, not accounted for in the system design Eventually folded into the traditional peaking factor 2 2 : Thousands 2: Hundreds Risk Level : requires a performance check 2: depends on other extenuating factors 3: does not require a performance test : Application peak TPS is more than five times the typical TPS for the business : If population growth doubles in less than nine months : A significant increase is expected due to the business winning a new contract or large client 3: No user population growth : Upcoming flash or spike events will add to existing application workload 4
5 If you have a large number of consumers that is growing, you would require performance and scalability testing. For example, flash events are a key risk area because they are occurring more frequently for businesses on application platforms that were neither designed nor tested for sudden workload bursts. 2. Application type Most businesses will rate their applications based on criticality to the business. The rating is typically for availability and recovery time. Ratings can range from high availability (almost no down time) rated A, to minutes of down time rated B, to hours rated C, to days rated D. These ratings factor into your selection criteria. Should a C rated application be performance tested? Under specific conditions it should; for instance, it is a major application upgrade or if it is chronically slow for the users to the point that it is interfering with their workflow and productivity. Application Characteristics Online website retailing (may include both desktop browser website and mobile website/app) Financial transactions (brokerage, 40K, etc.) Corporate support Customer portal: This is where the customer can maintain their account information, view their history of transactions, or check the status of an order Business portal: This is where the business partner can maintain their account information, view their history of transactions, or check the status of an order. It could be for an insurance agency with a large number of independent agents Business intelligence and analytics: Large volumes of data analysis, tight reporting deadlines or regulatory filings Date hub or integration hub: A key component where many applications are dependent upon Informational or marketing: User experience is important if this is for consumers Batch processing: Constrained processing windows Risk Level : requires a performance check 2: depends on other extenuating factors 3: does not require a performance test : Enterprise-wide use 2 or 3: Group-wide : Open enrollment is a key business process that occurs once per year : Most customer facing systems require some level of performance testing, the enduser response time is critical to how your customers view your business : The business partner is responsible for driving revenue to your business 2: The business partner provides a service to your business that is part of a workflow : Service level penalties if late : First mover advantage, business, competitive edge 2 or 3: Weekly, monthly, quarterly reporting 2 2 or 3 Rating depends on extent of penalties for violating SLA s Document management 5 : Timeliness of documents is critically important, e.g. news agency or day-trading investment advisor 2 or 3: Otherwise
6 volumes of data analysis, tight reporting deadlines or regulatory filings competitive edge 2 or 3: Weekly, monthly, quarterly reporting COLLABORATIVE WHITE PAPER Date SERIES: hub or integration hub: A key Identifying Application component Performance where Riskmany applications are dependent upon Informational or marketing: User experience is important if this is for consumers Batch processing: Constrained processing windows Document management Imaging systems: These are typically scanning systems that are used in mail order processing applications, or where signature is required. They are part of an essential workflow A core Enterprise-wide component, used by many other applications 2 2 or 3 Rating depends on extent of penalties for violating SLA s : Timeliness of documents is critically important, e.g. news agency or day-trading investment advisor 2 or 3: Otherwise : Part of a time critical workflow. The documents must be scanned quickly and made available quickly or 2 3. Application technology When you are using unfamiliar technologies, you need proactive performance management. In general, the application technology stack does not change for every release. Nevertheless, it is important to consider the cumulative effect of small changes over time with respect to online features and batch processes. Technology Characteristics Risk Level : requires a performance check 2: depends on other extenuating factors 3: does not require a performance test Well-known and stable technology stack Accessed via more than one client presentation tier (i.e., classic browser website, mobile website, web app) New technology for a key component: For instance replacing the WebSphere application server with Jboss, or replacing a C++ batch process with Java batch process Significant technology upgrade: For instance, upgrading the WebSphere application server, upgrading the Database to a new major release. The key here is to identify impact and determine the proper level of testing Significant application upgrade: This is typically for a third party vendor who made significant architecture changes, particularly if the new version of the application has not been demonstrated at full business volume New component added to the application: The application has new component that will become part of most of the key business transactions 3 or 2: It is critical to understand the number of transactions that use this component and the nature of the transactions 6
7 4. Application features and functions This section considers the magnitude of the changes made to the application for this release cycle. The goal is to assess the risk the new change poses to the performance, stability, and scalability of the application. Where new database tables were added or existing ones modified, did this impact the database partitioning scheme? On the application server, were new services introduced, or existing ones modified? Will this impact the application server s scalability profile? Did the web client change to introduce asynchronous web server requests? How will this impact the transaction arrival rate to the web server and application servers? Has this application experienced performance or stability issues in the recent past? Is there a history of performance issues after a new release? Is the application sensitive to a sudden increase in user load or transactions per second? Under what conditions does this occur? Impact Risk Level : requires a performance check 2: depends on other extenuating factors 3: does not require a performance test Web client Web Server Application server Database server or 2: Introducing asynchronous Web server requests : New plug-ins or new connections to application servers : Services added or changed with suspected performance impact : Impact to database partitioning scheme /2: New tables added to high volume transaction : New requirements for keeping and accessing historical information All tiers impacted by change Percentage of overall code changes or new code developed. For instance, if there are 00,000 lines of code, what percentage was modified? Batch processing where new jobs were introduced, was the concurrency model impacted? Reporting server : More than 5% 2: 5%-to 5% : Concurrency model impacted : New tools providing ad hoc and wider or deeper queries 7
8 COLLABORATIVE WHITE PAPER SERIES: Identifying Application Performance Risk 5. Software development process The software development process should identify non-functional requirements, such as performance, scalability, maintainability, usability, and others. During the requirements phase, any key business use cases that have response time requirements must be identified and tracked through the process. Also, key business use cases for batch process throughput should be identified. In general, activities that support performance engineering should be conducted throughout the entire lifecycle, and they should be defined in a standards document so that assessment of performance risk can be understood. Coordinated Performance tests: The performance team will lay out a plan to coordinate the goals and test cases for performance in architecture proof-of-concepts (POCs), unit testing, functional quality assurance (QA), and performance testing. The development/build phase has a unit testing activity, the functional QA testing phase will have a performance test activity, and the performance testing process will require the outcome of those two activities. Early in the lifecycle, an architectural POC may be required, and it should include a set of performance, stability, and scalability tests. The performance team can unify the strategy of introducing performance testing into the other testing activities. The performance team can introduce micro performance tests into the other phases of the SDLC where they already have testing activities, for architecture/design, development, and QA. 6. Recent release and production issues The recent past can be an indicator of the future. If performance, scalability, or stability issues arose from the last release of the application, performance testing is needed on the next release. In some instances, the application development team may have a poor track record for managing application performance, resulting in frequent performance issues. The performance team must see the application performance management reports from the production operations team. This will allow them to determine the nature of the production issues related to performance. It will allow them to build a historical profile for the production behavior of the application. This linkage of the performance team to the operations team provides a feedback loop to the performance team. This information will allow the team to adjust the performance test scenarios based on changing workloads and new or modified business functions. 7. The schedule of performance tests Applications will undergo performance testing at different times during their lifetime. The application can be tested before it is ever released into production; performance testing can be scheduled for every major release; or performance testing can be scheduled based on the extent of the application s changes. a. Project-based schedule: Project-based performance tests can be driven by the nature of the change to the application and technical architecture, rather than by the profile of the user population. This approach is appropriate if the user population is not growing, but the technology is changing. If the application uses a vendor product as a key part of the workflow, and the vendor has introduced a new major release, the level of risk may be high. Before agreeing to forgo in-house performance testing, the application owners must be more than satisfied that the vendor had done proper performance testing. Once the new version has been verified not to harm the response time or throughput, the performance test project is over. Oftentimes, the application is custom-developed by the IT organization for the business. The custom-developed application may be in need of technology upgrade or replacement. This would require a project-based approach to performance testing, possibly coupled with a releasebased approach to the schedule. The custom-developed application may be scheduled for iterative deployment across different release cycles. The risk of the new technology or upgrade must be understood. What did the vendor or IT development team change? You must understand how the changes impact the users workflow. You must measure the before and 8
9 after performance of the system. In order to do a proper comparison, you must understand the key business transactions response times and the batch process throughput of the existing version. b. Release-based schedule Release-based tests are recurring and are scheduled for every release. Since the application has been deemed critical, it requires a baseline test, performance validation, or performance characterization for every release. The type of test may change from release to release due to the nature of the change. The test scenarios can change based on observations from the production environment. Likewise, a changing production workload or changing user behavior will require the performance test cases to change. The performance team must have a link to the production application-monitoring and capacity-planning team. The user population could be increasing, and the business may have introduced new features or functions that have changed since the last baseline test. c. Production support schedule Production support test cases are required to help triage production issues. When issues arise due to performance, scalability, or stability, the root-cause must be found, and one or more solutions must be defined. These tests are disruptive to the planned performance testing schedule and environment. Oftentimes, the performance team has the only properly sized environment to reproduce the production issue. Release and configuration management become critical in this situation. You need mature processes to be able to suspend the current performance testing schedule and execute on the production issues. These test cases are created on-demand and adjusted as new information is uncovered. The tests are created to either locate the root-cause or to help define a solution. IV. Conclusion This approach will allow you to allocate the right resources to the right projects and applications. Performance engineering and performance testing should not be done in isolation or behind closed doors. The selection process and the risks must be visible, and there must be communication between the performance team and the business, ultimately to answer the questions of why are we testing? and what are we getting from those tests? Establish a transparent selection process, as some application owners budget for performance testing and others do not. This selection process will allow you to work with the applications owners who do not budget for performance testing, providing them a structured process for identifying risks to the business as a basis for selecting the applications to include in performance testing. Is the current vendor telling your business they must upgrade? Often software products are selected by the business because they provide a set of key business functions, while little attention is paid to the non-functional requirements of the business. This process will allow you to assess the risk introduced by a vendor solution, either during the selection process or with an established vendor who wants you to upgrade to the new version. This approach provides the criteria for defining the performance risk or scalability risk the application may or may not present to the business. For instance, you should always be looking out for business initiatives that introduce a new extreme workload, such as a new marketing campaign that will encourage customers to login to see the new product. Then in response, you must design and execute a scalability test to verify the behavior of the application under the anticipated flash-type workload. Most importantly, this approach provides visibility into the performance testing risk-based selection process. This approach allows you to communicate the risk to business and other key stakeholders by showing the connection between the business risk and the testing plan to reduce that risk. Now that you have identified the applications that should be performance tested, what types of tests should you be designing and executing? See the next white paper from Collaborative Consulting on the different categories of performance tests. 9
10 COLLABORATIVE WHITE PAPER SERIES: Identifying Application Performance Risk Collaborative Consulting is a leading information technology services firm dedicated to helping our clients achieve business advantage through the use of strategy and technology. We deliver a comprehensive set of solutions across multiple industries, with a focus on business process and program management, information management, software solutions, and software performance and quality. We also have a set of offerings specific to the life sciences and financial services industries. Our unique model offers both onsite management and IT consulting as well as U.S.-based remote solution delivery. To learn more about Collaborative, please visit our website at us at sales@collaborative.com, or contact us at Copyright 204 Collaborative Consulting, LLC. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. WP.24.06
Consequences of Poorly Performing Software Systems
Consequences of Poorly Performing Software Systems COLLABORATIVE WHITEPAPER SERIES Poorly performing software systems can have significant consequences to an organization, well beyond the costs of fixing
More informationProactive Performance Management for Enterprise Databases
Proactive Performance Management for Enterprise Databases Abstract DBAs today need to do more than react to performance issues; they must be proactive in their database management activities. Proactive
More informationMigrating Within the Cloud, SaaS to SaaS
Migrating Within the Cloud, SaaS to SaaS A Real World Experience COLLABORATIVE WHITEPAPER SERIES COLLABORATIVE WHITE PAPER SERIES: Migrating Within the Cloud, SaaS to SaaS How do you know when a technology
More informationiworks healthcare Managed IT services
iworks healthcare Managed IT services SunGard s iworks HEALTHCARE: Managed IT Services Organizations around the globe face an array of critical issues in today s business environment. Economic conditions
More informationMigrating Applications to the Cloud: Assessing Performance and Response Time Requirements
Migrating Applications to the Cloud: Assessing Performance and Response Time Requirements October, 2014 Contents Acknowledgements... 3 Considerations and Motivations... 4 Migration Roadmap... 6 Step 1
More informationMonitoring Best Practices for COMMERCE
Monitoring Best Practices for COMMERCE OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems
More informationMonitoring Best Practices for
Monitoring Best Practices for OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems like Magento,
More informationOpenbravo Services for Partners
Openbravo for Partners A pure channel organization devoted to Partner success # Devoted to Partner Success Openbravo for Partners are especially designed to accelerate partners practice towards business
More informationWHAT WE NEED TO START THE PERFORMANCE TESTING?
ABSTRACT Crystal clear requirements before starting an activity are always helpful in achieving the desired goals. Achieving desired results are quite difficult when there is vague or incomplete information
More informationApplication Performance Testing Basics
Application Performance Testing Basics ABSTRACT Todays the web is playing a critical role in all the business domains such as entertainment, finance, healthcare etc. It is much important to ensure hassle-free
More informationIncreasing Business Efficiency and Agility for ATGbased. Systems. the business challenge: upgrading the development pipeline
Increasing Business Efficiency and Agility for ATGbased ecommerce Systems This case study follows a Tier 1 retailer migrating to an ATG-based ecommerce platform and upgrading its software development process
More informationCisco Unified Communications and Collaboration technology is changing the way we go about the business of the University.
Data Sheet Cisco Optimization s Optimize Your Solution using Cisco Expertise and Leading Practices Optimizing Your Business Architecture Today, enabling business innovation and agility is about being able
More informationMaster the Might of the Hybrid Cloud
Reach for the Sky Master the Might of the Hybrid Cloud WHITE PAPER As an IT decision maker at a global enterprise, you face unique challenges in managing a complex infrastructure with varied resources
More informationThe Top 10 Reasons Why You Need Synthetic Monitoring
WHITE PAPER: WEB PERFORMANCE MANAGEMENT The Top 10 Reasons Why You Need Synthetic Monitoring A complete view of the application delivery chain (ADC) is required to optimize the performance and availability
More informationWhite Paper. How to Achieve Best-in-Class Performance Monitoring for Distributed Java Applications
White Paper How to Achieve Best-in-Class Performance Monitoring for Distributed Java Applications July / 2012 Introduction Critical Java business applications have been deployed for some time. However,
More informationReady, Set, Go! or Slow?
Leveraging the Cloud for On-Demand Performance Testing COLLABORATIVE WHITEPAPER SERIES New user behaviors that businesses are introducing to their web sites are driving more volume than ever before. Product
More informationHow To Test For Elulla
EQUELLA Whitepaper Performance Testing Carl Hoffmann Senior Technical Consultant Contents 1 EQUELLA Performance Testing 3 1.1 Introduction 3 1.2 Overview of performance testing 3 2 Why do performance testing?
More informationFrom Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development
From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development Introduction Today s developers are under constant pressure to launch killer apps and release enhancements as
More informationBusiness Transformation for Application Providers
E SB DE CIS IO N GUID E Business Transformation for Application Providers 10 Questions to Ask Before Selecting an Enterprise Service Bus 10 Questions to Ask Before Selecting an Enterprise Service Bus InterSystems
More informationOracle s Primavera P6 Enterprise Project Portfolio Management
Oracle s Primavera P6 Enterprise Project Portfolio Management Oracle s Primavera P6 Enterprise Project Portfolio Management is the most powerful, robust and easy-to-use solution for prioritizing, planning,
More information4 Steps to Surviving Big Data
4 Steps to Surviving Big Data As big data projects slam network performance, network managers must be ready for the challenges they bring. There s No Doubt that Big Data is a Big Deal to Companies Today
More informationBusiness Intelligence & Data Warehouse Consulting
Transforming Raw Data into Business Results In the rapid pace of today's business environment, businesses must be able to adapt to changing customer needs and quickly refocus resources to meet market demand.
More informationTIBCO Live Datamart: Push-Based Real-Time Analytics
TIBCO Live Datamart: Push-Based Real-Time Analytics ABSTRACT TIBCO Live Datamart is a new approach to real-time analytics and data warehousing for environments where large volumes of data require a management
More informationCrossing the DevOps Chasm
SOLUTION BRIEF Application Delivery Solutions from CA Technologies Crossing the DevOps Chasm Can improved collaboration and automation between Development and IT Operations deliver business value more
More informationI D C M A R K E T S P O T L I G H T. P r i va t e a n d H yb r i d C l o u d s E n a b l e New L e ve l s o f B u s i n e s s and IT Collaboration
I D C M A R K E T S P O T L I G H T P r i va t e a n d H yb r i d C l o u d s E n a b l e New L e ve l s o f B u s i n e s s and IT Collaboration September 2013 Adapted from IDC Maturity Model: Cloud A
More informationAn Oracle White Paper June, 2013. Enterprise Manager 12c Cloud Control Application Performance Management
An Oracle White Paper June, 2013 Enterprise Manager 12c Cloud Control Executive Overview... 2 Introduction... 2 Business Application Performance Monitoring... 3 Business Application... 4 User Experience
More informationBuilding a Converged Infrastructure with Self-Service Automation
Building a Converged Infrastructure with Self-Service Automation Private, Community, and Enterprise Cloud Scenarios Prepared for: 2012 Neovise, LLC. All Rights Reserved. Case Study Report Introduction:
More informationCisco Data Center Optimization Services
Cisco Data Center Optimization Services Evolve your data center solutions to support business growth, deliver nextgeneration services, and maintain competitive advantage with Cisco Data Center Optimization
More informationIBM Tivoli Netcool network management solutions for enterprise
IBM Netcool network management solutions for enterprise The big picture view that focuses on optimizing complex enterprise environments Highlights Enhance network functions in support of business goals
More informationCONSULTING SERVICES Managed IT services
CONSULTING SERVICES Managed IT services CONSULTING SERVICES Organizations around the globe face an array of critical issues in today s business environment. Economic conditions are requiring significant
More informationWhite Paper. Fundamentals of Performance Testing
etri White Paper Fundamentals of Performance Testing The Increasing Need for Proper Performance Testing due to Increasing Software Complexity in the Enterprise There have been two significant changes in
More informationSharePoint as a Business Application, Not Just a Collaboration Tool
SharePoint as a Business Application, Not Just a Collaboration Tool Products, Projects, Services and Work in One System Published March, 2013 http://epmlive.com Contents Introduction...2 Common Uses of
More informationWhite paper: Unlocking the potential of load testing to maximise ROI and reduce risk.
White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. Executive Summary Load testing can be used in a range of business scenarios to deliver numerous benefits. At its core,
More informationData Center Performance Insurance
Data Center Performance Insurance How NFS Caching Guarantees Rapid Response Times During Peak Workloads November 2010 2 Saving Millions By Making It Easier And Faster Every year slow data centers and application
More informationMonitoring Best Practices for
Monitoring Best Practices for OVERVIEW Providing the right level and depth of monitoring is key to ensuring the effective operation of IT systems. This is especially true for ecommerce systems like Magento,
More information5 Steps to Choosing the Right BPM Suite
5 Steps to Choosing the Right BPM Suite BPM Suites can deliver significant business benefits and a fast ROI but only if you choose the right one By Laura Mooney, Metastorm Copyright 2009, Metastorm Inc.
More informationBuilding an Excellent Relationship with your Cloud-Based Contact Center Infrastructure Vendor. April 2014
Building an Excellent Relationship with your Cloud-Based Contact Center Infrastructure Vendor April 2014 Sponsored by: - 1 - DMG Consulting LLC Table of Contents Introduction... 1 Cloud-Based Contact Center
More informationBUSINESS IMPACT OF POOR WEB PERFORMANCE
WHITE PAPER: WEB PERFORMANCE TESTING Everyone wants more traffic to their web site, right? More web traffic surely means more revenue, more conversions and reduced costs. But what happens if your web site
More informationField Service in the Cloud: Solving the 5 Biggest Challenges of Field Service Delivery
Field Service in the Cloud: Solving the 5 Biggest Challenges of Field Service Delivery The ServiceMax Whitepaper Executive Summary The time has come for field service organizations to also reap the benefits
More informationTop five lessons learned from enterprise hybrid cloud projects
Top five lessons learned from enterprise hybrid cloud projects Top performer highlights More than half of top performers give users access to selfservice provisioning across both private and public cloud
More informationFive steps to improving the customer service experience
Five steps to improving the customer service experience Metrics, tips, and tools for utilizing customer feedback An Ovum White Paper Sponsored by Publication Date: January 2012 INTRODUCTION As the use
More informationORACLE FINANCIAL SERVICES ANALYTICAL APPLICATIONS INFRASTRUCTURE
ORACLE FINANCIAL SERVICES ANALYTICAL APPLICATIONS INFRASTRUCTURE KEY FEATURES Rich and comprehensive business metadata allows business users to interact with financial services data model to configure
More informationScaling Healthcare Applications to Meet Rising Challenges of Healthcare IT
Scaling Healthcare Applications to Meet Rising Challenges of Healthcare IT December 2013 Copyright 2013 GigaSpaces. All Rights Reserved. Healthcare IT has entered the era of Big Data. Are your applications
More informationPredictive analytics with System z
Predictive analytics with System z Faster, broader, more cost effective access to critical insights Highlights Optimizes high-velocity decisions that can consistently generate real business results Integrates
More informationElegantJ BI. White Paper. The Enterprise Option Reporting Tools vs. Business Intelligence
ElegantJ BI White Paper The Enterprise Option Integrated Business Intelligence and Reporting for Performance Management, Operational Business Intelligence and Data Management www.elegantjbi.com ELEGANTJ
More informationCloud Lifecycle Management
Cloud Lifecycle Managing Cloud Services from Request to Retirement SOLUTION WHITE PAPER Table of Contents EXECUTIVE SUMMARY............................................... 1 CLOUD LIFECYCLE MANAGEMENT........................................
More informationRed Hat Enterprise Linux: The ideal platform for running your Oracle database
Red Hat Enterprise Linux: The ideal platform for running your Oracle database 2 Introduction 2 Scalability 2 Availability 3 Reliability 4 Manageability 5 Red Hat subscriptions 6 Conclusion www.redhat.com
More informationTools for Testing Software Architectures. Learning Objectives. Context
Tools for Testing Software Architectures Wolfgang Emmerich Professor of Distributed Computing University College London http://sse.cs.ucl.ac.uk Learning Objectives To discuss tools to validate software
More informationCloud Infrastructure Services for Service Providers VERYX TECHNOLOGIES
Cloud Infrastructure Services for Service Providers VERYX TECHNOLOGIES Meeting the 7 Challenges in Testing and Performance Management Introduction With advent of the cloud paradigm, organizations are transitioning
More informationWHITE PAPER. iet ITSM Enables Enhanced Service Management
iet ITSM Enables Enhanced Service Management iet ITSM Enables Enhanced Service Management Need for IT Service Management The focus within the vast majority of large and medium-size companies has shifted
More informationOpen Source Business Rules Management System Enables Active Decisions
JBoss Enterprise BRMS Open Source Business Rules Management System Enables Active Decisions What is it? JBoss Enterprise BRMS provides an open source business rules management system that enables active
More informationCS 389 Software Engineering. Lecture 2 Chapter 2 Software Processes. Adapted from: Chap 1. Sommerville 9 th ed. Chap 1. Pressman 6 th ed.
CS 389 Software Engineering Lecture 2 Chapter 2 Software Processes Adapted from: Chap 1. Sommerville 9 th ed. Chap 1. Pressman 6 th ed. Topics covered Software process models Process activities Coping
More informationEnd-to-End E-Clinical Coverage with Oracle Health Sciences InForm GTM
End-to-End E-Clinical Coverage with InForm GTM A Complete Solution for Global Clinical Trials The broad market acceptance of electronic data capture (EDC) technology, coupled with an industry moving toward
More informationWeight on That Business Report
COLLABORATIVE WHITEPAPER SERIES A critical phase of any performance engineering project is the key performance indicator (KPI) definition phase. A business analyst works with key stakeholders to determine
More informationWhite Paper: Assessing Performance & Response Time Requirements
White Paper: Assessing Performance & Response Time Requirements Mark Houghtlin IBM Cloud Advisory Services & Application Performance Optimization Consulting Practice Agenda Workload Transformation Analysis
More informationRemote Management Services Portfolio Overview
Enterprise environments today have various technologies and concerns in their network environment; from telephony, Internet, video, compute, and infrastructure, to regulatory and security management. On
More informationIPT 2015 Sales & Use Tax Symposium Indian Wells, CA. Tax Accrual Data Analytics Dashboards to Minimize Risk
IPT 2015 Sales & Use Tax Symposium Indian Wells, CA Tax Accrual Data Analytics Dashboards to Minimize Risk Presenters Holly Hamby Weatherford IT Director Tax Holly.Hamby@weatherford.com Les Jackson Deloitte
More informationEvolv Technology & Support Delivers Platform Updates & Customer Support Insights
Ahead of the Change, Ahead of the Curve Evolv Technology & Support Delivers Platform Updates & Customer Support Insights Craig Lovell VP of Product Development Sandrine Moreau VP of Customer Support Agenda
More informationBuilding Your CRM Short List: What You Need to Know Before You Buy
Building Your CRM Short List: What You Need to Know Before You Buy Nov. 28, 2007 Moderator: Matt Villano, senior contributing editor, Campus Technology Introduction Agenda Building your CRM shortlist:
More informationPerformance Test Process
A white Success The performance testing helped the client identify and resolve performance bottlenecks which otherwise crippled the business. The ability to support 500 concurrent users was a performance
More informationORACLE HYPERION PLANNING
ORACLE HYPERION PLANNING ENTERPRISE WIDE PLANNING, BUDGETING, AND FORECASTING KEY FEATURES Hybrid data model facilitates planning, analysis and commentary Flexible workflow capabilities Reliability with
More informationAutomation, Efficiency and Scalability in Securities Back Office Processing An implementer's view
Automation, Efficiency and Scalability in Securities Back Office Processing An implementer's view Arnab Debnath CEO, Anshinsoft Corp. Presentation Outline Perspective on back office automation (STP) Modular,
More informationNorth American Electric Reliability Corporation (NERC) Cyber Security Standard
North American Electric Reliability Corporation (NERC) Cyber Security Standard Symantec Managed Security Services Support for CIP Compliance Overviewview The North American Electric Reliability Corporation
More informationEnhancing Business Performance Through Innovative Technology Solutions
Enhancing Business Performance Through Innovative Technology Solutions Contact Center = Customer Experience FIELD SERVICE Customer Service BACK OFFICE CONTACT CENTER BRANCH OFFICE Help Desk HR Finance
More informationThe Production Cloud
The Production Cloud The cloud is not just for backup storage, development projects and other low-risk applications. In this document, we look at the characteristics of a public cloud environment that
More informationAn enterprise- grade cloud management platform that enables on- demand, self- service IT operating models for Global 2000 enterprises
agility PLATFORM Product Whitepaper An enterprise- grade cloud management platform that enables on- demand, self- service IT operating models for Global 2000 enterprises ServiceMesh 233 Wilshire Blvd,
More informationAn Oracle White Paper February 2010. Rapid Bottleneck Identification - A Better Way to do Load Testing
An Oracle White Paper February 2010 Rapid Bottleneck Identification - A Better Way to do Load Testing Introduction You re ready to launch a critical Web application. Ensuring good application performance
More informationHP Service Manager software
HP Service Manager software The HP next generation IT Service Management solution is the industry leading consolidated IT service desk. Brochure HP Service Manager: Setting the standard for IT Service
More informationService Virtualization:
Service Virtualization: Reduce the time and cost to develop and test modern, composite applications Business white paper Table of contents Why you need service virtualization 3 The challenges of composite
More informationBuilding an AWS-Compatible Hybrid Cloud with OpenStack
Building an AWS-Compatible Hybrid Cloud with OpenStack AWS is Transforming IT Amazon Web Services (AWS) commands a significant lead in the public cloud services market, with revenue estimated to grow from
More informationApplication Performance Management
Application Performance Management Intelligence for an Optimized WAN xo.com Application Performance Management Intelligence for an Optimized WAN Contents Abstract 3 Introduction 3 Business Drivers for
More informationSytorus Information Security Assessment Overview
Sytorus Information Assessment Overview Contents Contents 2 Section 1: Our Understanding of the challenge 3 1 The Challenge 4 Section 2: IT-CMF 5 2 The IT-CMF 6 Section 3: Information Management (ISM)
More informationOPTIMIZING PERFORMANCE IN AMAZON EC2 INTRODUCTION: LEVERAGING THE PUBLIC CLOUD OPPORTUNITY WITH AMAZON EC2. www.boundary.com
OPTIMIZING PERFORMANCE IN AMAZON EC2 While the business decision to migrate to Amazon public cloud services can be an easy one, tracking and managing performance in these environments isn t so clear cut.
More informationCustomers award top satisfaction scores to IBM System x x86 servers. August 2014 TBR T EC H N O LO G Y B U S I N ES S R ES EAR C H, I N C.
Customers award top satisfaction scores to IBM System x x86 servers August 2014 TBR T EC H N O LO G Y B U S I N ES S R ES EAR C H, I N C. IBM System x satisfaction scores surpass those of competing vendors
More informationBusiness Support System (BSS) Service Offering
Business Support System (BSS) Service Offering Focus Areas Social CRM Service Creation Telco 2.0 BSS Technologies and Solutions BSS Focus Areas Data Management BSS Business Areas BSS Processes and Systems
More informationEMC IT AUTOMATES ENTERPRISE PLATFORM AS A SERVICE
EMC IT AUTOMATES ENTERPRISE PLATFORM AS A SERVICE Self-service portal delivers ready-to-use development platform in less than one hour Application developers order from online catalog with just a few clicks
More informationStephen Miles. Transform IT assets to Drive Business Service Innovation. CA Expo Hong Kong. Vice President - Service Assurance Asia Pacific & Japan
Stephen Miles Vice President - Service Assurance Asia Pacific & Japan CA Expo Hong Kong 21 September, 2012 Transform IT assets to Drive Business Service Innovation The age of innovation has arrived CLOUD
More informationAligning Quality Management Processes to Compliance Goals
Aligning Quality Management Processes to Compliance Goals MetricStream.com Smart Consulting Group Joint Webinar February 23 rd 2012 Nigel J. Smart, Ph.D. Smart Consulting Group 20 E. Market Street West
More informationOracle Hyperion Planning
Oracle Hyperion Planning Oracle Hyperion Planning is an agile planning solution that supports enterprise wide planning, budgeting, and forecasting using desktop, mobile and Microsoft Office interfaces.
More information10 Best Practices for Application Performance Testing
Business white paper 10 Best Practices for Application Performance Testing Leveraging Agile Performance Testing for Web and Mobile Applications 10 Best Practices for Application Performance Testing Table
More informationTableau Server Scalability Explained
Tableau Server Scalability Explained Author: Neelesh Kamkolkar Tableau Software July 2013 p2 Executive Summary In March 2013, we ran scalability tests to understand the scalability of Tableau 8.0. We wanted
More informationAccelerate Your Enterprise Private Cloud Initiative
Cisco Cloud Comprehensive, enterprise cloud enablement services help you realize a secure, agile, and highly automated infrastructure-as-a-service (IaaS) environment for cost-effective, rapid IT service
More information<risk> Enterprise Risk Management
Global Resources... Local Knowledge is vital in supporting business continuity across diverse and challenging environments and operating models. By consolidating risk management activities into a single,
More informationManufacturing Strategies that Win: Executive View of the Cloud Executive Brief
Technology Evaluation Centers Executive Summary To date, manufacturers have been slow to embrace cloud computing. But the proven success of cloud-based solutions, coupled with the promise of a less expensive
More informationIT as a Service Emerges as a New Management Paradigm in the Software-Defined Datacenter Era
Customer Needs and Strategies IT as a Service Emerges as a New Management Paradigm in the Software-Defined Datacenter Era Mary Johnston Turner IDC OPINION IT as a service (ITaaS) represents a fundamentally
More informationSOLUTION WHITE PAPER. Building a flexible, intelligent cloud
SOLUTION WHITE PAPER Building a flexible, intelligent cloud Table of Contents Executive summary 1 Building a hybrid cloud 2 Provision complete cloud services 3 Service catalog 3 The user portal 4 Multi-tier
More informationLombardi Whitepaper: Why You (Probably) Cannot Afford to Use IBM for BPM. Why You (Probably) Cannot Afford to Use IBM for BPM
Why You (Probably) Cannot Afford to Use IBM for BPM 1 Why You (Probably) Cannot Afford to Use IBM for BPM You have a project that seems like a good fit for Business Process Management (BPM). And you re
More informationAutomate performance testing to predict system behaviour and improve application performance. Business white paper
Automate performance testing to predict system behaviour and improve application performance Business white paper Table of contents Executive summary... 3 What is performance testing?... 4 Why automate
More informationEMC PERSPECTIVE. The Private Cloud for Healthcare Enables Coordinated Patient Care
EMC PERSPECTIVE The Private Cloud for Healthcare Enables Coordinated Patient Care Table of Contents A paradigm shift for Healthcare IT...................................................... 3 Cloud computing
More informationSoftware development for the on demand enterprise. Building your business with the IBM Software Development Platform
Software development for the on demand enterprise Building your business with the IBM Software Development Platform An on demand business is an enterprise whose business processes integrated end-to-end
More informationMaking the Most of Your Enterprise Reporting Investment 10 Tips to Avoid Costly Mistakes
Making the Most of Your Enterprise Reporting Investment 10 Tips to Avoid Costly Mistakes Making the Most of Your Enterprise Reporting Investment 10 Tips to Avoid Costly Mistakes Charts, graphs, tables,
More informationPayment Card Industry Data Security Standard
Symantec Managed Security Services support for IT compliance Solution Overview: Symantec Managed Services Overviewview The (PCI DSS) was developed to facilitate the broad adoption of consistent data security
More informationCommercial Software Licensing
Commercial Software Licensing CHAPTER 4: Prepared by DoD ESI January 2013 Chapter Overview Publishers generally create one or more of three major types of software products: Applications software for transactions,
More informationRapid Bottleneck Identification A Better Way to do Load Testing. An Oracle White Paper June 2009
Rapid Bottleneck Identification A Better Way to do Load Testing An Oracle White Paper June 2009 Rapid Bottleneck Identification A Better Way to do Load Testing. RBI combines a comprehensive understanding
More informationJBoss EntErprisE BrMs www.jboss.com
JBoss Enterprise BRMS Open Source Business Rules Management System Enables Active Decisions What is it? JBoss Enterprise BRMS provides an open source business rules management system that enables active
More informationElastic Application Platform for Market Data Real-Time Analytics. for E-Commerce
Elastic Application Platform for Market Data Real-Time Analytics Can you deliver real-time pricing, on high-speed market data, for real-time critical for E-Commerce decisions? Market Data Analytics applications
More informationOptimos Enterprise Helpdesk Automation Solution Case Study
Optimos Enterprise Helpdesk Automation Solution Case Study IT Help Central National Science Foundation Optimos Incorporated 4455 Brookfield Corporate Drive Chantilly, VA 20151 Telephone: (703) 488-6900
More informationMoving to the Cloud Eric Tamblyn, VP Global Product Innovations
Moving to the Cloud Eric Tamblyn, VP Global Product Innovations G-Force Seattle-2012 1 What is a Cloud Solution? A Network or web-based service End-user flexibility to choose Applications & features Usage
More informationIntroduction. Software Development and Change Management Recommendations
Introduction This document was created by a joint working group of the Futures Industry Association ( FIA ) Principal Traders Group and the FIA European Principal Traders Association (collectively FIA
More information