PERFORMANCE AND LOAD TESTING

Transcription

1 PERFORMANCE AND LOAD TESTING 1. DESCRIPTION OF SERVICE Verizon provides application and infrastructure performance testing services for ecommerce, Enterprise (for example, SAP, Oracle NCA, PeopleSoft, Siebel ), and web based sites. Verizon performs testing services using established and proven test processes using Hewlett Packard, (HP,) LoadRunner generated capacity up to 1.25 MM page views per hour from our load test environment. Verizon and our infrastructure performance testing services have the capabilities of providing Customers with: Redundant hardware failover testing Application and infrastructure stability under load conditions Stress testing a system to its breaking point in order to find bottlenecks or weak links in a Customers ecommerce or internet facing environment(s) The engagement normally takes approximately 8-10 business days and culminates with creation and presentation of test results to the Customer.

2 2. CUSTOMER CHALLENGES Customer Challenges that the Verizon APA service will to address include: Not knowing the root cause of inadequate performance by critical business applications Internal friction and finger pointing for poor application performance without anyone understanding the root cause for poor application performance. Poor application performance usually has 5-8 actual causes, but Customers tend to seek a single root cause as they typically do not understand the true nature of performance issues. Customers need a better alerting system than simply fault management. Performance management tools, in most cases, proactively identify application performance degradation prior to fault management thresholds.

3 3. METHODS AND PROCESS The Verizon Performance & Load Testing service covers activities designed to ensure Verizon meets all offering objectives consistently, efficiently, and effectively. Verizons services therefore, cover all aspects for evaluating, improving, and optimizing your environments performance. In order to be able to perform these tasks, the performance and load testing offering ensures our Customer s understand how Information Technology (IT) delivers services and how IT supports value creation and business innovation. Verizon uses the following repeatable methodologies, Error! Reference source not found., to govern any Customer engagement: Plan Design Implement Operate Manage Figure 1: Verizon s Repeatable Methodology The Verizon repeatable methodology includes: Gathering Performance Test Discovery Document Reviewing the scope of engagement and the Performance Test Discovery Document with our Customer Preparing the Customer s environment, writing applicable test scripts, and performing smoke tests Performing testing Creating Performance Report Presenting the performance testing final report and our findings Addressing remediation recommendations as applicable

4 Verizon will work with each Customer s internal staff or their Trusted Partners to develop the plan to deliver a successful Application Performance Testing and Tuning engagement. Verizon will use the suggested engagement methodology for all activities as shown in Figure 2: Figure 2: The Verizon Engagement Methodology 3.1 DISCOVERY Verizon starts the testing engagement with the Customer filling out Verizon s Performance Test Discovery document. This document collects valuable information pertaining to the opportunity and allows Verizon to forecast the initial scope of the project. Data collected includes, but is not limited to: Application overview Site accessibility Load balancing scheme Browser support Protocols that are used between the customer and web server Business processes accessed Identification of click paths Click path weighting Script think time Miscellaneous testing information

5 3.2 ASSESSMENT AND PLANNING Following review of the discovery document, Verizon will liaise with the customer to address the following factors required to generate meaningful test loads: Any open questions pertaining to the opportunity Walk through general timing Resourcing Test reporting Number of Virtual Users (VUs) During the meeting, Verizon and the customer perform the initial planning and establish an execution time line agreed to, which results in properly scheduling the customers environment as well as Verizon s load test environment. If necessary, with proper access, Verizon resources can monitor and collect performance data from servers and network equipment. 3.3 SCRIPT CREATION Verizon will create HP LoadRunner test scripts and set the script weighting utilizing the information provided in the Performance Test Discovery document. 3.4 SMOKE TEST Verizon will execute a smoke test of the scripts 1-3 days prior to the actual Performance Test. The test will simulate 5-10 users and walk through each test. If changes are necessary, Verizon will update scripts and perform a second smoke test. 3.5 TEST EXECUTION AND DATA COLLECTION Verizon will execute the test scripts during any maintenance window defined by the customer in order to reduce the impact during peak business hours. Prior to the test, Verizon will establish a WebEx and conference bridge for the test team, the customer, etc. During the test, Verizon will collect the test data. 3.6 TEST REPORTING At the completion of test execution, Verizon will collect all comprehensive data for analysis of the Performance Test results. This will include Customer-provided servers and network data. Verizon will then conduct a comprehensive analysis of this data and document our findings in a Performance Test Analysis Report for the load testing conducted.

6 4. OUR EXPERTISE Verizon offers consulting expertise that will enable a holistic review of a Customer s IT and Data Center environment: International Organization for Standardization (ISO) Certified BS Certified Our comprehensive IT capabilities that span the project lifecycle including: Plan Design Implementation Our Global delivery capabilities Our experienced consultants with over 600 industry recognized certifications held by consultants, including The Open Group Architecture Framework (TOGAF ), Control Objectives for Information and Related Technology (COBIT ), Information Technology Infrastructure Library (ITIL ), Six Sigma Our expertise in implementing large, mission-critical applications Our 130 specialized consulting services are available in more than 30 countries Our 500+ Security Consultants are based in 27 countries that speak 25 languages

7 5. CUSTOMER RESPONSIBILITIES In addition to providing access to Customer s premises, the Customer will provide the following documentation and access seventy-two hours prior to the scheduled commencement of this engagement: Performance Test Discovery document. Verizon will provide the template. Access to and commitment from Customer business and IT managers to support data gathering and decision making, which is key to this approach Access to and paper or electronic copies of all Verizon-requested documentation Administrative support to setup data gathering and interviews, coordinate deliverable reviews, and meetings with business and IT managers.

8 6. ADDITIONAL SERVICES Verizon has advisory and cloud capabilities that span the entire life cycle, and can offer customers the ability to choose the solution that best meets their needs. Verizon also offers the following additional services to ensure that customers have a full solution: Application Performance Testing & Tuning Infrastructure & Application Discovery Server Consolidation Assessment & Design Cloud Application Rationalization Virtualization Optimization Cloud Migration Services