Load Testing an Internet Site

Transcription

1 Load Testing an Internet Site Course Overview Course Title Load Testing and Performance Tuning Methods for Optimizing Web Site Performance Description Maximizing Web site performance is essential for those companies that do business online. While performance monitoring gathers metrics to measure operational performance, load testing emulates an active Web site so that you can assess performance independent of actual users. Load testing controls and structures environmental variables in a way to reveal sources of potential problems. Knowing how and what to monitor, what tools and vantage points to choose for different situations, and how to correlate and analyze reams of performance data to quickly pinpoint and solve performance problems is a complex task for event-driven, highly-distributed Web environments. This course describes load testing for a Web site and explains how to effectively use load testing to identify typical problem areas. It differentiates alternative solutions for each problem area and describes when to use them. The course introduces multiple load-testing tools and discusses how to choose the tool that offers the best price to performance return to satisfy your business needs. Using a demonstration example, the course walks you through a simple loadtesting process that demonstrates how to define scenarios, run load tests, and analyze test results. Course Type Internet-based/OLC Desktop Companion Course Length Estimated time of completion is two hours, depending on your reading speed and the level of detail you desire. Module 1: approximately 15 minutes Module 2: approximately 15 minutes Module 3: approximately 15 minutes Module 4: approximately 15 minutes Module 5: approximately 15 minutes Module 6: approximately 15 minutes Target Audience This course is designed for ebusiness Solution Providers (ebsps), Business Development Managers (BDMs), and Strategic Relations Managers (SRMs). Prerequisite(s) none Course Goal This course is designed to introduce load testing as an essential step in Web site development and to provide a guide to the process of load testing, as well as to educate ebsps, BDMs, SRMs, and other course viewers on the needs, intentions, and technology capabilities of Web site load testing and performance tuning. Course Blueprint Template 1 Rev.0

2 Course Objectives After completing this course, you will be able to: Explain the process of performance tuning. Describe the need for load testing as part of performance tuning. Explain the process of load testing. Identify Web site performance problems and determine effective solutions. Identify available load-testing tools. Instructional Strategy A pre-course assessment and post-course assessment will be administered to determine the participant s pre- and post-course knowledge. Each instructional module will include objectives, presentation of information (text and multimedia), and a review exercise. Animation demonstrating and multimedia exercises reinforcing the dynamic concepts presented in this course is also included wherever applicable. Course Outline 1. Course Introduction Course Overview Course Description Course Type Course Length Target Audience Prerequisite(s) Course Goal Course Objectives Pre- Course Assessment Assess your knowledge of load testing a Web site! This pre-course assessment allows you to gauge your current knowledge and preview the course content. This assessment has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. [Assessment explanations will include references to specific lessons within the modules.] 2. Module 1: Performance Tuning Overview Module Description Once you have developed your Web site, how do you know that it can perform reliably when accessed by thousands of users over the Internet? How can you keep up with increasing traffic on the site, while ensuring that users can still load pages quickly and consistently? Regular performance tuning enables you to optimize performance under evolving business conditions, and ensures that your Web site remains scalable, available, and reliable. Lesson 1 provides an overview of different methods to fine-tune your Web site. Lesson 2 reveals some of the hazards of insufficient performance tuning. Lesson 3 discusses the iterative, top-down nature of the performance-tuning process, and the steps of performance tuning. Duration Approximately 15 minutes Course Blueprint Template 2 Rev.0

3 Module Objectives: After completing this module, you will be able to: Identify three components of tuning a Web site. Explain the benefits of performance tuning. Explain the process of performance tuning. Lesson 1: Overview to Tuning a Web Site Lesson 1 Objective: Identify the components of tuning a Web site. Lesson 1 Outline: 1. Methods of Tuning a Web Site s Performance 1.1. Functional Tuning 1.2. Usability Tuning 1.3. Performance Tuning Lesson 2: Why Tune a Web Site? Lesson 2 Objectives: Explain why performance tuning is a necessary function for any Web site. Describe the potential losses that can occur when a Web site is unavailable. Lesson 2 Outline: 1. Unrealistic Optimism Rules the Business World 2. Consequences of Unavailability 2.1. Potential Lost Revenue When Site is Down or Not Performing 2.2. Solution: Performance Tuning to Meet Performance Goals Lesson 3: Performance Tuning Process Lesson 3 Objective: Explain the major steps of performance tuning. Lesson 3 Outline: 1. Performance Tuning: An Iterative Process 2. Performance Tuning: A Top-down Process 3. Example of Performance Tuning: Initial System Configuration 3.1. Step One: Set Performance Goals 3.2. More Info: Sizing Tools and Sizing Guide 3.3. Step Two: Configure System Hardware and Software 3.4. More Info: Benchmarks 3.5. Step Three: Load Test to Gather Data 3.6. Step Four: Analyze Data to Determine If Performance Goals Are Met 3.7. Step Five: Identify the Source of the Performance Bottleneck 3.8. Step Six: Select a Viable Solution 4. A Valuable Resource: Intel Solution Center and Services 4.1. Intel Solution Center and Services Can Assist With Performance Tuning 5. Performance Tuning Game Module 1 Summary This module introduced three tuning techniques that you can use to validate your Web site s functional, usability, and performance capabilities. You learned that most businesses are overly optimistic about their Course Blueprint Template 3 Rev.0

4 Web site s capabilities, and that performance tuning can make their expectations a reality. Finally, you learned the steps involved in iterative, top-down performance tuning. The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information. Lesson 1.1: Overview to Tuning a Web Site Methods of Tuning a Web Site s Performance (1 of 2) Functional Tuning (1 of 2) Usability Tuning (1 of 2) Performance Tuning (2 of 2) Lesson 1.2: Why Tune a Web Site? Unrealistic Optimism Rules the Business World (1 of 4) Consequences of Unavailability (2 of 4) Potential Lost Revenue When Site Is Down or Not Performing (3 of 4) Solution: Performance Tuning to Meet Performance Goals (4 of 4) Lesson 1.3: Performance Tuning Process Performance Tuning: An Iterative Process (1 of 6) Performance Tuning: A Top-down Process (2 of 6) Example of Performance Tuning: Initial System Configuration (3 of 6) Step 1: Set Performance Goals (3 of 6) Step 2: Configure Hardware and Software (3 of 6) Step 3: Load Test to Gather Data (3 of 6) Step 4: Analyze Data to Determine If Performance Goals Are Met (4 of 6) Step 5: Identify the Source of the Performance Bottleneck (4 of 6) Step 6: Select a Viable Solution (4 of 6) A Valuable Resource: Intel Solution Center and Services (5 of 6) Intel Solution Center and Services Can Assist With Performance Tuning (5 of 6) Performance Tuning Game (6 of 6) Module 1 Review Exercise See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise. [Exercise explanations to include references to specific lessons within the modules.] Break Page + Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the next arrow. + Hidden page 3. Module 2: What is Load Testing? Module Description Load testing emulates an active Web site so that you can assess your Web site s performance independent of actual users, enabling you to give your site a trial run before its release on the Internet. You can test potential workloads over time, minimize response time, identify performance limitations, and further optimize your Web site. Lesson 1 discusses the importance of load testing in the performance-tuning process, and demonstrates the capabilities of load testing as a measuring tool. It explains how automated Course Blueprint Template 4 Rev.0

5 tools simplify the load testing process and enable you to define tests that yield reproducable outcomes. Lesson 2 identifies when in your Web site s life cycle that you should perform load tests. Duration Approximately 15 minutes Module Objectives: After completing this module, you will be able to: Define load testing. List the variables measured by load testing. Describe how load-testing tools are used to measure a Web site s performance. Identify when you should load test your Web site. Lesson 1: Load Testing Overview Lesson 1 Objective: Explain how load testing helps to enhance Web site performance. Lesson 1 Outline: 1. Load Testing: An Integral Part of Performance Tuning 2. A Way to Measure 3. Automated Tools to the Rescue 3.1. Benefits of Automated Load Testing Lesson 2: When to Load Test Lesson 2 Objective: Identify when to perform load tests. Lesson 4 Outline: 1. When to Load Test 2. Pre-deployment Load Testing 3. Post-deployment Load Testing Module 2 Summary Load testing is an integral part of performance tuning and involves applying measurement tools to your Web site. These automated tools can accurately simulate a user load on your Web site and provide information that will help you improve your site s performance. Load testing should be repeated often, both before and after deployment. The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information. Lesson 2.1: Load Testing Overview What is Load Testing? (1 of 4) A Measurement Tool (2 of 4) Automated Tools to the Rescue (3 of 4) Benefits of Automated Load-testing Tools (4 of 4) Lesson 2.2: When to Load Test When to Load Test (1 of 3) Pre-deployment Load Testing (2 of 3) Post-deployment Load Testing (3 of 3) Course Blueprint Template 5 Rev.0

6 Module 2 Review Exercise See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise. [Exercise explanations to include references to specific lessons within the modules.] Break Page + Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the next arrow. + Hidden page 4. Module 3: Load-testing Process Module Description Module 3 expands some of the basic concepts introduced earlier in Modules 1 and 2 with a systematic explanation of the load-testing process. Load testing can help you match your Web site s performance with your goals. Understanding your users and their needs, intentions, and technology capabilities is essential to the load-testing process, as you simulate their interaction with your Web site. Load testing helps you analyze your systems, identify areas that can be improved, implement changes, and test these changes. Lesson 1 provides an overview of the four phases of the load-testing process: definition, planning, preparation, and testing. Lesson 2 helps you define and set your performance, business, and technical goals. Lesson 3 helps you plan your test by specifying your testing objectives, load-testing scenarios, loadtesting strategies, test environments, and load-testing tools appropriate for the job. In Lesson 4, you prepare your testing environment and create the scripts, metrics, and workload models for the workload generation. Lesson 5 outlines the execution of the test. Lesson 6 reviews tasks that follow in the overall performancetuning life cycle. Duration Approximately 15 minutes Module Objectives: After completing this module, you will be able to: Describe each step in the load-testing process. Set performance goals. Define the user workload. Prepare and execute load tests. Lesson 1: Overview of the Load-testing Process Lesson 1 Objective: Identify the four phases in the load-testing process. Lesson 1 Outline: 1. Load-testing Process Lesson 2: Load-testing Process: Definition Phase Lesson 2 Objectives: Describe the definition phase in the load-testing process. Identify factors that should be considered when setting performance goals. Describe the types of users, activities, and connections that can affect workload. Course Blueprint Template 6 Rev.0

7 Lesson 2 Outline: 1. Definition Phase 2. Setting Performance Goals 3. Setting Business Goals: Logical User Model 4. Workload 5. Response Time 6. Navigation Methods 7. Web Site Categories 7.1. Publishing/Subscriber s Sites 7.2. Online Shopping Sites 7.3. Customer Self-service Sites 7.4. Trade/Auction Sites 8. Setting Technical Goals: Hardware and Software Configuration Lesson 3: Load-testing Process: Planning Phase Lesson 3 Objective: Describe how to set up the testing environment Lesson 3 Outline: 1. Planning Phase 2. Setting Load-testing Objectives 3. Load-testing Scenario 4. Defining the Load-testing Scenario: Virtual Users 5. Business-to-consumer Sites Virtual Users 6. Business-to-business Sites Virtual Users 7. Defining the Load-testing Scenario: Activities 8. Business-to-consumer Setes Virtual Users: Activities 9. Business-to-business Sites Virtual Users: Activities 10. Defining the Load-testing Scenario: Connection Speed 11. Load-testing Strategy 12. Test Environment Virtual User Model Testing Equipment Web Site Configurations 13. Load-testing Tools for the Job Lesson 4: Load-testing Process: Preparation Phase Lesson 4 Objectives: Describe the preparation phase in the load-testing process. Identify the steps in creating realistic test scripts. Lesson 4 Outline: 1. Preparation Phase 2. Setting Up the Test Environment 3. Creating Virtual-user Test Scripts 4. Customizing Virtual-user Test Scripts 4.1. WebTrends 5. Modeling User Behavior in Test Scripts 5.1. Think Times Course Blueprint Template 7 Rev.0

8 5.2. System Response Times 5.3. Error Handling 6. Configuring Metrics 7. Defining Statistics 8. Modeling Total Workload Lesson 5: Execute Test and Monitor Run-Time Information Lesson 5 Objective: Describe the testing phase in the load-testing process. Describe how to execute and monitor a load test. Lesson 5 Outline: 1. Testing Phase 2. Executing the Load Test 3. Monitoring Run-time Information Lesson 6: Analyze Results and Modify the System Lesson 6 Objective: Explain the importance of analyzing the load test results. Explain the importance of retesting the system after making changes. Lesson 6 Outline: 1. Analyzing Results and Modifying the System 2. Repeating the Load Test to Validate Changes Module 3 Summary Load testing is a four-phase process: definition, planning, preparation, and testing. In the definition phase, you set performance goals, designate your hardware and software configuration, and build a logical model of potential users. In the planning phase, you use products of the definition phase to set your load-testing objectives, create a load-testing scenario that will meet those objectives, choose a load-testing strategy, design your test environment, and choose load-testing tools for the job. In the preparation phase, you build a model of the workload using the load-testing scenario and load-testing objectives, and the virtual user scripts and performance metrics you configure. In the testing phase, your isolated test environment executes the test to gather performance and capacity statistics about your Web site. After load testing, you analyze the results of the load test and modify your Web site accordingly. The final step is to retest the system to validate the changes you made. The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information. Lesson 3.1: Overview of Load-testing Process Load-testing Process (1 of 1) Lesson 3.2: Load-testing Process: Definition Phase Definition Phase (1 of 5) Setting Performance Goals (1 of 5) Setting Business Goals: Logical User Model (2 of 5) Workload (2 of 5) Response Time (3 of 5) Navigation Methods (3 of 5) Web Site Categories (4 of 5) Publishing/Subscriber Sites (4 of 5) Course Blueprint Template 8 Rev.0

9 Online Shopping Sites (4 of 5) Customer Self-service Sites (4 of 5) Trade/Auction Sites (5 of 5) Setting Technical Goals: Hardware and Software Configuration (5 of 5) Lesson 3.3: Load-testing Process: Planning Phase Planning Phase (1 of 8) Setting Load-testing Objectives (1 of 8) Load-testing Scenario (2 of 8) Defining Load-testing Scenario: Virtual Users (3 of 8) Business-to-consumer Sites Virtual Users (3 of 8) Business-to-business Sites Virtual Users (3 of 8) Defining Load-testing Scenario: Activities (4 of 8) Business-to-consumer Sites Virtual Users: Activities (4 of 8) Business-to-business Sites' Virtual Users: Activities (4 of 8) Defining Load-testing Scenario: Connection Speed (5 of 8) Load-testing Strategy (6 of 8) Test Environment (7 of 8) Virtual User Models (7 of 8) Testing Equipment (7 of 8) Web Site Configurations (7 of 8) Load-testing Tools for the Job (8 of 8) Lesson 3.4: Load-testing Process: Preparation Phase Preparation Phase (1 of 6) Setting Up the Test Environment (1 of 6) Creating Testing Scripts (2 of 6) Customizing Virtual-user Testing Scripts (3 of 6) WebTrends (3 of 6) Modeling User Behavior in Testing Scripts (4 of 6) Think Times (4 of 6) System Response Times (4 of 6) Error Handling (4 of 6) Configuring Metrics (5 of 6) Defining Statistics (5 of 6) Modeling Total Workload (6 of 6) Lesson 3.5: Load-testing Process: Testing Phase Testing Phase (1 of 1) Executing the Load Test (1 of 2) Monitoring Run-time Information (2 of 2) Lesson 3.6: After Load Testing Analyzing Results and Modifying the System Repeating the Load Test to Validate Changes Module 3 Review Exercise See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise. [Exercise explanations to include references to specific lessons within the modules.] Course Blueprint Template 9 Rev.0

10 Break Page + Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the next arrow. + Hidden page 5. Module 4: Performance Problems and Solutions Module Description Before you tune a Web site, you should be familiar with the categories of performance problems and the types of symptoms that those problems manifest. This can help you isolate the problem area to identify bottlenecks and pinpoint viable solutions. This module discusses alternative solutions for each problem area and describes when to use them. Lesson 1 introduces you to symptoms of a Web site with performance problems and to the six different categories of performance issues. Lessons 2, 3, and 4 discuss system-level performance issues and their alternative solutions for servers, network bandwidth, and security. Lessons 5, 6, and 7 discuss system, application, and microarchitecture performance issues and their solutions for the key components of your Web site: Web servers, applications, and databases Duration Approximately 15 minutes Module Objectives: After completing this module, you will be able to: Identify the symptoms of a Web site with performance problems. Explain the types of general performance problems and solutions. Explain how to eliminate bandwidth utilization problems. Explain how to improve Web server performance. Identify Web-site security problems and solutions. Explain how to improve database performance. Explain how to improve application performance. Lesson 1: Performance Problems and Symptoms Lesson 1 Objectives: Identify the symptoms of a Web site with performance problems. Explain the six categories into which performance problems are placed. Lesson 1 Outline: 1. Categorizing Performance Problems 1.1. Distribution of Problems by Category 2. Identifying Performance Problems Lesson 2: General Performance Problems Lesson 2 Objectives: Describe general performance problems. Explain how to resolve general performance problems. Lesson 2 Outline: 1. Identifying General Performance Problems 2. Resolving General Performance Problems Course Blueprint Template 10 Rev.0

11 Lesson 3: Network Bandwidth Problems Lesson 3 Objectives: Identify acceptable bandwidth utilization statistics. Explain how to resolve bandwidth utilization problems. Lesson 3 Outline: 1. Recognizing Bandwidth Problems 2. Monitoring Bandwidth Utilization 3. Resolving Network Bandwidth Problems Lesson 4: Security Problems Lesson 4 Objectives: Identify different security problems. Explain effective security implementations. Lesson 4 Outline: 1. Using Security Technologies 2. Resolving Security and System Resource Problems Lesson 5: Web Server Problems Lesson 5 Objectives: List the problems that commonly affect Web servers. Explain how to resolve each of these problems. Lesson 5 Outline: 1. Identifying the Web Server as the Problem 2. Resolving Memory Problems 3. Resolving Memory Leaks 4. Addressing CPU Utilization Problems 5. Addressing Caching Problems 6. Balancing the Use of Static and Dynamic Content 7. Providing Resources for Web and Application Services Lesson 6: Application Problems Lesson 6 Objectives: Describe the problems of poor application server performance. Describe the problems associated with poor application performance. Explain how to resolve application performance problems. Lesson 6 Outline: 1. Identifying Poor Application Performance 2. Addressing Memory Problems 3. Optimizing Applications 3.1. Intel VTune Performance Analyzer Lesson 7: Database Problems Lesson 7 Objectives: Identify common problems associated with database software and database servers. Describe solutions to improve database performance. Course Blueprint Template 11 Rev.0

12 Lesson 6 Outline: 1. Identifying Database Problems 2. Examining Database Problems 3. Identifying Database Solutions Lesson 8: Identifying Performance Solutions Lesson 8 Objectives: Complete the game by providing the appropriate solution to specific performance problems. Lesson 6 Outline: 1. Identifying Performance Solutions Module 4 Summary Web site performance problems manifest themselves in the following categories of problems: general performance, network bandwidth, security levels and protocols, Web server, application, and database. Module 4 discussed specific issues and solutions within these categories to help you to identify and remedy performance problems and meet your load-testing goals. The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information. Lesson 4.1: Performance Issues and Symptoms Categorizing Performance Problems (1 of 3) Distribution of Performance Problems by Category (2 of 3) Identifying Performance Problems (3 of 3) Lesson 4.2: General Performance Issues Identifying General Performance Problems (1 of 2) Resolving General Performance Problems (1 of 2) Lesson 4.3: Network Bandwidth Problems Recognizing Bandwidth Problems (1 of 3) Monitoring Bandwidth Utilization (2 of 3) Resolving Network Bandwidth Problems (3 of 3) Lesson 4.4: Security Problems Using Security Technologies (1 of 2) Resolving Security and System Resource Problems (2 of 2) Lesson 4.5: Web Server Problems Identifying the Web Server as the Problem (1 of 6) Resolving Memory Problems (2 of 6) Resolving Memory Leaks (3 of 6) Addressing CPU Utilization Problems (4 of 6) Addressing Caching Problems (5 of 6) Balancing the Use of Static and Dynamic Content (5 of 6) Providing Resources for Web and Application Services (6 of 6) Lesson 4.6: Application Problems Identifying Poor Application Performance (1 of 3) Addressing Memory Problems (2 of 3) Optimizing Applications (3 of 3) Intel VTune Performance Analyzer (3 of 3) Course Blueprint Template 12 Rev.0

13 Lesson 4.7: Database Problems Identifying Database Problems (1 of 3) Examining Database Problems (2 of 3) Identifying Database Solutions (3 of 3) Lesson 8: Identifying Performance Solutions Identifying Performance Solutions (1 of 1) Module 4 Review Exercise See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise. [Exercise explanations to include references to specific lessons within the modules.] Break Page + Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the next arrow. + Hidden page 6. Module 5: Evaluating Load-testing and Run-time Monitoring Tools Module Description Now that you understand the methodology behind load testing a Web site, how do you go about selecting a load-testing tool? What are some commonly used tools? Are load-testing tools and run-time monitoring tools packaged together, or are they separate applications? Module 5 answers these questions and also provides a basic set of criteria for evaluating different load-testing and run-time monitoring tools. The criteria will direct you to the product or products that are most appropriate for your load-testing needs. Lesson 1 discusses the criteria for evaluating load-testing tools. Lesson 2 introduces several commonly used load-testing tools and provides usability and cost information for each of them. Finally, Lesson 3 presents criteria for evaluating run-time monitoring tools and provides some basic information about several commonly used run-time monitoring tools. Duration Approximately 15 minutes Module Objectives: After completing this module, you will be able to: Explain the criteria for selecting a load-testing tool. Describe the strengths and weaknesses of the load-testing tools presented in this module. Explain the criteria for selecting a run-time monitoring tool. Describe the level of analysis provided by the run-time monitoring tools presented in this module. Lesson 1: Evaluating Load-testing Tools Lesson 1 Objective: Course Blueprint Template 13 Rev.0

14 Explain the criteria for choosing a load-testing tool. Lesson 1 Outline: 1. Load-testing Tools 2. Criteria for Evaluating Load-testing Tools 2.1. Central Control over Testing 2.2. Ability to Create Automated Users 2.3. Utilities for Further Analysis 2.4. Test Your Entire System 2.5. Support a Wide Variety of Protocols and Technologies 2.6. Openness to New Protocols and Technologies Lesson 2: Common Load-testing Tools Lesson 2 Objective: Describe the strengths and weaknesses of common load-testing tools. Lesson 2 Outline: 1. Common Load-testing Tools 1.1. Empirix e-test Segue SilkPerformer Mercury Interactive Astra LoadTest Compuware QALoad Quest Software Benchmark Factory RadView WebLoad Evaluation of Common Load-testing Tools 2.1. More Info: Pricing Information Lesson 3: Evaluating Run-time Monitoring Tools Lesson 3 Objectives: Describe the different types of run-time monitoring tools. Describe when you would use the different types of run-time monitoring tools. Lesson 3 Outline: 1. Choosing a Run-time Monitoring Tool 2. Types of Run-time Monitoring Tools 2.1. More Info: Server Counters 2.2. More Info: System Counters 2.3. More Info: Web Server Performance Counters 2.4. More Info: Web Service Counters 3. Common Run-time Monitoring Tools 4. Evaluating the Level of Analysis Module 5 Summary When evaluating load-testing tools, make sure that the tools you purchase enable control over testing, automate virtual-user creation, and provide utilities for further analysis. They should allow you the ability to test your entire system, support a wide variety of protocols and technologies, and be designed to provide support new protocols and technologies. This module introduced some of the basic features, advantages, and disadvantages of six commonly used load-testing tools. Course Blueprint Template 14 Rev.0

15 When evaluating run-time monitoring tools, carefully research the monitoring capabilities, data collection methods, and the level of analysis provided by each tool. This module examined several commonly used run-time monitoring tools and briefly discussed the type of analysis each of these tools offers. Remember, when you are determining the purchase of a load-testing or run-time monitoring tool, be sure to select the tool that meets your needs. If you are spending extra money for features that you do not need, you could be spending money that would be better used in testing other parts of your site. The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information. Lesson 5.1: Evaluating Load-testing Tools Load-testing Tools (1 of 3) Criteria for Evaluating Load-testing Tools (2 of 3) Central Control Over Testing (2 of 3) Ability to Create Automated Users (2 of 3) Criteria for Evaluating Load-testing Tools (Continued) (3 of 3) Utilities for Further Analysis (3 of 3) Test Your Entire System (3 of 3) Support a Wide Variety of Technologies and Protocols (3 of 3) Openness to New Technologies and Protocols (3 of 3) Lesson 5.2 Common Load-testing Tools Common Load-testing Tools (1 of 3) Empirix e-test 4.2 (1 of 3) Segue SilkPerformer 4.0 (1 of 3) Mercury Interactive Astra LoadTest 4.0 (2 of 3) Compuware QALoad 4.7 (2 of 3) Quest Software Benchmark Factory 2.5 (2 of 3) RadView WebLoad 4.0 (2 of 3) Evaluation of Common Load-testing Tools (3 of 3) Lesson 5.3: Evaluating Run-time Monitoring Tools Choosing a Run-time Monitoring Tools (1 of 5) Types of Run-time Monitoring Tools (2 of 5) Common Run-time Monitoring Tools (4 of 5) Evaluating the Level of Analysis (5 of 5) Module 5 Review Exercise See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise. [Exercise explanations to include references to specific lessons within the modules.] Break Page + Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the next arrow. + Hidden page 7. Module 6: Load Testing a Web Site Course Blueprint Template 15 Rev.0

16 Module Description This module walks you through a simple example that demonstrates the practical applications of the performance-tuning and load-testing processes. First, you will step through the planning stages of a load test, from setting performance goals to choosing a load-testing tool. Next, you will load test three different system configurations and perform an analysis on a specific set of data retrieved from those tests, identifying performance issues and bottlenecks that occur in each configuration. Finally, you will determine which of these three configurations best meet your performance goals. Lesson 1 discusses how to define, plan, and prepare a load test for the demonstration. Lessons 2, 3, and 4 walk you through three iterations of load testing to familiarize you with points that might arise as you tune your system configuration. Lesson 5 covers issues involved with load testing that you should consider when testing in a more complex Web site configuration. Duration Approximately 15 minutes Module Objectives: After completing this module, you will be able to: Relate the performance-tuning and load-testing processes to a practical example of load testing. Explain how to set up a load test. Analyze practical data from a load test and compare it to performance goals. Choose the most effective solution presented in this demonstration. Lesson 1: Load-test Exercise Introduction Lesson 1 Objectives: Relate the performance-tuning and load-testing processes to a load-testing demonstration exercise. Identify techniques for completing the definition, planning, and preparation phases of the loadtesting process. Lesson 1 Outline: 1. Performance Tuning 2. Load Testing 3. Load Testing: Definition Phase 3.1. Performance Goals 3.2. Hardware and Software Configuration 3.3. Logical User Model 4. Load Testing: Planning Phase 4.1. Load-testing Objectives 4.2. Load-testing Scenario 4.3. Load-testing Strategy 4.4. Test Environment 4.5. Load-testing tools for the Job 5. Load Testing: Preparation Phase 5.1. Create Virtual User Scripts 5.2. Configure Metrics 5.3. Model User Behavior 5.4. Model Total Workload Lesson 2: Initial Configuration Lesson 2 Objective: Course Blueprint Template 16 Rev.0

17 Analyze load testing data and make conclusions from this data. Lesson 2 Outline: 1. Run Test 2. Analyze Data 3. Conclusions Lesson 3: Scaled-out Configuration Lesson 3 Objective: Analyze load-testing data and make conclusions from this data. Lesson 3 Outline: 1. Run Test 2. Analyze Data 3. Conclusions Lesson 4: Scaled-up Configuration Lesson 4 Objective: Analyze load-testing data and make conclusions from this data. Lesson 4 Outline: 1. Run Test 2. Analyze Data 3. Make Conclusions Lesson 5: Load-test Exercise Conclusion Lesson 5 Objectives: Identify the most effective of the three system configurations presented in this module. Explain the importance of maintaining a isolated and consistent test environment. Discuss the term ripple effect as it applies to load testing. Lesson 5 Outline: 1. Conclusions Module 6 Summary In Module 6, you walked through the performance-tuning process and load-testing process, testing several configurations of a simple web site. First you went through the definition, planning, and preparation phases of the load-testing process, identifying objectives, creating user profiles, configuring your test environment, and setting up your load-testing tools. Then you ran load test and analyzed data for an initial two-processor, single-server configuration; a second, scaled-out configuration; and a third, scaled-up configuration. You determined that the scaled-up configuration offered the best performance solution, although it did not completely meet performance goals. In a more extensive test, further tuning would be necessary to fully meet performance goals. A closed, repeatable testing environment is essential to an effective load test. Lesson 6.1: Load-test Exercise Introduction Performance Tuning (1 of 7) Load Testing (2 of 7) Load Testing: Definition Phase (3 of 7) Performance Goals (3 of 7) Hardware and Software Configuration (3 of 7) Logical User Model (3 of 7) Course Blueprint Template 17 Rev.0

18 Load Testing: Planning Phase (4 of 7) Load-testing Objectives (4 of 7) Load-testing Scenario (4 of 7) Load-testing Strategy (Load, Stress, or Capacity) (5 of 7) Test Environment (5 of 7) Load-testing Tools for the Job (5 of 7) Load Testing: Preparation Phase (6 of 7) Create Virtual-user Scripts (6 of 7) Configure Metrics (6of 7) Model User Behavior (7 of 7) Model Total Workload (7 of 7) Lesson 6.2: Initial Configuration Run Load Test (1 of 3) Analyze Data (2 of 3) Make Conclusions (3 of 3) Lesson 6.3: Scaled-out Configuration Run Load Test (1 of 3) Analyze Data (2 of 3) Make Conclusions (3 of 3) Lesson 6.4: Scaled-up Configuration Run Load Test (1 of 3) Analyze Data (2 of 3) Make Conclusions (3 of 3) Lesson 6.5 Load-test Exercise Conclusion Conclusions (1 of 1) Module 6 Review Exercise This review exercise has [#] questions. After answering each of the questions, click on the "Evaluate Exercise" button below. If you choose to, you can retake this exercise multiple times. Exercise explanations to include references to specific lessons within the modules. Break Page + Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the next arrow. + Hidden page 8. Course Summary Course Summary This six-module course has introduced you to the concepts of load testing and performance tuning, as well as the reasons why these functions are important. You have learned the best times to conduct a load test and the specific steps of the process. The course has discussed common performance problems that can be revealed through load testing and suggestions for correcting those problems. Last, the course provided you with some information on several common load-testing tools. Course Blueprint Template 18 Rev.0

19 Post Course Assessment This exercise has [#] questions. After answering all of the questions, click on the "Evaluate Exercise" button below. If you choose to do so, you can retake this exercise. [Assessment explanations to include references to specific lessons within the modules.] Course Evaluation Thank You Page+ + Hidden page Course Blueprint Template 19 Rev.0