Neustar Full-Service Load Testing Seconds delay Seconds delay. 1.0 Seconds delay. When DIY Won t Work.

Transcription

1 Neustar Enterprise Services Service Sheet Neustar Full-Service Load Testing When DIY Won t Work. HIGHLIGHTS: Fully managed service Dedicated engineer Detailed reporting and recommendations Validation from neutral experts EVERY SECOND COUNTS 0.25 Seconds delay All it takes to lose a customer The Value of a Dedicated Engineer If you need to test your website but have limited internal resources, Neustar full-service load testing is a smart choice. A Neustar Professional Services engineer handles it all, from planning, scripting and implementation to execution and analysis. When your testing needs are complex, this level of expertise and hands-on engagement makes a crucial difference. Neustar s engineers have performed thousands of load tests. They use proven methodologies to test beyond the firewall, providing the clearest simulation of real-world performance. With our managed solution, there s no costly software or hardware to install a plus for your development, QA and operational teams, especially towards the end of the software development cycle. Let Neustar do the heavy lifting, so you can focus on site improvements. We ll provide the data and analytics that lead to better decisions Seconds delay Equals a 20% drop in traffic 1.0 Seconds delay Can cause a 7% drop in conversions

2 Neustar Enterprise Services Service Sheet The Testing Process PROJECT MILESTONES: Statement of work Your team and Neustar agree on the scope, deliverables and timing of the project. Script definition and development of application scripts Once you deliver script definitions, Neustar builds and validates the test application scenarios. Test scheduling and execution We do this in collaboration with your development and operational teams. Your Neustar engineer helps to define your testing needs and create a workable schedule. Working with you closely, he or she gathers your requirements, builds the test scenarios, then schedules and runs a series of load tests and analyzes the results. Your engineer works alongside your team to ensure your tests go smoothly, plus answer questions about the results. Your test plans are based on the number of concurrent users outlined in each scenario. Utilizing Neustar s global testing network, we simulate as many logins, registrations and other transactions as needed. Thanks to our cloudbased platform, we can generate loads of virtually any size. You ll discover how many concurrent users your applications can handle at acceptable page load times and error rates. At the conclusion of each test, you get a quick view of the overall results and shortly afterwards, a customized analysis with key takeaways and areas for improvement. Analysis, discussion and final deliverables After evaluating the results, Neustar provides a summary document with key findings and recommendations. Web Server App Server Database Server PROFESSIONAL SERVICES ENGINEER GLOBAL WEBSITE ANALYSIS AND TESTING PLATFORM INTERNET CUSTOMER WEBSITE/APPLICATION PROFESSIONAL PERFORMANCE SUMMARY (EXPERT ANALYSIS)

3 Clear, Detailed Reporting TYPICAL TEST METRICS Summary Results Total page load attempts Total page load failures Total transaction attempts (sequence of pages) Total transaction failures Total data transferred (Mbytes) Average throughput Throughput and total data transferred by interval User load level and ramp schedule You can run as many or as few tests as you need, but we generally recommend a series of three. The first test establishes baselines and areas for improvement. The second and third tests measure and validate your progress. We capture detailed performance statistics and provide easy-to-understand graphs, so you can quickly pinpoint bottlenecks and problems within applications. See your summary results at a glance. View the number of concurrent users applied over time against your website/application.

4 Neustar Enterprise Services Service Sheet BI-INTERVAL RESULTS Each test is divided into distinct intervals, so you can see the impact load is having on your application over time. We provide the following metrics: Page load times compared to noload benchmark Get a quick view of results by interval. Discover the number of successes/failures for each step. Transaction success rate Page successes and errors Transaction load times Page load time ranges Find successful transactions by interval. Zero in by page attempts per interval.

5 Learn page load and transaction times by interval. Learn page load and transaction times by interval. Do statistical analysis to develop confidence. Full-page breakdown displays every item on the page.

6 Neustar Enterprise Services Service Sheet Errors Errors by page Errors by type See a breakdown of errors by page. See a breakdown of errors by type. Track percentage of errors by type (content, timeout, connectivity). Note: Content/application errors are captured and saved for later analysis. Here s an example of a payment processing error that occurred during a test:

7 Analysis and Recommendations After each test iteration, your engineer provides a written summary and analysis. Besides noting key findings, he/she pinpoints problems to the component level (network, router, application or server) and recommends corrective steps. With this information you ll be able to tackle common performance problems like: Bandwidth limitations Error rates exceeding thresholds Server CPU limitations Misconfigured web servers, application servers or database servers Errant load balancing configurations Router/firewall failure or misconfiguration Executive Summary After all tests are completed, your engineer will prepare your executive summary with overall findings and statistics from each test iteration. This document helps you answer important questions like How many transactions can the website support? or How long does the checkout process take when under peak load? Armed with this information, you ll find serious problems before your customers do, plus know exactly how your site performs when it matters most. Instead of leaving things to chance, you ll proactively protect your customer experience.

8 For More Information Call Online About Neustar Neustar, Inc., (NYSE: NSR) is a trusted, neutral provider of real-time information and analysis to the Internet, telecommunications, information services, financial services, retail, media and advertising sectors. Neustar applies its advanced, secure technologies in location, identification, and evaluation to help its customers promote and protect their businesses. More information is available at Ridgetop Circle, Sterling, VA / / Neustar, Inc. All rights reserved. V1-11/08/2012