LOAD IMPACT. On-Demand Performance Testing

Transcription

1 LOAD IMPACT On-Demand Performance Testing

2 WHY LOAD IMPACT On-demand and automated Cloud-based tool Large-scale load tests GUI, API, SDKs or CI Plugins 110,000 users + 1 million tests executed We ve even load tested satellites in outer space! Over 10 Years of QA and Testing Experience I don t have to spend a lot of time doing evaluation because Load Impact works so well - Senior Developer, POSSIBLE Load test SDK saved us! Caught a nasty bottleneck before a cutover...would have been very, very bad - Eric Ericsson, Operations Director, Baynote

3 EXPERTS IN MULTI-GEO LOAD GENERATION Dublin, Ireland London, UK Portland, USA Chicago, USA Ashburn, USA SF office Dallas, USA Palo Alto, USA Stockholm headquarters Tokyo, Japan Sao Paulo, Brazil Sao Paulo office Singapore Singapore office Sydney, Australia Powered by: Amazon and Rackspace

4 FOUR THINGS LOAD IMPACT IS GREAT AT Automated testing Always be ready to release great software with our Continuous Delivery load testing solution. Opt for quick installation with our CI plugins or full control with our API and SDKs. API testing Exercise the set of calls documented in your API exactly as your users would. Ensure that resources exposed by the API can be created, listed, updated and deleted appropriately under expected load. Mobile testing Quickly create a load test which simulates different mobile network conditions - such as 3G, 4G, Edge, etc - and easily record mobile user scenarios using our hosted proxy recorder. Web & web app testing Easily load test your website or web app. Record user scenarios using our Chrome extension or proxy recorder and configure a test with just a few clicks.

5 WHY LOAD TEST Average website owners overestimate capacity by 3.4 times 68% of website owners experienced performance or stability problems in 2012! 47% of PC visitors and 69% of tablet visitors expect response times equal to or below 2 seconds! 18% of shopping carts are abandoned due to slow website performance Source: Akamai, 2012; Load Impact, 2013, Vanson Bourne, 2012; Tammy Everts, Radware 2013.

6 WHEN TO LOAD TEST Early and Continuously Don't just build right, build the RIGHT things Early and continuous feedback on performance provides agility and adaptability to business strategy as well as resulting software Other reasons to load tests... Website launch Marketing campaign Seasonal traffic spike New feature release Verification of new optimization solution QA and incident management Reality check of enterprise tools

7 WHY AUTOMATE LOAD TESTING Stop wasting time on code tracks that don t meet performance criteria. Automate your load tests and enjoy higher-quality, lower-risk releases. Minimize lead time and human error by automating routine tasks like load testing Evaluate assumptions prior to release by performance testing systems under realistic load Don t do things the hard way. Build team confidence in the stability of every release.

8 HOW LOAD TESTING WORKS Load Impact Simulated Users/ Load Generators Internet Load Balancer Web Servers Application Servers Database Server Install the Load Impact Server Metrics Agent on target machines.

9 WE MEASURE BACKEND RESOURCES TOO Our Server Metrics Agent collects information on CPU usage, Memory usage, Disk I/O and Network I/O during testing. We also work well with the Nagios plugins system. *Full list of supported servers: loadimpact.com/server-monitoring

10 AUTOMATE AND CONTINUOUSLY DELIVER Always be ready to release great software with our easy to install, automated load testing solution Our place in your continuous delivery Pipeline Server Metrics Agent Simultaneous multi-geo load generation Advanced scripting Google Analytics integration Coming soon! Multiple user scenarios TomCat, Apache, NGINX compatibility Coming soon! Session recorder Performance trending Coming soon!

11 LOAD IMPACT CONTINUOUS DELIVERY Easy to install COMING SOON Flexibility and control

12 CONTINUOUS DELIVERY INTEGRATION WORKFLOW For Continuous Delivery, integrate Load Impact to run automatically after deployment to staging and before user acceptance testing Check-in code Build Run unit, integration, and other tests Deploy to staging or production-copy environment Run Load Impact load test Deploy to production environment

13 THE ANATOMY OF A LOAD IMPACT TEST Datastore User Scenarios Test Configuration Test Results

14 GET STARTED IN MINUTES Start testing using our GUI at loadimpact.com or integrate using our API, SDKs or CI plugins Select subscription level Get API token Select implementation method Configure tests Start testing (GUI, API, SDK or CI plugins)

15 LOAD IMPACT FEATURE SPECIFICATIONS Features Load Impact Comments Max concurrent users Up to 1.2 million concurrent users Load Impact VUs load objects in parallel, like a browser Max test time Unlimited Number of data series 16+ Data points for each URL and each point in time Sever Metrics data series 4+ CPU, RAM, disk and network usage. Add Nagios plugins. API access Configure, run tests, and extract results using our REST Schedule single test run or recurring tests API or our Daily, weekly, monthly tests. Recurring tests unlimited Mobile network emulation Max URL s per test Unlimited Full network emulation: 3G, 4G, Edge, etc. mobile browser behavior (Safari and Chrome) Multiple user scenarios in same test Up to 10 different regions in a single test Multi-step testing Dynamic scripts Advanced scripting using Lua script engine Custom HTTP headers HTTP verbs GET, POST, PUT, HEAD, DELETE, OPTIONS, TRACE, PATCH Request parameters Multiple test locations Up to 12 regions. Powered by Rackspace and Amazon Simultaneous multi-geo load generation In one single test, generate load from 10 different regions Overall response time reporting Response time per content type and URL In-test logging Custom /etc/hosts on test node Override the information in the public DNS. hostname to a different IP-address. Browser based test recording Create test using Google Analytics Continuous Integration Plugins Jenkins, TeamCity Download complete spec sheet

16 LOAD IMPACT FEATURES Large scale load tests Up to 1.2 million concurrent users. Tests which simulate loads higher than 8000 VUs require a dedicated load testing consultant. Simultaneous multi-geo load generation Generate load from up to 10 different regions, simultaneously. Powered by Amazon and Rackspace. Multiple user scenarios Emulate up to 10 different user types in a single test and get individual measurements for each type Load testing in the cloud No installation required (SaaS) and no license or hardware costs Professional services We configure and run your tests, provide extensive analysis and reporting, and optimization advice Extremely accessible service Instant, on-demand and self-service load testing. No waiting to get access and no long-term contracts Powerful interactive reporting Generate reports with multiple charts containing several measurement metrics for easy correlation

17 LOAD IMPACT FEATURES Cx Server metrics Install our lightweight monitoring agent on the servers you are load testing and get detailed information about resource utilization Automatic script generation Analyze a web page and generate a load script that loads the page just like a browser would. No programming required. Test scheduling Configure your load tests to run in the middle of the night, or to run once per week. You don't have to be around at all. Browser emulation Configure your load test to emulate popular browsers such as Firefox, IE, Chrome, Safari etc. Real-time testing Watch and control your load test in real time. View results as they are coming in Free session recorder Create user scenarios by recording browser behavior. Emulate execution of the script through the mimicking of the resulting requests. Chrome Extension The extension records all of the HTTP(S) requests that your browser makes, creates a script, and automatically uploads it to your Load Impact account, where it can be executed with just one click.

18 CASE STUDY - AKQA Situation Global interactive marketing agency known for creating engagement and experience vs. bombarding web audiences with endless messages Retained to develop new product launch site for large Japanese camera maker, destination site for worldwide premium clothing brand, and new site for Irish singer/activist Bono s AIDS charity Assignments came with specific, different, but equally aggressive performance goals Objectives Insure camera site could handle millions of simultaneous users from around the world within hours of new product launch Identify potential performance problems and bottlenecks for clothing manufacturer s staging environment built to same spec as production environment Make data-based recommendations for infrastructure upgrades to handle June and December traffic peaks for AIDS charity s website Strategy Polled industry colleagues for load testing service recommendations to replace Apache JMeter server performance testing tool Chose Load Impact for ease of setup and use, geographically dispersed testing ability, low cost, and transparent reporting functionality Conduct on-going tests in some cases daily tests of three websites during development Results Found and fixed failing script for camera-maker site; maintained optimal performance at traffic goal +25% Identified source of clothing manufacturer site s horrific performance; enabled CDN and cashing to achieve performance targets Used performance test data to justify CDN purchase for cash-strapped charity

19 Sign up for a free account Run a test with one click! Write code that scales Automated and on-demand performance testing for the DevOps-minded Partial list of customers Mercantil Commercebank Bonnier Digital Byggmax Ushahidi Saatchi & Saatchi Boxer Possible Red Bull Schibsted Media Group Visa JWT Svenska Dagbladet Nvidia Expovision Magine Lindex Libero Tommy Hilfiger Netregistry TV4 O2 AKQA Calvin Klein Brille24.de lynda.com Singapore Exchange Mr Green Earth Hour CA.gov tori.fi Deloitte 3bits Cloud Nine Star Republic Leap Motion loadimpact.com