LOAD IMPACT. Introduction

Transcription

1 LOAD IMPACT Introduction

2 WHY LOAD IMPACT On-demand and automated Cloud-based tool Large-scale load tests GUI, API, SDKs or CI Plug-ins 110,000 users + 1 million tests executed We ve even load tested satellites in outer space! Over 10 Years of QA and Testing Experience I don t have to spend a lot of time doing evaluation because Load Impact works so well - Senior Developer, Possible Load test SDK saved us! Caught a nasty bottleneck before a cutover...would have been very, very bad - Eric Ericsson, Operations Director, Baynote

3 EXPERTS IN MULTI-GEO LOAD GENERATION Dublin, Ireland London, UK Portland, USA Chicago, USA Ashburn, USA SF office Dallas, USA Palo Alto, USA Stockholm headquarters Tokyo, Japan Sao Paulo, Brazil Singapore Singapore office Sydney, Australia Powered by: Amazon and Rackspace

4 FOUR THINGS WE RE GREAT AT Automated testing Always be ready to release great software with our Continuous Delivery load testing solution. Opt for quick installation with our CI plug-ins or full control with our API and SDKs. API testing Exercise the set of calls documented in your API exactly as your users would. Ensure that resources exposed by the API can be created, listed, updated and deleted appropriately under expected load. Mobile testing Quickly create a load test which simulates different mobile network conditions - such as 3G, 4G, Edge, etc - and easily record mobile user scenarios using our hosted proxy recorder. Web & web app testing Easily load test your website or web app. Record user scenarios using our Chrome extension or proxy recorder and configure a test with just a few clicks.

5 WHY LOAD TEST Average website owners overestimate capacity by 3.4 times 68% of website owners experienced performance or stability problems in 2012! 47% of PC visitors and 69% of tablet visitors expect response times equal to or below 2 seconds! 18% of shopping carts are abandoned due to slow website performance Source: Akamai, 2012; Load Impact, 2013, Vanson Bourne, 2012; Tammy Everts, Radware 2013.

6 WHEN TO LOAD TEST Early and Continuously Don't just build right, build the RIGHT things Early and continuous feedback on performance provides agility and adaptability to business strategy as well as resulting software Other reasons to load tests... Website launch Marketing campaign Seasonal traffic spike New feature release Verification of new optimization solution QA and incident management Reality check of enterprise tools

7 WHY AUTOMATE LOAD TESTING Stop wasting time on code tracks that don t meet performance criteria. Automate your load tests and enjoy higher-quality, lower-risk releases. Minimize lead time and human error by automating routine tasks like load testing Evaluate assumptions prior to release by performance testing systems under realistic load Don t do things the hard way. Build team confidence in the stability of every release

8 HOW LOAD TESTING WORKS Load Impact Simulated Users/ Load Generators Internet Load Balancer Web Servers Application Servers Database Server Install the Load Impact Server Metrics Agent on target machines.

9 THE ANATOMY OF A LOAD IMPACT TEST Datastore User Scenarios Test Configuration Test Results

10 LOAD IMPACT FEATURE SPECIFICATIONS Features Load Impact Comments Max concurrent users Up to 1.2 million concurrent users Load Impact VUs load objects in parallel, like a browser Max test time Unlimited Number of data series 16+ Data points for each URL and each point in time Sever Metrics data series 4+ CPU, RAM, disk and network usage. Add Nagios plugins. API access Configure, run tests, and extract results using our REST Schedule single test run or recurring tests API or our Daily, weekly, monthly tests. Recurring tests unlimited Mobile network emulation Full network emulation: 3G, 4G, Edge, etc. Max URL s per test Unlimited mobile browser behavior (Safari and Chrome) Multiple user scenarios in same test Up to 10 different regions in a single test. Multi-step testing Dynamic scripts Advanced scripting using Lua script engine Custom HTTP headers HTTP verbs GET, POST, PUT, HEAD, DELETE, OPTIONS, TRACE, PATCH Request parameters Multiple test locations Up to 12 regions. Powered by Rackspace and Amazon Simultaneous multi-geo load generation In one single test, generate load from 10 different regions Overall response time reporting Response time per content type Response time per URL In-test logging Custom /etc/hosts on test node Override the information in the public DNS. Browser based test recording hostname to a different IP-address. Create test using Google Analytics Continuous Integration Plugins Jenkins, TeamCity

11 CASE STUDY - AKQA Situation Global interactive marketing agency known for creating engagement and experience vs. bombarding web audiences with endless messages Retained to develop new product launch site for large Japanese camera maker, destination site for worldwide premium clothing brand, and new site for Irish singer/activist Bono s AIDS charity Assignments came with specific, different, but equally aggressive performance goals Objectives Insure camera site could handle millions of simultaneous users from around the world within hours of new product launch Identify potential performance problems and bottlenecks for clothing manufacturer s staging environment built to same spec as production environment Make data-based recommendations for infrastructure upgrades to handle June and December traffic peaks for AIDS charity s website Strategy Polled industry colleagues for load testing service recommendations to replace Apache JMeter server performance testing tool Chose Load Impact for ease of setup and use, geographically dispersed testing ability, low cost, and transparent reporting functionality Conduct on-going tests in some cases daily tests of three websites during development Results Found and fixed failing script for camera-maker site; maintained optimal performance at traffic goal +25% Identified source of clothing manufacturer site s horrific performance; enabled CDN and cashing to achieve performance targets Used performance test data to justify CDN purchase for cash-strapped charity

12 Sign up for a free account Run a test now - FREE! Write code that scales Automated and on-demand load testing for the DevOps-minded Partial list of customers Mercantil Commercebank Bonnier Digital Byggmax Ushahidi Saatchi & Saatchi Boxer Possible Red Bull Schibsted Media Group Visa JWT Svenska Dagbladet Nvidia Expovision Magine Lindex Libero Tommy Hilfiger Netregistry TV4 O2 AKQA Calvin Klein Brille24.de lynda.com Singapore Exchange Mr Green Earth Hour CA.gov tori.fi Deloitte 3bits Cloud Nine Star Republic Leap Motion loadimpact.com