Going mobile: Keys to the successful performance of your mobile application Shane Evans, HP Product Manager Todd DeCapua, Shunra VP Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Mobile creates business disruptions Location-aware, finds free bikes and places to park bikes in Paris Transfer money from phone to phone app Check in, change and monitor flights 3
Mobile performance affects brand value 4
Why does it matter? Business Impact Mobile app performance impacts conversion, revenue and brand equity Conversion and Revenue Brand Equity Delay Bounce Rate Conversion Rate Cart Size Page Views +0.2s +0.5s +4.7% -1.9% -5.7% +1.0s +8.3% -3.5% -2.1% -9.4% 5
Shunra NV for HP delivers ROI in under 90 days* TechValidate Survey (February 2013) A Global 500 bank reduced performance incidents by over 70% A large, enterprise financial services company reduced testing time and accelerated application delivery by 30-40% A computer software company improved application performance / response time by 51-70% On average, Shunra NV customers save over $514,800 annually in remediation costs alone. * *Source: 2011 Shunra for HP Customer Survey Improve application response times by 51-70%++ Accelerate application delivery cycles by up to 40% Reduce performance issues in production by up to 70% 6
Key areas affecting Mobile Performance Rendering Network Backend 7
Mobile Impacts ALL Users No mobile users Mobile <2% users 8
Challenges: Application complexity drives user experience 3 rd Party Customers Cloud Services Major ISP Load Balancers Web Servers App Servers DB Servers Mainframe Employees Storage Browsers& Devices Mobile Carriers & ISPs Content Delivery Networks Web Services Mobile Components Increased complexity, means multiple points of performance failure Many IT projects fail due to improper testing The loss due to application performance issues directly costs businesses 9
Impact of the network on test results By not considering actual network conditions, testers can get trapped Without production network conditions With production network conditions Capacity >500 Users Response ~5 Seconds Capacity <200 Users Response ~50 Seconds VS. Inaccurate test results provide a false sense of security. Accurate and reliable test results provide performance confidence. 10
3 steps to mobile performance success 1. Discover and understand real network conditions 2. Recreate real mobile conditions in tests 3. Test and Tune (Analyze and optimize) 11
Testing the App
Mobile Technology Windows PC internet browser feature phones minimal browser Safari browser iphone, ipad Native app itunes store URL UR L URL Hybrid app ft.com HTML4 m.ft.com mobile site ft.com HTML5 responsive design ws.ft.com web services 13
Multiple Approaches Available Browser or hybrid app: Ajax? > TruClient Ajax Mobile scripting protocol using User Agent spoofing Simple > Mobile HTTP/HTML scripting protocol Native app: > Mobile HTTP/HTML scripting protocol Android: No device > Record Emulator using Android Virtual Device (AVD) Have rooted device > Mobile Recorder generate lrpcap to Analyze ios & others: > LoadRunner Proxy on same subnet/wi-fi hub > Record & Analyze WinPcap capture on the mobile app server 14
How to record mobile traffic App and Web Record & Analyze Traffic Analyze Traffic Capture network traffic and create script Capture traffic from Android recording app and create script Record Emulator Capture steps from emulator and create script Proxy Recording Use LR/PC as a proxy and record script TruClient Ajax TruClient mobile web recording 15 HP LoadRunner VuGen11.52
HTTP/HTML Recording Methods Wizard App and Web Record & Analyze Traffic Analyze Traffic Record Emulator Proxy Recording 16 TruClient Ajax HP LoadRunner VuGen11.52
5 different recording methods Choose what works best for you App and Web App web server Record & Analyze Traffic.pcap Network Listener Ad hoc network 17 Analyze Traffic Record Emulator Proxy Recording TruClient Ajax Device Emulator <User Agent > AP K Port 8080 LoadRunner Proxy Port 80/443 ios AP K.lrpcap Android Mobile Recorder 4.1+ w/ root HP LoadRunner VuGen11.5x
Network Conditions
Example: Large US Based Bank (How They Did It) Overall Performance Scenario Planning: 1. Seattle, WA: 15% 2. Los Angeles, CA: 15% 3. Denver, CO: 15% 4. Chicago, IL: 15% 5. Dallas, TX: 15% 6. Philadelphia, PA: 20% 7. London, UK: 2.5% 8. Tokyo, JP: 2.5% 100% Broadband Users Home:35% Mobile Users 3G: 20% Mobile Users 2.5G: 10% Distribution Center Users: 35% Broadband Users Home:75% Mobile Users 3G: 15% Broadband Users Home:75% Mobile Users 2.5G: 10% Mobile Users 3G: 15% Mobile Users 2.5G: 10% Broadband Users Home:15% Mobile Users 3G: 70% Mobile Users 2.5G: 30% Mobile Users 3G: 15% Mobile Users 2.5G: 10% Mobile Users 3G: 30% Enterprise Users HQ: 50% Mobile Users 2.5G: 70% Distribution Center Users: 10% 19 Broadband Users Home:35% Mobile Users 3G: 20% Mobile Users 2.5G: 10% Distribution Center Users: 35% Broadband Users Home:15% Mobile Users 3G: 15% Mobile Users 2.5G: 10% Enterprise Users HQ: 50% Distribution Center Users: 10%
NetworkCatcher Discover production network conditions Export production network conditions for virtualization in the test environment Global Mobile and Broadband Library Searchable library of network profiles from cities around the world Based on millions of data points, refreshed periodically Automatically identifies best-case, worst-case and average network performance over time Flexible network monitor that captures behavior and impairments (latency, jitter, bandwidth, loss) Measures and records conditions for any reachable location using ICPM, TCP or UDP Scheduled recording and automated analysis of network behavior up to 100 monitors can be simultaneously managed for up to 30 days each 20
Shunra NV for HP Software Network virtualization for load testing Native integration leverages HP technology to virtualize users and Shunra s technology to virtualize networks, and then report on their results. Shunra Predictor creates automated, locationbased SLO reports completed in seconds. Select pre-configured network scenarios, import NetworkCatcher results, or create customized topologies Efficiently analyze and review performance reports Understand overall user experience Emulate up to 100 different networks/locations per load generator 21
Shunra NV for HP Software 22
SNV4HP Import from Shunra s Global Library 23 23
Shunra NV for HP Software 24
Analytics Analysis, remediation and optimization Automated optimization recommendations, proven to improve HTTP application performance by up to 40% Automated Performance Scorecard highlights problem transactions SLO/SLA validation Secure analysis with HTTP/HTTPS decode Waterfall diagram for resource analysis (resource size and load time) 25
How to Analyze the Performance of a Mobile App Response Time Analysis 50 48 45 40 35 30 25 20 15 10 5 7 7 15 11 4 3 4 7 14 Wifi 3G Aberdeen Response Time Comparison WiFi Vs. 3G 0 Start Preview Top Chart Select Play Step Time Optimization Score KBs Data 26
How to Analyze the Performance of a Mobile App Waterfall Analysis Waterfall chart for the preview step Blocking downloads CDN resources Still slow for mobile access 27
HP mobile performance testing Comprehensive mobile application performance testing Performance Center or Load Runner Mobile TruClient or Mobile Application Protocol Shunra NV adds real world network conditions UFT Mobile UFT 70-80% of TRT on Network Network Virtualization PC LR Performance mobile protocols: Backend monitoring: Sitescope / diagnostics 28
How to succeed? Simple answer: virtualization Customers VU 3 rd Party Cloud Services SV SV VU NV SV Major ISP Load Balancers Web Servers App Servers DB Servers Mainframe Employees VU Browsers& Devices NV Mobile Carriers & ISPs Content Delivery Networks Web SV Services Mobile Components SV Storage Virtualized users (VU) Network virtualization (NV) Virtualized services (SV) 29
Summary Mobile performance is critical The network has a huge impact Virtualize to simplify Measure and recreate realistic network conditions Record mobile traffic to create realistic scenarios Test, Tune, Analyze and optimize 30
Download this presentation! Use HP Autonomy s Augmented Reality (AR) to download this presentation 1. Launch the HP Autonomy AR app* 2. View this slide through the app 3. Download the presentation! *Available on the App Store and Google Play 31
For more information Attend these sessions Visit these demos After the event Session Id, name 11 pt. HP Simplified Session Id, name Demo name, Demo number 11 pt. HP Simplified Demo name, Demo number Contact your sales rep Visit the website/facebook/twitter at: <insert URL here> Download the whitepaper at: <insert URL here> Your feedback is important to us. Please take a few minutes to complete the session survey. 32
Thank you