STeP-IN SUMMIT June 2014 at Bangalore, Hyderabad, Pune - INDIA. Mobile Application Performance: Test Strategies & Enhancement through WPO

Transcription

1 11 th International Conference on Software Testing June 2014 at Bangalore, Hyderabad, Pune - INDIA Test Strategies & Enhancement through WPO by Amit Deshpande, Lead Performance Engineer, Synechron Copyright: STeP-IN Forum Published with permission for restricted use in STeP-IN SUMMIT 2014 in agreement with full copyrights from owner(s) / author(s) of material. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording or otherwise without the prior consent of the owner(s) / author(s). This edition is manufactured in India and is authorized for distribution only during STeP-IN SUMMIT 2014 as per the applicable conditions. Practices Experience Knowledge Automation Produced By Hosted By

2

3 Test Strategies & Enhancement through WPO Amit Deshpande Synechron Technologies Pvt Ltd STeP-IN SUMMIT 2014 Agenda Mobile Apps, testing mindset & importance of performance Performance test scripting strategy for mobile applications (native, hybrid and web) Testing performance for different network bandwidths Mobile Web Performance Optimization (WPO) WPO techniques & tools Q&A 1 of 18

4 Before We Start 3 Things to keep in mind Mobile Desktop 2 of 18

5 Wi-fi Mobile Mobile Mobile Different Devices = Different Performances 3 of 18

6 Things have changed lot... Mindset Adoption for Mobile Application Testing Functional Load & Performance User Experience Security Compatibility Localization Conformance 4 of 18

7 What we want to achieve... To capture the traffic of the mobile application (hybrid/web) and create the scripts in performance test tool for further Performance/Load/Stress Tests. What are our challenges... No availability of recording tools for native/hybrid mobile application Some tools might require to root the device e.g. wireshark, tcpdump etc. For applications with SSL, there are issues with SSL certificate handshake for proxy recording JMeter has recording capability only from desktop and proxy recorder can t be extended as default for mobile platform JMeter doesn t have any option to execute the tests with different network bandwidths which may be important factor for mobile testing 5 of 18

8 Mobile Performance Test Strategy Overview Address Recording & Scripting Configure the ad-hoc network on the laptop/desktop with wireless adapter. Install fiddler on the machine where ad-hoc network is configured. Configure fiddler as proxy On the device search for the ad-hoc network configured and connect to it. On the device, in network settings configure the proxy (i.e. proxy for ad-hoc network) i.e. IP address of the machine with ad-hoc network and port as configured in the fiddler to accept remote connections. Access the application on the device, all the traffic would be recorded in fiddler which is to be utilized to create script in performance test tool. 6 of 18

9 Demo/Video Bandwidth Throttling & Network emulation with Fiddler 7 of 18

10 Bandwidth Throttling & Network emulation with Fiddler Best use of the proxy server & proxy settings of test tools Configure fiddler to accept remote connections Configure Fiddler as proxy to performance test tool Implement the Bandwidth throttling with Fiddler for different network speeds or introduce delays Extending Recording Approach The traffic captured is as good as recording done in any other tool from performance testing perspective The traffic captured can be extended to VSTS as web test Same traffic can be utilized to create scripts in most of the load testing tools provided they have basic protocol support 8 of 18

11 Mobile Web Performance It s not about how fast your site is, it s about how fast your users think it is. Mobile Web Performance Mobile networks are slower Mobile browsers are slower Why should we try to Optimize? Mobile processors are slower Mobile users are different 9 of 18

12 Web Performance Optimization Challenges for Enhancing the Performance of Mobile WebSites Web Performance Optimization LIMITED CPU AND MEMORY RESOURCES HIGH NETWORK LATENCIES VARIETY OF DISPLAY SIZES HIGHLY DEMANDING USER EXPECTATIONS 10 of 18

13 Web Performance Optimization More & Faster Servers? Web Performance Optimization 70%-80% of load time is on front end 11 of 18

14 Common Bottlenecks Network Loading Parsin g User Interaction Execution Rendering Animations Events Web Performance Optimization How do we solve these challenges? 12 of 18

15 Optimization Techniques Enable Gzip Reduce the no of requests - Minimum round trips Reduce size of responses Expiry headers Use CDN Optimization Techniques Speeding up things CSS at top Lazy loading of components Avoid redirects More JS at bottom Remove duplicate scripts Pre-fetch Pre-load 13 of 18

16 Optimization Techniques Images Optimize images with tools like ImageOptim, ImageAlpha CSS Sprites to reduce requests Device specific images Base64 inline Optimization Techniques ViewPort Optimizations Don t block the user experience to load entire web page Only first display top of the web page - part of view scope Speed is perception of the end user. Defer loading of the bottom of the web page Defer execution of unnecessary JS after page load 14 of 18

17 Tools Measuring Page load times... Tools Remote Debugging Chrome on Android 15 of 18

18 Tools WebPageTest Tools Measuring with Real Users - NewRelic 16 of 18

19 Performance isn t just for Christmas Measure Optimize Analyze Demo/Video 17 of 18

20 Queries Amit Deshpande 18 of 18