Introduction to Mobile Performance Testing

Transcription

1 Introduction to Mobile Performance Testing Shlomi Zalma, Wilson Mar DT3338 at Noon, June 13, 2013 HOL330 in Sands 305

2 Why performance test mobile apps? Mobile apps are now: how customers locate stores and information how brands get exposure many times a day the face of the organization 3

3 Slow app = Slow product? 4

4 Baseline vs. impact of network latency, etc. 5 from HP Network Virtualization by Shunra [P01]

5 Possible points of risk in landscape mdev: Data Caching Network: Latency & Loss Network: Encrypt, Compress. Network: Load Bal. Algorithm Dev: Resource Usage SysAdmin: Server Config. Back-end: Pooling & Threading DBA: DB Indexes & Logs Platforms & Versions Device Features Screen Sizes 2G,3G,4G Cellular Carriers 3 rd Party Cloud Services ISPs Firewalls VPNs Load Balancers Web Servers App Servers DB Servers Storage Internet Browsers LANs Web Services Mobile Components CDNs & CoLo. 6

6 HP LoadRunner components and workflow End User Client(s) Internet/WAN Application Server(s) Database 1 Author Scripts 5 Virtualize Network 4 Virtualize Services 6 Generate Load 7 Measure Impact 8 Analyze, Compare, Report 2 Collaborate HP Live Network 3 Test Scenario Plan and Execute Tests 7

7 Scan for more information LoadRunner Network Virtualization Service Virtualization Mobile Testing 8 HP Codescan app

8 Mobile technology terms Windows PC internet explorer feature phones minimal browser Chrome Safari browser iphone, Android ipad Native app Apple Play. google App Store.com URL URL URL Hybrid app ft.com HTML4 m.ft.com mobile site ft.com HTML5 responsive design ft.com/ws web services 9

9 Mobile LoadRunner Scripting

10 Create a New Script, Mobile Category 11 HP LoadRunner VuGen 11.5 SP1+

11 Multiple Approaches Available Browser or hybrid app: Ajax? > TruClient Ajax Mobile scripting protocol using User Agent spoofing in Firefox Simple > Mobile HTTP/HTML scripting protocol Native app: > Mobile HTTP/HTML scripting protocol Android: No device > Record Emulator using Android Virtual Device (AVD) Have rooted device > Mobile Recorder generate lrpcap to Analyze ios & others: > LoadRunner Proxy on same subnet/wi-fi hub (the newest technique) > Record & Analyze WinPcap capture on the mobile app server 12

12 Recording Method TruClient Ajax App web server 13 TruClient Ajax User Agent in Firefox > HP LoadRunner VuGen

13 TruClient recording 14 HP LoadRunner VuGen

14 Devices with User Agent strings Count: HP LoadRunner VuGen11.52

15 User Agent string example Sample User Agent for Samsung Galaxy S3 Mozilla/5.0 (Linux; U; Android 4.0; xx-xx; GT- I9300 Build/IMM76D) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Mobile Safari/ More at HP LoadRunner VuGen11.52

16 Android Versions 4.0 (15) 4.1 (16) 4.2 (17) 2.3 (9,10) 17

17 Mobile Device Manager Tool in VuGen 18

18 VuGen Scripting Process 1. Configure recording settings 2. Consider run-time settings 3. Object identification using script levels 4. Specify Transaction Names 5. Specify Completion End Events Logic 6. Insert flow control 7. Run-time logic 8. Vary data based on parameters 9. Using C script functions in a library 19 from HP Virtual User Generator User Guide page 73

19 Random Think-time in TruClient Arguments: Math.floor( 11 * Math.random()+5 ); 20

20 TruClient Toolbox drag and drop Arguments: var randwait = Math.floor( 11 * Math.random()+5 ); window.alert( randwait= + randwait ); 21

21 HTTP/HTML Mobile Recording

22 Mobile HTTP vs. HTML mode= HTTP For use with web services calls. Does not parse for resource requests. mode= HTML Parse HTML to automatically identify additional resources to download CSS JavaScript 23 HP LoadRunner VuGen

23 Record Mobile HTTP/HTML 24 HP LoadRunner VuGen11.52

24 HTTP/HTML Recording Methods Wizard HTTP/HTML Record & Analyze Traffic Analyze Traffic Record Emulator Proxy TruClient Recording 25 HP LoadRunner VuGen11.52

25 Proxy Recording

26 Proxy Recording HTTP/HTML Android APK Proxy Recording LoadRunner Proxy ios Proxy Port 8080 Port 80/443 IPA App web server 27 HP LoadRunner VuGen11.5x

27 Same subnet via Wi-Fi router HTTP/HTML Ethernet cables Proxy Recording Wi-Fi router on private LAN 28

28 Proxy Recording HTTP/HTML Proxy Recording 29 HP LoadRunner VuGen11.52

29 Proxy Recording Setup on ios Scroll down Eleanor Eleanor Password: ncjm-q3ey-t1dd 8080 Source: 30

30 Proxy Recording Setup on Android Galaxy S3 (4.1.2) Long press

31 Record Emulator

32 Record Emulator Android Recording Method HTTP/HTML Record Emulator Android \sdk\tools Async. device emulator ADT file APK Copy Android Backup File manager Install App web server Play. Google.com 33 HP LoadRunner VuGen11.5x

33 Record Emulator Requirements HTTP/HTML 1. USB cable to device 2. USB driver for device 3. Android app APK file for Android app under test 4. Android file download manager app to extract APK file from device Record Emulator 5. JDK (Java Development Kit) 6. ADT (Android Development Toolkit) plug-in for Eclipse 7. AVD (Android Virtual Device) within Eclipse for device under test 8. JAVA_HOME and PATH Windows environment variables 9. HP LoadRunner and SP2 patch to upgrade to

34 Record & Analyze Traffic HTTP/HTML Record & Analyze Traffic.cap,.pcap network sniffer APK Android Ad hoc network ios IPA App web server 35 HP LoadRunner VuGen11.5x

35 Analyze Traffic

36 Analyze Traffic HTTP/HTML Analyze Traffic APK Android 4.1+ (rooted) Mobile Recorder.lrpcap App web server 37 HP LoadRunner VuGen11.52

37 Android Mobile Recorder 1. Start Recording Stop and send Perform user steps. 38

38 Android Mobile Recorder Settings 39

39 Recording Methods Recap HTTP/HTML Record & Analyze Traffic.cap,.pcap network sniffer APK Android 4.1+ (rooted) Mobile Recorder Play. Google.com Analyze Traffic Record Emulator device emulator APK Ad hoc ADT file ios IPA.lrpcap App web server Proxy Recording LoadRunner Proxy Proxy Port 8080 Port 80/ TruClient Ajax User Agent in Firefox > HP LoadRunner VuGen11.52

40 Mobile scenarios

41 How can we help? Analytics Executive Scorecard Performance Center Test results ALM Analysis Tear down environment Continuous Delivery Automation (CDA) Application Security Assessment WebInspect Development Agile Manager App. Lifecycle Intelligence Monitoring & Diagnostics Business Service Management ALM Lab Management Run test cases UFT / BPT LoadRunner Execute automated build (Jenkins) Security Code Scan Fortify Source Code Analysis Provision & deploy environment Continuous Delivery Automation (CDA) Service Virtualization Network Virtualization 42 HP integrated testing suite

42 Interconnected component services Shopping process Search Buy Pay Ship Track Product Customer profiles Payment Shipping Track package Composite Managed cloud Traditional Public cloud Private cloud 43

43 Concurrency and rendezvous 44 Illustrative data [P10]

44 Key take-aways For mobile browser apps (jquery Mobile, Sencha, PhoneGap, etc.), little scripting is needed using User Agent spoofing via Firefox TruClient Mobile JavaScript executes against a DOM for each virtual user Traffic captured between native apps and server are converted to VuGen scripts Android native app traffic on rooted devices can be recorded on device using LoadRunner Mobile Recorder iphone and ipad (ios) -- all non-rooted apps can be recorded using LoadRunner Proxy Monitor and Diagnose using HP Business Service Management Consider HP Network Virtualization and Services Virtualization 45

45 Thank you