Mobile Application Performance Management

Transcription

1 Mobile Application Performance Management Technical Customer Facing Deck November, 2013 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

2 START in app stores and counting 2MApps The Mobile revolution 25%By 2017, enterprises will have an enterprise app store By 2016, mobile app projects will outnumber traditional app projects by 4:1 2 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

5 A poor app gets worse by Srma131 No longer able to book flights on the update. No support for this app by alicereed Airline does not have any support for this app for issues or improvement suggestions. Still can't view my insurance card by JJR27 Would be a neat feature but after a lot of time they never fix it. So pretty useless app. Resulting in poor App Ratings 5 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

6 How can end user experience be assured in a highly fragmented Mobile value delivery chain? OS Browser Device Carrier Back-end Increased Complexity! 6 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

7 Multiple points of failure (*) Back-end End users (*) Simplified architecture 7 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

8 How can I assure positive user experience, protect my brand & drive employee productivity? New challenges How can I quickly pinpoint and resolve the root cause of performance degradation? How can I anticipate and address performance issues before users are impacted? 8 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

9 Treat your App like a Visualize Isolate Predict Mobile Performance Issues V I P New answers 9 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

11 HP gives insight into the complete mobile value Allows chainyou to pinpoint the root cause of slow or unavailable mobile apps Mobile app performance, availability, user analytics App? Carrier? Service? Web Native Hybrid 11 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

12 emulator Real user monitors APM For Mobile Collect application data from any device running Android or ios Monitor the application backend network using HP RUM sniffer to allow E2E isolation cross the different tiers Monitor the application server using HP diagnostics in order to pinpoint problems 12 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

13 Real user monitors Visualize with HP Real User Monitoring Collect application data from mobile device Collect application data from the network Monitor Real Mobile Performance Collect rich mobile user information 13 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

15 Web Server App Server Isolate with HP Diagnostics Pinpoint root cause of poor mobile application performance Isolate issues across app servers, databases & middleware 15 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

16 Visibility into expected vs. actual user behavior Predict with HP SHA Early warning into mobile app performance issue following new release Early catch of unexpected drop in user activity 16 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

19 Real User Monitoring for Mobile Apps Collect Mobile App performance from native and hybrid Apps running on any Android or ios mobile device 20 Instrument in 5 min Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. No code change required Collect all HTTP network traffic, all the time: TX response times, errors, events, volume

20 No code change required Post-build instrumentation Two Click Android Instrumentation For POC, download an App from Google Play, instrument it and connect to demo environment No developers or customer intervention required Applicable for both native and hybrid apps Supports Android 2.2 and up 21 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

21 No code change required Simple ios Instrumentation 22 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Requires developer\build manager to add 3 frameworks and properties file to the project s build (also hosted on CocoaPods) Can POC on a developer device \ emulator Applicable for both native and hybrid Supports ios 5 and up

22 Gateway Firewall EC 2 Gateway Firewall Mobile RUM Architecture Native Only Web services DMZ Mobile Gateway Inside Organization Web Server Optional Cloud Deployment RUM CM probe RUM CM Probe RUM Engine BSM Native and Network Web services DMZ Mobile Gateway RUM CM Probe Inside Organization Web Server Duplicated traffic RUM NW Probe RUM Engine Application Servers BSM 23 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

23 Visualize with HP Real User Monitor - Locations Gain visibility to mobile app performance & user activity Understand usage and experience from different geographies 24 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

24 Visualize with HP Real User Monitor App Versions Visualize app version adoption and regressions 25 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

25 Visualize with HP Real User Monitor Device\OS Surviving The Mobile Continuous Delivery Release Cycle New devices and OS versions are released frequently, making it impossible to track and test everything understand how your application is keeping up with change 26 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

26 Visualize with HP Real User Monitor Segment Your Surviving Users The Mobile Continuous Delivery Release Cycle Understand Understand the exact the exact profile profile your of users your in users order in to order design, to design, develop develop and test and what test matters according most to real life scenarios. Device OS Version Application Version Mobile Carrier Connection Type 27 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

27 Isolate with HP Real User Monitor Ext Service Provider How does 3 rd party service providers affect your Mobile Performance? Unlock Performance of all external cloud services your App depends upon Is it an external performance issue or is the issue within your domain? 28 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

28 Isolate with HP Real User Monitor Full User Detect Session and Isolate Find a specific user session and investigate what yielded bad experience 29 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

29 Visualize with HP Real User Monitor Detect & Real-time Alert detection Receive real time alerts once Response time rises Availability drops Application experiences abnormal volume 30 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

31 Native Mobile Apps Recording Methods Capture File Source Advantages Disadvantages Mobile device Record the real traffic that comes from the device Requires administrator permissions or rooted device VuGen with configured hot spot wireless access point Easy and intuitive Administrator permissions not required Not all devices support ad-hoc wireless access points. Captures WiFi only (does not capture cellular network traffic) Server with Cellular Network Card Record real traffic (both WiFi and cellular network traffic) Requires administrator permissions Requires installation of software on the server Mobile Device emulator No device required No 3G needed Requires locating and installing device emulator 32 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

32 2007 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

33 Visualize with HP Business Process Monitor and Service Level Management 34 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

34 Isolate Mobile Carrier Related Issues Identify specific mobile carrier issues using BPM agents on machines with 3G/4G card connecting using different mobile carriers 35 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

35 HP SaaS Over-The-Air (OTA) Mobile Monitoring Insight into wireless / carrier performance & availability Problem it solves: Root cause analysis is it the app or the wireless service? Visibility into mobile end user performance & availability Time to value and resource constraints in IT operations Extends on-premise APM environment on mobile and to external locations Mobile Network Response Time & Availability Data Center Benefits: Visibility into mobile app performance broken out by location, carrier & transaction, e.g.; log-in, transfer funds; Lower mean to isolation quick root cause analysis Insight in minutes via HP SaaS No Capex investment required 36 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.

36 BPM Over the Air Performance Monitoring Isolate performance problems WAN VS Wireless 37 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

37 BPM Over the Air Availability Proactively monitor the mobile end-user experience Identify top problems based on transaction location 38 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

39 Visualize with HP Diagnostics Assure legacy backend succeeds serving a growing number of mobile users accessing it in different usage patterns compared to traditional applications - frequent logins, shorter sessions = load bursts 40 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

40 Isolate with HP Diagnostics Quickly identify problematic application tier where was most time spent? 41 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

41 Isolate with HP Real User Monitor and HP Diagnostics Detect end users experiencing low performance via HP RUM and pinpoint root cause with HP Diagnostics 42 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

44 Treat your App like a Visualize Isolate Predict Mobile Performance Issues V I P New answers 45 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

45 Visualiz eapp performance for best mobile end user experience Across any mobile app type Synthetic and real users 360 view user and infra Why HP? 46 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

46 Isolate Mobile app performance issues To a specific app version, device, carrier, etc.. To a specific user flow all the way to the line of code in the backend To a specific 3 rd party service Why HP? 47 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

47 Predict Time Machine for mobile app performance Early warnings for service outages Early catch of issues (based on volume drop) Why HP? Sentara Healthcare can detect an issue 1-2 hours before an app performance degradation happens 48 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

49 Companies treating their Apps like VIPs! Reduce app performance issues 30% Less problems Generate more revenue with always on apps 60% Less downtime Avoid end user impact 90% Faster problem isolation 50 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

50 Listen to Garanti Bank Listen to United Airlines Why HP? Proven success, such as Garanti Bank & United Airlines. Their mobile apps are 5 Stars. Goal 51 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

51 How do I get started? Free 30 day trial for Synthetic Monitoring. Value in 60 minutes Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

59 New mobile recording capabilities in LoadRunner/Vugen HP LoadRunner Mobile Recorder app Android app available from Google Play Store Enables recording of all network traffic of your native, browser-based or hybrid mobile web applications to a capture file. The file is then used to generate a LoadRunner script Creates a.lrpcap file on the device which can be ed to the machine running Vugen Can be recorded on a 3G or WiFi interfaced device Scripts can be run inside or outside your network, from your own and/or HP hosted locations Works on any rooted device Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

60 New mobile recording capabilities in LoadRunner/Vugen Proxy Recording Mode No need to install anything on the device Can be used for desktop O/S that do not support Vugen e.g. Linux, Mac etc. Works for web and native mobile applications that use HTTP(s) as the transport How to get started? Select the new option Proxy Recording when start recording Configure your mobile device to use the Vugen recording proxy Open the native app/browser on the device to access the application and all web traffic will be recorded Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Turn off the proxy setting to stop sending traffic to Vugen

61 Visualize with HP Business Process Monitor Mobile BPM Architecture Option 1 62 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

62 Visualize with HP Business Process Monitor Mobile BPM Architecture Option 2 63 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

63 Visualize with HP Business Process Monitor Mobile BPM Architecture Option 3 BPM (Wireless) Wireless Carrier/ISP BPM location can be configured with access to a Wireless Carrier (with a local 3G card for example) Internet BPM (WAN) Script can be replayed over Internet from local location or remote location. Ideally, network throughput is limited in run-time settings. Business Application BPM (LAN) 64 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

64 Visualize with HP Business Process Monitor Mobile BPM Scripting Mobile TruClient for Web App emulate mobile browser using Firefox, get an approximation of end to end user experience. Simulate device by setting User-Agent, connection settings and screen size. -> Support web applications recording only Mobile App (HTTP/HTML) transport layer emulation, get an insight into server performance. Create VuGen script from packet capture (PCAP) files, emulator recording, or new proxy recording method to support secure communication -> Support native & web application 65 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

65 Visualize with HP Business Process Monitor Mobile BPM Scripting Monitoring solution Real wireless carrier network monitoring Protocols Mobile TruClient Mobile App (HTTP/HTML) BPM installation Add to the BPM machine a 3G card to emulate real carrier network connection User OTA monitoring provided by Performance anywhere SaaS service Proactive backend (over the WAN) side Monitoring MobileTruClient Mobile App (HTTP/HTML) BPM inside monitoring, and over the WAN monitoring 66 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

66 Mobile TruClient Network Diagram Script Recorder VuGen Installed use TruClient Protocol Script is recorded here. Internet 1) Install VuGen as normal on a supported platform. 2) Record VuGen script using Mobile TruClient Protocol after specifying the proper mobile device settings. Business Application Servers 67 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

67 Proxy Recording for a Mobile Device Application Wireless Carrier/ISP 1) Configure your mobile device to use the VuGen Recording Proxy Proxy Script Recorder Full VuGen Internet Business Application Servers NOTE : The device and Vugen machine must be within the same network 68 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

68 Recording With a Device Emulator (Android only) Device Emulator Internet Script Recorder VuGen * Business Application Servers 1) pcap file is captured here from traffic generated by a Mobile Device emulator. 2) VuGen script is then generated here. * - In the case of an iphone, the Mac-based device emulator can be used with the VuGen Sniffing agent directly (installed on MacOS) to create a recording without the need to create a pcap file. 69 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

70 Real User Monitoring for Mobile, Cloud and Web All Apps, All Locations, All the Time - Single Data Store Data Center Network Probe Server Collector Client Mobile Apps RUM Browser Hybrid Network Real User Monitor Browse r Real User Monitor Browser Real User Monitor Server Collects data from network, measure inside data center, monitor frontend and backend tiers Mobile Collect data from client, No Network settings required! Mobile Server Network Combines data from client and network for true end to end visibility Network All Apps Discovery Mobile & Web Apps User Analytics End to End User Experience 71 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.

71 VDI Mail Backend /Middleware Frontend Various Increasing real-time end-user coverage RUM Protocols, Templates and Protocol SDK Application Protocol Application Protocol Custom web Flash Flex SAP Oracle Forms NCA Siebel PeopleSoft Streaming/VoIP HTTP/HTTPs AMF0, AMF3 HTTP/S, SAP GUI Over HTTP/TCP HTTP/S HTTP/s UDP FTP LDAP ISO 8583 SOAP IBM WebSphere MQ Oracle DB FTP LDAP VISA Base I, MasterCard CIS HTTP/s MQ Oracle DB.NET WCF MS SQL MS SQL MySQL MySQL IMAP IMAP DB2 DB2 SMTP POP3 SMTP POP3 Citrix Xen Citrix ICA 72 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

72 Feature: Client Monitoring and Web Tier Breakdown Web Tier Breakdown feeding from multiple network perspectives Send Message response time is broken by time spent in each tier 73 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

74 Diagnostics Web client monitoring technology & design Diagnostics uses a Yahoo! developed framework called boomerang Boomerang is a piece of javascript that you add to your web pages, where it measures the performance of your website from your end user's point of view. It has the ability to send this data back to your server for further analysis. With boomerang, you find out exactly how fast your users think your site is. - How it works Our monitoring software adds extra HTML code into the <head> section page of JSP page results. These scripts cause browsers to measure the round trip time from the user clicking on a link to the time that page referenced by that link is usable by the user. The resulting measurements are posted back to the application and Diagnostics collects and forward measurements via the Diagnostics Java Probe to a mediator. 75 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

75 Web client monitoring client monitoring view Top 3 URLs - Front End Time (Avg) - Hit Count Top 3 browser types - Front End Time (Avg) - Hit Count Top 3 locations - Front End Time (Avg) - Hit Count 76 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

76 Isolate with HP BPM and HP Diagnostics Detect and Isolate Investigate server performance problem detected from a threshold breached for a synthetic user transaction 77 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

77 Isolate with HP Real User Monitor network Detect sniffer and Isolate Expand isolation span and capabilities by monitoring not only the application running on the mobile device but also the web and backend tiers of the application using RUM network sniffer 78 Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

80 How SHA Works Collects Data Creates Baselines Detects Anomalies Sends Event Investigate Remediate Adaptive Baseline detect metrics seasonality, trend and create dynamic baselines Topology Analysis correlate metrics of related CIs across domains Temporal Analysis differentiate between spikes and real anomalies Historical Analysis compare with similar anomalies from the past Statistical Learning learn normal system behavior and suppress noise Statistica l Self Learning Historica l Analysis Baseline SHA Runtim e Core Temporal Analysis Topolog y Analysis 81 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

81 Feature: Adaptive baseline Automatically detect trend and seasonality On-going learning to adapt to changing conditions Transaction response time and its expected baseline sleeve over 2 days 82 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

82 Feature: Anomaly detection Metrics from different monitoring sources. Users can drag and drop in chart for more details Metric mini charts allow to visually correlate behaviours 83 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. SHA Anomaly timeframe

83 Feature: Anomaly Investigation UI View Service topology as captured by RTSM View planned and discovered changes (before and after the anomaly started) Reveal additional related CIs outside of the applications service model View abnormal metrics, events and planned downtime windows Observe metric behavior vs. expected baseline Visually or automatically correlate metric trends to help pinpoint problems Get to the root cause faster! 84 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

84 Online Gaming Provider: using SHA for business metrics SHA detected an issue 1 hour before it was reported by an end user 85 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.