Beauty or the Beast: The tale of your mobile app. Rob Kwok, Crittercism

Transcription

1 Beauty or the Beast: The tale of your mobile app Rob Kwok, Crittercism

2 Introduction & Agenda Why mobile performance matters Why delivering a great mobile experience is hard to do What metrics should you use to benchmark your apps performance How to collect & act on performance metrics to ensure a competitive app Q&A

3 Crittercism Background Mobile is our DNA" We Operate at Scale" Our solution is built from the ground-up for a mobile world " Monitor avg 4B+ app instances a day on over 1B monthly average users" Analyzed over 250 billion app launches " " Manage thousands of customer accounts" 120 countries" Our Investors" Crittercism and its technology are widely adopted and provide value to those struggling with the emerging mobile application market "

4 Lost revenue (1hr of downtime=tens of thousands of dollars) Lost brand (star ratings) No visibility into root cause (weeks to resolve) Reactive identification of the problem (days to identify)

5 Fragmentation adds Complexity X X = >100M Device manufacturer models OS versions Carriers Permutations creates complex ecosystem

6 App Service Dependencies Increases Complexity Average Number of Services Used

7 Two Core Pillars of Performance To Understand

8 8 Responsiveness Performance Responsiveness helps answer questions such as: Which services have the highest error rates? Why is my app slow in different geographies? Why this matters: Your app depends on many cloud/ backend services and their responsiveness impacts end-user experience

9 App Performance Depends on Service Performance Users expect responses in under 1 second* 9% 18% of services that mobile apps use have over 1 second average latency of service calls from mobile apps have error rates over 5% *Source:

10 End User Performance Varies By Location Response Times by Geography Response times include WiFi

11 Understand Your Third Party Service Dependencies Error Rates & Response Times by top Services

12 Uptime Performance Uptime helps answer questions such as: Which devices are causing my app to crash? Does my app crash more on a particular OS version? Why this matters: Uptime performance is a fundamental measure of end-user experience

13 47% of Apps Have an Uptime That is not Competitive Percent of apps by crash uptime

14 Android: Gingerbread Apps Least Stable Android OS and device breakdown

15 Apple: ios 7.1 Apps Most Stable Apple OS and device breakdown

16 Gaming Apps Least Stable Crash Rate by App Category

17 Top Companies use mapm to Optimize their Apps Mobile application performance monitoring (APM) technologies help enterprises & developers understand application usage patterns, performance and user frustration with applications deployed internally to enterprise users and externally to customers.

18 Issue: Monetize through mobile channel while creating best user experience Before: 3% downtime across all platforms We depend on Crittercism to help us manage the performance of our mobile apps, giving our engineering team the bandwidth to focus on new and exciting features. After: < 0.5% downtime across all platforms Impact: 83% improvement in uptime 2 stars -> 4+ stars

19 Issue: App performance issues affecting user experience Before: 6% downtime After: <1% downtime The previous app was very glitch-y it crashed all the time, especially in the cart. Now that all those issues are cleared up, every day we are getting thousands of new downloads. Impact: 6x revenue improvement 7x performance improvement

20 Issue: Poor visibility into app issues affecting users Before: 2 weeks to resolve issues, causing downtime Crittercism helps us deliver a better customer experience by shipping apps of a higher quality. After: Resolve most issues in 2 days Impact: 14X more efficient 2X faster app releases

21 21 Summary & Next Steps Mobile app performance impacts brand, revenue, and productivity Responsiveness & Uptime are core performance metrics to monitor and trend Leverage complete mapm to gain visibility into the performance of your apps Sign