Beauty or the Beast: The tale of your mobile app Rob Kwok, Crittercism
Introduction & Agenda Why mobile performance matters Why delivering a great mobile experience is hard to do What metrics should you use to benchmark your apps performance How to collect & act on performance metrics to ensure a competitive app Q&A
Crittercism Background Mobile is our DNA" We Operate at Scale" Our solution is built from the ground-up for a mobile world " Monitor avg 4B+ app instances a day on over 1B monthly average users" Analyzed over 250 billion app launches " " Manage thousands of customer accounts" 120 countries" Our Investors" Crittercism and its technology are widely adopted and provide value to those struggling with the emerging mobile application market "
Lost revenue (1hr of downtime=tens of thousands of dollars) Lost brand (star ratings) No visibility into root cause (weeks to resolve) Reactive identification of the problem (days to identify)
Fragmentation adds Complexity X X = 2582 106 691 >100M Device manufacturer models OS versions Carriers Permutations creates complex ecosystem
App Service Dependencies Increases Complexity Average Number of Services Used
Two Core Pillars of Performance To Understand
8 Responsiveness Performance Responsiveness helps answer questions such as: Which services have the highest error rates? Why is my app slow in different geographies? Why this matters: Your app depends on many cloud/ backend services and their responsiveness impacts end-user experience
App Performance Depends on Service Performance Users expect responses in under 1 second* 9% 18% of services that mobile apps use have over 1 second average latency of service calls from mobile apps have error rates over 5% *Source: http://chimera.labs.oreilly.com/books/1230000000545/ch10.html
End User Performance Varies By Location Response Times by Geography Response times include WiFi
Understand Your Third Party Service Dependencies Error Rates & Response Times by top Services
Uptime Performance Uptime helps answer questions such as: Which devices are causing my app to crash? Does my app crash more on a particular OS version? Why this matters: Uptime performance is a fundamental measure of end-user experience
47% of Apps Have an Uptime That is not Competitive Percent of apps by crash uptime
Android: Gingerbread Apps Least Stable Android OS and device breakdown
Apple: ios 7.1 Apps Most Stable Apple OS and device breakdown
Gaming Apps Least Stable Crash Rate by App Category
Top Companies use mapm to Optimize their Apps Mobile application performance monitoring (APM) technologies help enterprises & developers understand application usage patterns, performance and user frustration with applications deployed internally to enterprise users and externally to customers.
Issue: Monetize through mobile channel while creating best user experience Before: 3% downtime across all platforms We depend on Crittercism to help us manage the performance of our mobile apps, giving our engineering team the bandwidth to focus on new and exciting features. After: < 0.5% downtime across all platforms Impact: 83% improvement in uptime 2 stars -> 4+ stars
Issue: App performance issues affecting user experience Before: 6% downtime After: <1% downtime The previous app was very glitch-y it crashed all the time, especially in the cart. Now that all those issues are cleared up, every day we are getting thousands of new downloads. Impact: 6x revenue improvement 7x performance improvement
Issue: Poor visibility into app issues affecting users Before: 2 weeks to resolve issues, causing downtime Crittercism helps us deliver a better customer experience by shipping apps of a higher quality. After: Resolve most issues in 2 days Impact: 14X more efficient 2X faster app releases
21 Summary & Next Steps Mobile app performance impacts brand, revenue, and productivity Responsiveness & Uptime are core performance metrics to monitor and trend Leverage complete mapm to gain visibility into the performance of your apps Sign up @ www.crittercism.com!