5 Secrets to a Successful Mobile Application Testing Strategy 25 th Jun 2014 Ajay Balamurugadas / Sundaresan Krishnaswami www.maas360.com
Today s Agenda 5 key elements of a robust test repository Addressing Android testing pain points Android vs ios: Do you change your testing strategy? Best practices for cross platform testing Building the tacit knowledge in testing teams Q & A
Poll Question #1: What are your prime challenges in mobile application testing? a. Device/Brand level fragmentation b. API level fragmentation c. Inconsistent UI and UX d. Lack of test devices e. Lack of knowledge of mobile application testing techniques f. All of the above
Secret #1: 5 Key Elements of a Robust Test Repository
Resources For a Robust Test Repository Credits: http://thetesteye.com/posters/thetesteye_softwarequalitycharacteristics.pdf
Poll Question #2: Does your organization suffer from Android fragmentation? a. Yes b. No c. Somewhat
Secret #2: Addressing Android Fragmentation Key Challenges: Many devices to test Several different form factors Different operating system flavors Application backward compatibility App architecture API compatibility Hardware integration
Android Fragmentation: How Do We Tackle It? Normalize the device for performance, latest OS, most used Listen to your users Google Play, forums,etc. Application layout for different screen dimensions API behavior Mobile app functionality for different device hardware Follow AQuA best practices while building and testing apps http://www.appqualityalliance.org/
Secret #3: Android vs ios: Do you Change Your Testing Strategy? What type of app is this: hybrid or native? Hybrid apps Most hybrid apps are built for the browser You can start testing from a browser on your desktop Native apps Build a traceability matrix for your functionalities Identify key operating system differences Build your foundation (testing techniques) Build a Mobile testing ready reckoner Analyze & identify the tools you would require Android Debug Bridge, iphone Configuration Utility, Log collectors Understand the OS specific design guidelines and test for them Example: Gestures for different screens
Secret #4: Best Good Practices for Cross Platform Testing Device Settings Understand the device settings on each platform What is unique to each of the platforms Consistency heuristics Do a side by side comparison of two devices one platform each Note the differences and report them Test, Learn, Test Approach Test on one platform, understand the feature, test on another later Compare and contrast approach Use a mind map or simple checklist Have a cross-platform team test together Stop worrying about cross-platform much
Poll Question #3: If your organization were to conduct an assessment test on your testing team or yourself, will the score be 75% and above? a. Yes b. No c. May be
Secret #5: Tips to Build Tacit Knowledge in Testing Teams Bug blitz Dogfooding those apps Internal competitions Training sessions Virtual conferences
MaaS360 App Works Because Use case based approach Why do we need this feature? Write complete end to end scenarios, stories Checklist of previous field issues Test on real devices (and not emulators) Bring Your Own Device (BYOD) to test Listen to users App reviews on Google Play, App store, etc. Connect with users on app forums Bug blitz and internal contests Other people s views
MaaS360 App Works Because Continuous learning Testing feeds on Ministry of Testing Learn from platform-centric conferences like WWDC and Google I/O In-house workshops and hands-on training Field issue analysis Analytics based learning
MaaS360 App Security Test Checklist 1. Safeguard app data via secure containers 2. Data encryption Database, passwords, payloads 3. Network communication HTTPs URLs, MITM attacks 4. Inter-app communication Certificate based trust, web-service based trust 5. Privacy and permissions Respect user privacy, logging sensitive information, obtain only required permissions
Mobile Application Testing: Ready Reckoner Test for app behavior in the cloud and secure wipe conditions Test for secure app data communications and platform specific design guidelines Test for app store pre-submission guidelines Test with your own ready reckoner; share it Test, test and test for more positive ratings on the app store Read the book: Tap into Mobile Application Testing by Johnathan Kohl for enhancing your testing skills
Q&A
Connect with the MaaS360 Community Past Webinars (http://www.maas360.com/maasters/webinars) Building Secure Mobile Applications Using MaaS360 SDK and IBM Worklight Android 4.3 and Windows 8.1 -The Next Milestones in Mobile Device Management & BYOD Achieve Enterprise Mobile Security with MaaS360 MDM and Dual Persona The Evolution of BYOD - Are You Set-Up for Success? Plus lots of How-To content in our Resources section The Ten Commandments of Bring Your Own Device (BYOD) http://links.maas360.com/tencommandments Does Android Dream of Enterprise Adoption? https://links.maas360.com/doesandroiddream
Get Started Today! Set-up Get access to a free, fully functional trial for 30 days Provision Instantly enroll and configure your mobile devices Manage Start managing, securing, and supporting devices, apps, and docs