Best Practices for Testing Mobile Applications. Presented by Frank Schloendorn

Transcription

1 Best Practices for Testing Mobile Applications Presented by Frank Schloendorn 1

2 Let s continue the [Share comments, continue Q&A, suggest future topics] #MaaS360Webinar Click the link in the chat window to tweet about today s

3 Poll Question Number One What is your company s current position on testing/certifying mobile applications? We do not test/certify mobile applications We test/certify applications developed inhouse We test/certify applications developed inhouse and/or from third-party vendors 3 3

4 What Will I Learn? Challenges of Testing Mobile Applications Knowing the App You Are Testing Types of Testing Tools/Resources to Aid Testing Efforts Helpful Hints/Things to Remember 4 4

5 Poll Question Number Two Which types of mobile apps does your company test or plan to test? In-house applications Outsourced applications Third-party applications from the app store/marketplace 5 5

6 Challenges of Testing Mobile Applications Some similarities and differences from testing traditional desktop/laptop applications Multiple platforms (Android, ios, WP7, etc.) Updates to third-party apps are much more frequent and harder to control Bigger performance concerns (IE memory, battery) Fragmentation Software and hardware Primarily an Android concern Multiple hardware specs (processor, memory, features) Limited number of tools to help 6 6

7 Know the Application You Are Testing Is this an in-house application, or one that is from a third party? For in-house developed apps, testing should begin with early builds of the application Development tools should be utilized to profile the application and look for major design flaws (easier to fix sooner than later) For third-party tools, do some research on the company who makes the app Reviews in the app store/marketplace Frequency of updates/support options Company background/reputation 7 7

8 Know the Application You Are Testing (cont d) What platforms/os versions are you supporting/certifying? Does this coincide with the supported stack of the application? Android (1.x, 2.x, 3.x, 4.x) ios (3.x, 4.x, 5.x) WP7 (7.0, 7.5) Tablet or smartphone? Other? 8 8

9 Know the Application You Are Testing (cont d) Are there any device Feature requirements? GPS, Wi-Fi, Bluetooth, Accelerometer, Touch Screen, etc. Important to know from a device support perspective Important to know from a performance perspective Are there any Permission requirements? Access contacts, access phone, access messaging, etc. Important to know from a security perspective 9 9

10 Poll Question Number Three Do you currently control which applications a user can install on their mobile device? Yes No 10 10

11 Types of Testing Functional Same basic rules of traditional application testing Does the app perform its functions as intended? Usability/User Experience Similar to traditional application testing, but with additional caveats Is it intuitive, does user understand how to use it? Is it designed for a mobile experience? Does it fit the familiar look of other mobile applications? Does it meet the requirements of the platform if controlled by the vendor? (Apple) 11 11

12 Types of Testing (cont d) Performance Extremely important for mobile devices Memory, CPU, and especially power (battery) Network utilization also a concern (data plans) Upgrade testing Test both application and OS upgrades Ease of installation Is the install experience clear and concise? Use app store to distribute Notification of upgrades Are compatible OS/devices clearly marked? 12 12

13 Types of Testing (cont d) Accessibility Does your app need to support people with disabilities? Credibility Is the data/info presented accurate? User Emotions Don t BUG the user 13 13

14 Tools to Aid in Mobile Application Testing Emulators Available for all major platforms (Android, ios, WP7 etc.) Good for basic app testing (functional, user experience) Not good for performance/resource/sensor testing Should never take the place of testing on a real device Apps for performance testing First party: XCode (ios) Third party: Available through marketplace/app store Android: System Profiler, Battery Mix, Task Managers 14 14

15 Tools to Aid in Mobile Application Testing (cont d) Virtual device testing Subscription based Multiple vendors DeviceAnywhere Perfecto Mobile Remote access to hundreds of REAL devices All platforms New devices added regularly Save money over buying your own devices to test with 15 15

16 Tools to Aid in Mobile Application Testing (cont d) Automation Still in its infancy not a large selection of options Built-in security of mobile platforms limits capabilities and cross app testing Virtual device companies offer automation Requires dedicated devices on their platform Costly ($$$) Third-party automation options do exist Most are platform specific, few are cross platform Free and paid solutions exist Most are screen scrapers Automating mobile application testing generally requires a higher level of programming knowledge Community Testing/Crowd Testing 16 16

17 Helpful Hints/Things to Remember When developing in-house enterprise apps, make sure testing starts when development is in progress Know your target platform/devices Especially true with Android Know what versions/platforms you will support Don t assume that because it works on one device, it will work on all 17 17

18 Helpful Hints/Things to Remember (cont d) Don t underestimate the importance of performance testing Always have at least a few physical devices available for testing Especially older ones (iphone 3GS, early Android, etc.) When possible, have a group of BETA testers to help with real-world testing 18 18

19 Helpful Hints/Things to Remember (cont d) Don t underestimate or overestimate the importance of anecdotal test results Know the target audience for your application Be aware of upgrades to your application as well as upgrades to the device s OS either could break your app 19 19

20 Poll Question Number Four Which mobile platforms do you plan to test apps for? ios Android BlackBerry Windows Other 20 20

21 2012 Global Mobile Awards MaaS360 wins Best Enterprise Mobile Service Judges comments "This demonstrates genuine understanding of enterprise user issues, and enables straightforward and cost-effective mobile device management. Who we beat Good Technology for Good for Enterprise (GFE) MobileIron for MobileIron Virtual Smartphone Platform Release 4.5 for Android Virtela Technology Services Incorporated for Cloud-based Mobile Device Management Portugal Telecom and ClickSoftware for ClickMobile Enterproid for Divide 21

22 Let s continue the [Share comments, continue Q&A, suggest future topics] #MaaS360Webinar Click the link in the chat window to tweet about today s

23 Wrap-up Questions or follow-up? Upcoming Webinars ( March 15 Enabling the ipad in the Enterprise March 20 Getting Started with MaaS360 Past Webinars ( What s New in 4.0 Android Ice Cream Sandwich? Building Apps for iphone and ipad Securing the Kindle Fire in the Enterprise Plus lots of How-To content on our website Mobile Device Management Best Practices Mobile Device Management Glossary Learn All About the Cloud (AATC) Presented by The Software & Information Industry Association 23