Mobile testing. How to catch up? Agenda. Mobility, an uprising demand Capgemini. All rights reserved. 1. Nov 27, 2014 Sebastiaan Van Gucht

Transcription

1 Mobile testing How to catch up? Nov 27, 2014 Sebastiaan Van Gucht Agenda Introduction Mobile testing challenges Mobile test strategy & approach Key differences Q&A Copyright Capgemini 2014 All Rights Reserved 2 Mobility, an uprising demand Gartner Forrsights Forrester Mobility is a top five priority over the next three years 35% of North American & European firms see a mobility strategy as a priority 40% of business and IT Leaders are seeking more engagement on mobility-related issues Mobile is so important; put your best people on mobile. If you don't have a mobile strategy, you are no longer relevant. Eric Schmidt, former CEO, Google Capgemini. All rights reserved. 1

2 Apps & Responsive Design 4 The Mobility Landscape Platforms Carriers Device Types & Screen Resolutions Manufacturers 5 Challenges & Priorities 2013 Organizations focus their testing efforts on mobile apps performance, security and functionality Copyright Capgemini All Rights Reserved Capgemini. All rights reserved. 2

3 Challenges & Priorities 2013 DATA POINT: Organizations across all sectors show considerable increase Organizations across all sectors show in mobile testing. More than half of all organizations interviewed (55%) considerable increase in mobile test ing have now test mobile applications compared to an industry average of 31% in last year s research. Copyright Capgemini All Rights Reserved 7 Mobile Testing: A Shift from Tools to Methods The barriers to successful mobile testing have shifted from tools to methods Copyright Capgemini All Rights Reserved 8 Agenda Introduction Mobile testing challenges Mobile test strategy & approach Key differences Q&A Copyright Capgemini 2014 All Rights Reserved Capgemini. All rights reserved. 3

4 Strucuted test process - TMap Test base Test design techniques Control Control Plan Risks BTDM Prep Spec Test approach Exec Compl Infra Test goals Risks and analysis Test planning Test environment Testscript conservation 10 What specific risks are there in mobile? I am worried that my app will get bad reviews Is my data safe in the back end? Is the app fast enough? Will the app work on all devices and operating systems? I m worried that the users do not understand the app Is my app going to roll out in the app store? 11 The BDTM Proces Critical success factors Change proposals Requirements Business processes etc. Client 1 Assignment and test goals 2 Determining risk class Result Risk Time Costs 4 3 Determining test intensity 5 Allocating test design techniques Creating test cases Test execution Capgemini. All rights reserved. 4

5 Fragmentation of Devices & Operating Systems Number of different devices according to OpenSignal s study of downloads: more than 18,000 are included, compared to over 11,000 in Photograph: /PR/Opensignal 13 Strategy determination Type of the mobile test object Native App Mobile Website Hybrid Mobile App Supported platforms Android Windows ios Blackberry 14 Strategy determination Most used device Most used device <> first device Most used Android version Most used ios version Most used resolution the newest device the oldest device Largest screen resolution Smallest screen resolution Etc... Look at trends/future Capgemini. All rights reserved. 5

6 Example device list for mobile test strategy Market Device Vendor Resolution CPU OS share Galaxy SIII Samsung 720x Mhz % One X HTC 1280x Mhz % Galaxy Samsung 800x Mhz % Nexus 10 Google 2560x Mhz % 16 Preparation 17 Guidelines & Design Principles ios Human Interface Guidelines Capgemini. All rights reserved. 6

7 Also Review Guidelines 19 Specification - Device characteristics Differences between platforms ios Android API behavior Non- Functional Testing Interrupt Testing Differences between screen sizes Hybrid App & Mobile Website Small Medium - Large Device characteristics Smartphone Phablet - Tablet Performance Testing Usability Testing GUI Testing 20 Execution Manual execution Performance test execution Security test execution Usability test execution Automated execution Capgemini. All rights reserved. 7

8 Emulators Execution 22 Emulators vs Actual Devices Free Debugging Simulating Computing resources Network Environment Plain vanilla Accurate Live network UX Price Management Devices 23 Defect management Mobile characteristics Device category Device brand & name OS + Version Browser + Version Network Screen capturing & logging How on device? How to transport? Pinpoint issue Device specific /Brand specific/os (version) specific Capgemini. All rights reserved. 8

9 Infrastructure Test environment Wi-Fi and cellular connectivity(2g / 3G) enabled Mobile test lab 25 Mobility Test Automation Tools Native object based Bitmap based with OCR Free-to-use Commercial 26 Mobile Testing Set-up Private Mobile Cloud Local Mobile Cloud Public Mobile Cloud Emulators Copyright Capgemini All Rights Reserved Capgemini. All rights reserved. 9

10 Control Test progress Issues Quality But also Devices Operating systems on devices App versions 28 Agenda Introduction Mobile testing challenges Mobile test strategy & approach Key differences Q&A Copyright Capgemini 2014 All Rights Reserved 29 Key differences Connectivity Understanding Physical Characteristics Fragmentation Test Automation User Experience Engaging with third parties Network environment Security In combination with traditional best practices and processes for testing Capgemini. All rights reserved. 10

11 Questions? About Capgemini and Sogeti With more than 120,000 people in 40 countries, Capgemini is one of the world's foremost providers of consulting, technology and outsourcing services. The Group reported 2011 global revenues of EUR 9.7 billion. Together with its clients, Capgemini creates and delivers business and technology solutions that fit their needs and drive the results they want. A deeply multicultural organization, Capgemini has developed its own way of working, the Collaborative Business Experience TM, and draws on Rightshore, its worldwide delivery model. Rightshore is a trademark belonging to Capgemini The information contained in this presentation is proprietary Capgemini. All rights reserved Capgemini. All rights reserved. 11