Introduction to ios Testing

Transcription

1 Introduction to ios Testing Presented by Amy Klatt August 8, 2012

2 Agenda Overview Best practices Installing apps Setting up a test environment Screenshots and video Logs Q & A 2

3 The Challenge Overview 3

4 Overview Why is in the wild testing so important? Device specs and variations in OS versions are far less of an issue on ios than other mobile platforms. However, testing on real devices allows a developer to check app performance in a variety of conditions across different devices, OSes and mobile carriers. 4

5 The Challenge Best Practices 5

6 Best Practices As with any other test cycle, bugs should follow standard utest conventions and guidelines. Do include: Clear, actionable steps to reproduce Useful documentation Quality attachments are important. Your bug might not occur across every device. This is your evidence the bug actually exists! 6

7 Best Practices What documentation should I include? It s helpful to include: Screenshots Videos Crash logs The exact error message Does my bug need a log? Do I need a video or is a screenshot OK? 7

8 The Challenge Installing apps 8

9 Installing apps Apps can be installed by syncing with itunes or by downloading straight to the device. Common install scenarios: Installing from an FTP Installing from TestFlight Installing from the App Store Do I need to be provisioned? What if I get an error when I try to install? Is an installation error a bug? 9

10 Installing apps common problems 10

11 The Challenge Setting up a test environment 11

12 Setting up a test environment Setting up a test environment is a fairly straightforward process under ios Tools aside from itunes may be helpful, but are not strictly necessary: iphone Configuration Utility 3rd party utilities Developer tools and utilities are somewhat limited for ios devices. 12

13 Setting up a test environment 13

14 Setting up a test environment 14

15 The Challenge Tools: Logs and screenshots 15

16 Utilities - Screenshots You can take a screenshot on any ios device. Press and release the home button and the sleep wake button simultaneously You will hear a shutter clicking sound The screenshot will be found in the camera roll in the Photos app Copy the screenshot over to your Mac or PC or simply it to yourself 16

17 Utilities - Video There are fewer options for capturing video output on an ios device. External camera Hardware or peripherals (Digital AV Adapter, etc.) 3rd party apps Video capture utilities may be limited by the device hardware specs or OS version. Follow video recording best practices if you are using an external camera to record a bug. 17

18 Utilities - Logs When an app crashes or exits unexpectedly, a crash log is written. How to obtain a crash log: Sync your ios device through itunes. Locate the zipped crash log files The file can be uploaded to the utest platform as an attachment Or use the iphone Configuration Utility to save or export logs. 18

19 Utilities - Logs In Windows, the log can be found under: C:\Users\<USERNAME>\AppData\Roaming\Apple computer\logs\crashreporter/mobiledevice/<devi CE_NAME> On a Mac, you will find logs in: ~/Library/Logs/CrashReporter/MobileDevice/<DEVIC E_NAME> 19

20 Utilities - Logs You can also capture browser debugging information on an ios device. This can be helpful for testing mobile websites. Go to Settings > Safari > Advanced and enable Debug Console Error output will be displayed in Safari. A screenshot of error output can be attached to your bug if necessary 20

21 Utilities - Logs 21

22 Utilities - Logs 22

23 Utilities - Logs 23

24 Summary As you test ios mobile applications and websites, be sure to do the following: Write high quality bugs Provide clear steps to reproduce Attach useful documentation Use available tools and utilities to help demonstrate the issue you re reporting. 24

25 The Challenge Thank You Questions? 25