Unmoderated Usability Testing Tools. Jiayin Ye User Experience Intern 11/3/2014

Transcription

1 Unmoderated Usability Testing Tools Jiayin Ye User Experience Intern 11/3/2014

2 Unmoderated Usability Testing 2

3 What is unmoderated usability testing? Automatically gathers participants feedback and record their behavior Unmoderated usability testing tool 3

4 Why unmoderated usability testing? Test large number of people simultaneously Test multiple Web sites simultaneously Natural environment Great way to introduce usability testing Save money Fewer logistics to manage 4

5 How to do unmoderated usability testing? Define the study Recruit participants Launch your test and send invitations Analyze your results 5

6 Unmoderated Usability Testing Tools Research 6

7 Research landscape 17 Umoderated Usability Testing Tools 7

8 Evaluation Criteria Recruiting Delivery Pricing Workflow 8

9 Documentation Document Keep track of features of existing unmoderated usability testing tools online Presentation 9

10 Introducing each unmoderated usability testing tool 10

11 Keynote Function Testing: mobile/load testing Monitoring: mobile app/web monitoring Analytics Pricing: call for pricing (>$1000 per project) Mobile testing price: four different levels 11

12 UserZoom UserZoom Recorder 12

13 UserZoom Support various types of tests Delivery: quantitative & qualitative data Workflow: Build study: Data analytics: Recruiting participants: Pricing: various according to custom identity 13

14 Morae Software & web user experience testing Mobile device & hardware testing 14

15 Morae Workflow: Set up test -> record & view -> share findings Function: Recorder Observer Manager Delivery: Reports containing charts, tables, and video clips Recruiting: by user themselves Pricing: 30 days free trial Buy software: $1,

16 Loop11 Support: various test type Pricing: First project free Per month: Three different levels Per project: $350 Workflow: Start a usability test Customize it Invite participants Launch & learn 16

17 OpenHallway 1. Create new test 2. Input test URL User do the test 4. View user operation video

18 OpenHallway Workflow: Create test project & scenarios Record users remotely or locally Watch video results Recruiting: By user themselves Use try my UI: recruit users for you Delivery Video User thoughts/comments Pricing: 10 min video session for free Per month: three different levels 18

19 Try my UI User testing 19

20 Try my UI Workflow Set scenario + tasks + number of users + demographic profile Get video and other deliveries Delivery Narrated video Written answers of questions Pricing: Use own users Recruit by try my UI: Three different levels 20

21 UserTesting Workflow: 4 steps Delivery: video Recruiting: offered by software Pricing: Call for pricing Free trial available 21

22 Usabilla Usabilla live for website Customized feedback button to collect user feedback Collect user evaluation Online panel Delivery: visualized statistical data Pricing free trial available Per month: 4 different levels 22

23 Chalkmark Function: Website Usability testing & analysis Workflow: 3 steps Delivery Overview Heatmap Click density grid Custom selection zones Pricing Per month/year/survey Suit: Chalkmark + Treejack + OptimalSort 23

24 Treejack Function Test & evaluation information architecture Content hierarchy design Workflow: Input your tree Set tasks Recruit participants Delivery Pricing: same as Chalkmark 24

25 Intuitionhq Workflow: Upload screenshots/wireframes/sketches Set tasks Do same screen or A/B test Publish test Delivery: Heatmap Click time statistic data Task finish time cost Share results via (containing link to the result) Pricing: Free plan Determined by multiple factors 25

26 Kupima 1. Getting user tests 2. Setting test steps 3. Setting questions 4. Managing your tests 5. Get user feedback 6. Watch people using your site 7. Integrated summaries 8. Instant reporting 26

27 Kupima Workflow: 8 steps Recruiting: No user recruiting service Delivery: Video (with watermark) PDF report Pricing: Free for services above Premium features like recruiting 27

28 Navflow Workflow: Upload design pictures Let user to the test View results Recruiting: recruiting service test with customer s own users answer others tests to earn credits Delivery: visualization report + graph heatmap Pricing: 5 different levels 28

29 Userfeel Workflow: Specify the Website for Usability Testing Set the Scenario and Tasks Watch Videos of Testers Using Your Site Share results with others Delivery User screen video Answers to pre-set questions Pricing $39 per user (more than five, cheaper) Set test details Record user test 29

30 Userlytics Workflow: Set up usability test Recruiting Receive report Delivery Pricing: As low as $49 per respondent session Depend on various factors 30

31 Applause Function for multiple platforms on multiple features Usability test Workflow Select test type Set study requirements Assign Usability expert Delivery: comprehensive usability report View individual responses Pricing: flexible, has a price estimation tool 31

32 What users do Function Managed service: enterprise level company Self service: small-medium company Panel: Get paid to test websites and mobile apps Workflow Managed service: Platform for usability test Panel for recruiting Pricing: 4 different levels Self service: Set tasks Select users View results Pricing: 30 trial test, multiple levels/packs 32

33 Summary Function Workflow Recruiting Delivery Pricing 33

34 Appendix 34

35 Online Unmoderated Usability Testing Tools URL Keynote UserZoom Morae Loop11 OpenHallway Try my UI UserTesting Usabilla Chalkmark Treejack Intuitionhq Kupima Navflow Userfeel Userlytics Applause What users do 35

36 Articles about unmoderated usability testing Unmoderated, Remote Usability Testing: Good or Evil? Listing of unmoderated usability testing tools 25 Great Unmoderated Remote Usability Testing Apps 36

37