1 user checks! improve your design significantly" Workshop by Userneeds - Anouschka Scholten Assisted by ArjanneAnouk Interact Arjanne de Wolf AmsterdamUX Meet up - June 3, 2015
2 Make people s lives better.
3 Quantitative methods?
4 Getting to empat! w hy! the ability to see an experience through another person s eyes a key function of usability testing usability testing enables you to really see, hear and find out what moves your users
5 Usability Test traditional 1 round of testing" In a lab environment, eye tracking Moderator is a UX er, designer indirectly involved" " Process based
6 Usablity test drawbacks An extensive report, little or no redesign No retest Not in user context High costs: lab, eye tracking, special UX researcher Schedule well in advance (at least 1 month)
7 User Checks Agile Usability Test Test and retest within 1 week In the users context, quick and easy set up Designer conducts the test Value based
8 Design new site ggdhaaglanden.nl User check with a doctor in his office GGD Haaglanden project Angi Studio:"
9 From Ik weet niet wat OGGZ betekent, Milieu en Gezondheid is dit voor mij? I don t know what OGGZ means, Environment and Health is this for me? Menu indeling: geen overzicht, inzicht, herkenning, focus voldoet niet aan verwachting, weg wordt niet gevonden Menu: no overview,- insight, -regognition, -focus doesn t match expectations, user can t find what they need GGD Haaglanden project Angi Studio:
10 To Natuurlijk, ook SOA en bezorgd over kindermishandeling ja, belangrijk! Off course, also SOA and worried about child abuse yes, important! Wijzigingen op verschillende niveaus: wat waar onder valt, naamgeving, hiërarchie, toevoeging visuele cues (affordance), less is more Changes on various levels: IA, labeling, hierarchy, visual cues (affordance), focus, less is more GGD Haaglanden project Angi Studio:
11 Redesign LINDA subscription Project Angi Studio: Bij Meiden verwacht ik 14 tot 21...oh, ik denk dat ik toch wel in die doelgroep val als ik het zo lees? LINDA.Girls.. I expect this is for 14 till 21 year old oh, reading this subscription I think it actually does fit me? Pop-up information about LINDA.meiden
12 Sub home Subscription with incentive - mobile Zo onder elkaar is duidelijk, je kunt er zo doorheen Very clear and easy to walk through this way, underneath each other Lange lijst om te scrollen vormde geen enkel probleem Scrolling was no problem at all on mobile Navigeren met hoofdmenu gebeurde eerst ronde niet. Sticky menu bood ook geen oplossing Navigating via main menu on top wasn t used, it was ignored, even with a sticky menu dead end alert! 2 e round: de footer met menu, werd wel gebruikt Footer with next step was used Project van Angi Studio:
13 User checks drawbacks Too unexperienced biased designer Heavy pressure on improving the design within agile process (keeping in pace with development) With high fidelity testing it demands velocity for retest with high multidisciplinary efforts: product owners, IxD, visual design and content
14 powerful! agile usability testing with user checks
15 User Checks Agile Usability Testing Test and retest within 1 week In the users context, quick and easy set up Designer conducts the test Value based
16 User checks - Agile usability test cycle in 1 week Again or To final design 1 " Test Objectives 6 " Redesign 5 " Evaluate findings 1st round 2 " User goals 8 " Evaluate findings 2nd round 7 " User checks 4 " User checks 3 " Tasks
17 get down to it!
18 Usability testing is about observing behaviour Watch the user do what comes naturally, while performing a task. Don't help. Not asking about opinion.
19 What to test?
20 When to test Early as possible Often as possible ROI Save on development time Less support calls/ s More conversion
21 Procedure usability test 1. Let your user experience the prototype/mvp/site Show don t tell. Put your prototype in the user s hands (or your user in the prototype) and give just the minimum context so they understand what to do. Don t explain your thinking or reasoning for your prototype. 2. Have them talk through their experience (talk aloud) For example, when appropriate, as the host, ask Tell me what you are thinking as you are doing this. 3. Actively observe Watch how they use (and misuse!) what you have given them. Don t immediately correct what your user tester is doing. 4. Follow up with questions This is important; often this is the most valuable part of testing. Show me why this would [not] work for you. Can you tell me more about how this made you feel? Why? " Answer questions with questions (i.e well, what do you think that button does )
22 Key: moderating the test If they Are not talking Say What are you thinking? Ask you a question (e.g. Is that what I should do here? ) Get a task right or wrong Mess up Are unsure if they have completed a task and ask you Criticize the design Rephrase the question (e.g What do you think you should do? ) Thank you, that is very helpful " Thanks for the feedback Remember, you can t make any mistakes. You re doing a great job. Is this what you would do if you were doing X at home? Thanks for the feedback
23 User Checks set up Test script with real tasks Real target users as participants Ideally conducted in context user on their own device Record audio and screen capture 1 test moderator, 1 observer (more observers are possible, but not too much and really on the background)
24 Test script-agenda 1. Introduction and questions up front 2. Situation sketch + think aloud instruction 3. Think aloud session 4. Evaluate session, open questions 5. End session - thank participant
25 Example Introduction Thank you for participating, we really appreciate it! I m <name> and there is one person besides me <name> is also here. We re helping a company to develop a new service / to optimize a website This company cares about their customers and thinks it s very important to involve potential customers when developing new services. They want the new service to be valuable for you. That s why we want to ask you some questions and along the way we d like show you the service/site. You can walk through it. The interview takes about a 20 minutes. If you do not understand something, or you want to add something, do not hesitate to interrupt me! Do you mind if we record the session for future reference within our organisation? Everything we discuss and record is confidential; we will not share things without your permission! Any questions?
26 Task-think aloud instruction You are going to see: a draft proposal of the service, which has not yet been developed/ the site now. <if a proptotype> The proposal is only images. It looks finished and you can click through it, but most of it is not working yet. It s also not as fast as a normal app and you can t do anything wrong. <Situation sketch and task> Please open the link on your mobile phone and walk through the app. Can you please say things aloud? Not to me, but for yourself? Everything you do or say is fine, eg. Also "what the hell is this?!. You can start now by clicking the link
27 Evaluation questions Evaluation questions after the think aloud task, zoom in to what you observed, like: You mentioned what did you mean with that? I saw you doing why? What did you expect? How would you call it? You didn t go to why not? What do you expect to find? Also ask service, product or content specific questions, e.g.: You read this advice/text thoroughly, why? You were going back and fourth between product X and Y, why? You chose X and said something about the participants, what did you mean with that?
28 a case!
29 Tell us The main goal(s) of the site/application Target users Main tasks, main questions of the users Context of use Do not tell us how you think the site works now!!!
30 Volunteers 2 moderators 2 users
31 Observers Yellow sticky notes for findings Objective, record behaviour! ONLY write down what you observe, like: mentions X and doesn t seem to not know what X is ; sighs heavily on returning to; is confused about; does not know where to go next, seems frustrated;. Other coloured sticky notes for possible improvements that pop up in your mind, like: feedback is missing; label is not understood; no focus; X doesn t meet expectation;
32 1st user check session! 20 min! 2nd user check session! 20 min! Findings & improvements! 20 min!
33 5 Evaluate Findings The findings, issues Collect Findings Prioritize issues to be solved: prioritize from the business/user goals perspective, rate them Do this with the whole team
34 5 Evaluate Findings Design improvements Improvements on every level, note down (labeling, content, categorization, visual assets, interaction, concept, flow, persuasion) > but keep the business/user goals perspective in mind (focus)! Prioritize by Impact & Effort (matrix) or dot-vote Choose improvement(s) to be re-tested Do this with the whole team
35 Impact & Effort matrix Impact: creates high/low value for users effort: high/low effort in terms of time, knowledge, tools, people Do this with the whole team incl. decision makers! Source:
36 6 " Hypothesis and improve Prepare to retest Improve the design Set up the hypothesis (or more than one) We believe that [this statement is true (e.g adding social proof, better labeling, visual cues will )] We will know we are right/wrong when we have the following result [quantitative feedback; qualitative feedback; KPI; }
Usability Test Script Session 1 [date & time] [participant s name and location] [investigator s names] Step 1. Introducing yourself & read instructions Hi, my name is [ ] and I m going to be walking you
Usability Testing Guiding Principles Finding Usability Problems This is a step by step guideline to usability testing. Usability testing is Usability testing is testing anything with which users interact,
Andrew Hill USER EXPERIENCE DESIGN PORTFOLIO Projects Medical Device Call Center & Field Service Management Desktop & Mobile Apps (Siebel Open UI, ios) User Shadowing & Ethnographic Research Observation
Name Nationality Department Email Address Website Coen Danckmer Voordouw Dutch / Nederlands Man and Activity firstname.lastname@example.org www.danckmer.nl Project: Image: Photographer: Other images: COOLS CoenDVoordouw
Usability Test Results Task: Starting Position: 1 Home Scene Lauren DiVito March 6, 2014 Moderator Script: Evaluation Measures: Notes to Moderator: Task: Starting Position: Moderator Script: Evaluation
The Social Accelerator Setup Guide Welcome! Welcome to the Social Accelerator setup guide. This guide covers 2 ways to setup SA. Most likely, you will want to use the easy setup wizard. In that case, you
Usability test script Reprinted from Rocket Surgery Made Easy 2010 Steve Krug Web browser should be open to Google or some other neutral page Hi,. My name is, and I m going to be walking you through this
1 How to Run an End User Feedback Session on Your Product Teena Singh, Principal Product Manager, HCM User Experience Lulit Bezuayehu, User Experience Architect, HCM User Experience 1 Copyright 2012, 2013,
Belangrijk: Schrijf je antwoorden kort en bondig in de daartoe voorziene velden. Elke theorie-vraag staat op 2 punten (totaal op 24). De oefening staan in totaal op 16 punten. Het geheel staat op 40 punten.
Guidelines for Using the Retrospective Think Aloud Protocol with Eye Tracking September, 2009 Short paper by Tobii Technology Not sure of how to design your eye tracking study? This document aims to provide
Mail Merge Tutorial (for Word 2003-2007) By Allison King Spring 2007 (updated Fall 2007) What is mail merge? You've probably heard it mentioned around the office or at an interview (especially for a temp
Topic 5 Multimedia Project Development LEARNING OUTCOMES By the end of this topic, you should be able to: 1. Plan a multimedia development project; 2. Explain the steps involved in multimedia design; 3.
Moderating Usability Tests Principles & Practices for Interacting Joe Dumas and Beth Loring Morgan Kaufmann, 2008 ISBN 978-0-12-373933-9 Introduction Getting Started 10 Golden Rules Initial Contacts Interacting
Module 4: Identifying and Researching Career Options Transcript Introduction (video clip 1) This module will focus on the second step of the Career Planning Process, which is the step in which you ll figure
Chapter 7: TEST THE COMPUTER PROTOTYPE Remember: Authentic Subjects, Authentic Tasks, and Authentic Conditions Make a Test Plan Unless you have altered the goals for your site since you tested the paper
USABILITY TEST PLAN TEAM MIKE / GROUP 2: Rafael Flores Mike Wesolowski Mike Wilson Michael Correa Kasey Thompson Dave Castleton CONTENTS Table of Contents...2 Executive Summary...3 Methodology...4 Test
~ We are all goddesses, the only problem is that we forget that when we grow up ~ This brochure is Deze brochure is in in English and Dutch het Engels en Nederlands Come and re-discover your divine self
Name: Candidate Registration Number: Date of Exam: MINISTRY OF DEFENCE LANGUAGES EXAMINATIONS BOARD SURVIVAL SLP1 DUTCH PAPER A Reading Task 1 Task 2 Time allowed Translation Comprehension 15 minutes Candidates
The USER & The Design Process Jane Pirone User Friendly User Centered Design UX (User Experience) User Testing Usability UI (User Interface) why should we care so much about the USER? oh and what about
KM COLUMN MAY 2005 What is information architecture? Organising functionality and content into a structure that people are able to navigate intuitively doesn t happen by chance. Organisations must recognise
Continuous Program Improvement (CPI) CPI Support Call Analyzing CPI Qualitative Data Wednesday February 11 th & Thursday February 12 th, 2009 ETR Associates BA Laris, Lisa Unti, Kris Freiwald, Gina Lepore
Welkom in de wereld van EDI en de zakelijke kansen op langer termijn Sectorsessie mode 23 maart 2016 ISRID VAN GEUNS IS WORKS IS BOUTIQUES Let s get connected! Triumph Without EDI Triumph Let s get connected
HOW TO USE UNIVERSAL JOBMATCH Universal Jobmatch is an internet web site. It is run by The Department of Work and Pensions. Job seekers receiving benefits will be expected to register and use it. https://www.gov.uk/jobsearch
What can Kind en Gezin (Child and Family) do for you and your family? Discover our broad range of free services Engelse vertaling van Kennismakingsfolder ouders You are pregnant Je bent zwanger This is
Introduction Welcome to Substance Abuse: Training for Employees. This course will teach you about many aspects of substance abuse in the workplace. But before we begin, let's make sure you understand how
employager 1.0 design challenge a voyage to employ(ment) EMPLOYAGER 1.0 On the initiative of the City of Eindhoven, the Red Bluejay Foundation organizes a new design challenge around people with a distance
Inleiding Elke keer dat ik een uitspraak of een inspirerende quote hoor of zie dan noteer ik deze (iets wat ik iedereen aanraad om te doen). Ik ben hier even doorheen gegaan en het leek me een leuk idee
Facilitator Script Slacker Usability Test Portable OOBE June 2-3, 2008 This is a rough script for the usability test facilitator. The script shows flow and intent. Deviation from the script will be necessary
Top 10 Skills and Knowledge Set Every User Experience (UX) Professional Needs The user experience (UX) of your products is only as good as the knowledge and skills of your UX staff. Here are the top 10
801 Don't Make Me Think: Creating Effective e-learning with User Testing Kate Baldus, Bank Street College Angela Nicholas, Educational Usability Testing Overview What it is Observe users to discover errors
INTERVIEW TIPS PREPARING FOR INTERVIEWS These pre-interview essentials could make the difference between your next career step or a career full stop! Make sure you know the exact address and time of the
White Paper User Testing By Adrian Westlake UX Design Team Lead Intelligent Environments Introduction All products should be tested by the people that will use them, regardless of whether that audience
UX Research and Market Research A Conversation with Apala Lahiri Chavan Chief Oracle and Innovator Human Factors International The most important thing for user experience professionals to know is when
Review Identify and analyze a profitable niche market! Identify and analyze the competition! Develop a Unique Value Proposition! Create a pre-listing presentation! Build a database of homeowners! Types
Concept Design Gert Landheer Mark van den Brink Koen van Boerdonk Content Richness of Data Concept Design Fast creation of rich data which eventually can be used to create a final model Creo Product Family
Verbal Communication II Course Health Science Unit II Communication Essential Question How does the communication process affect health care delivery? TEKS 130.204 (c) 2A, 2B, 3B, 3C Prior Student Learning
Introduction Improving Government Websites and Surveys With Usability Testing and User Experience Research Jennifer Romano Bergstrom, Jonathan Strohl Fors Marsh Group 1010 N Glebe Rd., Suite 510, Arlington,
EMPLOYER USER GUIDE Getting Started... 2 Request Log-In Permission... 3 Log In... 4 My Control Panel... 5 Post a New Job... 7 Review Student Applications... 12 Contact Applicants... 13 Hire a Student...
THE EMOTIONAL VALUE OF PAID FOR MAGAZINES Intomart GfK 2013 Emotionele Waarde Betaald vs. Gratis Tijdschrift April 2013 1 CONTENT 1. CONCLUSIONS 2. RESULTS Reading behaviour Appreciation Engagement Advertising
Getting the most out of a usability test: Effective note-taking and analysis A workshop for User Friendly 2006 Hangzhou, China Whitney Quesenbery WQusability www.wqusability.com 908-638-5467 email@example.com
Daar krijg je dan je groendakmaterialen geleverd op een pallet. Waar moet je naar toe met zo'n pallet. Retour brengen? Gebruiken in de open haard? Maar je kunt creatiever zijn met pallets. Zo kun je er
Usability Test Plan for LVC 150 Prototype LVC 150 Mobile Web App Prepared for: Cc: Dr. Jeff Ritchie, Project Advisor Completed by: Emily Johnson Haley Dobart Tim Harris Ryan Dotson Date: March 23, 2014
Re- En g in e e rin g e C o m m e rc e F o r O n lin e B u s in e s s Customer User Guide Last Updated: June 2012 2012 Digibilly - All Rights Reserved Worldwide. PayPal is a registered trademark of PayPal,
A Usability Test Plan for The San Antonio College Website (2012) Prepared for Julie Cooper and Mark Goodspeed Contributors of the San Antonio College Website San Antonio, Texas by Cristal Palomino, Shelby
GATE Pilot Safety MAYORGAME (BURGEMEESTERGAME) Twan Boerenkamp Who is it about? Local council Beleidsteam = GBT or Regional Beleidsteam = RBT Mayor = Chairman Advisors now = Voorlichting? Official context
Lesson: Family Violence CLB 5-6 Instructional Package Family Law: Family Violence (CLB 5-6) CLB Outcomes CLB 5-III: Getting Things Done CLB 6-IV: Comprehending Information CLB5-II: Reproducing Information
Monitoring the team s performance Why does your team need to be monitored? How can performance be monitored? You should ensure that you monitor only what is really important. In the two BS2 sessions Making
Usability Testing Agenda! What is usability and why does it matter?! The basics: How to conduct a usability test! Q&A What is Usability?! Steve Krug, author or Don t Make Me Think! Making sure that something
Welcome to the NSLDS hands-on session. My name is Larry Parker. I'm from the Department of Education NSLDS. Today, I have with me a whole host of folks, so we're gonna make sure that if you have any questions
- 1 - PloneSurvey User Guide (draft 3) This short document will hopefully contain enough information to allow people to begin creating simple surveys using the new Plone online survey tool. Caveat PloneSurvey
Join Your Accountant And Jump On Our Cloud Your accountant is using Clear Books so why aren't you? Carry on reading to find out why Clear Books is the perfect accounting software for you and your business.
De afbeelding kan niet worden weergegeven. Het is mogelijk dat er onvoldoende geheugen beschikbaar is op de computer om de afbeelding te openen of dat de afbeelding beschadigd is. Start de computer opnieuw
Pristine s Day Trading Journal...with Strategy Tester and Curve Generator User Guide Important Note: Pristine s Day Trading Journal uses macros in an excel file. Macros are an embedded computer code within
Universiteit Stellenbosch University How to Create an Event Article The Event Creation Process Scott Ortlepp Corporate Marketing Digital Media Team Contents Making sure you have the correct article type...
DESIGNING A USER-FOCUSED EXPERIENCE HubSpot Design Certification Class 5 Kyle Geiste Experience Designer HubSpot Academy @kylegeiste TODAY S GOAL: You will be able to create templates that are optimized
Accelerate Development Reduce Time to Product Automate Critical Tasks White Paper: Designing Resourceful Graphical User Interfaces (GUIs) for Healthcare Applications The ASHVINS GROUP, Inc. 6161 Blue Lagoon
MASTERCLASS INNOVATIEVE BENADERINGEN VAN LEERPROCESSEN EN LEERPRAKTIJKEN PROF. DR. MARCUS SPECHT WELTEN INSTITUTE RESEARCH CENTRE FOR LEARNING, TEACHING AND TECHNOLOGY OPEN UNIVERSITEIT NEDERLAND MARCUS.SPECHT@OU.NL
IP-NBM 1 De bescheidenheid van een schaker 2 Maar wat betekent dat nu 3 De drie elementen richting onsterfelijkheid Genomics Artifical Intelligence (nano)robotics 4 De impact van automatisering en robotisering
Clinical Decision Making Welcome to this short overview of Clinical Decision Making for Nurses, Midwives and Allied Healthcare Professionals. We've split this overview into a number of elements that will
Usability Testing Credit: Slides adapted from H. Kiewe Materials for this class Readings: Nielsen, Why You Only Need to Test with 5 Users Dickelman, Usability Testing -- Fear and Loathing on the Keyboard
Chapter 6 Stock 139 140 Create a New Stock Item Click Stock on top bar of buttons on main screen. Stock Section To enter a new stock item onto the system click New. This will open the Stock Wizard. New
Free Website By Weebly Site & Weebly SEO Weebly is the one of the most easiest CMS platform that you can start own online business within a second. You can build a free website. This pdf file will discuss
BEST PRACTICES: How to Evaluate Software Demonstrations Get Organized to Stay in Control Reviewing demonstrations is perhaps the most critical component of the software selection process. This is where
Setting up VOIP conferencing on a PC You must have your computer and an internet connection. Your computer must have a supported sound card (most computers do). It is recommended that you use a computer
A GUIDE TO MOBILE EMAIL UNDERSTANDING THE WHAT, HOW & WHY TABLE OF CONTENTS EMAILS OPENED ON MOBILE? 1 Email open market share 2011-2013 WHAT DOES THIS MEAN? 2 FIRST THINGS FIRST 2 From and Subject Lines
Lesson plans for exam preparation ISE II Interview: Lesson Plan 3 ISE II (B2) Interview: preparing the Interactive Task Level: ISE II (CEFR B2) Time: 3 x 45 minutes Aims: To prepare for the Interactive
Usability Evaluation with Users CMPT 281 Outline Usability review Observational methods Interview methods Questionnaire methods Usability ISO 9241-11: The extent to which a product can be used by specified
Usability Test Results CyberLynx Annotator for Lotus 1-2-3 Executive Summary John Milanski ENG525 Usability Testing 25 Mar 1997 1 2 O VERVIEW Formal usability tests how well your software performs with
NAAR NEDERLAND HANDLEIDING www.naarnederland.nl 1. Introduction As of 15 March 2006, certain foreign nationals wishing to settle in the Netherlands for a prolonged period who require a provisional residence
Builder 2.0 Guide and Walkthrough Getting Started Get started with Builder 2.0 by logging in to the application via your Facebook. Once you have logged into the application, the main dashboard will appear.
Interactive Prototype Introduction & Mission Statement Anxiety disorders are among the most common mental health disorders in the United States. They can be chronic, debilitating, and incapacitating for
SCRIPT MICROLECTURE: RECORD A MICROLECTURE UNIVERSITY TWENTE Martine ten Voorde & Chris Rouwenhorst, onderwijskundige Dienst, universiteit Twente Cindy de Koning, presentator en trainer, cindydekoningmedia
ONE SIZE DOES NOT FIT ALL Affordable, effective and engaging approaches to user testing Justin Darley PM Consultant Sigma UK What is User Experience (UX)? a person s perceptions and responses that result
A MyPerformance Guide to Performance Conversations brought to you by the BC Public Service Agency contents Elements of a Conversation Preparing for the Conversation Clear on Intent/Topic for Discussion
Conducting Interviews in Qualitative Social Science Research Types: individual face-to-face (choose non-shy participants willing to share) telephone (not ideal but used when direct access not possible)
Assuring the Cloud Hans Bootsma Deloitte Risk Services firstname.lastname@example.org +31 (0)6 1098 0182 Need for Assurance in Cloud Computing Demand Fast go to market Support innovation Lower costs Access everywhere
VIDEO CREATIVE IN A DIGITAL WORLD Digital analytics afternoon Hugo.email@example.com firstname.lastname@example.org AdReaction Video: 42 countries 13,000+ Multiscreen Users 2 3 Screentime is enormous
1 It was late at night and Smartie the Penguin was WIDE awake He was supposed to be fast asleep but tomorrow was his birthday. He was so excited; all he wanted was a new computer! 2 The big day came and