1 user checks! improve your design significantly" Workshop by Userneeds - Anouschka Scholten Assisted by ArjanneAnouk Interact Arjanne de Wolf AmsterdamUX Meet up - June 3, 2015
2 Make people s lives better.
3 Quantitative methods?
4 Getting to empat! w hy! the ability to see an experience through another person s eyes a key function of usability testing usability testing enables you to really see, hear and find out what moves your users
5 Usability Test traditional 1 round of testing" In a lab environment, eye tracking Moderator is a UX er, designer indirectly involved" " Process based
6 Usablity test drawbacks An extensive report, little or no redesign No retest Not in user context High costs: lab, eye tracking, special UX researcher Schedule well in advance (at least 1 month)
7 User Checks Agile Usability Test Test and retest within 1 week In the users context, quick and easy set up Designer conducts the test Value based
8 Design new site ggdhaaglanden.nl User check with a doctor in his office GGD Haaglanden project Angi Studio:"
9 From Ik weet niet wat OGGZ betekent, Milieu en Gezondheid is dit voor mij? I don t know what OGGZ means, Environment and Health is this for me? Menu indeling: geen overzicht, inzicht, herkenning, focus voldoet niet aan verwachting, weg wordt niet gevonden Menu: no overview,- insight, -regognition, -focus doesn t match expectations, user can t find what they need GGD Haaglanden project Angi Studio:
10 To Natuurlijk, ook SOA en bezorgd over kindermishandeling ja, belangrijk! Off course, also SOA and worried about child abuse yes, important! Wijzigingen op verschillende niveaus: wat waar onder valt, naamgeving, hiërarchie, toevoeging visuele cues (affordance), less is more Changes on various levels: IA, labeling, hierarchy, visual cues (affordance), focus, less is more GGD Haaglanden project Angi Studio:
11 Redesign LINDA subscription Project Angi Studio: Bij Meiden verwacht ik 14 tot 21...oh, ik denk dat ik toch wel in die doelgroep val als ik het zo lees? LINDA.Girls.. I expect this is for 14 till 21 year old oh, reading this subscription I think it actually does fit me? Pop-up information about LINDA.meiden
12 Sub home Subscription with incentive - mobile Zo onder elkaar is duidelijk, je kunt er zo doorheen Very clear and easy to walk through this way, underneath each other Lange lijst om te scrollen vormde geen enkel probleem Scrolling was no problem at all on mobile Navigeren met hoofdmenu gebeurde eerst ronde niet. Sticky menu bood ook geen oplossing Navigating via main menu on top wasn t used, it was ignored, even with a sticky menu dead end alert! 2 e round: de footer met menu, werd wel gebruikt Footer with next step was used Project van Angi Studio:
13 User checks drawbacks Too unexperienced biased designer Heavy pressure on improving the design within agile process (keeping in pace with development) With high fidelity testing it demands velocity for retest with high multidisciplinary efforts: product owners, IxD, visual design and content
14 powerful! agile usability testing with user checks
15 User Checks Agile Usability Testing Test and retest within 1 week In the users context, quick and easy set up Designer conducts the test Value based
16 User checks - Agile usability test cycle in 1 week Again or To final design 1 " Test Objectives 6 " Redesign 5 " Evaluate findings 1st round 2 " User goals 8 " Evaluate findings 2nd round 7 " User checks 4 " User checks 3 " Tasks
17 get down to it!
18 Usability testing is about observing behaviour Watch the user do what comes naturally, while performing a task. Don't help. Not asking about opinion.
19 What to test?
20 When to test Early as possible Often as possible ROI Save on development time Less support calls/ s More conversion
21 Procedure usability test 1. Let your user experience the prototype/mvp/site Show don t tell. Put your prototype in the user s hands (or your user in the prototype) and give just the minimum context so they understand what to do. Don t explain your thinking or reasoning for your prototype. 2. Have them talk through their experience (talk aloud) For example, when appropriate, as the host, ask Tell me what you are thinking as you are doing this. 3. Actively observe Watch how they use (and misuse!) what you have given them. Don t immediately correct what your user tester is doing. 4. Follow up with questions This is important; often this is the most valuable part of testing. Show me why this would [not] work for you. Can you tell me more about how this made you feel? Why? " Answer questions with questions (i.e well, what do you think that button does )
22 Key: moderating the test If they Are not talking Say What are you thinking? Ask you a question (e.g. Is that what I should do here? ) Get a task right or wrong Mess up Are unsure if they have completed a task and ask you Criticize the design Rephrase the question (e.g What do you think you should do? ) Thank you, that is very helpful " Thanks for the feedback Remember, you can t make any mistakes. You re doing a great job. Is this what you would do if you were doing X at home? Thanks for the feedback
23 User Checks set up Test script with real tasks Real target users as participants Ideally conducted in context user on their own device Record audio and screen capture 1 test moderator, 1 observer (more observers are possible, but not too much and really on the background)
24 Test script-agenda 1. Introduction and questions up front 2. Situation sketch + think aloud instruction 3. Think aloud session 4. Evaluate session, open questions 5. End session - thank participant
25 Example Introduction Thank you for participating, we really appreciate it! I m <name> and there is one person besides me <name> is also here. We re helping a company to develop a new service / to optimize a website This company cares about their customers and thinks it s very important to involve potential customers when developing new services. They want the new service to be valuable for you. That s why we want to ask you some questions and along the way we d like show you the service/site. You can walk through it. The interview takes about a 20 minutes. If you do not understand something, or you want to add something, do not hesitate to interrupt me! Do you mind if we record the session for future reference within our organisation? Everything we discuss and record is confidential; we will not share things without your permission! Any questions?
26 Task-think aloud instruction You are going to see: a draft proposal of the service, which has not yet been developed/ the site now. <if a proptotype> The proposal is only images. It looks finished and you can click through it, but most of it is not working yet. It s also not as fast as a normal app and you can t do anything wrong. <Situation sketch and task> Please open the link on your mobile phone and walk through the app. Can you please say things aloud? Not to me, but for yourself? Everything you do or say is fine, eg. Also "what the hell is this?!. You can start now by clicking the link
27 Evaluation questions Evaluation questions after the think aloud task, zoom in to what you observed, like: You mentioned what did you mean with that? I saw you doing why? What did you expect? How would you call it? You didn t go to why not? What do you expect to find? Also ask service, product or content specific questions, e.g.: You read this advice/text thoroughly, why? You were going back and fourth between product X and Y, why? You chose X and said something about the participants, what did you mean with that?
28 a case!
29 Tell us The main goal(s) of the site/application Target users Main tasks, main questions of the users Context of use Do not tell us how you think the site works now!!!
30 Volunteers 2 moderators 2 users
31 Observers Yellow sticky notes for findings Objective, record behaviour! ONLY write down what you observe, like: mentions X and doesn t seem to not know what X is ; sighs heavily on returning to; is confused about; does not know where to go next, seems frustrated;. Other coloured sticky notes for possible improvements that pop up in your mind, like: feedback is missing; label is not understood; no focus; X doesn t meet expectation;
32 1st user check session! 20 min! 2nd user check session! 20 min! Findings & improvements! 20 min!
33 5 Evaluate Findings The findings, issues Collect Findings Prioritize issues to be solved: prioritize from the business/user goals perspective, rate them Do this with the whole team
34 5 Evaluate Findings Design improvements Improvements on every level, note down (labeling, content, categorization, visual assets, interaction, concept, flow, persuasion) > but keep the business/user goals perspective in mind (focus)! Prioritize by Impact & Effort (matrix) or dot-vote Choose improvement(s) to be re-tested Do this with the whole team
35 Impact & Effort matrix Impact: creates high/low value for users effort: high/low effort in terms of time, knowledge, tools, people Do this with the whole team incl. decision makers! Source:
36 6 " Hypothesis and improve Prepare to retest Improve the design Set up the hypothesis (or more than one) We believe that [this statement is true (e.g adding social proof, better labeling, visual cues will )] We will know we are right/wrong when we have the following result [quantitative feedback; qualitative feedback; KPI; }
Usability Test Script Session 1 [date & time] [participant s name and location] [investigator s names] Step 1. Introducing yourself & read instructions Hi, my name is [ ] and I m going to be walking you
Usability Testing Guiding Principles Finding Usability Problems This is a step by step guideline to usability testing. Usability testing is Usability testing is testing anything with which users interact,
Andrew Hill USER EXPERIENCE DESIGN PORTFOLIO Projects Medical Device Call Center & Field Service Management Desktop & Mobile Apps (Siebel Open UI, ios) User Shadowing & Ethnographic Research Observation
Name Nationality Department Email Address Website Coen Danckmer Voordouw Dutch / Nederlands Man and Activity firstname.lastname@example.org www.danckmer.nl Project: Image: Photographer: Other images: COOLS CoenDVoordouw
The Social Accelerator Setup Guide Welcome! Welcome to the Social Accelerator setup guide. This guide covers 2 ways to setup SA. Most likely, you will want to use the easy setup wizard. In that case, you
Usability Test Results Task: Starting Position: 1 Home Scene Lauren DiVito March 6, 2014 Moderator Script: Evaluation Measures: Notes to Moderator: Task: Starting Position: Moderator Script: Evaluation
Belangrijk: Schrijf je antwoorden kort en bondig in de daartoe voorziene velden. Elke theorie-vraag staat op 2 punten (totaal op 24). De oefening staan in totaal op 16 punten. Het geheel staat op 40 punten.
Usability test script Reprinted from Rocket Surgery Made Easy 2010 Steve Krug Web browser should be open to Google or some other neutral page Hi,. My name is, and I m going to be walking you through this
1 How to Run an End User Feedback Session on Your Product Teena Singh, Principal Product Manager, HCM User Experience Lulit Bezuayehu, User Experience Architect, HCM User Experience 1 Copyright 2012, 2013,
Guidelines for Using the Retrospective Think Aloud Protocol with Eye Tracking September, 2009 Short paper by Tobii Technology Not sure of how to design your eye tracking study? This document aims to provide
KM COLUMN MAY 2005 What is information architecture? Organising functionality and content into a structure that people are able to navigate intuitively doesn t happen by chance. Organisations must recognise
Topic 5 Multimedia Project Development LEARNING OUTCOMES By the end of this topic, you should be able to: 1. Plan a multimedia development project; 2. Explain the steps involved in multimedia design; 3.
Introduction Welcome to Substance Abuse: Training for Employees. This course will teach you about many aspects of substance abuse in the workplace. But before we begin, let's make sure you understand how
~ We are all goddesses, the only problem is that we forget that when we grow up ~ This brochure is Deze brochure is in in English and Dutch het Engels en Nederlands Come and re-discover your divine self
The USER & The Design Process Jane Pirone User Friendly User Centered Design UX (User Experience) User Testing Usability UI (User Interface) why should we care so much about the USER? oh and what about
Moderating Usability Tests Principles & Practices for Interacting Joe Dumas and Beth Loring Morgan Kaufmann, 2008 ISBN 978-0-12-373933-9 Introduction Getting Started 10 Golden Rules Initial Contacts Interacting
Welkom in de wereld van EDI en de zakelijke kansen op langer termijn Sectorsessie mode 23 maart 2016 ISRID VAN GEUNS IS WORKS IS BOUTIQUES Let s get connected! Triumph Without EDI Triumph Let s get connected
Mail Merge Tutorial (for Word 2003-2007) By Allison King Spring 2007 (updated Fall 2007) What is mail merge? You've probably heard it mentioned around the office or at an interview (especially for a temp
Top 10 Skills and Knowledge Set Every User Experience (UX) Professional Needs The user experience (UX) of your products is only as good as the knowledge and skills of your UX staff. Here are the top 10
HOW TO USE UNIVERSAL JOBMATCH Universal Jobmatch is an internet web site. It is run by The Department of Work and Pensions. Job seekers receiving benefits will be expected to register and use it. https://www.gov.uk/jobsearch
What can Kind en Gezin (Child and Family) do for you and your family? Discover our broad range of free services Engelse vertaling van Kennismakingsfolder ouders You are pregnant Je bent zwanger This is
Introduction Improving Government Websites and Surveys With Usability Testing and User Experience Research Jennifer Romano Bergstrom, Jonathan Strohl Fors Marsh Group 1010 N Glebe Rd., Suite 510, Arlington,
Inleiding Elke keer dat ik een uitspraak of een inspirerende quote hoor of zie dan noteer ik deze (iets wat ik iedereen aanraad om te doen). Ik ben hier even doorheen gegaan en het leek me een leuk idee
employager 1.0 design challenge a voyage to employ(ment) EMPLOYAGER 1.0 On the initiative of the City of Eindhoven, the Red Bluejay Foundation organizes a new design challenge around people with a distance
Module 4: Identifying and Researching Career Options Transcript Introduction (video clip 1) This module will focus on the second step of the Career Planning Process, which is the step in which you ll figure
Name: Candidate Registration Number: Date of Exam: MINISTRY OF DEFENCE LANGUAGES EXAMINATIONS BOARD SURVIVAL SLP1 DUTCH PAPER A Reading Task 1 Task 2 Time allowed Translation Comprehension 15 minutes Candidates
Facilitator Script Slacker Usability Test Portable OOBE June 2-3, 2008 This is a rough script for the usability test facilitator. The script shows flow and intent. Deviation from the script will be necessary
BEST PRACTICES: How to Evaluate Software Demonstrations Get Organized to Stay in Control Reviewing demonstrations is perhaps the most critical component of the software selection process. This is where
Concept Design Gert Landheer Mark van den Brink Koen van Boerdonk Content Richness of Data Concept Design Fast creation of rich data which eventually can be used to create a final model Creo Product Family
Continuous Program Improvement (CPI) CPI Support Call Analyzing CPI Qualitative Data Wednesday February 11 th & Thursday February 12 th, 2009 ETR Associates BA Laris, Lisa Unti, Kris Freiwald, Gina Lepore
USABILITY TEST PLAN TEAM MIKE / GROUP 2: Rafael Flores Mike Wesolowski Mike Wilson Michael Correa Kasey Thompson Dave Castleton CONTENTS Table of Contents...2 Executive Summary...3 Methodology...4 Test
DESIGNING A USER-FOCUSED EXPERIENCE HubSpot Design Certification Class 5 Kyle Geiste Experience Designer HubSpot Academy @kylegeiste TODAY S GOAL: You will be able to create templates that are optimized
EMPLOYER USER GUIDE Getting Started... 2 Request Log-In Permission... 3 Log In... 4 My Control Panel... 5 Post a New Job... 7 Review Student Applications... 12 Contact Applicants... 13 Hire a Student...
Verbal Communication II Course Health Science Unit II Communication Essential Question How does the communication process affect health care delivery? TEKS 130.204 (c) 2A, 2B, 3B, 3C Prior Student Learning
CUSTOMER PROFILE Headquarters: Seattle, WA Founded: 2005 Industry: Technology URL: zillow.com THE GOAL THE RESULT Improve customer experience and increase conversions while maintaining a competitive edge.
Re- En g in e e rin g e C o m m e rc e F o r O n lin e B u s in e s s Customer User Guide Last Updated: June 2012 2012 Digibilly - All Rights Reserved Worldwide. PayPal is a registered trademark of PayPal,
Interactive Prototype Introduction & Mission Statement Anxiety disorders are among the most common mental health disorders in the United States. They can be chronic, debilitating, and incapacitating for
A Usability Test Plan for The San Antonio College Website (2012) Prepared for Julie Cooper and Mark Goodspeed Contributors of the San Antonio College Website San Antonio, Texas by Cristal Palomino, Shelby
Lesson: Family Violence CLB 5-6 Instructional Package Family Law: Family Violence (CLB 5-6) CLB Outcomes CLB 5-III: Getting Things Done CLB 6-IV: Comprehending Information CLB5-II: Reproducing Information
Usability Test Plan for LVC 150 Prototype LVC 150 Mobile Web App Prepared for: Cc: Dr. Jeff Ritchie, Project Advisor Completed by: Emily Johnson Haley Dobart Tim Harris Ryan Dotson Date: March 23, 2014
What is User Experience? James Morley-Smith Mike Kaminsky Nico Li Innovation & Design Physical Product Design Customer Innovation Research Human Factors Engineering User Experience Design What is UX? User
Monitoring the team s performance Why does your team need to be monitored? How can performance be monitored? You should ensure that you monitor only what is really important. In the two BS2 sessions Making
elearning Guide: Instructional Design Produced by NHS Education for Scotland, 2013 Introduction This e-learning Guide provides the standards to be followed when developing content Web-based Training (WBT)
UX Research and Market Research A Conversation with Apala Lahiri Chavan Chief Oracle and Innovator Human Factors International The most important thing for user experience professionals to know is when
Pristine s Day Trading Journal...with Strategy Tester and Curve Generator User Guide Important Note: Pristine s Day Trading Journal uses macros in an excel file. Macros are an embedded computer code within
INTERVIEW TIPS PREPARING FOR INTERVIEWS These pre-interview essentials could make the difference between your next career step or a career full stop! Make sure you know the exact address and time of the
Customizing your Blackboard Course Changing the visual appearance Menu Buttons Changing your course buttons can add a splash of color to your course and make it more visually appealing to your students.
Home Messaging System Midterm Project INFO 564 Prototyping for Interactive Systems Prof. Stuart Ough Fall 2009 Indiana University School of Informatics (IUPUI) David Craske, Joe Kratzat, Jared Linder CONTENTS
IP-NBM 1 De bescheidenheid van een schaker 2 Maar wat betekent dat nu 3 De drie elementen richting onsterfelijkheid Genomics Artifical Intelligence (nano)robotics 4 De impact van automatisering en robotisering
Usability Testing Credit: Slides adapted from H. Kiewe Materials for this class Readings: Nielsen, Why You Only Need to Test with 5 Users Dickelman, Usability Testing -- Fear and Loathing on the Keyboard
THE EMOTIONAL VALUE OF PAID FOR MAGAZINES Intomart GfK 2013 Emotionele Waarde Betaald vs. Gratis Tijdschrift April 2013 1 CONTENT 1. CONCLUSIONS 2. RESULTS Reading behaviour Appreciation Engagement Advertising
Getting the most out of a usability test: Effective note-taking and analysis A workshop for User Friendly 2006 Hangzhou, China Whitney Quesenbery WQusability www.wqusability.com 908-638-5467 email@example.com
Daar krijg je dan je groendakmaterialen geleverd op een pallet. Waar moet je naar toe met zo'n pallet. Retour brengen? Gebruiken in de open haard? Maar je kunt creatiever zijn met pallets. Zo kun je er
Accelerate Development Reduce Time to Product Automate Critical Tasks White Paper: Designing Resourceful Graphical User Interfaces (GUIs) for Healthcare Applications The ASHVINS GROUP, Inc. 6161 Blue Lagoon
Spiel Connect to people by sharing stories through your favorite discoveries Addison Leong Joanne Jang Katherine Liu SunMi Lee Development & user Development & user Design & product Development & testing
Dreamweaver and Fireworks MX Integration Brian Hogan This tutorial will take you through the necessary steps to create a template-based web site using Macromedia Dreamweaver and Macromedia Fireworks. The
LIGHT Peace Studies BLUE 1 World Vision My World, My View: Photography Collaboration Project GRADES 1-6 My World, My View Photography Collaboration Project Adapted from Lydia Keen s Photography Workshop
Builder 2.0 Guide and Walkthrough Getting Started Get started with Builder 2.0 by logging in to the application via your Facebook. Once you have logged into the application, the main dashboard will appear.
Review Identify and analyze a profitable niche market! Identify and analyze the competition! Develop a Unique Value Proposition! Create a pre-listing presentation! Build a database of homeowners! Types
Assuring the Cloud Hans Bootsma Deloitte Risk Services firstname.lastname@example.org +31 (0)6 1098 0182 Need for Assurance in Cloud Computing Demand Fast go to market Support innovation Lower costs Access everywhere
LBi HR HelpDesk: USING THE EMPLOYEE SELF-SERVICE PORTAL Using the LBi HR HelpDesk Employee Self-service Portal LBi HR HelpDesk Pro, ProPlus, and Enterprise offer a self-service portal that empowers employees,
A GUIDE TO MOBILE EMAIL UNDERSTANDING THE WHAT, HOW & WHY TABLE OF CONTENTS EMAILS OPENED ON MOBILE? 1 Email open market share 2011-2013 WHAT DOES THIS MEAN? 2 FIRST THINGS FIRST 2 From and Subject Lines
Usability Test Results CyberLynx Annotator for Lotus 1-2-3 Executive Summary John Milanski ENG525 Usability Testing 25 Mar 1997 1 2 O VERVIEW Formal usability tests how well your software performs with
Presentation about Worknets on the Bridge-IT conference Barcelona, March 2011 Networks (Gaining new relations) Worknets (Making relations beneficial) to help organizations work together for common good
VIDEO CREATIVE IN A DIGITAL WORLD Digital analytics afternoon Hugo.email@example.com firstname.lastname@example.org AdReaction Video: 42 countries 13,000+ Multiscreen Users 2 3 Screentime is enormous
Innoveren, dat kan je leren?! #waardecreatie #integratie #innovatie #heleketen #atypisch @BertVrijhoef Waardecreatie door integratie van zorg- 16 December 2015. Take home messages Als je innoveren niet
(or, Why You Don t Need MS Project) Using Microsoft Office to Manage Projects will explain how to use two applications in the Microsoft Office suite to document your project plan and assign and track tasks.
Conducting Interviews in Qualitative Social Science Research Types: individual face-to-face (choose non-shy participants willing to share) telephone (not ideal but used when direct access not possible)
Research Report Ingelien Poutsma Marnienke van der Maal Sabina Idler Research report ABSTRACT This research investigates what the ideal bank for adolescents (10 16 years) looks like. The research was initiated
GATE Pilot Safety MAYORGAME (BURGEMEESTERGAME) Twan Boerenkamp Who is it about? Local council Beleidsteam = GBT or Regional Beleidsteam = RBT Mayor = Chairman Advisors now = Voorlichting? Official context
Setting up VOIP conferencing on a PC You must have your computer and an internet connection. Your computer must have a supported sound card (most computers do). It is recommended that you use a computer
Mailing List Growth Strategies A guide to increasing the size of your mailing list November 2012 Version 0.2 Contents Introduction... 3 Lightboxes... 4 Implementation advice... 6 Social Media... 8 Implementation
If your internal communication is really effective? Who reads what and why and what the impact is? How many info-sharing meetings need to be organised because nobody reads? What the service desk cost of
Clinical Decision Making Welcome to this short overview of Clinical Decision Making for Nurses, Midwives and Allied Healthcare Professionals. We've split this overview into a number of elements that will
Welcome to the NSLDS hands-on session. My name is Larry Parker. I'm from the Department of Education NSLDS. Today, I have with me a whole host of folks, so we're gonna make sure that if you have any questions
SCRIPT MICROLECTURE: RECORD A MICROLECTURE UNIVERSITY TWENTE Martine ten Voorde & Chris Rouwenhorst, onderwijskundige Dienst, universiteit Twente Cindy de Koning, presentator en trainer, cindydekoningmedia
Start Learning Joomla! Mini Course Transcript 2010 StartLearningJoomla.com The following course text is for distribution with the Start Learning Joomla mini-course. You can find the videos at http://www.startlearningjoomla.com/mini-course/
Join Your Accountant And Jump On Our Cloud Your accountant is using Clear Books so why aren't you? Carry on reading to find out why Clear Books is the perfect accounting software for you and your business.
Queensland Government etendering website Government buyer user manual System Requirements and Administration Version 2.0 July 2011 etender Help Desk phone 07 3836 0141 Table of contents 1 Introduction...
Budget Main Window (Single Bank Account) Budget Main Window (Multiple Bank Accounts) Page 1 of 136 Using Budget Help Budget has extensive help features. To get help use Budget's Help > Budget Help menu
Bureau for Good Branding & web design for folks who do good Nonprofit Website Assessment Guide Assess your site s effectiveness & identify common problem areas bureauforgood.com Bureau for Good Branding
WHITE PAPER Not Just Another Pretty (Inter)Face Lee Farabaugh, MS-HCI MSHI Chief Experience Officer The Benefits of Integrating Visual Design with User Experience Methodologies The landscape of healthcare
- 1 - PloneSurvey User Guide (draft 3) This short document will hopefully contain enough information to allow people to begin creating simple surveys using the new Plone online survey tool. Caveat PloneSurvey