Usability Test Plan. Erika Devine Carin Fishel Michelle Kesse Ryan Kokesh Jason Mosqueda Ben Rubenstein

Transcription

1 Usability Test Plan Erika Devine Carin Fishel Michelle Kesse Ryan Kokesh Jason Mosqueda Ben Rubenstein 1

2 Executive Summary... 3 Methodology... 3 Participants... 3 Test Environment... 3 Test Design... 3 Test Script... 4 Post Task Questions... 6 Post Test Questions... 7 Appendix... 8 Consent Form... 8 Contributions

3 Executive Summary Our application, kidcompass, is aimed at helping parents find places to go with their children; ease of navigation and clear design will be important in ensuring its success. In order to identify potential issues with the application's functionality and appeal, we have created a paper prototype to be used in informal usability testing. During this testing, we will ask users to interact with the prototype to accomplish three main tasks (find a location, create a profile, and review/rate a location) and provide feedback. This document contains the full details of our usability testing plan (to be executed in class on October 28), including methodology, a test script, questions to be answered after each task, questions to be answered upon completion of the entire test, and a consent form that will be distributed to test participants. Methodology Participants Six graduate students from DePaul's College of Computing and Digital Media, enrolled in a Usability Engineering course, will be participating in kidcompass's usability test. The participants' ages range from early 20s to late 40s. All of them are familiar with usability concepts and their level of expertise in technology is considered high. Test Environment kidcompass's Usability Test will take place on October 28, 2009, in the classroom where the participants typically attend their Usability Engineering course. Test Design kidcompass's informal Usability Test will have a list of tasks to be completed by the users and data will be collected the observers. The test will be made up of the following sections: Participant Greeting 3

4 The participant will be greeted by the test monitor, who will be observing the testing. The test monitor will let the participant know that only the application, and not the participant, is being tested. The participant will be given a consent form, which is not required to be signed. Performance Test Using a low-fidelity prototype (paper prototype), the participant will be given three scenarios and associated tasks to be completed for those scenarios. The test monitor will encourage the participant to thinkaloud through the tasks. The paper prototype will be controlled by another team member, as the participant makes selections. The observers will record both the errors that occurred during each task and what part of the application the participant liked/disliked. Each task will be timed and if not completed within 3 minutes of the start time, the test monitor will ask the participant to move on to the next task. Before starting the next task and after the last task, the participant will be asked to complete a post-task questionnaire. Participant Debriefing Once the participant has completed the tasks, s/he will be asked to fill out a post-test questionnaire. This will give the participant a chance to explain what s/he liked and disliked about the application. Once the participant has completed the questionnaire, the test monitor will ask the user a few questions pertaining to the test. After the debriefing is over, the participant will be thanked and dismissed. Test Script Good evening, my name is [Name] and I will be the test monitor this evening. I appreciate you taking this test and want you to feel comfortable and know that we will not be testing you personally, just the application. First I will need you to read the consent form. [Pass the Consent Form to the participant] 4

5 I will give you a list of tasks that you will need to complete. As you are working your way through them, please think aloud to explain what you are doing and why. Please note that I will not be able to answer any specific questions about how the application works or what you should do next. If you have trouble with any of the tasks, don t feel like you have failed anything, just move on to the next task. Errors are a good thing as they will help us improve the application. At some point, I may ask you to move on to the next task, whether you have completed the current task or not. [Ask the participant to get settled and hand him/her the first task] You may begin when you are ready. Task 1 - Find a location a. Explain task to user: Imagine you are in the suburbs visiting your in-laws for brunch and your visit ends earlier than you expected. Since it s a beautiful day, you want to take your daughter to a nearby park that is on the way to the highway that you will be taking to get back to the city. Please use kidcompass to find a nearby park that is North of your current location. b. Present first screen to user c. Change screens based on user's response. d. Post-task questions will follow after task completion. Task 2 - Create a profile a. Explain task to user: You've recently purchased the kidcompass application and want to create a profile to take full advantage of all its features. Navigate to the Create Profile screen and create a profile using the name Bob Jones and username bjones76. b. Present first screen to user c. Change screens based on user's response. d. Post-task questions will follow after task completion. Task 3 - Review/rate a location a. Explain task to user: You've recently visited Evergreen Park with your child, and you want to let other users know how great it is for children her age. Use kidcompass to find the listing for the park (located in Chicago, IL 60613). Give it a three-star rating and add a review with the text "My 2 year old loved it!". b. Present first screen to user 5

6 c. Change screens based on user's response d. Post-task questions will follow after task completion [If participant takes more than 3 minutes to complete a task, ask them to go ahead to the next one] Now that you have finished your last task, I will need for you to fill out this questionnaire. It is just a few questions to ask you how you feel about the test. [Pass the Post Test Questions to the participant. When the user is finished begin asking the debriefing question] [Now that you are done with the debriefing the user can leave] Thank you so much for helping us out with our usability test. Post Task Questions Scenario 1 [Show user first screen] 1. Is it obvious that the first search field is optional? 2. What does the header "Browse Nearby" mean to you? 3. If you wanted to enter a specific location, is it obvious where you should enter this information? 4. Right now you can search for a specific location by entering a zip code, city or address. Is there any other way you would want to search for a location? [Show user list of Browse Nearby options] 5. This is a list of the "Browse Nearby" options. Are there any options that are missing from this list, or that don't make sense? 6. Rate the level of difficulty in finding a location. Very Difficult Very Easy 7. How could the process of finding a location be improved? Scenario 2 1. Rate the level of difficulty in creating a profile. Very Difficult Very Easy 6

7 2. Would you like to be notified of the benefits of creating a profile during the startup screen? 3. The benefits of creating a profile are that you can save locations to a favorites list, and Rate and Review locations. With this in mind, how likely are you to create a profile? Very Unlikely Very Likely 4. How could the process of creating a profile be improved? Scenario 3 1. How difficult was it to give a star rating? Very Difficult Very Easy 2. How difficult was it to post the rating? Very Difficult Very Easy 3. Were you aware that the star rating and review comments sections were optional? 4. How could the process of rating/reviewing a location be improved? Post Test Questions 1. Which task was the most difficult to accomplish? Why? 2. Which task was the easiest to accomplish? Why? 3. Did you feel the screens were laid out logically? Was there anything that confused you or that you would change? 7

8 4. What would you say is the best part of KidCompass? 5. What would you say is the worst part of KidCompass? Very Unlikely Very Likely 6. How likely are you to purchase the kidcompass application? 7. How likely are you to recommend kidcompass to parents? 8. Please add any additional comments or suggested improvements. Appendix Consent Form As a participant in kidcompass's Usability Test you are entitled to the following: Minimal risk: The group conducting this test does not know of any risks associated on taking part of this test. Withdrawal at any time: You may withdraw from the test at any time without any penalization. Withdrawal of data: You may withdraw your results from the test without any penalization. Confidentiality: Your data will be kept confidential. If you have any questions or concerns you may contact Professor David Burns at dburns8@cdm.depaul.edu or any of the following group members: Erika Devine (hirika7@hotmail.com) Carin Fishel (carin.fishel@gmail.com) Michelle Kesse (mic8422@yahoo.com) Ryan Kokesh (rjkokesh@gmail.com) Jason Mosqueda (jasonmosqueda@gmail.com) Ben Rubenstein (rubensteinben@gmail.com) Contributions Team Member Contribution 8

9 Erika Devine - Created Test Script for Task 3 (rate/review location) - Created Post Task Questions for Task 3 Carin Fishel - Created Test Script for Task 1 (find a location) - Created Post Task Questions for Task 1 Michelle Kesse - Updated interface/screens for user tasks - Added Post Task questions for Task 2 Ryan Kokesh - Created Test Script for Task 2 - Contributed to screen updates Jason Mosqueda - Project Manager for this assignment - Work on draft of Methodology section - Work on draft of Post Test Questions Ben Rubenstein - Wrote executive summary - Edited test script and added post-task/test questions 9