Usability Test Script

Transcription

1 Usability Test Script Session 1 [date & time] [participant s name and location] [investigator s names] Step 1. Introducing yourself & read instructions Hi, my name is [ ] and I m going to be walking you through this session. Thank you for participating in this test. We really appreciate your interest. You probably already know but let me explain why you are here today. We re testing [x numbers of LMS being tested] learning management systems, just like [the one] currently used by [Institution s name], so we can see what it s like for actual students to use it. I want to make it clear right away that we re testing the learning management system, and not you. You can t do anything wrong here. In fact, this is probably the one place today where you don t have to worry about making mistakes. We want to hear exactly what you think, so please don t worry that you re going to hurt our feelings. With your permission, we re going to record what you have to say. The recording will be used only to help us figure out which system is better, and it won t be heard by anyone except the people working on the project. It also helps me because I don t have to take as many notes. So if you would, I m going to ask you to sign a permission letter for us to record you. It also says that you won t talk to anybody about what we re showing you today, since it hasn t been made public yet. Do you have any questions before we begin? >>>> Wait for participant to confirm This test should take approximately 30 min per system and by starting this test we would like to acknowledge you that you re committing to come for more visits to test other systems. If you have questions, just ask. I may not be able to answer them right away, since we re interested in how people do when they don t have someone sitting next to them, but I will try to answer any questions you still have when we re done. Are you ready? >>>> Wait for participant to confirm you if he/she is ready >>>> the audio recording

2 time: Step 2. Ask student to perform tasks I am now recording the audio for the usability test of the content management system. Today is [date]. Participant name is [ ]. This usability test takes place in 3 main parts. In this 1 st part I m going to give you a printed that gives you access information to the content management system. But before you start reading let me tell you what we re doing now. Let s imagine you re a student taking an online course. There are certain tasks you would normally perform and that we re simulating here. I m going to read each task out loud and ask you to try completing them as naturally as possible. If you feel for any reason that you re not comfortable performing a given task do not worry, just say I m not comfortable, and we will move on. As we go along, please think out loud, to tell us what s going through your mind. Ready? >>> open LMS in the computer but let the student log in. Task [1] Log yourself into the content management system use instructions use login select the proper course access the course Moodle Task [2] Please open the welcome letter, find syllabus and then navigate to Unit 1 Access welcome letter view syllabus Find unit 1 use navigation buttons Task [3] Please post a reply to the welcome discussion Find Discussion Select topic Post a reply submit reply Task [4] Please submit an assignment with single file upload attachment select an assignment module

3 click submit write answer browse for file attach file submit assignment Task [5] Please take the Introduction Quiz reach test area / find a test open test respond to question save & submit Task [6] Please check your total grade so far for this course Find grade area Search for a specific grade Task [7] Please your instructor asking what the office hours are Find shortcut select compose new message select recipient write message send Task [8] Please find a help topic on how to message Access help screen search for specific topic Thank you for working on these tasks. We are now moving to the 2n d part. >>>> Move to step 3.

4 time: Step 3. Ask for impression of look and feel Now in the 2 nd part, I d like to ask you about your first impressions on the look and feel of this system. What do you think of this home page, what strikes you about it, and what would you click on first. For now, don t actually click on anything. Just tell me what you would click on. And again, as much as possible, it will help us if you can try to think out loud so we know what you re thinking about. You can log off from the content management system. >>>> When participant is done with first impression feedback, do not say anything back just listen. Then close the LMS and follow with Step 4.

5 time: Step 4. Get feedback Now we would like to hear from you. Mostly we are looking to hear about whether the look and feel of this system s interface was intuitive enough for you to perform the actions we mentioned. How did you feel overall using the content management system? In a scale of 1 to 5, how easy do you think it was to perform the tasks? 1 not easy at all; 5 very easy How comfortable would you feel to use this system to take your online classes? 1 not comfortable at all; 5 very comfortable How likely are you to recommend this content management system to your friends? 1 not likely at all; 5 very likely >>>> inform the student the usability test for this current LMS is done. Move to the next LMS. time:

6 >>>> after 2 LMS were tested ask the participant to compared the first two. Now that you have navigated through 2 CMS tell me which one you liked better? The first or the second? >>>> after 4 LMS were tested ask the participant to selected which LMS they liked better and how they would order them as time: >>>> ecollege test is done. Close ecollege s window. Thank you for participating in this test.