Website Usability Testing: Lessons Learned Marian Davies Marian Davies Agnes Zientarska-Kayko April 2013
Agenda Creating Usability Tests Methodologies Protocols Data Collection and Analysis Findings
Creating Usability Tests Doable Affordable Skilled staff Availability
Communication Language Timeline Location Prizes
Tests and Goals Surveys High level snapshot of user needs, wants and impressions Focus Group Discussions Task-Based Testing Individual Interviews Test Functionality Test Navigation Observe user behaviour and task success rate Gather observations, opinions, attitudes
Pros and Cons Cost effective, efficient, reaches a large user base Surveys Mercy of participant and the technology Reveals user behaviour and preferences Task-Based Mercy of the participant Testing and the technology Uncover what may affect user behaviour Discover user behaviour, patterns and anomalies Focus Groups Individual Interviews Site specific, scheduling, low response rate Site specific, language vs. meaning
Tools Surveys Task-Based Testing Functionality Navigation ONLINE IN-PERSON Focus Groups Individual Interviews
Main Menu Navigation Top Library Home Primo Resources for Research Research Databases (Journal Articles) E-Journal Titles Online Reference Shelf Search By category Abbreviations / Acronyms Almanacs Associations / Societies Biographies Books / Journals Career / Employment Citation / Style Guides Cities / Regions / Countries Company Information Comprehensive Subject Directories Conferences - Upcoming Copyright Currency / Finance Dictionaries / Thesauri / Glossaries Encyclopedias Genealogy Government Information Internet Search Tools Library Catalogues / Homepages Maps / Atlases News / Radio / Television Patents / Trade-marks Phone / Mail / Email / Newsgroups Quotations / Concordances Research Grants / Organizations Scientific Data / Conversion / Measurement Standards / Codes Statistics / Data Time / Dates / Calendars Travel / Entertainment / Recreation Universities / Colleges Weather / Road Conditions Writing Assistance Other Electronic Reference Collections By subject E-Data Help Information Data Contacts UW-EDS Group Access to Data New Datasets Newsletter TUG Data Resources Archives & Rare Books General Information About us Hours and contact information Rules for use of the collections Photocopying Displays Tours Collections Digital Collections Archives & manuscripts Books, periodicals, government publications Genealogy Kitchener-Waterloo Record Photographic Negative Collection Local history UW Archives Help Using archives Using primary sources Finding information Dealing with your old books & documents Evaluations & appraisals Questions? Other Links Reproductions: K-W Record Photographic Negative Collection Related resources Government Information Information by Jurisdiction Debates, Legislation & Legal resources Publications & Information Sites & Databases Statistics & Data Resources g, Policy Opinion, Think Tanks & Analysis of Government Help Guides & Bibliographies Maps: University Map Library General Information Hours/Location Contact Information Collections Geospatial Data - Canadian Geospatial Data - US and World Maps and Atlases Aerial Photography Maps/Atlases Online Library Services Circulation/Reference GIS Subject Guide Postdoctoral Fellows Contact Us Register with the Library Your Borrowing Privileges Course Preparation Using Your Laptop in the Library Our Collections Get Resources from UW and Beyond Library Instruction International Students Library Services Research Help Library Terminology Translation Dictionaries Writing Assistance Key Library Phone Numbers International Student Office Persons with Disabilities Who to Contact Using the Library Services Adaptive Technology Centre Study Rooms and Workstations Davis Centre Library Research Assistance Retrieving Library Materials Campus Book Delivery Alternate Format Materials Sources for Alternative Formats (Electronic Texts, etc.) Photocopying About Library Services for Persons with Disabilities Extended Learning Students Services Borrow Books Find Journal Articles Interlibrary Loan (RACER) Access to Restricted Resources Need Help? Using Other Libraries Internet Research Distance Education History 247 Co-op Students on Work Term Services Contact Us Borrow Books Request Journal Articles Interlibrary Loan (RACER) Access to Restricted Resources Using Other Libraries Alumni Borrowing Electronic Resources Community & Business Borrowing Electronic Resources Customized service - IBIS Quick Links Copy Facilities Group Study Rooms Hours Key Library Phone Numbers Laptop Connections Name Release Form Paying Late Fees (fines) Placing Material on Reserves Printing Instructions Public Workstations Vending Machines Returning Library Material Self Registration, Faculty & Staff Suggest a Purchase Legislatures, Elections & Political Parties Renew On line Your Account / Renew Books Borrowing Borrowing Get it from Waterloo Who May Borrow Library Card Name Release Form Loan Period Returning Books Fines Sanctions Renew On-line Renew by Phone Recalls Interlibrary Loans TUG Retrieval Service Centre for Extended Learning Co-op Work Term Employment Opportunities in the Library Interlibrary Loan (RACER) About Us Hours Locations Staff & Administration Contacts Staff Web Policies Reports & Documents Manuals Library Campaign Home Kresge Challenge Make a Gift UW Keystone Campaign Flash Media Presentation Library Wallpaper Recent Gifts Library Events The Library Today News Stand Contact Info news @ your library TUG home page Ask a Librarian Help & Instruction How Do I? Find Library Materials (Books, Articles, etc.)? Use Library Services? Use Library Equipment? Apply for Library Employment? Access Other UW Services? Tours & Workshops Core Workshops Special Workshops Online Tutorials Introductory Advanced Subject Guides Applied Health Sciences Arts Engineering Environment Mathematics Science Interdisciplinary Where Is It? Library Floor Plans Connect from home Site Index Library Home Library Instruction/Workshops Reports & Documents Help Guides Other Links Air Photo Project Cartographic Resources on the Web GeoAbstract Art Show Gallery News & Newspapers Canadian American Worldwide Theses University of Waterloo Canada Great Britain and Ireland World RefWorks Course Reserves Services Services for Undergraduates Book a Study Room Find Books Borrowing Books Find Journal Articles Get Journal Articles Find Web Resources Find Library Hours Using Laptops in the Library Library Workshops Need HELP? Graduate Students Contact Us Your Borrowing Privileges Help for Your TA Responsibilities Using Your Laptop in the Library Our Collections Get Resources from UW and Beyond Library Instruction Faculty & Staff Contact Us Your Borrowing Privileges Course Preparation Using Your Laptop in the Library Our Collections Get Resources from UW and Beyond Library Instruction
Protocol Planning Introduction Who you are and your role Start session Objective The purpose of the study Methodology the deliverables Disclaimer (for Interviews and Focus Groups) Main Activity Tasks 1 through to end End session Conclusion Thank you statement Contact information
Individual Interviews Introduction and Objective Methodology Disclaimer Note User Information Start Task Analysis End Session Ask General Open-Ended Questions Thank Participant i t Provide Contact Information Who and What How Acknowledged Agreement Who is Participating i Tasks Start t Wrapping Up Opportunity to Clarify User Feedback is Important t Opportunity to Follow-up
Data Collection and Analysis Quantitative Qualitative Integrate / Compare Report
Quantitative Data Compile data Perform calculations Interpret the data TOOLS Excel SPSS SAS
Qualitative Data Transcribe Code the data Draw conclusions Discover Patterns Identify Themes Conclusions TOOLS ATLAS.ti TextSmart NVivo
Writing the Report Purpose D t C ll ti Methodology, Protocols Findings Conclusions Recommendations Executive Summary Data Collection Data Analysis Conclusions & Recommendations The Final Report
Findings Users want to customize the Library website Navigation requires too many clicks Too many options / unnecessarily complex Confusing and inconsistent terminology Users use Google Scholar as a starting point
Lessons Learned Keep it simple Protocol is key Pre-test Tools and equipment Record observations and progress