Crtifi Profssionl for Usility n Usr Exprin Usility Tsting (CPUX-UT) Vrsion.0, Jun 0 Pulishr: UXQB. V. Contt: info@uxq.org www.uxq.org Autorn: R. Molih, T. Gis, B. Rumml, O. Klug, K. Polkhn
Contnt Lgn... 3 Initil hk of livrls... 4 3 Tst sript... 6 4 Usr profils n tst prtiipnts... 7 Tst tsks... 8 6 Tst sssion in gnrl... 0 7 Brifing n pr-sssion intrviw... 8 Mortion... 9 Post-sssion intrviw... 0 Usility tst rport Lyout n ontnts... 6 Usility tst rport Exutiv summry... 7 Usility tst rport - Finings... 8 Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg of 9
Introution This oumnt ontins th vlution ritri for th prtil tst ling to th CPUX-UT rtifit. Th vlution ritri r us y th vlutor to sor livrls from th usility tst onut y nits sking to hiv th CPUX-UT rtifit. This oumnt is lso us to inform CPUX-UT nits out how thir CPUX-UT livrls r sor. Th si i hin th rting is tht h nit strts out with 00 points. Th sor is ru y numr of points for h vition from goo usility tst s rflt y th vlution ritri. Lgn ID Evlution ritrion E E Evlutor's ommnt Th IDs r us for rfrns. Thy r not nssrily omptly numr. Missing IDs usully orrspon to vlution ritri from rlir vlutions tht r no longr rlvnt. Th ritri rflt ky ritri in th CPUX-UT Curriulum. Th mximum numr of ngtiv points tht th n givn if th ritrion is violt. Th tul rting (zro or ngtiv points) givn y th ssssor. If th rting is OK, No prolm or Goo, ntr 0. Justifition of th rting, if rquir. Rfrns lik V3-.38 my us to rfr to squn in vio sumitt y th nit. Th smpl rfrn rfrs to th vio for tst prtiipnt 3. Th rfrn vnt strts pproximtly minuts n 38 sons ftr th strt of th vio. Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 3 of 9
Initil hk of livrls This is n initil hk to vrify tht th rquir livrls r vill n fulfill si rquirmnts. This initil hk is not prt of th soring. If ny of th following onitions r not mt, th vlutor shoul onsir rfully whthr it mks sns to ontinu th vlution. ID Evlution ritrion Ys/ No Evlutor's ommnt f g h i j i Is usility tst rport vill? Is th tst sript provi, possily s prt of th usility tst rport? Ar th tst tsks provi, possily s prt of th tst sript? Dos th usility tst rport ontin t lst 0 finings? Is vio from h usility tst sssion vill? Ar vio rorings of oth th mortor's f n th tst prtiipnt's f vill? Cn th first sons n th finl sons of h vio viw? Dos h usility tst sssion hv lngth tht is twn n 30 minuts? Is th uio qulity of th vio rorings OK? Is th vio qulity of th vio rorings OK? Is proprly sign NDA or Consnt form vill for h usility tst prtiipnt? Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 4 of 9
j Is proprly sign snn oumnt vill tht onfirms tht th nit omplt th usility tst without ssistn? Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg of 9
3 Tst sript ID Evlution ritrion E E Evlutor's ommnt f g h Dos th usility tst rport inlu tst sript? Not: This ritrion iffrs from, whih hks whthr tst sript is vill t ll. 3 uts points if th tst sript is vill ut not prt of th usility tst rport. Ar th ritri us for slting tst prtiipnts vill n rsonl? Dos th tst sript inlu suitl hklist for th rifing? Dos th mortor hr to th hklist for th rifing uring th tst sssions? Dos th tst sript inlu suitl hklist for th prsssion intrviw? Dos th mortor hr to th hklist for th pr-sssion intrviw uring th tst sssions? Dos th tst sript inlu th tst tsks? Dos th tst sript inlu suitl hklist for th postsssion intrviw? 3 Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 6 of 9
4 Usr profils n tst prtiipnts ID Evlution ritrion E E Evlutor's ommnt Do th tst prtiipnts mth th rquirmnts in th ssignmnt? Is rif ut qut informtion out h tst prtiipnt vill? Do tst prtiipnts mth th usr profil? On th sis of thir pprn on th vio, o tst prtiipnts sm to mth th informtion out tst prtiipnts provi in th usility tst rport? Is th nonymity of tst prtiipnts prsrv? 0 Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 7 of 9
Tst tsks ID Evlution ritrion E E Evlutor's ommnt Do th tst tsks mth th rquirmnts in th ssignmnt? 0 Ar thr tst tsks? f g Dos h tst tsk rss xtly on si funtion of th intrtiv systm? Not: A tst tsk tht tsts svrl inpnnt ky systm funtions shoul split. Ar th tst tsks suffiintly iffrnt? Not: Runnt tsks shoul voi. Two tst tsks must not unnssrily rss th sm funtion of th intrtiv systm. Dos h tst tsk ontin tst tsk sription tht n hn out vrtim to th tst prtiipnt? Is h tst tsk sription for th tst prtiipnt unmiguous n lr? Is h tst tsk rlvnt from th usrs' point of viw (no systmorint tsks)? 0 0 h Ar tst tsks fr from lus? i j Is th purpos of h tst tsk xplin or slf-vint? Is th strting onition for h tst tsk spifi? Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 8 of 9
k Ar tst tsks srious tht is, not humorous? l Ar prtnr tsks voi? Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 9 of 9
6 Tst sssion in gnrl ID Evlution ritrion E E Evlutor's ommnt f g Is h tst sssion unfft y prvious tst sssions? This oul hppn, for xmpl, if th h is not lr proprly twn sssions, so input suggstions from prvious sssions ppr. Ar tst sssions onut in suitl room? Is th room unistur? Dos th mortor mng tim wll so s mny tst tsks s possil r rss proprly within th givn tim frm for th tst sssion? Is th lngth of h tst sssion s rquir? Ar thr no hrwr mlfuntions uring th tst sssion? Ar thr no softwr mlfuntions uring th tst sssion? If thr r hrwr or softwr mlfuntions uring tst sssion, r thy hnl iplomtilly n omptntly y th mortor? Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 0 of 9
7 Brifing n pr-sssion intrviw ID Evlution ritrion E E Evlutor's ommnt f g h i Dos th mortor orlly inform h tst prtiipnt "W r not tsting you"? At th n of th rifing, os th mortor sk "Do you hv ny qustions?" Is th rifing ffiint? For xmpl, monstrtions of wht think-lou is r not onsir ffiint. Dos th mortor nquir out th tst prtiipnt's prvious knowlg of th intrtiv systm? Dos th mortor nquir out th tst prtiipnt's prvious knowlg of omprl intrtiv systms? Dos th mortor nquir out th tst prtiipnt's knowlg of th sujt mttr? Dos th mortor sk for th tst prtiipnt's top prioritis with rgr to th intrtiv systm? Dos th mortor soun gnuinly intrst in th prtiipnt? Is th mortor suffiintly urious uring th pr-sssion intrviw? Whn pproprit, os th mortor vit from th pr-sssion intrviw hklist? 3 Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg of 9
8 Mortion ID Evlution ritrion E E Evlutor's ommnt f g h i Dos th mortor sy s littl s possil whil th tst prtiipnt is solving tst tsks? Dos th mortor sy s littl s possil twn tst tsks? Ar th mortor's rmrks n oy lngug fr from lus? Smpl lus r Don t worry out this, or th oy lngug sys "You hv lmost solv th tsk. Th nswr is on th srn. Dos th mortor hlp or mov on to th nxt tsk whn th usility prolm is lr, or th tst prtiipnt is hoplssly stuk or gos roun in irls? If th mortor provis hlp, is th hlp limit to th solut minimum? Dos th mortor kp quit whn th tst prtiipnt os not n hlp? Dos th mortor voi ling qustions? Dos th mortor nourg tst prtiipnts to think lou without ovroing it? Ar tst tsks ommunit proprly to th tst prtiipnt without ny risk for misunrstning? 3 3 Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg of 9
j k l m n o Is th mortor suffiintly urious uring mortion? Dos th mortor follow up on ny importnt unlritis? Dos th mortor ppr intrst in wht th tst prtiipnt is sying n oing? Dos th mortor rfrin from sking ling qustions? For xmpl: "Woul you hv lik to gt spil offrs? For xmpl, spil pri or fr ssoris?" rthr thn "How o you lik th purhsing prour?" Is th mortor unis? Th mortor must not fn th intrtiv systm. Th mortor must not xprss his or hr own viws on th intrtiv systm. Th mortor must not hv srt gn suh s pt pv or thory out th intrf ing tst n try to gt th tst prtiipnt to rtiult it. Is th mortor rsptful towrs th tst prtiipnt? Th mortor shoul py ttntion to tst prtiipnt suggstions vn if thy ppr unrsonl. Is th mortor rsptful towrs th mnufturr or provir of th tst ojt? Th mortor shoul not mouth th intrtiv systm or th vlopmnt tm, vn if it is on to lm th tst prtiipnt. Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 3 of 9
p q r If th tst prtiipnt n t solv tsk n wnts to s how it n on, os th mortor iplomtilly rfus to rvl th intn wy of solving th tsk? It's OK to show th solution s prt of th post-sssion intrviw if th tst prtiipnt insists. If osrvrs, not tkrs, t., r prsnt in th tst room, o thy kp quit unlss spifilly rss y th mortor or th tst prtiipnt? Is th mortor suffiintly fmilir with th prout tht is ing tst? Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 4 of 9
9 Post-sssion intrviw ID Evlution ritrion E E Evlutor's ommnt Is th post-sssion intrviw ffiint? Dos th post-sssion intrviw tk lss thn minuts? Using mor thn minuts for th post-sssion intrviw my OK ut rquirs justifition. Dos th post-sssion intrviw minly fous on xprin tht is not vint from th tst sssion? Dos th post-sssion intrviw sk wht th tst prtiipnt onsirs th most importnt usility prolms? Dos th post-sssion intrviw sk wht th tst prtiipnt onsirs th most importnt positiv imprssions? Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg of 9
0 Usility tst rport Lyout n ontnts ID Evlution ritrion E E Evlutor's ommnt f Dos th usility tst rport ontin n xutiv summry? Dos th usility tst rport ontin finings? Dos th usility tst rport ontin th tst sript? Is th usility tst rport fr from unnssry informtion? Exmpls of unnssry informtion r iogrphis of th usility spilists involv in th tst, trnsripts n xplntions of wht usility is. Dos th usility tst rport ontin vrsion t? Dos th usility tst rport ontin ontt informtion for prson who n provi furthr informtion out th usility tst? 0 0 Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 6 of 9
Usility tst rport Exutiv summry ID Evlution ritrion E E Evlutor's ommnt f Dos th xutiv summry ppr t th vry ginning of th usility tst rport? Is th xutiv summry ontin on on pg only? Dos th xutiv summry ontin rif sription of th most importnt positiv finings? Ar th positiv finings tht r list in th xutiv summry lso list in th Finings stion of th usility tst rport? Dos th xutiv summry ontin rif sription of th most importnt usility prolms? Ar th usility prolms tht r list in th xutiv summry lso list in th Finings stion of th usility tst rport? 3 Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 7 of 9
Usility tst rport - Finings ID Evlution ritrion E E Evlutor's ommnt Ar thr mor thn 0 n lss thn 40 finings? Ar ll finings sy to unrstn? Ar ll finings uniqu? Not: Two sprtly rport finings must not sri wht is ssntilly th sm usility fining. Dos h fining sri th prolm from th tst prtiipnt's point of viw? Not: Finings must not fous on prout ttriut tht uss prolm. Ar ll finings tionl? Not: Gnrlly phrs finings, suh s "Th wsit os not spk th lngug of th usr" shoul ompni y t lst two vli xmpls. 0 4 4 f Ar ll finings rt? 3 g Ar ll rtings justifil? 3 h i j Is th mning of h rting xplin in usful n usl wy? Do t lst 3 of th finings ontin usful n usl rommntions? Ar t lst % of th finings positiv? Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 8 of 9
k l m n o p Ar positiv finings ompltly positiv? A positiv fining must not ontin ny ritiism Ar positiv finings sustntil (s oppos to flimsy or srsti)? Ar finings tht r not ovious from th txtul sription illustrt with pproprit srnshots? Ar finings supplmnt with quots from tst prtiipnts, whr pproprit? Ar finings in orn with tst prtiipnts' tul hvior s ror on th vios? Finings must not s on th prtiipnt's opinions or th mortor's opinions. Dos h fining rflt singl usility issu? Finings must not onglomrts of svrl inpnnt ut possily rlt issus. 0 Usility Tst Chklist - CPUX-UT Copyright 0, UXQB.V. Pg 9 of 9