E-learning evaluation: A cross-technique comparison

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "E-learning evaluation: A cross-technique comparison"

Transcription

1 E-learning evaluation: A cross-technique comparison Rosa Lanzilotti 1, Carmelo Ardito 1, Maria F. Costabile 1, Antonella De Angeli 2, 1 Dipartimento di Informatica Università di Bari Italy {lanzilotti, ardito, 2 School of Informatics - University of Manchester Po BOX 88 M601QD - UK Abstract. The evaluation of e-learning applications deserves special attention, and evaluators need effective methodologies and appropriate guidelines to perform their task. In this paper, we present a comparison of different techniques and describe the methodology of an experiment aimed to unveil strengths and weaknesses of Heuristic Evaluation, Direct Observation and SUE Inspection. The experiment was designed to compare the performance of evaluators applying different techniques on the same e-learning software. 1 Introduction Nowadays, it is becoming usual to learn by an electronic support, such as a simple CD-Rom or the Web. A major challenge for designers and Human-Computer Interaction (HCI) researchers is then to develop software tools able to engage novice learners and to support learning even at a distance. Obviously, the designers have to consider not only the different characteristics of learners, such as cultural background, technical experience, technological equipment, physical/cognitive abilities, but they also have to ensure that student s interaction with the software is as natural and intuitive as possible. It is a matter of fact, indeed, that often learners prefer traditional instruction to web-based training because the interaction is cognitively demanding (confusing menu, unclear buttons or illogical links). A topic still neglected in e-learning design is the interaction between learner and computer. The interface of an e-learning application can become a barrier to effective learning and information retention: if it is not well designed, the user can feel lost, confused or frustrated. Squires and Preece [15] argue that researchers have so far not given enough importance to the implications of usability features of an educational application in order to achieve educational goals. To this end, the authors assert that there is a need to help evaluators consider the way in which usability and learning interact. A consolidated evaluation methodology of e-learning applications is not yet available. Some authors propose to use traditional usability techniques for evaluating e-learning systems [6, 12]. Instead, Squires and Preece highlight the needs to adapt the

2 evaluation techniques to the context of learning and propose a list of heuristics, called learning with software that are a list of guidelines adapted to the context [15]. Researchers in our groups have experience in the evaluation of specific types of applications in various domains. The SUE (Systematic Usability Evaluation) methodology was developed, which systematically combined inspection with usertesting [4, 10]. The SUE inspection aims at helping usability inspectors share and transfer their evaluation expertise, simplify the inspection process for newcomers, and achieve more effective and efficient results. It is based on the use of evaluation patterns, called Abstract Tasks (ATs), which precisely describe the evaluators activities to be performed during the inspection. SUE has been applied to different classes of applications, such as hypermedia [10] and web sites [3]. We are currently adapting it to the context of e-learning. So far, we have identified a first set of usability attributes and guidelines able to capture the peculiar features of e-learning applications [1]. The ATs specific for e-learning were derived from such usability attributes and guidelines [2]. In order to validate this approach, we have carried out a controlled experiment, whose design is described in this paper. It compares the SUE approach to other well known techniques such as user-testing and heuristics evaluations. 2 Usability Evaluation Techniques Different methods can be used for evaluating the usability of interactive systems. Among them, the most commonly adopted are user-based methods and inspection methods. User-based methods mainly consist of user testing, in which usability properties are assessed by observing how the system is actually used by some representatives of real users [5]. Usability inspection methods involve expert evaluators only, who inspect the application and provide judgments based on their knowledge [11]. User-based evaluation currently provides the most complete form of evaluation, because it assesses usability through samples of real users. However, this technique has a number of drawbacks, such as the difficulty to properly select adequate user samples and to train these users to manage also advanced functions of an interactive system. Furthermore, it is difficult to reproduce ecological settings of usage in a limited amount of time. Failures in creating real-life situations may lead to artificial conclusions rather than to realistic results. The effort and time to set up reliable user testing is often conspicuous. A valid technique in the user-based evaluation methods is the thinking aloud in which users are asked to think aloud verbalising their actions when they use the system or prototype. In this way, evaluators can detect the user mental model of an application recognising eventual misconceptions and the system elements that cause them. With respect to user-based evaluation, usability inspection methods are more subjective, having heavy dependence upon the inspector skills. Their main advantage is however the cost saving: they save users [8], and do not require any special equipment, nor lab facilities. In addition, experts can detect a wide range of problems and possible faults of a complex system in a limited amount of time. Among the

3 inspection methods, the most commonly used is the heuristic evaluation [11]. It involves a small set of experts inspecting the system, and evaluating the interface against a list of recognized usability principles: the heuristics. Heuristic evaluation is one of the discount usability methods [11]. In fact some researches have shown that it is a very efficient usability engineering method, with a high benefit-cost ratio [11]. It is especially valuable when time and resources are short, because skilled evaluators, without needing the involvement of representative users can produce high quality results in a limited amount of time [9]. In order to provide a more robust evaluation method, SUE (Systematic Usability Evaluation) inspection has been introduced [10]. SUE proposes a set of evaluation patterns, called Abstract Tasks (ATs). ATs guide the inspector s activities, precisely describing which objects of the application to look for, and which actions to perform during the inspection in order to analyze such objects. In this way, even less experienced evaluators are given the opportunity of achieving with more complete and precise results. The aim of the experiment reported in this paper is to understand what are the relative strengths and potential problems of different usability techniques in the e- learning context. In details, we concentrated upon Heuristic Evaluation (HE), Direct Observation (DO), and Sue Inspection (SI) as these techniques cover the range of alternatives currently available. The experimental method is described in the following sections 2.1 Method Following the methodology adopted in [4], the comparison metric was defined along the three major dimensions of effectiveness, efficiency, and user satisfaction, which correspond to the principal usability factors as defined in [7]. In the adopted metric, effectiveness refers to the number of usability problems discovered by an average inspector. Efficiency refers to the time expended in relation to the effectiveness of the evaluation. Satisfaction refers to a number of subjective parameters, such as perceived usefulness, difficulty, acceptability and confidence with respect to the evaluation technique. For each dimension, a specific hypothesis was tested. As it is well known that user testing is accurate in terms of the number of problems unveiled, but requires a well-crafted evaluation setting and is costly in terms o resources and time, DO was tested as an evaluation baseline. Effectiveness Hypothesis. As a general hypothesis, we predicted that SI should increase evaluation effectiveness as compared to HE. The advantage is related to two factors: (a) the systematic nature of the SI technique that help the evaluator to identify basic application constituents; and (b) the use of ATs, which suggest the activities to be conducted over such application constituents. These factors are likely to reduce the subjective aspect of HE. Efficiency Hypothesis. We predicted that applying SI should take longer than HE. This prediction is generated by taking into consideration the fact that a rigorous application of several ATs is time demanding. The inspectors need to evaluate the applications performing each step reported in the AT activity description. On the

4 other hand, HE is less structured and faster than SI. However, we expected that SI should not compromise inspection efficiency, given the higher effectiveness of the technique that should compensate for the longer time required by its application. Thus, we expected no difference in efficiency between the two techniques. Satisfaction Hypothesis. The results reported in [4] showed that the SUE inspection enhances the inspectors control over the inspection process and their confidence on the obtained results. Thus, we believe that the satisfaction of the inspectors that used the SI is major than the satisfaction of the evaluators that exploited HE and DO, as they may feel more in control. Participants The study involved 75 senior students of a Human-Computer Interaction (HCI) class at the University of Bari in Italy. They participated in the experiment as part of their credits for the HCI course. All participants had a basic knowledge of usability of interactive systems and of usability evaluation techniques, because they had some previous experiences of evaluating software systems. In addition, we recruited 25 students of another computer science class, who use the e-learning system, thus acting as users for the DO technique. Design The three usability evaluation techniques were manipulated between-subjects. Initially, the evaluators were randomly divided in three groups of 25. Each group was assigned to one of the three experimental conditions. The HE (Heuristic Evaluation) group had to perform an heuristic evaluation exploiting the learning with software heuristics [15]. In the DO (Direct Observation) group, every evaluator observed a student during the interaction with the e-learning application using the thinking aloud technique. Finally, the SI (Sue Inspection) group used the inspection technique with ATs proposed by SUE methodology [1]. Procedure A week before the experiment, all participants were presented with a short demonstration of the application to be evaluated, lasting almost one hour. A few summary indications about the application content and the main functions were introduced, without providing, however, too many details. A couple of days before the experiment, a training session of about one hour introduced participants with the conceptual tools to be used during the experiment. Each group participated in their specific training session in which the usability technique adapted to the context of e- learning was illustrated. The experiment consisted of two experimental sessions lasting three hours each. During the first session, participants evaluated the e-learning system applying the technique they were assigned to. The HE group was provided with a list of the ten Preece and Squires heuristics, summarizing the usability guidelines for the e-learning systems. The DO group observed a student interacting with the e-learning system during the execution of seven predefined task. The SI group was given the list of

5 eight ATs to be applied during inspection. The limited number of ATs was due to the limited time of the experimental session. We selected the most basic ATs, which could guide SI inspectors in the analysis of the main application constituents. Working individually, participants of the three groups had to find usability problems in the application, and to record them on a report booklet, which differed according to the experimental condition. For the HE group, the booklet included ten forms, one for each e-learning heuristics. The form required information about where that heuristic was violated and a short description of the problem. The SI group was instead provided with a report booklet including eight forms, each one corresponding to an AT. Again, the forms required information about the violations detected through that AT and where they occurred. In the DO group, the booklet included seven forms, one for each predefined task, in which the observer enumerated and described the problems that the user encountered performing the predefined task and described the observed problem. At the end of the experimental session, all the filled forms were collected. A day after, there was another session in which each evaluator was asked to type each detected problem in an electronic form. This was required in order to avoid readability problems in the data analysis. In the electronic booklet, each participant wrote again the description of the problem, where it occurred, how it was found and how many time it occurred. Finally, the evaluator gave a severity rating to the problem in the scale from 1 (I do not agree that this is a usability problem at all) to 5 (usability catastrophe). Table 1: An example of the electronic booklet provided to the experimental groups. Problem description Wher e Ho w How Times Many Severity Ratings At the end of the second session, participants were invited to fill in the evaluatorsatisfaction questionnaire proposed in [4]. It combined several items to measure three main dimensions: user-satisfaction with the evaluated application, evaluatorsatisfaction with the inspection technique, and evaluator-satisfaction with the results achieved. The psychometric instrument was organized in two parts. The first was concerned with the application; the second included the questions about the adopted evaluation technique. Two final questions asked participants to specify how much they felt satisfied about their performance as evaluators. Data coding The report booklets have been analyzed by four expert evaluators with a strong HCI background to assess effectiveness and efficiency of the applied evaluation techniques. Evaluator satisfaction was instead measured analyzing the selfadministered post-experiment questionnaires. Currently, we are analyzing the data. Thus, the discussion of the results can not be included in this paper, but it will be ready at the workshop time.

6 3 Conclusion One present goal of researchers and developers of Human-Computer Interaction is to design software tools that support people to learn the material available online in an educationally effective manner. In this paper, after having briefly described our approach to the evaluation of usability of e-learning application, the design and the execution of a controlled experiment have been illustrated. This experiment aims at answering important questions about the effectiveness, efficiency, and satisfaction of the SUE inspection technique in the context of e-learning, in comparison with other evaluation techniques. The research continues for identifying a wider and more exhaustive set of guidelines and techniques that allow to obtain the more reliable results investigating the aspects of an e-learning application. References 1. Ardito C., De Marsico M., Lanzilotti R., Levialdi S., Roselli T., Rossano V., Tersigni M., 2004, Usability of E-Learning Tools, Proceedings of the International Conference Advanced Visual Interface 2004 (AVI 2004), Gallipoli, Italy, May 25-28, (2004) Ardito C., Costabile M.F., De Marsico M., Lanzilotti R., Levialdi S., Roselli T., Rossano V.: An Approach to Usability Evaluation of e-learning Applications, Special Issue User- Centred Interaction Paradigms for Universal Access in the Information Society of the International Journal Universal Access in the Information Society, Vol. 4/5, (2005). 3. Cantoni L., Di Blas N., Bolchini D. Comunicazione, qualita', usabilita, Edizioni Apogeo, De Angeli A., Matera M., Costabile M., Garzotto F., Paolini P.: On the Advantages of Systematic Inspection for Evaluating Hypermedia Usability. International Journal of Human- Computer Interaction, ISSN: , Vol. 15, N. 3, (2003) Dix A., Finlay J., Abowd G., and Beale R.: Human-Computer Interactio (3 rd Edition) London: Prentice Hall Europe, (2003). 6. Dringus L., An Iterative Usability Evaluation Procedure for Interactive Online Courses, Journal of Interactive Instruction Development, Vol. 7, N. 4, (1995) International Standard Organization 9241: Ergonomics Requirements for Office Work with Visual Display Terminal (VDT), Jeffries R. and Desurvies H.W.: Usability testing vs. Heuristic Evaluation: was There a Context?, ACM SIGCHI Bulletin, Vol. 24, N. 4, (October 1992) Kantner L. and Rosenbaum S.: Usability Studies of WWW Sites: Heuristics Evaluation vs. Laboratory Testing, Proceedings of SIGDOC 97, Snowbird, UT, USA, (1997) , ACM Pres. 10. Matera, M., Costabile, M.F., Garzotto, F., and Paolini, P.: SUE Inspection: an Effective Method for Systematic Usability Evaluation of Hypermedia. IEEE Transactions on Systems, Man and Cybernetics - Part A, Vol. 32, N. 1, (2002) Nielsen J.: Usability Engineering. Academic Press. Cambridge, MA. (1993). 12. Parlangeli O., Marchigiani E., and Bagnara S.: Multimedia System in Distance Education: Effects on Usability, Interacting with Computers, Elsevier Science Ltd, Great Britain, Vol. 12, (1999) Shneidermann B.: Designing the User Interface, Addison-Wesley, (2003).

7 14. Squire D. and Preece J.: Usability and Learning: Evaluating the potential of educational software. Computer & Education, Elsevier Science Ltd, Great Britain, 27(1), (1996) Squires D. and Preece J.: Predicting quality in Educational Software: Evaluating for Learning, Usability, and the Synergy between them. Interacting with Computers, Elsevier Science Ltd, Great Britain, Vol. 11, N. 5, (1999)

An Approach to Usability Evaluation of e- Learning Applications

An Approach to Usability Evaluation of e- Learning Applications An Approach to Usability Evaluation of e- Learning Applications C. ARDITO*, M.F. COSTABILE*, M. DE MARSICO, R. LANZILOTTI*, S. LEVIALDI, T. ROSELLI*, V. ROSSANO* *Dipartimento di Informatica Università

More information

Learning by e-learning: Breaking Down Barriers and Creating Opportunities for the Visually-Impaired

Learning by e-learning: Breaking Down Barriers and Creating Opportunities for the Visually-Impaired Learning by e-learning: Breaking Down Barriers and Creating Opportunities for the Visually-Impaired Barbara Leporini 1, Marina Buzzi 2 1 CNR-ISTI, via Moruzzi 1, 56124, Pisa, Italy barbara.leporini@isti.cnr.it

More information

Usability Heuristics Evaluation for Child E- learning Applications

Usability Heuristics Evaluation for Child E- learning Applications 654 JOURNAL OF SOFTWARE, VOL. 5, NO. 6, JUNE 2010 Usability Heuristics Evaluation for Child E- learning Applications Asmaa Alsumait Kuwait University, Computer Engineering Department, Kuwait alsumait@eng.kuniv.edu.kw

More information

Study of characteristics of Effective Online Help System to Facilitate Nurses Interacting with Nursing Information System

Study of characteristics of Effective Online Help System to Facilitate Nurses Interacting with Nursing Information System Study of characteristics of Effective Online Help to Facilitate Nurses Interacting with Nursing Information Study of characteristics of Effective Online Help to Facilitate Nurses Interacting with Nursing

More information

Quality of Web Usability Evaluation Methods: an empirical study on MiLE+

Quality of Web Usability Evaluation Methods: an empirical study on MiLE+ Quality of Web Usability Evaluation Methods: an empirical study on MiLE+ Davide Bolchini University of Lugano (Switzerland) Franca Garzotto Politecnico di Milano (Italy) Outline Motivation Goals MiLE+

More information

Quality of Web Usability Evaluation Methods: An Empirical Study on MiLE+

Quality of Web Usability Evaluation Methods: An Empirical Study on MiLE+ Quality of Web Usability Evaluation Methods: An Empirical Study on MiLE+ Davide Bolchini 1 and Franca Garzotto 2 1 TEC-Lab, Facoltà di Scienze della Comunicazione, Università della Svizzera Italiana Via

More information

Usability Testing and Expert Inspections Complemented by Educational Evaluation: A Case Study of an e-learning Platform

Usability Testing and Expert Inspections Complemented by Educational Evaluation: A Case Study of an e-learning Platform Granića, A., & Ćukušić, M. (2011). Usability Testing and Expert Inspections Complemented by Educational Evaluation: A Case Study of an e-learning Platform. Educational Technology & Society, 14 (2), 107

More information

MiLE+ (Milano-Lugano Evaluation method)

MiLE+ (Milano-Lugano Evaluation method) MiLE+ (Milano-Lugano Evaluation method) A systematic approach to usability evaluation Authors: Luca Triacca Davide Bolchini Copyright USI TEC-lab 04 - All Rights Reserved. www.tec-lab.ch. Index 1. MiLE+:

More information

To measure or not to measure: Why web usability is different. from traditional usability.

To measure or not to measure: Why web usability is different. from traditional usability. To measure or not to measure: Why web usability is different from traditional usability. Charlotte Olsson Department of Informatics Umeå University, 901 87 UMEÅ, Sweden +46 90 786 6820 colsson@informatik.umu.se

More information

The USE Project: Bridging the Gap between Usability Evaluation and Software Development

The USE Project: Bridging the Gap between Usability Evaluation and Software Development The USE Project: Bridging the Gap between Usability Evaluation and Software Development Als, B. 1, Frøkjær, E. 2, Hornbæk, K. 2, Høegh, R. 1, Jensen, J. 1, Nørgaard, M. 2, Skov, M. 2, Stage, J. 1 & Uldall-Espersen,

More information

Fan Fu. Usability Testing of Cloud File Storage Systems. A Master s Paper for the M.S. in I.S. degree. April, 2013. 70 pages. Advisor: Robert Capra

Fan Fu. Usability Testing of Cloud File Storage Systems. A Master s Paper for the M.S. in I.S. degree. April, 2013. 70 pages. Advisor: Robert Capra Fan Fu. Usability Testing of Cloud File Storage Systems. A Master s Paper for the M.S. in I.S. degree. April, 2013. 70 pages. Advisor: Robert Capra This paper presents the results of a usability test involving

More information

Design Approaches to Enhance Usability for E-Commerce Sites

Design Approaches to Enhance Usability for E-Commerce Sites www.ijcsi.org 84 Design Approaches to Enhance Usability for E-Commerce Sites Mohiuddin Ahmed 1, Jonayed Kaysar 2 and Nafis Rahman 3 1 Department of Computer Science and Information Technology, Islamic

More information

An Iterative Usability Evaluation Procedure for Interactive Online Courses

An Iterative Usability Evaluation Procedure for Interactive Online Courses An Iterative Usability Evaluation Procedure for Interactive Online Courses by Laurie P. Dringus ABSTRACT The Internet and World Wide Web (W3) have afforded distance learners simple links to access information.

More information

Human-Computer Interaction Standards

Human-Computer Interaction Standards Proceedings of the 6th International Conference on Human Computer Interaction, Yokohama, July 1995. Anzai & Ogawa (eds), Elsevier. Human-Computer Interaction Standards Nigel Bevan NPL Usability Services,

More information

An activity-based analysis of hands-on practice methods

An activity-based analysis of hands-on practice methods Journal of Computer Assisted Learning (2000) 16, 358-365 An activity-based analysis of hands-on practice methods S. Wiedenbeck, J.A. Zavala & J. Nawyn University of Nebraska Abstract The success of exploration-based

More information

Creative Interface Design For Information Seeking

Creative Interface Design For Information Seeking Creative interface design for information seeking Lee, S.S., Theng, Y.L, Goh, H.L.D., & Foo, S. (2004) Proc. 6 th Asia-Pacific Conference on Computer-Human Interaction (APCHI 2004) (Incorporating the 5

More information

MEASURING USABILITY OF ICONIC BASED GUIs OF MOBILE EMERGENCY SERVICE SOFTWARE BY USING HCI. Y.Batu Salman, Adem Karahoca

MEASURING USABILITY OF ICONIC BASED GUIs OF MOBILE EMERGENCY SERVICE SOFTWARE BY USING HCI. Y.Batu Salman, Adem Karahoca MEASURING USABILITY OF ICONIC BASED GUIs OF MOBILE EMERGENCY SERVICE SOFTWARE BY USING HCI Y.Batu Salman, Adem Karahoca Bahcesehir University, Engineering Faculty, Computer Engineering Department Bahcesehir,

More information

User Testing for Moodle Application

User Testing for Moodle Application , pp.243-252 http://dx.doi.org/10.14257/ijseia.2013.7.5.22 User Testing for Moodle Application Siah Sim Tee, Tengku Siti Meriam Tengku Wook and Suhaila Zainudin Universiti Kebangsaan Malaysia, Selangor,

More information

PhD Qualifying Examination: Human-Computer Interaction

PhD Qualifying Examination: Human-Computer Interaction PhD Qualifying Examination: Human-Computer Interaction University of Wisconsin Madison, Department of Computer Sciences Spring 2014 Monday, February 3, 2014 General Instructions This exam has 7 numbered

More information

Testing the Usefulness of a Pan-Tilt-Zoom (PTZ) Camera in Human-Robot Interactions

Testing the Usefulness of a Pan-Tilt-Zoom (PTZ) Camera in Human-Robot Interactions PROCEEDINGS of the HUMAN FACTORS AND ERGONOMICS SOCIETY 50th ANNUAL MEETING 2006 757 Testing the Usefulness of a Pan-Tilt-Zoom (PTZ) Camera in Human-Robot Interactions Curtis W. Nielsen and Michael A.

More information

Information about me. Human-Computer Interaction. 0 - presentation. The question: WHY???? TimeTable. Objectives. Non-objectives.

Information about me. Human-Computer Interaction. 0 - presentation. The question: WHY???? TimeTable. Objectives. Non-objectives. Human Computer Interaction 0 - presentation Department of Computer and Management Sciences Trento - Italy Information about me Contacts Department of Computer and Management Sciences - Trento Via Inama,

More information

Situated Usability Testing for Security Systems

Situated Usability Testing for Security Systems PNNL-20201 Prepared for the U.S. Department of Energy under Contract DE-AC05-76RL01830 Situated Usability Testing for Security Systems FL Greitzer February 2011 DISCLAIMER This report was prepared as an

More information

Screen Design : Navigation, Windows, Controls, Text,

Screen Design : Navigation, Windows, Controls, Text, Overview Introduction Fundamentals of GUIs Screen Design : Navigation, Windows, Controls, Text, Evaluating GUI Performance - Methods - Comparison 1 Example: Automotive HMI (CAR IT 03/2013) 64, 68, 69 2

More information

Heuristic evaluation for e-government websites in Saudi Arabia

Heuristic evaluation for e-government websites in Saudi Arabia Loughborough University Institutional Repository Heuristic evaluation for e-government websites in Saudi Arabia This item was submitted to Loughborough University's Institutional Repository by the/an author.

More information

Evaluation of a MOODLE Based Learning Management System Applied at Berlin Institute of Technology Based on ISO-9126

Evaluation of a MOODLE Based Learning Management System Applied at Berlin Institute of Technology Based on ISO-9126 Conference ICL21 September 15-17, 21 Hasselt, Belgium Evaluation of a MOODLE Based Learning Management System Applied at Berlin Institute of Technology Based on ISO-9126 Haytham S. Al-sarrayrih, Lars Knipping,

More information

Strategies for Evaluating Software Usability

Strategies for Evaluating Software Usability Strategies for Evaluating Software Usability Ronan Fitzpatrick Department of Mathematics, Statistics and Computer Science, Dublin Institute of Technology, Kevin Street, Dublin 8, Ireland. Tel: +353 (1)

More information

City University of Hong Kong. Information on a Course offered by Department of Information Systems with effect from Semester A in 2014 / 2015.

City University of Hong Kong. Information on a Course offered by Department of Information Systems with effect from Semester A in 2014 / 2015. City University of Hong Kong Information on a Course offered by Department of Information Systems with effect from Semester A in 2014 / 2015. Part I Course Title: Course Code: Course Duration: Human-Computer

More information

Remote Usability Evaluation Methods and Tools: A Survey

Remote Usability Evaluation Methods and Tools: A Survey Remote Usability Evaluation Methods and Tools: A Survey Fidas Christos, Katsanos Christos, Papachristos Eleftherios, Tselios Nikolaos, Avouris Nikolaos Human Computer Interaction Group, Electrical and

More information

Software Development and Usability Testing

Software Development and Usability Testing Software Development and Usability Testing Shneiderman, Chapter 4 Preece et al, Ch 9, 11-15 Krug, Rocket Surgery Made Easy Rubin, Handbook of Usability Testing Norman Neilsen Group www HCI in Software

More information

METHODOLOGIES FOR STUDIES OF PROGRAM VISUALIZATION

METHODOLOGIES FOR STUDIES OF PROGRAM VISUALIZATION Full paper ABSTRACT METHODOLOGIES FOR STUDIES OF PROGRAM VISUALIZATION Niko Myller & Roman Bednarik Department of Computer Science University of Joensuu PO Box 111, FI-80101 firstname.surname@cs.joensuu.fi

More information

The Usability of Electronic Stores based on the Organization of Information and Features

The Usability of Electronic Stores based on the Organization of Information and Features The Usability of Electronic Stores based on the Organization of Information and Features CHAN KAH-SING Singapore Polytechnic This paper describes an investigation on how the perceived usability of electronic

More information

A Simple Approach to Web-Site Usability Testing

A Simple Approach to Web-Site Usability Testing A Simple Approach to Web-Site Usability Testing Mikael B. Skov & Jan Stage Department of Computer Science, Aalborg University, Fredrik Bajers Vej 7, DK-92 Aalborg East, Denmark Universal access requires

More information

Common Industry Format Usability Tests

Common Industry Format Usability Tests Proceedings of UPA 98, Usability Professionals Association, Scottsdale, Arizona, 29 June 2 July, 1999 Common Industry Format Usability Tests Nigel Bevan Serco Usability Services 4 Sandy Lane, Teddington,

More information

A Human Cognitive Processing Perspective in Designing E-Commerce Checkout Processes

A Human Cognitive Processing Perspective in Designing E-Commerce Checkout Processes A Human Cognitive Processing Perspective in Designing E-Commerce Checkout Processes Marios Belk 1, Panagiotis Germanakos 1,2, Argyris Constantinides 3, George Samaras 1 1 Department of Computer Science,

More information

MEDICAL SCIENCES Vol.II -Human Aspects of Health Care Information Systems - Andre Kushniruk, Joseph Kannry

MEDICAL SCIENCES Vol.II -Human Aspects of Health Care Information Systems - Andre Kushniruk, Joseph Kannry HUMAN ASPECTS OF HEALTH CARE INFORMATION SYSTEMS Andre Kushniruk School of Health Information Science,University of Victoria, Victoria, British Columbia, Canada Joseph Kannry Mt. Sinai Medical Center,

More information

Levels of Automation and User Participation in Usability Testing

Levels of Automation and User Participation in Usability Testing Levels of Automation and User Participation in Usability Testing Kent L. Norman Department of Psychology Laboratory for Automation Psychology and Decision Processes University of Maryland, College Park,

More information

An approach for usability evaluation of e-commerce sites based on design patterns and heuristics criteria

An approach for usability evaluation of e-commerce sites based on design patterns and heuristics criteria An approach for usability evaluation of e-commerce sites based on design patterns and heuristics criteria M. Sartzetaki Y. Psaromiligkos S. Retalis P. Avgeriou MSc Student University of Paisley Technological

More information

Understanding the User Model of the Elderly People While Using Mobile Phones

Understanding the User Model of the Elderly People While Using Mobile Phones Understanding the User Model of the Elderly People While Using Mobile Phones Hsien-Hui TANG Shih-An KAO DITL, The Graduate Institute of Industrial Design, Chang Gung University, Taiwan hhtang@mail.cgu.edu.tw

More information

Usability Evaluation of Universities Websites

Usability Evaluation of Universities Websites 1 Jabar M. A., 2Usman Abbas Usman, 3Sidi F. Department of Information System, marzanah@ upm.edu.my 2 Department of Information System, abbasusman4real@yahoo.com 3 Department of Computer Science, fatimah@

More information

Transformation of Information Technology Based on Human Computer Interaction Concept

Transformation of Information Technology Based on Human Computer Interaction Concept Institute of Advanced Engineering and Science International Journal of Informatics and Communication Technology (IJ-ICT) Vol.2, No.3, December 2013, pp.137 ~143 ISSN: 2252-8776 137 Transformation of Information

More information

A literature review about usability evaluation methods for e-learning platforms

A literature review about usability evaluation methods for e-learning platforms 1038 Work 41 (2012) 1038-1044 DOI: 10.3233/WOR-2012-0281-1038 IOS Press A literature review about usability evaluation methods for e-learning platforms Freire, Luciana Lopes a,, Arezes, Pedro Miguel b

More information

Measuring the User Experience

Measuring the User Experience Measuring the User Experience Collecting, Analyzing, and Presenting Usability Metrics Chapter 5 Issues-Based Metrics Tom Tullis and Bill Albert Morgan Kaufmann, 2008 ISBN 978-0123735584 Introduction Usability

More information

HCI studies in Management Information Systems

HCI studies in Management Information Systems HCI studies in Management Information Systems Citation: Zhang, P., Nah, F., and Preece, J. (2004), HCI studies in Management Information Systems, Behaviour & Information Technology, forthcoming Ping Zhang,

More information

Screen Design : Navigation, Windows, Controls, Text,

Screen Design : Navigation, Windows, Controls, Text, Overview Introduction Fundamentals of GUIs - methods - Some examples Screen : Navigation, Windows, Controls, Text, Evaluating GUI Performance 1 Fundamentals of GUI What kind of application? - Simple or

More information

Human Computer Interaction and Romania s Future of Education

Human Computer Interaction and Romania s Future of Education Human Computer Interaction and Romania s Future of Education Veronica Adriana Popescu, Gheorghe N. Popescu, Cristina Raluca Popescu popescu_gh_cafr@yahoo.com University of Bucharest (Romania) Abstract

More information

Research Statement Chaiwoo Lee As I study topics around user-centered product design and development, I always try to keep the broader implications of my research in mind. Research on user-centered design

More information

Improving Software Engineering Practice with HCI Aspects

Improving Software Engineering Practice with HCI Aspects Improving Software Engineering Practice with HCI Aspects Xavier Ferre Universidad Politecnica de Madrid xavier@fi.upm.es Ana M. Moreno Universidad Politecnica de Madrid ammoreno@fi.upm.es Abstract Techniques

More information

Project 3: Usability Testing vs. Heuristic Evaluation. Team Members Jenny Allen Eric Drewski Ashley Engelhardt Junyoup Kim

Project 3: Usability Testing vs. Heuristic Evaluation. Team Members Jenny Allen Eric Drewski Ashley Engelhardt Junyoup Kim Project 3: Usability Testing vs. Heuristic Evaluation Team Members Jenny Allen Eric Drewski Ashley Engelhardt Junyoup Kim Date: October 4, 2007 Introduction The team analyzed the functionality of the OneStart

More information

Interface Design Rules

Interface Design Rules Interface Design Rules HCI Lecture 10 David Aspinall Informatics, University of Edinburgh 23rd October 2007 Outline Principles and Guidelines Learnability Flexibility Robustness Other Guidelines Golden

More information

Web Usability: Principles and Evaluation Methods

Web Usability: Principles and Evaluation Methods Web Usability: Principles and Evaluation Methods Maristella Matera, Francesca Rizzo, Giovanni Toffetti Carughi Dipartimento di Elettronica e Informazione, Politecnico di Milano Piazza Leonardo da Vinci,

More information

Analyzing lifelong learning student behavior in a progressive degree

Analyzing lifelong learning student behavior in a progressive degree Analyzing lifelong learning student behavior in a progressive degree Ana-Elena Guerrero-Roldán, Enric Mor, Julià Minguillón Universitat Oberta de Catalunya Barcelona, Spain {aguerreror, emor, jminguillona}@uoc.edu

More information

AN ONTOLOGICAL APPROACH TO WEB APPLICATION DESIGN USING W2000 METHODOLOGY

AN ONTOLOGICAL APPROACH TO WEB APPLICATION DESIGN USING W2000 METHODOLOGY STUDIA UNIV. BABEŞ BOLYAI, INFORMATICA, Volume L, Number 2, 2005 AN ONTOLOGICAL APPROACH TO WEB APPLICATION DESIGN USING W2000 METHODOLOGY ANNA LISA GUIDO, ROBERTO PAIANO, AND ANDREA PANDURINO Abstract.

More information

Evaluating a new programming language

Evaluating a new programming language In G. Kadoda (Ed). Proc. PPIG 13 Pages 275-289 Evaluating a new programming language Steven Clarke Microsoft Corporation 1 Microsoft Way Redmond, WA 98052 USA +1 425 705 5978 stevencl@microsoft.com Keywords:

More information

Supporting Mobile Applications Developer through Java IDE Using Contextual Inquiry

Supporting Mobile Applications Developer through Java IDE Using Contextual Inquiry 2009 World Congress on Computer Science and Information Engineering Supporting Mobile Applications Developer through Java IDE Using Contextual Inquiry Ogunleye Olalekan Samuel Meraka Institute, CSIR Meiring

More information

Testing Strategies for Evaluation of User Interfaces in SOA-based Systems

Testing Strategies for Evaluation of User Interfaces in SOA-based Systems Testing Strategies for Evaluation of User Interfaces in SOA-based Systems Piotr Chynał Wrocław University of Technology Wybrzeże Wyspiańskiego 27 50-370 Wrocław, Poland piotr.chynal@pwr.wroc.pl Abstract

More information

USABILITY TESTING WITH SALMON

USABILITY TESTING WITH SALMON USABILITY TESTING WITH SALMON WHAT IS USABILITY TESTING? Usability testing involves watching typical customers attempt to complete realistic tasks on your website, application or product and noting any

More information

USING PBL TO MEET THE NEEDS OF MANDATORY TRAINING IN HEALTHCARE

USING PBL TO MEET THE NEEDS OF MANDATORY TRAINING IN HEALTHCARE USING PBL TO MEET THE NEEDS OF MANDATORY TRAINING IN HEALTHCARE Dr Karen Ousey, Principal Lecturer 1 Mr. Stephen White, Senior Lecturer 2 ABSTRACT 1 Department of Nursing and Health Studies, Centre for

More information

A User Centered Approach for the Design and Evaluation of Interactive Information Visualization Tools

A User Centered Approach for the Design and Evaluation of Interactive Information Visualization Tools A User Centered Approach for the Design and Evaluation of Interactive Information Visualization Tools Sarah Faisal, Paul Cairns, Ann Blandford University College London Interaction Centre (UCLIC) Remax

More information

Evaluation of the Impacts of Data Model and Query Language on Query Performance

Evaluation of the Impacts of Data Model and Query Language on Query Performance Evaluation of the Impacts of Data Model and Query Language on Query Performance ABSTRACT Hock Chuan Chan National University of Singapore chanhc@comp.nus.edu.sg It is important to understand how users

More information

Outline. Lecture 13: Web Usability. Top Ten Web Design Mistakes. Web Usability Principles Usability Evaluations

Outline. Lecture 13: Web Usability. Top Ten Web Design Mistakes. Web Usability Principles Usability Evaluations Lecture 13: Web Usability Outline Web Usability Principles Usability Evaluations Wendy Liu CSC309F Fall 2007 1 2 What Makes Web Application Development Hard? Target audience can be difficult to define

More information

User Interface Design

User Interface Design User Interface Design Winter term 2005/2006 Thursdays, 14-16 c.t., Raum 228 Prof. Dr. Antonio Krüger Institut für Geoinformatik Universität Münster 20. Februar 06 IfGi Universität Münster User Interface

More information

TAGUCHI APPROACH TO DESIGN OPTIMIZATION FOR QUALITY AND COST: AN OVERVIEW. Resit Unal. Edwin B. Dean

TAGUCHI APPROACH TO DESIGN OPTIMIZATION FOR QUALITY AND COST: AN OVERVIEW. Resit Unal. Edwin B. Dean TAGUCHI APPROACH TO DESIGN OPTIMIZATION FOR QUALITY AND COST: AN OVERVIEW Resit Unal Edwin B. Dean INTRODUCTION Calibrations to existing cost of doing business in space indicate that to establish human

More information

Mobile games to foster the learning of history at archaeological sites

Mobile games to foster the learning of history at archaeological sites Ardito, C., Buono, P., Costabile, M. F., Lanzilotti, R., Pederson, T. (2007). Mobile games to foster the learning of history at archaeological sites. In Proceedings of IEEE VL/HCC 2007 Symposium on Visual

More information

Exploring the Usability of Municipal Web Sites: A Comparison Based on Expert Evaluation Results from Four Case Studies

Exploring the Usability of Municipal Web Sites: A Comparison Based on Expert Evaluation Results from Four Case Studies Informatica Economică vol. 14, no. 4/2010 87 Exploring the Usability of Municipal Web Sites: A Comparison Based on Expert Evaluation Results from Four Case Studies Costin PRIBEANU, Ruxandra-Dora MARINESCU,

More information

AN EVALUATION OF THE USEFULNESS OF WEB-BASED LEARNING ENVIRONMENTS The Evaluation Tool into the Portal of Finnish Virtual University

AN EVALUATION OF THE USEFULNESS OF WEB-BASED LEARNING ENVIRONMENTS The Evaluation Tool into the Portal of Finnish Virtual University AN EVALUATION OF THE USEFULNESS OF WEB-BASED LEARNING ENVIRONMENTS The Evaluation Tool into the Portal of Finnish Virtual University Abstract Kirsi Silius and Anne-Maritta Tervakari kirsi.silius@tut.fi

More information

City University of Hong Kong Course Syllabus. offered by Department of Information Systems with effect from Semester A 2016 / 2017

City University of Hong Kong Course Syllabus. offered by Department of Information Systems with effect from Semester A 2016 / 2017 City University of Hong Kong Course Syllabus offered by Department of Information Systems with effect from Semester A 2016 / 2017 Part I Course Overview Course Title: Human-Computer Interaction for Business

More information

Software Development. HCI in Software Development. Motivation for Good Design. CSCU9N5 Multimedia & HCI

Software Development. HCI in Software Development. Motivation for Good Design. CSCU9N5 Multimedia & HCI Software Development CSCU9N5 Multimedia & HCI HCI in Software Development Motivation for good design Goals for the designer How design fits into the software life cycle Case study: Microsoft Windows 95

More information

Evaluation of Fiji National University Campus Information Systems

Evaluation of Fiji National University Campus Information Systems ISSN No. 0976-5697!"# $#$!%&&$ '()))* Evaluation of Fiji National University Campus Information Systems Bimal Aklesh Kumar Department of Computer Science and Information Systems Fiji National University

More information

Collaborative Editing for All: the Google Docs Example

Collaborative Editing for All: the Google Docs Example Collaborative Editing for All: the Google Docs Example Giulio Mori, Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini and Victor M. R. CNR-IIT, via Moruzzi 1, 56124 Pisa, Italy CNR-ISTI, via Moruzzi

More information

Testing Websites with Users

Testing Websites with Users 3 Testing Websites with Users 3 TESTING WEBSITES WITH USERS Better Practice Checklist Practical guides for effective use of new technologies in Government www.agimo.gov.au/checklists version 3, 2004 Introduction

More information

Chapter 14: Usability testing and field studies. The aims: Usability testing

Chapter 14: Usability testing and field studies. The aims: Usability testing Chapter 14: Usability testing and field studies The aims: Explain how to do usability testing through examples Outline the basics of experimental design Discuss the methods used in usability testing Discuss

More information

Consumer Perception of Mobile Phone Attributes

Consumer Perception of Mobile Phone Attributes Consumer Perception of Mobile Phone Attributes Tao Zhang 1, Pei-Luen Patrick Rau 2, Jia Zhou 2 1 Department of Electrical Engineering and Computer Science Vanderbilt University, TN 37211, USA 2 Department

More information

Revista de Administração da Universidade Federal de Santa Maria E-ISSN: 1983-4659 rea@smail.ufsm.br Universidade Federal de Santa Maria Brasil

Revista de Administração da Universidade Federal de Santa Maria E-ISSN: 1983-4659 rea@smail.ufsm.br Universidade Federal de Santa Maria Brasil Revista de Administração da Universidade Federal de Santa Maria E-ISSN: 1983-4659 rea@smail.ufsm.br Universidade Federal de Santa Maria Brasil Ozen, Cagla; Basoglu, Nuri; Daim, Tugrul Impact of man-machine

More information

Designing an Adaptive Virtual Guide for Web Applications

Designing an Adaptive Virtual Guide for Web Applications 6th ERCIM Workshop "User Interfaces for All" Long Paper Designing an Adaptive Virtual Guide for Web Applications Luisa Marucci, Fabio Paternò CNUCE-C.N.R. Via V.Alfieri 1, 56010 Ghezzano - Pisa, Italy

More information

Evaluating the usability of web pages: a case study

Evaluating the usability of web pages: a case study Evaluating the usability of web pages: a case study M.A.E. Lautenbach, I.S. ter Schegget, A.M. Schoute & C.L.M. Witteman Psychological Laboratory Faculty of Social Sciences Utrecht University P.O. Box

More information

Does Branding Need Web Usability? A Value-Oriented Empirical Study

Does Branding Need Web Usability? A Value-Oriented Empirical Study Does Branding Need Web Usability? A Value-Oriented Empirical Study Davide Bolchini 1, Franca Garzotto 2 andfabio Sorce 2 1 Indiana University, School of Informatics (IUPUI) 535 W. Michigan St. Indianapolis,

More information

"A Role With No Edges": The Work Practices of Information Architects

A Role With No Edges: The Work Practices of Information Architects Proceedings of HCI International 2003, vol 1, 22-27 June 2003, Crete, pp. 396-400. "A Role With No Edges": The Work Practices of Information Architects Toni Robertson, Cindy Hewlett, Sam Harvey and Jenny

More information

Mensch-Maschine-Interaktion 1. Chapter 8 (June 21st, 2012, 9am-12pm): Implementing Interactive Systems

Mensch-Maschine-Interaktion 1. Chapter 8 (June 21st, 2012, 9am-12pm): Implementing Interactive Systems Mensch-Maschine-Interaktion 1 Chapter 8 (June 21st, 2012, 9am-12pm): Implementing Interactive Systems 1 Overview Introduction Basic HCI Principles (1) Basic HCI Principles (2) User Research & Requirements

More information

PREMIER PAS OF MOBILE INTERNET BUSINESS: A SURVEY RESEARCH ON MOBILE INTERNET SERVICE

PREMIER PAS OF MOBILE INTERNET BUSINESS: A SURVEY RESEARCH ON MOBILE INTERNET SERVICE PREMIER PAS OF MOBILE INTERNET BUSINESS: A SURVEY RESEARCH ON MOBILE INTERNET SERVICE Minhee Chae, Youngwan Choi, Hoyoung Kim, Hyoshik Yu & Jinwoo Kim Internet Business Research Center, Yonsei University

More information

Integrating The Student ID Card with the Ticketing System FINAL REPORT

Integrating The Student ID Card with the Ticketing System FINAL REPORT Universitetet i Oslo Institutt for informatikk Course Code: Course Title: Deliverable No.: INF4260 Human Computer Interaction Three Autumn 2007 Integrating The Student ID Card with the Ticketing System

More information

Effective Web Communication. Bunnyfoot Services

Effective Web Communication. Bunnyfoot Services Effective Web Communication. Bunnyfoot Services Harwell Innovation Centre 173 Curie Avenue Didcot Oxfordshire OX11 0QG Tel: +44 (0) 1235 838514 Fax: +44 (0) 1235 838501 Email: enquiries@bunnyfoot.com Web:

More information

Usability Inspection of Web Portals: Results and Insights from Empirical Study

Usability Inspection of Web Portals: Results and Insights from Empirical Study ISSN (Print): 194-0814 ISSN (Online): 194-084 www.ijcsi.org 234 Usability Inspection of Web Portals: Results and Insights from Empirical Study Andrina Granić 1, Nikola Marangunić 1 and Ivica Mitrović 2

More information

Expressing Help at Appropriate Levels

Expressing Help at Appropriate Levels Expressing Help at Appropriate Levels Oscar D. Andrade Department of Computer Science The University of Texas at El Paso El Paso, TX 79968 +1 915-747-8959 odandrade@miners.utep.edu David G. Novick Department

More information

Software Engineering. Introduction. Software Costs. Software is Expensive [Boehm] ... Columbus set sail for India. He ended up in the Bahamas...

Software Engineering. Introduction. Software Costs. Software is Expensive [Boehm] ... Columbus set sail for India. He ended up in the Bahamas... Software Engineering Introduction... Columbus set sail for India. He ended up in the Bahamas... The economies of ALL developed nations are dependent on software More and more systems are software controlled

More information

Assessing the Usability of Learning Management System: User Experience Study

Assessing the Usability of Learning Management System: User Experience Study Assessing the Usability of Learning Management System: User Experience Study Maha M. Althobaiti (&) and Pam Mayhew University of East Anglia, Norwich, UK {m.althobaiti,p.mayhew}@uea.ac.uk Abstract. E-learning

More information

Mobile Device Usability: Towards Achieving Usability Excellence

Mobile Device Usability: Towards Achieving Usability Excellence Mobile Device Usability: Towards Achieving Usability Excellence Mohammed I. Alowais Ahmed S. Alawaji Fang-Fang Chua Abstract the increasing trend of using smartphones and mobile applications led to more

More information

Design as a catalyst for engaging students in creative problem solving CASE STUDY

Design as a catalyst for engaging students in creative problem solving CASE STUDY Institution University of South Australia Course/Subject Idea Generation Methods for Designers Contact Ron Corso ron.corso@unisa.edu.au Helen Robinson Helen.robinson@unisa.edu.au Prerequisite skills Nil

More information

Considering Students Perceptions: The Distance Education Student Satisfaction Model

Considering Students Perceptions: The Distance Education Student Satisfaction Model Sahin, I., & Shelley, M. (2008). Considering Students Perceptions: The Distance Student Satisfaction Model. al Technology & Society, 11(3), 216 223. Considering Students Perceptions: The Distance Student

More information

Evaluating Usability of E-Learning Systems in Universities

Evaluating Usability of E-Learning Systems in Universities Evaluating Usability of E-Learning Systems in Universities Nicholas Kipkurui Kiget Department of Computer Science Masinde Muliro University of Science and Technology Kakamega, Kenya Professor G. Wanyembi,

More information

Assignment # 4 Summing up the Course

Assignment # 4 Summing up the Course Assignment # 4 Summing up the Course Usability form an Industrial Prospective (DV1301) Ch. M Nadeem Faisal Muhammad Asim Farrukh Sahar Rana Asif Sattar 790102-P373 811115-P373 800102-P373 840715-P177 mnmi07@student.bth.se

More information

CHAPTER THREE USER CENTERED DESIGN APPROACH. This chapter focuses on two main sections that are about user centered approach and

CHAPTER THREE USER CENTERED DESIGN APPROACH. This chapter focuses on two main sections that are about user centered approach and CHAPTER THREE USER CENTERED DESIGN APPROACH 3.1 Introduction This chapter focuses on two main sections that are about user centered approach and applying this approach to design of the Blue Air Travel

More information

Human-Computer Interaction Introduction to HCI BSc/CQU Lecture 1

Human-Computer Interaction Introduction to HCI BSc/CQU Lecture 1 Human-Computer Interaction Introduction to HCI BSc/CQU Lecture 1 (November 15, 2001) Tralvex (Rex) Yeap MAAAI MSCS Outline N-ways Introduction - Personal Information and Background - Students Information

More information

An Ontology-Based Approach for Designing Web Usability Evaluation Questionnaires

An Ontology-Based Approach for Designing Web Usability Evaluation Questionnaires An Ontology-Based Approach for Designing Web Usability Evaluation Questionnaires Elena García Barriocanal 1, Miguel A. Sicilia Urbán 2, León A. González Sotos 1, and José R. Hilera González 1 1 Computer

More information

Combining agile methods and user-centered design to create a unique user experience: An empirical inquiry

Combining agile methods and user-centered design to create a unique user experience: An empirical inquiry Combining agile methods and user-centered design to create a unique user experience: An empirical inquiry Cynthia Y. Lester Department of Computer Science Tuskegee University Tuskegee, Alabama, USA cylester@tuskegee.edu

More information

Design and Analysis in Software Engineering. Part 1: The Language of Case Studies and Formal Experiments

Design and Analysis in Software Engineering. Part 1: The Language of Case Studies and Formal Experiments ACM SIGSOFT Software Engineering Notes vol 19 no 4 October 1994 Page 16 contest. Members of the winning IBM team were Feng-hsinng Hsu, Murray S. Campbell and Arthur J. Hoane, Jr. Running five times faster

More information

Sharing designer and user perspectives of web site evaluation: a cross-campus collaborative learning experience

Sharing designer and user perspectives of web site evaluation: a cross-campus collaborative learning experience British Journal of Educational Technology Vol 33 No 3 2002 267 278 Sharing designer and user perspectives of web site evaluation: a cross-campus collaborative learning experience Penny Collings and Jon

More information

Open-EMR Usability Evaluation Report Clinical Reporting and Patient Portal

Open-EMR Usability Evaluation Report Clinical Reporting and Patient Portal Open-EMR Usability Evaluation Report Clinical Reporting and Patient Portal By Kollu Ravi And Michael Owino Spring 2013 Introduction Open-EMR is a freely available Electronic Medical Records software application

More information

Knowledge Infrastructure for Project Management 1

Knowledge Infrastructure for Project Management 1 Knowledge Infrastructure for Project Management 1 Pankaj Jalote Department of Computer Science and Engineering Indian Institute of Technology Kanpur Kanpur, India 208016 Jalote@iitk.ac.in Abstract In any

More information

Adaptation of Traditional Usability Testing Methods for Remote Testing

Adaptation of Traditional Usability Testing Methods for Remote Testing Adaptation of Traditional Usability Testing Methods for Remote Testing Jean Scholtz National Institute of Standards and Technology JeanScholtz@nist.gov Abstract Traditional usability testing methods are

More information

Developing Project Management Skills: Building a usable, accessible website for the Lower Severn Community Flood Information Network

Developing Project Management Skills: Building a usable, accessible website for the Lower Severn Community Flood Information Network 232 Greener by degrees: B9. Developing Project Management Skills: Building a usable, accessible website for the Lower Severn Community Flood Information Network Nina Reeves and Paul O Brien Aims The production

More information