Rosa Arruabarrena, Tomás A. Pérez, J. López-Cuadrado, J. Gutiérrez, and J.A. Vadillo
|
|
- Ellen Heath
- 8 years ago
- Views:
Transcription
1 On Evaluating Adaptive Systems for Education Rosa Arruabarrena, Tomás A. Pérez, J. López-Cuadrado, J. Gutiérrez, and J.A. Vadillo Dpto. de Lenguajes y Sistemas Informáticos, Universidad del País Vasco (UPV-EHU) Apdo San Sebastián, Spain Abstract. In this paper we have gathered some interesting techniques to evaluate educative systems. Our main purpose is to evaluate HEZINET, an adaptive hypermedia System for education available commercially. Therefore, we also include a system evaluation plan to identify which types and techniques of evaluation will be needed in order to accomplish it. 1 Introduction HEZINET is an Adaptive Hypermedia System [1] to learn Basque language. It automatically compiles exercises adapted to the concepts covered by the nodes that the student has already visited using the Item Response Theory and AI techniques [2]. The system has been validated and more than 2000 copies have been sold by now. However, we think that we can improve HEZINET. In order to do that, we have planned to perform different evaluations. At the moment we consider two uses of the system that we want to differentiate. On the one hand, the system is used as a distance learning system available on Internet to subscribed students (we will call it HEZINET-D for short). On the other hand, it is also being used in intranets by students in Basque academia as an extra support to traditional Basque classes (and we will call HEZINET-C for short). Until now, we have already made a usability test using surveys. The conclusions lead to some changes of location of functionality in the interface and to include some other contents to adapt to very beginners in Basque [3]. Now, together with the company that sells HEZINET we are interested in evaluating the effectiveness of the system and the advantages of the adaptation it provides [4]. This paper presents a wide study of strategies for software validation, types of evaluation to be considered when assessing computer assisted learning and concrete techniques to perform them. More detailed techniques are presented in [5]. A detailed overview on techniques that focus mainly on adaptation can be found in [6]. Finally, we present a plan to evaluate both versions of HEZINET.
2 2 Validation Strategies Software validation focuses on demonstrating that programs meet their requirements. We call the processes that check this validation strategies. In [7], several validation strategies are presented, such as (a) Proofs of Correctness, that consist on validating and verifying programs using formal proofs of correctness; (b) Criterion Based Validation, that is commonly used in software engineering (here the system is considered successful if it displays no major inadequacies within its intended application environment); (c) Expert Review in which a person (the expert) observes the whole system, parts of it and/or its behaviour and identifies its deficiencies; (d) Certification, that is based on techniques of software quality and deterministic rules; (e) Empirical Proofs, that use experience of user with the system as a measure. 3 Evaluation The evaluation of an educational system is a process of data gathering to determine the quality or the value of the instruction, its weaknesses and its strengths [8]. In [7,9,10] different dimensions of evaluation of these systems are presented. Two of them are the Evaluation Paradigms, that monitor what the evaluation goals are and the Evaluated Elements that classify those parts of the educational system to be assessed. Both are presented in detail in the following paragraphs. There are mainly three evaluation paradigms: (1) Formative Evaluation, which is oriented to detect weak points at early stages of the development of the product in order to modify and to improve it; (2) Summative Evaluation, that addresses punctual assessments of effectiveness of the finished application. The evaluation parameters are goals, benefits and costs; (3) Integrative Evaluation, which measures the level of integration between the educational software and other learning materials and methods into the context overall. If one looks at the elements being observed, three kinds of evaluation could be distinguished: (1) Internal Evaluation that implies that the system itself is assessed (for instance, different components of the system can be evaluated, such as the architecture, the intermediate processes, as well as behaviours of and the relations among the previous); (2) External Evaluation, that means that only elements out of the learning system are assessed, such as, student achievements or the affective impact of the system; (3) Global Evaluation, that evaluates components and impact on users. 4 Evaluation Techniques Evaluation techniques are concrete methods to carry out the validation of the system. Four most common ones are [10,11]: (1) Comparison: is based on comparing the characteristics of the system versus some standard or other system (for example, there are methods, such as golden standard, theoretical corroboration, empirical corroboration, duplication, Turing test, sensitivity analysis and benchmarking). (2) Contact
3 with users whose objective is to collect data about how the user interacts with the system, his/her behaviour and attitude (for instance, one can use interviews, surveys, questionnaires, focus groups, nominal groups, and tests). (3) Data analysis, that consists on reviewing, studying and assessing groups of data about certain characteristics. The information collected, processed and reported should be systematically reviewed and handled, and if any errors found, those should be corrected [12]. (4) Pilot testing which involves studying the performance of the system with potential end users. Depending on the number of users that are evaluated, we distinguish oneto-one testing, small-group testing, field testing and beta testing. 5 Evaluation of HEZINET To evaluate the effectiveness of both versions of HEZINET and taking into account [6,13,14], we have established a plan to: (1) improve the tools associated to the system; (2) assure that the adaptation results in better performance; (3) check the impact of the system as a motivating element of learning; (4) to attract users affectivity and retain the interaction with them as long as possible; (5) achieve excellent performance of students from the knowledge acquisition point of view, either using the system alone or transferring this acquisition to other contexts different from the computer; (6) guarantee that the system does not mislead students, independently from their computational skills, and that students can locate the desired contents either in HEZINET or in other related pedagogical material available. We planned to perform several the interface evaluation loops (internal summative evaluation) to measure different features. Although it could be considered formative, because the results will improve the product, we consider that the product has been already developed, and that we are working on a new version of the system. The plan is to create two groups of students (those involved with HEZINET-D and the ones with HEZINET-C). First, we check how students use the elements of the interface by means of (1) questionnaires detect weak points of the interface; (2) contacts with experts in Human Computer Interaction for alternative solutions to the identified problems and (3) empirical corroboration to choose the best prototype by means of (4) pilot testing on both populations. Therefore, our aim is to check if the new design solves the problems detected without interfering the rest of users. Once the new interface is validated, and if it were required, it will be integrated into a new version. To assess the affective impact of HEZINET, we will use open-ended questionnaires, in which users should indicate which elements are more helpful and pleasant. This evaluation (external and summative) could result in a reorganisation of the contents or in an inclusion of more multimedia courseware. To evaluate the system s effectiveness, we are interested in finding the differences among the learning results obtained from three populations: students from HEZINET- D, from HEZINET-C and from those that learn attending regular classes at school but without any tool of this sort. In order to conduct this (external summative) evaluation, we should analyse the user model. We will compare the data obtained from each population to check if any type of correlation among them exists. Concretely, when-
4 ever it would be possible, we will handle data from the system logs, from lists of results in tests completed at schools, in an anonymous way, and from the list of marks obtained in official tests of linguistic capability. As a result of the analysis, the hypotheses that correspond will be established. To verify the suitability of HEZINET-C within an institution like an academy of languages, it is important to assess whether the educational methods include the application as one more tool inside the classes or as an additional supporting service. We will conduct an (external integrative) evaluation using (1) interviews to students and teachers and (2) data gathering by direct observation. We consider that it is very complicated to evaluate the integration of HEZINET-D students and the learning material they may handle. Nevertheless, we could give some advice about the work environment for a good learning. 6 Conclusions Although it is not usual to evaluate systems after they are already in used, the goals of the education can vary and, perhaps, it is necessary to make certain adjustments to the initial proposed topics. It is important not only to evaluate the system but also to value the integration within the context where the learning will take place. Some synergies can be obtained thanks to the integration, which can do the system s potential be even higher than the expected one if the application were considered only separately. In this paper we have presented a wide study of types of evaluations that appear in educational systems. In the same way, it focuses on, possibly, the most interesting elements to conduct an evaluation of an educational adaptive hypermedia system. We have also discussed different goals we can consider and the system elements on which centre the study. Moreover, we also report about the techniques to be used to obtain a successful evaluation. Among these techniques, types of evaluations and strategies we have picked out the most interesting ones to evaluate HEZINET. Future work, as well as conducting the proposed evaluation plan, include projects to adapt HEZINET to other languages such as Spanish and French since the system is successful. References 1 Brusilovsky, P. (2001). "Adaptive Hypermedia." User Modeling and User-Adapted Interaction.Special Issue on: Ten Year Anniversary Issue 11(1/2): Pérez, T.A., López, R., Gutiérrez, J., González, A.: Learning Basque in a Distance-adaptive way. Computers and Education in the 21st Century. Kluwer Academic Publishers, Dordrecht, The Nederlands (2000) Villamañe, M., Gutiérrez, J., Arruabarrena, R., Pérez, T.A., Sanz-Lumbier, S., Sanz- Santamaría, S., López-Cuadrado, J., Vadillo, J.A.: Use and Evaluation of HEZINET; A System for Basque Language Learning. In: Lee, C.-H., Lajoie, S., Mizoguchi, R., Yoo, Y.D.,
5 du-boulay, B. (eds). Proceedings of the 9th International Conference on Computers In Education (ICCE/SchoolNet2001), Seoul (South Korea) (2001) 4. Karagiannidis, C. and D. G. Sampson (2000). Layered Evaluation of Adaptive Applications and Services. International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems: AH2000, Trento (Italy), Springer-Verlag Berlin Heidelberg. 5. Arruabarrena, R., T. A. Pérez, et al. (2001). Compendio de técnicas para evaluación de sistemas hipermedia adaptativos. Simposium Internacional de Informática Educativa, SIIE, Viseu, Portugal. 6. Weibelzahl, S.: Evaluation of Adaptive Systems. UM2001: Proceedings of the eighth International conference on User Modeling, Springer: Berlin (2001) 7. Mark, M.A., Greer, J.E.: Evaluation Methodologies for Intelligent Tutoring Systems. International Journal of Artificial Intelligence in Education, 4(2/3) (1993) Tessmer, M.: Planning and Conducting: Formative Evaluations. Kogan Page Limited. London (1993) 9. Draper, S.W., Brown, M.I., Henderson, F.P., McAteer, E.: Integrative evaluation: an emerging role for classroom studies of CAL. Computers and Education, 26, (1-3) (1996) Murray, T.: Formative Qualitative Evaluation for Exploratory ITS Research. International Journal of Artificial Intelligence in Education, 4(2/3) (1993) Harvey, J.: LTDI Evaluation Cookbook. Learning Technology Dissemination Initiative. Edinburgh (1999) 12 Frechtling, J., Sharp, L.: User-Friendly Handbook for Mixed Method Evaluations. NSF, Arlington, VA (1997) 13 Chin, D. N.: Empirical Evaluation of User Models and User-Adapted Systems. User Modeling and User-Adapted Interaction 11(1-2) (2001) Shute, V.J., Regian, W.: Principles for Evaluating Intelligent Tutoring Systems. International Journal of Artificial Intelligence in Education, 4(2/3) (1993)
Evaluation of Adaptive Web Systems
INFSCI 2480: Adaptive Web Systems Evaluation of Adaptive Web Systems Peter Brusilovsky School of Information Sciences University of Pittsburgh, USA With slides of Michael Yudelson, CMU Three Types of Evaluation
More informationTask-Model Driven Design of Adaptable Educational Hypermedia
Task-Model Driven Design of Adaptable Educational Hypermedia Huberta Kritzenberger, Michael Herczeg Institute for Multimedia and Interactive Systems University of Luebeck Seelandstr. 1a, D-23569 Luebeck,
More informationThe Multi-Agent System of Accounting
Education in Accounting Using an Interactive System Bogdan Pătruţ Faculty of Sciences, Vasile Alecsandri University of Bacău, Romania bogdan@edusoft.ro Abstract This paper represents a summary of a research
More informationCGMB 123 MULTIMEDIA APPLICATION DEVELOPMENT
CGMB 123 MULTIMEDIA APPLICATION DEVELOPMENT Chapter 7 Instructional System Design Models T.J.Iskandar Abd. Aziz tjiskandar@uniten.edu.my Part I Instructional Design Terms & Definition Objectives 3 Upon
More informationAnalyzing lifelong learning student behavior in a progressive degree
Analyzing lifelong learning student behavior in a progressive degree Ana-Elena Guerrero-Roldán, Enric Mor, Julià Minguillón Universitat Oberta de Catalunya Barcelona, Spain {aguerreror, emor, jminguillona}@uoc.edu
More informationHow to Manage the Collaborative Task in Dotlrn Web Based Learning
Implementing a collaborative task in dotlrn webbased learning environment Alberto Bayón 1, Olga C. Santos 2, Jesús G. Boticario 2 1,2 adenu Research Group, Artificial Intelligence Department, Computer
More informationProviding Adaptive Courses in Learning Management Systems with Respect to Learning Styles *
Providing Adaptive Courses in Learning Management Systems with Respect to Learning Styles * Sabine Graf Vienna University of Technology Women's Postgraduate College for Internet Technologies Vienna, Austria
More informationAn Approach to Adaptivity and Collaboration Support in a Web-Based Learning Environment
An Approach to Adaptivity and Collaboration Support in a Web-Based Learning Environment Martina Holenko Dlab, Nataša Hoić-Božić University of Rijeka, Department of Informatics Key words: collaborative
More informationONTOLOGY BASED FEEDBACK GENERATION IN DESIGN- ORIENTED E-LEARNING SYSTEMS
ONTOLOGY BASED FEEDBACK GENERATION IN DESIGN- ORIENTED E-LEARNING SYSTEMS Harrie Passier and Johan Jeuring Faculty of Computer Science, Open University of the Netherlands Valkenburgerweg 177, 6419 AT Heerlen,
More informationEvaluation Techniques
Evaluation Techniques 1 Overview This lecture will focus on the evaluation process and will answer the following questions: What is evaluation? What to evaluate? How to evaluate? The outcome of this session
More information2011 Springer-Verlag Berlin Heidelberg
This document is published in: Novais, P. et al. (eds.) (2011). Ambient Intelligence - Software and Applications: 2nd International Symposium on Ambient Intelligence (ISAmI 2011). (Advances in Intelligent
More informationA self-directed Virtual Learning Environment: Mi propio jefe (My own boss)
A self-directed Virtual Learning Environment: Mi propio jefe (My own boss) Diego Ernesto Leal Fonseca, Gerardo Tibaná Herrera (dleal@uniandes.edu.co, g-tibana@uniandes.edu.co) LIDIE Research and Development
More informationTHE BENEFITS OF THE USE OF INDUCTION VIRTUAL COMMUNITIES IN SUPPORTING NEW STUDENTS IN DISTANCE EDUCATION UNIVERSITIES
THE BENEFITS OF THE USE OF INDUCTION VIRTUAL COMMUNITIES IN SUPPORTING NEW STUDENTS IN DISTANCE EDUCATION UNIVERSITIES Angeles Sánchez-Elvira Paniagua,UNED, Spain Co-authors: Marcela Paz González Brignardello,
More informationHow To Train An Online Teaching
Applying Case Study in Preparing to Teach Online Courses in the Higher Education: the Development of Case Studies I-Chun Tsai University of Missouri, United States itch9@mizzou.edu Ching-Hua Wu Tamkang
More informationEvaluating Virtual Learning Environments: what are we measuring?
Electronic Journal of e-learning, Volume 1 Issue 1 (2003) 11-20 11 Evaluating Virtual Learning Environments: what are we measuring? Mary C Dyson and Silvio Barreto Campello Department of Typography & Graphic
More informationA Web-based Framework for User-centred Evaluation of End-User Experience in Adaptive and Personalized E-Learning Systems
2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology A Web-based Framework for User-centred Evaluation of End-User Experience in Adaptive and Personalized E-Learning
More informationImplementing Information Technology in the Learning Process
6th WSEAS International Conference on E-ACTIVITIES, Tenerife, Spain, December 14-16, 2007 263 Implementing Information Technology in the Learning Process SEPPO SIRKEMAA Pori Unit Turku School of Economics
More informationComputer Assisted Language Learning
Computer Assisted Language Learning!" # $ % &'$#($ Abstract $$ $ $ "$"" " "$ $ $ # "$ ( '$$ $ $ " " '' $ $" $ # $"$'" "" '"$' "$$ ) "*$"" +$# "$",-+../$ $$ # "-+..'$' "# "#$ " $$0#$$"$ $""-+.. $ Key words:
More information2. The importance of needs analysis: brief review of the literature on the topic
The importance of needs analysis in syllabus and course design. The CMC_E project: a case in point Lidia Gómez García - Universidade de Santiago de Compostela ABSTRACT This paper presents the results of
More informationMethodology for Creating Adaptive Online Courses Using Business Intelligence
Methodology for Creating Adaptive Online Courses Using Business Intelligence Despotović, S., Marijana; Bogdanović, M., Zorica; and Barać, M., Dušan Abstract This paper describes methodology for creating
More informationA Proposed Collaborative Computer Network-Based Learning Model for Undergraduate Students with Different Learning Styles
Turkish Online Journal of Distance Education-TOJDE November 2003 ISSN 1302-6488 Volume:4 Number:4 A Proposed Collaborative Computer Network-Based Learning Model for Undergraduate Students with Different
More informationBachelor Degree in Informatics Engineering Master courses
Bachelor Degree in Informatics Engineering Master courses Donostia School of Informatics The University of the Basque Country, UPV/EHU For more information: Universidad del País Vasco / Euskal Herriko
More informationKnow-How Nancy Protheroe
research report Program Evaluation Know-How Nancy Protheroe Take a critical look at specific school programs and approaches by using these research-based strategies In the assessment-driven environment
More informationOutline. Lecture 13: Web Usability. Top Ten Web Design Mistakes. Web Usability Principles Usability Evaluations
Lecture 13: Web Usability Outline Web Usability Principles Usability Evaluations Wendy Liu CSC309F Fall 2007 1 2 What Makes Web Application Development Hard? Target audience can be difficult to define
More informationEvrim GENÇ KUMTEPE, Anadolu University, Turkey
EPORTFOLIO SYSTEM FOR PRESERVICE DISTANCE TEACHER EDUCATION PROGRAM: AN ALTERNATIVE ASSESSMENT STORY FROM BOXES THROUGH ECONTAINERS Evrim GENÇ KUMTEPE, Anadolu University, Turkey Co-authors: Mehmet GÜLTEKİN,
More informationAnalysing the Behaviour of Students in Learning Management Systems with Respect to Learning Styles
Analysing the Behaviour of Students in Learning Management Systems with Respect to Learning Styles Sabine Graf and Kinshuk 1 Vienna University of Technology, Women's Postgraduate College for Internet Technologies,
More informationDOCTOR OF PHILOSOPHY DEGREE. Educational Leadership Doctor of Philosophy Degree Major Course Requirements. EDU721 (3.
DOCTOR OF PHILOSOPHY DEGREE Educational Leadership Doctor of Philosophy Degree Major Course Requirements EDU710 (3.0 credit hours) Ethical and Legal Issues in Education/Leadership This course is an intensive
More informationProgramme Specification: BA Teaching English as a Foreign Language
Programme Specification: BA Teaching English as a Foreign Language 1. Programme title Teaching English as a Foreign Language 2. Awarding institution Middlesex University 3. Teaching institution Middlesex
More informationDesigning an Adaptive Virtual Guide for Web Applications
6th ERCIM Workshop "User Interfaces for All" Long Paper Designing an Adaptive Virtual Guide for Web Applications Luisa Marucci, Fabio Paternò CNUCE-C.N.R. Via V.Alfieri 1, 56010 Ghezzano - Pisa, Italy
More informationOne for All and All in One
One for All and All in One A learner modelling server in a multi-agent platform Isabel Machado 1, Alexandre Martins 2 and Ana Paiva 2 1 INESC, Rua Alves Redol 9, 1000 Lisboa, Portugal 2 IST and INESC,
More informationUSING OPEN STUDENT MODELS IN DISTANCE LEARNING ENVIRONMENTS TO HELP TEACHERS PROVIDE ADAPTIVE TUTORING
24_MAZZA.qxd 3/26/2003 10:59 Pagina 245 SComS: New Media in Education (2003) 245-251 RICCARDO MAZZA 1 * USING OPEN STUDENT MODELS IN DISTANCE LEARNING ENVIRONMENTS TO HELP TEACHERS PROVIDE ADAPTIVE TUTORING
More informationManaging Marketing Information. Chapter 4
Managing Marketing Information Chapter 4 Marketing Info. System Marketing Information System (MIS) Consists of people, equipment, and procedures to gather, sort, analyze, evaluate, and distribute needed,
More informationDeveloping Adaptive Internet Based Courses with the Authoring System NetCoach
Developing Adaptive Internet Based Courses with the Authoring System NetCoach Gerhard Weber, Hans-Christian Kuhl, and Stephan Weibelzahl Pedagogical University Freiburg, Germany [weber,kuhl,weibelza]@ph-freiburg.de
More informationSYSTEMS APPROACH FOR BETTER EDUCATION RESULTS SABER. August 2014. Education Management Information Systems Data Collection Instrument Training Manual
SYSTEMS APPROACH FOR BETTER EDUCATION RESULTS SABER August 2014 Education Management Information Systems Data Collection Instrument Training Manual Contents Introduction... 2 Overview of the SABER... 3
More informationBuilding Online Learning Communities: Factors Supporting Collaborative Knowledge-Building. Joe Wheaton, Associate Professor The Ohio State University
For more resources click here -> Building Online Learning Communities: Factors Supporting Collaborative Knowledge-Building Joe Wheaton, Associate Professor David Stein, Associate Professor Jennifer Calvin,
More informationTHE ROLE OF THE TRAINER IN ONLINE COURSES
THE ROLE OF THE TRAINER IN ONLINE COURSES Ana Augusta Saraiva de Menezes da Silva Dias TecMinho - Associação Universidade Empresa para o Desenvolvimento (Portugal) anadias@tecminho.uminho.pt This article
More informationDOES OUR INITIAL TRAINING PROGRAM FOR PRIMARY TEACHERS REALLY WORK? DESIGN, IMPLEMENTATION AND ANALYSIS OF A QUESTIONNAIRE
DOES OUR INITIAL TRAINING PROGRAM FOR PRIMARY TEACHERS REALLY WORK? DESIGN, IMPLEMENTATION AND ANALYSIS OF A QUESTIONNAIRE María Martínez Chico 1, M. Rut Jiménez Liso 1 and Rafael López-Gay 2 1 University
More informationHow To Teach Chinese Language To Distance Learners
http://www.diva-portal.org Postprint This is the accepted version of a paper published in LMS Lingua. This paper has been peer-reviewed but does not include the final publisher proof-corrections or journal
More informationA QTI editor integrated into the netuniversité web portal using IMS LD
Giacomini Pacurar, E., Trigang, P & Alupoaie, S. (2005). A QTI editor integrated into the netuniversité web portal using IMS LD Journal of Interactive Media in Education 2005(09). [jime.open.ac.uk/2005/09].
More informationM. Luz Celaya Universidad de Barcelona mluzcelaya@ub.edu
María del Pilar García Mayo and María Luisa García Lecumberri, eds. 2003: Age and the Acquisition of English as a Foreign Language. Clevedon: Multilingual Matters. M. Luz Celaya Universidad de Barcelona
More informationSupporting Competence upon DotLRN through Personalization
Supporting Competence upon DotLRN through Personalization Carolina Mejía, Laura Mancera, Sergio Gómez, Silvia Balidiris, Ramón Fabregat University of Girona, Institute of Informatics Applications, 17071
More informationFORMAT OF THE PROPOSAL FOR A THESIS Revised and adapted from Practical Guide to Research Methods by Lang and Heiss.
THESIS PROPOSAL The proposal should describe what you propose to do for your research study. It should include: (a) your name; (b) date submitted; (c) a tentative title; (d) the problem; (e) the purpose
More informationAN ADAPTIVE WEB-BASED INTELLIGENT TUTORING USING MASTERY LEARNING AND LOGISTIC REGRESSION TECHNIQUES
AN ADAPTIVE WEB-BASED INTELLIGENT TUTORING USING MASTERY LEARNING AND LOGISTIC REGRESSION TECHNIQUES 1 KUNYANUTH KULARBPHETTONG 1 Suan Sunandha Rajabhat University, Computer Science Program, Thailand E-mail:
More informationMASSIVE OPEN ONLINE COURSES AN ADAPTIVE LEARNING FRAMEWORK
MASSIVE OPEN ONLINE COURSES AN ADAPTIVE LEARNING FRAMEWORK D.F.O.Onah 1*, J.E. Sinclair 1 1 The University of Warwick (UNITED KINGDOM) ABSTRACT Diverse student needs present a challenge in online education.
More informationCALIDAD TÉCNICA Y PEDAGÓGICA EN EL SERVICIO DE E-LEARNING. Chaminda Chiran Jayasundara (1) University of Colombo, Sri Lanka.
TECHNICAL AND PEDAGOGICAL SERVICE QUALITY OF E-LEARNING: a research framework for the development of a systematic means of identification and adaptation testing CALIDAD TÉCNICA Y PEDAGÓGICA EN EL SERVICIO
More informationModeling Java Interactive E-Learning Virtual Environment
Modeling Java Interactive E-Learning Virtual Environment Majlinda Fetaji 1, Bekim Fetaji 2, Mirlinda Ebibi 3 South East European University, Fax: 044 356 001 {m.fetaji; b.fetaji; m.ebibi}@seeu.edu.mk }
More informationKnowledge Management Challenges in Web-Based Adaptive e-learning Systems
Proceedings of I-KNOW 05 Graz, Austria, June 29 - July 1, 2005 Management Challenges in Web-Based Adaptive e-learning Systems Ekaterina Vasilyeva (University of Jyväskylä, Finland ekvasily@cc.jyu.fi) Mykola
More informationAccess how easy is it for learners to access the technology?
ONLINE LEARNING: towards enabling choice John D Ferguson, George R S Weir & John N Wilson Department of Computer and Information Sciences University of Strathclyde Glasgow, UK Abstract: Education is rapidly
More informationWeb User Search Pattern Analysis for Modeling Query Topic Changes
Web User Search Pattern Analysis for Modeling Query Topic Changes Sheng Han, Ayse Goker, and Daqing He School of Computer and Mathematical Sciences, The Robert Gordon University Aberdeen AB25 1HG, Scotland
More informationDefining an agenda for learning analytics
Defining an agenda for learning analytics Associate Professor Cathy Gunn Faculty of Education The University of Auckland Learning analytics is an emergent field of research in educational technology where
More informationConference Navigator 2.0: Community-Based Recommendation for Academic Conferences
Conference Navigator 2.0: Community-Based Recommendation for Academic Conferences Chirayu Wongchokprasitti chw20@pitt.edu Peter Brusilovsky peterb@pitt.edu Denis Para dap89@pitt.edu ABSTRACT As the sheer
More informationA Framework of Context-Sensitive Visualization for User-Centered Interactive Systems
Proceedings of 10 th International Conference on User Modeling, pp423-427 Edinburgh, UK, July 24-29, 2005. Springer-Verlag Berlin Heidelberg 2005 A Framework of Context-Sensitive Visualization for User-Centered
More informationDevelopment of Website Design Personalization Service Using Design Recommender System
Development of Website Design Personalization Service Using Design Recommender System Jong-Hwan Seo*, Kun-Pyo Lee** *Tongmyung University of Information Technology, Dept of Computer Graphics, 535 Yongdang-dong,
More informationThe Multi-courses Tutoring System Design
The Multi-courses Tutoring System Design Goran Šimić E-mail: gshimic@eunet.yu The Military educational center for signal, computer science and electronic warfare, Veljka Lukića Kurjaka 1, 11000 Belgrade,
More informationStrategic Outcome- Based Metrics for the Federal Government
RG Perspective Strategic Outcome- Based Metrics for the Federal Government 11 Canal Center Plaza Alexandria, VA 22314 HQ 703-548-7006 Fax 703-684-5189 www.robbinsgioia.com 2013 Robbins Gioia, Inc. 1. Introduction
More informationIdentifying Learning Styles in Learning Management Systems by Using Indications from Students Behaviour
Identifying Learning Styles in Learning Management Systems by Using Indications from Students Behaviour Sabine Graf * Kinshuk Tzu-Chien Liu Athabasca University School of Computing and Information Systems,
More informationAN EVALUATION OF THE USEFULNESS OF WEB-BASED LEARNING ENVIRONMENTS The Evaluation Tool into the Portal of Finnish Virtual University
AN EVALUATION OF THE USEFULNESS OF WEB-BASED LEARNING ENVIRONMENTS The Evaluation Tool into the Portal of Finnish Virtual University Abstract Kirsi Silius and Anne-Maritta Tervakari kirsi.silius@tut.fi
More informationHonours Degree (top-up) Computing Abbreviated Programme Specification Containing Both Core + Supplementary Information
Honours Degree (top-up) Computing Abbreviated Programme Specification Containing Both Core + Supplementary Information 1 Awarding Institution / body: Lancaster University 2a Teaching institution: University
More informationCHAPTER. Market Research. Research? Section What Is Your Competitive Advantage?
CHAPTER Market Research Section Research? What Is Market Section What Is Your Competitive Advantage? SECTION What Is Market Research? OBJECTIVES Explain why market research is important Consider important
More informationHOW STUDENTS PERCEIVE E-LEARNING SITUATIONS? THE CASE OF THE SVC WBT EMBRYOLOGY COURSE
HOW STUDENTS PERCEIVE E-LEARNING SITUATIONS? THE CASE OF THE SVC WBT EMBRYOLOGY COURSE Dr. Hervé Platteaux (herve.platteaux@unifr.ch) Centre NTE / University of Fribourg, Rue de Faucigny 2, 1700 Fribourg,
More informationSthephanny Moncada Linares (Universidad La Gran Colombia) Andrea Carolina Díaz Romero 1/17
A Model for Evaluating Spanish Language Learning Websites Coherent with the Communicative Language Approach: Towards the Strengthen of the Teachers' Knowing-Howto-Do Knowledge in Digital Competence Sthephanny
More informationRESULTS OF THE PROYECTO AULA APPLICATION TO ENGINEERING STUDENTS
RESULTS OF THE PROYECTO AULA APPLICATION TO ENGINEERING STUDENTS A. Vidal, J. Reyes, M. Fierro, A. Castellanos Facultad de Ingeniería Región Veracruz, Universidad Veracruzana (MEXICO) avidal@uv.mx, jreyes@uv.mx,
More informationImmediate Elaborated Feedback Personalization in Online Assessment
Immediate Elaborated Feedback Personalization in Online Assessment Ekaterina Vasilyeva 1,2, Paul De Bra 2, and Mykola Pechenizkiy 2 1 Department of Computer Science and Information Systems, University
More informationLessons Learned using CBR for Customer Support
Lessons Learned using CBR for Customer Support William Cheetham General Electric Global Research, 1 Research Circle, Niskayuna, NY 12309 ( cheetham@research.ge.com ) Abstract Three CBR systems were created
More informationDeveloping a Web-based Environment in Supporting Students Team-working and Learning in a Problem-based Learning Approach
Developing a Web-based Environment in Supporting Students Team-working and Learning in a Problem-based Learning Approach Hsiu-Ping Yueh Department of Agricultural Extension, National Taiwan University
More informationAdopting CALL to Promote Listening Skills for EFL Learners in Vietnamese Universities
Adopting CALL to Promote Listening Skills for EFL Learners in Vietnamese Universities Lan Luu Thi Phuong University of Auckland (New Zealand) lluu003@aucklanduni.ac.nz Abstract Listening skills are an
More informationUsing A Learning Management System to Facilitate Program Accreditation
Using A Learning Management System to Facilitate Program Accreditation Harry N. Keeling, Ph.D. Howard University Department of Systems and Computer Science College of Engineering, Architecture and Computer
More informationREGULATIONS FOR THE DEGREE OF MASTER OF SCIENCE IN INFORMATION TECHNOLOGY IN EDUCATION (MSc[ITE])
229 REGULATIONS FOR THE DEGREE OF MASTER OF SCIENCE IN INFORMATION TECHNOLOGY IN EDUCATION (MSc[ITE]) (See also General Regulations) Any publication based on work approved for a higher degree should contain
More informationReuse in Modelling Instructional Design
Reuse in Modelling Instructional Design By Chong Hwee Reei Background In recent years, there have been many advances in learning theories, instructional design and the technologies of development and delivery
More informationWhich competitive advantages can firms really obtain from ISO14001 certification?
Which competitive advantages can firms really obtain from ISO14001 certification? Josefina L. Murillo-Luna; Juan C. Ramón-Solans-Prat University of Zaragoza (SPAIN) jmurillo@unizar.es; steiner@unizar.es
More informationGLOSSARY OF EVALUATION TERMS
Planning and Performance Management Unit Office of the Director of U.S. Foreign Assistance Final Version: March 25, 2009 INTRODUCTION This Glossary of Evaluation and Related Terms was jointly prepared
More informationHow To Teach Online Learning
PROPOSING AN EFFECTIVE TEACHING PEDAGOGICAL MODE FOR ONLINE MBA EDUCATION: AN EXPLORATORY EMPIRICAL INVESTIGATION Wayne Huang and Thom Luce Department of MIS, College of Business, Ohio University, Athens,
More informationChapter 2 Interactive and Collaborative E-Learning Platform with Integrated Social Software and Learning Management System
Chapter 2 Interactive and Collaborative E-Learning Platform with Integrated Social Software and Learning Management System Zhao Du, Xiaolong Fu, Can Zhao, Qifeng Liu and Ting Liu Abstract E-learning featured
More informationNational assessment of foreign languages in Sweden
National assessment of foreign languages in Sweden Gudrun Erickson University of Gothenburg, Sweden Gudrun.Erickson@ped.gu.se This text was originally published in 2004. Revisions and additions were made
More informationAutomated Eclectic Instructional Design: Design factors
Automated Eclectic Instructional Design: Design factors Chien-Sing Lee 1 and Hwee-Reei Chong 2 Faculty of Information Technology Multimedia University Jalan Multimedia, 63100 Cyberjaya, Selangor. Malaysia.
More informationMARKETING RESEARCH AND MARKET INTELLIGENCE (MRM711S) FEEDBACK TUTORIAL LETTER SEMESTER `1 OF 2016. Dear Student
MARKETING RESEARCH AND MARKET INTELLIGENCE (MRM711S) FEEDBACK TUTORIAL LETTER SEMESTER `1 OF 2016 Dear Student Assignment 1 has been marked and this serves as feedback on the assignment. I have included
More informationPROSPECTIVE MIDDLE SCHOOL TEACHERS KNOWLEDGE IN MATHEMATICS AND PEDAGOGY FOR TEACHING - THE CASE OF FRACTION DIVISION
PROSPECTIVE MIDDLE SCHOOL TEACHERS KNOWLEDGE IN MATHEMATICS AND PEDAGOGY FOR TEACHING - THE CASE OF FRACTION DIVISION Yeping Li and Dennie Smith Texas A&M University, U.S.A. In this paper, we investigated
More informationEvolution of Interests in the Learning Context Data Model
Evolution of Interests in the Learning Context Data Model Hendrik Thüs, Mohamed Amine Chatti, Roman Brandt, Ulrik Schroeder Informatik 9 (Learning Technologies), RWTH Aachen University, Aachen, Germany
More informationStrategies to Enhance Learner s Motivation in E-learning Environment
Strategies to Enhance Learner s Motivation in E-learning Environment M. Samir Abou El-Seoud Faculty of Informatics and Computer Science, British University in Egypt (BUE), Cairo, Egypt samir.elseoud@bue.edu.eg
More informationAn Explorative Model for B2B Cloud Service Adoption in Korea - Focusing on IaaS Adoption
, pp.155-164 http://dx.doi.org/10.14257/ijsh.2013.7.5.16 An Explorative Model for B2B Cloud Service Adoption in Korea - Focusing on IaaS Adoption Kwang-Kyu Seo Department of Management Engineering, Sangmyung
More informationMaster of Arts in Instructional Technology Program. Policies and Procedures Manual 2014-2015
Master of Arts in Instructional Technology Program Policies and Procedures Manual 01-015 Master of Arts in Instructional Technology Program School of Education The Richard Stockton College of New Jersey
More informationMETHODOLOGIES FOR STUDIES OF PROGRAM VISUALIZATION
Full paper ABSTRACT METHODOLOGIES FOR STUDIES OF PROGRAM VISUALIZATION Niko Myller & Roman Bednarik Department of Computer Science University of Joensuu PO Box 111, FI-80101 firstname.surname@cs.joensuu.fi
More informationUsability Evaluation Using A Questionnaire Model
An Ontology-Based Approach for Designing Web Usability Evaluation Questionnaires Elena García Barriocanal 1, Miguel A. Sicilia Urbán 2, León A. González Sotos 1, and José R. Hilera González 1 1 Computer
More informationA QTI editor integrated into the netuniversité web portal using IMS LD
A QTI editor integrated into the netuniversité web portal using IMS LD Ecaterina Giacomini Pacurar 1, Philippe Trigano 2, Sorin Alupoaie 3 1 Université de Technologie de Compiègne UMR CNRS 6599 Heudiasyc
More informationSTUDENTS ACCEPTANCE OF A LEARNING MANAGEMENT SYSTEM FOR TEACHING SCIENCES IN SECONDARY EDUCATION
STUDENTS ACCEPTANCE OF A LEARNING MANAGEMENT SYSTEM FOR TEACHING SCIENCES IN SECONDARY EDUCATION Sarantos Psycharis 1, Georgios Chalatzoglidis 2, Michail Kalogiannakis 3 1 Associate Professor, ASPAITE,
More informationA Web-based Intelligent Tutoring System for Computer Programming
A Web-based Intelligent Tutoring System for Computer Programming C.J. Butz, S. Hua, R.B. Maguire Department of Computer Science University of Regina Regina, Saskatchewan, Canada S4S 0A2 Email: {butz, huash111,
More informationManaging Customer Knowledge in the e-business Environment: A Framework and System
Managing Customer Knowledge in the e-business Environment: A Framework and System Jaewoo Jung 1, Woojong Suh 2, Heeseok Lee 2 PriceWaterhouseCoopers 16F Coryo Finance Center Building, 23-6, Youdio, Youngdungpo-Ku,
More informationA study of application of information technology using e-crm in bank in rural area with special reference to SBI Bank, Sangamner
Feb., 2012 Marketing management A study of application of information technology using e-crm in bank in rural area with special reference to SBI Bank, Sangamner Dr. Kirti Gulati (Ass Prof) Institute of
More informationResearch into competency models in arts education
Research into competency models in arts education Paper presented at the BMBF Workshop International Perspectives of Research in Arts Education, Nov. 4 th and 5 th, 2013. Folkert Haanstra, Amsterdam School
More informationPedagogical Criteria for Successful Use of Wikis as Collaborative Writing Tools in Teacher Education
2012 3rd International Conference on e-education, e-business, e-management and e-learning IPEDR vol.27 (2012) (2012) IACSIT Press, Singapore Pedagogical Criteria for Successful Use of Wikis as Collaborative
More informationE-Learning at school level: Challenges and Benefits
E-Learning at school level: Challenges and Benefits Joumana Dargham 1, Dana Saeed 1, and Hamid Mcheik 2 1. University of Balamand, Computer science department Joumana.dargham@balamand.edu.lb, dandoun5@hotmail.com
More informationProgramme Specification and Curriculum Map for MA TESOL
Programme Specification and Curriculum Map for MA TESOL 1. Programme title MA TESOL 2. Awarding institution Middlesex University 3. Teaching institution Middlesex University 4. Programme accredited by
More informationEvaluating online teaching and learning
Evaluating online teaching and learning Martin Oliver University College London, Gower Street, London, WC1E 6BT Tel: +44 20 7679 1905; Fax: +44 20 7679 1715; E-Mail: Martin.Oliver@ucl.ac.uk Abstract. Evaluation
More informationPhases, Activities, and Work Products. Object-Oriented Software Development. Project Management. Requirements Gathering
Object-Oriented Software Development What is Object-Oriented Development Object-Oriented vs. Traditional Development An Object-Oriented Development Framework Phases, Activities, and Work Products Phases,
More informationTraining Executives in MAPFRE
8 number 31 // april 2004 Training Executives in MAPFRE Text prepared from information supplied verbally by Elvira Arango Luque Manager of MAPFRE's International Centre for Executive Training (Centro Internacional
More informationAn Investigation on Learning of College Students and the Current Application Situation of the Web-based Courses
2011 International Conference on Computer Science and Information Technology (ICCSIT 2011) IPCSIT vol. 51 (2012) (2012) IACSIT Press, Singapore DOI: 10.7763/IPCSIT.2012.V51.127 An Investigation on Learning
More informationThe Diffusion of E-Learning Innovations in an Australian Secondary College: Strategies and Tactics for Educational Leaders
The Diffusion of E-Learning Innovations in an Australian Secondary College: Strategies and Tactics for Educational Leaders Sam Jebeile Division of Economic and Financial Studies Macquarie University Australia
More informationegranary EVALUATION PROJECT: Evaluating the Use, Usability, and Usefulness of the egranary Digital Library
egranary EVALUATION PROJECT: Evaluating the Use, Usability, and Usefulness of the egranary Digital Library The WiderNet Project Cliff Missen, MA, Director Thomas Cook, Ph.D. 201 Communications Center The
More informationAn Online Computer Science Workshop for High School Teachers based on Free Google Software Tools
An Online Computer Science Workshop for High School Teachers based on Free Google Software Tools A. Naz and M. Lu West Virginia University Institute of Technology, Montgomery, West Virginia, USA Abstract
More informationCourseVis: Externalising Student Information to Facilitate Instructors in Distance Learning
CourseVis: Externalising Student Information to Facilitate Instructors in Distance Learning Riccardo MAZZA, Vania DIMITROVA + Faculty of communication sciences, University of Lugano, Switzerland + School
More information