General Approaches to evaluating student learning Qatar University, 2010 1 N U H A D Y A Z B I K D U M I T, R N, M A, P H D A M E R I C A N U N I V E R S I T Y O F B E I R U T
Evaluation Types: Levels and Uses 2 Use Formative Individual Evaluation of an individual learner or faculty member that is used to help individual improve performance: Identification of areas for improvement Specific suggestions for improvement.
3 Use Formative Program Evaluation of a program that is used to improve program performance: Identification of areas for improvement Specific suggestions for improvement.
4 Use Summative Individual Evaluation of an individual learner or faculty member that is used for judgments or decisions about the individual Verification of achievement for individual Motivation of individual to maintain or improve performance Certification of performance Grades Promotion
Use Summative Program 5 Evaluation of a program that is used for judgments or decisions about the program or program developers. Judgments regarding success, efficacy. Decisions regarding allocation of resources. Motivation/recruitment of learners and faculty Influencing attitudes regarding value of curriculum. Satisfying external requirements. Prestige, power, influence, promotion. Dissemination: presentation, publications
Specific Uses 6 Feedback on an improvement of individual performance Judgments regarding individual performance Feedback on and improvement of program performance
Specific Uses (cont d) 7 Judgments regarding program success Justification for the allocation of resources Motivation and recruitment Attitude change Demonstration of popularity Prestige, power, promotion, and influence Presentation, publications, and adoption of curricular components by others
Four Levels of Evaluation 8 attitudes, reactions and feelings learning (perceptions or knowledge) skills (applying learning to practice) effectiveness (improved performance)
Tools for Measuring Learning Outcomes 9 Writing skills Essay questions; term papers; take home exams Team work Ethical reasoning Lifelong learning Group projects Case study analysis Attendance of public lectures; Working with faculty on projects
Student Evaluation: Theory 10 Examinations, quizzes. Term papers. Group projects. Class participation. Oral presentations. Course assignments.
Student Evaluation: Lab/Field Work 11 Anecdotes; Critical incidents Conferences. Simulations: Case studies; Practice Exams. Written assignments: reports, lab/field logs, reflective writing, field notes, teaching plan. Checklists. Practice evaluation tools for summative evaluation.
Evaluation methods lab/field 12 Observation: Two components: Behaviors observed (data) Observer s interpretation Difficulties of method: Teacher variables (influence interpretation) Focus of observation (if exact behaviors not stated) Behaviors sampled may not be representative of student usual performance
Important for Evaluation 13 Clearly defined objectives/outcomes Clearly defined evaluation criteria Wording such as... Includes complete and accurate data in terms of... Reflects congruency among data, problem statement, plan, intervention Provides evidence of... perception of events... Addresses evaluation outcomes in terms of goals,... Presents case in a scholarly document....
14 Domain Learning Outcomes Teaching Strategies Cognitive comprehension Alignment Learning Outcomes, Teaching Strategies, & Assessment Tools Describe the relevance and importance of different biological processes to our daily life. Lecture Discussion (analysis of implications ) Use of examples Assessment Tools (assignments) Class participation Exams presentation Short Paper??? Cognitive?????????? Solve genetic problems????????? Genetic exercise????? Write well-documented explanatory and argumentative research syntheses, using information from a broad range of sources.?????????????????
Alignment: NURS Course Domain Learning Outcomes Teaching 15 Strategies Assessment Tools (assignments) Cognitive Application & Psychomotor Mechanism Utilize concepts from leadership and management theories and the nursing process in the care of clients in various health care settings. Discussion Clinical instruction CET Clinical project Cognitive Application Affective Organization Employ effective communication within the organizational culture. Clinical training: assume specific roles and responsibilities: Nurse Manager/Leader. Primary Nurse/Modular Nurse Auditor/Monitor. Nurse Educator CET: Documentation, observation of with staff Staff teaching Patient teaching Clinical project Cognitive Synthesis & evaluation Use critical thinking in problem solving, decisionmaking and conflict resolution during the management of nursing situations. Clinical instruction Clinical training assume specific roles and responsibilities: Nurse Manager/Leader. Primary Nurse/Modular Nurse Auditor/Monitor. Nurse Educator CET Clinical project