Kent State University Educational Specialist Program in School Psychology Intern Products Evaluation Rubric. Intern: Date:

Transcription

1 Kent State University Educational Specialist Program in School Psychology Intern Products Evaluation Rubric Intern: Date: Assessment Services, Reflected in Evaluation Team Report History/background Absent or incomplete Adequate Extensive Current educational performance Missing or inadequate Sufficient Extensive/data-based Previous interventions Missing or inadequate Anecdotal/descriptive Extensive/data-based Observation data Missing or inadequate Anecdotal/descriptive Selection and use of assessments Inappropriate or incomplete Meets requirements (measures current and sufficient to answer referral questions) Behavioral data that are summarized and interpreted Exceeds requirements (measures current and chosen to thoroughly explore referral questions and/or differential diagnosis) Summary and interpretation of results Inadequate diagnostic conclusions and conceptualization Adequate diagnostic conclusions and conceptualization Well-developed and supported diagnostic conclusions and conceptualization Disability determination Fails to address required areas Addresses required areas Clear, complete, and concise summary Recommendations Absent or incomplete Specific and practical recommendations based on data developed from assessment Specific, practical, researchbased recommendations based on assessment data Instructional implications Absent or incomplete Sufficient Extensive and research-based

2 Individual or Group Counseling Service Counseling focus/goals Absent or poorly defined Adequate Thoroughly summarized Counseling theory/approach Missing or inadequate Anecdotal/descriptive Extensive/data-based Methods and strategies No evidence that strategies are based on sound theory and research Some evidence that strategies are based on sound theory and research Extensive evidence that strategies are based on sound theory and research Progress notes/records Absent or incomplete Adequate progress notes Comprehensive progress notes Progress monitoring Absent or incomplete evidence of progress monitoring Evidence of adequate progress monitoring Outcomes are evaluated through ongoing multiple data collection Use of progress data to inform counseling No evidence counseling was informed by progress monitoring data Some evidence that counseling was informed by progress monitoring data Extensive evidence that counseling was informed by progress monitoring data Outcome Cannot be determined, or intervention is unsuccessful and the outcome is inadequately explained Intervention is successful or, if unsuccessful, the outcome is adequately explained Intervention is successful or, if unsuccessful, the outcome is adequately explained and a plan for further intervention is included 2

3 Intervention/Consultation Services Definition of problem Absent or vague General description of problem Problem defined in measurable, observable, behavioral terms Baseline Absent or incomplete Some baseline data Multiple samples of direct measures of behavior Goal Absent or unrelated to problem Adequate goal statement Goal and criterion (how much, by when) included Problem analysis Absent or incomplete Evidence of some analysis of reasons for problem Evidence of thorough analysis of reasons for problem Intervention plan Absent or incomplete Adequate intervention plan Systematic and comprehensive intervention plan Intervention approach Intervention is not research based, is unrelated to problem analysis, or is impractical and difficult to implement Intervention is research based and relates to problem analysis Intervention is practical and easy to implement, is research based and relates to problem analysis Progress monitoring Absent or incomplete data Adequate progress monitoring data Extensive progress monitoring data that are summarized and interpreted Treatment integrity Absent or incomplete data Some treatment integrity data Adequate treatment integrity data that are summarized and interpreted Evaluation Absent or vague evaluation of intervention Intervention is evaluated by data collection Intervention is evaluated by time series, graphic data, and results are explained 3

4 Training for Parents Needs assessment Absent or inadequate Adequate needs assessment Multiple or creative sources of needs assessment Training objective(s) Objectives unclear and/or unrelated to needs assessment Training objectives related to needs assessment Training objectives clearly articulated and related to needs assessment Promotional materials/recruitment strategy Absent or poor quality promotional materials Adequate promotional materials or other recruitment strategy Creative/high quality promotional materials or other recruitment strategy Lesson plans Lesson plans unrelated to Lesson plans generally related to Lesson plans clearly related to Training techniques/strategy Poorly suited to adult learners/other audience characteristics Adequate for adult learners/other audience characteristics Well-suited to adult learners/other audience characteristics Handout material Handout materials missing or poorly done Handout materials adequate Creative and/or well-developed handout materials Evaluation Absent or poor quality evaluation Adequate evaluation of program outcome Positive evaluation of program outcome and analysis for future training 4

5 Accountability Method/Summary of Results Method Absence of data-based Accountability measure is databased Accountability measure focuses accountability measure on outcomes rather than inputs Measure Source of data Summary of results Insufficiently samples relevant activities or competencies Insufficient number and types of respondents Absent or poor quality summary of results Adequately samples relevant activities or competencies Sufficient number and types of respondents Adequate summary and interpretation of results Comprehensively samples relevant activities or competencies Comprehensive number and types of respondents Positive evaluation and evidence of use for continuous improvement Summary s: Type of Service Assessment Services, Reflected in Evaluation Team Report Individual or Group Counseling Service Intervention/Consultation Services Training for Parents Accountability Method/Summary of Results Global Comments: 5