Power of IDEA & Campus Labs

Transcription

1

2 Power of IDEA & Campus Labs IDEA STUDENT RATINGS OF INSTRUCTION SYSTEM A research-based system that focuses on student learning on faculty-selected course outcomes CAMPUS LABS COURSE EVALUATION PLATFORM One system that collects and reports data, and brings data together for new insights Better methodology + Better technology = A better strategy for evaluating student learning

3 IDEA Overview The IDEA system provides feedback on student learning and gives suggestions for development IDEA instruments are backed by extensive research Over 35 years of service in higher education Non-profit organization Mission: To provide assessment and feedback systems to improve learning in higher education

4 IDEA Student Ratings of Instruction System (SRI) Used at approximately 400 institutions University of Rhode Island School Craft College Loyola University of Chicago Utah State University Sam Houston State University Howard Community College California State University Fresno Kirkwood Community College Rush University Medical Center Tennessee Tech University Houston Baptist University Howard University Johns Hopkins University Kalamazoo Valley Community College University of Indianapolis Lansing Community College Southeast Missouri State University University of Alabama Birmingham Wichita State University University of South Dakota

5 What Makes the IDEA SRI Unique

6 What makes the IDEA SRI Unique? Focus on Student Learning of Instructor Selected Course Objectives (outcomes) Adjustments for Extraneous Influences Diagnostic Component

7 What makes the IDEA SRI Unique? Validity and Reliability Comparison Data Flexibility 20 additional questions Multiple uses of data

8 IDEA SRI Data can be used for: Faculty Development Accreditation Program Development Faculty Evaluation

9 The IDEA Philosophy What an instructor does (teaching methods) is associated with certain types of student learning (student progress on selected course objectives) under certain circumstances (student and course characteristics)

10 A Key Factor of the IDEA SRI Focus on the instructor s purpose Instructors determine the objectives of the course

11 IDEA Faculty Information Form

12 IDEA Student Rating Form Student Rating Form Faculty Information Form Another Key Factor of the SRI: Focus on student learning Teaching effectiveness is determined by students learning on those objectives stressed by the instructor

13 Items on the SRI Diagnostic Form Consists of 47 Items: 20 Teaching Methods (formative purposes) 12 Learning Objectives (students rate their learning) Summary Items (excellent teacher and excellent course) Course and Student Characteristics (identifying circumstances) Experimental Items (used only for research purposes by IDEA)

14 Another Option: IDEA SRI Short Form May be more appropriate for clinical classes, practicums, etc. No formative piece (data can still be used for administrative purposes) Consists of 18 items: 12 Learning Objectives Summary Measures Student Characteristics 1 Research Item

15 Differences between data collected by form/report Diagnostic Form Report What were students perceptions of the course and their learning? Short Form Report What were students perceptions of the course and their learning? What might I do to improve my teaching?

16 Diagnostic Report

17 SRI Diagnostic Report Summary Information Scores provided two ways: Scores based on a 5-point scale Converted Scores to provide comparisons

18 How did I do compared to others?

19 Adjusted Scores Why do we have adjusted scores? - Level the playing field - Make comparisons more fair How did circumstances affect my scores? Adjustments for student motivation, work habits, class size, effort, and course difficulty (Diagnostic form) Adjustments for student motivation and work habits (Short form)

20 What were the circumstances?

21 Student Learning Details

22 Formative View

23 Formative View POD-IDEA Notes Background Helpful Hints Applications for Online Learning Assessment Issues References and Resources

24 POD-IDEA Notes IDEA Website

25 IDEA Papers Resources for Faculty Evaluation Faculty Development

26 Statistical Detail

27 How We Can Help

28 YOUR CONSULTANT IS HERE TO HELP One on One consulting services Free webinar introduction and training for Faculty Extensive resources Free assistance with report interpretation

29 IMPROVING COURSE EVALUATION PROCESSES AT FERRIS STATE UNIVERSITY ROBERTA C. TEAHEN, PH.D.

30 Objectives Centralize administration and processing in Academic Affairs. Enhance the flexibility including timing, addition of questions, and various tools. Protect the anonymity of student respondents. Assure the integrity of the process. Maintain historic and comparative records for varied reporting purposes, including accreditation.

31 From the Academic Senate Recommendations* Moving to online has multiple positives, reduced cost, increased confidentiality, reduced consumption of class time, rapid turnaround time, capacity for providing timely formative feedback

32 Realized Benefits to Electronic System Reduced support /administrative staff time commitment Expanded access for students to provide their feedback (as they can still complete if they miss the one class where evaluations are distributed) Improved anonymity for students Timelier feedback for evaluations use in improvement efforts formative feedback

33 Realized Benefits (continued) Aggregated institutional data for benchmarking improvements over time and identifying improvement opportunities Capacity to produce evidence for accreditation at multiple levels (program, college, institution) Ability to add questions to all forms and to utilize multiple forms in same platform.

34 Questions? If you have questions or to schedule a demo, contact us at or info@ideaedu.org