Course Evaluation Item Pool These items could be selected for mid-course or end-of-course evaluation. 285 Total Items

Course Evaluation Item Pool These items could be selected for mid-course or end-of-course evaluation. 285 Total Items THIS DOCUMENT IS THE INTELLECTUAL PROPERTY OF SMARTERSERVICES AND MUST NOT BE USED OR REPRODUCED IN ANY FORM WITHOUT THE WRITTEN CONSENT OF SMARTERSERVICES, LLC. CATEGORIES: DEMOGRAPHIC ITEMS 18 Items FACULTY EVALUATION 64 Items COURSE EVALUATION 98 Items PARTICIPATION EVALUATION 39 Items INFORMATION LITERACY / LIBRARY USAGE 10 Items DELIVERY SYSTEM EVALUATION 9 Items OPEN ENDED QUESTIONS - 25 Items EVALUATIVE EXERCISES 12 Items ADMINISTRATIVE EVALUATION 3 Items WRAP UP 6 Items INSTRUCTIONAL OBJECTIVES 1 item DEMOGRAPHIC ITEMS 18 Items Learner Last Name Learner First Name Learner Student Number Learner Email Address Learner Mailing Address Learner City Learner State Learner Zip Learner Phone 1 Learner Phone 2 Course Title Course Number Instructor Last Name Instructor Last Name How many distance learning courses have you taken? One, two, three, four, five or more Course Start Date Course End Date Term INSTRUCTIONAL OBJECTIVES

A good practice in course evaluations is to have questions which directly evaluate the student s perceived achievement of the learning objectives of the course. FACULTY EVALUATION 64 Items The instructor graded fairly. The instructor knew the subject matter well. The instructor provided helpful feedback on my assignments. The instructor was accessible and prompt in grading the assignments I submitted. The instructor was helpful, cordial, and willing to help me achieve the learning results. The instructor actively encouraged participant's input and questions. The instructor fully answered participant's questions. The instructor utilized excercises and/or audio visuals to support course content. The instructor was able to relate the course content to my job. I would take another course from this instructor. The instructor's teaching style was appropriate for an online course. There were positive interactions between the instructor and the students. Success in communicating or explaining subject matter: Poor / Fair / Good / Excellent Degree to which subject matter was made stimulating or relevant: Poor / Fair / Good / Excellent Concern and respect for individuals as students: Poor / Fair / Good / Excellent Administration of class and organization of materials: Poor / Fair / Good / Excellent

Encouragement and management of class interaction: Poor / Fair / Good / Excellent Responsiveness to inquiries outside of class: Poor / Fair / Good / Excellent Overall rating of this instructor: Poor / Fair / Good / Excellent The instructor encouraged students to take responsibility for their own learning. The instructor provided detailed comments on my assignments/projects. I received comments on assignments from my instructor quickly. I learned from the comments made by the instructor on assignments or exams. I felt comfortable telling the instructor of this course when I disagreed with something s/he said. I felt comfortable discussing my personal, academic, professional, or personal goals with the instructor of this course. I felt comfortable discussing with the instructor the comments s/he made on one or more of my assignments, projects, or exams. Related to course material, the instructor was interested in what I had to say. The instructor encouraged students to take advantage of his/her office hours. This course gave me experience working with individuals from diverse backgrounds. The instructor of this course showed respect for all students in the course. The instructor of this course encouraged me to respect points of view different from my own. The instructor of this course encouraged critical thinking. The instructor motivated me to do my best work in the course.

I would recommend a course taught by this instructor to other students. This instructor is conscientious about his/her involvement in the course. This instructor responds respectfully to student questions and viewpoints. This instructor invites criticism of his/her own ideas. It is clear what this instructor considers important. This instructor is receptive to ideas or viewpoints differing from his/her own. This instructor creates an atmosphere where ideas can be exchanged freely and easily. The instructor seems interested in teaching this course. Student questions are encouraged. Questions posed to the instructor are answered clearly and concisely. Students are encouraged to contact the instructor if they are having difficulty. The instructor was available when I needed assistance. This instructor responds to comments in an appropriate manner. This instructor is good at facilitating group discussion. The instructor challenges me to think. This instructor takes into consideration ethnic and cultural differences in teaching this course. This instructor encourages mutual respect among students of diverse backgrounds. This instructor is receptive to questions and discussion concerning multiculturalism and ethnicity.

This instructor is receptive to questions and discussion concerning gender issues. This instructor is receptive to questions and discussion concerning different lifestyles. This instructor is fair and unbiased in the treatment of all students in this course. This instructor teaches from an unbiased racial/ethnic perspective. This instructor treats students fairly regardless of their ethnic or cultural views. This instructor encourages discussion of racial, ethnic, and gender issues in the class. The instructor s direction in this course is free from attitudes and actions demeaning to women. The instructor s direction in this course is free from attitudes and actions demeaning to minorities. The instructor s direction in this course is free from attitudes/actions demeaning to women and minorities. The instructor s direction in this course if free from attitudes and actions demeaning to men. The instructor s direction in this course is free from attitudes/actions demeaning to men and minorities. How did the faculty in this course help or hinder (or generally influence) you? How were the faculty for this course different from other adults you come across? COURSE EVALUATION 98 Items The learning objectives were clear and understandable. The learning experiences helped me attain the desired learning results. The learning experiences were well designed, organized and appropriate.

The content of this course is valuable. Course objectives represent outcomes which I can achieve in the time allotted. The course as a whole was: Excellent / Good / Acceptable / Poor / Very Poor The assignments were a good use of my time and effort. Strongly Agree / Agree / Neutral / Disagree / Strongly Disagree The course met the stated course objectives. Strongly Agree / Agree / Neutral / Disagree / Strongly Disagree This course gave me at least one new skill to use in the workplace. The course content was well organized. The course provided me with skills and information that I can use right now. The course materials enhanced my understanding of this course. This course provided me an opportunity to network with my peers and/or people who have similar jobs. This course gave me some ideas, skills, or techniques that will allow me to do my job better. I would recommend this course to my colleagues. There is continuity from one course unit to the next. The number of students in class was: Too large / About right / Too small I felt comfortable using the technologies in this course. The course activities helped me learn more than I would have by myself. Compared to other courses, understanding the subject matter of this course was: Not difficult at all / Moderately difficult / Extremely difficult

The amount of effort required considering the number of credit hours for this course was: Too low / Reasonable / Excessive How clearly were course objectives defined at start of course? Not clearly at all / somewhat clearly / adequately / very clearly How well were the course objectives accomplished in relation to stated goals? Most goals relating to the course objectives were not accomplished / Actual accomplishment was consistent with the objective / Somewhat more was accomplished than specified by the objectives How clear were the connections between daily class assignments and overall course requirements? Not clear at all / Sometimes apparent / Connections clearly identified from class to class How helpful were the textbook(s) and required study materials for understanding the subject matter? Not helpful / Somewhat helpful / Extremely helpful If applicable, was the method of assessment to be used made clear at the beginning of the course? Yes / No / Not sure Did the assessment help your understanding of the subject? Yes / No / Not sure Now that you have completed the course, would you say that the course content was: Very interesting / Interesting / Not interesting Now that you have completed the course, would you say that the course content was: Too difficult / About right / Not challenging enough Because of the way this course used technology (e.g., computer simulation, internet, multimedia, etc.) I was better able to understand the ideas and concepts that were taught in this course. Because of the way this course was taught I am more likely to apply what I learned to real world problems. Because of the way this course was taught was more likely to work on assignments with other students. Because of the way this course was taught I was more likely to search for answers to my questions on the internet rather than asking the instructor or other students. Because of the way this course was taught I was more likely to discuss ideas and concepts taught in this course with other students. Because of the way this course used emai / discussion boards / chat / instant messagingl,

I was more likely to ask for clarification when I didn't understand. Because of the way this course was taught I was encouraged to exercise my creativity. Because of the way this course was taught I was able to conduct experiments and/or experience situations that I would not have been able to otherwise. The pace of this course is appropriate. This course requires an appropriate amount of work for the credit earned. This course is intellectually stimulating. Prerequisite course work adequately prepared me to handle assignments in this course. Facts and concepts from related fields are presented. I am encouraged to apply new knowledge and skills. I am encouraged to apply knowledge and skills in new situations. I am encouraged to learn on my own. This course emphasizes problem solving. Problem solving rather than solutions is emphasized in this course. Ideas rather than facts are emphasized in this course. I am challenged to do original creative work. Course discussions raised interesting new ideas. Because of the way this course was taught I am better able to remember important facts. I was at a disadvantage in this course because I didn't possess adequate typing skills.

I was at a disadvantage in this course because I didn't possess adequate computer skills. The course helped me to learn to work through a process to solve problems. Because of the way this course used student work groups, I was better able to visualize the ideas and concepts that were taught in this course. Examinations given in the course were representative of the material covered in the course. The objectives for this course were clearly stated. The assignments for this course were clearly stated. The content of the course was presented at an appropriate educational level. Aspects of faith were integrated into the course. Aspects of ethics were integrated into the course. Recent developments in the field are presented. Important points are clarified with good examples. Material is summarized in a manner that helps me learn. Major points are summarized. The grading criteria for this course is clearly defined. Grades are based on a fair weighting of the required course activities. Grading in this course is fair. Grades are an impartial assessment of my performance.

I know what improvement is needed from feedback on tests/assignments. Assignments are clear. Assignments contribute to my learning. Assignments and expectations on work outside class are clear. Assignments are pertinent to topics presented in class. Assigned readings are pertinent to topics presented in class. The assigned readings are helpful to my understanding of the class. Assignments are well spaced throughout the course. Course assignments help me learn on my own. The textbook is helpful for my understanding of the course. Course materials are a helpful guide to key concepts covered during class time. Exams reflect what is emphasized in class. Exams allow me to adequately demonstrate what I have learned. Exams require me to do more than recall facts. Exams cover material on which I expect to be tested. Exams stress my ability to apply knowledge in new situations. Exams require a synthesis of various parts of the course. Adequate time is allowed for exams.

Exams are reasonable in length. Exams are reasonable in difficulty. Test items are adequately explained after an exam. Appropriate steps are taken to prevent cheating. Required course activities involve more than simple recall of facts. Required course activities are important to my learning. Required course activities are consistent with course objectives. Required course activities provide a fair evaluation of my learning. Cheating is a problem on exams in this course. This course has broadened my understanding of people from different cultural and ethnic backgrounds. Select any of the following that you feel was a positive result of taking your course: (you may select more than one box) it helped me satisfy my interest in the subject it helped me meet people and collaborate with others it encouraged me to go on to other courses it helped me fulfill a personal ambition it will help directly/indirectly with my present job it will help me change jobs or gain promotion PARTICIPATION EVALUATION 39 Items Would you recommend this course to others? Yes / Maybe / No I actively participated in scheduled discussions about course material.

I asked for clarification when I didn't understand the material. I was encouraged by the instructor to take responsibility for my own learning. I was very comfortable participating in discussions for this course. I worked on assignments/projects for this course with other students. I discussed and/or commented on other students' assignments/projects for this course. The emphasis on working in groups in this course helped me to understand the ideas and concepts being taught. Assignments in this course were stimulating. Because I found this course intellectually stimulating, I worked on optional assignments/projects. The grade I expect to receive in this course is A / B / C / D / F / I / Other About how much time on average did you spend each week on course related activities? Less than an hour / one hour / two hours / three hours / four hours / five or more hours I had the prerequisite knowledge/experience to complete this course. How many online courses have you taken? This is my first / two / three / four / five or more If this is NOT your FIRST online course, how does it compare to other online courses you have taken. Much better / somewhat better / equivalent / somewhat worse / much worse My critical thinking skills have improved because of this class. My problem solving abilities have improved because of this class. This course has improved my writing skills. This course has improved my ability to read critically.

My ability to critically analyze written material has improved. This course has helped me become more receptive to other points of view. I have learned new ways to think about the issues dealt with in this course. I have learned to understand my strengths and weaknesses in this area. I have learned to see relationships among important topics and ideas. I have had an opportunity to demonstrate my knowledge and/or understanding. I have learned new ways to evaluate problems. I have acquired a basic understanding of the subject area of this course. I have developed a clear understanding of the moral and/or ethical issues in this area. This instructor has helped me develop confidence in my own abilities. I have been motivated to do additional work in this area. I have been motivated to study a topic from this course on my own initiative. I have been motivated to do additional reading in this area. I have been motivated to discuss new ideas outside of class. I have been motivated to do work beyond the minimum requirements. I have been encouraged to think for myself. I have become a more creative and skillful person because of this course. I have developed a greater appreciation for this subject.

Do you feel you have benefited from this course. Greatly / Moderately / Slightly / Not at all Select the reason below which influenced your decision to take this online course. (you may select more than one box) Personal enrichment Required for my degree program To transfer to another school It was convenient for me Financial reasons Other (please describe) INFORMATION LITERACY / LIBRARY USAGE 10 Items Please rate your access to all research/library materials required to complete the course: No materials required / Access was difficult to impossible / I was only able to access some required materials / I could easily access all materials I am able to define my information needs. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree I am able to accurately document (cite) sources of information. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree I am able to plan an effective research strategy. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree I am able to understand how library resources are organized. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree I am able to effectively use Boolean operators for online searching. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree I am able to use controlled vocabulary effectively to find information. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree I am able to critically evaluate the quality of an information source. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree I am able to find information in a variety of formats such as books, journal articles, videos, etc. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree I can differentiate between scholarly and popular sources. 1) Strongly Agree 2) Agree 3) Neutral 4) Disagree 5) Strongly Disagree DELIVERY SYSTEM EVALUATION 9 Items

This online course was easy to navigate and use. 1) Strongly Agree 2) Agree 3) Undecided 4) Disagree 5) Strongly Disagree The layout and structure of this online course were well designed. 1) Strongly Agree 2) Agree 3) Undecided 4) Disagree 5) Strongly Disagree Adequate information and technology support was available to me. 1) Strongly Agree 2) Agree 3) Undecided 4) Disagree 5) Strongly Disagree I spent too much time trying to gain access to a computer/getting on-line. I spent too much time learning how to use the technology (e.g., email, listserve, powerpoint, internet, etc.) The technology (e.g., email, listserve, powerpoint, internet, etc.) used in this course helped me complete assignments, projects on time. Producing web-based materials takes time away from learning ideas and concepts taught in this class. Because of the way this course used multimedia presentations/lectures, the instructor moved too fast through the course material. Technical support was available when needed. OPEN ENDED QUESTIONS - 25 Items What I learned most from this course was What I still need to learn more about is I will be apply to apply the following ideas from the course I will have difficulty in identifying the following ideas from the course The course might have been better if The course work was... On this course there should have been more opportunities for... because... On this course there should have been less... because... Things that shouldn't be changed on this course (because they worked well for me). In what ways do you think it was a well balanced course?

In what ways do you think it was not a well balanced course? How did being in this course help or hinder (or generally influence) you? What sort of person do you think would get most from this kind of course... and why? What sort of person do you think would get least from this kind of course... and why? What do you think you could have done (if anything) to get more out of this course? What do you think you have gained from this course? What might you do in the future to build on what you have gained from this course? What aspects of this course stand out as being most different for you? Were you surprised about the course in any way? If so what surprised you? Were you surprised about yourself in any way? If so what surprised you? What experiences on this course do you think might have most affected your personal and social development? In what ways (if any) do you think this course will have influenced or changed you? How did the experiential/assessment/project/assignment part of the course influence how you approached the rest of the course? Can you think of three ideas (however big or small) that would help to make this a better and more valuable course. If you could turn the clock back to the beginning of the course, what might you choose to do differently? EVALUATIVE EXERCISES 12 Items Draw a life line with this course on it. Predict how you will see this course next week, next month, next year, 10 years time. Write a short summary about this course. Think of five different people you will speak with after this course, and what you will tell them about it. Assess your progress on each course objective. Assess the value of each element of the course (using 'Plus', 'Minus', 'Interesting'). Sum up each week (or other period) in five separate words.

Identify what advice would you give to people taking course - to get most out of it? List what previous experiences of yours were most like this course... and why? Share what you think will you remember most about this course... and why? List the qualities do you think you need to work on these kinds of courses? Write an advertisement for this course. ADMINISTRATIVE EVALUATION 3 Items Course registration procedures: Inadequate / Adequate / Very Good / Excellent / Not Applicable Course fee payment procedures: Inadequate / Adequate / Very Good / Excellent / Not Applicable Problem resolution and support by school staff Inadequate / Adequate / Very Good / Excellent / Not Applicable WRAP UP 6 Items Additional comments regarding the instructor, coursework, online environment or other general observations: My overall feelings about the course are In the future, what other courses would you like to see offered? Overall, how would you compare the value of this course against other graduate level courses you have taken at a distance? Much below average / Somewhat below average / About average / Somewhat above average / Much above average / Not applicable Overall, how would you compare the value of this course against other graduate level courses you have taken in a traditional classroom setting? Much below average / Somewhat below average / About average / Somewhat above average / Much above average / Not applicable My online learning experiences could be made better if

LITERATURE REVIEW If one accepts the premise that the major goal of an educational institution is to promote positive changes in students, then we must look to students for feedback when we are evaluating our efforts to achieve that goal (2). Student evaluation of teachers is probably the most common form of summative teacher evaluation in our colleges and schools of veterinary medicine. Students can provide valid evaluative information in four areas (3): 1. Information about teaching methods --they know what works. 2. Fairness of the faculty member in the evaluation/teaching process--students talk to each other and have a good sense of fairness. 3. Faculty interest in the student. 4. Faculty interest in the content of a course or subject --students like enthusiasm! Others have argued that students are not a good source of teacher evaluations, but many of the objections are not supported by published data (2, 4-7). We suggest here that students are also an excellent source of formative evaluation for improvement of "attitudinal and motivational goals in education" (2). The formative evaluation of faculty by students is more likely to be successful if facilitated by experienced faculty (3). Summative and perhaps formative evaluation of teachers, teaching methods, or courses usually occurs at the end of courses when there is little opportunity for students to see or reap benefits from their comments. Also at this time, teachers cannot immediately implement recommended changes. Formative evaluations should occur earlier while there is time to change (4). What Research Tells Us About Course Evaluations There has been a great deal of debate concerning factors that affect students evaluation of an instructor or a course. Research studies have produced mixed conclusions. Raoul Arreola, in Developing a Comprehensive Faculty Evaluation System (1995), offers the following summary: All this research points out that many commonly held beliefs concerning student ratings are, on the whole, myths or misconceptions. Faculty cannot buy good ratings by giving easy grades. Students do not generally rate faculty lower in classes taught early in the morning or right after lunch. Teaching a small class does not automatically guarantee high student ratings, nor does teaching a large class automatically guarantee low ratings. However, freshman students do tend to rate faculty more harshly than do sophomores, sophomores tend to rate more harshly than juniors, and so on, with graduate students tending to rate faculty most generously. Also, students in required courses tend to rate their instructors more harshly than students in elective courses. It is interesting to note that most large, required courses tend to be offered early in the curriculum of a college. Thus, most of the large required courses may be offered in the freshman and sophomore years, just the time when students tend to rate their teachers most harshly. It would be easy to conclude from personal experience with such courses that the problem lies with the size of the course when, in fact, the research indicates it is the level (freshman, sophomore, etc.) and the fact that the course is required that are the factors which contribute to generally lower student ratings. The important conclusion to be drawn at this point is the necessity to systematically incorporate these findings into the interpretation of student ratings. From http://www.uiowa.edu/~examserv/level_2/evaluations/level_3/level_3- ACE_bulletin.html