What Do You Think? for Instructors

Transcription

1 Accessing course reports and analysis views What Do You Think? for Instructors Introduction As an instructor, you can use the What Do You Think? Course Evaluation System to see student course evaluation results for the courses you taught. Specifically, you can perform these tasks for your courses: Accessing course reports and analysis views Viewing the teaching ratings summary Viewing student comments Viewing the evaluation responses of individual students (students are anonymous) Creating and accessing surveys If authorized to do so, you can also create and edit evaluation questions for your courses and select questions from the Question Bank (if your institution is using the Question Bank option). See Creating and editing evaluation questions for your courses. Note Because the look of What Do You Think? is customized for your school, your pages will look a little different than the pages shown in this document. In addition, you may not have access to all the functions and reports described. Logging out You can log out of the system at any time by clicking Log Out at the top right of the page. The system automatically logs you out after 20 minutes of inactivity. Accessing course reports and analysis views When you log into What Do You Think? the My Courses page is displayed as shown below. This page provides two tab options: Course Reports Analysis Accessing Course Reports To access course reports for the courses you taught, click the Course Reports tab. Open evaluation terms and the courses you taught in each are listed with the following for each course: Response rate percentage Number of students who have submitted evaluations to date out of the total number of potential evaluators 2015 CollegeNET, Inc. 3

2 Accessing course reports and analysis views The date and time evaluation reports will be available An link to send an reminder to students who haven t submitted a course evaluation, for courses with less than a 100% response rate (if available for your institution) Closed evaluation terms and the courses you taught in each are listed with the following for each course: Response rate percentage Number of students who submitted evaluations out of the total number of potential evaluators Links to course reports Ratings, Comments, Responses (if available) Click to batch download evaluation reports Open evaluation terms Click to send reminder Closed evaluation terms 2015 CollegeNET, Inc. 4

3 Accessing course reports and analysis views To do this Do this... for open evaluation terms... Send an reminder to students who haven t submitted their evaluation for a course (if available for your institution) 1 Click the envelope icon in the Reminder column of the course. 2 Enter From, Subject, and Body just as you would in any other system. You can insert data field variables into the body of your message if you want to. Simply position your cursor where you want the data field in the message and click the data field label on the right. course.name inserts the name of the course. end.date inserts the evaluation term end date. user.firstname inserts the first name of the student. user.lastname inserts the last name of the student. In addition to the text you enter here, the message will also have appended student anonymity disclaimer text that has been created for your institution. 3 Click Send. for closed evaluation terms... Batch download evaluation reports for selected courses 1 Check the box of each course with an evaluation reports for download. 2 Click the Create Batch File link above the term and course list to open the Batch Download window. 3 Click the report type(s) you want to download. 4 Select whether you want to download the reports as a single PDF or.zip file. 5 Click Process Batch. 6 When the process completes, click Download Now! then open or save the file CollegeNET, Inc. 5

4 Accessing course reports and analysis views To do this Do this... for closed evaluation terms... View your teaching ratings summary outline Download your teaching ratings summary as a PDF or Excel file View your rating comments online Download your rating comments as a PDF View individual responses online Download all individual responses as a PDF Click View in the Ratings column. Then go to Viewing the teaching ratings summary Click the PDF or Excel icon in the Ratings column. Click View in the Comments column. Then go to Viewing student comments Click the PDF icon in the Comments column. Click View in the Responses column. Then go to Viewing the evaluation responses of individual students Click the PDF icon in the Responses column. Analysis views The Analysis tab provides three ways to view your evaluation scores and compare them to department averages Summary and Question. The Analysis Summary view To access the Analysis Summary view, click the Analysis tab and select Summary CollegeNET, Inc. 6

5 Accessing course reports and analysis views For each closed evaluation term, the Analysis Summary view displays a bar graph of the average of all evaluation scores for all your courses with a superimposed line graph of the average evaluation score for all courses in your department. You can roll over a bar to get the exact average evaluation score. Click to display Course Mean Distribution Chart for term From here, you can click a bar to display a Course Mean Distribution chart that shows the frequency percentage of the mean (average) score for your department for the evaluation term. You can sort the scores from highest to lowest by checking the Sort values box in the upper right. Check to sort values The Analysis Question view To access the Analysis Question view, click the Analysis tab and select Question. For each closed evaluation term, the Analysis Question view displays: A select list of evaluation questions An average score ranking by question as compared to your department s average score 2015 CollegeNET, Inc. 7

6 Accessing course reports and analysis views An average score difference for the selected question, comparing your average score with the average score of your department A heat map of your average score for each question compared to your department s average score The page is designed to show you at a glance how your scores for each evaluation question compare to those of your department. Click a question in the select list to highlight it in the Overall Question Ranking and display it in the Question Difference chart. Click a question to highlight it here and update this chart Overall Question Ranking Overall Question Ranking is a bar graph displaying for each question the difference between the average response score for your evaluations and the average response score for your department s evaluations, sorted highest (more green) to lowest (more red). In the example above, the instructor s average score for question 8 (Q8) is highest relative to the department, and question 4 (Q4) is the lowest CollegeNET, Inc. 8

7 Accessing course reports and analysis views You can hover over any question bar to see your average score s exact variation from the department average. Question Difference The Question Difference chart displays for each evaluation term your average score for the selected question as a line and your department s average score for the selected question as an area. Green areas indicate that your average score was higher than the department average; red areas indicate that it was lower. In the example above, the instructor s average score for question 10 (Q10) is higher than the department s average score for the same question. Course Question Heat Map Over Terms The Course Question Heat Map Over Terms chart is a heat map graph of your average score value for each question for all available terms as compared to the average score value for your department. Data blocks that are more green indicate your average score was higher than the department average score for the selected question; data blocks that are more red indicate your average score was lower than the department average score for the selected question. You can hover over any data block to see your average score and your department s. You can click on a data block to go to the Ratings Summary page for the course. See Viewing the teaching ratings summary CollegeNET, Inc. 9

8 Accessing course reports and analysis views Hover over question bar to see variation of your average score from department s here, and to update the Question Difference chart Hover over question data block to see your average score and that of your department, and to update the Question Difference chart 2015 CollegeNET, Inc. 10

9 Viewing the teaching ratings summary Viewing the teaching ratings summary The Ratings Summary page shows a summary of the ratings you received from your students in a particular course in each of several Elements of Instruction categories, and allows you to drill down in the interactive bar chart to see rating information for each category. You can also generate a PDF or Excel version of the ratings information. The information you see on this page is customized for your school based on your evaluation questions. Instructor, subject, and catalog information Course title, total course enrollment, and how many students evaluated the course Click the category to see details Chart of ratings in selected category Overall ratings in all categories Table of ratings in selected category Demographic information about the students who evaluated the course (if available/allowed to view) Accessing the Ratings Summary page From the My Courses page, click the View link under Ratings for one of your courses in a closed evaluation term. From any Evaluation Summary page, click Ratings Summary in the drop-down box at the top of the page CollegeNET, Inc. 11

10 Viewing student comments Using the Ratings Summary page To... See performance ratings for a single category Generate a PDF of the current view Generate an Excel file of the current view Go to the Comment Summary page Go to the Individual Responses page Do this... Click that bar on the chart. Click View as PDF at the top of the page. Click Export as Excel at the top of the page. Click Comment Summary at the top of the page. Then see, Viewing student comments. Click Individual Responses at the top of the page. Then see, Viewing the evaluation responses of individual students. Viewing student comments The Comments Summary page shows the comments made by students who evaluated a particular course you taught. The information you see on your comments page is customized for your school based on your evaluation questions. Instructor, subject, and catalog information Course title, total course enrollment, and how many students evaluated the course Click to select question Click to see entire evaluation Click filter options Comments of student evaluators for selected question 2015 CollegeNET, Inc. 12

11 Viewing the evaluation responses of individual students Accessing the Comment Summary page From the My Courses page, click View under Comments for one of your courses in a closed evaluation term. From any Evaluation Summary page, click Comment Summary at the top of the page. Using the Comment Summary page To... Select the comments question you want to see responses to Filter the information displayed See the entire evaluation that contained a particular comment Go to the Ratings Summary page Go to the Individual Responses page Do this... In the View Question section, click the number of the question. In the Filter Responses part of the page, check and uncheck boxes to toggle the display on or off for the corresponding responses. Click the number link of the comment. Click Ratings Summary in the drop-down box at the top of the page. Then see, Viewing the teaching ratings summary. Click Individual Responses in the drop-down box at the top of the page. Then see, Viewing the evaluation responses of individual students. Viewing the evaluation responses of individual students The Individual Responses page shows the evaluation responses of individual students for each of the courses you taught. This data is completely anonymous. The information you see on the individual response page is customized for your school based on your evaluation questions CollegeNET, Inc. 13

12 Viewing the evaluation responses of individual students Instructor, subject, and catalog information Course title, total course enrollment, and how many students evaluated the course Demographic information about the student evaluator (if allowed) Student s evaluation answers Accessing the Individual Responses page From the My Courses page, click View under Responses for one of your courses. From any Evaluation Summary page, click Individual Responses at the top of the page CollegeNET, Inc. 14

13 Creating and accessing surveys Using the Individual Responses page To... Go to the evaluation responses of the next student evaluator Go to the evaluation responses of the previous student evaluator Generate a PDF version of the information on the page Generate a PDF summary report for all evaluation responses Go to the Ratings Summary page Go to the Comment Summary page Do this... Click Next Respondent at the top or bottom of the page. Click Previous Respondent at the top or bottom of the page. Click View as PDF at the top of the page. Click Bulk PDF Download at the top of the page. Click Ratings Summary in the drop-down box at the top of the page. Then see, Viewing the teaching ratings summary. Click Comment Summary at the top of the page. Then see, Viewing student comments. Creating and accessing surveys Note If your institution does not permit instructors to work with surveys, the ability to create or access surveys will not be available CollegeNET, Inc. 15

14 Creating and accessing surveys You can use the What Do You Think? Survey tool to create, edit, and distribute surveys on any subject you create, such as mid-term opinions, reasons for dropping a class, or a facilities analysis. When ready, you can invite individual participants to take the survey and to see the survey results. Previously created surveys Create a new Surveys Delete, clone (copy) and archive surveys Task Icons The following icons can be found beneath the Tasks heading on the My Surveys page, and can be used as shortcuts. Delete existing survey Clone (copy) existing survey Archive existing survey 2015 CollegeNET, Inc. 16

15 Creating and accessing surveys Creating a Survey 1 Choose Survey from the What Do You Think? menu bar. 2 Click Create Survey. 3 Enter a Survey Title. Enter a Survey Title 4 Click Create. Survey Settings 1 Click Settings. Perform the following. a b c d Title - This field contains the name you initially gave the survey. You can change the name for the Settings, but it does not change the name of the survey. Survey Period - Select Always to make the survey s availability open-ended. Select Date Range to make its accessible between start/end dates. If you select Between, use the calendar field to provide the survey accessibility dates. Survey Availability - Select Public to allow anyone to participate in the survey. Select By Invitation to limit participants to those that you invite. Message on finish - By default Survey completed. Thank you displays when a survey is completed. To change that message, enter the new text here CollegeNET, Inc. 17

16 Creating and accessing surveys Survey name Survey availability options Survey participant options Survey participant completion message Creating Categories and Questions Surveys are composed of categories containing questions. Both categories and questions will be supplied by you, so be sure that they meet your needs. 1 Click the Add Category button. Enter a category title, such as Facilities Survey or Environmental Survey. 2 Enter a description of the survey, such as why it was created or its intent. 3 Enter a category abbreviation. The abbreviation is shown only on survey reports. Adjust Survey Settings Enter a Category Title Enter a Category Description Enter a Category Abbreviation a Click Save Settings CollegeNET, Inc. 18

17 Creating and accessing surveys 4 Click Add Question to produce a first question for the category. A category can contain an unlimited number of questions. Questions are added to a category one at a time and can be formatted as three distinct types. Note Depending upon the question type selected from these following, the options and fields change for question creation. Quantitative - Participant provides an integer-based answer from a sliding scale Select - Participant chooses from answers you provide Multi-select - Participant chooses from several possible answers that you provide Written (Short) - Participant enters a short written answer of their own Written (Long) - Participant enters a longer written answer of their own Video - Participant uploads video answers Enter a Question Enter a Question Abbreviation Enter a Question Type Define Answers, if applicable Note As you enter Category questions, you ll see they are bordered by a dotted line containing an up/down arrow in the top left corner, and an X in the top right corner. The arrows can be clicked to move or drag questions to suit the order you need in the survey. Click the X to delete the question. 5 Click Save to add the question to the survey. 6 Click Add Question to create more questions, or click Add Category to create more categories and question(s). Survey Availability Once a survey is created and ready for participants, the next step is to make it available. This can be managed from a survey, or from the list of surveys, through announcements CollegeNET, Inc. 19

18 Creating and accessing surveys Surveys can be distributed to participants or made available via invitation. When a survey is distributed, an announcement can be created, or copied and edited, to go with the distribution . Distribute from a survey 1 From My Surveys, select a survey to distribute and click the edit icon. 2 Click the Distribute icon. 3 Click the Survey Link sub-tab. 4 Copy the survey's anonymous url. Post the link to s, social media, or web sites. Invite participants from a survey 1 From My Surveys, select a survey in creation or edit mode. 2 Click the Invite tab. 3 Click the Actions button on the right of the screen to display a drop-down list. 4 Select one of the following. a b c Add Participants. Enter the , first name and last name of participants to invite, then click Add. Click the Close button when you are ready to continue. Upload Participants. Browse and select a properly formatted Excel file of participants, then click Open. Course Students. Click this option and select the names of students to invite to participate in the survey. Invite participants from the list of surveys 1 From My Surveys, select a survey to invite participants to view. 2 Click the Invite icon beneath the Tasks heading. 3 Click the Actions button on the right of the screen to display a drop-down list. 4 Select one of the following. a b c Add Participants. Enter the , first name and last name of participants to invite, then click Add. Upload Participants. Browse and select a properly formatted Excel file of participants, then click Open. Course Students. Click this option and select the names of students to invite to participate in the survey. 5 Copy the survey's anonymous url. Post the link to s, social media, or web sites CollegeNET, Inc. 20

19 Creating and accessing surveys Grant Survey Access A survey owner can grant survey access for others, such as other instructors or assistants, and give them the ability to: Edit a survey s questions, settings, and who can access it. Invite participants to take the survey or see the public URL View survey results. To edit or update survey access for an existing user 1 From My Surveys, click the survey to add access to. 2 Click the Access tab 3 Click the Add Access button. 4 Enter the address of an existing user, such as an instructor or administrator, into the field. 5 Select the user s access status in the three boxes. More than one can be selected. 6 Click the Save button. To add an unregistered user for survey access 1 Click the link in the If the user is not registered, you can add them here line. 2 Enter the following information in the corresponding text fields: ID First Name Middle Name Last Name address Type 3 Click the Save button. To change any of the user s registration information, click the Edit button. Set the user s permissions and click the Save button. More information about user permissions can be found in the Creating and editing academic administrators topic. Creating Survey Announcements This section shows how to use an existing or to create a survey announcement to send with a survey CollegeNET, Inc. 21

20 Creating and accessing surveys 1 Go to a survey in creation or edit mode. 2 Click the Distribute tab above the survey. 3 Click the Survey Link sub-tab. This tab contains the survey's anonymous url link. The url can be copied and posted to s, social media, or web sites. 4 To find and use an existing announcement to go with survey distribution, click the Announcements tab and select an announcement. 5 To create a new or edit an existing announcement, click the Edit Announcement tab. a b c d e f g h Select the announcement Type (Start, Reminder, Thank You) to go with the survey. Start - The announcement is the first announcement sent for survey completion. Reminder - The announcement is a second or later reminder announcement for survey completion. Thank You - The recipient has completed the survey. This occurs automatically upon survey completion. Use the When field calendar to schedule the date and time to send the announcement. From indicates the sender of the survey announcement. It may be pre-populated with an address. The Subject field is where you enter a survey name. Load Message From allows you enter any addresses that had been previously entered into this field. Data Fields contains properties that can be entered into the announcement. The properties include the following. survey.anonymous.url survey.individual.url survey.title user.firstname user.lastname Use the icons on the formatting toolbar to customize the announcement. You can copy, paste, utilize preset text formats, as well as add numbers, bullets, images (see below), lines, links, and indentations. Click Source to view the announcement as HTML. 6 Click Preview/Send Test to set up a test sent to you. 7 Click Schedule once the announcement is complete and ready to send, as scheduled in step 5b CollegeNET, Inc. 22

21 Creating and accessing surveys Adding images to an announcement 1 Click Image on the toolbar and open the Image Properties box. 2 On the Image Info tab, enter the URL containing the image to display in the announcement. 3 If there is a need for text to display when the mouse hovers over the image, enter it in the Alternate Tex field. 4 In pixels, enter the image s desired width, height, border size, horizontal space from text, and vertical space from text. 5 Set the image s alignment at left or right. Examine the image and its placement in the Preview box, and when ready click the OK button. Viewing Survey Results Once a survey becomes available and participants begin to take it, results will become available. Results can be viewed from a survey, or from the list of surveys. To view results from a survey 1 From My Surveys, select an existing survey and click the Edit icon. 2 Click the Results tab above the survey. 3 View the survey results. To view results from the list of surveys 1 From My Surveys, select a survey to access its results. 2 Click the Results icon beneath the Tasks heading. 3 View the survey results. Editing surveys Note Any question can be made required while editing it. This is managed by adding Required as a Validation rule during the question editing process. Responders cannot submit a survey until they have responded to all questions designated as required. To edit a survey, complete the following steps. 1 From My Surveys, select a survey to edit and click the edit icon beneath the Tasks heading. 2 Make all needed survey edits CollegeNET, Inc. 23

22 Creating and editing evaluation questions for your courses 3 Click the OK button when asked to verify your edits. Deleting surveys To delete a survey, complete the following steps. 1 From My Surveys, select a survey to delete and click the delete icon beneath the Tasks heading. 2 Click the OK button when asked to verify deletion. Creating and editing evaluation questions for your courses If authorized to do so, you can use What Do You Think? to add and edit evaluation questions specifically for the courses you teach, independent of any general evaluation questions that have been set up by your System Administrator for your institution and/or for specific schools, departments, course types, and so on. If your institution is using the Question Bank feature, you can also add questions from it. If you re authorized to add and edit questions (and possibly use the Question Bank), My Questions appears as a top level item. You can only add and edit questions for future evaluation terms. Adding evaluation questions for your courses 1 Click My Questions to go to the My Questions page. 2 Choose the future term and course for which you want to create questions. By default, the system displays course information for the current term. 3 Click Show Questions CollegeNET, Inc. 24

23 Creating and editing evaluation questions for your courses The evaluation questions for the course are displayed, below which is an Instructor s Questions section CollegeNET, Inc. 25

24 Creating and editing evaluation questions for your courses 4 Click Add New Question. 5 Enter the question text. 6 If you want this question added to the evaluations of all your courses for the selected evaluation term, not just this course, check that box. 7 Enter an abbreviation for the question. Note The abbreviation is displayed in some reports. 8 Select a question type. The question types you can select from have been set up during What Do You Think? implementation. 9 Do one of the following based on the question type you selected: If you selected this question type... Quantitative Select Written Do this... Select the quantitative answer type you want for the question, if you have the option to do so. Quantitative answer types were set up by your System Administrator during What Do You Think? implementation. You may not have the option to choose an answer type. Enter answer values (abbreviations) and labels (what appear in the question s Select list). Nothing no further action is required. 10 Click Create. 11 Repeat steps 4-10 to add more questions CollegeNET, Inc. 26

25 Creating and editing evaluation questions for your courses Adding questions from the Question Bank 1 Click My Questions to go to the My Questions page. 2 Click Search Question Bank to open the Search Question Bank window. If your institution hasn t elected to use the Question Bank feature, this button doesn t appear. 3 Filter the questions by entering one or more characters of the word(s) you want to filter on (optional). 4 Scroll through the questions to find the one you want, then click its Add button. The question is added on the My Questions page in a separate section. 5 Repeat steps 2-4 to add other questions from the Question Bank. Note You can remove questions you ve added from the Question Bank by clicking Remove These Questions in the appropriate section of the My Questions page, then clicking OK to confirm CollegeNET, Inc. 27

26 Creating and editing evaluation questions for your courses Editing the text and/or abbreviation of a question 1 Choose Edit Question from the actions menu to the right of the question. 2 Edit the question text and abbreviation as needed. 3 Click Save. Changing the presentation order of a question Choose Move Up from the actions menu to the right of the question until the question is where you want it in the presentation order. Other questions are moved down accordingly. Deleting a question 1 Choose Delete Question from the actions menu to the right of the question. 2 Click OK to confirm. WDYT CollegeNET, Inc. 28