Class Climate Sample Report Package

Transcription

1 Class Climate Reporting: PDF/A Compliant for long-term storage (save paper, no printing required) Level 1: Instant Feedback Level 2: Data Exploring Level 3: Advanced Comparisons Level 4: Organization and Department Reports Level 5: Quality Management Dashboard View Level 6: In-Depth Analysis Customization: Professional Services Class Climate Sample Report Package Level 1: Instant Feedback / Automated Instructor Report: Official Document Components can be removed and settings changes to alter the displayed data dynamically o Report Header settings, Font, Styles, Graphs, Logo Alignment, Language, Margins, etc... Show/Hide Norming, Notes, Traffic Lights (Quality Guidelines) Ability to activate Archiving to a specified address Ability to schedule automated report delivery tasks once the survey is closed Ability to Batch select all Insturctor PDF Reports to initialize the report delivery Batch events to enable printing all selected Instructor Reports into a single ZIP file for use in other applications Customize report options per survey or globally Include all reports in one Instructor or one per report Include one or multiple attachements to the Instructor Report o Cover Letter Use of Text Templates to modify text globally or per survey Contents are personalizable Optional Custom Layout (full version of Adobe required to create template) o Indicators (the average/mean for a group of questions can be shown or removed) o Item Analysis (histograms) Frequencies and Averages Std. Deviation and Median, Quartiles (10% or 25%) Trimmean, Box-Plot, Selection of Graphs Maxi-Histograms, Dual Scales o Profile Line (quick reference to identify strenghts and weakness for scaled items) Profile line shows a visual line of averages Comparsion results to show progress over time or department/orgainization trends Comparsion report level: Number of periods or against pre-generated reports o Comments Report (Respondents are Anonymous) Display of written (images) or online comments (typed text) Sorted by question or in the original survey order Administrator access to delete inappropriate comments Transcribtion of imaged comments into text is possible Extraction from paper according to threshold (class size percentage) Re-typing the comments via a Web interface by the Data Entry Assistant o Show Notes (ability to store conversations between the Dean and/or the Instructor in the report) o Cross Tabs (Tables & Graphs) Compare one question to another in order to provide a correlation o Norms (show comparison with the average quality) o Presentation Template Purpose is for discussions of the results with the group of students Shows only indicators (overall for the group of questions) The group of questions identified as a group during the survey design Class Climate Sample Report Package (data simulated to show layout and options) Page 1 of 24

2 Level 2: Data Exploring: o Subunit level reports, Program of Study, Instructor Profile, and Any Compilation o Filter Criteria based on existing questions o Report on multiple surveys for the same core questions (text is automatically compared and only the matching questions are merged, manual seletion is available) Filtering Reports o Merge Reports: Pull multiple reports into 1: result is a new report with the combined data Profile Line Comparisons o Compare instructors against each other When comparing instructors against each other (Maximum of 8 courses) o Compare instructors against their department o Compare instructors against their last year/term results o The additional comparsion line can be anonymous o Minimum and Maximum, Overall Averages o Questions can be excluded o Automatic Text Comparsion or Manual selection of questions Level 3: Advanced Comparisons o Over-Time Comparisons: Surveys of the same course in a previous period o Instructor against the Department Average: Instructor is compared to the existing Subunit report o Instructor-Group Comparisons: Instructor is compared to multiple instructors Level 4: Organization & Department Reports o Report for the President, Dean, and Dean of Studies Report for the President show each subunit and each course Average and Deviation o Customization: Professional Services Level 5: Quality Management Dashboard View o Quality Guidelines are defined by the organization (Based on the survey form/questions) o Benchmarking o Grant user access to Dean (Administrator has default access) o Web portal access to quickly & easily view quality outcomes (search and save query functions) Level 6: In-Depth Analysis o Generate reports based on any combination of data selections Department, Time Period, Program of Study, Survey Type, Survey Exclude open questions and/or combine survey unweighted o Export includes Raw Data and Questionnaire Contents o Batch Exports or individual survey or report level exporting o Define export values per survey o SPSS (SAV file) and CSV Export is supported o Custom export scripts via Professional Services Customization: Professional Services o Professional Services to create tools unique to your organization and your ROI standards Create a custom report (your layout) Create a custom Executive Report (including hyperlinks to report data) Create a custom cover letter page to use per survey or globally Create a unique export to format the data needed via a script Additional options are available Class Climate Sample Report Package (data simulated to show layout and options) Page 2 of 24

3 Level 1: Automated Instructor Report: Sample Cover Page o Customize your own text on the standard layout or customize the entire page layout (with Adobe or Professional Services) o Set Cover Page text per survey or globally o Include your own (one or multiple) attachments to the Instructor Report Package o Option to disable the Cover Page Page 1 of the Automated Instructor Report: Class Climate Sample Report Package (data simulated to show layout and options) Page 3 of 24

4 Question & Indicator Results Define text and data used in Header (Response rates, Logo alignment, along with a solid or graduated color) Define the Report Header values (Example shown: Instructor name, course, term) Determine the graph type (under the survey for automating the report delivery) Define statistics: Average, Median, or Both. Define Trimmean & Cronbach s Alpha options Ability to show or hide Overall Indicator, Legend, and the Quality Guidelines indicators Class Climate Sample Report Package (data simulated to show layout and options) Page 4 of 24

5 Question & Indicator Results: Show Legend & Cronbach s Alpha Ability to include a legend in order to define reporting statistics for Instructors Ability to enable a Cronbach s Alpha value (this value is a measure of the reliability and shows the internal consistency of the question group). The scale is from -1 to 1. In general with a value above 0.7 the scale (question group) is considered to be reliable. Class Climate Sample Report Package (data simulated to show layout and options) Page 5 of 24

6 Question & Indicator Results Additional graph options Fully automate the report delivery with the ability to pre-define your report options, allowing your instructors to focus on the report data, rather than on how to create and generate a report. Determine the graph type globally or for individual questions to highlight particular areas Histogram, Bar, Pie, Line, or Donut Diagram Class Climate Sample Report Package (data simulated to show layout and options) Page 6 of 24

7 Question Results Maxi-Histograms & Dual Scales Percentages, Averages, Std. Deviation, and Number of responses are shown Maxi-histograms do not contain any differences in comparison with the data shown in the question details. The size is the only difference and is offered as an option. Dual Scales Questions can be linked to each other, in order to prepare reporting to show the correlation Definition of critical areas in order to show items that need attention Class Climate Sample Report Package (data simulated to show layout and options) Page 7 of 24

8 Single & Multiple-Choice Question Detail Percent & Count Reports Single choice questions: ability to enable or disable the mean calculations Multiple-choice questions: ability to set maximum values for participants Open Questions: set ICR collection to single choice view with a bar for every choice or across groups of 10 Matrix question: Horizontal or Vertical orientation for participant, number of text values for returned data Grade Value: specific to Higher Education (Example: What is your expected GPA?) Class Climate Sample Report Package (data simulated to show layout and options) Page 8 of 24

9 Profile Line Report Quick Reference to identify strengths and weaknesses for scaled items Show minimum and maximum values, as well as overall averages (question group titles can be disabled) Ability to include comparison lines to show progress over time (determine the number of previous terms to show) Ability to include comparison lines against a pre-generated report to control the data show Compare instructors teaching the same course to each other, compare against the department, the school Ability to automate the comparison reporting with the Automated Instructor Report or to generate reports on demand using the Report Creator process Shown with and without comparison data: Class Climate Sample Report Package (data simulated to show layout and options) Page 9 of 24

10 Comment Report Respondent is anonymous Ability to enable a page breaks between comment results Display of written (respondent captured images) or online comments (typed respondent text) Ability for the Administrator to delete inappropriate comments Matching of exact comments by multiple respondents into a group reporting ( Instructor was great = 10 responses) Sorted by question for all comments or displayed in the survey order Transcription of imaged comments into text (based on percentage for small enrollment classes or all) via Data Entry Assistant (Web access to view captured images into text processing of paper copies is removed) Online responses shown: Paper based (captured images) shown: Class Climate Sample Report Package (data simulated to show layout and options) Page 10 of 24

11 Show Notes on Report Notes provide an avenue for discussion about the strengths, weaknesses, outcomes, or plans about the course. These notes become part of the official report package (PDF/A compliant for long-term storage) and can be recalled at a later time when needed. The Dean and Administrator can add notes to the Instructor s Report. The notes can be viewed by the Instructor on their automated report (the notes can also remain hidden to the instructor). The instructor can add their own notes when they have access to log into the system. Cross Tabulation Report Cross Tabs are define under the survey in order to automate the report delivery Select questions to show correlations (Example below: 666.7% of the Senior s Agree that the instructor is committed to helping students succeed, where as only 33.3% of the Junior also Agree) Class Climate Sample Report Package (data simulated to show layout and options) Page 11 of 24

12 Show Norming on the Report Norming can be included in the Automated Instructor Report Overall indicators are added to the beginning of the report to show the Norm value Automated Instructor Report includes a direct link to their Norming Report (Cover page with instructions/information about the Norming Report, Introduction page, overall dimension norm scores, and recommendation text based on their scores) Class Climate Sample Report Package (data simulated to show layout and options) Page 12 of 24

13 Level 2: Data Exploring (Report Creator access) o Summarized Reports with a consistent report layout o Selection of Subunit, Period, Course Type, and Survey(s) o Multiple survey selection: automatic or manual question text matching o Ability to include or exclude comments o Ability to exclude questions from the report (Example: gathering data from multiple surveys that all share the same 5 core questions) o Ability to show results unweighted o Ability to filter results against one or multiple criteria Summarized Reports: Subunit: Subunit, Period, Course Type, and Survey(s) Program of Study: Program of Study item, Period, Course Type, and Survey(s) Instructor Profile: Instructor name, Period, Course Type, and Survey(s) Any Compilation: Ability to select any combination of Subunits, Periods, Course Types, and Surveys Compilation/Tree Structure: Ability to select any combination of Subunits, Periods, Course Types, and Surveys User defined values to identify courses across the organization (up to 10 layers: Subunit, Instructor, Course location, Program of Study, Course, and the 5 user-defined fields) Overall Subunit/Department Report: Includes question detail, profile line, overall indicators, cross-tabs, comments based on the Subunit selected Class Climate Sample Report Package (data simulated to show layout and options) Page 13 of 24

14 Program of Study Report: Includes question detail, profile line, overall indicators, cross-tabs, comments based on the Program of Study field Instructor Profile Report (selected courses merged for an overall view) Includes question detail, profile line, overall indicators, cross-tabs, comments based on the Program of Study field Class Climate Sample Report Package (data simulated to show layout and options) Page 14 of 24

15 Any Compilation Report (selected of any desired combination of data) Includes question detail, profile line, overall indicators, cross-tabs, comments based on the Program of Study field Class Climate Sample Report Package (data simulated to show layout and options) Page 15 of 24

16 Subgroup Reporting: Filter criteria for one or multiple questions Tip: Subgroups reports can be used to create a Profile line comparison Class Climate Sample Report Package (data simulated to show layout and options) Page 16 of 24

17 Level 3: Advanced Comparisons: Profile Comparison Report Sample shown: Female Seniors vs. Male Seniors compared against Instructor Include up to 8 comparison lines Additional comparison lines can be anonymous Include overall average and Min/Max values Questions can be excluded Profile line can be set to compare the Instructors course based on the term, as well as included report data generated by the Report Creator Compare courses to each other Automatic text comparison (or manual) when multiple surveys are in use across courses Batch sending to all Instructors or to one address Create PDF download or PDF archive in single ZIP file Over-time comparisons: surveys of the same course in a previous period Instructor against the department average or an existing created report Instructor against an entire group of instructors (secondary comparison lines can be anonymous) Class Climate Sample Report Package (data simulated to show layout and options) Page 17 of 24

18 Level 4: Organization & Department Reports Generate reports for the President, Dean and Dean of Studies Generate on-demand reports for any desired combination with the standard reporting functions o Data Exploring o Advanced Comparisons (Profile line report) Report for the President shows each subunit and each course average and deviation o Customize the report layout and content with our Professional Services Includes customizable cover page Report for the Dean (selection for the desired Subunit) Results for the selected Subunit shows each course average and deviation o Customize the report layout and content with our Professional Services Includes customizable cover page Class Climate Sample Report Package (data simulated to show layout and options) Page 18 of 24

19 Report for the Dean of Studies (selection for the desired Subunit) This user type is only available under the Central Evaluation use of the system. The Dean of Studies logs into the system and makes desired selections of any course (under any subunit, based on the survey period) in order to have a summarized report generated (which is then sent to the Dean of Studies by the Administrator) Results for the selected Subunit shows each course average and deviation o Customize the report layout and content with our Professional Services Includes customizable cover page Class Climate Sample Report Package (data simulated to show layout and options) Page 19 of 24

20 Level 5: Quality Management Dashboard View Define quality guidelines based on the desired requirements for the survey Web portal access to quickly & easily view quality outcomes o Search and save functions Grant user access to the Dean (The Administrator has default access) Dean is presented with an overall view of the quality outcomes o Ability to view the guidelines results o Ability to sort the view by desired columns or search conditions o Ability to view the original instructor report o Ability to add notes to the instructor report Ability to view the quality outcomes View the Instructor Report and/or add notes Class Climate Sample Report Package (data simulated to show layout and options) Page 20 of 24

21 Level 6: In-Depth Analysis Generate reports based on any combination of data selections Generate reports based on the department, time period, program of study, survey type, etc... Exclude or include open questions Combine surveys (options include: unweighted) Exclude questions Export raw survey data results and questionnaire contents Batch export (system wide), individual survey, or based on generate report results o Select the Subunit(s), Period(s), Course Type(s), Questionnaire, and Course(s) Define export values at the survey level Export to SPSS (SAV file), CSV, or create a custom script with our Professional Services o Define system level delimiter: semicolon, comma, tab, or pipe Sample Export Generate reports to track participation in online surveys (CSV export) o Select Subunit(s), Period(s), Course Type(s), Survey(s), and Course(s) Generate reports to track response rates for online surveys (CSV export) o Select Subunit(s), Period(s), Course Type(s), Survey(s), and Course(s) Participation tracking for online surveys Response Rate Export Class Climate Sample Report Package (data simulated to show layout and options) Page 21 of 24

22 Customization: Professional Services Utilize our Professional Services to create unique tools for continued use within your organization Create a custom report and/or a custom cover letter Create a custom Executive Report (including hyperlinks to report data) Create a unique export script defined to meet your specific requirements Additional options are available to further customized the Class Climate solution o LMS integrations, custom languages, survey templates, etc. Sample: Course Report Sample: customized result layout Sample: customized report for the Dean Class Climate Sample Report Package (data simulated to show layout and options) Page 22 of 24

23 Sample: Instructor report Including special format to display comments: Class Climate Sample Report Package (data simulated to show layout and options) Page 23 of 24

24 Sample: Summarized report Sample: Patient Satisfaction report Class Climate Sample Report Package (data simulated to show layout and options) Page 24 of 24