Accreditation Council for Business Schools and Programs (ACBSP) Quality Assurance (QA) Report for Baccalaureate/Graduate Degree Programs

Transcription

1 Accreditation Council Business Schools and Programs (ACBSP) Standard 3 - Student and Stakeholder-Focused Results Student- and Stakeholder-Focused Results Student- and stakeholder-focused results examine how well your organization satisfies students and stakeholders key needs and expectations. Permance measures may include: satisfaction and dissatisfaction of current and past students and key stakeholders, perceived value, loyalty, persistence, or other aspects of relationship building, end of course surveys, alumni surveys, Internship feedback, etc. Measurement instrument or processes may include end of course surveys, alumni surveys, Internship feedback, etc. Each academic unit must demonstrate linkages to business practitioners and organizations, which are current and significant, including an advisory board. Periodic surveys should be made of graduates, transfer institutions, and/or employers of graduates to obtain data on the success of business programs in preparing students to compete successfully entry-level positions. Permance Measure What is your measurement instrument or Current Results Analysis of Results Analysis of Results Action Taken or Insert Graphs or Tables of Resulting Trends (3-5 data points preferred)

2 Accreditation Council Business Schools and Programs (ACBSP) Measurable goal What is your goal? 100% employment or admission to graduate school. Data is provided Trine University and each individual school. process? (Indicate length of cycle) Career Services Employment Survey. Data collected indicates employment within 6 months of graduation What are your current results? Despite the downturn in economic conditions the students have been successfu l in finding jobs What did you learn from the results? Data indicates that more KSB students have been successful finding jobs. A drop in student success occurred August School Overall % of May August 2010 alumni employed or in grad school Overall % of December 2010-August 2011 alumni employed or in grad school KSB 98% 95% 81% Overall % of December August 2012 Alumni employed or in grad school

3 Accreditation Council Business Schools and Programs (ACBSP) Standard 4: Student Learning Results (Required each accredited program, doctorate, masters, and baccalaureate) Permance Indicator Definition 1. Student Learning Results A student learning outcome is one that measures a specific competency attainment. Direct - Assessing student permance by examining samples of student work (Required each accredited Indirect - Assessing indicators other than student work such as getting feedback from the student or program) other persons who may provide relevant inmation. Formative An conducted during the student s education. Summative An conducted at the end of the student s education. Internal An instrument that was developed within the business unit. External An instrument that was developed outside the business unit. Comparative Compare results between classes, between online and on ground classes, Between professors, between programs, between campuses, or compare to external results such as results from the U.S. Department of Research and Statistics, or results from a vendor providing comparable data. Analysis of Results Permance Measure Measurable goal What is your goal? What is your measurement instrument or process? Do not use grades. (Indicate length of cycle) Current Results What are your current results? Analysis of Results What did you learn from the results? Insert Graphs or Tables of Resulting Trends (3-5 data points preferred)

4 Accreditation Council Business Schools and Programs (ACBSP) New criteria: improve mean percent correct management indicator. New criteria: improve mean percent correct Quantitative Business Analysis direct mative internal comparative Major Field Test results added. (Summative External Assessment) Major Field Test results have been added. (Summative External Assessment) As directed, grades eliminated. indicator shows that student scores are improving. As directed, grades eliminated. indicator and grades indicate that indicator would be a more appropriate measurement. To add value to data, need to benchmark Trine with other schools. Student permance has many variables and a determination of relevant metrics is Semester indicator Mean Percent Correct Fall 2010 Management 52 Spring Management Fall 2011 Management 54 Spring Management Fall 2012 Management 63 Spring 2013 Management 56 Semester indicator Mean Percent Correct Fall 2010 Quantitative 41 Business Analysis Spring Quantitative Business Analysis Fall 2011 Quantitative 45

5 Accreditation Council Business Schools and Programs (ACBSP) indicator. New criteria: improve mean percent correct Finance indicator. New criteria: improve mean percent correct Inmation indicator Major Field Test results have been added. (Summative External Assessment) Major Field Test results have been added. (Summative External Assessment) student permanc e is not consistent. As directed, grades eliminated. indicator shows that student scores are improving. As directed, grades eliminated. indicator and grades indicate that student permanc needed Business Analysis Fall 2012 Quantitative Business Analysis indicator would be a more appropriate measurement. To add value to data, need to assess with other schools. Student permance has many variables and a determination of relevant metrics is needed. Spring 2013 Quantitative Business Analysis Semester Indicator Mean Percent Correct Fall 2010 Finance 37 Spring 2011 Finance 43 Fall 2011 Finance 32 Spring 2012 Finance 48 Fall 2012 Finance 42 Spring 2013 Finance 39 Semester Indicator Mean Percent Correct Fall 2010 Inmation 42 Spring 2011 Inmation 38 Fall 2011 Inmation 43

6 Accreditation Council Business Schools and Programs (ACBSP) Mean scores on the Major Field Test in Business will show positive trend each year of at least one point. Individual content indicators will also show a positive trend each year of at least one point. ETS Major Field Test in Business. (Summative External Assessment) e is variable. No consistent trend is present. Intervention is needed to determine at what level students are entering the course. Spring 2012 Inmation Fall 2012 Inmation Spring 2013 Inmation. Semester Accounting Assessment Indicator Finance Assessment Indicator Spring Fall Spring Fall Spring Fall Spring Fall Spring Fall Spring Fall Spring Fall Spring

7 Accreditation Council Business Schools and Programs (ACBSP) Universitywide all students will average 3.0 out of a possible 4.0 on the General written skills General Assessment rubric applied in general summit. Summative, comparative internal : Note: in 2012 written skills were not assessed. The focus on the workshop was oral skills The overall scores the written skills of Trine students has remained level. Continued focus is needed on writing skills in all classes. The importance of written skills is essential in course work. The application of written skills to course content is a more appropriate focus improveme nt. Specific Semester Mean score Fall Spring Fall Spring Fall Spring Clarity of thesis/focus of writing Organization Support of Ideas Documentation Style Grammar, Spelling, Usage, Punc Formatting Collaboration OVERALL SCORES

8 Accreditation Council Business Schools and Programs (ACBSP) courses will be identified to track written skills and the ability to demonstrat e course content. Universitywide all students will average 3.0 out of a possible 4.0 on the General critical thinking skills General Assessment rubric applied in general summit. Summative, comparative internal The overall scores the written skills of Trine students have improved over that last two groups. It has not reached the Continued focus is needed on Critical thinking skills in all classes The importance of critical thinking skills is essential in course work. The application of critical thinking skills to course content is Oral Communication Main Idea and Support Organization Language Conventions Documentation Visual Aids Presentation Collaboration OVERALL SCORES

9 Accreditation Council Business Schools and Programs (ACBSP) 2008 level. a more appropriate focus improveme nt. Specific courses will be identified to track critical thinking and the ability to demonstrat e course content. Universitywide all students will be asses on the General quantitative skills. New General Assessment test administered to capstone students. Summative, Test has been administere d twice. Building baseline data Continued is needed to complete benchmarkin g process. Year Trine University Average score Spring % Spring %

10 Accreditation Council Business Schools and Programs (ACBSP) initiative that is in the benchmarking process. comparative internal

11 Accreditation Council Business Schools and Programs (ACBSP) Standard 6 - Organizational Permance Results 5. Organizational Effectiveness Results Organizational effectiveness results examine attainment of organizational goals. Each business unit must have a systematic reporting mechanism each business program that charts enrollment patterns, student retention, student academic success, and other characteristics reflecting students' permance. Key indicators may include: graduation rates, enrollment, improvement in safety, hiring equity, increased use of web-based technologies, use of facilities by community organizations, contributions to the community, or partnerships, retention rates by program, and what you report to governing boards and administrative units. Analysis of Results Increase in campus-wide sophomore retention rates by 5% each year until it reaches 80%. Enrollment statistics returning sophomores Improve ment in sophomo re retention. Lower retention Cohort 2011 A clear reason the drop in retention the Cohort of 2011 is not evident. Year Trine Sophomore retention rate KSB Students Cohort % Cohort % Cohort %