Report of Outcomes Assessment Results

Transcription

1 International Assembly for Collegiate Business Education Report of Outcomes Assessment Results Institution: Academic Business Unit: University of Saint Mary Business, Accounting, and Sport Management Academic Year: International Assembly for Collegiate Business Education Strang Line Road Lenexa, Kansas USA

2 Outcomes Assessment 1. Do you offer any majors, concentrations, specializations, emphases, options, or tracks as part of your business programs? X Yes. If yes, proceed to item 2 below. No. If no, proceed to item 4 below. 2. Do your majors, concentrations, specializations, emphases, options, or tracks appear on students transcripts, diplomas, diploma supplements, or other official records of program completion? X Yes. If yes, proceed to item 3 below. No. If no, proceed to item 4 below. 3. Does your current outcomes assessment plan include student learning assessment information for all majors, concentrations, specializations, emphases, options, and tracks contained within your business programs? Yes. If yes, proceed to item 4 below. X No. If no, please submit a revised outcomes assessment plan with your interim report that addresses student learning assessment for all majors, concentrations, specializations, emphases, options, and tracks comprising any portion of your business programs. Information about this requirement can be found on the IACBE website at the following address: 4. Is the outcomes assessment plan that you submitted to the IACBE still current or have you made changes? The outcomes assessment plan that we have previously submitted is still current. Changes have been made and the revised plan is attached. X We have made changes and the revised plan will be sent to the IACBE by: June 1,

3 Outcomes Assessment Results For Academic Year: Section I: Student Learning Assessment Department of Business, Accounting, and Sport Management Student Learning Assessment for Bachelor of Science in Business Administration General Program Intended Student Learning Outcomes (General Program ISLOs) 1. Students will demonstrate a basic understanding of the knowledge, skills, and attributes needed by managers and/or professionals in a business, economic, and political environment. 2. Students will demonstrate competence in business and accounting necessary to pursue general management, financial and /or accounting specialists opportunities. 3. Students will demonstrate business and accounting career-oriented skills most appropriate to to their selected concentration and/or major(s). 4. Students will demonstrate critical thinking and communication skills in the areas of ethics, diversity, change and leadership. Intended Student Learning Outcomes: Management ISLOs 1. Students will demonstrate the ability to analyze Business Organizations in terms of Organizational Development and traditional and contemporary Human Resources roles within the legal and regulatory environment and identify actions needed to obtain and sustain a competitive advantage. 2. Students will demonstrate the ability to integrate the Management and Strategic processes to use major analytical tools to analyze case studies, complete computerized simulations and to formulate, implement and evaluate problems, policies, procedures and to develop plans from a strategic executive level of management. Intended Student Learning Outcomes: Marketing ISLOs 1. Students will demonstrate knowledge and understanding of how to execute a basic S.W.O.T. analysis and conduct basic secondary research including demographic and psychographic techniques that define the target customer. 2. Students will demonstrate the ability to conduct a basic segmentation process that helps define who the customer is for a specific product or service and results in in the creation of strategy-based marketing plan using the 4Ps in a marketing mix designed especially for the product or service. 2

4 Assessment Instruments for Intended Student Learning Outcomes Direct Measures of Student Learning: 1. Direct Measure 1 Capstone exam given in our senior level Business Policy and Ethics class Program ISLOs Assessed by this Measure: 1-3 Objectives (Targets/Criteria) for Direct Measures: Objective (Target/Criterion) for Direct Measure 1 70% of our students will correctly answer 70% of the questions in each of the content areas of the Capstone Exam (See Course of Action 5 below) 2. Direct Measure 2 Senior integrated case analysis Program ISLOs Assessed by this Measure: 1-4 Objective (Target/Criterion) for Direct Measure 2 70% of our students score at least 70% on their integrated case study analysis (See Course of Action 5 below) 3. Direct Measure 3 Objective (Target/Criterion) for Direct Measure 3 Third Party CPC Testing Under Development (See Course of Action 4 below) Assessment Instruments for Intended Student Learning Outcomes Indirect Measures of Student Learning: 1. Indirect Measure 1 Undergraduate Student Satisfaction Survey Program ISLOs Assessed by this Measure: 1-4 Objectives (Targets/Criteria) for Indirect Measures: Objective (Target/Criterion) for Indirect Measure 1 75% of students will be at least satisfied with the Business Department 2. Indirect Measure 2 Graduate Employment Rates Program ISLOs Assessed by this Measure: 1-4 Objective (Target/Criterion) for Indirect Measure 2 75% of graduates of the business program will obtain jobs in the fields of business or accounting, continue on to graduate school as full time students, or enlist/be commissioned in the armed forces, within six months of graduating 3

5 Assessment Results: Bachelor of Science in Business Administration Summary of Results from Implementing Direct Measures of Student Learning: 1. Summary of Results for Direct Measure 1 In-house Capstone Test Report* Average Scores per Year by Major Overall MGT MKT ECON FIN ACC Sample 2015 All Students 75% 90% 74% 76% 53% 41% 10 Accounting 75% 91% 73% 81% 48% 42% 6 Management 75% 89% 70% 73% 67% 47% 3 Marketing 79% 89% 75% 75% 64% 58% All Students 82% 93% 77% 83% 69% 61% 12 Accounting 72% 79% 70% 64% 65% 70% 2 Management 82% 94% 71% 82% 74% 57% 7 Marketing 82% 91% 84% 85% 62% 66% All Students 79% 87% 83% 86% 65% 58% 11 Accounting 79% 85% 93% 82% 63% 60% 3 Management 79% 86% 90% 73% 60% 70% 1 Marketing 80% 88% 77% 90% 66% 56% All Students 87% 90% 91% 86% 81% 76% 8 Accounting 88% 90% 90% 82% 95% 80% 2 Management 97% 97% 100% 95% 95% 95% 2 Marketing 81% 86% 88% 84% 68% 65% All Students 88% 94% 92% 84% 81% 78% 9 Accounting 100% 100% 100% 100% 100% 100% 1 Management 89% 95% 90% 85% 83% 73% 3 Marketing 86% 92% 92% 80% 76% 76% 5 4

6 In-house Capstone Test Report* Five Year Average Overall MGT MKT ECON FIN ACC Sample All Students 82% 91% 83% 83% 70% 63% 50 Accounting 83% 89% 85% 82% 74% 70% 14 Management 84% 92% 84% 82% 76% 68% 16 Marketing 81% 89% 83% 83% 67% 64% 26 Students scoring 70% or better per section by major Major Overall MGT MKT ECON FIN ACC Sample All Majors 90% 100% 84% 88% 57% 43% # of students above 70% Accounting 79% 100% 86% 79% 50% 43% # of students above 70% Management 100% 100% 80% 100% 73% 47% # of students above 70% Marketing 91% 100% 86% 86% 50% 41% # of students above 70% total students 14 total students 15 total students 22 total students * Due to the fact that there are double majors, total students in concentrations will not equal total of all students. 5

7 2. Summary of Results for Direct Measure 2 University of Saint Mary Business Department Results of Capstone Case Study (May of Graduation Year) Graduates Capstone Case Study (Overall) 5 Year Analysis Spring 2011 (9 Students) Spring 2012 (8 Students) Spring 2013 (11 students) Spring 2014 (12 Students) Spring 2015 (10 Students) Average 81.70% 71.69% 81.31% 85.00% 87.00% 83.50% Median 85.00% 67.00% 83.50% 85.00% 88.75% 88.00% Mode 85.00% 82.50% 72.00% 85.00% 90.00% 88.00% Standard Deviation 8.66% 9.15% 8.48% 0.00% 2.80% 9.70% Variance (StdDev) 0.75% 0.84% 0.72% 0.00% 0.08% 0.94% Population StdDev 8.58% 8.55% 7.93% 0.00% 2.68% 9.20% Variance (PopStdDev) 0.74% 0.73% 0.63% 0.00% 0.07% 0.85% # Students w/ Scores over 70% 50 of 50 3 out of 9 8 out of 8 11 out of out of out of 10 % of Students w/ Scores over 70% 88% 33.33% % % % % We recognize that our measure is taken from an overall score rather than from specific areas of the grading rubric, which only generally addresses the Intended Student Learning Outcomes to which this measure is tied. A specific rubric is under development. 3. Summary of Results for Direct Measure 3 Objectives Under Development - See course of action 4. 6

8 Summary of Results from Implementing Indirect Measures of Student Learning: 1. Summary of Results for Indirect Measure Graduates Satisfaction Survey Results % of Business Students Satisfied (excludes Sports Management) Rating Average Above Avg Excellent (>=5 out of 1-10 Scale, 10 being highest 10) (>=7 out of 10) (>9 out of 10) Average Scores University Satisfaction (Overall) % 55.56% 11.11% 7.11 Job Preparedness % 77.78% 11.11% 7.44 Value of Education % 77.78% 0.00% 7.56 Available Technology 66.67% 66.67% 11.11% 6.67 Business Dept Satisfaction (Detail w/ Technology) % % 27.27% 8.57 Business Dept Satisfaction (Detail w/o Technology) % % 27.27% 8.75 Business Dept Satisfaction (Single Question Overall) % % 18.18% 8.78 For the Reporting Year, 100% of our students were at least satisfied with the Business Department, as indicated by a score of at least 7 on a scale of The average satisfaction rating for the Business Department was Summary of Results for Indirect Measure 2 Of 50 graduates from the business and accounting programs over the past five years, 48 were contacted regarding their employment status six months after graduation: Grads Contacted % Grad School % Emp in Related Field % Employed Non-related Field % Military Service % Employed % 68.75% 12.50% 0.00% 81.25% Eighty percent of our graduates are employed. Twenty-seven percent have gone to graduate school. Some of the students who went on to full time employment also went to graduate school, so the number of students who are actively employed and/or in graduate school postgraduation approaches 100%. 7

9 Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes Learning Assessment Measures General Program ISLOs Senior Capstone Exam Senior Integrated Case Study Third Party Comprehensive Exam Undergraduate Student Satisfaction Survey Graduate Employment Rates 1. Students will demonstrate a basic understanding of the knowledge, skills, and attributes needed by managers and/or professionals in a business, economic, and political environment. 2. Students will demonstrate competence in business and accounting necessary to pursue general management, financial and /or accounting specialists opportunities. 3. Students will demonstrate business and accounting careeroriented skills most appropriate to to their selected concentration and/or major(s). 4. Students will demonstrate critical thinking and communication skills in the areas of ethics, diversity, change and leadership. Assessment Measures Under Devleopment See Course of Action 4 under BSBA Target Was NOT NOT N/A N/A 8

10 Intended Student Learning Outcomes: Concentration in Management 1. Students will demonstrate the ability to analyze Business Organizations in terms of Organizational Development and traditional and contemporary Human Resources roles within the legal and regulatory environment and identify actions needed to obtain and sustain a competitive advantage. 2. Students will demonstrate the ability to integrate the Management and Strategic processes to use major analytical tools to analyze case studies, complete computerize simulations and to formulate, implement and evaluate problems, policies, procedures and to develop plans from a strategic executive level of management. Intended Student Learning Outcomes: Concentration in Marketing 1. Students will demonstrate knowledge and understanding of how to execute a basic S.W.O.T. analysis and conduct basic secondary research including demographic and psychographic techniques that define the target customer. 2. Students will demonstrate the ability to conduct a basic segmentation process that helps define who the customer is for a specific product or service and results in in the creation of strategy-based marketing plan using the 4Ps in a marketing mix designed especially for the product or service. Senior Capstone Exam Senior Integrated Case Study Third Party Comprehensive Exam Assessment Measures Under Devleopment See Course of Action 4 under BSBA Undergraduate Student Satisfaction Survey Graduate Employment Rates Target Was Senior Capstone Exam Senior Integrated Case Study Third Party Comprehensive Exam Assessment Measures Under Devleopment See Course of Action 4 under BSBA Undergraduate Student Satisfaction Survey Graduate Employment Rates Target Was 9

11 Proposed Courses of Action for Improvement in Learning Outcomes for which Targets Were Not Met:* 1. Course of Action 1 Updating Assessment Plan Our last attempt at updating the assessment plan (submitted May 2015) did not sufficiently address reporting needs. Based upon our experiences attending IACBE conferences and the input of IACBE advisors, we have learned more about outcomes assessment, and have determined that we needed to make significant revisions in our assessment plan. Specific areas where we need improvement is matching our measurement tools to more specifically assess the ISLOs. We have updated the plan, but were unable to implement it in time to use it as an assessment tool for the current annual report. As a result, we are using the original assessment plan from (dated 11/1/2014) to assess the data. This new assessment plan will be utilized for the upcoming self-study. 2. Course of Action 2 In-House Capstone Exam After reviewing several years worth of results from our current In-House Capstone exam, it became apparent that the exam does not specifically measure the skills that our graduates are expected to display, as described by our Intended Student Learning Outcomes. Therefore, a new In-House Capstone Exam has been developed. This allows us to more closely identify our students knowledge of concepts from both the business core courses and concentrations courses, as well as their ability to apply those concepts to skill based tasks. The core exam will measure student learning that is common to all of our grads based on the courses they are required to take, and separate concentration exams will be specific to the courses that are only taken by students in a specific major/concentration. We have not yet implemented the new exam, so the data above still displays the results of the old exam. The new exam will be implemented in Spring Course of Action 3 Capstone Case Study As noted in Course of Action 1, we are pursuing more efficient methods of obtaining more specific data to measure our Intended Student Learning Outcomes. As part of this process, we are reviewing the current grading rubric for the Capstone Case Study. Our former management professor retired last year, so action on this item was deferred. Our new management professor will be involved in this process. One goal is to produce methods for individual level assessment rather than aggregating all outcomes at the group level. 4. Course of Action 4 Third Party Exams After deploying third party pre- and post-tests for several years, we have had ongoing challenges (matching these tests by student), and will be discontuinuing the use of comparing entry versus exit tests as these have been difficult to compare effectively. We will retain the use of exit testing as it will provide us a comparison to comparable external schools. 5. Course of Action 5 Objectives for Direct Measures As a result of an conversation between Dr. Okrepkie and Dr. Logan, it was determined that the original performance objectives for this direct measure were unobtainable [75% our students will correctly answer 80% of the questions]. Therefore, we have adjusted this target level to be in line with many of the other business programs accredited by IACBE. Adjusting to IACBE norms, having 70% of our students score 70% on the in-house capstone exam and the case study is a more reasonable and attainable goal, so our benchmarks were adjusted for this year and will be used in future years assessments. *These courses of action do not exclusively pertain to those learning outcomes where performance targets were not met. They are also action items to improve assessment and measurement so that we can ensure that the results truly represent whether ISLOs were met or not. 10

12 Outcomes Assessment Results For Academic Year: Section I: Student Learning Assessment Department of Business, Accounting, and Sport Management Student Learning Assessment for Bachelor of Science in Accounting General Program Intended Student Learning Outcomes (General Program ISLOs) 1. Students will demonstrate a basic understanding of the knowledge, skills, and attributes needed by managers and/or professionals in a business, economic, and political environment. 2. Students will demonstrate competence in business and accounting necessary to pursue general management, financial and /or accounting specialists opportunities. 3. Students will demonstrate business and accounting career-oriented skills most appropriate to their selected concentration and/or major(s). 4. Students will demonstrate critical thinking and communication skills in the areas of ethics, diversity, change and leadership. 5. Students will effectively define the needs of various users of accounting data and demonstrate the ability to use such data effectively, as well as the ability to provide knowledgeable recommendations. 6. Students will demonstrate the ability to recognize circumstances providing for increased exposure to fraud and define preventative internal control measures. Assessment Instruments for Intended Student Learning Outcomes Direct Measures of Student Learning: 1. Direct Measure 1 Capstone exam given in our senior level Business Policy and Ethics class Program ISLOs Assessed by this Measure: 1-3, Direct Measure 2 Senior integrated case analysis Program ISLOs Assessed by this Measure: 1-2, Direct Measure 3 Third Party CPC Testing Objectives (Targets/Criteria) for Direct Measures: 70% our students will correctly answer 70% of the questions in each of the content areas of the Capstone Exam (See Course of Action 5 below) 70% of our students score at least 70% on their integrated case study analysis. (See Course of Action 5 below) Under Development (See Course of Action 4 below) 11

13 Assessment Instruments for Intended Student Learning Outcomes Indirect Measures of Student Learning: 1. Indirect Measure 1 Undergraduate Student Satisfaction Survey Program ISLOs Assessed by this Measure: Indirect Measure 2 Graduate Employment Rates Program ISLOs Assessed by this Measure: 1-5 Objectives (Targets/Criteria) for Indirect Measures: 75% of students will be at least satisfied with the Business Department. Objective (Target/Criterion) for Indirect Measure 2 75% of graduates of the business program will obtain jobs in the fields of business or accounting, continue on to graduate school as full time students, or enlist/be commissioned in the armed forces, within six months of graduating Assessment Results: Bachelor of Science in Accounting Summary of Results from Implementing Direct Measures of Student Learning: 1. Summary of Results for Direct Measure 1 In-house Capstone Test Report* Average Scores per Year by Major Overall MGT MKT ECON FIN ACC Sample 2015 All Students 75% 90% 74% 76% 53% 41% 10 Accounting 75% 91% 73% 81% 48% 42% 6 Management 75% 89% 70% 73% 67% 47% 3 Marketing 79% 89% 75% 75% 64% 58% All Students 82% 93% 77% 83% 69% 61% 12 Accounting 72% 79% 70% 64% 65% 70% 2 Management 82% 94% 71% 82% 74% 57% 7 Marketing 82% 91% 84% 85% 62% 66% All Students 79% 87% 83% 86% 65% 58% 11 Accounting 79% 85% 93% 82% 63% 60% 3 Management 79% 86% 90% 73% 60% 70% 1 Marketing 80% 88% 77% 90% 66% 56% 7 12

14 In-house Capstone Test Report* (cont) 2012 All Students 87% 90% 91% 86% 81% 76% 8 Accounting 88% 90% 90% 82% 95% 80% 2 Management 97% 97% 100% 95% 95% 95% 2 Marketing 81% 86% 88% 84% 68% 65% All Students 88% 94% 92% 84% 81% 78% 9 Accounting 100% 100% 100% 100% 100% 100% 1 Management 89% 95% 90% 85% 83% 73% 3 Marketing 86% 92% 92% 80% 76% 76% 5 Five Year Average Overall MGT MKT ECON FIN ACC Sample All Students 82% 91% 83% 83% 70% 63% 50 Accounting 83% 89% 85% 82% 74% 70% 14 Management 84% 92% 84% 82% 76% 68% 16 Marketing 81% 89% 83% 83% 67% 64% 26 Students scoring 70% or better per section by major Major Overall MGT MKT ECON FIN ACC Sample All Majors 90% 100% 84% 88% 57% 43% # of students above 70% Accounting 79% 100% 86% 79% 50% 43% # of students above 70% Management 100% 100% 80% 100% 73% 47% # of students above 70% Marketing 91% 100% 86% 86% 50% 41% # of students above 70% total students 14 total students 15 total students 22 total students * Due to the fact that there are double majors, total students in concentrations will not equal total of all students. 13

15 2. Summary of Results for Direct Measure 2 University of Saint Mary Business Department Results of Capstone Case Study (May of Graduation Year) Graduates Capstone Case Study (Overall) 5 Year Analysis Spring 2011 (9 Students) Spring 2012 (8 Students) Spring 2013 (11 students) Spring 2014 (12 Students) Spring 2015 (10 Students) Average 81.70% 71.69% 81.31% 85.00% 87.00% 83.50% Median 85.00% 67.00% 83.50% 85.00% 88.75% 88.00% Mode 85.00% 82.50% 72.00% 85.00% 90.00% 88.00% Standard Deviation 8.66% 9.15% 8.48% 0.00% 2.80% 9.70% Variance (StdDev) 0.75% 0.84% 0.72% 0.00% 0.08% 0.94% Population StdDev 8.58% 8.55% 7.93% 0.00% 2.68% 9.20% Variance (PopStdDev) 0.74% 0.73% 0.63% 0.00% 0.07% 0.85% # Students w/ Scores over 70% 50 of 50 3 out of 9 8 out of 8 11 out of out of out of 10 % of Students w/ Scores over 70% 88% 33.33% % % % % We recognize that our measure is taken from an overall score rather than from specific areas of the grading rubric, which only generally addresses the Intended Student Learning Outcomes to which this measure is tied. A specific rubric is under development. 3. Summary of Results for Direct Measure 3 Objectives Under Development. (See Course of Action 4 below) 14

16 Summary of Results from Implementing Indirect Measures of Student Learning: 1. Summary of Results for Indirect Measure Graduates Satisfaction Survey Results % of Business Students Satisfied (excludes Sports Management) Rating Average Above Avg Excellent (>=5 out of 1-10 Scale, 10 being highest 10) (>=7 out of 10) (>9 out of 10) Average Scores University Satisfaction (Overall) % 55.56% 11.11% 7.11 Job Preparedness % 77.78% 11.11% 7.44 Value of Education % 77.78% 0.00% 7.56 Available Technology 66.67% 66.67% 11.11% 6.67 Business Dept Satisfaction (Detail w/ Technology) % % 27.27% 8.57 Business Dept Satisfaction (Detail w/o Technology) % % 27.27% 8.75 Business Dept Satisfaction (Single Question Overall) % % 18.18% 8.78 For the Reporting Year, 100% of our students were at least satisfied with the Business Department, as indicated by a score of at least 7 on a scale of The average satisfaction rating for the Business Department was Summary of Results for Indirect Measure 2 Of 50 graduates from the business and accounting programs over the past five years, 48 were contacted regarding their employment status six months after graduation: Grads Contacted % Grad School % Emp in Related Field % Employed Non-related Field % Military Service % Employed % 68.75% 12.50% 0.00% 81.25% Eighty percent of our graduates are employed. Twenty-seven percent have gone to graduate school. Some of the students who went on to full time employment also went to graduate school, so the number of students who are actively employed and/or in graduate school postgraduation approaches 100%. 15

17 Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes General Program ISLOs 1. Students will demonstrate a basic understanding of the knowledge, skills, and attributes needed by managers and/or professionals in a business, economic, and political environment. 2. Students will demonstrate competence in business and accounting necessary to pursue general management, financial and /or accounting specialists opportunities. 3. Students will demonstrate business and accounting careeroriented skills most appropriate to their selected concentration and/or major(s). 4. Students will demonstrate critical thinking and communication skills in the areas of ethics, diversity, change and leadership. 5. Students will effectively define the needs of various users of accounting data and demonstrate the ability to use such data effectively, as well as the ability to provide knowledgeable recommendations. 6. Students will demonstrate the ability to recognize circumstances providing for increased exposure to fraud and define preventative internal control measures. Senior Capstone Exam Senior Integrated Case Study Learning Assessment Measures Third Party Comprehensive Exam Assessment Measures Under Devleopment See Course of Action 4 under BSBA Undergraduate Student Satisfaction Survey Graduate Employment Rates Target Was NOT NOT N/A N/A NOT NOT 16

18 Proposed Courses of Action for Improvement in Learning Outcomes for which Targets Were Not Met:* 1. Course of Action 1 Evaluating Results of Accounting Program Assessment Results from the in-house capstone exam reveal problems with its administration. An additional challenge is that accounting students do not seem to be scoring well on accounting according to the exam. This may be a problem with the exam, which has been acknowledged. It also requires analysis to determine whether students are adequately learning accounting skills. As a result of the development of the accounting major, we hope that improvements in the program will improve these scores next year. The exam will be updated for See the BSBA proposed courses of action for details on additional courses of action. The challenges that exist in this assessment are the same as those in the BSBA assessment. *These courses of action do not exclusively pertain to those learning outcomes where performance targets were not met. They are also action items to improve assessment and measurement so that we can ensure that the results truly represent whether ISLOs were met or not. 17

19 Outcomes Assessment Results For Academic Year: Section I: Student Learning Assessment Department of Business, Accounting, and Sport Management Student Learning Assessment for Masters of Business Administation General Program Intended Student Learning Outcomes (General Program ISLOs) 1. Identify critical business issues facing organizations. 2. Analyze business issues from a cross-disciplinary perspective and form practical responses to these issues. 3. Assess the impact of global influences on business decisions. 4. Formulate ethical approaches to business decisions and understand how to apply these within a business context. 5. Communicate effectively in both a written and oral manner. Assessment Instruments for Intended Student Learning Outcomes Direct Measures of Student Learning: Objectives (Targets/Criteria) for Direct Measures: 1. Direct Measure 1 Objective (Target/Criterion) for Direct Measure 1 Case Analysis Program ISLOs Assessed by 1a: 1-5 Program ISLOs Assessed by 1b: 1, 2, & 5 Program ISLOs Assessed by 1c: 1, 4, & 5 1a. Overall 90% of our students in the Business Policy and Ethics capstone class will score at least 80% on a series of textbook cases that are analyzed in this course. 1b. Overall 90% of our students in the Business Policy and Ethics capstone class will score at least 80% on a series of ethical discussion papers that are analyzed in this course. 1c. Overall 90% of our students in the Business Policy and Ethics capstone class will score at least 80% on a series of strategy discussion papers that are analyzed in this course. 2. Direct Measure 2 Objective (Target/Criterion) for Direct Measure 2 Students Exiting Assessment Final Paper Program ISLOs Assessed by this Measure: 1-5 Overall 90% of our students successfully complete the exiting assessment final paper with a grade of at least 80%. 18

20 3. Direct Measure 3 Objective (Target/Criterion) for Direct Measure 3 Third Party MBA Testing Program ISLOs Assessed by this Measure: 1-3 3a. Overall 50% of our MBA students will meet or exceed the national average score for all topic areas in the Ivy Software MBA Comprehensive Examination. 3b. Overall 50% of our MBA students will meet or exceed the average score of other IACBE schools tested for all topic areas in the Ivy Software MBA Comprehensive Examination. Assessment Instruments for Intended Student Learning Outcomes Direct Measures of Student Learning: Objectives (Targets/Criteria) for Direct Measures: 4. Direct Measure 4 Objective (Target/Criterion) for Direct Measure 4 Capstone Presentation Series Program ISLOs Assessed by this Measure: 5 4. Overall 90% of our students in the Business Policy and Ethics capstone class will score at least 80% on a series of presentations that are analyzed in this course. Assessment Instruments for Intended Student Learning Outcomes Indirect Measures of Student Learning: Objectives (Targets/Criteria) for Indirect Measures: 1. Indirect Measure 1 Objective (Target/Criterion) for Indirect Measure 1 Graduate Exit Survey Question 2 Program ISLOs Assessed by this Measure: 1-2 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: The program helped me to develop problem solving skills in a way that I am able to recognize critical problems and address organizational issues (ISLO 1&2). 2. Indirect Measure 2 Objective (Target/Criterion) for Indirect Measure 2 Graduate Exit Survey Question 3 Program ISLOs Assessed by this Measure: 2, 4 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: The program improved my ability to evaluate and balance decisions characterized by competing demands or requirements emanating from the organizational, stakeholder, societal and ethical contexts (ISLO 2&4). 19

21 Assessment Instruments for Intended Student Learning Outcomes Indirect Measures of Student Learning: Objectives (Targets/Criteria) for Indirect Measures: 3. Indirect Measure 3 Objective (Target/Criterion) for Indirect Measure 3 Graduate Exit Survey Question 5 Program ISLOs Assessed by this Measure: 5 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: The program improved my communication skills so that I was better equipped to convey information and knowledge in an effective and efficient manner(islo 5). 4. Indirect Measure 4 Objective (Target/Criterion) for Indirect Measure 4 Graduate Exit Survey Question 6 Program ISLOs Assessed by this Measure: 1-2 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: The program helped me to make decisions from a strategic perspective (ISLO 1&2). 5. Indirect Measure 5 Objective (Target/Criterion) for Indirect Measure 5 Graduate Exit Survey Question 7 Program ISLOs Assessed by this Measure: 3 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: The program helped me to make decisions that incorporated a global perspective (ISLO 3). 6. Indirect Measure 6 Objective (Target/Criterion) for Indirect Measure 6 Graduate Exit Survey Question 8 Program ISLOs Assessed by this Measure: 1 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: The program helped me to make decisions by evaluating critical factors in the marketplace (ISLO 1). 7. Indirect Measure 7 Objective (Target/Criterion) for Indirect Measure 7 Graduate Exit Survey Question 13 Program ISLOs Assessed by this Measure: 5 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: Class discussions enhanced learning from your peers (ISLO 5). 20

22 Assessment Instruments for Intended Student Learning Outcomes Indirect Measures of Student Learning: Objectives (Targets/Criteria) for Indirect Measures: 8. Indirect Measure 8 Objective (Target/Criterion) for Indirect Measure 8 Graduate Exit Survey Question 14 Program ISLOs Assessed by this Measure: 2 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: Use of cases in the class helped me to tie theory to real-life business problems (ISLO 2). 9. Indirect Measure 9 Objective (Target/Criterion) for Indirect Measure 9 Graduate Exit Survey Question 16 Program ISLOs Assessed by this Measure: 5 On average, graduating students will at least "Agree" (as indicated by a score of 4 or above) with the following question about the results they have achieved by completing their MBA: The amount of presentations were appropriate for a master's level program (ISLO 5). Assessment Results: Master of Business Administration Summary of Results from Implementing Direct Measures of Student Learning: 1. Summary of Results for Direct Measure 1 Of 85 MBA students who completed the Capstone Course this reporting year: % Students with Textbook Case Study sequence grade of 80% or better 96.47% % Students with Ethics Discussions grade of 80% or better 85.88% % Students with Strategy Discussions grade of 80% or better 92.94% 2. Summary of Results for Direct Measure % of MBA students who completed the Capstone course this reporting year scored 80% or better on the Exiting Final Paper. 21

23 Summary of Results from Implementing Direct Measures of Student Learning (cont): 3. Summary of Results for Direct Measure 3 USM Average Score % Students Scoring at or above IACBE Average % Students Scoring at or above National Average National Subject ID IACBE Average Average Finance % 29% Financial Accounting % 12% Management % 49% Managerial Accounting % 52% Marketing % 47% Strategy % 68% Overall Score % 24% 4. Summary of Results for Direct Measure % of MBA students who completed the Capstone course this reporting year scored 80% or better on the Capstone Presentation Series. Summary of Results from Implementing Indirect Measures of Student Learning: 1. Summary of Results for Indirect Measure 1 Question 2 The program helped me to develop problem solving skills in a way that I am able to recognize critical problems and address organizational issues. 97% Summary of Results for Indirect Measure 2 Question 3 The program improved my ability to evaluate and balance decisions characterized by competing demands or requirements emanating from the organizational, stakeholder, societal and ethical contexts. 98% Summary of Results for Indirect Measure 3 Question 5 The program improved my communication skills so that I was better equipped to convey information and knowledge in an effective and efficient manner. 81% Summary of Results for Indirect Measure 4 Question 6 The program helped me to make decisions from a strategic perspective. 98% Summary of Results for Indirect Measure 5 Question 7 The program helped me to make decisions that incorporated a global perspective. 91% Summary of Results for Indirect Measure 6 Question 8. The program helped me to make decisions by evaluating critical factors in the marketplace. 98%

24 Summary of Results from Implementing Indirect Measures of Student Learning (cont): 7. Summary of Results for Indirect Measure 7 Question 13. Class discussions enhanced learning from your peers. 78% Summary of Results for Indirect Measure 8 Question 14. Use of cases in the class helped me to tie theory to real-life business problems. 91% Summary of Results for Indirect Measure 9 Question 16. The amount of presentations were appropriate for a master's level program. 91% 4.26 Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes Learning Assessment Measures Intended Student Learning Outcomes: Master of Business Administration Case Analysis Exiting Final Paper Third Party MBA Testing Capstone Presentation Series Graduate Exit Survey Question 2 Graduate Exit Survey Question 3 Graduate Exit Survey Question 5 Graduate Exit Survey Question 6 1. Identify critical business issues facing organizations. 2. Analyze business issues from a cross-disciplinary perspective and form practical responses to these issues. 3. Assess the impact of global influences on business decisions. 4. Formulate ethical approaches to business decisions and understand how to apply these within a business context. 5. Communicate effectively in both a written and oral manner. NOT N/A N/A N/A NOT N/A N/A NOT N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 23

25 Summary of Achievement of Intended Student Learning Outcomes (cont): Intended Student Learning Outcomes Learning Assessment Measures Intended Student Learning Outcomes: Master of Business Administration Graduate Exit Survey Question 7 Graduate Exit Survey Question 8 Graduate Exit Survey Question 13 Graduate Exit Survey Question 14 Graduate Exit Survey Question 16 Indirect Measure Indirect Measure Indirect Measure 1. Identify critical business issues facing organizations. N/A N/A N/A N/A 2. Analyze business issues from a cross-disciplinary perspective and form practical responses to these issues. N/A N/A N/A N/A 3. Assess the impact of global influences on business decisions. N/A N/A N/A N/A 4. Formulate ethical approaches to business decisions and understand how to apply these within a business context. N/A N/A N/A N/A N/A 5. Communicate effectively in both a written and oral manner. N/A N/A N/A 24

26 Proposed Courses of Action for Improvement in Learning Outcomes for which Targets Were Not Met:* 1. Course of Action 1 Measuring Specific MBA Concentrations For our Graduate programs, we were not informed until 2014 that we were required to report separate outcomes for the MBA concentrations. All concentration courses at the MBA level are either in the process or scheduled for full analysis and revision (where needed) to develop appropriate objectives and measures. 2. Course of Action 2 MBA Third Party Testing Benchmarks Based upon our input from IACBE and after reviewing years of third party testing results for the MBA program, we have analyzed our performance objectives. It is clear that our performance objectives have been too high and out of line with other IACBE institutions. Having 80% of our students meeting or exceeding the national average is unrealistic. Adjusting to IACBE norms, having 50% of our students exceed the average is reasonable, so our benchmarks were adjusted for this year and will be used in future years assessments. 3. Course of Action 3 MBA Third Party Testing Results We have compared our scores across time and found some significant changes in results from one year to another. We hope to trace how changes in curriculum and possibly even instructors may have impacted these outcomes. We intend to identify key areas of success and replicate them in future iterations of our courses. 4. Course of Action 4 MBA Third Party Test as a Measure for Specific ISLOs This assessment plan seems to rely upon group averages as an indicator to demonstrate that we have met GP ISLOs 1-3. Our overall scores meet both benchmarks. It is also reasonable to imply that this test measures specific ISLOs such as a student s ability to Identify critical business issues facing organizations and analyze business issues from a cross-disciplinary perspective and form practical responses to these issues. Some sections also include questions about global influences on business decisions. However, students performance on individual sections (such as accounting or finance) do not explicitly relate to these ISLOs. Our assessment plan for next year intends to more precisely tie sections of the third party exam to specific outcomes. *These courses of action do not exclusively pertain to those learning outcomes where performance targets were not met. They are also action items to improve assessment and measurement so that we can ensure that the results truly represent whether ISLOs were met or not. 25

27 Section II: Operational Assessment (Note: Complete this section only if you received first-time accreditation or reaffirmation of accreditation after January 1, 2011.) Not Required, Accredited in