Assessment Summaries of ACBSP Accredited Programs. College of Management

Transcription

1 Assessment Summaries of ACBSP Accredited Programs College of Management

2 B.S. in Business Administration Program Directors: Mark Fenton Total Student Enrollment: 719 a. Peregrine CPC Exam b. Multi-section Common Final Exam c. Capstone Reviews d. Co-op Employer Evaluations a. PRC Surveys (student, faculty, board member) and Career Services Employment Data b. PARQ Alumni Follow-up (program, employer, student) c. Co-op/Internship Self-Assessment d. Program Facts and Enrollment 3. The PRC Key Instructors Survey (n=11/16) asked key staff to rate on a 5 point scale (5 being strongly agree), how they felt about 13 items across multiple areas. Mean scores ranged from 3.55 to 4.55 with Departments schedule an adequate number of course sections being rated lowest and Program Director s leadership is satisfactory as highest. 4. The PRC Student Survey (n=69/376) asked junior and senior students to rate on a 5 point scale (5 being strongly agree), how they felt about 20 items across multiple areas. Mean scores ranged from 3.42 to 4.22 with The coursework in ethnic studies being rated lowest and Instructors in my program are accessible for help outside of regular class time as highest. 5. The One-year Alumni Follow-Up Survey (n=28/163) asked alumni to rate on a 5 point scale (5 being excellent), how prepared they felt on 14 items. Mean scores ranged from 3.1 to 4.1 with Economics and International/global business being rated lowest and Marketing as highest. 6. Charts showing CPC results indicated that across 15 categories, scores ranged from very low to better than average with most ratings falling in the close to or better than average range. 7. For the Student Co-Op Employer Evaluation 98% of employers said they would hire their student again. 8. Student Co-Op Employer Evaluation data indicates, in general, employers were well satisfied with BSBA co-op students. Dissemination 9. Program faculty, deans, administration, BSBA Advisory Board Program Improvements 10. Program expanding the number of external advisory board members. Two new external members and one internal new member have joined the advisory board. More frequent meetings are also scheduled.

3 11. In Fall 13 Management Ethics was implemented. The new course BUMGT-235 (Management Ethics) has been well received by students and the long-term impact will be determined via future assessments. 12. Selecting an assessment coordinator has clearly strengthened the program. Faculty have been adapting common rubrics to have more uniform assessments. 13. The Advisory Board is now made up of a majority of business and industry professionals. 14. Expand the size of the BSBA Advisory Board to include more business and industry professionals. 15. More use of assessment rubrics on writing and oral presentations. 16. Increase the number of students from other countries. 17. Continue to encourage students to complete a study abroad opportunity with a goal of 20% of students doing at least one study abroad. 18. Improve marketing efforts to increasing the number of women and minorities in the program. 19. Continue to complete course revisions with the hopes of completing all by 2016.

4 B.S. in Management Program Directors: Wendy Dittmann Total Student Enrollment: a. Peregrine Common Professional Competencies (CPC) exam b. Locally designed quizzes, tests, and inventories c. Portfolio artifacts d. Capstone projects a. Employment data (Annual Employment Report) b. Program Student Survey c. PRC Survey d. Alumni Follow up Survey e. Enrollment, Retention Graduation Rates (Program Facts) 3. For graduates, there was a 97% employment rate with a median salary of $56,000 reported. 4. For program graduate applicants rated the importance of and their preparation on the program objectives on a 5-point scale (1=low, 5=high). For importance, mean scores ranged from and for preparation, mean scores ranged from For 13-14, Management student scores fell in the Average range on the Peregrine CPC exam. 6. On the formative assessment in INMGT-200, students performed near or above the 75% goal. 7. On the portfolio for INMGT-460, 90% of Fall 2013 and 100% of Spring 2014 students scored above 90%. 8. The percentage of students scoring above the reasonable to exceptional rank on the business plan rubric was 93% in Fall 2013 and 91% in Spring Green Belt certification was awarded to 10 students in the Quality Capstone. 10. Graduates of the B.S. in Management are employed at a rate consistent with other graduates of UW-Stout, 97%, and earn among the four highest average salaries. 11. Based on the PRC Survey, the program continues to show strengths in enrollment and outcomes (graduates). 12. Five year graduates responding to the [Alumni Follow-up] survey have consistently valued their Stout and BSM degree higher than one-year graduates. 13. BSM scores [on the Peregrine Exams] are slightly higher than other ACBSP accredited Stout programs and at par with other online ACBSP accredited programs. Dissemination 14. COM Associate Dean, COM Assessment Coordinator, Program Advisory Board and UW Information Portal. Program Improvements 15. Created assessment map of program objectives. 16. Formative assessment added in INMGT Continuation of Peregrine CPC Test to capstone classes. 18. Provided more complete interpretation of assessment results. 19. Encourage the use of developed rubrics, written and oral communication, by faculty within college. 20. Implement assessment in BUACT Develop new assessment measure in INMGT Collect data points over time.

5 B.S. in Retail Merchandising and Management Program Directors: Adel Mekraz Total Student Enrollment: 273 a. Course embedded assessments b. Peregrine CPC Exam c. Retail Company Profile Oral Presentations d. Employer Evaluation of a Co-op Student a. Career Services Annual Placement Report b. PRC Student, Faculty, and Advisory Board Surveys c. PARQ Alumni Follow-Up (General and Program Specific) d. Feedback from Industry Advisors e. Program Facts 3. Ninety-eight percent of graduates were employed with an average salary of $41, Employer evaluations of coop students on 17 items had overall scores ranging from with Initiative being the lowest and Team Work being the highest rated items. Overall, corporate interns received higher evaluations than store interns, with an average score of 4.11 compared to BUACT-206 Final: The average score (N=45) for RMM majors in was 66.95%. 6. Merchandise Planning & Control Pre/Post: For the 168 students who took the test, mean scores improved points from (pre) to (post). 7. Peregrine CPC Exam: The mean score was in FA13 and in SP14 which places students in the average category. 8. Retail Company Profile Oral Presentation: Students scored better in oral communications in person mean scores range from 3.5 to 3.8 and online mean scores range from 3.3 to The 10% decline in enrollment is a concern. 10. Mean scores on the alumni follow-up survey were on the low end of the spectrum compared to other programs at UW-Stout. This may be due to the visual merchandising lab lacking particular technology and software that some competitors have. 11. RMM students scored better in oral communication skills in the in-person course section than they did in the online section. It is not clear at this point what the reason is other than the perhaps because of the difference in the method of course delivery. Dissemination 12. RMM Advisory Board, external stakeholders via the Stout website. Program Improvements 13. A new rubric has been introduced this year for the measurement of Oral Communication Skills. 14. Program directors and assessment coordinator all have been working together on the development of a rubric which will be used to measure critical thinking, problem solving and analytical skills. 15. Expanded implementation of direct assessment methods to reach more RMM students. 16. Starting the academic year, the BURTL-451 Retail Practicum II course has started using the same measurement instrument that was used to assess student performance in the senior-level co-op experience. 17. RMM program will begin assessing oral communication skills at the freshman and sophomore levels. 18. The plan is for the RMM program to start using critical thinking rubric to assess critical thinking skills during the academic year.

6 B.S. in Supply Chain Management Program Directors: Gene Gutman Total Student Enrollment: 69 a. APICS Certification Exams (Supply Chain Basics; Master Planning of Resources) b. Course embedded assessments c. Capstone project evaluation d. Co-op employer evaluation a. Career Services data (employment reports; co-op salary information) b. Student co-op self-assessment c. PRC Surveys d. Alumni Follow-Up Survey e. Program Facts 3. Average hourly wage for co-op students was $16.53 per hour; Based on informal reporting, annual starting salaries ranged from $50,000 - $60,000 per year for SCM graduates in Student co-op self-assessment: On a 5-point scale (1-strongly disagree, 5=strongly agree), the average rating across questions was All students would recommend their co-op to others. 5. APICS Exams: 75% (9/12) students passed the Supply Chain Basics Exam, which is even with the national average. 67% (8/12) students passed the Master Planning of Resources exam which is slightly below the national average. 6. BUACT-206 Exam: SCM students (n = 21) scores averaged 75.44%, which is 6.08% above the average across COM. 7. Capstone Projects: out of 21 students 3 students were rated Outstanding, 9 were rated Above Average, and 5 were rated Average. No students were rated Not Acceptable. 8. Co-op employer student evaluation: 100% of employers gave ratings of Satisfied or better; 11 of 12 employers said they would hire the person again. 9. SCM students are in high demand and their skills are relevant as evidenced by the hourly wage of co-op students. 10. Based on student feedback to the Program Director, all students are employed in a field directly related to Supply Chain Management. 11. Enrollment has increased at a compound annual growth rate of 33.1% since the program started in Strong job demand in industry, capable graduates, and high salaries are driving enrollment numbers. 12. Performance has improved significantly during the last year on the APICS Basics of Supply Chain Management exam and the APICS master Planning of Resources exam. 13. SCM students demonstrated a higher comprehension of accounting concepts that other majors due to the higher admission standards and graduation GPA requirements for the SCM major. 14. The Advisory Board treats the capstone project review as if they were reviewing a project in their business. Assessment ratings indicate students can diagnose, design and optimize a supply chain. 15. Based on FA2013 and SP2014 data, student performance in co-ops is strong, employers are very satisfied and students value the experience.

7 Dissemination 16. Dean s Office, COM, Advisory Board, faculty, Department Chairs Program Improvements 17. The number of APICS exams were expanded from one to two for the year. 18. The instructor of INMGT-405 created videos for students to review prior to class, which improved student learning as evidenced by the improved APICS test scores. 19. Course mapping to learning objectives has started to align assessment measures with program objectives. 20. Developed and expanded rubrics, piloted courses, and created program revisions. 21. Implemented Advisory Board Members as mentors. 22. Recommendations from last year s AIM Report were addressed. 23. Implement program revisions and additional foundation classes. 24. Work with COM Associate Dean and Department Chairs to improve learning in foundation classes. 25. Develop and implement a pilot for BUSCM-341 Global Supply Chain Modeling and Optimization with a goal to offer it Spring Continue to improve student learning in INMGT-305/INMGT-405 to impact APICS exams pass rate. 27. Expand assessment of co-op evaluations. 28. Begin to collect and analyze survey data from graduates from the prior year. 29. Expand the rubric to assess BUSCM-460 Supply Chain Design I Capstone Project Evaluation and BUSCM-461 Capstone Project Evaluation.

8 M.S. in Operations and Supply Management Program Directors: James Keyes Total Student Enrollment: a. Industry Certification Tests (APICS Certification Exams) b. Capstone Projects (Plan B paper) c. Team / Group Projects and Presentations a. PRC Student, Faculty, and Advisory Board Surveys b. PARQ Alumni Follow-up Survey (general, program specific, and employer) c. Enrollment by Segmented Groups, Graduation Rates, and GPA from program facts d. Student Survey on Importance and Preparation 3. PRC: Student Survey mean results range from 3.27 to Faculty Survey mean results range from 3.00 to (1=strongly disagree; 5=strongly agree). The Advisory Board Survey indicates agreement that they have the opportunity to make recommendations and have an impact on program decisions. 4. PARQ Alumni Follow-up (n=3): Mean importance rating = 3.80, Mean preparation rating = 3.00 and Mean overall benefit to career advancement = All ratings were on a 5-point scale. 5. There were 49 new students in in the MS OSM program. The median amount of time to graduate was seven semesters. The mean undergraduate GPA for these students was Student Survey on Importance and Preparation: Mean for students perception of the degree of importance for each objective = 4.53, Mean for degree of preparation of objectives = 3.95, Mean for students perception of the overall benefit of the program = All ratings were on a 5-point scale % (11 out of 15) of students passed the APICS Basics of Supply Chain Management certification exam. 40% (6 out of 15) of students passed the APICS Master Planning of Resources (MPR) certification exam. Students in the MS OSM program underperformed on the MPR compared to the national mean pass rate. 8. All 9 students completed the Capstone Project (Plan B Paper) at an acceptable level for Students reported that the program has good program direction and instructors, variety of classes and content, and the practical application to the industry. Student identified the weaknesses of the program to include too much focus on group/team projects and not enough on-campus courses. 10. The faculty and advisory board identified strengths of the program included broad course offerings and good job outlook after graduation. The weaknesses reported by the instructors include the need for more courses and more assistance to international students. The advisory board reported a need to increase the pace of graduation time and expand the program market. 11. The alumni completing the PARQ survey had overall positive responses and showed that the objectives of the program have importance and relevance in their careers. 12. The enrollment of students in the MS OSM program has increased again this year, continuing a four year trend. Lack of a marketing plan is restricting the enrollment opportunities. 13. The Student Survey on Importance and Preparation response score means for the past several years is showing that the degree of importance is trending in a positive directions. This indicates that the MS OSM program is delivering increasingly important topical coverage. However the scores from the survey this year may indicate that students are not feeling as prepared as they have been in previous years, which may indicate that the program needs to evaluate how to better prepare students for a career in operations management. Dissemination 14. COM Associate Dean, COM Assessment Coordinator, and the MS OSM Advisory Board. The report will also be posted on the UW-Stout website.

9 Program Improvements 15. Developed an assessment rubric for the Plan B papers. 16. Developed an evaluation system to measure student success in completing the MS OSM program. 17. Began surveying students at the completion of their coursework. 18. Developed a survey to measure the impact and performance of students activity in INMGT 640 Lean Enterprise. The survey measures the impact of the students work. 19. Implement the use of the Lean Enterprise impact survey starting in the FA Review the use of APICS exams as an external assessment at the advisory board SP2015 meeting.