Report of Student Learning and Achievement Maastricht School of Management

Transcription

1 Report of Student Learning and Achievement Maastricht School of Management For Academic Year: Mission of Maastricht School of Management (MSM) To assist current and future managers to lead with confidence and impact, who are sensitive to context and culture, and who place a high value on integrity, respect for society and self-reflection. Student Learning Assessment for the Master of Business Administration General Program Intended Student Learning Outcomes (Program ISLOs) 1. Students will understand and master core concepts, methods, theories and tools in the business disciplines. 2. Students will identify an appropriate combination of diverse methods and tools to provide solutions to new business challenges. 3. Students will interpret complex information including the understanding of different perspectives and derive sound decisions and actions from it. 4. Students will communicate easily and convincingly conclusions regarding (new) business challenges in small teams as well as in front of larger audiences. 5. Students will have the ability to reflect on an analysis and the decision process. Intended Student Learning Outcomes: Specialization ISLOs, *Representative samples of graduations during the period. 6. Students will develop a deeper knowledge of the specialization and are able to apply this knowledge. Specialization in Accounting and Finance Students will develop a deeper knowledge of accounting and finance and is able to apply this knowledge. Specialization Corporate Strategy and Economic Policy Students will develop a deeper knowledge of corporate strategy and economic policy and are able to apply this knowledge. Specialization International Business Students will develop a deeper knowledge of international business and are able to apply this knowledge. Management and Competitive Strategy IACBE Public Disclosure of Student Learning Form 1

2 Students will develop a deeper knowledge of management and competitive strategy and are able to apply this knowledge. Entrepreneurial Drive Students will develop a deeper knowledge of the entrepreneurial world and are able to apply this knowledge. General & Strategic Management Students will develop a deeper knowledge of general and strategic management and are able to apply this knowledge. Assessment Instruments for Intended Student Learning Outcomes Direct Measures of Student Learning: Performance Objectives (Targets/Criteria) for Direct Measures: 1. Direct Measure 1: Thesis evaluation (knowledge/application) More than 70% of the students score 6.5 using a weighted average General Program ISLOs Assessed by this Measure: 1, 2 based on the facets Introduction, Literature Review, and hods in the thesis evaluation form. 2. Direct Measure 1: Thesis evaluation (critical thinking) More than 70% of the students score 6.5 based on the facet of General Program ISLOs Assessed by this Measure: 3 Discussions and Conclusions in the thesis evaluation form. 3. Direct Measure 1: Thesis evaluation (defense-communications) General Program ISLOs Assessed by this Measure: 4 4. Direct Measure 1: Thesis evaluation (self-directed learning) General program ISLOs Assessed by this Measure: 5 5. Direct Measure 2: Inbound/Outbound test General program ISLOs Assessed by this Measure: 1, 2 6. Direct Measure 2: Inbound/Outbound test General program ISLOs Assessed by this Measure: 6 Assessment Instruments for Intended Student Learning Outcomes Indirect Measures of Student Learning: More than 70% of the students score 6.5 based on the facet of Defense - communication- of the thesis evaluation. More than 70% of the students score 6.5 on the facet of Working Independently in the thesis evaluation form. At least 70% of the graduates score 8% higher in the outbound test in comparison with the inbound test. At least 70% of the graduates in a specialization score 10% higher on the subject of their specialization in the outbound test in comparison with the inbound test. Performance Objectives (Targets/Criteria) for Indirect Measures: 1. Indirect Measure 1: Satisfaction Survey More than 70% of the MBA graduates indicate that they either agree or fully agree with the achievement of each ISLOs (including the General Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5 specialization). Specialization ISLO assessed by this measure: 6 2. Indirect Measure 2: Alumni Survey More than 70% of the alumni either agree or fully agree with the General Program ISLOs Assessed by this Measure: 1, 2, 3, 4, 5 and 6. statements about the achievement of ISLOs and the impact in their professional life (including the specialization). Summary of Results from Implementing Direct Measures of Student Learning: IACBE Public Disclosure of Student Learning Form 2

3 1. Summary of Results for Direct Measure 1 The table below shows the extent to which the learning outcomes were met both in the Maastricth full-time MBA programme and a selected number of global partner programmes. The results are positive, with more than 75% of the students meeting each learning outcome. Average grades are rather high (around 75/100 in most global programmes) and as long as the variance is not too high (as is the case), the majority of students are able to reach the outcomes set. In the Maastricht program we see an improvement in students results, with the average grade moving from a 6.9 to a 7.6. This improvement can be attributed to better student selection as well as improved support throughout the whole academic program. Student understands and masters core concepts, methods, theories and tools in the business disciplines. Student can identify an appropriate combination of diverse methods and tools to provide solutions to new business challenges. Student can interpret complex information including the understanding of different perspectives and derive sound decisions and actions from it. Student communicates easily and convincingly conclusions regarding (new) business challenges in small teams as well as in front of larger audiences. Maastricht MBA 31 FHR Suriname MSMRO Romania NJU China 96% 96% 75% 90% 92% 88% 100% 90% 96% 92% 100% 90% 92% 92% 100% 90% Student has the ability to reflect an analysis and decision process. Specializations Student has developed a deeper knowledge of the specialization and is able to apply their knowledge 92% 96% 100% 95% Accounting and Finance Corporate Strategy and Economic Policy International Business Management and Competitive Strategy Entrepreneurial Drive General & Strategic Management 100% 83% 100% 84% 50% 90% IACBE Public Disclosure of Student Learning Form 3

4 2. Summary of Results for Direct Measure 2 Our second direct measure made use of the Peregrine inbound-outbound test. So far this has only been carried out fully within the Maastricht full-time MBA programme, although a number of partner schools have now also completed the outbound test (only). The intakes starting during this academic period are already doing the Inbound test as well. Therefore results of these comparisons are expected in the coming years. First, let us consider the Maastricht full-time MBA program. When looking at the 12 topics covered in the test, there were 10 areas where students on average, improved on their scores. This means that for 83% of the topics examined, improvements have been made. Moreover, the overall inbound grade was 56.52% compared to 62.39% for the outbound exam. This indicates that, on a whole, 100% of the students have improved their business knowledge by 10%. If we consider the specific learning outcomes, where we expect 70% of the students to improve their business knowledge by 8%, we see considerable improvements. Of the 25 students taking the outbound test, 76% of them improved their score by 20%. Although we do not have inbound scores for partner schools, two did take the outbound exam. The table below shows how MSM compares internationally. We see that the Maastricht programme has a higher inbound and outbound score compared to all IACBE schools. The percentage improvement of all IACBE schools is slightly better than those of MSM (17,8% compared to the MSM 10% overall). Over the next year, we will be increasing the implementation of the inbound-outbound tests at all our partner schools. Score MSM Maastricht MSMRO Romania ADA Azerbaijan IACBE (All) - International Assembly for Collegiate Business Education. IACBE Region 9 (European) Inbound 55,74 n/a n/a 46,663 49,181 Outbound 61,54 60,42 53,9 54,964 52,065 Please find below a graph representing the outbound test results of the full time MBA program in Maastricht, the MBA with ADA in Azerbaijan and the MBA of MSMRO in Romania in comparison to all IACBE schools as well as IACBE schools in the European region only. IACBE Public Disclosure of Student Learning Form 4

5 The direct measures indicate a successful achievement of the learning goals. The reason for this is due to a number of changes regarding academic support and student selection at all locations. Summary of Results from Implementing Indirect Measures of Student Learning: 1. Summary of Results for Indirect Measure 1 As an indirect measure a student satisfaction survey has been used. The table below indicates the views of the students about the MBA program and if they agree or fully agree with the statements about their achievement of the learning goals. IACBE Public Disclosure of Student Learning Form 5

6 Survey Questions Learning Goals Assessed Overall Average Learning Goals Achieved: 70% of the students rated 'Agree' or 'Fully Agree' Maastricht CBA MSMRO SIM Yemen Romania Vietnam The program offers sufficient knowledge concerning the different fields of management. The program offers adequate insight into the different paradigms and theoretical currents in the field of management. 1 75% 100% 100% 80% 1 85% 90% 100% 80% Average 1 89% 80% 95% 100% 80% The program offers sufficient knowledge of research methods. The program offers an adequate methodology to solve complex problems. The program stimulated the development of an innovative attitude. 2 60% 80% 80% 70% 2 60% 70% 100% 80% 2 75% 90% 100% 90% Average 2 80% 65% 80% 93% 80% In this program I have learned to analyse causes before designing solutions. I have learned to analyse the complexity of practical management situations. 3 80% 90% 100% 100% 3 60% 90% 100% 90% My awareness of the wider social implications of scientific knowledge has grown. I have become an autonomous and constructive critical thinker. 3 90% 100% 100% 90% 3 85% 100% 80% 90% Average 3 90% 79% 95% 95% 93% IACBE Public Disclosure of Student Learning Form 6

7 I have learned to substantiate and present my views and conclusions, to base them on sound arguments. 4 85% 100% 100% 80% My ability to work in teams has increased. 4 85% 100% 80% 90% My presentation skills have improved. 4 90% 100% 100% 100% Average 4 93% 87% 100% 93% 90% I have become a self-directed learner. 5 85% 100% 80% 90% My need to continue learning has increased. 5 90% 89% 100% 80% Average 5 89% 88% 95% 90% 85% The program offers adequate knowledge about the specialization field. 6 65% 100% 80% 50% Average 6 82% 65% 100% 80% 50% In total 87% of the students agree and fully agree with the statements about the achievement of the learning outcomes and this is very positive. However it is surprising that the students from the fulltime program were more neutral regarding statements about research methods. The thesis procedure and evaluation has become more rigorous and the MBA intake 31 worked harder and earlier in the research proposal. IACBE Public Disclosure of Student Learning Form 7

8 Average Percentage of Students who either agree or fully agree with the statements concerning Learning Outcome achievement Maastricht CBA Yemen MSMRO Romania SIM Vietnam 78% 94% 93% 83% 2. Summary of Results for Indirect Measure 2 As a second indirect measure MSM is using an alumni survey to see if alumni have incorporated the learning outcomes from their study program into their professional career. As the table below indicates on all aspects 75% or more of the MBA alumni have rated the statements with either agree or fully agree. These results are very positive. Survey Questions I became a business practitioner that masters the core concepts, methods and tools in the main functional areas of management. I became a capable business analyst with the skills to identify and provide solutions to new business challenges and the ability to reflect on and analyze decision processes. Learning Goals Assessed Learning Goals Achieved: 70% of the alumni rated 'Agree' or 'Fully Agree' 1 80,79% 2 85,31% IACBE Public Disclosure of Student Learning Form 8

9 I became a business practitioner able to develop solutions for complex problems in a globalized environment, as well a in emerging markets. I became an autonomous and constructive critical thinker that can interpret and give solutions to complex information from various management fields and derive sound decisions and actions from it. I became a socially responsible leader that can identify the interrelationships between business and its social and natural environment and operationalize in the management of organizations. I became a persuasive communicator of business knowledge and management decisions to specialist and non-specialist audiences. I became a business practitioner with adequate leadership and team skills. I became an ethically responsible leader that is able to recognize ethical problems and apply standards of ethical behavior in decision making. I became a self-directed and autonomous learner able to increase my intellectual curiosity. I became a business practitioner able to articulate the major theories and concepts in the area of my specialization. 2 79,66% 3 88,13% 3 84,18% 4 83,05% 4 84,18% 5 91,52% 5 92,66% 6 81,36% IACBE Public Disclosure of Student Learning Form 9

10 Extent of Accomplishment of Intended Student Learning Outcomes: Intended Student Learning Outcomes General Program Intended Student Learning Outcomes 1. Students will understand and master core concepts, methods, theories and tools in the business disciplines. 2. Students will identify an appropriate combination of diverse methods and tools to provide solutions to new business challenges. 3. Students will interpret complex information including the understanding of different perspectives and derive sound decisions and actions from it. 4. Students will communicate easily and convincingly conclusions regarding (new) business challenges in small teams as well as in front of larger audiences. Direct Measure 1 Thesis Evaluation Master of Business Administration Learning Assessment Measures Direct Measure 2 Inbound-Outbound test Indirect Measure 1 Satisfaction Survey Indirect Measure 2 Alumni Survey Performance Target Was Performance Target Was Performance Target Was Performance Target Was X X X X X X X X X X X X X X X X IACBE Public Disclosure of Student Learning Form 10

11 5. Students will have the ability to reflect on an analysis and the decision process. Intended Student Learning Outcomes: Specialization 6. Students will develop a deeper knowledge of the specialization and are able to apply this knowledge. X X X X Direct Measure 1 Thesis Evaluation Direct Measure 2 Inbound-Outbound test Indirect Measure 1 Satisfaction Survey Indirect Measure 2 Alumni Survey Performance Target Was Performance Target Was Performance Target Was Performance Target Was X X X X Proposed Courses of Action for Improvement in Learning Outcomes for which Performance Targets Were : 1. Course of Action 1 An evaluation format regarding the thesis and the supervison will be introduced with the objective to understand more about the time that students need to invest overall in the final project and to and assess what can be improved (currently this is partially covered in the Satisfaction Survey but it is useful to have more specific information). 2. Course of Action 2 The implementation of the Inbound-Outbound test will continue across all locations. 3. Course of Action 3 The results of the indirect measure 1 (the student satisfaction survey) are positive about the achievement of the learning outcomes. However, there are areas with room for improvement. The Academic Coordinator and the Academic Cluster Heads will continue revising the courses that have been taught and discussing with the local coordinators where improvements could be made. The Satisfaction Survey and the results so far will be discussed in the Annual Parnters Conference. IACBE Public Disclosure of Student Learning Form 11

12 Student Learning Assessment for Doctor of Business Administration General Program Intended Student Learning Outcomes (Program ISLOs) 1. Students will have ability to determine a clear managerial problem statement, and to translate it into clear research objectives and questions. 2. Stundent will have ability to perform a sound literature review, to develop a strong conceptual model and related research design. 3. Students wil have ability to apply the appropriate research methodology and to analyze qualitative and/or quantitative research data in a valid and reliable manner. 4. Students will have ability to present the research outcomes and conclusions in a clear and consistent manner, and to report on practical implications of the study, its methodological limitations, and recommendations for further research. 5. Students will have ability to disseminate research progress and outcomes in both professional and academic conferences and in peer-reviewed journals. 6 Stuents will have ability to become globally-oriented leaders, managers and innovators in business, prepared to address the major global transformations and issues that determine the international business environment. Assessment Instruments for Intended Student Learning Outcomes Direct Measures of Student Learning: 1. Direct Measure 1: MPhil defenses Criterion for Direct Measure 1 General Program ISLOs Assessed by this Measure: 1,2,3, 4 Thesis evaluation by MPhil evaluation committee: The Director of Research and Doctoral Programs forms a committee existing of at least three evaluators [the candidate s supervisor(s), their reader and the Director of Research and Doctoral Programs]. These committee members will assess the research proposal and inform the Director of Research and Doctoral Programs prior to the MPhil defense. 2. Direct Measure 2: DBA defenses Criterion for Direct Measure 2 General Program ISLOs Assessed by this Measure: 1,2,3,4,5,6 Dissertation evaluation by the DBA evaluation committee: The Director of Research and Doctoral Programs forms a committee existing of at least 5 evaluators (candidate s supervisor(s), MSM reader, 2 external reviewers, and the Dean). These committee members will assess the DBA dissertation and inform the Director of Research and Doctoral Programs prior to the DBA defense. Performance Objectives (Targets/Criteria) for Direct Measures: Proposal should describe a sound research problem and include a literature review, conceptual framework, hypotheses, and details of the methodological approach. Dissertation should be a contribution to the body of knowledge and be based on a sound literature review, conceptual framework, hypotheses, methodological approach, analyses of empirical data and the drawing of conclusions. IACBE Public Disclosure of Student Learning Form 12

13 Assessment Instruments for Intended Student Learning Outcomes Indirect Measures of Student Learning: Performance Objectives (Targets/Criteria) for Indirect Measures: 1. Indirect Measure 1: Satisfaction Survey (end of the program) Objective (Target/Criterion) for Indirect Measure 1 General Program ISLOs Assessed by this Measure: 1,2,3,4,5 80% agree with positive statements about the achievement of each individual SLOs. 2. Indirect Measure 2: Alumni Survey Objective (Target/Criterion) for Indirect Measure 2 General Program ISLOs Assessed by this Measure: 6 Summary of Results from Implementing Direct Measures of Student Learning: 1. Summary of Results for Direct Measure 1 MPhil defenses 80% alumni face a positive influence of their DBA study in their professional career. During the period September , there were 23 satisfactory MPhil defenses. This number matches the expectations according to the number of enrolled students in the previous years and the deadlines set for the submission of the disertations in agreement with the supervisors. 2. Summary of Results for Direct Measure 2 DBA defenses During the period September , there were 9 satisfactory DBA defenses. This number is stable in relation to previous years and it reflects a satisfactory rhythm in the process of DBA supervison. Summary of Results from Implementing Indirect Measures of Student Learning: 1. Summary of Results for Indirect Measure 1 Satisfaction Survey: With the aim to better reflect the achievement of learning outcomes, the Satisfaction Survey template is under revision and it will be run at the end of Summary of Results for Indirect Measure 2 Alumni Survey: 88% of the graduates in 2015 responded to the survey and 100% indicated they already experienced a positive influence of the DBA degree in their career. Even though this is survey was held a short period after their graduation, 80% indicated they received a promotion. IACBE Public Disclosure of Student Learning Form 13

14 Extent of Accomplishment of Intended Student Learning Outcomes: Intended Student Learning Outcomes General Program Intended Student Learning Outcomes 1. Ability to determine a clear managerial problem statement, and to translate it into clear research objectives and questions. 2. Ability to perform a sound literature review, to develop a strong conceptual model and related research design. 3. Ability to apply the appropriate research methodology and to analyze qualitative and/or quantitative research data in a valid and reliable manner. 4. Ability to present the research outcomes and conclusions in a clear and consistent manner, and to report on practical implications of the study, its methodological limitations, and recommendations for further research. 5. Ability to disseminate research progress and outcomes in both professional and academic Program 2 Doctor of Business Administration Direct Measure 1 MPhil defenses Learning Assessment Measures Direct Measure 2 DBA defenses Indirect Measure 1 Satisfaction Survey Indirect Measure 2 Alumni Survey Performance Target Was Performance Target Was Performance Target Was Performance Target Was IACBE Public Disclosure of Student Learning Form 14 X X X X X X X X X X X X X X X

15 conferences and in peer-reviewed journals. 6. Ability to become globallyoriented leaders, managers and innovators in business, prepared to address the major global transformations and issues that determine the international business environment. X X X X Proposed Courses of Action for Improvement in Learning Outcomes for which Performance Targets Were : 1. Course of Action 1 The DBA satisfaction survey template is under revision. A set of questions regarding the learning outcomes will be added. The survey will be run again in December 2015 and the results will be updated in the Outcomes Assessment Results. IACBE Public Disclosure of Student Learning Form 15