KNPE/M.S. Sport Management Assessment 1 2013 Review of the MS in Sport Management PROGRAM DESCRIPTION The Master of Science in Sport Management degree is designed to prepare students for a management career in the sport industry. Students attain theoretical knowledge and practical skills in preparation for various sport managerial careers in athletic and sport organizations, amateur, intercollegiate, and professional sports, equipment merchandising, and sport consulting. PROGRAM LEARNING OBJECTIVES The program was developed according to the program standards and guidelines established by the North American Society for Sport Management (NASSM). NASSM is the organization which represents scholars and practitioners in the discipline of sport management. Members of NASSM come from throughout the United States and Canada, and represents institutions offering sport management curricula. NASSM's standards and guidelines provide a level of quality assurance for students enrolling in sport management programs and employers hiring graduates of sport management programs. While NASSM does not certify programs, it does provide a program approval rating which signifies to students and potential employers that students who graduate from a NASSM approved program are prepared in content areas and have acquired knowledge and skills to become a professional sport manager. Sport management programs throughout North America can choose to be accredited by The Commission on Sport Management Accreditation (COSMA), based on the NASSM standards. There is no current mandate that sport management programs in its jurisdiction must be accredited. The NIU Sport Management program, although not accredited, follows and is in full compliance with the COSMA standards, but due to time and financial constraints, has chosen not to complete the accrediting process. Upon the completion of the M.S. in Sport Management degree program at NIU, students should be able to demonstrate competencies in the eight NASSM standards and guidelines shown below: 1. Apply management, leadership, and organizational concepts, principles, and theories in directing a sport organization. 2. Design, analyze, and evaluate research in sport. 3. Understand, apply, and analyze legal concepts related to sport. 4. Construct and utilize marketing concepts and principles in marketing sport. 5. Identify and analyze the current issues and problems facing sport. 6. Apply fiscal management practices in managing a sport organization. 7. Function as an ethical practitioner in the sport industry. 8. Demonstrate advanced knowledge, skills, and competencies in a practical (internship) sport organizational setting.
KNPE/M.S. Sport Management Assessment 2 EXPLANATION OF ASSESSMENT METHODS. The following chart shows how each objective will be assessed, including the assessment method, targets, time line, and persons responsible. Method Target Timeline Person Responsible Objective Addressed Internship evaluation by site supervisor. Supervisors are provided with a mid-term and final evaluation form that asks them to evaluate each student on a 5-point scale each of the program learning objectives (NASSM standards). All students are expected to score at or above average on the 5-point scale (3 or better). Fall, Spring, and Summer semesters. Program Director collates evaluations from site supervisors. Objectives 1, 3, 4, 6, 7, & 8. Course related evidence. Portfolio. Each student is required to develop a portfolio to reflect the 8 broad student learning program objectives. The portfolio can consist of materials from course work such as course papers, presentations, and projects, as well as materials develop during the internship experience. Thesis or Master s Paper. Students in the thesis option must complete a research study. Students electing the Master Paper submit a research paper that then forms the basis for a project. Advisory Board/Employer Survey. Meets once a year and asks board members (employers of program graduates) to comment on the program, make suggestions for program changes based on industry trends as they related to the NASSM standards. It is expected that all student portfolios will meet the passing requirements for demonstrating that all NASSM standards have been met. Any standard not met must be redone. For the thesis or masters paper students need to meet the passing standard for each learning outcome identified. An 80% pass rate is the target. No specific targets are set. The expectation is that the board will provide information on the degree to which the program is minimally meeting their needs as employers and ideally exceeds meeting their needs as employers. End of Fall, Spring, and Summer semesters. Program Director. Portfolio addresses all objectives. Thesis addresses objectives 1 7. Master paper: research paper address objectives 2 and 5; project 1, 3-7. Annually. Program Director. Objectives 1 & 3-7.
KNPE/M.S. Sport Management Assessment 3 Alumni Survey. Sent to program graduates to determine their satisfaction with the program and how well the program prepared them for their career. Items are also focused on how well the program met the NASSM standards. Exit interviews. Conducted with students at the end of their program of study. Addresses how well prepared students feel they are, what areas they feel they need more preparation in, which courses they feel have prepared them most, and any changes they would like to see to the program. Student responses to the alumni survey with respect to program satisfaction and career preparation are analyzed. Target is for 85% to report that they are satisfied and were well prepared for their career. The target is that 85% of students report having a positive experience and that feel well prepared for their career. Exit interviews are also analyzed to identify areas in which students felt unprepared as well as areas in which they felt well prepared to provide evidence for curricular and program review. Sent to graduates 1, 5, 9 years postgraduation. As students complete their program of study. Program Director. Objectives 1 4, 6, & 7. Program Director. Objectives 1 7. LEARNING OUTCOMES BY METHOD Objective Internship Supervisor Course Materials Advisory Board Alumni Survey Apply management, leadership, and organizational concepts, principles, and theories in directing a sport organization. X X X X Design, analyze, and evaluate research in sport. X X X Understand, apply, and analyze legal concepts related to sport. X X X X X Construct and utilize marketing concepts and principles in marketing sport. X X X X X Identify and analyze the current issues and problems facing sport. X X X Apply fiscal management practices in managing a sport organization. X X X X Function as an ethical practitioner in the sport industry. X X X X X Demonstrate advanced knowledge, skills, and competencies in a practical (internship) sport organizational setting. X X Exit Interview
KNPE/M.S. Sport Management Assessment 4 CHALLENGES TO THE IMPLEMENTATION OF THE PLAN The MS in Sport Management program has faced several challenges in the past few years, including a lack of consistent faculty in the program, a very high enrollment level (some classes having 40 students in a graduate-level course), and a lack of time and resources to develop and implement the needed changes. Since 2004, the program has not been able to maintain a second faculty member in place long enough for the coordinated implementation of the assessment program. For four years there was only one faculty member both teaching and directing the program, using adjunct faculty to cover the needed courses in the program. This hindered curricular innovation and progression. After attaining a full-time tenure track faculty member, the curricular issues of the program were addressed and development was able to occur to enhance the learning experience of the students, as well as better fulfill the eight NASSM Guidelines that the program is built upon. After two years the second faculty member left and a one-year visiting professor was hired, and subsequently brought in on a full-time tenure track basis the next year. Without the coordination of a consistent continual faculty, development and implementation of the program assessment plan becomes very difficult. During this period the program has been able to consistently collect assessment data through the surveys conducted with internship supervisors, alumni surveys (although return rates have been low), the use of the Masters Paper to assess course materials, and through the exit interviews. Through these methods, all the program outcomes have been assessed although the program team recognizes that some of the assessment methods need to be refined and that using all the proposed methods outlined in the program would provide a more comprehensive evaluation of the program. FULLY IMPLEMENTING THE ASSESSMENT PLAN Significant progress has been made on implementing the assessment methods identified in the plan but which have not been employed for the past few years. In addition, through feedback from the annual assessment reports, revisions have been made to the assessment methods that have been consistently used. The plan will be fully implemented by the end of the 2013 calendar year. Advisory Board. Progress has been made on identifying advisory board members and establishing a process. At the outset the Board will consist of four individuals in professional sports fields and one in intercollegiate sports. Three of the Board members are NIU sport management alumni, one is a NIU alumni, and the other is an employee of NIU in the NIU Athletic Department. The Board will meet at least once per year and is scheduled to meet Spring 2013. The Board will review industry requirements as well as evaluate the program based on the eight NASSM standards. The responsibility of the Board will also include an assessment of sample papers, class projects, and portfolios submitted to the program director. In addition, the board will review student satisfaction surveys and student exit interview reports to determine if students are meeting the competencies of the designed program. The board will make any
KNPE/M.S. Sport Management Assessment 5 recommended changes to the director of the program. Any changes in the program must be evidenced and approved by the university curricular process. Course Materials. Currently course related evidence is focused on the Masters Paper. Course evidence was also envisaged to include the development of a portfolio. Each student in the program will be required to develop a portfolio to reflect the 8 broad student learning program objectives. The portfolio will consist of articles that the student deemed important to their personal and intellectual development during the program (e.g. papers, projects, commentary on projects, etc.). The student will be provided with the eight NASSM Standards, and asked to comment on how their experience in the program helped them successfully attain competence in those standards. This document (in disc form) will be turned in to the course instructor at the end of the semester and then given to the program director for later evaluation and comment as well as being available to the Advisory Board for review. Portfolios will be developed to meet the needs and interests of the students, whereas, some students are focused on the management of professional sports, others might focus on intercollegiate athletics or community based programs. A rubric is being developed for assessing the Portfolio and beginning in fall 2013, all students will be required to complete a portfolio of materials they create or participate in during their tenure in the MS in Sport Management program. The program has two culminating courses (LESM 699A: Master s Thesis in Sport Management & LESM 698: Master s Paper). The LESM 699A course incorporates NASSM standards 1-7; LESM 698 incorporates NASSM standards 1-7. The thesis is a research study a student undertakes on a contemporary sport management issue. The LESM 698 course is a research paper that informs a potential project implementation. Refinement in Existing Methods. Using feedback from the annual assessment updates, changes have been made and additional changes are in progress to refine the assessment methods that have employed. Areas identified for improvement included establishing rubrics to more effectively assess the course materials rather than rely on a final grade for the work. Course Materials: The Master s Paper class (LESM 698) is the most popular option for students in the MS in Sport Management in order to fulfill the master s thesis/master s paper requirement of the program. A rubric has been developed to evaluate the quality of that paper/project and is attached to this document. The rubric identifies key elements of the paper that address each of the outcomes and objectives embedded in the work. In addition a similar rubric has been developed for the LESM 699A thesis option and is also attached. Internship Evaluation: An on line evaluation tool has been developed and posted to the program website for site supervisors of student internships. This has been in operation since Fall 2012. The internship evaluation can be found at: http://www.cedu.niu.edu/knpe/programs/sportmgmt/internships/evalform.shtml Exit Interviews: An anonymous exit interview tool will be developed for graduating students. The tool will be developed by the end of the spring 2013 semester and used at the end of that semester. The tool will be sent to those students that have indicated they are planning to graduate in a particular semester, and based on the perceived attainment of the student in accordance with the eight NASMM Standards. The data will be collected and aggregated for the entire year.
KNPE/M.S. Sport Management Assessment 6 Alumni Survey: The alumni survey is distributed through the NIU Alumni office. The response rate is very low and may not serve the program s needs for future assessment. The Program will investigate the implementation of a program-based survey through the Linked In professional networking tool that is currently used by students currently in the program and graduates to stay connected.
KNPE/M.S. Sport Management Assessment 7 MS in Sport Management Portfolio Rubric STANDARD Apply management, leadership, and organizational concepts, principles, and theories in directing a sport organization. Design, analyze, and evaluate research in sport. Understand, apply, and analyze legal concepts related to sport. Construct and utilize marketing concepts and principles in marketing sport. Identify and analyze the current issues and problems facing sport. DID NOT MEET (Limited or no evidence lacking any depth or breadth or integration or synthesis) Evidence is missing on one or more of the elements related to management, leadership, and organizational concepts. Summary fails to clearly link evidence with a demonstrated application to an organization. Evidence is missing on one or more items demonstrating knowledge of research design, statistical analyses of data, and the ability to use results to test hypotheses and deliver evidencebased recommendations. Evidence is missing on one of more items demonstrating the ability to apply and analyze legal issues in sport related industries. Limited evidence of having constructed, applied, and evaluated a marketing plan. Limited evidence identifying or showing an understanding of current issues facing the sport industry and little analysis of any of the issues identified ADEQUATELY MET (Some evidence but lacking in consistency and quality with some depth and breadth but limited integration and synthesis) Evidence is provided on most of the elements related to management, leadership, and organizational concepts. Summary makes some link to evidence provided and a demonstrated application to an organization. Evidence provided that demonstrates an understanding of research design, statistical analyses but limited evidence of the ability to translate the findings into clear evidence-based recommendations. Evidence is provided that shows an understanding of the range of legal issues encountered in the sport industry but with little application or analysis to specific contexts. Some evidence that shows an understanding of how to develop a marketing plan but limited evidence of application and effective evaluation. Some evidence that shows an understanding of a range of current issues facing the sport industry but with little accompanying analysis. FULLY MET (Comprehensive evidence that is consistent and compelling with depth and breadth and integration and synthesis) Evidence is provided on all of the elements related to management, leadership, and organizational concepts. Summary comprehensively links evidence with a demonstrated application to an organization. Compelling evidence provided that demonstrates both a clear understanding of research design, statistical analyses, and the ability to translate research findings into evidence-based recommendations. Comprehensive evidence that shows both a clear understanding of the range of legal issues and their application and analysis to real world sport industry examples. Clear evidence of the ability to develop a marketing plan and also apply it to a sport industry context and evaluate the effectiveness of the plan. Comprehensive evidence that shows breadth and depth of the issues facing the sport industry and a coherent and compelling analysis.
KNPE/M.S. Sport Management Assessment 8 Apply fiscal management practices in managing a sport organization. Function as an ethical practitioner in the sport industry. Demonstrate advanced knowledge, skills, and competencies in a practical sport organizational setting. Limited evidence of having constructed, applied, and evaluated a fiscal management plan. Limited evidence is provided that demonstrates an understanding of the ethical considerations in the sports industry or describes more than instance of having acted ethically. Limited evidence provided of industry experience. Summary fails to articulate a breadth and depth of the knowledge and skills acquired working in a sport organization. Some evidence that shows an understanding of how to develop a fiscal management plan but limited evidence of application and evaluation. Some examples are provided that show a clear understanding of the ethical considerations in the sports industry. Some examples of having acted ethically within a practical or applied setting are described. Some evidence provided of industry experience. Summary describes some knowledge and skills acquired working in a sport organization. Clear evidence of the ability to develop a fiscal management plan and also apply it to a sport industry context and evaluate the effectiveness of the plan. Comprehensive evidence is provided that demonstrates a depth of understanding of the ethical considerations in the sports industry. Multiple examples of having acted ethically within a practical or applied setting are described. Extensive evidence provided of industry experience. Summary articulates a breadth and depth of knowledge and skills acquired working in a sport organization.
KNPE/M.S. Sport Management Assessment 9 MS in Sport Management Thesis Rubric STANDARD Apply management, leadership, and organizational concepts, principles, and theories in directing a sport organization. Design, analyze, and evaluate research in sport. Understand, apply, and analyze legal concepts related to sport. Construct and utilize marketing concepts and principles in marketing sport. DID NOT MEET (Limited or no evidence lacking any depth or breadth or integration or synthesis) Thesis does not utilize current management, leadership, and organizational concepts and theories to formulate the research question. The thesis shows limited or no understanding of research design in the development of the methodology and the appropriate statistical techniques to address the study s question. Analysis is vague and not clearly linked to the study s purpose. In developing the purpose and study question, little including relevant legal issues. In developing the purpose and study question, little including relevant marketing concepts and principles. ADEQUATELY MET (Some evidence but lacking in consistency and quality with some depth and breadth but limited integration and synthesis) The thesis shows some understanding of the relevant theories from the management, leadership, and organizational research literature, but lacks coherence in using this to frame the research question. The thesis shows some understanding of research design in the development of an appropriate methodology and the appropriate statistical techniques to address the study s question. Analysis is vague and not clearly linked to the study s purpose. In developing the purpose and question, legal considerations are included but not subsequently developed or incorporated in the analysis and evaluation of the data. In developing the purpose and question, consideration was given to integrating marketing concepts, but not subsequently developed or incorporated in the analysis/evaluation of the data. FULLY MET (Comprehensive evidence that is consistent and compelling with depth and breadth and integration and synthesis) The thesis uses relevant and current research literature on management, leadership and organizational concepts and principles to establish a compelling theoretical framework to address the thesis question. The thesis shows a clear understanding of research design in the development of the methodology and the appropriate statistical techniques to address the study s question. Analysis is comprehensive and clearly linked to the study s purpose and evidence-based recommendations provided. Legal considerations are addressed in the development of the theoretical model driving the research question and are addressed in the evaluation of the findings. Marketing concepts are fully integrated into the development of the theoretical model driving the research question and are addressed in the evaluation of the findings.
KNPE/M.S. Sport Management Assessment 10 Identify and analyze the current issues and problems facing sport. Apply fiscal management practices in managing a sport organization. Function as an ethical practitioner in the sport industry. The thesis fails to identify a question of current importance. The question is descriptive and/or atheoretical with no clear rationale that demonstrates an analysis of the problem s relevance. There is no clear purpose and a lack of quality, currency, and breadth to the references cited. In developing the purpose and study question, little including relevant fiscal management issues. Limited evidence of the required steps in the protection of human subjects. The thesis identifies a question of current importance but there is no compelling rationale developed or analysis of the problem s relevance. The question is partially framed within a conceptual and/or theoretical framework. There is a clear purpose and evidence of current relevant research citations, but breadth of references is still lacking. In developing the purpose and question fiscal management considerations are included but not subsequently developed or incorporated in the analysis and evaluation of the data. Methodology shows some understanding of the steps for the protection of human subjects. The thesis identifies a question of compelling current importance and there is a clearly articulated and compelling rationale accompanied by a thorough analysis of the problem s relevance. The question is fully framed within a conceptual and/or theoretical framework. The purpose statement is readily apparent and the currency and breadth of the references cited extensive. Fiscal management considerations are addressed in the development of the theoretical model driving the research question and are addressed in the evaluation of the findings. All human subject concerns were addressed through the study s design and data collection protocols.
KNPE/M.S. Sport Management Assessment 11 MS in Sport Management Masters Paper: Research Paper Rubric STANDARD Design, analyze, and evaluate research in sport. Identify and analyze the current issues and problems facing sport. DID NOT MEET (Limited or no evidence lacking any depth or breadth or integration or synthesis) The research paper shows limited understanding of research design in the development of the methodology and the appropriate statistical techniques to address the study s question. Analysis is vague and not clearly linked to the study s purpose. The research paper fails to identify a question of current importance. The question is descriptive and/or atheoretical with no clear rationale that demonstrates an analysis of the problem s relevance. There is no clear purpose and a lack of quality, currency, and breadth to the references cited. ADEQUATELY MET (Some evidence but lacking in consistency and quality with some depth and breadth but limited integration and synthesis) The research paper shows some understanding of research design in the development of an appropriate methodology and the appropriate statistical techniques to address the study s question. Analysis is vague and not clearly linked to the study s purpose. The research paper identifies a question of current importance but there is no compelling rationale developed or analysis of the problem s relevance. The question is partially framed within a conceptual and/or theoretical framework. There is a clear purpose and evidence of current relevant research citations. FULLY MET (Comprehensive evidence that is consistent and compelling with depth and breadth and integration and synthesis) The research shows a clear understanding of research design in the development of the methodology and the appropriate statistical techniques to address the study s question. Analysis is comprehensive and clearly linked to the study s purpose and evidence-based recommendations provided. The research paper identifies a question of compelling current importance and there is a clearly articulated and compelling rationale accompanied by a thorough analysis of the problem s relevance. The question is fully framed within a conceptual and/or theoretical framework. The purpose statement is readily apparent and the currency and breadth of the references cited extensive.
KNPE/M.S. Sport Management Assessment 12 MS in Sport Management Master Paper: Project Rubric STANDARD Apply management, leadership, and organizational concepts, principles, and theories in directing a sport organization. Design, analyze, and evaluate research in sport. Understand, apply, and analyze legal concepts related to sport. Construct and utilize marketing concepts and principles in marketing sport. Identify and analyze the current issues and problems facing sport. DID NOT MEET (Limited or no evidence lacking any depth or breadth or integration or synthesis) Project does not utilize current management, leadership, and organizational concepts and theories to guide implementation The project shows limited understanding of research design, analysis and evaluation in framing how the project will be implemented. In developing the project implementation framework, little including relevant legal issues. In developing the project, little including relevant marketing concepts and principles. The project fails to identify an issue of current importance with no clear rationale that demonstrates an analysis of the problem s relevance. ADEQUATELY MET (Some evidence but lacking in consistency and quality with some depth and breadth but limited integration and synthesis) The project shows some understanding of the relevant theories from the management, leadership, and organizational research literature but lacks coherence in using this to frame implementation. The project shows some understanding of how research design, analysis, and evaluation frame a project but this is not carried through in showing how it impacts implementation. In developing the project implementation framework, legal considerations are included but not subsequently developed or incorporated into the project plan. In developing the project, some integrating marketing concepts but this is not subsequently developed or incorporated into the implementation plan. The project identifies an issue of current importance, but there is no compelling rationale developed or analysis of the problem s relevance. FULLY MET (Comprehensive evidence that is consistent and compelling with depth and breadth and integration and synthesis) The project uses relevant and current research literature on management, leadership and organizational concepts and principles to establish a compelling implementation framework. The project shows a clear understanding of research design, analysis and evaluation and also the implications for project implementation. Legal considerations are fully addressed in the development of the project framework and its implementation. Marketing concepts are fully integrated into the development of the project and its implementation. The project identifies an issue of compelling current importance and there is a clearly articulated and compelling rationale that drives the project s proposed implementation.
KNPE/M.S. Sport Management Assessment 13 Apply fiscal management practices in managing a sport organization. Function as an ethical practitioner in the sport industry. In developing the project implementation plan, little including relevant fiscal management issues. Limited evidence of the ethical considerations inherent in the project are understood. In developing the project, fiscal management considerations are included but not subsequently developed or incorporated into the implementation of the plan. Ethical considerations are identified, but limited evidence of how these will be addressed. Fiscal management considerations are appropriately addressed in both the development and implementation of the proposed project. All ethical considerations inherent in the project s implementation are articulated and addressed.