List all of the program s learning outcomes: (regardless of whether or not they are being assessed this year)

Transcription

1 STUDENT LEARNING ASSESSMENT REPORT SUBMITTED BY: CATHARINE A KOPAC, MAGGIE VENZKE DATE: BRIEFLY DESCRIBE WHERE AND HOW ARE DATA AND DOCUMENTS USED TO GENERATE THIS REPORT BEING STORED: DATA USED TO COMPILE THE REPORT WILL BE STORED ON THE WRITER S HARD DRIVE AT THE UNIVERSITY WITH PAPER COPIES STORED IN UNIVERSITY FILES. IN ADDITION, FACULTY SUBMITTING DATA FOR THE REPORT HAVE PERSONAL COPIES OF SUPPORTING DATA IN UNIVERSITY FILES. STUDENTS CLINICAL EVALUATIONS MAY BE FOUND IN THE STUDENTS FILES IN THE SCHOOL OF HEALTH PROFESSIONS OFFICE. EXECUTIVE SUMMARY List all of the program s learning outcomes: (regardless of whether or not they are being assessed this year) Learning Outcome Year of Last Assessment Year of Next Planned Assessment Employ ethical theory in the decision-making process Apply knowledge of nursing theory and theories from other relevant disciplines Utilize research findings to advance evidence-based nursing practice Incorporate principles of health promotion in teaching and in patient-care delivery Use advanced knowledge from the sciences and related disciplines to support Advanced Nursing Practice and role development Demonstrate expertise in a specialized area of advanced nursing practice Plan and initiate change in nursing practice and in health care systems Implement leadership strategies in a variety of settings to advance professional nursing practice Engage in collaborative relationships improve health care delivery and advance nursing practice

2 Describe how the program s outcomes support Marymount s Mission, Strategic Plan, and relevant school plan: MU is an independent comprehensive Catholic university that endeavors to foster individual development and to combine the liberal arts and career preparation. The nursing programs are organized within the Malek School of Health Professions (MSHP). The MSHP supports the University mission in fostering the development of each student by enabling him or her to become a well-rounded health professional. The MSN program provides academic and practicum education necessary for advanced-practice. With the stated goal of development of the whole person, the MSN program will continue in the tradition of an ever-evolving curriculum that fosters interdisciplinary collaboration, scholarship, and excellence. Provide a brief description of the assessment process used including strengths, challenges and planned improvements: Faculty have five opportunities to evaluate program outcomes: 1. When a student is engaged in a course addressing specific content* 2. During the clinical practicum experiences** 3. Performance on the comprehensive examination*** 4. Survey of graduating students**** 5. Survey of alumni**** *Multiple measures are used to assess program outcomes and this is a strength. **A Copy of the Preceptor Clinical Evaluation Tool is appended to this document. ***The comprehensive final examination is a 150 item multiple choice exam that addresses the following content areas: assessment and management of men, women and children, professionalism, theory, research and policy. ****Surveys of our graduating students for this year were the standard ones used by the University and hence, indirect measures. When admissions to the MSN Education Program were suspended, it was recognized that a new supplementary form specific to the FNP Program needed to be developed. This is planned for the coming year. Current MSN core curricula include content that has been identified as essential for advanced practice nursing by the Commission on Collegiate Education in Nursing (CCNE), the body that accredits the Marymount nursing programs. The American Association of Colleges of Nursing (AACN) Essentials of Master s Education document is used as a basis for the MSN curriculum. Revision of the Essentials by AACN was completed in 2011 and was instrumental in influencing the action plan developed during the 5-year report submitted in 2012 (See Action Plan Progress Report). 2

3 Describe how the program implemented its planned improvements from last year: -A new pharmacology instructor (Doctorate in Pharmacology) with recent primary care experience was added to the teaching team. Provide a response to last year s University Assessment Committee review of the program s learning assessment report: (List each recommendation and provide a specific response to each). We had a buy last year..we submitted a 5 year report. 3

4 Outcome and Past Assessment Learning Outcome 1: Utilize research findings to advance evidence-based nursing practice Is this outcome being reexamined? Yes No This outcome was last evaluated in the academic year. If yes, give a brief summary of previous results (including trends) and any changes made to the program. Assessment Activity Outcome Measures Explain how student learning will be measured and indicate whether it is direct or indirect. Research Proposal Paper (NU 591) (direct) Evidence Based Practice Review Paper (NUF 501) (direct MSN FNP Graduating Student Survey (GSS) (indirect) Performance Standard Define and explain acceptable level of student performance. 90% of the students will get an 85 or above. 100% will get an 85 or above. 90% of respondents will evaluate themselves as being able to utilize research to provide quality care Data Collection Discuss the data collected and student population Faculty maintain records of proposal grades Faculty maintain records of review paper grades Graduating Survey is generated by office of Institutional Effectiveness with input from nursing faculty Analysis 1) Describe the analysis process. 2) Present the findings of the analysis including the numbers participating and deemed acceptable. The standard was achieved. 90% of the students who completed a proposal in NU 591 did achieve an 85 or above. Only one of the students received less than 85. The standard was achieved. 100% of the students did achieve an 85 or above on their Evidenced Based Practice Paper. The standard was achieved. Two elements of the GSS were used: (use of qualitative/quantitative techniques within the field and the evaluation of the quality of information). 100% of all respondents evaluated themselves as being able to do this. 4

5 Interpretation of Results Extent this Learning Outcome has been achieved by students (Use both direct and indirect measure results): With both direct and indirect measures, the outcome was successfully achieved. Only one student was identified who did not meet the set standard. Program strengths and opportunities for improvement relative to assessment of outcome: One of our program strengths is that we have several well prepared faculty who can teach the MSN level research course; this flexibility allows us to accommodate student schedules and provide diversity in research presentation. Students have made an effort to take the course prior to beginning clinical practicums so as to have a strong underpinning (evidence based practice) for their developing practice. Graduate students are always challenged by work schedule demands in addition to school demands, so sometimes the course is taken late in the program (last year) when students are in their practicum experiences. Faculty will continue to monitor and advise, accordingly. We are able to offer the course in the late afternoon and evening. Discuss planned curricular or program improvements for this year based on assessment of outcome: No changes are anticipated in Our accreditation and certification bodies require this research as an outcome underpinning for practice (evidence based practice). 5

6 Outcome and Past Assessment Learning Outcome 2: Use advanced knowledge from the sciences and related disciplines to support Advanced Nursing Practice and role development Is this outcome being reexamined? Yes No This outcome was last evaluated in the academic year. If yes, give a brief summary of previous results (including trends) and any changes made to the program. Assessment Activity Outcome Measures Explain how student learning will be measured and indicate whether it is direct or indirect. MSN FNP Program Comprehensive Exam (direct) MSN FNP Graduating Student Survey (GSS) (indirect) Preceptor Clinical Evaluation Tool in NUF 503 & NUF 504 (direct) Performance Standard Define and explain acceptable level of student performance. 90% of the students will attain an 80 or above on 1 st attempt. 85% of the students will evaluate themselves as competent or above. Preceptor evaluation of student- all elements of tool will be rated as 3 or higher (on a 1 5 rating scale). Data Collection Discuss the data collected and student population 150 item comprehensive exam is given the month prior to graduation Graduating Survey is generated by office of Institutional Effectiveness with input from nursing faculty Preceptor evaluations of students are reviewed by FNP faculty Analysis 1) Describe the analysis process. 2) Present the findings of the analysis including the numbers participating and deemed acceptable. This standard was met. Of the 14 students who took the Comprehensive Exam, 100% passed the exam with an 80 or above on the first try. This standard was met. Two elements of the GSS were used: application of knowledge and skills to new situations and solving problems in the nursing field using knowledge and skills. 100% of all respondents evaluated themselves as being able to do this. This standard was met. 100% were rated 3 or better. It should be noted that 58% were rated as 4 or better and 17 were rated as 5. 6

7 Interpretation of Results Extent this Learning Outcome has been achieved by students (Use both direct and indirect measure results): With both direct and indirect measures, the outcome was successfully achieved. This was further demonstrated by a 100% pass rate on the professional nurse practitioner certification exams. Program strengths and opportunities for improvement relative to assessment of outcome: This outcome clearly appears to be a strength of the program. Not only are the students able to perform well on a comprehensive exam but they are performing well in their clinical practicums as evaluated by their preceptors. Additionally, the GSS supports the outcomes of both the exam and preceptor evaluations. Discuss planned curricular or program improvements for this year based on assessment of outcome: No changes are anticipated in All scientifically based courses are required by both accreditation and certification bodies. 7

8 Outcome and Past Assessment Learning Outcome 3: Engage in collaborative relationships to improve health care delivery and advance nursing practice. Is this outcome being reexamined? Yes No There was no past record of this outcome being measured before. If yes, give a brief summary of previous results (including trends) and any changes made to the program. Assessment Activity Outcome Measures Explain how student learning will be measured and indicate whether it is direct or indirect. Item on Preceptor Clinical Evaluation Tool in NUF 503 & NUF 504 (direct) NUF 501 Mid-Term Exam on advanced practice role (direct) MSN FNP Graduating Student Survey (GSS) (indirect) Performance Standard Define and explain acceptable level of student performance. Preceptor evaluation of student- 90% of students will achieve a 3 or above on this item of the evaluation tool (on a 1-5 rating scale). 85% of students will achieve an 85 or better on the exam 85% will evaluate themselves as engaging in collaborative relationships in health care delivery Data Collection Discuss the data collected and student population Preceptor evaluations of students are reviewed by FNP faculty Faculty maintain records of Exam grades Graduating Survey is generated by office of Institutional Effectiveness with input from nursing faculty Analysis 1) Describe the analysis process. 2) Present the findings of the analysis including the numbers participating and deemed acceptable. This standard was met. 100% were rated as 3 or better. It should be noted that 83% were rated as 4 or better and 25% were rated as 5. This standard was not met. Of the 19 students who took the NUF 501 exam, 78.5% received a grade of 85% or above. This standard was partially met. Two elements of the GSS were used: work as part of a team, and lead a team. 100% of the students reported that they had the opportunity to work as part of a team, but only 77.8% of the students reported that they felt prepared to lead a team. 8

9 Interpretation of Results Extent this Learning Outcome has been achieved by students (Use both direct and indirect measure results): The outcome was of interest to the faculty because practicum sites vary and the opportunity to engage in collaborative practice can be challenging depending on the site. Program strengths and opportunities for improvement relative to assessment of outcome: Utilizing the data from the GSS, students were forthcoming in saying (100%) that they had worked on teams (GSS). Only 22.2% of these students felt they were prepared to lead teams. This data was extrapolated from the survey and is an indirect measure of engaging in collaborative relationships. Our expectations are that students will be able to meet this measure as they progress in the role after graduation. Future supplementary evaluations can be developed to more closely examine this outcome. Discuss planned curricular or program improvements for this year based on assessment of outcome: No changes are anticipated in the academic year. An MSN supplementary evaluation tool for graduating FNP students needs to be developed this year. A complete student learning assessment report includes appendix of rubrics, survey questions, or other relevant documents and information. 9