College of Nursing PhD Program Assessment Plan. 1. Introduction

Transcription

1 1. Introduction Unit Mission Statement: The University of Kentucky College of Nursing (CON) PhD in Nursing develops nursing scholars who are prepared to create new knowledge that fosters the health and well-being among the people of Kentucky, the region, and the world, and who provide stewardship of the discipline through excellence in nursing education, research, practice, and service in an ever-changing health care environment. Basic Assessment Approach: The College of Nursing pursues a unified approach to program assessment which meets the accreditation standards of both professional nursing and university accreditors. This approach tracks the alignment and delivery of learning outcomes across the curriculum, as shown in the attached curriculum map. All program-level student learning outcomes will be formally assessed on a three-year cycle, which is included in section three below. This assessment will include direct measurement of student work, and indirect measures of program quality such as course evaluations and student surveys. Definition of Key s: Assessment: A strategy for understanding, confirming, and improving student learning through a continuous, systematic process. Curriculum Map: A visual depiction of how learning outcomes and/or professional standards are translated into individual courses taught within a program Learning Outcomes: Statements of learning expectations. Indirect Evidence: Data from which you can make inferences about learning but do not demonstrate actual learning, such as perception or comparison data. Includes, but is not limited to: surveys, focus groups, exit interviews, course grades, and institutional performance indicators. Direct Evidence: Students show achievement of learning goals through performance of knowledge and skills. Includes, but is not limited to: capstone experiences, score gains between entry and exit, portfolios, and substantial course assignments that require performance of learning. 2. Assessment Oversight, Resources Assessment of all College of Nursing programs is coordinated by the Assistant Dean for Academic Operations and Assessment (Sherry Holmes, MSN, RN) and the Assessment Coordinator (Heidi Hiemstra, PhD.). They are joined on the PhD program assessment team by the Associate Dean for Graduate Affairs (Terry Lennie, PhD, RN, FAHA, FAAN) and the PhD Program Director (Susan Frazier, PhD, RN, FAHA). This team works collaboratively to define and measure student learning outcomes, plan and monitor assessment and improvement activities, and write annual assessment reports. 1

2 3. Program-Level Learning Outcomes and Reporting Cycle Outcome Number Outcome 1: Outcome 2: Outcome 3: Outcome 4: Doctor of Philosophy in Nursing SLO Reporting Cycle Student Learning Outcome Cycle Academic Year Demonstrates knowledge of the science through original research utilizing critical evaluation of existing knowledge (AACN Pathways to Excellence Expected Outcome: Develop the Science). Outcome 2: Contributes to the development of the science through a pattern of productive scholarship and grantsmanship (AACN Pathways to Excellence Expected Outcome: Develop the Science). Demonstrates an understanding of the professional responsibilities of a PhD prepared scholar through professional leadership, mentorship and service (AACN Pathways to Excellence Expected Outcome: Steward the Discipline). Contributes to the formal and informal education of current and future nurses through discovery, application, and integration (AACN Pathways to Excellence Expected Outcome: Educate the Next Generation). Reporting Year Annual Annual October 31, Annual Annual October 31, Annual Annual October 31, Year October 31, 2018 Research-focused Nursing PhD programs are not accredited by professional nursing accreditors because they are not professional doctorates. However, the American Association of Colleges of Nursing (AACN) has published Pathways to Excellence for the research-focused doctorate, from which these learning outcomes are adapted. (The Research-Focused Doctoral Program in Nursing: Pathways to Excellence (AACN, August 2010) 4. Curriculum Map The currculum map is APPENDIX A: Nursing PhD Program Student Learning Outcomes Curriculum Map. Please note that this map is likely to change, as substantial curricular changes are currently under discussion. It is expected that these changes will be developed and sent through the university approval process in , with the new curriculum implemented in fall of

3 5. Assessment Methods and Measures Direct Measures: Doctoral Candidacy Exam Doctoral Dissertation IRB Training Certificate IRB Approval of Dissertation Research Students Curriculum Vitae Student participation in the GNAAC student mentorship program Indirect Measures: Teaching effectiveness portion of course evaluations (semester) Advisor Evaluation (annual) PhD Graduate Survey (new, annual) Post-graduation employment information (annual) 3

4 6. Data Collection and Review Outcome Data Source Collection Process Target & Method Outcome 1: Demonstrates knowledge of the science through ethical original research utilizing critical evaluation of existing knowledge. Metric 1.1 Candidacy Exam Rubric (TBD Fall semester 2015) Metric 1.2 Metric 1.3 Metric 1.4 Dissertation Defense Rubric (TBD Fall semester 2015) Certificate of completion of training in ethical and responsible conduct of research Research study approval by a certified Institutional Review Board The rubric is completed by the chair in consultation with the Doctoral Advisory Committee at completion of oral defense. The rubric evaluates both the written and oral components of the candidacy exam. The rubric is forwarded to the Associate Dean for Graduate Affairs who compiles the data to share with the PhD Program Committee and the CON Assessment Office The rubric is completed by committee chair in consultation with the Doctoral Advisory Committee at completion of oral defense. The rubric evaluates both the written dissertation and the oral defense of the dissertation. The rubric is forwarded to the Associate Dean for Graduate Affairs who compiles the data to share with the PhD Program Committee and the CON Assessment Office Course faculty for NUR will verify certification of training ethical and responsible conduct of research; which is a course requirement. Student IRB applications are approved by the Director of Graduate Studies (DGS). The DGS informs the Office of the Associate Dean for Research (ADR) when student proposals are being submitted. The Office of the ADR s requests a copy of letter of IRB approval. The Associate Dean for Graduate Affairs will compile data and share the PhD Program Committee and the CON Assessment Office. All students meet or exceed expectations in each section of the rubric All students meet or exceed expectations in each section of the rubric All students have achieved certificate of training issued by the UK Office of Research Integrity All students have IRB approval for dissertation research studies. Outcome 2: Contributes to the development of the science through a pattern of productive scholarship and grantsmanship Metric 2.1 Curriculum Vitae: abstracts or papers submitted for publication, and presentations /posters at professional conferences. Advisors conduct a summative review of students CVs prior to the dissertation defense. A copy is sent to the administrative assistant of the Associate Dean for Graduate Affairs, who compiles the information. The Associate Dean then shares it with the PhD Program Committee and the CON Assessment Office. By graduation, X% of PhD students have... (TBD) 4

5 Outcome Data Source Collection Process Target & Method Outcome 2: Contributes to the development of the science through a pattern of productive scholarship and grantsmanship Metric 2.2 Curriculum Vitae: submitted and funded grants Advisors conduct a summative review of students CVs prior to the dissertation defense. A copy is sent to the administrative assistant to the DGS. Data on grants submitted and received are compiled by the administrative assistant for the Associate Dean for Graduate Affairs who shares it with the PhD Program Committee and the CON Assessment Office. By graduation, X% of PhD students have (TBD) Outcome 3: Demonstrates an understanding of the professional responsibilities of a PhD prepared scholar through professional leadership, mentorship and service. Metric 3.1 Curriculum Vitae: Professional memberships and professional or community service Metric 3.2 Participation in the GNAAC student mentorship program Advisors conduct a summative review of students CVs prior to the dissertation defense. A copy is sent to the administrative assistant to the DGS. Data on membership in profession organizations, service on committees in professional organizations, local service to college, service to community organizations submitted are compiled by the administrative assistant to the Associate Dean for Graduate Affairs who shares it with the PhD Program Committee and the CON Assessment Office The Graduate Nursing Activities and Advisory Committee (GNAAC) has a student mentorship program in which incoming students are matched with students who have been in the program for at least a year. The Associate Dean for Graduate Affairs will track PhD students who participate in the program. By graduation, all PhD students have evidence on their CV of professional or community service, and are members of at least one professional organization. All PhD students participate in the GNAAC mentorship program. Outcome 4: Contributes to the formal and informal education of current and future nurses through discovery, application, and integration. Metric 4.1 TBD 7. Assessment Cycle and Data Analysis Assessment of student learning takes place throughout the program and occurs in all courses. Program faculty will be asked to maintain records of course-level assessment as usual. Except for the annual review of student CV s, program-level assessment data will only be gathered at summative points in the curriculum as articulated above. The program will follow a three year assessment cycle, with all outcomes assessed each year. Given the small size of the Nursing PhD program, which typically has fewer than ten students in an entry cohort, course assignments used for program assessment will be used in total rather than sampled. Relevant course assignments and CV items will be collected and summarized for program-level assessment by the PhD program director and the PhD program committee. Look at trend data at 5

6 the end of every 3 years as well as annually. Given the small numbers of students in the program, trend data will utilize smoothed three-year data. Actual results are compared to targets each year. If targets are met, targets and metrics are evaluated for relevance and adequacy. If targets are not met, relevancy of the target and metric is reviewed, and substantive reasons for insufficient performance are investigated. If warranted, plans for improvement actions are developed and implemented at that point. Assessment reports will be completed no later than August 1 st of every year and turned in to the college s assessment coordinator for review. Final reports will be sent to the university s assessment office no later than October 31 st of every year. 8. Teaching Effectiveness The College of Nursing uses multiple data sources to evaluate the teaching effectiveness of faculty in the PhD program, primarily using CoursEval online survey software. Students in core PhD curriculum courses complete two end-of-course evaluations, one for the course itself and one for the teaching effectiveness of the faculty member(s) who taught the course. Feedback on faculty mentoring is provided by an advisor evaluation sent to students annually. Additional information on student outcomes and teaching effectiveness is collected on an annual PhD graduate survey. Course surveys are reviewed by the relevant Associate Dean, and used in faculty evaluation. Aggregate PhD graduate survey results are presented to the program faculty annually. 9. What are the plans to evaluate students post-graduate success? The CON is required to report employment outcome data for PhD students to the American Association of Colleges of Nursing annually, even though the program is not accredited by that body. This data is collected by faculty advisors, and is reported by type of academic and nonacademic position. 10. Appendices APPENDIX A: Nursing PhD Program Student Learning Outcomes Curriculum Map 6

7 APPENDIX A: Nursing PhD Program Student Learning Outcomes Curriculum Map I= Introduce, R = Reinforce, E = Emphasize Cohort First Second Third Fourth Course Outcome 1: Demonstrates knowledge of the science through original research utilizing critical evaluation of existing knowledge. (AACN Pathway: Develop the Science) Outcome 2: Contributes to the development of the science through a pattern of productive scholarship and grantsmanship (AACN Pathways to Excellence Expected Outcome: Develop the Science). Outcome 3: Demonstrates an understanding of the professional responsibilities of a PhD prepared scholar through professional leadership, mentorship and service. (AACN Pathway: Steward the Discipline) NUR 779 Doctoral Seminar 1 Introduced Introduced Introduced TBD NUR 770 Philosophical Introduced TBD Foundations of Nursing Practice NUR 790 Knowledge Development in Nursing Introduced Introduced TBD NUR 779 Doctoral Seminar 2 Reinforced Reinforced Reinforced TBD NUR 791 Qualitative Methods in Reinforced Emphasized TBD Nursing Research NUR 778 Proseminar in Reinforced Reinforced Emphasized TBD Contemporary Health and Nursing Policy Issues NUR 779 Doctoral Seminar 3 Emphasized TBD NUR 792 Quantitative Methods in Nursing Research Reinforced Emphasized TBD NUR 793 Measurement of Emphasized Emphasized TBD Nursing Phenomena NUR 794 Analysis, Emphasized Emphasized TBD Interpretation and Presentation of Quantitative Data NUR 771 Research Experience Reinforced Reinforced TBD NUR 9XX Clinical Cognates (2) Reinforced TBD NUR 767 Dissertation Emphasized Emphasized TBD Residency Qualifying Exam Assessed Assessed Assessed TBD Dissertation Final Exam Assessed Assessed Assessed TBD Outcome 3: Contributes to the formal and informal education of current and future nurses through discovery, application, and integration. (AACN Pathway: Educate the Next Generation)