Assessment of Student Learning

Transcription

1 Assessment of Student Learning 1 Statement of Purpose/Mission School of Nurse Anesthesia Annual Report, Content for the Annual Report The Faculty of Bryan College of Health Sciences, School of Nurse Anesthesia, believes that: The study of nurse anesthesia is unique in the realm of traditional graduate programming as the theoretical and clinical principles of the art draw from the integration of many disciplines that contribute to the core of professional education. The complexity of contemporary anesthesia practice justifiably requires this integration to enable the nurse anesthetist to practice the humanistic, scientific and technical skills of the profession competently and intelligently. The educational program for the preparation of nurse anesthetists is conducted as a shared responsibility between student and faculty. Students must be intensely committed to achieving their goals through a consistent demonstration of purpose, motivation, responsibility to patients and colleagues, independence of thought, creativity and personal demeanor. Faculty, likewise, are committed to the responsibilities of serving as a competent resource, guide and professional role model. The program seeks to express its commitment to each student through individualized instruction and counsel. Our primary goal is to provide the graduate student with an advanced scientific knowledge base and a comprehensive array of clinical skills that hallmark the standards of care in anesthesia practice. Our obligation to graduates will be to prepare them for full participation in the delivery of anesthesia care in concert with other health care providers. They will be competent in independent judgment as professional nurses. Our responsibility to the community is expressed in the aim of providing an educational program that will ably prepare the nurse anesthetist to meet the health care needs of a culturally diverse population. Our obligation to the profession is to prepare a nurse anesthetist who will serve as an invaluable resource in support of the goals of the American Association of Nurse Anesthetists and to the advancement of the profession of nurse anesthesia. 1

2 2 Measurable Objectives The School of Nurse Anesthesia has 17 terminal objectives divided into 4 categories: Academic Terminal Objectives: 1. The student will develop advanced level of scientific knowledge supporting the practice of nurse anesthesia. 2. The student will acquire specific pharmacological knowledge applicable to anesthesia practice. 3. The student will identify physiologic abnormalities and interpret and intervene based on monitoring data. 4. The student will develop a body of knowledge sufficient for entrance to clinical practice. Clinical Terminal Objectives: 1. The student will formulate an anesthesia care plan based on didactic knowledge and physiologic principles. 2. The student will appropriately implement the anesthesia plan for patients of all ages and physical conditions for a variety of surgical and medically related procedures. 3. The student will demonstrate acquired knowledge of perioperative anesthesia care including general, regional, and sedation techniques. 4. The student will meet or exceed Council on Certification of Nurse Anesthetists' case requirements. 5. The student will demonstrate ability to transfer theory to practice. Research Terminal Objectives: 1. The student will be a knowledgeable consumer of research literature. 2. The student will complete a senior research project or thesis in which knowledge is created and/or existing knowledge is appropriately critiqued and integrated. 3. The student will be able to formally present and defend their research project or thesis in a public forum. Professionalism Terminal Objectives: 1. The student will be able to demonstrate professionalism by collaborative participation in a health care team in concert with other health care providers. 2. The student will be able to demonstrate sensitivity to the ethnic and cultural diversity of patients and other providers. 3. The student will understand the importance of his/her participation in the professional organizations of nurse anesthetists at all levels. 4. The student will teach others and participate in continuing education activities to acquire new knowledge and improve practice. 5. The student will gain an appreciation of occupational risks to include stress management, substance abuse and environmental hazards. 2

3 The Graduate Assessment committee is evaluating the Terminal Objectives on a rotating basis. Six objectives are addressed in the Annual Report. Objectives assessed for Annual Report: A. Academic: The student will acquire specific pharmacological knowledge applicable to anesthesia practice. B. Academic: The student will develop a body of knowledge sufficient for entrance to clinical practice. C.Clinical: The student will meet or exceed Council on Certification of Nurse Anesthetists' case requirements. D. Research: The student will be able to formally present and defend their research project or thesis in a public forum E. Professionalism: The student will be able to demonstrate sensitivity to the ethnic and cultural diversity of patients and other providers. F. Professionalism: The student will teach others and participate in continuing education activities to acquire new knowledge and improve practice. 3

4 3 Multiple measurements of outcomes * Indicates an outcome that did not meet the benchmark Clinical Evaluations The evaluations of student clinical performance are completed on a daily basis by the clinical faculty of the home clinical sites, and a monthly basis when the student is assigned to an affiliate clinical site. The student is rated either Satisfactory, Unsatisfactory or Not Applicable on eight items by the supervising clinical faculty. The clinical evaluations are returned to the program administration and compiled into individual student notebooks. Student Exit Evaluations Each student completes a program evaluation the final week prior to their graduation. The student indicates Yes, definitely, Yes, somewhat or No to statements derived from the terminal objectives. The benchmark is that > 70% will respond Yes, definitely. Information related to the clinical, academic, and administrative components is also obtained. Additionally the student is asked to identify the perceived program strengths and weaknesses. Results from sixteen completed exit evaluations were compiled in May-July 2015; a 100% return was obtained. Clinical Case Record numbers Students maintain a daily record of all clinical case experiences. Upon completion of the nurse anesthesia program, a transcript of the case records is submitted to the Council on Certification of Nurse Anesthetists as part of the requirements which qualify the graduates to sit the National Certification Exam. An internet based service is utilized by the program to facilitate record keeping, with a monthly report filed with program administration. Intercultural Development Inventory (IDI) The Intercultural Development Inventory is a 50-item, theory-based paper and pencil instrument that measures intercultural sensitivity as conceptualized in Bennett s Developmental Model of Intercultural Sensitivity. The IDI measures an individual s (or group s) fundamental worldview orientation to cultural difference, and thus the individual s or group s capacity for intercultural competence. As a theory-based test, the IDI meets the standard scientific criteria for a valid and reliable psychometric instrument. The benchmark is that 75% will score at the Minimization or Acceptance/Adaptation dimension. The 2015 graduates scores are below with 80% scoring at Minimization or Acceptance/Adaptation dimensions. 4

5 Dimension % of Class in each of the Dimensions in Freshman year (n=16) % of Class in each of the Dimensions in Senior year (n=15) Adaption 6.3%(1) 13.4(2) Acceptance 37.6% (6) 33.4%(5) Minimization 50% (8) 33.4%(5) Polarization 6.3%(1) 6.7%(1) Denial 0%(0) 13.3%(2) Alumni Survey, 1 and 2 years post graduation At 1 and 2 years following graduation from the nurse anesthesia program, each graduate is mailed a Alumni Survey. The graduate is asked to rate 13 statements on a 3 point scale: Yes, definitely, Yes, somewhat or No. The benchmark is that > 70% will respond Yes, definitely. Open ended questions are included which ask the graduate to list the strengths of their education, and areas needing improvement in the program. Two Yes or No items are included which ask if clinical situations for which the graduate was not prepared had been encountered, and whether the graduate would recommend the program to a friend. The graduate is also asked to check areas of clinical specialty and to rate the importance and quality of each of the courses in the curriculum. In June of 2015 the Alumni Survey was ed to the fifteen 2013 graduates and fourteen 2014 graduates. Seven (47%) 2013 and eight (57%) 2014 graduates returned a completed alumni survey. Employer Evaluation of, 1 and 2 years post graduation At approximately 1 and 2 years following graduation from the nurse anesthesia program, each graduate is ed a Contact Information Survey which includes a request for an employer address. In June of 2014 the Contact Information Survey was ed to fifteen 2013 graduates and fourteen 2014 graduates sixteen responses. Sixteen employers were contacted and eleven completed the survey (69%). The employer is asked to rate 13 statements on a 3 point scale: Yes, definitely, Yes, somewhat or No. The benchmark is that > 70% will respond Yes, definitely and 0% will respond No. Open ended questions are included which ask the employer to list the strengths of the alumni, and areas needing improvement. Two Yes or No items are included which ask if clinical situations for which the graduate was not prepared had been encountered, and whether the employer would hire another alumni of the program. 5

6 Council on Certification of Nurse Anesthetists, National Certification Examination Each graduate must pass the National Certification Examination in order to be designated a Certified Registered Nurse Anesthetist (CRNA). Certification is required in every state in order to obtain professional licensure. Total test scores and five subject area scores are reported to the program as scaled scores. The designated passing score is 450. The program benchmark set is 90% of the national pass rate, and the COA mandatory pass rate is 80% of the national pass rate averaged over the most recent three years. The first attempt national pass rate for 2014 (January 1- August 31) was 86%, for a 77% pass rate benchmark (86.9). Eleven of fifteen 2015 graduates passed on the first attempt for a 73% pass rate. Certification Exam Benchmark National mean, 2014 Bryan mean, % > National Mean 50% 20%* Certification Exam scores are correlated with overall GPA while a student in the program. See below for the pooled scores for the three years 2013, 2014 and The first attempt pass rate for the 3 years is 80%, (one 2015 student had not taken a first attempt at the time of the report) and the pass rate for first and second attempt for the 3 years is 91%, with 100% of graduates passing the NCE and becoming certified (two 2015 students had not taken a third attempt at the time of the report). GPA NCE Score SEE 1 SEE * * * * * * * * *

7 Council on Certification of Nurse Anesthetists, Self-Evaluation Examination (SEE) The Self-Evaluation Examination (SEE), administered by the Council on Certification of Nurse Anesthetists (CCNA), has three objectives: (1) to provide information to students about their progress in the nurse anesthesia program; (2) to provide information 7

8 to program directors on how well their programs are preparing students with the knowledge they need for anesthesia practice; and (3) to prepare students for the Certification Examination experience. All students currently enrolled in an accredited nurse anesthesia program are eligible to register for the SEE. Five content areas which reflect the curriculum requirements adopted by the Council on Accreditation of Nurse Anesthesia Educational Programs are included in 160 multiple choice questions. The SEE is voluntary, meaning not all nurse anesthesia students nationally take the exam. Each student in the Bryan College of Health Sciences School of Nurse Anesthesia is required to take the SEE at the end of the first 15 months, and at 27 months in the program. Total test scores and content area scores are reported to the program as scaled scores and percentile scores. The benchmark set is 50% of students will score at the 50 th percentile or above, and 80% of students will score at the 20 th percentile or above. The mean total SEE score for the 2015 graduating class was at the 48 percentile rank nationally for second year students, with a range from 3 to 98 percentile rank The mean SEE score for the 2016 graduating class was at the 58th percentile rank nationally for first year students, with a range from 6-98 percentile rank for first year students. See benchmark data below SEE Benchmark Total Score 1 st year 5/2016 n = 15 2 nd year 5/2015 n = 16 50% > 50 th percentile 60% 62.5% 80% > 20 th percentile 93% 81% Employment Rate: At four months following graduation, 100% of graduates seeking employment were employed as a Certified Registered Nurse Anesthetist. Graduation Rate: Fifteen students matriculated into the 2015 cohort in the Fall 2012 semester with sixteen completing in May of One student transferred into the cohort from the 2014 cohort. 8

9 Objective A: The student will acquire specific pharmacological knowledge applicable to anesthesia practice. Objective A: Measured with SEE, Pharmacology Subject Scores. Each student in the Bryan Medical Center School of Nurse Anesthesia is required to take the SEE at the end of the first 12 months, and at 24 months in the program. Total test scores and content area scores are reported to the program as scaled scores and percentile scores. The benchmark set is 50% of students will score at the 50 th percentile or above, and 80% of the students will score at the 20 th percentile or above. SEE Benchmark Fall 2012 Fall 2012 Fall 2013 Fall 2013 Fall 2014 Fall 2014 Pharmacology n=14 n=15 n=16 n=14 n=15 n=16 Graduating Class year average Year Completed in 1 st year 2 nd year 1 st year 2 nd year 1st year 2 nd year program % > 50 th percentile 43%* 7%* 50% 50% 67% 62.5% 47%* > 20 th percentile 93% 87% 94% 78%* 93% 94% 90% Objective A: Measured with Certification Exam, Basic Sciences subject score. Didactic knowledge is measured with the Certification Exam with a pass score of 450. The 2015 graduating class mean Basic Scineces subject score was 468 with score range of The 2014 national mean was 507. The table below compiles the most recent 3 years of data. The benchmark is that 50% of graduates will score at, or above, the national mean score. Certification Exam Basic Sciences Subscore 5/2013 n = 15 5/2014 n = 14 5/2015 n = 15 National mean Class mean Class range Compiled 2013, 2014 and 2015 % > national mean 40% 21% 20% 27%* % > % 57% 73% 68% 9

10 Objective A: Measured with Exit Evaluation Measured with the following item included in the Exit Evaluation: The didactic or classroom portion of the program: provided specific pharmacological knowledge applicable to anesthesia practice. The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Exit Evaluation: pharmacological knowledge 5/2013 n = 15 5/2014 n = 14 5/2015 n = 16 Compiled 2013, 2014, and 2015 Yes, Definitely 33% 79% 62.5% 58%* Yes, Somewhat 53% 21% 37.5% 38% No 13% 0% 0% 4%* Objective A: Measured with Alumni Survey Measured with the following item included in the Alumni Survey: My education at the Bryan College of Health Sciences School of Nurse Anesthesia prepared me for beginning practice as a CRNA: specific pharmacological knowledge applicable to anesthesia practice. The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Response 2011, 2012 Class n=13 Surveyed in , 2013 Class n=15 Surveyed in , 2014 Class n=15 Surveyed in year combined n=43 Yes, Definitely 77% 67% 87% 77% Yes, Somewhat 23% 33% 13% 23% No 0% 0% 0% 0% Objective A: Measured with Employer Survey 10

11 Measured with the following item included in the Employer Survey: The CRNA alumni of the Bryan College of Health Sciences School of Nurse Anesthesia have obtained the following knowledge: specific pharmacological knowledge applicable to anesthesia practice. The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Two employers completed the survey in 2013, seven in 2014, and eleven in Seventeen of twenty employers (85%) responded Yes, definitely to the item and three (15%) responded Yes, somewhat. Objective B: The student will develop a body of knowledge sufficient for entrance to clinical practice. Objective B: Measured with SEE, Total Scores. Each student in the Bryan Medical Center School of Nurse Anesthesia is required to take the SEE at the end of the first 12 months, and at 24 months in the program. Total test scores and content area scores are reported to the program as scaled scores and percentile scores. The benchmark set is 50% of students will score at the 50 th percentile or above, and 80% of the students will score at the 20 th percentile or above. SEE Benchmark Fall 2012 Fall 2012 Fall 2013 Fall 2013 Fall 2014 Fall 2014 Total Score n=14 n=15 n=16 n=14 n=15 n=16 Graduating Class year average Year Completed in 1 st year 2 nd year 1 st year 2 nd year 1st year 2 nd year program % > 50 th percentile 36%* 33%* 69% 57% 60% 62.5% 53% > 20 th percentile 86% 100% 75%* 86% 93% 81% 87% Objective B: Measured with Certification Exam; Total Score Didactic knowledge is measured with the Certification Exam with a pass score of 450. Certification Exam Total Score 5/2013 n = 15 5/2014 n = 14 5/2015 n = 15 Compiled 2013, 2014 and

12 National mean Bryan mean Bryan range % > national mean 47% 36% 20% 34%* % > % 79% 73% 80% Objective B: Measured with Alumni Survey Measured with the following item included in the Alumni Survey: My education at the Bryan College of Health Sciences, School of Nurse Anesthesia, prepared me for beginning practice as a CRNA: a body of knowledge sufficient for entrance to clinical practice. The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Response 2011, 2012 Class n=13 Surveyed in , 2013 Class n=15 Surveyed in , 2014 Class n=15 Surveyed in year combined n=43 Yes, Definitely 100% 100% 100% 100% Yes, Somewhat 0% 0% 0% 0% No 0% 0% 0% 0% Objective B: Measured with Employer Survey Measured with the following item included in the Employer Survey: The CRNA alumni of the Bryan College of Health Sciences has obtained the following knowledge: a body of knowledge sufficient for entrance to clinical practice. The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Two employers completed the survey in 2013, seven in 2014, and eleven in Seventeen of twenty employers (85%) responded Yes, definitely to the item and three (15%) responded Yes, somewhat. Objective B:Measured with Employment Rate 12

13 For 2013 (n=15), 2014 (n=14) and 2015 (n=16) graduates at six months following graduation, 100% of graduates seeking employment obtained a position as a Certified Registered Nurse Anesthetist. One 2015 graduate had a delayed graduation and had not registered for the NCE or sought employment at the time of the report. Objective B: Measured with Graduation Rate Calculated by the number of students who complete the program within 100% of the usual curriculum (33 months for MS curriculum), and the number of student who complete the program within 150% of the usual curriculum (49.5 months for MS curriculum). Forty-five of forty-seven students completed the program for a 96% graduation rate cohort cohort cohort # matriculating # completing in 100% # completing in 150% Si students matriculated into the 2011 cohort in the Fall 2008 semester with eleven graduating in May of One hundred percent graduated within 35 months of matriculation into the program. Objective C: Clinical: The student will meet or exceed Council on Certification of Nurse Anesthetists' case requirements. Objective C: Measured with Clinical Case Records All graduates have met the Council on Certification of Nurse Anesthetists requirements for eligibility for the Certification Exam prior to completion of the 33 month academic program. Program benchmarks in excess of the minimum requirements for certification were also measured for the 2013, 2014, and 2015 graduates. The benchmark for number of general anesthetics is 575. Regional anesthesia benchmarks include 50 subarachnoid blocks and 50 epidural blocks. The sedation benchmarks are 125 monitored anesthesia care experiences. The open heart procedure benchmark is 20, and the less than 2 years of age pediatric patient benchmark is 20. See table below: Council on Certification Minimum Case Requirements Bryan Benchmarks 2013 n= n= n=16 13

14 Total Anesthetic Cases General Anesthetics Regional Anesthetic Administration Spinal Epidural Peripheral nerve Monitored Anesthesia Care Cardiac-thoracic 5 Pediatric 35 <2 10 Geriatric 50 Obstetric 30 Emergency D. Research: The student will be able to formally present and defend their research project or thesis in a public forum. Each Student has successfully defend their oral and written presentation in a public forum of an average of 40 CRNA clinical preceptors and faculty. Each student has achieved a grade of A+, A or B+ for the completed project. E. Professionalism: The student will be able to demonstrate sensitivity to the ethnic and cultural diversity of patients and other providers. Objective E: Measured with Exit Evaluation Measured with the following item included in the Exit Evaluation: My educational experiences in the program developed: my sensitivity to ethnic and cultural diversity of patients and other members of the health care team. 14

15 The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Exit Evaluation: sensitivity to ethnic and cultural diversity 5/2013 n = 15 5/2014 n = 14 5/2015 n = 16 Compiled 2013, 2014, and 2015 Yes, Definitely 33% 43% 62.5% 47%* Yes, Somewhat 60% 57% 31% 49% No 7% 0% 6% 4%* Objective E: Measured with Alumni Survey Measured with the following item included in the Alumni Survey: During my education at the Bryan College of Health Sciences School of Nurse Anesthesia, prepared me for beginning practice as a CRNA by providing me with sufficient skill or ability to: demonstrate sensitivity to the ethnic and cultural diversity of patients and other health care providers. The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Response 2011, 2012 Class n=13 Surveyed in , 2013 Class n=15 Surveyed in , 2014 Class n=15 Surveyed in year combined n=43 Yes, Definitely 100% 87% 87% 91% Yes, Somewhat 0% 13% 13% 9% No 0% 0% 0% 0% Objective E: Measured with Employer Survey Measured with the following item included in the Employer Survey: The CRNA alumni of the Bryan College of Health Sciences School of Nurse is prepared for beginning practice as a CRNA with sufficient skill or ability to: demonstrate sensitivity to the ethnic and cultural diversity of patients and other health care providers. Two employers completed the survey in 2013, seven in 2014, and eleven in Eighteen of twenty employers (90%) responded Yes, definitely to the item and two (10%) responded Yes, somewhat. 15

16 Objective E: Measured with Intercultural Development Inventory The IDI development orientation is evaluated in the final semester of the curriculum. 5/2013 n = 15 5/2014 n = 14 5/2015 n = 15 Compiled 2013, 2014, and 2015 n=44 Adaptation Acceptance Minimization (82%) Polarization Denial (18%) F. Professionalism: The student will teach others and participate in continuing education activities to acquire new knowledge and improve practice. Objective F: Measured with Exit Evaluation Measured with the following item included in the Exit Evaluation: My educational experiences in the program developed: my ability to teach others. The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Exit Evaluation: teach others 5/2013 n = 15 5/2014 n = 14 5/2015 n = 16 Compiled 2013, 2014, and 2015 Yes, Definitely 73% 64% 75% 71% Yes, Somewhat 27% 29% 19% 24% No 0% 7% 6% 4%* 16

17 Objective F: Measured with Alumni Survey Upon completion of the Bryan College of Health Sciences, School of Nurse Anesthesia I was prepared for beginning practice as a CRNA with sufficient skill or ability to: teach others and participate in continuing education activities to acquire new knowledge and improve practice. The benchmark is that 70% will respond Yes, Definitely and 0% will respond No. Response 2011, 2012 Class n=13 Surveyed in , 2013 Class n=15 Surveyed in , 2014 Class n=15 Surveyed in year combined n=43 Yes, Definitely 92% 93% 94% 93% Yes, Somewhat 8% 7% 6% 7% No 0% 0% 0% 0% Objective F: Measured with Employer Survey The CRNA has sufficient skill or ability to: teach others and participate in continuing educational activities to acquire new knowledge and improve practice. Two employers completed the survey in 2013, seven in 2014, and eleven in Seventeen of twenty employers (85%) responded Yes, definitely to the item and two (10%) responded Yes, somewhat and one (5%) responded No". 4 Determine gaps between objectives and outcomes A. Academic: The student will acquire specific pharmacological knowledge applicable to anesthesia practice. Partially met, benchmarks for Exit Evaluations, SEE Exam and Certification Exam were not met. Benchmarks for Alumni and Employer surveys met. B. Academic: The student will develop a body of knowledge sufficient for entrance to clinical practice. Partially met, Certification Exam benchmark was not met. Alumni Survey, Employer Survey, SEE Exam, Employment Rate and Graduation Rate benchmarks were met. E. Professionalism: The student will be able to demonstrate sensitivity to the ethnic and cultural diversity of patients and other providers. Partially met, benchmarks for Exit Evaluation not met. Alumni Survey, Employer Survey and IDI were met. F. Professionalism: The student will teach others and participate in continuing education activities to acquire new knowledge and improve practice. Partially met, benchmarks for Exit Evaluation and Employer Survey not met. Alumni Survey benchmark was met. 17

18 5 Determine probable reasons for the gaps A. Pharmacology courses may need greater focus on topics included in NCE, the course outcomes may be including content which is not relevant. Students are not retaining content through the program. B. Students are not retaining content through the program. In some cases students may have poor test taking skills which becomes more pronounced as the NCE passing standard is increased. E. Students are not making the connection between program activities and the development of sensitivity to ethnic and cultural diversity. F. Students are not making the connection between program activities and the development of the ability to teach. 6 Make programmatic and/or operational adjustments to narrow gaps. A. Review NRAN735 and NRAN730 Course Descriptions, Course Objectives and syllabi for alignment with NCE content outline. Access pharmacology courses, objectives, exams and lectures provided by Dr. John Nagelhout to benchmark against NRAN735 and NRAN730. Revise NRAN735 and NRAN730 Course Descriptions, Course Objectives and syllabi with input of faculty. B. Revise quiz assignments in Sr Synthesis course to include a graded component, rather than a pass/fail for completion of assigned quizzes. Communicate 5 year summary of SEE score predictors of NCE success with students. Implement an admissions requirement of a GRE score. The GRE score will not be included in the applicant file as a component of admissions decisions, but the data will be collected and analyzed for 3 years. E. Schedule a presentation on cultural sensitivity development at the all student conference in January. Make more explicit connections between coursework activities and the development of cultural sensitivity. F. Make more explicit connections between coursework activities and the development of the ability to teach. 7 Recommend changes in budget for the planning/budge ting processes 8 Correlate adjustments to A speaker stipend for an expert in diversity and cultural sensitivity has been included in the budget of A new Comprehensive Exam policy was first implemented in 2012 with the graduating class of 2014 the first class to be subject to the policy. Prior to the implementation of the policy, the student had no incentive to score well on the SEE. The 18

19 changes in outcomes 9 Continue refining your assessment plan and processes Comprehensive Exam policy provides incentive for the student to achieve in the SEE. Scores will be monitored over the three years of to assess for changes. Revise the items on the Exit Evaluation to read: I have developed sensitivity to ethnic and cultural diversity of patients and other members of the health care team. I am able to teach others (patients, other health care providers). Responses are: Yes, definitely; Yes, somewhat; or No 19

20 Bryan College of Health Sciences School of Nurse Anesthesia Assessment Matrix for Annual Report Objectives assessed in report: Measure of outcome Student Exit Evaluations Objective A Objective B Objective C Objective D Objective E Objective F Alumni Survey Employer Survey SEE Exam Certification Exam Intercultural Development Inventory-IDI Clinical Case Record numbers Sr Project/Thesis presentations Employment Rate Graduation Rate Objectives assessed for Annual Report: A. Academic: The student will acquire specific pharmacological knowledge applicable to anesthesia practice. B. Academic: The student will develop a body of knowledge sufficient for entrance to clinical practice. C.Clinical: The student will meet or exceed Council on Certification of Nurse Anesthetists' case requirements. D. Research: The student will be able to formally present and defend their research project or thesis in a public forum E. Professionalism: The student will be able to demonstrate sensitivity to the ethnic and cultural diversity of patients and other providers. F. Professionalism: The student will teach others and participate in continuing education activities to acquire new knowledge and improve practice. 20

21 Objectives A. Academic: The student will acquire specific pharmacological knowledge applicable to anesthesia practice. Measures Exit Evaluations Year of Graduating Class 2013, 2014, 2015 Results Benchmark Met 58% Yes, definitely 38% Yes, somewhat 4% No > 70%, Yes, definitely 0%, No Did Not Meet Comments B. Academic: The student will develop a body of knowledge sufficient for entrance to clinical practice. Alumni Survey 2011, 2012, 2013, 2014 Employer Survey SEE Exam- Pharmacology Certification Exam-Basic Sciences 2011, 2012, 2013, , 2014, 2015, 2016 Alumni Survey 2011, 2012, 2013, 2014 Employer Survey SEE Exam- Total Score 77% Yes, definitely 23% Yes, somewhat 0% No 85% Yes, definitely 15% Yes, somewhat 0% No 47% > 50 th PR 90% > 20 th PR 2013, 2014, % > national mean 2011, 2012, 2013, , 2014, 2015, % Yes, definitely 0% Yes, somewhat 0% No 85% Yes, definitely 15% Yes, somewhat 0% No 53% > 50 th PR 87% > 20 th PR > 70%, Yes, definitely 0%, No > 70%, Yes, definitely 0%, No 50% > 50 th 80% > 20 th National percentile rank 50% > national mean > 70%, Yes, definitely 0%, No > 70%, Yes, definitely 0%, No 50% > 50 th 80% > 20 th National percentile rank 21

22 Certification Exam-Total Score Employment Rate Graduation Rate 2013, 2014, % > national mean 50% > national mean 2013, 2014, % 90% 2013, 2014, % 90% C. Clinical: The student will meet or exceed NBCRNA case requirements. D. Research: The student will be able to formally present and defend their research project or thesis in a public forum. Clinical Case Records Sr Project presentations 2013, 2014, 2015 All met See page , 2014, % 100% E. Professionalism: The student will be able to demonstrate sensitivity to the ethnic and cultural diversity of patients and other providers. Exit Evaluations 2013, 2014, % Yes, definitely 49% Yes, somewhat 4% No > 70%, Yes, definitely 0%, No Alumni Survey 2011, 2012, 2013, 2014 Employer Survey 2011, 2012, 2013, % Yes, definitely 13% Yes, somewhat 0% No 90% Yes, definitely 10% Yes, somewhat 0% No IDI 2013, 2014, % at the Minimization or > 70%, Yes, definitely 0%, No > 70%, Yes, definitely 0%, No 75% at the Minimization or Acceptance, 22

23 F. Professionalism: The student will teach others and participate in continuing education activities to acquire new knowledge and improve practice. Exit Evaluations 2013, 2014, 2015 Alumni Survey 2011, 2012, 2013, 2014 Employer Survey 2011, 2012, 2013, 2014 Acceptance, Adaptation dimension 71% Yes, definitely 24% Yes, somewhat 4% No 94% Yes, definitely 6% Yes, somewhat 0% No 85% Yes, definitely 10% Yes, somewhat 5% No Adaptation dimension > 70%, Yes, definitely 0%, No > 70%, Yes, definitely 0%, No > 70%, Yes, definitely 0%, No 23