PROCEDURE 1) The EXIT examination is administered during the final semester synthesis course.

Transcription

1 Program Outcome Assessment Methods Results MSN students will demonstrate professional nurse specialist content/discipline knowledge and skills on the comprehensive EXIT examinations. Content/discipline knowledge and skills are theory-based actions reflected in the core competencies found in: National Organization Of Nurse Practitioner Faculties Domains And Core Competencies Of Nurse Practitioner Practice (NONPF, 2006); or Scope and Standards for Nurse Anesthesia Practice rates on national standardized comprehensive EXIT examinations (HESI/Fitzgerald/PNP/Anesthesia Self-Evaluation Examination [SEE]). Examination content includes all core competencies. MSN students enrolled in the final semester course will pass at the facultydetermined passing score (depends on national average for each certification exam) on the national standardized comprehensive EXIT examination. 1) The EXIT examination is administered during the final semester synthesis course. 2) The data will be aggregated to determine the percentile of the students who met the standard. 3) All students in the synthesis course will be assessed. Term NURSE PRACTITIONER (NP) Summer 2010 Students EXIT % (1 st Sitting) Child No cohort Adult % Family % Total % NURSE ANESTHESIA Fall 2009 Total % (self-evaluation exam) (AANA, 200) NP-MSN Tracks: In 2010, 100% of the NP students passed the standardized comprehensive EXIT examinations; For administrators and faculty will institute the following strategies: 1) Mandatory comprehensive EXIT examination during the final semester and a 2-3 day examination review session 2) Students who score below the identified EXIT examination acceptable passing score will develop a remediation plan; and 3) Previous strategies will continue to be implemented (See previous MSN student learning outcome reports). See additional strategies under certification examination pass rates. NP-ANESTHESIA Track: The nurse anesthesia EXIT exam in Fall 2009 was a self-evaluation exam; however, the nurse anesthesia certification pass rate was 76.7%, a decrease from 8.6% in Strategies initiated during were the following: 1) Re-sequence courses to better balance curricular load; 2) Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; ) Incorporate review questions prior to clinical to bridge theory-clinical gap; ) Establish a pass/fail EXIT comprehensive exam that includes an oral/written component; 6) Contract with a new external board exam review group that will provide computerized practice exams and pre & post review course mock exam data. 1

2 Program Outcome Assessment Methods Results Post graduation, MSN graduates will demonstrate professional nurse specialist content/discipline knowledge and skills on the national certification examinations. rates on certification examinations - American Nurses Credentialing Center (ANCC), American Academy of Nurse Practitioners (AANP), Pediatric Nursing Certification Board, and the Nurse Anesthesia National Certification Examination (NCE). rates for MSN alumni (first sitting) will be within 10% range of the national pass rates. rates will be reported from American Nurses Credentialing Center (ANCC), American Academy of Nurse Practitioners (AANP), Pediatric Nursing Certification, and the Nurse Anesthesia National Certification Examination (NCE) for all the alumni. CERT EXAM Rates (1 st Sitting) Adult NP-AANP Adult NP-ANCC Pediatric NP-ANCC Family NP-AANP Family NP-ANCC A Psych NP-ANCC NP-% PASS RATE Nurse Anesthesia % 100.0% 7.0% 60.0% % 79.1% 82.3% 86.9% 8.8% % 60.0% 100.0% 68% 8.7% 77.9% 3.7% 8.1% % 3.9% 0.0% 0.0% 0.0% 8% 9.% 82.7% 0.6% 88.1% % 63.6% 60.0% 66.7% 7.0% CERT EXAM Rates (1 st Sitting) Adult NP-AANP Adult NP-ANCC Pediatric NP-ANCC Family NP-AANP Family NP-ANCC A Psych NP-ANCC Fam/Psy NP-ANCC Ped Nurs Cert Board NP-% PASS RATE Nurse Anesthesia % 62.% 0.0% 70.0% 81.3% 20.0% 62% 91.9% NP-MSN Tracks: In 2009 all NP nurse practitioner certification pass rates were 82%, an increase from 6% in For administrators and faculty teaching in the NP tracks will continue the following strategies: 1) Continue the numerical passing grade for all graduate courses from B =80-83 to B+ =8-88; 2) Reduced the number of conditionally admitted students; 3) Previous strategies will continue to be implemented (See previous outcome reports); and ) See additional strategies under comprehensive EXIT examination pass rates. ANESTHESIA-MSN Track: The nurse anesthesia certification pass rate in 2009 was 76.7%, a decrease from 8.6% in Administrators attribute part of the decrease in the certification pass rate to a new national testing format: multiple-multiple choice questions, short answer, clicking on anatomical locations, and calculated answers (the national pass rate also decreased). Strategies initiated during were the following: 1) Re-sequence courses to better balance curricular load; 2) Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; ) Incorporate review questions prior to clinical to bridge theory-clinical gap; ) Establish a pass/fail comprehensive EXIT exam that includes oral/written component; 6) Contract with a new external board exam review group that will provide computerized practice exams and pre & post review course mock exam data. 92.8% 8.3% 78.7% 92.8% 93.2% 80.1% % 3.3% 7.0% 62.%.6% 7.0% 68% 92.1% 90.0% 87.2% 73.9% 83.0% 79.9% 82.9% %.% 81.8% 2.0% 6% 8.6% 8.3% 82.% 93.1% 78.8% % 97.0% 82.00% 63.16% 91.67% 79.00% 92.86% 0.00% 7.00% 82% 76.7% 83.0% 82.% 8.9% 91.7% 79.9% 87.% 8.0% 93.07% 80.62% 86.7% 2

3 Program Outcome As nurse specialists, MSN alumni will function as effective communicators in advanced practice. Assessment Methods Alumni Survey: Effective communication item statements evaluated are noted in the results. On a point Likert-type scale (1 = Not at all = Very much), alumni will rate the communication survey items with an average of 3. or higher. 1) At two (2) months and one (1) year post graduation, alumni will be sent the survey. 2) Data will be aggregated to determine the mean of the statement. Employer Performance Appraisal: Effective communication item statements evaluated are noted in the results. On a point Likert-type scale (1 = Not at all = Very much), alumni will rate at least one of the communication survey items with an average of 3. or higher. 1) The Appraisal will be included with the POST 1 YR Alumni Survey. Alumni recipients are instructed to have his/her employer return the survey. 2) Data will be aggregated to determine the mean of the statement. Results EXIT MSN Alumni Survey: Fall 09 Sum 10 Sum 10 Sum 10 ANP FNP P-MSN Return=2 (%) 10(10%) 13(13%) (%) -2 communicating effectively with individuals/families communicating effectively intra-professionally using consultation activities to meet client needs performing professional education activities assuming leadership roles in ANP POST 1 YR MSN Alumni Survey: (Spring 2010) Total Return = 32 (10%) Return= 17-2 communicating effectively with individuals/families communicating effectively intra-professionally using consultation activities to meet client needs..7-8 performing professional education activities assuming leadership roles in ANP..2 MSN Employer Performance Appraisal (Spring, 2010) On the following statement: Indicate appropriate performance factors for this employee, taking into consideration the employee s educational level and job title/description: Total Return = 18 (%) Return= 9-3 Inter-relationships (rapport).67 - Leadership.6 - Written/verbal communication skills.67-6 Participation in organization.6 *< 3.0 During the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced Practice Nursing (American Association of Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr. Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner practice. The course objectives revision will be implemented during

4 Program Outcome As nurse specialists, MSN alumni will function as effective caregivers in advanced practice. Assessment Methods Alumni Survey: Professional nurse specialist item statements evaluated are noted in the results. On a point Likert-type scale (1 = Not at all = Very much), alumni will rate caregiver survey items with an average of 3. or higher.. 1) At two (2) months and one (1) year post graduation, alumni will be sent the survey. 2) Data will be aggregated to determine the mean of the statement. Employer Performance Appraisal: Professional nurse specialist item statements evaluated are noted in the results. On a point Likert-type scale (1 = Not at all = Very much), alumni will rate at least one of the professional nurse specialist survey items with an average of 3. or higher. 1) The Appraisal will be included with the POST 1 YR Alumni Survey. Alumni recipients are instructed to have his/her employer return the survey. 2) Data will be aggregated to determine the mean of the statement. Results EXIT MSN Alumni Survey: Fall 09 Sum 10 Sum 10 Sum 10 ANP FNP P-MSN Return=2 (%) 10(10%) 13(13%) (%) -1 assessing individuals and families needs performing advanced practice therapeutics managing client care adapting advanced practice therapeutics to situations conducting research studies for improving nursing practice understanding legal and ethical implications for ANP." understanding cultural implications for ANP." obtaining advanced certification POST 1 YR MSN Alumni Survey: (Spring 2010) Total Return = 32 (10%) Return= 17-1 assessing individuals and families needs performing advanced practice therapeutics managing client care..1-6 adapting advanced practice therapeutics to situations..3-9 conducting research studies for improving nursing practice understanding legal and ethical implications for ANP.".1-12 understanding cultural implications for ANP.".7-13 obtaining advanced certification..29 MSN Employer Performance Appraisal: (Spring, 2009) On the following statement: Indicate appropriate performance factors for this employee, taking into consideration the employee s educational level and job title/description: Total Return = 18 (%) Return= 9-1 Knowledge base.78-2 Professional performance.89 *< 3.0 During the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced Practice Nursing (American Association of Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr. Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner practice. The course objectives revision will be implemented during

5 Support System Assessment Method Results CNHS administrators and staff will provide courteous, timely, and competent services and effective support to MSN students. Alumni survey: Level of satisfaction item statements evaluated are noted in the results. On a point Likert-type scale (1 = Not at all = Very much), alumni will rate the level of satisfaction survey items with an average of 3. or higher. 1) At two (2) months and one (1) year post graduation, alumni will be sent the survey. 2) Data will be aggregated to determine the mean of the statement. EXIT MSN Alumni Survey: Indicate your level of satisfaction for Nursing resources/ support services during your program of study: Fall 09 Sum 10 Sum 10 Sum 10 Spring 10 ANP FNP P-MSN POST 1 YR Return=2(%) Return=10(10%) Return=13(13%) Return=(%) Return=17 NURSING program information (printed) NURSING web site NURSING support personnel (e.g., secretaries) *.33 NURSING pre-program advisement services *.13 NURSING program advisement services NURSING scholarship/financial aid information NURSING skills laboratory (ies) NURSING audiovisual materials NURSING computer laboratory NURSING library materials NURSING student governance Indicate your level of satisfaction for Florida International University (FIU) resources/ support services during your program of study: FIU web site FIU advisement service FIU admission services FIU registration services * 3.71 FIU financial aid services FIU Learning Center FIU library services FIU health services FIU student governance *< 3.0 Use of Results for Improving Student Learning CON support personnel: Support personnel will attend appropriate training sessions to increase knowledge and skills. CON pre-program/program advisement services: 1) Student advisement workshops will be held annually by experienced faculty/staff for new and current faculty; 2) A student services satisfaction survey is currently being developed. FIU services: At meetings with FIU administrators, issues with FIU services (registration, etc.) were discussed.

6 Summarize use of results for continuous improvement of the educational program: Comprehensive (EXIT) Examination NP-MSN Tracks: In 2010, 100% of the NP students passed the standardized comprehensive EXIT examinations; For administrators and faculty will continue the following strategies: 1) Mandatory comprehensive EXIT examinations and a 3 day examination review session. Students must take the HESI and Fitzgerald (pre/post) examinations and must attend a 3 day Fitzgerald Review session; 2) To pass the capstone course, all students must receive a passing score (determined by the individual examination passing scores) on the two comprehensive EXIT examinations (HESI and Fitzgerald post-test). Child Health students will use the PNP examination; 3) Faculty will provide remediation if students do not pass any of the comprehensive EXIT examinations; ) If all efforts fail and students still do not pass the comprehensive EXIT examinations, they will be required to repeat the course the following semester; ) Previous strategies will continue to be implemented (See previous MSN student learning outcome reports). See additional strategies under certification examination pass rates. NP-ANESTHESIA Track: The nurse anesthesia EXIT exam in Fall 2009 was a self-evaluation exam; however, the nurse anesthesia certification pass rate was 76.7%, a decrease from 8.6% in Strategies initiated during were the following: 1) Re-sequence courses to better balance curricular load; 2) Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; ) Incorporate review questions prior to clinical to bridge theory-clinical gap; ) Establish a pass/fail EXIT comprehensive exam that includes an oral/written component; 6) Contract with a new external board exam review group that will provide computerized practice exams and pre & post review course mock exam data. Certification Examinations NP-MSN Tracks: In 2009 all NP nurse practitioner certification pass rates were 82%, an increase from 6% in For administrators and faculty teaching in the NP tracks will continue the following strategies: 1) Continue the numerical passing grade for all graduate courses from B =80-83 to B+ =8-88; 2) Reduced the number of conditionally admitted students; 3) Previous strategies will continue to be implemented (See previous outcome reports); and ) See additional strategies under comprehensive EXIT examination pass rates. ANESTHESIA-MSN Track: The nurse anesthesia certification pass rate in 2009 was 76.7%, a decrease from 8.6% in Administrators attribute part of the decrease in the certification pass rate to a new national testing format: multiple-multiple choice questions, short answer, clicking on anatomical locations, and calculated answers (the national pass rate also decreased). Strategies initiated during were the following: 1) Re-sequence courses to better balance curricular load; 2) Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; ) Incorporate review questions prior to clinical to bridge theory-clinical gap; ) Establish a pass/fail comprehensive EXIT exam that includes oral/written component; 6) Contract with a new external board exam review group that will provide computerized practice exams and pre & post review course mock exam data. Alumni Surveys During the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced Practice Nursing (American Association of Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr. Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner practice. The course objectives revision will be implemented during Program Support/Services During the following changes were made to support services based on feedback (level of satisfaction items below average of 3.) from alumni: CON support personnel: Support personnel will attend appropriate training sessions to increase knowledge and skills. CON pre-program/program advisement services: 1) Student advisement workshops will be held annually by experienced faculty/staff for new and current faculty; 2) A student services satisfaction survey is currently being developed. FIU services: At meetings with FIU administrators, issues with FIU services (registration, etc.) were discussed. 6

7 NOTE: Due to low return rates on mailed Alumni EXIT and POST 1 YEAR surveys, the alumni surveys were developed in an online format during summer 2101 using Qualtrics software. New procedures will be developed on ing these surveys during the academic year and forward. 7