Health Information Management (Program/Option) Martin Smith (Report Prepared By) Table of Contents Assessment Records 1. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Data Structure, Content and Use. 2. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Clinical Classification Systems - ICD-9-CM Coding. 3. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Clinical Classification Systems - CPT Coding. 4. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Health Information Analysis. 5. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Delivery Systems. 6. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Legal Issues. 7. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Information Requirements and Standards. 8. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Information Technology. 9. Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Health Information Systems. 10. Students will develop knowledge and skills at the recall, application, and analysis levels in St. Petersburg College Page 1 of 28 - September 14, 2009
Approvals the content area of Organization and Supervision. Educational Outcomes Coordinator(s): Jesse Coraggio, Magaly Tymms - August 25, 2009 Provost : Phil Nicotera - September 10, 2009 VP Educational and Student Services: Anne Cooper - September 14, 2009 St. Petersburg College Page 2 of 28 - September 14, 2009
Introduction In support of the mission of St. Petersburg College, faculty committees established several specific goals. Two of these goals, as stated in the College s Mission Statement are to: Expand student access to baccalaureate programs, bachelor's degrees, graduate degrees, and careers; as well as prepare lower division students for successful transfer into baccalaureate programs through the associate in arts and articulated associate in science degree programs Perform continuous institutional self-evaluation and efficient and effective operations to assure a culture of excellence in student services and academic success It is the intent of St. Petersburg College to incorporate continuous improvement practices in all areas. Assessment reports provide comparisons of present and past results which are used to identify topics where improvement is possible. SPC has traditionally used past results as a vital tool in achieving its commitment to continuous improvement. St. Petersburg College Page 3 of 28 - September 14, 2009
I. Major Learning Outcome #1 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Data Structure, Content and Use. II. Introduction Use of Past Results: SPC graduates from the Health Information Management Associate in Science (HIM A.S.) degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the Registered Health Information Technician (RHIT) examination that exceeded the national means for all RHIT exam candidates for scores in Subdomain 1.A. Healthcare Data Structure, Content, and Use. These results can be interpreted to conclude that the SPC HIM A.S. degree program is exceeding the expectations outlined in the Criteria for Success. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). St. Petersburg College Page 4 of 28 - September 14, 2009
Domain Specifications: The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Data Structure, Content and Use. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Healthcare Data Structure, Content, and Use based on results from new (first-time) exam candidates. V. Summary of Assessment Findings Testing Period Number of Students SPC National 2006 10 18.02 18.92-0.90 2007 10 4.10 5.11-1.01 2008 10 4.50 4.46 0.04 Difference Outcome Did not meet Did not meet. VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrated below mean/average scores on the RHIT examination. The s were not met in two out of the three years reporting period for the national means for all RHIT exam candidates for scores in Sub-domain 1.A. Healthcare Data Structure, Content, and Use. These results can be interpreted to conclude that the SPC HIM A.S. degree program requires an action plan to increase the expectations outlined in the Criteria for Success. VII. Action Plan and Timetable for Implementation St. Petersburg College Page 5 of 28 - September 14, 2009
Based on the analysis of the results the following Action Plan Items have been selected for implementation: Ref. # B. Enhance Curriculum & Faculty Development B1. Align curriculum with General Education Objective and/or Accreditation/National Standards of the discipline B4. Revise course content Action Plan Detail B. Enhance Curriculum & Faculty Development B1. The Major Learning Outcomes have been revised to align with the Accreditation/National Standards of the discipline. In spring 2010 we will introduce an updated version of the textbook used in our core HIM courses and update material in the courses based upon this book. This will further align the curriculum with Accreditation/National Standards of the discipline. This is a global action item which applies to all Major Learning Outcomes. B4. Revise the course content to ensure that the current national exam objectives are being taught in the courses that relate to this learning outcome. I. Major Learning Outcome #2 Date to Accomplish 6/2010 6/2010 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Clinical Classification Systems - ICD-9-CM Coding. II. Introduction Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination that were below the national means for all RHIT exam candidates for scores in Subdomain 1.B. St. Petersburg College Page 6 of 28 - September 14, 2009
Clinical Classification Systems - ICD-9-CM Coding. These results can be interpreted to conclude that the SPC HIM A.S. degree program is not achieving the expectations outlined in the Criteria for Success. Results were reviewed with the HIM Faculty in 2006, and appropriate interventions were planned for implementation. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications: Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Clinical Classification Systems - ICD-9-CM Coding. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Clinical Classification Systems - ICD-9-CM Coding based on results from new (first-time) exam candidates. V. Summary of Assessment Findings St. Petersburg College Page 7 of 28 - September 14, 2009
Testing Period Number of Students SPC National 2006 10 8.25 8.20 0.05 2007 10 5.39 5.00 0.39 2008 10 5.16 5.70-0.54 Difference Outcome Did not meet VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrate mean/average scores on the RHIT examination for years 2006 and 2007 that exceed the national mean for scores in Subdomain 1.B. Clinical Classification Systems ICD-9 Coding. However, the SPC mean in this content area was below the national mean for all RHIT exam candidates in 2008. Further analysis reveals that this continues to be an area of concern which was carried over from the previous three year assessment. Additional steps are being taken to ensure this will not remain the same for the next reporting cycle. See action plan for details. VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: A. Enable Greater Student Success A1. Identify needs and address ways to improve overall student success B. Enhance Curriculum & Faculty Development B4. Revise course content St. Petersburg College Page 8 of 28 - September 14, 2009
Ref. # Action Plan Detail A. Enable Greater Student Success A1. New adjuncts have been hired to teach the basic ICD-9 coding class. These adjuncts are working professionals with many years of coding experience and are a significant upgrade from those hired during the previous reporting cycle. Date to Accomplish 6/2010 This action item applies to MLO 2 and MLO 3. B. Enhance Curriculum & Faculty Development B4. We will alter the method of assessment in the classes to ensure that 6/2010 student's have obtained the basic coding skills prior to moving forward in our program. In addition, as mentioned in the action plan for MLO 1, we will be adding new textbooks to our coding classes that provide a more learner centered style in addition to more hands on practical coding rather than the previous style which centered around a traditional testing approach. This action item applies to MLO 2 and MLO 3. I. Major Learning Outcome #3 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Clinical Classification Systems - CPT Coding. II. Introduction Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination that were below the national means for all RHIT exam candidates for scores in Subdomain 1.C. Clinical Classification Systems - CPT Coding. These results can be interpreted to conclude that the SPC HIM A.S. degree program is not achieving the expectations outlined in the Criteria for Success. St. Petersburg College Page 9 of 28 - September 14, 2009
Results were reviewed with the HIM Faculty in 2006, and appropriate interventions were planned for implementation. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications: The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Clinical Classification Systems - CPT Coding. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Clinical Classification Systems - CPT Coding based on results from new (first-time) exam candidates. V. Summary of Assessment Findings St. Petersburg College Page 10 of 28 - September 14, 2009
Testing Period Number of Students SPC National 2006 10 10.01 9.36 0.65 2007 10 7.20 7.99-0.79 2008 10 10.40 9.57 0.83 Difference Outcome Did not meet VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrated mean/average scores on the RHIT examination for years 2006 and 2008 that exceeded the national mean for scores in Subdomain 1.C. Clinical Classification Systems - CPT Coding. However, the SPC mean in this content area was below the national mean for all RHIT exam candidates in 2007. Further analysis of outcomes in this subdomain for the years 2003, 2004, and 2005 indicated that scores in this content area for four out of the six years (2003-2008) have exceeded the national mean except in year 2004 & 2007. Since the 2008 SPC results rebounded to exceed the national mean, we conclude that the SPC HIM A.S. degree program is consistently achieving the expectations outlined in the Criteria for Success. However, since this continues to be an area of concern which was carried over from the previous three year assessment, additional steps are being taken to ensure that this will not remain the same for the next reporting cycle. The action plan stated within MLO 2, addresses both MLO 2 and MLO 3. VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: E. None St. Petersburg College Page 11 of 28 - September 14, 2009
E1. No Action Plan is deemed necessary Ref. # Action Plan Detail Date to Accomplish E. None E1. No Action is deemed necessary. 7/2009 I. Major Learning Outcome #4 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Health Information Analysis. II. Introduction Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination that were below the national means for all RHIT exam candidates for scores in Domain 2. Health Information Analysis. These results can be interpreted to conclude that the SPC HIM A.S. degree program is not achieving the expectations outlined in the Criteria for Success. Results were reviewed with the HIM Faculty in 2006, and appropriate interventions were planned for implementation. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination St. Petersburg College Page 12 of 28 - September 14, 2009
Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications: The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Health Information Analysis. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Health Information Analysis based on results from new (first-time) exam candidates. V. Summary of Assessment Findings Testing Period Number of Students SPC National 2006 10 15.60 15.54 0.06 2007 10 5.25 5.17 0.08 2008 10 5.10 5.20-0.10 Difference Outcome Did not meet VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrated mean/average scores on the RHIT examination for years 2006 and 2007 that exceeded the national mean for scores in Subdomain 2. Health Information Analysis. However, the SPC mean in this content area was below the national mean for all RHIT exam candidates in 2008. Further analysis of outcomes in this subdomain indicated that this subdomain was split into two different areas in 2007. St. Petersburg College Page 13 of 28 - September 14, 2009
subdomain was split into two different areas in 2007. Results were reviewed with the HIM Faculty in 2008, and appropriate interventions were planned for implementation. See action plan for details. VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: B. Enhance Curriculum & Faculty Development B4. Revise course content Ref. # Action Plan Detail B. Enhance Curriculum & Faculty Development B4. In 2007 the learning outcome was split into two different areas. We will update the content of courses to reflect these changes in addition to adding an additional learning outcome to this assessment in order to reflect these changes. Date to Accomplish 6/2010 I. Major Learning Outcome #5 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Delivery Systems. II. Introduction Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination that exceeded the national means for all RHIT exam candidates for scores in Subdomain 3.A. Healthcare Delivery Systems. These results can be interpreted to conclude that the SPC HIM A.S. degree program is exceeding the expectations outlined in the Criteria for Success. St. Petersburg College Page 14 of 28 - September 14, 2009
III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications: The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Delivery Systems. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Healthcare Delivery Systems based on results from new (first-time) exam candidates. V. Summary of Assessment Findings Testing Period Number of Students SPC National Difference Outcome St. Petersburg College Page 15 of 28 - September 14, 2009
2006 10 6.30 5.91 0.39 2007 10 6.00 5.79 0.21 2008 10 6.90 6.06 0.84 VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrated mean/average scores on the RHIT examination that exceeded the national means for all RHIT exam candidates for scores in Subdomain 3.A. Healthcare Delivery Systems. These results can be interpreted to conclude that the SPC HIM A.S. degree program is exceeding the expectations outlined in the Criteria for Success. VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: E. None E1. No Action Plan is deemed necessary Ref. # Action Plan Detail Date to Accomplish E. None E1. Learning outcomes were met, no action plan required. 07/2009 I. Major Learning Outcome #6 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Legal Issues. II. Introduction St. Petersburg College Page 16 of 28 - September 14, 2009
Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination for years 2003 and 2005 that exceeded the national mean for scores in Subdomain 3.B. Legal Issues. However, the SPC mean in this content area was below the national mean for all RHIT exam candidates in 2004. Further analysis of outcomes in this subdomain for the years 2000, 2001, and 2002 indicated that scores in this content area for five out of the six years (2000-2005) have exceeded the national mean except in year 2004. Since the 2005 SPC results rebounded to exceed the national mean in 2005, we concluded that the SPC HIM A.S. degree program is consistently achieving the expectations outlined in the Criteria for Success. However, results in future years will continue to be monitored to determine if further action is needed. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications:The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Legal Issues. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Legal Issues based on results from new (first-time) exam candidates. St. Petersburg College Page 17 of 28 - September 14, 2009
Legal Issues based on results from new (first-time) exam candidates. V. Summary of Assessment Findings Testing Period Number of Students SPC National 2006 10 5.60 5.37 0.23 2007 10 9.50 9.38 0.12 2008 10 9.40 9.19 0.21 Difference Outcome VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrated mean/average scores on the RHIT examination that exceeded the national means for all RHIT exam candidates for scores in Subdomain 3.B. Legal Issues. These results can be interpreted to conclude that the SPC HIM A.S. degree program is exceeding the expectations outlined in the Criteria for Success. VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: E. None E1. No Action Plan is deemed necessary Ref. # Action Plan Detail Date to Accomplish E. None E1. Standards exceeded, no action plan required. 6/2010 St. Petersburg College Page 18 of 28 - September 14, 2009
I. Major Learning Outcome #7 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Information Requirements and Standards. II. Introduction Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination that were below the national means for all RHIT exam candidates for scores in Subdomain 3.C. Healthcare Information Requirements and Standards. These results were interpreted to conclude that the SPC HIM A.S. degree program was not achieving the expectations outlined in the Criteria for Success. Results were reviewed with the HIM Faculty in 2006, and appropriate interventions were planned for implementation. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications: The student will acquire knowledge and skills at the recall, St. Petersburg College Page 19 of 28 - September 14, 2009
Domain Specifications: The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Healthcare Information Requirements and Standards. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Healthcare Information Requirements and Standards based on results from new (first-time) exam candidates. V. Summary of Assessment Findings Testing Period Number of Students SPC National 2006 10 7.60 7.18 0.42 2007 10 NA NA NA 2008 10 NA NA NA Difference Outcome Standard Removed Standard Removed VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for 2006 demonstrated mean/average scores on the RHIT examination that exceeded the national means for all RHIT exam candidates for scores in Subdomain 3.C. Healthcare Information Requirements and Standards. These results can be interpreted to conclude that the SPC HIM A.S. degree program is exceeding the expectations outlined in the Criteria for Success. NOTE: This subdomain was eliminated in 2007 and will thus be removed from this assessment report in future years. St. Petersburg College Page 20 of 28 - September 14, 2009
VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: E. None E1. No Action Plan is deemed necessary Ref. # Action Plan Detail Date to Accomplish E. None E1. No Action Plan is deemed necessary. 7/2009 I. Major Learning Outcome #8 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Information Technology. II. Introduction Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination that exceeded the national means for all RHIT exam candidates for scores in Subdomain 4.A. Information Technology. These results can be interpreted to conclude that the SPC HIM A.S. degree program is exceeding the expectations outlined in the Criteria for Success. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national St. Petersburg College Page 21 of 28 - September 14, 2009
graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination. Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications: The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Information Technology. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Information Technology based on results from new (first-time) exam candidates. V. Summary of Assessment Findings Testing Period Number of Students SPC National 2006 10 5.60 5.88-0.28 2007 10 7.00 6.91 0.09 2008 10 8.80 8.23 0.57 Difference Outcome Did not meet St. Petersburg College Page 22 of 28 - September 14, 2009
VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrate mean/average scores on the RHIT examination for years 2007 and 2008 that exceed the national mean for scores in Sub-domain 4.A. Information Technology. However, the SPC mean in this content area was below the national mean for all RHIT exam candidates in 2006. Since the 2006 SPC results rebounded to exceed the national mean in susequent years, we conclude that the SPC HIM A.S. degree program is consistently achieving the expectations outlined in the Criteria for Success. However, results in future years will continue to be monitored to determine if further action is needed. VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: E. None E1. No Action Plan is deemed necessary Ref. # Action Plan Detail Date to Accomplish E. None E1. No action plan needed at this time. 6/2010 I. Major Learning Outcome #9 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Health Information Systems. II. Introduction Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination that exceeded the national means for all RHIT exam candidates for scores in Subdomain 4.B. St. Petersburg College Page 23 of 28 - September 14, 2009
Health Information Systems. These results can be interpreted to conclude that the SPC HIM A.S. degree program is exceeding the expectations outlined in the Criteria for Success. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination. Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications: The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Health Information Systems. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Health Information Systems based on results from new (first-time) exam candidates. V. Summary of Assessment Findings Testing Period Number of Students SPC National Difference Outcome St. Petersburg College Page 24 of 28 - September 14, 2009
2006 10 5.20 4.85 0.35 2007 10 7.60 8.13-0.53 2008 10 7.50 7.29 0.21 Did not meet VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrated mean/average scores on the RHIT examination for years 2006 and 2008 that exceed the national mean for scores in Sub-domain 4.B. Health Information Systems. However, the SPC mean in this content area was below the national mean for all RHIT exam candidates in 2007. Further analysis of outcomes in this sub-domain for the years 2003, 2004, and 2005 indicate that scores in this content area for five out of the six years (2003-2008) has exceeded the national mean except in year 2007. Since the 2008 SPC results rebounded to exceed the national mean that year, we conclude that the SPC HIM A.S. degree program is consistently achieving the expectations outlined in the Criteria for Success. However, our accrediting agency CAHIIM has added an additional two subdomains to the area of Health Information Systems which will require us to create an action plan in addition to adding them as new Major Learning outcomes. VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: B. Enhance Curriculum & Faculty Development B4. Revise course content Ref. # Action Plan Detail B. Enhance Curriculum & Faculty Development Date to Accomplish St. Petersburg College Page 25 of 28 - September 14, 2009
B4. Revise the course content to ensure that the current national exam objectives are being taught in the courses that relate to the additional learning outcomes that were added in 2007. 6/2010 This action item impacts MLO 9 and MLO 10. I. Major Learning Outcome #10 Students will develop knowledge and skills at the recall, application, and analysis levels in the content area of Organization and Supervision. II. Introduction Use of Past Results: SPC graduates from the HIM A.S. degree program for the three year period of 2003, 2004, and 2005 demonstrated mean/average scores on the RHIT examination that exceeded the national means for all RHIT exam candidates for scores in Domain 5. Organization and Supervision. These results were interpreted to conclude that the SPC HIM A.S. degree program was exceeding the expectations outlined in the Criteria for Success. III. Methodology s of Assessment: The results of the Registered Health Information Technician (RHIT) examination were utilized to assess the Health Information Management program. Date(s) of Administration: 2006, 2007, and 2008 Assessment Method: Conduct Domain/Sub-domain analysis of performance of SPC graduates on the Registered Health Information Technician (RHIT) examination. The national RHIT exam results are distributed annually to HIM program directors. A detailed breakdown is provided which compares the performance of SPC Health Information Management Associate in Science (HIM A.S.) degree graduates with national means/averages of all exam candidates. Assessment Instrument: Registered Health Information Technician (RHIT) examination. St. Petersburg College Page 26 of 28 - September 14, 2009
Population: Upon successful completion of the SPC Health Information Management Associate in Science (HIM A.S.) degree, the graduate will apply to take the Registered Health Information Technician (RHIT) examination administered by the American Health Information Management Association (AHIMA). Domain Specifications: The student will acquire knowledge and skills at the recall, application, and analysis levels in the content area of Organization and Supervision. IV. Criteria for Success Equal or exceed the RHIT national exam pass rate outcome within the major content area of Organization and Supervision based on results from new (first-time) exam candidates. V. Summary of Assessment Findings Testing Period Number of Students SPC National 2006 10 9.90 9.70 0.20 2007 10 7.60 7.58 0.02 2008 10 6.65 7.52-0.87 Difference Outcome Did not meet VI. Discussion and Analysis of Assessment Findings SPC graduates from the HIM A.S. degree program for the three year period of 2006, 2007, and 2008 demonstrated mean/average scores on the RHIT examination for years 2006 and 2007 that exceeded the national mean for scores in Sub-domain 5. Organization and Supervision. However, the SPC mean in this content area was below the national mean for all RHIT exam candidates in 2008. Further analysis of outcomes in this sub-domain for the years 2007 and 2008 indicated that this domain was split into two different areas and it was the new subdomain that caused our students to not meet the in 2008. St. Petersburg College Page 27 of 28 - September 14, 2009
subdomain that caused our students to not meet the in 2008. Since there are additional domains we will create an action plan to address these changes in addition to adding another learning outcome for this assessment. See action plan for MLO 9, which also addresses MLO 10. VII. Action Plan and Timetable for Implementation Based on the analysis of the results the following Action Plan Items have been selected for implementation: E. None E1. No Action Plan is deemed necessary Ref. # Action Plan Detail Date to Accomplish E. None E1. No Action Plan is deemed necessary. 7/2009 St. Petersburg College Page 28 of 28 - September 14, 2009