MEDICAL RECORDS/ HEALTH INFORMATION MANAGEMENT TECHNOLOGY Plan for Assessment of Student Academic Achievement

Transcription

1 MEDICAL RECORDS/ HEALTH INFORMATION MANAGEMENT TECHNOLOGY Plan for Assessment of Student Academic Achievement From the Mission of Hocking College To prepare individuals for careers as technicians or technologists who will work with skilled craftsmen and professionals. Mission of Academic Affairs Unit To promote learning and learner success. Mission of Medical Records/Health Information Management Technology To prepare individuals for entry-level careers as Health Information Management technicians in health care facilities and to provide graduates with opportunities for advancement and professional development. Central Objective Graduates of the Medical Records/Health Information Management Technology will be well prepared for entry-level employment. IP0001MedicalRecords/HIM-1

2 Institutional Core Competencies The following general outcomes are life and work skills cultivated in all students seeking the Associate Degree. 1. Communicates effectively. 2. Demonstrates math skills. 3. Demonstrates learning and critical thinking skills. 4. Maintains professional skills and attitudes. 5. Practices human relations skills. 6. Demonstrates knowledge of science and the environment. 7. Demonstrates community, cultural, and global awareness. 8. Maintains a code of ethics. Program Exit Competencies The following outcomes express additional, particular skills, behaviors, and attitudes cultivated in students seeking the Associate Degree in Medical Records/Health Information Management. 1. Defines terminology and health information necessary for documentation. 2. Evaluates documentation to support diagnoses, tests, and treatments. 3. Collects, stores, and retains records. 4. Assigns diagnostic/procedure codes. 5. Maintains accuracy of data. 6. Analyzes data and computes statistics. 7. Manages the office environment. 8. Supervises staff. 9. Monitors changes in and compliance with accreditation standards and government regulations. 10. Responds appropriately to requests for release of information. 11. Communicates and behave in a professional manner. The Institutional Core Competencies and Program Exit Competencies combine to form a single set of skills, behaviors, and attitudes determined desirable for entry-level practitioners in Medical Records/Health Information Management, for graduates transferring to four-year institutions, and for educated citizens. IP0001MedicalRecords/HIM-2

3 Criteria for Assessing Student Academic Achievement 1. The aggregate score for each Program Exit Competency evaluated by graduates of the Medical Records/HIM program on a survey will be 3.5 or higher (on a 5-point scale), indicating the graduates satisfaction with their Hocking College preparation for entry-level work. Data gathered for : * Number of Surveys returned: 1 Program Exit Competency** Aggregate Overall aggregate 4.5 **See page 2 of this report for a complete listing of the Program Exit Competencies Data provided by Hocking College Graduate Surveys, This graduate rated each program exit competency above the 3.5 goal. The overall aggregate was 4.5 with no rating falling below 4.0. It is disappointing that only one graduate survey was returned. Student s graduating from the HIM program have completed 360 hours of clinical practice in three different healthcare facilities, all of them requiring completion of tasks more complex than the environment from which this survey is received. Based on most students self-reports plus objective performance evaluations completed by their supervisor, and by the completion of the third clinical which must be completed in an acute care hospital, students perform well on all entry-level competencies required by the American Health Information Management Association. In an exam similar to the Registered Health Information Technician certification exam will be given at the end of the third directed practice, which is a capstone course. Students not passing all ten entry-level competencies tested will not receive a passing grade for the third directed practice capstone course. The student then will be required to complete more directed practice hours in an acute care hospital with the focus being hands on training performing tasks for which they scored poorly on the competency exam. This capstone experience will ensure a graduate is well prepared to enter the work force. Another improvement that is being made in the program is a major focus every quarter on the area of professional behavior. Students will write papers and practice professional behavior skills in the laboratory. This is also the focus of the cohort class that Kris Williams and myself co-teach (Interpersonal Relationships) during the first quarter in the HIM technology. However, it is an area where improvement is needed. IP0001MedicalRecords/HIM-3

4 Does this analysis support conclusions drawn from other assessment data analyzed for ? Please elaborate. Yes, it does support other data. On the same survey, the graduate rated overall satisfaction with technology education at 4.5 (on a 5-point scale). The only suggestion for improvement made by the graduate was to offer more hands-on experiences during the first year of the program. This rating is also consistent with the evaluations by the on-site clinical supervisors for students during Those ratings were 1 st clinical = 4.92, 2 nd clinical = 4.80, and 3 rd clinical = 4.70 (see IP9900, pages 10-12). * Graduate and employer survey results for are reported with data for ; survey results are not available until 15 months following June graduation. IP0001MedicalRecords/HIM-4

5 2. The aggregate score for each Institutional Core Competency evaluated by graduates of the Medical Records/HIM program on a survey will be 3.5 or higher (on a 5-point scale), indicating the graduates satisfaction with their Hocking College preparation in life/job skills. Data gathered for : * Number of Surveys returned: 1 Core Competency** Aggregate Overall Aggregate 4.8 **See page 2 of this report for a complete listing of the Core Competencies Data provided by Hocking College Graduate Surveys, This graduate rated each Institutional Core Competency above the 3.5 goal. The overall aggregate was 4.8 with no individual score falling below 4.0. Does this analysis support conclusions drawn from other assessment data analyzed for ? Please elaborate. Yes, it does support other assessment data. On the same survey, this graduate rated overall satisfaction with Hocking college education at 4.0 (on a 5-point scale). During , onsite clinical supervisors for the students also evaluated mastery of Institutional Core Competencies. Those evaluations were as follows: 1 st clinical=4.91, 2 nd clinical=5.00, and 3 rd clinical=4.67 (see IP9900, pages 10-12). It would be interesting to compare the students grade point average at graduation to their level of satisfaction with their preparedness and see if there is a correlation between the two. One would think that those students with higher grade point averages would be more satisfied than those with lower GPAs. * Graduate and employer survey results for are reported with data for ; survey results are not available until 15 months following June graduation. IP0001MedicalRecords/HIM-5

6 3. The aggregate score for each Program Exit Competency evaluated by employers of Medical Records/HIM graduates on a survey will be 3.5 or higher (on a 5-point scale), indicating betterthan-satisfactory to superior performance. Data gathered for *: Number of employer surveys returned: 2 Program Exit Competencies Aggregates 1. Defines terminology and health information necessary for documentation Evaluates documentation to support diagnosis, tests, and treatments Collects, stores, and retains records Assigns diagnostic/procedure codes Maintains accuracy of data Analyzes data and computes statistics Manages the office environment Supervises staff N/A 9. Monitors changes in and compliance with accreditation N/A 10. Responds appropriately to requests for release of information Communicates and behaves in a professional manner 3.0 Overall aggregate 3.0 Source of information: Hocking College Employer Survey, (Completed by Career Services, June 2001) The mean score of 3.0 is below the program goal of 3.5 (on a 5-point scale). In , no employer surveys were returned so a comparison to the previous year is not possible. Since the ratings were below goal, the type of employment for the graduates was reviewed. It was learned that one student was employed as a receptionist and the skills the student learned at Hocking College in Health Information Management (HIM) were not being utilized. Since one graduate was not employed in a setting in which the specific HIM skills were utilized, it is not appropriate to place emphasis on this particular set of survey results. We will continue to monitor future employer surveys. The addition of the capstone experience as previously described will strengthen the HIM program. Does this analysis support conclusions drawn from other assessment data analyzed for ? Please elaborate. Last year no employer surveys were returned. Thus, it is a significant improvement to have two surveys returned. The employer who responded did not offer any recommendations for improving the program. The employer survey ratings are not supported by on-site clinical supervisors ratings. The onsite clinical supervisors for students during rated student performance at higher levels as follows: 1 st clinical = 4.92, 2 nd clinical = 4.80, and 3 rd clinical = 4.70, (see IP9900, pages 10 12). * Graduate and employer survey results for are reported with data for ; survey results are not available until 15 months following June graduation. IP0001MedicalRecords/HIM-6

7 4. The aggregate score for each Institutional Core Competency evaluated by employers of Medical Records/HIM graduates on a survey will be 3.5 or higher (on a 5-point scale), indicating betterthan-satisfactory to superior performance. Data gathered for *: Number of Surveys returned: 2 Core Competency** Aggregate Overall Aggregate 3.3 **See page 2 of this report for a complete list of Institutional Core Competencies. Source of information: Hocking College Employer Survey, (Completed by Career Services, June 2001) The small number of employer surveys returned is disappointing. It is also disappointing that the overall aggregate fell below the 3.5 goal. We will continue to monitor this information. As mentioned earlier in this report, passing a competency exam as part of successful completion of the HIM capstone clinical practice will be implemented during the school year and will provide a methodology to objectively measure students abilities to perform according to the American Health Information Management Association s expectations regarding entry-level competency. This exam will also afford students the opportunity to receive more hands-on training in areas where they have demonstrated weakness and will ensure they enter the profession with a validation that they are indeed well prepared. Does this analysis support conclusions drawn from other assessment data analyzed for ? Please elaborate. No, it does not. On-site clinical supervisors rated students during the same time period well above the goal. (See IP9900, pages 10-12). It is also significant that the employers did not offer any recommendations for improving the program. However, as stated previously, a better indicator of actual performance will be implemented in 2002 for the HIM capstone course, which will allow us to evaluate how the students performed on an entry-level competency exam for the profession. This exam will also afford opportunity to correlate those results with students and employers perceptions of performance and preparedness. * Graduate and employer survey results for are reported with data for ; survey results are not available until 15 months following June graduation. IP0001MedicalRecords/HIM-7

8 5. Fifty percent of Hocking College s Medical Records/HIM technology graduates responding to a graduate survey will report employment in the field within six months of graduation; within twelve months, that number will reach 80 percent. Data gathered for *: Total number of graduates: 3 Number of graduates available for employment: 3 Number of graduates employed related to technology: 2 Number of graduates furthering education: 0 Source of information: Hocking College Graduate Placement Report, (Completed by Career Services, June 2001) The goal was exceeded since 67% (2 out of 3 )of the students available for employment are employed in the Health Information Management Field with six months of completing the program. Does this analysis support conclusions drawn from other assessment data analyzed for ? Please elaborate. Yes, based upon the job demand in our profession, all students who desire employment in the Health Information Management profession can be gainfully employed upon graduation. Hospital administrators along the Route 33 corridor have solicited the college s help to provide trained coders. However, many of our graduates are not willing to commute nor move in order to apply for higher paying coding positions. In addition, many of our students are choosing not to sit for the RHIT certification exam and employers prefer job applicants that have the credential because passing the exam verifies the student is qualified. As a side note many of the students who enter the program right after high school seem to be pursuing a degree because of parent s pressure to do so. Often, the younger student s perception of employment goals does not match the perception of the parents nor the program goals to provide trained HIM professionals. Younger students seem satisfied to just graduate and secure any type of employment. Whereas older students who enter the program have specific job related goals and are seeking the credential. The older students almost always achieve their goal. Graduate and employer survey results for are reported with data for ; survey results are not available until 15 months following June graduation. IP0001MedicalRecords/HIM-8

9 6. Seventy-eight percent of Health Information Management (HIM) graduates who sit for the American Health Information Management Association (AHIMA) Registered Health Information Technician (RHIT) certification exam within one year of graduation will pass on the first attempt, with a pass rate which meets or exceeds the national average pass rate. Data gathered for : Number of graduates: 9 Number who sat for ART certification exam: 2 (4 total, one retest, and another who had graduated in 1999) Number who passed exam: 1 Passing score: 79% (for 1 student) National Mean: 71% Minimum passing score: 62% The goal was not met. Overall, only 1 graduate passed out of 3 who were taking the test for the first time. Additionally, one of the first time test takers had been out of school for three years and had not been employed in a relevant profession. Excluding that person, the pass rate would be 50%. In addition, the student who passed scored above the National Mean by 8%. Program change planned for as a result of this analysis: The addition of the capstone course as previously described will enhance overall preparation prior to the exam. The exam is now offered quarterly via computer, which should help improve the passing rate as well. The timing of the exam will correlate more closely with program completion. This Criterion will be changed to read as follows in our Plan: This criterion will not be changed. IP0001MedicalRecords/HIM-9

10 7. The aggregate score for HIM graduates who sit for the AHIMA RHIT certification exam for the first time within one year of graduation will meet or exceed the national average scores on each of the ten subtest areas. Data gathered for : Number of students taking exam: 4 Subcategories All Graduates Recent Graduates National Average Data structure, content and use 65% 65% 87% ICD-9-CM coding 66% 74% 85% CPT coding 73% 73% 94% Health Information Analysis 54% 81% 77% Healthcare delivery systems 78% 80% 97% Legal issues 70% 65% 86% Healthcare Information requirements 55% 65% 77% Technology 60% 60% 78% Health Information systems 63% 55% 83% Organization and Supervision 75% 77% 96% It is disappointing that only one subtest by the recent graduates exceeded the National Mean Average. In this particular year, the student group was composed of seven students who had failed in other programs and had transferred into Medical Records. The overall attitude of the group was negative. The student who passed the exam scored above the national mean in two categories. In addition her passing score was 79% compared to the minimum pass score which was 62%. This student's attitude was positive and her grades were significantly higher than the others in this group. Her subtest scores are as follows: Data structure, content and use 77% ICD-9-CM coding 87% CPT coding 93% Health Information Analysis 68% Healthcare delivery systems 90% Legal issues 100% Healthcare Information requirements 70% Technology 70% Health Information systems 70% Organization and Supervision 80% Program change planned for as a result of this analysis: The addition of the capstone course as previously described will enhance overall preparation prior to the exam. The exam is now offered quarterly via computer, which should help improve the passing rate as well. The timing of the exam will correlate more closely with program completion. This Criterion will be changed to read as follows in our Plan: This criterion will not be changed. IP0001MedicalRecords/HIM-10

11 8. The aggregate score for each competency evaluated by on-site clinical supervisors for students in the First HIM Clinical will be 3.5 or higher, indicating better-than-adequate performance. Data gathered for : Number of students evaluated: 7 Competency Aggregate 1. Attend as per schedule Be on time Communicates effectively Demonstrates critical thinking Demonstrates math skills Demonstrates knowledge of science and environment Demonstrates professional skills Maintains code of ethics Demonstrates community, cultural, and global awareness Can define necessary information for documentation Can evaluate documentation to support diagnosis Demonstrates knowledge to collect, store, and retain information Demonstrates knowledge regarding outpatient diagnosis coding Demonstrates knowledge of systems to maintain accuracy of data Demonstrates knowledge of how to analyze date and computerized Statistical reports Demonstrates knowledge of systems to manage Heath Information Department Demonstrates knowledge of how to supervise staff Demonstrates knowledge of how to respond appropriately to requests Can communicate and behave in a professional manner 4.8 Overall 4.4 Note: Students are scheduled to be in the clinical for 8 hours every Thurs/Fri for 8 weeks. The goal was exceeded. Additionally, each performance area exceeded the goal as well. A review of student evaluations indicated that each one received an aggregate score that exceeded the goal as well. Program change planned for as a result of this analysis: The program will not be changed. However, see previous comments (IP0001, page 3) regarding implementation of a competency exam which will be added to the HIM capstone course. This exam will further validate student s preparedness regarding entry-level competency. This Criterion will be changed to read as follows in our Plan: This criterion will not be changed. IP0001MedicalRecords/HIM-11

12 9. The aggregate score for each Competency evaluated by on-site clinical supervisors for students in the second HIM clinical will be 3.8 or higher, indicating better-than-adequate performance. Data gathered for : Number of students evaluated: 8 Competency Aggregate 1. Attendance Punctuality Communicates effectively Demonstrates critical thinking Demonstrates math skills Demonstrates knowledge of science and environment Demonstrates professional skills Maintains code of ethics Demonstrates community, cultural, and global awareness Defines necessary information for documentation Evaluates documentation to support diagnosis Demonstrates knowledge to collect, store, and retain information Demonstrates knowledge regarding outpatient coding Demonstrates knowledge to maintain accuracy of data Demonstrates knowledge of how to analyzes data and computerized statistical reports Demonstrates knowledge of systems to manage Health Information Department Demonstrates knowledge of how to supervise staff Responds appropriately to requests for medical information Communicates and behaves in a professional manner 4.9 Overall 4.8 The overall aggregate exceeded the 3.5 goal (on a 5-point scale). In addition, each individual skill area also exceeded the goal. Additionally, all skill area except one (#17 above) were rated higher when compared to the 1 st clinical experience. Program change planned for as a result of this analysis: The addition of the capstone course will add more objectivity to performance ratings. My experience over the past thirteen years of teaching is that directed practice supervisors exhibit a lot of grace to students when evaluating their performance and tend to give them higher scores than I as an instructor might. This Criterion will be changed to read as follows in our Plan: This criterion will not be changed. IP0001MedicalRecords/HIM-12

13 10. The aggregate score for each competency evaluated by on-site clinical supervisors for students in the third HIM clinical will be 4.1 or higher, indicating excellent to superior performance. Data gathered for : Number of students evaluated: 5 Competency Aggregate 1. Attendance Punctuality Communicates effectively Demonstrates critical thinking Demonstrates math skills Demonstrates knowledge of science and environment Demonstrates professional skills Maintains code of ethics Demonstrates community, cultural, and global awareness Defines necessary information for documentation Evaluates documentation to support diagnosis Demonstrates knowledge to collect, store, and retain information Demonstrates knowledge regarding outpatient diagnosis coding Demonstrates knowledge to maintain accuracy of data Demonstrates knowledge of how to analyzes data and computerized statistical reports Demonstrates knowledge of systems to manage Health Information Department Demonstrates knowledge of how to supervise staff Responds appropriately to requests for medical information Communicates and behaves in a professional manner 5.0 Overall 4.8 The overall aggregate as well as each individual area of competency exceeded the 3.5 goal (on a 5-point scale). Program change planned for as a result of this analysis: The capstone experience will be added as previously described. This Criterion will be changed to read as follows in our Plan: This criterion will not be changed. IP0001MedicalRecords/HIM-13