Outcomes Assessment Plan Radiologic Technology Program Austin Community College Graduating Class of 2012

Transcription

1 Outcomes Assessment Plan Radiologic Technology Program Austin Community College Graduating Goal #1: Upon completion of the program, the graduate will satisfactorily demonstrate Entry Level Clinical Competency Skills. Desired Outcomes Measurement Tools Benchmarks Time Frame Person/Group Results Responsible 1.1 Students will demonstrate clinical competency 1.1 Clinical Education Plan: 5 Semesters Annually, In the Fall Semester (October) after graduation. 1.2 Level of Clinical Competency as perceived by Employers 1.3 Level of Clinical Competency as perceived by Employers 1.4 Students will deliver quality patient care. 1.5 Level of Clinical Competency as perceived by graduates. 1.2 Employer Survey: Question 4: Evaluation of technical skills 1.3 Employer Survey: Question 5: Rating of graduates education as it relates to the job 1.4. Professional Skills Development Evaluation. Question #9. Student delivers quality patient care 1.5 Graduate Survey: Question 10: How would you rate your technical abilities in relation to other new radiographers? average at least 85%(B) in their Clinical Courses earn an average score of 4.0 points on a scale of 1 5 points. earn an average score of 4.0 points on a scale of 1 5 points. earn an average score of 4.0 points on a scale of 1 5 points. rate themselves with an average score of at least 3.75 on a 1 5 point scale. Twice each semester: RADR 1360, 1361, 2460, 2461, and 2362 Every two years on even numbered Years. Twice each semester for five semesters: RADR 1360, 1361, 2460, 2461, and Every two years on even numbered years. Benchmark not met. Only 75% of students met or exceeded benchmark. 25% made C s. Benchmark met. Results are a score of 4.3. We will continue to monitor. Employer Survey score was 4.1 pts. Students averaged 4.6 on a scale of 1 5 pts. Benchmark Met. Results were a 4.6 out of a 1-5 scale.

2 Desired Outcomes Measurement Tools Benchmarks Time Frame Person/Group Responsible 1.6 Demonstrate 1.6 Rating of Every Semester in positioning skills positioning skills on achieve an average of RADR 1360, 1361, necessary to achieve Clinical Competency 85% or better on 2460,2461, and 2362 a diagnostic Evaluation Form: clinical competency radiograph. Questions: 8, 9, 10, evaluation Demonstrate Competency in Lab Practical Testing for First Year Students. 1.8 Demonstrate Competency in Lab Practical Testing Session for 2 nd Year Students. 12, 13, 14, and Lab Practical Evaluation Form. 1.8 Lab Practical Evaluation Form. achieve an average of 85% or better on lab practical competency testing. achieve an average of at least 85% or better on lab practical competency testing. Results Students achieved a >85% for these positioning skill criteria for each clinical course. Benchmark met. In July, of every year. First Year: Results: All students passed with at least an 85%. Benchmark met. In April of every year. Second Year: Results: All students passed competency tests with at least an 85%. Benchmark met Goal #1: Clinical Competency: 1.1 Students will Demonstrate Clinical Competency: The graduates completed five clinical courses as part of their clinical education plan. In evaluating the outcomes for all enrolled students, it was determined that the majority of the students met or exceeded the established benchmark that all the students would make at least an 85%. The final results were that 75% of the students met or exceeded the benchmark while the remainder were successful, but scored under 85%. It is noted that the majority of the enrolled students that scored under the 85% did so because of point deductions due to absences or poor performance with imaging analysis activities. The Plan of Action for this finding will be as follows: Discuss this observation with current and new incoming students. Be proactive in counseling students that are in danger of missing the benchmark or possibly failing clinical courses.

3 1.2 Level of Clinical Competency as perceived by Employers: Survey data not available yet. The survey is in progress. It should be noted that clinical visits and consultation with clinical officials and Directors indicate that they are pleased with the technical skills of recent graduates. This data will be revised when the information from the surveys becomes available. 1.3 Clinical Competency : Employers rating of graduate s education as it relates to the job. This data is not yet available because the surveys are in progress. This data will be revised when the information from the surveys becomes available. 1.4 Students will deliver quality patient care: The enrolled students and graduates are delivering quality patient care. This has been substantiated by evaluating the Professional skills development Evaluation form. On a scale of 1 5, the program benchmark is 4.0 and the students/graduates achieved at least a 4.6. The progress will continue to be monitored and no significant changes need to be made at this time. This data is also discussed with the students during their clinical counseling sessions twice a semester. 1.5 Level of Clinical Competency as perceived by graduates: This data is not yet available. The survey is in progress and we should have some data soon. 1.6 Demonstrating positioning skills necessary to achieve diagnostic images: The students were evaluated using the clinical competency evaluation form on a number of questions which addressed positioning skills. The benchmark was that students needed to earn at least 85% on the evaluation and it was noted that all of the enrolled students achieved an 85% or better on their clinical evaluations. The program faculty will continue to evaluate this criteria. At the present, it is not necessary that the positioning criteria be revised. The faculty will continue to monitor the criteria. 1.7 Demonstrate competency in lab practical testing for first year students: The benchmark for this outcome is for the students to achieve at least an 85% on simulated clinical procedures in the program lab facilities. The result was that 100% of the students met or exceeded the benchmark. The program faculty will continue to emphasize the importance of practice to the students to ensure that they are aware of their importance. The faculty have established a protocol to document that students are spending time in the lab to practice all the required procedures. Faculty will continue to monitor this area. 1.8 Demonstrate competency in lab practical testing for 2 nd year students: The benchmark for this outcome is for the students to achieve at least an 85% on their lab practical competencies performed in the program lab. The results were that all of the students met or exceeded the benchmark. Faculty will continue to monitor the situation.

4 Improvements to the Assessment Plan The program has converted the surveying process for both graduates and employers to an on-line format. This should help the program make necessary improvements a lot more quickly. The program has employed additional faculty to assist with assessment The program has also employed a tutor that rotates between campuses to work with the students in preparation for a variety of subjects but including their clinical competency skills. Outcomes Assessment Plan Program Goal #2: The Radiography Students will demonstrate problem solving and critical thinking skills in the didactic and clinical components of the program. Desired Outcomes Measurement Tools Benchmark Time Frame Person/Group Responsible 2.1 Students will Annually in December Faculty Member demonstrate ability teaching course to evaluate exposure parameters to adjust radiographic quality factors. 2.1a RADR 1213-Prin of Rad Imaging I Final Exam. Items: 68,69, 71,82, b RADR 1213-Prin of Rad Imaging I Unit 3 Lab Activity on the effects of scatter radiation 2.1a. Students will correctly answer at least 3 out of the 5 identified questions. 2.1b Students will correctly answer 3 of the 4 questions on this lab exercise. Results 2.1a. 80% of the students correctly answered 3 of the 5 questions. Action Plan: Provide additional lecture material and lab activities to enhance this benchmark. 2.1b. 100% of the students correctly answered 4 of the 4 questions in this benchmark. Continue to monitor.

5 Desired Outcomes Measurement Tools Benchmark Time Frame Person/Group Responsible 2.2 Students will 2.2 Clinical Students will achieve Every Semester: Faculty demonstrate the Competency at least 80% on RADR 1360, 1361, ability to perform Evaluation Form. portable chest x rays 2460, 2461, & procedures in a Trauma designation. and cross table lateral trauma setting. hips. 2.3 Students will demonstrate the ability to be innovative in performing difficult simulations in lab setting. 2.3 RADR 2205-Prin of Rad Imaging 2 Lab Project using portable x-ray machine and whole body phantom. Students will achieve at least 85% on simulated trauma patient in the program lab with the portable x-ray unit. Annually in Spring Faculty member teaching course Results % of the students earned 80% or better with trauma procedures for hips and CXRs. 2.3 RADR 2205 Lab Project: Results: 100% of the students at both campuses scored 100% on this lab activity. Benchmark Met. Continue to Monitor. Goal #2: Problem solving and Critical Thinking Skills 2.1 Students will demonstrate ability to revise exposure parameters to change image quality: The enrolled students were evaluated using laboratory activities which demonstrated the role of collimation with the production of scatter radiation. They demonstrated how adjusting the collimation will improve image quality. They also adjusted other exposure parameters to document the changes to image density, contrast, and recorded details. There were two benchmarks which were used which addressed the lab activities and the role of exposure parameters. The students were expected to correctly answer 3 of 5, and 3 of 4 questions in two separate exams. The results were as follows: With the first activity, only 80% of the students answered 3 of the 5 questions correctly. The action plan to address this finding/deficiency is as follows: The program will develop additional learning activities on the role of kvp, mas, and SID. These learning activities will include the use of film screen imaging. It is noted that quality factors such as density, contrast, and details is best addressed with film screen imaging rather than with digital imaging. These activities are available to the students. Additional Individual Tutoring sessions will be conducted prior to unit exams. Group Review Sessions have also been conducted prior to unit exams to better prepare the students for the test.

6 2.2 Students will demonstrate the ability to perform procedures in a trauma setting. To assess this particular outcome/goal, the measurement tool used was the clinical competency evaluation form. Faculty selected two very common trauma procedures (cross table lateral hip and a chest x-ray) to assess the ability of the student to innovate, improvise, or otherwise solve problems by thinking critically. The benchmark was that each student needed to score at least a 75% on these two trauma examinations. The results were that 100% of the students earned a 75% or better and met the benchmark. Faculty will continue to monitor this requirement. No additional action is indicated at this time. 2.3 Students will demonstrate the ability to be innovative in performing difficult simulations in a lab setting. This procedure was performed using a team approach by the students and were evaluated by two faculty members. To ensure that students continue to enhance their skills in performing this kind of examinations, program faculty will conduct additional simulations using different procedures. The procedure may be performed with film/screen or with CR cassettes.

7 Outcomes Assessment Plan Goal #3: The student will demonstrate and practice Professional Growth and Development Desired Outcomes Measurement Tools Benchmark Time Frame Person/Group responsible 3.1 Students will document professional growth and development by demonstrating professionalism and ethical behavior. 3.2 Student delivers quality care regardless of the age, gender, or patient condition. 3.3 Students demonstrate a courteous and respectful attitude toward patients, physicians, clinical personnel, and fellow students. 3.4 Student actively seeks and participates in learning experiences. 3.1 RADR 1309-Intro to Radiography, Unit I assignment Project: Professional and Ethical Behavior Assignment 3.2 Professionalism Section on Professional Skills Development Form., Question #9 3.3 Professionalism Section on Professional Skills Development Form. Question # Independence and Initiative Assessment of Professional Skills. Question 33. The average score of the students will be at least 85% on a 0 100% scale. Each student will achieve at least a 4.0 on a scale of 1 5 points. The average rating of the students will be at least a 4.0 on a scale of 1 5 points. The average rating of the students will be at least 4.0 on a scale of 1 5 points. Results Fall Semester RADR 1309 Faculty RADR 1309 Professionalism/Ethical Behavior Assn. Results: The RRC cohort scored 97.74% and the EVC cohort 93.48%. Benchmarks met. Continue to monitor. Each Clinical Semester: RADR 1360, 1361, 2460, 2461, and 2362 Every Clinical Semester: RADR 1360, 1361, 2460, 2461, and Every Clinical Semester: RADR 1360, 1361, 2460, 2461, 2362 Program faculty Students averaged 4.6 pts on a scale of Will continue to monitor Students averaged 4.7 on a scale of 1-5 points. Will continue to monitor. Also, will have speaker from clinic come emphasize patient care. Students averaged 4.0 on a scale of 1 5 pts. Will continue to encourage students to be proactive.

8 Goal #3 Demonstrating Professional Growth and Development Analysis of Student Learning Outcomes and Plan of Action 3.1 Documenting professional growth and development by demonstrating professionalism and ethical behavior: This outcome requires that faculty assess a learning activity/assignment in RADR Intro to Radiography & Patient Care. This didactic course introduces the student to Radiology and in particular, emphasizes patient care strategies and methods. In Unit 1, the students complete a project on Professional and Ethical Behavior. The faculty established that the benchmark for this learning activity should be no less than 85% to document achievement. The results were that all students were successful and exceeded the 85% benchmark. The Round Rock Campus scored a 97.74% and the Eastview Campus scored The benchmark was met for this outcome and no additional action is needed. 3.2 Delivery of quality care regardless of age, gender, or patient condition: The measurement tool for this particular item was a question in the professionalism section of the Professional Skills Development Form. The benchmark established for this requirement is that the student must earn at least four points on a scale of 1 5. All the students exceeded the benchmark by scoring 4.6 point. Faculty will continue to monitor this particular skill and at the present time, no additional action is necessary. 3.3 Students will demonstrate a courteous and respectful attitude towards patients, Dr. s, clinical personnel, and fellow students: This is the measurement tool used and is found as a question on the professionalism section of the Professional Skills Development Form The benchmark for the desired outcome is that on a scale of 1 5, each student is expected to score at least a 4.0. The results were that all the students met the benchmark by exceeding the set score. The average was a 4.6. Faculty will continue to monitor this particular skill and at the present time, no additional action is necessary. 3.4 Student participation with learning experiences. The measurement tool for this trait is a question on the Professional Skills Development Form which evaluates independence and initiative. The benchmark for this question is that on a scale of 1 5, students are expected to earn at least a 4.0 in how well they show these traits. The results are that the students met the benchmark by all scoring a 4.0. The faculty will continue to monitor this requirement and at the present time, no additional action is necessary. Students will be encouraged to be proactive in the performance of their duties. Don t wait to be told what to do if there is work to be done.

9 Outcomes Assessment Plan Goal #4: Upon completion of the program, the graduate will demonstrate satisfactory communication skills Desired Outcomes Measurement Tools Benchmark Time Frame Responsible Party Results 4.1 Enrolled students will demonstrate satisfactory communication skills in clinical courses. Professional Skills Development Evaluation. Communication Section, questions 16 average at least a 3.75 points on a 1 5 point scale Every Clinical Semester: RADR 1360, 1361, 2460, 2461, and Program faculty Students averaged 4.47 pts on a scale of 1 5 points. Continue to monitor. 4.2 Enrolled students will demonstrate satisfactory communication skills during lab simulation testing 4.3 Enrolled students will demonstrate satisfactory oral presentation skills. 4.4 Graduates will demonstrate satisfactory communication skills. 21 Evaluation form for lab challenges in RADR 1411-Basic Procedures and RADR 2431-Adv. Procedures, question #17 Research and Presentation Project, RADR 2233-Adv. Med Imaging. Grade Form Employer Survey, Section 4: Communication Question. communicate effectively with simulated patients at least 80% of the time during the evaluation average 85% or better on the combined research paper and oral presentation. Survey results on communication skills of graduates will average 4.0 on a 1 5 point scale. Every Fall and Spring Semesters Every Spring in May Every two years on even years teaching RADR 2233 Evaluation forms for question #17 (communication skills) shows a > 80% success rate on good communication. All the students were successful on the written research paper. The average score was 93%. Benchmark not met on oral presentation. See Action Plan. Results were an average of 4.5 on a 1 5 scale. Continue to monitor.

10 Goal #4: Satisfactory Communication Skills Analysis of Student Learning Outcomes & Plan of Action Analysis of Student Learning Outcomes & Plan of Action 4.1 Enrolled Students will demonstrated Satisfactory Communication Skills: The assessment/measurement tool for this desired outcome is the Professional Skills Development Form. It should be noted that clinical instructors perform this evaluation twice a semester, one midway through the clinical semester and the other at the end of the semester. There is sufficient time between the two evaluations to enable progress to be demonstrated from one evaluation to another. The faculty selected six questions under the communications section of the evaluation and these include: Effective communication & interaction with all members of the health care team. Student introduces self to patient. Student addresses patient respectfully and not with pet names. Student obtains the patient s clinical history. Student explains procedure to patient in understandable terms. Student provides physician/clinical staff with pertinent information Communication skills on the evaluation form are graded on a scale of 1 5 points and the benchmark is an average at least a 3.75 for the skills listed. The results were that the students averaged Faculty will continue to monitor, otherwise, no additional action is needed. 4.2 Effective communication skills during lab simulation testing: The evaluation form used for this outcome is the standard lab challenge evaluation form that is used during simulated lab procedures, question # 17. The benchmark is that the students will communicate effectively with simulated patients at least 80% of the time. The results are that the benchmark was met. It is noted that the students all scored >80% on this evaluation form. The faculty will continue to monitor this component of assessment. No additional action needs to be taken at this time. 4.3 demonstrate satisfactory written and oral presentation skills: This outcome was measured with a research paper that is required in RADR 2233-Advanced Medical Imaging. The benchmark for this measurement tool is that students will score 85% or better with the written and oral presentations. Because the program is now using a hybrid classroom curriculum, the amount of class time available for presentations was not available. The written part of the measurement was successful and all the students passed with an average of 93%. To provide sufficient time for presentations, the students will be scheduled to do presentation during non-class days when they are available. This will be done beginning in the Spring of It should be also noted that as part of the program academic support course requirements, students are required to complete English Composition I and Introduction to Public Speaking. All of the students complete these courses before they enroll in the radiology courses.

11 4.4 Graduates will demonstrate satisfactory communication skills: The measurement tool for this outcome is a question about communication in the Employer Survey. Because the surveys are currently in progress, the results are not available yet. The results will be posted as soon as all the surveys are processed.