SUBSTANCE ABUSE COUNSELING ARTIFACT ASSESSMENT RESULTS

Transcription

1 SUBSTANCE ABUSE COUNSELING ARTIFACT ASSESSMENT RESULTS Evaluation Team Members: 1. Donnalyn Kalei, Assistant Professor, Administration of Justice 2. Donna Madrid, Adjunct Faculty, Administration of Justice and Political Science 3. Valerie Hafford, Adjunct Faculty, Human Services Program Learning Outcomes to Be Assessed: SLO # 6: Reflect on personal traits, values and issues that may enhance or interfere with his/her effectiveness as a counselor. Artifact Sampling: SUBS 294 Practicum I Adjunct faculty member Christine Kefford submitted 13 student final term paper artifacts from her Subs 294 Fall 2008 class. The evaluation team members randomly selected 38% (5 of 13) final term papers to be evaluated. Copies of the five final term papers were distributed to each team member, along with a copy of the Substance Abuse Counseling Rubric, which was used as an assessment tool to evaluate the student term papers. Evaluation Team Member s Results: Of the 15 evaluations (3 evaluators per 5 samples), 12 were marked as either Meeting (5) or Exceeding Expectations (7). 3 were marked as Does Not Meet Expectations. All 3 were marked for lack of personal reflection on how personal traits, values and issues may enhance or interfere with his/her effectiveness as a counselor. Considering that practicum students are engaged in 200 hours of fieldwork and 30 hours of in- class seminar during the semester, 80% of the student artifacts met or exceeded expectations, indicating that this is a very good outcome. All 3 evaluation team members agreed that SLO #6 is being covered in the final term paper assignment and it is a good assessment tool for the program. Course of Action Using the Assessment Results: The evaluation team agreed that the Subs 294 final term paper assignment should be continued. However, the team recommended that students should submit a draft of their final term paper to the instructor so that students are clear as to the requirements of the assignment before they turn in their final draft.

2 Hawaii Community College Instructional Program Assessment Plan for Learning Outcomes Certificate of Completion Substance Abuse Counseling Submitted by: Donnalyn Kalei, May 8, 2008 Semester: Fall 2008 Student Learning Outcome (program level) for Assessment* (taken from Appendix): SLO # 6: Reflect on personal traits, values and issues that may enhance or interfere with his/her effectiveness as a counselor Step 1. Identify the artifact(s) (i.e.), (student work) for assessment and course(s) from which selected: Written Final Term Paper Subs 294 Step 2. Develop the assessment tool Rubric to be used with 3 levels of assessment Level 1=exceeds expectations; Level 2=meets expectations; Level 3=does not meet expectations; See attach Rubric/assessment tool. Step 3. Set the Performance Rate 80% of the artifacts assessed by the Assessment Team will meet or exceed expectations Step 4. Describe the sampling method to be used to collect data Written Final Term Papers will be collected from Subs 294 class.. Step 5. Describe the sampling method used for assessment: Of the pool of final term papers collected, five papers will be randomly selected by the assessment team for evaluation Step 6. Describe the composition of the Assessment Team: Program faculty Social Sciences faculty Social Science faculty Step 7. The Assessment Team uses the Term Paper Rubric to evaluate the data. Step 8. The program will summarize and interpret the results, and determine the implications for program improvement.

3 SUBS PROGRAM ASSESSMENT RUBRIC FOR STUDENT LEARNING OUTCOME: SLO # 6: Reflect on personal traits, values and issues that may enhance or interfere with his/her effectiveness as a counselor. ASPECT LEVEL 1 EXCEEDS EXPECTATIONS Feelings Intellectual-Knowledge & Thoughts Importance/Significance Additional Information Writing Identifies feeling(s), has a clear and supported hypothesis about its origins, development, and connection to personal traits, values and issues that may enhance or interfere with effectiveness as a counselor. Outlines prior knowledge, impressions, and misconceptions. Uses relevant skills, course knowledge, and giving specific examples from the text in relationship to personal traits, issues and values. Describes local and wider importance. Explains the how and why personal traits, values and issues are important to more than self, but to the client and those working in the substance abuse counseling field. Consulted other sources and integrated the information in the reaction paper. Error free, well written paper; follows MLA or APA citation guidelines. LEVEL 2 MEETS EXPECTATIONS Identifies feeling(s) and has a reasonable hypothesis about its origins relating to personal traits, values and issues. Describes prior knowledge and interests in specific terms relating to personal traits, values and issues. Describes importance of issues to self and immediate and extended groups. Refers to other sources of Information, but does not integrate them into the paper. Neat and organized paper: May contain few grammatical errors. LEVEL 3 DOES NOT MEET EXPECTATIONS Identifies feeling(s) and speculates about the cause of it but unable to relate it to personal traits, values and issues when counseling. Comments on prior knowledge and interests in a global way no specific related experiences or references to self. Vaguely describes some importance to self. No further information sought or desired Sloppy paper with numerous grammatical and punctuation errors

4 CERTIFICATE OF COMPLETION - SUBSTANCE ABUSE COUNSELING ARTIFACT ASSESSMENT RESULTS SPRING 2009 Evaluation Team Members: 1. Donnalyn Kalei, Assistant Professor, Administration of Justice 2. David Loeding, HawCC Registrar Program Learning Outcomes to Be Assessed: PLO # 1 Satisfy the addiction studies educational requirements for Hawaii State Department of Health Alcohol and Drug Abuse Division s (ADAD) certification. Artifact Sampling: Subs Program Grade Log as of September 2009 The grade logs for 7 Subs program majors, who applied for Spring 2009 graduation were retrieved from the Registrar s internal data system to be assessed to determine how many students graduated in Spring 2009 with a C grade or better, fulfilling the Requirements for a Certificate of Completion in Substance Abuse Counseling and satisfy the Addiction Studies Educational Requirements for the State of Hawaii Department of Health Alcohol and Drug Abuse Division s CSAC certification. Evaluation Team Member s Results: 7 grade logs of Subs program majors that applied for Spring 2010 graduation, 6 or 86% received the grade of C or better for Subs courses required for the CC in Subs and met ADAD s addiction studies education requirement, which surpassed 80% SLO benchmark by meeting or exceeding the C grade in their completed course work. 1 student received an incomplete grade. However, only 4 program majors or 57% graduated in Spring program majors did not graduate because their Spring 2009 graduation application was submitted late, and 1 did not graduate because she received an incomplete grade. Course of Action Using the Assessment Results: The evaluation team agreed that the Registrar s internal data system was a good tool to assess this SLO. However, the team recommended that Subs program instructors and HawCC s counseling department should meet with program majors eligible to graduate early in the Spring semester and encourage them to apply for graduation early or before the graduation application deadline.

5 Semester: Spring 2009 Hawai i Community College Instructional Program Assessment Plan For Learning Outcomes Certificate of Completion Substance Abuse Counseling (SUBS) Submitted by: Donnalyn Kalei, May 18, 2009 Student Learning Outcome SLO # 1 for Assessment* (taken from Appendix A): Satisfy the addiction studies educational requirements for Hawaii State Department of Health Alcohol and Drug Abuse Division s (ADAD) certification. Step 1. Identify the artifact(s) (i.e., student work) for assessment and **course(s) from which selected: Name/Description of artifact: Subs 140, 245, 268, and 295; College records of 2009 Subs program graduates. ** If there are multiple sections for a course and at least one is offered in a distance education (DE) modality (Banner Instructional Methods codes for DE are: DCO=distance completely online; DIV=distance interactive video; OS=off-site), an artifact from the DE section should be included. If another section of a DE course is also offered face-to-face (i.e., traditional lecture in-person), artifacts should be collected for BOTH the face-to-face section and the DE section for comparison purposes. Step 2. Develop the assessment tool (e.g., rubric) to be used with 3 levels of assessment, if applicable Level 1=does not meet expectations; Level 2=meets expectations; Level 3=exceeds expectations. Attach the assessment tool. Step 3. Set the Performance Rate: A passing letter grade of C or higher for all SUBS Program Courses. 80% of SUBS program graduates received a letter grade of C or higher for all required program courses. Step 4. Describe the method used to collect the artifacts: Where or from whom artifacts will be collected: Social Sciences Department Chair will collect grade reports of SUBS Program graduates from the HawCC Registrar When will artifacts be collected: After grades are entered for Spring 2009 or in September 2009 Step 5. Describe the sampling method used to collect the data: Sampling will not occur. All results collected will be used. Step 6. Describe the composition of the Assessment Team (AT) (add more rows as needed): Evaluator(s): 1 HawCC Registrar 2 Social Science Department Chair 3 Advisory Council Member Step 7. The Assessment Team uses the assessment tool(s) (e.g., rubric) to evaluate the data. See Appendix A - Rubric Step 8. The Program will summarize and interpret the results, and determine the implications for program improvement. Note: a summary will be included in the comprehensive program review. *note: one form will be submitted for each student learning outcome that is assessed Assessment Plan to be sent electronically to the Vice Chancellor for Academic Affairs for posting on the internet Revised, April 16, 2009 by the ad hoc Assessment Committee, to be used for Fall 2009 Assessment Plan submissions

6 Appendix A Certificate of Completion in Substance Abuse Counseling SUBS Program Student Learning Outcomes (revised May 2008): 1. Satisfy the addiction studies educational requirements for Hawaii State Department of Health Alcohol and Drug Abuse Division s (ADAD) certification. 2. Identify and articulate medical, social and/or psychological aspects of addiction. 3. Apply the Twelve Core Functions of the Alcohol and Drug Abuse Counselor 4. Perform basic individual or group counseling and interviewing/facilitation skills 5. Practice within the legal and ethical parameter of the substance abuse counseling profession 6. Reflect on personal traits, values and issues that may enhance or interfere with his/her effectiveness as a counselor. 7. Develop career plans for entry-level positions in substance abuse, criminal justice and human services organizations that service substance abusing populations. Matrix of Student Learning Outcomes by Course Matrix of Student Learning Outcomes (program level) by Course (add more columns and rows as needed) Course Course Title SLO 1 SLO 2 SLO 3 SLO 4 SLO 5 SLO 6 SLO 7 Alpha/No Subs 140 Individual Counseling X X X X X X Subs 141 Intro Ho oponopono X X X X X Subs 245 Group Counseling X X X X X Subs 248 Case Management Subs 262 Adolescent Counseling Subs 268 Survey of Subs Problems X X X X Subs Core Functions Subs 275 Families and Addiction Subs 280 Co-Occurring Disorders Subs 294 Subs Practicum I X Subs 295 Subs Practicum II X Student Learning Outcomes (program level) to be assessed for each year of the program review cycle. Identify the learning outcomes by number only taken from above Fall semester Spring semester Year 1 (2008/09) 1 1 Year 2 (2009/2010) 2 3 Year 3 (2010/2011) 4 5 Year 4 (2011/2012) 6 7 SUBS Program SLO # 1 Satisfy the addiction studies educational requirements for Hawaii State Department of Health Alcohol and Drug Abuse Division s (ADAD) certification. SUBS Program graduates must successfully complete all SUBS courses with a letter grade of C or better Does Not Meet Meets Minimum Exceeds Minimum Received D grade or Below or did not complete course. 40% Received C Grade 40% Received B or A Grade

7 Appendix B Retrieved from: ) HAWAII ADMINISTRATIVE RULES TITLE 11 DEPARTMENT OF HEALTH CHAPTER CERTIFICATION STANDARDS FOR SUBSTANCE ABUSE COUNSELORS AND PROGRAM ADMINISTRATORS SUBCHAPTER 2 REQUIREMENTS FOR CERTIFICATION Qualifications of certified substance abuse counselors. The department may issue a substance abuse counselor certificate to any person who has successfully completed education, training, supervised practical training, work experience, and written and oral examinations, which address a body of knowledge, work behavior, and skills related to substance abuse counseling as determined by the department. Certified substance abuse counselor. (a) The applicant shall have a high school diploma or its equivalent and shall have completed six thousand hours of clinically supervised work experience providing direct alcohol and drug treatment services. (1) The experience shall be documented by the clinical supervisor on a form to be provided by the department. The clinical supervisor must be employed or contracted by the program or agency in which the work experience is gained. (2) A certificate in substance abuse counseling from an accredited school may be substituted for two thousand hours of experience providing direct alcohol and drug treatment services. (b) The applicant shall provide documentation showing the following information: (1) A minimum of two hundred seventy hours of substance abuse specific education; (2) Six hours of education on professional ethics; (3) Six hours of education on 42 Code of Federal Regulations, Part 2; and (4) Six hours of education on HIV and AIDS including issues related to confidentiality of records.