UNION UNIVERSITY MASTER SOCIAL WORK PROGRAM ASSESSMENT OF STUDENT LEARNING OUTCOMES LAST COMPLETED ON SPRING 2014 Form AS4 (M)

Transcription

1 UNION UNIVERSITY MASTER SOCIAL WORK PROGRAM ASSESSMENT OF STUDENT LEARNING OUTCOMES LAST COMPLETED ON SPRING 2014 Form AS4 (M) Accreditation Standard The program provides summary data and outcomes for the assessment of each of its competencies, identifying the percentage of students achieving the. Accreditation Standard The program uses Form AS4 (B) and/or ASR (M) to report assessment outcomes to its constituents and the public on its website and routinely up-dates (minimally every two years) these postings. All Council on Social Work Education programs measure and report student learning outcomes. Students are assessed on their mastery of the competencies that comprise the accreditation standards of the Council on Social Work Education. These competencies are dimensions of social work practice that all social workers are expected to master during their professional training. A measurement is set by the social work programs for each competency. An assessment score at or above that is considered by the program to represent mastery of that particular competency. Union University s Master of Social Work Program uses Field Education Evaluations and assessment of two assignments in the SW623 course (a case file and a community proposal). Following the descriptions, three tables appear reporting the data assessing each of the competencies (MSW Foundation Field Education, MSW Concentration Field Education and Assessment of Competencies and Practice Behaviors). Field Education Evaluations The Agency Field Instructor completes the final field evaluation with each student at the conclusion of the student s field hours. The evaluation is a measure for each of the program s identified competencies within that particular agency context. Students are rated on a scale of 1-4 for their performance of each of the outcomes related to the competencies with a 4 representing consistently high levels of performance, a 3 representing acceptable performance, a 2 representing inadequate performance at times, and a 1 representing consistency poor levels of performance. Students must score a minimum of 131 total points, or an average of level 3, in order to pass field successfully. The program has set as a for each competency that 80% of the students will score at a level 3. Data can be found in Table 1.

2 2 Table 1. MSW Foundation Year Field Education 2014 Table 1. MSW Foundation Year Field Education 2014 Competency and Practice Behavior Mean (SD) MSWs who met the N (%) (the 1. Identify as a professional social worker and conduct oneself accordingly. Practice personal reflection and self-correction to assure continual 3.55(.60) 19 (95%) professional development Attend to professional roles and boundaries 3.60(.60) 19 (95%) Demonstrate professional demeanor in behavior, appearance, 3.75(.55) 19 (95%) and communication Demonstrate commitment to career-long learning 3.65(.59) 19 (95%) Demonstrate commitment to career-long service 3.65(.59) 19 (95%) Takes initiative to use supervision and consultation 3.55(.60) 19 (95%) Practice self-care 3.35(.67) 18 (90%) 2. Apply social work ethical principles to guide professional practice Recognize and manage personal values in a way that allows professional values to guide practice Apply strategies of ethical reasoning, recognizing ambiguity, and arriving at principled decisions in the context of the NASW Code of Ethics 3. Apply critical thinking to inform and communicate professional judgments Distinguish, appraise, and integrate multiple sources of knowledge, including research-based knowledge, and practice wisdom Analyze models of assessment, prevention, intervention, and evaluation Demonstrate effective oral communication in working with individuals, families, groups, organizations, communities, and colleagues Demonstrate effective written communication in working with individuals, families, groups, organizations, communities, and colleagues 4. Engage diversity and difference in practice Recognize the extent to which a culture s structures and values may oppress, marginalize, alienate vulnerable populations, or create, enhance privilege and power Demonstrate self-awareness related to the influence of personal culture, and values, (e.g. religious, ethical, and moral; ethnicity; class; etc.) in working with diverse groups in order to reduce biases 3.50(.61) 19 (95%) 3.35(.67) 18 (90%) 3.30(.80) 16 (80%) 3.20(.77) 16 (80%) 3.60(.50) 20 (100%) 3.50(.69) 18 (90%) 3.60(.60) 19 (95%) 3.60(.50) 20 (100%) Recognize and communicate their understanding of the importance 3.55(.60) 19 (95%)

3 Table 1. MSW Foundation Year Field Education 2014 Competency and Practice Behavior Mean (SD) MSWs who met the N (%) (the of difference in shaping life experiences View themselves as learners by engaging those with whom they work as cultural informants 3.65(.49) 20 (100%) 5. Advance human rights and social and economic justice Understand how Christian thought and practices values human life 3.70(.47) 20 (100%) and advances social and economic justice Understand the forms and mechanisms of oppression and 3.70(.47) 20 (100%) discrimination Advocate for human rights and economic justice 3.45(.76) 17 (85%) Engage in practices that advance social and economic justice 3.50(.69) 18 (90%) 6. Engage in research-informed practice and practice-informed research Use research evidence to inform practice 3.35(.74) 17 (85%) Use practice experience to inform research 3.40(.68) 18 (90%) 7. Apply knowledge of human behavior and the social environment Utilize theory, conceptual frameworks, and practice models to guide 3.45(.69) 18 (90%) the processes of assessment, intervention, and evaluation Critique and apply knowledge to understand person and environment 3.45(.83) 18 (90%) 8. Engage in policy practice to advance social and economic wellbeing and to deliver effective social work services Analyze, formulate, and advocate for policies that advance social wellbeing 3.55(.69) 18 (90%) in client systems of all sizes Collaborate with colleagues and clients for effective policy action 3.50(.61) 19 (95%) 9. Respond to contexts that shape practice 3 Demonstrate flexibility and creativity when encountering change or crisis Provide leadership in promoting sustainable changes in service deliver and practice 3.45(.76) 17 (85%) 3.45(.69) 17 (85%) 10. Engage, assess, intervene, and evaluate with individuals, families, groups, organizations, and communities (A) Engagement

4 Table 1. MSW Foundation Year Field Education 2014 Competency and Practice Behavior Mean (SD) MSWs who met the N (%) (the Demonstrate appropriate preparation for action with individuals, 3.40(.68) 18 (90%) families, groups, organizations, and communities Use empathy and other interpersonal skills effectively in all levels of 3.55(.51) 20 (100%) practice Establish and maintain a mutually agreed upon focus of work 3.45(.60) 19 (95%) throughout the client/worker relationship (B) Assessment Collect, organize, and interpret client data 3.40(.75) 17 (85%) Assess client strengths and limitations 3.55(.60) 19 (95%) Develop mutually agreed-on intervention goals and objectives 3.45(.69) 18 (90%) (C) Intervention Select appropriate intervention strategies 3.45(.60) 19 (95%) Initiate actions to achieve intervention goals 3.55(.51) 20 (100%) Implement prevention interventions that enhance client capacities 3.40(.75) 17 (85%) Implement problem-solving process with clients (e.g. individuals, 3.55(.60) 19 (95%) families, groups, organizations, communities) Negotiate, mediate, and advocate for clients 3.65(.49) 20 (100%) Facilitate transitions and endings 3.35(.67) 18 (90%) (D) Evaluation Critically analyze, monitor and evaluate practice 3.60(.60) 19 (95%) Use evaluation outcomes to modify practice 3.45(.69) 18 (90%) 11. Appreciate the context of Christian higher education for social work education Understand the relationship of both historical and contemporary Christian thought and practice with the core values of the social work profession Understand how one s personal religious/spiritual beliefs and practices can be a resource both for the practitioner and the client Understand how one s personal religious/spiritual beliefs and practices can impede one s practice or well-being Articulate the commitment of Christian faith to leadership in service to church and society Grading Scale = A; = B; = C 3.65(.59) 19 (95%) 3.70(.47) 20 (100%) 3.70(.47) 20 (100%) 3.70(.47) 20 (100%) Total (23.18) Range ( ) N 20 4

5 5 Table 2. MSW Concentration Year Field Education 2014 Table 2. MSW Concentration Year Field Education 2014 Competency and Practice Behavior Mean (SD) MSWs who met the N (%) (the 1. Identify as a professional social worker and conduct oneself accordingly. Identify one s own professional strengths, limitations, and challenges 3.62(.61) 29 (93.5%) while attending to self-care needs Promote self-directed, career-long learning by evaluating one s own 3.55(.57) 30 (96.8%) learning needs and those they might supervise in selection of CEU offerings Function within clearly defined professional roles and boundaries 3.71(.64) 30 (96.8%) based on the needs of the client, the agency context, the type of service provided, and differential use of self Develop patterns of ongoing self-reflection as leaders in the social 3.55(.72) 29 (93.5%) work profession Engage in supervision with initiative, independence, responsibility for 3.61(.76) 28 (90.3%) agenda and appropriate use of consultation within the agency structures and lines of authority Demonstrate professional demeanor in behavior, appearance, and 3.68(.70) 29 (93.5%) communication appropriate to the relationship and setting Recognize and manage safety needs in social work practice settings 3.77(.42) 31 (100%) Advocate for client access to appropriate social services 3.84(.45) 30 (96.8%) 2. Apply social work ethical principles to guide professional practice Make ethical decisions in social work practice by applying standards of the National Association of Social Workers Code of Ethics (NASW) Integrate personal with professional values to appropriately guide social work practice Apply strategies of ethical reasoning for leadership in social work practice to arrive at principled decisions and using consultation appropriately 3. Apply critical thinking to inform and communicate professional judgments Articulate elements of critical thinking needed in leadership capacities (e.g. logic models for agency processes, organizational audits, stakeholder analysis, decisions about treatment with individual cases, peer evaluation Demonstrate professionally appropriate communication: in writing (clinical records, reports, group curricula) and verbally (team meetings, case conferences, communications with collaterals) 3.77(.50) 30 (96.8%) 3.62(.62) 29 (93.5%) 3.58(.56) 30 (96.8%) 3.45(.62) 29 (93.5%) 3.58(.56) 30 (96.8%)

6 Table 2. MSW Concentration Year Field Education 2014 Competency and Practice Behavior Mean (SD) MSWs who met the N (%) (the Integrate and apply multiple sources of knowledge (research based 3.51(.68) 28 (90.3%) knowledge, practice wisdom, and client perspectives) to guide practice 4. Engage diversity and difference in practice Utilize culturally sensitive and relevant practice skills that integrate 3.74(.51) 30 (96.8%) self-awareness with knowledge from clients and other sources Recognize the extent to which sociocultural structures and values may 3.71(.46) 31 (100%) oppress, marginalize, alienate, create or enhance privilege 5. Advance human rights and social and economic justice Articulate how Christian thought and practice values human life and advances social and economic justice Articulate the potentially challenging and/or oppressive effects of economic, social cultural, and global factors on client systems Advocate for the inclusion, participation, and voice of diverse people, communities and organizations affected by oppressive conditions 6. Engage in research-informed practice and practice-informed rresearch Use evidence-based research to identify effective clinical interventions for particular populations, problems, and settings Articulate a research idea from social work practice, develop a question, design a study, and report findings 7. Apply knowledge of human behavior and the social environment Critique and apply HBSE theories (e.g. strengths, ecological, cognitivebehavioral, interpersonal, family systems, life-span development, psychodynamic) to guide assessment, intervention, and evaluation Identify how biopsychosocial, cultural, and spiritual contexts facilitate or inhibit individual, organizational and/or social change 8. Engage in policy practice to advance social and economic wellbeing and to deliver effective social work services Recognize the reciprocal relationships of clients and practice with both public and organization policy Demonstrate leadership in collaboration with colleagues and clients for effective policy action that promotes social and economic justice 9. Respond to contexts that shape practice Demonstrate flexibility and creativity in the context of change in advance practice with individuals, families, groups, organizations and communities Provide leadership in promoting sustainable change in service delivery and practice 3.74(.51) 30 (96.8%) 3.68(.54) 30 (96.8%) 3.61(.56) 30 (96.8%) 3.42(.67) 30 (96.8%) 3.35(.75) 28 (90.3%) 3.58(.56) 30 (96.8%) 3.77(.42) 31 (100%) 3.58(.67) 30 (96.8%) 3.32(.65) 30 (96.8%) 3.64(.71) 29 (93.6%) 3.42(.67) 30 (96.8%) 6

7 Table 2. MSW Concentration Year Field Education 2014 Competency and Practice Behavior Mean (SD) MSWs who met the N (%) (the 10. Engage, assess, intervene, and evaluate with individuals, families, groups, organizations, and communities (A) Engagement Develop relationships with clients that are professional, purposeful, 3.77(.56) 29 (93.6%) culturally appropriate, and characterized by clear boundaries Encourage clients to be equal partners in the establishment of 3.68(.54) 30 (96.8%) treatment goals and methods Attend to the interpersonal dynamics and contextual factors that both 3.48(.68) 30 (96.8%) strengthen and potentially threaten the alliances in organizational and community contexts (B) Assessment Collaborate with client to define goals and target behaviors 3.61(.67) 30 (96.8%) Assess clients readiness for change, clients coping strategies and 3.48(.77) 28 (90.3%) strengths, and safety needs (C) Intervention Initiate and implement intervention plans with a client system(s) to 3.45(.67) 30 (96.8%) meet goals, based on appropriate theory and research evidence Collaborate with other professionals/constituents to coordinate 3.64(.66) 30 (96.8%) interventions (D) Evaluation Evaluate client system(s) progress and intervention effectiveness (e.g. client self-assessment and satisfaction, collateral reports, behavioral outcome measures, single-subject design) 3.48(.68) 30 (96.8%) Use evaluation outcomes to enhance best practice interventions 3.45(.77) 28 (90.3%) 11. Appreciate the context of Christian higher education for social work education Describe how the Christian mandate that comports with the NASW Code of Ethics to treat all persons with unconditional dignity, to do justice, and practice compassion Describe historical, spiritual, and religious influences on the profession of social work Formulate responses to societal needs that follow ethical practice for spiritually sensitive social work practice (e.g. appreciate how personal religious and spiritual beliefs and practices can be a resource or impediment) 3.84(.58) 30 (96.8%) 3.58(.67) 30 (96.8%) 3.77(.62) 30 (96.8%) Mean total (17.70) Range (59-152) Grading Scale =A; =B; =C; <97 =F N 31 7

8 8 Assessment Scale for Evaluation of Practice Behaviors (SW623) in 2014 The purpose of this assessment is to have faculty complete a systematic evaluation of advance practice students at the end of the curriculum sequence to assess concentration year practice behaviors. Faculty developed a rubric to rate the two assignments from SW623 (case file and community proposal) for all the concentration year practice behaviors. The assessment was completed for the first time in spring As a result of this assessment, we concluded the SW623 assignments guidelines need reworking to adequately measure the following practice behaviors consistently across all students. Note that all practice behaviors were measure in the field evaluation: Engage in supervision with initiative, independence, responsibility for agenda and appropriate use of consultation within the agency structures and lines of authority Recognize and manage safety needs in social work practice settings Describe historical, spiritual, and religious influences on the profession of social work Formulate responses to societal needs that follow ethical practice for spiritually sensitive social work practice (e.g. appreciate how personal religious and spiritual beliefs and practices can be a resource or impediment) Use evidence-based research to identify effective clinical interventions for particular populations, problems, and settings Articulate a research idea from social work practice, develop a question, design a study, and report findings D.1 Evaluate client system(s) progress and intervention effectiveness (e.g. client selfassessment and satisfaction, collateral reports, behavioral outcome measures, single-subject design) D.2 Use evaluation outcomes to enhance best practice interventions For the aforementioned practice behaviors the assignments were not explicit in requiring students to demonstrate these behaviors. For some students this behavior was seen in the case file and/or community proposal; however, for many students their assignments did not provide any material to allow a rating of that behavior. Furthermore, in this first attempt at assessment in SW623 the students were not explicitly told that the case file and community proposal assignments were being assessed by the department across the 40 practice behaviors. In the future, students could be alerted to this purpose and critique their own papers regarding this content.

9 9 Regarding the research practice behaviors, the students are trained to empirically assess client problems and behaviors using rapid assessment tools and then to determine a target behavior/s to measure repeatedly across time in single subject design. However, the case file assignment guidelines did not have this as a requirement and some students did not develop this component in the case file. Additionally, the assignments needs to add a guideline for minimum reference requirements. While some students used adequate references, others used too few. Finally, in the community proposal assignment few students discussed the use of community-based research models (needs assessment, focus groups, empowerment/participatory models). Due to the lack of assignment specificity, the number of students used in the table below varies for the aforementioned subset of practice behaviors. Table 3. Assessment of Competencies and Practice Behaviors (SW623) in 2014 Table 3. Assessment of Competencies and Practice Behaviors (SW623) in 2014 Competency and Practice Behavior Identify as a professional social worker and conduct oneself accordingly. 1. Identify one s own professional strengths, limitations, and challenges while attending to self-care needs 2. Promote self-directed, career-long learning by evaluating one s own learning needs and those they might supervise in selection of CEU offerings 3. Function within clearly defined professional roles and boundaries based on the needs of the client, the agency context, the type of service provided, and differential use of self 4. Develop patterns of ongoing self-reflection as leaders in the social work profession 5. Engage in supervision with initiative, independence, responsibility for agenda and appropriate use of consultation within the agency structures and lines of authority 6. Demonstrate professional demeanor in behavior, appearance, and communication appropriate to the relationship and setting 7. Recognize and manage safety needs in social work practice settings M (SD) N MSWs who met the N (%) (the 3.53(.62) (93.7%) 3.97(.18) 32 32(100%) 3.8(.40) 32 32(100%) 3.66(.48) 32 32(100%) (.61) 32 30(93.7%) 8. Advocate for client access to appropriate social services 3.78(.42) 32 32(100%) 9

10 10 Table 3. Assessment of Competencies and Practice Behaviors (SW623) in 2014 Competency and Practice Behavior Apply social work ethical principles to guide professional practice 1. Make ethical decisions in social work practice by applying standards of the National Association of Social Workers Code of Ethics (NASW) 2. Integrate personal with professional values to appropriately guide social work practice 3. Apply strategies of ethical reasoning for leadership in social work practice to arrive at principled decisions and using consultation appropriately Apply critical thinking to inform and communicate professional judgments 1. Articulate elements of critical thinking needed in leadership capacities (e.g. logic models for agency processes, organizational audits, stakeholder analysis, decisions about treatment with individual cases, peer evaluation 2. Demonstrate professionally appropriate communication: in writing (clinical records, reports, group curricula) and verbally (team meetings, case conferences, communications with collaterals) Professional communication Written communication Oral communication 3. Integrate and apply multiple sources of knowledge (research based knowledge, practice wisdom, and client perspectives) to guide practice Engage diversity and difference in practice 1. Utilize culturally sensitive and relevant practice skills that integrate self-awareness with knowledge from clients and other sources 2. Recognize the extent to which sociocultural structures and values may oppress, marginalize, alienate, create or enhance privilege Advance human rights and social and economic justice 1. Articulate how Christian thought and practice values human life and advances social and economic justice M (SD) N MSWs who met the N (%) (the 3.62(.61) (93.7%) 3.60(.61) (93.7%) 3.56(.62) (93.7%) 3.66(.54) 32 31(96.9%) 3.68(.53) 3.66(.60) 3.44(.67) (96.9%) 30 (93.7%) 29(90.6%) 3.66(.54) 32 31(96.9%) 3.66(.54) 32 31(96.9%) 3.50(.71) 22 31(96.9%)

11 11 Table 3. Assessment of Competencies and Practice Behaviors (SW623) in 2014 Competency and Practice Behavior MSWs who M (SD) N met the N (%) (the 2. Articulate the potentially challenging and/or oppressive 3.59(.55) 32 31(96.9%) effects of economic, social cultural, and global factors on client systems 3. Advocate for the inclusion, participation, and voice of 3.53(.56) 32 31(96.9%) diverse people, communities and organizations affected by oppressive conditions Engage in research-informed practice and practiceinformed research 1. Use evidence-based research to identify effective clinical 3.12(.91) 32 32(100%) interventions for particular populations, problems, and settings 2. Articulate a research idea from social work practice, 2.97(.93) 32 32(100%) develop a question, design a study, and report findings 7. Apply knowledge of human behavior and the social environment 1. Critique and apply HBSE theories (e.g. strengths, 3.44(.62) (93.7%) ecological, cognitive-behavioral, interpersonal, family systems, life-span development, psychodynamic) to guide assessment, intervention, and evaluation 2. Identify how biopsychosocial, cultural, and spiritual 3.53(.56) 32 31(96.9%) contexts facilitate or inhibit individual, organizational and/or social change Engage in policy practice to advance social and economic well-being and to deliver effective social work services 1. Recognize the reciprocal relationships of clients and 3.53(.51) 32 32(100%) practice with both public and organization policy 2. Demonstrate leadership in collaboration with colleagues 3.59(.49) 32 32(100%) and clients for effective policy action that promotes social and economic justice Respond to contexts that shape practice 1. Demonstrate flexibility and creativity in the context of 3.59(.49) 32 32(100%) change in advance practice with individuals, families, groups, organizations and communities 2. Provide leadership in promoting sustainable change in 3.66(.48) 32 32(100%) service delivery and practice Engage, assess, intervene, and evaluate with individuals, families, groups, organizations, and communities

12 12 Table 3. Assessment of Competencies and Practice Behaviors (SW623) in 2014 Competency and Practice Behavior (A) Engagement 1. Develop relationships with clients that are professional, purposeful, culturally appropriate, and characterized by clear boundaries 2. Encourage clients to be equal partners in the establishment of treatment goals and methods (B) Assessment 1. Collaborate with client to define goals and target behaviors 2. Assess clients readiness for change, clients coping strategies and strengths, and safety needs (C) Intervention 1. Initiate and implement intervention plans with a client system(s) to meet goals, based on appropriate theory and research evidence 2. Collaborate with other professionals/constituents to coordinate interventions (D) Evaluation 1. Evaluate client system(s) progress and intervention effectiveness (e.g. client self-assessment and satisfaction, collateral reports, behavioral outcome measures, singlesubject design) 2. Use evaluation outcomes to enhance best practice interventions Appreciate the context of Christian higher education for social work education 1. Describe how the Christian mandate that comports with the NASW Code of Ethics to treat all persons with unconditional dignity, to do justice, and practice compassion 2. Describe historical, spiritual, and religious influences on the profession of social work 3. Formulate responses to societal needs that follow ethical practice for spiritually sensitive social work practice (e.g. appreciate how personal religious and spiritual beliefs and practices can be a resource or impediment) M (SD) N MSWs who met the N (%) (the 3.58(.50) 32 32(100%) 3.68(.47) 32 32(100%) 3.63(.55) 32 31(96.9%) 3.66(.54) 32 31(96.9%) 3.59(.61) 32 30(93.7%) 3.66(.60) 32 30(93.7%) (.18) 32 32(100) 0 1

13 13 Table 3. Assessment of Competencies and Practice Behaviors (SW623) in 2014 Competency and Practice Behavior MSWs who M (SD) N met the N (%) (the