PROGRAM EVALUATION & IMPROVEMENT FOR VICTIM SERVICES Thursday, July 31, 2014
TODAY S PRESENTERS Susan Howley Director of Public Policy The National Center for Victims of Crime Nicole Geller Director, Justice Initiatives Social Solutions Global Melissa Caine-Huckabay Director of Training and Technology West Contra Costa Family Justice Center
Fundraising/ appropriations Compelling stories A few statistics Personal relationship
Fundraising/Appropriations Previously Today Compelling stories A few statistics Personal relationship Proving our value
All funders Congress OMB State legislature State grant administrators Private foundations Individual donors
All want to know: How are you using this money? Is it making a difference?
Vision 21: Building Organizational Capacity High-capacity Results-oriented
DATA Collect Analyze Use
Too many organizations Don t know Where they are spending their time and money How many victims they re serving, what services, and what level of effort Whether their activities are making a difference
HOPE New technologies to capture What we re doing What we re achieving Feedback loop
FAMILY JUSTICE CENTER OVERVIEW 2014 Melissa Caine-Huckabay Director of Training & Technology
What is the Family Justice Center? WCCFJC 2014 13
Q: What happens when a victim seeks services for domestic violence, sexual assault, child abuse, elder abuse, or human trafficking? Emotional Peer Counseling Restraining Order Assistance Support Access to Counseling and Mental Health Services Victim Assistance With Emergency Shelter Advocacy Court Support Victims of Crime Compensation Program Family Law Assistance Safety Planning Law Enforcement Assistance A: The victim often gets referred to many different resources in 14 many different places. WCCFJC 2014
Access to Counseling and Mental Health Services Peer Counseling Emotional Support Assistance With Restraining Order Assistance Victims of Crime Emergency Shelter Victim Compensation Advocacy Program Law Family Law Assistance Enforcement Assistance Court Support WCCFJC 2014 Safety Planning 15
WCCFJC s Vision: Through Throughaasingle singledoor, door, the West Contra Costa Family Justice Center brings together our entire community to support the healing of family violence survivors. Our diverse partners work hand-in-hand, responding directly to survivor needs. Working together, we create new violence free futures for families, communities, and our county. WCCFJC 2014 16
Data shows: 84% of FJC clients have children under the age of 18, and over half of these children are in common with the client s abuser More than 1/3 of clients require services in languages other than English (most frequently Spanish, but also Tagalog, Vietnamese, and other) It s working During the pilot phase, there were over 1,500 total visits to FJC and Partners Over 643 new families accessed services during this same time thanks to the community: Clients have come to the FJC from over 56 different referral referralsources sources (10% are friends and family referrals)17 WCCFJC 2014
How do survivors receive support from the Family Justice Center? Two Projects: Project Serve (Navigation & WINGS) Project Connect (Community Building) WCCFJC 2014 18
Project Serve Focuses on the context-specific needs and healing of each survivor and family Five areas: Domestic Violence Sexual Assault Child Abuse Elder Abuse Human Trafficking WCCFJC 2014 19
STEP 1 Welcome to the Family Justice Center Counseling and Family Therapy (*) Mental Health Counseling, Children s Counseling, Parenting Support, Child Care Advocates (*) Assistance with immediate crisis Tell us about you! Navigator law enforcement entities in every city throughout West Contra Costa County. District Attorney s Office (*) Information about criminal cases, court outcomes and specialized programs design to help victims of violence. Faith Based Support (*) Spiritual counseling and A Navigator (*) will review the types of services available to you from a variety of agencies and help connect you with those who can address your needs. When talking to a Navigator you will determine some of the connections. support for a variety of faith traditions. Employment and Finances Address immediate financial crisis, get you back on your feet, and build financially secure futures. Before checking out make sure you have talked to the Client Navigator and had all of your questions answered and needs assessed. Schedule follow-up appointments. Legal Services Information about legal processes, family court, legal representation and immigration services. Health Care Receive patient financial counseling for STEP 5 Stay Connected health coverage. Basic Needs Address food and clothing needs. STEP 3 Getting Connected Check Out and Exit intervention, court accompaniment, restraining orders and many other resources. Criminal Justice System (*) The Center partners with STEP 2 STEP 4 WCCFJC 2014 Call us if you have any questions or want to schedule another visit. We are here for you. 20
Early Outcomes It took time to make sense of the early data The model was working Our County s first snapshot of multi-system coordination Celebrating the victories Finding the gaps Who s missing? Re-evaluating roles Sustainability focused Groundbreaking Celebration 11/1/2013 WCCFJC 2014 21
Project Connect Programming Added in phase II of the pilot Reach all members of the West County community Stay connected longer with our clients Support survivors on a deeper level, after the point of crisis WCCFJC 2014 22
Project Connect Gatherings Survivors, community members, service providers Networking and information sharing Rotating topics Moving the conversation forward WCCFJC 2014 23
WINGS Women INspired to Grow and Succeed 7-week workshop series Self-sufficiency for survivors Partnership with local DV shelter program & culturally specific services WCCFJC 2014 24
Cooking Matters Offered in partnership with 18 Reasons 6-week workshop series Healthy, affordable family cooking and eating Survivors, community members WCCFJC 2014 25
What do we mean by Collective Impact? Evolving role within County collaborative Shared vision for change Shared measurement systems Mutually reinforcing activities Continuous communication Backbone support organization WCCFJC 2014 26
Family Justice Center Backbone Functions: Guide vision and strategy Support aligned activities Establish shared measurement practices Build public will Advance policy Mobilize funding WCCFJC 2014 27
New projects, new challenges County s High Risk Team pilot Law Enforcement Training Project WCCFJC 2014 28
Program Evaluation Early, unsophisticated data led to lots of questions What are we measuring? Are we aligned? If yes, in which areas? How do we know what we are doing is effective? How do we tell our story? How do we include survivor voices? How do we measure and communicate risk? WCCFJC 2014 29
On The Horizon On-going process, but has yielded big changes Long-term needs assessment Self-sufficiency and financial literacy A focus on resilience and risk factors Understanding poly-victimization and co-occurrence Continue to evaluate how to best measure effectiveness WCCFJC 2014 30
CASE MANAGEMENT IS A SCIENCE WHICH CAN BE APPLIED BY ALL OUTCOMES CASE MANAGEMENT SOCIAL ROI F EVIDENCE-BASED PRACTICE MODELS COLLABORATIVE & COLLECTIVE IMPACT $ o What Works 7 ANALYTIC REPORTING PERFORMANCE MANAGEMENT 6
WHAT WE KNOW local effort = individual, community & statewide outcomes National & Statewide Data Sets State Level Impact Benchmark Local Needs Community Level Impact The research will reveal Targeted Areas For Improvement Client-Level Impact Monitor Models Delivered with Fidelity Identify Programs and EBPM
WHERE IS THE SECTOR MOVING?
PUBLIC FUNDING IS FLOWING TO INNOVATIVE PRACTICE MODELS
THE RIGHT DATA REVEALS TRAJECTORY Baseline E E Trajectory E E E E Effort = Cost = Investment Frequency Duration Type Impact = Benefit = Return Target Population Period of Service
THE RIGHT DATA CAN REVEAL APPROPRIATE INTERVENTIONS Target Population E E E E E Period of Service E E Positive Impact
THE ART OF COLLABORATION THE MISSION: TO IMPROVE SERVICE ACROSS ORGANIZATIONS p p p p p MODEL DATA R LEAD AGENCY 7 p p p p
COLLABORATION BEGINS: LOCALLY 6 BENCH- MARKING 7 EVALUATION e MONITOR- ING k Partners work to achieve similar results, but struggle to learn critical lessons from their peers.
THE POWER OF DATA WITHIN EVALUATION k 6 BENCH- MARKING 7 EVALUATION e MONITOR- ING Tools should be scalable and improve cross-agency data sharing and benchmarking
AS THE INTELLIGENCE GROWS: CITY-WIDE k 6 BENCH- MARKING 7 EVALUATION e MONITOR- ING Building a community of practice improves agency performance and community-wide outcomes
THE SHARING EXPANDS STATE 6 BENCH- MARKING 7 EVALUATION e MONITOR- ING k Partners work to achieve similar results, but struggle to learn critical lessons from their peers.
THE KNOWLEDGE WE SHARE AFFECTS CHANGE k 6 BENCH- MARKING 7 EVALUATION e MONITOR- ING Data collection tools must be scalable and improve cross-agency data sharing and benchmarking
WITH INFORMATION AND EVALUATION BEST PRACTICE CAN REPLICATE k 6 BENCH- MARKING 7 EVALUATION e MONITOR- ING Building a community of practice improves agency performance and state-wide outcomes
LET S GO NATIONWIDE WITH WHAT IS EFFECTIVE! 6 BENCH- MARKING k 7 EVALUATION e MONITOR- ING Partners work to achieve similar results, but struggle to learn critical lessons from their peers.
WORKING TOWARD A NATIONAL BODY OF WORK k 6 BENCH- MARKING 7 EVALUATION e MONITOR- ING A continual process is what makes this effort scalable, and improves cross-agency data sharing and benchmarking
ETO WHAT STARTS LOCALLY INFORMS US NATIONALLY ETO ETO ETO ETO ETO ETO ETO k 7 ANALYTICS ETO 6 BENCH- MARKING e MONITOR- ING ETO ETO ETO ETO ETO ETO ETO ETO ETO Community of practice improves agency performance and drives nation-wide outcomes Confidential - Copyright, 2014 Social Solutions Global All Rights Reserved
BUT YOU CAN T MEASURE the difference between counting how many and assessing how well Changes in attitude and behavior Changes in perception Changes in receptiveness to service or help Incremental progress towards goals Changes in condition yes you can!
Data and Technology can be scary words No matter how advanced your technology becomes, it is still human beings helping human beings. Good technology and good data is an invaluable asset in service to victims we don t know what we don t know The technology available today can reveal behavioral patterns and predictors, making us less reliant on anecdote but rather supported by evidence Applying a practice with fidelity
Different Victims Have Different Needs and different indicators of success Domestic Violence Child Abuse Poly Victimization Financial Fraud Elder Abuse Human Trafficking Minors Human Trafficking Adults
The More Precise We Get The More Likely Our Model Can Predict Results Agency Children Services Teens Victims Offender/Ex Offender
Trajectory: Incremental Progress & Correlation Agency Children Victims Services Teens Offender
Trajectory: The Calculus of Impact Baseline Trajectory Frequency Duration Type Impact = Benefit = Return Target Population Period of Service
Incremental Tracking Reveals Actual Trajectory Positive Impact Target Population Period of Service
Stages of Change Model
Know where you are starting to get to where you need to be 60 At Intake 50 40 30 20 10 0 Precontemplation Contemplation Preparation Action Maintenance 60 At Departure 50 40 30 20 10 0 Precontemplation Contemplation Preparation Action Maintenance
The Power of Timing Before After Training No Charges Filed 54% DA Filed Charges 46% No Charges Filed 35% DA Filed Charges 65%
Do the best you can until you know better. Then when you know better, do better. Maya Angelou
Presenter Information Susan Howley Director of Public Policy The National Center for Victims of Crime showley@ncvc.org 202.467.8700 Melissa Caine-Huckabay - Director of Training and Technology West Contra Costa Family Justice Center mcainehuckabay@wccfjc.org 510.965.4949 Nicole Geller Director, Justice Initiatives Social Solutions Global ngeller@socialsolutions.com 317.409.7069
R QUESTIONS & ANSWERS Go ahead. Ask away.