Factors predicting attrition from prison-based intensive psychosocial drug treatment Eli Grant, Sean Grant, Paul Montgomery To start a Campbell review, a title must be registered and approved by the appropriate Campbell review group. For information about the title registration and protocol and review steps, visit the Campbell website: http://www.campbellcollaboration.org/systematic_reviews/index.php Submitted to the Coordinating Group of: X Crime and Justice Education Social Welfare Other Plans to co-register: X No Yes Cochrane Other Maybe Instruction: Briefly address each item below. Provide enough precise information to allow us the ability to evaluate the scope of the review and its appropriateness for the Campbell Collaboration. Note the review proposal should not overlap with existing Campbell and Cochrane published reviews or registered reviews in progress. 1 The Campbell Collaboration www.campbellcollaboration.org
TITLE OF THE REVIEW Factors predicting attrition from prison-based intensive psychosocial drug treatment BACKGROUND The Problem Drug use and crime are strongly associated. Randomised controlled trials and meta-analyses have demonstrated that intensive, psychosocial drug treatment interventions delivered in prison settings are effective in reducing post-prison offending and drug use (Mitchell, Wilson, & MacKenzie, 2006; Smith, Gates, & Foxcroft, 2006; Wexler, Melnick, Lowe, & Peters, 1999). Despite recent increases in investment in prison-based treatment across jurisdictions, substantial discrepancies remain between the number of prisoners in need of drug treatment and the number of treatment spaces available (Butzin, Martin, & Inciardi, 2005; Prendergast, 2011; UKDPC, 2007). Furthermore, there is substantial variability in prisoners responses to treatment: a large portion of those who enter intensive psychosocial programmes drop out or are removed before completing (Pelissier, Camp, & Motivans, 2003). Attrition from prison-based drug programs reduces clinical and cost-effectiveness. Prisoners who do not complete treatment programmes experience poorer post-treatment outcomes (Gossop, Marsden, Stewart, & Rolfe, 1999; Gossop, Trakada, Stewart, & Witton, 2005; Hiller, Knight, & Simpson, 1999; McMurran & Theodosi, 2007). In addition to a well-established dose-response relationship between treatment tenure and post-prison improvements, minimum threshold periods required for treatment effects and cost-effectiveness have also been identified (Simpson et al., 1997) specifically, at least thirty days of treatment retention are needed for any measurable improvement in drug use or reoffending and at least ninety days for improvements to be large enough for such programmes to be cost-effective (French, Fang, & Fretz, 2010; Griffith, Hiller, Knight, & Simpson, 1999; Malivert, Fatséas, Denis, Langlois, & Auriacombe, 2012; Welsh, 2010; Zhang, Friedmann, & Gerstein, 2003). A large number of pre-treatment factors potentially underlie differences in participant response and successful treatment engagement. There is now a substantial body of research concerning which of these factors comprise useful predictors of attrition. Narrative reviews of this literature have generally concluded that pre-treatment factors do not consistently predict retention (Meier & Best, 2006; Simpson, 2004). However, these have not examined the extent to which differences in findings relate to differences between studies in terms of the treatment model, implementation, setting, population, analytical methods, retention measures and model specifications used. A comprehensive, systematic appraisal of primary studies is needed to identify robust predictors of retention in prison-based, psychosocial drug treatment. 2 The Campbell Collaboration www.campbellcollaboration.org
This review aims to systematically investigate, summarise and if possible synthesise findings from retention analyses of prison-based psychosocial drug treatment. The use of systematic review methods and meta-analyses will contribute to the retention literature by: (1) enabling more precise estimates of the magnitude and reliability of relationships between repeatedly tested pre-treatment predictors and retention outcomes (2) determining the extent to which methodological, clinical and contextual variations impact the magnitude and significance of relationships between pre-treatment variables and retention outcomes (3) using explicit inclusion, exclusion, coding and appraisal decisions in order to allow replication and updating as additional studies are completed, thereby reducing (and making transparent) the effects of any potential theoretical or personal unconscious bias on the part of the reviewer The Population The population of interest is the adult prison population in any jurisdiction. Adult prisoners are defined as individuals of either gender who are over the age of eighteen and held in secure correctional settings, whether sentenced or awaiting trial. In order to be included, participants need to have participated in the intervention (defined below). As research suggests that most prisoners have one or more mental health disorders (Dressing, Kief, & Salize, 2009), samples that include individuals with co-morbid mental health diagnoses or symptoms will therefore be included. Sex offenders, individuals legally mandated to mental institutions, diagnosed psychopaths and juvenile prisoners are all considered clinically distinct subgroups that are physically segregated from the general prison population (Olver, Stockdale, & Wormith, 2011). These groups of prisoners are also generally offered different treatment programmes (Johnson et al., 2004; Looman & Abracen, 2011). Where these groups comprise over 10% of a study s sample, the study will be excluded unless it reports results separately for those prisoners in the review s target population. The Intervention Several models of psychosocial drug treatment are defined by theoretical orientation (e.g. Therapeutic Communities, Twelve-Step and Cognitive-Behavioural programmes). Programmes based on the same theoretical model frequently vary in terms of duration, intensity and method of delivery. These categories are also problematic because the majority of prison-based psychosocial interventions adapt and/or combine multiple treatment models (so-called eclectic programmes) (Wexler & Prendergast, 2010). As a result, categories of treatment model have limited utility in defining and distinguishing between different interventions. This review therefore defines the intervention of interest in terms of its core components 3 The Campbell Collaboration www.campbellcollaboration.org
rather than its theoretical model or programme label. Specifically, the intervention is defined as any prison-based treatment programme that: Has the primary aim of reducing substance abuse Targets substance users Is delivered in a correctional facility Uses an abstinence-based approach to drug treatment Requires prisoners to live in the treatment unit Has an expected duration of at least three months Requires daily participation in treatment activities Delivers group-based psychosocial treatment Variations of the intervention: The review thus includes Therapeutic Community, Twelve- Step, Cognitive Behavioural, Motivational Enhancement and eclectic or otherwise adapted drug treatment programmes provided they include the core components listed above. Interventions that include pharmacotherapeutic components as part of their treatment model (e.g. methadone maintenance) will be excluded. Brief (under three months), nonintensive (non-daily participation) and non-group based psychosocial interventions will also be excluded, as reasons for attrition from such different treatment modalities may differ substantially. Setting: Based on the criteria used in a previous Campbell Review of incarceration-based drug treatment (Mitchell et al., 2006), correctional facilities are defined as jails and prisons and exclude community-based residential facilities, half-way houses, open prisons or other non-secure facilities. Prison-diversion treatment units are included if they are secure facilities but excluded if they operate under open conditions and/or accept any participants who would not otherwise be incarcerated. Comparison: Because of the nature of the question, there is no comparison condition. Comparisons will be made between completers and non-completers taking part in the same interventions. Outcomes: What are the intended effects of the intervention? The primary outcome is retention, as measured in terms of treatment tenure (e.g., days/weeks/months of treatment completed); completion (e.g., programme completed or not completed); or completion of treatment thresholds (e.g. 30 or 90 days of treatment). There are no secondary outcomes. 4 The Campbell Collaboration www.campbellcollaboration.org
OBJECTIVES To systematically review, summarise and synthesise findings from analyses of participantlevel and programme-level predictors of attrition from intensive residential drug treatment programmes delivered in prison settings. METHODOLOGY Inclusion Criteria Studies reporting quantitative data that can identify participant and/or programme-level predictors of attrition will be included. Both published and unpublished studies will be searched for and eligible for inclusion. Specifically, studies will be included if they: (1) Use a sample composed primarily of participants from the population described above: adult prisoners of either gender who participated in the target intervention (as defined above) while in prison or sentenced to a secure prison-diversion setting; (2) Collected quantitative measures of participant or programme characteristics before treatment, with information on the reliability and validity for any constructed measures; (3) Collected quantitative measures of retention: either programme completion or time in treatment (measured in days or by retention past threshold time periods); (4) Report sufficient data for analysing bivariate or multivariate associations between pre-treatment variables and retention outcomes. Studies methodological quality will be appraised using explicit checklists designed to appraise observational studies. Studies that meet inclusion criteria but are of poor methodological quality will not be excluded from the review but may be excluded from any meta-analyses or subjected to sensitivity analysis. Exclusion Criteria: Studies that report only qualitative data, do not meet methodological standards, and/or provide insufficient data for analysing associations between pre-treatment variables and retention outcomes will be excluded. Your method of synthesis Meta-analyses will be used if a sufficient number of studies are identified whose model specifications and methodological quality allow for synthesis. Effect sizes for individual 5 The Campbell Collaboration www.campbellcollaboration.org
predictor variables will be compared using the Fisher z-transformation of the correlation coefficient to standardise across studies. However, we anticipate that different studies may specify models differently, resulting in a number of complex issues in quantitative synthesis. We are consulting with specialist statisticians to determine for the protocol what the most appropriate measures and/or meta-analytic techniques would be. 6 The Campbell Collaboration www.campbellcollaboration.org
REFERENCES Butzin, C. A., Martin, S. S., & Inciardi, J. A. (2005). Treatment during transition from prison to community and subsequent illicit drug use. Journal of Substance Abuse Treatment, 28(4), 351-358. Dressing, H., Kief, C., & Salize, H. J. (2009). Prisoners with mental disorders in Europe. The British Journal of Psychiatry, 194(1), 88. doi: 10.1192/bjp.194.1.88 French, M. T., Fang, H., & Fretz, R. (2010). Economic evaluation of a prerelease substance abuse treatment program for repeat criminal offenders. Journal of Substance Abuse Treatment, 38(1), 31-41. doi: 10.1016/j.jsat.2009.06.001 Gossop, M., Marsden, J., Stewart, D., & Rolfe, A. (1999). Treatment retention and 1 year outcomes for residential programmes in England. Drug and Alcohol Dependence, 57(2), 89-98. Gossop, M., Trakada, K., Stewart, D., & Witton, J. (2005). Reductions in criminal convictions after addiction treatment: 5-year follow-up. Drug and Alcohol Dependence, 79(3), 295-302. Griffith, J. D., Hiller, M. L., Knight, K., & Simpson, D. D. (1999). A cost-effectiveness analysis of in-prison therapeutic community treatment and risk classification. The Prison Journal, 79(3), 352-368. doi: 10.1177/0032885599079003005 Hiller, M. L., Knight, K., & Simpson, D. D. (1999). Prison-based substance abuse treatment, residential aftercare and recidivism. Addiction, 94(6), 833-842. doi: 10.1046/j.1360-0443.1999.9468337.x Johnson, T. P., Cho, Y. I., Fendrich, M., Graf, I., Kelly-Wilson, L., & Pickup, L. (2004). Treatment need and utilization among youth entering the juvenile corrections system. Journal of Substance Abuse Treatment, 26(2), 117-128. Looman, J., & Abracen, J. (2011). Substance abuse among high-risk sexual offenders: do measures of lifetime history of substance abuse add to the prediction of recidivism over actuarial risk assessment instruments? Journal of Interpersonal Violence, 26(4), 683-700. Malivert, M., Fatséas, M., Denis, C., Langlois, E., & Auriacombe, M. (2012). Effectiveness of therapeutic communities: a systematic review. European Addiction Research, 18(1), 1-11. McMurran, M., & Theodosi, E. (2007). Is treatment non-completion associated with increased reconviction over no treatment? Psychology, Crime and Law, 13(4), 333-343. 7 The Campbell Collaboration www.campbellcollaboration.org
Meier, P. S., & Best, D. (2006). Programme factors that influence completion of residential treatment. Drug and Alcohol Review, 25(4), 349-355. Mitchell, O., Wilson, D. B., & MacKenzie, D. L. (2006). The effectiveness of incarcerationbased drug treatment on criminal behavior. Campbell Systematic Reviews, 11. DOI: 10.4073/csr.2006.11 Olver, M. E., Stockdale, K. C., & Wormith, J. S. (2011). A meta-analysis of predictors of offender treatment attrition and its relationship to recidivism. Journal of Consulting and Clinical Psychology, 79(1), 6-21. doi: 10.1037/a0022200 Pelissier, B., Camp, S. D., & Motivans, M. (2003). Staying in treatment: how much difference is there from prison to prison? Psychology of Addictive Behaviors, 17(2), 134-141. Prendergast, M. L. (2011). Issues in defining and applying evidence-based practices criteria for treatment of criminal-justice involved clients. Journal of Psychoactive Drugs, 43(sup1), 10-18. doi: 10.1080/02791072.2011.601984 Simpson, D. D. (2004). A conceptual framework for drug treatment process and outcomes. Journal of Substance Abuse Treatment, 27(2), 99-121. Simpson, D. D., Joe, G. W., Broome, K. M., Hiller, M. L., Knight, K., & Rowan-Szal, G. A. (1997). Program diversity and treatment retention rates in the drug abuse treatment outcome study (DATOS). Psychology of Addictive Behaviors, 11(4), 279-293. Smith, L. A., Gates, S., & Foxcroft, D. (2006). Therapeutic communities for substance related disorder. Cochrane Database of Systematic Reviews, 1, CD005338. UKDPC. (2007). An analysis of UK drug policy. London: UK Drug Policy Commission. Welsh, W. N. (2010). Inmate responses to prison-based drug treatment: a repeated measures analysis. Drug and Alcohol Dependence, 109(1-3), 37-44. doi: DOI: 10.1016/j.drugalcdep.2009.11.024 Wexler, H. K., Melnick, G., Lowe, L., & Peters, J. (1999). Three-year reincarceration outcomes for Amity in-prison therapeutic community and aftercare in California. The Prison Journal, 79(3), 321-336. doi: 10.1177/0032885599079003003 Wexler, H. K., & Prendergast, M. L. (2010). Therapeutic communities in United States prisons: effectiveness and challenges. Therapeutic Communities, 31(2), 157-175. Zhang, Z., Friedmann, P. D., & Gerstein, D. R. (2003). Does retention matter? treatment duration and improvement in drug use. Addiction, 98(5), 673-684. 8 The Campbell Collaboration www.campbellcollaboration.org
REVIEW AUTHORS Lead reviewer: Name: Eli Grant Title: Ms. Affiliation: Centre for Evidence Based Intervention and Nuffield College, University of Oxford Address: Nuffield College, New Road City: Oxford Postal Code: OX1 1NF Country: United Kingdom Phone: +44 (0) 1865 280325 Email: elizabeth.grant@nuffield.ox.ac.uk Co-authors: Name: Sean Grant Title: Mr. Affiliation: Centre for Evidence Based Intervention, University of Oxford Address: Barnett House, Wellington Square City: Oxford Postal Code: OX1 2ER Country: United Kingdom Phone: +44 (0) 1865 280325 Email: sean.grant@spi.ox.ac.uk Name: Paul Montgomery Title: Professor Affiliation: Centre for Evidence Based Intervention, University of Oxford Address: Barnett House, Wellington Square City: Oxford Postal Code: OX1 2ER Country: United Kingdom Phone: +44 (0) 1865 280325 Email: paul.montgomery@spi.ox.ac.uk ROLES AND RESPONSIBLIITIES Please give brief description of content and methodological expertise within the review team. The recommended optimal review team composition includes at least one person on the review team who has content expertise, at least one person who has methodological expertise 9 The Campbell Collaboration www.campbellcollaboration.org
and at least one person who has statistical expertise. It is also recommended to have one person with information retrieval expertise. Who is responsible for the below areas? Please list their names: Content: Systematic review methods: Statistical analysis: Information retrieval: Eli Grant, Sean Grant, Paul Montgomery Eli Grant, Sean Grant, Paul Montgomery Eli Grant, Sean Grant Eli Grant, Sean Grant POTENTIAL CONFLICTS OF INTEREST None declared. FUNDING Internal Funding Nuffield College, University of Oxford External Funding Economic and Social Research Council REQUEST SUPPORT Support for database searches is requested. Statistical support may be needed at a later stage for dealing with the aforementioned issues in quantitative synthesis. PRELIMINARY TIMEFRAME Approximate date for submission of Draft Protocol (please note this should be no longer than six months after title approval. If the protocol is not submitted by then, the review area may be opened up for other reviewers): 1 April 2013. 10 The Campbell Collaboration www.campbellcollaboration.org