Disseminating evidence-based practices in substance abuse treatment: A review with suggestions

Size: px
Start display at page:

Download "Disseminating evidence-based practices in substance abuse treatment: A review with suggestions"


1 Journal of Substance Abuse Treatment 31 (2006) Regular article Disseminating evidence-based practices in substance abuse treatment: A review with suggestions William R. Miller, (Ph.D.) a, 4, James L. Sorensen, (Ph.D.) b, Jeffrey A. Selzer, (M.D.) c, Gregory S. Brigham, (Ph.D.) d a Department of Psychology, MSC , 1 University of New Mexico, Albuquerque, NM , USA b University of California San Francisco, San Francisco, CA, USA c Zucker Hillside Hospital, Glen Oaks, NY, USA d Maryhaven, Columbus, OH, USA Received 20 March 2006; received in revised form 20 March 2006; accepted 20 March 2006 Abstract Although substance abuse professionals are generally open to new and better therapeutic methods, most evidence-based treatments do not easily find their way into practice. Natural diffusion processes for innovations in substance abuse treatments are relatively informal and have yielded a widely acknowledged gap between science and community practice. This review focuses on methods for effectively disseminating new treatment methods into practice. Therapist manuals and one-time workshops are in themselves relatively ineffective in helping practitioners gain proficiency in new clinical approaches. Individual performance feedback and coaching improve the acquisition of clinical skills. Specific incentives for implementation may also be needed to encourage treatment providers, programs, and systems to adopt new approaches. D 2006 Elsevier Inc. All rights reserved. Keywords: Diffusion; Dissemination; Evidence-based practice; Addiction; Evidence-based treatment 1. The science practice gap in substance abuse treatment In his classic volume, Diffusion of Innovations, Rogers (2003) documented the characteristic lag between the development of clearly advantageous innovations and their adoption in routine practice. For example, from the time of the first experiment showing that citrus fruits could completely eliminate the high mortality from scurvy, 194 years passed before this knowledge was implemented as a policy on naval sailing ships, a delay that cost a myriad of lives. Even medical care often fails to provide treatment that is consistent with current research knowledge (Grimshaw & Eccles, 2004; Haines & Jones, 1994; Schuster, McGlynn, 4 Corresponding author. address: (W.R. Miller). & Brook, 1998); however, the gap between science and standard practice seems to be particularly wide in substance abuse treatment in the United States (Lamb, Greenlick, & McCarty, 1998; Marinelli-Casey, Domier, & Rawson, 2002; Sorensen & Midkiff, 2002). Historically, there has been relatively little overlap between treatment methods commonly used in community practice and those with scientific evidence of efficacy. One review (Miller, Wilbourne, & Hettema, 2003, p. 41) concluded that b[t]he negative correlation between scientific evidence and treatment-as-usual...could hardly be larger if one intentionally constructed treatment programs from those approaches with the least evidence of efficacy.q This gap is partly caused by the unique development of American addiction treatment, which evolved in relative isolation from mainstream health care (Guydish, 2003; White, 1998). Through the middle of the 20th century, little or no professional help was available for these socially /06/$ see front matter D 2006 Elsevier Inc. All rights reserved. doi: /j.jsat

2 26 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) stigmatized disorders, which most practitioners and hospitals refused to treat. Consequently, there arose an alternative system of care, provided primarily by compassionate peers who were themselves in recovery. Although a disease model was advanced for alcoholism and subsequently for drug dependence, treatment remained segregated in specialist treatment programs with little connection to medical and mental health services. Treatment practices thus continued to be guided by the folk wisdom of recovering people, particularly through the perspectives of Alcoholics Anonymous and related 12-step programs (Alcoholics Anonymous, 1976; Jellinek, 1960). Individual providers, programs, and systems developed strong allegiance to particular treatment models, often regardless of scientific evidence for efficacy or lack thereof (Morgenstern, 2000). This developmental process led to a polarization of science versus practice perspectives (Kalb & Propper, 1976), reflected now in a broader impassioned debate regarding the merits of relying on evidence-based practices in behavioral health services (Beutler, 2004; Levant, 2004). This review begins with a brief consideration of how substance abuse treatment procedures ordinarily find their way into practice. This process of adoption is often not simple. Beyond openness to and motivation for learning new methods, practitioners engage in various processes to develop skillfulness in new procedures. We use the term dissemination to describe these methods for strengthening practice competencies, and we use the term diffusion to describe the processes by which innovations are normally communicated to and adopted by practitioners (see National Institute on Drug Abuse [NIDA], 1991). After discussing natural diffusion processes, we briefly consider what treatment methods should be disseminated and various strategies for helping clinicians learn them. We then conclude with a review and discussion of research on the dissemination of substance abuse treatment methods. We generated this article through an iterative process. An early source was an annotated bibliography on knowledge transfer in drug abuse treatment (Sorensen, Lin, & Sera, 2004) in which all authors had participated either by nominating or providing manuscripts or by reviewing drafts. The bibliography had drawn upon reference databases for articles identified through keyword searches, including the following keywords: bknowledge transfer,q bdiffusion,q bdissemination,qbtechnology transfer,qbdrug rehabilitation,q bdrug therapy,q bsubstance abuse treatment,q bpractice to research,q and baddiction research.q Preparation of the bibliography also involved asking colleagues to nominate relevant manuscripts and names of frequently cited authors in the area. We also decided to focus only on addiction because of this area s singular history rather than to more broadly address mental health or medicine issues in this review. Finally, we stress that the article is not a systematic review of the literature but instead a review of issues addressed in the writings of our field. In this way, the review may be less systematic but more relevant to clinicians in substance abuse treatment. 2. The natural diffusion of substance abuse treatment methods 2.1. What is delivered in United States treatment? Within the standards of evidence-based medicine, health care professionals are generally expected to provide treatment with the best current scientific evidence of efficacy. The same standard has been slow to emerge in substance abuse treatment (Lamb et al., 1998) and mental health care (Stirman, Crits-Christoph, & DeRubeis, 2004). Many widely practiced methods remain unsupported by scientific evidence, whereas other treatments with strong evidence of efficacy are rarely delivered in practice. For example, despite decades of evidence supporting the efficacy of behaviorally oriented couples counseling, only 4% of substance abuse treatment programs reported using it (Fals-Stewart & Birchler, 2001). This gap is perpetuated to the extent that internship and degree programs preparing the next generation of substance abuse professionals continue to neglect evidence-based treatment (EBT) in training. Graduate programs and internships in psychology, for example, may not require students to develop competence in even one empirically validated treatment (Crits- Christoph, Frank, Chambless, Brody, & Karp, 1995), if indeed they address addictions at all during clinical training (Miller & Brown, 1997). It is useful here to distinguish between unevaluated treatment methods (for which there has been little or no research) and disconfirmed treatment approaches (which have been tested and found wanting in multiple trials) (Miller et al., 2003). Some treatment methods have been evaluated in only one or two clinical studies, a small evidence base from which to draw any conclusion. Other widely practiced methods (e.g., Berg & Reuss, 1997) have never been tested at all in a randomized clinical trial. For such unevaluated methods, efficacy is simply unknown. In contrast, other treatment methods have a long history of negative findings in clinical trials yet continue in widespread practice. For example, many substance abuse programs continue to include educational lectures and films as a standard component of treatment, unaware of dozens of clinical trials showing no impact of such didactic approaches (Miller et al., 2003; Davis, Thomson, Oxman, & Haynes, 1995). Similarly, controlled trials have shown little or no beneficial impact on substance use outcomes from interventions such as acupuncture, confrontational approaches, insight-oriented group or individual psychotherapy, or mandated Alcoholics Anonymous attendance (Miller et al., 2003). In substance abuse prevention, the Drug Abuse Resistance Education program was widely disseminated well before any evidence base

3 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) was available and continues to be the most popular schoolbased approach in the United States despite clear failure to show efficacy in controlled trials (Rogers, 2002) How open are clinicians to innovation? Surveys have reflected a general openness of substance abuse professionals to learning new treatment methods, particularly those that appear to address common problems in practice (Erickson-Pritchard, 1999; Forman, Bovasso, & Woody, 2001; McGovern, Fox, Xie, & Drake, 2004). As would be expected, there is also variability among clinicians in their felt need to learn new approaches. Those who endorse a 12-step model or identify themselves as being in recovery have tended to express less interest in and use of evidence-based behavioral and pharmacotherapies (McGovern et al., 2004; Moyers & Miller, 1993; Thomas, Wallack, Lee, McCarty, & Swift, 2003). In a New Mexico survey, counselors endorsing a 12-step model reported using a larger array of treatment methods but fewer EBTs (Erickson-Pritchard, 1999). It does not appear that type of academic degree or years of education, however, predict use of EBT (Erickson-Pritchard, 1999). Physicians and programs with any involvement in research are substantially more likely to adopt treatment innovations (Thomas et al., 2003). The continuing gap between science and practice in the addiction field may be related to values and models acquired during professional training. In a classic article, Kalb and Propper (1976) distinguished two training approaches that they identified as craft and scientific models. A practitioner trained in a craft model learns by apprenticeship by observing and copying the performance of model teachers. Critical analysis of the overall model may be actively discouraged in favor of loyalty to the craft. In contrast, scientist-professionals are expected to be skeptical to demand evidence for elements of any model. The scientist is supposed to be exposed to a wide variety of viewpoints and trained to think about issues in a critical and independent fashion. It would follow, Kalb and Propper reasoned, that those trained in a craft model would be more resistant to alternative views and innovations more reluctant to question their own assumptions and approaches in light of new evidence. These authors linked the craft model to the historic American tradition of non-degree-holding recovering addiction counselors who follow a 12-step treatment approach. Scientists have tended to rely on academic journals for the dissemination of new knowledge, but very few substance abuse clinicians use such journals to inform their practice (Miller, 1987b; Sobell, 1996). A survey of 99 directors of alcoholism treatment centers found that treatment providers preferred to obtain information by faceto-face interaction (e.g., workshops and consultation with colleagues) and made very limited use of scientific books, journals, and conferences (Levinson, Schaefer, Sylvester, Meland, & Haugen, 1982). The survey also highlighted the problem of perceived information overload as a result of the rapidly expanding literature in the field, combined with too little time to keep up with it. Indeed, the problem may not be too few but too many treatment options How are new practices diffused? Erickson-Pritchard (1999) found through a survey that substance abuse counselors reported delivering a mean of 32 (F7) treatment methods or 69% of the 47 therapies listed. The American practice zeitgeist appears to have shifted from strong endorsement of one (disease model) school of thought (Miller, 1986) to an eclecticism that moderately endorses an array of models without a consistent focus (Ball et al., 2002; Taxman & Bouffard, 2003). If diffusion of innovations is minimally influenced by the scientific evidence base, then how do specific treatment practices come to be adopted? Through his diffusion theory, Rogers (2003) identified five factors that increase the likelihood that an innovation, such as a new treatment practice, will be adopted. All have to do with perceptions of the new practice: 1. Relative advantage the perception that it is significantly better than current practice, perhaps more effective or cost effective, or meeting a particular need; 2. Compatibility the extent to which the new practice fits with the provider s experience, values, and goals; 3. Simplicity the perception that the new practice is easy to understand and use; 4. Trialability the extent to which the new practice can be sampled or tried out before a decision is made; and 5. Observability how readily the benefits of the new practice can be observed by others. Rogers (2003) further identified an S-shaped curve to describe the process of adoption of an innovation. Diffusion is relatively flat in the beginning, picked up at first by a few innovators and then by opinion leaders who are generally early adopters. The curve then turns upward into a steep climb, first with the early majority and then with adoption by the average members from the group. Finally, the S curve begins to level out at what will be the plateau of adoption, as the skeptical late adopters and finally the laggard traditionalists come along (Rogers, 2003). At the level of the individual practitioner, there are five steps involved in adopting a new practice (Rogers, 2003), roughly paralleling the transtheoretical stages of change (Prochaska & DiClemente, 1984). After learning about the new practice (knowledge), the clinician develops a positive attitude toward it (persuasion) and ideally gets support from his or her social/organizational system (Simpson, 2002; Thomas et al., 2003). This leads to an intention to try the

4 28 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) new method (decision) and the process of learning how to use it (implementation). Upon experiencing success with the new approach (confirmation), the clinician then integrates it into routine practice and may subsequently encourage its use by others. If these are the processes that govern spontaneous diffusion, then what are the channels through which it occurs? Substance abuse providers indicate that far and away they are most likely to learn about new practices through informal channels colleagues, practical experience, or reading and less often through formal workshops or training (Erickson-Pritchard, 1999). Sometimes providers cannot identify how they became aware of an innovation other than through a variety of sources from which they picked up a positive buzz the sum of comments about an innovation exchanged among people (Rosen, 2000). In the arena of substance abuse treatment, awareness of a new way of doing things may come from a wide range of sources, such as hearing about it in conversation with a colleague or client, seeing something on the news, picking up a brochure, reading a treatment improvement protocol, attending a staff meeting, or being at a professional conference. In surveys, 82% of substance abuse clinicians agreed that research findings should be used more in practice (Forman et al., 2001), and most said that reading is one important way through which they learn about new treatments (Erickson-Pritchard, 1999). Beutler, Williams, and Wakefield (1993) similarly found that mental health clinicians most often used information from popular books, practice-oriented journals, and workshops and seldom used information from research journals. Clinicians tend to be mixed in attitudes toward the use of manuals to guide treatment (Addis & Krasnow, 2000) and respond more favorably to guidelines based on principles and procedures rather than to the session-by-session prescription of content that has characterized most National Institute on Alcohol Abuse and Alcoholism (NIAAA) and NIDA manuals to date (Godley, White, Diamond, Passetti, & Titus, 2001) Barriers for adopting EBTs There is a certain inertia in clinical practice, a tendency to continue doing what is familiar and comfortable, and perhaps a discomfort in considering that long-practiced methods may not be optimal. Research tends to be published in outlets and formats that are relatively inaccessible to busy practitioners, often with little effort given to addressing and adapting it to the needs of community programs (Miller, 1987a). Researchers and clinicians have operated in zones of comfort with too little overlap. Beyond personal factors, there are various systemic barriers to the diffusion of new practice-relevant knowledge (Lamb et al., 1998). Some of these are practical aspects of how service delivery is currently structured. For example, small outpatient programs are unlikely to have medical staff who can provide medication or evaluate mental disorders. Larger organizations with more professional staff have a higher babsorptive capacityq to seek as well as use new information and to hire new staff already familiar with innovations (Knudsen & Roman, 2004). Austerity of funding leaves agencies concentrating on survival, with few resources left for learning and adopting new treatments. Funding sources often provide little support for practitioners in learning new approaches, and most training is on-the-job, which favors the status quo. Such specific systemic barriers should be considered and addressed early in the process of dissemination planning (Rollnick, Kinnersley, & Butler, 2002; Stirman et al., 2004) Incentives for adopting EBTs Given some natural barriers to adoption, it is sensible to explore positive incentives for implementing EBTs. Intrinsic incentives include the desire to offer one s patients the most effective treatment available, a sense of personal growth, and the prestige of working in an agency that uses cuttingedge innovations. Extrinsic incentives also help, and a potent one is differential funding. The State of Oregon, for example, has required that 75% of state funds go to evidence-based practices by July 2009 (Oregon Department of Human Services, 2005). This has created a considerable demand from providers to learn about and adopt EBTs. Follow-up monitoring is needed to document and sustain the use of EBTs; otherwise, providers can simply declare (and believe) that they are delivering EBTs behind closed doors without actually changing practice (Miller & Meyers, 1995). Clinician adherence to key aspects of an EBT has been linked to greater effectiveness (Henggeler, Melton, Brondino, & Scherer, 1997; Miller, Benefield, & Tonigan, 1993). Even when counselors have developed the requisite skill and can perform an EBT competently on demand, adherence drift can be a problem. In one study, simple bargraph feedback of performance fidelity presented privately to each counselor increased adherence from 42% to 71%. A lottery for cash prizes contingent on adherence further increased adherence to 81% (Andrzejewski, Kirby, Morral, & Iguchi, 2001). Modest incentives to programs (e.g., computers, annual $1,000 stipend) can also enhance adherence at the agency level (Carise, Cornely, & Gurel, 2002). Incentives can also enhance clinician participation in the learning of new treatments. In moving toward differential funding for evidence-based substance abuse treatment, the city of Albuquerque (New Mexico) established recurrent annual funding to provide free EBT training for providers. Agencies can offer incentives such as training time off with pay, raises, bonuses, and promotions contingent on developing competence in EBT. Preferential hiring of EBT-proficient staff is a further incentive to keep clinical skills current. Training events can include meals, door prizes, and continuing education credit (VandeCreek & Brace, 1991).

5 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) There are a number of significant barriers to the dissemination of pharmacotherapies for addictive illness. Although the use of medication is widely accepted for the treatment of substance withdrawal (i.e., for detoxification), effective medications are not used widely to prevent relapse either on a time-limited basis or for an indefinite period of maintenance (Woody & McNicholas, 2004). The history of addiction treatment programs is one of development independent of organized medicine, with great reliance on the approaches of the nonprofessional 12-step approach to recovery. Addiction treatment programs and 12-step groups have at times conveyed wariness about medications in the role of addiction treatment. No doubt, part of this wariness is justified by harmful prescribing practices to patients with addictions by some physicians. This barrier is reinforced by negative attitudes toward addiction treatment and persons with addictions on the part of some physicians. Programs that are motivated to incorporate innovative pharmacotherapy may be unable to afford sufficient physician time or to recruit appropriately trained physicians. Further barriers to adoption of medications include the relatively modest effects of certain medications, lack of funds to purchase medications, and the reluctance of pharmaceutical companies to develop and actively market medications Natural diffusion: summing up The diffusion of substance abuse treatment methods occurs naturally and through largely informal channels. The general processes by which innovations are adopted in practice have been thoroughly studied (Rogers, 2003) and seem to apply well in understanding the spread of intervention methods for substance abuse (Rogers, 1995, 2002). Unfortunately, these natural diffusion processes have created a large gap between EBT methods and those delivered in practice (Lamb et al., 1998; Miller, Zweben, & Johnson, 2005). It appears that intentional efforts are needed to disseminate EBT methods into practice and that economic and other specific incentives may be needed to encourage their adoption. 3. Which treatments should be disseminated? Treatment methods deserve to be disseminated into practice once there is sufficient evidence of their efficacy (Persons, 1997), but there are various standards for judging the research necessary to render a treatment evidence based (Chambless & Ollendick, 2001; Davidson, Trudeau, Ockene, Orleans, & Kaplan, 2004). Consensus in expert professional opinion continues to be used as the primary standard in developing the treatment improvement protocols (see ) of the Center for Substance Abuse Treatment (CSAT). Some guidelines use a blend of empirical evidence and expert opinion (American Society of Addiction Medicine, 2001). There is increasing reliance, however, on summary reviews and meta-analyses of published scientific evidence, particularly clinical trials, and various systems have been developed to describe levels of confidence in the specific efficacy of treatment approaches (Drake, Rosenberg, Teague, Bartels, & Torrey, 2003; McCrady, 2000; Miller & Wilbourne, 2002). The end product of such reviews is often a list of treatment methods that are evidence based, as distinguished (by omission) from those that are not (NIDA, 1999). Because definitions and evaluation criteria differ, the resulting lists of which treatments are evidence based can differ substantially, with a few treatments appearing on most lists (Miller, Zweben, et al., 2005). It can make quite a difference which list of criteria one uses to define evidence based. Any such list should not be reified and will require regular updating (McCrady, 2000). An alternative is to avoid listing treatments that are in and out and instead provide an accessible and updated tabulation of the amount and type of evidence supporting each approach (e.g., Miller & Wilbourne, 2002). There is also a problem of gaps in the evidence base. There are fewer studies, for example, of how to treat particular combinations of substance abuse with concomitant psychological and medical disorders (Carey, Purnine, Maisto, Carey, & Simons, 2000). Existing studies may also be addressing the wrong questions from a program s perspective. Clinicians and programs are likely to be interested in whether a new treatment will improve results from what they are already doing (relative advantage) and not in whether the new treatment is superior to no treatment, minimal treatment, or placebo. Attention is needed not only to techniques but also to therapeutic relationship factors that can account for substantial proportions of variance in substance abuse treatment outcome (Ackerman et al., 2001; Najavits & Weiss, 1994; Norcross, 2004). Presumably, the purposes of adopting EBTs are to improve over current practices and ultimately to improve outcomes. Informed caution and humility are appropriate in generalizing from randomized trials to community practice (Borkovec & Castonguay, 1998; Goldfried & Eubanks-Carter, 2004; Haaga, 2004; Westen, Novotny, & Thompson-Brenner, 2004). 4. Strategies for learning new treatment methods There are at least three general aids in the learning of any new skill, be it flying an aircraft, sailing, tennis, or chess. First, there is usually some fundamental preparatory knowledge to acquire, the ground school of flying or sailing. This often involves reading, verbal instruction, or observing competent practice by others. Next comes practice with feedback. Without information about how well one is doing, repeated trials are of little value and can quickly foster bad habits. Finally, there is coaching or supervision to

6 30 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) reinforce correct practice and provide expert tips for performance improvement Preparatory information There is no shortage of available information about substance abuse treatment. The field has many scientific and professional journals (Arciniega & Miller, 1997; Babor, Stenius, & Savva, 2004), practice guidelines (American Psychiatric Association, 1995; American Society of Addiction Medicine, 2001), books and therapist manuals, demonstration tapes, treatment improvement protocols, information services, listserves, web-based information and training, and continuing professional education opportunities. If anything, substance abuse practitioners suffer from information overload, with little help in sorting wheat from chaff. Helpful here would be a public service that abstracts and synthesizes outcome research and applies it to policy implications for clinical practice (Haynes & Haines, 1998). Providing preparatory information has been a primary dissemination strategy for pharmaceutical companies, which spend more than $12 billion per year promoting products (Ma, Stafford, Cockburn, & Finkelstein, 2003). A major portion of this amount is devoted to supporting visits by pharmaceutical representatives to physicians offices. This practice, known as detailing, creates an ongoing relationship between the pharmaceutical representative and the physician, with a goal of increasing product prescriptions. Academic detailing (Soumerai, 1998; Soumerai & Avorn, 1990), based on this model of an ongoing relationship between a dissemination agent and a recipient, has been specifically effective in changing prescribing patterns (Davis, Thomson, Oxman, & Haynes, 1995). Direct-to-consumer advertising is a growing but still small portion of marketing (Ma et al., 2003). Within the substance abuse field, particular educational effort has been devoted to the dissemination of buprenorphine, which, like methadone, can be highly effective in treating opiate addiction. The Drug Abuse Treatment Act of 2000 and subsequent approval as well as designation of buprenorphine as a Schedule III medication by the Food and Drug Administration in 2002 made it possible for opiatedependent individuals to receive buprenorphine in private physician offices. In addition to some important pharmacological advantages for buprenorphine, these regulations provide greater flexibility and privacy in the use of buprenorphine compared with methadone treatment of opiate addiction, in addition to its pharmacological advantages. Using technology transfer procedures outlined in The Change Book (Addiction Technology Transfer Centers, 2000), McCarty, Rieckmann, Green, Gallon, and Knudsen (2004) offered a 1.5-day workshop for rural practitioners interested in learning to use buprenorphine in managing opioid dependence. Participants reported more positive beliefs about the efficacy of buprenorphine, and 35% were using it in practice 9 months later. Another informational strategy to promote the adoption of buprenorphine has been directed to non-physician clinicians. The NIDA and the CSAT have chosen buprenorphine awareness as an objective for one of their blending teams (Whitten, 2005). By educating non-physician staff about the benefits of buprenorphine, momentum for adoption may be increased and, once adopted, better integrated into other aspects of treatment. In diffusion research, a distinction is often drawn between hard and soft technologies. For hard technologies, such as machinery or medications, quality control is in the technology itself. Quality control of a medication occurs primarily outside the clinic, at the manufacturer, and is less reliant on the provider than in the case of soft technologies, such as counseling and psychotherapy, in which the effectiveness of the intervention is highly dependent on the skill with which the clinician delivers it. As distinguished from pharmacotherapies, treatments based on psychosocial methods and processes have come to be called behavioral therapies. This generic use of the term creates some confusion with the prior use of behavior therapy to describe a particular treatment approach rooted in learning theory. For present purposes, we are using behavioral in the more generic sense of verbal counseling and psychotherapies emphasizing psychosocial factors. Hearing or reading about a behavioral treatment does not in itself yield competence in providing it. In a review of more than 100 trials of interventions to improve professional practice, Oxman, Thomson, Davis, and Haynes (1995) concluded that information-only strategies are usually insufficient to produce changes in the practice behavior of health professionals. Similarly, guidelines from professional organizations may predispose clinicians to consider change, but guidelines alone are unlikely to change practice behavior unless they are accompanied by opportunities for learning Monitored practice with feedback Learning any new skill does not occur without feedback. One of the most consistent findings in motivational psychology is that feedback improves performance. Trying to learn a counseling method without feedback is like learning to bowl in the dark: One may get a feeling on how to release a ball and subsequent noise will provide some clue about accuracy, but without information about where the ball struck, years of practice may yield little improvement. Self-perceived competence in delivering a behavioral treatment bears little or no relationship to actual practice proficiency (Miller, Yahne, Moyers, Martinez, & Pirritano, 2004) Supervision and coaching In addition to reliable feedback about performance, it is helpful to have an expert coach, teacher, or supervisor when learning a new skill. It is very helpful to have a proficient expert in the new intervention used onsite or readily available

7 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) to line staff to provide ongoing training, coaching, and supervision. Expert coaching is an established technique for improving performance, and positive reinforcement for improving performance is another well-established behavioral principle. An onsite mentor is helpful not only in acquiring the specific skills of a new treatment but also in supporting persistence in behavior change efforts. New practices feel awkward in the beginning, and implementing them may at least initially diminish therapist congruence (Miller & Mount, 2001), therapeutic alliance (Crits-Christoph et al., 1998), and other interpersonal relationship dimensions that are themselves associated with better client outcomes (Henry, Strupp, Butler, Schacht, & Binder, 1993). Without ongoing onsite reinforcement and support, it is easy to revert to prior practice habits. The substance abuse area seems particularly disadvantaged in its ability to make good use of supervision, however, because there is insufficient training and internal organization to provide much supervision. McLellan and Meyers (2004) conducted a nationally representative survey of 175 substance abuse treatment programs for adults and found that bthe organization, administrative and personnel infrastructures of many programs are fragile and unstableq (p. 768). There was a disturbing level of turnover at all levels, from counseling staff to program directors, and more than half had not been in their jobs for even 1 year (McLellan, Carise, & Kleber, 2003). Thus, supervision time is minimal in most programs, making it difficult to implement new evidence-based practices in a way that they will display the power they showed in clinical trials. In partnership with a number of physician professional organizations, the CSAT has participated in the development of 8-hour meetings to train interested physicians in the use of buprenorphine. Participation in such training qualifies a physician to receive authorization from the Drug Enforcement Administration to prescribe buprenorphine. Since the beginning of this program, more than 6,000 physicians have been trained, fewer than half of whom have ever prescribed buprenorphine. To increase the number of actual prescribers, the CSAT has entered into a partnership with a number of physician organizations to create the Physician Clinical Support System (PCSS), a national mentoring network to promote the use of buprenorphine (McDowell, 2004). This research utilization strategy is setting the goal of consultation with an experienced mentor within 24 hours of a request. The PCSS printed material conveys not only reassurance that physicians will be given support in prescribing buprenorphine but also a positive view of the gratification resulting from involvement with the targeted patient population The Clinical Trials Network as a bidirectional model of diffusion Recognition that research advances in the treatment of addiction were not being adopted in the national system of community treatment programs led to the formation of a panel by the U.S. Institute of Medicine to explore this problem and make recommendations. The resulting publication, Bridging the Gap Between Practice and Research: Forging Partnerships With Community-Based Drug and Alcohol Treatment (Lamb et al., 1998), documented the panel s findings and recommendations, described barriers to more widespread adoption of treatments with proven efficacy, and suggested strategies to overcome them. One important strategic recommendation was to increase communication back and forth between researchers and clinicians. This recommendation for a bidirectional approach (Herschell, McNeil, & McNeil, 2004) went beyond researchers communicating results and clinicians expressing needs by explicitly urging a model in which researchers and clinicians collaborate to generate ideas for interventions to be tested. The NIDA responded by creating the Clinical Trials Network (CTN), a web of university-based regional research and training centers each with a group of affiliated community treatment programs (see CTN/Index.htm). The CTN thus brought together researchers experienced in addiction treatment efficacy research with established community treatment agencies willing to participate in clinical trials. These scientists and programs have collaborated to select and design studies testing the efficacy of EBT methods when delivered by the staff and with the patients of real-life community programs (Carroll et al., 2002), thus blurring the line between efficacy and effectiveness research (Glasgow, Lichtenstein, & Marcus, 2003). Studies were selected based on relevance to clinical needs and with an eye toward sustainability: the treatments tested should not be so complex or costly as to inhibit their continued use in practice, if found effective. Rogers (2003), whose research on dissemination was described earlier, described the CTN as an ideal bdissemination scaffoldq with substantial potential to impact practice (Selzer & Shine, 2004). Once treatments are found to be effective in community programs, how can they be disseminated into practice? To this end, a partnership was formed between the NIDA and the CSAT to develop blending teams (Whitten, 2005). These teams bring together scientists who have evaluated the particular approach, community clinicians who have participated in tests of the intervention, and members of the CSAT s Addiction Technology Transfer Centers. The blending teams are charged with the task of developing educational material and dissemination strategies to promote the adoption of CTN-tested protocols that proved effective. 5. Research on dissemination of evidence-based practices 5.1. Three stages of science Logically, dissemination should be the last step in a careful sequence of treatment development. First, a new

8 32 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) treatment method evolves, ideally with a specifiable theory of how and why it works. After initial experience to define procedures, the treatment next undergoes a series of tests to determine its efficacy. If (and only if) it works under controlled conditions, then the treatment is ready for dissemination into community practice. The NIDA has adopted this three-stage model for conceptualizing the state of behavioral therapy research (Onken, Blaine, & Battjes, 1997), paralleling phases through which new medications pass as they are being developed and tested. Stage I: Treatment development. Considerable research and development are needed before a behavioral therapy is ready to be tested. The new treatment is specified not only in principle but also in operational procedures that can be described in print, allowing others to replicate the method. This process of specification now usually involves development of an intervention manual and of measures to document whether and how well the treatment is being delivered. A period of pilot testing normally follows, using feedback to improve the treatment and measures. This pilot phase also usually provides an estimate of the size of impact on patient outcomes that can be expected. If things look promising, then the treatment is ready for the next stage of development. Stage II: Establishing efficacy. This stage establishes whether the therapy works and why. In treatment research, efficacy refers to how well a treatment works under ideal and well-controlled research conditions, whereas effectiveness refers to how well it works in the more chaotic real-life conditions of community practice (Haynes & Haines, 1998). Stage II research is focused on efficacy, usually through randomized clinical trials to compare the new method against control conditions or alternative treatments. This stage also involves studies aiming to understand a treatment s mechanism of action and the specific components that account for its success. If a treatment is efficacious, then studies on specific mechanisms of efficacy inform what features to emphasize in training when the treatment is disseminated. Stage III: Establishing effectiveness. A treatment that works under controlled research conditions (efficacy) may not necessarily work in the community (effectiveness). Thus, Stage III involves taking a treatment that has shown promise in clinical trials and determining how well it can work in the community. Stage III studies also determine what it takes to help frontline clinicians learn the new treatment and apply it effectively in practice. The stage model does not tell the whole story of course. Many treatments have been developed by innovators and have diffused into community practice without even Stage I research. Some examples are self-help programs (Nowinski, 2003), therapeutic communities (DeLeon, 2003), the Minnesota model (Cook, 1988), and drug courts (Deschenes, Peters, Goldkamp, & Belenko, 2003). The stage model describes a deliberate stepwise process to develop interventions that do work and that can be learned and used by practicing clinicians. There are other hybrid models that incorporate elements of both efficacy and effectiveness in the development of interventions (Carroll & Rounsaville, 2003). Nevertheless, the stage model is an excellent template for considering what interventions merit dissemination efforts to speed up their diffusion into the community. The stage model can also be used to specify and evaluate previously untested treatments that are already in widespread use (Hall, 2001). Reports of successful dissemination efforts have begun to appear in the substance abuse literature (Martin, Herie, Turner, & Cunningham, 1998; Shanley, Lodge, & Mattick, 1996), along with guidelines for promoting the adoption of new treatment methods (Backer, David, & Soucy, 1995). However, reliable dissemination measures and benchmarks are needed to evaluate the effectiveness of such efforts. The following sections describe approaches for evaluating the effectiveness of diffusion and dissemination efforts Measures of diffusion One key measure is the extent to which an innovation has been adopted in practice (Rogers, 1995). This can be assessed by surveying providers (Thomas et al., 2003). Large surveys of organizations provide an opportunity to not only measure use in the field but also examine the influence of organizational attributes that influence programs likelihood of adopting new interventions. For example, Knudsen, Johnson, and Roman (2003), Knudsen, Johnson, Roman, and Oser (2003), Knudsen, Roman, and Ducharme (2004), and Roman and Johnson (2002) of the University of Georgia conducted studies to understand the extent to which evidence-based interventions were being used in clinical programs. They found that use of naltrexone in substance abuse treatment programs was significantly related to both the treatment center s age (older centers showing more adoption) and its administrative leadership (centers with more tenured leaders and more counselors holding degrees showing more adoption). Each research group has tended to create its own measures of adoption, but there have also been efforts to develop more generally useful measures. An example is Organizational Readiness for Change assessment, which was developed at the Texas Christian University (Lehman, Greener, & Simpson, 2002) Effectiveness of training Written measures Perhaps the most common form for evaluating a dissemination event is a posttraining questionnaire that may ask about satisfaction with training and competencies acquired. Self-reports of competence, however, bear little or no relationship to actual behavioral proficiency in delivering a treatment (Carroll et al., 2002; Miller et al., 2004;

9 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) Schwarz, 1999), and such questionnaires are therefore of limited value in judging the effectiveness of training. A second approach asks trainees to demonstrate their knowledge on a posttraining quiz or their skill by responding to specific stimuli such as a written case scenario (Miller, Hedrick, & Orlofsky, 1991). This is a step closer to practice, reflecting a trainee s ability to write appropriate responses or select them from among multiple options. Stimuli to prompt trainee responses could also be presented by audiotape, videotape, or interactive electronic technologies (Carpenter, Watson, Raffety, & Chabal, 2003; Weingardt, 2004) Practice samples Still closer to practice are proficiency samples in which the trainee is asked to demonstrate skill in a simulated interaction. A common format here is to have a trainee interview an actor simulating a patient (Arthur, 1999; Barsky & Coleman, 2001; Ockene, Wheeler, Adams, Hurley, & Hebert, 1997; Levin, Owen, Stinchfield, Rabinowitz, & Pace, 1999; Lockyer et al., 1996). The trainee may also self-select a session from normal practice as a demonstration of acquired skillfulness in the new method (Miller et al., 2004). Such samples illustrate a trainee s ability to produce training-appropriate responses on demand in a live interaction. They thus show the extent to which a clinician is able to demonstrate a clinical skill but not the extent to which that skill is actually being applied in ordinary practice. The clearest evidence of successful dissemination comes from work samples of ongoing practice, ideally selected at random from a larger set of (or all) recorded sessions. Obtaining structured observer ratings of actual psychotherapy sessions is a method pioneered by Carl Rogers and his students (Truax & Carkhuff, 1967). This has become a common method for monitoring treatment fidelity in clinical trials of behavioral therapies (Crits- Christoph et al., 1998; DiClemente, Carroll, Connors, & Kadden, 1994; Miller, Moyers, Arciniega, Ernst, & Forcehimes, 2005). Most often, practice samples are rated on a series of Likert scales for general aspects of competence or for the presence of specific prescribed and proscribed practice behaviors (Bien, Miller, & Boroughs, 1993; Levin et al., 1999; Lockyer et al., 1996; Madson, Campbell, Barrett, Brondino, & Melchert, 2005). More global ratings of this kind may or may not differentiate between compared treatments and may show little improvement over the course of training (Crits- Christoph et al., 1998; Rounsaville, Chevron, Weissman, Prusoff, & Frank, 1986). Greater specificity tends to increase the sensitivity of ratings to detect training effects and between-treatment differences (Carroll et al., 1998; Henry et al., 1993). Specific therapist behavior counts can further enhance the predictive value of treatment process measures (Miller et al., 1993; Moyers, Miller, & Hendrickson, 2005; Patterson & Forgatch, 1985). Ultimately, the aim of disseminating EBTs is to improve patient outcomes. Here, then, is a more distal measure of the effectiveness of dissemination: Training should change providers practice behavior, which in turn should yield better treatment outcome. For example, Strosahl et al. (1998) trained therapists in acceptance and commitment therapy and documented that the patients of those therapists reported better ability to cope with their problems, fewer referrals for medical evaluations, and greater likelihood of completing treatment (see also Hayes, Strosahl, & Wilson, 1999) Dissemination of behavioral therapies To date, much of the research on dissemination of behavioral treatments for substance abuse have involved relatively short periods of training for health professionals to provide brief interventions (Hollis, Lichtenstein, Vogt, Stevens, & Biglan, 1993; Hollis et al., 1994; Levin et al., 1999; Lichtenstein et al., 1996; Lindsay et al., 1994; Lockyer et al., 1996). Targeting smoking (Ockene et al., 1988) and drinking (Ockene et al., 1997), Ockene et al. found modest skill improvements in ratings of taped interviews with standardized patient actors with medical personnel who received 3 hours of training in patientcentered counseling. Similarly, modest skill gains were reported after a 5-day training with physicians (Levin et al., 1999). Most EBTs, however, are considerably more complex than brief medical interventions. How do practitioners learn new treatments that are more complicated? If they receive any formal training at all in the new approach (Erickson-Pritchard, 1999), a typical continuing professional education format is a 1- to 2-day clinical workshop, often attended to maintain professional licensure (Vande- Creek & Brace, 1991). How effective are such workshops for increasing clinical skillfulness in more complex behavioral therapies? Two studies showed an increase in trainees ability, after 1 2 days of training, to generate reflective listening responses on a paper-and-pencil task posing clinical vignettes (Miller et al., 1991; Rubel, Sobell, & Miller, 2000). Like self-report, however, such questionnaire responses do not reliably predict proficiency in actual counseling sessions (Miller et al., 2004). A 2-day clinical workshop on motivational interviewing, conducted by its progenitor, yielded statistically significant albeit modest skill increases on observer coding of sessions, but these practice behavior changes were not large enough to produce any improvement in patient response (Miller & Mount, 2001). In short, workshop training produced small practice changes that could be demonstrated on demand but not enough to make a difference to patients. What then would increase the impact of training? A subsequent randomized trial tested two training aids personal performance feedback and individual coaching

10 34 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) in addition to workshop training (Miller et al., 2004). With a complex coding system, the Motivational Interviewing Skill Code (Moyers, Martin, Catley, Harris, & Ahluwalia, 2003), skill acquisition was significantly improved by either feedback or coaching. A self-training (from book and videotape) control group showed no improvement in clinical skill, and the workshop alone again produced only modest gains. When improvement in client response (rather than therapist behavior) was the criterion, only the group receiving both feedback and coaching showed significant improvement. Training, feedback, and ongoing coaching or supervision can bring 90% of substance abuse clinicians up to proficiency level in cognitive behavior therapy (Morgenstern, Morgan, McCrady, Keller, & Carroll, 2001) and motivational interviewing (Miller et al., 2004). This is a rather consistent finding: that providing written guidelines or therapist manuals is relatively ineffective in enhancing clinical skillfulness (Oxman et al., 1995) and workshop training typically results in at best modest increments in skill and implementation. Nonetheless, the publication of therapist manuals has been one heavily used dissemination strategy by both the NIDA (Budney & Higgins, 1998; Carroll, 1998; Szapocznik, Hervis, & Schwartz, 2003) and the NIAAA (Kadden et al., 1992; Miller, Zweben, DiClemente, & Rychtarik, 1992; Nowinski, Baker, & Carroll, 1992). Tens of thousands of these manuals have been distributed at cost or free, although the impact on practice remains unclear. Workshops without follow-up may produce attitude change (Hayes et al., 2004; McCarty et al., 2004), but practice behavior is more challenging to modify. Personal outreach visits (academic detailing) are somewhat more effective in changing practice but variable (Oxman et al., 1995). Follow-up contact (e.g., ongoing coaching, supervision, or booster sessions) significantly enhances change in practice behavior (Kelly et al., 2000; Miller et al., 2004; Sholomskas et al., 2005; Sorensen, Hall, Loeb, & Allen, 1988). Short of in-person coaching, interactive instructional technology delivered via software or the internet offers promise as a way to convey knowledge and even shape clinical skills when learning new treatments (Sholomskas et al., 2005; Weingardt, 2004). Besides training procedures themselves, various factors may influence the effectiveness of dissemination efforts in fostering adoption and clinical skill acquisition of new treatments. It is sensible to select for training those clinicians who are more receptive to the particular new approach and whose professional beliefs and orientation are more compatible with it (Ball et al., 2002). This happens to some extent through self-selection among training options. The specific method being trained can also make a difference. In one study with ongoing supervision and feedback, therapists delivering cognitive behavior therapy became more proficient over time, whereas no case-to-case improvement effect of training was found for supportive expressive therapy or generic drug counseling (Crits-Christoph et al., 1998). The levels of organizational readiness (Simpson, 2002) and support for new practices (Thomas et al., 2003) also influence the extent to which a program s providers will adopt them Dissemination research needs Research on best practices for disseminating evidencebased substance abuse treatments into practice is still in its infancy. Clearly, the mere publication of efficacy studies and even training manuals has done little to promote the adoption of EBTs in clinical practice. Although medication prescribing may be altered by basic information provided by pharmaceutical companies, it is highly doubtful that proficiency in more complex behavioral interventions can be achieved by reading a therapist manual or attending a clinical workshop. A key direction for future dissemination research in substance abuse treatment is to identify the learning experiences that are necessary to develop competence in specific EBTs. Two promising candidates are methods often used in the acquisition of any skill: accurate feedback of performance and expert coaching for skill improvement. Although logical and promising, it remains unclear which kinds or amounts of feedback and coaching are necessary or sufficient. Diffusion research would also be advanced by better understanding of how EBTs work (Silverman & Kurtines, 2004). Lacking clarity on the mechanisms of action, we are left to disseminate back-box treatment packages that may well contain superfluous, superstitious, or even countertherapeutic components. Knowledge of the most important active ingredients of an EBT can help focus dissemination on those elements that are essential to effective practice. It can also inform the limits of reinvention of an innovation as it is adapted across cultures and contexts, separating the attributes that must be retained for effectiveness from those that can be modified without compromising the treatment (Rogers, 2003). Indeed, a degree of reinvention may be inevitable and may promote adoption. The acquisition of proficiency in an EBT is only one step in the adoption process. Also needed is research on processes that favor the continued improvement of skills once they are established. In clinical trials, this concern is described as bdrift from protocol.q What are the critical dimensions of practice on which drift is detrimental and which aspects of an EBT can clinicians reinvent, adapting it to their own style? The ability to reinvent promotes diffusion but can compromise fidelity. Based on the limited information available, a research utilization model in which dissemination agents and their recipients have ongoing contact and interaction is most likely to be successful. The ideal situation may be an onsite expert in the EBT who is available to train current and new staff and to provide ongoing supervision, coaching, and feedback. This will be feasible for some EBTs in some larger agencies. Telephone or web-based contact may also

11 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) be effective when the trainer-supervisor and trainees are separated geographically. Again, future research could clarify the frequency, amount, and type of contact that favors skill acquisition and maintenance. The cost and sustainability of such systems must also be considered. Forman et al. (2001) developed and tested high-sustainability systems to provide clinicians with ongoing feedback from clients (see Individual differences among providers can also influence the outcomes of dissemination efforts. Some clinicians take to a new approach more readily, acquiring proficiency rapidly and naturally integrating it into their ongoing practice. Other clinicians may not achieve proficiency in a particular behavioral approach no matter how much training, feedback, and supervision are provided. In the multisite COMBINE study, practice samples were prescreened for empathic ability before therapist candidates were hired and trained in a combined behavioral intervention that included motivational interviewing (Miller, Moyers, et al., in press). A pretraining level of competence in crucial component skills may enhance acquisition of proficiency in an EBT. Although fidelity to pharmacotherapy interventions is much less a problem than it is with behavioral therapies, there are also important dissemination questions to answer for this type of intervention. How well does an intervention such as academic detailing work when targeted to physicians working limited hours in addiction treatment programs? The same questions about intensity, frequency, and nature of contact with dissemination agents for behavioral therapies are also important here. What would the impact be of direct-to-consumer marketing of a new pharmacotherapy? For example, would a buprenorphine awareness program directed to program clients have impact? Finally, what are system factors that promote the adoption of evidence-based practices (Roman & Johnson, 2002)? What is the impact of incentives for the adoption of evidence-based practices? What is the impact if an organization s performance improvement measurements focus on evidence-based practice patterns? Do organizations that promote the adoption of evidence-based practices have better clinical outcomes for their clients? Do such organizations have improved retention of qualified staff? 6. Discussion Whatever natural benefits there are for using evidencebased practices have usually been insufficient to bring about their adoption in community practice. Nonetheless, it is clear that, like other health care providers, substance abuse practitioners will be increasingly required to learn and adopt evidence-based practices. Established clinical practices are not easy to change and require interventions at both the systemic and the individual provider level (Mattson & Donovan, 1994). One problem concerns funding: Systems seeking to change provider behavior need to allocate sufficient resources for dissemination. This recognition has led federal institutes and agencies to implement major technology transfer initiatives to disseminate EBTs into practice (Addiction Technology Transfer Centers, 2000; NIDA, 1991) Toward evidence-based dissemination Similar to the ethical imperative for evidence-based practice in substance abuse treatment is the need for evidence-based approaches in disseminating EBTs (Grimshaw & Eccles, 2004). Much is known about how to promote the diffusion of innovations (McCarty, 2003; Rogers, 2003; Stirman et al., 2004) and how to help practitioners develop proficiency in new treatment methods, but relatively little of such knowledge is put into practice in continuing professional education. The dissemination of knowledge about EBTs is certainly a first step. There has been a proliferation of substance abuse therapist manuals, books, treatment improvement protocols, videotapes, and other material intended to improve practice. As with the bewildering spectrum of self-help resources found in most bookstores, clear guidelines are needed to help providers distinguish EBTs from the much larger array of treatment methods that are promoted. Yet knowledge alone does not change practice. Just as educational lectures and films have virtually no impact on clients substance abuse treatment outcomes, didactic material and presentations appear to have little impact on providers substance abuse treatment practices. The dissemination of knowledge-focused material and workshops cannot substitute for proper clinical training, feedback, and supervision in helping providers learn more effective EBTs (Herschell et al., 2004). The above-reviewed treatment dissemination literature might be summarized in two simple principles. To learn any new behavioral skill, people need not only informational training but also (1) clear and accurate feedback regarding their performance and (2) guidance from a supervisor/coach who has greater expertise and proficiency in the skill. Without performance feedback, significant change in practitioner behavior does not occur. This may account for why there is so little relationship between psychotherapists years of experience and their patients outcomes. In contrast, surgeons automatically receive ongoing and relatively rapid feedback regarding the outcomes of their work and become more skillful at procedures with continued practice. Most providers of substance abuse services work in a feedback vacuum, receiving little reliable information regarding the outcomes of their work. Likewise, supervision rarely involves observation of and feedback from actual practice sessions. Yet feedback is of limited usefulness without guidance for how to improve performance. A persistent novice golfer on a driving range can gradually learn how to drive a ball farther, but learning can be substantially accelerated by a

12 36 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) little coaching from an experienced professional. Attending a workshop, studying a therapist manual, or trying to master a new treatment without feedback or coaching is like reading about and attending a lecture on golf then practicing swings blindfolded. You will hit one now and then albeit probably not very well. Acknowledgments This research was supported in part by Cooperative Agreements K05-AA00133, U10-DA015833, U10-DA015815, U10-DA013732, and U10-DA from the National Institutes of Health. References Ackerman, S. J., Benjamin, L. S., Beutler, L. E., Gelso, C. J., Goldfried, M. R., & Hill, C. (2001). Empirically supported therapy relationships: Conclusions and recommendations of the Division 29 Task Force. Psychotherapy, 38, Addiction Technology Transfer Centers. (2000). The change book: A blueprint for technology transfer. Kansas City, MO7 Addiction Technology Transfer Center National Office. Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists attitudes towards psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68, Alcoholics Anonymous. (1976). Alcoholics Anonymous: The story of how many thousands of men and women have recovered from alcoholism (3rd ed.). New York7 A.A. World Services. American Psychiatric Association. (1995). Practice guideline for the treatment of patients with substance use disorders: Alcohol, cocaine, opioids. American Journal of Psychiatry, 152(Suppl), American Society of Addiction Medicine (2001). Patient placement criteria for the treatment of substance-related disorders (PPC-2R). Chevy Chase, MD7 American Society of Addiction Medicine. Andrzejewski, M. E., Kirby, K. C., Morral, A. R., & Iguchi, M. Y. (2001). Technology transfer through performance management: The effects of graphical feedback and positive reinforcement on drug treatment counselors behavior. Drug and Alcohol Dependence, 63, Arciniega, L. T., & Miller, W. R. (1997). Where to publish? Some considerations among English-language addiction journals. Addiction, 92, Arthur, D. (1999). Assessing nursing students basic communication and interviewing skills: The development and testing of a rating scale. Journal of Advanced Nursing, 29, Babor, T. F., Stenius, K., & Savva, S. (Eds.). (2004). Publishing addiction science: A guide for the perplexed. London, UK7 International Society of Addiction Journal Editors. Backer, T. E., David, S. L., & Soucy, G. (Eds.). (1995). Reviewing the behavioral science knowledge base on technology transfer (NIDA Research Monograph. 155). Rockville, MD7 National Institute on Drug Abuse. Ball, S. A., Bachrach, K., DeCarlo, J., Farentinos, C., Keen, M., McSherry, T., et al. (2002). Characteristics, beliefs, and practices of community clinicians trained to provide manual-guided therapy for substance abusers. Journal of Substance Abuse Treatment, 23, Barsky, A., & Coleman, H. (2001). Evaluating skill acquisition in motivational interviewing: The development of an instrument to measure practice skills. Journal of Drug Education, 31, Berg, I. K., & Reuss, N. H. (1997). Solutions step by step: A substance abuse treatment manual. New York7 W. W. Norton. Beutler, L. E. (2004). The empirically-supported treatments movement: A scientist-practitioner s response. Clinical Psychology: Science and Practice, 11, Beutler, L. E., Williams, R. E., & Wakefield, P. J. (1993). Obstacles to disseminating applied psychological science. Applied & Preventive Psychology, 2, Bien, T. H., Miller, W. R., & Boroughs, J. M. (1993). Motivational interviewing with alcohol outpatients. Behavioural and Cognitive Psychotherapy, 21, Borkovec, T. D., & Castonguay, L. G. (1998). What is the scientific meaning of empirically supported therapy? Journal of Consulting and Clinical Psychology, 66, Budney, A. J., & Higgins, S. T. (1998). A community reinforcement plus vouchers approach: Treating cocaine addiction. Rockville, MD7 National Institute on Drug Abuse. Carey, K. B., Purnine, D. M., Maisto, S. A., Carey, M. P., & Simons, J. S. (2000). Treating substance abuse in the context of severe and persistent mental illness: Clinicians perspectives. Journal of Substance Abuse Treatment, 19, Carise, D., Cornely, W., & Gurel, O. (2002). A successful researcher practitioner collaboration in substance abuse treatment. Journal of Substance Abuse Treatment, 23, Carpenter, K. M., Watson, J. M., Raffety, B., & Chabal, C. (2003). Teaching brief interventions for smoking cessation via an interactive computerbased tutorial. Journal of Health Psychology, 8, Carroll, K. M. (1998). A cognitive behavioral approach: Treating cocaine addiction. Rockville, MD7 National Instsitute on Drug Abuse. Carroll, K. M., Connors, G. J., Cooney, N. L., Diclemente, C. C., Donovan, D. M., Kadden, R. R., et al. (1998). Internal validity of Project Match treatments: Discriminability and integrity. Journal of Consulting and Clinical Psychology, 66, Carroll, K. M., Farentinos, C., Ball, S. A., Crits-Christoph, P., Libby, B., Morgenstern, J., et al. (2002). MET meets the real world: Design issues and clinical strategies in the Clinical Trials Network. Journal of Substance Abuse Treatment, 23, Carroll, K. M., & Rounsaville, B. J. (2003). Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatric Services, 54, Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, Cook, C. H. (1988). The Minnesota model in the management of drug and alcohol dependency: Miracle, method, or myth? Part I. The philosophy and the programme. British Journal of Addiction, 83, Crits-Christoph, P., Frank, E., Chambless, D. L., Brody, C., & Karp, J. F. (1995). Training in empirically validated treatments: What are clinical psychology students learning? Professional Psychology, Research and Practice, 26, Crits-Christoph, P., Siqueland, L., Chittams, J., Barber, J. P., Beck, A. T., Frank, A., et al. (1998). Training in cognitive, supportive expressive, and drug counseling therapies for cocaine dependence. Journal of Consulting and Clinical Psychology, 66, Davidson, K. W., Trudeau, K. J., Ockene, J. K., Orleans, C. T., & Kaplan, R. M. (2004). A primer on current evidence-based review systems and their implication for behavioral medicine. Annals of Behavioral Medicine, 28, Davis, D. A., Thomson, M. A., Oxman, A. D., & Haynes, R. B. (1995). Changing physician performance: A systematic review of the effect of continuing education strategies. Journal of the American Medical Association, 274, DeLeon, G. (2003). Therapeutic communities: Research practice reciprocity. In J. L. Sorensen, R. A. Rawson, J. Guydish, & J. E. Zweben (Eds.), Drug abuse treatment through collaboration: Practice and research partnerships that work (pp ). Washington, DC7 American Psychological Association. Deschenes, E. P., Peters, R. H., Goldkamp, J. L., & Belenko, S. (2003). Drug courts. In J. L. Sorensen, R. A. Rawson, J. Guydish, & J. E.

13 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) Zweben (Eds.), Drug abuse treatment through collaboration: Practice and research partnerships that work (pp ). Washington, DC7 American Psychological Association. DiClemente, C. C., Carroll, K. M., Connors, G. J., & Kadden, R. M. (1994). Process assessment in treatment matching research. Journal of Studies on Alcohol, 12, Drake, R. E., Rosenberg, S. D., Teague, G. B., Bartels, S. J., & Torrey, W. C. (2003). Fundamental principles of evidence-based medicine applied to mental health care. Psychiatric Clinics of North America, 26, Erickson-Pritchard, H. (1999). Models and modalities: Diffusion of ideas in alcohol and drug abuse treatment. Unpublished master s thesis. University of New Mexico, Albuquerque. Fals-Stewart, W., & Birchler, G. R. (2001). A national survey of the use of couples therapy in substance abuse treatment. Journal of Substance Abuse Treatment, 20, Forman, R. F., Bovasso, G., & Woody, G. (2001). Staff beliefs about addiction treatment. Journal of Substance Abuse Treatment, 21, 1 9. Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003). Why don t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. American Journal of Public Health, 93, Godley, S. H., White, W. L., Diamond, G., Passetti, L., & Titus, J. C. (2001). Therapist reactions to manual-guided therapies for the treatment of adolescent marijuana users. Clinical Psychology: Science and Practice, 8, Goldfried, M. R., & Eubanks-Carter, C. (2004). On the need for a new psychotherapy research paradigm: Comment on Westen, Novotny, and Thompson-Brenner. Psychological Bulletin, 130, Grimshaw, J. M., & Eccles, M. P. (2004). Is evidence-based implementation of evidence-based care possible? Medical Journal of Australia, 180 (Suppl), Guydish, J. (2003). Introduction: Dissemination from practice to research. In J. L. Sorensen, R. A. Rawson, J. Guydish, & J. E. Zweben (Eds.), Drug abuse treatment through collaboration: Practice and research partnerships that work (pp ). Washington, DC7 American Psychological Association. Haaga, D. A. (2004). A healthy dose of criticism for randomized trials: Comment on Westen, Novotny, and Thompson-Brenner. Psychological Bulletin, 130, Haines, A., & Jones, R. (1994). Implementing findings of research. British Medical Journal, 308, Hall, G. C. (2001). Psychotherapy research with ethnic minorities: Empirical, ethical and conceptual issues. Journal of Consulting and Clinical Psychology, 69, Hayes, S. C., Bissett, R., Roget, N., Padilla, M., Kohlenberg, B. S., Fisher, G., et al. (2004). The impact of acceptance and commitment training and multicultural training on the stigmatizing attitudes and professional burnout of substance abuse counselors. Behavior Therapy, 35, Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (1999). Acceptance and commitment therapy: An experiential approach to behavior change. New York7 Guilford Press. Haynes, B., & Haines, A. (1998). Barriers and bridges to evidence based clinical practice. British Medical Journal, 317, Henggeler, S. W., Melton, G. B., Brondino, M. J., & Scherer, D. G. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, Henry, W. P., Strupp, H. H., Butler, S. F., Schacht, T. E., & Binder, J. L. (1993). Effects of training in time-limited dynamic psychotherapy: Changes in therapist behavior. Journal of Consulting and Clinical Psychology, 61, Herschell, A. D., McNeil, C. B., & McNeil, D. W. (2004). Clinical child psychology s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11, Hollis, J. F., Lichtenstein, E., Vogt, T., Stevens, V. J., & Biglan, A. (1993). Nurse-assisted counseling for smokers in primary care. Annals of Internal Medicine, 118, Hollis, J. F., Vogt, T., Stevens, V., Biglan, A., Severson, H., & Lichtenstein, E. (1994). The Tobacco Reduction and Cancer Control (TRACC) program: Team approaches to counseling in medical and dental settings. In D. M. Burns, S. J. Cohen, T. E. Kottke, & E. R. Gritz (Eds.), Tobacco and the clinician: Intervention for medical and dental practice (pp ). Bethesda, MD7 National Cancer Institute. Jellinek, E. M. (1960). The disease concept of alcoholism. Highland Park, NJ7 Hillhouse Press. Kadden, R., Carroll, K., Donovan, D., Cooney, N., Monti, P., Abrams, D., et al. (1992). Cognitive behavioral coping skills therapy manual, vol. 3. Rockville, MD7 National Institute on Alcohol Abuse and Alcoholism. Kalb, M., & Propper, M. S. (1976). The future of alcohology: Craft or science? American Journal of Psychiatry, 133, Kelly, J. A., Somlai, A. M., DiFranceisco, W. J., Otto-Salaj, L. L., McAuliffe, T. L., Hacki, K. L., et al. (2000). Bridging the gap between the science and service of HIV prevention: Transferring effective research-based HIV prevention interventions to community AIDS service providers. American Journal of Public Health, 90, Knudsen, H. K., Johnson, J. A., & Roman, P. M. (2003). Retaining counseling staff at substance abuse treatment centers: Effects of management practices. Journal of Substance Abuse Treatment, 24, Knudsen, H. K., Johnson, J. A., Roman, P. M., & Oser, C. B. (2003). Rural and urban similarities and differences in private substance abuse treatment centers. Journal of Psychoactive Drugs, 35, Knudsen, H. K., & Roman, P. M. (2004). Modeling the use of innovations in private treatment organizations: The role of absorptive capacity. Journal of Substance Abuse Treatment, 26, Knudsen, H. K., Roman, P. M., & Ducharme, L. J. (2004). The availability of psychiatric programs in private substance abuse treatment centers, 1995 to Psychiatric Services, 55, Lamb, S., Greenlick, M. R., & McCarty, D. (Eds.). (1998). Bridging the gap between practice and research: Forging partnerships with community-based drug and alcohol treatment. Washington, DC7 National Academy Press. Lehman, W. E., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22, Levant, R. F. (2004). The empirically validated treatments movement: A practitioner s perspective. Clinical Psychology: Science and Practice, 11, Levin, F. R., Owen, P., Stinchfield, R., Rabinowitz, E., & Pace, N. (1999). Use of standardized patients to evaluate the physicians in residence program: A substance abuse training approach. Journal of Addictive Diseases, 18, Levinson, D., Schaefer, J. M., Sylvester, R., Meland, J. A., & Haugen, B. (1982). Information dissemination and overload in the alcoholism treatment field. Journal of Studies on Alcohol, 43, Lichtenstein, E., Hollis, J. F., Severson, H. H., Stevens, V. J., Vogt, T. M., Glasgow, R. E., et al. (1996). Tobacco cessation interventions in health care settings: Rationale, model, outcomes. Addictive Behaviors, 21, Lindsay, E. A., Ockene, J. K., Berger, L., Hymowitz, N., Pomrehn, P., & WIlson, D. M. (1994). Physicians and dentists roles in COMMIT The Community Intervention Trial for Smoking Cessation. In D. M. Burns, S. J. Cohen, T. E. Kottke, & E. R. Gritz (Eds.), Tobacco and the clinician: Intervention for medical and dental practice (pp ). Bethesda, MD7 National Cancer Institute. Lockyer, J., el-guebaly, N., Simpson, E., Gromoff, B., Toews, J., & Juschka, B. (1996). Standardized patients as a measure of change in the ability of family physicians to detect and manage alcohol abuse. Academic Medicine, 71, Ma, J., Stafford, R. S., Cockburn, I. M., & Finkelstein, S. N. (2003). A statistical analysis of the magnitude and composition of drug promotion in the United States in Clinical Therapeutics, 25,

14 38 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) Madson, M.B., Campbell, T. C., Barrett, D. E., Brondino, M. J., & Melchert, T. P. (2005). Development of the Motivational Interviewing Supervision and Training Scale. Psychology of Addictive Behaviors, 19, Marinelli-Casey, P., Domier, C. P., & Rawson, R. A. (2002). The gap between research and practice in substance abuse treatment. Psychiatric Services, 53, Martin, G. W., Herie, M. A., Turner, B. J., & Cunningham, J. A. (1998). A social marketing model for disseminating research-based treatments to addictions treatment providers. Addiction, 93, Mattson, M. E., & Donovan, D. M. (1994). Clinical applications: The transition from research to practice. Journal of Studies on Alcohol, (Suppl. 12), McCarty, D. (2003). Alcohol and drug abuse demonstrations: Developing and testing community interventions. In J. L. Sorensen, R. A. Rawson, J. Guydish, & J. E. Zweben (Eds.), Drug abuse treatment through collaboration: Practice and research partnerships that work (pp ). Washington, DC7 American Psychological Association. McCarty, D., Rieckmann, T., Green, C., Gallon, S., & Knudsen, J. (2004). Training rural practitioners to use buprenorphine: Using the Change Book to facilitate technology transfer. Journal of Substance Abuse Treatment, 26, McCrady, B. S. (2000). Alcohol use disorders and the Division 12 Task Force of the American Psychological Association. Psychology of Addictive Behaviors, 14, McDowell, J. (2004). Buprenorphine update: Mentoring program supports physicians treating opioid addiction. Substance Abuse and Mental Health Service Administration News, 12, McGovern, M. P., Fox, T. S., Xie, H., & Drake, R. E. (2004). A survey of clinical practices and readiness to adopt evidence-based practices: Dissemination research in an addiction treatment system. Journal of Substance Abuse Treatment, 26, McLellan, A. T., Carise, D., & Kleber, H. D. (2003). Can the national addiction treatment infrastructure support the public s demand for quality care? Journal of Substance Abuse Treatment, 25, McLellan, A. T., & Meyers, K. (2004). Contemporary addiction treatment: A review of systems problems for adults and adolescents. Biological Psychiatry, 56, Miller, W. R. (1986). Haunted by the zeitgeist: Reflections on contrasting treatment goals and concepts of alcoholism in Europe and the United States. Annals of the New York Academy of Sciences, 472, Miller, W. R. (1987a). Behavioral alcohol treatment research advances Barriers to utilization. Advances in Behaviour Research and Therapy, 9, Miller, W. R. (1987b). Behavioral treatment research advances: Barriers to utilization. Advances in Behaviour Research and Therapy, 9, Miller, W. R., Benefield, R. G., & Tonigan, J. S. (1993). Enhancing motivation for change in problem drinking: A controlled comparison of two therapist styles. Journal of Consulting and Clinical Psychology, 61, Miller, W. R., & Brown, S. A. (1997). Why psychologists should treat alcohol and drug problems. American Psychologist, 52, Miller, W. R., Hedrick, K. E., & Orlofsky, D. (1991). The Helpful Responses Questionnaire: A procedure for measuring therapeutic empathy. Journal of Clinical Psychology, 47, Miller, W. R., & Meyers, R. J. (1995). Beyond generic criteria: Reflections on life after clinical science wins. Clinical Science, (Spring), 4 6. Miller, W. R., & Mount, K. A. (2005). A small study of training in motivational interviewing: Does one workshop change clinician and client behavior? Behavioural and Cognitive Psychotherapy, 29, Miller, W. R., Moyers, T. B., Arciniega, L. T., Ernst, D., & Forcehimes, A. (2005). Training, supervision and quality monitoring of the COMBINE study behavioral interventions. Journal of Studies on Alcohol, Suppl 15, Miller, W. R., & Wilbourne, P. L. (2002). Mesa Grande: A methodological analysis of clinical trials of treatments for alcohol use disorders. Addiction, 97, Miller, W. R., Wilbourne, P. L., & Hettema, J. (2003). What works? A summary of alcohol treatment outcome research. In R. K. Hester, & W. R. Miller (Eds.), Handbook of alcoholism treatment approaches: Effective alternatives, (3rd ed.). (pp ). Boston, MA7 Allyn & Bacon. Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72, Miller, W. R., Zweben, A., DiClemente, C. C., & Rychtarik, R. C. (2005). Motivational Enhancement Therapy manual: A clinical research guide for therapists treating individuals with alcohol abuse and dependence (Vol. Project MATCH Monograph Series, Vol. 2). Rockville, MD7 National Institute on Alcohol Abuse and Alcoholism. Miller, W. R., Zweben, J. E., & Johnson, W. (2005). Evidence-based treatment: Why, what, where, when, and how? Journal of Substance Abuse Treatment, 29, Morgenstern, J. (2000). Effective technology transfer in alcoholism treatment. Substance Use & Misuse, 35, Morgenstern, J., Morgan, T. J., McCrady, B. S., Keller, D. S., & Carroll, K. M. (2001). Manual-guided cognitive behavioral therapy training: A promising method for disseminating empirically supported substance abuse treatments to the practice community. Psychology of Addictive Behaviors, 15, Moyers, T. B., Martin, T., Catley, D., Harris, K. J., & Ahluwalia, J. S. (2003). Assessing the integrity of motivational interventions: Reliability of the Motivational Interviewing Skills Code. Behavioural and Cognitive Psychotherapy, 31, Moyers, T. B., & Miller, W. R. (2005). Therapists conceptualizations of alcoholism: Measurement and implications for treatment. Psychology of Addictive Behavior, 7, Moyers, T. B., Miller, W. R., & Hendrickson, S. M. L. (2005). What makes motivational interviewing work? Therapist interpersonal skill as a predictor of client involvement within motivational interviewing sessions. Journal of Consulting and Clinical Psychology, 73, Najavits, L. M., & Weiss, R. D. (1994). Variations in therapist effectiveness in the treatment of patients with substance use disorders: An empirical review. Addiction, 89, National Institute on Drug Abuse. (1991). Drug abuse technology transfer (DHHS Publication No. (ADM) ). Rockville, MD7 National Institute on Drug Abuse. National Institute on Drug Abuse. (1999). Principles of drug addiction treatment: A research based guide (NIH Publication No ). Bethesda, MD7 National Institute on Drug Abuse. Norcross, J. C. (2004). Empirically supported treatments (ESTs): Context, consensus, and controversy. Register Report, 30 (Spring), 2 4. Nowinski, J. (2003). Self-help groups. In J. L. Sorensen, R. A. Rawson, J. Guydish, & J. E. Zweben (Eds.), Drug abuse treatment through collaboration: Practice and research partnerships that work (pp ). Washington, DC7 American Psychological Association. Nowinski, J., Baker, S., & Carroll, K. M. (1992). Twelve step facilitation therapy manual: A clinical research guide for therapists treating individuals with alcohol abuse and dependence. Rockville, MD7 National Institute on Alcohol Abuse and Alcoholism. Ockene, J. K., Quirk, M. E., Goldberg, R. J., Kristeller, J. L., Donnelly, G., Kalan, K. L., et al. (1988). A residents training program for the development of smoking intervention skills. Archives of Internal Medicine, 148, Ockene, J. K., Wheeler, E. V., Adams, A., Hurley, T. G., & Hebert, J. (1997). Provider training for a patient-centered alcohol counseling in a primary care setting. Archives of Internal Medicine, 157, Onken, L. S., Blaine, J. D., & Battjes, R. J. (1997). Behavioral therapy research: A conceptualization of a process. In S. W. Henggeler, & A. B. Santos (Eds.), Innovative approaches for difficult-to-treat populations (pp ). Washington, DC7 American Psychiatric Press. Oregon Department of Human Services. (2005, June). Implementation of evidence-based practices (EBP) in Oregon. Retrieved August 30, 2005, from Oregon Department of Human Services, Office of Mental

15 W.R. Miller et al. / Journal of Substance Abuse Treatment 31 (2006) Health and Addiction Services Web site: mentalhealth/ebp/main.shtml. Oxman, A. D., Thomson, M. A., Davis, D. A., & Haynes, R. B. (1995). No magic bullets: A systematic review of 102 trials of interventions to improve professional practice. Canadian Medical Association Journal, 153, Patterson, G. R., & Forgatch, M. S. (1985). Therapist behavior as a determinant for client noncompliance: A paradox for the behavior modifier. Journal of Consulting and Clinical Psychology, 53, Persons, J. B. (1997). Dissemination of effective methods: Behavior therapy s next challenge. Behavior Therapy, 28, Prochaska, J. O., & DiClemente, C. C. (1984). The transtheoretical approach: Crossing traditional boundaries of therapy. Homewood, IL7 Dow/Jones Irwin. Rogers, E. M. (1995). Diffusion of drug abuse prevention programs: Spontaneous diffusion, agenda setting, and reinvention. In T. E. Backer, S. L. David, & G. Soucy (Eds.), Reviewing the behavioral science knowledge base on technology transfer, vol (pp ). Rockville, MD7 National Institute on Drug Abuse. Rogers, E. M. (2002). Diffusion of preventive innovations. Addictive Behaviors, 27, Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York7 Free Press. Rollnick, S., Kinnersley, P., & Butler, C. (2002). Context-bound communication skills training: Development of a new method. Medical Education, 36, Roman, P. M., & Johnson, J. A. (2002). Adoption and implementation of new technologies in substance abuse treatment. Journal of Substance Abuse Treatment, 22, Rosen, E. (2000). The anatomy of buzz: How to create word-of-mouth marketing. New York7 Doubleday. Rounsaville, B. J., Chevron, E. S., Weissman, M. M., Prusoff, B. A., & Frank, E. (1986). Training therapists to perform interpersonal psychotherapy in clinical trials. Comprehensive Psychiatry, 27, Rubel, E. C., Sobell, L. C., & Miller, W. R. (2000). Do continuing education workshops improve participants skills? Effects of a motivational interviewing workshop on substance abuse counselors skills and knowledge. The Behavior Therapist, 23, 73 77, 90. Schuster, M., McGlynn, E., & Brook, R. H. (1998). How good is the quality of health care in the United States? Milbank Quarterly, 76, Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, Selzer, J., & Shine, B. (2004). Experts support CTN dissemination strategies. NIDA Notes, 19, 13. Shanley, C., Lodge, M., & Mattick, R. P. (1996). Dissemination of research findings to alcohol and other drug practitioners. Drug and Alcohol Review, 15, Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005). We don t train in vain: A dissemination trial of three strategies of training clinicians in cognitive behavioral therapy. Journal of Consulting and Clinical Psychology, 73, Silverman, W. K., & Kurtines, W. M. (2004). Research progress on effectiveness, transportability, and dissemination of empirically supported treatments: Integrating theory and research. Clinical Psychology: Science and Practice, 11, Simpson, D. D. (2002). A conceptual framework for transferring research into practice. Journal of Substance Abuse Treatment, 22, Sobell, L. C. (1996). Bridging the gap between scientists and practitioners: The challenge before us. Behavior Therapy, 27, Sorensen, J. L., Hall, S. M., Loeb, P., & Allen, T. (1988). Dissemination of a job seekers workshop to drug treatment programs. Behavior Therapy, 19, Sorensen, J. L., Lin, C. Y., & Sera, R. E. (2004). Technology transfer in drug abuse treatment: Annotated bibliography (2nd ed.). San Francisco, CA7 University of California, San Francisco. Available at ctndisseminationlibrary.org/pdf/2004_sorensen_01.pdf. Sorensen, J. L., & Midkiff, E. E. (2002). Bridging the gap between research and drug abuse treatment. Journal of Psychoactive Drugs, 32, Soumerai, S. (1998). Principles of academic detailing to improve the management of psychiatric disorders. International Journal of Psychiatry in Medicine, 28, Soumerai, S., & Avorn, J. (1990). Principles of educational outreach (bacademic detailingq) to improve clinical decision making. Journal of the American Medical Association, 263, Stirman, S. W., Crits-Christoph, P., & DeRubeis, R. J. (2004). Achieving successful dissemination of empirically supported psychotherapies: A synthesis of dissemination theory. Clinical Psychology: Science and Practice, 11, Strosahl, K. D., Hayes, S. C., Bergan, J., & Romano, P. (1998). Assessing the field effectiveness of acceptance and commitment therapy: An example of the manipulated training research method. Behavior Therapy, 29, Szapocznik, J., Hervis, O., & Schwartz, S. (2003). Brief strategic family therapy for adolescent drug abuse. Bethesda, MD7 National Institute on Drug Abuse. Taxman, F. S., & Bouffard, J. A. (2003). Substance abuse counselors treatment philosophy and the content of treatment services provided to offenders in drug court programs. Journal of Substance Abuse Treatment, 25, Thomas, C. P., Wallack, S. S., Lee, S., McCarty, D., & Swift, R. (2003). Research to practice: Adoption of naltrexone in alcoholism treatment. Journal of Substance Abuse Treatment, 24, Truax, C. B., & Carkhuff, R. R. (1967). Toward effective counseling and psychotherapy. Chicago7 Aldine. VandeCreek, L., & Brace, K. (1991). Mandatory continuing education in the health professions. Journal of Training and Practice in Professional Psychology, 5, Weingardt, K. R. (2004). The role of instructional design and technology in the dissemination of empirically supported, manual-based therapies. Clinical Psychology: Science and Practice, 11, Westen, D., Novotny, C. M., & Thompson-Brenner, H. (2004). The empirical status of empirically supported psychotherapies: Assumptions, findings, and reporting in controlled clinical trials. Psychological Bulletin, 130, White, W. L. (1998). Slaying the dragon: The history of addiction treatment and recovery in America. Bloomington, IL7 Lighthouse Training Institute. Whitten, L. (2005). CTN update: Blending initiative introduces two new training programs. NIDA Notes, 20, 13. Woody, G. E., & McNicholas, L. (2004). Putting addiction treatment medications to use: Lessons learned. In H. J. Harwood, & T. G. Myers (Eds.), New treatments for addiction: Behavioral, ethical, legal, and social questions (pp ). Washington, DC7 National Academies Press.

Brief Interventions and Brief Therapies for Substance Abuse Treatment Improvement Protocol (TIP) Series 34

Brief Interventions and Brief Therapies for Substance Abuse Treatment Improvement Protocol (TIP) Series 34 Brief Interventions and Brief Therapies for Substance Abuse Treatment Improvement Protocol (TIP) Series 34 Table of Contents Kristen Lawton Barry, Ph.D. Consensus Panel Chair U.S. DEPARTMENT OF HEALTH

More information

The Matrix Model of Intensive Outpatient Treatment

The Matrix Model of Intensive Outpatient Treatment The Matrix Model of Intensive Outpatient Treatment A guideline developed for the Behavioral Health Recovery Management project Richard A. Rawson UCLA Integrated Substance Abuse Programs Los Angeles, California

More information

Treatment Improvement Protocol (TIP) Series

Treatment Improvement Protocol (TIP) Series Substance Abuse and Mental Health Services Administration Center for Substance Abuse Treatment Enhancing Motivation For Change in Substance Abuse Treatment Treatment Improvement Protocol (TIP) Series 35

More information

Spreading Good Ideas for Better Health Care. 2000 Research Series. A Practical Toolkit. Volume 2 by Paul Plsek TOOLS, PERSPECTIVES AND INFORMATION FOR

Spreading Good Ideas for Better Health Care. 2000 Research Series. A Practical Toolkit. Volume 2 by Paul Plsek TOOLS, PERSPECTIVES AND INFORMATION FOR MARKET POSITION 2000 Research Series Spreading Good Ideas for Better Health Care A Practical Toolkit Volume 2 by Paul Plsek TOOLS, PERSPECTIVES AND INFORMATION FOR HEALTH CARE LEADERS Acknowledgements

More information

Clinical Decision Support Systems: State of the Art

Clinical Decision Support Systems: State of the Art Clinical Decision Support Systems: State of the Art Prepared for: Agency for Healthcare Research and Quality U.S. Department of Health and Human Services 540 Gaither Road Rockville, MD 20850 www.ahrq.gov

More information

N ATIONAL Q UALITY F ORUM. Evidence-Based Treatment Practices for Substance Use Disorders WORKSHOP PROCEEDINGS

N ATIONAL Q UALITY F ORUM. Evidence-Based Treatment Practices for Substance Use Disorders WORKSHOP PROCEEDINGS N ATIONAL Q UALITY F ORUM Evidence-Based Treatment Practices for Substance Use Disorders WORKSHOP PROCEEDINGS NQF N ATIONAL Q UALITY F ORUM Evidence-Based Treatment Practices for Substance Use Disorders

More information


TWELVE STEP FACILITATION THERAPY MANUAL National Institute on Alcohol Abuse and Alcoholism Project MATCH Monograph Series Volume 1 TWELVE STEP FACILITATION THERAPY MANUAL A Clinical Research Guide for Therapists Treating Individuals With Alcohol

More information

RESEARCH Reviewing the Behavioral Science Knowledge Base on Technology Transfer

RESEARCH Reviewing the Behavioral Science Knowledge Base on Technology Transfer National Institute on Drug Abuse RESEARCH MONOGRAPH SERIES Reviewing the Behavioral Science Knowledge Base on Technology Transfer 155 U.S. Department of Health and Human Services Public Health Service

More information

Motivation and Confidence:

Motivation and Confidence: Motivation and Confidence: what does it take to change behaviour? Anna Dixon Kicking Bad Habits: How can the NHS help us become healthier? Individual responsibility for health and self-care are key themes

More information

The Effectiveness of Drug and Alcohol Treatment: A Review of the Research Literature. David M. Stein, Ph.D.

The Effectiveness of Drug and Alcohol Treatment: A Review of the Research Literature. David M. Stein, Ph.D. The Effectiveness of Drug and Alcohol Treatment: A Review of the Research Literature David M. Stein, Ph.D. 2 Table of Contents What are Typical Outcomes for Persons Receiving Minimal or No Treatment for

More information

Building Your Program

Building Your Program Building Your Program Integrated Treatment for Co-Occurring Disorders U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES Substance Abuse and Mental Health Services Administration Center for Mental Health Services

More information

Take Action. Focus On Prevention

Take Action. Focus On Prevention Make A Difference Take Action Reach Out Red Ribbon Your Community Focus On Prevention U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES Substance Abuse and Mental Health Services Administration www.samhsa.gov

More information

Reconsidering the evaluation of addiction treatment: from retrospective follow-up to concurrent recovery monitoring

Reconsidering the evaluation of addiction treatment: from retrospective follow-up to concurrent recovery monitoring HORIZONS REVIEW Blackwell Science, LtdOxford, UKADDAddiction0965-2140 2005 Society for the Study of Addiction 100 Review Article Reconsidering the evaluation of addiction treatment A. Thomas McLellan et

More information

Drug Abuse Treatment Evaluation: Strategies, Progress, and Prospects

Drug Abuse Treatment Evaluation: Strategies, Progress, and Prospects RESEARCH ANALYSIS and UTILIZATION SYSTEM Drug Abuse Treatment Evaluation: Strategies, Progress, and Prospects U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES Public Health Service Alcohol, Drug Abuse and

More information

Evaluating Professional Development: A Framework for Adult Education

Evaluating Professional Development: A Framework for Adult Education Evaluating Professional Development: A Framework for Adult Education A Publication of Building Professional Development Partnerships for Adult Educators Project PRO-NET May 1997 Mark Kutner Renee Sherman

More information

STRENGTHENING NONPROFITS: A Capacity Builder s Resource Library. Measuring Outcomes

STRENGTHENING NONPROFITS: A Capacity Builder s Resource Library. Measuring Outcomes STRENGTHENING NONPROFITS: A Capacity Builder s Resource Library Measuring Outcomes TABLE OF CONTENTS INTRODUCTION... 4 OVERVIEW... 5 Why Measure Outcomes?... 5 What is Outcome Measurement?... 5 Some Words

More information

Evidence-Based I O Psychology: Not There Yet

Evidence-Based I O Psychology: Not There Yet Industrial and Organizational Psychology, 4 (2011), 3 22. Copyright 2011 Society for Industrial and Organizational Psychology. 1754-9426/11 FOCAL ARTICLE Evidence-Based I O Psychology: Not There Yet ROB

More information

Residential Substance Abuse Treatment for State Prisoners

Residential Substance Abuse Treatment for State Prisoners APR. 03 U.S. Department of Justice Office of Justice Programs National Institute of Justice Special REPORT Residential Substance Abuse Treatment for State Prisoners WEB-ONLY DOCUMENT Implementation Lessons

More information

Developmentally Appropriate Practice in Early Childhood Programs Serving Children from Birth through Age 8

Developmentally Appropriate Practice in Early Childhood Programs Serving Children from Birth through Age 8 Position Statement Developmentally Appropriate Practice in Early Childhood Programs Serving Children from Birth through Age 8 Adopted 2009 A position statement of the National Asssociation for the Education

More information

Applied research organizations invest a

Applied research organizations invest a How Can Research Organizations More Effectively Transfer Research Knowledge to Decision Makers? JOHN N. LAVIS, DAVE ROBERTSON, JENNIFER M. WOODSIDE, CHRISTOPHER B. McLEOD, JULIA ABELSON, and the Knowledge

More information

First Edition. Design & Refine. Developing effective interventions for children and young people. The Social Research Unit at Dartington

First Edition. Design & Refine. Developing effective interventions for children and young people. The Social Research Unit at Dartington First Edition Design & Refine Developing effective interventions for children and young people The Social Research Unit at Dartington Table of Contents Acknowledgements 1 Introduction 2 1 The what works

More information



More information

Conceptual Synthesis 1: Learning from the Diffusion of Innovations

Conceptual Synthesis 1: Learning from the Diffusion of Innovations ESRC UK Centre for Evidence Based Policy and Practice: Working Paper 10 Conceptual Synthesis 1: Learning from the Diffusion of Innovations Sandra Nutley Huw Davies Isabel Walter Research Unit for Research

More information

Research Review. Evidence-Based Programs and Practices: What Does It All Mean?

Research Review. Evidence-Based Programs and Practices: What Does It All Mean? Research Review Evidence-Based Programs and Practices: What Does It All Mean? Children s Services Council s Mission and Vision and Evidence-Based Programs In order for CSC to truly achieve its mission

More information

Iapt banner to go here. Good practice guidance on the use of self-help materials within IAPT services

Iapt banner to go here. Good practice guidance on the use of self-help materials within IAPT services Iapt banner to go here Good practice guidance on the use of self-help materials within IAPT services March 2010 Foreword This guide was produced following an Improving Access to Psychological Therapies

More information

What makes great teaching?

What makes great teaching? What makes great teaching? Review of the underpinning research Robert Coe, Cesare Aloisi, Steve Higgins and Lee Elliot Major October 2014 Executive Summary A framework for professional learning This review

More information


DISTRICT READINESS TO SUPPORT SCHOOL TURNAROUND 1 DISTRICT READINESS TO SUPPORT SCHOOL TURNAROUND A Users Guide to Inform the Work of State Education Agencies and Districts Daniel Player Dallas Hambrick Hitt William Robinson University of Virginia Partnership

More information

Making Smart IT Choices

Making Smart IT Choices Making Smart IT Choices Understanding Value and Risk in Government IT Investments Sharon S. Dawes Theresa A. Pardo Stephanie Simon Anthony M. Cresswell Mark F. LaVigne David F. Andersen Peter A. Bloniarz

More information

A Primer on the Psychiatric Rehabilitation Process

A Primer on the Psychiatric Rehabilitation Process A Primer on the Psychiatric Rehabilitation Process William A. Anthony and Marianne D. Farkas Boston University Center for Psychiatric Rehabilitation 2009, Center for Psychiatric Rehabilitation, Trustees

More information

Outcomes with the ARISE Approach to Engaging Reluctant Drug- and Alcohol-Dependent Individuals in Treatment #,y

Outcomes with the ARISE Approach to Engaging Reluctant Drug- and Alcohol-Dependent Individuals in Treatment #,y THE AMERICAN JOURNAL OF DRUG AND ALCOHOL ABUSE Vol. 30, No. 4, pp. 711 748, 2004 Outcomes with the ARISE Approach to Engaging Reluctant Drug- and Alcohol-Dependent Individuals in Treatment #,y Judith Landau,

More information