Psychiatric and substance use disorders co-occur frequently

Article Diagnosis of Comorbid Psychiatric Disorders in Substance Users Assessed With the Psychiatric Research for Substance and Mental Disorders for DSM-IV Deborah Hasin, Ph.D. Sharon Samet, M.S.W. Edward Nunes, M.D. Jakob Meydan, Psy.D. Karen Matseoane, B.A. Rachel Waxman, B.A. Objective: The authors used the Psychiatric Research for Substance and Mental Disorders for DSM-IV (PRISM- IV) to test the reliability of DSM-IV-defined disorders, including primary and substance-induced disorders, in substanceabusing subjects. Method: Substance-abusing patients (N= 285) from substance abuse/dual-diagnosis treatment settings and mental health treatment settings participated in test and blind retest interviews with the PRISM-IV, which includes specific guidelines for assessment of substance abusers. Results: Kappas for primary and substance-induced major depressive disorder ranged from 0.66 to 0.75. Reliability for psychotic disorders, eating disorders, antisocial personality disorder, and borderline personality disorder was in the same range. Reliability for most anxiety disorders was lower. Reliability was good to excellent (kappas 0.65) for most substance dependence disorders. Continuous measures (severity, age at onset) had intraclass correlation coefficients >0.70 with few exceptions. Reliability was better for primary than for substance-induced disorders, although not greatly so. Conclusion: Most DSM-IV psychiatric disorders can be assessed in substance-abusing subjects with acceptable to excellent reliability by using specifically designed procedures. Good reliability improves the likelihood of significant study results. (Am J Psychiatry 2006; 163:689 696) Psychiatric and substance use disorders co-occur frequently in the clinical (1) and general population (2 4). Understanding the relationship between substance use disorders and psychiatric disorders is necessary to clarify the etiology of the disorders and to improve treatment, but diagnostic issues have hindered this process. The diagnosis of psychiatric disorders among substance abusers is complicated by the resemblance of intoxication and withdrawal effects to the symptoms of psychiatric disorders. The challenge has been to design measures to differentiate three conditions: 1) expected intoxication and withdrawal symptoms, 2) psychiatric disorders occurring during periods of active substance use, and 3) psychiatric disorders that are clearly independent from substance use because they are temporally distinct from periods of substance use. Before publication of DSM-IV, specific criteria for making these differentiations in substance abusers did not exist, resulting in reliability (5 8) and validity (9 12) problems and low levels of agreement between study groups, even when the same measures were used (13). DSM-IV substantially clarified the guidelines for differentiating independent and substance-induced disorders. Among individuals with histories of substance use disorders, primary (independent) DSM-IV psychiatric disorders are diagnosed if the full psychiatric syndrome is established before substance use or if it occurs or persists more than 4 weeks after the cessation of acute intoxication or withdrawal. A psychiatric episode occurring when substance use was insufficient to produce persistent intoxication or withdrawal would be diagnosed as primary (independent) according to DSM-IV. In contrast, substanceinduced psychiatric disorders are defined as those that occur during periods of heavy substance use (or remitting shortly thereafter) and that have symptoms that exceed the expected effects of intoxication or withdrawal listed in DSM-IV. DSM-IV was published in 1994. To our knowledge, no study has yet addressed the reliability of the DSM-IV system of differentiating between intoxication/ withdrawal symptoms, disorders whose symptoms exceed intoxication/withdrawal effects, and psychiatric disorders that are temporally independent from periods of substance use. To provide a diagnostic instrument that was reliable and valid for assessment of psychiatric disorders in substance abusers, the Psychiatric Research for Substance and Mental Disorders (PRISM) (14) was developed. The pre-dsm-iv PRISM included standardized guidelines and probes to differentiate organic and nonorganic syndromes and was administered by experienced clinical interviewers. A test-retest reliability study (14) involving 172 dual-diagnosis or substance abuse patients showed good to excellent reliability for many diagnoses, including sub- Am J Psychiatry 163:4, April 2006 ajp.psychiatryonline.org 689

COMORBID PSYCHIATRIC DISORDERS IN SUBSTANCE USERS stance use disorders, primary affective disorders, eating disorders, some anxiety disorders, and psychotic symptoms (analogous to the Structured Clinical for DSM-IV-TR Non-Patient [SCID-IV-TR-NP] category). Publication of DSM-IV and investigator feedback indicated the need to incorporate the new DSM-IV criteria (including the criteria for substance-induced disorders), to shorten and simplify the interview, and to add assessment of specific psychotic disorders. This led to development of the PRISM-IV (unpublished 2003 manuscript of Hasin et al.). The development process integrated refinement and editing of probes and structure with piloting and small test-retest studies among substance abuse patients. The results of this process were then subjected to a new, larger test-retest reliability study, reported here. Method Procedures Subjects were recruited from New York City treatment facilities. All subjects were engaged in ongoing outpatient treatment or were inpatients hospitalized for as long as 1 month before study participation. Clinic staff screened patients for eligibility and referred eligible patients to a research coordinator who explained the study and obtained written informed consent. Eligibility criteria included age 18 65 years; use of alcohol, heroin, or cocaine in the prior 30 days (or 30 days prior to hospitalization, among inpatients); and sufficiently stable medical and psychiatric status to participate, including resolution of any acute withdrawal symptoms. The retest interviewer was blind to the results of the first interview. Mean time between interviews was 5.2 days (SD=5.1, range=0 36); 95% of retests occurred within 14 days. Subject fees were $35 $50 per interview, depending on the site. The Institutional Review Board of New York State Psychiatric Institute approved all procedures. Subjects Of 342 eligible patients, 285 (83.33%) completed a test and a retest interview. Of these 285 patients, 54.04% (N=154) were male. About half (51.93%, N=148) were white, 31.58% (N=90) were African American, 12.28% (N=35) were Hispanic, and 2.21% (N=6) were of other ethnicities. The subjects mean age was 36.28 years (SD=8.77), almost one-half (47.02%, N=134) were unemployed, 74.74% (N=213) had at least 12 years of education, and 13.70% (N=39) were married or cohabiting. Treatment settings included outpatient substance abuse/dual-diagnosis (43.2%, N=123), outpatient mental health (35.4%, N=101), and inpatient rehabilitation or dual-diagnosis (21.4%, N=61) settings. When we compared the subjects who completed only one interview (N=17) to those who completed both interviews (N=285), no significant differences were found for age, race, gender, employment, marital status, education, or a lifetime diagnosis of substance abuse/dependence or major depressive disorder (primary or substance-induced). No information was available for those who did not participate in at least one interview, but the good response rate (83%) precluded substantial bias. Measure The PRISM-IV is a semistructured interview. Initial PRISM-IV probes are structured and asked as written; follow-up probes are also provided to ascertain more information. Unlike fully structured interviews where rereading the written probe is the only authorized clarification, the PRISM-IV also allows some unstructured interviewer follow-up probing. ers are trained to use the follow-up probes provided or to add their own probes when necessary, using guidelines in the interview. The PRISM-IV covers the following diagnoses for current and lifetime time frames: abuse and dependence (by substance), major depressive disorder, dysthymia, cyclothymia, mania, hypomania, schizophrenia, schizophreniform disorder, schizoaffective disorder, mood disorder with psychotic features, delusional disorder, brief psychotic disorder, psychotic disorder due to a medical condition, psychotic disorder not otherwise specified, specific phobia, social phobia, panic disorder, agoraphobia, generalized anxiety disorder, obsessive-compulsive disorder, posttraumatic stress disorder (PTSD), anorexia, bulimia, antisocial personality disorder, and borderline personality disorder. Psychiatric syndromes due to a medical condition are noted. Diagnostic modules can be selected to suit specific research needs. Substance use disorders that are unimportant to the research question can be omitted. The PRISM-IV also provides continuous measures, including age at onset of disorder, and severity measures based on symptom counts for some disorders, such as major depressive disorder and substance dependence. Onset of substance dependence is established on the basis of the time at which the subject first met the full criteria, i.e., experienced three or more symptoms within the same year. If onset occurred in the last 12 months, onset is identified as having occurred in the month when three or more symptoms first co-occurred. Onset of other psychiatric disorders is the age when the full criteria were initially met (e.g., onset of major depressive disorder is the age when the subject had five or more symptoms and impairment or distress). Each module begins with low-threshold screening questions and skip-outs. In the PRISM-IV, the sections on substance use precede other diagnostic sections so that the interviewer ascertains the substance use history before assessing primary and substance-induced psychiatric episodes. Periods of heavy use or chronic intoxication (4 or more days/week for a month, or binge use) and extended periods of abstinence are identified to assist later comorbidity assessment. All four abuse and seven dependence criteria are rated for each substance used to avoid underdiagnosing dependence (15). Primary disorders are diagnosed when symptoms persist at least 4 weeks in the absence of heavy substance use or when symptoms precede the onset of heavy use. For a PRISM-IV substance-induced diagnosis, 1) a primary episode must be ruled out and 2) the symptoms must exceed the expected effects of intoxication or withdrawal. The PRISM-IV provides guidelines that specify these DSM-IV intoxication and withdrawal effects. Because specific diagnostic criteria are necessary to obtain a reliable diagnosis (16), the PRISM-IV also addresses the lack of duration and threshold criteria for substance-induced disorders in DSM- IV by assigning substance-induced diagnoses only when an episode meets the duration and symptom requirements for a corresponding primary DSM-IV diagnoses. For example, substanceinduced major depressive disorder must have a duration of at least 2 weeks, and five of the nine depression symptoms, including depressed mood or anhedonia, must be present. Depression is common among substance abusers (17, 18), but diagnosing major depressive disorder in substance abusers has been problematic (19 21). Therefore, when primary major depressive disorder has been ruled out by the history, the PRISM-IV depression module addresses substance-induced major depressive disorder, giving special attention to depressive symptoms also listed as DSM-IV intoxication/withdrawal effects. To assess these symptoms, the subject s own substance-using, nondepressed experience is used as a reference period (commonly a period of substance use preceding the onset of depressed mood). Symptoms that do not change in presence or intensity between nondepressed and depressed periods of consistently heavy sub- 690 ajp.psychiatryonline.org Am J Psychiatry 163:4, April 2006

HASIN, SAMET, NUNES, ET AL. TABLE 1. Test-Retest Reliability of Diagnoses of Substance Dependence and Abuse Made With the Psychiatric Research for Substance and Mental Disorders for DSM-IV in 285 Substance-Abusing Patients Current Diagnosis Prevalence First Second Kappa SE Lifetime Diagnosis Prevalence First Second Diagnosis Kappa SE Dependence Alcohol 0.82 0.03 0.48 0.47 0.76 0.04 0.67 0.61 Cannabis 0.73 0.06 0.18 0.14 0.63 0.05 0.33 0.30 Cocaine 0.90 0.03 0.42 0.42 0.87 0.03 0.60 0.59 Hallucinogens 0.54 0.18 0.02 0.01 0.51 0.09 0.09 0.07 Heroin 0.94 0.03 0.20 0.20 0.96 0.02 0.30 0.31 Sedatives 0.74 0.08 0.07 0.06 0.76 0.09 0.13 0.14 Stimulants 0.66 0.66 0.07 0.06 0.51 0.08 0.10 0.08 Opiates 0.62 0.10 0.06 0.05 0.66 0.06 0.16 0.15 Abuse (DSM-IV) Alcohol 0.56 0.13 0.04 0.03 0.52 0.10 0.06 0.07 Cannabis 0.42 0.12 0.05 0.06 0.48 0.06 0.21 0.21 Cocaine 0.50 0.31 0.01 0.01 0.33 0.15 0.03 0.03 Hallucinogens 0.01 0.00 0.01 0.01 0.28 0.10 0.06 0.07 Heroin 0.33 0.25 0.01 0.01 Sedatives 0.42 0.17 0.03 0.02 0.36 0.12 0.06 0.04 Stimulants 0.20 0.13 0.04 0.02 Opiates 0.44 0.21 0.01 0.02 0.44 0.21 0.04 0.04 Abuse (with/without diagnosis of dependence) Alcohol 0.80 0.04 0.49 0.49 0.77 0.04 0.69 0.68 Cannabis 0.66 0.05 0.24 0.19 0.69 0.04 0.52 0.48 Cocaine 0.88 0.03 0.42 0.41 0.88 0.03 0.61 0.59 Hallucinogens 0.54 0.14 0.04 0.03 0.95 0.07 0.14 0.14 Heroin 0.90 0.03 0.20 0.19 0.95 0.02 0.31 0.32 Sedatives 0.72 0.08 0.09 0.07 0.73 0.06 0.18 0.14 Stimulants 0.39 0.28 0.01 0.01 0.60 0.08 0.12 0.09 Opiates 0.61 0.10 0.06 0.07 0.61 0.10 0.14 0.11 stance use (e.g., insomnia in a patient with alcoholism) are not counted as symptoms of substance-induced major depressive disorder. However, during periods of heavy substance use, symptoms that begin or substantially increase in intensity with the onset of depressed mood are counted toward a diagnosis of substance-induced major depressive disorder. Partial remission is available as a time-frame option for some PRISM-IV categories. Relative to current disorders, the PRISM-IV default for partial remission is to consider it as past, although this definition can be adjusted to the needs of individual studies. Specifically, patients with past alcohol/drug dependence and one or two current symptoms are considered to be in partial remission. A major depressive episode that persists at a subthreshold level (i.e., fewer than five symptoms) for at least 2 months is considered to be in partial remission. Patients with psychotic disorders who experienced an active phase are assessed for current residual symptoms. If functioning remains markedly below the functioning level prior to onset of psychosis or if the subject continues to be dependent on social services, the residual phase is coded as current. For mood disorder with psychotic features, (nonbizarre) delusional disorder, and brief psychotic episode, there is no distinction between active and residual symptoms. If any psychotic symptoms are present within the last 2 months, the disorder is considered current ; otherwise it is past. For anxiety and eating disorders, current is defined as within the last 2 months, and partial remission is not assessed. Antisocial personality disorder and borderline personality disorder are considered current if full criteria were ever met and any symptoms are present in the last 12 months. The diagnostic programs include three time frames: past, within the past 12 months, and within the past 2 months. ers and Supervision ers had master s degrees in psychology and at least 1 year of clinical experience. Training included reading the PRISM- IV training manual, didactic sessions and role playing, and observation of interviewers. Weekly staff meetings were held to discuss diagnostic questions and prevent interviewer drift. s were audiotaped if patients consented, and 81 randomly selected tapes were reviewed by a supervisor. Statistical Analysis Reliability for diagnoses was assessed with kappa (22). Reliability for continuous variables was assessed with the intraclass correlation coefficient (ICC) (22 24). Lifetime kappas represent reliability for diagnoses any time in the patient s lifetime, including last 12 months. Current kappas exclude cases in partial remission except where otherwise noted. Coefficients 0.75 indicate excellent reliability; 0.40 0.74, fair to good reliability; and 0.39, poor reliability (22). Low prevalence (<0.05) is sometimes but not always associated with poor reliability. Reliability for low-prevalence conditions is presented as qualitative information. Results Substance Use Disorders For most categories of DSM-IV substance dependence, reliability was good to excellent, including alcohol, cocaine, heroin, cannabis, and sedatives dependence (Table 1). For other, low-prevalence substance dependence disorders, kappas were fair. For substance abuse diagnosed as required in DSM-IV (i.e., excluded if dependence was Am J Psychiatry 163:4, April 2006 ajp.psychiatryonline.org 691

COMORBID PSYCHIATRIC DISORDERS IN SUBSTANCE USERS TABLE 2. Test-Retest Reliability of Assessments of Continuous Variables With the Psychiatric Research for Substance and Mental Disorders for DSM-IV in 285 Substance-Abusing Patients Variable Intraclass Correlation Coefficient 95% CI Age at onset of disorder Alcohol dependence 0.73 0.66 0.78 Cocaine dependence 0.72 0.65 0.77 Heroin dependence 0.72 0.63 0.80 Cannabis dependence 0.80 0.71 0.86 Hallucinogen dependence 0.80 0.55 0.92 Sedative dependence 0.87 0.76 0.93 Stimulant dependence 0.85 0.65 0.94 Opiate dependence 0.62 0.40 0.77 Major depressive disorder Primary 0.49 0.32 0.63 Substance-induced 0.51 0.27 0.69 Posttraumatic stress disorder 0.66 0.41 0.82 Antisocial personality disorder 0.24 0.00 0.46 Borderline personality disorder 0.28 0.00 0.52 Disorder severity a Alcohol dependence Last 12 months 0.86 0.83 0.88 Lifetime 0.83 0.80 0.86 Cocaine dependence Last 12 months 0.90 0.88 0.92 Lifetime 0.89 0.87 0.91 Heroin dependence Last 12 months 0.93 0.92 0.95 Lifetime 0.97 0.96 0.97 Cannabis dependence Last 12 months 0.76 0.72 0.80 Lifetime 0.72 0.55 0.76 Hallucinogen dependence Last 12 months 0.75 0.71 0.79 Lifetime 0.59 0.52 0.65 Sedative dependence Last 12 months 0.80 0.76 0.83 Lifetime 0.79 0.75 0.83 Stimulant dependence Last 12 months 0.64 0.58 0.69 Lifetime 0.55 0.48 0.62 Opiate dependence Last 12 months 0.73 0.68 0.77 Lifetime 0.74 0.69 0.78 Major depressive disorder Primary 0.72 0.66 0.76 Substance-induced 0.63 0.56 0.68 Conduct disorder 0.85 0.81 0.87 Antisocial personality disorder 0.74 0.70 0.78 Borderline personality disorder 0.66 0.60 0.71 a For dependence disorders severity was measured by the number of disorder criteria met (range= 0 7), for major depressive disorder by the number of symptoms (range=0 9), for conduct disorder by the number of childhood symptoms (range=0 15), for antisocial personality disorder by the number of adult symptoms (range=0 7), and for borderline personality disorder by the number of symptoms (range=0 9). present), reliability ranged from poor to fair, as has been found elsewhere (14, 25 28). Abuse assessed independently of dependence showed substantially better reliability, indicating that the abuse criteria themselves were reliable. Reliability of dependence severity (number of criteria, range=0 7) was very good to excellent, as was reliability of age at onset of dependence (Table 2). Mood Disorders Reliability was excellent for current primary (independent) major depressive disorder (Table 3) and good for current substance-induced major depressive disorder, despite the low prevalence of the latter disorder. Reliability was very good for lifetime primary (independent) and substance-induced major depressive disorder. An either/ or category indicating primary (independent) or substance-induced major depressive disorder had excellent lifetime and very good current reliability. Depression severity (number of symptoms, range=0 9) showed very good reliability (ICC=0.71). Reliability of dysthymia was poor, consistent with findings in other substance abuse studies (8). This poor reliability was due to the difficulty of rating diffuse, mild mood symptoms in substance abusers and to the hierarchical relationship of dysthymia to major depressive disorder. The number of patients with a manic episode (primary or substance-induced) was very low; only a combined category (primary or substance-induced manic episode) had acceptable reliability. Anxiety Disorders With some exceptions, the reliability of current and lifetime primary anxiety disorders was fair to good. The kappa for any lifetime primary anxiety disorder was 0.56 (SE=0.06) and for the either/or category of lifetime primary and substance-induced anxiety disorder was 0.55 (SE=0.06). However, reliability of individual substance-induced anxiety disorders (panic or generalized anxiety disorder) was poor, as was the reliability of any lifetime substance-induced anxiety disorder (kappa=0.33). The kappa of 0.58 for lifetime PTSD was acceptable. Psychotic Disorders Consistent with DSM-IV, hallucinations that the individual realizes are substance-induced when experienced are coded as intoxication/withdrawal symptoms and not counted toward a diagnosis of an independent psychotic disorder. Although psychotic disorders were rare, reliability was surprisingly robust (Table 3). Reliability of any current independent psychotic disorder was excellent, as was the reliability of any substance-induced psychotic disorder, schizophrenia, and substance-induced schizophrenia, a condition meeting all the criteria for DSM-IV schizophrenia except that all active phases of the disorder occurred entirely within periods of heavy substance use. Brief psychotic disorder (primary and substance-induced) had lower but acceptable kappas. No cases of schizoaffective disorder, schizophreniform disorder, or delusional disorders were found in the study subjects. Personality Disorders and Eating Disorders For antisocial personality disorder, the PRISM-IV showed good reliability (kappa=0.69), with the main disagreement in the conduct disorder element, accounting for 76.7% of the discrepant antisocial personality disorder 692 ajp.psychiatryonline.org Am J Psychiatry 163:4, April 2006

HASIN, SAMET, NUNES, ET AL. TABLE 3. Test-Retest Reliability of Psychiatric Diagnoses Made With the Psychiatric Research for Substance and Mental Disorders for DSM-IV in 285 Substance-Abusing Patients a Current Diagnosis Prevalence First Second Kappa SE Lifetime Diagnosis Prevalence First Second Diagnosis Kappa SE Affective disorders Major depressive disorder Primary 0.75 0.06 0.12 0.10 0.70 0.05 0.31 0.28 Substance-induced 0.66 0.09 0.08 0.05 0.70 0.06 0.21 0.14 Primary or substance-induced 0.69 0.06 0.20 0.15 0.77 0.04 0.45 0.38 Dysthymia Primary 0.22 0.12 0.06 0.02 Substance-induced 0.22 0.12 0.04 0.05 Primary or substance-induced 0.36 0.12 0.05 0.04 0.23 0.09 0.10 0.07 Manic episode Primary 0.40 0.28 0.004 0.01 Substance-induced 1.00 0.00 0.004 0.004 0.67 0.32 0.01 0.004 Primary or substance-induced 0.67 0.32 0.004 0.01 0.75 0.17 0.01 0.02 Anxiety disorders Panic disorder Primary 0.56 0.16 0.02 0.02 0.53 0.12 0.05 0.05 Substance-induced 0.39 0.28 0.01 0.01 Generalized anxiety disorder Primary 0.24 0.20 0.02 0.01 0.17 0.16 0.02 0.02 Substance-induced Specific phobia 0.31 0.13 0.03 0.05 0.34 0.12 0.04 0.06 Social phobia 0.61 0.10 0.07 0.06 0.57 0.09 0.09 0.07 Obsessive-compulsive disorder 0.66 0.18 0.02 0.01 0.54 0.18 0.02 0.01 Posttraumatic stress disorder 0.44 0.12 0.05 0.04 0.58 0.07 0.13 0.12 Any primary or substance-induced anxiety disorder 0.57 0.07 0.15 0.13 0.55 0.06 0.25 0.24 Psychotic disorders Schizophrenia Primary 0.86 0.08 0.04 0.04 0.86 0.08 0.04 0.04 Substance-induced 0.66 0.22 0.01 0.01 0.75 0.17 0.01 0.02 Brief psychotic disorder Primary 0.50 0.31 0.004 0.01 Substance-induced 0.44 0.21 0.01 0.02 Psychotic disorder Primary 0.86 0.08 0.04 0.04 0.74 0.08 0.06 0.07 Substance-induced 0.75 0.17 0.01 0.01 0.59 0.12 0.04 0.04 Primary or substance-induced 0.83 0.07 0.06 0.05 0.70 0.07 0.10 0.11 Eating disorders Bulimia 0.76 0.13 0.02 0.02 Anorexia 1.00 0.00 0.01 0.01 Personality disorders Antisocial personality disorder 0.69 0.05 0.23 0.20 Borderline personality disorder 0.67 0.06 0.21 0.18 a Low prevalence (<0.05) is sometimes but not always associated with poor reliability. Reliability for low-prevalence conditions is presented as qualitative information. cases (also noted elsewhere [29]). However, very good to excellent reliability was found for severity of conduct disorder (Table 2) and adult antisocial symptoms. Reliability for borderline personality disorder and number of borderline personality disorder symptoms (the measure of severity) was good (kappa=0.67, ICC=0.66). Consistent with previous results (14), anorexia and bulimia were rare, but the diagnoses of these disorders were highly reliable. Including Partially Remitted Cases Among Those Considered Current Expanding the current time frame to include episodes in partial remission did not substantially affect reliability. Reliability of current plus partially remitted dependence (e.g., three or more past symptoms, one or two current symptoms) was slightly lower than current dependence across drug categories (e.g., alcohol, kappa=0.74; cocaine, kappa=0.86; heroin, kappa=0.92). Similarly, minor differences emerged in reliability for primary and substance-induced major depressive disorder when current and partially remitted cases were combined (primary, kappa= 0.71; substance-induced, kappa=0.63). Administration Time The mean administration time (based on all interviews except the first five done by each interviewer) was 2.03 hours (SD=0.91). We divided time (hours) into quartiles and examined the characteristics of each quartile. The mean administration times in the briefest, the second, the third, and the lengthiest quartiles were 1.05 hours (SD= Am J Psychiatry 163:4, April 2006 ajp.psychiatryonline.org 693

COMORBID PSYCHIATRIC DISORDERS IN SUBSTANCE USERS 0.23), 1.64 hours (SD=0.17), 2.18 hours (SD=0.18), and 3.26 hours (SD=0.75), respectively. The mean numbers of substance use sections covered in the briefest, second, third, and lengthiest quartiles were 3.19 (SD=1.80), 3.67 (SD= 1.94), 4.04 (SD=2.25), and 4.93 (SD=2.41), respectively. The mean numbers of psychiatric sections covered because patients passed screening in the briefest, second, third, and lengthiest quartiles were 3.79 (SD=1.33), 4.83 (SD= 1.82), 4.87 (SD=1.75), and 5.24 (SD=1.91), respectively. The mean numbers of lifetime psychiatric diagnoses made (other than abuse or dependence) in the briefest, second, third, and lengthiest quartiles were 0.61 (SD=0.90), 1.39 (SD=1.29), 1.79 (SD=1.43), and 2.69 (SD=1.64), respectively. Complicated substance use and psychiatric histories have previously been shown to lengthen administration times (30, 31). Discussion We conducted a test-retest study of DSM-IV diagnoses in substance-abusing patients by using the PRISM-IV, a diagnostic instrument designed to improve reliability in such samples. In developing the instrument, we used fundamental principles of psychometrics, including the need for clear criteria and guidelines for rating symptoms and syndromes. The study had a rigorous test-retest design and a large demographically and clinically varied sample. The results indicate that many DSM-IV disorders can be diagnosed reliably with the PRISM-IV in substance abusers, including substance dependence, primary and substance-induced major depressive disorder, primary and substance-induced psychotic disorder, some primary anxiety disorders, antisocial personality disorder, and borderline personality disorder. Although reliability for substance dependence disorders was largely very good to excellent, reliability for DSM-IV substance abuse was lower, as was found previously (14, 25 28). However, as in earlier studies (7, 32), abuse reliability improved considerably when abuse was not ruled out by dependence. That the improvement in the reliability is not simply due to increased prevalence is suggested by the improvement in reliability of current hallucinogen abuse despite its remaining a low-prevalence condition. This finding indicates that abuse criteria are reliable but that their hierarchical relationship to dependence in DSM-IV reduces their reliability, a potential consideration for DSM-V. The reliability of some DSM-IV anxiety disorders and dysthymia was lower than that of the other disorders. Although part of the reason might be low prevalence, the good to excellent reliability values obtained for some lowprevalence disorders in this study suggest that prevalence is not a complete explanation. The structure of the PRISM- IV interview did not allow assessment of the reliability of anxiety disorders or dysthymia independently of the occurrence of major depressive disorder. However, some of the unreliability of these anxiety disorders and dysthymia appeared to occur because of inconsistencies in reporting major depressive disorder in the first and second interview, which led to inconsistent skipping out of some of the anxiety and dysthymia sections. The influence of diagnostic hierarchies on reliability (also found for substance abuse, albeit in a different form) suggests the need for attention in DSM-V, and future studies should address this issue in more detail. Validation studies of anxiety disorders and dysthymia in substance abusers suggest problems that DSM-IV does not appear to have solved (33, 34), and no test-retest reliability information on these disorders in substance abusers has been published. Considerable interest exists in the substantive relationships of substance use disorders and anxiety disorders, but the results reported here suggest that reliability problems may impede progress in this area. More methodological information on the performance of DSM-IV primary and substance-induced anxiety categories in substance-abusing samples is needed, either to show that other assessment methods work better or to indicate that the diagnostic criteria themselves need improvement. Reliability is an important characteristic of a measure, since an unreliable measure cannot be valid. The present study did not address PRISM-IV validity, but such information is emerging from other sources. PRISM-IV and SCID were compared to longitudinal, expert, all data (LEAD)/psychiatrist diagnoses in Spanish dual-diagnosis patients (35). For major depressive disorder, substance-induced psychosis, anxiety disorders, antisocial personality disorder, and borderline personality disorders, agreement between the PRISM-IV and LEAD diagnoses was substantially higher (mean kappa=0.69) than agreement between the SCID and LEAD diagnoses (mean kappa=0.36). Another study validated the PRISM-IV differentiation between DSM-IV primary and substance-induced psychotic disorders in 287 emergency room patients (36). Further, PRISM-IV data on the distinction between primary and substance-induced disorders are emerging as an important source of information on psychiatric disorders in substance abusers (21, 37, 38). Given increasing use of the DSM-IV version of the PRISM, information on its reliability among substance abusers is important in interpreting results of these studies. In this study, the PRISM-IV was tested in substanceabusing subjects, who have traditionally presented challenges to diagnostic accuracy due to complex, overlapping symptoms. Thus, the study served two purposes, one broader and the other more specific. The broader purpose was to address the reliability of the DSM-IV distinction between primary and substance-induced disorders. To our knowledge, this study is the first to do so. The results showed that many substance-induced psychiatric disorders could be evaluated with acceptable reliability. When reliability of primary and substance-induced disorders differed, reliability was usually lower for the substance-in- 694 ajp.psychiatryonline.org Am J Psychiatry 163:4, April 2006

HASIN, SAMET, NUNES, ET AL. duced disorder, almost certainly reflecting the difficulty of differentiating these disorders from the expected effects of intoxication and withdrawal associated with specific substances. However, if we had attempted to make the substance-induced diagnoses without explicit duration and symptom requirements (following DSM-IV exactly), reliability would almost certainly have been far lower, and we wished to provide a method to assess these disorders with good reliability. The necessity of specific diagnostic criteria in achieving good reliability has been a fundamental principle underlying psychiatric diagnosis since DSM-III (16). There is no reason to think that substance-induced disorders differ in this regard, a consideration that may be useful for DSM-V. The second purpose of the study was to present the reliability of a specific instrument that may be used when study samples include many substance abusers. Demonstrating reliability of the PRISM-IV was important, because it differed considerably from the DSM-III-R version, including the addition of many diagnoses, adjustments for DSM-IV substance-induced disorders, and overall reduction in the number of items, complexity, and training time. These changes could all have reduced reliability and hence were important reasons to conduct a new reliability study. The study showed that many diagnostic categories have good to excellent reliability when evaluated with the PRISM-IV and better reliability than with the pre-dsm-iv instruments tested in substance-abusing samples (5, 7, 8, 32). Other instruments in widespread use, including the Composite International Diagnostic and the NIMH Diagnostic Schedule IV have no published reliability information in substance-abusing samples. The importance of good reliability has been illustrated in recent reviews indicating that studies in which rigorous methods are used were much more likely to find significant effects of psychiatric comorbidity on the follow-up status of patients with substance use disorders (1) and on treatment effects in clinical trials (39). Received Nov. 3, 2004; revision received March 14, 2005; accepted April 1, 2005. From the Department of Epidemiology, Mailman School of Public Health, Columbia University, New York; the Department of Psychiatry, College of Physicians and Surgeons, Columbia University, New York; and the New York State Psychiatric Institute. Address correspondence and reprint requests to Dr. Hasin, Columbia University/New York State Psychiatric Institute, 1051 Riverside Dr., Box 123, New York, NY 10032; dsh2@columbia.edu (e-mail). Supported by grants K05-AA-014223 and R01-DA-10919 (Dr. Hasin) from the National Institute on Alcohol Abuse and Alcoholism, grant K02 DA-00288 (Dr. Nunes) from the National Institute on Drug Abuse, and contributing support from the New York State Psychiatric Institute. The authors thank Valerie Richmond, M.A., for editorial assistance and manuscript preparation and thank Jean Endicott, Ph.D., for her general contributions to the research and Kristin Dietz Trautman, M.S.S.W., Melissa Cockerham, M.A., and Gloria Miele, Ph.D., for their contributions to the development of the PRISM-IV. References 1. Hasin D, Nunes E, Meydan J: Comorbidity of alcohol, drug, and psychiatric disorders: epidemiology, in Dual Diagnosis and Treatment: Substance Abuse and Comorbid Disorders. Edited by Kranzler HR, Tinsley JA. New York, Marcel Dekker, 2004, pp 1 34 2. Regier DA, Farmer M, Rae D, Locke B, Keith S, Judd L, Goodwin F: Comorbidity of mental disorders with alcohol and other drug abuse: results from the Epidemiologic Catchment Area (ECA) study. JAMA 1990; 264:2511 2518 3. Kessler RC, Crum RM, Warner LA, Nelson CB, Schulenberg J, Anthony JC: Lifetime co-occurrence of DSM III R alcohol abuse and dependence with other psychiatric disorders in the National Comorbidity Survey. Arch Gen Psychiatry 1997; 54:313 321 4. Grant BF, Stinson FS, Dawson DA, Chou SP, Dufour MC, Compton WM, Pickering RP, Kaplan K: Prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: results from the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC). Arch Gen Psychiatry 2004; 61:807 816 5. Williams JB, Gibbon M, First MB, Spitzer RL, Davies M, Borus J, Howes MJ, Kane J, Pope HG, Rounsaville BJ, Wittchen H: The Structured Clinical for DSM-III-R (SCID): II. multisite test-retest reliability. Arch Gen Psychiatry 1992; 49:630 636 6. Rounsaville BJ, Anton SF, Carroll K, Budde D, Prusoff BA, Gawin F: Psychiatric diagnoses of treatment-seeking cocaine abusers. Arch Gen Psychiatry 1991; 48:43 51 7. Bryant KJ, Rounsaville BJ, Spitzer RL, Williams JB: Reliability of dual diagnosis: substance dependence and psychiatric disorders. J Nerv Ment Dis 1992; 180:251 257 8. Ross H, Swinson R, Doumani S, Larkin EJ: Diagnosing comorbidity in substance abusers: a comparison of the test-retest reliability of two interviews. Am J Drug Alcohol Abuse 1995; 21: 167 185 9. Hasin D, Grant BF: Psychiatric diagnosis of patients with substance abuse problems: a comparison of two procedures, the DIS and the SADS-L: alcoholism, drug abuse/dependence, anxiety disorders and antisocial personality disorder. J Psychiatr Res 1987; 21:7 22 10. Hasin D, Grant BF: Diagnosing depressive disorders in patients with alcohol and drug problems: a comparison of the SAD-L and the DIS. J Psychiatr Res 1987; 21:301 311 11. Kranzler HR, Kadden RM, Burleson JA, Babor TF, Apter A, Rounsaville BJ: The validity of psychiatric diagnoses in patients with substance use disorders: is the interview more important than the interviewer? Compr Psychiatry 1995; 36:278 288 12. Kranzler HR, Kadden RM, Babor TF, Tennen H, Rounsaville BJ: Validity of the SCID in substance abuse patients. Addiction 1996; 91:859 868 13. Weiss RD, Mirin S, Griffin M: Methodological considerations in the diagnosis of coexisting psychiatric disorders in substance abusers. Br J Addiction 1992; 87:179 187 14. Hasin D, Trautman K, Miele G, Samet S, Smith M, Endicott J: Psychiatric Research for Substance and Mental Disorders (PRISM): reliability for substance abusers. Am J Psychiatry 1996; 153:1195 1201 15. Hasin DS, Grant BF: The co-occurrence of DSM-IV alcohol abuse in DSM-IV alcohol dependence: NESARC results on heterogeneity that differs by population subgroup. Arch Gen Psychiatry 2004; 61:891 896 16. Spitzer RL, Endicott J, Robins E: Clinical criteria for psychiatric diagnosis and DSM-III. Am J Psychiatry 1975; 132:1187 1192 17. Grant BF: Comorbidity between DSM-IV drug use disorders and major depression: results of a national survey of adults. J Subst Abuse 1995; 7:481 497 Am J Psychiatry 163:4, April 2006 ajp.psychiatryonline.org 695

COMORBID PSYCHIATRIC DISORDERS IN SUBSTANCE USERS 18. Swendsen JD, Merikangas KR, Canino GJ, Kessler RC, Rubio-Stipec M, Angst J: The comorbidity of alcoholism with anxiety and depressive disorders in four geographic communities. Compr Psychiatry 1998; 39:176 184 19. Schuckit MA: Genetic and clinical implications of alcoholism and affective disorder. Am J Psychiatry 1986; 143:140 147 20. Hasin D, Liu X, Nunes E, McCloud S, Samet S, Endicott J: Effects of major depression on remission and relapse of substance dependence. Arch Gen Psychiatry 2002; 59:375 380 21. Hasin DS, Grant BF: Major depression in 6,050 former drinkers: association with past alcohol dependence. Arch Gen Psychiatry 2002; 59:794 800 22. Fleiss JL: Statistical Methods for Rates and Proportions, 2nd ed. New York, John Wiley & Sons, 1981 23. Bartko JJ: The intraclass correlation coefficient as a measure of reliability. Psychol Rep 1966; 19:3 11 24. Shrout PE, Fleiss JL: Intraclass correlation: uses in assessing rater reliability. Psychol Bull 1979; 86:420 428 25. Grant BF, Harford TC, Dawson DA, Chou PS, Pickering R: The Alcohol Use Disorder and Associated Disabilities Schedule (AUDADIS): reliability of alcohol and drug modules in a general population sample. Drug Alcohol Depend 1995; 39:37 44 26. Hasin D, Carpenter KM, McCloud S, Smith M, Grant BF: The Alcohol Use Disorder and Associated Disabilities Schedule (AUDADIS): reliability of alcohol and drug modules in a clinical sample. Drug Alcohol Depend 1997; 44:133 141 27. Pull CB, WB Saunders JB, Mavreas V, Cottler LB, Grant BF, Hasin DS, Blaine J, Mager D, Üstün B: Concordance between ICD-10 alcohol and drug use disorder criteria and diagnoses as measured by the AUDADIS-ADR, CIDI and SCAN: results of a crossnational study. Drug Alcohol Depend 1997; 47:207 216 28. Canino G, Bravo M, Ramirez R, Febo V, Frenandez R, Hasin D, Grant BF: The Spanish AUDADIS: reliability and concordance with clinical diagnoses in a Hispanic population. J Stud Alcohol 1999; 60:790 799 29. Wittchen HU, Lachner G, Wunderlich U, Pfister H: Test-retest reliability of the computerized DSM-IV version of the Munich- Composite International Diagnostic (M-CIDI). Soc Psychiatry Psychiatr Epidemiol 1998; 33:568 578 30. Wittchen HU: Reliability and validity studies of the WHO Composite International Diagnostic (CIDI): a critical review. J Psychiatr Res 1994; 28:57 84 31. Lachner G, Wittchen HU, Perkonigg A, Holly A, Schuster P, Wunderlich U, Turk D, Garczynski E, Pfister H: Structure, content and reliability of the Munich-Composite International Diagnostic (M-CIDI) substance use sections. Eur Addict Res 1998; 4:28 41 32. Bucholz KK, Cadoret R, Cloninger CR, Dinwiddie SH, Hesselbrock VM, Nurnberger JL, Reich T, Schmidt I, Schuckit MA: A new, semi-structured psychiatric interview for use in genetic linkage studies: a report on the reliability of the SSAGA. J Stud Alcohol 1994; 55:149 158 33. Kranzler HR, Tennen H, Babor TF, Kadden RM, Rounsaville BJ: Validity of the longitudinal, expert, all data procedure for psychiatric diagnosis in patients with psychoactive substance use disorders. Drug Alcohol Depend 1997; 45:93 104 34. Kranzler HR, Rosenthal RN: Dual diagnosis: alcoholism and comorbid psychiatric disorders. Am J Addictions 2003; 12(suppl 1):S26 S40 35. Torrens M, Serrano D, Astals M, Perez-Dominguez G, Martin- Santos R: Diagnosing psychiatric comorbidity in substance abusers: validity of the Spanish versions of the Psychiatric Research for Substance and Mental Disorders and the Structured Clinical for DSM-IV. Am J Psychiatry 2004; 161:1231 1237 36. Caton CL, Drake RE, Hasin D, Dominguez B, Shrout PE, Samet S, Schanzer WB: Differences between early-phase primary psychotic disorders with concurrent substance use and substanceinduced psychoses. Arch Gen Psychiatry 2005; 62:137 145 37. Aharonovich E, Liu X, Nunes E, Hasin D: Suicide attempts in substance abusers: effects of major depression in relation to substance use disorders. Am J Psychiatry 2002; 159:1600 1602 38. Aharonovich E, Liu X, Samet S, Nunes E, Hasin D: Remission from alcohol and other substances: effects of cannabis use. Alcohol Clin Exp Res 2004; 28S:111A 39. Nunes EV, Levin FR: Treatment of depression in patients with alcohol or other drug dependence: a meta-analysis. JAMA 2004; 291:1887 1896 696 ajp.psychiatryonline.org Am J Psychiatry 163:4, April 2006