Survey-Specific Analysis Instructions for the CAHPS Clinician & Group Survey (4-Point Scale) Purpose of Survey-Specific Instructions... 1 What the Analysis Program Does... 1 Global Ratings... 1 Composite Measures... 2 Example of a CAHPS Macro Call... 4 Survey-Specific Analysis Instructions for the CAHPS Clinician & Group Survey (4-Point Scale)
Purpose of Survey-Specific Instructions This document explains how to adapt the CAHPS Analysis Program Version 3.6a (also known as the CAHPS macro) to analyze the results of the CAHPS Clinician & Group Survey. Comprehensive instructions for using this program for any CAHPS survey are provided in Instructions for Analyzing Data from CAHPS Surveys (Document No. 2015). This document is included in the CAHPS Clinician & Group Survey and Reporting Kit 2008. If you will be analyzing results of the Clinician & Group Survey, please read both documents carefully so that you are clear on how to use the macro for this survey. What the Analysis Program Does The CAHPS Analysis Program generates output that you can use to calculate the performance of various entities including medical groups, individual physicians, health plans, hospitals, counties, States, regions, or any other appropriate units of measure to show how one entity s performance compares to the overall performance of all other entities. The program generates both text output and SAS data sets, which provide information on the scores for global ratings, composite measures, and individual items. Global Ratings Global ratings are based on four survey items from the CAHPS Clinician & Group Survey Adult Primary Care Questionnaire that ask the respondents to assess their doctors and the quality of care received on a scale of 0 to 10. When submitting these for analysis with the CAHPS macro, you will need to set the macro parameter vartype=2 indicating the response options 0-10 for the Rating Scale. Rating Measures in the Clinician & Group Survey Q23 RV10 Supplemental Using any number from 0 to 10, where 0 is the worst doctor possible and 10 is the best doctor possible, what number would you use to rate this doctor? Using any number from 0 to 10, where 0 is the worst care possible and 10 is the best care possible, what number would you use to rate the medical care you received during your most recent visit with this doctor? Updated 7/30/2008 Page 1
OD9 Supplemental SC7 Supplemental Using any number from 0 to 10, where 0 is the worst care possible and 10 is the best care possible, what number would you use to rate all your health care from the other doctors or providers you visited at this doctor s office in the last 12 months? We want to know your rating of the specialist you saw most often in the last 12 months. Using any number from 0 to 10, where 0 is the worst specialist possible and 10 is the best specialist possible, what number would you use to rate that specialist? Composite Measures Composite measures, also known as reporting composites, are groupings of two or more questions that address the same dimensions of health care. The composites in the 1.0 version of this survey are as follows: Getting appointments and health care when needed (5 questions). How well doctors communicate (6 questions). Courteous and helpful office staff (2 questions). Additional composites in the 2.0 (beta) of the Child Primary Care Questionnaire are: Doctor's attention to your child's growth and development (5 items). Doctor's advice on keeping your child safe and healthy (5 items). The following table indicates which items are included in each of the composite measures. Composite Measures in the Clinician & Group Survey Getting Appointments and Health Care When Needed Q6 In the last 12 months, when you phoned this doctor s office to get an appointment for care you/[your child] needed right away, how often did you get an appointment as soon as you thought you/[your child] needed? Q8 In the last 12 months, when you made an appointment for a check-up or routine care [for your child] with this doctor, how often did you get an appointment as soon as you thought you/[your child] needed? Q10 In the last 12 months, when you phoned this doctor s office during regular office hours, how often did you get an answer to your medical question that same day? Page 2
Q12 In the last 12 months, when you phoned this doctor s office after regular office hours, how often did you get an answer to your medical question as soon as you needed? Q13 Wait time includes time spent in the waiting room and exam room. In the last 12 months, how often did you/[your child] see this doctor within 15 minutes of your/[his or her] appointment time? How Well Doctors Communicate Q14 In the last 12 months, how often did this doctor explain things [about your child s health] in a way that was easy to understand? Q15 In the last 12 months, how often did this doctor listen carefully to you? Q17 In the last 12 months, how often did this doctor give you easy to understand instructions about taking care of these health problems or concerns? Q18 In the last 12 months, how often did this doctor seem to know the important information about your/[your child s] medical history? Q19 In the last 12 months, how often did this doctor show respect for what you had to say? Q20 In the last 12 months, how often did this doctor spend enough time with you/[your child]? Courteous and Helpful Office Staff Q24 In the last 12 months, how often were clerks and receptionists at this doctor s office as helpful as you thought they should be? Q25 In the last 12 months, how often did clerks and receptionists at this doctor s office treat you with courtesy and respect? Doctor's Attention to Your Child's Growth and Development (Child Primary Care Questionnaire 2.0 (beta) only) Q42 In the last 12 months, did you and this doctor talk about your child s learning ability? Q43 In the last 12 months, did you and this doctor talk about the kinds of behaviors that are normal for your child at this age? Q44 In the last 12 months, did you and this doctor talk about how your child s body is growing? Q45 In the last 12 months, did you and this doctor talk about how your child s moods and emotions? Q50 In the last 12 months, did you and this doctor talk about how your child gets along with others? Page 3
Doctor's Advice on Keeping Your Child Safe and Healthy (Child Primary Care Questionnaire 2.0 (beta) only) Q46 In the last 12 months, did you and this doctor talk about things you can do to keep your child from getting injured? Q47 In the last 12 months, did this doctor give you any printed handouts or booklets with information about how to keep your child from getting injured? Q48 In the last 12 months, did you and this doctor talk about how much or what kind of food your child eats? Q49 In the last 12 months, did you and this doctor talk about how much or what kind of exercise your child gets? Q51 In the last 12 months, did you and this doctor talk about whether there are any problems in your household that might affect your child? Example of a CAHPS Macro Call The CAHPS macro is designed to analyze both individual items and composites of several items that use the same response scale. Below is an example of a SAS data step designed to prepare the raw data for use by the CAHPS macro. For the purposes of this example, the macro adjusts the results for age only; however, the CAHPS Consortium recommends adjusting for age, education, and general health status. Once the data step is run and a new analysis data set is created, you can run multiple CAHPS macro calls using any combination of single items or composites based on recodings done in the data step. data runfinal( drop = i ) ; set in.test ; * Recodes numeric site variables to character to simplify interpretation of the result tables. The CAHPS macro requires the variable PLAN be created. PLAN may be any entity, such as a hospital, clinic, state, gender, or whatever unit needs to be compared. The text output and variable names will still use the label PLAN, but you will know exactly what it is from this data step. ; length plan $ 20 ; if region = 1 then plan = Clinic 1 ; else if region = 2 then plan = Clinic 2 ; else if region = 3 then plan = Clinic 3 ; else plan = Clinic Other ; age = q31 ; run ; * Run measures through the CAHPS macro * for a single rating ; %cahps(var = q23, vartype = 2, Page 4
name = Rating of Doctor, adjuster = age, adultkid = 3, dataset = runfinal, outname = ratedoct ) ; * Run measures through the CAHPS macro * for a composite ; %cahps(var = q24 q25, vartype = 3, name = Clerks and Receptionists, adjuster = age, adultkid = 3, dataset = runfinal, outname = clerkrecep ) ; * Run measures through the CAHPS macro * for a 6-point scale using original values ; %cahps(var = q66, vartype = 5, min_resp = 1, max_resp = 6, name = a 6-Point Scale, adjuster = age, adultkid = 3, dataset = runfinal, outname = Six_All ) ; Page 5