Evidence Based And Systems Based Best Practices For Management Of Imaging Utilization James H Thrall MD Radiologist-in-Chief Massachusetts General Hospital Juan M Taveras Professor of Radiology Harvard Medical School
Evidence and Systems Based Approaches Evidence based appropriateness criteria Implementation of appropriateness criteria based decision support systems point-of-care CPOE systems Systems to identify duplicate exams Systems for improved provider feedback and education Appropriateness criteria for radiologists recommendations
ACR Appropriateness Criteria Under development since the early 1990s Evidence and consensus based Teams with participation of non radiologist experts in each categorical area Over 160 topics with 800 variants
ACR Appropriateness Criteria Cover diagnostic, interventional and therapeutic applications Cited widely as the basis for CPOE and Radiology Benefits Management programs Continuous gathering and updating of evidence Not in a readily usable format
MGH Computerized Physician Order Entry and Decision Support System
Just-in-time information education-- for referring physicians
Pick-lists for exam and reason for doing it
Duplicate Exam Warning Search engine finds all prior or scheduled exams of the same type 14
Appropriateness Values 1-3 Low Utility 4-6 Intermediate 7-9 High Utility
Physician can proceed, cancel or modify order
MRI Appropriateness Ordering Trends Post Implementation of CPOE with Decision Support Modified ACR AC 11% Low Appropriateness 2% Low Appropriateness
CT Brain Appropriateness Ordering Trends Post Implementation of CPOE with Decision Support 12% Low Appropriateness 4% Low Appropriateness
April 2009
ROE DS Impact On Outpatient CT Utilization CT Scan Utilization ROE Penetration Annual Compound Growth Rate 1% Annual Compound Growth Rate 12% C. L. Sistrom, P. A. Dang, J. B. Weilburg, K. J. Dreyer, D. I. Rosenthal, and J. H. Thrall. Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis. Radiology 251 (1):147-155, 2009.
Impact of Decision Support actual tests per 1000 members 395.0 390.0 385.0 380.0 375.0 370.0 365.0 360.0 355.0 350.0 345.0 340.0 335.0 330.0 325.0 320.0 315.0 310.0 Begin Q2-3 2003 MGPO actual imaging tests per 1000 members (MRIs, CT Scans, Nuclear Cardiology) Full implementation Q2 2005 Composite is a utilization rate weighted 2004 mean of BCBS, 2005HPHC, & TAHP weighted 2006 by the average 2007distribution of total 2008 P4P withhold over time BCBS rates are weighted tests per 1000 members ; HPHC & TAHP rates are unweighted tests per 1000 members Year 2008 Actual Utilization is based on claims data with service dates Jan08 through Aug08, paid as of Sep 08 Composite: BCBS, HPHC, TAHP
Utilization Report for Providers in an MGH Primary Care Practice All MGPO Practices (n=112754) Your Practice (n=18159) Dr. S (n=445) Dr. R (n=391) Dr. Q (n=402) Dr. P (n=365) Dr. O (n=2045) Dr. N (n=748) Dr. M (n=1111) Dr. L (n=809) Dr. K (n=419) Dr. J (n=719) Dr. I (n=1147) Dr. H (n=431) Dr. G (n=961) Dr. F (n=1023) Dr. E (n=1469) Dr. D (n=428) Dr. C (n=731) Dr. B (n=721) 5X variation between providers in the same practice Dr. A (n=884) 0 5 10 15 20 25 30 Adjusted CT/MR/Nuc scans per 100 patients in panel in 2007
IBIS Pilot 2 (CY09 Q2 CY09 Q4) Study of the Impact Concurrent Display of Imaging Utilization and Quality Data has on PCP Utilization & Scoring Concurrent feedback of individual performance
Recommendation rates for exams performed for identical clinical indications read by different radiologists I REC rates for different radiologists 25.0% 20.0% 15.0% 10.0% 5.0% 0.0% A B C D E F G H I J Radiologists
15 10 5 0 Variation Reporting: Radiologist Recommendations Analysis of 6M Diagnostic Exams 15 2.5 2.0 1.5 1.0 0.5 10 5 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 Year 0.0 0 1995 1994 Imaging Recommendations % Odds Ratio (ref=1995) Imaging Recommendation % 5-10 10-14 15-19 20-24 25-29 30-34 35-39 40-44 45-49 50+ Radiologist Experience (years after MD) 1.0 Odds Ratio (ref=<5-10) 3.5 3 2.5 2 1.5 1 0.5 0 0.5 0.0 VASC Observed to expected ratios by radiologist, by subspecialty area CARDIA CHEST CHEST CHEST ER ER GI-GU GI-GU GI-GU GI-GU MAMMO MISC MISC MISC MISC MISC MISC MISC MISC MISC MISC NEURO NEURO NEURO NEURO NEURO NEURO NEURO NEURO PEDI PEDI BONE BONE Obs:Exp Rec Rate Case Mix Adjusted
ACR CT and DR Dose Registries The ACR is implementing CT and DR dose registries in pilot phase Currently no convenient way to record exposure data ACR is working with vendors to develop automated solutions especially for CT The registries will provide immediate feedback for anomalies Benchmarking and establishment of best practices for adult and pediatric applications
Chest 45 40 35 30 CTDIvol 25 20 Female Male 15 10 5 0 0 20 40 60 80 100 120 Age
Protocol Optimization Protocols may not be revised for new technology Some radiology groups have not spent the time necessary to optimize protocols Patient size Patient age Clinical indication # of prior exams One size does not fit all patients Ambiguous chain of command in many hospitals hinders adoption of best practices Two different governance structures Hospital personnel Physicians Technologists often do not report to radiologists
Color coded guide based on indication categories for helping radiologists and technologists select CT protocols for children Pink- Routine, R/O Green- Low dose, F/U Red- Ultra low dose, bone and multiple exams Yellow- Stone protocol Blue- High dose, high res Grey- CT angiography Babies < 20lbs Cuties 21-60 lbs Kiddies 61-100 lbs Teenies 101-200lbs Biggies >200lbs Developed at MGH by Manudeep Kalra MD and colleagues
Image Gently and Step Lightly Campaigns Of The Society Of Pediatric Radiology http://www.pedrad.org/associations/5364/ig/ Image Wisely, a new campaign underway from the RSNA and ACR will follow the principles of Image Gently
The imaging community has the opportunity through Image Gently, Step Lightly and Image Wisely and the ACR Quality and Safety Registries to parallel the FDA s efforts in the concept of safe use
Observations Imaging has transformed medical practice and appropriate imaging should be encouraged Development of better evidence and better methods to educate referring physicians is key to improving utilization Decision support at the point-of-care appears to work effectively and should be explored more widely New technology and new protocol approaches offer substantial promise to reduce doses There is no low tech alternative in the US health system and we must do better in the stewardship of high technology medicine