SCARCE: Stewardship Curriculum and Audit for Residents to Cultivate Efficiency

Transcription

1 SCARCE: Stewardship Curriculum and Audit for Residents to Cultivate Efficiency The development and assessment of a novel CanMEDS Manager curriculum to improve resident test-ordering efficiency Andrew Burke, Chris Hillis, Jason Cheung, John Neary, Leah Hillier, Shuoyan Ning, Carol Mantle, John You, Parveen Wasi

2 Disclosures I do not have an affiliation (financial or otherwise) with a pharmaceutical, medical device or communications organization.

3 Introduction to SCARCE CanMEDS Manager Role 1 : Allocate finite health resources appropriately Consider efficiency alongside effectiveness Need for Teaching Waste Reduction to Residents: 1/3 of all healthcare costs non-contributory to care 2 Diagnostic testing is most wasteful area: >54%! 3 Current Resident Test-Ordering Practices: Efficient practice is not highly valued Little formal instruction on appropriate practices 4 1. Frank JR, et al. The CanMEDS 2005 physician competency framework. Better standards. Better physicians. Better care. Ottawa: The Royal College of Physicians and Surgeons of Canada; Institute of Medicine. The Healthcare Imperative: Lowering Costs and Improving Outcomes. Washington, DC: National Academies Pr; Miyakis S et al. Factors contributing to inappropriate ordering of tests in an academic medical department and the effect of an educational feedback strategy. Postgrad Med J 2006; 82: Dine CJ, et al. Educating physicians-in-training about resource utilization and their own outcomes of care in the inpatient setting. J Grad Med Educ 2010; Jun;2(2):

4 Unnecessary Investigations at HHS Percentage of Unnecessary Investigations (%)

5 Goal of Study Clinical Question Will the SCARCE Curriculum and Audit reduce unnecessary investigations ordered by housestaff on the Clinical Teaching Unit? Key Points Explain the SCARCE Curriculum Methodology of double-blind prospective controlled trial Impact of SCARCE on practice patterns and healthcare costs

6 Methodology

7 Session 1: Appropriate Use of Investigations Prospective Cohort Trial Large Group Format 60 minutes Session 2: Investigation Practices Feedback Audit Small Group Format 60 minutes Pre (Wk 1) Intervention (Wk 2) Post (Wk 3) Hamilton General CTU Housestaff (CC, PGY1, PGY2) Monitor Investigations SCARCE Curriculum and Audit Monitor Investigations Juravinski Hospital CTU Housestaff (CC, PGY1, PGY2) Monitor Investigations Usual Teaching Monitor Investigations

8 SCARCE Curriculum Appropriate Use of Investigations Clinical reasoning to increase yield Mrs. EV: 68F w DVT on LMWH LOS 64 days = 71 Normal INRs Costs of investigations to system Case-based examples and quality improvement

9 SCARCE Audit Feedback on Investigation Practices Trained clinician reviews housestaff orders Assessment of whether investigations are necessary Peer-review and reflection

10 Outcome Assessment Investigation Adjudication Unnecessary Investigation 5,6 : Admission and Progress Notes Evidence-Based Criteria for Investigations Reviewers given all documentation available at time of order Highly unlikely to contribute to diagnosis Highly unlikely to change management Redundant or unreasonable frequency Unreasonably low pre-test probability Admission and Ward Investigations Risk of investigation outweighs benefit Duplicated assessment: Blinded Senior Resident and Staff Physician 5. van Walraven C & Naylor D. Do we know what inappropriate laboratory utilization is? JAMA. 1998;280: Verstappen W et al. Effect of a pactice-based strategy on test ordering performance of primary care physicians: a randomized trial. JAMA. 2003; 289:

11 Results

12 Baseline Characteristics Housestaff Characteristics SCARCE Site Control Site Total no Clinical Clerks no (%) 5 (29) 6 (35) PGY-1 no (%) 9 (53) 8 (47) PGY-2 no (%) 3 (18) 3 (18) Patient Characteristics Total number Age - yr Female (%) Mean Day of admission

13 Investigations Reviewed 283 Admitted Patients 78 Pts < Day 3 of Admit 205 Eligible Patients 64 Patients with Investigations 264 Investigations Electrolytes 35 Creatinine 29 CBC 26 Urea 23 Calcium 20 Magnesium17 Phosphate16 Albumin16 AST/ALT 13 Chest X-ray 11 Misc 60

14 Housestaff Investigation Ordering Practices: SCARCE vs. Control Percentage of Unnecessary Investigations Week PRE 1 Week Control SCARCE Curriculum Received by Housestaff

15 Housestaff Investigation Ordering Practices: SCARCE vs. Control *Absolute decrease of 13.9% ( ) Percentage of Unnecessary Investigations * Week PRE 1 Week POST Control SCARCE Curriculum Received by Housestaff *p<0.01

16 Investigation Profile of SCARCE Housestaff Investigations/ Patient-Day 4 3 * Week PRE 1 Week 3 POST 2 * 1 0 Total Unnecessary Necessary Investigation Type

17 Discussion Cost Implications of SCARCE: Direct savings of $24.51/patient-day Hamilton Health Sciences: >$2,000,000 annually Starting a Culture of Efficiency and Cost Control: Educating trainees to allocate finite resources Collaborating with a wide group of stakeholders Limitations to SCARCE Trial: Documentation-based reviews Length of follow-up (future study)

18 Acknowledgements SCARCE Collaborators: Dr. Parveen Wasi Dr. John You Dr. John Neary Carol Mantle Dr. Chris Hillis Dr. Jason Cheung Dr. Shuoyan Ning Leah Hillier Funding: MOHLTC Collaboration Initiative Statistical Support: CLARITY Research Group Dr. Eleanor Pullenayegum Dr. Stephen Walter

19 Thank you!

20 Classification of Unnecessary Investigations 5,6 Excessive Frequency/Redundancy eg. Repeat LFTs after normal day 1 & 2 Very Low Pre-test Probability eg. Urea if volume & kidneys normal No Change to Management eg. PTT if on warfarin No Change to Diagnosis eg. D-dimer in high suspicion PE

21 Agreement Between Independent Assessors Pair A Pair B Proportion Agreement Kappa Bias 0.01 <0.01

22 References 1. Institute of Medicine. The Healthcare Imperative: Lowering Costs and Improving Outcomes. Washington, DC: National Academies Pr; Miyakis S et al. Factors contributing to inappropriate ordering of tests in an academic medical department and the effect of an educational feedback strategy. Postgrad Med J 2006; 82: Reinhardt UE. Fees, volume and spending at Medicare. 24 December Accessed at on May 13, Dine CJ, et al. Educating physicians-in-training about resource utilization and their own outcomes of care in the inpatient setting. J Grad Med Educ 2010; Jun;2(2): van Walraven C & Naylor D. Do we know what inappropriate laboratory utilization is? JAMA. 1998;280: Verstappen W et al. Effect of a practice-based strategy on test ordering performance of primary care physicians: a randomized trial. JAMA. 2003; 289:

23 Future Directions Longer Term: SCARCE Effectiveness at week 8 Crossover CTU Sites Implement SCARCE into Regular Curriculum Faculty Investigation Ordering Practices Faculty Development

24 Determining Unnecessary Investigations Highly unlikely to contribute to diagnosis Highly unlikely to change management Redundancy or unreasonable frequency Unreasonably low pre-test probability of abnormal result Risk of investigation greatly outweighs benefit

25 Results Investigation Profile Before and After SCARCE SCARCE Week 1 SCARCE Week 3 P value Control Week 1 Control Week 3 P value Investigations Investigation/pt/day Unnecessary inv/pt/day Necessary inv/pt/day SCARCE resulted in a significant decrease in total investigations per patient per day This change was driven by a decrease in unnecessary investigations