Patient Safety Metrics MedRec Quality Audit Virginia Flintoft & Alexandru Titeu CPSI Central Measurement Team
Agenda Patient Safety Metrics - Introduction Getting Data In Worksheets vs Data Collection Forms (DCF) MedRec Quality Audit Requirements for Faxing Getting Results Out MedRec Quality Score Reports and Measurement Worksheets Patient Safety Metrics - Demo How to enroll in MedRec-Acute and MedRec-LTC Intervention How to add and generate the forms How to view data and run reports
Patient Safety Metrics Features: Cloud-based data collection and reporting tool no cost to user Available in English and French User friendly and simple to navigate Accessible from website with login details Tracks >100 process and outcome measures over 14 interventions Provides real time reporting and export of data to CSV/Excel Roll Up or Drill Down Reports (i.e. Unit Organization Health Region Province National) with automated Run Charts Reduces burden of data collection, entry and analysis Capacity to customize measures and reports
User Roles and Permissions Members Add/View data for their site only (all interventions) Add new members to their site Zone Leads Add/View data for any site in their Zone Add new members to any site in their Zone Contact CMT to add new Zone Leads
Getting Data In
Worksheets vs Data Collection Forms Data Collection (Audit) Forms - DCF Patient-level data (de-identified) - daily Multiple data elements Print form Collect data Fax form Automatic roll-up to Measurement Worksheets Measurement Worksheets Aggregate data - monthly Numerator and Denominator Created automatically when you add your DCFs
7 so we may contact you in the event of an error
Requirements for faxing DCFs Enter your Name, Phone Number, and E-mail in the top-left corner (so we may contact you in the event of an error) Enter all elements of the Date (year, month, day) on all forms Enter Day as a double digit (e.g. the 3 rd should be entered as 03, with 0 on the top row and 3 on the row below) Use a Flatbed (flat glass scanning) fax machine if possible Fax form in FINE or SUPERFINE RESOLUTION (setting on fax machine) with NO COVER PAGE Login to PSMetrics one hour after faxing your forms to verify the data was received successfully
Beware of common mistakes! Do not use a cover sheet Do not enter future dates Do not hole punch, fold or spill anything on the form Do not cross out bubbles if you made a mistake, please use the VOID bubble to exclude wrong sections Do not fill out forms on top of each other as ink might bleed through the paper onto the second page Do not write or make extra markings on the form Fill in bubble completely (Sharpie is best, pen and pencil is OK) Print form in Normal or Good quality (do not use Draft quality because the form will be too faint)
Getting Results Out
MedRec Quality Score You get 1 point for meeting the criteria for each element (C, D, E, F, G) C. BPMH based on >1 source. = Yes D. Actual medication use verified by pt./caregiver interview. = Yes OR Unable to perform E. Each medication has drug name, dose +/- strength, route, frequency on BPMH and Admission Orders. = Yes F. Every medication in the BPMH is accounted for in the admission orders. = Yes G. Prescriber has documented rationale for 'holds' and 'discontinued' medications. = Yes/NA Your score is 5 if you meet all MedRec Quality elements on admission
Quality audit data rolls-up to Measurement Worksheets Percentage of Patients Reconciled at Admission (Question B) MedRec-Acute 5 MedRec-LTC 7 Percentage of Patients with One or More Discrepancy on Admission (Question F) MedRec-Acute 7 MedRec-LTC 5 Average MedRec Quality Score on Admission (Questions C, D, E, F and G) MedRec-Acute 11 MedRec-LTC 6 MedRec Quality Bundle Compliance on Admission (Questions C, D, E, F and G) MedRec-Acute 12 MedRec-LTC 7
Reports Types of Reports 1. Measurement Worksheet Run Charts and/or Compliance Run Charts can be used to visualize your program/unit/procedure/service specific data, found in the Data Tab 2. Compare My Results reports can be used to roll-up and compare your Measurement Worksheet data (Site > Health Region > Province > National), found in the Report Tab 3. Source Data reports can be used to export all your raw Measurement Worksheet data or all your raw Data Collection (Audit) Form faxed data, found in the Report Tab 4. HH Compliance reports can be used to report on HH Audit data by different HCP vs Moment combinations, found in the Report Tab Common Features Export any report by clicking the Export to CSV button to save or import your data for use in programs such as Excel Save any Run Chart or Graph by right-clicking the image and choose the Save Picture option Sort the report data by clicking any of the table headers See detailed instructions on how to export data and save graphs on page 22 of the Training Manual
Measurement Worksheet Run Charts and Compliance Run Charts (Data Tab) Each Measurement Worksheet has a Run Charts and/or Compliance Run Charts that can be used to visualize your program/unit/procedure/service specific data Data Collection (Audit) Form data automatically rolls-up into Measurement Worksheets (see separate email for roll-up details) See detailed instructions on how to view worksheet run charts on page 19 of the Training Manual
Compare my Results (Report Tab) These reports can be used to roll-up and compare your Measurement Worksheet data (Site > Health Region > Province > National) Compare My Results reports allow you to compare your site to other rolled-up data (Organization vs Health Region > Province > National) Compare My Bundle Compliance reports allow you to aggregate you bundle compliance results Compare National Results reports allow you to view overall data (national vs Health Region > Province) See detailed instructions on how to run reports on page 21 of the Training Manual
Source Data Reports (Report Tab) These reports can be used to export all your raw Measurement Worksheet data or all your raw Data Collection (Audit) Form faxed data Source Data - Monthly Data reports allow you to export all your raw monthly rolled-up data by Measure, Intervention, Health Region, or Province Source Data - MedRec-Acute QA reports allow you to export the raw patient level data, the individual patient score, or aggregate score Source Data - MedRec-LTC QA reports allow you to export the raw patient level data, the individual patient score, or aggregate score Source Data - VTE - Patient Data report allows you to export raw patient level data See detailed instructions on how to run reports on page 21 of the Training Manual
Hand Hygiene Compliance Reports (Report Tab) HH Compliance reports allow you to report HH Audit data by different HCP vs Moment combinations See detailed instructions on how to run reports on page 21 of the Training Manual
How To s in the Training Manual How to Add Data using printed Data Collection (Audit) Form - DCF See detailed instructions on page 14 of the Training Manual. How to Add/Enrol a New Intervention or Manage Existing Interventions See detailed instructions on page 8 of the Training Manual. How to Add/Create a New Data Collection (Audit) Form - DCF See detailed instructions on page 10 of the Training Manual. How to Add New Team Members See detailed instructions on page 24 of the Training Manual. https://psmetrics.utoronto.ca/metrics/help/psmetrics-trainingmanual.pdf
Patient Safety Metrics - Demo Patient Safety Metrics https://psmetrics.utoronto.ca/metrics/login.aspx Central Measurement Team Virginia Flintoft & Alexandru Titeu metrics@saferhealthcarenow.ca 19
Questions? 20
Thank you ISMP Canada Jennifer Turple - 1-866-544-7672 ext. 255 JTurple@ismp-canada.org Patient Safety Metrics Presentation Slides and Training Manual https://psmetrics.utoronto.ca/metrics/login.aspx CPSI Central Measurement Team Virginia Flintoft - 416-946-8350 Alexandru Titeu - 416-946-3103 metrics@saferhealthcarenow.ca