Assuring Data Quality

Transcription

1 Assuring Data Quality Jennie Wilson Programme Leader SSI Surveillance Dept. of Healthcare-Associated Infection & Antimicrobial Resistance, Health Protection Agency

2 SSI cumulative incidence (%) 8.0% 7.0% 6.0% 5.0% 4.0% 3.0% 2.0% 1.0% 0.0% 2005 Hip prosthesis: inter-country rate (cumulative incidence) AT BE DE ES FI FR HU LT NL NO PL UE UN US UW N=6 N=6 N=100 N=5 N=12 N=200 N=7 N=6 N=34 N=20 N=17 N=172 NA NA NA N in-hospital SSI/1000 post-op. pt.-days Hip prosthesis: inter-country rate (incidence density) AT BE DE ES FI FR HU LT NL NO UE UN US UW N=6 N=6 N=54 N=5 N=6 N=200 N=7 N=6 N=33 N=20 N=172 NA NA NA

3 External benchmarks External benchmarks are a powerful driver for effecting change, but require standardised data collection methods standardised analysis high data quality central co-ordination Gaynes 1997

4 Why is data quality so important locally? Apr-Jun 2004 Jul-Sep 2004 Oct-Dec 2004 Jan-Mar 2005 Apr-Jun 2005 P e rio d Do you know whether action is required? real problems? poorly collected data?

5 SSI Surveillance Basic methodology Targeted at categories of clinically similar operative procedures Data collection form completed for each relevant operation (denominator) Systematic (active) surveillance after each operation to detect infections (numerator)

6 Methods of identifying patients with SSI (numerator) Active Designated, trained personnel, use a variety of data sources to determine whether an HAI has occurred Sensitivity = % Passive HAI identified and reported by people other than designated, trained personnel. Requires fewer people but unreliable, definition not applied consistently Sensitivity: 14-34% (Perl, 1998)

7 Surveillance methods: Sensitivity of case finding Lab-based phone Sensitivity 36% 1.2hrs / 100 beds / week Temperature / treatment chart Sensitivity 65% 6.5 hours / 100 beds / week Lab-based, ward liaison Sensitivity 76% 6.4 hours / 100 beds / week Glenister et al 1992

8 Systematic surveillance for SSI Lab-based based ward liaison 1. Visit ward/patient 3 times per week discuss patients with ward staff check medical / nursing records check temperature / treatment charts 2. Review microbiology reports daily identify positive surgical site reports

9 Definitions of surgical site infection (CDC) Superficial incisional involves only skin or subcutaneous tissue occurs within 30 days of surgery Deep incisional involves fascial or muscle layers occurs within 30 days, implants within 1 year Organ/space part of anatomy opened / manipulated infection appears related to surgery occurs within 30 days, implants within 1 year

10 Superficial Incisional Infection Must meet one of the following criteria: 1. Purulent drainage from superficial incision 2. Culture of organisms from fluid/tissue 3. At least 1 symptom of inflammation (pain, tenderness, localised swelling, redness, heat) and incision deliberately opened to manage infection 4. Clinicians diagnosis of superficial SSI

11 Deep Incisional Infection Must meet one of the following criteria: 1. Purulent drainage from deep incision 2. Deep incision dehisces / deliberately opened and patient has 1 symptom : fever, localised pain/tenderness 3. Abscess / other evidence of infection in deep incision: re-operation / histopathology / radiology 4. Clinicians diagnosis of deep infection

12 Identifying SSI Review patients systematically whilst they are in hospital Do not rely on reviewing case-notes after discharge to find SSIs If a patient is prescribed antibiotics do not assume these are for SSI check with clinician Check significance of positive microbiology cultures Make sure any SSI identified post-discharge also meets the definition

13 Is this an SSI.? Nursing record states: Wound oozing ++ from small lower section. Pressure dressing applied Oozing what: Clear (serous) fluid, blood, pus? What was the condition of the suture line? Red, swollen, dehisced Was a wound swab taken, if so why?

14 Criteria for SSI checklist Weblink data entry (SSISS)

15 Validation studies Mannien et al 2007: PREZIES, Netherlands Reviewed 859 medical charts; 149 SSI Validation team = gold standard PPV = 0.97; NPV = 0.99 McCoubrey et al 2005: SSI surveillance, Scotland 91 SSI reported validated by case note review 10/27 hospitals criteria not recorded PPV 94.6% (95%CL ); NPV 99.4 (95% CL ) (assuming not recorded data valid)

16 NNIS SSI Risk Index Each operation is scored, and results stratified, using 3 major risk factors associated with SSI*: ASA pre-operative assessment score Wound class Duration of surgery (T time) Score between 0 and 3 *Culver et al (1991)

17 Risk Index factors ASA classification of physical illness 1: normal healthy patient 2: mild systemic disease 3: severe systemic disease 4: incapacitating systemic disease 5: moribund, little chance of survival Wound classification Clean: no signs of infection, no body tracts Clean-contaminated: body tract entered Contaminated: spillage form GIT, inflammation, open trauma Dirty: pus, perforated viscera, delayed open trauma, faecal contamination Changed by pre-op and intra-op events

18 T time association between p value and cut point for duration of operation (abdominal hysterectomy) Leong et al 2006

19 Large bowel surgery Trend in rate of SSI by Risk index group % infected u/k All Vascular surgery Risk Index Group % infected u/k All Risk Index Group

20 Effect of indirect standardisation on crude rates of SSI (vascular surgery) Rate of SW I (% ) crude adjusted

21 Distribution of the incidence of surgical site infection by category of surgical procedures 25 Percentiles 90th 75th th 25th 10th % operations infected 0 Abdomial hysterectomy Bile duct, liver or pancreatic surgery Coronary Artery Bypass Graft Gastric surgery Total hip replacement Hip hemiarthroplasty Knee replacement Large bowel surgery Limb amputation Open reduction of fracture Small bowel surgery Vascular surgery October 1997 to December 2003 Source: SSI Surveillance Service, CDSC

22 Crude rates of SWI for vascular surgery (95% CL) 45 by hospital Rate of SWI (%) Hospital Order 90 th percentile 50 th percentile Data to December 2001

23 Funnel plots used to account for variation in sample size Cumulative incidence Cumulative incidence % CI 99% CI Hospital number of operations Total hip prosthesis, January 2000 March 2005

24 Cumulative incidence Total hip prosthesis 1.24 Hip hemiarthroplasty 4.05 Knee prosthesis 0.65 Open reduction long bone fracture Incidence density % infected Total hip prothesis 1.36 Hip hemiarthroplasty 2.29 Knee prosthesis 0.76 Open reduction of long bone fracture Incidence density per 1000 days

25 Funnel plots to adjust for variation in sample size and length of post-op op stay Incidence density/ 1000 post-op in-patient days Incidence Density % CI 99% CI Hospital in-patient post-operative days

26 Length of stay in elective surgery is reducing Median length of stay Total hips Total knee Hip hemi Year

27 Proportion of SSI detected Proportion of SSI detected pre & post discharge Barrett et al Post discharge Pre-discharge Varicose Vein Arterial Appendicectomy Small & Large Bowel Upper GI Tract Renal & Bladder Breast & axillary clearance Head & Neck Orthopaedic Other Cholecystectomy Excisicion of Lesions Explorative Hernia Repair Laparotomy Caesarean Hysterectomy/BSO/Myom Number of SSIs

28 Post-discharge surveillance study Barrett et al 2000 Post-discharge surveillance method Resources data collection, informing/contacting patients General practitioners/district nurses poor response rate to questionnaire Patients better response; +/- reliability Sensitivity of case-finding active vs. passive surveillance reliability

29 Response rate to PDS patient questionnaires Response rate affected by ethnic group and age 27% 22% No Response Response No Reminder Response With Reminder 51% n = 6159 Barrett et al 2000