ACCURACY OF STROKE RECOGNITION BY EMERGENCY MEDICAL DISPATCHERS



Similar documents
IS EMS A PART OF YOUR STROKE TEAM?

Prehospital Management of Stroke. Todd J. Crocco, MD

Development of Smartphone Application That Aids Stroke Screening and Identifying Nearby Acute Stroke Care Hospitals

4th Annual New York Stroke Conference Maximizing Stroke Quality of Care: Key Ingredients

Developing a Dynamic Team Approach to Stroke Care. Emergency Medical Services 2015

Department of Veterans Affairs VHA DIRECTIVE Veterans Health Administration Washington, DC November 2, 2011

A Summary Policy Brief

Emergency Medical Services Stroke Policy Inventory. Executive Summary Report Emergency Medical Services Stroke Policy Inventory

Diagnostic Accuracy of Stroke Referrals From Primary Care, Emergency Room Physicians, and Ambulance Staff Using the Face Arm Speech Test

STROKE PREVENTION AND TREATMENT MARK FISHER, MD PROFESSOR OF NEUROLOGY UC IRVINE

ACT FAST! Stroke is prevalent and life-threatening

King County EMS Stroke Quality Improvement Program

STROKE TRAINING FOR EMS PROFESSIONALS

EDUCATION AND PRACTICE

Cost Effectiveness of Helicopter Transport of Stroke Patients for Thrombolysis

A Collaborative Effort to Improve Emergency Stroke Care: Mobile Stroke Unit

Accuracy of a Priority Medical Dispatch System in Dispatching Cardiac Emergencies in a Suburban Community

07/14/2014 REVIEWED/REVISED: DATE TO BE REVIEWED: 01/31/2016 EMERGENCY MEDICAL SERVICES ELECTRONIC PATIENT CARE REPORT DOCUMENTATION - EPCR

doi: /j.jocn

San Diego Community Paramedicine

Approved: Acute Stroke Ready Hospital Advanced Certification Program

A Comparison of Hemorrhagic and Ischemic Strokes among Blacks and Whites:

ALBERTA PROVINCIAL STROKE STRATEGY (APSS)

Ambulance Trust Feedback Report. Progress in improving stroke care

TIME LOST IS BRAIN LOST. TARGET: STROKE CAMPAIGN MANUAL

The Accuracy of Predicting Cardiac Arrest by Emergency Medical Services Dispatchers: The Calling Party Effect

Emergency Department Visits for Chest Pain and Abdominal Pain: United States,

With the advent of alteplase, stroke care as a medical

THE INTERNET STROKE CENTER PRESENTATIONS AND DISCUSSIONS ON STROKE MANAGEMENT


Stroke Coding Issues Presentation to: NorthEast Cerebrovascular Consortium

COUNTY OF KERN EMERGENCY MEDCAL SERVICES DEPARTMENT. EMS Aircraft Dispatch-Response-Utilization Policies & Procedures

Level III Stroke Center Data Collection Requirements

Inba Clinical Pathway for Local Stroke Network with Helicopter Emergency Medical Service in Chiba, Japan

SUBJECT: TRANSPORT OF PATIENTS FROM REFERENCE NO. 520 CATALINA ISLAND

Trends in Life Expectancy and Causes of Death Following Spinal Cord Injury. Michael J. DeVivo, Dr.P.H.

A mobile telemedicine system for remote consultation in cases of acute stroke

All New Haven Area Fire, Police & Emergency Medical Service Chiefs & Pre-Hospital Field Personnel

COUNTY OF KERN EMERGENCY MEDICAL SERVICES DEPARTMENT

Physician Oversight of EMS Dispatch

EMS Patient Care Report Navigation Logic for Record Creation

A Comprehensive Strategy for Coordinating the Care for Patients with Coronary Artery Disease (CAD) and Other Chronic Medical Conditions

HAAD JAWDA Quality KPI; waiting times. December 2015

SUBJECT: PRIVATE PROVIDER AGENCY (EMT, PARAMEDIC, MICN) TRANSPORT/RESPONSE GUIDELINES REFERENCE NO. 517

Local and State Oversight of Emergency Medical Services in California

STATE OF MAINE DEPARTMENT OF PUBLIC SAFETY MAINE EMERGENCY MEDICAL SERVICES 152 STATE HOUSE STATION AUGUSTA, MAINE 04333

San Benito County Emergency Medical Services Agency

EMS MANAGEMENT OF ACUTE STROKE PREHOSPITAL TRIAGE (RESOURCE DOCUMENT TO NAEMSP POSITION STATEMENT)

Seeing ambulance services in a different light

EMERGENCY MEDICAL DISPATCH PROGRAM REQUIREMENTS PURPOSE:

Physician and other health professional services

MLFD Standard Operating Guidelines SOG# Subject: Patient Transfer of Care Initiated 1/30/2013

American College of Emergency Physicians

Emergency Medical Technician (EMT) Training Program Application Packet

Hector Alonso-Serra, MD, MPH, Donald Blanton, MS, MD, Robert E. O Connor, MD, MPH

Administrative Policy 5201

Stroke remains the third leading cause of death and a leading

Five Things You Need to Know about NIH StrokeNet in Five Minutes

Disclosures. Georgia Facts. Stroke System Models. Telestroke. The World is Flat : A Brief Future of Acute Stroke Care

REMINDER: Please ensure all stroke and TIA patients admitted to hospital are designated as "Stroke Service" in Cerner.

Carolyn A. McAllister

Evaluating ED Patients with Transient Ischemic Attack: Inpatient vs. Outpatient Strategies

ACUTE STROKE PATHWAY

SAN FRANCISCO INTERNATIONAL AIRPORT - PARAMEDIC FIRST RESPONDER PROGRAM

Building an Emergency Response to Acute Stroke

Helicopter Transport of Stroke Patients and Its Influence on Thrombolysis Rates Data From the Austrian Stroke Unit Registry

REGIONAL SUSPECTED STROKE PROTOCOL

Long term care coding issues for ICD-10-CM

Module Two: EMS Systems. Wisconsin EMS Medical Director s Course

Implementing a Prehospital 12-Lead Program

CASE SELECTION: EVALUATING THE RECORDS TO DETERMINE WHICH CASES TO REJECT OR TAKE

Emergency Medical Services Agency. Report to the Local Agency Formation Commission

Proposed procedure: Insertion of the LMA Supreme for airway management by flight paramedics.

SIERRA-SACRAMENTO VALLEY EMS AGENCY PROGRAM POLICY REFERENCE NO. 450

ROLE OF THE REGISTERED NURSE IN THE OUT-OF-HOSPITAL ENVIRONMENT

Stuart B Black MD, FAAN Chief of Neurology Co-Medical Director: Neuroscience Center Baylor University Medical Center at Dallas

MEDICAL POLICY No R7 DETOXIFICATION I. POLICY/CRITERIA

3.04 Land Ambulance Services

Jacksonville State University, Jacksonville, AL Doctorate in Science Emergency Management 2011 to present

STRAIGHT BACK TRIAGE WILLIAM BEAUMONT HOSPITAL, ROYAL OAK CAMPUS

PROGRAM ASSISTANCE LETTER

Jacksonville State University, Jacksonville, AL Doctorate in Science Emergency Management 2011 to present

Adding IV Amiodarone to the EMS Algorithm for Cardiac Arrest Due to VF/Pulseless VT

Attack Care Bundle. Emergency Department Stroke and Transient Ischaemic. Summary for clinicians

CRITICAL ILLNESS CLAIM FORM

Informed Consent, Wisconsin-Style

TITLE: MEDICAL PRIORITY DISPATCH SYSTEM RESPONSE AND MODE ASSIGNMENTS FOR CARDS 1-34 EMS Policy No. 3202

Josefine Persson Institution of Neuroscience and physiology, the Sahlgrenska academy at Gothenburg university, Sweden. 26-May-2015

PHARMACISTS ROLE WITHIN THE IMMUNIZATION NEIGHBORHOOD. Presentation by Mitchel C. Rothholz, RPh, MBA Chief Strategy Officer

EMERGENCY MEDICAL SERVICES POLICIES AND PROCEDURES Policy Number 910 Date Date Effective Date: December 1, 2005

NATIONAL AMBULANCE SERVICE ONE LIFE PROJECT

Healthcare Inspection

Preemptive Care for Frequent ER Users. David Persse, MD Public Health Authority Physician Director, EMS City of Houston

CHAPTER 9 DISEASES OF THE CIRCULATORY SYSTEM (I00-I99)

Translating Science to Health Care: the Use of Predictive Models in Decision Making

DO YOU LIVE IN A CARDIAC READY COMMUNITY?

STATE OF NEVADA MARTA E. JENSEN Interim Administrator. Agreement Renewal. Check Level of Service: Basic Intermediate Advanced

Who provides this training? Are there any requirements? The parents/guardians and the doctor go through the medication curriculum with the student.

SEAS SUBSCRIBER ORDER SENIOR EMERGENCY ALERT SYSTEM PHONE 858/ FAX 858/

Blue Care Network Physical & Occupational Therapy Utilization Management Guide Published 11/13/2012

Transcription:

ACCURACY OF STROKE RECOGNITION BY EMERGENCY MEDICAL DISPATCHERS AND PARAMEDICS SAN DIEGO EXPERIENCE Prasanthi Ramanujam, Kama Z. Guluma, Edward M. Castillo, Marcus Chacon, Matt B. Jensen, Ekta Patel, William Linnick, James V. Dunford ABSTRACT Background. Prehospital personnel in Emergency Medical Service (EMS) systems have varying levels of accuracy in stroke recognition. Identifying the accuracy of emergency medical dispatcher using Medical Priority Dispatch Systems (MPDS) stroke protocol and paramedics may help understand the accuracy of stroke recognition in about 3000 emergency medical dispatch systems and prehospital systems world wide. Objective. Our aim was to assess the accuracy of stroke identification in emergency medical dispatchers (EMD) with high compliance to MPDS protocol and paramedics using Cincinnati Prehospital Stroke Scale (CSS). Methods. This was a retrospective observational study. Data was acquired from a computer assisted dispatch (CAD) system, a computerized paramedic record database and discharge diagnosis from billing records or stroke registry containing all stroke assessments of patients who presented to the participating study hospitals within 12 hours of symptom onset. We included patients 18 years or older, identified as having stroke by EMD and city agency paramedics. We excluded patients taken to hospitals not participating in the study, patients with a dispatch determinant of Stroke (card 28) not transported by City EMS agency (SDMSE) to participating hospitals, patients in the stroke registry not transported by SDMSE or patients with no final outcome data. A stroke neurologist or hospital discharge diagnosis of stroke (physician diagnosis) was used to determine the sensitivity and predictive values of EMD and paramedic recognition of stroke. Results. Of 882 patients with a dispatch determinant of stroke using MPDS Stroke protocol, 367 had a final discharge diagnosis of stroke. This gives a sensitivity of 83% and a positive predictive value of 42% for EMD using MPDS Stroke protocol. Of 477 patients with a paramedic Received from the Department of Emergency Medicine, University of San Francisco Medical Center, San Francisco, CA (PR); Department of Emergency Medicine, University of San Diego Medical Center, San Diego, CA (KZG, EMC, JVD); Department of Neurology, University of Wisconsin-Madison, Clinical Science Center, Madison, WI (MC, MBJ); City of San Diego Emergency Medical Services, San Diego, CA (WL, EP, JVD), and Department of Emergency Medicine, Sharp Grossmont Hospital, La Mesa, CA (WL) Support: This study was funded by the Stroke Center, University of California San Diego Medical Center. Conflict of Interests: None of the authors have financial disclosures or conflicts of interest to declare in regards to this study. Address correspondence to Prasanthi Ramanujam MBBS, Department of Emergency Medicine, University of San Francisco Medical Center, 505 Parnassus Avenue L-126, San Francisco, CA 94143 0208. e-mail: Prasanthi.Ramanujam@ucsf.edu. doi: 10.1080/10903120802099526 assessment of stroke using CSS, 193 had a final discharge diagnosis of stroke. This gives a sensitivity of 44% and a PPV of 40% for paramedics using CSS. Conclusions. In our EMS system, EMD using MPDS Stroke protocol with a high compliance has a higher sensitivity than paramedics using CSS. Key words: cerebrovascular accident; emergency medical services; neurologic manifestations. PREHOSPITAL EMERGENCY CARE 2008;12:307 313 BACKGROUND AND PURPOSE OF THE STUDY In this era of thrombolysis and revascularization procedures, management of acute ischemic stroke is a timecritical process. 1 Even though majority of the delays have been attributed to patient access of emergency healthcare, it is important for prehospital and hospital systems to respond quickly and efficiently to improve outcomes for patients with acute stroke. 2 4 In prehospital systems, stroke recognition is achieved by both emergency medical dispatchers (EMD) and field providers. EMD plays a vital role within emergency medical services (EMS) systems, as they are the first point of medical contact in an emergency response system. Roles of emergency medical dispatchers include recognition of stroke symptoms, assignment of an appropriate ambulance response for each patient and provision of post-dispatch instructions based on individual requirements. It is crucial for them to identify stroke to avoid inappropriate assignment of low acuity code and thereby reduce delays in ambulance response. It is also important for EMD to be highly sensitive in stroke recognition and also fairly specific to avoid overutilization of EMS resources. Further, in the future, once stroke is recognized, EMD can be trained to notify emergency departments to expedite stroke triage and notification of stroke teams for acute management. Like prehospital stroke scales, dispatch programs contain protocols to guide emergency medical dispatcher recognition of stroke and appropriate ambulance response assignment. 5 7 The most widely used dispatch program is the Medical Priority Dispatch System (MPDS). 8 Although 3000 cities across the world use MPDS, only 80 agencies (2%) are recognized as accredited centers of excellence, defined as having high dispatcher compliance (>90%), education programs, protocol review, field training and medical 307

308 PREHOSPITAL EMERGENCY CARE JULY /SEPTEMBER 2008 VOLUME 12 /NUMBER 3 direction. 9 While prior studies have reported varying levels of dispatch recognition and priority assignments by emergency medical dispatchers using MPDS, there is paucity of studies on validation of MPDS protocol for stroke 10 13 and comparison of medical dispatcher and paramedic recognition of stroke within the same system. The role of field prehospital providers i.e paramedics, include recognition of signs and symptoms of stroke, triage of patients to primary or specialized stroke centers, initiation of clinical trial treatment protocols in special circumstances and notification of emergency department about the impending patient arrival. The various prehospital stroke scales available for use by EMS systems include Cincinnati Prehospital Stroke Scale (CSS), Los Angeles Prehospital Stroke Screen (LAPSS), Melbourne Ambulance Stroke Screen (MASS) and Face Arm Speech Test (FAST). 5 7,14 Although the various stroke scales have been validated in prior studies, our study is unique in comparing the accuracy of EMD and paramedics within a single EMS system using the discharge diagnosis of stroke. The purpose of the study was to determine the accuracy of EMD and paramedic recognition of stroke. Since our EMD have a high compliance to the protocol, this study will help to determine the sensitivity of the MPDS Stroke protocol. By assessing the accuracy of EMD and paramedics, deficiencies in prehospital stroke recognition can be identified. This will pave way for future studies to determine factors that could further improve the accuracy of stroke recognition by prehospital providers. SUBJECT AND METHODS This is a retrospective observational study and was conducted in the EMS system of the City of San Diego during the time period January 1, 2005 to December 31, 2005. Using a descriptive study design we wanted to determine the accuracy of EMD using MPDS stroke protocol and paramedics using CSS by comparing the dispatch determinant code and paramedic clinical assessment to a stroke team diagnosis or hospital discharge diagnosis. The participating sites included the Fire Communication Center of the City of San Diego (FCC), San Diego Medical Service Enterprise (SDMSE) and six hospitals in the County of San Diego. This study protocol was approved by the Institutional Review Boards (IRB) of all participating institutions and was granted waiver of informed consent. San Diego County is the sixth largest county in the US and has a population of approximately 3 million residing in 4000 square miles. 15,16 There are 18 acute care hospitals serving the San Diego County region. The age-adjusted rate of hospitalization for stroke in San Diego County is 3.04 per 1000. 17 The City of San Diego has a population of 1.3 million and is the eighth largest city in the Country. 16 The Fire Communication Center for the City of San Diego receives about 100,000 medical aid calls annually. Advanced life support response in the City of San Diego consists of a fire department engine based paramedic as well as a paramedic staffed ambulance. EMS System in City of San Diego The City of San Diego FCC is staffed with approximately 33 full time emergency medical dispatchers who are trained according to the California EMS Authority guidelines. 18,19 They also undergo a refresher course on stroke annually. In addition, EMD in FCC have completed the 20-point requirement by National Association of Emergency Medical Dispatch (NAEMD) and FCC has remained a center of excellence from 1998 through the study period. In a center of excellence, EMD have more than 90% compliance with the MPDS protocols including stroke protocol making it feasible to study the accuracy of the MPDS Stroke protocol. The dispatch center uses the computerized version of the MPDS protocols called Pro QA. Pro QA (MPDS Version 11.2, Priority Dispatch Corp.) is a state- ofthe-art emergency medical dispatching Windows- NT based software program that integrates with computer assisted database (CAD) and phone systems. Pro QA guides the emergency medical dispatcher through a series of scripted questions to determine the acuity of patient status and select the case entry protocol specific to the chief compliant for e.g. stroke. Using Pro QA, emergency medical dispatchers ask a standardized series of questions (MPDS protocol) and based on the caller responses assign a determinant code. 20 The caller information, determinant code and other call related data are captured in the Pro QA. The compliance to the MPDS Stroke protocol is captured in the performance reports generated by the software AQUA used by quality management staff to monitor individual and center perfomance. San Diego Medical Service Enterprise (SDMSE) is the largest 911 paramedic and non-emergency provider for residents in the County of San Diego. In addition to serving the City of San Diego, they also serve a specific geographical County service area and also provide non-emergency transport to three hospital groups in the County of San Diego. The participating EMS agency, San Diego Medical Service Enterprise (SDMSE) has 450 paramedics and 800 first responders. Each year, City of San Diego paramedics receive one hour of formal instruction in the recognition and management of acute stroke from the City Medical Director (JD). Medics are taught time-critical aspects of early stroke care, the differential diagnosis of stroke and development of a regional stroke system in San Diego.

Ramanujam et al. STROKE RECOGNITION BY EMD AND PARAMEDICS SAN DIEGO EXPERIENCE 309 The San Diego County Division of Emergency Medical Services Policy S-123 addresses Altered Neurological Function, Nontraumatic. Paramedics employ the Cincinnati Prehospital Stroke Scale to assess for facial droop, arm drift and speech abnormality. 21 For suspected stroke occurring within 2 hours of onset medics are advised to expedite transport and provide early notification to the on-line base hospital to confirm destination. At the time of this study, stroke receiving centers were not formally designated, patient destination request was honored and lack of availability of CT was the primary indication for ED diversion for suspected acute stroke. At the conclusion of each paramedic transport, paramedics generate a Palm-based electronic medical record called TapCharts which includes chief complaint, medical interventions, diagnostic codes and ambulance destination. This information is uploaded to a computer server maintained by SDMSE. Study Site Hospitals (Table 1) The County of San Diego has 18 acute care hospitals. The six participating hospitals include the two campuses of the academic medical center and four community hospitals with access to stroke team neurologists based at the academic medical center. The two campuses of the academic medical center were the only JCAHO certified stroke centers among the six hospitals during the study period. The volume of patients seen in the emergency departments at the academic medical centers is approximately 70,000 and the total number of EMS transports to these hospitals annually are about 8500(12% of total ED visits). The number of annual emergency department visits to the community hospitals is about 177,000 and the number of transports by the city EMS agency to these hospitals is approximately 23,000(13% of total ED visits). The number of stroke transports based on the field diagnosis by paramedics to the academic medical centers during the study period was 95 and the number of stroke transports by paramedics to the community hospitals during the study period was 398. TABLE 1. Characteristics of Participating Hospitals in the City of San Diego during the Year 2005 Transports with Total Total number paramedic Type of number of of EMS assessment Hospital ED Visits transports of stroke Academic/University 50,000 7453 81 affiliated Academic/University 20,000 1168 14 affiliated Community 70,000 8825 170 Community 55,000 12324 180 Community 22,000 2229 46 VA Hospital 30,000 224 2 247,000 32223 493 Subjects Our inclusion criteria for the study were patients who are 18 years or older identified as having stroke in the prehospital phase using the MPDS Stroke protocol by emergency medical dispatchers or by use of CSS by paramedics. Although, young adults and children do suffer stroke, it was arbitrarily determined that we would study patients over 18 years of age only. Patients who were taken to other acute care hospitals not participating in the study, patients with a dispatch determinant of Stroke (card 28) who were not transported by City EMS agency (SDMSE) to participating hospitals, patients in the stroke registry not transported by SDMSE or patients with no final outcome data were excluded from the study. Data Collection Data was collected from prehospital resources called the Computer Assisted Dispatch (CAD) database at the FCC and the computerized paramedic records called Tapcharts. The source for outcome data is the stroke registry maintained by the stroke team at the academic medical center and the billing records of the participating hospitals if outcome was not available in the stroke registry. During the study period, we acquired the number of medical aid calls to the FCC, the total number of patients with a stroke determinant code (Card 28), compliance of emergency medical dispatchers to the MPDS Stroke protocol and patient demographics from the CAD. We obtained clinical assessment of paramedics using Cincinnati Prehospital Stroke Scale, time spent on scene, time to destination, and hospital destination and patient demographics from the computerized paramedic database maintained by SDMSE. The stroke registry database had patient demographics, adjudicated final diagnosis for each patient while the hospital billing records had patient demographics and ICD-9 codes for the patient s hospital visit. [Transient Cerebral Ischemia Unspecified, Cerebral Artery Occlusion Unspecified with Cerebral Infarction, Intracranial Hemorrhage Unspecified or other related ICD 9 codes 430 438]. Once the data from all sources were collected, we used the transport identification number from the tapcharts to directly link the two prehospital databases i.e. CAD and Tapcharts. The transport number is unique to each individual call and related patient transport. Once the prehospital databases were linked, we matched this dataset with the stroke registry and billing records using patient information. The discharge diagnosis for patients in stroke registry was compared with patients who had a prehospital diagnosis of stroke.

310 PREHOSPITAL EMERGENCY CARE JULY /SEPTEMBER 2008 VOLUME 12 /NUMBER 3 Data Analysis We classified true positive strokes as patients who were assigned a code of determinant stroke by emergency medical dispatchers or paramedics and had a discharge diagnosis of stroke. False negatives were patients with a discharge diagnosis of stroke from the stroke registry with no dispatch determinant or paramedic diagnosis of stroke. False positives are patients with dispatch determinant or paramedic diagnosis of stroke with a discharge diagnosis other than stroke. We were not able to obtain true negatives since we did not follow all patients with a dispatch determinant or paramedic diagnoses other than stroke. Data from all three databases were entered into MS Access 2003 (Microsoft Corp., Redmond, WA) and analyzed using SPSS Version 14 (SPSS Inc., Chicago, IL). RESULTS A total of 86,989 medical aid calls were received at the FCC during the 12 month study period. The total number of EMS transports for the year by SDMSE was 72,638. Of all the medical aid calls, the total number of stroke determinant codes by the emergency medical dispatchers for the study period was 2140 (2%). Of the 72,638 EMS transports by SDMSE, the total number of paramedic assessment of stroke using CSS was 995 (1.3%). The numbers of patients with a dispatch determinant of stroke transported by SDMSE to the six participating hospitals were 882 and the numbers of patients with positive CSS assessments transported by SDMSE to the six participating hospitals were 493. The total numbers of patients in the stroke registry included in our study were 440. Number of medical aid calls to FCC: 86,989 Number of all EMS transports by SDMSE for the year 2005: 72,638 Number of patients with dispatch determinant of stroke (Card 28) for the year 2005: 2140 Number of patients with SDMSE paramedic assessment of stroke using CSS taken to all hospitals: 995 Number of patients with dispatch determinant of stroke (Card 28) transported by SDMSE to the six study hospitals: 882 Number of patients with paramedic assessment of stroke using CSS taken to the six study hospitals: 493 * * Missing data 16 FIGURE 1. Number of patients with prehospital recognition of stroke taken to the participating hospitals in San Diego during the year 2005.

Ramanujam et al. STROKE RECOGNITION BY EMD AND PARAMEDICS SAN DIEGO EXPERIENCE 311 The numbers of patients with missing data were 16 (Figure 1). Dispatcher Diagnostic Accuracy: (Table 2) Among all stroke patients taken to the study hospitals, EMD assigned a determinant code of Stroke to 882 patients. Of the 882 patients, only 367 (42%) had a final diagnosis of stroke. Therefore, the numbers of true positive strokes were 367. Emergency medical dispatchers did not assign a dispatch determinant to 73 patients who had a final diagnosis of stroke in the registry. Therefore, the numbers of false negative strokes were 73. The sensitivity and positive predictive value for EMD using MPDS Stroke protocol is 83% (95 CI 80 87), and 42% (95 CI 37 46) respectively. Paramedic Diagnostic Accuracy: (Table 2) City paramedics using the CSS determined 493 transports to be strokes of which final outcome data was available for 477. Of the 477, 193 (40%) had a final diagnosis of stroke. Therefore, the numbers of true positives were 193. Paramedics did not recognize 247 patients with a final diagnosis of stroke. Therefore the numbers of false negative strokes were 247. The sensitivity and positive predictive value for paramedics using CSS for stroke recognition in our EMS system with 95% CI are 44% (95 CI 39 49),and 40% (95 CI 36 45) respectively. DISCUSSION Accurate recognition of stroke by EMD is important because ambulance response, field communication and allocation of field resources are based on determinant code assigned by emergency medical dispatchers. Although this may be less important in urban single tier systems with high priority response and short response time to potential stroke calls, this may carry more significance in multi-tiered, rural or volunteer systems. Therefore, in order to have a universal robust dispatch system that recognizes most stroke patients accurately as well as appropriately assign priority responses, it is imperative to study the accuracy of the protocols used by EMD and also to study various factors that improve recognition of stroke by EMD. Prior studies have examined the accuracy of stroke recognition by emergency medical dispatcher, communication of stroke symptoms by callers to medical dispatchers as well as the response assignment of dispatchers in these situations. 10 12 Such studies have shown varying levels of emergency medical dispatch recognition as well as response assignments to callers with possible stroke. Porteous et al. reported that emergency medical dispatchers coded less than half of the calls as stroke when the caller used the term stroke and only 41% of ambulance assignments for stroke were high priority responses. As one of the early studies on stroke recognition by prehospital providers, the authors reported the dispatcher sensitivity for stroke, but did not report accuracy of the MPDS stroke protocol. 12 Following this study, Ellison and co-investigators reported a sensitivity of 61% and a specificity of 20% for stroke recognition by emergency medical dispatchers. 10 While the medical dispatchers in the latter study used MPDS protocols they did not report a high compliance to the protocol. Rosamond et al. in their study on understanding how stroke symptoms are been communicated to dispatchers reported that only 31% of patients discharged with a diagnosis of stroke/tia were assigned a dispatch determinant of stroke in centers using MPDS protocols. 11 In our study, we determined the TABLE 2. Accuracy of Stroke Recognition by Emergency Medical Dispatchers and Paramedics in City of San Diego during the year 2005. Yes No Yes 515 882 42% + No 90 163 TOTAL 440 605 1045 83% * Yes No Yes 477 40% + No 321 568 TOTAL 440 605 1045 44% * True Positive Patients with EMD determinant or paramedic assessment of stroke and discharge diagnosis of stroke False Negative Patients with EMD determinant or paramedic assessment other than stroke and a discharge diagnosis of stroke False Positive Patients with EMD determinant or paramedic assessment of stroke and a discharge diagnosis other than stroke. * Sensitivity of stroke recognition True Positive/ True Positive+ False Negative Positive Predictive Value of stroke recognition True Positive/True Positive False Positive Speci city and Negative Predictive values not calculated in this study.

312 PREHOSPITAL EMERGENCY CARE JULY /SEPTEMBER 2008 VOLUME 12 /NUMBER 3 accuracy of emergency medical dispatchers with a high compliance to the MPDS stroke protocols and our results showed high sensitivity (85%) and moderate positive predictive value (42%) for stroke recognition. It is likely that this difference in sensitivity maybe from low number of false negatives in our study sample. Many of the subtle presentations of strokes may have been missed by EMD and since we did not obtain final diagnosis on all medical aid calls, our sensitivity values may appear higher than in the previous studies. Also, higher sensitivity maybe a result of increase in knowledge about stroke among our EMD thereby, leading to better stroke recognition. Even though in our discussion we state that training may be an important factor in stroke recognition, a better understanding of the training factor and its role in EMD recognition of stroke should be achieved through future studies. Recent studies by Hurwitz et al and Liferidge et al reported that laypersons or untrained adults could administer the CSS to patients and return the findings to the investigator successfully when directed by simulated dispatchers. 22,23 The use of such novel strategies may further help to improve dispatch recognition of stroke and expedite stroke triage in the prehospital setting. Paramedics play an important role in the recognition, triage, expedited transport and management of stroke patients. In our study, we noted the sensitivity of paramedics for stroke recognition is about 44% and a positive predictive value of 40%. Smith and colleagues reported a higher sensitivity (61%) and positive predictive value (77%) among paramedics not using prehospital stroke scales. 24 Also, during the validation phase of the Cincinnati Stroke Scale, paramedic sensitivity of 59% was higher than values reported in our study. 25 Bray and colleagues reported a sensitivity of 78% among paramedics in their system and showed an increase in sensitivity among paramedics after educational session and use of a stroke scale. 26,27 Wojner-Alexandrov and colleagues reported increase in sensitivity for paramedics after use of Los Angeles Prehospital Stroke Screen (LAPSS) and monthly paramedic education. 28 The reasons for low sensitivity among our paramedics may be multi-factorial. Paramedics may have coded stroke symptoms as Altered Neurological Function but, this was not included in our database. This may underestimate the number of true positive strokes or increase the number of false negatives leading to lower sensitivity for paramedic recognition. Although, missing data from paramedic records were captured in the study but we did not screen for documentation errors in paramedic charts which may have contributed to less accurate estimate of sensitivity and predictive value. Even though paramedics use the Cincinnati Stroke Scale, we did not assess the knowledge or variability among the providers during the study period. It has been shown in prior studies that paramedic education improves stroke recognition and therefore, our paramedics receive a refresher course on stroke. However, the duration of knowledge retention and frequency for training sessions have not been established and may be an area of future study. LIMITATIONS Although we have taken steps to ensure reliable data extraction from the various databases, a number of inherent limitations of retrospective study design must be noted. In a retrospective study, data is not primarily collected for study purposes and therefore, one of the limitations includes lack of completeness of databases. Emergency Medical Dispatchers and field providers may not always record their assessments leading to missing data fields. However, in our study sample we found only a small number of missing data due to electronic data collection thereby minimizing the impact of missing data on study results. A major limitation resulting from the retrospective nature of the study is that we did not follow all medical aid calls to determine the outcomes. This was due to the large volume of calls received at the FCC and inability to follow patients transported by multiple EMS agencies to different destinations across the county, with the limited research resources. Hence, we could not reliably obtain the population of true negatives. Therefore, we were unable to calculate the specificity and negative predictive values of the MPDS stroke protocol and Cincinnati Prehospital Stroke Screen in our system. The calculation of emergency medical dispatcher or paramedic sensitivity is somewhat limited since false negatives were defined as patients with a stroke registry diagnosis of stroke and prehospital diagnosis other than stroke. The results may be more accurate if we also followed all patients with prehospital diagnoses other than stroke. However, as stated above, this was not feasible with the resources and datasets available for the research study. Further limitations include restricted generalizability of the study results to non-urban EMS agencies. However, if the compliance of the emergency medical dispatchers to the MPDS Stroke protocol is known to be high as in our system, the accuracy of the stroke recognition in any EMS system may be similar to our results. While compliance to dispatch protocols is known, there is no measure of paramedic compliance or variability among our paramedics in our EMS system. Hence, we can only conclude about the accuracy of paramedics using the Cincinnati Prehospital Stroke Scale and not validate the Cincinnati Prehospital Stroke Scale using this retrospective study design. Lastly, while the stroke team adjudicated the stroke team diagnosis, we cannot comment on the validity of the ICD-9 codes or hospital discharge diagnosis for patients not included in the stroke registry. However, due to lack of other outcome data, they serve as the gold standard for determining prehospital accuracy of stroke recognition.

Ramanujam et al. STROKE RECOGNITION BY EMD AND PARAMEDICS SAN DIEGO EXPERIENCE 313 CONCLUSIONS Emergency Medical Dispatchers have a high sensitivity for stroke recognition in our system but both EMD and paramedics have similar positive predictive value for stroke recognition. References 1. Adams H, Adams R, Del Zoppo G, Goldstein LB. Stroke Council of the American Heart Association; American Stroke Association. guidelines for the early management of patients with ischemic stroke: 2005 guidelines update. A scientific statement from the Stroke Council of the American Heart Association/American Stroke Association. Stroke. 2005;36(4):916 923 2. Wester P, Radberg J, Lundgren B, Peltonen M. Factors associated with delayed admission to hospital and in-hospital delays in acute stroke and TIA: a prospective, multicenter study. Seek- Medical-Attention-in-Time Study Group. Stroke. 1999;30(1):40 48. 3. Agyeman O, Nedeltchev K, Arnold M, Fischer U, Remonda L, Isenegger J, Schroth G, Mattle HP. Time to admission in acute ischemic stroke and transient ischemic attack. Stroke. 2006;37(4):963 966 4. California Acute Stroke Pilot Registry (CASPR) Investigators. Prioritizing interventions to improve rates of thrombolysis for ischemic stroke. Neurol. 2005;64(4):654 659. 5. Kothari RU, Pancioli A, Liu T, Brott T, Broderick J. Cincinnati prehospital stroke scale: reproducibility and validity. Ann Emerg Med. 1999;33(4):373 378. 6. Bray JE, Martin J, Cooper G, Barger B, Bernard S, Bladin C. Paramedic identification of stroke: community validation of the melbourne ambulance stroke screen. Cerebrovasc Dis. 2005;20(1):28 33. 7. Kidwell CS, Starkman S, Eckstein M, Weems K, Saver JL. Identifying stroke in the field. Prospective validation of the Los Angeles prehospital stroke screen (LAPSS). Stroke. 2000;31(1):71 76. 8. Dispatch Protocol Systems, The good the bad and the ugly. Available at: http://www.emergencydispatch.org/articles/ ProtocolSystems.html. Accessed Nov 22, 2007. 9. Dunford JV. Emergency medical dispatch. Emerg Med Clin North Am. 2002;20(4):859 875. 10. Ellison SR, Gratton MC, Schwab RA, Ma OJ. Prehospital dispatch assessment of stroke. Mo Med. 2004;101(1):64 66. 11. Rosamond WD, Evenson KR, Schroeder EB, Morris DL, Johnson AM, Brice JH. Calling emergency medical services for acute stroke: a study of 9-1-1 tapes. Prehosp Emerg Care. 2005;9(1):19 23. 12. Porteous GH, Corry MD, Smith WS. Emergency medical services dispatcher identification of stroke and transient ischemic attack. Prehosp Emerg Care. 1999;3(3):211 216. 13. Kothari R, Barsan W, Brott T, Broderick J, Ashbrock S. Frequency and accuracy of prehospital diagnosis of acute stroke. Stroke. 1995;26(6):937 941 14. Nor AM, McAllister C, Louw SJ, Dyker AG, Davis M, Jenkinson D, Ford GA. Agreement between ambulance paramedic- and physician-recorded neurological signs with Face Arm Speech Test (FAST) in acute stroke patients. Stroke. 2004;35(6):1355 1359. 15. County of San Diego. Available at: http://www2.sdcounty. ca.gov/hhsa. Accessed Nov 22, 2007. 16. State and County Quickfacts. Available at: http://quickfacts. census.gov/qfd/states/06/06073.html. Accessed Nov 22, 2007. 17. Kamigaki AS, Kotz KJ, Kurata JH, Hayashi T, Troyan JL, Owh S, Himathongkham S, Lianov LS, Pheatt N, Hernandez M. Heart Disease and Stroke in California: Surveillance and Prevention. Sacramento, CA: Chronic Disease Epidemiology and Control Section, California Department of Health Services, 2002. Chronic Disease Epidemiology and Control Section Website. Available at: http://www.dhs.ca.gov/ps/cdic/chronic/cardiobrochure.pdf. Accesssed Oct 10, 2007. 18. Accreditation. Available at: http://www.emergencydispatch.org /framesett.html Accessed May 3, 2007. 19. Moorehead GV, Koehler GA. Emergency medical services dispatch training guidelines. California Emergency Medical Services Authority. EMS #132. March 1986. Available at: http:// www.emsa.cahwnet.gov/legislation/emdguide.asp. Accessed Mar 30, 2007. 20. The National Academies of Emergency Dispatch. Available at: http://www.emergencydispatch.org/articles/whatis.html. Accessed Mar 31, 2007. 21. Kothari R, Hall K, Brott T, Broderick J. Early stroke recognition: developing an out-of-hospital NIH Stroke Scale. Acad Emerg Med. 1997;4(10):986 990. 22. Liferidge AT, Brice JH, Overby BA, Evenson KR. Ability of laypersons to use the cincinnati prehospital stroke scale. Prehosp Emerg Care. 2004;8(4):384 387. 23. Hurwitz AS, Brice JH, Overby BA, Evenson KR. Directed use of the cincinnati prehospital stroke scale by laypersons. Prehosp Emerg Care. 2005;9(3):292 296. 24. Smith WS, Corry MD, Fazackerley J, Isaacs SM. Improved paramedic sensitivity in identifying stroke patients in the prehospital setting. Prehosp Emerg Care. 1999;3(3):207 210. 25. Kothari RU, Pancioli A, Liu T, Brott T, Broderick J. Cincinnati prehospital stroke scale: reproducibility and validity. Ann Emerg Med. 1999;33(4):373 378. 26. Smith WS, Isaacs M, Corry MD. Accuracy of paramedic identification of stroke and transient ischemic attack in the field. Prehosp Emerg Care. 1998;2(3):170 175. 27. Bray JE, Martin J, Cooper G, Barger B, Bernard S, Bladin C. An interventional study to improve paramedic diagnosis of stroke. Prehosp Emerg Care. 2005;9(3):297 302. 28. Wojner-Alexandrov AW, Alexandrov AV, Rodriguez D, Persse D, Grotta JC. Houston paramedic and emergency stroke treatment and outcomes study (HoPSTO). Stroke. 2005;36(7):1512 1518.