How To Write A Data Collection And Performance Report For The District Of Illinois

Transcription

1 fial report ITS Performace Measures Detailed Defiitio of Performace Measures prepared for Florida DOT District 4 prepared by Cambridge Systematics, Ic. 82 East Park Aveue, Suite 23 Tallahassee, Florida 323 date November 25

2 ITS Performace Measures Table of Cotets. Itroductio Recommeded Performace Measures Outcome Measures Beefit/Cost Measures Output Measures Fuctioal Requiremets of the Data Archive Reportig Format...4- Weekly Report (optioal)...4- Evet Report (optioal)...4- Mothly Report...4- Quarterly Report Aual Report Required Report for Statewide ITS Measures Assessmet of the FDOT District 4 Performace Measuremet Program Appedix A...A- Appedix B... B- i

3 ITS Performace Measures List of Tables Table 2. Recommeded Performace Measure Matrix Table 3. Data Archive Fuctioal Requiremets for Performace Measures ii

4 ITS Performace Measures. Itroductio Performace measures provide accoutability to the public ad ehace commuicatio betwee the operators ad users of the system. They ca aid i settig policy, allocatig resources, ad reportig o results. At the statewide level, the Florida Trasportatio Commissio (FTC) is charged with evaluatig the performace, operatioal productivity, ad fiscal maagemet of the Florida Departmet of Trasportatio (FDOT). The review icludes performace measures o 8 major programs withi FDOT; the impacts of itelliget trasportatio systems (ITS) deploymets have ot yet bee recorded but a set of statewide ITS performace measures curretly are beig developed. This task aims to help District 4 defie performace measures to meet objectives of the statewide reportig ad to measure performace operatios activities of the District. Specifically, this report will detail the measures selected by District 4 for periodic reportig ad specify the eeded fuctioal requiremets for the developmet of a data archive. This report is the secod ad fial of two reports to idetify ad recommed performace measures to assess the ITS program i District 4. The focus of the District 4 ITS performace measuremet program is to measure outcomes ad activities that are resposibilities of the Traffic Operatios Divisio. The measures reported will be the accoutability assessmet of the District s ITS Program. Data o activities coducted by parter agecies may be collected but will ot be reported as part of this program. The first report produced i May 25 describes the developmet of a data collectio pla ad performace measures that will complemet a umber of existig FDOT activities ad assist i achievig the goals ad objectives established by the District. This task is iteded to assist the District i meetig the goals ad objectives of the ITS Busiess Pla ad i achievig the stated visio of beig the umber oe ITS program i the Uited States ad will further the District as a leader i Florida i data collectio ad performace moitorig. This report begis by idetifyig five geeral performace measure categories ad 6 selected performace measures ad the data required to support the reportig of those measures. A recommeded set of fuctioal requiremets for a District 4 data archive is preseted alog with the curret status of each of those requiremets. I the fial sectio lists of suggested measures for differet audieces is preseted. The appedix icludes a example mock-up of a District 4 mothly performace report. -

5 ITS Performace Measures 2. Recommeded Performace Measures This sectio of the report presets detailed defiitios of outcome ad output performace measures itroduced i the Data Collectio ad Performace Measures Report. These performace measures will aid i achievig a umber of District Busiess Pla goals ad fulfillig statewide requiremets for Florida s ITS Program. Outcome measures relate to how well the agecy is meetig its missio ad stated goals. These measures will allow the District to report o the beefits of the ITS program from the perspective of the ultimate customer the travelig public. I some cases outcomes measures will use ITS data to assess the outcome of District activities that are beyod the cotrol of the Traffic Operatios Divisio or eve the FDOT. Output measures relate to the physical quatities of items, levels of effort expeded, scale or scope of activities, ad the efficiecy i covertig resources ito a product. These are sometimes called efficiecy measures ad will allow the District to evaluate the effectiveess of their ITS operatios. It should be oted that the goal of the FDOT District 4 ITS program is to measure the performace of all the FIHS roadways withi the District. Curretly, ITS equipmet is available o a portio of the freeways i the District. I the ear future there is ulikely to be sigificat data available o o-istrumeted roadways, particularly arterials. Maually collected data will be used as it is available ad over time the ITS coverage will be expaded to the etire FIHS. 2. OUTCOME MEASURES Cogestio ad Reliability Measures that capture average cogestio coditios ad those that idetify travel reliability, or the variability i performace of the selected route. Icidet Duratio Measures that capture icidet coditios ad delay from travel lae blockages. Customer Satisfactio Measures that capture the perceptio of users of the trasportatio system ad ITS ifrastructure. 2.2 BENEFIT/COST MEASURES Beefit/cost measures are eeded to idicate the effectiveess of compoets of the District s ITS program or the program as a whole. As District 4 s program is 2-

6 ITS Performace Measures beig developed the etire program will be measured i terms of beefits ad costs. As the program matures idividual program elemets also may be measured. The Federal Highway Admiistratio defies performace measuremet as a process of assessig progress toward achievig predetermied goals, icludig iformatio o the efficiecy with which resources are trasformed ito goods ad services (outputs), the quality of those outputs (how well they are delivered to cliets ad the extet to which cliets are satisfied) ad outcomes (the results of a program activity compared to its iteded purpose), ad the effectiveess of govermet operatios i terms of their specific cotributios to program objectives. Iput measures idicate the resources that go ito a process ad they useful i reportig efficiecy measures (iput versus output to show productivity ad cost-effectiveess). A beefit/cost measure takes both the outputs ad outcomes of the program ito accout, which is why this report icludes these measures as a separate category. 2.3 OUTPUT MEASURES System Coverage Measures that capture the coverage of traffic detectors, video cameras, traveler iformatio, ad commuicatios equipmet. Traffic Flow Measures that capture the performace of traffic flow o the roadway etwork. Icidet Maagemet Measures that capture icidet maagemet performace. System Performace Measures that capture the equipmet availability ad performace. Traveler Iformatio Measures that capture the use ad performace of traveler iformatio ifrastructure. The complete list of recommeded performace measures are preseted i Table 2.. Orgaized by the outcome ad output measures categories described above, the table details the specific performace measures, with a brief defiitio, a list of qualifiers for the measure (i.e., recommeded time respose), its status (whether it is a existig district measure, a ew performace measure, or is uder developmet the procedures ad/or ifrastructure are ot yet i place to evaluate the measure), a referece to the formula (listed i Appedix A), ad data eeds. The data eeds colum details raw data eeds to report o each idividual measure, as well as the status (existig or ew data field) ad the source of the data poits (i.e., SMART ad/or SuGuide, see Detailed Defiitio of Performace Measures, May 25 for descriptios of these systems). The followig details the qualifiers ( Reported By ) cotaied i Table 2. ad the potetial beefits they may have: 2-2

7 ITS Performace Measures Roadway Segmets of roadway o the etwork. This may aid i idetifyig problem areas or sectios that eed further aalysis, more istrumetatio, ad/or closer proximity of emergecy equipmet. Time period Time of day, day of week, moth, seaso, year. This may aid i idetifyig temporal or seasoal problem areas as well as provide a historical referece. Icidet severity Icidet severity level as defied by the Florida DOT. This may aid i idetifyig ways to better allocate resources ad provide a better uderstadig of the icidets. Type of icidet Accidet, road work, disabled vehicle. This may aid i idetifyig improvemets for icidet maagemet strategies. Type of equipmet Equipmet or software type. This may aid i idetifyig problem equipmet. System The etire trasportatio etwork uder study, which curretly is the freeway etwork i Broward Couty. This may aid i idetifyig overall performace ad areas for improvemet. It should be oted that the area withi District 4 is covered by the South Florida 5 traveler iformatio system. This system is maaged ad reported by FDOT District 6, therefore 5 activities are ot icluded i this report. 2-3

8 ITS Performace Measures Table 2. Recommeded Performace Measure Matrix Measure Outcome Measures Cogestio Travel Time Idex Total Delay Percet of Cogested Traffic Defiitio The ratio of average travel time to a free flow travel time. The additioal time that is icurred whe actual travel times are greater tha free-flow travel times. The ratio of cogested VMT to total VMT. VMT is the sum of distaces traveled by all motor vehicles i a specified highway system for a give period of time. Performace Measure Reported By (as available) Uits Roadway, time period, system Noe Mothly () Roadway, time period, system Vehicle-Hours Aually (2) Roadway, time period, system Percetage Aually (3) Data Needs Reportig Frequecy Formula Data Required Status Source Use of Measure Actual travel time Speed (from detectors) Free flow travel time Free flow speed Actual speeds for each road segmet New New SuGuide SuGuide Distace Existig SuGuide Actual travel time New SuGuide Free flow travel time New SuGuide Total VMT Total traffic volume x the legth of the road sectio (for the time period of iterest) Cogested VMT Traffic volume x the legth of the road sectio that occurs below a preset threshold (for the time period of iterest) Existig Existig SuGuide SuGuide Idicates cogestio level. Reportig is required by FHWA ad FDOT Cetral Office. Plaers travel time as alterative to level of service. Idicates cogestio level. Alterate idicator to Travel Time Idex. Should be calculated mothly ad summed for aual reportig. Idicates cogestio level. Alterate idicator to Travel Time Idex. Should be calculated mothly ad summed for aual reportig. Travel Time Reliability Plaig Time Idex The 95 th percetile travel time idex. Roadway, time period, system Noe Aually (4) Travel time idex New SuGuide Idicates variability of roadway cogestio. Alterate idicator to Buffer Idex. Should be calculated mothly ad summed for aual reportig. Buffer Idex The extra time most travelers add to their average Roadway, time period, system Percetage Mothly (5) Actual travel time: New SuGuide Idicates variability of roadway cogestio. I travel time whe plaig trips. urba areas travel time reliability provides a customer experiece idicatio of freeway perform- Volume Speed ace. Reportig is required by FHWA ad FDOT Cetral Office. Free flow speed Distace Accuracy of Cogestio (Travel Time) Iformatio Differece betwee predicted travel time iformatio preseted to public ad the actual travel time experieced. Roadway, time period, system, evacuatio Miutes, Percetage Aually (6) uder developmet Actual travel time: Volume Speed New TMC Operators Idicates validity of the travel time algorithm ad accuracy of system detectors. Should be calculated mothly ad summed for aual reportig. Free flow speed Distace Predicted travel time New TMC Operators Icidet Duratio Total Icidet Duratio Differece i time from whe first agecy is otified util all evidece of the icidet is removed. Roadway, a.m./p.m. peak, ad off-peak time period, icidet severity, icidet type Miutes Weekly (7) Time of icidet a occurrece Existig SMART Time of retur to ormal traffic flow (if ot possible, time whe Road Rager leaves site) b Existig SMART Idicates the total time of icidet impact. Measures overall efficiecy of TIM activities by parterig agecies. 2-4

9 ITS Performace Measures Measure Icidet Duratio (cotiued) TMC Detectio Time Period Defiitio The differece betwee whe the TMC is otified ad whe ay agecy is otified. Performace Measure Reported By (as available) Roadway, a.m./p.m. peak, ad off-peak time periods Uits Data Needs Reportig Frequecy Formula Data Required Status Source Use of Measure Miutes Weekly (8) Time of icidet a occurrece Existig SMART Time of iitial otificatio Existig SMART Measures the time it takes other agecies to otify the TMC. Value is zero whe TMC detects the icidet. A measure of agecy coordiatio. TMC Verificatio Time Period The differece betwee the iitial TMC otificatio time ad whe the icidet is verified. Roadway, a.m./p.m. peak, ad off-peak time periods Miutes Weekly (9) Time of iitial otificatio Existig SMART Time of verificatio Existig SMART Measures camera coverage ad Road Rager coverage, which are the primary factors i reducig verificatio time. TMC Respose Time Period The differece betwee the iitial TMC otificatio time ad the time Road Ragers/SIRV arrive. Roadway, a.m./p.m. peak, ad off-peak time periods, icidet severity Miutes Weekly () Track Road Ragers ad SIRV separately: Existig SMART Time of iitial otificatio Time of Road Rager (RR) arrival Existig SMART Measures time for Road Ragers/SIRV to arrive o the icidet scee. Provides a idicatio of Road Rager routes ad coverage areas. Road Rager Dispatch Time Period The differece betwee iitial TMC otificatio ad whe a Road Rager is cotacted for dispatch to a icidet. Road Rager Respose Time Period Icidet Clearace Time Period The differece betwee whe a Road is dispatched ad whe that Road Rager arrives at the icidet scee. The differece betwee the time Road Ragers/SIRV arrives ad the laes are cleared. Roadway, a.m./p.m. peak, ad off-peak time periods Roadway, a.m./p.m. peak, ad off-peak time periods Roadway, a.m./p.m. peak, ad off-peak time periods, icidet severity, lae Icidet Delay Total delay per lae mile. Roadway, a.m./p.m. peak, ad off-peak time periods, icidet severity Number of Secodary Icidets Customer Satisfactio Satisfactio with ITS Program Satisfactio with DMS Satisfactio with Traveler Iformatio SMART Suguide ad ITMS Web Site Satisfactio with Road Ragers Ease of Database Accessibility The umber of evets that occur due to the cogestio from the primary evet (desigated as secodary icidet by TMC). Percetage of respodets satisfied with overall ITS program. Percetage of respodets satisfied with DMS usage ad performace. Percetage of respodets satisfied with the traveler iformatio web site. Percetage of respodets satisfied with Road Ragers service. Percetage of parterig agecies satisfied with database accessibility. Roadway, a.m./p.m. peak, ad off-peak time periods, icidet severity Miutes Weekly () Time of iitial otificatio Time of Road Rager (RR) dispatch Miutes Weekly (2) Time of dispatch Time of Road Rager (RR) arrival Miutes Weekly (3) Vehicle-Hours Aually (4) Track Road Ragers ad SIRV separately Time of Road Rager (RR) arrival Existig SMART Compoet of TMC respose time. Existig SMART Compoet of TMC respose time. Existig SMART Time that the laes are cleared Existig SMART Icidet duratio Uder SMART Volumes Speeds Developmet Queue legth Needed SMART Number of blocked laes Existig SMART A measure of iteragecy coordiatio sice vehicle removal is primarily the resposibility of other agecies. Measures adherece to Ope Roads Policy. Provides a quatitative measure of the cogestio impacts of a icidet. Icidets Aually (5) Number of secodary crashes New SMART Provides a idicatio of reduced crashes, a importat public beefit of Icidet maagemet. Aual survey Percetage Aually Percetage resposes from survey Aual survey Percetage Aually Percetage resposes from survey Aual survey Percetage Aually Percetage resposes from survey Aual survey Percetage Aually Percetage resposes from survey User feedback/survey Percetage Aually Percetage resposes from survey Radom public survey results New Cetral Office/ District 4 Aual survey Radom public survey results New Cetral Office/ District 4 Aual survey Radom public survey results New Cetral Office/ District 4 Aual survey Radom public survey results New Cetral Office/ District 4 Aual survey User survey results New District 4 Aual survey Provides a qualitative measure of public satisfactio of the ITS program. Provides a qualitative measure of public satisfactio of the ITS program. Provides a qualitative measure of public satisfactio of the ITS program. Provides a qualitative measure of public satisfactio of the ITS program. Provides a qualitative measure of system usability ad idicates ay user problems with the database ad its accessibility. 2-5

10 ITS Performace Measures Measure Beefit/Cost Measures ITS Program Beefit/Cost Ratio Output Measures System Coverage ITS Miles Maaged Percet Ceterlie Miles Maaged Defiitio Total ITS program beefits divided by total program cost. Number of ceterlie miles covered/maaged by ITS equipmet i the etwork, (as defied i the 24 Statewide ITS Performace Measures report). Percet of ceterlie miles covered/maaged by ITS equipmet i the etwork. Performace Measure Reported By (as available) Uits Data Needs Reportig Frequecy Formula Data Required Status Source Use of Measure Program Ratio Aually Beefits/Cost Estimates of ITS beefits, icludig travelers time saved, freight time saved, crashes reduced, ad secodary crashes reduced. Total District ITS programs costs New FDOT District 4 Provides a overall idicatio of the effectiveess of the District s ITS program. Roadway Miles Aually (6) ITS roadway coverage Existig FDOT District 4 Measures ITS geographical coverage. Required by FDOT Cetral Office. Roadway type Percetage Aually (7) ITS roadway coverage Existig FDOT District 4 Idicates the portio of the roadway system covered by ITS. Number of ITS Devices Number of ITS devices. Type, roadway Devices Aually (8) Number of ITS devices Existig FDOT District 4 Idicates total umber of ITS devices. Traffic Flow Average Volume The average umber of vehicles. Roadway, time period Vehicles Aually (9) Traffic cout (detectors) New SuGuide Traffic volumes are used by FDOT Plaig. Average Occupacy Average Travel Time Average Desity The average percetage of time, durig the sample period, that the detector sesed a vehicle. The average time to traverse a give highway segmet. The average umber of vehicles that occupy oe mile of road space. Roadway, time period Percetage Aually (2) Traffic occupacy (detectors) New SuGuide Vehicle occupacy measures traffic desity. Occupacy is used i some traffic algorithms. Roadway, time period Miutes Mothly (2) Actual travel time New SuGuide Travel time is the basic measure of cogestio ad reliability. Roadway, time period Icidet Maagemet Total Number of Icidets Number of icidets maaged. Roadway,.a.m/.p.m peak, ad off-peak time periods, icidet severity TMC Icidet Detectio Method System by which the TMC was otified. Roadway, a.m./p.m. peak, ad off-peak time periods, icidet severity Icidet Level Severity of lae blockage icidets. Roadway, a.m./p.m. peak, ad off-peak time periods, icidet severity Icidet Maagemet Dollars Spet Per Icidet Respose Total Number of Requests for Road Rager/SIRV Respose Total Number of Road Rager/ SIRV Resposes Total Number of Road Rager/ SIRV Evets Icidet maagemet program aual cost divided by aual umber of icidet resposes. Number of requests for Road Rager respose. Number of Road Rager resposes logged. Number of Road Rager evets logged. Vehicles-Miles (all laes i a directio) Aually (22) Traffic flow (vph) Hourly equivalet of cout volumes: cout, speed, distace Icidets Weekly (23) Noe Weekly (24) Icidet detectio Icidet type Icidet severity Noe Mothly (25) Icidet detectio Icidet type Icidet severity Program Cost Aually (26) Icidet detectio Icidet type Icidet severity Roadway, time period, icidet type, couty, truck, beat, zoe, source Roadway, time period, icidet type, couty, truck, beat, zoe, source Roadway, time period, icidet type, couty, truck, beat, zoe, source Icidet type Existig SMART Icidet severity Existig SMART New SuGuide Desity is used i some traffic algorithms. A alterate to occupacy measure. Idicates level of TMC activity, used i maagig resource eeds ad beefit calculatios. Existig SMART Provides idicatio of the portio of icidets detected by TMC or Road Ragers. Existig SMART Trackig icidet severity provides stratificatio of icidets for icidet duratio calculatios. Existig SMART Cost of icidet maagemet program Existig FDOT District 4 Calls Mothly (27) Track Road Ragers ad SIRV separately: Call type Resposes Mothly (28) Track Road Ragers ad SIRV separately: Respose type Evets Mothly (29) Track Road Ragers ad SIRV separately: Evet type Provides a idicatio of the cost-effectiveess of the icidet maagemet program. Existig SMART Idicates level of Road Rager/SIRV activity. Differece betwee requests ad resposes idicates gaps i Road Rager coverage. Existig SMART Idicates level of Road Rager/SIRV activity. It will assist i Road Rager resource allocatio. Existig SMART Idicates level of Road Rager activity ad service performed. It will assist i Road Rager resource allocatio. 2-6

11 ITS Performace Measures Measure Defiitio Icidet Maagemet (cotiued) Total Number of Road Rager/ Number of Road Rager activities logged. SIRV Activities Average Road Rager/ SIRV Assistig Time Average Road Rager/ SIRV I-service Time Average legth of a Road Rager assist. Average legth of Road Rager service time the Road Rager is available to provide assists or be dispatched. Performace Measure Reported By (as available) Roadway, time period, icidet type, couty, truck, beat, zoe, source Roadway, time period, icidet type, couty, truck, beat, zoe, source Roadway, time period, icidet type, couty, truck, beat, zoe, source Uits Data Needs Reportig Frequecy Formula Data Required Status Source Use of Measure Activities Mothly (3) Track Road Ragers ad SIRV separately: Activity type Miutes Mothly (3) Track Road Ragers ad SIRV separately: Road Rager activity log Emergecy maagemet timelie Miutes Mothly Total time Road Ragers are i service/umber of RR vehicles Average Road Rager Billable Time Average legth of Road Rager billable time. Couty, truck, beat, zoe Hours Mothly Total Road Rager billable time/umber of RR vehicles Track Road Ragers ad SIRV separately: Road Rager activity log Existig SMART Idicates the type of service performed. It will assist i Road Rager resource allocatio. Existig SMART Idicates the service time of Road Ragers. It will assist i Road Rager resource allocatio. Existig SMART Idicates the service time of Road Ragers. It will assist i Road Rager resource allocatio. Road Rager activity log Existig SMART Idicates the service time of Road Ragers. It will assist i Road Rager resource allocatio. Number of Outgoig TMC Calls Number of outgoig TMC calls. Type Calls Mothly (32) Number of calls Existig TMC Operators Measures umber of times other agecies are cotacted by the TMC. Number of Icomig TMC Calls Number of icomig TMC calls. Type Calls Mothly (33) Number of calls Existig TMC Operators Idicates umber of times other agecies cotact the TMC. System Performace ITS Field Equipmet ad Commuicatios Equipmet Operatioal Field Equipmet Percetage Percet time equipmet is operatioal. Device type, roadway Percetage Mothly (34) Equipmet uptime Time of equipmet failure Existig Time of equipmet replacemet/repair/resolutio Existig Mea Time to Repair Average dowtime per prevetative or emergecy repair/failure. Device Hours Aually (35) Equipmet dowtime Time of equipmet failure Time of equipmet replacemet/repair/resolutio Mea Time Betwee Failures Average time betwee equipmet failure. Device Days Aually (36) Time of equipmet failure Time of equipmet replacemet/repair/resolutio Cost per Equipmet Repair/Failure TMC Software ad Hardware Device/Module Uptime Percetage Cost of repair ad impacts o a system due to a equipmet failure. Percetage of time a TMC device or software module is operatioal. TMC Operators TMC Operators Idicates ITS field equipmet ad systems reliability ad efficiecy of the ITS maiteace program. Existig SMART Idicates time eeded to detect ad repair equipmet. Measures efficiecy of maiteace program. Existig SMART Idicates how ofte a piece of equipmet fails. Provides iformatio o equipmet quality ad the maufacturer s warraty. Device Cost Aually (37) Cost of repair Existig FDOT District 4 Idicates cost of maitaiig a piece of equipmet. Provides iformatio o equipmet quality ad the maufacturer s warraty. Software module, server, switch, firewall, ad video wall cotroller Percetage Mothly (38) TMC hardware device uptime: Time of module failure, time of module replacemet/repair/resolutio Existig TMC IT Idicates TMC equipmet ad systems reliability ad efficiecy of the TMC maiteace program. Calls Set to IT Helpdesk Number of requests set the District IT Helpdesk. Category Calls Mothly (39) Calls Existig TMC IT Idicates the total umber of requests for IT assistace. Used to maage IT resource eeds. Helpdesk Calls Outstadig Number of uresolved Helpdesk request at the ed of the reportig period. Category Calls Mothly (4) Call uresolved Existig TMC IT Idicates calls that still eed to be resolved. Used to maage IT resource eeds. Helpdesk Calls Closed Number of Helpdesk requests that were completed. Category Calls Mothly (4) Calls resolved Existig TMC IT Idicates progress i completig requests for IT assistace. Helpdesk Call Close Time Time period from whe a call was received by the Helpdesk util it was closed. Category Days Mothly (42) Call resolve time Existig TMC IT Idicates time eeded to complete a request for IT assistace. Used to maage IT resource eeds. 2-7

12 ITS Performace Measures Measure Traveler Iformatio Defiitio Performace Measure Reported By (as available) Uits Data Needs Reportig Frequecy Formula Data Required Status Source Use of Measure Number of TMC Web Site Visits Number of web site visits. Time period, evet Hits Mothly (43) Web site hits Existig TMC IT Idicates how ofte the web site is used by the public. Also, idicates effectiveess of ITS marketig program. TMC Web Pages Visited Web page hits. Page Hits Mothly (43) Web site hits Existig TMC IT Idicates which pages are viewed most. Uused pages may be deleted or combied. Referrig Web Sites Referrig web sites. Site Sites Mothly (44) Referrig web pages Existig TMC IT Idicates where users foud referece to FDOT web site. TMC Web Site Visit Data Average web site visit data trasmitted. Site Bytes of data Mothly (45) Data trasmitted per visit Existig TMC IT Idicates how visitors use the web site ad provides idicatios of badwidth eeds. Number of DMS Messages Number of DMS messages. A.M./P.M. peak ad off-peak time period, type, evet Messages Mothly (46) Message type Existig SMART Idicates how ofte DMS are used. DMS Message Duratio Average legth of time a message is displayed. A.M./P.M. peak ad off-peak time period, type, evet Diversios Due to DMS Messages Number of DMS Messages Posted i Respose Aother Agecy Request Average icrease i detector (ramp) volumes whe a icidet message is displayed. Number of DMS messages requested by a differet agecy (i.e., eighborig district, cetral office). A.M./P.M. peak ad off-peak time period, type, evet A.M./P.M. peak ad off-peak time period, type, evet Messages Mothly (47) Message duratio Existig SMART Idicates how log DMS are used. Vehicles Mothly (48) Vehicle couts New SuGuide Idicates how may vehicles chage behavior due to DMS. Messages Mothly (46) Message type Existig SMART Idicates how ofte other agecies eed to utilize DMS ifrastructure. Message ower Existig SMART DMS Message Postig Time Differece i time from icidet verificatio to whe the first DMS message is posted o a sig. A.M./P.M. peak ad off-peak time period, type, evet Miutes Mothly (49) Icidet verificatio time Time whe first message is posted Existig SMART Idicates operator time eeded to post a message, measures operator efficiecy ad ease of software use. Note: For all data poits specified here, it is assumed that the locatio ad time ad date stamp of the measure is collected as well. a Actual time of icidet occurrece is difficult to measure ofte iitial otificatio time is used as evet start time. b Retur to ormal flow is difficult to measure ad will likely be a subjective estimate by operator. It is recommeded that the time whe all laes are ope be used util detector data ca be used to idicate retur to ormal flow. 2-8

13 ITS Performace Measures 3. Fuctioal Requiremets of the Data Archive Curretly, the FDOT District 4 TMC is i the process of testig the statewide SuGuide software for traffic data collectio ad archivig. The SuGuide software collects traffic data from vehicle sesors, cotrols CCTV camera ad DMS sigs, evaluates traffic coditios, maages icidets, provides iformatio to the geeral public ad trasportatio agecies, ad performs data loggig ad archivig. The FDOT District 4 TMC also is developig the System Maagemet for Advaced Roadway Techologies (SMART) Software for icidet data collectio ad archivig. The SMART software replaces FDOT s Icidet Database System ad Icidet Trackig Database System with a cetralized system that provides real-time access to icidet data ad supports mobile data collectio by Road Ragers ad Severe Icidet Respose Vehicles. The District also is buildig a ew SMART module to obtai ad archive traffic detector data. The fuctioal requiremets preseted here are based upo the discussios held with FDOT District 4 staff as well as the Cambridge Systematics experieces with reviewig data archives from other areas. The fuctioal requiremets preseted here are iteded to defie formally what eeds to be doe i TMC data archivig i order to report o the performace measures. A requiremet is marked with a sig if curret SMART/SuGuide system capabilities ca meet its eed, while a X sig meas additioal software developmet is eeded. Table 3. Data Archive Fuctioal Requiremets for Performace Measures. Provide for the collectio ad storage of several data types geerated by the deploymet of ITS ad operatioal systems throughout the District... Provide for storage of Roadway-Based Traffic Data Related Performace Measures: Cogestio ad Reliability, Traffic Flow, System Coverage... Provide storage of aggregatios of traffic data (time/space summaries of volume, speed, occupacy)... Provide storage of raw ( as received from field, uedited) data olie for at least 24-hours...2. Provide storage of raw data offlie for a period of at least oe year...3. Provide storage of aggregatios of 5-miute by lae 3-

14 ITS Performace Measures...4. Provide storage of aggregatios of -hour by statio (oe directio)...5. Provide storage of aggregatios of 24-hour by roadway (both directios).2. Provide for storage of Icidet Data o roadways uder the direct maagemet of traffic maagemet ceters Related Performace Measures: Cogestio ad Reliability, Icidet Duratio, Icidet Maagemet, Customer Satisfactio, System Coverage.2.. Provide for storage of poits o the icidet timelie as follows:.2... Icidet Start Time X Icidet Notificatio Time Icidet Verificatio Time Road Ragers/Law Eforcemet Dispatch Time Road Ragers/Law Eforcemet Arrival Time Additioal respoders (Fire, Rescue, EMS, Wrecker) Dispatch Time Additioal respoders Arrival Time Icidet Lae Blockage Clearace Time Icidet Scee Departure Time.2... Normal Traffic Resume Time X.2.2. Provide for storage of icidet characteristics as follows: Icidet type (e.g., crash, breakdow, debris) followig the District s defiitio Crash severity (icidet level) Number ad types of vehicles ivolved Icidet milepost locatio ad the locatio relative to the highway crosssectio: i-lae, shoulder, media, gore, ad combiatios of these The umber of laes affected.2.3. Provide capability to receive icidet iformatio from other TMC ceters.2.4. Provide capability to extract selected icidet data ad allow access to icidet data via exteral system iterfaces.2.5. Provide capability to log Road Ragers activities.3. Provide capability to collect ad store Roadway Weather Data Related Performace Measures: Cogestio ad Reliability, System Coverage.3.. Provide capability to itegrate roadway weather data with other (cogestio, icidet, closure) data by geographic locatio.3.2. Provide capability to access roadway weather data via exteral system iterfaces X X 3-2

15 ITS Performace Measures.4. Provide capability to capture ad store iformatio regardig Plaed Icidets (e.g., special evets, lae/road closures) Related Performace Measures: Icidet Duratio, Icidet Maagemet.5. Provide capability for storig DMS messages Related Performace Measures: Customer Satisfactio, Traffic Iformatio, Icidet Maagemet, System Coverage.5.. Provide capability to create message library to store ad recall DMS messages.5.2. Provide capability to provide access to traffic ad icidet (icludig road closures) iformatio to other ceters.5.3. Provide capability to receive DMS iformatio from other ceters.5.4. Provide capability to relate DMS messages to icidets.6. Provide capability for collectig ad storig Traffic Detector ad DMS Locatio Data Related Performace Measures: System Coverage, System Performace.6.. Provide capability for map displays of detector ad DMS locatios.6.2. Provide capability for matchig liear referece locatio of detectors ad DMS to other FDOT-maitaied data systems.6.3. Provide HPMS Sectio Idetificatios for all detectors ad DMS.7. Provide capability for collectig ad storig Traffic Detector ad DMS Istallatio ad Maiteace Activities ad Cost Related Performace Measures: System Coverage, System Performace.7... Type of activity X Activity start/ed times ad cost X Test results X Commets X.8. Provide capability for collectig ad storig Traveler Iformatio Web Site Activities. Related Performace Measures: Customer Satisfactio, Traveler Iformatio, System Coverage.8.. Provide capability for collectig ad storig web site visitor iformatio (umber of visits, duratios of visits, page requested, source IP address, referrig sites).8.2. Provide tools to moitor ad log web site health (peak periods, uptime, dowtime, repair cost, load time, trasactios, itrusios, server loads) 2. Provide for Traffic Data Processig Fuctios 2.. Data Trasformatios: Provide capability of trasformig ad storig field-measured data from roadway devices Related Performace Measures: Cogestio ad Reliability, Traffic Flow 2... Provide capability of trasformig spot speeds to travel times by assumig a lik legth of half the distace to earest upstream ad dowstream detectors Provide storage of lik travel times at the 5-miute by lae level X Provide capability of trasformig lae volumes ito maximum capacities by locatio X X X X X 3-3

16 ITS Performace Measures Provide storage of capacities at the 5-miute by lae level X Provide capability of trasformig spot speeds ito HCM-based levels of service (LOS) Provide storage of LOS at the -hour by directio level X 2.2. Traffic Data Imputatio: Provide capability of imputig missig roadway-based traffic data at the 5-miute by lae level Related Performace Measures: Cogestio ad Reliability, Traffic Flow 2.3. Traffic Data Quality Cotrol: Provide capability of assessig the quality of data received from roadway-based traffic detectors Related Performace Measures: Cogestio ad Reliability, Traffic Flow, System Performace Provide capability of automatically detectig data of poor or suspicious quality from roadway-based traffic detectors Provide periodic quality reports as follows: Provide Daily Detector Health Reports X Provide Quality Cotrol Test Results Report X Provide Normalcy Reports X Provide System Quality Cotrol Reports X 2.4. Likage to Legacy Systems: Provide capability of trasmittig data to other uits withi FDOT, as defied by eeds of FDOT District Provide capability of producig stadard traffic measuremets for use i Florida TTMS (AADT, K-/D-factors) Provide capability of sedig crash iformatio to safety office for idetifyig crashes ot reported by police officers o the Police Accidet Report X X X X X To esure data availability i performace measures, data archivig modules i SMART ad SuGuide should use the listed requiremets as a referece i their software developmet process. Special attetio should be give to the X marked requiremets that are ot yet implemeted i curret SMART ad SuGuide software. 3-4

17 ITS Performace Measures 4. Reportig Format It is recommeded that a umber of differet reports are used to covey the performace measures results to a variety of audieces. Visual represetatios of the data should be icluded i the reports (bar graphs, pie charts, ad maps, where appropriate). Iformatio regardig the previous reportig period ad (whe available) the same period from the previous year should be icluded as a referece to improve readers uderstadig of the performace measures by providig cotext ad showig treds of improvemet or regressio. Aberratios i the reports should be explaied i text. Weekly Report (optioal) Audiece: TMC maagers ad staff. Performace Measures: Curretly focused o icidet maagemet ad Road Rager activities. Optioal iformatio o traveler iformatio ad field device maiteace may be added as available. Evet Report (optioal) Audiece: TMC maagers, EOC maagers, other FDOT districts, ad the FDOT Cetral Office. The focus of this report is measures that best summarize hurricae (or other) evacuatio maagemet performace. Performace Measures Accuracy of cogestio iformatio Number of secodary icidets Traveler Iformatio Number of web page visits Number of DMS messages Diversios due to DMS messages Number of DMS messages maaged by differet agecy Mothly Report Audiece: TMC maagers ad staff. 4-

18 ITS Performace Measures Performace Measures: See Appedix B for a mock-up of the Mothly Report. Traveler Iformatio Smart SuGuide web site» Total visits» Web site data trasmitted Total umber of DMS messages Average DMS message duratio Number of DMS messages posted due to other agecy request DMS message postig time Icidet Maagemet Total icidet duratio TMC detectio time TMC verificatio time TMC respose time» Road Rager dispatch time» Road Rager respose time Icidet clearace time Total umber of icidets Icidet detectio method Icidet level (Lae blockig icidets) Number of requests for Road Rager respose Number of Road Rager resposes Number of Road Rager evets Number of Road Rager activities Average Road Rager assist time Cogestio ad Reliability Systemwide Travel Time Idex Systemwide Buffer Idex Speed map average speed or travel time (weekday peaks) by road segmet 4-2

19 ITS Performace Measures Devices (for detectors, CCTV, DMS, ad Road Ragers vehicles) Total umber of devices by type Operatioal field equipmet percetage TMC device/module uptime percetage Calls set to IT Helpdesk Calls to IT Helpdesk outstadig Calls to IT Helpdesk completed IT Helpdesk call close time System Coverage Number of outgoig TMC calls Number of icomig TMC calls Miscellaeous mothly Descriptio of oe or two worst icidets ad aalysis of these icidets Segmet of roadway where there are the most umber of icidets Project updates Discussio of evets that affected operatios Quarterly Report Audiece: FDOT District 4 maagemet, other FDOT districts, ad the FDOT Cetral Office. The focus of this report is outcome measures ad select output measures that best summarize a activity. These measures should be preseted i o more tha two or three pages. Performace Measures Cogestio ad Reliability Travel Time Idex Buffer Idex Total icidet duratio Number of icidets Number of severe icidets (Level 3) Traffic Flow Average speed Average travel time 4-3

20 ITS Performace Measures Aual Report Audiece: Florida Trasportatio Commissio, geeral public. The focus is o outcome measures ad a few high-level output measures. The existig aual report format is sufficiet for the iteral DOT aual report, but a high-level graphic-orieted brochure format may be better received by the public. Performace Measures Cogestio ad Reliability Travel Time Idex Total Delay Percet of cogested traffic Plaig Time Idex Buffer Idex Total icidet duratio Customer satisfactio survey results Traffic Flow Average travel time System coverage Number of icidets Cost per icidet respose Smart SuGuide web site visits Required Report for Statewide ITS Measures Audiece: These measures will be icluded i the Performace ad Productio Review of the Florida Departmet of Trasportatio published aually. Please ote that these requiremets have ot yet bee fialized. Performace Measures Total Aual Road Rager Stops (by District, State Total) FIHS Limited Access Miles Maaged by ITS (by District, State Total) Icidet duratio with breakout of respose time ad clearace time Cogestio ad Reliability Travel Time Idex Total Delay Percet of cogested traffic Plaig Time Idex Buffer Idex Customer satisfactio based o a radom geeral public survey 4-4

21 ITS Performace Measures 5. Assessmet of the FDOT District 4 Performace Measuremet Program FDOT District 4 is i the process of developig oe of the Natio s premier performace measuremet programs. The amout ad rage of data curretly beig collected is well beyod most traffic maagemet ceters performace measuremet programs. Whe traffic data begis to be collected ad archived the District will have a comprehesive performace measuremet program that will eable the District to assess all aspects of their ITS activities ad to describe to FDOT maagemet ad the public quatitative beefits of the ITS Program ad active maagemet ad operatios of the District s freeway system. The data collectio ad performace measuremet program described i this documet will eable FDOT District 4 to be a model program for TMCs across the Coutry. 5-

22 ITS Performace Measures Appedix A Appedix A List of equatios for Performace Measure ad Data matrix. Travel Time Idex: 2. Total Delay: 3. Percet of Cogested Traffic: For a specific road sectio ad time period : TT TTI TT For several TTI average Delay freeflow Total Delay VMT VMT PTI TTI road sectios ( TTI VMT ) ( VMT ) ( TT TT freeflow ) Delay cogested total % ad time periods :,, for each sectio ad time period for each sectio ad time period Volume 4. Plaig Time Idex: ( ) 2 PTI VMT, PTI average 95 th percetile VMT, for each sectio ad time period for each sectio ad time period Turer, S., R. Margiotta ad T. Lomax (24). Moitorig Urba Freeways i 23: Curret Coditios ad Treds from Archived Operatios Data, Texas Trasportatio Istitute ad Cambridge, Systematics, Ic., FHWA-HOP-5-8, Washigto, D.C. 2 Ibid. A-

23 ITS Performace Measures Appedix A TT BI 5. Buffer Idex: ( ) 3 BI VMT, 6. Accuracy of Cogestio Iformatio: 7. Total Icidet Duratio: 8. TMC Detectio Time Period: 9. TMC Verificatio Time Period:. TMC Respose Time Period:. Road Rager Dispatch Time Period: 2. Road Rager Respose Time Period: BI average th 95 percetile TT TT % VMT Methodology uder developmet Icidet Duratio t Total Icidet Duratio Average Icidet Duratio Detectio Time t, ormal flow Average Detectio Time Verificatio Time t for each sectio ad time period for each sectio ad time period i- t ID, for each icidet i- iitial otificatio AverageVerificatio Time Respose Time t Average Respose Time Dispatch Time t i- verificatio RR arrives Average Dispatch Time RR Respose Time t t DT t i- ID t RT icidet occurs VT icidet occurs iitial otificatio iitial otificatio i- t RR dispatch Average RR Respose Time i- DT TMC otificatio t RR dispatch i- RR arrives RRRT 3 Turer, S., R. Margiotta ad T. Lomax (24). Moitorig Urba Freeways i 23: Curret Coditios ad Treds from Archived Operatios Data, Texas Trasportatio Istitute ad Cambridge, Systematics, Ic., FHWA-HOP-5-8, Washigto, D.C. A-2

24 ITS Performace Measures Appedix A 3. Icidet Clearace Time: 4. Icidet Delay: 5. Number of Secodary Icidets: Icidet Clearace Time t laes cleared Average Icidet Clearace Time t i- CT RR arrives Methodology uder developmet, iterim formula is: total volume X icidet duratio (miutes) X 5 miutes per vehicle Total Secodary Icidets Average Secodary Icidets SI, for each icidet 6. ITS Miles Maaged: Total Miles Maaged mile for each mile maaged 7. Percet Miles Maaged: % Miles Maaged i- i-, SI Total Miles Maaged Total miles i system % 8. Number of ITS Devices: 9. Average Volume: 2. Average Occupacy: 2. Average Travel Time: 22. Average Desity: 23. Total Number of Icidets: 24. TMC Icidet Detectio Method: Total ITS Devices AverageVolume i- Average Occupacy Travel Time Average Travel Time Desity legth Average desity Icidets device volume i-, occupacy TT for each device of type volume volume t t, time take by a vehicle i- x 2 x i- avg vehicle Icidet Detectio i- icidets desity i legth, detectio zoe to traverse a occupacy for each qualifier of iterest icidets, for each detectio method fixed segmet A-3

25 ITS Performace Measures Appedix A 25. Icidet Level: Icidet severity icidets for each severity level 26. Icidet Maagemet Dollars Spet per Icidet: IM $ Total umber i- Icidet Maagemet $, of icidets 27. Road Ragers Calls: Total RR Calls RRcalls for each type of call ad time period, 28. Road Rager Resposes: Total RR Assists RRresposes, for each type of respose ad time period 29. Road Rager Evets: Total RR Evets RRevets for each type of evet ad time period, 3. Road Rager Activities: 3. Road Rager/SIRV Assistig Time: 32. Number of Outgoig Calls: 33. Number of Icomig Calls: 34. Operatioal Percetage: 35. Mea Time to Repair: 36. Mea Time betwee Failures: 37. Cost per Equipmet Repair: Total RR Activity RR Assist Time t Average RR Assist Time Total Outgoig Calls Total Icomig Calls RRactivity t, RRdeparts RRarrives Average Operatioal Percetage Repair Time t Average Repair Time Failure Time t Trouble Report Closed RRAT for each type of activity ad time period outgoigcalls icomigcalls t i,trouble Report Created Average Time Betwee Failure Average Cost for Repair Repair Time cost,, for each type of for each type of uptime total time Trouble Report Created t,, call call for each equipmet type for each equipmet type i-,trouble Report Closed Failure Time, for each equipmet type, for each equipmet type A-4

26 ITS Performace Measures Appedix A 38. Device Uptime Percetage: 39. Calls Set to IT Helpdesk: 4. Helpdesk Calls Outstadig: Percet Uptime Total Helpdesk Calls Device uptime total time for each type of Outstadig Helpdesk Calls call, for each equipmet type helpdeskcalls, for each type of call helpdeskcalls helpdeskcallsclosed, 4. Helpdesk Calls Closed: Helpdesk Calls Closed helpdeskcallsclosed for each type of call 42. Helpdesk Call Close Time: 43. Number of TMC Web Site Visits: Help Desk Call Close Time t callclosed Average Help Desk Call Close Time Total Hits webhits, t, callreceived HDCCT for each page ad time period 44. Referrig Web Sites: Referrig page web referral for each page ad time period 45. Web Site Visit Data: Web site data trasmitted per visit Number of bytes of data trasmitted 46. DMS Messages: Total DMS Messages message for each type, roadway ad time period 47. DMS Message Duratio: DMS Msg Legth t ed time Average DMS Msg legth t,, start time DMS ML, for each type ad time period 48. DMS Diversios: Diversios volume - AverageVolume, for each message 49. DMS Message Postig Time:,t DMS Postig Time t DMSstarttime Average DMS Postig Time t, t icidetverificatio DMS PT, for each type ad time period A-5

27 Appedix B ITS Performace Measures Appedix B 25 October Mothly SMART SuGuide TMC Performace Measures FDOT District 4 Traffic Operatios 34 West Commercial Boulevard Fort Lauderdale, Florida 3339 Notes Four ew CCTV cameras ad oe ew DMS sig were activated o Moday, October 7 as a part of ITS Deploymet Phase II. Oe ew Road Rager Uit was added. Costructio work o I-75 caused log delays ad high 5 call umbers. Icidet duratios ad umber of were sigificatly lower tha the previous moth whe major storms impacted the area. This Moth at a Glace Smart SuGuide Web Site Visits Total Visits 5, Web site Data Trasmitted 5 MB DMS Messages Total Number of DMS Messages 3 Average DMS Message Duratio 5 mi Number of DMS Messages Posted due to Other 5 Agecy Request DMS Message Postig Time 5 mi Icidets Maaged Icidet Duratio 2 mi TMC Detectio Time mi TMC Verificatio Time mi TMC Respose Time 8 mi Road Rager Dispatch Time 2 mi Road Rager Respose Time 6 mi Average Icidet Clearace Time mi Total Number of Icidets, Cogestio & Reliability Systemwide Travel Time Idex (weekday peakhours).2 Systemwide Buffer Idex (weekday peak-hours) 2% Devices Filed Equipmet Total Numbers Operatioal Percetage RTMS 8% CCTV 5 9% DMS 2 9% Road Ragers Vehicles 97% System Coverage Number of Icomig TMC Calls Number of Outgoig TMC Calls 9 B-

28 ITS Performace Measures Appedix B Smart SuGuide Web Site Visits Number of Website Visits Website Visits per Day Week Week 2 Week 3 Week 4 Last Moth W eekly Average Aual Weekly Average Visit Types 3 2 Retru V isits, 86% Su Mo Tue Wed Thu Fri Sat Curret Moth Average Last Moth Average Aual Average New Visits, 6% Udetectable, 9% 25 Mothly Website Visits 25 Website Data Trasmitted (i Mbytes) Ja Feb Mar Apr May Ju Jul Aug Sep Oct Nov Dec Ja Feb Mar Apr May Ju Jul Aug Sep Oct B-2

29 ITS Performace Measures Appedix B DMS Messages Number of DMS Messages Average DMS Message Duratios (miutes) Curret Moth Last Moth Aual Mothly I-95 I-75 I Curret Moth Average Last Moth Average Aual Average Number of DMS Message Posted due to Other Agecy Request Average DMS Message Postig Time (miutes) Curret Moth Last Moth Curret Moth Average Last Moth Average Aual Average B-3

30 ITS Performace Measures Appedix B Icidets Number of Icidets Icidets per Day Week Week 2 Week 3 W eek 4 Last Moth Weekly Average Aual Weekly Average Detectio Methods 5 5% 45% 4% 35% 3% 5 Su Mo Tue Wed Thu Fri Sat 25% 2% Curret Moth Average Last Moth Average Aual Average 5% % 5% % TMC Detected Caller Reported Others Icidet Types Others, 9% Special Evets, 3% Road kills, 9% Debris, 9% Stalled Vehicles, 9% Costructio/Maiteace, 57% Accidets, 57% Icidet Levels & Secodary Icidets Road Ragers Number of Level Icidets Number of Level 2 Icidets Number of Level 3 Icidets Number of Secodary Icidets Number of Requests Number of Resposes Number of Road Rage Evets Number of Road rager Activities Curret Moth Last Moth Aual Mothly Curret Moth Last Moth Aual Mothly B-4