Operational Testing of Biometric Access Control Systems by the National Safe Skies Alliance (NSSA) Presented By: Valerie M. Lively, TSA Biometric Consortium Conference September 22 24, 2003 Transportation Security
National Safe Skies Alliance! Operational Test of Biometric Access Control Systems! Test bed located at the Knoxville McGhee Tyson Airport (TYS) in Knoxville, TN.! David Speaks, Sr. Test Engineer
Test Projects! Veriprint 2100 Optical Fingerprint System " Biometric Systems Inc., Completed Fall 2000! Handkey CR Hand Geometry System " Recognition Systems Inc., Completed Spring 2001! Portal Facial Recognition System " Lau Technologies Inc., Completed Fall 2001! IrisAccess 2200T Iris Recognition System " Iridian Technologies Inc., Completed Spring 2002
Test Projects (cont.)! FingerPunch Ultrasound Fingerprint System " Ultra-Scan Corporation, Completed Fall 2002! MorphoAcess Optical Fingerprint System " Sagem Corporation, Completed Winter 2002 " Outdoor version is currently being tested at the Jackson International Airport, Jackson, MS.! V-Flex Chip Fingerprint System " Bioscrypt Inc., Completed Spring 2003
TYS Test Approach! All tests at TYS have been conducted on a single administrative door.! Active users for the door totals approximately 25 persons using the door 1-2 times each per day on average.! TYS employees use magnetic stripe badges! Consistently using the same door has been important to provide a baseline when comparing the performance of biometric systems.
Measurable Parameters! Two categories associated with judging the success of door access control: A. Degree of security provided B. Amount of inconvenience
Measurable Parameters - A What is the likelihood of the system allowing an unauthorized person to transit the door?! Two measurable parameters associated with this question are part of the Safe Skies testing of biometrics: " False Acceptance Rate (FAR) " Rate of successful entry by unauthorized personnel using specific techniques to defeat the system
Measurable Parameters - B! The parameters associated with inconvenience to the user that are typically evaluated during Safe Skies biometric testing are: " The time required to enroll into the biometric system " The Failure to Enroll Rate (FTE) " The additional time required by the user to transit the door (throughput rate) " The False Reject Rate (FRR) under normal conditions " The FRR under specified abnormal conditions than those present when the subject was enrolled (different lighting, dirty fingers, wearing glasses/no glasses, etc.) " Ergonomic ease/difficulty for credential or biometric presentation (survey)
Test Results Biometric Access Control Comparison Device Failure to Enroll Rate Enrollment Time Transit Time (secs) Airport Employee FRR Safe Skies Test Subject FRR FAR Overall User Satisfaction Rating Veriprint 2100 Fingerprint 5.30% 3:30 9.40 17.70% 12.10% 1.30% 3.44 HandKey CR Hand Geometry 0:57 8.00 4.17% 0.11% 2.33 Lau Portal Facial Recognition 3:00 11.50 26.20% 2.50% 0.19% 2.33 IrisAccess 2200T 2:16 14.20 0.60% N/A 2.33 UltraScan FingerPunch Fingerprint 1:49 11.79 12.31% 9.90% 2.14 Sagem MorphoAccess Fingerprint 1:29 8.01 0.70% 2.20% 1.14 Bioscrypt V-Flex Fingerprint 1:38 5.38 2.60% 6.60% 0.40% 1.14
Test Results (cont.) False Rejection Rate 30% Airport Employee 25% Safe Skies 20% 15% 10% 5% 0% Iris Recognition Optical Fingerprint Fingerprint Hand Geometry Ultrasonic Fingerprint Optical Fingerprint Facial Recognition
Contact Information Valerie M. Lively Transportation Security Laboratory Access Control and Analysis Technologies Building 315 William J. Hughes Technical Center Atlantic City International Airport, NJ 08405 609-485-7220 (voice) 609-383-1973 (fax) Valerie.Lively@faa.gov Valerie.Lively@dhs.gov