Eye-Tracking Research in an A330 Full Flight Simulator Project at the Berlin University of Technology Institute of Aeronautics and Astronautics Funded by the Deutsche Akademie für Flugmedizin and the Zentrum für Flugsimulation Berlin (ZFB) Contact: Dipl.-Ing. Geerd Anders anders@ilr.tu-berlin.de Berlin University of Technology
Overview Environment: Flight simulator with Scientific Research Facility (SRF) Method: Measurement of head- and eye-movements Flight trials with professional airline pilots: Approach and landing Initial results Summary / Outlook A340/A330 Full Flight Simulator Overview
Equipment: iview-ht System by SensoMotoric Instruments (SMI) Cockpit Setup: Headband with mounted eye- and scene-camera Head-tracking transmitter and sensor Eye-Tracking Research in an A330 Full Flight Simulator
Subjects 16 professional pilots (Lufthansa, LTU and Condor) = 8 crews Ø age: 36,7 years, Ø piloting experience: 14,4 years and 7500 flight hours (4500 flight hours in glass cockpits) Scenario 4 destinations in Germany (Düsseldorf, Frankfurt, Munich and Stuttgart) Approach and landing (Descent from FL200 in managed mode, several altitude clearances, radar vectors (selected mode), ILS approach to touch down or go around) Air Traffic Control (ATC) by an instructor inside the simulator cockpit Weather: CAT I conditions, medium strong winds Concept 3 4 approaches for each crew, Captain as Pilot Flying (PF) Crew briefing, pre-flight preparation (charts, weather, ) Setup and calibration of the measurement equipment (for PF) Measurement of Eye-Point of Gaze (EPoG) data, head-tracking, video-recording and simulator data collection Debriefing, questionnaires and rating scales Experiment
Scene Video: Scene recorded by headmounted camera Eye-Point of Gaze display as cursor overlay in video!!! cursor DEMO overlay!!! Pilot Flying (subject) Cockpit Video: Environment recorded by ceiling-mounted camera Pilot actions and events Scene and Cockpit Video
Static Cockpit View: Point of gaze and simulator data Virtual Cockpit View: Eye- and head-movements Scene Video Eye- and head-movements Cockpit Video Events and actions, sound Visualization of Eye-Point of Gaze (EPoG) Data
The A330 Cockpit Average proportional fixation duration (n=25) 40 Overhead Panel (OCA) 35 OUT 30 Glareshield (GSc) FCU 25 MAP PFD ND E/WD ND PFD [%] 20 Main Panel (MPn) SD 15 MCDU (CDU) MCDU (CDU) 10 Center Pedestal (OCA) 5 0 PFD ND EWD SD GSc MPn CDU OCA MAP OUT N,N Areas of Interest Initial Results I: Areas of Interest (A330 Cockpit)
Attention Allocation to Areas of Interest (Average proportional fixation duration, n=25) FMA 40 35 SPD Artificial Horizon (AH) G / S ALT V / S 30 25 FRQ LOC HDG QNH [%] 20 15 [%] 10 8 6 4 2 10 5 0 FMA SPD AH ALT V/S HDG LOC G/S QNH FRQ N,N Areas of Interest within PFD 0 PFD ND EWD SD GSc MPn CDU OCA MAP OUT N,N Areas of Interest Initial Results II: Areas of Interest (Cockpit & PFD)
Number of Fixations Fixation Duration Average Proportion of Fixations Simulation Data (Alt-Spd-Hdg, FCU Actions, FMA Changes, Radio Comm.) Dynamic Attention Allocation (moving average, 40s) Fixations on Areas of Interests (timeline) Detailed EPoG Data Analysis in the Context of Simulation Data
Summary Definition of realistic flight scenarios (approach and landing) Measurement of eye- and head-movements of professional airline pilots inside an A330 full flight simulator Extensive data recording (EPoG, videos, simulation data, questionnaires) " 25 datasets from 7 crews are available for further analysis Analysis of the Pilot s Monitoring Behavior Descriptive parameters (attention allocation to areas of interest, fixation duration, transitions, scan-cycles, etc.) Dynamic data representation on a timeline Simulation context dependent (status, actions, events) Mental representation of information (subjective rating) Summary and Outlook