D-Lab3 Flexible Measurement and Analysis Environment Copyright Ergoneers GmbH 2013. All rights reserved.
1. Overview 2. General functions 3. Software Moduls & Measurement Devices 4. Outlook
1. Overview
Overview Jack of all trades for measurement and analysis of human behaviour An application to plan, synchronous measurement and analysis of any type of data sources Modular structur (any type of combination of available data sources) Frequency independence of the data sources Real-time visualization of all data sources Free-configurable layout (multi-monitor skills) Variety of data modules with specific analysis functions for each data source Integration of data from different data sources
Process Software Devices Overview CAN Bus: Peak DataStream: Network Fieldbus Videos: USB PAL IP & IP PTZ DVI Eye-Tracking: Head-Mounted Remote HMD Audio Physiology Motion Plan Measure Analyze
2. General Functions
General Functions Subject administration with subject attributes (for example age, gender, etc.) Task and event administration: o Online and offline coding and visualization o Manual and network controlled o Task based evaluation in statistical functions Separation of data and attributes of the study: o Local study planning (tasks, recording sources, screenlayout, etc.) and worldwide reproduction Study data administration: o Send out complete studies or substudies o Enables incremental evaluation and aggregation of the results
General Functions Comment function: Online und offline commenting with time reference Video cutting: o o Screenshots Save visualizations as videos Export of all raw data in table format Send to Ergoneers : direct online sending of the recording data on the FTP server for evaluation
Scripting language Create new data (channels, tasks, statistical values, actions) out of the existing data A multiplicity of available logical operators (for example mean, edge operator, relational operators, etc.) Formulas can be saved and be loaded again in other projects Examples: o o o Task only valid if at the beginning v > 50km/h and the glance in a specific AOI Calculation of the TLC out of lane position Reaction time after appearance of a specific event
3. Software Moduls & Measurement Devices
3.1 Eye-Tracking Head-Mounted
Measurement Devices Dikablis Eye-Tracking Glasses 3.0 o Cable o Mobile o Wireless Eye-Tracking frequency: 100Hz (monocular/binocular) Accuracy: o Pupil detection: 0,05 o Glance direction: 0,2 0,5 Camera viewing angle: 55-90 Portable with: o Normal glasses o Shutter glasses o Polarized glasses
Dikablis Cable Desktop PC D-Lab 3.0 USB 3 High-End Notebook / Ultrabook
Dikablis Mobile High-End Tablet 8 (e.g. Dell Venue Pro 8) Recording Can be carried in the pocket D-Lab3 runs on tablet
Dikablis Wireless Desktop PC Recording WLAN D-Lab 3.0 Save data locally Transmission of Reduced video data for realtime observation Geometry of pupils Fixation coordinates Marker coordinates High-End Notebook / Ultrabook
D-Lab Eye-Tracking Head-Mounted Live Eye-Tracking Automated marker based calculation of the glances towards AOIs o o Online: gaze control and gaze-contingent reaction Offline: analysis Offline optimization of pupil detection und recalibration (several calibration planes) Automatically AOI-based calculation of glance metrics (for example total glance time, number of glances, mean glance duration etc.) Glance visualization functions (HeatMap, ShadowMap, gaze path, and so on)
3.2 Eye-Tracking Remote
Measurement Devices Tobii Remote Tracker: o X2-30 o X2-60 o TX300 o T60XL o T60 & T120 o X60 & X120
D-Lab Eye-Tracking Remote Live Eye-Tracking Screen based and scene-camera based Automated calculation of glances towards AOIs o o Online: gaze control and gaze-contingent reaction Offline: analysis Automatically AOI-based calculation of the glance metrics (for example total glance time, number of glances, mean glance duration etc.) Glance visualization functions (HeatMap, ShadowMap, gaze path, etc.)
3.3 Eye-Tracking Virtual Reality
Components Dikablis HMD Cameras FullHD DVI Grabber Sensics: o xsight o zsight Vicon o Cameras: Bonita3, Bonita10, T-Series o Software: Tracker & Nexus WorldViz VR Software
System Layout Vicon Motion Capturing Cameras Computer with Vicon Tracker/Nexus Software Screen that shows WorldViz s virtual world and highlights the object the subject is looking at (or also shows crosshair) Position & Orientation Orientation HMD screen content Computer with WorldViz Software HMD screen content (grabbed via DVI grabber) x- and y-fixation coordinates in HMD s screen coordinate system Eye-Cam Video(s) Computer with D-Lab Eye-Tracking VR Software Screen that shows WorldViz s virtual world (grabbed via DVI grabber) and superimposed fixation crosshair
D-Lab Eye-Tracking Virtual Reality Live Eye-Tracking Automated marker based calculation of the glances towards AOIs o o Online: gaze control and gaze-contingent reaction Offline: analysis Offline optimization of pupil detection und recalibration (several calibration planes) Automatically AOI-based calculation of glance metrics (for example total glance time, number of glances, mean glance duration etc.) Glance visualization functions (HeatMap, ShadowMap, gaze path, and so on)
3.4 Video
Measurement Devices PAL cameras USB cameras IP cameras (with and without PTZ) o 640x480 o 800x600 o 1280x800 o 1280x960 o 1920x1080 DVI signals
D-Lab Video Synchronous recording und playback of several video channels with different resolutions Analysis of actions: o o o o Definition of the coding scheme (behaviors, behavior groups, participants, modifiers, comments) Flexible interval and sample coding Objectivity of sampling and coding Statistical evaluation of the coding Gaze-Video projection (in camera image or DVI signal)
Gaze-Video Projection with Projector or Monitor Projection wall or Monitor Computer that sends the video to a monitor or to a projector D-Lab laptop with modules D-Lab Eye-Tracking Professional and D-Lab Video Essential DVI Grabber FieldCam FieldCam films content of projection wall or monitor and at least one marker EyeCam(s)
Gaze-Video Projection with Projector or Monitor Laptop Screen Dikablis Eye-Tracking Video Video grabbed via DVI Grabber
Gaze-Video Projection with Camera(s) Scene Camera films cockpit and at least one marker D-Lab laptop with modules D-Lab Eye-Tracking Professional and D-Lab Video Essential Scene Camera Co-Pilot Pilot
3.5 DataStream - Network - Fieldbus
Measurement Devices Network interface TCP/IP: Any number of connections from several computers Wago measurement interface
D-Lab DataStream Variety of different configurable diagrams for visualization (for example: line chart, point chart, vector diagram, peak, and so on) One or more values per diagram Several subjects per diagram Variable x-axis (for example meters of advance as x-axis) Statistical function (subject, task, measured value, metric)
3.6 CAN Bus
Measurement Devices PEAK CAN card
D-Lab CAN Bus Read and store encrypted or decrypted (via dbc file) values from CAN Bus Variety of different configurable diagrams for visualization (for example: line chart, point chart, vector diagram, peak, and so on) One or more values per diagram Several subjects per diagram Variable x-axis (for example meters of advance as x-axis) Statistical function (subject, task, measured value, metric)
3.7 Audio
Measurement Devices Up to 16 microphones
D-Lab Audio Saved as separate audio channels Playback and audio visualization for selectable channels manual Transcription Speech to text (in the future) Word analysis via formula editor Statistical function (subject, task, word, metric)
3.8 Physio
Measurement Devices EEG EMG EKG, heart rate Skin conductance Breathing EOG Finger pulse Brightness Temperature Acceleration (1- and 3-axis)
D-Lab Physio Variety of different configurable diagrams to visualization (for example: line chart, point chart, vector diagram, peak, etc.) One or more values per diagram Several subjects per diagram Variable x-axis (for example meters of advance as x-axis) Physiological metrics (e.g. heart rate variability) based on measured raw data Statistical function (subject, task, measured value, metric)
3.9 Motion
Measurement Devices Vicon o Cameras: Bonita3 Bonita10 T-Series o Software: Tracker Nexus
D-Lab Motion Variety of different configurable diagrams to visualization (for example: line chart, point chart, vector diagram, peak, etc.) One or more values per diagram Several subjects per diagram Variable x-axis (for example meters of advance as x-axis) Eye-Hand-Body coordination Statistical function (subject, task, measured value, metric)
D-Lab Motion
4. Outlook
Outlook Distributed architecture Add further sensors Online formula editor GPS sensor Driving Environment Sensor Import of external data sources and subsequent synchronization Diagrams for data visualization (for example bar charts like in excel)