D-Lab3 Flexible Measurement and Analysis Environment. Copyright Ergoneers GmbH All rights reserved.

Transcription

1 D-Lab3 Flexible Measurement and Analysis Environment Copyright Ergoneers GmbH All rights reserved.

2 1. Overview 2. General functions 3. Software Moduls & Measurement Devices 4. Outlook

3 1. Overview

4 Overview Jack of all trades for measurement and analysis of human behaviour An application to plan, synchronous measurement and analysis of any type of data sources Modular structur (any type of combination of available data sources) Frequency independence of the data sources Real-time visualization of all data sources Free-configurable layout (multi-monitor skills) Variety of data modules with specific analysis functions for each data source Integration of data from different data sources

5 Process Software Devices Overview CAN Bus: Peak DataStream: Network Fieldbus Videos: USB PAL IP & IP PTZ DVI Eye-Tracking: Head-Mounted Remote HMD Audio Physiology Motion Plan Measure Analyze

6 2. General Functions

7 General Functions Subject administration with subject attributes (for example age, gender, etc.) Task and event administration: o Online and offline coding and visualization o Manual and network controlled o Task based evaluation in statistical functions Separation of data and attributes of the study: o Local study planning (tasks, recording sources, screenlayout, etc.) and worldwide reproduction Study data administration: o Send out complete studies or substudies o Enables incremental evaluation and aggregation of the results

8 General Functions Comment function: Online und offline commenting with time reference Video cutting: o o Screenshots Save visualizations as videos Export of all raw data in table format Send to Ergoneers : direct online sending of the recording data on the FTP server for evaluation

9 Scripting language Create new data (channels, tasks, statistical values, actions) out of the existing data A multiplicity of available logical operators (for example mean, edge operator, relational operators, etc.) Formulas can be saved and be loaded again in other projects Examples: o o o Task only valid if at the beginning v > 50km/h and the glance in a specific AOI Calculation of the TLC out of lane position Reaction time after appearance of a specific event

10 3. Software Moduls & Measurement Devices

11 3.1 Eye-Tracking Head-Mounted

12 Measurement Devices Dikablis Eye-Tracking Glasses 3.0 o Cable o Mobile o Wireless Eye-Tracking frequency: 100Hz (monocular/binocular) Accuracy: o Pupil detection: 0,05 o Glance direction: 0,2 0,5 Camera viewing angle: Portable with: o Normal glasses o Shutter glasses o Polarized glasses

13 Dikablis Cable Desktop PC D-Lab 3.0 USB 3 High-End Notebook / Ultrabook

14 Dikablis Mobile High-End Tablet 8 (e.g. Dell Venue Pro 8) Recording Can be carried in the pocket D-Lab3 runs on tablet

15 Dikablis Wireless Desktop PC Recording WLAN D-Lab 3.0 Save data locally Transmission of Reduced video data for realtime observation Geometry of pupils Fixation coordinates Marker coordinates High-End Notebook / Ultrabook

16 D-Lab Eye-Tracking Head-Mounted Live Eye-Tracking Automated marker based calculation of the glances towards AOIs o o Online: gaze control and gaze-contingent reaction Offline: analysis Offline optimization of pupil detection und recalibration (several calibration planes) Automatically AOI-based calculation of glance metrics (for example total glance time, number of glances, mean glance duration etc.) Glance visualization functions (HeatMap, ShadowMap, gaze path, and so on)

17 3.2 Eye-Tracking Remote

18 Measurement Devices Tobii Remote Tracker: o X2-30 o X2-60 o TX300 o T60XL o T60 & T120 o X60 & X120

19 D-Lab Eye-Tracking Remote Live Eye-Tracking Screen based and scene-camera based Automated calculation of glances towards AOIs o o Online: gaze control and gaze-contingent reaction Offline: analysis Automatically AOI-based calculation of the glance metrics (for example total glance time, number of glances, mean glance duration etc.) Glance visualization functions (HeatMap, ShadowMap, gaze path, etc.)

20 3.3 Eye-Tracking Virtual Reality

21 Components Dikablis HMD Cameras FullHD DVI Grabber Sensics: o xsight o zsight Vicon o Cameras: Bonita3, Bonita10, T-Series o Software: Tracker & Nexus WorldViz VR Software

22 System Layout Vicon Motion Capturing Cameras Computer with Vicon Tracker/Nexus Software Screen that shows WorldViz s virtual world and highlights the object the subject is looking at (or also shows crosshair) Position & Orientation Orientation HMD screen content Computer with WorldViz Software HMD screen content (grabbed via DVI grabber) x- and y-fixation coordinates in HMD s screen coordinate system Eye-Cam Video(s) Computer with D-Lab Eye-Tracking VR Software Screen that shows WorldViz s virtual world (grabbed via DVI grabber) and superimposed fixation crosshair

23 D-Lab Eye-Tracking Virtual Reality Live Eye-Tracking Automated marker based calculation of the glances towards AOIs o o Online: gaze control and gaze-contingent reaction Offline: analysis Offline optimization of pupil detection und recalibration (several calibration planes) Automatically AOI-based calculation of glance metrics (for example total glance time, number of glances, mean glance duration etc.) Glance visualization functions (HeatMap, ShadowMap, gaze path, and so on)

24 3.4 Video

25 Measurement Devices PAL cameras USB cameras IP cameras (with and without PTZ) o 640x480 o 800x600 o 1280x800 o 1280x960 o 1920x1080 DVI signals

26 D-Lab Video Synchronous recording und playback of several video channels with different resolutions Analysis of actions: o o o o Definition of the coding scheme (behaviors, behavior groups, participants, modifiers, comments) Flexible interval and sample coding Objectivity of sampling and coding Statistical evaluation of the coding Gaze-Video projection (in camera image or DVI signal)

27 Gaze-Video Projection with Projector or Monitor Projection wall or Monitor Computer that sends the video to a monitor or to a projector D-Lab laptop with modules D-Lab Eye-Tracking Professional and D-Lab Video Essential DVI Grabber FieldCam FieldCam films content of projection wall or monitor and at least one marker EyeCam(s)

28 Gaze-Video Projection with Projector or Monitor Laptop Screen Dikablis Eye-Tracking Video Video grabbed via DVI Grabber

29 Gaze-Video Projection with Camera(s) Scene Camera films cockpit and at least one marker D-Lab laptop with modules D-Lab Eye-Tracking Professional and D-Lab Video Essential Scene Camera Co-Pilot Pilot

30 3.5 DataStream - Network - Fieldbus

31 Measurement Devices Network interface TCP/IP: Any number of connections from several computers Wago measurement interface

32 D-Lab DataStream Variety of different configurable diagrams for visualization (for example: line chart, point chart, vector diagram, peak, and so on) One or more values per diagram Several subjects per diagram Variable x-axis (for example meters of advance as x-axis) Statistical function (subject, task, measured value, metric)

33 3.6 CAN Bus

34 Measurement Devices PEAK CAN card

35 D-Lab CAN Bus Read and store encrypted or decrypted (via dbc file) values from CAN Bus Variety of different configurable diagrams for visualization (for example: line chart, point chart, vector diagram, peak, and so on) One or more values per diagram Several subjects per diagram Variable x-axis (for example meters of advance as x-axis) Statistical function (subject, task, measured value, metric)

36 3.7 Audio

37 Measurement Devices Up to 16 microphones

38 D-Lab Audio Saved as separate audio channels Playback and audio visualization for selectable channels manual Transcription Speech to text (in the future) Word analysis via formula editor Statistical function (subject, task, word, metric)

39 3.8 Physio

40 Measurement Devices EEG EMG EKG, heart rate Skin conductance Breathing EOG Finger pulse Brightness Temperature Acceleration (1- and 3-axis)

41 D-Lab Physio Variety of different configurable diagrams to visualization (for example: line chart, point chart, vector diagram, peak, etc.) One or more values per diagram Several subjects per diagram Variable x-axis (for example meters of advance as x-axis) Physiological metrics (e.g. heart rate variability) based on measured raw data Statistical function (subject, task, measured value, metric)

42 3.9 Motion

43 Measurement Devices Vicon o Cameras: Bonita3 Bonita10 T-Series o Software: Tracker Nexus

44 D-Lab Motion Variety of different configurable diagrams to visualization (for example: line chart, point chart, vector diagram, peak, etc.) One or more values per diagram Several subjects per diagram Variable x-axis (for example meters of advance as x-axis) Eye-Hand-Body coordination Statistical function (subject, task, measured value, metric)

45 D-Lab Motion

46 4. Outlook

47 Outlook Distributed architecture Add further sensors Online formula editor GPS sensor Driving Environment Sensor Import of external data sources and subsequent synchronization Diagrams for data visualization (for example bar charts like in excel)