Quickguide. IntelliGaze. version 4. Rev A GB

Transcription

1 Manual Quickguide IntelliGaze version 4 Rev A GB

2 Contents 1. Introduction Hardware setup PC connection Molnitor Size Monitor Arm / Desktop Stand Camera Hardware CAM30NT Mounting the Camera USB cable options Software setup Prerequisites Software Installation Setting System Preferences for Desktop Control Configuring the Service Mode (optional) Hot keys Basic Operation Start IntelliGaze Position the camera Ctrl+F1 / Operation Center Calibration Ctrl+F5 / or via Operation Center Controlling Desktop Applications Three modes of opreration in IntelliGaze IntelliGaze Starter Edt IntelliGaze Communication Edt IntelliGaze 360 Edt Operation Center Overview Adjust application profile Safe Access Side menus and program functions Mouse menu left side Meny över specialfunktioner höger sida Windows Store Apps left side Windows Store Apps right side Keyboard Magnifier Touch menu Safety and responsibility Conformity with the Medical Devices Directive Recycling Waste Electrical and Electronic Equipment

3 1. Introduction IntelliGaze is in terms of performance, market leader in eye tracking. IntelliGaze 4.0 has a significantly improved, new user interface and pioneering functional solutions. The major improvements are: Assisted mode to get started easily and interact with eye control. Early intervention as Look to Learn etc. Completely redesigned, user-friendly interface for touch and eye control. Completed profiles to smoothly adapt eye tracking options. Multimodal control now also in Windows. Provides increased access to programs, including the new Direct Switch functions. Blank Screen for sleep mode. Improved video recording with sound of the eye. Modular licenses and easier remote updates. 2. Hardware setup 2.1 PC connection A free USB2- or USB3 port, preferably directly on the computer. 2.2 Monitor Size IntelliGaze can track most users accurately on monitors up to 22. The camera should be mounted as closely as possible to the screen area to achieve best results. A VESA mount is desirable. 2.3 Monitor Arm/Desktop Stand It is highly recommended to use a monitor arm or adaptable desktop stand to provide flexibility when positioning the IntelliGaze system. 3

4 2.4 Camera Hardware CAM30NT USB2 connector (Mini-USB) 6. System status LED. Green = OK. 2. Place for cable lock 7. Auxiliary mounting option (M3, max length 8mm) 3. Standard mount, d=8 mm. Max depth 35 mm 4. Standard mount Pin-lock screw. Tighten only by hand! 8. Internal Camera status LED. Yellow = OK. 9. Device label, warranty seal 5. Auxiliary power supply (mini-usb). Only required at very long USB cable, supplement to p.1. Use only power supply delivered by the manufacturer! 4

5 2.5 Mounting the Camera 1. Please attach the included mounting adapter to the computer and possibly monitor arm. The actual combination will vary and depend on your mounting and computing hardware. 2. Push the camera module carefully onto the rods until the front is approximately aligned with the monitor plane. 3. Carefully tighten the lock screw on the bottom with a Philips screwdriver. 4. Connect the USB cable to an available USB2/3 port on the computer. 2.6 USB cable options The camera is delivered with 0.5m USB2 cable. If a USB cable that is very long is used, the system might report a cable too long error due to electrical limitations. If this message displays, connect an extra power supply to the camera, see 2.4 Camera Hardware. External power supply to supplement the USB port is available as an option. 3. Software setup When IntelliGaze is delivered together with Rolltalk, the software is already installed. 3.1 Prerequisites 1. Download the latest version of the program from Abilia s website, Or use the enclosed installation CD. 2. An IntelliGaze camera unit with appropriate license. 3. A PC with a preferably fresh Windows installation which meets the hardware requirements. - Have latest Windows patches installed. - An Internet connection is not required for most installers. - IntelliGaze provides a common installer for both 32bit and 64bit systems. - To prevent a re-boot, the camera should be disconnected during setup. - Updates can be installed over a previous version. 5

6 3.2 Software Installation 1. Launch setup.exe and follow the instructions. 2. On a first-time installation, please run the Monitor Calibration program: In order to ensure the highest gaze accuracy over a large working range, the physical setup of the system needs to be calibrated once, when the system is being integrated. Most Cameras will be attached to the monitor using a VESA mount. The interactive sketch will assist you in locating the requested measurements. For later updates, the Monitor Calibration program can be found in the IntelliGaze program group. In a dual-monitor setup, please make sure the camera is attached to the primary display! 3. Plug in the camera and wait until a Windows message confirms the installation of alea technologies drivers. The device manager now lists the camera driver in the USB section, additionally the Internal Camera Status LED (8) turns yellow. 4. Start IntelliGaze, and position yourself centered about 60cm (2ft.) from the camera. Open the Operation Center and verify the proper functioning by checking the Tracking Status Monitor: stable green smiley and no error messages. The smiley should follow your head movements without significant delay or stutter. The Tracking Status Monitor reacts on touch and will provide more details or options in case of problems. 5. The basic IntelliGaze system has now been installed. 3.3 Setting System Preferences for Desktop Control Start IntelliGaze and open the preferences dialog (i.e. Ctrl-F11 or via Operation Center). General - Select your language and ensure that the camera license matches your requirements. Integrated Keyboard - Select your preferred keyboard layout(s). Input - adapt the preferred input option(s), i.e. dwell or blink click or/and switches. This will be the triggers which can be used in application profiles. If Windows should provide gaze input right after boot-up, you will have to add IntelliGaze to the Startup folder. 6

7 3.4 Configuring the Service Mode (optional) Close IntelliGaze and start the IntelliGaze Service program to adjust the parameters if needed. 1. Win7: Enable and set up touch screen input. (Automatic in Win8). 2. Disable automatic search for software updates. 3.5 Keyboard shortcuts Keyboard shortcuts are combinations of two or more keys. Using these, you can perform actions that normally require a mouse or other pointing device. Keyboard shortcuts can make it easier to use your computer and save you time and effort when you work with Windows and the Internet. Quick Commands are specifically important for you to help with the computer, for example, at a fitting or installation. Shortcut Ctrl + A Ctrl + F5 Ctrl + F1 Ctrl + F11 Mellanslag PAUSE Ctrl + S Ctrl + D Ctrl + I Ctrl + Q Ctrl + R Function Show Application Center (Safe Mode only) Start calibration Show Operation Center Enter preferences menu - Equiv. tray icon. Accept calibration point manually Dis-/Enable mouse cursor control Toggle standard mouse cursor display on/off Screen video recording, with gaze on/off Eye image snap-shot (encrypted) Quit IntelliGaze Eye video recording on/off (encrypted) 7

8 4. Basic Operation This section will provide a simple step-by-step guide on how to operate IntelliGaze for general computer control. 4.1 Start IntelliGaze Double click on the IntelliGaze icon to start IntelliGaze. If the eye control should start automatically when you start your computer, add IntelliGaze to the Startup folder. When IntelliGaze is used with Rolltalk, the eye control always starts automatically. When the program is started, the camera LED will lit dim red and the icon for IntelliGaze is shown in the program list. 4.2 Position the camera Ctrl+F1 / Operation Center The monitor should be aligned with the user s head in about 60cm (2ft.) distance. A straight look of the user should intersect the monitor in the upper 3rd, centrally. The status window confirms that the camera is picking up eye movement and that the head of the user is at the right distance and in the right position. The face shown should be green, with the eye/s visible. If it is yellow or red, adjust the distance. The figure gets bigger if the user is too close and smaller if the user is too far away. Red face, with only one eye visible Yellow face, with no eyes visible Green face, correct distance and position If the user should be wearing glasses, a more stable tracking might be achieved by positioning the camera slightly lower than normal. Touching the Tracking Status provides a semi-live view of the user to better locate reflections. 8

9 4.3 Calibration Ctrl+F5 / or via Operation Center The system should be calibrated individually in order to achieve the best accuracy for the user. It is recommended to calibrate both eyes while using at least 9 points. Nevertheless options to cover a wide range of requirements are provided. If the positioning above has been successful and the user s condition does not pose any other challenges, the calibration will just pace through a number of points, while waiting for the user to follow. The results will be shown graphically, including a short qualitative feedback. In complex cases, where a full calibration is too complex and limited accuracy is sufficient, a 1-point calibration is recommended. IntelliGaze provides many advanced options to calibrate even very complex case. If IntelliGaze is used with Compact Rolltalk it s recommended to calibrate via Rolltalk Designer. After a successful calibration the Operation Center can be closed and gaze control will be enabled. 4.4 Controlling Desktop Applications Mouse Control a gaze activated input, similar to a mouse, will be enabled. By default, clicks will be initiated by dwelling on a target for about 1 second. Special functions and other mouse functions can be activated from side menus. The side menus is activated by fixating just outside the monitor area. See more about side menus in chapter 7. Side menus and program functions. 5. Three modes of operation in IntelliGaze The IntelliGaze interface can be adapted to the actual user needs. Higher levels include the functionality of lower levels: 5.1 IntelliGaze Starter Edt. A special use case, where a person guides the user through a number of applications, i.e. Look-to-Learn, and controls the gaze control features frequently through a simplified Operation Center. 5.2 IntelliGaze Communication Edt. Only applications that have been set up to access IntelliGaze data directly, can be controlled by gaze. 5.3 IntelliGaze 360 Edt. 5.3.a Full Control Full gaze controlled access to all available functions, switches look&feel automatically, depending on profile settings. Most functions can be controlled via the Operation Center. 5.3.b Safe Access The access can be limited to pre-selected Windows applications by enabling the Safe Access option. Mode 1 and 3a/b can be selected in the preferences section of the software. Mode 2 is solely controlled by the client application. Access to mode 2 and 3 requires an appropriately licensed camera. 9

10 6. Operation Center Overview The Control Center is shown at the top of the screen. From here it is possible to access several different settings and functions. - Switch desktop - Task Manager - Close active program The Status widow is displayed if the camera has eye contact and the user is within distance and position to the screen. - Pause Gaze input - Options - Call Assistance Calibration: - Load calibration profile - Save calibration profile - Show last calibration result - Start calibration Options: General - Dwell time adjust - Audio adjustments - Keyboard type Current application - Adjust current application profile 10

11 6.1 Adjust application profile IntelliGaze can have different application profiles for the different programs that are used with IntelliGaze. Whenever a program is launched, IntelliGaze automatically loads a matching profile. A small square in the upper right corner shows the current profile name and key functions. For programs that does not have an own profile, the Default profile is used. 6.2 Safe Access The Safe Access mode allows to limit the number of programs and Operation Center functions that the user can access. It introduces a full screen Application Center which serves as a home page. Safe Access is set here: Preferences > Operation Center > Safe Access Entries can be defined under: Preferences > Operation Center > Application Center. Alternatively the current application can be added directly: Operation Center > Options > Current Application > Add to Application Center. 11

12 7. Side menus and program functions To the left and right of the screen there are side menus with mouse functions and special functions. Side menus are activated by fixating the gaze just off the screen. Side menus are automatically adapted to the classic desktop or modern interface with touch. Side menus can be fastened to the screen by an extra gaze in the same direction off the screen. When the sidebar is fastened, a small needle at the top of the menu bar. All side menus can be closed with one off-screen fixation in the same direction. At the bottom of the screen there are different keyboards. At the top of the screen the status window is displayed. Mouse functions is displayed to the left, special function to the right and keyboards at the bottom. In addition to mouse functions, special functions for scrolling (choosing from a long list, or continuously text read), drag&drop (directly or precise joystick), two finger touch (zoom and rotate) also Win8 functions are supported. The keyboard can be set with preset layouts. IntelliGaze will, depending on the application to be controlled, automatically open the keyboard, or the magnifier. 12

13 7.1 Mouse menu left side The off-screen mouse menu can be accessed on the left side of the screen. Single Left Click Single Right Click, lockable* Double Left Click, lockable* Drag and Drop */ Locked Mouse actions will be used with every click until they are unlocked again. By default, Single Left-Click will be enabled after every other click action. Drag and Drop Options Two different drag and drop options are available Direct, single click select and drop operation. 2. The Position Helper will be used for very precise select and drop operation. The Position Helper tool does not place the mouse cursor directly at the gaze location, instead the position of the Windows cursor is moved according to the gaze position relative to a 'dead zone' (red circle). A fixation inside the dead zone initiates the mouse click. After the primary selection, the dead-zone shape changes to an octagon and the secondary selection can be completed as before. All menu functions are disabled while a drag&drop operation is in progress. 13

14 7.2 Meny över specialfunktioner höger sida Pause halts the gaze interaction, can be restarted with a second activation on the pause button. Enforce Magnifier will pop up the magnifier at the next activation on the screen. Scroll will open a scroll selection pop-up to choose between text scrolling and selection scrolling. Configuration Opens the configuration menu for IntelliGaze. When paused, the menu will disappear after 30s to allow undisturbed mediaconsumption or similar. Another off-screen fixation will bring the menu back. Scroll Selection Two different scroll modes are available to choose between text scrolling operation and selection scrolling operation Text reading scrolling Used for reading long texts with automatic scrolling and minimal obstruction. Exit with fixation on upper right exit icon. 2. Selection scrolling Used to select an item from a scrolling list of options. Exit with a fixation inside the scroll area. 14

15 7.3 Windows Store Apps left side The off-screen App Gestures menu can be accessed on the left side of the screen. Tap and Select Gestures Drag and Drop Gestures Pan and Scroll Gestures Zoom and Rotate Gestures Tap and Select Gestures Options Four different Tap and Select Options are available Drag and Drop Gestures Options 1. Single tap 2. Double tap 3. Right mouse click 4. Select tap Two different drag and drop options are available to allow the user either fast and coarse or very precise drag&drop selection operations. 1 2 Pan and Scroll Gestures Options 1. Hold finger down and move it with the eyes. 2. The Position Helper will be used for very precise select and drop operation. Two different Pan and Scroll Gestures are available to allow the user either use a reading scroll mode or a mode where you can pan in any direction Pan in any direction 2. Reading scrolling Zoom and Rotate Gestures Options Zoom and Rotate are multi-touch gestures Switch to the zoom mode 2. Switch to the rotate mode 15

16 7.4 Windows Store Apps right side Pause halts the gaze interaction, can be restarted with a second activation on the pause button. Enforce Magnifier will pop up the magnifier at the next activation on the screen. System Gestures will open a system gesture menu that allows the user to perform a windows system gesture just like close, charms or switch app. Configuration Opens the configuration menu for IntelliGaze. System Gestures System Gestures are special Windows operations to switch between apps, close an app, show the charms menu or application options. Close close the app Charms menu will open the Windows charms menu Application Options opens the options menu of the application Task Manager shows the windows task manager to switch between apps Activate next app switches to the next app in the list 16

17 7.5 Keyboard A click inside an edit box or a text field will automatically pop up a keyboard. Depending on the pre-selection of the configuration, one out of three keyboards will be activated. Use either the integrated keyboard in IntelliGaze for easy typing, the Windows OSK which supports several languages and provides word prediction or an optional third party keyboard which can be customized. Integrated keyboard (ABC-layout) with local text feedback. Shown above is the integrated IntelliGaze keyboard. Buttons that are marked with a tiny triangle in the corner offer international variations of the letter when performing an immediate second fixation on the same button. The preview on top of the keyboard shows the content of the cursor even if the text field is hidden by the on screen keyboard. Its purpose is to provide quick feedback. 17

18 7.6 Magnifier A click in a region with small, crowded elements will automatically open the magnifier to allow for precise selections. Interactive magnifier The magnifier will always be opened in the middle of the screen. It provides a live view of the desktop, rather than a simple, static snapshot and it can be shifted around by looking at or beyond the little arrows outside the central area. The operation can be canceled by looking at the top-right cross. IntelliGaze will always try to snap the cursor into elements. When there are overlapping elements and controls it can be advantageous to turn the automation off to prevent false selections. This can be done with the lower left button. As constantly finding interactive GUI elements is a performance demanding task, slower PCs might fail to accomplish the calculations in real-time. The magnifier will then always pop up when the search for elements does not finish in time. A red frame on the magnifier indicates that the magnifier popped up because of lack of processing power on the PC. 7.7 Touch menu Displays that have touch panel support can be used to bring up a menu to start the calibration or show the side menus with a fingertip. The touch menu will disappear automatically after a few seconds when not touched. 18

19 8. Safety and responsibility Alea technologies has conducted a risk analysis for the product in compliance with NS- EN for Medical devices. The product's user instruction and technical specifications have been written in consideration of the safety assessments contained in this document. Safety must always be considered for when starting to use the product and during daily use. It is not possible to describe in the user instructions all the ways the product must not be used. If in doubt if that you have begun to use or set up the product correctly, we recommend that you contact your dealer. Abilia is not liable for any injuries, or consequential injuries or loss as a result of use, incorrect use, lack of follow-up, incorrect installation, incorrect connections etc. In all cases, Abilia s economic liability is restricted to the cost of the actual product. 8.1 Conformity with the Medical Devices Directive The IntelliGaze is marketed as a technical aid for people with disabilities and meets the requirements in the Medical Devices Directive 93/42/EEC including relevant EMC and electrical safety requirements. 8.2 Recycling Waste Electrical and Electronic Equipment The product contains electronics components that must be recycled. When the product is no longer of use, hand it in to a recycling centre for waste electrical and electronic equipment. 19

20 Abilia AB, Kung Hans väg 3, Sollentuna, Box 92, Sollentuna, Sweden Phone +46 (0) Fax +46 (0) Quick guide_intelligaze4_gb_reva.docx June