2015 The Regents of the University of Colorado, a body corporate. All rights reserved. Created by Becky Breaux, Assistive Technology Partners.

Transcription

1 Access to Mobile Devices Through the Power Wheelchair Drive Control System Becky Breaux, MS, OTR/L, ATP OBJECTIVES Participants will be able to: Describe the methods of access to Android/Windows based devices to include proportional and digital mouse emulation. Describe at least 3 different ways to achieve a mouse click when using mouse emulators through the power wheelchair drive control system. OBJECTIVES Participants will be able to: Describe the methods of access to Apple devices to include directed scan with Voice Over, directed scan with Switch Control, two switch step scan, and auto scan. List at least three different types of interface devices that work with power wheelchairs, available on the market today. List the basic equipment components you need to interface devices with a power wheelchair s control system. 1

2 Why Access Phones/Tablets? Mobile smartphones/tablets becoming routine part of our lives Multi-functional devices Important mode of communication Using the drive control system has many potential advantages Problems/Challenges Area is fairly new, complex and constantly changing Phones/tablets Operating systems PWC interface systems Problems/Challenges Touch Based Devices different from computers/aac devices Mouse Emulation not available on Apple Difficult to access some functions on Android devices Touch devices rely on GESTURES Access to phones/tablets may not be optimum method for user 2

3 Problems/Challenges There is a lack of uniform terminology in the industry Problems/Goals Goal for today: Foundation of terms/concepts Demonstrate types of scanning on Apple Devices Compare/contrast differences between mouse emulators and interface devices Access to Android/Windows Phones and Tablets 3

4 Access to Android/Windows Phones and Tablets Proportional Emulation Digital Emulation Direct Access: Proportional Mouse Emulation Android/Windows devices allow mouse emuation Proportional, 360 degree movement Fast and efficient Direct Requires refined, graded motor movements Equal access to all items in a symbol set User has the most Control and Choice Mouse Clicks Nudges Assign buttons on Joystick (w/ software) Built-in switch buttons or push functions External specialty switches Dwell software 4

5 Non-Proportional Digital Mouse Emulation Separate switches (or switch joystick) are used to emulate mouse movements Up, Down, Left, Right Mouse Moves Motor control requirements less than w/proportional User has less Choice and Control than w/proportional Sustained activation, timely release Quadrant Control Four Quadrant Joystick moves = up, down, left, and right External switch for mouse click, double-click, drag Quadrant Control Three Quadrant 1st switch = up and down moves 2 nd switch = left and right moves 3 rd switch = left mouse click, click/drag 4 th switch = right click Programming capabilities vary between manufacturers 5

6 Mouse Click Options Assign functions through Quadrant Control set up varies from one manufacturer to another External specialty switches plug into the mouse emulator or display Dwell Software RNET BT Mouse Emulator Plugs directly into RNET electronics Go into Mouse Mode, turn BT on phone/tablet for discovery mode Push joystick/forward until you hear beep, push joystick/reverse until you hear a beep RNET BT Mouse Emulator Mouse Clicks Nudges w/pc Programmer left click, right click, scroll up, scroll down Specialty switches (two ports on module) Assign buttons/ports (Quickie only) Can use up to two BT emulators at same time Permobil only at this time 6

7 RNET BT Mouse Emulator R-NET for Android App Large mouse cursor Easy access to home, max volume, and mute Q-Logic BT Mouse Emulators Q-Logic Q2 Joystick BT is a standard component with either Q-Logic EX Enhanced Display Works with Android/Windows AND Apple devices Q-Logic BT Mouse Emulators Plug specialty switches into ports Assign Buttons using software Lots of programming options for mouse clicks 7

8 Invacare RF Mouse Emulator Mark VIi electronics Transmitter plugs into electronics RF receiver (dongle) paired w/ transmitter in factory Few, easy steps to set up Invacare RF Mouse Emulator Receiver works with multiple USB devices Plug and play Dual port on transmitter for specialty switches Use a splitter for 2 separate switches Can use two RF emulators at the same time Connecting the RF Dongle to an Android Smartphone or Tablet Search: "On the Go Connector" and name of your device 30 pin to USB adapter Micro USB to USB adapter 8

9 External Mouse Emulators ASL Mouse Emulator (553 or 554) Wired or Wireless Digital emulation using a proportional OR digital drive control system Allows 3 to 5 Switch Control External Mouse Emulators ASL Mouse Emulator (553 or 554) Special programming capabilities mouse speed, acceleration, delays, using dip switches Ports for specialty switches May need USB adaptor to plug receiver into phone/tablet External Mouse Emulator Tecla Shield Download Tecla Access app Uses Directed scan method with on-screen navigation bar Best for switch users who must use Android 9

10 External Mouse Emulator iportal Mouse Mover Not Available in US Works with DX, DX2 and Shark electronics Access to Android/Windows phones and tablets All External Mouse Emulators Require an interfacing component: RNET: Input/Output Module Mark VIi: Aux ½ or Aux ¾ Q-Logic: ECU module Swipes or Scrolling on Android/Windows Click and Drag: Important to emulate swipes and scrolling functions Consider optimum switch location depression/hold of switch while moving joystick 10

11 Changing the Pointer speed Go To: Settings Language and Input Pointer Speed Accessing All Screen Icons on an Android Phone On some phones (Samsung), the HOME, FILE, MENU, & BACK buttons are capacitive buttons only Accessing All Screen Icons on an Android Phone Activate UNIVERSAL TOUCH to go to HOME Screen or use PINCH gestures Go To: Settings Accessibility Universal Touch 11

12 Apps that use Dwell Select APP Specific Dwell Select: Predictable or Type and Speak. Predictable Type and Speak Apps that use Dwell Select Screen navigation using Dwell Select Mouse Track, which will allow dwell select throughout Android OS. Mouse Track In Summary: Mouse Emulation Options Proportional Emulation = Proportional Drive Control system connected to a BT or RF Mouse emulator 12

13 In Summary: Mouse Emulation Options Digital Mouse Emulation = Digital Drive System connected to BT or RF Mouse Emulator OR Proportional or Digital Drive System connected to External Mouse emulator (and digital interfacing component) Access to iphones and ipads Mouse Emulation NOT an option on Apple phones/tablets 13

14 Access to iphone or ipad Directed scan with 3 or more switches User directs the scan Two Switch Step Scan Single Switch Auto Scan Access to iphone or ipad Built-in OS Features Voice Over (ios 6 and above) Directed Scan w/3+ Switches Switch Control (ios 7 and above) Directed Scan w/3+ Switches 2 Switch Step Auto Scan Scanning Requires less motor control More switch hits (fatigue?) User has less Choice & Control Cognitive Demands Attention Memory Waiting/Anticipation Visual or auditory tracking Sequencing 14

15 Before You Start: Always Turn on the Accessibility Shortcut!! Triple click HOME button to turn app on or off Helps if you get stuck in the app Select ONLY ONE shortcut at a time How to Turn on Accessibility Shortcuts Go to Settings Go to General Go to Accessibility Click on Accessibility Shortcuts Select the Shortcut (ie: Voice Over OR Switch Control) De-select all other shortcuts Directed Scan w/voice Over User directs the scan left or right, then selects 3 switches VO designed for people with visual limitations Voice Feedback Not all apps are VO compatible 15

16 Directed Scan w/voice Over Go to: Settings General Accessibility Voice Over Slide button to ON Directed Scan w/ Switch Control User directs the scan left, right, up, or down Can move one line at a time, or one item at a time 3 switches or more Combined w/group scanning, screen navigation more efficient Directed Scan w/ Switch Control Turn on Accessibility Shortcut for Switch Control only Go to: Settings General Accessibility Switch Control Switches 16

17 Directed Scan w/ Switch Control Assign your switches to control actions on the Apple device such as: Move to next item Move to previous item Select item Tap App Switcher Siri ETC. To Begin, go to: Settings General Accessibility Switch Control Switches Setting up Switches w/ Switch Control Add External Switch 1 1. Click on Switches 2. Choose Add External Switch 3. Click on External 4. Activate your switch 5. Choose the Switch Action (ie: Move to Next Item) Add External Switch 2 1. Repeat steps Activate your 2 nd switch 3. Choose the Switch Action (Move to Previous Item) Directed Scan w/ Switch Control Add External Switch 3 1. Repeat steps Activate your 3 rd switch 3. Choose the Switch Action (Select Item) 4. Slide button next to Switch Control ON 17

18 Step Scan w/switch Control Two Switch Repeat previous instructions for setting up an external switch Activate Switch 1: Move to Next Item Activate Switch 2: Select Item Automatic Scan w/switch Control Activate Switch 1: Select Item Turn on Accessibility shortcut for switch control and de-select all others Turn Auto Scanning ON Turn Switch Control ON Scan begins automatically or with a switch hit Requires momentary activation on switch Combine with Group Scanning Auto Scan Options Auto Tap Feature Gives switch access to menu of features and gestures Many other settings Auditory feedback Scanning time Group Items Etc. 18

19 Interfaces with Apple Devices: Q-Logic Joystick 2 or EX Enhanced Display Directed Scan with Voice Over Only Can add specialty switches Built into joystick or display No additional charge! Also works with Android/Windows (for mouse emulation) Directed Scan w/voice Over using Q-Logic Go to Settings - General - Accessibility -Voice Over. Turn Voice Over to the "On" position. LEFT, RIGHT, and SELECT Double click/tap LEFT = Search. Double click/tap RIGHT = Next Page. Long Hold of Forward = Home. Interfaces for Apple Devices: Permobil RNET BT idevice Directed Scan with Voice Over (requires PC Programmer) Directed Scan with Switch control (3+ switches) Two switch Step Scan Auto Scan 19

20 Interfaces for Apple Devices: Permobil idevice Plugs directly into electronics Two Switch Ports Program short/medium/long holds Actions: App Switcher, Siri, Home, Search, etc Can connect with up to two BT Mouse Emulators External Interfaces for Apple Devices Tecla Shield Connects via BT with Mark VIi, RNET and Q- Logic electronics Works with AAC devices, MAC computers (proportional control) Directed scan w/voice Over or Switch Control, 2 switch step, or auto scan Requires digital interface External Interfaces for Apple Devices iportal Accessibility Not available in US (works with Shark, DX, & DX2 electronics) Directed Scan w/ Voice Over & Mouse Emulation w/ Assistive Touch 20

21 Ablenet Resource Switch Access and ios - The Missing User s Guide & Video Tutorials: Ablenet site also has good information about new features of ios8 Ablenet Resource The Missing User s Guide & Video Tutorials: You can practice some features of Switch Control without an interface Switch 1 = Camera (head turns) Switch 2 = Screen References Ablenet, Inc. ios7: The Missing User Guide (updated 4/8/2014). Retrieved November 15, 2014 from: UserGuide.pdf. Anson, D (2008). Computer access. In M. Lange (Ed), Fundamentals in Assistive Technology, 4 th Ed. (pp ). Arlington, VA: RESNA Press. Computer Resources for People with Disabilities: A Guide to Exploring Today s Assistive Technology (1994). Product descriptions: alternate input, (pp ). Alameda, CA: The Alliance for Technology Access. Cook, A., Polgar, J., Hussey, S. (2008). Cook & Hussey's Assistive Technologies: Principles and Practice (3rd Edition ed.). St. Louis: Mosby. Cumley, D. Terminology for AAC: organized for augmentative and alternative communication by Dr. Beukelman & Dr. Mirenda, Retrieved November 15, 2014 from: 21

22 References Lange, M. (June 4, 2013). Mounting, interfacing, and more! Full Day Workshop sponsored by Assistive Technology Partners and Colorado Department of Education SWAAAC Program, Thornton, CO. Lange, M (2008). Accessing the technology. In M. Lange (Ed), Fundamentals in Assistive Technology, 4 th Ed. (pp ). Arlington, VA: RESNA Press. Reed, P., Lahm, E. (Ed.). (2004). Assessing students' needs for assistive technology (4th ed.). Milton, WI: Wisconsin Assistive Technology Initiative. Special Education Technology British Columbia. Switch access for the ipad: Retrieved November 15, 2014 from: 22

23 Accessing Android or WindowsTablets/Phones Through the PWC Electronics Name of Technology Interface Type of Mouse Emulation Details of Operaton MouseFunctions Comments Invacare Mark Vii Invacare Wireless Mouse Emulator for Mark Vii (RF) Proportional Mouse Emulation if using a joystick or other proportional drive control system, OR, Digital Mouse Emulation if using a digital drive control system. Requires a "hockey puck" transmitter that attaches directly into the Invacare Mark VIi electronics and communicates with an RF receiver on a USB dongle. The transmitter and receiver are paired in the factory, giving you "plug and play" capabilities. The dongle can therefore be used with multiple devices. A USB adapter may be required, especially for phones. Look for an "On the Go Connector" or "USB Adapter" for the specific phone or tablet being used. The RF transmitter has stereo jack ports for specialty switches. Plug a dual switch into this port, or purchase a stereo-mono adapter to use two separate specialty switches for left/right clicks. If digital mouse emulation is being used, diagonal directions can be achieved without any special programming. Mouse clicks can be achieved without specialty switches by setting up quadrants (ie: two quadrants control all mouse movements, the other two quadrants control left /right clicks). Programming includes mouse speed, mouse acceleration slow to fast, and acceleration delays. When you turn on mouse emulation for the first time, follow a specific series of steps provided by the manufacturer. After this first set up, plug and play with the USB dongle occurs automatically with any USB capable device. One potential advantage of RF vs Bluetooth is that phone and tablet manufacturers sometimes change their BT software with the development of new devices. As new BT capable devices emerge, they may not work with the BT mouse module unless a new chip is installed in the module. Permobil RNET Permobil Blue Tooth Mouse Module for RNET electronics Proportional Mouse Emulation if using a joystick or other proportional drive control system, OR, Digital Mouse Emulation if using a digital drive control system. Once connected, go into RNET electronics and pair the system as with any other BT device. Make sure your phone or tablet is in discovery mode by turning Blue Tooth on. You can also download an RNET for Android app, which provides a home button and large mouse cursor. The mouse module has switch ports that can accommodate specialty switches for left/right mouse clicks. RNET electronics also offer built-in nudge features using PC programmer. Nudges allow a joystick to be pushed very quickly up or to the right, for example, to simulate left and right mouse clicks. If using digital mouse emulation, diagonal directions can be achieved using PC Programmer. Quadrants can also be set up (ie: two quadrants control all mouse movements, the other two control left/right clicks). Nudges and SW1 and SW2 ports can be custom programmed for the following options: (Left Click, Right Click, Left Double Click, Right Double Click, Scroll Up, and Scroll Down). The Nudge time is also programmable using PC Programmer. Up to two Blue Tooth Mouse Modules can be used simulataneously with the Permobil idevice, allowing users to connect to up to two Android or Windows devices AND one Apple device, so they can switch back and forth between three devices total. 1

24 Accessing Android or WindowsTablets/Phones Through the PWC Electronics Name of Technology Interface Type of Mouse Emulation Details of Operaton MouseFunctions Comments Quickie RNET Sunrise RNET Bluetooth Mouse Emulator Proportional Mouse Emulation with joystick or other proportional drive control system, OR, Digital Mouse Emulation with a digital drive control system Once connected, go into RNET electronics and pair the system as with any other BT device. Make sure your phone or tablet is in discovery mode by turning Blue Tooth on. You can also download an RNET for Android app, which provides a home button and larger mouse cursor. RNET electronics offer built-in nudge features using PC programmer software. Nudges allow a joystick to be pushed very quickly up or to the right, for example, to simulate left and right mouse clicks. If using digital mouse emulation, diagonal directions can be achieved using PC Programmer. Quadrants can also be set up (ie: two quadrants control all mouse movements, the other two control left/right clicks).you can also assign special features or buttons on the joystick to mimic mouse clicks; this is a special feature unique to Sunrise Medical. Or, purchase a joystick with mono jack ports built into it, and use/assign these ports for your mouse functions. Currently you can have one Bluetooth module paired to multiple devices, although you can only have one of those devices on at one time. There is a new option coming that will allow you to connect to multiple devices (ie; a phone and computer at the same time without having to turn one of those devices off). This new option will allow you to easily switch between devices. Quantum Q-Logic Q Logic 2 Joystick with built-in Blue Tooth Mouse Emulator Proportional Mouse Emulation Once connected, go into Q Logic electronics and pair the system as with any other BT device. Make sure your phone or tablet is in discovery mode by turning Blue Tooth on. Switch ports are located in the joystick to connect specialty switches or use the buttons on the joystick itself. Buttons can also be assigned using a PC. The BT Mouse Module (as well as IR module) are built into the Q2 joystick at no additonal cost). This device also connects with Apple devices (using directed scan with Voice Over), so that one device will interface with both Android and Apple products. Quantum Q-Logic Q-Logic EX Enhanced Display with built-in Blue Tooth Mouse Emulator. For Android/Windows Devices: Digital Mouse Emulation using a digital drive control system. Once connected, go into Q Logic electronics and pair the system as with any other BT device. Make sure your phone or tablet is in discovery mode by turning Blue Tooth on. Switch ports are located in the display to connect specialty switches for left/right clicks. Quadrants can also be set up (ie: two quadrants can control all mouse movements, while the other two quadrants can control left/right clicks). Q Logic offers many special programming capabilities for mouse clicks. The BT Mouse Module (as well as IR module) are built into the EX Enhanced Display at no additonal cost). This device also connects with Apple devices (using directed scan with Voice Over), so that one device will interface with both Android and Apple products. 2

25 Accessing Android or WindowsTablets/Phones Through the PWC Electronics Name of Technology Interface Type of Mouse Emulation Details of Operaton MouseFunctions Comments Permobil RNET, Quantum Q-Logic, Quickie RNET, and Invacare Mark VIi. ASL Mouse Emulator (553 and 554 Wireless) Digital Mouse Emulation when using either a proportional drive control system or a digital drive control system. Receiver plugs directly into the Android or Windows device via USB. A USB adapter may be required, especially for phones. Look for an "On the Go Connector" or "USB Adapter" for the specific phone. Mouse ports are built into the transmitter to control left click, right click, and click/drag and can be used with specialty switches. Can be set up for 3 to 5 switch control. With 3 switch control, one switch controls up/down mouse moves, second switch control left/right mouse moves, and third switch controls click/doubleclick). Module also offers many special programming features for mouse speed, acceleration, delays, etc. The pwc must have an ECU module (Q-Logic), Aux 1/2 or 3/4 (Mark VIi), or Input/Output Module (RNET), to interface with this device. System relies on Zigby frequencies, so line of sight is not necessary. Transmitter will pair with multiple receivers/devices. Permobil RNET, Quantum Q-Logic, Quickie RNET, and Invacare Mark VIi. Tecla Shield (distributed by ASL) Type of Directed Scan using an on-screen keyboard as your control device. The onscreen keyboard is accessed via your drive control system, whether it is a proportional or digital drive control system. Blue Tooth transmitter that pairs with your Android device. A free app, called Tecla Access must be downloaded to the phone and chosen as the default keyboard. Go to Settings - Language and Input, and choose the Tecla Access keyboard. Type of directed scan that uses the Tecla Access on-screen keyboard. Using the on-screen keyboard, the user navigates to the desired mouse function (up, down, left, right, select) The pwc must have an ECU module (Q-Logic), Aux 1/2 or 3/4 (Mark VIi), or Input/Output Module (RNET), to interface with this device. This system is most appropriate if the user needs to use switches for optimum access using switches. User must be able to focus on onscreen keyboard and switch focus to the switch Shield also provides switch control of Apple and must use Android system. The Tecla movements. Significant cognitive load. devices, MAC computers, and AAC devices. Not Available in US: DX, DX2, and Shark Electronics iportal Mouse Mover Mouse emulation with proportional or digital drive control system. Blue Tooth transmitter that pairs with your PC, laptop, or tablet computer. Blue Tooth transmitter that pairs with your PC, laptop, or tablet. Has many special features/commands for screen navigation. High cognitive load. Can also purchase iportal Mouse Mover + Accessibility, which allows users to have mouse emulation of Windows-based computers, laptops, and tablets in addition to directed scan methods on Apple devices. 3

26 Accessing Apple Devices Through the PWC Electronics Name of Technology Interface Type of Screen Navigation Details of Operaton Comments Permobil RNET Permbil idevice Directed Scan with Voice Over, Directed Scan with Switch Control (3 or more switches), 2 Switch Step Scan and Auto Scan. Can be used with either a proportional or digital drive control system. Pair the device with your iphone or ipad. On your apple device, go to Settings - General - Accessibility - Switch Control - Switches - Add New Switch - External. Activate each external switch when prompted and choose a switch action. For example, if using a joystick, push the joystick to the right when prompted to "activate your external switch" and choose "Move to Next Item" as the switch action. Choose "Add a New Switch" and "External" again, and push the joystick to the left when prompted to activate the switch. Choose "Move to Previous Item." Choose "Add a New Switch" and "External" again, and move the joystick forward when prompted to activate the switch. Choose "Select Item" as the switch action. The idevice module also has two switch ports for use with specialty switches. This device allows users to choose several swich actions in the Switch Control settings of the Apple device. In addition to programming "Move to Next Item," "Move to Previous Item," and "Select Item," users can also program additional functions such as "Home Button," "Siri," "App Switcher," etc. For example, if uisng a joystick, you can program short, medium, and long holds of the joystick (in all four directions) for various switch actions. To set up for 2 switch step scan, choose one switch to "Move to Next Item," and the second switch to "Select Item." For Auto scan, set up one switch to "Select Item" and then turn "Auto Scan" to the ON position. Up to two Blue Tooth Mouse Modules can be used simulataneously with the Permobil idevice, allowing users to connect to up to two Android or Windows devices AND one Apple device, so they can switch back and forth between three devices total. Quantum Q-Logic Q Logic 2 Joystick Directed Scan with Voice Over Pair the device with your Apple phone or tablet. On your apple device, go to Settings - General - Accessibility -Voice Over. Turn Voice Over to the "ON" position. Default settings are preprogrammed. Push joystick left and right to move cursor left/right. Push joystick down to select. Double Left =search. Double right = next page. Long hold up = Home. The BT Mouse Module (as well as IR module) are built into the Q2 joystick at no additonal cost). This device will also act as a BT mouse emulator with Android/Windows devices, so that one device can interface with both Android and Apple products. 1

27 Accessing Apple Devices Through the PWC Electronics Name of Technology Interface Type of Screen Navigation Details of Operaton Comments Quantum Rehab Q-Logic EX Enhanced Display Directed Scan with Voice Over Pair the device with your Apple phone or tablet. On your apple device, go to Settings - General - Accessibility -Voice Over. Turn Voice Over to the "ON" position. Use your left turn switch to move the cursor to the left, press the right turn switch to move the cursor to the right. Press forward switch to select item. Default settings are pre-programmed. Double click the left turn switch = Search. Double click the right turn switch = Next Page. Long Hold of Forward Switch = Home. Press reverse switch = Select Item. The BT Mouse Module (as well as IR module) are built into the EX Enhanced Display at no additonal cost). Permobil RNET, Quantum Q-Logic, Quickie RNET, and Invacare Mark VIi. Tecla Shield (distributed by ASL) Switch Control with ios 7 or above (directed scan, two switch step, and auto scan); App Control (for use with switch accessible apps); ios Classic (directed scan with Voice Over in linear direction); and ios 4-Way (directed scan with Voice Over in 4 directions) Pair the device with your Apple phone or tablet following the instruction manual (available online and very helpful). Choose the method of scan you prefer by toggling through the status lights of the Tecla Shield. The online user's guide is very helpful to guide through set up of the scan method you choose. Each scan method has default settings to access additional functions such as Siri, Search, Home, App Switcher, etc. The pwc must have an ECU module (Q-Logic), Aux 1/2 or 3/4 (Mark VIi), or Input/Output Module (RNET), to interface with this device. Tecla Shield will interface with Android devices for a type of directed scan; MAC and PC computers for digital mouse emulation with multiple switches; and MAC computers with OSX Mavericks and above to use Switch Control features (to include directed scan, 2 switch step, and auto scan). Tecla Shield is very versatile, works with a variety of electronics, and good as an assessment tool. Not Available in US: DX, DX2, and Shark Electronics iportal Accessibility Directed Scan with Voice Over and Universal Touch. Works with either a proportional or digital drive control system. Blue Tooth transmitter that pairs with your Apple device. Uses Voice Over and Universal Touch app as a unique screen navigation method. Has many special features/commands for screen navigation. High cognitive load. Can also purchase iportal Mouse Mover + Accessibility, which allows users to have mouse emulation of Windows-based computers, laptops, and tablets in addition to directed scan methods on Apple devices. 2