SCALA on the Internet of Things: an Exploratory Research

Transcription

1 SCALA on the Internet of Things: an Exploratory Research Interdisciplinary Center for Educational Technologies (CINTED) UFRGS Brazil Roceli P.Lima, Magda Bercht, Liliana M.Passerino, Rosa M.Vicari Post-Graduation Program in Applied Computer Science (PIPCA) UNISINOS Brazil João C.Gluz

2 1. Introduction

3 3. Scala System

4 3. Scala System SCALA Web Communication Board module interface.

5 3.SCALA System - Advanced search engine - SCALA integrated to Siesta-Cloud - SCALA integrated to ARASAAC - SCALA WEB, SCALA TABLET, Visual Narratives Module, Scanning Module - SCALA Desktop - SCALA Prototype 2014/

6 5. Map on how to evolve SCALA to work on the IoT 1. Scientific databases 2. Results of the Exploratory Research 3. The main technologies used in the selected articles 4. Propose to evolve SCALA to work on the IoT The selected databases of Exact and Earth Sciences: Association for the Computing Machinery (ACM) and Institute of Electrical and Electronic Engineers (IEEE). The Multi- Disciplinary selected: Science Direct, Scopus and Springer. The exploration criteria defined for the research was to select articles from the databases that meet a query descriptor including the terms Internet of Things and Autism.

7 5. Map on how to evolve SCALA to work on the IoT 2. Results of the Exploratory Research Architecture and multimodal interface of system presented in [5] (a) system's architectural model (b) multimodal visual interface

8 5. Map on how to evolve SCALA to work on the IoT 2.1 Results of the Exploratory Research Architectural model for the system presented in [18]

9 5. Map on how to evolve SCALA to work on the IoT 2.2 Results of the Exploratory Research Architectural model for the system presented in [18] SmartBox

10 5. Map on how to evolve SCALA to work on the IoT 2.3 Results of the Exploratory Research MOBIS system for object visual recognition (source [16])

11 5. Map on how to evolve SCALA to work on the IoT 3. The main technologies used in the selected papers Technologies used in the articles about IoT and Autism Software Hardware Communication machine learning algorithm web information retrieval filter visual interface system for presenting multimodal contents monitoring sensors (temperature, vibration, motion) image processing and visual computing audio generation sensor for controlling odors sensor for controlling lighting movement sensors mobile devices (cell phones and tablets) use of tags and RFID P2P Communication protocol Internet Wireless

12 6. SCALA and the Internet of Things SCALA functionalities and IoT technologies applied with Autism. SCALA functionalities IoT technologies applied with Autism 1. Board layout options 1. machine learning algorithm 2. Create board 2. web information retrieval filter 3. View board 3. visual interface system 4. Undo command 4. monitoring sensors 5. Edit image 5. audio 6. Save board 6. odor sensors 7. Open board 7. lighting sensors 8. Add pages to board and clear 8. communication protocol board 9. P2P 9. Export board 10. Import images 11. Print board 12. Board Scanning module 13. Free Communication module 10. Internet 11. Wireless 12. mobile device 13. visual computing 14. tags

13 6. SCALA and the Internet of Things (1)Incorporate the identification of tags/rfid in physical objects; (2)Implement visual recognition algorithms for physical objects; (3)Adapt the Free Communication module in order to represent physical objects; (4)Elaborate a mapping strategy, between physical objects with virtual objects (pictographs). (5)Web information retrieval systems and semantic technologies (ontology) may be used to identify possible models of equivalent pictographs;

14 6. SCALA and the Internet of Things (6)Encapsulate sensors in physical objects to identify approximation, location and touch, to execute audio, to show lights, for vibration, among other features; (7)Develop a routing protocol for a local network of physical objects, supporting on information security. In this case, a protocol like SPTP, which uses a secure P2P communication technology, can be used.

15 7. Final Remarks The exploratory research methodology used to find works that apply IoT to Autism was effective because descriptors limited the scope of the research. The individual analysis of the each one papers allowed us to identify recent works with good ideas on how to proceed with the integration of IoT with SCALA.

16 7. Final Remarks The analysis of these works resulted on a set of examples of technologies that could be compared to the features already present on the SCALA system. Allowed us to propose a set of new features to be developed and added to SCALA, resulting in a system able to handle virtual and physical objects for a more productive alternative communication experience.

17 Acknowledgements The authors are grateful to Foundation for Research Support of the State of Amazonas - FAPEAM (by means of RH-DOUTORADO Scholarships), Federal Education Institute of Amazonas (IFAM), Federal University of Rio Grande do Sul (UFRGS) and University of Vale do Rio dos Sinos the financial support given to this research.