ICT and HCI between multimodality and cognitive personalization

Transcription

1 ICT and HCI between mutimodaity and cognitive personaization Prof. Licia Sbattea ACCESSIBILITY Poitecnico di Miano - Como icia.sbattea@poimi.it

2 Contents and time schedue Specia Users & Apps (11/3, 15/3, 18/3, 5/4, 12/4, 20/4, 22/4) Devices & HCI (9/3, 16/3, 30/3, 1/4, 8/4, 15/4) Web Accessibiity (6/4, 13/4, 20/4) Meeting Users (18/3, 30/3, 9/4, 13/4, 22/4) signatures wi be coected =>(+0,20 each) Prof. Licia Sbattea - Poimi/ 2016

3 Modes, appications, research presentation, meeting users Contents: 1) Universa accessibiity: nationa and internationa contexts The UN Convention on the Rights of Persons with Disabiities (2007) and its infuence on ICT The internationa network: (the roe of governmenta, non governmenta, professiona, industria and academic subjects) 2) A goba reference mode to profie users Human mind and behavior (embodiment and reationa skis) Perception, attention, and tempora skis / Emotiona and affective skis Interaction and communication / Learning and cooperation Personaity and subjective differences Impairments, disabiities and handicaps The WHO ICF Mode and its extensions to support ICT accessibiity Prof. Licia Sbattea - Poimi/ 2016

4 Modes, appications, research presentation, meeting users 3) Mutimoda devices and contexts Mutimodaity for innovation and accessibiity Innovative devices and best accessibe soutions for different abiities (sensoria, physica, cognitive, and reationa) Best and worst practices and programs in the fied of earning, professiona education, autonomy, communication, rehabiitation and sef expression Accessibiity and evauation modes and instruments Prof. Licia Sbattea - Poimi/ 2016

5 Modes, appications, research presentation, meeting users 4) Web accessibiity Accessing the interface and the contents Disabiities reied to persona, socia or cutura diversities How to use the input and the output redundancies: additiona and compementary mutimodaity The WCAG guideines and other reied documents The persona stye and the access paradigm: graphics, texts, gestures, and voices The wireess and the mobie context. Accessibiity of the active web: best and worst practices and programs. How to evauate the web accessibiity taking into account different points of view The nationa egisation: imits and opportunities Prof. Licia Sbattea - Poimi/ 2016

6 Modes, appications, research presentation, meeting users 5) Focus On Different disabiities (cognitive, sensoria, physica, or reationa) but aso aged persons or persons with dysexia (DSA) presentation of innovative research programs and projects presentation of a meaningfu mutimoda and cooperative contexts Prof. Licia Sbattea - Poimi/ 2016

7 HCI, Innovative ICT, Accessibe Computing, Assistive Technoogy Strength and weakness Sow / Quick Very sma / very big A reationship of mutua hep To be egitimated To be identified To be integrated Prof. Licia Sbattea - Poimi/ 2016

8 New attention The OMS paradigm for Persons with Disabiity (and not ony for them!) OMS: ICF (impairment, disabiity, handicap) Persona attributes? Context reied properties?) Motor, Sensoria, Cognitive, Reationa Impairments Congenita or acquired disabiities The centra roe of persons Wish, responsibiity adut ife Different ages kids, young peope, eders Prof. Licia Sbattea - Poimi/ 2016

9 Compexity and Integration Compexity Of the mind Of the existentia dimension Integration Neuroscience Pedagogy Psychoogy and Cognitive Science Cinic Prof. Licia Sbattea - Poimi/ 2016

10 ICT - Mutichanne - Mutimoda Accessibiity and Navigation Mutichanne: Information systems / adaptive systems accessibiity and heterogeneity Mutimoda: Different modaity are avaiabe simutaneousy for accessibiity (visua, auditory, and tactie )... Preferred or constricted? Context awareness: technoogica, reationa / cooperative or communicative, persona, historica, socia Prof. Licia Sbattea - Poimi/ 2016

11 ICT - Wireess & Peer-to-peer Distributed Architecture user-centered VSDBs: Coud Soutions peer-to-peer interaction Distributed databases and context adaptabiity Fexibiity of connections in wireess contexts Persona profies: heath, earning, daiy ife,. Position detection and navigation RFID (passive or active). WI-FI contexts Prof. Licia Sbattea - Poimi/ 2016

12 ICT Adaptabiity and Personaization User profie behavior anaysis: cooperative, communicative, action oriented preferences, motivation, wish, Persona habits and characters,... Adaptabiity At different eves (interface, design, functiona specification, requirements ) Through time Static / dynamic processes Prof. Licia Sbattea - Poimi/ 2016

13 ICT Devices and Interfaces New integrated modaities are studied to enhance the interaction Auditory / visua / tactie / neuroogica / reied to specific actions Brain-computer interaction Tabet PC and touch screens Gestura interface Main points to be stressed: The synaesthesic properties of perception Te integration between different steps of the project (design, impementation, vaidation) of the system and its interfaces Prof. Licia Sbattea - Poimi/ 2016

14 ICT Virtua reaity From 2D to 3D spaces Space and time: exporative styes in space and time The simuated reaity: different contexts to communicate, cooperate, earn, eave, Virtua /Rea networking The deayed or faciitated experience Prof. Licia Sbattea - Poimi/ 2016

15 ICT - Robotics Devices Actuators / manipuators To hep or to substitute human action Different eve of: programmabiity personaization The roe of the object And the reationship that the person is going to share Prof. Licia Sbattea - Poimi/ 2016

16 ICT Signa Processing Less invasive devices and processing Signa detection is possibe aso in compex situations, taking into account daiy ife conditions. The detection of meaningfu signas Aows a better detection of the brain activity Conditions are sti compex New appications make innovative studies more and more significant Prof. Licia Sbattea - Poimi/ 2016

17 ICT Computationa Linguistics The anaysis and the production of written or spoken texts At different eve (morphoogica, exica, syntactica, semantic and pragmatic eves, ) Making navigation more efficient and accessibe the anaysis of compexity, summarization, the detection of the text structure, data mining, Transation between different formats and anguages. Iconic, ora, or written anguages... Guideines, standards and protocos, Linguistic Prediction Natura anguage and innovative anguages Prof. Licia Sbattea - Poimi/ 2016

18 AT Learning and paying Paying: new opportunities rea / virtua space / time cooperation/ persona exporation Learning: new opportunities Sef and word exporation Kids as actors authors or protagonists A constructive paradigm and a cooperative context Imbaance between costs, resuts in time A string impact factor Evauation and vaidation Prof. Licia Sbattea - Poimi/ 2016

19 AT Mutimoda Communication Mutimoda integration Linguistics / Textua Auditory / voca / musica Tactie / gestura / animated Iconic / deaing with representation Rewarding and prestigious Soutions for anguage and communication disabiities Prof. Licia Sbattea - Poimi/ 2016

20 AT - User Empowerment Daiy ife supports Functiona supports Communicative Supports Cognitive Assistants Decision Making Supports The user centered paradigm Guideines for Research and Deveopment Prof. Licia Sbattea - Poimi/ 2016

21 AT Sensoria Rehabiitation Sensoria Disabiity: visua auditive Virtua Contexts More or ess invasive techniques Mixed Strategies Prof. Licia Sbattea - Poimi/ 2016

22 AT- Rehabiitation and Robotics Main topics: functionaity programmabiity Support to functiona rehabiitation Definition to the rehabiitative strategy Its evauation and vaidation A cognitive / reationa Partner Prof. Licia Sbattea - Poimi/ 2016

23 AT - BCI Neuroscience, Neuropsychoogy, Cognitive Psychoogy, Cinics Signa Detection Monitoring rehabiitative process Modeing menta process at different eve Appications Rehabiitation Mediated Interaction Prof. Licia Sbattea - Poimi/ 2016

24 R&D The Reationa Mind The Mind is mutimoda and compex Perception Synaesthesia Spatia Dimensions Tempora Dimensions Memory Attention / Shared Attention Emotiona and Affective Aspects Language / Diaogue / Linguistic acts Identification (adut and prestigious artifacts) Responsibiity / Management For new reationships and adut ife Prof. Licia Sbattea - Poimi/ 2016

25 R&D Imitation and Simuation Mirror Neurons: A neurophysioogica base for imitation and simuation The reationship is stressed To earn To cooperate To communicate To sef identify I know what You do Empathy and non-verba resonant channe Imitation / embodied simuation I know what You do,.. What You fee.. What You hear? Prof. Licia Sbattea - Poimi/ 2016

26 POLIMI The ATGroup Assistive Technoogy Group, the mission: Identify, forecast, impement, promote and appy innovative method and technoogy from ICT for the deveopment of sustainabe soutions for disabed and edery which guarantees the recovery of functionaity, socia integration, equa opportunities, heath, sef determination and quaity of ife Prof. Licia Sbattea - Poimi/ 2016

27 POLIMI - MutiChancePoiTeam The wireess Campus 400 students with motor, sensoria disabiity and specific earning impairments Accessibe ICT and innovative projects Personaized access to distributed services On-ine studying (but ony when reay needed) Specia projects UbiCampus 4Whees Vocaization, prediction and correction for Dysexia PoiNotes, PoiSpe, PoiLips, SPARTA 2 KASPER Prof. Licia Sbattea - Poimi/ 2016

28 POLIMI - ESAGRAMMA Mutimoda Communication For Kids, Young and Aduts with autism and menta retard Cooperative activities of: storyteing mutimoda interaction (verba, textua, auditory- musica, tactie, gestura, iconic, AAC, ) Design and evauation of rehabiitative pathways Prof. Licia Sbattea - Poimi/ 2016

29 Universa Accessibiity: UN poicies G3ict The Goba Initiative for Incusive ICTs. A Fagship Advocacy Initiative of the United Nations Goba Aiance for ICT and Deveopment Internationa Projects: Digita Accessibiity Index for Persons with DIsabiities (G3ict /ITU / POLIMI: DEI, Mcpt ) Tookit for Poicy Makers on e-accessibiity and Service Needs for Persons with Disabiities (G3ict / ITU / POLIMI: DEI, Mcpt ) ICT4IAL Guideines for accessiibity of contents and materias (EAgency, G3ict, Daisy Cons., EuSchoonet, IAU) Prof. Licia Sbattea - Poimi/ 2016

30 R&D - EU poicy Strategic research items: Standardization and protocos Cognitive Disabiity (and edery) Mutimoda Interaction Brain Computer Interaction User profiing and vaidation of strategies Low cost avaiabiity of devices and best practices Different stackhoders Not a specific strategy but a user-centered DESIGN POLICY Where user can be so specia! Prof. Licia Sbattea - Poimi/ 2016

31 AT Internationa Contexts Rehabiitation Engineering and AT Society of North America - RESNA North Caroine State Univ. Center for Universa Design - Internationa Conferences and Workshops AAATE (Europe) ICCHP (IFIP) ASSETS (ACM) HCI, CHI EDULEARN, ICERI, Magazine and Scientific Journas Computer Science (HCI, e-earning, Web Services, MM e MC,..) Psychoogy pedagogy neuro-psychoogy Specific references: ASPHI, SIVA, ESTEEN (porta), ATIS4a (porta), HANDYMATICA (Boogna) Prof. Licia Sbattea - Poimi/ 2016

32 Bibiography 1) INTERACTION DESIGN. BEYOND HUMAN-COMPUTER INTERACTION, 3 rd Edition, Y. Rogers, H. Sharp, J. Preece, Wiey, ) ASSISTIVE TECHNOLOGY, Principes and Practice, 3 rd Edition, A. M. Cook, J. Mier Pogar, S. M. Hussey (author emerita), Esevier, ) The SLIDES prepared by the teachers Further readings: 1) INCLUSIVE DESIGN GUIDELINES FOR HCI, Coette Nicoe, Juio Abasca, Tayor & Francis, ) JUST ASK: INTEGRATING ACCESSIBILITY THROUGHOUT DESIGN, Henry, Shawn Lawton, ) USER INTERFACES FOR ALL: CONCEPTS, METHODS, AND TOOLS (Human Factors and Ergonomics), Constantine Stephanidis (Editor), 2000 Prof. Licia Sbattea - Poimi/ 2016

33 Bibiography 4) UNDERSTANDING ACCESSIBILITY, Robert B. Yonaitis, HiSoftware, pdf onine 5) ASSISTIVE TECHNOLOGY. Matching device and consumer for successfu rehabiitation, M. J, Scherer (editor), American Psychoogica Association, ) CONNECTING TO LEARN. Educationa and Assistive Technoogy for Peope with disabiities, M. Scherer, American Psychoogica Association, ) ASSISTIVE TECHNOLOGY IN THE WORKPLACE, D. de Jonge, M. J. Scherer, S. Rodger, Mosby Esevier, ) EXTRA-ORDINARY HUMAN-COMPUTER INTERACTION. Interfaces for users with disabiities, A. D. N. Edwards (editor), Cambridge University Press, ) AUGMENTATIVE AND ALTERNATIVE COMMUNICATION: European Perspectives, S. Von Tetzchner, M. H. Jensen (editors), Whurr Pubishers Ltd, London, ) The G3ict pubications (see 11) Seected papers from the Proceeding of Internationa Conferences and Workshops HCI, AAATE, ICCHP, ASSETS Prof. Licia Sbattea - Poimi/ 2016