How to create a consistent connected vehicle user experience with multimodal HMIs. Dr. Dominique Massonié

Transcription

1 How to create a consistent connected vehicle user experience with multimodal HMIs Dr. Dominique Massonié

2 Elektrobit (EB) 2015 Model-based approach for synchronizing modalities Tooling to manage the complexity of creating multimodal HMIs

3 Our solutions for the automotive world Infotainment software and services - Connected navigation software - HMI tools for in-dash, digital instrument clusters and head-up displays - Global software integration and engineering services Connected services - Connected experiences around urbanization and electrification - Online diagnostics - Software and content updates Car Infrastructure software and services - EB tresos integrated ECU software and tools, based on AUTOSAR standards - Complete solutions for: basic software, functional safety, automotive security - Test & Analyzing solutions - Functional Safety consulting Driver Assistance software and services - Software development for driver assistance functions - Electronic horizon and test drive recording solutions - Driver Assistance modules and algorithms

4 In-car input modalities and user expectations

5 Interaction modalities for the driver Elektrobit (EB) 2015

6 Interaction modalities for the driver Elektrobit (EB) 2015

7 Interaction modalities for the driver Elektrobit (EB) 2015

8 User expectations Many car buyers have low affinity to technology and expect intuitive interaction (Natural Language Understanding, ) Elektrobit (EB) 2015

9 Enabling intuitive multimodal user interaction

10 Multimodal User Interaction Elektrobit (EB) 2015

11 Multimodal User Interaction towards NLU Elektrobit (EB) 2015

12 Personal Voice Assistant user view Elektrobit (EB) 2015

13 Personal Voice Assistant behind the surface Today 3:00 pm User: alternatives Free Text Dictation Possible Inference... John How long is your meeting? Please enter a description Elektrobit (EB) 2015

14 Hybrid NLU Speech Dialog Systems availability Cloud Elektrobit (EB) 2015

15 Model based approach for synchronizing modalities

16 Model based approach for synchronizing modahow to create a consistent connected vehicle user experience with multimodal HMIslities All modalities lead to Rome Elektrobit (EB), 2015

17 Synchronizing modalities using state machines Own state machine for speech; using same implementation as for graphical user interface (GUI) UML based flow modeling for HMI and Dialog business logic GUI and speech state machines synchronized via events Each speech state has always the same pattern Elektrobit (EB), 2015

18 Synchronizing modalities using state machines Own state machine for speech; using same implementation as for graphical user interface (GUI) UML based flow modeling for HMI and Dialog business logic GUI and speech Play state prompts machines synchronized via events Recognize Commands Each speech state has always the same pattern Elektrobit (EB), 2015

19 Tooling to manage the complexity of creating multimodal HMIs

20 Mastering HMI development traditional approach HMI development stakeholders: OEM, Tier1, SW suppliers (different tool chains and separate processes) Concept, prototyping Specification, simulation, requirements Development, validation, mass production Leading to : Maintenance, functional update Misunderstandings and unexpected HMI behavior Time-consuming development loops and challenging optimization cycles Performance troubles Elektrobit (EB),

21 Mastering HMI development tool-based approach HMI development stakeholders: OEM, Tier1, SW suppliers (different tool chains and separate processes) Concept, prototyping Specification, simulation, requirements Development, validation, mass production Maintenance, functional update HMI development from user-concept to series product with a continuous tool chain and an integrated process. => reuse of working results/complete HMI for other models and brands Elektrobit (EB),

22 Register now for your free copy of EB GUIDE 6 Contact us: dominique.massonie@elektrobit.com

23 Questions? Elektrobit (EB) 2015