The Future of Communication

Transcription

1 Future Technologies I: Communication Session 2 Hannover, 3 November 2010 The Future of Communication Wolfgang Wahlster German Research Center for Artificial Intelligence Saarbrücken, Kaiserslautern, Bremen, Berlin Phone: +49 (681) /4162 Fax: +49 (681) / wahlster@dfki.de WWW:

2 The Future Internet 3D Internet Internet of Things Semantic Web Internet of Services Multimodal Interaction Technologies Trusted Cloud Broadband Communication

3 Syntactic vs. Semantic Web Syntactic Web HTML XML understands content Semantic Web OWL, RDF, OWL-S

4 Web 3.0 = Semantic Web + Web 2.0 semantic foundation Semantic Web Web 3.0 Web 1.0 Web 2.0 community based

5 Outline of Today s Talk Breaking Communication Barriers: The digital product memory (M2M Communication) Next Generation Speech Understanding Systems (Human Human Interaction) Multimodal Interaction in the Car (Human Machine Interaction)

6 From RFID to Smart Wireless Sensors: Identification and Monitoring Smart Sensor Items tablet Number box blister pack europallet Smart Dust container Cost Time W. Wahlster

7 Building Personal Digital Memories from an Instrumented Environment s Observations Grocery Shopping Cooking Personal Digital Memories

8 Products with Integrated Dynamic Digital Storage, Sensing, and Wireless Communication Capabilities The product as an information container The product carries information across the complete supply chain and its lifecycle. The product as an agent I was produced on 30 April 2010 and shipped on 3 May 2010 Grasp at the middle The product affects its environment The product as an observer 2 mins open Please close! The product monitors itself and its environment W. Wahlster

9 Browsing the Semantic Product Memory at the Fridge s Display at the Customer s Home W. Wahlster

10 Realtime Monitoring of Small and Large Containers with Digital Product Diaries for Smart Logistics Smart Temperature Sensor on Small DHL Packet PPosition Security Condition W. Wahlster

11 Tracking and Tracing in the Logistics Chain Track and Trace Device Energy Management Unit DHL Realtime Information Hub Localization Component Communication Unit Sensor Interface SemProm Acess Unit Tracking of Light, Shock Pressure, Motion, Temperature Internal Sensors Access to Product Memory On Packet Level Volume Monitoring Database of Customers Packets without Smart Item SemProm Packet with Temperature Sensor W. Wahlster

12 DFKI s Fembot AILA: Using the Semantic Product Memory for Adaptive Grasping Stereo Cameras in the Head and 3D Camera on the Torso for Approaching an Object Reading Size, Weight and Lifting Points from the Product Memory with an antenna in the left hand. W. Wahlster

13 Combining all Senses - Getting Rid of Keyboard and Mouse Speech Graphics Gesture Multimodal Interaction Biometrics Physical Action Facial Expression Body Language

14 Beyond SmartPhones: The Emotional Phone as an Organic User Interface (transmitting kisses, breath, pressure) See Fabian Hammert, Deutsche Telekom Laboratories (T-Labs), Berlin

15 Beyond SmartPhones: Changing Size, Shape, Weight as a Cognitive Affordance

16 A Bold Vision: Back to an Oral Society? 1450 Mainz 2050 W -560 Years today Oral Society Store Retrieve Copy Edit Textual Society +40 Years today Simultaneous Speech Translation Systems Summarization Systems Digital Voice Recording Voic Speech Retrieval

17 Verbmobil: Simultaneous Translation of Spontaneous Dialogs German Englisch Japanese Chinese, Wahlster 2000

18 Multilingual Dialog in a Restaurant with the i-you System by Yocoy

19 Multiparty Speaker Diarization and Tracking Who spoke When, with Whom, Where about What? Overlapped, non-native accented and spontaneous Speech

20 Just-in-time Access to Relevant Documents or Fragments of Past Recorded Meetings Killer App for Call Centers: Just-in-Time Answer Retrieval during the Conversation between an Agent and a Customer by Parallel Speech Understanding

21 SuVi: The Generation of Meeting Summaries as Story Boards in Cartoon Style Still pictures extracted from video capture, cartoon-style speech balloons for spoken dialog contributions and text boxes for the results of topic detection

22 Texo: Multimodal Speech Interface to Web Services

23 Future Cars as Mobile Computers, Mobile Sensors and Mobile Internet Nodes 1. More Safety 2. Less Pollution 3. More Efficiency 4. Better Connectivity 5. More Fun

24 Semantic Peer-to-Peer Communication GPS: Position of Car Attention! Risk of aquaplaning 100 meters ahead!!! GPS: Position of Bike Semantic Peer-to-Peer Connection Aquaplaning Sensor Large wedge of water under the wheels of the car

25 Semantic Car2Car Communication for Local Danger Warning

26 The Intelligent Intersection Assistant: Car2Bike Communication with Automatic Blinking and Honking

27 CANSpeech: DFKI s new Speech Interface for the CAN Bus Warmer seat please! I'm cold. What's the temperature in the car? Please close my window partially. Set the temperature at 22 degrees! Open all windows! CAN = Controller Area Network, bus for real-time car apps 27

28 Combining Tangible Interfaces and Spoken Interaction Faster! Faster! Interpretation and disambiguation of multimodal utterances on the basis of the in-car context: selecting a wiper speed setting vs changing the speed of cruise control

29 Multimodal Interaction: Speech and Tangible Interfaces W. Wahlster

30 Multimodal Interaction: Speech and Eye Gazes Stau Using eye gazes as additional input modality: Here: correcting dictated speech messages while driving

31 Multimodal Interaction: Speech and Eye Gazes Twitter4Car

32 Multimodal Interaction: Speech and 2D Gestures gesture circle show circular context menu (AUDI) slow: browse context menu

33 Multimodal Persuasive Intervention If you keep on driving like this, you ll burn up a lot more gas than yesterday! Hey, it s green! Better watch the road. See you later green mobility: motivating users to change their behavior by persuasive intervention emotional virtual character persuades driver to drive energy-efficiently character only appears when driving situation allows this (parking, red light, )

34 The Future of Communication? Embodied Interaction with Humanoid Robots Realistic Facial Expressions combined with Emotional Speech Synthesis: the Robotic Head by Hanson Robotics used by a Team at the University of Bristol

35 Conclusion: ICT will help to Break Communication Barriers Human Man Human Man Speech-to-Speech Translation German Human Man Machine Chinese Human-Machine Interaction Chinese Java Machine Machine M2M Communication OWL RDF

36 Thank you for your attention Zu Zuse Year 2010