Future Technologies I: Communication Session 2 Hannover, 3 November 2010 The Future of Communication Wolfgang Wahlster German Research Center for Artificial Intelligence Saarbrücken, Kaiserslautern, Bremen, Berlin Phone: +49 (681) 302-5252/4162 Fax: +49 (681) 302-5383/5341 Email: wahlster@dfki.de WWW: http://www.dfki.de/~wahlster
The Future Internet 3D Internet Internet of Things Semantic Web Internet of Services Multimodal Interaction Technologies Trusted Cloud Broadband Communication
Syntactic vs. Semantic Web Syntactic Web HTML XML understands content Semantic Web OWL, RDF, OWL-S
Web 3.0 = Semantic Web + Web 2.0 semantic foundation Semantic Web Web 3.0 Web 1.0 Web 2.0 community based
Outline of Today s Talk Breaking Communication Barriers: The digital product memory (M2M Communication) Next Generation Speech Understanding Systems (Human Human Interaction) Multimodal Interaction in the Car (Human Machine Interaction)
From RFID to Smart Wireless Sensors: Identification and Monitoring Smart Sensor Items tablet Number box blister pack europallet Smart Dust container Cost Time W. Wahlster
Building Personal Digital Memories from an Instrumented Environment s Observations Grocery Shopping Cooking Personal Digital Memories
Products with Integrated Dynamic Digital Storage, Sensing, and Wireless Communication Capabilities The product as an information container The product carries information across the complete supply chain and its lifecycle. The product as an agent I was produced on 30 April 2010 and shipped on 3 May 2010 Grasp at the middle The product affects its environment The product as an observer 2 mins open Please close! The product monitors itself and its environment W. Wahlster
Browsing the Semantic Product Memory at the Fridge s Display at the Customer s Home W. Wahlster
Realtime Monitoring of Small and Large Containers with Digital Product Diaries for Smart Logistics Smart Temperature Sensor on Small DHL Packet PPosition Security Condition W. Wahlster
Tracking and Tracing in the Logistics Chain Track and Trace Device Energy Management Unit DHL Realtime Information Hub Localization Component Communication Unit Sensor Interface SemProm Acess Unit Tracking of Light, Shock Pressure, Motion, Temperature Internal Sensors Access to Product Memory On Packet Level Volume Monitoring Database of Customers Packets without Smart Item SemProm Packet with Temperature Sensor W. Wahlster
DFKI s Fembot AILA: Using the Semantic Product Memory for Adaptive Grasping Stereo Cameras in the Head and 3D Camera on the Torso for Approaching an Object Reading Size, Weight and Lifting Points from the Product Memory with an antenna in the left hand. W. Wahlster
Combining all Senses - Getting Rid of Keyboard and Mouse Speech Graphics Gesture Multimodal Interaction Biometrics Physical Action Facial Expression Body Language
Beyond SmartPhones: The Emotional Phone as an Organic User Interface (transmitting kisses, breath, pressure) See Fabian Hammert, Deutsche Telekom Laboratories (T-Labs), Berlin 2010 http://www.ted.com/talks/fabian_hemmert_the_shape_shifting_future_of_the_mobile_phone.html
Beyond SmartPhones: Changing Size, Shape, Weight as a Cognitive Affordance
A Bold Vision: Back to an Oral Society? 1450 Mainz 2050 W -560 Years today Oral Society Store Retrieve Copy Edit Textual Society +40 Years today Simultaneous Speech Translation Systems Summarization Systems Digital Voice Recording Voicemail Speech Retrieval
Verbmobil: Simultaneous Translation of Spontaneous Dialogs German Englisch Japanese Chinese, Wahlster 2000
Multilingual Dialog in a Restaurant with the i-you System by Yocoy
Multiparty Speaker Diarization and Tracking Who spoke When, with Whom, Where about What? Overlapped, non-native accented and spontaneous Speech
Just-in-time Access to Relevant Documents or Fragments of Past Recorded Meetings Killer App for Call Centers: Just-in-Time Answer Retrieval during the Conversation between an Agent and a Customer by Parallel Speech Understanding
SuVi: The Generation of Meeting Summaries as Story Boards in Cartoon Style Still pictures extracted from video capture, cartoon-style speech balloons for spoken dialog contributions and text boxes for the results of topic detection
Texo: Multimodal Speech Interface to Web Services
Future Cars as Mobile Computers, Mobile Sensors and Mobile Internet Nodes 1. More Safety 2. Less Pollution 3. More Efficiency 4. Better Connectivity 5. More Fun
Semantic Peer-to-Peer Communication GPS: Position of Car Attention! Risk of aquaplaning 100 meters ahead!!! GPS: Position of Bike Semantic Peer-to-Peer Connection Aquaplaning Sensor Large wedge of water under the wheels of the car
Semantic Car2Car Communication for Local Danger Warning
The Intelligent Intersection Assistant: Car2Bike Communication with Automatic Blinking and Honking
CANSpeech: DFKI s new Speech Interface for the CAN Bus Warmer seat please! I'm cold. What's the temperature in the car? Please close my window partially. Set the temperature at 22 degrees! Open all windows! CAN = Controller Area Network, bus for real-time car apps 27
Combining Tangible Interfaces and Spoken Interaction Faster! Faster! Interpretation and disambiguation of multimodal utterances on the basis of the in-car context: selecting a wiper speed setting vs changing the speed of cruise control
Multimodal Interaction: Speech and Tangible Interfaces W. Wahlster
Multimodal Interaction: Speech and Eye Gazes Stau Using eye gazes as additional input modality: Here: correcting dictated speech messages while driving
Multimodal Interaction: Speech and Eye Gazes Twitter4Car
Multimodal Interaction: Speech and 2D Gestures gesture circle show circular context menu (AUDI) slow: browse context menu
Multimodal Persuasive Intervention If you keep on driving like this, you ll burn up a lot more gas than yesterday! Hey, it s green! Better watch the road. See you later green mobility: motivating users to change their behavior by persuasive intervention emotional virtual character persuades driver to drive energy-efficiently character only appears when driving situation allows this (parking, red light, )
The Future of Communication? Embodied Interaction with Humanoid Robots Realistic Facial Expressions combined with Emotional Speech Synthesis: the Robotic Head by Hanson Robotics used by a Team at the University of Bristol
Conclusion: ICT will help to Break Communication Barriers Human Man Human Man Speech-to-Speech Translation German Human Man Machine Chinese Human-Machine Interaction Chinese Java Machine Machine M2M Communication OWL RDF
Thank you for your attention Zu Zuse Year 2010