Siri: A Virtual Personal Assistant An Ontology-driven Application for the Masses

Transcription

1 Siri: A Virtual Personal Assistant An Ontology-driven Application for the Masses 2010 Siri, Inc. All rights reserved. Adam Cheyer and Tom Gruber cofounders, Siri

2 It was imaginable 20 years ago. Apple's Visionary Video: Knowledge Navigator (1987) from

3 Interaction with the Assistant Touch screens and cinematic animation Global network for info and collaboration Awareness of temporal and social context Continuous Speech in and out Conversational Interface - assistant talks back Delegation of tasks to the assistant Assistant use of personal data

4 How Close are we Today? Touch screens Cinematic effects Global network Location and time awareness Speech out, on demand Isolated speech to text But where is the interface for assistance?

5 Location Awareness Time Awareness Task Awareness Conversational Interface Speech to Text Access to Personal Information Text to Intent Dialog flow Semantic Data Services APIs Task & Domain Models

6 A Virtual Personal Assistant

7 The Assistant Paradigm For Human-Computer Interaction focus on task completion intent understanding via conversation in context learns and applies personal information

8 A VPA helps you get things done TIRED "what do you want to read?" "at your service" "at your service(s)"

9 The Ecosystem of APIs and Online Data Over 1600 APIs growing at accelerated rate...

10 Composability amplifies the power of services. API-perspective.aspx

11 Virtual Personal Assistant NLP Autocomplete Dialog Restaurants Movies Events Weather Travel Local Search

12 Video:

13 The Interface is a Conversation Book Fleur de Lys at 9:00 I need a romantic place for dinner tonight. I found these romantic French restaurants with tables available at 7:00 and 9:00 I want a reservation, 2 people. I found these romantic restaurants near you. Somewhere in soma. I found these romantic French restaurants in SOMA, San Francisco I found these romantic restaurants in SOMA, San Francisco How about French?

14 Example Task Automation I found the following Italian restaurants that reviews say are romantic near your home Your table is reserved for 2 Saturday night at 8:00pm. Multiple-criteria vertical search combining multiple sources of information with integrated transactions and social communication Your invitation has been sent to friend@ .com

15 Task-oriented NL Understanding Natural Language matching Concept Disambiguation get me a table for the best italian food in palo alto get me a table italian food Booking a restaurant in palo alto Location: Palo Alto get me a table Request Intent Identification Service Data Gathering Restaurant italian food RestaurantType: italian best italian food Preference: rating shopping Restaurant Request Service Invocation Time: tonight [default] Restaurant Listing Results Presentation Availability of Best Italian Restaurants in Palo Alto Il Fornaio 6:30 9:00 9:30

16 Ontology Unifies all Models Domains Language Tasks Services Dialog User Ontology (c) 2009 Siri, Inc.

17 tool demo

18 Semantic Autocomplete Find restaurants, hotels, movies, Book a table, a room, a seat, Schedule a meeting, an event, Remember to a thing to do Buy a ticket, a book, a DVD, Check a flight, the weather,

19 Dialog modules organized by generic task and domain Taskindependent Driven by Generic Task Domain Specific Prompt Explain Present Offer

20 Task Models Plan a Meal Find a store Find something to do Plan a trip Go to the movies...

21 Model-driven Service Orchestration Best lasagna in SF Restaurants tonight Menu Item >+ Reviews >+ Preference >+ Rating > Location Availability >+ Hours >+ Preference >+ Ratings

22 Conclusion Building an assistant requires the integration of a lot of technology. But it's no longer an art. Using ontologies and declarative models transform the problem into (knowledge) engineering. And it works.

23 For More Information Download: (c) 2009 Siri, Inc.