Using VoiceXML, XHTML, and SCXML to Build Multimodal Applications. James A. Larson

Size: px

Start display at page:

Download "Using VoiceXML, XHTML, and SCXML to Build Multimodal Applications. James A. Larson"

John Hardy
10 years ago
Views:

1 Using VoiceXML, XHTML, and SCXML to uild Multimodal pplications James. Larson

2 genda SCXML controls the flow of an application SCXML controls modalities VoiceXML XHTML Others, e.g., InkML, SVG SCXML controls Web services

3 State Chart XML Represents a state transition system States Transitions

4 Possible ctions within a <state> <if > <else/> <log /> </if> Multimodal life cycle events <cancel /> <pause /> <resume /> <data /> Executable content <assign/> <var> <script/> <if/>, <elseif/>, <else/> <log/>

5 SCXML Sequentially perform the actions in two states <prepare /> <state id=""> <prepare /> target=""/> <state id="">

6 Conditional branch SCXML <prepare /> OK C Opps <state id=""> <prepare /> cond="result='ok '" target=""/> cond="result='opps'" target="c"/>

7 Parallel States SCXML C D <state id=""> <transition. target=""/> <state id=""/> <parallel> <state id="c"/> <state id="d"/> </parallel>

8 genda SCXML controls the flow of an application SCXML controls modalities VoiceXML XHTML Others, e.g., InkML, SVG SCXML controls Web services

9 SCXML + VoiceXML <state id=""> <start name= "getirport.vxml" /> target=""/> state id=""> getirport.vxml <?xml version="1.0"?> <vxml version="3.0" xmlns = " <form id = "destination" > <field name = "irport"> <grammar src= "airport.grxml"/> <prompt>say your destination airport </prompt> <grammar src= irport.grxml </field> <filled> <send event= "" namelist = "irport" /> </filled> </form> </vxml>

org/2001/vxml"> <form id = "destination" > <field name = "irport"> <grammar src= "airport.

10 SCXML + XHTML <state id=""> <start name= "getirport.xhtml" /> getirport.xhtml target=""/> <html/> <head> <ev:listener ev:event="onchange" ev:observer="bodyid" ev:handler= "senddone()" /> state id=""> <script> {function senddone } </script> </head>  <body id="bodyid"/><p>enter month</p> <input type="text" id="month"/> </body> </html>

ev:handler= "senddone()" /> state id=""> <script> {function senddone } </script>

11 SCXML + XHTML + VoiceXML 1 2 <state id="1"> <start name= "getirport.vxml" /> target=""/> <state id="2"> <start name= "getirport.xhtml" /> target=""/> state id="">

12 nother example of multiple modalities SCXML + InkML + VoiceXML 1 2 <state id="1"> <start name= "getstuff.vxml" /> target=""/> <state id="2"> <start name= "getstuff.inkml" /> target=""/> state id="">

13 SCXML + InkML + VoiceXML 1 2 <state id="1"> <start name= "getstuff.vxml" /> target=""/> <state id="2"> <start name= "getstuff.inkml" /> target=""/> <interpretation mode = "speech"> <travel> <to hook="ink"/> <from hook="ink"/> <day> Tuesday </day> </travel> </interpretation> state id="">

inkml" /> target=""/> <interpretation mode = "speech"> <travel> <to

14 SCXML + InkML + VoiceXML 1 2 <state id="1"> <start name= "getstuff.vxml" /> target=""/> <state id="2"> <start name= "getstuff.inkml" /> target=""/> <interpretation mode = "speech"> <travel> <to hook="ink"/> <from hook="ink"/> <day> Tuesday </day> </travel> </interpretation> state id=""> <interpretation mode = "ink"> <travel> <to>las Vegas </to> <from>portland </from> </travel> </interpretation>

inkml" /> target=""/> <interpretation mode = "speech"> <travel> <to hook="ink"/> <from hook="ink"/>

15 SCXML + InkML + VXML 1 <state id="1"> <start name= "getstuff.vxml" /> target=""/> <interpretation mode = "interp1"> <travel> <to> Las Vegas </to> <from> Portland </from> <day> Tuesday </day> </travel> </interpretation> 2 <state id="2"> <start name= getstuff.inkml" /> target=""/> <interpretation mode = "speech"> <travel> <to hook="ink"/> <from hook="ink"/> <day> Tuesday </day> </travel> </interpretation> state id=""> <interpretation mode = "ink"> <travel> <to>las Vegas </to> <from>portland </from> </travel> </interpretation>

</travel> </interpretation> 2 <state id="2"> <start name= getstuff.

16 genda SCXML controls the flow of an application SCXML controls modalities VoiceXML XHTML Others, e.g., InkML, SVG SCXML controls Web services

17 SCXML Control More Than Just Modalities vxml sql complexcalculation SQL Complex calculations Web services xhtml <start />

18 References State Chart XML (SCXML): State Machine Notation for Control bstraction Multimodal rchitecture and Interfaces Commons SCXML (Open Source)

org/tr/scxml/ Multimodal rchitecture and Interfaces

19 Summary SCXML controls the flow of an application SCXML controls modalities XHTML VoiceXML Others, e.g., inkml, SVG SCXML controls Web services

Standard Languages for Developing Multimodal Applications

Standard Languages for Developing Multimodal Applications James A. Larson Intel Corporation 16055 SW Walker Rd, #402, Beaverton, OR 97006 USA [email protected] Abstract The World Wide Web Consortium