Title
CONVERSATIONAL MULTI-MODAL BROWSER: AN INTEGRATED MULTI-MODAL BROWSER AND DIALOG MANAGER
Abstract
This paper describes a multi-modal, free flow browser. A multi-modal browserallows the user to perform tasks via any of several modalities, such as speechand GUI or devices available sequentially or concurrently. A free-flow or mixedinitiative browser allows the user to choose the navigation across an applicationand the order in which tasks are completed.This paper describes a system to provide flow conversational capability acrossmodalities or devices. Multi-modal interaction is provided using a DOM basedMVC multi-modal browser as described in [3,6-11] and extended with a event-driven form-based dialog manager [1,2]. We use XForms-based deviceindependent authoring for the applicatio [4,5,6]. This paper details theXForms-based programming model of conversational applications, theprinciples and architecture of an XForms-based and event driven, task oriented,mixed initiative dialog manager and the integration of a dialog manager and amulti-modal browser using a standard-based DOM event driven interface. Thedialog manager relies on a DOM based representatio of the form-basedframework presented in [1,2] to provide free-flow dialog management. Itdetermines the user's intention by measuring the relevance of user input todifferent tasks. It also provides focus determination by determining the nextlogical turn in the conversation.
Year
DOI
Venue
2003
10.1109/SAINT.2003.1183070
SAINT
Keywords
Field
DocType
paper details thexforms-based programming,event-driven form-based dialog manager,thedialog manager,user input todifferent task,mixedinitiative browser,free-flow dialog management,dialog manager,mixed initiative dialog manager,integrated multi-modal browser,conversational multi-modal browser,free flow browser,amulti-modal browser,graphical user interfaces,software architecture,programming model
Dialog box,World Wide Web,Conversation,Programming paradigm,Computer science,XForms,Graphical user interface,Human–computer interaction,Dialog system,Software architecture,Modal
Conference
ISBN
Citations 
PageRank 
0-7695-1872-9
2
0.41
References 
Authors
6
3
Name
Order
Citations
PageRank
Alpana Tiwari1272.27
Rafah A. Hosn271.61
Stéphane H. Maes38719.00