Title
The WAMI toolkit for developing, deploying, and evaluating web-accessible multimodal interfaces
Abstract
Many compelling multimodal prototypes have been developed which pair spoken input and output with a graphical user interface, yet it has often proved difficult to make them available to a large audience. This unfortunate reality limits the degree to which authentic user interactions with such systems can be collected and subsequently analyzed. We present the WAMI toolkit, which alleviates this difficulty by providing a framework for developing, deploying, and evaluating Web-Accessible Multimodal Interfaces in which users interact using speech, mouse, pen, and/or touch. The toolkit makes use of modern web-programming techniques, enabling the development of browser-based applications which rival the quality of traditional native interfaces, yet are available on a wide array of Internet-connected devices. We will showcase several sophisticated multimodal applications developed and deployed using the toolkit, which are available via desktop, laptop, and tablet PCs, as well as via several mobile devices. In addition, we will discuss resources provided by the toolkit for collecting, transcribing, and annotating usage data from multimodal user interactions.
Year
DOI
Venue
2008
10.1145/1452392.1452420
ICMI
Keywords
Field
DocType
wami toolkit,web-accessible multimodal interface,web-accessible multimodal interfaces,authentic user interaction,compelling multimodal prototype,sophisticated multimodal application,internet-connected device,multimodal user interaction,browser-based application,annotating usage data,graphical user interface,web accessibility,application development,speech recognition,user interface,world wide web,mobile device,voice over ip
Transcription (linguistics),Laptop,Computer science,Input/output,Mobile device,Human–computer interaction,Graphical user interface,Usage data,Multimedia,Voice over IP
Conference
Citations 
PageRank 
References 
34
2.87
12
Authors
3
Name
Order
Citations
PageRank
Alexander Gruenstein121623.52
Ian McGraw225324.41
Ibrahim Badr3935.70