Title | ||
---|---|---|
The WAMI toolkit for developing, deploying, and evaluating web-accessible multimodal interfaces |
Abstract | ||
---|---|---|
Many compelling multimodal prototypes have been developed which pair spoken input and output with a graphical user interface, yet it has often proved difficult to make them available to a large audience. This unfortunate reality limits the degree to which authentic user interactions with such systems can be collected and subsequently analyzed. We present the WAMI toolkit, which alleviates this difficulty by providing a framework for developing, deploying, and evaluating Web-Accessible Multimodal Interfaces in which users interact using speech, mouse, pen, and/or touch. The toolkit makes use of modern web-programming techniques, enabling the development of browser-based applications which rival the quality of traditional native interfaces, yet are available on a wide array of Internet-connected devices. We will showcase several sophisticated multimodal applications developed and deployed using the toolkit, which are available via desktop, laptop, and tablet PCs, as well as via several mobile devices. In addition, we will discuss resources provided by the toolkit for collecting, transcribing, and annotating usage data from multimodal user interactions. |
Year | DOI | Venue |
---|---|---|
2008 | 10.1145/1452392.1452420 | ICMI |
Keywords | Field | DocType |
wami toolkit,web-accessible multimodal interface,web-accessible multimodal interfaces,authentic user interaction,compelling multimodal prototype,sophisticated multimodal application,internet-connected device,multimodal user interaction,browser-based application,annotating usage data,graphical user interface,web accessibility,application development,speech recognition,user interface,world wide web,mobile device,voice over ip | Transcription (linguistics),Laptop,Computer science,Input/output,Mobile device,Human–computer interaction,Graphical user interface,Usage data,Multimedia,Voice over IP | Conference |
Citations | PageRank | References |
34 | 2.87 | 12 |
Authors | ||
3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Alexander Gruenstein | 1 | 216 | 23.52 |
Ian McGraw | 2 | 253 | 24.41 |
Ibrahim Badr | 3 | 93 | 5.70 |