Title
Multimodal Human Computer Interaction with MIDAS Intelligent Infokiosk
Abstract
In this paper, we present an intelligent information kiosk called MIDAS (Multimodal Interactive-Dialogue Automaton for Self-service), including its hardware and software architecture, stages of deployment of speech recognition and synthesis technologies. MIDAS uses the methodology Wizard of Oz (WOZ) that allows an expert to correct speech recognition results and control the dialogue flow. User statistics of the multimodal human computer interaction (HCI) have been analyzed for the operation of the kiosk in the automatic and automated modes. The infokiosk offers information about the structure and staff of laboratories, the location and phones of departments and employees of the institution. The multimodal user interface is provided with a touch screen, natural speech input and head and manual gestures, both for ordinary and physically handicapped users.
Year
DOI
Venue
2010
10.1109/ICPR.2010.941
ICPR
Keywords
Field
DocType
speech recognition,automated mode,handicapped user,speech recognition result,intelligent information kiosk,multimodal human computer interaction,midas intelligent infokiosk,multimodal user interface,natural speech input,multimodal interactive-dialogue automaton,user statistic,speech synthesis,speech,data models,multimodal interaction,hidden markov models,artificial intelligent,hci,human computer interaction,automatic speech recognition,hardware architecture,software architecture,grammar,artificial intelligence
Data modeling,Speech synthesis,Software deployment,Computer science,Gesture,Human–computer interaction,Software architecture,User interface,Interactive kiosk,Hardware architecture
Conference
Citations 
PageRank 
References 
1
0.35
6
Authors
5
Name
Order
Citations
PageRank
Alexey Karpov129845.82
Andrey Ronzhin212221.22
Irina Kipyatkova3333.09
Alexander L. Ronzhin4255.34
lale akarun5120170.68