Title
Multimodal Sentence Similarity in Human-Computer Interaction Systems
Abstract
Human-to-human conversation remain such a significant part of our working activities because its naturalness. Multimodal interaction systems combine visual information with voice, gestures and other modalities to provide flexible and powerful dialogue approaches. The use of integrated multiple input modes enables users to benefit from the natural approach used in human communication. However natural interaction approaches may introduce inter-pretation problems. This paper proposes a new approach to match a multimodal sentence with a template stored in a knowledge base to interpret the multimodal sentence and define the multimodal templates similarity. We have assumed to map each multimodal sentence to the natural language one. The system then provides the exact/approximate interpretation according to the template similarity level.
Year
DOI
Venue
2007
10.1007/978-3-540-74827-4_51
KES (2)
Keywords
Field
DocType
natural interaction approach,human-to-human conversation,template similarity level,multimodal sentence similarity,human-computer interaction systems,powerful dialogue approach,new approach,natural language,multimodal templates similarity,multimodal sentence,natural approach,multimodal interaction system,human computer interaction,multimodal interaction,knowledge base
Multimodal interaction,Gesture,Computer science,Naturalness,Natural approach,Natural language,Human–computer interaction,Natural language processing,Artificial intelligence,Knowledge base,Human communication,Sentence
Conference
Volume
ISSN
Citations 
4693
0302-9743
1
PageRank 
References 
Authors
0.35
8
3
Name
Order
Citations
PageRank
Fernando Ferri1278.99
Patrizia Grifoni228746.89
Stefano Paolozzi3707.75