Title
Increasing robustness of multimodal interaction via individual interaction histories.
Abstract
Multimodal input fusion can be considered a well researched topic and yet it is rarely found in real world applications. One reason for this could be the lack of robustness in real world situations, especially regarding unimodal recognition technologies like speech and gesture, that tend to produce erroneous inputs that can not be detected by the subsequent multimodal input fusion mechanism. Previous work implying the possibility to detect and overcome such errors through knowledge of individual temporal behaviors has neither provided a real-time implementation nor evaluated the real benefit of such an approach. We present such an implementation of applying individual interaction histories in order to increase the robustness of multimodal inputs within a smartwatch scenario. We show how such knowledge can be created and maintained at runtime, present evaluation data from an experiment conducted in a realistic scenario, and compare the approach to the state of the art known from literature. Our approach is ready to use in other applications and existing systems, with the prospect to increase the overall robustness of future multimodal systems.
Year
DOI
Venue
2016
10.1145/3011263.3011273
MA3HMI@ICMI
DocType
Citations 
PageRank 
Conference
0
0.34
References 
Authors
9
4
Name
Order
Citations
PageRank
Felix Schüssel1174.12
Frank Honold252.81
Nikola Bubalo3253.76
Michael Weber485785.80