Paper Info
Title
Assessing the Contribution of Semantic Congruency to Multisensory Integration and Conflict Resolution.
Abstract
The efficient integration of multisensory observations is a key property of the brain that yields the robust interaction with the environment. However, artificial multisensory perception remains an open issue especially in situations of sensory uncertainty and conflicts. In this work, we extend previous studies on audio-visual (AV) conflict resolution in complex environments. In particular, we focus on quantitatively assessing the contribution of semantic congruency during an AV spatial localization task. In addition to conflicts in the spatial domain (i.e. spatially misaligned stimuli), we consider gender-specific conflicts with male and female avatars. Our results suggest that while semantically related stimuli affect the magnitude of the visual bias (perceptually shifting the location of the sound towards a semantically congruent visual cue), humans still strongly rely on environmental statistics to solve AV conflicts. Together with previously reported results, this work contributes to a better understanding of how multisensory integration and conflict resolution can be modelled in artificial agents and robots operating in real-world environments.
Year
Venue
Field
2018
arXiv: Artificial Intelligence
Multisensory integration,Computer science,Conflict resolution,Environmental statistics,Cognitive psychology,Artificial intelligence,Stimulus (physiology),Sensory system,Robot,Perception,Congruence (geometry),Machine learning
DocType
Volume
Citations 
Journal
abs/1810.06748
0
PageRank 
References 
Authors
0.34
0
7
Name
Order
Citations
PageRank
Di Fu185.00
Pablo V. A. Barros211922.02
German Ignacio Parisi324821.75
Haiyan Wu421.70
Sven Magg56713.49
Xun Liu613.43
Stefan Wermter71100151.62