Title
Mechanisms of visual-auditory temporal processing for artificial intelligence
Abstract
In everyday life, our brains integrate various kinds of information from different modalities to perceive our complex environment. Temporal synchrony of audiovisual stimuli is required for audiovisual integration. Many studies have shown that temporal asynchrony of visual-auditory stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms of asynchrony inputs were not well understood. In present study, visual and auditory stimuli onset asynchrony (SOA= ±250 ms, ±200 ms, ±150 ms, ±100 ms, ±50 ms, 0 ms), only the auditory stimulus was attended. From the behavioral results, the responses to temporal asynchronous audiovisual stimuli were more accurate than unimodal auditory stimuli. The most significant enhancement was SOA = -100ms condition (the visual preceding), which reaction time was the fastest. These results revealed the basis of audiovisual interaction in which audiovisual stimuli presented with different SOA. The temporal alignment of visual-auditory stimuli can enhance the auditory detection. The study can offer basic theory for artificial intelligence.
Year
DOI
Venue
2014
10.1109/BMEI.2014.7002868
BMEI
Keywords
Field
DocType
visual stimulus interaction,audiovisual integration,temporal alignment,auditory stimulus interaction,time -100 ms,artificial intelligence,information integration,neurophysiology,asynchrony input,temporal asynchronous audiovisual stimuli response,hearing,complex environment perception,behavioral result,multisensory mechanism,temporal synchrony,visual stimuli onset asynchrony,visual-auditory stimuli alignment,visual preceding,auditory stimuli onset asynchrony,brain,temporal asynchrony,modality variation,visual perception,unimodal auditory stimuli,multimodal,soa enhancement,auditory detection enhancement,visual-auditory temporal processing mechanism,synchronisation,audiovisual interaction,reaction time,visualization
Modalities,Computer vision,Asynchronous communication,Auditory stimuli,Asynchrony,Visualization,Computer science,Speech recognition,Artificial intelligence,Stimulus (physiology)
Conference
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Jingjing Yang103.04
Qi Li201.35
Xiujun Li302.03
Jing-Long Wu421029.63