Title
Toward a subjective synchronous communication in multimodal human-machine interaction: Intention of movement alternates simultaneous perception in auditory-tactile temporal order judgment
Abstract
We investigated the effect of voluntary movement on temporal multimodal integration using a psychological experiment. The present study used auditory-tactile Temporal Order Judgment (TOJ) task to measure the differences in Point of Subjective Simultaneity (PSS) and Just Noticeable Difference (JND). To distinguish the effect of voluntary movement and proprioceptive feedback, we prepared three conditions: Voluntary condition, Involuntary condition, and No-movement condition. Voluntary movement and Involuntary movement shifted PSS to the point where an auditory stimulus presented prior to a tactile stimulus compared to No-movement condition. Furthermore, the shift of PSS in Voluntary condition was larger than that in Involuntary condition. JND of Voluntary condition was smaller than those of the other two conditions. These results revealed that voluntary movement improved temporal resolution between auditory and tactile stimuli. Moreover, it was demonstrated that voluntary movement also alternates audio-tactile temporal integration.
Year
DOI
Venue
2012
10.1109/MHS.2012.6492493
Micro-NanoMechatronics and Human Science
Keywords
Field
DocType
bioelectric potentials,biomechanics,feedback,hearing,neurophysiology,psychology,touch (physiological),JND,PSS shift,audio-tactile temporal integration,auditory stimuli,auditory-tactile TOJ,auditory-tactile temporal order judgment,involuntary condition,just noticeable difference,multimodal human-machine interaction,no movement condition,perception,point of subjective simultaneity,proprioceptive feedback,psychological experiment,subjective synchronous communication,tactile stimulus,temporal multimodal integration,temporal resolution,voluntary movement
Simultaneous perception,Cognitive psychology,Control engineering,Artificial intelligence,Just-noticeable difference,Stimulus (physiology),Temporal resolution,Human machine interaction,Asynchronous communication,Computer vision,Proprioception,Materials science,Simultaneity
Conference
ISSN
ISBN
Citations 
2474-378X
978-1-4673-4811-9
0
PageRank 
References 
Authors
0.34
3
4
Name
Order
Citations
PageRank
Nishi, A.100.34
Yokoyama, M.200.68
Ogata, T.300.34
Nozawa, T.4162.15