Paper Info
Title
Audio and Visual Cues in a Two-Talker Divided Attention Speech-Monitoring Task.
Abstract
Although audiovisual (AV) cues are known to improve speech intelligibility in difficult listening environments, little is known about their role in divided attention tasks that require listeners to monitor multiple talkers at the same time. In this experiment, a call-sign-based multitalker listening test was used to evaluate performance in two-talker AV configurations that combined zero, one, or two channels of visual information (neither, one, or both talkers visible) with zero, one, or two channels of audio information (no audio, both talkers played from the same loudspeaker, and both talkers played through different, spatially separated loudspeakers). The results were analyzed to determine the relative performance levels that would occur with each AV configuration with target information that was equally likely to originate from either of the two talkers in the stimulus. The results indicate that spatial separation of the audio signals has the greatest impact on performance in multichannel AV speech displays and that caution should be used when presenting a visual representation of only a single talker unless that talker is known to be the highest priority talker in the combined AV stimulus. Potential applications of this research include the design of improved audiovisual speech displays for multichannel communications systems.
Year
DOI
Venue
2005
10.1518/001872005774860023
HUMAN FACTORS
Keywords
Field
DocType
visual cues,communication system,speech intelligibility
Sensory cue,Speech processing,Audio signal,Voice activity detection,Cued speech,Psychology,Motor theory of speech perception,Speech recognition,Acoustic model,Intelligibility (communication)
Journal
Volume
Issue
ISSN
47
3
0018-7208
Citations 
PageRank 
References 
2
0.74
1
Authors
3
Name
Order
Citations
PageRank
Douglas S. Brungart1285.63
Alexander J. Kordik2153.57
Brian D. Simpson3398.77