Paper Info
Title
Can Visualization Of Internal Articulators Support Speech Perception?
Abstract
This paper describes the contribution to speech perception given by animations of intra-oral articulations. 18 subjects were asked to identify the words in acoustically degraded sentences in three different presentation modes: acoustic signal only, audiovisual with a front view of a synthetic face and an audiovisual with both front face view and a side view, where tongue movements were visible by making parts of the cheek transparent. The augmented reality side-view did not help subjects perform better overall than with the front view only, but it seems to have been beneficial for the perception of palatal plosives, liquids and rhotics, especially in clusters. The results indicate that it cannot be expected that intra-oral animations support speech perception in general, but that information on some articulatory features can be extracted. Animations of tongue movements have hence more potential for use in computer-assisted pronunciation and perception training than as a communication aid for the hearing-impaired.
Year
Venue
Keywords
2008
INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5
talking head, speech perception, speech visualization, audiovisual speech, internal articulation
Field
DocType
Citations 
Pronunciation,Computer science,Visualization,Motor theory of speech perception,Speech recognition,Augmented reality,Speech perception,Perception training,Perception,Information and Computer Science
Conference
5
PageRank 
References 
Authors
0.68
4
2
Name
Order
Citations
PageRank
Preben Wik18511.72
Olov Engwall219730.71