Title
Improving human scoring of prosody using parametric speech synthesis.
Abstract
This paper proposes a method that utilizes parametric speech synthesis to improve human scoring of non-native speaker utterances. Instead of assessing each prosodic feature by directly listening to the utterance itself, in order to focus only on the target prosodic feature, the unassessed features are substituted with those of the native speakers. We used parametric speech synthesis to generate the features for substitution. In this study, HMM-based speech synthesis from an average model of native speakers was utilized. The experimental result shows that the proposed method can improve scoring reliability, which is confirmed by an increase in the inter-rater correlation. We also build an automatic pronunciation evaluation system trained from non-native speech databases with scores given by either the conventional and proposed methods, and compare the performance of the systems. The result shows that the predicted pronunciation scores matched the human-rated scores; the human-machine correlation produced a score of 0.87, while the conventional scoring method produced a score of 0.74.
Year
DOI
Venue
2019
10.1016/j.specom.2019.06.001
Speech Communication
Keywords
Field
DocType
Computer assisted language learning (CALL),Computer assisted pronunciation training (CAPT),Automatic pronunciation evaluation system,Parametric speech synthesis,Average voice model
Pronunciation,Prosody,Speech synthesis,Computer science,Active listening,Utterance,Speech recognition,Parametric statistics,Correlation,Hidden Markov model
Journal
Volume
ISSN
Citations 
111
0167-6393
1
PageRank 
References 
Authors
0.37
0
4
Name
Order
Citations
PageRank
hafiyan prafianto110.71
Takashi Nose239939.82
Yuya Chiba386.96
Akinori Ito427262.32