Title
Exploiting Acoustic and Syntactic Features for Automatic Prosody Labeling in a Maximum Entropy Framework
Abstract
In this paper, we describe a maximum entropy-based automatic prosody labeling framework that exploits both language and speech information. We apply the proposed framework to both prominence and phrase structure detection within the Tones and Break Indices (ToBI) annotation scheme. Our framework utilizes novel syntactic features in the form of supertags and a quantized acoustic-prosodic feature representation that is similar to linear parameterizations of the prosodic contour. The proposed model is trained discriminatively and is robust in the selection of appropriate features for the task of prosody detection. The proposed maximum entropy acoustic-syntactic model achieves pitch accent and boundary tone detection accuracies of 86.0% and 93.1% on the Boston University Radio News corpus, and, 79.8% and 90.3% on the Boston Directions corpus. The phrase structure detection through prosodic break index labeling provides accuracies of 84% and 87% on the two corpora, respectively. The reported results are significantly better than previously reported results and demonstrate the strength of maximum entropy model in jointly modeling simple lexical, syntactic, and acoustic features for automatic prosody labeling.
Year
DOI
Venue
2008
10.1109/TASL.2008.917071
IEEE Transactions on Audio, Speech & Language Processing
Keywords
Field
DocType
natural language processing,speech synthesis,stress,automatic speech recognition,biomedical research,indexing terms,rhythm,indexation,maximum entropy,natural languages,maximum entropy model,viterbi algorithm,prominence,bioinformatics,robustness,entropy,labeling
Prosody,Speech synthesis,Pattern recognition,Edge detection,Computer science,Pitch accent,Speech recognition,Natural language,Phrase structure rules,Artificial intelligence,Principle of maximum entropy,Syntax
Journal
Volume
Issue
ISSN
16
4
1558-7916
Citations 
PageRank 
References 
41
2.09
41
Authors
3
Name
Order
Citations
PageRank
Vivek Kumar Rangarajan Sridhar114411.21
Srinivas Bangalore2412.43
Narayanan Shrikanth35558439.23