Title
Punctuation-generation-inspired linguistic features for Mandarin prosody generation.
Abstract
This paper proposes two novel linguistic features extracted from text input for prosody generation in a Mandarin text-to-speech system. The first feature is the punctuation confidence (PC), which measures the likelihood that a major punctuation mark (MPM) can be inserted at a word boundary. The second feature is the quotation confidence (QC), which measures the likelihood that a word string is quoted as a meaningful or emphasized unit. The proposed PC and QC features are influenced by the properties of automatic Chinese punctuation generation and linguistic characteristic of the Chinese punctuation system. Because MPMs are highly correlated with prosodic–acoustic features and quoted word strings serve crucial roles in human language understanding, the two features could potentially provide useful information for prosody generation. This idea was realized by employing conditional random-field-based models for predicting MPMs, quoted word string locations, and their associated confidences—that is, PC and QC—for each word boundary. The predicted punctuations and their confidences were then combined with traditional linguistic features to predict prosodic–acoustic features for performing speech synthesis using multilayer perceptrons. Both objective and subjective tests demonstrated that the prosody generated with the proposed linguistic features was superior to that generated without the proposed features. Therefore, the proposed PC and QC are identified as promising features for Mandarin prosody generation.
Year
DOI
Venue
2019
10.1186/s13636-019-0147-y
EURASIP Journal on Audio, Speech, and Music Processing
Keywords
Field
DocType
Conditional random field, Multilayer perceptron, Text-to-speech system, Prosody generation, Linguistic feature, Speech synthesis, Punctuation confidence, Mandarin
Conditional random field,Prosody,Speech synthesis,Computer science,Speech recognition,Multilayer perceptron,Perceptron,Linguistics,Language understanding,Punctuation,Mandarin Chinese
Journal
Volume
Issue
ISSN
2019
1
1687-4722
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Chen-Yu Chiang13111.55
yuping hung200.68
hanyun yeh331.40
I.-Bin Liao441.12
chenming pan501.01