Title
Integrated Expression Prediction and Speech Synthesis From Text
Abstract
Generating expressive, naturally sounding, speech from text using a speech synthesis (TTS) system is a highly challenging problem. However for tasks such as audiobooks it is essential if their use is to become widespread. Generating expressive speech from text can be divided into two parts: predicting expressive information from text; and synthesizing the speech with a particular expression. Traditionally these components have been studied separately. This paper proposes an integrated approach, where the training data and representation of expressive synthesis is shared across the two components. There are several advantages to this scheme including: robust handling of automatically generated expressive labels; support for a continuous representation of expressions; and joint training of the expression predictor and speech synthesizer. Synthesis experiments indicated that the proposed approach produced far more expressive speech than both a neutral TTS and one where the expression was randomly selected. The experimental results also show the advantage of a continuous expressive synthesis space over a discrete space.
Year
DOI
Venue
2014
10.1109/JSTSP.2013.2294938
IEEE Journal of Selected Topics in Signal Processing
Keywords
Field
DocType
neural network,audiobook,expressive information,speech synthesis,cluster adaptive training,integrated expression prediction,expressive speech synthesis,tts system,speech synthesizer,text analysis,expressive synthesis,speech synthesis from text,hidden markov model,expression predictor,decision trees,speech,hidden markov models,vectors
Training set,Speech synthesis,Expression (mathematics),Computer science,Speech recognition,Artificial intelligence,Natural language processing,Discrete space
Journal
Volume
Issue
ISSN
8
2
1932-4553
Citations 
PageRank 
References 
0
0.34
19
Authors
5
Name
Order
Citations
PageRank
Langzhou Chen1628.92
Mark J. F. Gales23905367.45
Norbert Braunschweiler3598.47
Masami Akamine48915.15
Kate Knill524928.02