Title
A corpus-based speech synthesis system with emotion
Abstract
We propose a new approach to synthesizing emotional speech by a corpus-based concatenative speech synthesis system (ATR CHATR) using speech corpora of emotional speech. In this study, neither emotional-dependent prosody prediction nor signal processing per se is performed for emotional speech. Instead, a large speech corpus is created per emotion to synthesize speech with the appropriate emotion by simple switching between the emotional corpora. This is made possible by the normalization procedure incorporated in CHATR that transforms its standard predicted prosody range according to the source database in use. We evaluate our approach by creating three kinds of emotional speech corpus (anger, joy, and sadness) from recordings of a male and a female speaker of Japanese. The acoustic characteristics of each corpus are different and the emotions identifiable. The acoustic characteristics of each emotional utterance synthesized by our method show clear correlations to those of each corpus. Perceptual experiments using synthesized speech confirmed that our method can synthesize recognizably emotional speech. We further evaluated the method's intelligibility and the overall impression it gives to the listeners. The results show that the proposed method can synthesize speech with a high intelligibility and gives a favorable impression. With these encouraging results, we have developed a workable text-to-speech system with emotion to support the immediate needs of nonspeaking individuals. This paper describes the proposed method, the design and acoustic characteristics of the corpora, and the results of the perceptual evaluations.
Year
DOI
Venue
2003
10.1016/S0167-6393(02)00081-X
Speech Communication
Keywords
Field
DocType
emotional speech,speech corpus,emotional utterance,corpus-based concatenative speech synthesis,acoustic characteristic,large speech corpus,source database,concatenative speech synthesis,emotion,emotional speech corpus,corpus,emotional corpus,synthesized speech,natural speech,corpus-based speech synthesis system,signal processing,text to speech,speech synthesis
Speech corpus,Prosody,Speech synthesis,Computer science,Chinese speech synthesis,Speech recognition,Natural language processing,Artificial intelligence,VoxForge,Speech production,Acoustic model,Intelligibility (communication)
Journal
Volume
Issue
ISSN
40
1-2
Speech Communication
Citations 
PageRank 
References 
56
2.88
9
Authors
4
Name
Order
Citations
PageRank
Akemi Iida1748.28
Nick Campbell2562.88
Fumito Higuchi3748.22
Michiaki Yasumura426636.88