Paper Info
Title
Transformation of prosody in voice conversion.
Abstract
Voice Conversion (VC) aims to convert one's voice to sound like that of another. So far, most of the voice conversion frameworks mainly focus only on the conversion of spectrum. We note that speaker identity is also characterized by the prosody features such as fundamental frequency (F0), energy contour and duration. Motivated by this, we propose a framework that can perform F0, energy contour and duration conversion. In the traditional exemplar-based sparse representation approach to voice conversion, a general source-target dictionary of exemplars is constructed to establish the correspondence between source and target speakers. In this work, we propose a Phonetically Aware Sparse Representation of fundamental frequency and energy contour by using Continuous Wavelet Transform (CWT). Our idea is motivated by the facts that CWT decompositions of F0 and energy contours describe prosody patterns in different temporal scales and allow for effective prosody manipulation in speech synthesis. Furthermore, phonetically aware exemplars lead to better estimation of activation matrix, therefore, possibly better conversion of prosody. We also propose a phonetically aware duration conversion framework which takes into account both phone-level and sentence-level speaking rates. We report that the proposed prosody conversion outperforms the traditional prosody conversion techniques in both objective and subjective evaluations.
Year
Venue
Field
2017
Asia-Pacific Signal and Information Processing Association Annual Summit and Conference
Prosody,Speech synthesis,Fundamental frequency,Matrix (mathematics),Computer science,Sparse approximation,Continuous wavelet transform,Speech recognition,Continuous wavelet transforms,Frequency conversion
DocType
ISSN
Citations 
Conference
2309-9402
4
PageRank 
References 
Authors
0.37
0
3
Name
Order
Citations
PageRank
Berrak Sisman16010.34
Haizhou Li23678334.61
Kay Chen Tan32767164.86