Title
An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Abstract
AbstractSpeaker identity is one of the important characteristics of human speech. In voice conversion, we change the speaker identity from one to another, while keeping the linguistic content unchanged. Voice conversion involves multiple speech processing techniques, such as speech analysis, spectral conversion, prosody conversion, speaker characterization, and vocoding. With the recent advances in theory and practice, we are now able to produce human-like voice quality with high speaker similarity. In this article, we provide a comprehensive overview of the state-of-the-art of voice conversion techniques and their performance evaluation methods from the statistical approaches to deep learning, and discuss their promise and limitations. We will also report the recent Voice Conversion Challenges (VCC), the performance of the current state of technology, and provide a summary of the available resources for voice conversion research.
Year
DOI
Venue
2021
10.1109/TASLP.2020.3038524
IEEE/ACM Transactions on Audio, Speech and Language Processing
Keywords
DocType
Volume
Vocoders, Training data, Speech analysis, Deep learning, Pipelines, Speech synthesis, Training, Voice conversion, speech analysis, speaker characterization, vocoding, voice conversion evaluation, voice conversion challenges
Journal
29
Issue
ISSN
Citations 
1
2329-9290
11
PageRank 
References 
Authors
0.67
112
4
Search Limit
100112
Name
Order
Citations
PageRank
Berrak Sisman16010.34
junichi yamagishi21906145.51
Simon King31438114.49
Haizhou Li43678334.61