Title
Singing Voice Conversion with Non-parallel Data
Abstract
Singing voice conversion is a task to convert a song sang by a source singer to the voice of a target singer. In this paper, we propose using a parallel data free, many-to-one voice conversion technique on singing voices. A phonetic posterior feature is first generated by decoding singing voices through a robust Automatic Speech Recognition Engine (ASR). Then, a trained Recurrent Neural Network (RNN) with a Deep Bidirectional Long Short Term Memory (DBLSTM) structure is used to model the mapping from person-independent content to the acoustic features of the target person. F0 and aperiodic are obtained through the original singing voice, and used with acoustic features to reconstruct the target singing voice through a vocoder. In the obtained singing voice, the targeted and sourced singers sound similar. To our knowledge, this is the first study that uses non parallel data to train a singing voice conversion system. Subjective evaluations demonstrate that the proposed method effectively converts singing voices.
Year
DOI
Venue
2019
10.1109/MIPR.2019.00059
2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR)
Keywords
Field
DocType
Singing voice conversion, phonetic posteriors, non parallel data, singer-independent content, deep neural networks (DNN)
Computer science,Long short term memory,Recurrent neural network,Speech recognition,Singing,Decoding methods,Aperiodic graph
Journal
Volume
ISBN
Citations 
abs/1903.04124
978-1-7281-1198-8
3
PageRank 
References 
Authors
0.42
14
4
Name
Order
Citations
PageRank
Chen Xin1625120.92
Wei Chu2185.48
Jinxi Guo3123.99
Ning Xu418420.03