Title
CTC regularized model adaptation for improving LSTM RNN based multi-accent Mandarin speech recognition.
Abstract
This paper proposes a novel regularized adaptation method to improve the performance of multi-accent Mandarin speech recognition task. The acoustic model is based on long short term memory recurrent neural network trained with a connectionist temporal classification loss function (LSTM-RNN-CTC). In general, directly adjusting the network parameters with a small adaptation set may lead to over-fitting. In order to avoid this problem, a regularization term is added to the original training criterion. It forces the conditional probability distribution estimated from the adapted model to be close to the accent independent model. Meanwhile, only the accent-specific output layer needs to be fine-tuned using this adaptation method. Experiments are conducted on RASC863 and CASIA regional accented speech corpus. The results show that the proposed method obtains obvious improvement when compared with LSTM-RNN-CTC baseline model. It also outperforms other adaptation methods.
Year
DOI
Venue
2018
https://doi.org/10.1007/s11265-017-1291-1
Signal Processing Systems
Keywords
DocType
Volume
multi-accent,Mandarin speech recognition,LSTM-RNN-CTC,model adaptation,CTC regularization
Journal
90
Issue
ISSN
ISBN
7
1939-8018
978-1-5090-4295-1
Citations 
PageRank 
References 
1
0.35
20
Authors
5
Name
Order
Citations
PageRank
Jiangyan Yi11917.99
Hao Ni2213.25
Zhengqi Wen38624.41
Bin Liu419135.02
Jianhua Tao5848138.00