Name
Title | ||
|---|---|---|
Blhuc: Bayesian Learning Of Hidden Unit Contributions For Deep Neural Network Speaker Adaptation |
Abstract | ||
|---|---|---|
Speaker adaptation techniques play a key role in reducing the mismatch between speech recognition systems and target users. In order to robustly learn speaker-dependent adaptation parameters, model based DNN adaptation techniques often require a significant amount of data. For example, in the commonly used learning hidden unit contributions (LHUC) based DNN adaptation, speaker dependent high-dimensional hidden layer output scaling vectors are used. When limited adaptation data are available, the standard LHUC is prone to over-fitting and poor generalization. To address the issue, Bayesian learning of hidden unit contributions (BLHUC) is proposed in this paper. A posterior distribution over the LHUC scaling vectors is used to explicitly model the uncertainty associated with the adaptation parameters. An efficient variational inference based approach is adopted to estimate the LHUC parameter posterior distribution. Experiments conducted on a 300-hour Switchboard setup showed that the proposed BLHUC method outperformed the baseline speaker-independent DNN systems and LHUC adapted DNN systems by up to 1.4% and 1.1% absolute reductions of word error rate respectively, when only using 1 utterance of adaptation data from each speaker. Consistent performance improvements were also obtained over the baseline, LHUC adapted and LHUC SAT systems when increasing the amount of adaptation data. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/icassp.2019.8682667 | 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) |
Keywords | Field | DocType |
Bayesian learning, LHUC, speaker adaptation | Bayesian inference,Pattern recognition,Computer science,Inference,Word error rate,Utterance,Posterior probability,Artificial intelligence,Artificial neural network,Scaling,Speaker adaptation | Conference |
ISSN | Citations | PageRank |
1520-6149 | 0 | 0.34 |
References | Authors | |
0 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Xurong Xie | 1 | 6 | 8.57 |
| Xunying Liu | 2 | 330 | 52.46 |
| Tan Lee | 3 | 476 | 74.69 |
| Shoukang Hu | 4 | 6 | 10.90 |
| Lan Wang | 5 | 187 | 25.70 |