Name
Abstract | ||
|---|---|---|
We propose a novel approach to addressing the adaptation effectiveness issue in parameter adaptation for deep neural network (DNN) based acoustic models for automatic speech recognition by adding one or more small auxiliary output layers modeling broad acoustic units, such as mono-phones or tied-state (often called senone) clusters. In scenarios with a limited amount of available adaptation data, most senones are usually rarely seen or not observed, and consequently the ability to model them in a new condition is often not fully exploited. With the original senone classification task as the primary task, and adding auxiliary mono-phone/senone-cluster classification as the secondary tasks, multi-task learning (MTL) is employed to adapt the DNN parameters. With the proposed MTL adaptation framework, we improve the learning ability of the original DNN structure, then enlarge the coverage of the acoustic space to deal with the unseen senone problem, and thus enhance the discrimination power of the adapted DNN models. Experimental results on the 20,000-word open vocabulary WSJ task demonstrate that the proposed framework consistently outperforms the conventional linear hidden layer adaptation schemes without MTh by providing 5.4% relative reduction in word error rate (WERR) with only 1 single adaptation utterance, and 10.7% WERR with 40 adaptation utterances against the un-adapted DNN models. |
Year | Venue | Keywords |
|---|---|---|
2015 | 16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5 | deep neural networks, speaker adaptation, multi-task learning, CD-DNN-HMM |
Field | DocType | Citations |
Multi-task learning,Computer science,Word error rate,Utterance,Speech recognition,Artificial neural network,Acoustic space,Vocabulary,Deep neural networks | Conference | 21 |
PageRank | References | Authors |
0.57 | 23 | 6 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Zhen Huang | 1 | 100 | 11.60 |
| Jinyu Li | 2 | 915 | 72.84 |
| Sabato Marco Siniscalchi | 3 | 310 | 30.21 |
| I-Fan Chen | 4 | 110 | 10.72 |
| Ji Wu | 5 | 226 | 32.62 |
| Chin-Hui Lee | 6 | 6101 | 852.71 |