Name
Abstract | ||
|---|---|---|
This paper presents a novel deep neural network architecture for transfer learning in acoustic models. A well-known approach for transfer leaning is using target domain data to fine-tune a pre-trained model with source model. The model is trained so as to raise its performance in the target domain. However, this approach may not fully utilize the knowledge of the pre-trained model because the pre-trained knowledge is forgotten when the target domain is updated. To solve this problem, we propose a new architecture based on progressive neural networks (PNN) that can transfer knowledge; it does not forget and can well utilize pre-trained knowledge. In addition, we introduce an enhanced PNN that uses feature augmentation to better leverage pre-trained knowledge. The proposed architecture is challenged in experiments on three different recorded Japanese speech recognition tasks (one source and two target domain tasks). In a comparison with various transfer learning approaches, our proposal achieves the lowest error rate in the target tasks. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.23919/APSIPA.2018.8659556 | Asia-Pacific Signal and Information Processing Association Annual Summit and Conference |
Field | DocType | ISSN |
Data modeling,Architecture,Task analysis,Computer science,Transfer of learning,Word error rate,Knowledge transfer,Source model,Artificial intelligence,Artificial neural network | Conference | 2309-9402 |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
7 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Takafumi Moriya | 1 | 1 | 1.35 |
| Ryo Masumura | 2 | 25 | 28.24 |
| Taichi Asami | 3 | 22 | 10.49 |
| Yusuke Shinohara | 4 | 88 | 10.26 |
| Marc Delcroix | 5 | 699 | 62.07 |
| Yoshikazu Yamaguchi | 6 | 77 | 11.18 |
| Yushi Aono | 7 | 7 | 11.02 |