Paper Info
Title
Investigating Online Low-Footprint Speaker Adaptation Using Generalized Linear Regression And Click-Through Data
Abstract
To develop speaker adaptation algorithms for deep neural network (DNN) that are suitable for large-scale online deployment, it is desirable that the adaptation model be represented in a compact form and learned in an unsupervised fashion. In this paper, we propose a novel low-footprint adaptation technique for DNN that adapts the DNN model through node activation functions. The approach introduces slope and bias parameters in the sigmoid activation functions for each speaker, allowing the adaptation model to be stored in a small-sized storage space. We show that this adaptation technique can be formulated in a linear regression fashion, analogous to other speak adaptation algorithms that apply additional linear transformations to the DNN layers. We further investigate semi-supervised online adaptation by making use of the user click-through data as a supervision signal. The proposed method is evaluated on short message dictation and voice search tasks in supervised, unsupervised, and semi-supervised setups. Compared with the singular value decomposition (SVD) bottleneck adaptation, the proposed adaptation method achieves comparable accuracy improvements with much smaller footprint.
Year
DOI
Venue
2015
10.1109/ICASSP.2015.7178784
2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP)
Keywords
Field
DocType
automatic speech recognition, deep neural network, speaker adaptation, low footprint
Bottleneck,Singular value decomposition,Pattern recognition,Computer science,Speech recognition,Generalized linear model,Linear map,Artificial intelligence,Artificial neural network,Hidden Markov model,Voice search,Sigmoid function
Conference
ISSN
Citations 
PageRank 
1520-6149
7
0.40
References 
Authors
21
4
Name
Order
Citations
PageRank
Yong Zhao112713.62
Jinyu Li291572.84
Jian Xue3271.07
Yifan Gong41332135.58