Title
Streaming small-footprint keyword spotting using sequence-to-sequence models
Abstract
We develop streaming keyword spotting systems using a recurrent neural network transducer (RNN-T) model: an all-neural, end-to-end trained, sequence-to-sequence model which jointly learns acoustic and language model components. Our models are trained to predict either phonemes or graphemes as subword units, thus allowing us to detect arbitrary keyword phrases, without any out-of-vocabulary words. In order to adapt the models to the requirements of keyword spotting, we propose a novel technique which biases the RNN-T system towards a specific keyword of interest. Our systems are compared against a strong sequence-trained, connectionist temporal classification (CTC) based “keyword-filler” baseline, which is augmented with a separate phoneme language model. Overall, our RNN-T system with the proposed biasing technique significantly improves performance over the baseline system.
Year
DOI
Venue
2017
10.1109/ASRU.2017.8268974
2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)
Keywords
DocType
Volume
Keyword spotting,sequence-to-sequence models,recurrent neural network transducer,attention,embedded speech recognition
Conference
abs/1710.09617
ISBN
Citations 
PageRank 
978-1-5090-4789-5
4
0.45
References 
Authors
20
6
Name
Order
Citations
PageRank
Yanzhang He16416.36
Rohit Prabhavalkar216322.56
Kanishka Rao318911.94
Wei Li4436140.67
Anton Bakhtin540.45
Ian McGraw625324.41