Title
JHU ASpIRE system: Robust LVCSR with TDNNS, iVector adaptation and RNN-LMS
Abstract
Multi-style training, using data which emulates a variety of possible test scenarios, is a popular approach towards robust acoustic modeling. However acoustic models capable of exploiting large amounts of training data in a comparatively short amount of training time are essential. In this paper we tackle the problem of reverberant speech recognition using 5500 hours of simulated reverberant data. We use time-delay neural network (TDNN) architecture, which is capable of tackling long-term interactions between speech and corrupting sources in reverberant environments. By sub-sampling the outputs at TDNN layers across time steps, training time is substantially reduced. Combining this with distributed-optimization we show that the TDNN can be trained in 3 days using up to 32 GPUs. Further, iVectors are used as an input to the neural network to perform instantaneous speaker and environment adaptation. Finally, recurrent neural network language models are applied to the lattices to further improve the performance. Our system is shown to provide state-of-the-art results in the IARPA ASpIRE challenge, with 26.5% WER on the dev Jest set.
Year
DOI
Venue
2015
10.1109/ASRU.2015.7404842
2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
Keywords
Field
DocType
far field speech recognition,time delay neural networks,iVectors,recurrent neural network language models
Training set,Recurrent neural network language models,Computer science,Speech recognition,Time delay neural network,Scenario testing,Artificial intelligence,Artificial neural network,Machine learning
Conference
Citations 
PageRank 
References 
8
0.50
21
Authors
6
Name
Order
Citations
PageRank
Vijayaditya Peddinti122912.17
Guoguo Chen242819.89
Vimal Manohar3547.99
Tom Ko4678.15
Daniel Povey52442231.75
Sanjeev Khudanpur62155202.00