Title
Optimization Of The Gaussian Mixture Model Evaluation On Gpu
Abstract
In this paper we present a highly optimized implementation of Gaussian mixture acoustic model evaluation algorithm. Evaluation of these likelihoods is one of the most computationally intensive parts of automatics speech recognizers but it can be well-parallelized and offloaded to GPU devices. Our approach offers significant speed-up compared to the recently published approaches, since it exploits the GPU architecture better. All the recent implementations were programmed either in CUDA or OpenCL GPU programming frameworks. We present results for both; CUDA as well as OpenCL.Results suggest that even very large acoustic models can be utilized in real-time speech recognition engines on computers and laptops equipped with a low-end GPU. Optimization of acoustic likelihoods computation on GPU enables to use the remaining GPU resources for offloading of other compute-intensive parts of LVCSR decoder.Other possible use of the freed GPU resources is to evaluate several acoustic models at the same time and use fusion techniques or model selection techniques to improve the quality of resulting conditional likelihoods under diverse conditions.
Year
Venue
Keywords
2011
12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5
CUDA, GPU, OpenCL, Gaussian Mixture Models
Field
DocType
Citations 
Computer science,CUDA,Parallel computing,Model selection,Implementation,Computational science,Gaussian,General-purpose computing on graphics processing units,Mixture model,Computation,Acoustic model
Conference
3
PageRank 
References 
Authors
0.45
7
4
Name
Order
Citations
PageRank
Jan Vanek1459.10
Jan Trmal223520.91
Josef V. Psutka310218.39
Josef Psutka436555.24