Title
Identification Of Hidden Markov Models Using Spectral Learning With Likelihood Maximization
Abstract
In this paper, we consider identifying a hidden Markov model (HMM) with the purpose of computing estimates of joint and conditional (posterior) probabilities over observation sequences. The classical maximum likelihood estimation algorithm (via the Baum-Welch/expectation-maximization algorithm), has recently been challenged by methods of moments. Such methods employ low-order moments to provide parameter estimates and have several benefits, including consistency and low computational cost. This paper aims to reduce the gap in statistical efficiency that results from restricting to only low-order moments in the training data. In particular, we propose a two-step procedure that combines spectral learning with a single Newton-like iteration for maximum likelihood estimation. We demonstrate an improved statistical performance using the proposed algorithm in numerical simulations.
Year
Venue
Field
2017
2017 IEEE 56TH ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC)
Efficiency,Training set,Data modeling,Mathematical optimization,Computer science,Likelihood maximization,Maximum likelihood,Hidden Markov model,Signal processing algorithms,Method of moments (statistics)
DocType
ISSN
Citations 
Conference
0743-1546
1
PageRank 
References 
Authors
0.37
0
4
Name
Order
Citations
PageRank
Robert Mattila143.51
Cristian R. Rojas225243.97
Vikram Krishnamurthy3925162.74
Bo Wahlberg421040.68