Name
Abstract | ||
|---|---|---|
We present an online version of the expectation-maximization (EM) algorithm for hidden Markov models (HMMs). The sufficient statistics required for parameters estimation is computed recursively with time, that is, in an online way instead of using the batch forward-backward procedure. This computational scheme is generalized to the case where the model parameters can change with time by introducing a discount factor into the recurrence relations. The resulting algorithm is equivalent to the batch EM algorithm, for appropriate discount factor and scheduling of parameters update. On the other hand, the online algorithm is able to deal with dynamic environments, i.e., when the statistics of the observed data is changing with time. The implications of the online algorithm for probabilistic modeling in neuroscience are briefly discussed. |
Year | DOI | Venue |
|---|---|---|
2008 | 10.1162/neco.2008.10-06-351 | Neural Computation |
Keywords | Field | DocType |
discount factor,parameters estimation,online algorithm,parameters update,batch em algorithm,batch forward-backward procedure,resulting algorithm,hidden markov model,computational scheme,appropriate discount factor,online version,probabilistic model,parameter estimation,expectation maximization,em algorithm,recurrence relation,sufficient statistic | Online algorithm,Mathematical optimization,Forward algorithm,Markov model,Expectation–maximization algorithm,Artificial intelligence,Probabilistic logic,Hidden Markov model,Artificial neural network,Mathematics,Machine learning,Hidden semi-Markov model | Journal |
Volume | Issue | ISSN |
20 | 7 | 1530-888X |
Citations | PageRank | References |
32 | 1.87 | 4 |
Authors | ||
2 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Gianluigi Mongillo | 1 | 85 | 9.03 |
| Sophie Denève | 2 | 172 | 17.55 |