Title
Optimal Data-Driven Estimation Of Generalized Markov State Models For Non-Equilibrium Dynamics
Abstract
There are multiple ways in which a stochastic system can be out of statistical equilibrium. It might be subject to time-varying forcing; or be in a transient phase on its way towards equilibrium; it might even be in equilibrium without us noticing it, due to insufficient observations; and it even might be a system failing to admit an equilibrium distribution at all. We review some of the approaches that model the effective statistical behavior of equilibrium and non-equilibrium dynamical systems, and show that both cases can be considered under the unified framework of optimal low-rank approximation of so-called transfer operators. Particular attention is given to the connection between these methods, Markov state models, and the concept of metastability, further to the estimation of such reduced order models from finite simulation data. All these topics bear an important role in, e.g., molecular dynamics, where Markov state models are often and successfully utilized, and which is the main motivating application in this paper. We illustrate our considerations by numerical examples.
Year
DOI
Venue
2018
10.3390/computation6010022
COMPUTATION
Keywords
DocType
Volume
Markov state model, non-equilibrium, metastability, coherent set, molecular dynamics, transfer operator, Koopman operator, extended dynamic mode decomposition
Journal
6
Issue
ISSN
Citations 
1
2079-3197
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Péter Koltai101.01
Hao Wu201.01
Frank Noé35812.57
Christof Schütte416735.19