Title
Uncovering Discrete Non-Linear Dependence with Information Theory
Abstract
In this paper, we model discrete time series as discrete Markov processes of arbitrary order and derive the approximate distribution of the Kullback-Leibler divergence between a known transition probability matrix and its sample estimate. We introduce two new information-theoretic measurements: information memory loss and information codependence structure. The former measures the memory content within a Markov process and determines its optimal order. The latter assesses the codependence among Markov processes. Both measurements are evaluated on toy examples and applied on high frequency foreign exchange data, focusing on 2008 financial crisis and 2010/2011 Euro crisis.
Year
DOI
Venue
2015
10.3390/e17052606
ENTROPY
Keywords
Field
DocType
Markov process,Kullback-Leibler divergence,information theory
Markov process,Markov property,Markov model,Markov chain,Discrete phase-type distribution,Variable-order Markov model,Markov kernel,Statistics,Mathematics,Markov renewal process
Journal
Volume
Issue
ISSN
17
5
1099-4300
Citations 
PageRank 
References 
0
0.34
2
Authors
4
Name
Order
Citations
PageRank
Anton Golub100.34
Gregor Chliamovitch284.05
Alexandre Dupuis3206.61
Bastien Chopard4503102.87