Name
Title | ||
|---|---|---|
Rényi information transfer: Partial rényi transfer entropy and partial rényi mutual information |
Abstract | ||
|---|---|---|
Shannon and Rényi information theory have been applied to coupling estimation in complex systems using time series of their dynamical states. By analysing how information is transferred between constituent parts of a complex system, it is possible to infer the coupling parameters of the system. To this end, we introduce the partial Rényi transfer entropy and we give an alternative derivation of the partial Rényi mutual information, using the conditional Rényi α-divergence. We prove that, in the limit α → 1, this divergence tends to the conditional Kullback-Leibler divergence from Shannon information theory. As a result, when α → 1, we obtain the partial transfer entropy and the partial mutual information from their Rényi equivalents. Using these Rényi information-theoretic functionals, we identify the coupling direction and delay between two processes in an autoregressive system of order 1. |
Year | DOI | Venue |
|---|---|---|
2014 | 10.1109/ICASSP.2014.6854688 | ICASSP |
Keywords | Field | DocType |
partial rényi mutual information,complex systems,renyi α-divergence,delay,information flow,kullback-leibler divergence,partial rényi transfer entropy,partial rényi mutual information,renyi information-theoretic functionals,partial rényi transfer entropy,rέnyi information theory,delays,autoregressive processes,shannon information theory,autoregressive system,dynamical states,entropy,coupling estimation,coupling parameters,renyi equivalents,time series | Information theory,Complex system,Autoregressive model,Transfer entropy,Pattern recognition,Information transfer,Rényi entropy,Mutual information,Artificial intelligence,Mathematics | Conference |
ISSN | Citations | PageRank |
1520-6149 | 0 | 0.34 |
References | Authors | |
1 | 1 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Septimia Sarbu | 1 | 4 | 1.52 |