Title
Conservation of mutual and directed information
Abstract
Two conservation laws for mutual information in terms of directed informations between two synchronized sequences of random variables are derived, the first for the case of no conditioning and the second for the case of causal conditioning on a third synchronized sequence. As a byproduct of the derivation of the first conservation law, the directed information specifying the feedback flowing from the second sequence to the first sequence is identified, which leads to a simple proof that a previously known sufficient condition for equality of mutual and directed information is also a necessary condition.
Year
DOI
Venue
2005
10.1109/ISIT.2005.1523313
international symposium on information theory
Keywords
Field
DocType
causality,information theory,random functions,causal conditioning,conservation law,directed informations,random variables,synchronized sequences
Information theory,Discrete mathematics,Random variable,Combinatorics,Computer science,Multivariate mutual information,Mutual information,Interaction information,Conditional mutual information,Pointwise mutual information,Conservation law
Conference
Citations 
PageRank 
References 
58
4.03
2
Authors
2
Name
Order
Citations
PageRank
James L. Massey11096272.94
Massey, P.C.2584.03