Paper Info
Title
High Integrated Information In Complex Networks Near Criticality
Abstract
Integrated information has recently been proposed as an information-theoretic measure of a network's dynamical complexity. It aims to capture the amount of information generated by a network as a whole over and above that generated by the sum of its parts when the network transitions from one dynamical state to another. Several formulations of this measure have been proposed, with numerical schemes for computing network complexity. In this paper, we approach the problem analytically. We compute the integrated information of weighted networks with stochastic dynamics. Our formulation makes use of the Kullback-Leibler divergence between the multi-variate distribution on the set of network states versus the corresponding factorized distribution over its parts. Using Gaussian distributions, we compute analytic results for several prototypical network topologies. Our findings show that operating near the edge of criticality is favorable for a high rate of information integration in complex dynamical networks. This observation is consistent across network topologies. We discuss the implication of these results for biological and communication networks.
Year
DOI
Venue
2016
10.1007/978-3-319-44778-0_22
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2016, PT I
Keywords
Field
DocType
Network dynamics, Complexity measures, Information theory
Information theory,Information integration,Telecommunications network,Network dynamics,Network complexity,Computer science,Theoretical computer science,Network topology,Gaussian,Artificial intelligence,Complex network,Machine learning
Conference
Volume
ISSN
Citations 
9886
0302-9743
2
PageRank 
References 
Authors
0.39
6
2
Name
Order
Citations
PageRank
Xerxes D. Arsiwalla18417.84
Paul F. M. J. Verschure2677116.64