Title
Entropy region and convolution.
Abstract
The entropy region is constructed from vectors of random variables by collecting Shannon entropies of all subvectors. Its shape is studied here by means of polymatroidal constructions, notably by convolution. The closure of the region is decomposed into the direct sum of tight and modular parts, reducing the study to the tight part. The relative interior of the reduction belongs to the entropy region. Behavior of the decomposition under self-adhesivity is clarified. Results are specialized and extended to the region constructed from four tuples of random variables. This and computer experiments help to visualize approximations of a symmetrized part of the entropy region. The four-atom conjecture on the minimal Ingleton score is refuted.
Year
DOI
Venue
2013
10.1109/TIT.2016.2601598
IEEE Trans. Information Theory
Keywords
Field
DocType
Entropy,Convolution,Channel coding,Random variables,Network coding,Shape,Visualization
Entropy power inequality,Discrete mathematics,Combinatorics,Joint quantum entropy,Rényi entropy,Quantum relative entropy,Shannon's source coding theorem,Joint entropy,Min entropy,Mathematics,Maximum entropy probability distribution
Journal
Volume
Issue
ISSN
abs/1310.5957
11
0018-9448
Citations 
PageRank 
References 
1
0.35
0
Authors
2
Name
Order
Citations
PageRank
František Matúš1238.61
László Csirmaz216315.86