Title
Mutual information and relative entropy over the Binomial and Negative Binomial channels
Abstract
We study the relation of the mutual information and relative entropy over the Binomial and Negative Binomial channels with estimation theoretical quantities, in which we extend already known results for Gaussian and Poisson channels. We establish general expressions for these information theory concepts with a direct connection with estimation theory through the conditional mean estimation and a particular loss function.
Year
DOI
Venue
2012
10.1109/ISIT.2012.6284304
Information Theory Proceedings
Keywords
Field
DocType
Gaussian channels,entropy,estimation theory,Gaussian channel,Poisson channel,conditional mean estimation,estimation theoretical quantity,information theory concept,loss function,mutual information,negative binomial channel,relative entropy
Statistical physics,Discrete mathematics,Information theory and measure theory,Rényi entropy,Mutual information,Differential entropy,Negative binomial distribution,Joint entropy,Conditional entropy,Statistics,Mathematics,Maximum entropy probability distribution
Conference
ISSN
ISBN
Citations 
2157-8095 E-ISBN : 978-1-4673-2578-3
978-1-4673-2578-3
4
PageRank 
References 
Authors
0.51
5
3
Name
Order
Citations
PageRank
Camilo G. Taborda1101.29
Fernando Pérez-Cruz274961.24
Perez-Cruz, F.3745.00