Title | ||
---|---|---|
Mutual information and relative entropy over the Binomial and Negative Binomial channels |
Abstract | ||
---|---|---|
We study the relation of the mutual information and relative entropy over the Binomial and Negative Binomial channels with estimation theoretical quantities, in which we extend already known results for Gaussian and Poisson channels. We establish general expressions for these information theory concepts with a direct connection with estimation theory through the conditional mean estimation and a particular loss function. |
Year | DOI | Venue |
---|---|---|
2012 | 10.1109/ISIT.2012.6284304 | Information Theory Proceedings |
Keywords | Field | DocType |
Gaussian channels,entropy,estimation theory,Gaussian channel,Poisson channel,conditional mean estimation,estimation theoretical quantity,information theory concept,loss function,mutual information,negative binomial channel,relative entropy | Statistical physics,Discrete mathematics,Information theory and measure theory,Rényi entropy,Mutual information,Differential entropy,Negative binomial distribution,Joint entropy,Conditional entropy,Statistics,Mathematics,Maximum entropy probability distribution | Conference |
ISSN | ISBN | Citations |
2157-8095 E-ISBN : 978-1-4673-2578-3 | 978-1-4673-2578-3 | 4 |
PageRank | References | Authors |
0.51 | 5 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Camilo G. Taborda | 1 | 10 | 1.29 |
Fernando Pérez-Cruz | 2 | 749 | 61.24 |
Perez-Cruz, F. | 3 | 74 | 5.00 |