Title
On some extremal problems for mutual information and entropy.
Abstract
The problem of determining the maximum mutual information I(X; Y) and minimum entropy H(X, Y) of a pair of discrete random variables X and Y is considered under the condition that the probability distribution of X is fixed and the error probability Pr{Y ≠ X} takes a given value ε, 0 ≤ ε ≤ 1. Precise values for these quantities are found, which in several cases allows us to obtain explicit formulas for both the maximum information and minimum entropy in terms of the probability distribution of X and the parameter ε.
Year
DOI
Venue
2016
10.1134/S0032946016040013
Probl. Inf. Transm.
Field
DocType
Volume
Transfer entropy,Combinatorics,Random variable,Minimum entropy,Probability distribution,Mutual information,Principle of maximum entropy,Probability of error,Mathematics,Maximum entropy probability distribution
Journal
52
Issue
ISSN
Citations 
4
0032-9460
0
PageRank 
References 
Authors
0.34
0
1
Name
Order
Citations
PageRank
Vyacheslav V. Prelov114529.59