Title
Semiparametric estimation of mutual information and related criteria : optimal test of independence
Abstract
We derive independence tests by means of dependence measures thresholding in a semiparametric context. Precisely, the estimates of $\\varphi$ -mutual informations, associated to $\\varphi$ -divergences between a joint distribution and the product distribution of its marginals, are derived through the dual representation of $\\varphi$ -divergences. The asymptotic properties of the proposed estimates are established, including consistency, asymptotic distributions, and large deviations principle. The obtained tests of independence are compared via their relative asymptotic Bahadur efficiency and numerical simulations. It follows that the proposed semiparametric mutual information test is the optimal one. On the other hand, the proposed approach provides a new method for estimating the mutual information in a semiparametric setting, as well as a model selection procedure in a large class of dependence models, including semiparametric copulas.
Year
DOI
Venue
2017
10.1109/TIT.2016.2620163
IEEE Trans. Information Theory
Keywords
DocType
Volume
Mutual information,Random variables,Testing,Estimation,Numerical models,Entropy,Context
Journal
63
Issue
ISSN
Citations 
1
0018-9448
0
PageRank 
References 
Authors
0.34
10
2
Name
Order
Citations
PageRank
Amor Keziou1315.57
philippe regnault201.01