Title
An Elementary Proof Of A Classical Information-Theoretic Formula
Abstract
A renowned information-theoretic formula by Shannon expresses the mutual information rate of a white Gaussian channel with a stationary Gaussian input as an integral of a simple function of the power spectral density of the channel input. We give in this paper a rigorous yet elementary proof of this classical formula. As opposed to all the conventional approaches, which either rely on heavy mathematical machineries or have to resort to some "external" results, our proof, which hinges on a recently proven sampling theorem, is elementary and self-contained, only using some well-known facts from basic calculus and matrix theory.
Year
DOI
Venue
2018
10.1109/ISIT.2019.8849415
2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT)
Field
DocType
Volume
Discrete mathematics,Algebra,Matrix (mathematics),Gaussian channels,Elementary proof,Communication channel,Spectral density,Gaussian,Mutual information,Nyquist–Shannon sampling theorem,Mathematics
Journal
abs/1809.01422
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Xianming Liu146147.55
Ronit Bustin2528.94
Guangyue Han315921.85
Shlomo Shamai44531410.89