Paper Info
Title
Robust coding for a class of sources: Applications in control and reliable communication over limited capacity channels
Abstract
This paper is concerned with the control of a class of dynamical systems over finite capacity communication channels. Necessary conditions for reliable data reconstruction and stability of a class of dynamical systems are derived. The methodology is information theoretic. It introduces the notion of entropy for a class of sources, which is defined as a maximization of the Shannon entropy over a class of sources. It also introduces the Shannon information transmission theorem for a class of sources, which states that channel capacity should be greater or equal to the mini-max rate distortion (maximization is over the class of sources) for reliable communication. When the class of sources is described by a relative entropy constraint between a class of source densities, and a given nominal source density, the explicit solution to the maximum entropy, is given, and its connection to Rényi entropy is illustrated. Furthermore, this solution is applied to a class of controlled dynamical systems to address necessary conditions for reliable data reconstruction and stability of such systems.
Year
DOI
Venue
2008
10.1016/j.sysconle.2008.06.006
Systems & Control Letters
Keywords
Field
DocType
Limited capacity constraint,Robust stability and observability,Shannon lower bound
Information theory,Mathematical optimization,Transfer entropy,Rényi entropy,Shannon's source coding theorem,Principle of maximum entropy,Entropy (information theory),Kullback–Leibler divergence,Mathematics,Maximum entropy probability distribution
Journal
Volume
Issue
ISSN
57
12
0167-6911
Citations 
PageRank 
References 
5
0.51
18
Authors
2
Name
Order
Citations
PageRank
Alireza Farhadi1949.51
Charalambos D. Charalambous231549.89