Name
Abstract | ||
|---|---|---|
In sensor management, the usefulness of information theoretic measures seems to be validated by a large number of empirical studies, but theoretical justification presented until so far, both for selection of the measure and for the use of information-driven sensor management itself, still seems inconclusive, conflicting, or debatable. In this paper, we suggest that information-driven sensor management may be justified on the basis of uncertainty reduction rather than information gain. We subsequently identify that, due to well-known relationships between Shannon entropy, mutual information and Kullback-Leibler (KL) divergence, for sensor management purposes using the Kullback-Leibler (KL) divergence (a measure of information gain; thus a relative measure) is exactly the same as using the the Shannon entropy (a measure of uncertainty; an absolute measure). This is also used to demonstrate that, if uncertainty reduction is desirable, the asymmetry of the KL divergence is not relevant to the sensor management problem. Finally, we show some counterpoints to some arguments for replacing the KL divergence with the more general Rényi divergences. |
Year | Venue | Keywords |
|---|---|---|
2011 | Information Fusion | entropy,sensors,KL divergence asymmetry,Kullback-Leibler divergence,Shannon entropy,general Rényi divergences,information-driven sensor management criteria,uncertainty reduction,Kullback-Leibler divergence,Rényi divergence,Sensor management,entropy,information theory |
Field | DocType | ISBN |
Econometrics,Random variable,Computer science,Artificial intelligence,Entropy (information theory),Information theory,Mathematical optimization,Information theory and measure theory,Measurement uncertainty,Mutual information,Machine learning,Kullback–Leibler divergence,Uncertainty reduction theory | Conference | 978-1-4577-0267-9 |
Citations | PageRank | References |
7 | 0.48 | 15 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Edson Hiroshi Aoki | 1 | 14 | 2.45 |
| Arunabha Bagchi | 2 | 58 | 10.78 |
| Pranab Kumar Mandal | 3 | 25 | 4.37 |
| Y. Boers | 4 | 135 | 18.13 |