Name
Title | ||
|---|---|---|
The duality between information embedding and source coding with side information and some applications |
Abstract | ||
|---|---|---|
Aspects of the duality between the information-embedding problem and the Wyner-Ziv (1976) problem of source coding with side information at the decoder are developed and used to establish a spectrum new results on these and related problems, with implications for a number of important applications. The single-letter characterization of the information-embedding problem is developed and related to the corresponding characterization of the Wyner-Ziv problem, both of which correspond to optimization of a common mutual information difference. Dual variables and dual Markov conditions are identified, along with the dual role of noise and distortion in the two problems. For a Gaussian context with quadratic distortion metric, a geometric interpretation of the duality is developed. From such insights, we develop a capacity-achieving information-embedding system based on nested lattices. We show the resulting encoder-decoder has precisely the same decoder-encoder structure as the corresponding Wyner-Ziv system based on nested lattices that achieves the rate-distortion limit. For a binary context with Hamming distortion metric, the information-embedding capacity is developed, along with its relationship to the corresponding Wyner-Ziv rate-distortion function. In turn, an information-embedding system for this case based on nested linear codes is constructed having an encoder-decoder that is identical to the decoder-encoder structure for the corresponding system that achieves the Wyner-Ziv rate-distortion limit. Finally, based on these results, a simple layered joint source-channel coding system is developed with a perfectly symmetric encoder-decoder structure. Its application and performance is discussed in a broadcast setting in which there is a need to control the fidelity experienced by different receivers. Among other results, we show that such systems and their multilayer extensions retain attractive optimality properties in the Gaussian-quadratic case, but not in the binary-Hamming case. |
Year | DOI | Venue |
|---|---|---|
2003 | 10.1109/TIT.2003.810639 | IEEE Transactions on Information Theory |
Keywords | DocType | Volume |
information-embedding capacity,wyner-ziv problem,corresponding system,corresponding wyner-ziv system,decoder-encoder structure,capacity-achieving information-embedding system,wyner-ziv rate-distortion limit,information embedding,nested lattice,information-embedding problem,side information,corresponding wyner-ziv rate-distortion function,source coding,decoding,information theory,lattices,data hiding,information retrieval,duality mathematics,source code,robustness | Journal | 49 |
Issue | ISSN | ISBN |
5 | 0018-9448 | 0-7803-7123-2 |
Citations | PageRank | References |
101 | 14.24 | 17 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| R. J. Barron | 1 | 101 | 14.24 |
| Brian Chen | 2 | 289 | 39.05 |
| Gregory W. Wornell | 3 | 9849 | 1189.42 |