Title
Information Equals Amortized Communication
Abstract
We show how to efficiently simulate the sending of a single message M to a receiver who has partial information about the message, so that the expected number of bits communicated in the simulation is close to the amount of additional information that the message reveals to the receiver. This is a generalization and strengthening of the Slepian-Wolf theorem, which shows how to carry out such a simulation with low amortized communication in the case that M is a deterministic function of X. A caveat is that our simulation is interactive. As a consequence, we prove that the internal information cost (namely the information revealed to the parties) involved in computing any relation or function using a two party interactive protocol is exactly equal to the amortized communication complexity of computing independent copies of the same relation or function. We also show that the only way to prove a strong direct sum theorem for randomized communication complexity is by solving a particular variant of the pointer jumping problem that we define. This paper implies that a strong direct sum theorem for communication complexity holds if and only if efficient compression of communication protocols is possible. In particular, together with our result, a recent result of Ganor, Kol, and Raz implies that the strongest version of direct sum for randomized communication complexity is false.
Year
DOI
Venue
2014
10.1109/TIT.2014.2347282
Information Theory, IEEE Transactions  
Keywords
Field
DocType
information theory,protocols,slepian-wolf theorem,amortized communication complexity,direct sum theorem,internal information cost,partial information,party interactive protocol,pointer jumping problem,randomized communication complexity direct sum,communication complexity,compression,interactive communication
Discrete mathematics,Combinatorics,Potential method,Computer science,Amortized analysis,Theoretical computer science
Journal
Volume
Issue
ISSN
60
10
0018-9448
Citations 
PageRank 
References 
63
2.21
10
Authors
2
Name
Order
Citations
PageRank
Mark Braverman181061.60
Anup Rao258132.80