Simultaneous transmission of data and state with common knowledge

This work studies the problem of simultaneous transmission of independent data and state via a state controlled channel, under the requirement that the encoder can produce locally an exact copy of the state estimation constructed by the decoder. The common formulation of problems of lossy source coding and source-channel coding, does not require that the sender be acquainted with the reconstructed source at the decoder. Some applications, like the transmission of medical images, may require that both sides - the sender and the receiver - will share a common version of the distorted data, for the purpose of future discussions or consultation. This requirement, termed here as the common knowledge (CK) constraint, is satisfied automatically in rate-distortion theory for single sources. However, in problems involving joint source-channel coding, the receiver can exploit the signals it receives in a manner that cannot be exactly reproduced at the sender site. In this work a single letter characterization of the achievable rate and distortion pairs is developed, for the problem of simultaneous transmission of data and state under the CK constraint. In particular, it is shown that even under the CK constraint separation strategy is not optimal in general, and joint state-channel coding is necessary to achieve optimal rate-distortion pairs.

[1]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[2]  J. Nicholas Laneman,et al.  Reversible Information Embedding in Multi-User Channels ∗ , 2005 .

[3]  T. Cover,et al.  Rate vs. distortion trade-off for channels with state information , 2002, Proceedings IEEE International Symposium on Information Theory,.

[4]  Shlomo Shamai,et al.  Information Rates Subject to State Masking , 2007, IEEE Transactions on Information Theory.

[5]  Gregory W. Wornell,et al.  The duality between information embedding and source coding with side information and some applications , 2003, IEEE Trans. Inf. Theory.

[6]  Joseph A. O'Sullivan,et al.  Information-theoretic analysis of information hiding , 2003, IEEE Trans. Inf. Theory.

[7]  Abbas El Gamal,et al.  On the capacity of computer memory with defects , 1983, IEEE Trans. Inf. Theory.

[8]  Shlomo Shamai,et al.  On the achievable throughput of a multiantenna Gaussian broadcast channel , 2003, IEEE Transactions on Information Theory.

[9]  Young-Han Kim,et al.  Simultaneous Communication of Data and State , 2007, 2007 IEEE International Symposium on Information Theory.

[10]  Patrick Mitran,et al.  Achievable rates in cognitive radio channels , 2006, IEEE Transactions on Information Theory.

[11]  Mung Chiang,et al.  Channel capacity and state estimation for state-dependent Gaussian channels , 2005, IEEE Transactions on Information Theory.

[12]  Shlomo Shamai,et al.  The Capacity Region of the Gaussian Multiple-Input Multiple-Output Broadcast Channel , 2006, IEEE Transactions on Information Theory.

[13]  Ton Kalker,et al.  Capacity bounds and constructions for reversible data-hiding , 2003, IS&T/SPIE Electronic Imaging.

[14]  Ton Kalker,et al.  Coding Theorems for Reversible Embedding , 2003, Advances in Network Information Theory.