Distributed single source coding with side information

In the paper we advocate image compression technique in the scope of distributed source coding framework. The novelty of the proposed approach is twofold: classical image compression is considered from the positions of source coding with side information and, contrarily to the existing scenarios, where side information is given explicitly, side information is created based on deterministic approximation of local image features. We consider an image in the transform domain as a realization of a source with a bounded codebook of symbols where each symbol represents a particular edge shape. The codebook is image independent and plays the role of auxiliary source. Due to the partial availability of side information at both encoder and decoder we treat our problem as a modification of Berger-Flynn-Gray problem and investigate a possible gain over the solutions when side information is either unavailable or available only at decoder. Finally, we present a practical compression algorithm for passport photo images based on our concept that demonstrates the superior performance in very low bit rate regime.

[1]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[2]  Nasir D. Memon,et al.  CALIC-a context based adaptive lossless image codec , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[3]  Mung Chiang,et al.  Duality between channel capacity and rate distortion with two-sided state information , 2002, IEEE Trans. Inf. Theory.

[4]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[5]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[6]  Michael T. Orchard,et al.  Space-frequency quantization for wavelet image coding , 1997, IEEE Trans. Image Process..

[7]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[8]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[9]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[10]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[11]  Xiaolin Wu.  Compression of Wavelet Transform Coefficients , 2000 .

[12]  J. M. Lervik,et al.  Entropy coding of composite sources modeled by infinite Gaussian mixture distributions , 1996, 1996 IEEE Digital Signal Processing Workshop Proceedings.

[13]  Thierry Pun,et al.  Wavelet-based image denoising using nonstationary stochastic geometrical image priors , 2003, IS&T/SPIE Electronic Imaging.

[14]  Kannan Ramchandran,et al.  Enhancing analog image transmission systems using digital side information: a new wavelet-based image coding paradigm , 2001, Proceedings DCC 2001. Data Compression Conference.

[15]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[17]  Ram Zamir,et al.  The rate loss in the Wyner-Ziv problem , 1996, IEEE Trans. Inf. Theory.

[18]  Kannan Ramchandran,et al.  Multiresolution joint source-channel coding using embedded constellations for power-constrained time-varying channels , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[19]  Sheila S. Hemami,et al.  What's your sign?: efficient sign coding for embedded wavelet image coding , 2000, Proceedings DCC 2000. Data Compression Conference.

[20]  Antonio Ortega,et al.  Image subband coding using context-based classification and adaptive quantization , 1999, IEEE Trans. Image Process..

[21]  C. Chrysafis,et al.  Efficient context-based entropy coding for lossy wavelet image compression , 1997, Proceedings DCC '97. Data Compression Conference.

[22]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Giuseppe Longo,et al.  The information theory approach to communications , 1977 .

[24]  Michael T. Orchard,et al.  Wavelet image coding using rate-distortion optimized backward adaptive classification , 1997, Electronic Imaging.

[25]  Michael T. Orchard,et al.  Image coding based on mixture modeling of wavelet coefficients and a fast estimation-quantization framework , 1997, Proceedings DCC '97. Data Compression Conference.

[26]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[27]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[28]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder , 1979 .

[29]  K. R. Rao,et al.  The Transform and Data Compression Handbook , 2000 .

[30]  Robert M. Gray,et al.  Encoding of correlated observations , 1987, IEEE Trans. Inf. Theory.