Transport of wireless video using separate, concatenated, and joint source-channel coding

The transmission of video over time-varying wireless communication channels can benefit from the use of joint source-channel (JSC) coding methods. We survey relevant research in JSC code design and discuss how this work can be used for video compression and transmission. A main focus is the use of estimation-based techniques to take advantage of the residual redundancy present at the output of the source encoder. As noted in previous work, the combination of the source encoder and channel can often be modeled as a hidden Markov model. This statistical framework is the basis for state estimation and minimum mean-square error estimation procedures for JSC decoding, and it can also be used to develop channel state and channel parameter estimation methods. We discuss these approaches, along with work that also incorporates modulation, channel coding, and rate allocation within the JSC design. The integration of these methods into video compression standards is considered.

[1]  N. Moayeri,et al.  Modeling, capacity, and joint source/channel coding for Rayleigh fading channels , 1993, IEEE 43rd Vehicular Technology Conference.

[2]  Joachim Hagenauer,et al.  A Viterbi algorithm with soft-decision outputs and its applications , 1989, IEEE Global Telecommunications Conference, 1989, and Exhibition. 'Communications Technology for the 1990s and Beyond.

[3]  Kenneth Rose,et al.  Combined source-channel vector quantization using deterministic annealing , 1994, IEEE Trans. Commun..

[4]  Michael W. Marcellin,et al.  Transform coding of monochrome and color images using trellis coded quantization , 1993, IEEE Trans. Circuits Syst. Video Technol..

[5]  Nick G. Kingsbury,et al.  Error resilient transmission of MPEG-II over noisy wireless ATM networks , 1997, Proceedings of International Conference on Image Processing.

[6]  Pamela C. Cosman,et al.  Robust wavelet zerotree image compression with fixed-length packetization , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[7]  E. Gilbert.  Capacity of a burst-noise channel , 1960 .

[8]  Bernd Girod,et al.  Joint source channel coding of images with trellis coded quantization and convolutional codes , 1995, Proceedings., International Conference on Image Processing.

[9]  David J. Miller,et al.  Improved image decoding over noisy channels using minimum mean-squared estimation and a Markov mesh , 1999, IEEE Trans. Image Process..

[10]  H. Gharavi,et al.  H.263 compatible video coding and transmission , 1996, Proceedings of First International Workshop on Wireless Image/Video Communications.

[11]  Hsueh-Ming Hang,et al.  Combined quantizer and linear error control code design for noisy channels , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[12]  Gottfried Ungerboeck,et al.  Channel coding with multilevel/phase signals , 1982, IEEE Trans. Inf. Theory.

[13]  Thomas E. Fuja,et al.  Exploiting the residual redundancy in motion estimation vectors to improve the quality of compressed video transmitted over noisy channels , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[14]  Lane A. Hemaspaandra,et al.  Using simulated annealing to design good codes , 1987, IEEE Trans. Inf. Theory.

[15]  Thomas R. Fischer.  Joint trellis coded quantization/modulation , 1991, IEEE Trans. Commun..

[16]  Nariman Farvardin,et al.  Subband Image Coding Using Entropy-Coded Quantization over Noisy Channels , 1992, IEEE J. Sel. Areas Commun..

[17]  David G. Daut,et al.  Combined Source-Channel Coding of Images Using the Block Cosine Transform , 1981, IEEE Trans. Commun..

[18]  Allen Gersho,et al.  Globally optimal vector quantizer design by stochastic relaxation , 1992, IEEE Trans. Signal Process..

[19]  Masao Kasahara,et al.  A construction of vector quantizers for noisy channels , 1984 .

[20]  Khalid Sayood,et al.  Joint source/channel coding for variable length codes , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[21]  U. Benzler.  Scalable multiresolution video coding using subband decomposition , 1996, Proceedings of First International Workshop on Wireless Image/Video Communications.

[22]  John F. Arnold,et al.  Layered coding using bitstream decomposition with drift correction , 1997, IEEE Trans. Circuits Syst. Video Technol..

[23]  Michael W. Marcellin,et al.  Trellis coded quantization of memoryless and Gauss-Markov sources , 1990, IEEE Trans. Commun..

[24]  Joachim Hagenauer.  Source-controlled channel decoding , 1995, IEEE Trans. Commun..

[25]  Nick G. Kingsbury,et al.  The EREC: an error-resilient technique for coding variable-length blocks of data , 1996, IEEE Trans. Image Process..

[26]  Ghassan Kawas Kaleh,et al.  Joint parameter estimation and symbol detection for linear or nonlinear unknown channels , 1994, IEEE Trans. Commun..

[27]  P. Wintz,et al.  Quantizing for Noisy Channels , 1969 .

[28]  Robert M. Gray,et al.  The design of joint source and channel trellis waveform coders , 1987, IEEE Trans. Inf. Theory.

[29]  John G. Cleary,et al.  Integrating error detection into arithmetic coding , 1997, IEEE Trans. Commun..

[30]  Kenneth Rose,et al.  Jointly optimized VQ index assignment and transmission energy allocation , 1997, Proceedings of ICC'97 - International Conference on Communications.

[31]  Nariman Farvardin,et al.  Optimal block cosine transform image coding for noisy channels , 1990, IEEE Trans. Commun..

[32]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[33]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[34]  Nariman Farvardin,et al.  Joint design of block source codes and modulation signal sets , 1992, IEEE Trans. Inf. Theory.

[35]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[36]  David J. Miller,et al.  Image decoding over noisy channels using minimum mean-squared estimation and a Markov mesh , 1997, Proceedings of International Conference on Image Processing.

[37]  J. Hagenauer,et al.  Source-controlled channel decoding in image transmission , 1996, Proceedings of First International Workshop on Wireless Image/Video Communications.

[38]  Susanna Aign.  Error concealment, early re-synchronization, and iterative decoding for MPEG-2 , 1997, Proceedings of ICC'97 - International Conference on Communications.

[39]  Charles D. Creusere,et al.  A new method of robust image compression based on the embedded zerotree wavelet algorithm , 1997, IEEE Trans. Image Process..

[40]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[41]  Kannan Ramchandran,et al.  Hybrid compressed-uncompressed framework for wireless image transmission , 1997, Proceedings of International Conference on Image Processing.

[42]  Amy R. Reibman,et al.  Video transport in wireless ATM , 1995, Proceedings., International Conference on Image Processing.

[43]  Vladimir Cuperman,et al.  Joint source and channel coding using a non-linear receiver , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[44]  Kenneth Zeger,et al.  Progressive image coding for noisy channels , 1997 .

[45]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[46]  Hong Shen Wang,et al.  Finite-state Markov channel-a useful model for radio communication channels , 1995 .

[47]  Khalid Sayood,et al.  Use of residual redundancy in the design of joint source/channel coders , 1991, IEEE Trans. Commun..

[48]  Scott L. Miller,et al.  DPCM picture transmission over noisy channels with the aid of a Markov model , 1995, IEEE Trans. Image Process..

[49]  W. F. Schreiber,et al.  Advanced television systems for terrestrial broadcasting: Some problems and some proposed solutions , 1995, Proc. IEEE.

[50]  NARIMAN FARVARDIN,et al.  Optimal quantizer design for noisy channels: An approach to combined source - channel coding , 1987, IEEE Trans. Inf. Theory.

[51]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[52]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[53]  Alain Glavieux,et al.  Reflections on the Prize Paper : "Near optimum error-correcting coding and decoding: turbo codes" , 1998 .

[54]  Tor A. Ramstad,et al.  Bandwidth compression for continuous amplitude channels based on vector approximation to a continuous subset of the source signal space , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[55]  Jerry D. Gibson,et al.  A constrained joint source/channel coder design , 1994, IEEE J. Sel. Areas Commun..

[56]  Avideh Zakhor,et al.  Joint source/channel coding of scalable video over noisy channels , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[57]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[58]  James W. Modestino,et al.  Rate-distortion performance for joint source and channel coding of images , 1995, Proceedings., International Conference on Image Processing.

[59]  Itu-T.  Video coding for low bitrate communication , 1996 .

[60]  Didier J. Le Gall,et al.  The MPEG video compression algorithm , 1992, Signal Process. Image Commun..

[61]  Allen Gersho,et al.  Pseudo-Gray coding , 1990, IEEE Trans. Commun..

[62]  Nam C. Phamdo,et al.  Optimal detection of discrete Markov sources over discrete memoryless channels - applications to combined source-channel coding , 1994, IEEE Trans. Inf. Theory.

[63]  Robert M. Gray,et al.  Joint source and noisy channel trellis encoding , 1981, IEEE Trans. Inf. Theory.

[64]  Andrea J. Goldsmith,et al.  Iterative joint design of source codes and multiresolution channel codes , 1997, Proceedings of ICC'97 - International Conference on Communications.

[65]  Michelle Effros.  Robustness to channel variation in source coding for transmission across noisy channels , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[66]  Joachim Hagenauer,et al.  Rate-compatible punctured convolutional codes (RCPC codes) and their applications , 1988, IEEE Trans. Commun..

[67]  Rama Chellappa,et al.  Joint source-channel subband coding of images , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[68]  Geoffrey C. Fox,et al.  Vector quantization by deterministic annealing , 1992, IEEE Trans. Inf. Theory.

[69]  John D. Villasenor,et al.  A class of reversible variable length codes for robust image and video coding , 1997, Proceedings of International Conference on Image Processing.

[70]  Thomas E. Fuja,et al.  Joint source-channel decoding of variable-length encoded sources , 1998, 1998 Information Theory Workshop (Cat. No.98EX131).

[71]  David J. Miller,et al.  A sequence-based approximate MMSE decoder for source coding over noisy channels using discrete hidden Markov models , 1998, IEEE Trans. Commun..

[72]  Lajos Hanzo,et al.  Robust H.263 video transmission over mobile channels in interference limited environments , 1996, Proceedings of First International Workshop on Wireless Image/Video Communications.

[73]  R. E. Van Dyck,et al.  Wavelet video transmission over wireless channels , 1998, Signal Process. Image Commun..

[74]  Nariman Farvardin,et al.  A study of vector quantization for noisy channels , 1990, IEEE Trans. Inf. Theory.

[75]  Nam C. Phamdo,et al.  A unified approach to tree-structured and multistage vector quantization for noisy channels , 1993, IEEE Trans. Inf. Theory.

[76]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[77]  David J. Miller,et al.  Joint source-channel decoding for variable-length encoded data by exact and approximate MAP sequence estimation , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[78]  Robert L. Stevenson,et al.  Fixed length entropy coding for robust video compression , 1997, Proceedings of International Conference on Image Processing.

[79]  K.M. Uz,et al.  Multiresolution Broadcast for Digital HDTV Using Joint Source/Channel Coding , 1993, IEEE J. Sel. Areas Commun..

[80]  Ming Lei Liou,et al.  Overview of the p×64 kbit/s video coding standard , 1991, CACM.

[81]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[82]  Fady Alajaji,et al.  Quantization of memoryless and Gauss-Markov sources over binary Markov channels , 1997, IEEE Trans. Commun..

[83]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[84]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[85]  David J. Miller,et al.  Low-delay optimal MAP state estimation in HMM's with application to symbol decoding , 1997, IEEE Signal Processing Letters.

[86]  F. Kossentini,et al.  Robust EZW image coding for noisy channels , 1997, IEEE Signal Processing Letters.

[87]  Min Wang,et al.  Trellis-coded quantization designed for noisy channels , 1994, IEEE Trans. Inf. Theory.

[88]  Hamid Jafarkhani,et al.  Channel-matched hierarchical table-lookup vector quantization for transmission of video over wireless channels , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[89]  E. O. Elliott.  Estimates of error rates for codes on burst-noise channels , 1963 .

[90]  T.E. Fuja,et al.  Channel codes that exploit the residual redundancy in CELP-encoded speech , 1996, IEEE Trans. Speech Audio Process..

[91]  Allen Gersho,et al.  Vector quantizer design for memoryless noisy channels , 1988, IEEE International Conference on Communications, - Spanning the Universe..

[92]  Amir K. Khandani,et al.  Combined source-channel coding using turbo-codes , 1997 .

[93]  Richard E. Ladner,et al.  Codebook organization to enhance maximum a posteriori detection of progressive transmission of vector quantized images over noisy channels , 1996, IEEE Trans. Image Process..