Distributed Video Coding for Video Communication on Mobile Devices and Sensors

In the context of digital video coding, recent insights have led to a new video coding paradigm called Distributed Video Coding, or DVC, characterized by low-complexity encoding and high-complexity decoding, which is in contrast to traditional video coding schemes. This chapter provides a detailed overview of DVC by explaining the underlying principles and results from information theory and introduces a number of application scenarios. It also discusses the most important practical architectures that are currently available. One of these architectures is analyzed step-by-step to provide further details of the functional building blocks, including an analysis of the coding performance compared to traditional coding schemes. Next to this, it is demonstrated that the computational complexity in a video coding scheme can be shifted dynamically from the encoder to the decoder and vice versa by combining conventional and distributed video coding techniques. Lastly, this chapter discusses some currently important research topics of which it is expected that they can further enhance the performance of DVC, i.e., side information generation, virtual channel noise estimation, and new coding modes.

[1]  Shantanu Rane,et al.  ANALYSIS OF ERROR-RESILIENT VIDEO TRANSMISSION BASED ON SYSTEMATIC SOURCE-CHANNEL CODING , 2004 .

[2]  Wang Xin Overview of the H.264 / AVC Video Coding Standard , 2003 .

[3]  Ofer Hadar,et al.  Dynamic Computational Complexity and Bit Allocation for Optimizing H.264/AVC Video Compression , 2006, 2006 International Conference on Information Technology: Research and Education.

[4]  Ram Zamir,et al.  The rate loss in the Wyner-Ziv problem , 1996, IEEE Trans. Inf. Theory.

[5]  Stefano Tubaro,et al.  Hash-Based Motion Modeling in Wyner-Ziv Video Coding , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[6]  K. Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[7]  Stefan Borchert,et al.  ON EXTRAPOLATING SIDE INFORMATION IN DISTRIBUTED VIDEO CODING , 2007 .

[8]  Henrique S. Malvar,et al.  Low-complexity transform and quantization in H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Rik Van de Walle,et al.  Stopping criterions for turbo coding in a Wyner-Ziv video codec , 2009, 2009 Picture Coding Symposium.

[10]  Catarina Brites,et al.  Correlation Noise Modeling for Efficient Pixel and Transform Domain Wyner–Ziv Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Søren Forchhammer,et al.  Rate-distortion-complexity optimization of fast motion estimation in H.264/MPEG-4 AVC , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  Christine Guillemot,et al.  A Hybrid Encoder/Decoder Rate Control for Wyner-Ziv Video Coding with a Feedback Channel , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[13]  Peter Lambert,et al.  Accounting for quantization noise in online correlation noise estimation for Distributed Video Coding , 2009, 2009 Picture Coding Symposium.

[14]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[15]  Pierpaolo Baccichet,et al.  Systematic Lossy Error Protection based on H.264/AVC redundant slices and flexible macroblock ordering , 2006 .

[16]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[17]  Warnakulasuriya Anil Chandana Fernando,et al.  feedback free DVC architecture using machine learning , 2008, 2008 15th IEEE International Conference on Image Processing.

[18]  Catarina Brites,et al.  Content Adaptive Wyner-ZIV Video Coding Driven by Motion Activity , 2006, 2006 International Conference on Image Processing.

[19]  Bernd Girod,et al.  Wyner-Ziv Residual Coding of Video , 2006 .

[20]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[21]  Yücel Altunbasak,et al.  Rate-Distortion and Complexity Joint Optimization for Fast Motion Estimation In H.264 Video Coding , 2006, 2006 International Conference on Image Processing.

[22]  Warnakulasuriya Anil Chandana Fernando,et al.  Wyner-Ziv Coding with Temporal and Spatial Correlations for Motion Video , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[23]  Stefano Tubaro,et al.  Intra Mode Decision Based on Spatio-Temporal Cues in Pixel Domain Wyner-ZIV Video Coding , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[24]  Qionghai Dai,et al.  Multi-View Images Coding Based on Multiterminal Source Coding , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[25]  Markus Flierl,et al.  Coding of Multi-View Image Sequences with Video Sensors , 2006, 2006 International Conference on Image Processing.

[26]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[27]  Catarina Brites,et al.  STUDYING THE FEEDBACK CHANNEL IN TRANSFORM DOMAIN WYNER-ZIV VIDEO CODING * , 2007 .

[28]  Stefano Tubaro,et al.  Error concealment using a DVC approach for video streaming applications , 2007, 2007 15th European Signal Processing Conference.

[29]  Stefano Tubaro,et al.  Exploiting Spatial Redundancy in Pixel Domain Wyner-Ziv Video Coding , 2006, 2006 International Conference on Image Processing.

[30]  Christine Guillemot,et al.  Optimal Reconstruction in Wyner-Ziv Video Coding with Multiple Side Information , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[31]  Edward J. Delp,et al.  Complexity-Rate-Distortion Analysis of Backward Channel Aware Wyner-Ziv Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[32]  Edward J. Delp,et al.  Rate Distortion Analysis of Motion Side Estimation in Wyner–Ziv Video Coding , 2007, IEEE Transactions on Image Processing.

[33]  Limin Liu,et al.  Wyner-Ziv Video Coding using LDPC Codes , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[34]  Peter Lambert,et al.  Accurate Correlation Modeling for Transform-Domain Wyner-Ziv Video Coding , 2008, PCM.

[35]  Markus Flierl,et al.  Wyner-Ziv coding of video with unsupervised motion vector learning , 2008, Signal Process. Image Commun..

[36]  Simone Milani,et al.  A distributed video coder based on the H.264/AVC standard , 2007, 2007 15th European Signal Processing Conference.

[37]  Peter Lambert,et al.  Heuristic dynamic complexity coding , 2008, SPIE Photonics Europe.

[38]  Jörn Ostermann,et al.  Enhanced Reconstruction of the Quantised Transform Coefficients for WYNER-ZIV Coding , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[39]  Peter Lambert,et al.  Introducing skip mode in distributed video coding , 2009, Signal Process. Image Commun..

[40]  Stefano Tubaro,et al.  Rate-Distortion Analysis of Motion-Compensated Interpolation at the Decoder in Distributed Video Coding , 2007, IEEE Signal Processing Letters.

[41]  Catarina Brites,et al.  Studying the GOP Size Impact on the Performance of a Feedback Channel-Based Wyner-Ziv Video Codec , 2007, PSIVT.

[42]  Peter Lambert,et al.  Dynamic Complexity Coding: Combining Predictive and Distributed Video Coding , 2007, PCS 2007.

[43]  Aleksandra Pizurica,et al.  Rate Allocation Algorithm for Pixel-Domain Distributed Video Coding Without Feedback Channel , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[44]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[45]  A.B.B. Adikari,et al.  Multiple side information streams for distributed video coding , 2006 .

[46]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraints , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[47]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[48]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[49]  Stefano Tubaro,et al.  An efficient request stopping method at the turbo decoder in distributed video coding , 2007, 2007 15th European Signal Processing Conference.

[50]  Catarina Brites,et al.  IMPROVING FRAME INTERPOLATION WITH SPATIAL MOTION SMOOTHING FOR PIXEL DOMAIN DISTRIBUTED VIDEO CODING , 2005 .

[51]  Kannan Ramchandran,et al.  Duality between source coding and channel coding and its extension to the side information case , 2003, IEEE Trans. Inf. Theory.

[52]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[53]  Pascal Frossard,et al.  Wyner-Ziv Coding of Multi-View Omnidirectional Imageswith Overcomplete Decompositions , 2007, 2007 IEEE International Conference on Image Processing.

[54]  Jörn Ostermann,et al.  Side Information Interpolation with Sub-Pel Motion Compensation for WYNER-ZIV Decoder , 2006, SIGMAP.

[55]  Christine Guillemot,et al.  Overlapped Quasi-Arithmetic Codes for Distributed Video Coding , 2007, 2007 IEEE International Conference on Image Processing.