Error-Resilient Scheme for Wavelet Video Codec Using Automatic ROI Detection and Wyner-Ziv Coding Over Packet Erasure Channel

The error-resilient for video transmission over the Internet in which regarded as the packet erasure channel is always a tough task and has gained lots of attentions. The main contradictory problem lies between error-resilient and bandwidth usage. Additional redundant data has to be added to achieve robust transmission which leads to huge bandwidth usage. In this paper, an error-resilient scheme called Wyner-Ziv Error-Resilient (WZER) based on a receiver driven layered Wyner-Ziv (WZ) coding framework is proposed. The WZER purposely emphasizes on the protection of the Region of Interest (ROI) area in the frame thus to achieve the better tradeoff between the bandwidth usage and error-resilience. WZER is designed to work for the scenario of wavelet based video coding over packet erasure channel, where several techniques including automatic ROI detection, ROI mask generation, Rate distortion optimization (RDO) quantization, WZ coding with layer design, and packet level Low Density Parity Check (LDPC) code are used. The performances of the proposed WZER are simulated based on average PSNR of luminance, perceptual reconstruction and bandwidth usage and compared with normal Forward Error Correction (FEC) full protection scheme and no protection scheme. The results show the advantages of the proposed WZER over traditional FEC protection, especially in the aspects of the recovery of the subject area and bandwidth efficiency.

[1]  Bernd Girod,et al.  Systematic lossy forward error protection for video waveforms , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[2]  Chien-Peng Ho,et al.  Content-Adaptive Packetization and Streaming of Wavelet Video over IP Networks , 2007, EURASIP J. Image Video Process..

[3]  Hayder Radha,et al.  Network-embedded FEC for optimum throughput of multicast packet video , 2005, Signal Process. Image Commun..

[4]  Bernd Girod,et al.  Error-resilient video transmission using multiple embedded Wyner-Ziv descriptions , 2005, IEEE International Conference on Image Processing 2005.

[5]  Min Wu,et al.  Multiple description distributed image coding with side information for mobile wireless transmission , 2005, IS&T/SPIE Electronic Imaging.

[6]  William A. Pearlman,et al.  Error-resilient video coding with improved 3D SPIHT and error concealment , 2003, IS&T/SPIE Electronic Imaging.

[7]  Shantanu Rane,et al.  Systematic lossy error protection of video based on H.264/AVC redundant slices , 2006, Electronic Imaging.

[8]  David Nistér,et al.  Lossless region of interest coding , 1999, Signal Process..

[9]  Ran Giladi,et al.  New Error-Resilient Scheme Based on FMO and Dynamic Redundant Slices Allocation for Wireless Video Transmission , 2007, IEEE Transactions on Broadcasting.

[10]  William A. Pearlman,et al.  An embedded wavelet video coder using three-dimensional set partitioning in hierarchical trees (SPIHT) , 1997, Proceedings DCC '97. Data Compression Conference.

[11]  Albert Wang,et al.  Error control for receiver-driven layered multicast of audio and video , 2001, IEEE Trans. Multim..

[12]  Youshi Xu,et al.  Unequal packet loss protection for layered video transmission , 1999, IEEE Trans. Broadcast..

[13]  Li Tang Combined and iterative form of spatial and temporal error concealment for video signals , 2006, IEEE Transactions on Broadcasting.

[14]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[15]  Nariman Farvardin,et al.  Lossy/lossless region-of-interest image coding based on set partitioning in hierarchical trees , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[16]  C. Christopoulos,et al.  Efficient methods for encoding regions of interest in the upcoming JPEG2000 still image coding standard , 2000, IEEE Signal Processing Letters.

[17]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[18]  Kannan Ramchandran,et al.  PRISM: an uplink-friendly multimedia coding paradigm , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[19]  Yücel Altunbasak,et al.  Error-resilient image and video transmission over the Internet using unequal error protection , 2003, IEEE Trans. Image Process..

[20]  Lap-Pui Chau,et al.  Error-resilient coding of H.264 based on periodic macroblock , 2006, IEEE Transactions on Broadcasting.

[21]  Liang-Gee Chen,et al.  Fast video segmentation algorithm with shadow cancellation, global motion compensation, and adaptive threshold techniques , 2004, IEEE Transactions on Multimedia.

[22]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[23]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[24]  William A. Pearlman,et al.  Multilayered protection of embedded video bitstreams over binary symmetric and packet erasure channels , 2005, J. Vis. Commun. Image Represent..

[25]  Mark J. T. Smith,et al.  Three-dimensional subband coding techniques for wireless video communications , 2002, IEEE Trans. Circuits Syst. Video Technol..

[26]  Jonathan Loo,et al.  Error-Resilient Performance of Dirac Video Codec Over Packet-Erasure Channel , 2007, IEEE Transactions on Broadcasting.

[27]  A. Enis Çetin,et al.  Influence function based Gaussianity tests for detection of microcalcifications in mammogram images , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[28]  Pierpaolo Baccichet,et al.  Systematic Lossy Error Protection based on H.264/AVC redundant slices and flexible macroblock ordering , 2006 .

[29]  Kannan Ramchandran,et al.  PRISM: a "reversed" multimedia coding paradigm , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[30]  William A. Pearlman,et al.  Three-dimensional subband coding of video using the zero-tree method , 1996, Other Conferences.

[31]  Wai-Tian Tan,et al.  Resilient compression of video for transmission over the Internet , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[32]  Shih-Chia Huang,et al.  Optimization of Hybridized Error Concealment for H.264 , 2008, IEEE Transactions on Broadcasting.

[33]  Charles D. Creusere Robust image coding using the embedded zerotree wavelet algorithm , 1996, Proceedings of Data Compression Conference - DCC '96.

[34]  William A. Pearlman,et al.  A full-featured, error-resilient, scalable wavelet video codec based on the set partitioning in hierarchical trees (SPIHT) algorithm , 2002, IEEE Trans. Circuits Syst. Video Technol..

[35]  Zixiang Xiong,et al.  Layered Wyner-Ziv video coding for transmission over unreliable channels , 2006 .

[36]  Zixiang Xiong,et al.  Progressive video coding for noisy channels , 1998, Optics & Photonics.

[37]  Kannan Ramchandran,et al.  PRISM: A Video Coding Paradigm With Motion Estimation at the Decoder , 2007, IEEE Transactions on Image Processing.

[38]  Rui Zhang,et al.  Wyner-Ziv coding for video: applications to compression and error resilience , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[39]  Kannan Ramchandran,et al.  Receiver-driven multicast over wireless with distributed source coding and FEC , 2007, IWCMC.

[40]  Steven McCanne,et al.  Receiver-driven layered multicast , 2001 .

[41]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[42]  Ali N. Akansu,et al.  Unequal error protection of SPIHT encoded image bit streams , 2000, IEEE Journal on Selected Areas in Communications.

[43]  Kenneth Zeger,et al.  Progressive image coding for noisy channels , 1997 .

[44]  Christophe Tillier,et al.  Distributed Temporal Multiple Description Coding for Robust Video Transmission , 2008, EURASIP J. Wirel. Commun. Netw..

[45]  Bernd Girod,et al.  Systematic lossy error protection versus layered coding with unequal error protection , 2005, IS&T/SPIE Electronic Imaging.

[46]  Narendra Ahuja,et al.  Wyner-Ziv coding of video: an error-resilient compression framework , 2004, IEEE Transactions on Multimedia.

[47]  Kok-Keong Loo,et al.  Bandwidth efficient error resilience scheme for wavelet based video transmission , 2008, 2008 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[48]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[49]  Laurence B. Milstein,et al.  On the performance of hybrid FEC/ARQ systems using rate compatible punctured turbo (RCPT) codes , 2000, IEEE Trans. Commun..

[50]  Yo-Sung Ho,et al.  Error concealment techniques for digital TV , 2002, IEEE Trans. Broadcast..