Scalable multiple description coding with side information using motion interpolation

Problems with modern video delivery systems is that decoder fails to decode video when it is transmitted over error prone channels, due to varying characteristics of a wireless channel or congestion in wired networks. Thus introducing mismatch into the decoded video stream. Scalable video coding (SVC) encounters such a problem as the loss of a lower layer prevents all higher layers being decoded, even if the higher layers are correctly received. Multiple description coding (MDC) can help solve such a problem. We propose a scalable MDC architecture that creates an even and odd streams with residual information regarding the other stream. Using such a method creates redundancies that can improve the decoded reconstruction of a frame however increasing the bit rate of a given stream. To solve this a motion interpolation technique is used to improve the construction of side information thus reducing the bit rate but improving the frame quality. Experimental results show that motion interpolation scheme can improve the frame quality by 6 dB over a pixel based interpolation scheme for a number of video sequences Experimental results also show that this method can give 40% saving in bit rate when compared to a pixel based interpolation. Using such a method makes the system a viable target for mobile communications.

[1]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..

[2]  Stefano Tubaro,et al.  Multiple description video coding for scalable and robust transmission over IP , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Lisimachos P. Kondi A rate-distortion optimal hybrid scalable/multiple-description video codec , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Helen J. Wang,et al.  LAYERED MULTIPLE DESCRIPTION CODING , 2003 .

[5]  Antonio Ortega,et al.  Robust video communication by combining scalability and multiple description coding techniques , 2003, IS&T/SPIE Electronic Imaging.

[6]  Luciano Alparone,et al.  Adaptively weighted vector-median filters for motion-fields smoothing , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[7]  Catarina Brites,et al.  IMPROVING FRAME INTERPOLATION WITH SPATIAL MOTION SMOOTHING FOR PIXEL DOMAIN DISTRIBUTED VIDEO CODING , 2005 .

[8]  Yung-Chang Chen,et al.  Multiple description motion compensation video coding for MPEG-4 FGS over lossy packet networks , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[9]  A. Murat Tekalp,et al.  Scalable multiple description video coding with flexible number of descriptions , 2005, IEEE International Conference on Image Processing 2005.

[10]  Yao Wang,et al.  Multiple Description Coding for Video Delivery , 2005, Proceedings of the IEEE.

[11]  Catarina Brites,et al.  Motion compensated refinement for low complexity pixel based distributed video coding , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[12]  Stephan Wenger Video Redundancy Coding in H.263 , 2000 .

[13]  Peter Schelkens,et al.  Embedded Multiple Description Coding of Video , 2006, IEEE Transactions on Image Processing.

[14]  John G. Apostolopoulos ERROR-RESILIENT VIDEO COMPRESSION VIA MULTIPLE STATE STREAMS , 1999 .

[15]  Christophe Tillier,et al.  A Motion-Compensated Overcomplete Temporal Decomposition for Multiple Description Scalable Video Coding , 2007, EURASIP J. Image Video Process..

[16]  T. Sikora,et al.  Multi-State Video Coding with Side Information , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[17]  Yao Wang,et al.  Error-resilient video coding using multiple description motion compensation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[18]  H. Schwarz,et al.  Overview of the Scalable H.264/MPEG4-AVC Extension , 2006, 2006 International Conference on Image Processing.

[19]  Mei Yu,et al.  New Multiple Description Layered Coding Method For Video Communication , 2005, Sixth International Conference on Parallel and Distributed Computing Applications and Technologies (PDCAT'05).

[20]  Ahmet M. Kondoz,et al.  Scalable multiple description video coding for stereoscopic 3D , 2008, IEEE Transactions on Consumer Electronics.

[21]  Mihaela van der Schaar,et al.  Multiple description scalable coding using wavelet-based motion compensated temporal filtering , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).