Arbitrarily shaped virtual-object based video compression

Object based compression techniques are widely believed to have the potential to give the best compression results for a given signal quality. However, true object tracking and extraction are difficult and computationally expensive. In this paper, an arbitrarily shaped virtual-object compression method is developed. The method is similar to the object based compression methods in that it separates the changing portion of the video from the stationary portion, and encodes them independently. The changing portion of the video is grouped as a 3D arbitrarily shaped virtual-object whereas the unchanged portion of the video is grouped as background. The arbitrarily shaped virtual object is coded using 3D wavelet compression whereas stationary background is coded as a single frame using 2D wavelet compression. Experimental results demonstrate that the newly developed method has comparable performance with the state-of-the-art compression methods and significantly outperforms rectangular virtual-object compression.

[1]  Truong Q. Nguyen,et al.  Rate-Distortion Optimized Bitstream Extractor for Motion Scalability in Wavelet-Based Scalable Video Coding , 2010, IEEE Transactions on Image Processing.

[2]  Min-Jen Tsai,et al.  Stack-run image coding , 1996, IEEE Trans. Circuits Syst. Video Technol..

[3]  Jos B. T. M. Roerdink,et al.  Accelerating Wavelet Lifting on Graphics Hardware Using CUDA , 2011, IEEE Transactions on Parallel and Distributed Systems.

[4]  Bo Zhang,et al.  Packed integer wavelet transform constructed by lifting scheme , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[5]  Christine Guillemot,et al.  Robust Video Coding Based on Multiple Description Scalar Quantization With Side Information , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  W. Sweldens.  The Lifting Scheme: A Custom - Design Construction of Biorthogonal Wavelets "Industrial Mathematics , 1996 .

[7]  Information technology — Coding of audio-visual objects — Part 3 : Audio Technologies de l ' information — Codage des objets audiovisuels — Partie , 1999 .

[8]  Michael T. Orchard,et al.  A comparative study of DCT- and wavelet-based image coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[9]  Jo Yew Tham,et al.  Highly scalable wavelet-based video codec for very low bit-rate environment , 1998, IEEE J. Sel. Areas Commun..

[10]  Tihao Chiang,et al.  A zerotree wavelet video coder , 1997, IEEE Trans. Circuits Syst. Video Technol..

[11]  R. Sankar,et al.  Integer-to-integer shape adaptive wavelet transform for region of interest image coding , 2002, Proceedings of 2002 IEEE 10th Digital Signal Processing Workshop, 2002 and the 2nd Signal Processing Education Workshop..

[12]  Yuan F. Zheng,et al.  Object tracking using the Gabor wavelet transform and the golden section algorithm , 2002, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Sharad Singhal,et al.  Interframe video coding using overlapped motion compensation and perfect reconstruction filter banks , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Yin-Tsung Hwang,et al.  An efficient shape coding scheme and its codec design , 2001, 2001 IEEE Workshop on Signal Processing Systems. SiPS 2001. Design and Implementation (Cat. No.01TH8578).

[15]  Lele Zhou,et al.  A Novel Shape Coding Scheme For MPEG-4 Visual Standard , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[16]  T. M. Strat,et al.  Object-based encoding: next-generation video compression , 2001, Proceedings of Workshop and Exhibition on MPEG-4 (Cat. No.01EX511).

[17]  C. Sidney Burrus,et al.  Wavelet transform based fast approximate Fourier transform , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[18]  R. Adhami.  Video compression technique using wavelet transform , 1996, 1996 IEEE Aerospace Applications Conference. Proceedings.

[19]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  Yuan F. Zheng,et al.  Optimal 3-D coefficient tree structure for 3-D wavelet video coding , 2003, IEEE Trans. Circuits Syst. Video Technol..

[21]  Yuan F. Zheng,et al.  Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Yuan F. Zheng,et al.  Feature-based wavelet shrinkage algorithm for image denoising , 2005, IEEE Transactions on Image Processing.

[23]  Thomas Sikora,et al.  Shape-adaptive DCT for generic coding of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[24]  Michael R. Frater,et al.  Quad-Tree Block-Based Binary Shape Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Jin Li,et al.  Arbitrary shape wavelet transform with phase alignment , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[26]  King Ngi Ngan,et al.  3-D Shape-Adaptive Directional Wavelet Transform for Object-Based Scalable Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Lan Zhu,et al.  Design and optimization of video compression system based on MPEG-4 , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[28]  Hari Kalva,et al.  MPEG-4 systems , 2002, SPIE ITCom.

[29]  Shipeng Li,et al.  Arbitrarily shaped video-object coding by wavelet , 2001, IEEE Trans. Circuits Syst. Video Technol..

[30]  Y.F. Zheng,et al.  Virtual-object video compression , 2005, 48th Midwest Symposium on Circuits and Systems, 2005..

[31]  Vooi Voon Yap,et al.  Video compression using dual tree complex wavelet transform , 2007, 2007 International Conference on Intelligent and Advanced Systems.

[32]  Joachim M. Buhmann,et al.  Video coding by region-based motion compensation and spatio-temporal wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[33]  Shuxin Yin,et al.  Design and Optimization of Video Compression System Based on H.264 , 2010, 2010 International Conference on Optoelectronics and Image Processing.

[34]  Michael T. Orchard,et al.  A comparative study of DCT and wavelet based coding , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[35]  Alexandros Eleftheriadis,et al.  MPEG-4 Systems: Overview , 2000, Signal Process. Image Commun..

[36]  Gunnar Karlsson,et al.  Three dimensional sub-band coding of video , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[37]  Wai-tian Tan,et al.  Real time software implementation of scalable video codec , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[38]  Eric J Balster,et al.  Video compression and rate control methods based on the wavelet transform , 2004 .

[39]  Shipeng Li,et al.  Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding , 2000, IEEE Trans. Circuits Syst. Video Technol..

[40]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[41]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[42]  James E. Fowler.  QccPack: an open-source software library for quantization, compression, and coding , 2000, Proceedings DCC 2000. Data Compression Conference.

[43]  M. R. Kaimal,et al.  Object Coding using a Shape Adaptive Wavelet Transform with Scalable WDR Method , 2007, 2007 IEEE International Conference on Image Processing.