Panoramic Video Coding Using Affine Motion Compensated Prediction

This paper proposes an affine motion compensated prediction (AMCP) method to predict the complex changes between the successive frames in panoramic video coding. A panoramic video is an image-based rendering (IBR) technique [1] which provides users with a large field of view (e.g. 360 degree) on surrounding dynamic scenes. It includes not only the translational motions but also the non-translational motions, such as zooming and rotation etc. However, the traditional motion compensated prediction is a translational motion compensated prediction (TMCP) which cannot predict non-translational changes between panoramic images accurately. The AMCP can model the nontranslational motion effects of panoramic video accurately by using six motion coefficients which are estimated by Gauss Newton iterative minimization algorithm [2]. Simulated results show that the gain of coding performance is up to about 1.3 dB when using AMCP compared with TMCP in panoramic video coding.

[1]  Harry Shum,et al.  On the data compression and transmission aspects of panoramic video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Wen-Shyong Hsieh,et al.  Automatic feature-based global motion estimation in video sequences , 2004, IEEE Transactions on Consumer Electronics.

[3]  S. B. Kang,et al.  Survey of image-based representations and compression techniques , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Petri Haavisto,et al.  Video coding using motion compensation with polynomial motion vector fields , 1997, Signal Process. Image Commun..

[5]  Richard Szeliski,et al.  Stereo reconstruction from multiperspective panoramas , 2004 .

[6]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[7]  Shree K. Nayar,et al.  Generalized mosaicing: polarization panorama , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Thomas Wiegand,et al.  Affine multipicture motion-compensated prediction , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Tien-Tsin Wong,et al.  A system for real-time panorama generation and display in tele-immersive applications , 2005, IEEE Transactions on Multimedia.

[10]  T. Davies,et al.  Affine motion compensation using a content-based mesh , 2005 .

[11]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and texture-mapped models , 1997, International Conference on Computer Graphics and Interactive Techniques.

[12]  Guna Seetharaman,et al.  Affine schemes in mesh-based video motion compensation , 2003, 2003 IEEE Workshop on Signal Processing Systems (IEEE Cat. No.03TH8682).

[13]  Andrew Chi-Sing Leung,et al.  The plenoptic illumination function , 2002, IEEE Trans. Multim..

[14]  Takeshi Naemura,et al.  Generation of a disparity panorama using a 3-camera capturing system , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[15]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[16]  Amir Averbuch,et al.  Fast motion estimation using bidirectional gradient methods , 2004, IEEE Transactions on Image Processing.

[17]  Debashis Ghosh,et al.  Object-based affine motion estimation , 2003, TENCON 2003. Conference on Convergent Technologies for Asia-Pacific Region.

[18]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .