Bidirectional Motion Estimation Approach Using Warping Mesh Combined to Frame Interpolation

This paper concentrates on the bidirectional motion estimation problem for applications at very low bit rate. The missing frames in the original video sequence are predicted by the decoder using only the received frames with not additional information. The same selected moving objects on each decoded frames, are initially meshed from quadrilateral blocks which are then deformed using specific warping functions. The positions of the mesh nodes are adapted to the object's edges in such a way that the reconstruction error is as small as possible. Afterwards, the position displacements of these nodes are used to predict those of the moving objects in the missing frames. Finally, the meshed objects are reconstructed thanks to the predicted nodes. The proposed approach is integrated in the H.264/AVC video coding standard. Simulation results present the performance of the proposed bidirectional motion estimation.

[1]  Guido Heising.  Efficient and robust motion estimation in grid-based hybrid video coding schemes , 2002, Proceedings. International Conference on Image Processing.

[2]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[3]  R. M. A. P. Rajatheva,et al.  Mesh-based video coding for low bit-rate communications , 2006, IEEE Transactions on Consumer Electronics.

[4]  Bilge Gunsel,et al.  Two-dimensional mesh-based visual-object representation for interactive synthetic/natural digital video , 1998, Proc. IEEE.

[5]  G. Aubert,et al.  Video object segmentation using Eulerian region-based active contours , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Yao Wang,et al.  Use of two-dimensional deformable mesh structures for video coding .I. The synthesis problem: mesh-based function approximation and mapping , 1996, IEEE Trans. Circuits Syst. Video Technol..

[7]  Jiang Li,et al.  A low complexity motion compensated frame interpolation method , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[8]  Tsuhan Chen,et al.  A new frame interpolation scheme for talking head sequences , 1995, Proceedings., International Conference on Image Processing.

[9]  Ingvar Claesson,et al.  Face Detection using Local SMQT Features and Split up Snow Classifier , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[10]  Yao Wang,et al.  Motion-Compensated Prediction Using Nodal-Based Deformable Block Matching , 1995, J. Vis. Commun. Image Represent..

[11]  Ted Belytschko,et al.  Finite Elements, An Introduction , 1982 .

[12]  H. Saunders,et al.  Finite element procedures in engineering analysis , 1982 .

[13]  A. Zergainoh,et al.  Motion estimation method through adaptive deformable variable-sized rectangular meshes using warping function , 2006, 2006 IEEE International Symposium on Signal Processing and Information Technology.

[14]  Ferran Marqués,et al.  The MPEG-4 Book , 2003, J. Electronic Imaging.

[15]  Mohammad Umar Siddiqi,et al.  Multiresolution Motion Estimation for Low-Rate Video Frame Interpolation , 2004, EURASIP J. Adv. Signal Process..

[16]  Anissa Zergaïnoh-Mokraoui,et al.  New Bidirectional Motion Estimation Using Mesh-Based Frame Interpolation for Videoconferencing Applications , 2008, Data Compression Conference (dcc 2008).

[17]  Tao Chen.  Adaptive temporal interpolation using bidirectional motion estimation and compensation , 2002, Proceedings. International Conference on Image Processing.

[18]  Pierre Duhamel,et al.  The influence of the non-uniform spline basis on the approximation signal , 2004, 2004 12th European Signal Processing Conference.