Fuzzy Motion Interpolation for Mesh-Based Motion Estimation

Mesh-based motion estimation is an important tool for video coding especially with low bit rate. In this paper, a new method for interpolating pixel motion from adjacent mesh nodes with the ability of omitting independent nodes is proposed. By exploiting fuzzy rules to determine the association of pixel and neighboring nodes, the proposed interpolation can detach pixels from some nodes. Consequently, it can deal with those critical patches on objects boundary which their nodes do not belong to one object. Updating the membership functions of each rule with specified strategy makes the interpolation adaptive with non-stationary conditions of image sequences and decreases sensitivity to initial selection of parameters. Experimental results show that the proposed method, in comparison with the conventional methods, increases the motion interpolation accuracy while does not accompanies with massive time cost and complexity

[1]  Yücel Altunbasak,et al.  Hierarchical motion estimation with content-based meshes , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  A. Murat Tekalp,et al.  Closed-form connectivity-preserving solutions for motion compensation using 2-D meshes , 1997, IEEE Trans. Image Process..

[3]  Hans-Jürgen Zimmermann,et al.  Fuzzy set theory , 1992 .

[4]  Jörn Ostermann,et al.  Comparison of block-based and mesh-based motion estimation algorithms , 1997, Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97.

[5]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[6]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[7]  E. Fatemizadeh,et al.  Edge Sensitive Block Motion Estimation Employing Partial Ridgelet Distortion Search , 2006, 2006 IEEE International Symposium on Signal Processing and Information Technology.

[8]  Karl Rohr,et al.  Image Registration Based on Thin-Plate Splines and Local Estimates of Anisotropic Landmark Localization Uncertainties , 1998, MICCAI.

[9]  A. Murat Tekalp,et al.  2-D mesh-based tracking of deformable objects with occlusion , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[10]  Chung Ming Kuo,et al.  An effective mesh-based motion compensation technique for video coding , 2003, J. Vis. Commun. Image Represent..

[11]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[12]  Hiroshi Harashima,et al.  Motion compensation based on spatial transformations , 1994, IEEE Trans. Circuits Syst. Video Technol..

[13]  Anthony Vetro,et al.  Use of two-dimensional deformable mesh structures for video coding. II. The analysis problem and a region-based coder employing an active mesh representation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[14]  Yao Wang,et al.  Use of two-dimensional deformable mesh structures for video coding .I. The synthesis problem: mesh-based function approximation and mapping , 1996, IEEE Trans. Circuits Syst. Video Technol..

[15]  K. J. Ray Liu,et al.  An adaptive interpolation scheme for 2-D mesh motion compensation , 1997, Proceedings of International Conference on Image Processing.

[16]  A. Murat Tekalp,et al.  Tracking Motion and Intensity Variations Using Hierarchical 2-D Mesh Modeling for Synthetic Object Transfiguration , 1996, CVGIP Graph. Model. Image Process..