Performance Evaluation of various Temporal Derivatives for Stabilization of Videos with Large Moving Objects

The efficiency of the various video stabilization methods depends open the efficiency of the motion estimation stage.. Various Temporal derivatives are designed to efficiently estimating the inter-frame motion or optical flow for video stabilization. The performance of the video stabilization methods degrades under the presence of large moving objects in the scene. Therefore, this paper compares the performance of video stabilization method by estimating the motion using the various temporal derivatives. The video stabilization method in this paper uses differential Taylor series expansion based motion estimation followed by IIR filter for smoothening the motion. A 2D-affine parametric model is used for motion estimation. For performance evaluation the MSE and temporal derivatives in X and Y directions using different derivative operators are compared. it is found that the four point temporal derivative gives the minimum inter-frame error under large object in scene

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  Hany Farid,et al.  Video Stabilization and Enhancement , 2007 .

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[5]  Jinhai Cai,et al.  Robust video stabilisation algorithm using feature point selection and delta optical flow , 2009, DICTA 2009.

[6]  Wen-Chung Kao,et al.  Digital image stabilization based on panning motion velocity analysis , 2013, 2013 IEEE International Symposium on Consumer Electronics (ISCE).

[7]  Li Chen,et al.  A fast video stabilization algorithm based on block matching and edge completion , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[8]  Jyoti Singhai,et al.  Review of Motion Estimation and Video Stabilization techniques For hand held mobile video , 2011 .

[9]  Dan Schonfeld,et al.  Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Huizhong Chen,et al.  Efficient Video Stabilization with Dual-Tree Complex Wavelet Transform , 2010 .

[11]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Paresh Rawat,et al.  Adaptive Motion Smoothening for Video Stabilization , 2013 .