Real-time video stabilization based on fast block matching and improved Kalman filter

Mobile devices become widely used as their easily handling whereas unpleasant shaking effect comes along inevitably in the recorded sequences. This paper presents a robust real-time video stabilization algorithm applying fast block matching and an improved kalman filter. Key block picking and hierarchical searching improve the efficiency of the motion estimation section to make the method available for real-time application, meanwhile the proposed improved kalman filter outstands by preserving the initiative camera scanning while removing unwanted jitters properly at the same time adaptively. Theoretical analysis and practical experimental results demonstrate the effectiveness and robustness of the proposed method even if large scale of panning motion effect exists.

[1]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[2]  P. R. Anurenjan,et al.  Video stabilization using Speeded Up Robust Features , 2011, 2011 International Conference on Communications and Signal Processing.

[3]  Sunglok Choi,et al.  Robust video stabilization to outlier motion using adaptive RANSAC , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Tzuu-Hseng S. Li,et al.  Extended Kalman filter based hand-shake detector for optical image stabilization using a low cost gyroscope , 2013, IEEE Transactions on Consumer Electronics.

[5]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[6]  Sebastiano Battiato,et al.  A Robust Image Alignment Algorithm for Video Stabilization Purposes , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Michael Gleicher,et al.  Subspace video stabilization , 2011, TOGS.

[8]  Avishek Saha,et al.  A neighborhood elimination approach for block matching in motion estimation , 2011, Signal Process. Image Commun..

[9]  Yue Wang,et al.  Video stabilization based on high degree B-spline smoothing , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  Sebastiano Battiato,et al.  A Robust Block-Based Image/Video Registration Approach for Mobile Imaging Devices , 2010, IEEE Transactions on Multimedia.

[11]  Aziz Umit Batur,et al.  Video stabilization and rolling shutter distortion reduction , 2010, 2010 IEEE International Conference on Image Processing.

[12]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[13]  Wen Gao,et al.  A Hardware-Efficient Multi-Resolution Block Matching Algorithm and its VLSI Architecture for High Definition MPEG-Like Video Encoders , 2010, IEEE Transactions on Circuits and Systems for Video Technology.