Digital image stabilization based on adaptive motion filtering with feedback correction

For online digital image stabilization system, the camera usually moves with diverse and variable modes, which make the motion filtering process difficult to reserve the intentional fluctuations and remove unwanted jitters simultaneously. This paper presents an adaptive motion filtering algorithm with feedback correction. Firstly, based on the low frequency character of intentional motion in adjacent frames, the intentional velocity is regarded as the control variable, thus the modified one dimension Kalman filtering algorithm is proved to converge to a balance state of consistency and stabilization. Secondly, according to the mutual restraint of consistency and stabilization, this paper proposes two corresponding online feedback factors to reflect the immediate filtering performances. Hence, a motion filtering algorithm with improved Kalman filtering and parameter self-adjustment is realized, which can describe the real camera motion flexibly, as well as adapt to its changes. At last, an objective evaluation method for motion filtering is presented from the aspects of integral consistency, integral stabilization and integral robustness. Compared with other classical motion filtering algorithms, experimental results indicate that the proposed algorithm is more fast-computing and adaptive for different moving modes of the camera, which can reserve the intentional motions and remove the jitters steadily.

[1]  Byung Cheol Song,et al.  Fast 3D video stabilization using ROI-based warping , 2014, J. Vis. Commun. Image Represent..

[2]  Joonki Paik,et al.  Video Stabilization Using Kalman Filter and Phase Correlation Matching , 2005, ICIAR.

[3]  Ang Su,et al.  Instantaneous video stabilization for unmanned aerial vehicles , 2014, J. Electronic Imaging.

[4]  Hore,et al.  [IEEE 2010 20th International Conference on Pattern Recognition (ICPR) - Istanbul, Turkey (2010.08.23-2010.08.26)] 2010 20th International Conference on Pattern Recognition - Image Quality Metrics: PSNR vs. SSIM , 2010 .

[5]  Andreas Birk,et al.  Using iFMI spectral registration for video stabilization and motion detection by an Unmanned Aerial Vehicle (UAV) , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[6]  Truong Q. Nguyen,et al.  Real-Time Affine Global Motion Estimation Using Phase Correlation and its Application for Digital Image Stabilization , 2011, IEEE Transactions on Image Processing.

[7]  Sergio Bampi,et al.  Applying CUDA Architecture to Accelerate Full Search Block Matching Algorithm for High Performance Motion Estimation in Video Encoding , 2011, 2011 23rd International Symposium on Computer Architecture and High Performance Computing.

[8]  Lan Chen,et al.  Semantic Link Network-Based Model for Organizing Multimedia Big Data , 2014, IEEE Transactions on Emerging Topics in Computing.

[9]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[10]  Hai Zhao,et al.  Robust video stabilization based on particle filtering with weighted feature points , 2012, IEEE Transactions on Consumer Electronics.

[11]  Lan Chen,et al.  Semantic based representing and organizing surveillance big data using video structural description technology , 2015, J. Syst. Softw..

[12]  Cecilio Angulo,et al.  Real-time video stabilization without phantom movements for micro aerial vehicles , 2014, EURASIP J. Image Video Process..

[13]  Tsung-Han Tsai,et al.  Design and Implementation of Efficient Video Stabilization Engine Using Maximum a Posteriori Estimation and Motion Energy Smoothing Approach , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Zygmunt Wróbel,et al.  New Efficient Method of Digital Video Stabilization for In-Car Camera , 2012, MCSS.

[15]  Mohan S. Kankanhalli,et al.  Real-life events in multimedia: detection, representation, retrieval, and applications , 2013, Multimedia Tools and Applications.

[16]  Dan Schonfeld,et al.  Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[18]  A. Amanatiadis,et al.  A Rotational and Translational Image Stabilization System for Remotely Operated Robots , 2007, 2007 IEEE International Workshop on Imaging Systems and Techniques.

[19]  Mehdi Rezaei,et al.  Real-time video stabilization by adaptive fuzzy filtering , 2011 .

[20]  Li Song,et al.  Video stabilization with L1–L2 optimization , 2013, 2013 IEEE International Conference on Image Processing.

[21]  Li Song,et al.  Shaking video synthesis for video stabilization performance assessment , 2013, 2013 Visual Communications and Image Processing (VCIP).

[22]  Myung Jin Chung,et al.  Robust Online Digital Image Stabilization Based on Point-Feature Trajectory Without Accumulative Global Motion Estimation , 2012, IEEE Signal Processing Letters.

[23]  Manish Okade,et al.  Video stabilization using maximally stable extremal region features , 2012, Multimedia Tools and Applications.

[24]  Jin Young Choi,et al.  Spatio-temporal weighting in local patches for direct estimation of camera motion in video stabilization , 2014, Comput. Vis. Image Underst..

[25]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[26]  Yunhuai Liu,et al.  Video structural description technology for the new generation video surveillance systems , 2015, Frontiers of Computer Science.

[27]  Sung-Jea Ko,et al.  Robust digital image stabilization using the Kalman filter , 2009, IEEE Transactions on Consumer Electronics.

[28]  Adel M. Alimi,et al.  Video stabilization with moving object detecting and tracking for aerial video surveillance , 2014, Multimedia Tools and Applications.

[29]  Mohan S. Kankanhalli,et al.  W3-privacy: understanding what, when, and where inference channels in multi-camera surveillance video , 2012, Multimedia Tools and Applications.

[30]  Janusz Konrad,et al.  Probabilistic video stabilization using Kalman filtering and mosaicing , 2003, IS&T/SPIE Electronic Imaging.

[31]  Etay Mar Or,et al.  Hand Motion and Image Stabilization in Hand-held Devices , 2007, IEEE Transactions on Consumer Electronics.

[32]  Zihan Zhou,et al.  Plane-Based Content Preserving Warps for Video Stabilization , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.