Efficient Video Stabilization Technique for Hand Held Mobile Videos

Majority of the videos that have been captured by mobile cameras are suffering from low quality due to either low end manufacturing designs or complicated operating environments and untrained users. Thus videos taken by hand held mobile cameras tend to suffer from different undesired slow motions that cause annoying shaky motion and jitter. It is desirable to stabilize the video sequence by removing the undesired motion between the successive frames. Current methods are applicable to only specific camera motion models; hence having limitation to process gorse motion. In this paper an efficient video stabilization algorithm for hand held camera videos has been proposed. The proposed algorithm uses differential global motion estimation with Taylor series expansion to improve the estimation efficiency. Affine motion model has been assumed to define the inter-frame error between consecutive frames. Motion vectors have been estimated analytically by solving the derivatives of the inter-frame error. After motion estimation Gaussian kernel filtering has been used to smoothen out estimated motion parameters. Inverse rotation smoothening has been applied to remove the rotation effect from the smoothed transformation chain. This has led to reduced accumulation error and minimizes the missing image area significantly. The performance of the proposed algorithm has been tested on real time videos and compared with existing algorithm.

[1]  Maurizio Pilu,et al.  Video stabilization as a variational problem and numerical solution with the Viterbi method , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  Dan Schonfeld,et al.  Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[4]  Wenbin Chen,et al.  Video Stabilization Using Scale-Invariant Features , 2007, 2007 11th International Conference Information Visualization (IV '07).

[5]  Olivier Adda,et al.  A Tool for Global Motion Estimation and Compensation for Video Processing , 2003 .

[6]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[7]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Hany Farid,et al.  Video Stabilization and Enhancement , 2007 .

[9]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[10]  SchonfeldDan,et al.  Robust video stabilization based on particle filter tracking of projected camera motion , 2009 .

[11]  Janusz Konrad,et al.  Probabilistic video stabilization using Kalman filtering and mosaicing , 2003, IS&T/SPIE Electronic Imaging.

[12]  Rama Chellappa,et al.  Fast electronic digital image stabilization , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[13]  Bernd Girod,et al.  Unified Real-Time Tracking and Recognition with Rotation-Invariant Fast Features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[15]  Guangyou Xu,et al.  Digital Video Sequence Stabilization Based on 2.5D Motion Estimation and Inertial Motion Filtering , 2001, Real Time Imaging.

[16]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[17]  Huizhong Chen,et al.  Efficient Video Stabilization with Dual-Tree Complex Wavelet Transform , 2010 .

[18]  Shang-Hong Lai,et al.  A robust and efficient video stabilization algorithm , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[19]  Michael Bosse,et al.  Non-metric image-based rendering for video stabilization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.