A robust real-time video stabilization algorithm

Abstract The acquisition of digital video usually suffers from undesirable camera jitters due to unstable camera motions. In this paper, we propose a robust real-time video stabilization algorithm that alleviates the undesirable jitter motions from the unstable video to produce a stabilized video. In the proposed algorithm, we first compute the sparse optical flow vectors between successive frames, followed by estimating the camera motion by fitting the computed optical flow vectors to a simplified affine motion model with a robust trimmed least squares method. Then the computed camera motion parameters are smoothed temporally to reduce the motion fluctuations by using a regularization method. Finally, we transform all frames in the video sequence based on the original and smoothed camera motions to obtain a stabilized video. Experimental results are given to demonstrate the stabilization performance and the efficiency of the proposed algorithm.

[1]  Patrick Bouthemy,et al.  A unified approach to shot change detection and camera motion characterization , 1999, IEEE Trans. Circuits Syst. Video Technol..

[2]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[3]  Azriel Rosenfeld,et al.  Image Sequence Stabilization in Real Time , 1996, Real Time Imaging.

[4]  Atsushi Nomura,et al.  Spatio-temporal optimization method for determining motion vector fields under non-stationary illumination , 2000, Image Vis. Comput..

[5]  Shang-Hong Lai,et al.  New video shot change detection algorithm based on accurate motion and illumination estimation , 2001, IS&T/SPIE Electronic Imaging.

[6]  K. Ratakonda.  Real-time digital video stabilization for multi-media applications , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[7]  Sarp Erturk,et al.  Real-Time Digital Image Stabilization Using Kalman Filters , 2002 .

[8]  S. Erturk,et al.  Digital image stabilization with sub-image phase correlation based global motion estimation , 2003, IEEE Trans. Consumer Electron..

[9]  Janusz Konrad,et al.  Probabilistic video stabilization using Kalman filtering and mosaicing , 2003, IS&T/SPIE Electronic Imaging.

[10]  Jyh-Yeong Chang,et al.  Digital image translational and rotational motion stabilization using optical flow technique , 2002, IEEE Trans. Consumer Electron..

[11]  Rama Chellappa,et al.  Fast Electronic Digital Image Stabilization for Off-Road Navigation , 1996, Real Time Imaging.

[12]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[13]  Guangyou Xu,et al.  Digital Video Sequence Stabilization Based on 2.5D Motion Estimation and Inertial Motion Filtering , 2001, Real Time Imaging.

[14]  Jin-Hau Kuo,et al.  Efficient algorithm for scene change detection and camera motion characterization using the approach of heterogeneous video transcoding on MPEG compressed videos , 2001, IS&T/SPIE Electronic Imaging.