An Empirical Study on Estimating Motions in Video Stabilization

The objective of video stabilization is to remove undesirable motion effects so that only intentional motion effects are retained. The primary benefit of video stabilization is to improve video quality. We present an empirical study that addresses some important practical issues on estimating motions in the development of video stabilization applications. Specifically, we use synthetic test data to investigate the performance of the Kanade-Lucas-Tomasi algorithm. Our contributions include the following. First, We propose a measure, "average pixel deviation" (APD), to directly assess the accuracy of estimated motion parameters in comparison to true motion parameters, which is capable of overcoming some shortcomings of measures used in previous performance studies. Second, a practical issue of error accumulation often arises during the estimation of motion between frames, which has not been addressed in the previous studies to the best of our knowledge. We propose a novel periodic correction strategy, which is capable of effectively reducing error accumulation.

[1]  K. Ratakonda.  Real-time digital video stabilization for multi-media applications , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[2]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[3]  Harry Shum,et al.  Full-frame video stabilization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Rama Chellappa,et al.  Evaluation of image stabilization algorithms , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[5]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Andreas Engelsberg,et al.  A comparative review of digital image stabilising algorithms for mobile video communications , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[7]  S. Erturk.  Image sequence stabilisation based on Kalman filtering of frame positions , 2001 .

[8]  C. Miro,et al.  Digital video stabilization architecture for low cost devices , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[9]  Chong-Wah Ngo,et al.  Selective object stabilization for home video consumers , 2005, IEEE Trans. Consumer Electron..

[10]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[11]  S. Erturk,et al.  Image sequence stabilisation: motion vector integration (MVI) versus frame position smoothing (FPS) , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[12]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[13]  Gianni Vernazza,et al.  Image stabilization algorithms for video-surveillance applications , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[14]  Anil C. Kokaram,et al.  Gradient based dominant motion estimation with integral projections for real time video stabilisation , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[15]  Ryo Kurazume,et al.  Development of image stabilization system for remote operation of walking robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[16]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[17]  Andrea Fusiello,et al.  Image stabilization by features tracking , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[18]  Shang-Hong Lai,et al.  A robust and efficient video stabilization algorithm , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[19]  Carlo S. Regazzoni,et al.  Color-based video stabilization for real-time on-board object detection on high-speed trains , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[20]  Janusz Konrad,et al.  Probabilistic video stabilization using Kalman filtering and mosaicing , 2003, IS&T/SPIE Electronic Imaging.

[21]  Rama Chellappa,et al.  Fast electronic digital image stabilization , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[22]  T. J. Dennis,et al.  Image sequence stabilisation based on DFT filtering , 2000 .