Image sequence stabilisation: motion vector integration (MVI) versus frame position smoothing (FPS)

Image sequence stabilisation is the task of removing unwanted camera movements (jitter) from a video sequence. While these jitter can be translational, rotational or zoom based, translational cases have a larger influence on visual perception and are most likely to result in visual appearance degradation that will upset the viewer. While most of the research in the area of image stabilisation has been concentrated in the motion estimation part, with the goal of accurate global motion estimation, the correction part has been given less attention. Two techniques have been reported for the correction of translational jitter: motion vector integration (MVI) and frame position smoothing (FPS). While most reported stabilisation systems have employed MVI, this paper shows that FPS outperforms this technique in that jitter stabilisation is accomplished while successfully preserving intentional camera motions, without the need to compromise as is the case in MVI.

[1]  Hiroshi Mitani,et al.  VHS camcorder with electronic image stabilizer , 1989 .

[2]  Michal Irani,et al.  Recovery of ego-motion using image stabilization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Mitsuru Sato,et al.  Control Teciiniques For Optical Image Stabilizing System , 1993 .

[4]  Rama Chellappa,et al.  Fast Electronic Digital Image Stabilization for Off-Road Navigation , 1996, Real Time Imaging.

[5]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[6]  T. J. Dennis,et al.  Image sequence stabilisation based on DFT filtering , 2000 .

[7]  Alessandro Giua,et al.  Guest Editorial , 2001, Discrete event dynamic systems.

[8]  Sung-Hee Lee,et al.  Digital Image Stabilizing Algorithms Based On Bit-plane Matching , 1998, International 1998 Conference on Consumer Electronics.

[9]  R. Chellappa,et al.  Electronic image stabilization using multiple visual cues , 1995, Proceedings., International Conference on Image Processing.

[10]  Rama Chellappa,et al.  Selective stabilization of images acquired by unmanned ground vehicles , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  J. Paik,et al.  An Adaptive Motion Decision System For Digital Image Stabilizer Based On Edge Pattern Matching , 1992, IEEE 1992 International Conference on Consumer Electronics Digest of Technical Papers.

[12]  Sung-Jea Ko,et al.  Fast digital image stabilizer based on Gray-coded bit-plane matching , 1999, IEEE Trans. Consumer Electron..

[13]  Atsushi Morimura,et al.  Electronic image stabilization system for video cameras and VCRs , 1992 .

[14]  Andreas Engelsberg,et al.  A comparative review of digital image stabilising algorithms for mobile video communications , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[15]  Azriel Rosenfeld,et al.  Image Sequence Stabilization in Real Time , 1996, Real Time Imaging.