Integration of Digital Stabilizer With Video Codec for Digital Video Cameras

This paper presents three novel schemes for integrating digital stabilizer with video codec of a digital video camera, each designed for a different application scenario. Scheme 1 confines the global motion estimation (ME) to within a small background region determined by clustering the motion vectors (MVs) generated by the video encoder. Scheme 2 performs the main ME task at the digital stabilizer and sends the resulting motion vectors to the video encoder, where the motion vectors are further refined to subpixel accuracy. Scheme 3, which is applied on the decoder side, acquires the motion information directly from the video decoder to perform digital stabilization. These integration schemes achieve computational efficiency without affecting the performance of video coding and digital stabilization.

[1]  Yu-Chun Peng,et al.  The effect of digital image stabilization on coding performance [video coding] , 2004, Proceedings of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004..

[2]  S. Erturk,et al.  Digital image stabilization with sub-image phase correlation based global motion estimation , 2003, IEEE Trans. Consumer Electron..

[3]  Janusz Konrad,et al.  Probabilistic video stabilization using Kalman filtering and mosaicing , 2003, IS&T/SPIE Electronic Imaging.

[4]  Hiroshi Mitani,et al.  VHS camcorder with electronic image stabilizer , 1989 .

[5]  Mohammad Rahmati,et al.  Weighted multiple bit-plane matching, a simple and efficient matching criterion for electronic digital image stabilizer application , 2002, 6th International Conference on Signal Processing, 2002..

[6]  Sheng-Jyh Wang,et al.  A novel structure for digital image stabilizer , 2000, IEEE APCCAS 2000. 2000 IEEE Asia-Pacific Conference on Circuits and Systems. Electronic Communication Systems. (Cat. No.00EX394).

[7]  Andrea Fusiello,et al.  Image stabilization by features tracking , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[8]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[9]  Jyh-Yeong Chang,et al.  Digital image translational and rotational motion stabilization using optical flow technique , 2002, IEEE Trans. Consumer Electron..

[10]  Andreas Engelsberg,et al.  A comparative review of digital image stabilising algorithms for mobile video communications , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[11]  Sarp Ertürk,et al.  Membership function adaptive fuzzy filter for image sequence stabilization , 2004, IEEE Transactions on Consumer Electronics.

[12]  Anil C. Kokaram,et al.  Gradient based dominant motion estimation with integral projections for real time video stabilisation , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[13]  Sarp Erturk,et al.  Real-Time Digital Image Stabilization Using Kalman Filters , 2002 .

[14]  Joonki Paik,et al.  An adaptive motion decision system for digital image stabilizer based on edge pattern matching , 1992 .

[15]  Rama Chellappa,et al.  Performance Characterization of Image Stabilization Algorithms , 1996, Real Time Imaging.

[16]  Sarp Ertürk,et al.  Image sequence stabilization by low-pass filtering of interframe motion , 2000, IS&T/SPIE Electronic Imaging.

[17]  Chin-Teng Lin,et al.  A robust digital image stabilization technique based on inverse triangle method and background detection , 2005, IEEE Transactions on Consumer Electronics.

[18]  Yu-Chun Peng,et al.  Integration of image stabilizer with video codec for digital video cameras , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[19]  Yu-Chun Peng,et al.  DSP implementation of digital image stabilizer , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[20]  Sung-Jea Ko,et al.  Fast digital image stabilizer based on Gray-coded bit-plane matching , 1999, IEEE Trans. Consumer Electron..

[21]  Bernard Besserer,et al.  Global motion estimation for MPEG-encoded streams , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[22]  A. Tanju Erdem,et al.  Effect of image stabilization on the performance of the MPEG-2 video coding algorithm , 1998, Electronic Imaging.

[23]  Harry Shum,et al.  Full-frame video stabilization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Rama Chellappa,et al.  Evaluation of image stabilization algorithms , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[25]  Mitsuru Sato,et al.  Control Teciiniques For Optical Image Stabilizing System , 1993 .

[26]  Ming-Ting Sun,et al.  Global motion estimation from coarsely sampled motion vector field and the applications , 2003, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Joonki Paik,et al.  An Edge Detection Approach To Digital Image Stabilization Based On Tri-state Adaptive Linear Neurons , 1991 .

[28]  Yu-Chun Peng,et al.  Digital image stabilization and its integration with video encoder , 2005, Second IEEE Consumer Communications and Networking Conference, 2005. CCNC. 2005.

[29]  Sarp Ertürk,et al.  Real-Time Digital Image Stabilization Using Kalman Filters , 2002, Real Time Imaging.

[30]  Sung-Hee Lee,et al.  Digital Image Stabilizing Algorithms Based On Bit-plane Matching , 1998, International 1998 Conference on Consumer Electronics.

[31]  Atsushi Morimura,et al.  Automatic image stabilizing system by full-digital signal processing , 1990 .

[32]  Noboru Wakami,et al.  An application of fuzzy set theory for an electronic video camera image stabilizer , 1995, IEEE Trans. Fuzzy Syst..

[33]  Mohammad Rahmati,et al.  An electronic digital image stabilizer based on stationary wavelet transform (SWT) , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[34]  T. J. Dennis,et al.  Image sequence stabilisation based on DFT filtering , 2000 .