A Robust Block-Based Image/Video Registration Approach for Mobile Imaging Devices

Digital video stabilization enables to acquire video sequences without disturbing jerkiness by compensating unwanted camera movements. In this paper, we propose a novel fast image registration algorithm based on block matching. Unreliable motion vectors (i.e., not related with jitter movements) are properly filtered out by making use of ad-hoc rules taking into account local similarity, local “activity,” and matching effectiveness. Moreover, a temporal analysis of the relative error computed at each frame has been performed. Reliable information is then used to retrieve inter-frame transformation parameters. Experiments on real cases confirm the effectiveness of the proposed approach even in critical conditions.

[1]  K. Ratakonda.  Real-time digital video stabilization for multi-media applications , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[2]  Dmitriy Vatolin,et al.  Low Complexity Global Motion Estimation from Block Motion Vectors , 2006 .

[3]  Cordelia Schmid,et al.  Selection of scale-invariant parts for object class recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Alberto Del Bimbo,et al.  Encyclopedia of Multimedia , 2006 .

[5]  Sebastiano Battiato,et al.  Video Stabilization , 2008, Encyclopedia of Multimedia.

[6]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[7]  Hugo Jiménez-Hernández,et al.  Dynamic Selection of Characteristics for Feature Based Image Sequence Stabilization , 2008, ACIVS.

[8]  Sebastiano Battiato,et al.  A robust video stabilization system by adaptive motion vectors filtering , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[9]  Gianni Vernazza,et al.  Image stabilization algorithms for video-surveillance applications , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[10]  Joonki Paik,et al.  Video Stabilization Using Kalman Filter and Phase Correlation Matching , 2005, ICIAR.

[11]  Marius Tico,et al.  Method of Motion Estimation for Image Stabilization , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[12]  Rastislav Lukac,et al.  Single-Sensor Imaging: Methods and Applications for Digital Cameras , 2008 .

[13]  T. J. Dennis,et al.  Image sequence stabilisation based on DFT filtering , 2000 .

[14]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Natasha Gelfand,et al.  Viewfinder Alignment , 2008, Comput. Graph. Forum.

[16]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[17]  Cordelia Schmid,et al.  Indexing Based on Scale Invariant Interest Points , 2001, ICCV.

[18]  Bing-Yu Chen,et al.  Video stabilization using robust feature trajectories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[21]  Andrew Zisserman,et al.  Feature Based Methods for Structure and Motion Estimation , 1999, Workshop on Vision Algorithms.

[22]  Emiliano Mario Piccinelli,et al.  An innovative, high quality and search window independent motion estimation algorithm and architecture for MPEG-2 encoding , 2000, 2000 Digest of Technical Papers. International Conference on Consumer Electronics. Nineteenth in the Series (Cat. No.00CH37102).

[23]  P. Anandan,et al.  About Direct Methods , 1999, Workshop on Vision Algorithms.

[24]  Aziz Umit Batur,et al.  Video Stabilization with Optimized Motion Estimation Resolution , 2006, 2006 International Conference on Image Processing.

[25]  Seok-Woo Jang,et al.  Adaptive robust estimation of affine parameters from block motion vectors , 2005, Image Vis. Comput..

[26]  Sebastiano Battiato,et al.  SIFT Features Tracking for Video Stabilization , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[27]  Yu-Chun Peng,et al.  Integration of Digital Stabilizer With Video Codec for Digital Video Cameras , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Venkatesh Saligrama,et al.  Motion detection with an unstable camera , 2008, 2008 15th IEEE International Conference on Image Processing.

[29]  Luc Van Gool,et al.  Simultaneous Object Recognition and Segmentation by Image Exploration , 2004, ECCV.

[30]  Sebastiano Battiato,et al.  Periodic Pattern Detection for Real-Time Application , 2009, WILF.

[31]  Narciso García Santos,et al.  Automatic Feature-Based Stabilization of Video with Intentional Motion through a Particle Filter , 2009, ACIVS 2009.

[32]  Sebastiano Battiato,et al.  Digital video stabilization through curve warping techniques , 2008, IEEE Transactions on Consumer Electronics.

[33]  James J. Little,et al.  Global localization using distinctive visual features , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  I. Du,et al.  Direct Methods , 1998 .

[35]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[36]  Rama Chellappa,et al.  Stabilization and Mosaicing of Airborne Videos , 2006, 2006 International Conference on Image Processing.

[37]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[38]  Filippo Vella,et al.  Digital image stabilization by adaptive block motion vectors filtering , 2002, IEEE Trans. Consumer Electron..

[39]  Sebastiano Battiato,et al.  Regular texture removal for video stabilization , 2008, 2008 19th International Conference on Pattern Recognition.

[40]  Ki-Sang Hong,et al.  Affine Motion Based CMOS Distortion Analysis and CMOS Digital Image Stabilization , 2007, IEEE Transactions on Consumer Electronics.

[41]  Janne Heikkilä,et al.  Global motion estimation using block matching with uncertainty analysis , 2007, 2007 15th European Signal Processing Conference.

[42]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[43]  Andrew Zisserman,et al.  Multi-view Matching for Unordered Image Sets, or "How Do I Organize My Holiday Snaps?" , 2002, ECCV.

[44]  Dan Schonfeld,et al.  Online Video Stabilization Based on Particle Filters , 2006, 2006 International Conference on Image Processing.