Motion Compensation Based on Robust Global Motion Estimation: Experiments and Applications

A robust and general method for image alignment is proposed in this paper. The industrial constraints are the possible large and irregular camera motion, some possible occlusions or moving objects in the images and some blur or motion blur. Images are taken from an Unmanned Aerial Vehicle or a long-range camera. Given this context, a similarity transformation is estimated. An hybrid algorithm is proposed, implemented in a pyramidal way, and combining direct and feature-based approaches. Some detailed experiments in this paper show the robustness and efficiency of the proposed algorithm. Results of some applications of this method are given, like image stabilisation, image mosaicing and road surveillance.

[1]  Sarp Erturk,et al.  Real-Time Digital Image Stabilization Using Kalman Filters , 2002 .

[2]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[3]  Elie Inaty,et al.  A Robust Edge-Based Corner Detector (EBCD) , 2014, Int. J. Image Graph..

[4]  Frédéric Dufaux,et al.  Efficient, robust, and fast global motion estimation for video coding , 2000, IEEE Trans. Image Process..

[5]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[6]  Federico Tombari,et al.  ZNCC-based template matching using bounded partial correlation , 2004 .

[7]  Kamel Bouchefra,et al.  Temporally optimized edge segmentation for mobile robotics applications , 2005, SPIE Optics + Photonics.

[8]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[11]  Yasser Almehio,et al.  Matching Images Using Invariant Level-line Primitives under Projective Transformation , 2010, 2010 Canadian Conference on Computer and Robot Vision.

[12]  Patrick Bonnin,et al.  Moving targets detection from UAV based on a robust real-time image registration algorithm , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[13]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[14]  Luc Pronzato,et al.  A Minimum-Entropy Procedure for Robust Motion Estimation , 2006, 2006 International Conference on Image Processing.

[15]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[16]  Alois Knoll,et al.  Efficient compositional approaches for real-time robust direct visual odometry from RGB-D data , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Selim Benhimane,et al.  Real-time image-based tracking of planes using efficient second-order minimization , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  J. Odobez,et al.  Separation of Moving Regions from Background in an Image Sequence Acquired with a Mobil Camera , 1997 .

[19]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[20]  Nassir Navab,et al.  A real-time tracking system combining template-based and feature-based approaches , 2007, VISAPP.