Image registration among UAV image sequence and Google satellite image under quality mismatch

In this paper, we developed an Unmanned Aerial Vehicle (UAV) image registration system consisting of UAV image to UAV image registration, UAV image to Google satellite image registration, and registration refinement with a normalized variant of mutual information for quality mismatch problem. We show the limitation of the conventional mutual information for quality mismatch and then suggest using a normalized variant of mutual information to refine registration between UAV image and Google satellite image. Experiments carried out on the realistic UAV image sequence and Google satellite image show that the developed system could provide better UAV-to-satellite image registration and could conquer the quality mismatch problem.

[1]  Quanfu Fan,et al.  Robust Spatiotemporal Matching of Electronic Slides to Presentation Videos , 2011, IEEE Transactions on Image Processing.

[2]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[3]  Gérard G. Medioni,et al.  Map-Enhanced UAV Image Sequence Registration , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[4]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[5]  Sunglok Choi,et al.  Performance Evaluation of RANSAC Family , 2009, BMVC.

[6]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[7]  Gérard G. Medioni,et al.  Map-Enhanced UAV Image Sequence Registration and Synchronization of Multiple Image Sequences , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[10]  Xavier Binefa,et al.  DLIG: Direct Local Indirect Global Alignment for Video Mosaicing , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[12]  François Deschênes,et al.  Image mosaicing using local optical flow registration , 2008, 2008 19th International Conference on Pattern Recognition.