SIFT optimization and automation for matching images from multiple temporal sources

Abstract Scale Invariant Feature Transformation (SIFT) was applied to extract tie-points from multiple source images. Although SIFT is reported to perform reliably under widely different radiometric and geometric conditions, using the default input parameters resulted in too few points being found. We found that the best solution was to focus on large features as these are more robust and not prone to scene changes over time, which constitutes a first approach to the automation of processes using mapping applications such as geometric correction, creation of orthophotos and 3D models generation. The optimization of five key SIFT parameters is proposed as a way of increasing the number of correct matches; the performance of SIFT is explored in different images and parameter values, finding optimization values which are corroborated using different validation imagery. The results show that the optimization model improves the performance of SIFT in correlating multitemporal images captured from different sources.

[1]  Ghassan Hamarneh,et al.  N-Sift: N-Dimensional Scale Invariant Feature Transform for Matching Medical Images , 2007, ISBI.

[2]  Somsak Kittipiyakul,et al.  Wireless Mesh Networking with XBee , 2010 .

[3]  Javier Ortega-Garcia,et al.  Iris recognition based on SIFT features , 2004, 2009 First IEEE International Conference on Biometrics, Identity and Security (BIdS).

[4]  Fabio Remondino.  DETECTORS AND DESCRIPTORS FOR PHOTOGRAMMETRIC APPLICATIONS , 2006 .

[5]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[6]  Charles R. Farrar,et al.  A different approach to sensor networking for shm: Remote powering and interrogation with unmanned aerial vehicles , 2007 .

[7]  Sharath Pankanti,et al.  Fingerprint verification using SIFT features , 2008, SPIE Defense + Commercial Sensing.

[8]  Shin'ichi Satoh,et al.  BIG-OH: BInarization of gradient orientation histograms , 2014, Image Vis. Comput..

[9]  Yiding Wang,et al.  SIFT Based Automatic Tie-Point Extraction for Multitemporal SAR Images , 2008, 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing.

[10]  Andrea Lagorio,et al.  On the Use of SIFT Features for Face Authentication , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Achim Roth,et al.  Registration of Near Real-time SAR Images by Image-to-Image Matching , 2007 .

[13]  M.S. Nixon,et al.  On Model-Based Analysis of Ear Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[14]  Z. Yi,et al.  Multi-spectral remote image registration based on SIFT , 2008 .

[15]  Qiushi Zhao,et al.  A SIFT-based contactless palmprint verification approach using iterative RANSAC and local palmprint descriptors , 2014, Pattern Recognit..

[16]  F. Neitzel,et al.  Mobile 3d Mapping with a Low-Cost Uav System , 2012 .

[17]  Junichi Susaki,et al.  Automatic GCP Extraction of Fully Polarimetric SAR Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Javier Ruiz-del-Solar,et al.  A comparative study of thermal face recognition methods in unconstrained environments , 2012, Pattern Recognit..

[19]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[20]  Emanuele Frontoni,et al.  A Vision-Based Guidance System for UAV Navigation and Safe Landing using Natural Landmarks , 2010, J. Intell. Robotic Syst..

[21]  Alison Brown,et al.  High Accuracy Autonomous Image Georeferencing Using a GPS/Inertial-Aided Digital Imaging System , 2002 .

[22]  Javier Ortega-Garcia,et al.  Iris recognition based on SIFT features , 2009, 2009 First IEEE International Conference on Biometrics, Identity and Security (BIdS).

[23]  Bernd Girod,et al.  Mobile Visual Search , 2011, IEEE Signal Processing Magazine.

[24]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[25]  May Michael,et al.  Object Recognition from Infra Red image data for Mobile Platforms: Scale Invariant Feature Transform - A Graphical Parameter Analysis , 2010, BMVC 2010.

[26]  Rongrong Ji,et al.  A new camera self-calibration method based on CSA , 2013, 2013 Visual Communications and Image Processing (VCIP).

[27]  Krishnaprasad Jagadish,et al.  Image Matching Using High Dynamic Range Images and Radial Feature Descriptors , 2008, ISVC.

[28]  J. Gonçalves,et al.  UAV photogrammetry for topographic monitoring of coastal areas , 2015 .

[29]  Aleksandra Anna Sima,et al.  Optimizing SIFT for Matching of Short Wave Infrared and Visible Wavelength Images , 2013, Remote. Sens..

[30]  Dieter Schmalstieg,et al.  Pose tracking from natural features on mobile phones , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[31]  Niels Henze,et al.  What is That? Object Recognition from Natural Features on a Mobile Phone , 2009 .

[32]  Sebastiano Battiato,et al.  SIFT Features Tracking for Video Stabilization , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[33]  Cong Geng,et al.  Face recognition based on the multi-scale local image structures , 2011, Pattern Recognit..

[34]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[35]  Massimo Tistarelli,et al.  Feature Level Fusion of Face and Fingerprint Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[36]  Jianjiang Feng,et al.  Combining minutiae descriptors for fingerprint matching , 2008, Pattern Recognit..

[37]  Xin Chen,et al.  City-scale landmark identification on mobile devices , 2011, CVPR 2011.

[38]  Davide Marenchino,et al.  Performance Analysis of the SIFT Operator for Automatic Feature Extraction and Matching in Photogrammetric Applications , 2009, Sensors.

[39]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[40]  Enrico Grosso,et al.  Face Identification by SIFT-based Complete Graph Topology , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[41]  Christian Heipke,et al.  Automation of interior, relative, and absolute orientation , 1997 .