Applicability of the SIFT operator to geometric SAR image registration

The SIFT operator's success for computer vision applications makes it an attractive alternative to the intricate feature based SAR image registration problem. The SIFT operator processing chain is capable of detecting and matching scale and affine invariant features. For SAR images, the operator is expected to detect stable features at lower scales where speckle influence diminishes. To adapt the operator performance to SAR images we analyse the impact of image filtering and of skipping features detected at the highest scales. We present our analysis based on multisensor, multitemporal and different viewpoint SAR images. The operator shows potential to become a robust alternative for point feature based registration of SAR images as subpixel registration consistency was achieved for most of the tested datasets. Our findings indicate that operator performance in terms of repeatability and matching capability is affected by an increase in acquisition differences within the imagery. We also show that the proposed adaptations result in a significant speed-up compared to the original SIFT operator.

[1]  M. Berthod,et al.  ERS SAR interferometry: an operational evaluation of the DTM production , 1997, IGARSS'97. 1997 IEEE International Geoscience and Remote Sensing Symposium Proceedings. Remote Sensing - A Scientific Vision for Sustainable Development.

[2]  M. Younis,et al.  The TanDEM-X mission: A satellite formation for high-resolution SAR interferometry , 2007, 2007 European Radar Conference.

[3]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[4]  A. Lopes,et al.  A statistical and geometrical edge detector for SAR images , 1988 .

[5]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Jordi Inglada,et al.  On the possibility of automatic multisensor image registration , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Hua-mei Chen,et al.  Mutual Information: A Similarity Measure for Intensity Based Image Registration , 2004 .

[8]  B. S. Manjunath,et al.  A contour-based approach to multisensor image registration , 1995, IEEE Trans. Image Process..

[9]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[10]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[11]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[12]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Sylvie Le Hégarat-Mascle,et al.  Soil moisture estimation from ERS/SAR data: toward an operational methodology , 2002, IEEE Trans. Geosci. Remote. Sens..

[14]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[15]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[16]  Tony Lindeberg,et al.  Shape-Adapted Smoothing in Estimation of 3-D Depth Cues from Affine Distortions of Local 2-D Brightness Structure , 1994, ECCV.

[17]  Pramod K. Varshney,et al.  MI Based Registration of Multi-Sensor and Multi-Temporal Images , 2004 .

[18]  Cordelia Schmid,et al.  Indexing Based on Scale Invariant Interest Points , 2001, ICCV.

[19]  A. Roth.  TerraSAR-X: a new perspective for scientific use of high resolution spaceborne SAR data , 2003, 2003 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas.

[20]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[21]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[22]  Jean-Marie Nicolas,et al.  Matching criteria for radargrammetry , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[23]  Pramod K. Varshney,et al.  Mutual information-based image registration for remote sensing data , 2003 .

[24]  A. Roth,et al.  TerraSAR-X SAR products and processing algorithms , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[25]  Jennifer L. Dungan,et al.  Forest variable estimation from fusion of SAR and multispectral optical data , 2002, IEEE Trans. Geosci. Remote. Sens..

[26]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[27]  Marc Acheroy,et al.  Hierarchical approach for registration of high-resolution polarimetric SAR images , 2002, SPIE Remote Sensing.

[28]  P. Reinartz,et al.  Estimation of along-track velocity of road vehicles in SAR data , 2005, SPIE Remote Sensing.

[29]  Peter Reinartz,et al.  Radar signatures of road vehicles: airborne SAR experiments , 2005, SPIE Remote Sensing.

[30]  Alan C. Bovik,et al.  On detecting edges in speckle imagery , 1988, IEEE Trans. Acoust. Speech Signal Process..

[31]  James J. Little,et al.  Vision-based mobile robot localization and mapping using scale-invariant features , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[32]  Jun Shen,et al.  An optimal linear operator for step edge detection , 1992, CVGIP Graph. Model. Image Process..

[33]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[34]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Peter Reinartz,et al.  Application of generalized partial volume estimation for mutual information based registration of high resolution SAR and optical imagery , 2008, 2008 11th International Conference on Information Fusion.

[36]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[37]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[38]  Hui.  A Contour-Based Approach to Multisensor Image Registration , 1995 .

[39]  Kidiyo Kpalma,et al.  An automatic image registration for applications in remote sensing , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[42]  Kostas Papathanassiou,et al.  Overview of interferometric data acquisition and processing modes of the experimental airborne SAR system of DLR , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[43]  Tony Lindeberg,et al.  Shape-adapted smoothing in estimation of 3-D shape cues from affine deformations of local 2-D brightness structure , 1997, Image Vis. Comput..