Automatic Registration of Multisensor Images Using an Integrated Spatial and Mutual Information (SMI) Metric

A new image-registration method is presented by integrating the area-based and feature-based methods. The integrated method is characterized by a novel similarity metric based on spatial and mutual information (SMI), the ant colony optimization for continuous domain (ACO\BBR), and a two-phase searching strategy. The SMI-based metric takes into account both spatial relations of detected features [spatial information (SI)] and the mutual information (MI) between the reference and sensed images. The spatial relation is to derive a fast transformation of the near global optimum without specifying the initial searching range. The MI is to obtain an optimal transformation with high accuracy. ACO \BBR is adopted to optimize SMI for the first time in this paper, as the function of SMI is generally non-convex and irregular. In addition, a two-phase searching strategy is designed to improve the performance of ACO\BBR. Phase-1 only considers the SI and finds some low-accurate solutions. Phase-2 considers both SI and MI so it is to search for a more accurate solution. These two phases are switched according to the diversity of the solutions. The proposed integrated method has been tested using the remote-sensing images acquired from different sensors, including TM, SPOT, and SAR. The experimental results indicate that the SMI-based metric is more robust than the conventional metrics which consider SI or MI alone. This method is able to achieve a highly accurate automatic registration of multisensor images.

[1]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[2]  Azriel Rosenfeld,et al.  Point pattern matching by relaxation , 1980, Pattern Recognit..

[3]  Lin Liu,et al.  An Innovative Method to Classify Remote-Sensing Images Using Ant Colony Optimization , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Marios S. Pattichis,et al.  Robust Multispectral Image Registration Using Mutual-Information Models , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jacqueline Le Moigne,et al.  Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient , 2003, IEEE Trans. Image Process..

[6]  Siamak Khorram,et al.  The effects of image misregistration on the accuracy of remotely sensed change detection , 1998, IEEE Trans. Geosci. Remote. Sens..

[7]  Pramod K. Varshney,et al.  Mutual information-based CT-MR brain image registration using generalized partial volume joint histogram estimation , 2003, IEEE Transactions on Medical Imaging.

[8]  H. Ghorbani,et al.  Multiresolution registration of multitemporal remote sensing images by optimization of mutual information using a simulated annealing based Marquardt-Levenberg technique , 2007, 2007 International Conference on Intelligent and Advanced Systems.

[9]  P Kovesi,et al.  Phase congruency: A low-level image invariant , 2000, Psychological research.

[10]  Fawwaz T. Ulaby,et al.  Mutual information based registration of SAR images , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[11]  Ardeshir Goshtasby,et al.  A Region-Based Approach to Digital Image Registration with Subpixel Accuracy , 1986, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[13]  Max A. Viergever,et al.  Interpolation Artefacts in Mutual Information-Based Image Registration , 2000, Comput. Vis. Image Underst..

[14]  Qian Ma,et al.  Feature-based nonrigid image registration using a Hausdorff distance matching measure , 2007 .

[15]  Michel Defrise,et al.  Symmetric Phase-Only Matched Filtering of Fourier-Mellin Transforms for Image Registration and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Gong-Jian Wen,et al.  A High-Performance Feature-Matching Method for Image Registration by Combining Spatial and Similarity Information , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Xiaohu Zhang,et al.  Determining Class Proportions Within a Pixel Using a New Mixed-Label Analysis Method , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[20]  Jan Flusser,et al.  A moment-based approach to registration of images with affine geometric distortion , 1994, IEEE Trans. Geosci. Remote. Sens..

[21]  Ram M. Narayanan,et al.  Data Level Fusion of Multilook Inverse Synthetic Aperture Radar (ISAR) Images , 2006, 35th IEEE Applied Imagery and Pattern Recognition Workshop (AIPR'06).

[22]  R. Hartley.  Transmission of information , 1928 .

[23]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jacqueline Le Moigne,et al.  Mutual information as a similarity measure for remote sensing image registration , 2001, SPIE Defense + Commercial Sensing.

[25]  David A. Clausi,et al.  ARRSI: Automatic Registration of Remote-Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[27]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[28]  R. L. Bolus,et al.  Delineation of 1993 Midwest flooding using ERS-1 SAR, SPOT and Landsat imagery , 1994, Proceedings of IGARSS '94 - 1994 IEEE International Geoscience and Remote Sensing Symposium.

[29]  Jubai An,et al.  A Simple and Robust Feature Point Matching Algorithm Based on Restricted Spatial Order Constraints for Aerial Image Registration , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Raimondo Schettini,et al.  Image registration by recognition of corresponding structures , 1990 .

[31]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .

[32]  Amir Averbuch,et al.  Implicit similarity: a new approach to multi-sensor image registration , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[33]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  N. Hanaizumi,et al.  An automated method for registration of satellite remote sensing images , 1993, Proceedings of IGARSS '93 - IEEE International Geoscience and Remote Sensing Symposium.

[35]  Josip Krapac,et al.  Infrared-Visual Image Registration Based on Corners and Hausdorff Distance , 2007, SCIA.

[36]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[37]  Ram M. Narayanan,et al.  Data-Level Fusion of Multilook Inverse Synthetic Aperture Radar Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[39]  Mohamed S. Kamel,et al.  Multi-resolution image registration using multi-class Hausdorff fraction , 2004 .

[40]  Rasmus K. Ursem,et al.  Diversity-Guided Evolutionary Algorithms , 2002, PPSN.

[41]  B. S. Manjunath,et al.  A contour-based approach to multisensor image registration , 1995, IEEE Trans. Image Process..

[42]  Pramod K. Varshney,et al.  Performance of mutual information similarity measure for registration of multitemporal remote sensing images , 2003, IEEE Trans. Geosci. Remote. Sens..

[43]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[44]  T. Guneriussen,et al.  Application of ERS-1 SAR data in combination with Landsat and SPOT data for forestry mapping in a Norwegian forest region , 1993, Proceedings of IGARSS '93 - IEEE International Geoscience and Remote Sensing Symposium.

[45]  Peter Kovesi,et al.  Phase Congruency Detects Corners and Edges , 2003, DICTA.

[46]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[48]  Guo-Qiang Han,et al.  Image registration based on generalized and mean Hausdorff distances , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[49]  Laurence C. Smith,et al.  Automated Image Registration Based on Pseudoinvariant Metrics of Dynamic Land-Surface Features , 2008, IEEE Transactions on Geoscience and Remote Sensing.