A High-Performance Feature-Matching Method for Image Registration by Combining Spatial and Similarity Information

A crucial problem that involves feature-based image registration algorithms is how to reliably establish the correspondence between the features detected in the sensed image and those detected in the reference image. Generally, most existing methods only use spatial relations or feature similarity, or a simple combination of them, to solve this problem, and all have some limitations. In this paper, a new feature-matching strategy is developed. It is realized by introducing a function whose independent variable is the match matrix, which describes the correspondence of the features, to combine spatial relations and organically feature similarity, and its global maximum is assumed to be reached if the sensed image is completely aligned with the reference image. Thus, the feature correspondence can be estimated by finding the maximum of the function. Two approaches are devised to solve the optimization problem. One is based on the branch-and-bound strategy to yield a global optimal solution, and the other uses an iterative algorithm that combines graduated assignment and variable metric methods to search for a local optimal solution with low computational complexity. The proposed method can work without the limitations of feature type, similarity criterion, and transform model, and its performance is evaluated using a variety of real images. Compared with some existing methods, it is fast and robust, and has the highest accuracy.

[1]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[2]  Pramod K. Varshney,et al.  Performance of mutual information similarity measure for registration of multitemporal remote sensing images , 2003, IEEE Trans. Geosci. Remote. Sens..

[3]  A. Ardeshir Goshtasby,et al.  2-D and 3-D Image Registration: for Medical, Remote Sensing, and Industrial Applications , 2005 .

[4]  Eric Mjolsness,et al.  New Algorithms for 2D and 3D Point Matching: Pose Estimation and Correspondence , 1998, NIPS.

[5]  Mohamed Batouche,et al.  A fully automatic method for feature-based image registration , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[6]  Jacqueline Le Moigne,et al.  Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient , 2003, IEEE Trans. Image Process..

[7]  Ian Dowman,et al.  An improved model for automatic feature-based registration of SAR and SPOT images , 2001 .

[8]  Siamak Khorram,et al.  A feature-based image registration algorithm using improved chain-code representation combined with invariant moments , 1999, IEEE Trans. Geosci. Remote. Sens..

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Taejung Kim,et al.  Automatic satellite image registration by combination of matching and random sample consensus , 2003, IEEE Trans. Geosci. Remote. Sens..

[11]  B. S. Manjunath,et al.  Registration Techniques for Multisensor Remotely Sensed Imagery , 1996 .

[12]  Gongjian Wen,et al.  A GLOBAL OPTIMAL REGISTRATION METHOD FOR SATELLITE REMOTE SENSING IMAGES , 2002 .

[13]  Jan Flusser,et al.  A moment-based approach to registration of images with affine geometric distortion , 1994, IEEE Trans. Geosci. Remote. Sens..

[14]  Jan Flusser Object matching by means of matching likelihood coefficients , 1995, Pattern Recognit. Lett..

[15]  Michel Balinski,et al.  Integer Programming: Methods, Uses, Computation , 2010, 50 Years of Integer Programming.

[16]  W. Press,et al.  Numerical Recipes in C++: The Art of Scientific Computing (2nd edn)1 Numerical Recipes Example Book (C++) (2nd edn)2 Numerical Recipes Multi-Language Code CD ROM with LINUX or UNIX Single-Screen License Revised Version3 , 2003 .

[17]  Amir Averbuch,et al.  Multisensor image registration via implicit similarity , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Michel Balinski,et al.  Integer Programming: Methods, Uses, Computations , 1965 .

[19]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[20]  Jordi Inglada,et al.  Similarity measures for multisensor remote sensing images , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[21]  Kidiyo Kpalma,et al.  An automatic image registration for applications in remote sensing , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[23]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[24]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  A. Ardeshir Goshtasby,et al.  Point pattern matching using convex hull edges , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[26]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[27]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  George C. Stockman,et al.  Matching Images to Models for Registration and Object Detection via Clustering , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[30]  Yun He,et al.  A generalized divergence measure for robust image registration , 2003, IEEE Trans. Signal Process..

[31]  L. Van Gool,et al.  A GENERIC APPROACH TO IMAGE CO-REGISTRATION , 2006 .