Alignment of challenging image pairs: Refinement and region growing starting from a single keypoint correspondence

Our goal is a registration algorithm capable of aligning image pairs having some combination of low overlap, large illumination differences (e.g. day and night), substantial scene changes and different modalities. Our approach starts by extracting and matching keypoints. Rankedordered matches are tested individually in succession. Each is used to generate a transformation estimate in a small image region surrounding the keypoints. The growth process works by iterating three steps: 1) refining the estimate by symmetrically matching features on the two images, 2) expanding the region according to the uncertainty in the mapping, 3) selecting an appropriate transformation model. Image features are corner points and face points located by analyzing the intensity structure of image neighborhoods. After convergence, if a correctness test verifies the transformation it is accepted and the algorithm ends; otherwise the process starts over with the next keypoint match. Experimental results on a suite of challenging image pairs shows that the algorithm substantially out-performs recent algorithms based on keypoint matching.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[3]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[5]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[6]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[7]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[8]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[9]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[10]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[11]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[12]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Harpreet S. Sawhney,et al.  Robust Video Mosaicing through Topology Inference and Local to Global Alignment , 1998, ECCV.

[14]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.