Improved Symmetric-SIFT for Multi-modal Image Registration

Multi-modal image registration has received significant research attention over the past decade. Symmetric-SIFT is a recently proposed local description technique that can be used for registering multi-modal images. It is based on a well-known general image registration technique named Scale Invariant Feature Transform (SIFT). Symmetric-SIFT, however, achieves this invariance to multi-modality at the cost of losing important information. In this paper, we show how this loss may adversely affect the accuracy of registration results. We then propose an improvement to Symmetric-SIFT to overcome the problem. Our experimental results show that the proposed technique can improve the number of true matches by up to 10 times and overall matching accuracy by up to 30%.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Sabine Süsstrunk,et al.  Illuminant estimation and detection using near-infrared , 2009, Electronic Imaging.

[3]  Jong Beom Ra,et al.  Multi-sensor image registration based on intensity and edge orientation information , 2008, Pattern Recognit..

[4]  Ghassan Hamarneh,et al.  N-Sift: N-Dimensional Scale Invariant Feature Transform for Matching Medical Images , 2007, ISBI.

[5]  Jeff Orchard.  Efficient Least Squares Multimodal Registration With a Globally Exhaustive Alignment Search , 2007, IEEE Transactions on Image Processing.

[6]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[7]  Rui Ma,et al.  MI-SIFT: mirror and inversion invariant generalization for SIFT descriptor , 2010, CIVR '10.

[8]  Chia-Ling Tsai,et al.  Registration of Challenging Image Pairs: Initialization, Estimation, and Decision , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[10]  Max A. Viergever,et al.  Image registration by maximization of combined mutual information and gradient information , 2000, IEEE Transactions on Medical Imaging.

[11]  Li Yuan-yuan.  A SURVEY OF MEDICAL IMAGE REGISTRATION , 2006 .

[12]  Jie Tian,et al.  Real-time multi-modal rigid registration based on a novel symmetric-SIFT descriptor , 2009 .

[13]  Charles V. Stewart,et al.  Keypoint Descriptors for Matching Across Multiple Image Modalities and Non-linear Intensity Variations , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[15]  Carlo Tomasi,et al.  Image Similarity Using Mutual Information of Regions , 2004, ECCV.

[16]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Guy Marchal,et al.  3D Multi-Modality Medical Image Registration Using Feature Space Clustering , 1995, CVRMed.