Multi-modal Image Registration Based on Modified-SURF and Consensus Inliers Recovery

Multi-modal image registration has been received significant research attention in past decades. In this paper, we proposed a solution for rigid multi-modal image registration, which focus on handling gradient reversal and region reversal problems happened in multimodal images. We also consider the common property of multi-modal images in geometric structure for feature matching. Besides the improvements in features extraction and matching step, we use a correspondences recovery step to obtain more matches, thus improving the robustness and accuracy of registration. Experiments show that the proposed method is effective.

[1]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[2]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[3]  Jie Tian,et al.  Real-time multi-modal rigid registration based on a novel symmetric-SIFT descriptor , 2009 .

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Sergio Escalera,et al.  Multi-modal RGB–Depth–Thermal Human Body Segmentation , 2016, International Journal of Computer Vision.

[6]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[7]  Parvaneh Saeedi,et al.  Robust Weighted Graph Transformation Matching for Rigid and Nonrigid Image Registration , 2012, IEEE Transactions on Image Processing.

[8]  Arturo Espinosa-Romero,et al.  A robust Graph Transformation Matching for non-rigid registration , 2009, Image Vis. Comput..

[9]  Ming Zhao,et al.  A Robust Delaunay Triangulation Matching for Multispectral/Multidate Remote Sensing Image Registration , 2015, IEEE Geoscience and Remote Sensing Letters.

[10]  Yan Yang,et al.  Rapid multimodality registration based on MM-SURF , 2014, Neurocomputing.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Qi Zhang,et al.  Multi-modal and Multi-spectral Registration for Natural Images , 2014, ECCV.

[13]  Guojun Lu,et al.  Improved Symmetric-SIFT for Multi-modal Image Registration , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[14]  Robert J. Maciunas,et al.  Registration of head CT images to physical space using a weighted combination of points and surfaces [image-guided surgery] , 1998, IEEE Transactions on Medical Imaging.