Space Independent Image Registration Using Curve-Based Method with Combination of Multiple Deformable Vector Fields

This paper proposes a novel curve-based or edge-based image registration technique that utilizes the curve transformation function and Gaussian function. It enables deformable image registration between images in different spaces, e.g., different color spaces or different medical image modalities. In particular, piecewise polynomial fitting is used to fit a curve and convert it to the global cubic B-spline control points. The transformation between the curves in the reference and source images are performed by using these control points. The image area is segmented with respect to the reference curve for the moving pixels. The Gaussian function, which is symmetric about the coordinates of the points of the reference curve, was used to improve the continuity in the intra- and inter-segmented areas. The overall result on curve transformation by means of the Hausdroff distance was 5.820 ± 1.127 pixels on average on several 512 × 512 synthetic images. The proposed method was compared with an ImageJ plugin, namely bUnwarpJ, and a software suite for deformable image registration and adaptive radiotherapy research, namely DIRART, to evaluate the image registration performance. The experimental result shows that the proposed method yielded better image registration performance than its counterparts. On average, the proposed method could reduce the root mean square error from 2970.66 before registration to 1677.94 after registration and can increase the normalized cross-correlation coefficient from 91.87% before registration to 97.40% after registration.

[1]  Michael Unser,et al.  Elastic registration of biological images using vector-spline regularization , 2005, IEEE Transactions on Biomedical Engineering.

[2]  Ning Ge,et al.  Fast Remote-Sensing Image Registration Using Priori Information and Robust Feature Extraction , 2016 .

[3]  Michael Brady,et al.  MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration , 2012, Medical Image Anal..

[4]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[5]  Lorenzo Bruzzone,et al.  Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Ya Su,et al.  Symmetric Face Normalization , 2019, Symmetry.

[7]  Jinxiang Dong,et al.  A New Curves-Based Local Image Registration Method , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[8]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Sebastian Kurtek,et al.  A new curves-based method for adaptive multimodal registration , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[10]  Yong Li,et al.  Multimodal Image Registration With Line Segments by Selective Search , 2017, IEEE Transactions on Cybernetics.

[11]  Andrea Cavallaro,et al.  Robust Registration of Dynamic Facial Sequences , 2017, IEEE Transactions on Image Processing.

[12]  Zhihai He,et al.  Multimodal Medical Image Registration Based on Feature Spheres in Geometric Algebra , 2018, IEEE Access.

[13]  Jerry L. Prince,et al.  MIND Demons: Symmetric Diffeomorphic Deformable Registration of MR and CT for Image-Guided Spine Surgery , 2016, IEEE Transactions on Medical Imaging.

[14]  Michael Unser,et al.  Splines: A perfect fit for signal processing , 2000, 2000 10th European Signal Processing Conference.

[15]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Hemant D. Tagare,et al.  Why Does Mutual-Information Work for Image Registration? A Deterministic Explanation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Qolamreza R. Razlighi,et al.  Spatial Mutual Information as Similarity Measure for 3-D Brain Image Registration , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[18]  B. S. Manjunath,et al.  Registration of 3-D multimodality brain images by curve matching , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[19]  Jamshid Shanbehzadeh,et al.  An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors , 2013, EURASIP J. Image Video Process..

[20]  Tianzi Jiang,et al.  Fingerprint registration by maximization of mutual information , 2006, IEEE Transactions on Image Processing.

[21]  Bede Liu,et al.  Image registration by "Super-curves" , 2004, IEEE Transactions on Image Processing.

[22]  B. Denis de Senneville,et al.  EVolution: an edge-based variational method for non-rigid multi-modal image registration , 2016, Physics in medicine and biology.

[23]  Sansanee Auephanwiriyakul,et al.  Automatic cervical cell segmentation and classification in Pap smears , 2014, Comput. Methods Programs Biomed..

[24]  Han Yan,et al.  Exploring the Utilization of Gradient Information in SIFT Based Local Image Descriptors , 2019, Symmetry.

[25]  Sasa Mutic,et al.  Technical note: DIRART--A software suite for deformable image registration and adaptive radiotherapy research. , 2011, Medical physics.

[26]  Qingwu Hu,et al.  Robust Feature Matching for Remote Sensing Image Registration Based on $L_{q}$ -Estimator , 2016, IEEE Geoscience and Remote Sensing Letters.

[27]  Dan Wu,et al.  3D MRI image super-resolution for brain combining rigid and large diffeomorphic registration , 2017, IET Image Process..