Retinal image mosaicking using scale-invariant feature transformation feature descriptors and Voronoi diagram

Abstract. Purpose: Peripheral retinal lesions substantially increase the risk of diabetic retinopathy and retinopathy of prematurity. The peripheral changes can be visualized in wide field imaging, which is obtained by combining multiple images with an overlapping field of view using mosaicking methods. However, a robust and accurate registration of mosaicking techniques for normal angle fundus cameras is still a challenge due to the random selection of matching points and execution time. We propose a method of retinal image mosaicking based on scale-invariant feature transformation (SIFT) feature descriptor and Voronoi diagram. Approach: In our method, the SIFT algorithm is used to describe local features in the input images. Then the input images are subdivided into regions based on the Voronoi method. Each pair of Voronoi regions is matched by the method zero mean normalized cross correlation. After matching, the retinal images are mapped into the same coordinate system to form a mosaic image. The success rate and the mean registration error (RE) of our method were compared with those of other state-of-the-art methods for the P category of the fundus image registration database. Results: Experimental results show that the proposed method accurately registered 42% of retinal image pairs with a mean RE of 3.040 pixels, while a lower success rate was observed in the other four state-of-the-art retinal image registration methods GDB-ICP (33%), Harris-PIIFD (0%), HM-2016 (0%), and HM-2017 (2%). Conclusions: The proposed method outperforms state-of-the-art methods in terms of quality and running time and reduces the computational complexity.

[1]  Jayant V. Kulkarni,et al.  Orthogonal moments for determining correspondence between vessel bifurcations for retinal image registration , 2015, Comput. Methods Programs Biomed..

[2]  Jiang Liu,et al.  A Robust Outlier Elimination Approach for Multimodal Retina Image Registration , 2015, MICCAI.

[3]  Robert Laganière,et al.  A fast and robust homography scheme for real-time planar target detection , 2018, Journal of Real-Time Image Processing.

[4]  Jirí Jan,et al.  Retinal image analysis aimed at blood vessel tree segmentation and early detection of neural-layer deterioration , 2012, Comput. Medical Imaging Graph..

[5]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[6]  Yu Huang,et al.  Mosaic-based figure-ground segmentation along with static segmentation by mean shift , 2007, SIP.

[7]  Antonis A. Argyros,et al.  Retinal image registration based on keypoint correspondences, spherical eye modeling and camera pose estimation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[9]  Alfred Mertins,et al.  Segmentation of retinal vessels with a hysteresis binary-classification paradigm , 2012, Comput. Medical Imaging Graph..

[10]  Sajib Saha,et al.  A Two-Step Approach for Longitudinal Registration of Retinal Images , 2016, Journal of Medical Systems.

[11]  Antonis A. Argyros,et al.  Retinal image preprocessing, enhancement, and registration , 2019, Computational Retinal Image Analysis.

[12]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[13]  Damber Thapa,et al.  Trans-palpebral illumination: an approach for wide-angle fundus photography without the need for pupil dilation. , 2016, Optics letters.

[14]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[15]  Antonis A. Argyros,et al.  Retinal image registration through simultaneous camera pose and eye shape estimation , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  A. V. Cideciyan,et al.  Registration of ocular fundus images: an algorithm using cross-correlation of triple invariant image descriptors , 1995 .

[17]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[18]  Dongbo Zhang,et al.  Blood Bifurcation Structure and Global to Local Strategy Based Retinal Image Registration , 2012, CCPR.

[19]  Yan Dong,et al.  Automatic Registration Based on Improved SIFT for Medical Microscopic Sequence Images , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[20]  Guoliang Fan,et al.  Hybrid retinal image registration , 2006, IEEE Transactions on Information Technology in Biomedicine.

[21]  Jun Huang,et al.  Retinal image registration via feature-guided Gaussian mixture model. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  Jing Tian,et al.  Retinal image registration using topological vascular tree segmentation and bifurcation structures , 2015, Biomed. Signal Process. Control..

[23]  Jun Zhu,et al.  Image Mosaic Method Based on SIFT Features of Line Segment , 2014, Comput. Math. Methods Medicine.

[24]  Gang Wang,et al.  Robust point matching method for multimodal retinal image registration , 2015, Biomed. Signal Process. Control..

[25]  Richard Szeliski,et al.  Fast Poisson blending using multi-splines , 2011, 2011 IEEE International Conference on Computational Photography (ICCP).

[26]  Robert C. Bolles,et al.  A RANSAC-Based Approach to Model Fitting and Its Application to Finding Cylinders in Range Data , 1981, IJCAI.

[27]  Yoshinori Dobashi,et al.  A Method for Creating Mosaic Images Using Voronoi Diagrams , 2002, Eurographics.

[28]  Aziz Baataoui,et al.  Image mosaicing using voronoi diagram , 2016, Multimedia Tools and Applications.

[29]  Chia-Ling Tsai,et al.  Registration of Challenging Image Pairs: Initialization, Estimation, and Decision , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Kun Zhang,et al.  Retinal image automatic registration based on local bifurcation structure , 2016, 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[31]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[32]  Colin Archibald,et al.  Research in Computer and Robot Vision , 1995 .

[33]  Mark Fisher,et al.  Retinal vessel segmentation using multi-scale textons derived from keypoints , 2015, Comput. Medical Imaging Graph..

[34]  Qiao Hu,et al.  Automated construction of arterial and venous trees in retinal images , 2015, Journal of medical imaging.

[35]  Antonis A. Argyros,et al.  FIRE: Fundus Image Registration dataset , 2017 .

[36]  Tien-Tsin Wong,et al.  Volumetric Ultrasound Panorama Based on 3D SIFT , 2008, MICCAI.

[37]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[38]  Antonis A. Argyros,et al.  An experimental evaluation of the accuracy of keypoints-based retinal image registration , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[39]  Stephen J. McKenna,et al.  RERBEE: Robust Efficient Registration via Bifurcations and Elongated Elements Applied to Retinal Fluorescein Angiogram Sequences , 2012, IEEE Transactions on Medical Imaging.

[40]  D. Mordant,et al.  Non-contact ultra-widefield imaging of retinopathy of prematurity using the Optos dual wavelength scanning laser ophthalmoscope , 2013, Eye.

[41]  Ruhina Karani,et al.  Image Registration using Discrete Cosine Transform and Normalized Cross Correlation , 2012 .

[42]  Mohd Yamani Idna Idris,et al.  Feature-Based Retinal Image Registration Using D-Saddle Feature , 2017, Journal of healthcare engineering.