Registration of OCT fundus images with color fundus photographs based on blood vessel ridges

This paper proposes an algorithm to register OCT fundus images (OFIs) with color fundus photographs (CFPs). This makes it possible to correlate retinal features across the different imaging modalities. Blood vessel ridges are taken as features for registration. A specially defined distance, incorporating information of normal direction of blood vessel ridge pixels, is designed to calculate the distance between each pair of pixels to be matched in the pair image. Based on this distance a similarity function between the pair image is defined. Brute force search is used for a coarse registration and then an Iterative Closest Point (ICP) algorithm for a more accurate registration. The registration algorithm was tested on a sample set containing images of both normal eyes and eyes with pathologies. Three transformation models (similarity, affine and quadratic models) were tested on all image pairs respectively. The experimental results showed that the registration algorithm worked well. The average root mean square errors for the affine model are 31 µm (normal) and 59 µm (eyes with disease). The proposed algorithm can be easily adapted to registration for other modality retinal images.

[1]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[4]  Frédéric Zana,et al.  A multimodal registration algorithm of eye fundus images using vessels detection and Hough transform , 1999, IEEE Transactions on Medical Imaging.

[5]  Robyn A. Owens,et al.  Registration of stereo and temporal images of the retina , 1999, IEEE Transactions on Medical Imaging.

[6]  Simon R. Arridge,et al.  A survey of hierarchical non-linear medical image registration , 1999, Pattern Recognit..

[7]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[8]  Langis Gagnon,et al.  Procedure to detect anatomical structures in optical fundus images , 2001, SPIE Medical Imaging.

[9]  Jiri Jan,et al.  Registration of multimodal images of retina , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[10]  Charles V. Stewart,et al.  A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Hong Shen,et al.  Frame-Rate Spatial Referencing Based on Invariant Indexing and Alignment with Application to Online Retinal Image Registration , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Chia-Ling Tsai,et al.  The dual-bootstrap iterative closest point algorithm with application to retinal image registration , 2003, IEEE Transactions on Medical Imaging.

[13]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[14]  Yulong Shen,et al.  Registration and fusion of retinal images-an evaluation study , 2003, IEEE Transactions on Medical Imaging.

[15]  George K. Matsopoulos,et al.  Multimodal registration of retinal images using self organizing maps , 2004, IEEE Transactions on Medical Imaging.

[16]  Chia-Ling Tsai,et al.  Model-based method for improving the accuracy and repeatability of estimating vascular bifurcations and crossovers from retinal fundus images , 2004, IEEE Transactions on Information Technology in Biomedicine.

[17]  Shuliang Jiao,et al.  Simultaneous acquisition of sectional and fundus ophthalmic images with spectral-domain optical coherence tomography. , 2005, Optics express.

[18]  Guoliang Fan,et al.  Hybrid retinal image registration , 2006, IEEE Transactions on Information Technology in Biomedicine.

[19]  Yasser M. Kadah,et al.  Survey of Retinal Image Segmentation and Registration , 2006 .

[20]  J. G. Flanagan,et al.  Automated Detection of the Retinal Blood Vessels and Fovea for Scanning Laser Tomography Images , 2007 .

[21]  Brandon J Lujan,et al.  Calibration of fundus images using spectral domain optical coherence tomography. , 2008, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[22]  Joseph A Izatt,et al.  CORRELATION OF PATHOLOGIC FEATURES IN SPECTRAL DOMAIN OPTICAL COHERENCE TOMOGRAPHY WITH CONVENTIONAL RETINAL STUDIES , 2008, Retina.

[23]  Yi-Ju Li,et al.  Retinal Image Registration Algorithm Based on Vessel Ridge Detection , 2008 .

[24]  Harihar Narasimha-Iyer,et al.  Registration of Cirrus HD-OCT Images With Fundus Photographs, Fluorescein Angiographs and Fundus Autofluorescence Images , 2008 .

[25]  Ying Li,et al.  Ridge-branch-based blood vessel detection algorithm for multimodal retinal images , 2009, Medical Imaging.

[26]  William J Feuer,et al.  Spectral domain optical coherence tomographic imaging of geographic atrophy. , 2008, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[27]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .