Ridge-based retinal image registration algorithm involving OCT fundus images

This paper proposes an algorithm for retinal image registration involving OCT fundus images (OFIs). The first application of the algorithm is to register OFIs with color fundus photographs; such registration between multimodal retinal images can help correlate features across imaging modalities, which is important for both clinical and research purposes. The second application is to perform the montage of several OFIs, which allows us to construct 3D OCT images over a large field of view out of separate OCT datasets. We use blood vessel ridges as registration features. The brute force search and an Iterative Closest Point (ICP) algorithm are employed for image pair registration. Global alignment to minimize the distance between matching pixel pairs is used to obtain the montage of OFIs. Quality of OFIs is the big limitation factor of the registration algorithm. In the first experiment, the effect of manual OFI enhancement on registration was evaluated for the affine model on 11 image pairs from diseased eyes. The average root mean square error (RMSE) decreases from 58 μm to 40 μm. This indicates that the registration algorithm is robust to manual enhancement. In the second experiment for the montage of OFIs, the algorithm was tested on 6 sets from healthy eyes and 6 sets from diseased eyes, each set having 8 partially overlapping SD-OCT images. Visual evaluation showed that the montage performance was acceptable for normal cases, and not good for abnormal cases due to low visibility of blood vessels. The average RMSE for a typical montage case from a healthy eye is 2.3 pixels (69 μm).

[1]  Charles V. Stewart,et al.  Covariance-driven mosaic formation from sparsely-overlapping image sets with application to retinal image mosaicing , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  Mun Wai Lee,et al.  Optimal Global Mosaic Generation from Retinal Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  Xiaodong Wu,et al.  Automated 3-D Intraretinal Layer Segmentation of Macular Spectral-Domain Optical Coherence Tomography Images , 2009, IEEE Transactions on Medical Imaging.

[4]  Xing Zhang,et al.  Salient Feature Region: A New Method for Retinal Image Registration , 2011, IEEE Transactions on Information Technology in Biomedicine.

[5]  Giovanni Gregori,et al.  Spectral domain optical coherence tomography imaging of dry age-related macular degeneration. , 2010, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[6]  Giovanni Gregori,et al.  Registration of OCT fundus images with color fundus photographs based on blood vessel ridges , 2010, Optics express.

[7]  Ying Li,et al.  Ridge-branch-based blood vessel detection algorithm for multimodal retinal images , 2009, Medical Imaging.

[8]  Haifeng Zhao,et al.  New multi-resolution image stitching with local and global alignment , 2010 .

[9]  Joseph A Izatt,et al.  CORRELATION OF PATHOLOGIC FEATURES IN SPECTRAL DOMAIN OPTICAL COHERENCE TOMOGRAPHY WITH CONVENTIONAL RETINAL STUDIES , 2008, Retina.

[10]  Arturo Espinosa-Romero,et al.  Graph-Based Methods for Retinal Mosaicing and Vascular Characterization , 2007, GbRPR.

[11]  Milan Sonka,et al.  Vessel segmentation in 3D spectral OCT scans of the retina , 2008, SPIE Medical Imaging.

[12]  Carmen A Puliafito,et al.  Automated detection of retinal layer structures on optical coherence tomography images. , 2005, Optics express.

[13]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[14]  Joseph M. Reinhardt,et al.  Retinal image mosaicing using the radial distortion correction model , 2008, SPIE Medical Imaging.

[15]  Giovanni Gregori,et al.  Registration Error Analysis of the Ridge-Based Retinal Image Registration Algorithm for Oct Fundus Images and Color Fundus Photographs , 2010 .

[16]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[17]  Charles V. Stewart,et al.  A Feature-Based Technique for Joint Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Maciej Wojtkowski,et al.  Ophthalmic imaging by spectral optical coherence tomography. , 2004, American journal of ophthalmology.

[19]  Guoliang Fan,et al.  Hybrid retinal image registration , 2006, IEEE Transactions on Information Technology in Biomedicine.

[20]  B L Trus,et al.  Constructing retinal fundus photomontages. A new computer-based method. , 1996, Investigative ophthalmology & visual science.

[21]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[22]  William J Feuer,et al.  Spectral domain optical coherence tomographic imaging of geographic atrophy. , 2008, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[23]  Chia-Ling Tsai,et al.  Registration of Challenging Image Pairs: Initialization, Estimation, and Decision , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  B. Roysam,et al.  Image processing algorithms for retinal montage synthesis, mapping, and real-time location determination , 1998, IEEE Transactions on Biomedical Engineering.

[25]  Hiroshi Ishikawa,et al.  Retinal nerve fiber layer thickness measurement comparability between time domain optical coherence tomography (OCT) and spectral domain OCT. , 2010, Investigative ophthalmology & visual science.

[26]  Harihar Narasimha-Iyer,et al.  Registration of Cirrus HD-OCT Images With Fundus Photographs, Fluorescein Angiographs and Fundus Autofluorescence Images , 2008 .

[27]  Shuliang Jiao,et al.  Simultaneous acquisition of sectional and fundus ophthalmic images with spectral-domain optical coherence tomography. , 2005, Optics express.

[28]  David L. Milgram,et al.  Computer Methods for Creating Photomosaics , 1975, IEEE Transactions on Computers.

[29]  J. van Leeuwen,et al.  Graph Based Representations in Pattern Recognition , 2003, Lecture Notes in Computer Science.

[30]  Philippe C. Cattin,et al.  Retina Mosaicing Using Local Features , 2006, MICCAI.

[31]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[32]  Charles V. Stewart,et al.  A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Philippe C. Cattin,et al.  Objective and expert-independent validation of retinal image registration algorithms by a projective imaging distortion model , 2010, Medical Image Anal..

[34]  Shijian Lu,et al.  Automated layer segmentation of optical coherence tomography images , 2010, 2010 5th IEEE Conference on Industrial Electronics and Applications.