3D Reconstruction and Registration for Retinal Image Pairs

Structure analysis of the optic-nerve head (ONH) and retinal image registration are important for diagnosing eye diseases. Thus, a 3D reconstruction method and a retinal image registration method are proposed in this paper. The former reconstruction method exploits disparity map estimation as a depth cue to disambiguate the relative positions and then uses the guided filter to obtain the final depth map. Using the depth map, a red-cyan anaglyph can be computed and the 3D structure of the ONH can be reconstructed. The latter registration method exploits and establishes the vasculature relationship between retinal images as a mosaic cue to be used for feature extraction and matching, and then divides the vessel segmentation image into four quadrants and obtains the Grid-based Motion Statistics (GMS) feature correspondence technique for each region. Using the regional GMS feature correspondence, the transformation parameters can be accurately identified and a good registration result can be ensured. Experiment results demonstrate the benefit of the proposed reconstruction and registration method.

[1]  Mona Kathryn Garvin,et al.  3D reconstruction of the optic nerve head using stereo fundus images for computer-aided diagnosis of glaucoma , 2010, Medical Imaging.

[2]  Robert Ritch,et al.  The ISNT rule and differentiation of normal from glaucomatous eyes. , 2006, Archives of ophthalmology.

[3]  Xin Zhao,et al.  Automatic Retinal Image Registration Using Blood Vessel Segmentation and SIFT Feature , 2017, Int. J. Pattern Recognit. Artif. Intell..

[4]  Michael H. Goldbaum,et al.  Locating the optic nerve in a retinal image using the fuzzy convergence of the blood vessels , 2003, IEEE Transactions on Medical Imaging.

[5]  Tomaso Poggio,et al.  Cooperative computation of stereo disparity , 1988 .

[6]  Yang-Ming Zhu,et al.  A Java program for stereo retinal image visualization , 2007, Comput. Methods Programs Biomed..

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  J. Fujimoto,et al.  Optical coherence tomography: A new tool for glaucoma diagnosis , 1995, Current opinion in ophthalmology.

[9]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[10]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Antonios Gasteratos,et al.  Review of Stereo Vision Algorithms: From Software to Hardware , 2008 .

[12]  Yang Xiang,et al.  Retinal image registration using bifurcation structures , 2011, 2011 18th IEEE International Conference on Image Processing.

[13]  Yasuyuki Matsushita,et al.  GMS: Grid-Based Motion Statistics for Fast, Ultra-robust Feature Correspondence , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Bostjan Likar,et al.  Enhancement of Vascular Structures in 3D and 2D Angiographic Images , 2016, IEEE Transactions on Medical Imaging.