Monocular Retinal Depth Estimation and Joint Optic Disc and Cup Segmentation using Adversarial Networks

One of the important parameters for the assessment of glaucoma is optic nerve head (ONH) evaluation, which usually involves depth estimation and subsequent optic disc and cup boundary extraction. Depth is usually obtained explicitly from imaging modalities like optical coherence tomography (OCT) and is very challenging to estimate depth from a single RGB image. To this end, we propose a novel method using adversarial network to predict depth map from a single image. The proposed depth estimation technique is trained and evaluated using individual retinal images from INSPIRE-stereo dataset. We obtain a very high average correlation coefficient of 0.92 upon five fold cross validation outperforming the state of the art. We then use the depth estimation process as a proxy task for joint optic disc and cup segmentation.

[1]  Andrew Hunter,et al.  Optic nerve head segmentation , 2004, IEEE Transactions on Medical Imaging.

[2]  Keerthi Ram,et al.  Fully Convolutional Networks for Monocular Retinal Depth Estimation and Optic Disc-Cup Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[3]  Tien Yin Wong,et al.  Superpixel Classification Based Optic Disc and Optic Cup Segmentation for Glaucoma Screening , 2013, IEEE Transactions on Medical Imaging.

[4]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Mona Kathryn Garvin,et al.  Robust Multiscale Stereo Matching from Fundus Images with Radiometric Differences , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  James C. Gee,et al.  Optic Disc and Cup Segmentation from Color Fundus Photograph Using Graph Cut with Priors , 2013, MICCAI.

[7]  Juan Xu,et al.  Optic disk feature extraction via modified deformable model technique for glaucoma analysis , 2007, Pattern Recognit..

[8]  Joachim M. Buhmann,et al.  Glaucoma detection using entropy sampling and ensemble learning for automatic optic cup and disc segmentation , 2017, Comput. Medical Imaging Graph..

[9]  Jayanthi Sivaswamy,et al.  Joint optic disc and cup boundary extraction from monocular fundus images , 2017, Comput. Methods Programs Biomed..

[10]  Manuel Emilio Gegúndez-Arias,et al.  Detecting the Optic Disc Boundary in Digital Fundus Images Using Morphological, Edge Detection, and Feature Extraction Techniques , 2010, IEEE Transactions on Medical Imaging.

[11]  Rob Fergus,et al.  Depth Map Prediction from a Single Image using a Multi-Scale Deep Network , 2014, NIPS.

[12]  Jayanthi Sivaswamy,et al.  Coupled Sparse Dictionary for Depth-Based Cup Segmentation from Single Color Fundus Image , 2014, MICCAI.

[13]  Guosheng Lin,et al.  Deep convolutional neural fields for depth estimation from a single image , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Jayanthi Sivaswamy,et al.  Optic Disk and Cup Segmentation From Monocular Color Retinal Images for Glaucoma Assessment , 2011, IEEE Transactions on Medical Imaging.

[15]  Kaamran Raahemifar,et al.  Optic Disc and Optic Cup Segmentation Methodologies for Glaucoma Image Detection: A Survey , 2015, Journal of ophthalmology.

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.