Multi-stage segmentation of the fovea in retinal fundus images using fully Convolutional Neural Networks

The fovea is one of the most important anatomical landmarks in the eye and its localization is required in automated analysis of retinal diseases due to its role in sharp central vision. In this paper, we propose a two-stage deep learning framework for accurate segmentation of the fovea in retinal colour fundus images. In the first stage, coarse segmentation is performed to localize the fovea in the fundus image. The location information from the first stage is then used to perform fine-grained segmentation of the fovea region in the second stage. The proposed method performs end-to-end pixelwise segmentation by creating a deep learning model based on fully convolutional neural networks, which does not require the prior knowledge of the location of other retinal structures such as optic disc (OD) and vasculature geometry. We demonstrate the effectiveness of our method on a dataset with 400 retinal images with average localization error of 14 ± 7 pixels.

[1]  Jordi Pont-Tuset,et al.  Supervised Evaluation of Image Segmentation and Object Proposal Techniques , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Shyr-Shen Yu,et al.  A Novel Scheme for the Fovea Localization on Retinal Images , 2014, 2014 International Symposium on Computer, Consumer and Control.

[3]  Charles V. Stewart,et al.  Robust detection and classification of longitudinal changes in color retinal fundus images for monitoring diabetic retinopathy , 2006, IEEE Transactions on Biomedical Engineering.

[4]  Bram van Ginneken,et al.  Fast detection of the optic disc and fovea in color fundus photographs , 2009, Medical Image Anal..

[5]  J. Winder,et al.  Identification of lesion components that influence visual function in age related macular degeneration , 2003, The British journal of ophthalmology.

[6]  Dwarikanath Mahapatra,et al.  Segmentation of Optic Disc and Optic Cup in Retinal Fundus Images Using Coupled Shape Regression , 2016 .

[7]  Huazhu Fu,et al.  Retinal vessel segmentation via deep learning network and fully-connected conditional random fields , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[8]  Dwarikanath Mahapatra,et al.  Segmentation of optic disc and optic cup in retinal fundus images using shape regression , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[11]  M. Mainster,et al.  Visual acuity related to retinal distance from the fovea in macular disease. , 1984, Annals of ophthalmology.

[12]  Jiang Liu,et al.  Using deep learning for robustness to parapapillary atrophy in optic disc segmentation , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[13]  Bram van Ginneken,et al.  Segmentation of the Optic Disc, Macula and Vascular Arch in Fundus Photographs , 2007, IEEE Transactions on Medical Imaging.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.