Fully automatic quantification of individual ganglion cells from AO-OCT volumes via weakly supervised learning

Quantitative features of individual ganglion cells (GCs) are potential paradigm changing biomarkers for improved diagnosis and treatment monitoring of GC loss in neurodegenerative diseases like glaucoma and Alzheimer’s disease. The recent incorporation of adaptive optics (AO) with extremely fast and high-resolution optical coherence tomography (OCT) allows visualization of GC layer (GCL) somas in volumetric scans of the living human eye. The current standard approach for quantification – manual marking of AO-OCT volumes – is subjective, time consuming, and not practical for large scale studies. Thus, there is a need to develop an automatic technique for rapid, high throughput, and objective quantification of GC morphological properties. In this work, we present the first fully automatic method for counting and measuring GCL soma diameter in AO-OCT volumes. Aside from novelty in application, our proposed deep learningbased algorithm is novel with respect to network architecture. Also, previous deep learning OCT segmentation algorithms used pixel-level annotation masks for supervised learning. Instead in this work, we use weakly supervised training, which requires significantly less human input in curating the training set for the deep learning algorithm, as our training data is only associated with coarse-grained labels. Our automatic method achieved a high level of accuracy in counting GCL somas, which was on par with human performance yet orders of magnitude faster. Moreover, our automatic method’s measure of soma diameters was in line with previous histological and in vivo semi-automatic measurement studies. These results suggest that our algorithm may eventually replace the costly and time-consuming manual marking process in future studies.

[1]  Jianfei Liu,et al.  Cone Photoreceptor Cell Segmentation and Diameter Measurement on Adaptive Optics Images Using Circularly Constrained Active Contour Model , 2018, Investigative ophthalmology & visual science.

[2]  Robert J Zawadzki,et al.  Review of adaptive optics OCT (AO-OCT): principles and applications for retinal imaging [Invited]. , 2017, Biomedical optics express.

[3]  Donald T. Miller,et al.  Imaging and quantifying ganglion cells and other transparent neurons in the living human retina , 2017, Proceedings of the National Academy of Sciences.

[4]  David Alonso-Caneiro,et al.  Automatic segmentation of OCT retinal boundaries using recurrent neural networks and graph search. , 2018, Biomedical optics express.

[5]  Myeong Jin Ju,et al.  Automated identification of cone photoreceptors in adaptive optics optical coherence tomography images using transfer learning. , 2018, Biomedical optics express.

[6]  W. Drexler,et al.  Adaptive optics optical coherence tomography at 120,000 depth scans/s for non-invasive cellular phenotyping of the living human retina. , 2009, Optics express.

[7]  Sina Farsiu,et al.  Deep learning based detection of cone photoreceptors with multimodal adaptive optics scanning light ophthalmoscope images of achromatopsia. , 2018, Biomedical optics express.

[8]  Austin Roorda,et al.  Automated identification of cone photoreceptors in adaptive optics retinal images. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Suha Kwak,et al.  Learning Pixel-Level Semantic Affinity with Image-Level Supervision for Weakly Supervised Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Lisanne J. Balk,et al.  Ganglion cell layer measurements correlate with disease severity in patients with Alzheimer's disease. , 2016 .

[11]  Sebastien Ourselin,et al.  Automatic Cone Photoreceptor Localisation in Healthy and Stargardt Afflicted Retinas Using Deep Learning , 2018, Scientific Reports.

[12]  Daniel X. Hammer,et al.  Trans-retinal cellular imaging with multimodal adaptive optics , 2018, Biomedical optics express.

[13]  C. Curcio,et al.  Topography of ganglion cells in human retina , 1990, The Journal of comparative neurology.

[14]  Francesco Viola,et al.  The loss of macular ganglion cells begins from the early stages of disease and correlates with brain atrophy in multiple sclerosis patients , 2019, Multiple sclerosis.

[15]  Robert J. Zawadzki,et al.  Retinal AO OCT , 2015 .

[16]  Kazuhiro Kurokawa,et al.  Combined hardware and computational optical wavefront correction. , 2018, Biomedical optics express.

[17]  Sina Farsiu,et al.  Automatic detection of cone photoreceptors in split detector adaptive optics scanning light ophthalmoscope images , 2016, Biomedical optics express.

[18]  Jennifer J. Hunter,et al.  Imaging individual neurons in the retinal ganglion cell layer of the living eye , 2017, Proceedings of the National Academy of Sciences.

[19]  Ravi Yadav,et al.  Optical coherence tomography as a tool to evaluate retinal changes in Parkinson's disease. , 2015, Parkinsonism & related disorders.

[20]  Peyman Milanfar,et al.  Statistical Models of Signal and Noise and Fundamental Limits of Segmentation Accuracy in Retinal Optical Coherence Tomography , 2018, IEEE Transactions on Medical Imaging.

[21]  Nathan Doble,et al.  Inner Retinal Changes in Primary Open-Angle Glaucoma Revealed Through Adaptive Optics-Optical Coherence Tomography , 2018, Journal of glaucoma.

[22]  J. Stone,et al.  The topography of primate retina: A study of the human, bushbaby, and new‐ and old‐world monkeys , 1981, The Journal of comparative neurology.

[23]  Sina Farsiu,et al.  Deep longitudinal transfer learning-based automatic segmentation of photoreceptor ellipsoid zone defects on optical coherence tomography images of macular telangiectasia type 2 , 2018, Biomedical optics express.

[24]  Elena Garcia-Martin,et al.  Ganglion cell layer measurements correlate with disease severity in patients with Alzheimer's disease , 2016, Acta ophthalmologica.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  R. W. Rodieck,et al.  Parasol and midget ganglion cells of the human retina , 1985, The Journal of comparative neurology.

[27]  David Alonso-Caneiro,et al.  Automatic Detection of Cone Photoreceptors With Fully Convolutional Networks , 2019, Translational vision science & technology.

[28]  Omer P. Kocaoglu,et al.  A Review of Adaptive Optics Optical Coherence Tomography: Technical Advances, Scientific Applications, and the Future , 2016, Investigative ophthalmology & visual science.

[29]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.

[30]  Mitrofanis Pavlidis,et al.  MORPHOMETRIC EXAMINATION OF HUMAN AND MONKEY RETINAL GANGLION CELLS WITHIN THE PAPILLOMACULAR AREA , 2006, Retina.

[31]  Yuri Boykov,et al.  Normalized Cut Loss for Weakly-Supervised CNN Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Sina Farsiu,et al.  Open source software for automatic detection of cone photoreceptors in adaptive optics ophthalmoscopy using convolutional neural networks , 2017, Scientific Reports.

[33]  Gozde Sahin,et al.  Ganglion Cell–Inner Plexiform Layer Thickness in Patients With Parkinson Disease and Association With Disease Severity and Duration , 2014, Journal of neuro-ophthalmology : the official journal of the North American Neuro-Ophthalmology Society.

[34]  Raed Alroughani,et al.  Optical coherence tomography segmentation analysis in relapsing remitting versus progressive multiple sclerosis , 2017, PloS one.

[35]  Joseph A. Izatt,et al.  Automatic cone photoreceptor segmentation using graph theory and dynamic programming , 2013, Biomedical optics express.

[36]  Donald T. Miller,et al.  Cone photoreceptor classification in the living human eye from photostimulation-induced phase dynamics , 2019, Proceedings of the National Academy of Sciences.

[37]  T. Wong,et al.  Spectral-Domain OCT Measurements in Alzheimer's Disease: A Systematic Review and Meta-analysis. , 2019, Ophthalmology.

[38]  Sina Farsiu,et al.  RAC-CNN: multimodal deep learning based automatic detection and classification of rod and cone photoreceptors in adaptive optics scanning light ophthalmoscope images. , 2019, Biomedical optics express.