Automated Layer Segmentation of Retinal Optical Coherence Tomography Images Using a Deep Feature Enhanced Structured Random Forests Classifier

Optical coherence tomography (OCT) is a high-resolution and noninvasive imaging modality that has become one of the most prevalent techniques for ophthalmic diagnosis. Retinal layer segmentation is very crucial for doctors to diagnose and study retinal diseases. However, manual segmentation is often a time-consuming and subjective process. In this work, we propose a new method for automatically segmenting retinal OCT images, which integrates deep features and hand-designed features to train a structured random forests classifier. The deep convolutional features are learned from deep residual network. With the trained classifier, we can get the contour probability graph of each layer; finally, the shortest path is employed to achieve the final layer segmentation. The experimental results show that our method achieves good results with the mean layer contour error of 1.215 pixels, whereas that of the state of the art was 1.464 pixels, and achieves an F1-score of 0.885, which is also better than 0.863 that is obtained by the state of the art method.

[1]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  Jelena Novosel,et al.  Loosely coupled level sets for simultaneous 3D retinal layer segmentation in optical coherence tomography , 2015, Medical Image Anal..

[4]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[5]  Yaozong Gao,et al.  Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model , 2016, IEEE Transactions on Medical Imaging.

[6]  Xinjian Chen,et al.  Automated 3-D Retinal Layer Segmentation of Macular Optical Coherence Tomography Images With Serous Pigment Epithelial Detachments , 2015, IEEE Transactions on Medical Imaging.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.

[9]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[10]  Kathleen M. Robinette,et al.  Gender Recognition Using 3-D Human Body Shapes , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[12]  Aaron Carass,et al.  Multiple-object geometric deformable model for segmentation of macular OCT. , 2014, Biomedical optics express.

[13]  Xiaoming Liu,et al.  Patch-based denoising method using low-rank technique and targeted database for optical coherence tomography image , 2017, Journal of medical imaging.

[14]  Pascal A. Dufour,et al.  Graph-Based Multi-Surface Segmentation of OCT Data Using Trained Hard and Soft Constraints , 2013, IEEE Transactions on Medical Imaging.

[15]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[16]  Scott T. Acton,et al.  Surface extraction and thickness measurement of the articular cartilage from MR images using directional gradient vector flow snakes , 2006, IEEE Transactions on Biomedical Engineering.

[17]  Joseph A. Izatt,et al.  Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation , 2010, Optics express.

[18]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Srilaxmi Bearelly,et al.  The external limiting membrane in early-onset Stargardt disease. , 2014, Investigative ophthalmology & visual science.

[20]  Peter Kontschieder,et al.  Structured class-labels in random forests for semantic image labelling , 2011, 2011 International Conference on Computer Vision.

[21]  C. Lawrence Zitnick,et al.  Fast Edge Detection Using Structured Forests , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[23]  Jyotirmoy Chatterjee,et al.  Learning layer-specific edges for segmenting retinal layers with large deformations. , 2016, Biomedical optics express.

[24]  Weisi Lin,et al.  Cross-Examination for Angle-Closure Glaucoma Feature Detection , 2016, IEEE Journal of Biomedical and Health Informatics.

[25]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[26]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Alexander Wong,et al.  Intra-retinal layer segmentation in optical coherence tomography images. , 2009, Optics express.

[28]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[29]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[30]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[32]  Camille Couprie,et al.  Semantic Segmentation using Adversarial Networks , 2016, NIPS 2016.

[33]  Xiaoming Liu,et al.  Automated segmentation of nine retinal layers with layer thickness information on SD-OCT images , 2016, International Conference on Digital Image Processing.

[34]  K. A. Vermeer,et al.  Automated segmentation by pixel classification of retinal layers in ophthalmic OCT images , 2011, Biomedical optics express.

[35]  Jing Tian,et al.  Performance evaluation of automated segmentation software on optical coherence tomography volume data , 2016, Journal of biophotonics.

[36]  Ya Xing Wang,et al.  Automatic Choroidal Layer Segmentation Using Markov Random Field and Level Set Method , 2017, IEEE Journal of Biomedical and Health Informatics.

[37]  Wolfgang Drexler,et al.  State-of-the-art retinal optical coherence tomography , 2008, Progress in Retinal and Eye Research.

[38]  Marios Anthimopoulos,et al.  Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[39]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[40]  Mannudeep K. Kalra,et al.  Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN) , 2017, ArXiv.

[41]  Hye Jin Lee,et al.  Detection of glaucoma progression by assessment of segmented macular thickness data obtained using spectral domain optical coherence tomography. , 2012, Investigative ophthalmology & visual science.

[42]  Scott T. Acton,et al.  Vessel boundary tracking for intravital microscopy via multiscale gradient vector flow snakes , 2004, IEEE Transactions on Biomedical Engineering.

[43]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[44]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Donald C Hood,et al.  Quantification of peripapillary sparing and macular involvement in Stargardt disease (STGD1). , 2011, Investigative ophthalmology & visual science.

[46]  Xinjian Chen,et al.  Three-Dimensional Segmentation of Fluid-Associated Abnormalities in Retinal OCT: Probability Constrained Graph-Search-Graph-Cut , 2012, IEEE Transactions on Medical Imaging.

[47]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[48]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[49]  Sina Farsiu,et al.  Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. , 2015, Biomedical optics express.

[50]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[51]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[52]  Sina Farsiu,et al.  Length-adaptive graph search for automatic segmentation of pathological features in optical coherence tomography images , 2016, Journal of biomedical optics.

[53]  Xiaodong Wu,et al.  Automated 3-D Intraretinal Layer Segmentation of Macular Spectral-Domain Optical Coherence Tomography Images , 2009, IEEE Transactions on Medical Imaging.

[54]  F. Medeiros,et al.  Evaluation of retinal nerve fiber layer, optic nerve head, and macular thickness measurements for glaucoma detection using optical coherence tomography. , 2005, American journal of ophthalmology.

[55]  W. Freeman,et al.  OPTICAL COHERENCE TOMOGRAPHY-RASTER SCANNING AND MANUAL SEGMENTATION IN DETERMINING DRUSEN VOLUME IN AGE-RELATED MACULAR DEGENERATION , 2010, Retina.

[56]  Xiaoming Liu,et al.  Mass Classification in Mammograms Using Selected Geometry and Texture Features, and a New SVM-Based Feature Selection Method , 2014, IEEE Systems Journal.

[57]  G. Ripandelli,et al.  Optical coherence tomography. , 1998, Seminars in ophthalmology.

[58]  Bram van Ginneken,et al.  Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[59]  Dong Liu,et al.  A deep convolutional feature based learning layer-specific edges method for segmenting OCT image , 2017, International Conference on Digital Image Processing.

[60]  Milan Sonka,et al.  Intra-retinal layer segmentation of 3D optical coherence tomography using coarse grained diffusion map , 2012, Medical Image Anal..

[61]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[62]  Xiaoming Liu,et al.  Fluid region segmentation in OCT images based on convolution neural network , 2017, International Conference on Digital Image Processing.