Deep ensemble neural-like P systems for segmentation of central serous chorioretinopathy lesion

Abstract Automatic segmentation of the central serous chorioretinopathy (CSC) lesion and its related ellipsoid zone from the Bruch membrane (EZ-BM) areas is important in the early diagnosis and treatment of retinopathy to prevent vision loss. However, the large variations in the locations and shapes of the CSC lesion, as well as the low contrast of EZ-BM areas with their surroundings make the segmentation task challenging. To address these challenges, in this paper, we propose a new parallel neural-like P system named the deep ensemble neural-like (DEN) P system, which combines the strengths of spiking neural P systems (SN P systems) and deep convolutional neural networks (CNNs) for more accurate and efficient segmentation of CSC lesion and the related EZ-BM areas. The DEN P system establishes three modules with new rules and neuron architectures, which is implemented end-to-end in neurons. Specifically, we propose an ensemble fully convolutional network (FCN) module to train several FCNs with different initializations to obtain effective features, which leverage the strength of ensemble learning in a DEN P system. Benefiting from the parallelism of DEN P systems, FCNs are conducted in different neurons simultaneously. To achieve efficient classification, we propose a multiloss module with three different loss functions to alleviate DEN P system falling into a single-loss function. Different losses are also conducted in different neurons parallelly. To further enhance the performance, we introduce a coarse-fine compensation module to correct detection errors. Being a parallel computational paradigm, DEN P systems are less time consuming, completing CSC lesion and EZ-BM areas on 1,280 images in 0.04 s with an average dice ratio of 0 . 93 ± 0 . 04 and 0 . 95 ± 0 . 02 , respectively. Moreover, the ablation study shows that the proposed modules are critical for effective learning. The extension and generalization of the DEN P systems are also investigated .

[1]  Ehsan Adeli,et al.  3-D Fully Convolutional Networks for Multimodal Isointense Infant Brain Image Segmentation , 2019, IEEE Transactions on Cybernetics.

[2]  Xiyu Liu,et al.  Unsupervised Segmentation of Choroidal Neovascularization for Optical Coherence Tomography Angiography by Grid Tissue-Like Membrane Systems , 2019, IEEE Access.

[3]  Xiyu Liu,et al.  Deep membrane systems for multitask segmentation in diabetic retinopathy , 2019, Knowl. Based Syst..

[4]  Shuicheng Yan,et al.  Multi-loss Regularized Deep Neural Network , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Sue S Yom,et al.  Randomized phase III trial of concurrent accelerated radiation plus cisplatin with or without cetuximab for stage III to IV head and neck carcinoma: RTOG 0522. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[6]  Yading Yuan,et al.  Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance , 2017, IEEE Transactions on Medical Imaging.

[7]  Qi Meng,et al.  A hybrid approach based on differential evolution and tissue membrane systems for solving constrained manufacturing parameter optimization problems , 2013, Appl. Soft Comput..

[8]  Il Hong Suh,et al.  Dynamic multi-objective optimization based on membrane computing for control of time-varying unstable plants , 2011, Inf. Sci..

[9]  Qiang Wu,et al.  Automatic Choroid Layer Segmentation from Optical Coherence Tomography Images Using Deep Learning , 2019, Scientific Reports.

[10]  J. Donald,et al.  Pathogenesis of Disciform Detachment of the Neuroepithelium: III. Senile Disciform Macular Degeneration , 1967 .

[11]  Peter A. Calabresi,et al.  Towards Topological Correct Segmentation of Macular OCT from Cascaded FCNs , 2017, FIFI/OMIA@MICCAI.

[12]  Hyunjin Park,et al.  Three-dimensional continuous max flow optimization-based serous retinal detachment segmentation in SD-OCT for central serous chorioretinopathy. , 2017, Biomedical optics express.

[13]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[14]  Xinjian Chen,et al.  Three-Dimensional Segmentation of Fluid-Associated Abnormalities in Retinal OCT: Probability Constrained Graph-Search-Graph-Cut , 2012, IEEE Transactions on Medical Imaging.

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[16]  Gheorghe Paun,et al.  Computing with Membranes , 2000, J. Comput. Syst. Sci..

[17]  Sim Heng Ong,et al.  Integrating spatial fuzzy clustering with level set methods for automated medical image segmentation , 2011, Comput. Biol. Medicine.

[18]  Andreas Spanias,et al.  Optimizing Kernel Machines Using Deep Learning , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Xiyu Liu,et al.  Lattice based communication P systems with applications in cluster analysis , 2013, Soft Computing.

[20]  S. M. Riazul Islam,et al.  A smart healthcare monitoring system for heart disease prediction based on ensemble deep learning and feature fusion , 2020, Inf. Fusion.

[21]  Hong Peng,et al.  Multiobjective fuzzy clustering approach based on tissue-like membrane systems , 2017, Knowl. Based Syst..

[22]  Alireza Mehridehnavi,et al.  Macular OCT Classification Using a Multi-Scale Convolutional Neural Network Ensemble , 2018, IEEE Transactions on Medical Imaging.

[23]  Mirza Faisal Beg,et al.  Retinal Fluid Segmentation and Detection in Optical Coherence Tomography Images using Fully Convolutional Neural Network , 2017, ArXiv.

[24]  Oscar H. Ibarra,et al.  On spiking neural P systems , 2006, Natural Computing.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Sander M. Bohte,et al.  Editorial: Artificial Neural Networks as Models of Neural Information Processing , 2017, Front. Comput. Neurosci..

[27]  Hong Peng,et al.  Fuzzy reasoning spiking neural P system for fault diagnosis , 2013, Inf. Sci..

[28]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[29]  Hong Peng,et al.  Coupled Neural P Systems , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Elankovan Sundararajan,et al.  Using graphics processing unit to accelerate simulation of membrane computing , 2017, 2017 6th International Conference on Electrical Engineering and Informatics (ICEEI).

[31]  J. Fujimoto,et al.  Optical Coherence Tomography , 1991 .

[32]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[33]  Stuart J. Gibson,et al.  Cystoid macular edema segmentation of Optical Coherence Tomography images using fully convolutional neural networks and fully connected CRFs , 2017, ArXiv.

[34]  Hyunjin Park,et al.  Automatic Subretinal Fluid Segmentation of Retinal SD-OCT Images With Neurosensory Retinal Detachment Guided by Enface Fundus Imaging , 2018, IEEE Transactions on Biomedical Engineering.

[35]  Thomas Theelen,et al.  Robust total retina thickness segmentation in optical coherence tomography images using convolutional neural networks. , 2017, Biomedical optics express.

[36]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[37]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[38]  László G. Nyúl,et al.  An Approach to the Quantitative Assessment of Retinal Layer Distortions and Subretinal Fluid in SD-OCT Images , 2017, Acta Cybern..

[39]  Yilong Yin,et al.  Choroid segmentation from Optical Coherence Tomography with graph-edge weights learned from deep convolutional neural networks , 2017, Neurocomputing.

[40]  Frcs,et al.  Central Serous Chorioretinopathy , 2012 .

[41]  Yue Wu,et al.  Deep-Learning Based, Automated Segmentation of Macular Edema in Optical Coherence Tomography , 2017, bioRxiv.