An Automatic Image Processing Method Based on Artificial Intelligence for Locating the Key Boundary Points in the Central Serous Chorioretinopathy Lesion Area

Accurately and rapidly measuring the diameter of central serous chorioretinopathy (CSCR) lesion area is the key to judge the severity of CSCR and evaluate the efficacy of the corresponding treatments. Currently, the manual measurement scheme based on a single or a small number of optical coherence tomography (OCT) B-scan images encounters the dilemma of incredibility. Although manually measuring the diameters of all OCT B-scan images of a single patient can alleviate the previous issue, the situation of inefficiency will thus arise. Additionally, manual operation is subject to subjective factors of ophthalmologists, resulting in unrepeatable measurement results. Therefore, an automatic image processing method (i.e., a joint framework) based on artificial intelligence (AI) is innovatively proposed for locating the key boundary points of CSCR lesion area to assist the diameter measurement. Firstly, the initial location module (ILM) benefiting from multitask learning is properly adjusted and tentatively achieves the preliminary location of key boundary points. Secondly, the location task is formulated as a Markov decision process, aiming at further improving the location accuracy by utilizing the single agent reinforcement learning module (SARLM). Finally, the joint framework based on the ILM and SARLM is skillfully established, in which ILM provides an initial starting point for SARLM to narrow the active region of agent, and SARLM makes up for the defect of low generalization of ILM by virtue of the independent exploration ability of agent. Experiments reveal the AI-based method which joins the multitask learning, and single agent reinforcement learning paradigms enable agents to work in local region, alleviating the time-consuming problem of SARLM, performing location task in a global scope, and improving the location accuracy of ILM, thus reflecting its effectiveness and clinical application value in the task of rapidly and accurately measuring the diameter of CSCR lesions.

[1]  Zhipeng Yan,et al.  An intelligent location method of key boundary points for assisting the diameter measurement of central serous chorioretinopathy lesion area , 2022, Comput. Biol. Medicine.

[2]  Bo Yi Kim,et al.  Simple Code Implementation for Deep Learning–Based Segmentation to Evaluate Central Serous Chorioretinopathy in Fundus Photography , 2022, Translational vision science & technology.

[3]  Álvaro S. Hervella,et al.  End-to-end multi-task learning for simultaneous optic disc and cup segmentation and glaucoma classification in eye fundus images , 2021, Applied Soft Computing.

[4]  Eun Jeong Min,et al.  Multi-task learning based structured sparse canonical correlation analysis for brain imaging genetics , 2021, Medical Image Anal..

[5]  Taimur Hassan,et al.  Deep learning based joint segmentation and characterization of multi-class retinal fluid lesions on OCT scans for clinical use in anti-VEGF therapy , 2021, Comput. Biol. Medicine.

[6]  Marcos Ortega,et al.  Automated Segmentation of the Central Serous Chorioretinopathy fluid regions using Optical Coherence Tomography Scans , 2021, 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS).

[7]  Xin Zhao,et al.  Synergic Adversarial Label Learning for Grading Retinal Diseases via Knowledge Distillation and Multi-Task Learning , 2021, IEEE Journal of Biomedical and Health Informatics.

[8]  Zhuo Wang,et al.  Deep ensemble neural-like P systems for segmentation of central serous chorioretinopathy lesion , 2021, Inf. Fusion.

[9]  Srinivasa Rao Kundeti,et al.  Landmark Detection in 3D Medical Images Using Reinforcement Learning , 2020, 2020 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM).

[10]  Yong Xia,et al.  Deep Reinforcement Learning for Weakly-Supervised Lymph Node Segmentation in CT Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[11]  K Alsaih,et al.  Deep learning architectures analysis for age-related macular degeneration segmentation on optical coherence tomography scans , 2020, Comput. Methods Programs Biomed..

[12]  Shih-Chia Huang,et al.  DSNet: Joint Semantic Learning for Object Detection in Inclement Weather Conditions , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Hao Wei,et al.  Automated segmentation of fluid regions in optical coherence tomography B-scan images of age-related macular degeneration , 2020 .

[14]  Massimiliano Pontil,et al.  Multi-task Learning , 2020, Transfer Learning.

[15]  Jingxin Liu,et al.  Attention by Selection: A Deep Selective Attention Approach to Breast Cancer Classification , 2019, IEEE Transactions on Medical Imaging.

[16]  Jeny Rajan,et al.  Deep Learning Based Sub-Retinal Fluid Segmentation in Central Serous Chorioretinopathy Optical Coherence Tomography Scans , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Stefanos Zafeiriou,et al.  RetinaFace: Single-stage Dense Face Localisation in the Wild , 2019, ArXiv.

[18]  Marinko V Sarunic,et al.  Deep‐learning based multiclass retinal fluid segmentation and detection in optical coherence tomography images using a fully convolutional neural network , 2019, Medical Image Anal..

[19]  Loïc Le Folgoc,et al.  Evaluating reinforcement learning agents for anatomical landmark detection , 2019, Medical Image Anal..

[20]  Meng Liu,et al.  Assessment of central serous chorioretinopathy (CSC) depicted on color fundus photographs using deep Learning , 2019, ArXiv.

[21]  Dorin Comaniciu,et al.  Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Keshab K. Parhi,et al.  Fully Automated Segmentation of Fluid/Cyst Regions in Optical Coherence Tomography Images With Diabetic Macular Edema Using Neutrosophic Sets and Graph Algorithms , 2018, IEEE Transactions on Biomedical Engineering.

[23]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Hervé Delingette,et al.  Robust Non-rigid Registration Through Agent-Based Action Learning , 2017, MICCAI.

[25]  Larry S. Davis,et al.  SSH: Single Stage Headless Face Detector , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[26]  Jianping Fan,et al.  Hierarchical learning of multi-task sparse metrics for large-scale image classification , 2017, Pattern Recognit..

[27]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[28]  Taimur Hassan,et al.  Fully Automated Robust System to Detect Retinal Edema, Central Serous Chorioretinopathy, and Age Related Macular Degeneration from Optical Coherence Tomography Images , 2017, BioMed research international.

[29]  Serge J. Belongie,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Taimur Hassan,et al.  Automated diagnosis of macular edema and central serous retinopathy through robust reconstruction of 3D retinal surfaces , 2016, Comput. Methods Programs Biomed..

[31]  Dorin Comaniciu,et al.  An Artificial Agent for Robust Image Registration , 2016, AAAI.

[32]  Dorin Comaniciu,et al.  An Artificial Agent for Anatomical Landmark Detection in Medical Images , 2016, MICCAI.

[33]  Jelena Novosel,et al.  Locally-adaptive loosely-coupled level sets for retinal layer and fluid segmentation in subjects with central serous retinopathy , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Tom Schaul,et al.  Dueling Network Architectures for Deep Reinforcement Learning , 2015, ICML.

[36]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[37]  Min Zhao,et al.  Central serous chorioretinopathy: Recent findings and new physiopathology hypothesis , 2015, Progress in Retinal and Eye Research.

[38]  Milan Sonka,et al.  Stratified Sampling Voxel Classification for Segmentation of Intraretinal and Subretinal Fluid in Longitudinal Clinical OCT Data , 2015, IEEE Transactions on Medical Imaging.

[39]  Marc G. Bellemare,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[40]  J. Jonas,et al.  Optical coherence tomography-assisted enhanced depth imaging of central serous chorioretinopathy. , 2013, Investigative ophthalmology & visual science.

[41]  Hado van Hasselt,et al.  Double Q-learning , 2010, NIPS.

[42]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[43]  P. Dayan,et al.  Q-learning , 1992, Machine Learning.

[44]  Hyunjin Park,et al.  Automatic Subretinal Fluid Segmentation of Retinal SD-OCT Images With Neurosensory Retinal Detachment Guided by Enface Fundus Imaging , 2018, IEEE Transactions on Biomedical Engineering.

[45]  Hubert P. H. Shum,et al.  Northumbria Research , 2022 .