Deep-reinforcement-learning-based images segmentation for quantitative analysis of gold immunochromatographic strip

Abstract Gold immunochromatographic strip (GICS) is a widely used lateral flow immunoassay technique. A novel image segmentation method is developed in this paper for quantitative analysis of GICS based on the deep reinforcement learning (DRL), which can accurately distinguish the test line and the control line in the GICS images. The deep belief network (DBN) is employed in the deep Q network in our DRL algorithm. Meanwhile, the multi-factor learning curve is introduced in the DRL algorithm to dynamically adjust the capacity of the replay buffer and the sampling size, which leads to enhanced learning efficiency. It is worth mentioning that the states, actions, and rewards in the developed DRL algorithm are determined based on the characteristics of GICS images. Experiment results demonstrate the feasibility and reliability of the proposed DRL-based image segmentation method and show that the proposed new image segmentation method outperforms some existing image segmentation methods for quantitative analysis of GICS images.

[1]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Shiang-Bin Jong,et al.  Rapid and simple quantitative measurement of alpha-fetoprotein by combining immunochromatographic strip test and artificial neural network image analysis system. , 2004, Clinica chimica acta; international journal of clinical chemistry.

[3]  Chong Li.  Overview of Reinforcement Learning , 2019 .

[4]  David Silver,et al.  A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning , 2017, NIPS.

[5]  Di Zhao,et al.  Proportional–Integral Observer Design for Multidelayed Sensor-Saturated Recurrent Neural Networks: A Dynamic Event-Triggered Protocol , 2020, IEEE Transactions on Cybernetics.

[6]  Yurong Liu,et al.  Sampled‐data consensus of nonlinear multiagent systems subject to cyber attacks , 2018 .

[7]  Gregory T. A. Kovacs,et al.  Optical Scanner for Immunoassays With Up-Converting Phosphorescent Labels , 2008, IEEE Transactions on Biomedical Engineering.

[8]  Yurong Li,et al.  A Novel Image Methodology for Interpretation of Gold Immunochromatographic Strip , 2011, J. Comput..

[9]  Zidong Wang,et al.  Mixed $H_2/H_\infty$ State Estimation for Discrete-Time Switched Complex Networks With Random Coupling Strengths Through Redundant Channels , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Abhijit Gosavi,et al.  Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning , 2003 .

[11]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[12]  Marc Peter Deisenroth,et al.  Deep Reinforcement Learning: A Brief Survey , 2017, IEEE Signal Processing Magazine.

[13]  Xin Luo,et al.  Quantitative Analysis of Immunochromatographic Strip Based on Convolutional Neural Network , 2019, IEEE Access.

[14]  Fuad E. Alsaadi,et al.  Fusion estimation for multi-rate linear repetitive processes under weighted try-once-discard protocol , 2020, Inf. Fusion.

[15]  Yang Liu,et al.  Optimal Parameters Design of Oilfield Surface Pipeline Systems Using Fuzzy Models , 1999, Inf. Sci..

[16]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[18]  Zidong Wang,et al.  Image-Based Quantitative Analysis of Gold Immunochromatographic Strip via Cellular Neural Network Approach , 2014, IEEE Transactions on Medical Imaging.

[19]  P. Read Montague,et al.  Reinforcement Learning: An Introduction, by Sutton, R.S. and Barto, A.G. , 1999, Trends in Cognitive Sciences.

[20]  Shizhi Qian,et al.  A mathematical model of lateral flow bioreactions applied to sandwich assays. , 2003, Analytical biochemistry.

[21]  Zhidong Li,et al.  Multi-objective optimization of energy consumption in crude oil pipeline transportation system operation based on exergy loss analysis , 2019, Neurocomputing.

[22]  Zhiguo Shi,et al.  The optimization of path planning for multi-robot system using Boltzmann Policy based Q-learning algorithm , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[23]  Grish C Varshney,et al.  Immunochromatographic dipstick assay format using gold nanoparticles labeled protein-hapten conjugate for the detection of atrazine. , 2007, Environmental science & technology.

[24]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[25]  Bin Wang,et al.  Similarity based leaf image retrieval using multiscale R-angle description , 2016, Inf. Sci..

[26]  Jie Cao,et al.  Time Series Modeling of Nano-Gold Immunochromatographic Assay via Expectation Maximization Algorithm , 2013, IEEE Transactions on Biomedical Engineering.

[27]  Qing-Long Han,et al.  Moving Horizon Estimation of Networked Nonlinear Systems With Random Access Protocol , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  Junjie Wu,et al.  Towards information-theoretic K-means clustering for image indexing , 2013, Signal Process..

[29]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[30]  Yang Liu,et al.  Layout optimization of large-scale oil-gas gathering system based on combined optimization strategy , 2019, Neurocomputing.

[31]  T. P. Wright,et al.  Factors affecting the cost of airplanes , 1936 .

[32]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[33]  Dimitri P. Bertsekas,et al.  Feature-based aggregation and deep reinforcement learning: a survey and some new implementations , 2018, IEEE/CAA Journal of Automatica Sinica.

[34]  Liang Lin,et al.  Crafting a Toolchain for Image Restoration by Deep Reinforcement Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Kee-Eung Kim,et al.  An Improved Particle Filter With a Novel Hybrid Proposal Distribution for Quantitative Analysis of Gold Immunochromatographic Strips , 2019, IEEE Transactions on Nanotechnology.

[36]  Fuad E. Alsaadi,et al.  A Dynamic Event-Triggered Approach to H∞ Control for Discrete-Time Singularly Perturbed Systems With Time-Delays and Sensor Saturations , 2020 .

[37]  Kristen L. Helton,et al.  Microfluidic Overview of Global Health Issues Microfluidic Diagnostic Technologies for Global Public Health , 2006 .

[38]  Fuad E. Alsaadi,et al.  Deep Belief Networks for Quantitative Analysis of a Gold Immunochromatographic Strip , 2016, Cognitive Computation.

[39]  Makarov Ilya,et al.  Deep Reinforcement Learning in VizDoom First-Person Shooter for Health Gathering Scenario , 2019 .

[40]  Lei Zou,et al.  Moving Horizon Estimation for Networked Time-Delay Systems Under Round-Robin Protocol , 2019, IEEE Transactions on Automatic Control.

[41]  Changyin Sun,et al.  An adaptive strategy via reinforcement learning for the prisoner U+02BC s dilemma game , 2018, IEEE/CAA Journal of Automatica Sinica.

[42]  Antonio Liotta,et al.  On-Line Building Energy Optimization Using Deep Reinforcement Learning , 2017, IEEE Transactions on Smart Grid.

[43]  Lei Zou,et al.  Finite-horizon H∞ state estimation for artificial neural networks with component-based distributed delays and stochastic protocol , 2018, Neurocomputing.

[44]  Heriberto Cuayáhuitl,et al.  Deep reinforcement learning for conversational robots playing games , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).