Trend Training Based RNN for Human Induced Pluripotent Stem Cell Reprogramming Prediction Using Time-Lapse Microscopy Images

Recurrent Neural Network (RNN) operates on sequential data using a recurrent hidden state dependent on previous data. Even proved successful in many fields, RNNs suffer from vanishing and exploding gradient problems. Gating approach of LSTM and GRU solves these problems but lose prediction accuracies if short-term changes occur in time-lapse microscopy images taken in cell culture. This study uses trend training (feed forward and pre-training) based RNN to improve the prediction accuracy for human iPS cell reprogramming and formation in future culture. The feed forward RNN uses the prediction of each time-step in the next recursive batch training for the next prediction recursively to give recurrent RNN internal states approaching optimal. Pre-training gives optimal initial RNN parameters selected from RNN models pre-trained by sets of time-lapse images taken from a completed cell culture process. An example shows the predicted accuracies and iPS cell colony shapes by feed forward RNN are apparently better than those without the feed forward training, the accuracies and iPS cell colony shapes furthermore applying the pre-trained models are better than only using the feed forward training. Thirty experimental results show the proposed method achieved 0.752 (SD 0.137) accuracy in future 72 time-steps (1.5 days).

[1]  Koji Zettsu,et al.  Dynamically pre-trained deep recurrent neural networks using environmental monitoring data for predicting PM2.5 , 2015, Neural Computing and Applications.

[2]  Hideo Yokota,et al.  HUMAN INDUCED PLURIPOTENT STEM CELL REGION DETECTION IN BRIGHT-FIELD MICROSCOPY IMAGES USING CONVOLUTIONAL NEURAL NETWORKS , 2019, Biomedical Engineering: Applications, Basis and Communications.

[3]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[4]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[5]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[6]  Otmar Hilliges,et al.  Learning Human Motion Models for Long-Term Predictions , 2017, 2017 International Conference on 3D Vision (3DV).

[7]  Yoko Yasuda,et al.  Computational image analysis of colony and nuclear morphology to evaluate human induced pluripotent stem cells , 2014, Scientific Reports.

[8]  Duc Duong,et al.  A New Model for Stock Price Movements Prediction Using Deep Neural Network , 2017, SoICT.

[9]  I. Fuentes,et al.  Generation and characterization of human induced pluripotent stem cells (iPSCs) from hand osteoarthritis patient-derived fibroblasts , 2020, Scientific Reports.

[10]  Li Li,et al.  Using LSTM and GRU neural network methods for traffic flow prediction , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Hideo Yokota,et al.  Human Induced Pluripotent Stem Cell Reprogramming Prediction in Microscopy Images using LSTM based RNN , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).