Optimizing Contextual Feature Learning for Mitosis Detection with Convolutional Recurrent Neural Networks

Automatic detection of mitosis in cell videos is essential for research in many fields including stem cell biology and pharmacology. Current state-of-the-art graph-based and deep learning models for mitosis detection rely on candidate sequence extraction that locates the mitotic events at the center of the input frame for optimal contextual feature learning. We propose a method to detect mitosis, by extending convolutional long short-term memory (LSTM) neural networks to remove the candidate sequence extraction step. Our method maintains a high detection accuracy by using the entire video frames as the input, instead of small crops from the original frames and this, acts to preserve the complete contextual features of mitotic events. We evaluated our method on a dataset of stem cell phase-contrast microscopy videos. Under conditions of a temporal tolerance of 1 and 3 frames, our method achieved a detection F1-score of 0.880 and 0.911, which outperformed state-of-the-art benchmark methods by approximately 0.15 in F1-score.

[1]  Takeo Kanade,et al.  Mitosis sequence detection using hidden conditional random fields , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[2]  David Dagan Feng,et al.  An Ensemble of Fine-Tuned Convolutional Neural Networks for Medical Image Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[3]  Christophe Trefois,et al.  Light microscopy applications in systems biology: opportunities and challenges , 2013, Cell Communication and Signaling.

[4]  Zhaozheng Yin,et al.  Two-Stream Bidirectional Long Short-Term Memory for Mitosis Event Detection and Stage Localization in Phase-Contrast Microscopy Images , 2017, MICCAI.

[5]  Mei Chen,et al.  Detection of mitosis within a stem cell population of high cell confluence in phase-contrast microscopy images , 2011, CVPR 2011.

[6]  Mei Chen,et al.  Spatiotemporal Joint Mitosis Detection Using CNN-LSTM Network in Time-Lapse Phase Contrast Microscopy Images , 2017, IEEE Access.

[7]  Zhaozheng Yin,et al.  A Hierarchical Convolutional Neural Network for Mitosis Detection in Phase-Contrast Microscopy Images , 2016, MICCAI.

[8]  Mei Chen,et al.  Mitosis Detection in Phase Contrast Microscopy Image Sequences of Stem Cell Populations: A Critical Review , 2017, IEEE Transactions on Big Data.

[9]  Wenhui Li,et al.  3D Convolutional Networks-Based Mitotic Event Detection in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[10]  Nathalie Harder,et al.  An Objective Comparison of Cell Tracking Algorithms , 2017, Nature Methods.

[11]  Takeo Kanade,et al.  Automated Mitosis Detection of Stem Cell Populations in Phase-Contrast Microscopy Images , 2011, IEEE Transactions on Medical Imaging.

[12]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.