Spatio-Temporal Mitosis Detection in Time-Lapse Phase-Contrast Microscopy Image Sequences: A Benchmark

In this paper, we report the results of the first international contest on mitosis detection in phase-contrast microscopy image sequences (https://www.iti-tju.org/mitosisdetection), which was held at the workshop of computer vision for microscopy image analysis (CVMI) in CVPR 2019. This contest aims to promote research on spatiotemporal mitosis detection under microscopy images. In this contest, we released a large-scale time-lapse phase-contrast microscopy image dataset (C2C12-16) for the mitosis detection task. Compared with the previous popular datasets (e.g., C2C12, C3H10), C2C12-16 contains more annotated mitotic events and more diverse cell culture environments. A total of ten different mitosis detection methods were submitted in the contest and evaluated on the test sets of four different cell culture environments in C2C12-16. In this benchmark, we describe all methods and conduct a thorough analysis based on their performances and discuss a feasible direction for mitosis detection. To the best of our knowledge, this is the first benchmark for the mitosis detection problem using a time-lapse phase-contrast microscopy spatiotemporal image sequence model.

[1]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[2]  Tammy Riklin-Raviv,et al.  Fully unsupervised symmetry-based mitosis detection in time-lapse cell microscopy , 2018, Bioinform..

[3]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[4]  Nassir Navab,et al.  AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[5]  Zhaozheng Yin,et al.  A Hierarchical Convolutional Neural Network for Mitosis Detection in Phase-Contrast Microscopy Images , 2016, MICCAI.

[6]  Lee E. Weiss,et al.  Phase contrast time-lapse microscopy datasets with automated and manual cell tracking annotations , 2018, Scientific Data.

[7]  Takeo Kanade,et al.  Computer vision tracking of stemness , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[8]  Zhaozheng Yin,et al.  Two-Stream Bidirectional Long Short-Term Memory for Mitosis Event Detection and Stage Localization in Phase-Contrast Microscopy Images , 2017, MICCAI.

[9]  Paul F. Whelan,et al.  A Novel Framework for Cellular Tracking and Mitosis Detection in Dense Phase Contrast Microscopy Images , 2013, IEEE Journal of Biomedical and Health Informatics.

[10]  Takeo Kanade,et al.  Automated Mitosis Detection of Stem Cell Populations in Phase-Contrast Microscopy Images , 2011, IEEE Transactions on Medical Imaging.

[11]  Luca Fiaschi,et al.  Learning-based mitotic cell detection in histopathological images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[12]  Sally Temple,et al.  LEVER: software tools for segmentation, tracking and lineaging of proliferating cells , 2016, Bioinform..

[13]  Luca Maria Gambardella,et al.  Assessment of algorithms for mitosis detection in breast cancer histopathology images , 2014, Medical Image Anal..

[14]  Mario Vento,et al.  Benchmarking HEp-2 Cells Classification Methods , 2013, IEEE Transactions on Medical Imaging.

[15]  Catarina Eloy,et al.  BACH: Grand Challenge on Breast Cancer Histology Images , 2018, Medical Image Anal..

[16]  Philippe Van Ham,et al.  Tracking of migrating cells under phase-contrast video microscopy with combined mean-shift processes , 2005, IEEE Transactions on Medical Imaging.

[17]  Nico Karssemeijer,et al.  Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks , 2018, IEEE Transactions on Medical Imaging.

[18]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Mei Chen,et al.  Detection of mitosis within a stem cell population of high cell confluence in phase-contrast microscopy images , 2011, CVPR 2011.

[20]  Takeo Kanade,et al.  Mitosis sequence detection using hidden conditional random fields , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[21]  Stephen T. C. Wong,et al.  Mitosis cell identification with conditional random fields , 2007, 2007 IEEE/NIH Life Science Systems and Applications Workshop.

[22]  Mei Chen,et al.  Spatiotemporal Joint Mitosis Detection Using CNN-LSTM Network in Time-Lapse Phase Contrast Microscopy Images , 2017, IEEE Access.

[23]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[24]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[25]  Wenhui Li,et al.  3D Convolutional Networks-Based Mitotic Event Detection in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[26]  M. Omair Ahmad,et al.  Tracking Biological Cells in Time-Lapse Microscopy: An Adaptive Technique Combining Motion and Topological Features , 2011, IEEE Transactions on Biomedical Engineering.

[27]  Chenchen Liu,et al.  Mitosis event recognition and detection based on evolution of feature in time domain , 2018, Machine Vision and Applications.

[28]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[29]  Jong Yih Kuo,et al.  An Improved Object Detection Method for Mitosis Detection , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Anne E. Carpenter,et al.  Symmetry-based mitosis detection in time-lapse microscopy , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[31]  Takeo Kanade,et al.  Cell image analysis: Algorithms, system and applications , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[32]  Jinhui Tang,et al.  Multi-Grained Random Fields for Mitosis Identification in Time-Lapse Phase Contrast Microscopy Image Sequences , 2017, IEEE Transactions on Medical Imaging.

[33]  Takeo Kanade,et al.  A Semi-Markov Model for Mitosis Segmentation in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations , 2012, IEEE Transactions on Medical Imaging.

[34]  Mei Chen,et al.  Sequential Saliency Guided Deep Neural Network for Joint Mitosis Identification and Localization in Time-Lapse Phase Contrast Microscopy Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[35]  Mei Chen,et al.  Mitosis Detection in Phase Contrast Microscopy Image Sequences of Stem Cell Populations: A Critical Review , 2017, IEEE Transactions on Big Data.