3D Convolutional Networks-Based Mitotic Event Detection in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations

In this paper, we propose a straightforward and effective method for mitotic event detection in time-lapse phase contrast microscopy image sequences of stem cell populations. Different from most of recent methods leveraging temporal modeling to learn the latent dynamics within one mitotic event, we mainly target on the data-driven spatio-temporal visual feature learning for mitotic event representation to bypass the difficulties in both robust hand-crafted feature designing and complicated temporal dynamic learning. Specially, we design the architecture of the convolutional neural networks with 3D filters to extract the holistic feature of the volumetric region where individual mitosis event occurs. Then, the extracted features can be directly feeded into the off-the-shelf classifiers for model learning or inference. Moreover, we prepare a novel and challenging dataset for mitosis detection. The comparison experiments demonstrate the superiority of the proposed method.

[1]  Takeo Kanade,et al.  Cell image analysis: Algorithms, system and applications , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[2]  Takeo Kanade,et al.  Mitosis sequence detection using hidden conditional random fields , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[3]  David A. Clausi,et al.  Automated Detection of Mitosis in Embryonic Tissues , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[4]  Stephen T. C. Wong,et al.  Mitosis cell identification with conditional random fields , 2007, 2007 IEEE/NIH Life Science Systems and Applications Workshop.

[5]  Takeo Kanade,et al.  Automated Mitosis Detection of Stem Cell Populations in Phase-Contrast Microscopy Images , 2011, IEEE Transactions on Medical Imaging.

[6]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[7]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Milan Sonka,et al.  Mitotic cell recognition with hidden Markov models , 2004, Medical Imaging: Image-Guided Procedures.

[10]  Takeo Kanade,et al.  A Semi-Markov Model for Mitosis Segmentation in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations , 2012, IEEE Transactions on Medical Imaging.

[11]  Yuting Su,et al.  Nonnegative Mixed-Norm Convex Optimization for Mitotic Cell Detection in Phase Contrast Microscopy , 2013, Comput. Math. Methods Medicine.

[12]  Yuting Su,et al.  Sparse coding induced transfer learning for HEp-2 cell classification. , 2014, Bio-medical materials and engineering.

[13]  Xiaobo Zhou,et al.  A Novel Cell Segmentation Method and Cell Phase Identification Using Markov Model , 2009, IEEE Transactions on Information Technology in Biomedicine.

[14]  Yuting Su,et al.  Sequential sparse representation for mitotic event recognition , 2013 .

[15]  Dai Fei Elmer Ker,et al.  Tracking of Hematopoietic Stem Cells in Microscopy Images for Lineage Determination , 2011 .

[16]  Takeo Kanade,et al.  Reliably Tracking Partially Overlapping Neural Stem Cells in DIC Microscopy Image Sequences , 2009 .

[17]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[18]  Mei Chen,et al.  Detection of mitosis within a stem cell population of high cell confluence in phase-contrast microscopy images , 2011, CVPR 2011.

[19]  O. Sertel,et al.  Computer-aided Prognosis of Neuroblastoma: Detection of mitosis and karyorrhexis cells in digitized histological images , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Yuting Su,et al.  HEp-2 cells Classification via clustered multi-task learning , 2016, Neurocomputing.

[21]  Takeo Kanade,et al.  Spatiotemporal mitosis event detection in time-lapse phase contrast microscopy image sequences , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[22]  Takeo Kanade,et al.  Cell population tracking and lineage construction with spatiotemporal context , 2008, Medical Image Anal..

[23]  Yuting Su,et al.  Cell type-independent mitosis event detection via hidden-state conditional neural fields , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).