DeepDistance: A Multi-task Deep Regression Model for Cell Detection in Inverted Microscopy Images

This paper presents a new deep regression model, which we call DeepDistance, for cell detection in images acquired with inverted microscopy. This model considers cell detection as a task of finding most probable locations that suggest cell centers in an image. It represents this main task with a regression task of learning an inner distance metric. However, different than the previously reported regression based methods, the DeepDistance model proposes to approach its learning as a multi-task regression problem where multiple tasks are learned by using shared feature representations. To this end, it defines a secondary metric, normalized outer distance, to represent a different aspect of the problem and proposes to define its learning as complementary to the main cell detection task. In order to learn these two complementary tasks more effectively, the DeepDistance model designs a fully convolutional network (FCN) with a shared encoder path and end-to-end trains this FCN to concurrently learn the tasks in parallel. For further performance improvement on the main task, this paper also presents an extended version of the DeepDistance model that includes an auxiliary classification task and learns it in parallel to the two regression tasks by also sharing feature representations with them. DeepDistance uses the inner distances estimated by these FCNs in a detection algorithm to locate individual cells in a given image. In addition to this detection algorithm, this paper also suggests a cell segmentation algorithm that employs the estimated maps to find cell boundaries. Our experiments on three different human cell lines reveal that the proposed multi-task learning models, the DeepDistance model and its extended version, successfully identify the locations of cell as well as delineate their boundaries, even for the cell line that was not used in training, and improve the results of its counterparts.

[1]  Yaozong Gao,et al.  Learning Distance Transform for Boundary Detection and Deformable Segmentation in CT Prostate Images , 2014, MLMI.

[2]  Thomas Fevens,et al.  Nuclei Segmentation in Histopathological Images Using Two-Stage Learning , 2019, MICCAI.

[3]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[4]  Hao Chen,et al.  DCAN: Deep contour‐aware networks for object instance segmentation from histology images , 2017, Medical Image Anal..

[5]  Can Fahrettin Koyuncu,et al.  Object‐Oriented Segmentation of Cell Nuclei in Fluorescence Microscopy Images , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[6]  Ling Shao,et al.  Deep learning for automatic cell detection in wide-field microscopy zebrafish images , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[7]  Chanho Jung,et al.  Segmenting Clustered Nuclei Using H-minima Transform-Based Marker Extraction and Contour Parameterization , 2010, IEEE Transactions on Biomedical Engineering.

[8]  Min Bai,et al.  Deep Watershed Transform for Instance Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Xiaobo Zhou,et al.  Nuclei Segmentation Using Marker-Controlled Watershed, Tracking Using Mean-Shift, and Kalman Filter in Time-Lapse Microscopy , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[10]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[11]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[12]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[13]  Takeo Kanade,et al.  Cell segmentation in phase contrast microscopy images via semi-supervised classification over optics-related features , 2013, Medical Image Anal..

[14]  Mert R. Sabuncu,et al.  Joint Cell Nuclei Detection and Segmentation in Microscopy Images Using 3D Convolutional Networks , 2018, ArXiv.

[15]  Vincent Lepetit,et al.  You Should Use Regression to Detect Cells , 2015, MICCAI.

[16]  Selim Aksoy,et al.  Unsupervised segmentation and classification of cervical cell images , 2012, Pattern Recognit..

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Hai Su,et al.  Deep Voting: A Robust Approach Toward Nucleus Localization in Microscopy Images , 2015, MICCAI.

[19]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[20]  Hai Su,et al.  Efficient and robust cell detection: A structured regression approach , 2018, Medical Image Anal..

[21]  Andrew Zisserman,et al.  Microscopy cell counting and detection with fully convolutional regression networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[22]  Hai Su,et al.  Automatic Ki-67 Counting Using Robust Cell Detection and Online Dictionary Learning , 2014, IEEE Transactions on Biomedical Engineering.

[23]  John T Elliott,et al.  Comparison of segmentation algorithms for fluorescence microscopy images of cells , 2011, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[24]  Bai Ying Lei,et al.  Accurate Segmentation of Cervical Cytoplasm and Nuclei Based on Multiscale Convolutional Network and Graph Partitioning , 2015, IEEE Transactions on Biomedical Engineering.

[25]  Can Fahrettin Koyuncu,et al.  Iterative h‐minima‐based marker‐controlled watershed for cell nucleus segmentation , 2016, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[26]  Carolina Wählby,et al.  Automated Training of Deep Convolutional Neural Networks for Cell Segmentation , 2017, Scientific Reports.

[27]  Jie-Zhi Cheng,et al.  Accurate Cervical Cell Segmentation from Overlapping Clumps in Pap Smear Images , 2017, IEEE Transactions on Medical Imaging.

[28]  Bahram Parvin,et al.  Invariant Delineation of Nuclear Architecture in Glioblastoma Multiforme for Clinical and Molecular Association , 2013, IEEE Transactions on Medical Imaging.

[29]  Hai Su,et al.  Beyond Classification: Structured Regression for Robust Cell Detection Using Convolutional Neural Network , 2015, MICCAI.

[30]  Hai Su,et al.  Robust Cell Detection and Segmentation in Histopathological Images Using Sparse Reconstruction and Stacked Denoising Autoencoders , 2015, MICCAI.

[31]  David B. A. Epstein,et al.  Micro‐Net: A unified model for segmentation of various objects in microscopy images , 2018, Medical Image Anal..

[32]  Hao Chen,et al.  Automated mitosis detection with deep regression networks , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[33]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.