Microscopy cell nuclei segmentation with enhanced U-Net

Background Cell nuclei segmentation is a fundamental task in microscopy image analysis, based on which multiple biological related analysis can be performed. Although deep learning (DL) based techniques have achieved state-of-the-art performances in image segmentation tasks, these methods are usually complex and require support of powerful computing resources. In addition, it is impractical to allocate advanced computing resources to each dark- or bright-field microscopy, which is widely employed in vast clinical institutions, considering the cost of medical exams. Thus, it is essential to develop accurate DL based segmentation algorithms working with resources-constraint computing. Results An enhanced, light-weighted U-Net (called U-Net+) with modified encoded branch is proposed to potentially work with low-resources computing. Through strictly controlled experiments, the average IOU and precision of U-Net+ predictions are confirmed to outperform other prevalent competing methods with 1.0 % to 3.0 % gain on the first stage test set of 2018 Kaggle Data Science Bowl cell nuclei segmentation contest with shorter inference time. Conclusions Our results preliminarily demonstrate the potential of proposed U-Net+ in correctly spotting microscopy cell nuclei with resources-constraint computing.

[1]  Ling Liu,et al.  A Comparative Measurement Study of Deep Learning as a Service Framework , 2018, IEEE Transactions on Services Computing.

[2]  Ying Liu,et al.  Acute Lymphoblastic Leukemia Cells Image Analysis with Deep Bagging Ensemble Learning , 2019 .

[3]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[4]  Vijay S. Pande,et al.  Using Deep Learning for Segmentation and Counting within Microscopy Data , 2018, ArXiv.

[5]  Anne E Carpenter,et al.  Evaluation of Deep Learning Strategies for Nucleus Segmentation in Fluorescence Images , 2018, bioRxiv.

[6]  Trevor Darrell,et al.  Deep Layer Aggregation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[8]  A. Chambolle Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[9]  Fabian J. Theis,et al.  Evaluation of Deep Learning Strategies for Nucleus Segmentation in Fluorescence Images , 2019, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[10]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[11]  Zachary C. Lipton,et al.  Troubling Trends in Machine Learning Scholarship , 2018, ACM Queue.

[12]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[13]  Romuere Rôdrigues Veloso e Silva,et al.  Deep learning for cell image segmentation and ranking , 2019, Comput. Medical Imaging Graph..

[14]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[15]  Hye-Jin Kim,et al.  Deep-learning-based label-free segmentation of cell nuclei in time-lapse refractive index tomograms , 2018, bioRxiv.

[16]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Aaron Carass,et al.  Why rankings of biomedical image analysis competitions should be interpreted with care , 2018, Nature Communications.

[19]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[20]  Benjamin Kesler,et al.  Automated cell boundary and 3D nuclear segmentation of cells in suspension , 2019 .

[21]  Sheng Yang Michael Loh,et al.  Large‐scale image‐based screening and profiling of cellular phenotypes , 2017, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[22]  Lassi Paavolainen,et al.  A deep learning framework for nucleus segmentation using image style transfer , 2019, bioRxiv.

[23]  Suk-Hwan Lee,et al.  Blood Cell Images Segmentation using Deep Learning Semantic Segmentation , 2018, 2018 IEEE International Conference on Electronics and Communication Engineering (ICECE).

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Alain Trémeau,et al.  Residual Conv-Deconv Grid Network for Semantic Segmentation , 2017, BMVC.

[26]  Yanzhao Wu,et al.  Benchmarking Deep Learning Frameworks: Design Considerations, Metrics and Beyond , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[27]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[28]  Klaus H. Maier-Hein,et al.  nnU-Net: Breaking the Spell on Successful Medical Image Segmentation , 2019, ArXiv.