Nuclei R-CNN: Improve Mask R-CNN for Nuclei Segmentation

Accurate nuclei segmentation plays an essential role in medical research and various clinical applications. Recently, deep learning has demonstrated its superior performance on object segmentation in natural scene images. However, these methods cannot produce fine segmentation in histopathological images. Therefore, this paper improves Mask R-CNN for nuclei segmentation which is called Nuclei R-CNN, mainly focus on the network model, training scheme and the preprocess of histopathological data. Additionally, we found poor prediction accuracy under high-resolution histopathological images and proposed a simple Block-Merging method to deal with it. The quantitative assessment of Nuclei R-CNN has been based on challenging public dataset. Our experimental shows that Nuclei R-CNN outperforms existing methods for segmenting histopathological images.

[1]  Lin Yang,et al.  Robust Nucleus/Cell Detection and Segmentation in Digital Pathology and Microscopy Images: A Comprehensive Review , 2016, IEEE Reviews in Biomedical Engineering.

[2]  Thomas Walter,et al.  Nuclei segmentation in histopathology images using deep neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[3]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[4]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[5]  Robert F. Murphy,et al.  Nuclear segmentation in microscope cell images: A hand-segmented dataset and comparison of algorithms , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[6]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[9]  Prabir Bhattacharya,et al.  Segmentation of nuclei in digital pathology images , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[13]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Thomas Walter,et al.  Segmentation of Nuclei in Histopathology Images by Deep Regression of the Distance Map , 2019, IEEE Transactions on Medical Imaging.

[15]  Eugene W. Myers,et al.  Cell Detection with Star-convex Polygons , 2018, MICCAI.

[16]  Joel H. Saltz,et al.  Hierarchical nucleus segmentation in digital pathology images , 2016, SPIE Medical Imaging.

[17]  Hao Chen,et al.  DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Erik H. W. Meijering,et al.  Cell Segmentation: 50 Years Down the Road [Life Sciences] , 2012, IEEE Signal Processing Magazine.

[19]  Yongming Li,et al.  Automatic cell nuclei segmentation and classification of breast cancer histopathology images , 2016, Signal Process..

[20]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).