Semi-supervised nuclei segmentation based on multi-edge features fusion attention network

The morphology of the nuclei represents most of the clinical pathological information, and nuclei segmentation is a vital step in current automated histopathological image analysis. Supervised machine learning-based segmentation models have already achieved outstanding performance with sufficiently precise human annotations. Nevertheless, outlining such labels on numerous nuclei is extremely professional needing and time consuming. Automatic nuclei segmentation with minimal manual interventions is highly needed to promote the effectiveness of clinical pathological researches. Semi-supervised learning greatly reduces the dependence on labeled samples while ensuring sufficient accuracy. In this paper, we propose a Multi-Edge Feature Fusion Attention Network (MEFFA-Net) with three feature inputs including image, pseudo-mask and edge, which enhances its learning ability by considering multiple features. Only a few labeled nuclei boundaries are used to train annotations on the remaining mostly unlabeled data. The MEFFA-Net creates more precise boundary masks for nucleus segmentation based on pseudo-masks, which greatly reduces the dependence on manual labeling. The MEFFA-Block focuses on the nuclei outline and selects features conducive to segment, making full use of the multiple features in segmentation. Experimental results on public multi-organ databases including MoNuSeg, CPM-17 and CoNSeP show that the proposed model has the mean IoU segmentation evaluations of 0.706, 0.751, and 0.722, respectively. The model also achieves better results than some cutting-edge methods while the labeling work is reduced to 1/8 of common supervised strategies. Our method provides a more efficient and accurate basis for nuclei segmentations and further quantifications in pathological researches.

[1]  Lirong Yin,et al.  Iterative reconstruction of low-dose CT based on differential sparse , 2023, Biomed. Signal Process. Control..

[2]  Bin Li,et al.  DCGNN: a single-stage 3D object detection network based on density clustering and graph neural network , 2022, Complex & Intelligent Systems.

[3]  Jing Zhong,et al.  Nuclei segmentation of HE stained histopathological images based on feature global delivery connection network , 2022, PloS one.

[4]  Xiaomei Qin,et al.  Improved Image Fusion Method Based on Sparse Decomposition , 2022, Electronics.

[5]  Lei Wu,et al.  Meta multi-task nuclei segmentation with fewer training samples , 2022, Medical Image Anal..

[6]  Syeda Shamaila Zareen,et al.  SVseg: Stacked Sparse Autoencoder-Based Patch Classification Modeling for Vertebrae Segmentation , 2022, Mathematics.

[7]  Jing Zhong,et al.  Segmentation of HE-stained meningioma pathological images based on pseudo-labels , 2022, PloS one.

[8]  Wengang Zhou,et al.  ATSO: Asynchronous Teacher-Student Optimization for Semi-Supervised Image Segmentation , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  M. Cui,et al.  Artificial intelligence and computational pathology , 2021, Laboratory Investigation.

[10]  Abdesslam Benzinou,et al.  Automatic Human Dendritic Cells Segmentation Using K-Means Clustering and Chan-Vese Active Contour Model , 2020, Comput. Methods Programs Biomed..

[11]  Hao Chen,et al.  A Multi-Organ Nucleus Segmentation Challenge , 2020, IEEE Transactions on Medical Imaging.

[12]  A. Sufian,et al.  Evolution of Image Segmentation using Deep Convolutional Neural Network: A Survey , 2020, Knowl. Based Syst..

[13]  Hao Lu,et al.  Deep Segmentation-Emendation Model for Gland Instance Segmentation , 2019, MICCAI.

[14]  Sanja Fidler,et al.  Gated-SCNN: Gated Shape CNNs for Semantic Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Dimitris N. Metaxas,et al.  Attentive neural cell instance segmentation , 2019, Medical Image Anal..

[16]  F. Jug,et al.  Cell segmentation methods for label-free contrast microscopy: review and comprehensive comparison , 2019, BMC Bioinformatics.

[17]  Ling Shao,et al.  Collaborative Learning of Semi-Supervised Segmentation and Classification for Medical Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Jin Tae Kwak,et al.  Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images , 2018, Medical Image Anal..

[19]  Joel H. Saltz,et al.  Methods for Segmentation and Classification of Digital Microscopy Tissue Images , 2018, Front. Bioeng. Biotechnol..

[20]  Richard J. Chen,et al.  Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images , 2018, IEEE Transactions on Medical Imaging.

[21]  Gang Yu,et al.  BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation , 2018, ECCV.

[22]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[23]  Vijayan K. Asari,et al.  Nuclei Segmentation with Recurrent Residual Convolutional Neural Networks based U-Net (R2U-Net) , 2018, NAECON 2018 - IEEE National Aerospace and Electronics Conference.

[24]  Piotr Bilinski,et al.  Dense Decoder Shortcut Connections for Single-Pass Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Pengfei Xiong,et al.  Pyramid Attention Network for Semantic Segmentation , 2018, BMVC.

[26]  Berkman Sahiner,et al.  Creating synthetic digital slides using conditional generative adversarial networks: application to Ki67 staining , 2018, Medical Imaging.

[27]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[28]  Chandan Chakraborty,et al.  Her2Net: A Deep Framework for Semantic Segmentation and Classification of Cell Membranes and Nuclei in Breast Cancer Evaluation , 2018, IEEE Transactions on Image Processing.

[29]  Ye Wang,et al.  Semantic Segmentation with Reverse Attention , 2017, BMVC.

[30]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[31]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[32]  Shuiwang Ji,et al.  Residual Deconvolutional Networks for Brain Electron Microscopy Image Segmentation , 2017, IEEE Transactions on Medical Imaging.

[33]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[34]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[35]  ZhenZhou Wang,et al.  A New Approach for Segmentation and Quantification of Cells or Nanoparticles , 2016, IEEE Transactions on Industrial Informatics.

[36]  Hao Chen,et al.  Deep Contextual Networks for Neuronal Structure Segmentation , 2016, AAAI.

[37]  Lin Yang,et al.  An Automatic Learning-Based Framework for Robust Nucleus Segmentation , 2016, IEEE Transactions on Medical Imaging.

[38]  Andrew G. Clark,et al.  Modes of cancer cell invasion and the role of the microenvironment. , 2015, Current opinion in cell biology.

[39]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[40]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Alan Wee-Chung Liew,et al.  An integration strategy based on fuzzy clustering and level set method for cell image segmentation , 2013, 2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013).

[42]  Jinping Fan,et al.  Automated cervical cell image segmentation using level set based active contour model , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[43]  Milind M. Mushrif,et al.  HISTOPATHOLOGICAL IMAGE ANALYSIS USING IMAGE PROCESSING TECHNIQUES : AN OVERVIEW , 2012 .

[44]  Qiang Zuo,et al.  R2AU-Net: Attention Recurrent Residual Convolutional Neural Network for Multimodal Medical Image Segmentation , 2021, Secur. Commun. Networks.

[45]  Oscal T.-C. Chen,et al.  Image Segmentation Method Using Thresholds Automatically Determined from Picture Contents , 2009, EURASIP J. Image Video Process..