Multi-stream Cell Segmentation with Low-level Cues for Multi-modality Images

Cell segmentation for multi-modal microscopy images remains a challenge due to the complex textures, patterns, and cell shapes in these images. To tackle the problem, we first develop an automatic cell classification pipeline to label the microscopy images based on their low-level image characteristics, and then train a classification model based on the category labels. Afterward, we train a separate segmentation model for each category using the images in the corresponding category. Besides, we further deploy two types of segmentation models to segment cells with roundish and irregular shapes respectively. Moreover, an efficient and powerful backbone model is utilized to enhance the efficiency of our segmentation model. Evaluated on the Tuning Set of NeurIPS 2022 Cell Segmentation Challenge, our method achieves an F1-score of 0.8795 and the running time for all cases is within the time tolerance.

[1]  Xiaoguang Han,et al.  Which Pixel to Annotate: A Label-Efficient Nuclei Segmentation Framework , 2022, IEEE Transactions on Medical Imaging.

[2]  Wendy J. Fantl,et al.  CellSeg: a robust, pre-trained nucleus segmentation and pixel quantification software for highly multiplexed fluorescence images , 2022, BMC Bioinformatics.

[3]  Trevor Darrell,et al.  A ConvNet for the 2020s , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Paul A. Wiggins,et al.  Omnipose: a high-precision morphology-independent solution for bacterial cell segmentation , 2021, bioRxiv.

[5]  Yizhou Yu,et al.  Semi-Supervised Medical Image Detection with Adaptive Consistency and Heterogeneous Perturbation , 2021, medRxiv.

[6]  Christoph Reich,et al.  Attention-Based Transformers for Instance Segmentation of Cells in Microstructures , 2020, 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[7]  André O. Françani,et al.  Multiclass Yeast Segmentation in Microstructured Environments with Deep Learning , 2020, 2020 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB).

[8]  Marius Pachitariu,et al.  Cellpose: a generalist algorithm for cellular segmentation , 2020, Nature Methods.

[9]  Xuantao Su,et al.  Deep Learning‐Based Single‐Cell Optical Image Studies , 2020, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[10]  Wolfgang Wiechert,et al.  Analyzing Microbial Population Heterogeneity-Expanding the Toolbox of Microfluidic Single-Cell Cultivations. , 2019, Journal of molecular biology.

[11]  Jin Tae Kwak,et al.  Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images , 2018, Medical Image Anal..

[12]  Laura J. Grundy,et al.  An open-source platform for analyzing and sharing worm-behavior data , 2018, bioRxiv.

[13]  Eugene W. Myers,et al.  Cell Detection with Star-convex Polygons , 2018, MICCAI.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Anne E Carpenter,et al.  Annotated high-throughput microscopy image sets for validation , 2012, Nature Methods.

[18]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Jagath C. Rajapakse,et al.  Segmentation of Clustered Nuclei With Shape Markers and Marking Function , 2009, IEEE Transactions on Biomedical Engineering.

[20]  Dong-Hyun Lee,et al.  Pseudo-Label : The Simple and Efficient Semi-Supervised Learning Method for Deep Neural Networks , 2013 .