CNN-based two-stage cell segmentation improves plant cell tracking

Abstract Automated tracking of densely packed plant cells in time-lapse live imaging datasets is a challenging task. A local graph matching algorithm was proposed to track such cells by exploiting the tight spatial topology of neighboring cells. However, it is not easy to segment the plant cells in noisy region by the existing cell segmentation approaches, and false cell segmentation will cause serious errors in subsequent tracking procedure. In this letter, we present to segment plant cells via a CNN-based two-stage segmentation approach. In the first stage, the cells are preliminarily segmented by the existing plant cell segmentation methods such as the watershed algorithm. In the second stage, a fine CNN-based discrimination model retains the segmented cell candidates with clear boundaries in the original noisy cell images. With the CNN-based two-stage cell segmentation method, an accurate cell segmentation result is obtained as the input of the next tracking procedure. The experimental results demonstrate that our proposed segmentation approach achieves great segmentation performance for various plant cell datasets. Moreover, the proposed segmentation method is combined with three existing plant cell tracking algorithms, to demonstrate that the CNN-Based two-stage segmentation approach is very generic and greatly improves the plant cell tracking accuracy.

[1]  Hong Liu,et al.  A Skeleton Pruning Approach Using Contour Length as the Significance Measure , 2008, 2008 Third International Conference on Pervasive Computing and Applications.

[2]  Joakim Jalden,et al.  Global Linking of Cell Tracks Using the Viterbi Algorithm , 2015, IEEE Transactions on Medical Imaging.

[3]  Jiwen Lu,et al.  Deep Hashing for Scalable Image Search , 2017, IEEE Transactions on Image Processing.

[4]  Andrew Zisserman,et al.  Learning to Detect Cells Using Non-overlapping Extremal Regions , 2012, MICCAI.

[5]  Amit K. Roy-Chowdhury,et al.  Efficient cell segmentation and tracking of developing plant meristem , 2011, 2011 18th IEEE International Conference on Image Processing.

[6]  Jinhui Tang,et al.  Multi-Grained Random Fields for Mitosis Identification in Time-Lapse Phase Contrast Microscopy Image Sequences , 2017, IEEE Transactions on Medical Imaging.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Jiwen Lu,et al.  Deep Metric Learning for Visual Understanding: An Overview of Recent Advances , 2017, IEEE Signal Processing Magazine.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Aidil Azwin Zainul Abidin,et al.  Image processing of an agriculture produce: Determination of size and ripeness of a banana , 2008, 2008 International Symposium on Information Technology.

[11]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Min Liu,et al.  DeepSeed Local Graph Matching for Densely Packed Cells Tracking , 2021, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[13]  Min Liu,et al.  Cell Tracking Across Noisy Image Sequences Via Faster R-CNN and Dynamic Local Graph Matching , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[14]  Min Liu,et al.  A multi-seed dynamic local graph matching model for tracking of densely packed cells across unregistered microscopy image sequences , 2018, Machine Vision and Applications.

[15]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face and Kinship Verification , 2017, IEEE Transactions on Image Processing.

[16]  Jiwen Lu,et al.  Learning Compact Binary Descriptors with Unsupervised Deep Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Anirban Chakraborty,et al.  Adaptive cell segmentation and tracking for volumetric confocal microscopy images of a developing plant meristem. , 2011, Molecular plant.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Hanchuan Peng,et al.  A Multiscale Ray-Shooting Model for Termination Detection of Tree-Like Structures in Biomedical Images , 2019, IEEE Transactions on Medical Imaging.