Separating Touching Cells Using Pixel Replicated Elliptical Shape Models

One of the most important and error-prone tasks in biological image analysis is the segmentation of touching or overlapping cells. Particularly for optical microscopy, including transmitted light and confocal fluorescence microscopy, there is often no consistent discriminative information to separate cells that touch or overlap. It is desired to partition touching foreground pixels into cells using the binary threshold image information only, and optionally incorporating gradient information. The most common approaches for segmenting touching and overlapping cells in these scenarios are based on the watershed transform. We describe a new approach called pixel replication for the task of segmenting elliptical objects that touch or overlap. Pixel replication uses the image Euclidean distance transform in combination with Gaussian mixture models to better exploit practically effective optimization for delineating objects with elliptical decision boundaries. Pixel replication improves significantly on commonly used methods based on watershed transforms, or based on fitting Gaussian mixtures directly to the thresholded image data. Pixel replication works equivalently on both 2-D and 3-D image data, and naturally combines information from multi-channel images. The accuracy of the proposed technique is measured using both the segmentation accuracy on simulated ellipse data and the tracking accuracy on validated stem cell tracking results extracted from hundreds of live-cell microscopy image sequences. Pixel replication is shown to be significantly more accurate compared with other approaches. Variance relationships are derived, allowing a more practically effective Gaussian mixture model to extract cell boundaries for data generated from the threshold image using the uniform elliptical distribution and from the distance transform image using the triangular elliptical distribution.

[1]  Sally Temple,et al.  LEVER: software tools for segmentation, tracking and lineaging of proliferating cells , 2016, Bioinform..

[2]  Sally Temple,et al.  Non-monotonic Changes in Progenitor Cell Behavior and Gene Expression during Aging of the Adult V-SVZ Neural Stem Cell Niche , 2017, Stem cell reports.

[3]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[4]  Serge Beucher,et al.  Watershed, Hierarchical Segmentation and Waterfall Algorithm , 1994, ISMM.

[5]  A survey on continuous elliptical vector distributions , 2003 .

[6]  Xiaobo Zhou,et al.  Automatic Segmentation of High-Throughput RNAi Fluorescent Cellular Images , 2008, IEEE Transactions on Information Technology in Biomedicine.

[7]  Andrew R. Cohen,et al.  Computational prediction of neural progenitor cell fates , 2010, Nature Methods.

[8]  Bahram Parvin,et al.  3D Segmentation of Mammospheres for Localization Studies , 2006, ISVC.

[9]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[10]  Andrew R. Cohen,et al.  Vertebrate neural stem cell segmentation, tracking and lineaging with validation and editing , 2011, Nature Protocols.

[11]  Qing Yang,et al.  CHEF: convex hull of elliptic features for 3D blob detection , 2002, Object recognition supported by user interaction for service robots.

[12]  Bahram Parvin,et al.  Integrated profiling of three dimensional cell culture models and 3D microscopy , 2013, Bioinform..

[13]  Andrew R. Cohen Extracting meaning from biological imaging data , 2014, Molecular biology of the cell.

[14]  Atsushi Miyawaki,et al.  Visualizing Spatiotemporal Dynamics of Multicellular Cell-Cycle Progression , 2008, Cell.

[15]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[16]  Cheng Fang,et al.  Axonal transport analysis using Multitemporal Association Tracking , 2012, Int. J. Comput. Biol. Drug Des..

[17]  Yue Wang,et al.  Visualization and correction of automated segmentation, tracking and lineaging from 5-D stem cell image sequences , 2014, BMC Bioinformatics.

[18]  Badrinath Roysam,et al.  A hybrid 3D watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks , 2003, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[19]  Yingbo Li,et al.  Detection and tracking of overlapping cell nuclei for large scale mitosis analyses , 2016, BMC Bioinformatics.

[20]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[21]  Carlos Ortiz-de-Solorzano,et al.  Segmentation of Touching Cell Nuclei Using a Two-Stage Graph Cut Model , 2009, SCIA.

[22]  Mark R. Winter,et al.  Computational Image Analysis Reveals Intrinsic Multigenerational Differences between Anterior and Posterior Cerebral Cortex Neural Progenitor Cells , 2015, Stem Cell Reports.

[23]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Shaoqun Zeng,et al.  Large-scale localization of touching somas from 3D images using density-peak clustering , 2016, BMC Bioinformatics.

[25]  Ullrich Köthe,et al.  Graphical model for joint segmentation and tracking of multiple dividing cells , 2015, Bioinform..

[26]  Adele P. Peskin,et al.  Survey statistics of automated segmentations applied to optical imaging of mammalian cells , 2015, BMC Bioinformatics.

[27]  Sheldon M. Ross,et al.  Introduction to Probability Models (4th ed.). , 1990 .

[28]  Lin Yang,et al.  Robust Segmentation of Overlapping Cells in Histopathology Specimens Using Parallel Seed Detection and Repulsive Level Set , 2012, IEEE Transactions on Biomedical Engineering.

[29]  O. Cohen-Fix,et al.  Sizing up the nucleus: nuclear shape, size and nuclear-envelope assembly , 2009, Journal of Cell Science.

[30]  Hugo Proença,et al.  Detection and separation of overlapping cells based on contour concavity for Leishmania images , 2014, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[31]  Jagath C. Rajapakse,et al.  Segmentation of Clustered Nuclei With Shape Markers and Marking Function , 2009, IEEE Transactions on Biomedical Engineering.

[32]  Philipp J. Keller,et al.  Fast, accurate reconstruction of cell lineages from large-scale fluorescence microscopy data , 2014, Nature Methods.

[33]  Sally Temple,et al.  Measuring Process Dynamics and Nuclear Migration for Clones of Neural Progenitor Cells , 2016, ECCV Workshops.

[34]  Sally Temple,et al.  Automatic Summarization of Changes in Biological Image Sequences Using Algorithmic Information Theory , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  William A. Harris Faculty Opinions recommendation of Computational prediction of neural progenitor cell fates. , 2010 .

[36]  Xiaobo Zhou,et al.  Nuclei Segmentation Using Marker-Controlled Watershed, Tracking Using Mean-Shift, and Kalman Filter in Time-Lapse Microscopy , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.