Region-based progressive localization of cell nuclei in microscopic images with data adaptive modeling

BackgroundSegmenting cell nuclei in microscopic images has become one of the most important routines in modern biological applications. With the vast amount of data, automatic localization, i.e. detection and segmentation, of cell nuclei is highly desirable compared to time-consuming manual processes. However, automated segmentation is challenging due to large intensity inhomogeneities in the cell nuclei and the background.ResultsWe present a new method for automated progressive localization of cell nuclei using data-adaptive models that can better handle the inhomogeneity problem. We perform localization in a three-stage approach: first identify all interest regions with contrast-enhanced salient region detection, then process the clusters to identify true cell nuclei with probability estimation via feature-distance profiles of reference regions, and finally refine the contours of detected regions with regional contrast-based graphical model. The proposed region-based progressive localization (RPL) method is evaluated on three different datasets, with the first two containing grayscale images, and the third one comprising of color images with cytoplasm in addition to cell nuclei. We demonstrate performance improvement over the state-of-the-art. For example, compared to the second best approach, on the first dataset, our method achieves 2.8 and 3.7 reduction in Hausdorff distance and false negatives; on the second dataset that has larger intensity inhomogeneity, our method achieves 5% increase in Dice coefficient and Rand index; on the third dataset, our method achieves 4% increase in object-level accuracy.ConclusionsTo tackle the intensity inhomogeneities in cell nuclei and background, a region-based progressive localization method is proposed for cell nuclei localization in fluorescence microscopy images. The RPL method is demonstrated highly effective on three different public datasets, with on average 3.5% and 7% improvement of region- and contour-based segmentation performance over the state-of-the-art.

[1]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[2]  Haibin Ling,et al.  Diffusion Distance for Histogram Comparison , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Hubert Cardot,et al.  Cooperation of color pixel classification schemes and color watershed: a study for microscopic images , 2002, IEEE Trans. Image Process..

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Karl Rohr,et al.  Fast Globally Optimal Segmentation of Cells in Fluorescence Microscopy Images , 2011, MICCAI.

[6]  David Dagan Feng,et al.  A Multistage Discriminative Model for Tumor and Lymph Node Detection in Thoracic Images , 2012, IEEE Transactions on Medical Imaging.

[7]  Vincent Lepetit,et al.  General constraints for batch Multiple-Target Tracking applied to large-scale videomicroscopy , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Fredrik Georgsson,et al.  Image Processing Assisted Algorithms for Optical Projection Tomography , 2012, IEEE Transactions on Medical Imaging.

[9]  Ullrich Köthe,et al.  Learning to segment dense cell nuclei with shape prior , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Hui Kong,et al.  Partitioning Histopathological Images: An Integrated Framework for Supervised Color-Texture Segmentation and Cell Splitting , 2011, IEEE Transactions on Medical Imaging.

[11]  Hanchuan Peng,et al.  Bioimage informatics: a new area of engineering biology , 2008, Bioinform..

[12]  Yoonsuck Choe,et al.  Cell tracking and segmentation in electron microscopy images using graph cuts , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[14]  Eugene W. Myers,et al.  AUTOMATIC SEGMENTATION OF NUCLEI IN 3D MICROSCOPY IMAGES OF C.ELEGANS , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[15]  Jo A. Helmuth,et al.  Shape reconstruction of subcellular structures from live cell fluorescence microscopy images. , 2009, Journal of structural biology.

[16]  Polina Golland,et al.  Morphology-Guided Graph Search for Untangling Objects: C. elegans Analysis , 2010, MICCAI.

[17]  Takeo Kanade,et al.  Understanding the phase contrast optics to restore artifact-free microscopy images for segmentation , 2012, Medical Image Anal..

[18]  Kishore Mosaliganti,et al.  Detection of Spatially Correlated Objects in 3D Images Using Appearance Models and Coupled Active Contours , 2009, MICCAI.

[19]  Heng Huang,et al.  Object localization in medical images based on graphical model with contrast and interest-region terms , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[20]  Ana Maria Mendonça,et al.  Cell Nuclei and Cytoplasm Joint Segmentation Using the Sliding Band Filter , 2010, IEEE Transactions on Medical Imaging.

[21]  Robert F. Murphy,et al.  Nuclear segmentation in microscope cell images: A hand-segmented dataset and comparison of algorithms , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[22]  Erik H. W. Meijering,et al.  Cell Segmentation: 50 Years Down the Road [Life Sciences] , 2012, IEEE Signal Processing Magazine.

[23]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[24]  Li Cheng,et al.  Discriminative Segmentation of Microscopic Cellular Images , 2011, MICCAI.

[25]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Takeo Kanade,et al.  Cell segmentation in microscopy imagery using a bag of local Bayesian classifiers , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[27]  Ivo F. Sbalzarini,et al.  Discrete Region Competition for Unknown Numbers of Connected Regions , 2012, IEEE Transactions on Image Processing.

[28]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[29]  Anant Madabhushi,et al.  Image segmentation with implicit color standardization using cascaded EM: Detection of myelodysplastic syndromes , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[30]  Ivo F. Sbalzarini,et al.  Deconvolving Active Contours for Fluorescence Microscopy Images , 2009, ISVC.

[31]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[32]  Wiro J. Niessen,et al.  Advanced Level-Set-Based Cell Tracking in Time-Lapse Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[33]  Xiaobo Zhou,et al.  Multiple Nuclei Tracking Using Integer Programming for Quantitative Cancer Cell Cycle Analysis , 2010, IEEE Transactions on Medical Imaging.

[34]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[35]  David Dagan Feng,et al.  Microscopic Image Segmentation with Two-Level Enhancement of Feature Discriminability , 2012, 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA).

[36]  Bahram Parvin,et al.  Batch-invariant nuclear segmentation in whole mount histology sections , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[37]  Xiao Liu,et al.  Simultaneous recognition and segmentation of cells: application in C.elegans , 2011, Bioinform..

[38]  Takeo Kanade,et al.  Automated Mitosis Detection of Stem Cell Populations in Phase-Contrast Microscopy Images , 2011, IEEE Transactions on Medical Imaging.

[39]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[40]  Peter Meer,et al.  Unsupervised segmentation based on robust estimation and color active contour models , 2005, IEEE Transactions on Information Technology in Biomedicine.

[41]  Karl Rohr,et al.  Efficient globally optimal segmentation of cells in fluorescence microscopy images using level sets and convex energy functionals , 2012, Medical Image Anal..

[42]  Javier Bernal,et al.  Evaluation of Segmentation Algorithms on Cell Populations Using CDF Curves , 2012, IEEE Transactions on Medical Imaging.

[43]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[44]  Richard I. Hartley,et al.  A new approach for spot detection in total internal reflection fluorescence microscopy , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[45]  Polina Golland,et al.  Resolving clustered worms via probabilistic shape models , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[46]  Anant Madabhushi,et al.  An Integrated Region-, Boundary-, Shape-Based Active Contour for Multiple Object Overlap Resolution in Histological Imagery , 2012, IEEE Transactions on Medical Imaging.

[47]  Bahram Parvin,et al.  Graphical methods for quantifying macromolecules through bright field imaging , 2009, Bioinform..

[48]  Mei Chen,et al.  Cell nuclei segmentation in fluorescence microscopy images using inter- and intra-region discriminative information , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[49]  Gustavo K. Rohde,et al.  A template matching approach for segmenting microscopy images , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[50]  Xiaobo Zhou,et al.  Automatic Segmentation of High-Throughput RNAi Fluorescent Cellular Images , 2008, IEEE Transactions on Information Technology in Biomedicine.

[51]  Takeo Kanade,et al.  Nonnegative Mixed-Norm Preconditioning for Microscopy Image Segmentation , 2009, IPMI.

[52]  Stella X. Yu,et al.  Pop out many small structures from a very large microscopic image , 2011, Medical Image Anal..

[53]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.