Automatic Nuclei Segmentation in H&E Stained Breast Cancer Histopathology Images

The introduction of fast digital slide scanners that provide whole slide images has led to a revival of interest in image analysis applications in pathology. Segmentation of cells and nuclei is an important first step towards automatic analysis of digitized microscopy images. We therefore developed an automated nuclei segmentation method that works with hematoxylin and eosin (H&E) stained breast cancer histopathology images, which represent regions of whole digital slides. The procedure can be divided into four main steps: 1) pre-processing with color unmixing and morphological operators, 2) marker-controlled watershed segmentation at multiple scales and with different markers, 3) post-processing for rejection of false regions and 4) merging of the results from multiple scales. The procedure was developed on a set of 21 breast cancer cases (subset A) and tested on a separate validation set of 18 cases (subset B). The evaluation was done in terms of both detection accuracy (sensitivity and positive predictive value) and segmentation accuracy (Dice coefficient). The mean estimated sensitivity for subset A was 0.875 (±0.092) and for subset B 0.853 (±0.077). The mean estimated positive predictive value was 0.904 (±0.075) and 0.886 (±0.069) for subsets A and B, respectively. For both subsets, the distribution of the Dice coefficients had a high peak around 0.9, with the vast majority of segmentations having values larger than 0.8.

[1]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. , 2002, Histopathology.

[2]  P. V. van Diest,et al.  Systematic random sampling for selective interactive nuclear morphometry in breast cancer sections. Refinement and multiobserver evaluation. , 1993, Analytical and quantitative cytology and histology.

[3]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[4]  S. Pinder,et al.  Histological grading of breast carcinomas: a study of interobserver agreement. , 1995, Human pathology.

[5]  J J Vaquero,et al.  Applying watershed algorithms to the segmentation of clustered nuclei. , 1998, Cytometry.

[6]  J A Beliën,et al.  Origins of ... image analysis in clinical pathology. , 1997, Journal of clinical pathology.

[7]  J A Beliën,et al.  Counting mitoses by image processing in Feulgen stained breast cancer sections: the influence of resolution. , 1997, Cytometry.

[8]  Brian C. Lovell,et al.  Unsupervised cell nucleus segmentation with active contours , 1998, Signal Process..

[9]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[10]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  E. Dougherty,et al.  RNAi microarray analysis in cultured mammalian cells. , 2003, Genome research.

[12]  P. Diest,et al.  At convenience and systematic random sampling: effects on the prognostic value of nuclear area assessments in breast cancer patients , 2004, Breast Cancer Research and Treatment.

[13]  Yuval Garini,et al.  Spectral imaging: Principles and applications , 2006, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[14]  Xiaobo Zhou,et al.  Nuclei Segmentation Using Marker-Controlled Watershed, Tracking Using Mean-Shift, and Kalman Filter in Time-Lapse Microscopy , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[15]  Oliver Schmitt,et al.  Radial symmetries based decomposition of cell clusters in binary and gray level images , 2008, Pattern Recognit..

[16]  Yukako Yagi,et al.  The importance of optical optimization in whole slide imaging (WSI) and digital pathology imaging , 2008, Diagnostic pathology.

[17]  Peter Hufnagl,et al.  Image standards in Tissue-Based Diagnosis (Diagnostic Surgical Pathology) , 2008, Diagnostic pathology.

[18]  John Meyer,et al.  Grading nuclear pleomorphism on histological micrographs , 2008, 2008 19th International Conference on Pattern Recognition.

[19]  Klaus Kayser,et al.  How to measure image quality in tissue-based diagnosis (diagnostic surgical pathology) , 2008, Diagnostic pathology.

[20]  Gyan Bhanot,et al.  Expectation–Maximization-Driven Geodesic Active Contour With Overlap Resolution (EMaGACOR): Application to Lymphocyte Segmentation on Breast Cancer Histopathology , 2010, IEEE Transactions on Biomedical Engineering.

[21]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[22]  G. Kayser,et al.  Theory of sampling and its application in tissue based diagnosis , 2009, Diagnostic pathology.

[23]  Po-Whei Huang,et al.  Effective segmentation and classification for HCC biopsy images , 2010, Pattern Recognit..

[24]  Ali Khademhosseini,et al.  Constrained watershed method to infer morphology of mammalian cells in microscopic images , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[25]  Metin Nafi Gürcan,et al.  Computer-Aided Detection of Centroblasts for Follicular Lymphoma Grading Using Adaptive Likelihood-Based Cell Segmentation , 2010, IEEE Transactions on Biomedical Engineering.

[26]  Hui Kong,et al.  Partitioning Histopathological Images: An Integrated Framework for Supervised Color-Texture Segmentation and Cell Splitting , 2011, IEEE Transactions on Medical Imaging.

[27]  Krzysztof Borowiak,et al.  Proteomic patterns analysis with multivariate calculations as a promising tool for prompt differentiation of early stage lung tissue with cancer and unchanged tissue material , 2011, Diagnostic pathology.

[28]  Eduardo Romero,et al.  A supervised visual model for finding regions of interest in basal cell carcinoma images , 2011, Diagnostic pathology.

[29]  Max A. Viergever,et al.  Marker-controlled watershed segmentation of nuclei in H&E stained breast cancer biopsy images , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[30]  Eduardo Romero,et al.  Learning regions of interest from low level maps in virtual microscopy , 2011, Diagnostic pathology.

[31]  Myriam Oger,et al.  Towards a computer aided diagnosis system dedicated to virtual microscopy based on stereology sampling and diffusion maps , 2011, Diagnostic pathology.

[32]  Mitko Veta,et al.  Prognostic value of automatically extracted nuclear morphometric features in whole slide images of male breast cancer , 2012, Modern Pathology.

[33]  Daniel Heim,et al.  Detection and Segmentation of Cell Nuclei in Virtual Microscopy Images: A Minimum-Model Approach , 2012, Scientific Reports.

[34]  Anant Madabhushi,et al.  An Integrated Region-, Boundary-, Shape-Based Active Contour for Multiple Object Overlap Resolution in Histological Imagery , 2012, IEEE Transactions on Medical Imaging.

[35]  Nassir Navab,et al.  Automated malignancy detection in breast histopathological images , 2012, Medical Imaging.