Unsupervised morphological segmentation of tissue compartments in histopathological images

Algorithmic segmentation of histologically relevant regions of tissues in digitized histopathological images is a critical step towards computer-assisted diagnosis and analysis. For example, automatic identification of epithelial and stromal tissues in images is important for spatial localisation and guidance in the analysis and characterisation of tumour micro-environment. Current segmentation approaches are based on supervised methods, which require extensive training data from high quality, manually annotated images. This is often difficult and costly to obtain. This paper presents an alternative data-independent framework based on unsupervised segmentation of oropharyngeal cancer tissue micro-arrays (TMAs). An automated segmentation algorithm based on mathematical morphology is first applied to light microscopy images stained with haematoxylin and eosin. This partitions the image into multiple binary ‘virtual-cells’, each enclosing a potential ‘nucleus’ (dark basins in the haematoxylin absorbance image). Colour and morphology measurements obtained from these virtual-cells as well as their enclosed nuclei are input into an advanced unsupervised learning model for the identification of epithelium and stromal tissues. Here we exploit two Consensus Clustering (CC) algorithms for the unsupervised recognition of tissue compartments, that consider the consensual opinion of a group of individual clustering algorithms. Unlike most unsupervised segmentation analyses, which depend on a single clustering method, the CC learning models allow for more robust and stable detection of tissue regions. The proposed framework performance has been evaluated on fifty-five hand-annotated tissue images of oropharyngeal tissues. Qualitative and quantitative results of the proposed segmentation algorithm compare favourably with eight popular tissue segmentation strategies. Furthermore, the unsupervised results obtained here outperform those obtained with individual clustering algorithms.

[1]  Ching-Wei Wang Robust Automated Tumour Segmentation on Histological and Immunohistochemical Tissue Images , 2011, PloS one.

[2]  Antony Galton,et al.  Unsupervised Superpixel-Based Segmentation of Histopathological Images with Consensus Clustering , 2017, MIUA.

[3]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[4]  Jan Kybic,et al.  jSLIC : superpixels in ImageJ , 2014 .

[5]  Mutlu Mete,et al.  PARAMETER-FREE MULTI-LEVEL FUZZY C-MEANS CLUSTERING FOR UNSUPERVISED STRUCTURE DETECTION IN HISTOLOGICAL IMAGES , 2010 .

[6]  Sandro Vega-Pons,et al.  A Survey of Clustering Ensemble Algorithms , 2011, Int. J. Pattern Recognit. Artif. Intell..

[7]  Mao-Jiun J. Wang,et al.  Image thresholding by minimizing the measures of fuzzines , 1995, Pattern Recognit..

[8]  Anna Choromanska,et al.  Online Clustering with Experts , 2012, AISTATS.

[9]  Jonathan M. Garibaldi,et al.  An Investigation into the use of Fuzzy C-Means Clustering of Fourier Transform Infrared Microscopic Data for the Automation of Breast Cancer Grading , 2009 .

[10]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[11]  Frank Y. Shih,et al.  Automatic seeded region growing for color image segmentation , 2005, Image Vis. Comput..

[12]  Dirk R. Padfield,et al.  Color and texture based segmentation of molecular pathology images usING HSOMS , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Xiaoli Z. Fern,et al.  Cluster Ensemble Selection , 2008, Statistical analysis and data mining.

[14]  Ludmila I. Kuncheva,et al.  Moderate diversity for better cluster ensembles , 2006, Inf. Fusion.

[15]  Yue Zhang,et al.  Segmentation of lumen and outer wall of abdominal aortic aneurysms from 3D black‐blood MRI with a registration based geodesic active contour model , 2017, Medical Image Anal..

[16]  Pau-Choo Chung,et al.  A Fast Algorithm for Multilevel Thresholding , 2001, J. Inf. Sci. Eng..

[17]  Gabriel Landini,et al.  Morphologic characterization of cell neighborhoods in neoplastic and preneoplastic epithelium. , 2010, Analytical and quantitative cytology and histology.

[18]  Xiaobo Zhou,et al.  A Novel Cell Segmentation Method and Cell Phase Identification Using Markov Model , 2009, IEEE Transactions on Information Technology in Biomedicine.

[19]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Adrian E. Raftery,et al.  How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis , 1998, Comput. J..

[21]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[22]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[23]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[24]  Antony Galton,et al.  Morphological Separation of Clustered Nuclei in Histological Images , 2016, ICIAR.

[25]  Ana L. N. Fred,et al.  Combining multiple clusterings using evidence accumulation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  G. LANDINI,et al.  Automatic thresholding from the gradients of region boundaries , 2016, Journal of microscopy.

[27]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[28]  Ws. Rasband ImageJ, U.S. National Institutes of Health, Bethesda, Maryland, USA , 2011 .

[29]  Cenk Sokmensuer,et al.  Automatic segmentation of colon glands using object-graphs , 2010, Medical Image Anal..

[30]  Nasir M. Rajpoot,et al.  RanPEC: Random Projections with Ensemble Clustering for Segmentation of Tumor Areas in Breast Histol , 2012 .

[31]  Jun Kong,et al.  Integrated morphologic analysis for the identification and characterization of disease subtypes , 2012, J. Am. Medical Informatics Assoc..

[32]  Matti Pietikäinen,et al.  Identification of tumor epithelium and stroma in tissue microarrays using texture analysis , 2012, Diagnostic Pathology.

[33]  Michel Herbin,et al.  A 'no-threshold' histogram-based image segmentation method , 2002, Pattern Recognit..

[34]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[35]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[36]  D. Defays,et al.  An Efficient Algorithm for a Complete Link Method , 1977, Comput. J..

[37]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[38]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[39]  Serge Beucher,et al.  Watershed, Hierarchical Segmentation and Waterfall Algorithm , 1994, ISMM.

[40]  L. Hubert,et al.  Comparing partitions , 1985 .

[41]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[42]  Gabriel Landini,et al.  Architectural analysis of oral cancer, dysplastic, and normal epithelia , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[43]  Serge Beucher,et al.  Use of watersheds in contour detection , 1979 .

[44]  Vipin Chaudhary,et al.  Automated segmentation of stromal tissue in histology images using a voting Bayesian model , 2013, Signal Image Video Process..

[45]  A. Seewald,et al.  Quantitative Image Analysis of Epithelial and Stromal Area in Histological Sections of Colorectal Cancer: An Emerging Diagnostic Tool , 2015, BioMed research international.

[46]  Ana L. N. Fred,et al.  Analysis of consensus partition in cluster ensemble , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[47]  N. Otsu A threshold selection method from gray level histograms , 1979 .