A cascade-learning approach for automated segmentation of tumour epithelium in colorectal cancer

Abstract Automated segmentation of tumor epithelial tissue from histological images is a fundamental aspiration of digital pathology to improve biomarker assessment and tissue diagnosis. Accurate tumour segmentation is an important step in many automated digital image analysis applications to be used in clinical practice. In particular, segmentation of tumour, non-tumour epithelium and stromal tissue compartments on immunohistochemistry images presents a challenge. Many artifacts, such as staining and/or illumination variations, can confound image analysis. In this paper, we propose a cascade-learning approach which can diminish the impact of these artifacts. It consists of (a) a set of novel invariant features that encodes meaningful information about the appearance and shape of the region of interest and (b) a novel level set formulation where contour evolution is driven by a probabilistic model of the appearance of the region (based on fuzzy c-means). The merit of our approach is that it exploits both appearance and shape information and combines them in the tissue classification framework. We evaluate the performance of our approach on the segmentation of tumour epithelium in colorectal cancer. The experimental results show that our approach is robust to staining differences, additive noise, intensity inhomogeneities, and can cope with a limited number of training samples, when compared to the state-of-the-art tumour epithelial segmentation methods.

[1]  Xingquan Zhu,et al.  Class Noise vs. Attribute Noise: A Quantitative Study , 2003, Artificial Intelligence Review.

[2]  F. Marincola,et al.  Cancer classification using the Immunoscore: a worldwide task force , 2012, Journal of Translational Medicine.

[3]  Tolga Tasdizen,et al.  Isolation and two-step classification of normal white blood cells in peripheral blood smears , 2012, Journal of pathology informatics.

[4]  Z. Trajanoski,et al.  Integrative Analyses of Colorectal Cancer Show Immunoscore Is a Stronger Predictor of Patient Survival Than Microsatellite Instability. , 2016, Immunity.

[5]  Won-Ki Jeong,et al.  Interactive Histology of Large-Scale Biomedical Image Stacks , 2010, IEEE Transactions on Visualization and Computer Graphics.

[6]  Fabio A. González,et al.  Visual pattern mining in histology image collections using bag of features , 2011, Artif. Intell. Medicine.

[7]  Bahram Parvin,et al.  Classification of Tumor Histology via Morphometric Context , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Dirk R. Padfield,et al.  Color and texture based segmentation of molecular pathology images usING HSOMS , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[9]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[10]  Nasir M. Rajpoot,et al.  A Spatially Constrained Deep Learning Framework for Detection of Epithelial Tumor Nuclei in Cancer Histology Images , 2015, Patch-MI@MICCAI.

[11]  D. Crookes,et al.  Segmentation of Squamous Epithelium from Ultra-large Cervical Histological Virtual Slides , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Alexei Kouznetsov,et al.  Quantifying the architectural complexity of microscopic images of histology specimens. , 2009, Micron.

[13]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[14]  Bram van Ginneken,et al.  The importance of stain normalization in colorectal tissue classification with convolutional networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[15]  G. Dranoff,et al.  Cancer immunology—analysis of host and tumor factors for personalized medicine , 2011, Nature Reviews Clinical Oncology.

[16]  M. Eramian,et al.  Segmentation of epithelium in H&E stained odontogenic cysts , 2011, Journal of microscopy.

[17]  F. Marincola,et al.  Towards the introduction of the ‘Immunoscore’ in the classification of malignant tumours , 2013, The Journal of pathology.

[18]  Nasir M. Rajpoot,et al.  A novel texture descriptor for detection of glandular structures in colon histology images , 2015, Medical Imaging.

[19]  Francesco Bianconi,et al.  Multi-class texture analysis in colorectal cancer histology , 2016, Scientific Reports.

[20]  Doaa Mahmoud-Ghoneim Optimizing automated characterization of liver fibrosis histological images by investigating color spaces at different resolutions , 2011, Theoretical Biology and Medical Modelling.

[21]  Victor-Emil Neagoe,et al.  Concurrent self-organizing maps for pattern classification , 2002, Proceedings First IEEE International Conference on Cognitive Informatics.

[22]  Francesco Bianconi,et al.  Discrimination between tumour epithelium and stroma via perception-based features , 2015, Neurocomputing.

[23]  C. Chakraborty,et al.  Textural characterization of histopathological images for oral sub-mucous fibrosis detection. , 2011, Tissue & cell.

[24]  Bahram Parvin,et al.  When machine vision meets histology: A comparative evaluation of model architecture for classification of histology sections☆ , 2017, Medical Image Anal..

[25]  Bahram Parvin,et al.  Classification of Histology Sections via Multispectral Convolutional Sparse Coding , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[27]  Metin Nafi Gürcan,et al.  An efficient computational framework for the analysis of whole slide images: Application to follicular lymphoma immunohistochemistry , 2012, J. Comput. Sci..

[28]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[29]  Jyotirmoy Chatterjee,et al.  Automated oral cancer identification using histopathological images: a hybrid feature extraction paradigm. , 2012, Micron.

[30]  Anant Madabhushi,et al.  Cascaded discrimination of normal, abnormal, and confounder classes in histopathology: Gleason grading of prostate cancer , 2012, BMC Bioinformatics.

[31]  Bahram Parvin,et al.  Classification of tumor histopathology via sparse feature learning , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[32]  Fabio A. González,et al.  Content-based histopathology image retrieval using a kernel-based semantic annotation framework , 2011, J. Biomed. Informatics.

[33]  Lei Zhang,et al.  Active contours with selective local or global segmentation: A new formulation and level set method , 2010, Image Vis. Comput..

[34]  Mohammad Ilyas,et al.  Statistical colour models: an automated digital image analysis method for quantification of histological biomarkers , 2016, BioMedical Engineering OnLine.

[35]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[36]  T. Mattfeldt,et al.  MULTICLASS PATTERN RECOGNITION OF THE GLEASON SCORE OF PROSTATIC CARCINOMAS USING METHODS OF SPATIAL STATISTICS , 2013 .

[37]  Matti Pietikäinen,et al.  Identification of tumor epithelium and stroma in tissue microarrays using texture analysis , 2012, Diagnostic Pathology.

[38]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[39]  Bahram Parvin,et al.  Invariant Delineation of Nuclear Architecture in Glioblastoma Multiforme for Clinical and Molecular Association , 2013, IEEE Transactions on Medical Imaging.

[40]  Cenk Sokmensuer,et al.  A Resampling-Based Markovian Model for Automated Colon Cancer Diagnosis , 2012, IEEE Transactions on Biomedical Engineering.

[41]  Sotirios A. Tsaftaris,et al.  Active contour model driven by Globally Signed Region Pressure Force , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).