Multi-class texture analysis in colorectal cancer histology

Automatic recognition of different tissue types in histological images is an essential part in the digital pathology toolbox. Texture analysis is commonly used to address this problem; mainly in the context of estimating the tumour/stroma ratio on histological samples. However, although histological images typically contain more than two tissue types, only few studies have addressed the multi-class problem. For colorectal cancer, one of the most prevalent tumour types, there are in fact no published results on multiclass texture separation. In this paper we present a new dataset of 5,000 histological images of human colorectal cancer including eight different types of tissue. We used this set to assess the classification performance of a wide range of texture descriptors and classifiers. As a result, we found an optimal classification strategy that markedly outperformed traditional methods, improving the state of the art for tumour-stroma separation from 96.9% to 98.6% accuracy and setting a new standard for multiclass tissue separation (87.4% accuracy for eight classes). We make our dataset of histological images publicly available under a Creative Commons license and encourage other researchers to use it as a benchmark for their studies.

[1]  Francesco Bianconi,et al.  Discrimination between tumour epithelium and stroma via perception-based features , 2015, Neurocomputing.

[2]  W. E. Mesker,et al.  Prognostic significance of the tumor-stroma ratio: validation study in node-negative premenopausal breast cancer patients from the EORTC perioperative chemotherapy (POP) trial (10854) , 2013, Breast Cancer Research and Treatment.

[3]  M. R. Turner,et al.  Texture discrimination by Gabor functions , 1986, Biological Cybernetics.

[4]  Seiichi Serikawa,et al.  Texture databases - A comprehensive survey , 2013, Pattern Recognit. Lett..

[5]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[6]  Jürgen Beyerer,et al.  Machine Vision: Automated Visual Inspection: Theory, Practice and Applications , 2015 .

[7]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[8]  Jakob Nikolas Kather,et al.  Continuous representation of tumor microvessel density and detection of angiogenic hotspots in histological whole-slide images , 2015, Oncotarget.

[9]  George Lee,et al.  Feature Importance in Nonlinear Embeddings (FINE): Applications in Digital Pathology , 2016, IEEE Transactions on Medical Imaging.

[10]  J Kulka,et al.  The prognostic significance of tumour–stroma ratio in oestrogen receptor-positive breast cancer , 2014, British Journal of Cancer.

[11]  Matti Pietikäinen,et al.  Computer Vision Using Local Binary Patterns , 2011, Computational Imaging and Vision.

[12]  Jakob Nikolas Kather,et al.  New Colors for Histology: Optimized Bivariate Color Maps Increase Perceptual Contrast in Histological Images , 2015, PloS one.

[13]  Du-Ming Tsai,et al.  Optimal Gabor filter design for texture segmentation using stochastic optimization , 2001, Image Vis. Comput..

[14]  B F Warren,et al.  The proportion of tumor-stroma as a strong prognosticator for stage II and III colon cancer patients: validation in the VICTOR trial. , 2013, Annals of oncology : official journal of the European Society for Medical Oncology.

[15]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[16]  Lin Yang,et al.  Virtual Microscopy and Grid-Enabled Decision Support for Large-Scale Analysis of Imaged Pathology Specimens , 2009, IEEE Transactions on Information Technology in Biomedicine.

[17]  Aul,et al.  MULTICLASS PATTERN RECOGNITION OF THE GLEASON SCORE OF PROSTATIC CARCINOMAS USING METHODS OF SPATIAL STATISTICS , 2013 .

[18]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[19]  Houqiang Liu,et al.  Tumor-Stroma Ratio Is an Independent Predictor for Survival in Esophageal Squamous Cell Carcinoma , 2012, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[20]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  J. Epstein An update of the Gleason grading system. , 2010, The Journal of urology.

[22]  Taghi M. Khoshgoftaar,et al.  RUSBoost: Improving classification performance when training data is skewed , 2008, 2008 19th International Conference on Pattern Recognition.

[23]  Horst Bunke,et al.  The IAM-database: an English sentence database for offline handwriting recognition , 2002, International Journal on Document Analysis and Recognition.

[24]  L R Schad,et al.  The use of reticulated foam in texture test objects for magnetic resonance imaging. , 1998, Magnetic resonance imaging.

[25]  P. Caie,et al.  Quantification of tumour budding, lymphatic vessel density and invasion through image analysis in colorectal cancer , 2014, Journal of Translational Medicine.

[26]  Matti Pietikäinen,et al.  Rotation Invariant Image Description with Local Binary Pattern Histogram Fourier Features , 2009, SCIA.

[27]  Francisco Herrera,et al.  Prototype Selection for Nearest Neighbor Classification: Taxonomy and Empirical Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Xin Huang,et al.  Quantitative histology analysis of the ovarian tumour microenvironment , 2015, Scientific Reports.

[29]  Krista A. Ehinger,et al.  SUN database: Large-scale scene recognition from abbey to zoo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Matti Pietikäinen,et al.  Identification of tumor epithelium and stroma in tissue microarrays using texture analysis , 2012, Diagnostic Pathology.

[31]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[32]  F. Markowetz,et al.  Quantitative Image Analysis of Cellular Heterogeneity in Breast Tumors Complements Genomic Profiling , 2012, Science Translational Medicine.

[33]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[34]  Anant Madabhushi,et al.  Cascaded discrimination of normal, abnormal, and confounder classes in histopathology: Gleason grading of prostate cancer , 2012, BMC Bioinformatics.

[35]  Frank G Zöllner,et al.  Support vector machines in DSC‐based glioma imaging: Suggestions for optimal characterization , 2010, Magnetic resonance in medicine.

[36]  Frank G Zöllner,et al.  SVM-based glioma grading: Optimization by feature reduction analysis. , 2012, Zeitschrift fur medizinische Physik.

[37]  W. J. Lorenz,et al.  Magnetic Resonance Imaging of Intracranial Tumors: Tissue Characterization by Means of Texture Analysis , 1992 .

[38]  Francesco Bianconi,et al.  Rotation invariant co-occurrence features based on digital circles and discrete Fourier transform , 2014, Pattern Recognit. Lett..

[39]  Z. Werb,et al.  Tumors as organs: complex tissues that interface with the entire organism. , 2010, Developmental cell.

[40]  Yan Wang,et al.  Tumor-stroma ratio is an independent predictor for survival in early cervical carcinoma. , 2014, Gynecologic oncology.

[41]  Francesco Bianconi,et al.  An appendix to "Texture databases - A comprehensive survey" , 2014, Pattern Recognit. Lett..

[42]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[43]  Po-Whei Huang,et al.  Automatic Classification for Pathological Prostate Images Based on Fractal Analysis , 2009, IEEE Transactions on Medical Imaging.

[44]  K. Alitalo,et al.  Assessment of tumour viability in human lung cancer xenografts with texture-based image analysis , 2015, Journal of Clinical Pathology.

[45]  Lakhmi C. Jain,et al.  Local Binary Patterns: New Variants and Applications , 2013, Local Binary Patterns.

[46]  Sergio Escalera,et al.  On the Decoding Process in Ternary Error-Correcting Output Codes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  T. Mattfeldt,et al.  MULTICLASS PATTERN RECOGNITION OF THE GLEASON SCORE OF PROSTATIC CARCINOMAS USING METHODS OF SPATIAL STATISTICS , 2013 .

[48]  Adrien Depeursinge,et al.  Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles , 2016, Medical Image Anal..

[49]  Marinette Revenu,et al.  Wavelet-based multiscale texture segmentation: Application to stromal compartment characterization on virtual slides , 2010, Signal Process..