A new optical density granulometry-based descriptor for the classification of prostate histological images using shallow and deep Gaussian processes

BACKGROUND AND OBJECTIVE Prostate cancer is one of the most common male tumors. The increasing use of whole slide digital scanners has led to an enormous interest in the application of machine learning techniques to histopathological image classification. Here we introduce a novel family of morphological descriptors which, extracted in the appropriate image space and combined with shallow and deep Gaussian process based classifiers, improves early prostate cancer diagnosis. METHOD We decompose the acquired RGB image in its RGB and optical density hematoxylin and eosin components. Then, we define two novel granulometry-based descriptors which work in both, RGB and optical density, spaces but perform better when used on the latter. In this space they clearly encapsulate knowledge used by pathologists to identify cancer lesions. The obtained features become the inputs to shallow and deep Gaussian process classifiers which achieve an accurate prediction of cancer. RESULTS We have used a real and unique dataset. The dataset is composed of 60 Whole Slide Images. For a five fold cross validation, shallow and deep Gaussian Processes obtain area under ROC curve values higher than 0.98. They outperform current state of the art patch based shallow classifiers and are very competitive to the best performing deep learning method. Models were also compared on 17 Whole Slide test Images using the FROC curve. With the cost of one false positive, the best performing method, the one layer Gaussian process, identifies 83.87% (sensitivity) of all annotated cancer in the Whole Slide Image. This result corroborates the quality of the extracted features, no more than a layer is needed to achieve excellent generalization results. CONCLUSION Two new descriptors to extract morphological features from histological images have been proposed. They collect very relevant information for cancer detection. From these descriptors, shallow and deep Gaussian Processes are capable of extracting the complex structure of prostate histological images. The new space/descriptor/classifier paradigm outperforms state-of-art shallow classifiers. Furthermore, despite being much simpler, it is competitive to state-of-art CNN architectures both on the proposed SICAPv1 database and on an external database.

[1]  D. Gleason,et al.  Histologic grading of prostate cancer: a perspective. , 1992, Human pathology.

[2]  Arnav Bhavsar,et al.  Breast Cancer Histopathological Image Classification: Is Magnification Important? , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Anindya Sarkar,et al.  Prostate Cancer Grading: Use of Graph Cut and Spatial Arrangement of Nuclei , 2014, IEEE Transactions on Medical Imaging.

[4]  Michalis K. Titsias,et al.  Variational Learning of Inducing Variables in Sparse Gaussian Processes , 2009, AISTATS.

[5]  M. Usman Akram,et al.  Automatic gleason grading of prostate cancer using Gabor filter and local binary patterns , 2017, 2017 40th International Conference on Telecommunications and Signal Processing (TSP).

[6]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[7]  Neil D. Lawrence,et al.  Deep Gaussian Processes , 2012, AISTATS.

[8]  Carl E. Rasmussen,et al.  Understanding Probabilistic Sparse Gaussian Process Approximations , 2016, NIPS.

[9]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[10]  Melih Kandemir,et al.  Empowering Multiple Instance Histopathology Cancer Diagnosis by Cell Graphs , 2014, MICCAI.

[11]  Scotty Kwok,et al.  Multiclass Classification of Breast Cancer in Whole-Slide Images , 2018, ICIAR.

[12]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[13]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[14]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Ismaël Koné,et al.  Hierarchical ResNeXt Models for Breast Cancer Histology Image Classification , 2018, ICIAR.

[16]  Thomas J. Fuchs,et al.  Terabyte-scale Deep Multiple Instance Learning for Classification and Localization in Pathology , 2018, ArXiv.

[17]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Daisuke Komura,et al.  Machine Learning Methods for Histopathological Image Analysis , 2017, Computational and structural biotechnology journal.

[19]  Wenyuan Li,et al.  Path R-CNN for Prostate Cancer Diagnosis and Gleason Grading of Histological Images , 2019, IEEE Transactions on Medical Imaging.

[20]  A. Enis Çetin,et al.  Classification of Hematoxylin and Eosin Images Using Local Binary Patterns and 1-D SIFT Algorithm , 2017, IWCIM@EUSIPCO.

[21]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[22]  T. Hermanns,et al.  Automated Gleason grading of prostate cancer tissue microarrays via deep learning , 2018, Scientific Reports.

[23]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[24]  Kashif Rajpoot,et al.  SVM Optimization for Hyperspectral Colon Tissue Cell Classification , 2004, MICCAI.

[25]  Matti Pietikäinen,et al.  Computer Vision Using Local Binary Patterns , 2011, Computational Imaging and Vision.

[26]  Arkadiusz Gertych,et al.  Machine learning approaches to analyze histological images of tissues from radical prostatectomies , 2015, Comput. Medical Imaging Graph..

[27]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Ron Kikinis,et al.  Large scale digital prostate pathology image analysis combining feature extraction and deep neural network , 2017, ArXiv.

[29]  Arkadiusz Gertych,et al.  Semantic segmentation for prostate cancer grading by convolutional neural networks , 2018, Medical Imaging.

[30]  Aaron Fenster,et al.  Prostate Histopathology: Learning Tissue Component Histograms for Cancer Detection and Classification , 2013, IEEE Transactions on Medical Imaging.

[31]  Hamid R. Tizhoosh,et al.  A comparative study of CNN, BoVW and LBP for classification of histopathological images , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[32]  Karen E. Burtt,et al.  Computer Aided-Diagnosis of Prostate Cancer on Multiparametric MRI: A Technical Review of Current Research , 2014, BioMed research international.

[33]  Cecilia M. Lindgren,et al.  Towards Deep Cellular Phenotyping in Placental Histology , 2018, ArXiv.

[34]  Kaisa Liimatainen,et al.  Metastasis detection from whole slide images using local features and random forests , 2017, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[35]  Egor Krivov,et al.  Ensembling Neural Networks for Digital Pathology Images Classification and Segmentation , 2018, ICIAR.

[36]  R. Kumar,et al.  Detection and Classification of Cancer from Microscopic Biopsy Images Using Clinically Significant and Biologically Interpretable Features , 2015, Journal of medical engineering.

[37]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[38]  Anant Madabhushi,et al.  AUTOMATED GRADING OF PROSTATE CANCER USING ARCHITECTURAL AND TEXTURAL IMAGE FEATURES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[39]  Shyam Lal,et al.  A study about color normalization methods for histopathology images. , 2018, Micron.

[40]  Melih Kandemir,et al.  Asymmetric Transfer Learning with Deep Gaussian Processes , 2015, ICML.

[41]  Rajesh Mehra,et al.  Breast cancer histology images classification: Training from scratch or transfer learning? , 2018, ICT Express.

[42]  Bahram Marami,et al.  Ensemble Network for Region Identification in Breast Histopathology Slides , 2018, ICIAR.

[43]  Marc Peter Deisenroth,et al.  Doubly Stochastic Variational Inference for Deep Gaussian Processes , 2017, NIPS.

[44]  Jin Tae Kwak,et al.  Multiview boosting digital pathology analysis of prostate cancer , 2017, Comput. Methods Programs Biomed..

[45]  Xin Qi,et al.  Computer aided analysis of prostate histopathology images to support a refined Gleason grading system , 2017, Medical Imaging.