Deep convolutional neural networks for automatic classification of gastric carcinoma using whole slide images in digital histopathology

Deep learning using convolutional neural networks is an actively emerging field in histological image analysis. This study explores deep learning methods for computer-aided classification in H&E stained histopathological whole slide images of gastric carcinoma. An introductory convolutional neural network architecture is proposed for two computerized applications, namely, cancer classification based on immunohistochemical response and necrosis detection based on the existence of tumor necrosis in the tissue. Classification performance of the developed deep learning approach is quantitatively compared with traditional image analysis methods in digital histopathology requiring prior computation of handcrafted features, such as statistical measures using gray level co-occurrence matrix, Gabor filter-bank responses, LBP histograms, gray histograms, HSV histograms and RGB histograms, followed by random forest machine learning. Additionally, the widely known AlexNet deep convolutional framework is comparatively analyzed for the corresponding classification problems. The proposed convolutional neural network architecture reports favorable results, with an overall classification accuracy of 0.6990 for cancer classification and 0.8144 for necrosis detection.

[1]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[2]  Paul Mills,et al.  Virtual Microscopy with Extended Depth of Field , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[3]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[4]  Joel H. Saltz,et al.  Efficient Multiple Instance Convolutional Neural Networks for Gigapixel Resolution Image Classification , 2015, ArXiv.

[5]  James Diamond,et al.  The use of morphological characteristics and texture analysis in the identification of tissue composition in prostatic neoplasia. , 2004, Human pathology.

[6]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[7]  Olaf Hellwich,et al.  Determining similarity in histological images using graph-theoretic description and matching methods for content-based image retrieval in medical diagnostics , 2012, Diagnostic Pathology.

[8]  Olaf Hellwich,et al.  A review of graph-based methods for image analysis in digital histopathology , 2015 .

[9]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[10]  Anant Madabhushi,et al.  AUTOMATED GRADING OF PROSTATE CANCER USING ARCHITECTURAL AND TEXTURAL IMAGE FEATURES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[11]  Olaf Hellwich,et al.  A Multi-resolution Approach for Combining Visual Information using Nuclei Segmentation and Classification in Histopathological Images , 2015, VISAPP.

[12]  Fabio A. González,et al.  Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks , 2014, Medical Imaging.

[13]  Lior Rokach,et al.  Ensemble-based classifiers , 2010, Artificial Intelligence Review.

[14]  Todd H. Stokes,et al.  Pathology imaging informatics for quantitative analysis of whole-slide images , 2013, Journal of the American Medical Informatics Association : JAMIA.

[15]  Olaf Hellwich,et al.  Cell nuclei attributed relational graphs for efficient representation and classification of gastric cancer in digital histopathology , 2016, SPIE Medical Imaging.

[16]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[17]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[18]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[19]  A M Zaitoun,et al.  Quantitative assessment of gastric atrophy using the syntactic structure analysis. , 1998, Journal of clinical pathology.

[20]  Geoffrey E. Hinton What kind of graphical model is the brain? , 2005, IJCAI.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[23]  Luca Fiaschi,et al.  Learning-based mitotic cell detection in histopathological images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[24]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[25]  Padraig Cunningham,et al.  Ensemble based system for whole-slide prostate cancer probability mapping using color texture features , 2011, Comput. Medical Imaging Graph..

[26]  Raouf N. G. Naguib,et al.  Colour texture analysis using co-occurrence matrices for classification of colon cancer images , 2002, IEEE CCECE2002. Canadian Conference on Electrical and Computer Engineering. Conference Proceedings (Cat. No.02CH37373).

[27]  Shin Shi,et al.  Emgu CV Essentials , 2013 .

[28]  Klaus Kofler,et al.  Performance and Scalability of GPU-Based Convolutional Neural Networks , 2010, 2010 18th Euromicro Conference on Parallel, Distributed and Network-based Processing.

[29]  Jun Kong,et al.  Computer-aided prognosis of neuroblastoma on whole-slide images: Classification of stromal development , 2009, Pattern Recognit..

[30]  Olaf Hellwich,et al.  Appearance-based necrosis detection using textural features and SVM with discriminative thresholding in histopathological whole slide images , 2015, 2015 IEEE 15th International Conference on Bioinformatics and Bioengineering (BIBE).

[31]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[32]  J. Tasic,et al.  Colour spaces: perceptual, historical and applicational background , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[33]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Matteo Fassan,et al.  Epidemiology of Gastric Cancer , 2015 .

[35]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[36]  Mark Li-cheng Wu,et al.  Automated virtual microscopy of gastric biopsies , 2006, Cytometry. Part B, Clinical cytometry.

[37]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[38]  A. Madabhushi,et al.  Detecting Prostatic Adenocarcinoma From Digitized Histology Using a Multi-Scale Hierarchical Classification Approach , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  Christian Borgelt,et al.  Introduction to Neural Networks , 2016 .

[40]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[41]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[42]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[43]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[44]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[45]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[46]  Peter Hufnagl,et al.  Reproducibility of Her2/neu scoring in gastric cancer and assessment of the 10% cut-off rule , 2014, Cancer medicine.

[47]  Li Deng,et al.  Three Classes of Deep Learning Architectures and Their Applications: A Tutorial Survey , 2012 .

[48]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[49]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[50]  Michael T. Lotze,et al.  Inflammation and necrosis promote tumour growth , 2004, Nature Reviews Immunology.

[51]  Bülent Yener,et al.  ECM-aware cell-graph mining for bone tissue modeling and classification , 2010, Data Mining and Knowledge Discovery.